数据融合中的MD5/SHA字段数据集

Question

I need to concatanate a few string values in order to obtain the SHA256 encrypted string. I've seen Data Fusion has a plugin to do the job:

The documentation however is very poor and nothing I've tried seems to work. I created a table in BQ with the string fields I need to concatanate but the output is same as input. Can anyone provide with an example on how to use this plugin?

EDIT

Below I present the example,

This is how the workflow looks like:

For the testing purposes, I added one column with the following string:

2022-01-01T00:00:00+01:00

And here's the output:

Answer 1

You can use Wrangler to concatenate the string values.

I tried your scenario adding Wrangler to the Pipeline:

Joining 2 Columns:

I named the column new_col , using , as delimiter:

Output:

Answer 2

What you described can be achieved by 2 Wranglers:

1. The first Wrangler will be what @angela-b described. Use the merge directive to create a new column with the concatenation of two columns. Example directive that joins column a and b using , as the delimiter and stores the result in column a_b :

merge a b a_b ,

2. The second Wrangler will use the hash directive which will hash the column in place using a specified algorithm. Example of a directive that hashes column a_b using MD5:

hash :a_b 'MD5' true

Remember to set the last parameter encode to true so that you get a string output instead of a byte array.