How to select Master and Detail for Joiner Transformation containing large records in IICS?

Question

I am using Informatica Intelligent Cloud Services ( IICS ) Intelligent Structure model to parse the JSON file that I have.The file is located on S3 bucket,and it contains 3 groups. 2 Groups contains lots of records (~100,000) and 3rd group contains (~10,000 records). According to Intelligent structure model, largest group contains PK, which I can use to join the other group, but the issue is for Master and Detail which group should I select ? Usually, group with lower records should be selected but in my case, lower records contains foreign key ? Is there a work around for this issue ?

I am new to IICS so how to resolve the issue ? Any help will be appreciated. Thanks in advance!

Answer 1

Rule is, select table with samll rowcount should be master because during execution, the master source is cached into the memory for joining purpose.

Having said that, can you use 3rd group with less rows as master for both joins like below. If its normal join, logic remains same but perf will improve if you choose master with less rows and less granularity.

Sq_gr1(d)\
Sq_gr3-jnr1(m)->|jnr2----->
Sq_gr2(d)------>/

Outer join will take time equivalent to count of rows.