简体   繁体   English

Informatica 并行作业在 Teradata 上创建 mload 问题

[英]Informatica parallel jobs creating mload issue on Teradata

In the ETL there are 2 parallel jobs and those 2 jobs run start and finish almost at the same time.在 ETL 中有 2 个并行作业,这 2 个作业几乎同时开始和结束。 After they are finished they will update few details to a same look up table.完成后,他们会将一些细节更新到同一个查找表。 Both the parallel jobs are taking the same amount of time to finish.两个并行作业都需要相同的时间来完成。 If both the jobs are started at the same time then the jobs are creating a mlock on the look up table and both the jobs are failing.如果两个作业同时启动,则这些作业正在查找表上创建一个 mlock,并且这两个作业都失败了。 Tried releasing mlock and running them again.尝试释放 mlock 并再次运行它们。 But that is still going into mlock again.但这仍然会再次进入 mlock。 So added a wait time of 20 secs before the 1st parallel job.因此在第一个并行作业之前添加了 20 秒的等待时间。 Then both the parallel jobs finished with any issue and updated the required details to the look up table.然后,两个并行作业都完成了任何问题,并将所需的详细信息更新到查找表。

Adding a wait time is not an ideal solution in this use case, because later on few parallel jobs needs to added (somewhere around 20-30).在此用例中添加等待时间并不是一个理想的解决方案,因为稍后需要添加少量并行作业(大约 20-30 左右)。 If wait steps were to be added before each parallel job, then the time increases drastically.如果要在每个并行作业之前添加等待步骤,则时间会急剧增加。 Because for the 2nd job 20 sec, 3rd job 40 sec, so on.. This will be a large number by the time 20th job is reached.因为对于第 2 个作业 20 秒,第 3 个作业 40 秒,依此类推.. 到第 20 个作业时,这将是一个很大的数字。

So looking for an alternative solution rather than adding a wait step before each job to avoid the MLock issue?那么寻找替代解决方案而不是在每个作业之前添加等待步骤以避免 MLock 问题?

Be sure each job has its own distinct log, work, and error table names.确保每个作业都有自己不同的日志、工作和错误表名称。 If multiple jobs that potentially try to run in parallel use the same names (eg the default generated names), you are more likely to run into issues.如果可能尝试并行运行的多个作业使用相同的名称(例如默认生成的名称),您更有可能遇到问题。

But if the update is only for a "few details" then MLOAD is the wrong tool.但如果更新只是为了“一些细节”,那么 MLOAD 是错误的工具。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM