简体繁体 English

WSO2 ESB正在处理大文件，然后停止并重新启动？

[英]WSO2 ESB processing a large file, stopping and restarting?

原文 2015-07-30 19:53:08 2 1 loops/ wso2/ wso2esb/ mediator/ smooks

Is it possible in the WSO2 ESB to process a large file (with each line representing a single record/message), and stop or pause the processing within the file, then restart where it left off? WSO2 ESB中是否可以处理一个大文件（每行代表一个记录/消息），然后停止或暂停文件中的处理，然后从中断处重新开始？ (using the Smooks mediator and/or Iterate mediator, so any other mechanism) （使用Smooks介体和/或Iterate介体，以及其他任何机制）

It appears that if you are processing a large file (say with 10K entries) you cannot stop or pause the processing (or say the ESB is brought down in the middle of processing the file), and then restart where it was stopped. 看来，如果您正在处理一个大文件（例如具有10K条目），则无法停止或暂停该处理（或者说ESB在处理文件的过程中被关闭），然后在被停止的位置重新启动。 Upon restarting either the whole file has to be reprocessed, or the file is dumped to the error folder and skipped. 重新启动后，必须重新处理整个文件，或者将文件转储到错误文件夹并跳过。 Is this correct? 这个对吗？

Thanks for any help on this. 感谢您对此的任何帮助。

1 个解决方案

AFAIK this cannot be done in a straight forward manner. AFAIK不能直接做到这一点。 However you could probably split the large file in to smaller files using Smooks mediator (message splitting) [1], and use VFS processing on it [2]. 但是，您可以使用Smooks中介程序（消息拆分）[1]将大文件拆分为较小的文件，并对其进行VFS处理[2]。 Each file on the VFS location that is processed will either be deleted or moved, so whenever the process restarts it will not process the already processed messages/files. VFS位置上已处理的每个文件都将被删除或移动，因此，只要进程重新启动，它就不会处理已处理的消息/文件。

[1] - https://github.com/smooks/smooks/tree/v1.5.1/smooks-examples/file-router/ [1] -https://github.com/smooks/smooks/tree/v1.5.1/smooks-examples/file-router/

[2] - https://docs.wso2.com/pages/viewpage.action?pageId=33136056 [2] -https://docs.wso2.com/pages/viewpage.action?pageId=33136056