Pentaho Spoon - 等待文件 - 通配符

Question

I know i've asked a couple of pentaho related questions lately but am rushing to evaluate it in a short timeframe:)

My latest obstacle I am trying to overcome is that I am building a job that will process an input file when it arrives, but i only know the format for the filename, not the exact filename itself and the "wait for file" step does not allow wildcards. This seems like a glaring ommision for such a step so am wondering if i've just missed something but on forums etc it seems i'm not the only one facing such a challenge.

Ideally i need the "wait for file" step to search on a wildcard/regex and when it finds a match pass the resulting files name to the next step in the job for processing.

Any suggestions?

Thanks

Tom

Answer 1

Again I try to answer your question.

Actually, you don't need a job to wait for a file. Based on my answer on country split: Pentaho Spoon - Output to multiple files based on field content , you just need to pass through the source name and then archive it using process file (see the pic below).

From here, I think you can adapting my logic using the ktr I provided before (http://pentaho.phi-integration.com/kettle/kettle-files/split_countries.ktr ).

Then you can control the repetition of the job (wait and process files) using job scheduler (see the pic).

Well, hope this helps Tom !

Regards,

Dino

Answer 2

I had a similar requirement, and solved this by creating a directory specifically for receiving the files (from a remote host).

The the "Get File Names" step reads the files in the directory and passes the name to the next step. The "Get File Names" allows wildcards, btw.

(Off course, I have to clean up in input queue once I have finished processing the file.)

EDIT: I omitted to mention that you loose the "wake" functionality with the Get File Names, and you'll have to loop and schedule regular parses of the directory.