We are thinking of the integration of apache spark in our calculation process where we at first wanted to use apache oozie and standard MR or MO (Map-Only) jobs.
After some research several questions remain:
Please consider the following scenarios when answering:
Thanks for your answers in advance.
Spark is supported in Oozie 4.2 as an action type, see docs . The scenarios you mentioned are common Oozie features.
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.