简体   繁体   English

如何设置cron作业以运行map reduce?

[英]how to setup cron job to run map reduce?

I have three map reduce jobs and need to configure as a cron job. 我有三个map reduce作业,需要配置为cron作业。

I tried with creating cron job to run mapreduce but its not working. 我尝试创建cron作业来运行mapreduce,但无法正常工作。 I mean map reduce job run is not initiated. 我的意思是地图还原作业未启动。

Please help in setting up cron job to run map reduce job. 请帮助设置cron作业以运行map reduce作业。 I can use Oozie for setting up a workflow job but wanted to use cronjob only. 我可以使用Oozie设置工作流作业,但只想使用cronjob。

I highly recommend to use Oozie for MapReduce jobs scheduling. 我强烈建议使用Oozie进行MapReduce作业调度。 There is a lot of work done for you - workflows, data dependencies, monitoring. 您需要完成许多工作-工作流,数据依赖项,监视。 You can start with simple cron-like scenario and then extend without big reengineering. 您可以从简单的类似cron的场景开始,然后在不进行大量重新设计的情况下进行扩展。 See https://github.com/yahoo/oozie/wiki/Oozie-Coord-Use-Cases for examples. 有关示例,请参见https://github.com/yahoo/oozie/wiki/Oozie-Coord-Use-Cases

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM