繁体   English   中英

蜂巢总是减少0%

[英]hive always reduce on 0%

我在蜂巢上运行hiveql时使用蜂巢来分析数据并创建表并将本地文件加载到蜂巢中

select sum(qlog_test.contlength) from qlog_test where qlog_test.area='HK' limit 10; 卡在地图上100%减少0%

2012-12-08 21:39:28,349 Stage-1 map = 80%, reduce = 0%, Cumulative CPU 29.72 sec 2012-12-08 21:39:29,370 Stage-1 map = 80%, reduce = 0%, Cumulative CPU 29.72 sec 2012-12-08 21:39:30,385 Stage-1 map = 80%, reduce = 0%, Cumulative CPU 29.72 sec 2012-12-08 21:39:31,401 Stage-1 map = 80%, reduce = 0%, Cumulative CPU 29.72 sec 2012-12-08 21:39:32,413 Stage-1 map = 80%, reduce = 0%, Cumulative CPU 29.72 sec 2012-12-08 21:39:33,423 Stage-1 map = 80%, reduce = 0%, Cumulative CPU 29.72 sec 2012-12-08 21:39:34,434 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:35,445 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:36,455 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:37,466 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:38,485 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:39,503 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:40,515 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:41,526 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:42,536 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:43,551 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:44,561 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:45,570 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:46,580 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:47,589 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:48,603 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:49,619 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:50,632 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:51,647 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:52,661 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:53,675 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:54,686 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:55,698 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:56,710 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:57,720 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:58,732 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:59,747 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:00,758 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:01,768 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:02,777 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:03,786 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:04,795 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:05,804 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:06,815 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:07,828 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:08,840 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:09,854 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:10,867 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:28,349 Stage-1 map = 80%, reduce = 0%, Cumulative CPU 29.72 sec 2012-12-08 21:39:29,370 Stage-1 map = 80%, reduce = 0%, Cumulative CPU 29.72 sec 2012-12-08 21:39:30,385 Stage-1 map = 80%, reduce = 0%, Cumulative CPU 29.72 sec 2012-12-08 21:39:31,401 Stage-1 map = 80%, reduce = 0%, Cumulative CPU 29.72 sec 2012-12-08 21:39:32,413 Stage-1 map = 80%, reduce = 0%, Cumulative CPU 29.72 sec 2012-12-08 21:39:33,423 Stage-1 map = 80%, reduce = 0%, Cumulative CPU 29.72 sec 2012-12-08 21:39:34,434 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:35,445 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:36,455 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:37,466 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:38,485 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:39,503 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:40,515 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:41,526 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:42,536 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:43,551 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:44,561 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:45,570 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:46,580 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:47,589 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:48,603 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:49,619 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:50,632 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:51,647 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:52,661 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:53,675 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:54,686 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:55,698 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:56,710 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:57,720 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:58,732 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:39:59,747 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:00,758 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:01,768 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:02,777 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:03,786 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:04,795 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:05,804 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:06,815 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:07,828 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:08,840 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:09,854 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec 2012-12-08 21:40:10,867 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 35.89 sec这是我的hadoop节点详细信息

在此处输入图片说明

这是地图/缩小作业的详细信息 在此处输入图片说明

我有这个问题。 确保查看减速器日志。 参考您的屏幕快照,单击化简行中的1,然后跟踪记录所有数据的文件。 然后,单击“全部”,然后查看导致问题的原因。 我遇到的问题是IP配置错误,因此映射器和减速器无法通信。 重新启动系统很有帮助。 编辑您的问题,以包括reduce log所说的话,也许我们可以为您提供进一步的帮助。

暂无
暂无

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM