簡體   English   中英

Hadoop:java.lang.ClassNotFoundException:map-reduce

[英]Hadoop: java.lang.ClassNotFoundException:map-reduce

您好我正在使用eclipse導出map reduce程序的jar文件。當我嘗試使用命令運行jar文件時

hadoop jar WordCountdemo.jar /Demo2/WordCount.txt /mroutput7utput7

我收到錯誤:

Exception in thread "main" java.lang.ClassNotFoundException: /Demo2/WordCount/txt
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:348)
    at org.apache.hadoop.util.RunJar.run(RunJar.java:316)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:236)

我的程序如下所示:

import java.io.IOException;
import java.util.StringTokenizer;

import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapreduce.Job;
import org.apache.hadoop.mapreduce.Mapper;
import org.apache.hadoop.mapreduce.Reducer;
import org.apache.hadoop.mapreduce.lib.input.FileInputFormat;
import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat;

public class WordCountdemo {
    public static class Tmaper extends Mapper<Object, Text, Text, IntWritable>{
        private final static IntWritable one = new IntWritable(1);
        private Text word = new Text();
        public void map(Object key, Text value, Context context
                ) throws IOException, InterruptedException{
            StringTokenizer itr = new StringTokenizer(value.toString());
            while (itr.hasMoreTokens()) {
                word.set(itr.nextToken());
                context.write(word, one);
              }
        }
        
    }
    public static class Treducer extends Reducer<Text,IntWritable,Text,IntWritable>{
        private IntWritable result = new IntWritable();
        public void reduce(Text key, Iterable<IntWritable> values,
                Context context
                ) throws IOException, InterruptedException {
                int sum = 0;
                for (IntWritable val : values) {
                 sum += val.get();
                }
                result.set(sum);
                context.write(key, result);
                }
    }
    public static void main(String[] args) throws Exception {
        Configuration conf = new Configuration();
        Job job = Job.getInstance(conf, "word count");
        job.setJarByClass(WordCountdemo.class);
        job.setMapperClass(Tmaper.class);
        //job.setCombinerClass(Treducer.class);
        job.setReducerClass(Treducer.class);
        job.setOutputKeyClass(Text.class);
        job.setOutputValueClass(IntWritable.class);
        FileInputFormat.addInputPath(job, new Path(args[0]));
        FileOutputFormat.setOutputPath(job, new Path(args[1]));
        
        System.exit(job.waitForCompletion(true) ? 0 : 1);
      }
}

我無法弄清楚問題出在哪里或出在哪里代碼取自Hadoop

你錯過了一個論點 - 類。

hadoop jar WordCountdemo.jar WordCountdemo /Demo2/WordCount.txt /mroutput7utput7

暫無
暫無

聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.

 
粵ICP備18138465號  © 2020-2024 STACKOOM.COM