February 07, 2014

Hadoop Mapper only MapReduce jobs

It's funny! You can have mapper only Hadoop MapReduce Jobs. This would be useful sometime when you need to change the structure of data. Otherwise you can use this way when want to filter out data. But I don't think you will need this much often.

First file is a simple mapper which really does nothing. You can change it as you want. You can see in main method job.setNumReduceTasks(0); line which set reduce tasks to 0. You can find Maven project on GitHub

11 comments:

  1. It does not work. Many errors
    Caused by: java.lang.NoSuchMethodException: App$Map.()

    ReplyDelete
    Replies
    1. You need to write your map class. I think you don't have any map class.

      Delete
  2. java.lang.RuntimeException: java.lang.NoSuchMethodException: App$Map.()
    Caused by: java.lang.NoSuchMethodException: App$Map.()

    ReplyDelete
  3. Hi, I am really happy to found such a helpful and fascinating post that is written in well manner. Thanks for sharing such an informative post.R Programming Online Training | Hadoop Online Training

    ReplyDelete
  4. hai i admin.Great blog.thanks.Much obliged for sharing, Reach your Goal and at last get a fruitful future. In the event that you need to take in an abnormal state dialect.............
    Selenium Training in Chennai
    Dot Net Training in Chennai
    Android Training in Chennai
    Hadoop Training in Chennai

    ReplyDelete
  5. We sharing this's one the best blog post Concepts for Hadoop Map Reduce learn the material. This is very interesting and useful.
    Hadoop Online Training
    Best Hadoop Training
    Learn Hadoop Online Training

    ReplyDelete
  6. Well Said, you have provided the right info that will be beneficial to somebody at all time. Thanks for sharing your valuable Ideas to our vision.Big Data Hadoop Training in Bangalore | Data Science Training in Bangalore

    ReplyDelete
  7. Great. very useful. thanks for sharing valuable post
    data science training in bangalore

    ReplyDelete