February 07, 2014

Hadoop Mapper only MapReduce jobs

It's funny! You can have mapper only Hadoop MapReduce Jobs. This would be useful sometime when you need to change the structure of data. Otherwise you can use this way when want to filter out data. But I don't think you will need this much often.

First file is a simple mapper which really does nothing. You can change it as you want. You can see in main method job.setNumReduceTasks(0); line which set reduce tasks to 0. You can find Maven project on GitHub

14 comments:

  1. It does not work. Many errors
    Caused by: java.lang.NoSuchMethodException: App$Map.()

    ReplyDelete
    Replies
    1. You need to write your map class. I think you don't have any map class.

      Delete
  2. java.lang.RuntimeException: java.lang.NoSuchMethodException: App$Map.()
    Caused by: java.lang.NoSuchMethodException: App$Map.()

    ReplyDelete
  3. I believe there are many more pleasurable opportunities ahead for individuals that looked at your site.
    hadoop training in bangalore

    ReplyDelete
  4. Those guidelines additionally worked to become a good way to
    recognize that other people online have the identical fervor like mine
    to grasp great deal more around this condition.



    aws training in bangalore



    aws training in chennai

    ReplyDelete
  5. It was so good to read and useful to improve my knowledge as updated one.Thanks to Sharing.

    Hadoop online Training\Informatica Online Training\ETL Testing Online Training

    ReplyDelete
  6. You rock particularly for the high caliber and results-arranged offer assistance. I won't reconsider to embrace your blog entry to anyone who needs and needs bolster about this region.
    nebosh igc course in chennai

    ReplyDelete
  7. I wanna say thanks for the suggestions that you are contributed here...
    Best Online Software Training Institute | Hadoop Training

    ReplyDelete
  8. Those guidelines additionally worked to become a good way to recognize that other people online have the identical fervor like mine to grasp great deal more around this condition.

    Best AWS training in bangalore

    ReplyDelete