Import Hadoop Code to Eclipse

Setting up eclipse for Hadoop development is bit time consuming with no clear instructions available online

Just trying to share what i know :)

You should do it on some Linux machine ideally. I used Windows just to show the steps (PS : Ubuntu i still love you )

Also read the Building.txt in the source code to know more about what all you need to build.

Here we go :)

Download m2e plugin in eclipse

Download m2e subversive connector

You should also have

SVN kit 1.3.5

Native Java HL 1.6

While this import is being done if eclipse asks you to allow him to download something , let him :) , Keep eclipse happy :)

Open Eclipse

Click Import

Maven > Import existing project from SVN

 

Select SCM type as SVN from drop menu ( If you don't have this then you need to install connector as told above)

URL as

http://svn.apache.org/repos/asf/hadoop/common/trunk/

 

Click next

Choose destination directory ( Optional )

Hit the import button and relax for some time :)

After some time you would see this

 

Click Next

 

Done

After this eclipse will take some time to build your workspace , resolve dependencies all that magical maven stuff :) The guy who wrote maven was wonderful :)

A long list of Hadoop projects will get fit into Eclipse project list on left :)

Do a quick refresh , That’s it you are ready to play with Hadoop code.

From time to time do a update of the project so that you are always updated with line of fire Trunk code :)  and know what those awesome people in apache are doing.

Was it helpful ? You know better way ?

Share your thoughts below in comments , Thanks for reading

There are 2 problems at this moment , but right now i don't have time to check them. Just writing them for my reference

1) Some build issues and Java compatibility.

2) Code is not showing up as java packages but as folders

Update on Issues above , This problem is that eclipse is not able to detect that particular project as Java project. I saw the issue with pom.xml artifact jdk.tools:jdk.tools:jar:1.6 is missing. So fixing this should resolve , so both 1) and 2) are related  :)