Skip to content

memonews/maven-hadoop

 
 

Repository files navigation

Maven Plugin for Hadoop
-------------------------
  
Copyright (C) 2011 MeMo News AG



This is a maven plugin for Hadoop issued under Apache License. 
This software comes with absolutely *NO WARRANTY* whatsoever. 
See LICENSE.txt for more details. 


Installation
============

The plugin should be available in the central repository soon.

<plugin> 
   <groupId>com.github.maven-hadoop.plugin</groupId>
   <artifactId>maven-hadoop-plugin</artifactId>
    <version>0.20.2-SNAPSHOT</version>
    <configuration>
        <hadoopHome>/opt/software/hadoop</hadoopHome>
        <path>hdfs://localhost:8020/user/${user.name}</path>
    </configuration>
</plugin>
      
     
where , hadoopHome  is set to HADOOP_HOME installation directory of the version against which this needs to be compiled against.

Usage / Goals:
=============

* mvn hadoop:pack
------

Creates the jar file to be submitted to the hadoop job engine. 

The jar contains a directory called ./lib , that contains all the dependent jars in the same. 
The classes of the current project are also available in the same. 

The jar would be created in $basedir/target/hadoop-deploy/${artifact.name}-{artifact.version}-hdeploy.jar. 

Once created, this could be started with the hadoop jar engine. 

$ $HADOOP_HOME/bin/hadoop jar  $basedir/target/hadoop-deploy/${artifact.name}-{artifact.version}-hdeploy.jar   job.launching.class

* mvn hadoop:deploy
--------

Deploys the packed job to the given path on hdfs.

   
      

Packages

No packages published

Languages

  • Java 100.0%