Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hadoop NativeTask Runtime Error #7

Open
veenasreegajula opened this issue Sep 28, 2016 · 0 comments
Open

Hadoop NativeTask Runtime Error #7

veenasreegajula opened this issue Sep 28, 2016 · 0 comments

Comments

@veenasreegajula
Copy link

Tried to run Wordcount program using prebuild Nativetask it ran successfully though it produced the

IO error (ERROR nativeio.NativeIO: Unable to initialize NativeIO libraries
java.lang.NoSuchFieldError: workaroundNonThreadSafePasswdCalls
)

,but when I tried to build Native task source file locally and used to run the Wordcount program it is giving the IO error (ERROR nativeio.NativeIO: Unable to initialize NativeIO libraries
java.lang.NoSuchFieldError: workaroundNonThreadSafePasswdCalls

) and MapReduce job got failed by giving the below error

java.lang.UnsatisfiedLinkError: org.apache.hadoop.mapred.nativetask.NativeRuntime.JNIConfigure([[B)V
16/09/28 16:34:32 INFO mapred.JobClient: map 0% reduce 0%
16/09/28 16:34:32 INFO mapred.JobClient: Job complete: job_local_0001
16/09/28 16:34:32 INFO mapred.JobClient: Counters: 0
16/09/28 16:34:32 INFO mapred.JobClient: Job Failed: NA
Exception in thread "main" java.io.IOException: Job failed!

Can anyone help with this issue.

Note: we had to change the below in order to build the source locally.

  1. Included unistd.h in couple of files
  2. Commented the below in file BatchHandler.cc
    #ifndef QUICK_BUILD
    #include "org_apache_hadoop_mapred_nativetask_NativeBatchProcessor.h"
    #endif

    because org_apache_hadoop_mapred_nativetask_NativeBatchProcessor.h file is not existing.
  3. Commented the below in file NativeRuntimeJniImpl.cc
    #ifndef QUICK_BUILD
    #include "org_apache_hadoop_mapred_nativetask_NativeRuntime.h"
    #endif

    because org_apache_hadoop_mapred_nativetask_NativeRuntime.h file is not existing.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant