Can't able to run mapredure on alluxio

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Can't able to run mapredure on alluxio

UDIT JOSHI
I configured hdfs with alluxio and passed all tests but I am facing problems in distributing alluxio client jar

!) I set up hadoop-env.sh

export HADOOP_CLASSPATH="/root/alluxio-1.8.0-hadoop-2.6/client/alluxio-1.8.0-client.jar"

2)Also try to distribute jar by 

bin/hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar wordcount -libjars /root/alluxio-1.8.0-hadoop-2.6/client/alluxio-1.8.0-client.jar dft dft-alluxio
 

But get the same error 
I cant able to run wordcount through hadoop -example .jar through alluxio 
and my intrigation checker also failed 

Job job_1491779488590_0002 failed with state FAILED due to: Application application_1491779488590_0002 failed 2 times due to AM Container for appattempt_1491779488590_0002_000002 exited with  exitCode: 1
For more detailed output, check application tracking page:http://erfan:8088/cluster/app/application_1491779488590_0002Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1491779488590_0002_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1: 

picturemessage_4ytnp3ry.5kr.png



--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Can't able to run mapredure on alluxio

Lu Qiu
Hi Udit,

More detailed logs would help us to debug. Could you provide us the logs of each attempt? 
For more detailed output, check application tracking page:http://erfan:8088/cluster/app/application_1491779488590_0002Then, click on links to logs of each attempt.
Thanks,
Lu

On Thu, Oct 4, 2018 at 4:55 AM UDIT JOSHI <[hidden email]> wrote:
I configured hdfs with alluxio and passed all tests but I am facing problems in distributing alluxio client jar

!) I set up hadoop-env.sh

export HADOOP_CLASSPATH="/root/alluxio-1.8.0-hadoop-2.6/client/alluxio-1.8.0-client.jar"

2)Also try to distribute jar by 

bin/hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar wordcount -libjars /root/alluxio-1.8.0-hadoop-2.6/client/alluxio-1.8.0-client.jar dft dft-alluxio
 

But get the same error 
I cant able to run wordcount through hadoop -example .jar through alluxio 
and my intrigation checker also failed 

Job job_1491779488590_0002 failed with state FAILED due to: Application application_1491779488590_0002 failed 2 times due to AM Container for appattempt_1491779488590_0002_000002 exited with  exitCode: 1
For more detailed output, check application tracking page:http://erfan:8088/cluster/app/application_1491779488590_0002Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1491779488590_0002_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1: 

picturemessage_4ytnp3ry.5kr.png



--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Can't able to run mapredure on alluxio

Bin Fan
In reply to this post by UDIT JOSHI
Hi Udit,

the current log shows the MR job failed due to one task failed after two attempts (likely to be a mapper from its ID).
it would be helpful to find out the log for that particular task.
You can maybe check this doc to see if it helps

- Bin

On Thu, Oct 4, 2018 at 4:55 AM UDIT JOSHI <[hidden email]> wrote:
I configured hdfs with alluxio and passed all tests but I am facing problems in distributing alluxio client jar

!) I set up hadoop-env.sh

export HADOOP_CLASSPATH="/root/alluxio-1.8.0-hadoop-2.6/client/alluxio-1.8.0-client.jar"

2)Also try to distribute jar by 

bin/hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar wordcount -libjars /root/alluxio-1.8.0-hadoop-2.6/client/alluxio-1.8.0-client.jar dft dft-alluxio
 

But get the same error 
I cant able to run wordcount through hadoop -example .jar through alluxio 
and my intrigation checker also failed 

Job job_1491779488590_0002 failed with state FAILED due to: Application application_1491779488590_0002 failed 2 times due to AM Container for appattempt_1491779488590_0002_000002 exited with  exitCode: 1
For more detailed output, check application tracking page:http://erfan:8088/cluster/app/application_1491779488590_0002Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1491779488590_0002_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1: 

picturemessage_4ytnp3ry.5kr.png



--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Can't able to run mapredure on alluxio

UDIT JOSHI
Thanks, I will do that. 

unsupprted major minor java version 52.0 in yarn logs i resolved it

because of multiple java present in my cloudera hadoop 


On Fri, Oct 5, 2018 at 2:10 AM Bin Fan <[hidden email]> wrote:
Hi Udit,

the current log shows the MR job failed due to one task failed after two attempts (likely to be a mapper from its ID).
it would be helpful to find out the log for that particular task.
You can maybe check this doc to see if it helps

- Bin

On Thu, Oct 4, 2018 at 4:55 AM UDIT JOSHI <[hidden email]> wrote:
I configured hdfs with alluxio and passed all tests but I am facing problems in distributing alluxio client jar

!) I set up hadoop-env.sh

export HADOOP_CLASSPATH="/root/alluxio-1.8.0-hadoop-2.6/client/alluxio-1.8.0-client.jar"

2)Also try to distribute jar by 

bin/hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar wordcount -libjars /root/alluxio-1.8.0-hadoop-2.6/client/alluxio-1.8.0-client.jar dft dft-alluxio
 

But get the same error 
I cant able to run wordcount through hadoop -example .jar through alluxio 
and my intrigation checker also failed 

Job job_1491779488590_0002 failed with state FAILED due to: Application application_1491779488590_0002 failed 2 times due to AM Container for appattempt_1491779488590_0002_000002 exited with  exitCode: 1
For more detailed output, check application tracking page:http://erfan:8088/cluster/app/application_1491779488590_0002Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1491779488590_0002_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1: 

picturemessage_4ytnp3ry.5kr.png



--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Can't able to run mapredure on alluxio

Gene Pang
Hi,

Were you able to resolve your issue?

Thanks,
Gene

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.