docker build failed using latest 1.8 version with hadoop 2.7

classic Classic list List threaded Threaded
9 messages Options
Reply | Threaded
Open this post in threaded view
|

docker build failed using latest 1.8 version with hadoop 2.7

童诚超

in alluxio quick start of running alluxio in docker chapter, i came up with following problem.

iv tried the docker cmd in my centos 7.4 it works fine , but why it kept failing in docker build...

any1 can help is highly appreciated!  thankyou !

`[root@SZV1000348579 docker]# docker build -t alluxio --build-arg http_proxy=http://10.171.121.97:8848 --build-arg ALLUXIO_TARBALL=alluxio-1.8.0-hadoop-2.7-bin.tar.gz .
Sending build context to Docker daemon  371.5MB
Step 1/8 : FROM openjdk:8-jdk-alpine
 ---> 5801f7d008e5
Step 2/8 : ARG ALLUXIO_TARBALL=http://downloads.alluxio.org/downloads/files/1.8.0/alluxio-1.8.0-bin.tar.gz
 ---> Using cache
 ---> b4688ec638d2
Step 3/8 : RUN apk add --update bash &&     rm -rf /var/cache/apk/*
 ---> Using cache
 ---> 4904350f2dcf
Step 4/8 : ADD ${ALLUXIO_TARBALL} /opt/
 ---> Using cache
 ---> 46601472bd3e
Step 5/8 : RUN cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio
 ---> Running in a6ab9bd2d9f5
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/libexec': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/client': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/lib': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7': Directory not empty
The command '/bin/sh -c cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio' returned a non-zero code: 1
[root@SZV1000348579 docker]#`

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: docker build failed using latest 1.8 version with hadoop 2.7

Andrew Audibert-2
Hi,

This looks like an issue specific to Centos 7 + Docker. If an image adds and then tries to move or remove a file, the removal will fail if the filesystem is formatted incorrectly. Can you check whether your xfs partition has ftype 0?

After further investigation, I noticed that my xfs partition had ftype set to 0. Red Hat states that xfs partitions need to be formatted with ftype set to 1 if they are to be used with overlay.
https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/7.2_Release_Notes/technology-preview-file_systems.html
I guess the issue can now be closed as it's not Docker related. Hopefully people who encounter this issue can stumble upon this issue for a solution.

- Andrew

On Monday, September 3, 2018 at 1:30:11 AM UTC-7, 童诚超 wrote:

in alluxio quick start of running alluxio in docker chapter, i came up with following problem.

iv tried the docker cmd in my centos 7.4 it works fine , but why it kept failing in docker build...

any1 can help is highly appreciated!  thankyou !

`[root@SZV1000348579 docker]# docker build -t alluxio --build-arg http_proxy=<a href="http://10.171.121.97:8848" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.171.121.97%3A8848\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEu6oSxOeNFVFKc3OYwxKIWVeP9ag&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.171.121.97%3A8848\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEu6oSxOeNFVFKc3OYwxKIWVeP9ag&#39;;return true;">http://10.171.121.97:8848 --build-arg ALLUXIO_TARBALL=alluxio-1.8.0-hadoop-2.7-bin.tar.gz .
Sending build context to Docker daemon  371.5MB
Step 1/8 : FROM openjdk:8-jdk-alpine
 ---> 5801f7d008e5
Step 2/8 : ARG ALLUXIO_TARBALL=<a href="http://downloads.alluxio.org/downloads/files/1.8.0/alluxio-1.8.0-bin.tar.gz" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fdownloads.alluxio.org%2Fdownloads%2Ffiles%2F1.8.0%2Falluxio-1.8.0-bin.tar.gz\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNF_0HhpdVKg6aRp6gSg8U3NVU-ieg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fdownloads.alluxio.org%2Fdownloads%2Ffiles%2F1.8.0%2Falluxio-1.8.0-bin.tar.gz\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNF_0HhpdVKg6aRp6gSg8U3NVU-ieg&#39;;return true;">http://downloads.alluxio.org/downloads/files/1.8.0/alluxio-1.8.0-bin.tar.gz
 ---> Using cache
 ---> b4688ec638d2
Step 3/8 : RUN apk add --update bash &&     rm -rf /var/cache/apk/*
 ---> Using cache
 ---> 4904350f2dcf
Step 4/8 : ADD ${ALLUXIO_TARBALL} /opt/
 ---> Using cache
 ---> 46601472bd3e
Step 5/8 : RUN cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio
 ---> Running in a6ab9bd2d9f5
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/libexec': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/client': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/lib': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7': Directory not empty
The command '/bin/sh -c cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio' returned a non-zero code: 1
[root@SZV1000348579 docker]#`

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: docker build failed using latest 1.8 version with hadoop 2.7

Andrew Audibert
I think we could work around this issue by changing the Dockerfile to create a symlink instead of performing a rename. Could you try this out and see if it fixes things on your system? https://github.com/Alluxio/alluxio/pull/7817/files

On Wednesday, September 5, 2018 at 1:59:01 PM UTC-7, Andrew Audibert wrote:
Hi,

This looks like an issue specific to Centos 7 + Docker. If an image adds and then tries to move or remove a file, the removal will fail if the filesystem is formatted incorrectly. Can you check whether your xfs partition has ftype 0?

<a href="https://github.com/moby/moby/issues/27358#issuecomment-254066211" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fmoby%2Fmoby%2Fissues%2F27358%23issuecomment-254066211\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFIgRgvUxo7zFLZnS2ETqGsXAaCEg&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fmoby%2Fmoby%2Fissues%2F27358%23issuecomment-254066211\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFIgRgvUxo7zFLZnS2ETqGsXAaCEg&#39;;return true;">https://github.com/moby/moby/issues/27358#issuecomment-254066211
After further investigation, I noticed that my xfs partition had ftype set to 0. Red Hat states that xfs partitions need to be formatted with ftype set to 1 if they are to be used with overlay.
<a href="https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/7.2_Release_Notes/technology-preview-file_systems.html" rel="nofollow" style="background-color:transparent;color:rgb(3,102,214)" target="_blank" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Faccess.redhat.com%2Fdocumentation%2Fen-US%2FRed_Hat_Enterprise_Linux%2F7%2Fhtml%2F7.2_Release_Notes%2Ftechnology-preview-file_systems.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLYAXLx3GbxEPhy5B9fO87ZfNELg&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Faccess.redhat.com%2Fdocumentation%2Fen-US%2FRed_Hat_Enterprise_Linux%2F7%2Fhtml%2F7.2_Release_Notes%2Ftechnology-preview-file_systems.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLYAXLx3GbxEPhy5B9fO87ZfNELg&#39;;return true;">https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/7.2_Release_Notes/technology-preview-file_systems.html
I guess the issue can now be closed as it's not Docker related. Hopefully people who encounter this issue can stumble upon this issue for a solution.

- Andrew

On Monday, September 3, 2018 at 1:30:11 AM UTC-7, 童诚超 wrote:

in alluxio quick start of running alluxio in docker chapter, i came up with following problem.

iv tried the docker cmd in my centos 7.4 it works fine , but why it kept failing in docker build...

any1 can help is highly appreciated!  thankyou !

`[root@SZV1000348579 docker]# docker build -t alluxio --build-arg http_proxy=<a href="http://10.171.121.97:8848" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.171.121.97%3A8848\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEu6oSxOeNFVFKc3OYwxKIWVeP9ag&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.171.121.97%3A8848\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEu6oSxOeNFVFKc3OYwxKIWVeP9ag&#39;;return true;">http://10.171.121.97:8848 --build-arg ALLUXIO_TARBALL=alluxio-1.8.0-hadoop-2.7-bin.tar.gz .
Sending build context to Docker daemon  371.5MB
Step 1/8 : FROM openjdk:8-jdk-alpine
 ---> 5801f7d008e5
Step 2/8 : ARG ALLUXIO_TARBALL=<a href="http://downloads.alluxio.org/downloads/files/1.8.0/alluxio-1.8.0-bin.tar.gz" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fdownloads.alluxio.org%2Fdownloads%2Ffiles%2F1.8.0%2Falluxio-1.8.0-bin.tar.gz\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNF_0HhpdVKg6aRp6gSg8U3NVU-ieg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fdownloads.alluxio.org%2Fdownloads%2Ffiles%2F1.8.0%2Falluxio-1.8.0-bin.tar.gz\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNF_0HhpdVKg6aRp6gSg8U3NVU-ieg&#39;;return true;">http://downloads.alluxio.org/downloads/files/1.8.0/alluxio-1.8.0-bin.tar.gz
 ---> Using cache
 ---> b4688ec638d2
Step 3/8 : RUN apk add --update bash &&     rm -rf /var/cache/apk/*
 ---> Using cache
 ---> 4904350f2dcf
Step 4/8 : ADD ${ALLUXIO_TARBALL} /opt/
 ---> Using cache
 ---> 46601472bd3e
Step 5/8 : RUN cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio
 ---> Running in a6ab9bd2d9f5
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/libexec': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/client': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/lib': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7': Directory not empty
The command '/bin/sh -c cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio' returned a non-zero code: 1
[root@SZV1000348579 docker]#`

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: docker build failed using latest 1.8 version with hadoop 2.7

童诚超
In reply to this post by Andrew Audibert-2
I checked my partition and found it's not even XFS partition...

[root@SZV1000348579 docker]# xfs_info /dev/
xfs_info: /dev/ is not a mounted XFS filesystem

ahhh... havent figured out how are all these stuff connected to each other...

在 2018年9月6日星期四 UTC+8上午4:59:01,Andrew Audibert写道:
Hi,

This looks like an issue specific to Centos 7 + Docker. If an image adds and then tries to move or remove a file, the removal will fail if the filesystem is formatted incorrectly. Can you check whether your xfs partition has ftype 0?

<a href="https://github.com/moby/moby/issues/27358#issuecomment-254066211" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fmoby%2Fmoby%2Fissues%2F27358%23issuecomment-254066211\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFIgRgvUxo7zFLZnS2ETqGsXAaCEg&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fmoby%2Fmoby%2Fissues%2F27358%23issuecomment-254066211\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFIgRgvUxo7zFLZnS2ETqGsXAaCEg&#39;;return true;">https://github.com/moby/moby/issues/27358#issuecomment-254066211
After further investigation, I noticed that my xfs partition had ftype set to 0. Red Hat states that xfs partitions need to be formatted with ftype set to 1 if they are to be used with overlay.
<a href="https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/7.2_Release_Notes/technology-preview-file_systems.html" rel="nofollow" style="background-color:transparent;color:rgb(3,102,214)" target="_blank" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Faccess.redhat.com%2Fdocumentation%2Fen-US%2FRed_Hat_Enterprise_Linux%2F7%2Fhtml%2F7.2_Release_Notes%2Ftechnology-preview-file_systems.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLYAXLx3GbxEPhy5B9fO87ZfNELg&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Faccess.redhat.com%2Fdocumentation%2Fen-US%2FRed_Hat_Enterprise_Linux%2F7%2Fhtml%2F7.2_Release_Notes%2Ftechnology-preview-file_systems.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLYAXLx3GbxEPhy5B9fO87ZfNELg&#39;;return true;">https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/7.2_Release_Notes/technology-preview-file_systems.html
I guess the issue can now be closed as it's not Docker related. Hopefully people who encounter this issue can stumble upon this issue for a solution.

- Andrew

On Monday, September 3, 2018 at 1:30:11 AM UTC-7, 童诚超 wrote:

in alluxio quick start of running alluxio in docker chapter, i came up with following problem.

iv tried the docker cmd in my centos 7.4 it works fine , but why it kept failing in docker build...

any1 can help is highly appreciated!  thankyou !

`[root@SZV1000348579 docker]# docker build -t alluxio --build-arg http_proxy=<a href="http://10.171.121.97:8848" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.171.121.97%3A8848\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEu6oSxOeNFVFKc3OYwxKIWVeP9ag&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.171.121.97%3A8848\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEu6oSxOeNFVFKc3OYwxKIWVeP9ag&#39;;return true;">http://10.171.121.97:8848 --build-arg ALLUXIO_TARBALL=alluxio-1.8.0-hadoop-2.7-bin.tar.gz .
Sending build context to Docker daemon  371.5MB
Step 1/8 : FROM openjdk:8-jdk-alpine
 ---> 5801f7d008e5
Step 2/8 : ARG ALLUXIO_TARBALL=<a href="http://downloads.alluxio.org/downloads/files/1.8.0/alluxio-1.8.0-bin.tar.gz" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fdownloads.alluxio.org%2Fdownloads%2Ffiles%2F1.8.0%2Falluxio-1.8.0-bin.tar.gz\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNF_0HhpdVKg6aRp6gSg8U3NVU-ieg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fdownloads.alluxio.org%2Fdownloads%2Ffiles%2F1.8.0%2Falluxio-1.8.0-bin.tar.gz\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNF_0HhpdVKg6aRp6gSg8U3NVU-ieg&#39;;return true;">http://downloads.alluxio.org/downloads/files/1.8.0/alluxio-1.8.0-bin.tar.gz
 ---> Using cache
 ---> b4688ec638d2
Step 3/8 : RUN apk add --update bash &&     rm -rf /var/cache/apk/*
 ---> Using cache
 ---> 4904350f2dcf
Step 4/8 : ADD ${ALLUXIO_TARBALL} /opt/
 ---> Using cache
 ---> 46601472bd3e
Step 5/8 : RUN cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio
 ---> Running in a6ab9bd2d9f5
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/libexec': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/client': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/lib': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7': Directory not empty
The command '/bin/sh -c cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio' returned a non-zero code: 1
[root@SZV1000348579 docker]#`

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: docker build failed using latest 1.8 version with hadoop 2.7

童诚超
In reply to this post by Andrew Audibert
Hi , i v tried this new dockerfile, it seems work when pack the image

but issue came up when i tried to start master/slave, they all exited with error code 127

maybe there should be changed within the entrypoint.sh also ?

在 2018年9月6日星期四 UTC+8上午8:05:34,and...@alluxio.com写道:
I think we could work around this issue by changing the Dockerfile to create a symlink instead of performing a rename. Could you try this out and see if it fixes things on your system? <a href="https://github.com/Alluxio/alluxio/pull/7817/files" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2FAlluxio%2Falluxio%2Fpull%2F7817%2Ffiles\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHMfFJyYPFEdm692aDUlrLQrQzCKw&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2FAlluxio%2Falluxio%2Fpull%2F7817%2Ffiles\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHMfFJyYPFEdm692aDUlrLQrQzCKw&#39;;return true;">https://github.com/Alluxio/alluxio/pull/7817/files

On Wednesday, September 5, 2018 at 1:59:01 PM UTC-7, Andrew Audibert wrote:
Hi,

This looks like an issue specific to Centos 7 + Docker. If an image adds and then tries to move or remove a file, the removal will fail if the filesystem is formatted incorrectly. Can you check whether your xfs partition has ftype 0?

<a href="https://github.com/moby/moby/issues/27358#issuecomment-254066211" rel="nofollow" target="_blank" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fmoby%2Fmoby%2Fissues%2F27358%23issuecomment-254066211\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFIgRgvUxo7zFLZnS2ETqGsXAaCEg&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fmoby%2Fmoby%2Fissues%2F27358%23issuecomment-254066211\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFIgRgvUxo7zFLZnS2ETqGsXAaCEg&#39;;return true;">https://github.com/moby/moby/issues/27358#issuecomment-254066211
After further investigation, I noticed that my xfs partition had ftype set to 0. Red Hat states that xfs partitions need to be formatted with ftype set to 1 if they are to be used with overlay.
<a href="https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/7.2_Release_Notes/technology-preview-file_systems.html" rel="nofollow" style="background-color:transparent;color:rgb(3,102,214)" target="_blank" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Faccess.redhat.com%2Fdocumentation%2Fen-US%2FRed_Hat_Enterprise_Linux%2F7%2Fhtml%2F7.2_Release_Notes%2Ftechnology-preview-file_systems.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLYAXLx3GbxEPhy5B9fO87ZfNELg&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Faccess.redhat.com%2Fdocumentation%2Fen-US%2FRed_Hat_Enterprise_Linux%2F7%2Fhtml%2F7.2_Release_Notes%2Ftechnology-preview-file_systems.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLYAXLx3GbxEPhy5B9fO87ZfNELg&#39;;return true;">https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/7.2_Release_Notes/technology-preview-file_systems.html
I guess the issue can now be closed as it's not Docker related. Hopefully people who encounter this issue can stumble upon this issue for a solution.

- Andrew

On Monday, September 3, 2018 at 1:30:11 AM UTC-7, 童诚超 wrote:

in alluxio quick start of running alluxio in docker chapter, i came up with following problem.

iv tried the docker cmd in my centos 7.4 it works fine , but why it kept failing in docker build...

any1 can help is highly appreciated!  thankyou !

`[root@SZV1000348579 docker]# docker build -t alluxio --build-arg http_proxy=<a href="http://10.171.121.97:8848" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.171.121.97%3A8848\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEu6oSxOeNFVFKc3OYwxKIWVeP9ag&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.171.121.97%3A8848\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEu6oSxOeNFVFKc3OYwxKIWVeP9ag&#39;;return true;">http://10.171.121.97:8848 --build-arg ALLUXIO_TARBALL=alluxio-1.8.0-hadoop-2.7-bin.tar.gz .
Sending build context to Docker daemon  371.5MB
Step 1/8 : FROM openjdk:8-jdk-alpine
 ---> 5801f7d008e5
Step 2/8 : ARG ALLUXIO_TARBALL=<a href="http://downloads.alluxio.org/downloads/files/1.8.0/alluxio-1.8.0-bin.tar.gz" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fdownloads.alluxio.org%2Fdownloads%2Ffiles%2F1.8.0%2Falluxio-1.8.0-bin.tar.gz\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNF_0HhpdVKg6aRp6gSg8U3NVU-ieg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fdownloads.alluxio.org%2Fdownloads%2Ffiles%2F1.8.0%2Falluxio-1.8.0-bin.tar.gz\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNF_0HhpdVKg6aRp6gSg8U3NVU-ieg&#39;;return true;">http://downloads.alluxio.org/downloads/files/1.8.0/alluxio-1.8.0-bin.tar.gz
 ---> Using cache
 ---> b4688ec638d2
Step 3/8 : RUN apk add --update bash &&     rm -rf /var/cache/apk/*
 ---> Using cache
 ---> 4904350f2dcf
Step 4/8 : ADD ${ALLUXIO_TARBALL} /opt/
 ---> Using cache
 ---> 46601472bd3e
Step 5/8 : RUN cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio
 ---> Running in a6ab9bd2d9f5
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/libexec': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/client': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/lib': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7': Directory not empty
The command '/bin/sh -c cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio' returned a non-zero code: 1
[root@SZV1000348579 docker]#`

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: docker build failed using latest 1.8 version with hadoop 2.7

Andrew Audibert
I'm able to follow the tutorial from the docs after only changing "mv" to "ln -s". For the containers that exit, is there any output from running "docker logs" on the container id?

On Wed, Sep 5, 2018 at 11:35 PM 童诚超 <[hidden email]> wrote:
Hi , i v tried this new dockerfile, it seems work when pack the image

but issue came up when i tried to start master/slave, they all exited with error code 127

maybe there should be changed within the entrypoint.sh also ?

在 2018年9月6日星期四 UTC+8上午8:05:34,[hidden email]写道:
I think we could work around this issue by changing the Dockerfile to create a symlink instead of performing a rename. Could you try this out and see if it fixes things on your system? https://github.com/Alluxio/alluxio/pull/7817/files

On Wednesday, September 5, 2018 at 1:59:01 PM UTC-7, Andrew Audibert wrote:
Hi,

This looks like an issue specific to Centos 7 + Docker. If an image adds and then tries to move or remove a file, the removal will fail if the filesystem is formatted incorrectly. Can you check whether your xfs partition has ftype 0?

After further investigation, I noticed that my xfs partition had ftype set to 0. Red Hat states that xfs partitions need to be formatted with ftype set to 1 if they are to be used with overlay.
https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/7.2_Release_Notes/technology-preview-file_systems.html
I guess the issue can now be closed as it's not Docker related. Hopefully people who encounter this issue can stumble upon this issue for a solution.

- Andrew

On Monday, September 3, 2018 at 1:30:11 AM UTC-7, 童诚超 wrote:

in alluxio quick start of running alluxio in docker chapter, i came up with following problem.

iv tried the docker cmd in my centos 7.4 it works fine , but why it kept failing in docker build...

any1 can help is highly appreciated!  thankyou !

`[root@SZV1000348579 docker]# docker build -t alluxio --build-arg http_proxy=http://10.171.121.97:8848 --build-arg ALLUXIO_TARBALL=alluxio-1.8.0-hadoop-2.7-bin.tar.gz .
Sending build context to Docker daemon  371.5MB
Step 1/8 : FROM openjdk:8-jdk-alpine
 ---> 5801f7d008e5
Step 2/8 : ARG ALLUXIO_TARBALL=http://downloads.alluxio.org/downloads/files/1.8.0/alluxio-1.8.0-bin.tar.gz
 ---> Using cache
 ---> b4688ec638d2
Step 3/8 : RUN apk add --update bash &&     rm -rf /var/cache/apk/*
 ---> Using cache
 ---> 4904350f2dcf
Step 4/8 : ADD ${ALLUXIO_TARBALL} /opt/
 ---> Using cache
 ---> 46601472bd3e
Step 5/8 : RUN cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio
 ---> Running in a6ab9bd2d9f5
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/libexec': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/client': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/lib': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7': Directory not empty
The command '/bin/sh -c cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio' returned a non-zero code: 1
[root@SZV1000348579 docker]#`

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
--

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: docker build failed using latest 1.8 version with hadoop 2.7

童诚超
docker logs prints

[root@SZV1000348579 alluxio-1.8.0-hadoop-2.7]# docker logs cd9eb2f1e840
/entrypoint.sh: line 93: bin/alluxio: No such file or directory
[root@SZV1000348579 alluxio-1.8.0-hadoop-2.7]# 

i will retry it from the beginning see if things change 

在 2018年9月7日星期五 UTC+8上午1:09:38,Andrew Audibert写道:
I'm able to follow the <a href="https://www.alluxio.org/docs/1.8/en/Running-Alluxio-On-Docker.html" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fwww.alluxio.org%2Fdocs%2F1.8%2Fen%2FRunning-Alluxio-On-Docker.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNG8RZMIn4A78Hpj-A4kbjzGSORWEw&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fwww.alluxio.org%2Fdocs%2F1.8%2Fen%2FRunning-Alluxio-On-Docker.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNG8RZMIn4A78Hpj-A4kbjzGSORWEw&#39;;return true;">tutorial from the docs after only changing "mv" to "ln -s". For the containers that exit, is there any output from running "docker logs" on the container id?

On Wed, Sep 5, 2018 at 11:35 PM 童诚超 <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="3KOdFSBjEQAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">tong....@...> wrote:
Hi , i v tried this new dockerfile, it seems work when pack the image

but issue came up when i tried to start master/slave, they all exited with error code 127

maybe there should be changed within the entrypoint.sh also ?

在 2018年9月6日星期四 UTC+8上午8:05:34,and...@alluxio.com写道:
I think we could work around this issue by changing the Dockerfile to create a symlink instead of performing a rename. Could you try this out and see if it fixes things on your system? <a href="https://github.com/Alluxio/alluxio/pull/7817/files" rel="nofollow" target="_blank" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2FAlluxio%2Falluxio%2Fpull%2F7817%2Ffiles\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHMfFJyYPFEdm692aDUlrLQrQzCKw&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2FAlluxio%2Falluxio%2Fpull%2F7817%2Ffiles\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHMfFJyYPFEdm692aDUlrLQrQzCKw&#39;;return true;">https://github.com/Alluxio/alluxio/pull/7817/files

On Wednesday, September 5, 2018 at 1:59:01 PM UTC-7, Andrew Audibert wrote:
Hi,

This looks like an issue specific to Centos 7 + Docker. If an image adds and then tries to move or remove a file, the removal will fail if the filesystem is formatted incorrectly. Can you check whether your xfs partition has ftype 0?

<a href="https://github.com/moby/moby/issues/27358#issuecomment-254066211" rel="nofollow" target="_blank" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fmoby%2Fmoby%2Fissues%2F27358%23issuecomment-254066211\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFIgRgvUxo7zFLZnS2ETqGsXAaCEg&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fmoby%2Fmoby%2Fissues%2F27358%23issuecomment-254066211\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFIgRgvUxo7zFLZnS2ETqGsXAaCEg&#39;;return true;">https://github.com/moby/moby/issues/27358#issuecomment-254066211
After further investigation, I noticed that my xfs partition had ftype set to 0. Red Hat states that xfs partitions need to be formatted with ftype set to 1 if they are to be used with overlay.
<a href="https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/7.2_Release_Notes/technology-preview-file_systems.html" rel="nofollow" style="background-color:transparent;color:rgb(3,102,214)" target="_blank" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Faccess.redhat.com%2Fdocumentation%2Fen-US%2FRed_Hat_Enterprise_Linux%2F7%2Fhtml%2F7.2_Release_Notes%2Ftechnology-preview-file_systems.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLYAXLx3GbxEPhy5B9fO87ZfNELg&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Faccess.redhat.com%2Fdocumentation%2Fen-US%2FRed_Hat_Enterprise_Linux%2F7%2Fhtml%2F7.2_Release_Notes%2Ftechnology-preview-file_systems.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLYAXLx3GbxEPhy5B9fO87ZfNELg&#39;;return true;">https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/7.2_Release_Notes/technology-preview-file_systems.html
I guess the issue can now be closed as it's not Docker related. Hopefully people who encounter this issue can stumble upon this issue for a solution.

- Andrew

On Monday, September 3, 2018 at 1:30:11 AM UTC-7, 童诚超 wrote:

in alluxio quick start of running alluxio in docker chapter, i came up with following problem.

iv tried the docker cmd in my centos 7.4 it works fine , but why it kept failing in docker build...

any1 can help is highly appreciated!  thankyou !

`[root@SZV1000348579 docker]# docker build -t alluxio --build-arg http_proxy=<a href="http://10.171.121.97:8848" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.171.121.97%3A8848\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEu6oSxOeNFVFKc3OYwxKIWVeP9ag&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.171.121.97%3A8848\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEu6oSxOeNFVFKc3OYwxKIWVeP9ag&#39;;return true;">http://10.171.121.97:8848 --build-arg ALLUXIO_TARBALL=alluxio-1.8.0-hadoop-2.7-bin.tar.gz .
Sending build context to Docker daemon  371.5MB
Step 1/8 : FROM openjdk:8-jdk-alpine
 ---> 5801f7d008e5
Step 2/8 : ARG ALLUXIO_TARBALL=<a href="http://downloads.alluxio.org/downloads/files/1.8.0/alluxio-1.8.0-bin.tar.gz" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fdownloads.alluxio.org%2Fdownloads%2Ffiles%2F1.8.0%2Falluxio-1.8.0-bin.tar.gz\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNF_0HhpdVKg6aRp6gSg8U3NVU-ieg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fdownloads.alluxio.org%2Fdownloads%2Ffiles%2F1.8.0%2Falluxio-1.8.0-bin.tar.gz\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNF_0HhpdVKg6aRp6gSg8U3NVU-ieg&#39;;return true;">http://downloads.alluxio.org/downloads/files/1.8.0/alluxio-1.8.0-bin.tar.gz
 ---> Using cache
 ---> b4688ec638d2
Step 3/8 : RUN apk add --update bash &&     rm -rf /var/cache/apk/*
 ---> Using cache
 ---> 4904350f2dcf
Step 4/8 : ADD ${ALLUXIO_TARBALL} /opt/
 ---> Using cache
 ---> 46601472bd3e
Step 5/8 : RUN cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio
 ---> Running in a6ab9bd2d9f5
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/libexec': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/client': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/lib': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7': Directory not empty
The command '/bin/sh -c cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio' returned a non-zero code: 1
[root@SZV1000348579 docker]#`

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="3KOdFSBjEQAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">alluxio-user...@googlegroups.com.
For more options, visit <a href="https://groups.google.com/d/optout" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;">https://groups.google.com/d/optout.
--
Andrew Audibert
<a href="http://alluxio.com/" style="color:rgb(17,85,204);font-size:12.8px" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Falluxio.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEOzcgHeqiDCH9tkk9r99TjTZX7Nw&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Falluxio.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEOzcgHeqiDCH9tkk9r99TjTZX7Nw&#39;;return true;">Alluxio, Inc. | <a href="http://bit.ly/alluxio-open-source" style="color:rgb(17,85,204)" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-open-source\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEDNVXZleOB7VIXYMM8vGuSeh4NQw&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-open-source\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEDNVXZleOB7VIXYMM8vGuSeh4NQw&#39;;return true;">Alluxio Open Source | <a href="http://bit.ly/alluxio-get-involved" style="color:rgb(17,85,204)" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-get-involved\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEMkj0A_5qpmy2ZeIJGUV1QLgzxRg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-get-involved\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEMkj0A_5qpmy2ZeIJGUV1QLgzxRg&#39;;return true;">Alluxio Community Site

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: docker build failed using latest 1.8 version with hadoop 2.7

童诚超
In reply to this post by Andrew Audibert
after retry the whole tutorial now its working perfectly in containers !

the reason i think maybe there are some typo or misconfig in environment , anyway its been resolved .

thanks for your concern with this issue!

在 2018年9月7日星期五 UTC+8上午1:09:38,Andrew Audibert写道:
I'm able to follow the <a href="https://www.alluxio.org/docs/1.8/en/Running-Alluxio-On-Docker.html" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fwww.alluxio.org%2Fdocs%2F1.8%2Fen%2FRunning-Alluxio-On-Docker.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNG8RZMIn4A78Hpj-A4kbjzGSORWEw&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fwww.alluxio.org%2Fdocs%2F1.8%2Fen%2FRunning-Alluxio-On-Docker.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNG8RZMIn4A78Hpj-A4kbjzGSORWEw&#39;;return true;">tutorial from the docs after only changing "mv" to "ln -s". For the containers that exit, is there any output from running "docker logs" on the container id?

On Wed, Sep 5, 2018 at 11:35 PM 童诚超 <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="3KOdFSBjEQAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">tong....@...> wrote:
Hi , i v tried this new dockerfile, it seems work when pack the image

but issue came up when i tried to start master/slave, they all exited with error code 127

maybe there should be changed within the entrypoint.sh also ?

在 2018年9月6日星期四 UTC+8上午8:05:34,and...@alluxio.com写道:
I think we could work around this issue by changing the Dockerfile to create a symlink instead of performing a rename. Could you try this out and see if it fixes things on your system? <a href="https://github.com/Alluxio/alluxio/pull/7817/files" rel="nofollow" target="_blank" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2FAlluxio%2Falluxio%2Fpull%2F7817%2Ffiles\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHMfFJyYPFEdm692aDUlrLQrQzCKw&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2FAlluxio%2Falluxio%2Fpull%2F7817%2Ffiles\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHMfFJyYPFEdm692aDUlrLQrQzCKw&#39;;return true;">https://github.com/Alluxio/alluxio/pull/7817/files

On Wednesday, September 5, 2018 at 1:59:01 PM UTC-7, Andrew Audibert wrote:
Hi,

This looks like an issue specific to Centos 7 + Docker. If an image adds and then tries to move or remove a file, the removal will fail if the filesystem is formatted incorrectly. Can you check whether your xfs partition has ftype 0?

<a href="https://github.com/moby/moby/issues/27358#issuecomment-254066211" rel="nofollow" target="_blank" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fmoby%2Fmoby%2Fissues%2F27358%23issuecomment-254066211\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFIgRgvUxo7zFLZnS2ETqGsXAaCEg&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fmoby%2Fmoby%2Fissues%2F27358%23issuecomment-254066211\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFIgRgvUxo7zFLZnS2ETqGsXAaCEg&#39;;return true;">https://github.com/moby/moby/issues/27358#issuecomment-254066211
After further investigation, I noticed that my xfs partition had ftype set to 0. Red Hat states that xfs partitions need to be formatted with ftype set to 1 if they are to be used with overlay.
<a href="https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/7.2_Release_Notes/technology-preview-file_systems.html" rel="nofollow" style="background-color:transparent;color:rgb(3,102,214)" target="_blank" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Faccess.redhat.com%2Fdocumentation%2Fen-US%2FRed_Hat_Enterprise_Linux%2F7%2Fhtml%2F7.2_Release_Notes%2Ftechnology-preview-file_systems.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLYAXLx3GbxEPhy5B9fO87ZfNELg&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Faccess.redhat.com%2Fdocumentation%2Fen-US%2FRed_Hat_Enterprise_Linux%2F7%2Fhtml%2F7.2_Release_Notes%2Ftechnology-preview-file_systems.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLYAXLx3GbxEPhy5B9fO87ZfNELg&#39;;return true;">https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/7.2_Release_Notes/technology-preview-file_systems.html
I guess the issue can now be closed as it's not Docker related. Hopefully people who encounter this issue can stumble upon this issue for a solution.

- Andrew

On Monday, September 3, 2018 at 1:30:11 AM UTC-7, 童诚超 wrote:

in alluxio quick start of running alluxio in docker chapter, i came up with following problem.

iv tried the docker cmd in my centos 7.4 it works fine , but why it kept failing in docker build...

any1 can help is highly appreciated!  thankyou !

`[root@SZV1000348579 docker]# docker build -t alluxio --build-arg http_proxy=<a href="http://10.171.121.97:8848" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.171.121.97%3A8848\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEu6oSxOeNFVFKc3OYwxKIWVeP9ag&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.171.121.97%3A8848\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEu6oSxOeNFVFKc3OYwxKIWVeP9ag&#39;;return true;">http://10.171.121.97:8848 --build-arg ALLUXIO_TARBALL=alluxio-1.8.0-hadoop-2.7-bin.tar.gz .
Sending build context to Docker daemon  371.5MB
Step 1/8 : FROM openjdk:8-jdk-alpine
 ---> 5801f7d008e5
Step 2/8 : ARG ALLUXIO_TARBALL=<a href="http://downloads.alluxio.org/downloads/files/1.8.0/alluxio-1.8.0-bin.tar.gz" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fdownloads.alluxio.org%2Fdownloads%2Ffiles%2F1.8.0%2Falluxio-1.8.0-bin.tar.gz\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNF_0HhpdVKg6aRp6gSg8U3NVU-ieg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fdownloads.alluxio.org%2Fdownloads%2Ffiles%2F1.8.0%2Falluxio-1.8.0-bin.tar.gz\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNF_0HhpdVKg6aRp6gSg8U3NVU-ieg&#39;;return true;">http://downloads.alluxio.org/downloads/files/1.8.0/alluxio-1.8.0-bin.tar.gz
 ---> Using cache
 ---> b4688ec638d2
Step 3/8 : RUN apk add --update bash &&     rm -rf /var/cache/apk/*
 ---> Using cache
 ---> 4904350f2dcf
Step 4/8 : ADD ${ALLUXIO_TARBALL} /opt/
 ---> Using cache
 ---> 46601472bd3e
Step 5/8 : RUN cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio
 ---> Running in a6ab9bd2d9f5
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/libexec': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/client': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/lib': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7': Directory not empty
The command '/bin/sh -c cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio' returned a non-zero code: 1
[root@SZV1000348579 docker]#`

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="3KOdFSBjEQAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">alluxio-user...@googlegroups.com.
For more options, visit <a href="https://groups.google.com/d/optout" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;">https://groups.google.com/d/optout.
--
Andrew Audibert
<a href="http://alluxio.com/" style="color:rgb(17,85,204);font-size:12.8px" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Falluxio.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEOzcgHeqiDCH9tkk9r99TjTZX7Nw&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Falluxio.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEOzcgHeqiDCH9tkk9r99TjTZX7Nw&#39;;return true;">Alluxio, Inc. | <a href="http://bit.ly/alluxio-open-source" style="color:rgb(17,85,204)" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-open-source\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEDNVXZleOB7VIXYMM8vGuSeh4NQw&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-open-source\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEDNVXZleOB7VIXYMM8vGuSeh4NQw&#39;;return true;">Alluxio Open Source | <a href="http://bit.ly/alluxio-get-involved" style="color:rgb(17,85,204)" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-get-involved\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEMkj0A_5qpmy2ZeIJGUV1QLgzxRg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-get-involved\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEMkj0A_5qpmy2ZeIJGUV1QLgzxRg&#39;;return true;">Alluxio Community Site

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: docker build failed using latest 1.8 version with hadoop 2.7

Andrew Audibert
Glad to hear you got it working!

On Thu, Sep 13, 2018 at 2:30 AM 童诚超 <[hidden email]> wrote:
after retry the whole tutorial now its working perfectly in containers !

the reason i think maybe there are some typo or misconfig in environment , anyway its been resolved .

thanks for your concern with this issue!


在 2018年9月7日星期五 UTC+8上午1:09:38,Andrew Audibert写道:
I'm able to follow the tutorial from the docs after only changing "mv" to "ln -s". For the containers that exit, is there any output from running "docker logs" on the container id?

On Wed, Sep 5, 2018 at 11:35 PM 童诚超 <[hidden email]> wrote:
Hi , i v tried this new dockerfile, it seems work when pack the image

but issue came up when i tried to start master/slave, they all exited with error code 127

maybe there should be changed within the entrypoint.sh also ?

在 2018年9月6日星期四 UTC+8上午8:05:34,[hidden email]写道:
I think we could work around this issue by changing the Dockerfile to create a symlink instead of performing a rename. Could you try this out and see if it fixes things on your system? https://github.com/Alluxio/alluxio/pull/7817/files

On Wednesday, September 5, 2018 at 1:59:01 PM UTC-7, Andrew Audibert wrote:
Hi,

This looks like an issue specific to Centos 7 + Docker. If an image adds and then tries to move or remove a file, the removal will fail if the filesystem is formatted incorrectly. Can you check whether your xfs partition has ftype 0?

After further investigation, I noticed that my xfs partition had ftype set to 0. Red Hat states that xfs partitions need to be formatted with ftype set to 1 if they are to be used with overlay.
https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/7.2_Release_Notes/technology-preview-file_systems.html
I guess the issue can now be closed as it's not Docker related. Hopefully people who encounter this issue can stumble upon this issue for a solution.

- Andrew

On Monday, September 3, 2018 at 1:30:11 AM UTC-7, 童诚超 wrote:

in alluxio quick start of running alluxio in docker chapter, i came up with following problem.

iv tried the docker cmd in my centos 7.4 it works fine , but why it kept failing in docker build...

any1 can help is highly appreciated!  thankyou !

`[root@SZV1000348579 docker]# docker build -t alluxio --build-arg http_proxy=http://10.171.121.97:8848 --build-arg ALLUXIO_TARBALL=alluxio-1.8.0-hadoop-2.7-bin.tar.gz .
Sending build context to Docker daemon  371.5MB
Step 1/8 : FROM openjdk:8-jdk-alpine
 ---> 5801f7d008e5
Step 2/8 : ARG ALLUXIO_TARBALL=http://downloads.alluxio.org/downloads/files/1.8.0/alluxio-1.8.0-bin.tar.gz
 ---> Using cache
 ---> b4688ec638d2
Step 3/8 : RUN apk add --update bash &&     rm -rf /var/cache/apk/*
 ---> Using cache
 ---> 4904350f2dcf
Step 4/8 : ADD ${ALLUXIO_TARBALL} /opt/
 ---> Using cache
 ---> 46601472bd3e
Step 5/8 : RUN cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio
 ---> Running in a6ab9bd2d9f5
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/server': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client/target': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly/client': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/assembly': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/docker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/checker': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/mesos': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/kubernetes': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/yarn': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration/fuse': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/integration': Directory not empty
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/libexec': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/bin': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/conf': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/client': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7/lib': Invalid argument
mv: can't remove 'alluxio-1.8.0-hadoop-2.7': Directory not empty
The command '/bin/sh -c cd /opt &&     (if ls | grep -q ".tar.gz"; then tar -xzf *.tar.gz && rm *.tar.gz; fi) &&     mv alluxio-* alluxio' returned a non-zero code: 1
[root@SZV1000348579 docker]#`

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
--

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.