Need mkdir Permission When LoadMetadata of a path

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

Need mkdir Permission When LoadMetadata of a path

baiquan

When doing LoadMetadata /warehouse/xxxxx/date=20181125
 I find alluxio need to mkdir on hdfs, and it  failed (because the root dir is set readonly by hdfs admin)

2018-11-24 02:28:40,769 WARN  HdfsUnderFileSystem - 2 try to make directory for hdfs://xxx/warehouse : The directory / is frozen, pleas
e change another directory
.
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:169)
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:858)
        at sun
.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
        at sun
.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java
.lang.reflect.Method.invoke(Method.java:498)
        at com
.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
        at com
.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
        at com
.sun.proxy.$Proxy24.mkdirs(Unknown Source)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolPr
otos
.java)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocol
Protos.java)
        at org
.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
        at org
.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
        at java
.security.AccessController.doPrivileged(Native Method)
        at javax
.security.auth.Subject.doAs(Subject.java:422)
        at org
.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1705)
        at org
.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)

2018-11-26 12:56:44,825 WARN  FileSystemMasterClientServiceHandler - Exit (Error): LoadMetadata: alluxioPath=/warehouse/xxxxx/date=20181125, recursive=false, options=LoadMetadataTOptions(), Error=org.apache.hadoop.hdfs.protocol.NSQuotaExceededException: The directory / is frozen, please change another directory.
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:169)
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:858)
        at sun
.reflect.GeneratedMethodAccessor74.invoke(Unknown Source)
        at sun
.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java
.lang.reflect.Method.invoke(Method.java:498)
        at com
.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
        at com
.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
        at com
.sun.proxy.$Proxy24.mkdirs(Unknown Source)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolProtos.java)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocolProtos.java)
        at org
.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
        at org
.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)

        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
        at java
.security.AccessController.doPrivileged(Native Method)
        at javax
.security.auth.Subject.doAs(Subject.java:422)
        at org
.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1705)
        at org
.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)


I want to know: whether We can load a file without change anything with hdfs

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.

21543211131_.pic_hd.jpg (1M) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Need mkdir Permission When LoadMetadata of a path

binfan
Administrator
Hi Baiquan,

can you specify the version of Alluxio you are using?

Thanks

- Bin

On Sunday, November 25, 2018 at 11:55:39 PM UTC-8, [hidden email] wrote:

When doing LoadMetadata /warehouse/xxxxx/date=20181125
 I find alluxio need to mkdir on hdfs, and it  failed (because the root dir is set readonly by hdfs admin)

2018-11-24 02:28:40,769 WARN  HdfsUnderFileSystem - 2 try to make directory for hdfs://xxx/warehouse : The directory / is frozen, pleas
e change another directory
.
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:169)
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:858)
        at sun
.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
        at sun
.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java
.lang.reflect.Method.invoke(Method.java:498)
        at com
.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
        at com
.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
        at com
.sun.proxy.$Proxy24.mkdirs(Unknown Source)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolPr
otos
.java)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocol
Protos.java)
        at org
.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
        at org
.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
        at java
.security.AccessController.doPrivileged(Native Method)
        at javax
.security.auth.Subject.doAs(Subject.java:422)
        at org
.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1705)
        at org
.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)

2018-11-26 12:56:44,825 WARN  FileSystemMasterClientServiceHandler - Exit (Error): LoadMetadata: alluxioPath=/warehouse/xxxxx/date=20181125, recursive=false, options=LoadMetadataTOptions(), Error=org.apache.hadoop.hdfs.protocol.NSQuotaExceededException: The directory / is frozen, please change another directory.
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:169)
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:858)
        at sun
.reflect.GeneratedMethodAccessor74.invoke(Unknown Source)
        at sun
.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java
.lang.reflect.Method.invoke(Method.java:498)
        at com
.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
        at com
.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
        at com
.sun.proxy.$Proxy24.mkdirs(Unknown Source)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolProtos.java)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocolProtos.java)
        at org
.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
        at org
.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)

        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
        at java
.security.AccessController.doPrivileged(Native Method)
        at javax
.security.auth.Subject.doAs(Subject.java:422)
        at org
.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1705)
        at org
.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)


I want to know: whether We can load a file without change anything with hdfs

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Need mkdir Permission When LoadMetadata of a path

wayasxxx
1.8.0

在 2018年11月26日星期一 UTC+8下午9:10:20,Bin Fan写道:
Hi Baiquan,

can you specify the version of Alluxio you are using?

Thanks

- Bin

On Sunday, November 25, 2018 at 11:55:39 PM UTC-8, <a href="javascript:" target="_blank" gdf-obfuscated-mailto="ijTnFbamBwAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">bai...@... wrote:

When doing LoadMetadata /warehouse/xxxxx/date=20181125
 I find alluxio need to mkdir on hdfs, and it  failed (because the root dir is set readonly by hdfs admin)

2018-11-24 02:28:40,769 WARN  HdfsUnderFileSystem - 2 try to make directory for hdfs://xxx/warehouse : The directory / is frozen, pleas
e change another directory
.
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:169)
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:858)
        at sun
.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
        at sun
.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java
.lang.reflect.Method.invoke(Method.java:498)
        at com
.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
        at com
.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
        at com
.sun.proxy.$Proxy24.mkdirs(Unknown Source)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolPr
otos
.java)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocol
Protos.java)
        at org
.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
        at org
.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
        at java
.security.AccessController.doPrivileged(Native Method)
        at javax
.security.auth.Subject.doAs(Subject.java:422)
        at org
.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1705)
        at org
.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)

2018-11-26 12:56:44,825 WARN  FileSystemMasterClientServiceHandler - Exit (Error): LoadMetadata: alluxioPath=/warehouse/xxxxx/date=20181125, recursive=false, options=LoadMetadataTOptions(), Error=org.apache.hadoop.hdfs.protocol.NSQuotaExceededException: The directory / is frozen, please change another directory.
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:169)
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:858)
        at sun
.reflect.GeneratedMethodAccessor74.invoke(Unknown Source)
        at sun
.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java
.lang.reflect.Method.invoke(Method.java:498)
        at com
.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
        at com
.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
        at com
.sun.proxy.$Proxy24.mkdirs(Unknown Source)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolProtos.java)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocolProtos.java)
        at org
.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
        at org
.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)

        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
        at java
.security.AccessController.doPrivileged(Native Method)
        at javax
.security.auth.Subject.doAs(Subject.java:422)
        at org
.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1705)
        at org
.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)


I want to know: whether We can load a file without change anything with hdfs

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Need mkdir Permission When LoadMetadata of a path

binfan
Administrator
In reply to this post by baiquan
Hi Baiquan,

To answer your question shortly, the --readOnly option for mount should prevernt
writing to UFS (HDFS in your case). 
A few more questions to help us identify your problem and see if there is any missing
cases:

(1) do you have a complete trace stack for the following error message?
It will be very helpful to see where in Alluxio code throws this exception.


2018-11-26 12:56:44,825 WARN  FileSystemMasterClientServiceHandler - Exit (Error): LoadMetadata: alluxioPath=/warehouse/xxxxx/date=20181125, recursive=false, options=LoadMetadataTOptions(), Error=org.apache.hadoop.hdfs.protocol.NSQuotaExceededException: The directory / is frozen, please change another directory.
        at com.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:169)
        at com.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:858)
        at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
        at com.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
        at com.sun.proxy.$Proxy24.mkdirs(Unknown Source)
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolProtos.java)
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocolProtos.java)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1705)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)

(2) Can you tell us the state for each of the following Alluxio directories before the error: 

/warehouse
/warehouse/xxxxx
/warehouse/xxxxx/date=2018112,

   (a) does the directory exist in Alluxio
   (b) does the directory exist in HDFS
   (c) the persist state of the directory in Alluxio


This will help us identify the problem.

Thanks!

- Bin

On Sunday, November 25, 2018 at 11:55:39 PM UTC-8, [hidden email] wrote:

When doing LoadMetadata /warehouse/xxxxx/date=20181125
 I find alluxio need to mkdir on hdfs, and it  failed (because the root dir is set readonly by hdfs admin)

2018-11-24 02:28:40,769 WARN  HdfsUnderFileSystem - 2 try to make directory for hdfs://xxx/warehouse : The directory / is frozen, pleas
e change another directory
.
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:169)
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:858)
        at sun
.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
        at sun
.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java
.lang.reflect.Method.invoke(Method.java:498)
        at com
.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
        at com
.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
        at com
.sun.proxy.$Proxy24.mkdirs(Unknown Source)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolPr
otos
.java)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocol
Protos.java)
        at org
.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
        at org
.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
        at java
.security.AccessController.doPrivileged(Native Method)
        at javax
.security.auth.Subject.doAs(Subject.java:422)
        at org
.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1705)
        at org
.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)

2018-11-26 12:56:44,825 WARN  FileSystemMasterClientServiceHandler - Exit (Error): LoadMetadata: alluxioPath=/warehouse/xxxxx/date=20181125, recursive=false, options=LoadMetadataTOptions(), Error=org.apache.hadoop.hdfs.protocol.NSQuotaExceededException: The directory / is frozen, please change another directory.
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:169)
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:858)
        at sun
.reflect.GeneratedMethodAccessor74.invoke(Unknown Source)
        at sun
.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java
.lang.reflect.Method.invoke(Method.java:498)
        at com
.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
        at com
.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
        at com
.sun.proxy.$Proxy24.mkdirs(Unknown Source)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolProtos.java)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocolProtos.java)
        at org
.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
        at org
.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)

        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
        at java
.security.AccessController.doPrivileged(Native Method)
        at javax
.security.auth.Subject.doAs(Subject.java:422)
        at org
.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1705)
        at org
.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)


I want to know: whether We can load a file without change anything with hdfs

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Need mkdir Permission When LoadMetadata of a path

baiquan
(1) I'm so sorry. this it the whole trace log in our alluxio master log.
(2) Here are some log on client, which may help you find what master do when receive RPC:
在此输入代码...Caused by: alluxio.exception.status.UnknownException: The directory / is frozen, please change another directory. For more information, please contact with administrator.
    at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:167)
    at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:859)
    at sun
.reflect.GeneratedMethodAccessor87.invoke(Unknown Source)
    at sun
.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java
.lang.reflect.Method.invoke(Method.java:498)
    at com
.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
    at com
.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
    at com
.sun.proxy.$Proxy24.mkdirs(Unknown Source)
    at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolProtos.java)
    at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocolProtos.java)
    at org
.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
    at org
.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
    at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)
    at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
    at java
.security.AccessController.doPrivileged(Native Method)
    at javax
.security.auth.Subject.doAs(Subject.java:422)
    at org
.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1706)
    at org
.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)

    at alluxio
.exception.status.AlluxioStatusException.from(AlluxioStatusException.java:176)
    at alluxio
.exception.status.AlluxioStatusException.fromThrift(AlluxioStatusException.java:130)
    at alluxio
.AbstractClient.retryRPCInternal(AbstractClient.java:432)
    at alluxio
.AbstractClient.retryRPC(AbstractClient.java:410)
   
at alluxio.client.file.RetryHandlingFileSystemMasterClient.loadMetadata(RetryHandlingFileSystemMasterClient.java:181)
    at alluxio
.client.file.BaseFileSystem.loadMetadata(BaseFileSystem.java:301)






(2)  I test the follow dir using "hadoop fs -ls" . Here are the result:
        /warehouse "not exist"
        /warehouse/xxxxx "exist"
        /warehouse/xxxxx/date=2018112,"exist"
    And there are all "not exist" in alluxio

What I know is that Our HDFS admin have some hidden-strategys that made /warehouse "not exist".

I guess:when LoadMetadata ,alluxio will check all paths on the tree of it's parent dirs . If it "not exist" in HDFS, alluxio will mkdir on HDFS

In our case. /warehouse "not exist" ,so it will mkdir on HDFS, and failed due to permission
 

在 2018年11月28日星期三 UTC+8上午1:51:55,Bin Fan写道:
Hi Baiquan,

To answer your question shortly, the --readOnly option for mount should prevernt
writing to UFS (HDFS in your case). 
A few more questions to help us identify your problem and see if there is any missing
cases:

(1) do you have a complete trace stack for the following error message?
It will be very helpful to see where in Alluxio code throws this exception.


2018-11-26 12:56:44,825 WARN  FileSystemMasterClientServiceHandler - Exit (Error): LoadMetadata: alluxioPath=/warehouse/xxxxx/date=20181125, recursive=false, options=LoadMetadataTOptions(), Error=org.apache.hadoop.hdfs.protocol.NSQuotaExceededException: The directory / is frozen, please change another directory.
        at com.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:169)
        at com.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:858)
        at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
        at com.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
        at com.sun.proxy.$Proxy24.mkdirs(Unknown Source)
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolProtos.java)
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocolProtos.java)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1705)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)

(2) Can you tell us the state for each of the following Alluxio directories before the error: 

/warehouse
/warehouse/xxxxx
/warehouse/xxxxx/date=2018112,

   (a) does the directory exist in Alluxio
   (b) does the directory exist in HDFS
   (c) the persist state of the directory in Alluxio


This will help us identify the problem.

Thanks!

- Bin

On Sunday, November 25, 2018 at 11:55:39 PM UTC-8, <a href="javascript:" target="_blank" gdf-obfuscated-mailto="MHNhKagECAAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">bai...@... wrote:

When doing LoadMetadata /warehouse/xxxxx/date=20181125
 I find alluxio need to mkdir on hdfs, and it  failed (because the root dir is set readonly by hdfs admin)

2018-11-24 02:28:40,769 WARN  HdfsUnderFileSystem - 2 try to make directory for hdfs://xxx/warehouse : The directory / is frozen, pleas
e change another directory
.
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:169)
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:858)
        at sun
.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
        at sun
.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java
.lang.reflect.Method.invoke(Method.java:498)
        at com
.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
        at com
.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
        at com
.sun.proxy.$Proxy24.mkdirs(Unknown Source)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolPr
otos
.java)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocol
Protos.java)
        at org
.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
        at org
.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
        at java
.security.AccessController.doPrivileged(Native Method)
        at javax
.security.auth.Subject.doAs(Subject.java:422)
        at org
.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1705)
        at org
.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)

2018-11-26 12:56:44,825 WARN  FileSystemMasterClientServiceHandler - Exit (Error): LoadMetadata: alluxioPath=/warehouse/xxxxx/date=20181125, recursive=false, options=LoadMetadataTOptions(), Error=org.apache.hadoop.hdfs.protocol.NSQuotaExceededException: The directory / is frozen, please change another directory.
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:169)
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:858)
        at sun
.reflect.GeneratedMethodAccessor74.invoke(Unknown Source)
        at sun
.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java
.lang.reflect.Method.invoke(Method.java:498)
        at com
.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
        at com
.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
        at com
.sun.proxy.$Proxy24.mkdirs(Unknown Source)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolProtos.java)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocolProtos.java)
        at org
.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
        at org
.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)

        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
        at java
.security.AccessController.doPrivileged(Native Method)
        at javax
.security.auth.Subject.doAs(Subject.java:422)
        at org
.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1705)
        at org
.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)


I want to know: whether We can load a file without change anything with hdfs

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Need mkdir Permission When LoadMetadata of a path

binfan
Administrator
Hi Baiquan,

We are investigating this issue. I will post update later if we make some progress

On Tuesday, November 27, 2018 at 6:54:31 PM UTC-8, [hidden email] wrote:
(1) I'm so sorry. this it the whole trace log in our alluxio master log.
(2) Here are some log on client, which may help you find what master do when receive RPC:
在此输入代码...Caused by: alluxio.exception.status.UnknownException: The directory / is frozen, please change another directory. For more information, please contact with administrator.
    at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:167)
    at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:859)
    at sun
.reflect.GeneratedMethodAccessor87.invoke(Unknown Source)
    at sun
.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java
.lang.reflect.Method.invoke(Method.java:498)
    at com
.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
    at com
.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
    at com
.sun.proxy.$Proxy24.mkdirs(Unknown Source)
    at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolProtos.java)
    at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocolProtos.java)
    at org
.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
    at org
.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
    at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)
    at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
    at java
.security.AccessController.doPrivileged(Native Method)
    at javax
.security.auth.Subject.doAs(Subject.java:422)
    at org
.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1706)
    at org
.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)

    at alluxio
.exception.status.AlluxioStatusException.from(AlluxioStatusException.java:176)
    at alluxio
.exception.status.AlluxioStatusException.fromThrift(AlluxioStatusException.java:130)
    at alluxio
.AbstractClient.retryRPCInternal(AbstractClient.java:432)
    at alluxio
.AbstractClient.retryRPC(AbstractClient.java:410)
   
at alluxio.client.file.RetryHandlingFileSystemMasterClient.loadMetadata(RetryHandlingFileSystemMasterClient.java:181)
    at alluxio
.client.file.BaseFileSystem.loadMetadata(BaseFileSystem.java:301)






(2)  I test the follow dir using "hadoop fs -ls" . Here are the result:
        /warehouse "not exist"
        /warehouse/xxxxx "exist"
        /warehouse/xxxxx/date=2018112,"exist"
    And there are all "not exist" in alluxio

What I know is that Our HDFS admin have some hidden-strategys that made /warehouse "not exist".

I guess:when LoadMetadata ,alluxio will check all paths on the tree of it's parent dirs . If it "not exist" in HDFS, alluxio will mkdir on HDFS

In our case. /warehouse "not exist" ,so it will mkdir on HDFS, and failed due to permission
 

在 2018年11月28日星期三 UTC+8上午1:51:55,Bin Fan写道:
Hi Baiquan,

To answer your question shortly, the --readOnly option for mount should prevernt
writing to UFS (HDFS in your case). 
A few more questions to help us identify your problem and see if there is any missing
cases:

(1) do you have a complete trace stack for the following error message?
It will be very helpful to see where in Alluxio code throws this exception.


2018-11-26 12:56:44,825 WARN  FileSystemMasterClientServiceHandler - Exit (Error): LoadMetadata: alluxioPath=/warehouse/xxxxx/date=20181125, recursive=false, options=LoadMetadataTOptions(), Error=org.apache.hadoop.hdfs.protocol.NSQuotaExceededException: The directory / is frozen, please change another directory.
        at com.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:169)
        at com.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:858)
        at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
        at com.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
        at com.sun.proxy.$Proxy24.mkdirs(Unknown Source)
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolProtos.java)
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocolProtos.java)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1705)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)

(2) Can you tell us the state for each of the following Alluxio directories before the error: 

/warehouse
/warehouse/xxxxx
/warehouse/xxxxx/date=2018112,

   (a) does the directory exist in Alluxio
   (b) does the directory exist in HDFS
   (c) the persist state of the directory in Alluxio


This will help us identify the problem.

Thanks!

- Bin

On Sunday, November 25, 2018 at 11:55:39 PM UTC-8, [hidden email] wrote:

When doing LoadMetadata /warehouse/xxxxx/date=20181125
 I find alluxio need to mkdir on hdfs, and it  failed (because the root dir is set readonly by hdfs admin)

2018-11-24 02:28:40,769 WARN  HdfsUnderFileSystem - 2 try to make directory for hdfs://xxx/warehouse : The directory / is frozen, pleas
e change another directory
.
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:169)
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:858)
        at sun
.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
        at sun
.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java
.lang.reflect.Method.invoke(Method.java:498)
        at com
.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
        at com
.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
        at com
.sun.proxy.$Proxy24.mkdirs(Unknown Source)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolPr
otos
.java)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocol
Protos.java)
        at org
.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
        at org
.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
        at java
.security.AccessController.doPrivileged(Native Method)
        at javax
.security.auth.Subject.doAs(Subject.java:422)
        at org
.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1705)
        at org
.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)

2018-11-26 12:56:44,825 WARN  FileSystemMasterClientServiceHandler - Exit (Error): LoadMetadata: alluxioPath=/warehouse/xxxxx/date=20181125, recursive=false, options=LoadMetadataTOptions(), Error=org.apache.hadoop.hdfs.protocol.NSQuotaExceededException: The directory / is frozen, please change another directory.
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.checkFrozen(ProxyClientProtocolHandlerNBPB.java:169)
        at com
.bytedance.hadoop.hdfs.server.proxy.ProxyClientProtocolHandlerNBPB.mkdirs(ProxyClientProtocolHandlerNBPB.java:858)
        at sun
.reflect.GeneratedMethodAccessor74.invoke(Unknown Source)
        at sun
.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java
.lang.reflect.Method.invoke(Method.java:498)
        at com
.bytedance.hadoop.hdfs.server.proxy.BaseRpcInvocationProxy.invokeMethod(BaseRpcInvocationProxy.java:89)
        at com
.bytedance.hadoop.hdfs.server.proxy.RpcInvocationProxyNB.invoke(RpcInvocationProxyNB.java:93)
        at com
.sun.proxy.$Proxy24.mkdirs(Unknown Source)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$1.mkdirs(ClientNamenodeProtocolProtos.java)
        at org
.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol.callMethod(ClientNamenodeProtocolProtos.java)
        at org
.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:751)
        at org
.apache.hadoop.ipc.RPC$Server.call(RPC.java:1078)
        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226)

        at org
.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2222)
        at java
.security.AccessController.doPrivileged(Native Method)
        at javax
.security.auth.Subject.doAs(Subject.java:422)
        at org
.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1705)
        at org
.apache.hadoop.ipc.Server$Handler.run(Server.java:2222)


I want to know: whether We can load a file without change anything with hdfs

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.