java.lang.IllegalArgumentException: Wrong FS: alluxio://ip: expected: hdfs://ip:

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

java.lang.IllegalArgumentException: Wrong FS: alluxio://ip: expected: hdfs://ip:

Sambhu R
Hello,

Hadoop-Version: Apache-3.1.0
Alluxio-version:   1.7
Mounted hdfs to  Alluxio

I'm trying to run 'WordMean' in hadoop:
hadoop jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar wordmean alluxio://nn-alluxio:19998/1gb/ alluxio://nn-alluxio:19998/sortqw
and
No error.....

but can't run:

hadoop jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar wordmean alluxio://nn-alluxio:19998/1gb/ alluxio://nn-alluxio:19998/sortqqqq

error: java.lang.IllegalArgumentException: Wrong FS: alluxio://nn-alluxio:19998/sortqqqq/part-r-00000, expected: hdfs://nn-alluxio:9000
    at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:781)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:240)
    at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1569)



please note :
Input file: alluxio://nn-alluxio:19998/1gb/ is in hdfs

Output file: I'm trying to write in Alluxio..


Also note that I have no problem running wordcount, Can write in alluxio file system

Please help...... thank you...








--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: java.lang.IllegalArgumentException: Wrong FS: alluxio://ip: expected: hdfs://ip:

Andrew Audibert
Hi Sambhu,

It could be that WordMean relies on fs.default.name to create its FileSystem. Try configuring

<property>
   <name>fs.default.name</name>
   <value>alluxio://nn-alluxio:19998/</value>
</property>

HDFS FileSystems can be constructed either with a URI+config, or just config. When using URI+config, fs.default.name isn't necessary since HDFS can figure out the FileSystem from the URI scheme. But when just config is given, the FileSystem type is determined by fs.default.name, causing problems if you try to use it on URIs that don't match fs.default.name (hdfs by default).

- Andrew

On Mon, Jul 2, 2018 at 12:28 AM Sambhu R <[hidden email]> wrote:
Hello,

Hadoop-Version: Apache-3.1.0
Alluxio-version:   1.7
Mounted hdfs to  Alluxio

I'm trying to run 'WordMean' in hadoop:
hadoop jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar wordmean alluxio://nn-alluxio:19998/1gb/ alluxio://nn-alluxio:19998/sortqw
and
No error.....

but can't run:

hadoop jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar wordmean alluxio://nn-alluxio:19998/1gb/ alluxio://nn-alluxio:19998/sortqqqq

error: java.lang.IllegalArgumentException: Wrong FS: alluxio://nn-alluxio:19998/sortqqqq/part-r-00000, expected: hdfs://nn-alluxio:9000
    at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:781)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:240)
    at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1569)



please note :
Input file: alluxio://nn-alluxio:19998/1gb/ is in hdfs

Output file: I'm trying to write in Alluxio..


Also note that I have no problem running wordcount, Can write in alluxio file system

Please help...... thank you...








--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
--

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: java.lang.IllegalArgumentException: Wrong FS: alluxio://ip: expected: hdfs://ip:

Sambhu R
In reply to this post by Sambhu R
Thanks Andrew,

But that is not working...

here is my core-site.xml

<configuration>
<property>
  <name>fs.default.name</name>
  <value>hdfs://nn-alluxio:9000</value>
</property>
<property>
   <name>fs.default.name</name>
   <value>alluxio://nn-alluxio:19998/</value>
</property>
<property>
  <name>fs.alluxio.impl</name>
  <value>alluxio.hadoop.FileSystem</value>
  <description>The Alluxio FileSystem (Hadoop 1.x and 2.x)</description>
</property>
<property>
  <name>fs.AbstractFileSystem.alluxio.impl</name>
  <value>alluxio.hadoop.AlluxioFileSystem</value>
  <description>The Alluxio AbstractFileSystem (Hadoop 2.x)</description>
</property>
</configuration>

My clutser wont start with this configuration, with this error:

ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: Exception in secureMain
java.io.IOException: No services to connect, missing NameNode address.
        at org.apache.hadoop.hdfs.server.datanode.BlockPoolManager.refreshNamenodes(BlockPoolManager.java:165)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1427)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:497)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2769)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2677)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2719)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2863)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2887)
2018-07-06 04:21:18,404 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1: java.io.IOException: No services to connect, missing NameNode address.
2018-07-06 04:21:18,406 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at dn-alluxio.aibl.lan/10.3.5.144
************************************************************/



On Monday, July 2, 2018 at 12:58:44 PM UTC+5:30, Sambhu R wrote:
Hello,

Hadoop-Version: Apache-3.1.0
Alluxio-version:   1.7
Mounted hdfs to  Alluxio

I'm trying to run 'WordMean' in hadoop:
hadoop jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar wordmean alluxio://nn-alluxio:19998/1gb/ alluxio://nn-alluxio:19998/sortqw
and
No error.....

but can't run:

hadoop jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar wordmean alluxio://nn-alluxio:19998/1gb/ alluxio://nn-alluxio:19998/sortqqqq

error: java.lang.IllegalArgumentException: Wrong FS: alluxio://nn-alluxio:19998/sortqqqq/part-r-00000, expected: hdfs://nn-alluxio:9000
    at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:781)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:240)
    at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1569)



please note :
Input file: alluxio://nn-alluxio:19998/1gb/ is in hdfs

Output file: I'm trying to write in Alluxio..


Also note that I have no problem running wordcount, Can write in alluxio file system

Please help...... thank you...








--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: java.lang.IllegalArgumentException: Wrong FS: alluxio://ip: expected: hdfs://ip:

Andrew Audibert
Hi Sambhu,

Hadoop uses fs.default.name from the server side as well as the client. You need to keep the original fs.default.name property for the server-side HDFS system. Only the client configuration should override fs.default.name.

- Andrew



On Thu, Jul 5, 2018 at 9:45 PM Sambhu R <[hidden email]> wrote:
Thanks Andrew,

But that is not working...

here is my core-site.xml

<configuration>
<property>
  <name>fs.default.name</name>
  <value>hdfs://nn-alluxio:9000</value>
</property>

<property>
   <name>fs.default.name</name>
   <value>alluxio://nn-alluxio:19998/</value>
</property>
<property>
  <name>fs.alluxio.impl</name>
  <value>alluxio.hadoop.FileSystem</value>
  <description>The Alluxio FileSystem (Hadoop 1.x and 2.x)</description>
</property>
<property>
  <name>fs.AbstractFileSystem.alluxio.impl</name>
  <value>alluxio.hadoop.AlluxioFileSystem</value>
  <description>The Alluxio AbstractFileSystem (Hadoop 2.x)</description>
</property>
</configuration>

My clutser wont start with this configuration, with this error:

ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: Exception in secureMain
java.io.IOException: No services to connect, missing NameNode address.
        at org.apache.hadoop.hdfs.server.datanode.BlockPoolManager.refreshNamenodes(BlockPoolManager.java:165)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1427)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:497)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2769)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2677)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2719)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2863)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2887)
2018-07-06 04:21:18,404 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1: java.io.IOException: No services to connect, missing NameNode address.
2018-07-06 04:21:18,406 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at dn-alluxio.aibl.lan/10.3.5.144
************************************************************/



On Monday, July 2, 2018 at 12:58:44 PM UTC+5:30, Sambhu R wrote:
Hello,

Hadoop-Version: Apache-3.1.0
Alluxio-version:   1.7
Mounted hdfs to  Alluxio

I'm trying to run 'WordMean' in hadoop:
hadoop jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar wordmean alluxio://nn-alluxio:19998/1gb/ alluxio://nn-alluxio:19998/sortqw
and
No error.....

but can't run:

hadoop jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar wordmean alluxio://nn-alluxio:19998/1gb/ alluxio://nn-alluxio:19998/sortqqqq

error: java.lang.IllegalArgumentException: Wrong FS: alluxio://nn-alluxio:19998/sortqqqq/part-r-00000, expected: hdfs://nn-alluxio:9000
    at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:781)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:240)
    at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1569)



please note :
Input file: alluxio://nn-alluxio:19998/1gb/ is in hdfs

Output file: I'm trying to write in Alluxio..


Also note that I have no problem running wordcount, Can write in alluxio file system

Please help...... thank you...








--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
--

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: java.lang.IllegalArgumentException: Wrong FS: alluxio://ip: expected: hdfs://ip:

Sambhu R
You mean in alluxio's core-site.xml?
Thanks




On Saturday, July 7, 2018 at 3:56:28 AM UTC+5:30, Andrew Audibert wrote:
Hi Sambhu,

Hadoop uses <a href="http://fs.default.name" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name from the server side as well as the client. You need to keep the original <a href="http://fs.default.name" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name property for the server-side HDFS system. Only the client configuration should override <a href="http://fs.default.name" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name.

- Andrew



On Thu, Jul 5, 2018 at 9:45 PM Sambhu R <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="9jRLdraLCgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">rsamb...@...> wrote:
Thanks Andrew,

But that is not working...

here is my core-site.xml

<configuration>
<property>
  <name><a href="http://fs.default.name" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name</name>
  <value>hdfs://nn-alluxio:9000</value>
</property>

<property>
   <name><a href="http://fs.default.name" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name</name>
   <value>alluxio://nn-alluxio:19998/</value>
</property>
<property>
  <name>fs.alluxio.impl</name>
  <value>alluxio.hadoop.FileSystem</value>
  <description>The Alluxio FileSystem (Hadoop 1.x and 2.x)</description>
</property>
<property>
  <name>fs.AbstractFileSystem.alluxio.impl</name>
  <value>alluxio.hadoop.AlluxioFileSystem</value>
  <description>The Alluxio AbstractFileSystem (Hadoop 2.x)</description>
</property>
</configuration>

My clutser wont start with this configuration, with this error:

ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: Exception in secureMain
java.io.IOException: No services to connect, missing NameNode address.
        at org.apache.hadoop.hdfs.server.datanode.BlockPoolManager.refreshNamenodes(BlockPoolManager.java:165)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1427)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:497)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2769)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2677)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2719)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2863)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2887)
2018-07-06 04:21:18,404 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1: java.io.IOException: No services to connect, missing NameNode address.
2018-07-06 04:21:18,406 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at dn-alluxio.aibl.lan/<a href="http://10.3.5.144" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.3.5.144\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGMI669-vsTTVEapbrk3iCQlv7QvA&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.3.5.144\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGMI669-vsTTVEapbrk3iCQlv7QvA&#39;;return true;">10.3.5.144
************************************************************/



On Monday, July 2, 2018 at 12:58:44 PM UTC+5:30, Sambhu R wrote:
Hello,

Hadoop-Version: Apache-3.1.0
Alluxio-version:   1.7
Mounted hdfs to  Alluxio

I'm trying to run 'WordMean' in hadoop:
hadoop jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar wordmean alluxio://nn-alluxio:19998/1gb/ alluxio://nn-alluxio:19998/sortqw
and
No error.....

but can't run:

hadoop jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar wordmean alluxio://nn-alluxio:19998/1gb/ alluxio://nn-alluxio:19998/sortqqqq

error: java.lang.IllegalArgumentException: Wrong FS: alluxio://nn-alluxio:19998/sortqqqq/part-r-00000, expected: hdfs://nn-alluxio:9000
    at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:781)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:240)
    at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1569)



please note :
Input file: alluxio://nn-alluxio:19998/1gb/ is in hdfs

Output file: I'm trying to write in Alluxio..


Also note that I have no problem running wordcount, Can write in alluxio file system

Please help...... thank you...








--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="9jRLdraLCgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">alluxio-user...@googlegroups.com.
For more options, visit <a href="https://groups.google.com/d/optout" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;">https://groups.google.com/d/optout.
--
Andrew Audibert
<a href="http://alluxio.com/" style="color:rgb(17,85,204);font-size:12.8px" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Falluxio.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEOzcgHeqiDCH9tkk9r99TjTZX7Nw&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Falluxio.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEOzcgHeqiDCH9tkk9r99TjTZX7Nw&#39;;return true;">Alluxio, Inc. | <a href="http://bit.ly/alluxio-open-source" style="color:rgb(17,85,204)" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-open-source\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEDNVXZleOB7VIXYMM8vGuSeh4NQw&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-open-source\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEDNVXZleOB7VIXYMM8vGuSeh4NQw&#39;;return true;">Alluxio Open Source | <a href="http://bit.ly/alluxio-get-involved" style="color:rgb(17,85,204)" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-get-involved\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEMkj0A_5qpmy2ZeIJGUV1QLgzxRg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-get-involved\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEMkj0A_5qpmy2ZeIJGUV1QLgzxRg&#39;;return true;">Alluxio Community Site

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: java.lang.IllegalArgumentException: Wrong FS: alluxio://ip: expected: hdfs://ip:

Andrew Audibert
It needs to be in the core-site.xml used by the wordmean application, but I'm not sure how to set that without messing up the configuration for the hdfs servers.

Looking at the code for WordMean I see

  private double readAndCalcMean(Path path, Configuration conf)
      throws IOException {
    FileSystem fs = FileSystem.get(conf);
    Path file = new Path(path, "part-r-00000");

    if (!fs.exists(file))
      throw new IOException("Output not found!");

The issue arises because they call FileSystem.get(conf) instead of FileSystem.get(path.toUri(), conf). The first will create a filesystem based off of fs.default.name, while the second will create one based off of the path. If you patch the code to provide the path URI in addition to the conf, it should fix things. Otherwise, the hadoop community might have some ideas about how to set fs.default.name for a mapreduce application without messing with the fs.default.name used by namenodes and datanodes.

- Andrew

On Friday, July 6, 2018 at 9:51:43 PM UTC-7, Sambhu R wrote:
You mean in alluxio's core-site.xml?
Thanks




On Saturday, July 7, 2018 at 3:56:28 AM UTC+5:30, Andrew Audibert wrote:
Hi Sambhu,

Hadoop uses <a href="http://fs.default.name" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name from the server side as well as the client. You need to keep the original <a href="http://fs.default.name" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name property for the server-side HDFS system. Only the client configuration should override <a href="http://fs.default.name" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name.

- Andrew



On Thu, Jul 5, 2018 at 9:45 PM Sambhu R <[hidden email]> wrote:
Thanks Andrew,

But that is not working...

here is my core-site.xml

<configuration>
<property>
  <name><a href="http://fs.default.name" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name</name>
  <value>hdfs://nn-alluxio:9000</value>
</property>

<property>
   <name><a href="http://fs.default.name" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name</name>
   <value>alluxio://nn-alluxio:19998/</value>
</property>
<property>
  <name>fs.alluxio.impl</name>
  <value>alluxio.hadoop.FileSystem</value>
  <description>The Alluxio FileSystem (Hadoop 1.x and 2.x)</description>
</property>
<property>
  <name>fs.AbstractFileSystem.alluxio.impl</name>
  <value>alluxio.hadoop.AlluxioFileSystem</value>
  <description>The Alluxio AbstractFileSystem (Hadoop 2.x)</description>
</property>
</configuration>

My clutser wont start with this configuration, with this error:

ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: Exception in secureMain
java.io.IOException: No services to connect, missing NameNode address.
        at org.apache.hadoop.hdfs.server.datanode.BlockPoolManager.refreshNamenodes(BlockPoolManager.java:165)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1427)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:497)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2769)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2677)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2719)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2863)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2887)
2018-07-06 04:21:18,404 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1: java.io.IOException: No services to connect, missing NameNode address.
2018-07-06 04:21:18,406 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at dn-alluxio.aibl.lan/<a href="http://10.3.5.144" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.3.5.144\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGMI669-vsTTVEapbrk3iCQlv7QvA&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.3.5.144\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGMI669-vsTTVEapbrk3iCQlv7QvA&#39;;return true;">10.3.5.144
************************************************************/



On Monday, July 2, 2018 at 12:58:44 PM UTC+5:30, Sambhu R wrote:
Hello,

Hadoop-Version: Apache-3.1.0
Alluxio-version:   1.7
Mounted hdfs to  Alluxio

I'm trying to run 'WordMean' in hadoop:
hadoop jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar wordmean alluxio://nn-alluxio:19998/1gb/ alluxio://nn-alluxio:19998/sortqw
and
No error.....

but can't run:

hadoop jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar wordmean alluxio://nn-alluxio:19998/1gb/ alluxio://nn-alluxio:19998/sortqqqq

error: java.lang.IllegalArgumentException: Wrong FS: alluxio://nn-alluxio:19998/sortqqqq/part-r-00000, expected: hdfs://nn-alluxio:9000
    at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:781)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:240)
    at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1569)



please note :
Input file: alluxio://nn-alluxio:19998/1gb/ is in hdfs

Output file: I'm trying to write in Alluxio..


Also note that I have no problem running wordcount, Can write in alluxio file system

Please help...... thank you...








--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to alluxio-user...@googlegroups.com.
For more options, visit <a href="https://groups.google.com/d/optout" rel="nofollow" target="_blank" onmousedown="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;">https://groups.google.com/d/optout.
--
Andrew Audibert
<a href="http://alluxio.com/" style="color:rgb(17,85,204);font-size:12.8px" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Falluxio.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEOzcgHeqiDCH9tkk9r99TjTZX7Nw&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Falluxio.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEOzcgHeqiDCH9tkk9r99TjTZX7Nw&#39;;return true;">Alluxio, Inc. | <a href="http://bit.ly/alluxio-open-source" style="color:rgb(17,85,204)" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-open-source\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEDNVXZleOB7VIXYMM8vGuSeh4NQw&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-open-source\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEDNVXZleOB7VIXYMM8vGuSeh4NQw&#39;;return true;">Alluxio Open Source | <a href="http://bit.ly/alluxio-get-involved" style="color:rgb(17,85,204)" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-get-involved\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEMkj0A_5qpmy2ZeIJGUV1QLgzxRg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-get-involved\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEMkj0A_5qpmy2ZeIJGUV1QLgzxRg&#39;;return true;">Alluxio Community Site

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: java.lang.IllegalArgumentException: Wrong FS: alluxio://ip: expected: hdfs://ip:

Sambhu R
okay thanks , let me try that...

On Tuesday, July 10, 2018 at 3:27:01 AM UTC+5:30, [hidden email] wrote:
It needs to be in the core-site.xml used by the wordmean application, but I'm not sure how to set that without messing up the configuration for the hdfs servers.

Looking at the <a href="https://github.com/apache/hadoop/blob/b6f66b0da1cc77f4e61118404a008b4bd7e1a752/hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java/org/apache/hadoop/examples/WordMean.java#L120" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fapache%2Fhadoop%2Fblob%2Fb6f66b0da1cc77f4e61118404a008b4bd7e1a752%2Fhadoop-mapreduce-project%2Fhadoop-mapreduce-examples%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fexamples%2FWordMean.java%23L120\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFePSDCdO2VSC_GUtx5PF49hOkUxg&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fapache%2Fhadoop%2Fblob%2Fb6f66b0da1cc77f4e61118404a008b4bd7e1a752%2Fhadoop-mapreduce-project%2Fhadoop-mapreduce-examples%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fexamples%2FWordMean.java%23L120\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFePSDCdO2VSC_GUtx5PF49hOkUxg&#39;;return true;">code for WordMean I see

  private double readAndCalcMean(Path path, Configuration conf)
      throws IOException {
    FileSystem fs = FileSystem.get(conf);
    Path file = new Path(path, "part-r-00000");

    if (!fs.exists(file))
      throw new IOException("Output not found!");

The issue arises because they call FileSystem.get(conf) instead of FileSystem.get(path.toUri(), conf). The first will create a filesystem based off of <a href="http://fs.default.name" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name, while the second will create one based off of the path. If you patch the code to provide the path URI in addition to the conf, it should fix things. Otherwise, the hadoop community might have some ideas about how to set <a href="http://fs.default.name" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name for a mapreduce application without messing with the <a href="http://fs.default.name" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name used by namenodes and datanodes.

- Andrew

On Friday, July 6, 2018 at 9:51:43 PM UTC-7, Sambhu R wrote:
You mean in alluxio's core-site.xml?
Thanks




On Saturday, July 7, 2018 at 3:56:28 AM UTC+5:30, Andrew Audibert wrote:
Hi Sambhu,

Hadoop uses <a href="http://fs.default.name" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name from the server side as well as the client. You need to keep the original <a href="http://fs.default.name" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name property for the server-side HDFS system. Only the client configuration should override <a href="http://fs.default.name" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name.

- Andrew



On Thu, Jul 5, 2018 at 9:45 PM Sambhu R <[hidden email]> wrote:
Thanks Andrew,

But that is not working...

here is my core-site.xml

<configuration>
<property>
  <name><a href="http://fs.default.name" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name</name>
  <value>hdfs://nn-alluxio:9000</value>
</property>

<property>
   <name><a href="http://fs.default.name" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ffs.default.name\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFLGTK29rZEUMeVGojX5gzRP9xJtg&#39;;return true;">fs.default.name</name>
   <value>alluxio://nn-alluxio:19998/</value>
</property>
<property>
  <name>fs.alluxio.impl</name>
  <value>alluxio.hadoop.FileSystem</value>
  <description>The Alluxio FileSystem (Hadoop 1.x and 2.x)</description>
</property>
<property>
  <name>fs.AbstractFileSystem.alluxio.impl</name>
  <value>alluxio.hadoop.AlluxioFileSystem</value>
  <description>The Alluxio AbstractFileSystem (Hadoop 2.x)</description>
</property>
</configuration>

My clutser wont start with this configuration, with this error:

ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: Exception in secureMain
java.io.IOException: No services to connect, missing NameNode address.
        at org.apache.hadoop.hdfs.server.datanode.BlockPoolManager.refreshNamenodes(BlockPoolManager.java:165)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1427)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:497)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2769)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2677)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2719)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2863)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2887)
2018-07-06 04:21:18,404 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1: java.io.IOException: No services to connect, missing NameNode address.
2018-07-06 04:21:18,406 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at dn-alluxio.aibl.lan/<a href="http://10.3.5.144" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.3.5.144\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGMI669-vsTTVEapbrk3iCQlv7QvA&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2F10.3.5.144\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGMI669-vsTTVEapbrk3iCQlv7QvA&#39;;return true;">10.3.5.144
************************************************************/



On Monday, July 2, 2018 at 12:58:44 PM UTC+5:30, Sambhu R wrote:
Hello,

Hadoop-Version: Apache-3.1.0
Alluxio-version:   1.7
Mounted hdfs to  Alluxio

I'm trying to run 'WordMean' in hadoop:
hadoop jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar wordmean alluxio://nn-alluxio:19998/1gb/ alluxio://nn-alluxio:19998/sortqw
and
No error.....

but can't run:

hadoop jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar wordmean alluxio://nn-alluxio:19998/1gb/ alluxio://nn-alluxio:19998/sortqqqq

error: java.lang.IllegalArgumentException: Wrong FS: alluxio://nn-alluxio:19998/sortqqqq/part-r-00000, expected: hdfs://nn-alluxio:9000
    at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:781)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:240)
    at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1569)



please note :
Input file: alluxio://nn-alluxio:19998/1gb/ is in hdfs

Output file: I'm trying to write in Alluxio..


Also note that I have no problem running wordcount, Can write in alluxio file system

Please help...... thank you...








--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to alluxio-user...@googlegroups.com.
For more options, visit <a href="https://groups.google.com/d/optout" rel="nofollow" target="_blank" onmousedown="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;">https://groups.google.com/d/optout.
--
Andrew Audibert
<a href="http://alluxio.com/" style="color:rgb(17,85,204);font-size:12.8px" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Falluxio.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEOzcgHeqiDCH9tkk9r99TjTZX7Nw&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Falluxio.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEOzcgHeqiDCH9tkk9r99TjTZX7Nw&#39;;return true;">Alluxio, Inc. | <a href="http://bit.ly/alluxio-open-source" style="color:rgb(17,85,204)" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-open-source\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEDNVXZleOB7VIXYMM8vGuSeh4NQw&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-open-source\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEDNVXZleOB7VIXYMM8vGuSeh4NQw&#39;;return true;">Alluxio Open Source | <a href="http://bit.ly/alluxio-get-involved" style="color:rgb(17,85,204)" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-get-involved\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEMkj0A_5qpmy2ZeIJGUV1QLgzxRg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-get-involved\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEMkj0A_5qpmy2ZeIJGUV1QLgzxRg&#39;;return true;">Alluxio Community Site

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.