Re: Tachyon running on MapR FS

classic Classic list List threaded Threaded
2 messages Options
ZT
Reply | Threaded
Open this post in threaded view
|

Re: Tachyon running on MapR FS

ZT
Hi,

I can state that the steps mentioned by the OP and the first response (with Alluxio substituted for Tachyon of course) worked for me. I tried the setup on MapR 5.0.0 and Alluxio master branch. Step 2 in the OP results in a deprecated configuration parameter error, so leave it out. My Git clone's HEAD is at

commit 7aa4f5cd221c5e31ef2a357f288c69849945f838
Merge: 25fbb48 43ef5e2
Author: Jiri Simsa <[hidden email]>
Date:   Wed Aug 3 11:17:55 2016 -0700

    Merge pull request #3782 from aaudiber/heartbeat-context-test-cleanup
    
    [ALLUXIO-2119] Heartbeat context test cleanup

Thanks,
Zoram

On Saturday, February 27, 2016 at 4:13:40 AM UTC+5:30, James Jones wrote:
Hello,

For the people that were working on getting this configured within a MapR environment...

Have you been successful? Were the steps mentioned in this thread the only steps needed? Has anyone tried this with Alluxio 1.0 vs. Tachyon 0.8.2?

James

On Wednesday, February 24, 2016 at 10:23:18 AM UTC-5, Jiří Šimša wrote:
Hi John,

If you are compiling Alluxio yourself, you will need the -Pmesos flag to enable compilation of the Alluxio Mesos Framework and Executors.

Best,

On Wed, Feb 24, 2016 at 5:37 AM, John Omernik <[hidden email]> wrote:
In addition to the MapR FS build instructions, is there anything else that is needed to run with Mesos? (A compile flag etc?)

I need MapR and Mesos :) 



On Wed, Feb 24, 2016 at 7:28 AM, John Omernik <[hidden email]> wrote:
I will working on trying this as well. Do we need to implement a specific MapR Interface, or just compile with the MapR libs and use the HDFS interface. I am guessing the latter. 

On Wed, Feb 24, 2016 at 7:26 AM, John Omernik <[hidden email]> wrote:
I will be doing some work on this as well. 

On Mon, Feb 22, 2016 at 1:50 PM, LK <[hidden email]> wrote:
We are working on this shortly. I will post back and let you know. 
Thank you


On Monday, February 22, 2016 at 12:13:40 PM UTC-5, Bernard Lin wrote:
hey curious about how did it go? 

On Friday, February 19, 2016 at 11:37:34 AM UTC-5, LK wrote:
Thank you for the information! Will post back with how it all goes.

On Thursday, February 18, 2016 at 6:44:12 PM UTC-5, cc wrote:
Apart from step 1,2,3 you provided, you also need to configure TACHYON_UNDERFS_ADDRESS in <a href="https://github.com/amplab/tachyon/blob/branch-0.8/conf/tachyon-env.sh.template#L81" rel="nofollow" target="_blank" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Famplab%2Ftachyon%2Fblob%2Fbranch-0.8%2Fconf%2Ftachyon-env.sh.template%23L81\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNF5Gqx4Dc0h4gfi09Az-i1ENqu6jg&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Famplab%2Ftachyon%2Fblob%2Fbranch-0.8%2Fconf%2Ftachyon-env.sh.template%23L81\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNF5Gqx4Dc0h4gfi09Az-i1ENqu6jg&#39;;return true;">conf/tachyon-env.sh, and compile Tachyon against your MapR distribution by appending appropriate -hadoop.version to mvn.

Best,
Cheng

在 2016年2月19日星期五 UTC+8上午2:50:02,LK写道:
Hello, 

I was looking to get Tachyon running on MapR. 
I read some old posts and looked over some of the documentation, but I'm not clear on what to do with the version .8.2 of Tachyon.

Do these steps sound like the proper steps to take?

1. Create a tachyon-site.properties file in: $TACHYON_HOME/conf

2. Add the following entries to the tachyon-site.properties?

tachyon.underfs.hdfs.prefixes=mprfs://,hdfs://,glusterfs:///

tachyon.underfs.hdfs.impl= com.mapr.fs.MapRFileSystem

 

3. Add MapR FS jar into Tachyon's class path.


4. I saw the information about making a custom build for MapR. Is that necessary?

<a href="http://tachyon-project.org/documentation/v0.8.2/Building-Tachyon-Master-Branch.html#mapr" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ftachyon-project.org%2Fdocumentation%2Fv0.8.2%2FBuilding-Tachyon-Master-Branch.html%23mapr\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNG5tvhW2l4OKi9pkjQk5cTfgK89eQ&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Ftachyon-project.org%2Fdocumentation%2Fv0.8.2%2FBuilding-Tachyon-Master-Branch.html%23mapr\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNG5tvhW2l4OKi9pkjQk5cTfgK89eQ&#39;;return true;">http://tachyon-project.org/documentation/v0.8.2/Building-Tachyon-Master-Branch.html#mapr


We are moving to MapR 5 soon. 


Thank you!

 

--
You received this message because you are subscribed to the Google Groups "Tachyon Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to tachyon-user...@googlegroups.com.
For more options, visit <a href="https://groups.google.com/d/optout" rel="nofollow" target="_blank" onmousedown="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;">https://groups.google.com/d/optout.



--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to alluxio-user...@googlegroups.com.
For more options, visit <a href="https://groups.google.com/d/optout" rel="nofollow" target="_blank" onmousedown="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;">https://groups.google.com/d/optout.



--
Jiří Šimša
<a href="http://alluxio.com" rel="nofollow" target="_blank" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Falluxio.com\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHBX05zcSsMVKyYu5VW-WXWhLx2Sg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Falluxio.com\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHBX05zcSsMVKyYu5VW-WXWhLx2Sg&#39;;return true;">Alluxio, Inc.

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Tachyon running on MapR FS

Gene Pang
Thanks for the confirmation, Zoram.

-Gene

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.