Behavior of Alluxio writes with multiple under storages

classic Classic list List threaded Threaded
3 messages Options
Dev
Reply | Threaded
Open this post in threaded view
|

Behavior of Alluxio writes with multiple under storages

Dev
Hi All,

I am using Alluxio 1.6.1 and I am having trouble understanding 'Coupled with the potential to mount multiple under storage systems, Alluxio can serve as a unifying layer for any number of varied data sources.'

Question: How to configure multiple under storage? Do I need to use alluxio.underfs.address multiple times? and how will write to alluxio work in this case. If I use 'CACHE_THROUGH' as write type, in which under storage data will be written, if multiple  under storage are configured/mounted?

Any help in clarifying these doubts will be a great help.

Thanks
Dev

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Behavior of Alluxio writes with multiple under storages

Andrew Audibert
Hi Dev,

There is only one root under storage system, but any number of additional under storage systems can be mounted within the filesystem namespace. See https://www.alluxio.org/docs/1.7/en/Unified-and-Transparent-Namespace.html for examples of this.

If under storage A is your root under storage (mounted at "/") and under storage B is mounted at "/ufs_b", operations under the "/ufs_b/" directory will go only to under storage B.

- Andrew

On Mon, Jun 11, 2018 at 9:51 PM Dev <[hidden email]> wrote:
Hi All,

I am using Alluxio 1.6.1 and I am having trouble understanding 'Coupled with the potential to mount multiple under storage systems, Alluxio can serve as a unifying layer for any number of varied data sources.'

Question: How to configure multiple under storage? Do I need to use alluxio.underfs.address multiple times? and how will write to alluxio work in this case. If I use 'CACHE_THROUGH' as write type, in which under storage data will be written, if multiple  under storage are configured/mounted?

Any help in clarifying these doubts will be a great help.

Thanks
Dev

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
--

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Dev
Reply | Threaded
Open this post in threaded view
|

Re: Behavior of Alluxio writes with multiple under storages

Dev
Thanks Andrew for clarification. Got it.

Thanks
Dev

On Wednesday, 13 June 2018 23:40:23 UTC+5:30, Andrew Audibert wrote:
Hi Dev,

There is only one root under storage system, but any number of additional under storage systems can be mounted within the filesystem namespace. See <a href="https://www.alluxio.org/docs/1.7/en/Unified-and-Transparent-Namespace.html" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fwww.alluxio.org%2Fdocs%2F1.7%2Fen%2FUnified-and-Transparent-Namespace.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGRrIcQdD1MBktjTSZ-cpPwzvDvcg&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fwww.alluxio.org%2Fdocs%2F1.7%2Fen%2FUnified-and-Transparent-Namespace.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGRrIcQdD1MBktjTSZ-cpPwzvDvcg&#39;;return true;">https://www.alluxio.org/docs/1.7/en/Unified-and-Transparent-Namespace.html for examples of this.

If under storage A is your root under storage (mounted at "/") and under storage B is mounted at "/ufs_b", operations under the "/ufs_b/" directory will go only to under storage B.

- Andrew

On Mon, Jun 11, 2018 at 9:51 PM Dev <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="JMEfLmC1BgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">devendram...@...> wrote:
Hi All,

I am using Alluxio 1.6.1 and I am having trouble understanding 'Coupled with the potential to mount multiple under storage systems, Alluxio can serve as a unifying layer for any number of varied data sources.'

Question: How to configure multiple under storage? Do I need to use alluxio.underfs.address multiple times? and how will write to alluxio work in this case. If I use 'CACHE_THROUGH' as write type, in which under storage data will be written, if multiple  under storage are configured/mounted?

Any help in clarifying these doubts will be a great help.

Thanks
Dev

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="JMEfLmC1BgAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">alluxio-user...@googlegroups.com.
For more options, visit <a href="https://groups.google.com/d/optout" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;">https://groups.google.com/d/optout.
--
Andrew Audibert
<a href="http://alluxio.com/" style="color:rgb(17,85,204);font-size:12.8px" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Falluxio.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEOzcgHeqiDCH9tkk9r99TjTZX7Nw&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Falluxio.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEOzcgHeqiDCH9tkk9r99TjTZX7Nw&#39;;return true;">Alluxio, Inc. | <a href="http://bit.ly/alluxio-open-source" style="color:rgb(17,85,204)" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-open-source\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEDNVXZleOB7VIXYMM8vGuSeh4NQw&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-open-source\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEDNVXZleOB7VIXYMM8vGuSeh4NQw&#39;;return true;">Alluxio Open Source | <a href="http://bit.ly/alluxio-get-involved" style="color:rgb(17,85,204)" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-get-involved\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEMkj0A_5qpmy2ZeIJGUV1QLgzxRg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-get-involved\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEMkj0A_5qpmy2ZeIJGUV1QLgzxRg&#39;;return true;">Alluxio Community Site

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.