alluxio master HA in HBase

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

alluxio master HA in HBase

倪项菲
Hi Community,
    We are using alluxio(v1.6) master HA in our environment,one is active and one is standby,and we want to integrate with HBase,we find the doc from the official site for the hbase-site.xml:
    https://www.alluxio.org/docs/1.6/en/Running-HBase-on-Alluxio.html
    <property>
     <name>fs.alluxio.impl</name>
     <value>alluxio.hadoop.FileSystem</value>
   </property>
   <property>
     <name>fs.AbstractFileSystem.alluxio.impl</name>
     <value>alluxio.hadoop.AlluxioFileSystem</value>
   </property>
   <property>
     <name>hbase.rootdir</name>
     <value>alluxio://master_hostname:port/hbase</value>
   </property>
 
   about the hbase.rootdir property,how to set this one?we have to alluxio masters.
   
   Any help would be highly appreciated.

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: alluxio master HA in HBase

Andrew Audibert
Hi,

In HA mode you can put either master's address there - it won't make a difference since HBase will talk to Zookeeper to determine the current Alluxio leader. To make HA mode work, you also need two additional parameters so that HBase knows to query Zookeeper.

<property>
  <name>alluxio.zookeeper.enabled</name>
  <value>true</value>
</property>
<property>
  <name>alluxio.zookeeper.address</name>
  <value>[zookeeper_hostname]:2181</value>
</property>

Cheers,
Andrew

On Mon, Jun 11, 2018 at 12:52 AM 倪项菲 <[hidden email]> wrote:
Hi Community,
    We are using alluxio(v1.6) master HA in our environment,one is active and one is standby,and we want to integrate with HBase,we find the doc from the official site for the hbase-site.xml:
    <property>
     <name>fs.alluxio.impl</name>
     <value>alluxio.hadoop.FileSystem</value>
   </property>
   <property>
     <name>fs.AbstractFileSystem.alluxio.impl</name>
     <value>alluxio.hadoop.AlluxioFileSystem</value>
   </property>
   <property>
     <name>hbase.rootdir</name>
     <value>alluxio://master_hostname:port/hbase</value>
   </property>
 
   about the hbase.rootdir property,how to set this one?we have to alluxio masters.
   
   Any help would be highly appreciated.

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
--

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: alluxio master HA in HBase

倪项菲
Thanks for you reply,
do you mean that I can put one of the alluxio master's address in 
   <property>
     <name>hbase.rootdir</name>
     <value>alluxio://master_hostname:port/hbase</value>
   </property>

and add two additional parameters you mentioned in your reply?

在 2018年6月12日星期二 UTC+8上午4:02:05,Andrew Audibert写道:
Hi,

In HA mode you can put either master's address there - it won't make a difference since HBase will talk to Zookeeper to determine the current Alluxio leader. To make HA mode work, you also need two additional parameters so that HBase knows to query Zookeeper.

<property>
  <name>alluxio.zookeeper.enabled</name>
  <value>true</value>
</property>
<property>
  <name>alluxio.zookeeper.address</name>
  <value>[zookeeper_hostname]:2181</value>
</property>

Cheers,
Andrew

On Mon, Jun 11, 2018 at 12:52 AM 倪项菲 <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="sfk_JsDSBQAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">xiang...@...> wrote:
Hi Community,
    We are using alluxio(v1.6) master HA in our environment,one is active and one is standby,and we want to integrate with HBase,we find the doc from the official site for the hbase-site.xml:
    <a href="https://www.alluxio.org/docs/1.6/en/Running-HBase-on-Alluxio.html" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fwww.alluxio.org%2Fdocs%2F1.6%2Fen%2FRunning-HBase-on-Alluxio.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHyf10TSAZyFwRV6Woe7h48AVofig&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fwww.alluxio.org%2Fdocs%2F1.6%2Fen%2FRunning-HBase-on-Alluxio.html\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHyf10TSAZyFwRV6Woe7h48AVofig&#39;;return true;">https://www.alluxio.org/docs/1.6/en/Running-HBase-on-Alluxio.html
    <property>
     <name>fs.alluxio.impl</name>
     <value>alluxio.hadoop.FileSystem</value>
   </property>
   <property>
     <name>fs.AbstractFileSystem.alluxio.impl</name>
     <value>alluxio.hadoop.AlluxioFileSystem</value>
   </property>
   <property>
     <name>hbase.rootdir</name>
     <value>alluxio://master_hostname:port/hbase</value>
   </property>
 
   about the hbase.rootdir property,how to set this one?we have to alluxio masters.
   
   Any help would be highly appreciated.

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="sfk_JsDSBQAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">alluxio-user...@googlegroups.com.
For more options, visit <a href="https://groups.google.com/d/optout" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;">https://groups.google.com/d/optout.
--
Andrew Audibert
<a href="http://alluxio.com/" style="color:rgb(17,85,204);font-size:12.8px" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Falluxio.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEOzcgHeqiDCH9tkk9r99TjTZX7Nw&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Falluxio.com%2F\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEOzcgHeqiDCH9tkk9r99TjTZX7Nw&#39;;return true;">Alluxio, Inc. | <a href="http://bit.ly/alluxio-open-source" style="color:rgb(17,85,204)" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-open-source\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEDNVXZleOB7VIXYMM8vGuSeh4NQw&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-open-source\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEDNVXZleOB7VIXYMM8vGuSeh4NQw&#39;;return true;">Alluxio Open Source | <a href="http://bit.ly/alluxio-get-involved" style="color:rgb(17,85,204)" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-get-involved\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEMkj0A_5qpmy2ZeIJGUV1QLgzxRg&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fbit.ly%2Falluxio-get-involved\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEMkj0A_5qpmy2ZeIJGUV1QLgzxRg&#39;;return true;">Alluxio Community Site

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: alluxio master HA in HBase

Andrew Audibert
That is correct

On Mon, Jun 11, 2018 at 7:36 PM 倪项菲 <[hidden email]> wrote:
Thanks for you reply,
do you mean that I can put one of the alluxio master's address in 
   <property>
     <name>hbase.rootdir</name>
     <value>alluxio://master_hostname:port/hbase</value>
   </property>

and add two additional parameters you mentioned in your reply?

在 2018年6月12日星期二 UTC+8上午4:02:05,Andrew Audibert写道:
Hi,

In HA mode you can put either master's address there - it won't make a difference since HBase will talk to Zookeeper to determine the current Alluxio leader. To make HA mode work, you also need two additional parameters so that HBase knows to query Zookeeper.

<property>
  <name>alluxio.zookeeper.enabled</name>
  <value>true</value>
</property>
<property>
  <name>alluxio.zookeeper.address</name>
  <value>[zookeeper_hostname]:2181</value>
</property>

Cheers,
Andrew

On Mon, Jun 11, 2018 at 12:52 AM 倪项菲 <[hidden email]> wrote:
Hi Community,
    We are using alluxio(v1.6) master HA in our environment,one is active and one is standby,and we want to integrate with HBase,we find the doc from the official site for the hbase-site.xml:
    <property>
     <name>fs.alluxio.impl</name>
     <value>alluxio.hadoop.FileSystem</value>
   </property>
   <property>
     <name>fs.AbstractFileSystem.alluxio.impl</name>
     <value>alluxio.hadoop.AlluxioFileSystem</value>
   </property>
   <property>
     <name>hbase.rootdir</name>
     <value>alluxio://master_hostname:port/hbase</value>
   </property>
 
   about the hbase.rootdir property,how to set this one?we have to alluxio masters.
   
   Any help would be highly appreciated.

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
--

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.