Alluxio Questions

classic Classic list List threaded Threaded
2 messages Options
SAB
Reply | Threaded
Open this post in threaded view
|

Alluxio Questions

SAB
I am planning to use Alluxio for a new project. Before using Alluxio wanted to check couple of things. 

1. On how many nodes Alluxio community (Open Source Edition) can be installed to the maximum.?
2. What will be the dependencies to other Hadoop Eco system components when integrated with Cloudera Hadoop Distribution.?

3. Can Alluxio be installed and managed by Cloudera Manager UI.?

4. I was able to integrate Alluxio with Spark/HDFS Can Alluxio be integrated with Impala and how to easy it is to integrate?

5. Is there a way that data stored in Alluxio memory (RAM) can written back to HDD after a period of time.?


--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Alluxio Questions

Calvin Jia
Hi,

Glad to hear you are trying out Alluxio! Would you mind sharing some of the general context around your project (ie. streaming, data warehousing, Cloud storage acceleration, etc)?

For your questions:
1. There is no limit on the number of nodes. Alluxio has been deployed with 1000+ workers in production.
2. Alluxio will need to work with Zookeeper if you want HA. If you want to connect with CDH HDFS as an under store, you will need the appropriate connector. See the docs.
3. Alluxio is currently not integrated with Cloudera Manager, a similar manager interface is available in the Alluxio community/enterprise edition provided by Alluxio Inc
4. Impala requires specific storage systems for write (ie. HDFS), I've seen people use Impala on Alluxio for read-only workloads with success
5. Do you mean HDD managed by Alluxio or the under store?

Hope this helps,
Calvin

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.