Query about Alluxio performance evaluation

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Query about Alluxio performance evaluation

wwwovbcom
After deploying Alluxio, is there any benchmark/demo to evaluate its performance? I saw there are some demo based on specific under file systems,e.g., S 1, Hadoop, in the source code package. Is there any general benchmark, e.g., for NFS under file system? 

For Alluxio 1.8.0, is there a demo benchmark for C++ interface?

Thanks very much.

Phillip

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Query about Alluxio performance evaluation

binfan
Administrator
Hi Phillip

FYI, Alluxio C++ interface is still WIP (https://github.com/Alluxio/alluxio/pull/7337)
I don't think there is an available benchmark yet.

Regarding your question on benchmarking with different UFS, since UFS
is simply a configuration setting in Alluxio (http://www.alluxio.org/docs/master/en/Unified-and-Transparent-Namespace.html),
we don't include benchmark on different UFSes.
There is correctness tests though for different UFSes, you can check flag `ufsContractTest`in files like https://github.com/Alluxio/alluxio/blob/master/underfs/s3a/pom.xml

Regarding general purpose benchmarking, here is one blog article using TPCDS
that you may read as a reference:

https://www.alluxio.com/blog/enabling-decoupled-compute-and-storage-with-alluxio


- Bin

On Tuesday, September 4, 2018 at 2:40:57 AM UTC-7, wwwovbcom wrote:
After deploying Alluxio, is there any benchmark/demo to evaluate its performance? I saw there are some demo based on specific under file systems,e.g., S 1, Hadoop, in the source code package. Is there any general benchmark, e.g., for NFS under file system? 

For Alluxio 1.8.0, is there a demo benchmark for C++ interface?

Thanks very much.

Phillip

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.