Export memory mapping api for user

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Export memory mapping api for user

hn5092
Now, alluxio impl hdfs filesystem api, but hdfs api not export memory mapping file method. if a spark task is locality task,the file will be exist on current node.So , the spark task can use direct memory via memory mapping file api. like druid ,every node manager self data,improve read performance 

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Export memory mapping api for user

Gene Pang
Hi,

Thanks for the email. Could you provide information or links about the specific api you are referring to?

Thanks,
Gene

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.