fuse.log filling up with uid/gid mapping errors

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

fuse.log filling up with uid/gid mapping errors

John Landahl
I'm mounting an S3 bucket into Alluxio and then using alluxio-fuse to access those files with clients. It looks like Alluxio shows the owner of the files as the creator of the S3 bucket, and then alluxio-fuse tries to map that name to a local uid/gid when files are accessed. Since the bucket creator is not going to be a valid local user/group, how can I turn off these mapping attempts? The errors in fuse.log accumulate rapidly as I regularly access thousands of files via alluxio-fuse. Some examples from fuse.log:

2018-09-14 00:28:04,351 ERROR AlluxioFuseUtils - Failed to get id from x with option -g
2018-09-14 00:28:04,357 ERROR AlluxioFuseUtils - Failed to get id from x with option -u
2018-09-14 00:28:04,358 ERROR AlluxioFuseUtils - Failed to get id from x with option -g
2018-09-14 00:28:04,375 ERROR AlluxioFuseUtils - Failed to get id from x with option -u
2018-09-14 00:28:04,376 ERROR AlluxioFuseUtils - Failed to get id from x with option -g
2018-09-14 00:28:04,391 ERROR AlluxioFuseUtils - Failed to get id from x with option -u
2018-09-14 00:28:04,392 ERROR AlluxioFuseUtils - Failed to get id from x with option -u
2018-09-14 00:28:04,393 ERROR AlluxioFuseUtils - Failed to get id from x with option -g
2018-09-14 00:28:04,393 ERROR AlluxioFuseUtils - Failed to get id from x with option -g

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: fuse.log filling up with uid/gid mapping errors

Andrew Audibert
Thanks for raising this John. I agree it would be quite useful to have an easy way to turn off the mapping attempts for situations where they don't make sense.

Right now the best we can do is disable the log message by adding

log4j.logger.alluxio.fuse.AlluxioFuseUtils=OFF

to conf/log4j.properties under the alluxio home folder. After updating the property, you'll need to re-mount fuse for it to pick up the change. The lookups will still be attempted, but at least your log won't be spammed. Could you file a JIRA ticket to request the feature and describe how you would like the mapping to work in situations like yours? 

Thanks,
Andrew

On Thu, Sep 13, 2018 at 5:28 PM John Landahl <[hidden email]> wrote:
I'm mounting an S3 bucket into Alluxio and then using alluxio-fuse to access those files with clients. It looks like Alluxio shows the owner of the files as the creator of the S3 bucket, and then alluxio-fuse tries to map that name to a local uid/gid when files are accessed. Since the bucket creator is not going to be a valid local user/group, how can I turn off these mapping attempts? The errors in fuse.log accumulate rapidly as I regularly access thousands of files via alluxio-fuse. Some examples from fuse.log:

2018-09-14 00:28:04,351 ERROR AlluxioFuseUtils - Failed to get id from x with option -g
2018-09-14 00:28:04,357 ERROR AlluxioFuseUtils - Failed to get id from x with option -u
2018-09-14 00:28:04,358 ERROR AlluxioFuseUtils - Failed to get id from x with option -g
2018-09-14 00:28:04,375 ERROR AlluxioFuseUtils - Failed to get id from x with option -u
2018-09-14 00:28:04,376 ERROR AlluxioFuseUtils - Failed to get id from x with option -g
2018-09-14 00:28:04,391 ERROR AlluxioFuseUtils - Failed to get id from x with option -u
2018-09-14 00:28:04,392 ERROR AlluxioFuseUtils - Failed to get id from x with option -u
2018-09-14 00:28:04,393 ERROR AlluxioFuseUtils - Failed to get id from x with option -g
2018-09-14 00:28:04,393 ERROR AlluxioFuseUtils - Failed to get id from x with option -g

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
--

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.