Issue setup Alluxio with CEPH

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Issue setup Alluxio with CEPH

Mania
Hi. I am trying to setup Alluxio with CEPH. I got the following error when I was running "alluxoi runTest" command. Any help is really appreciated to resolve the issue. 

alluxio.exception.AlluxioException: com.amazonaws.services.s3.model.AmazonS3Exception: Found (Service: Amazon S3; Status Code: 302; Error Code: 302 Found; Request ID: null; S3 Extended Request ID: null), S3 Extended Request ID: null
at alluxio.exception.status.AlluxioStatusException.toAlluxioException(AlluxioStatusException.java:119)
at alluxio.client.file.BaseFileSystem.createFile(BaseFileSystem.java:136)
at alluxio.examples.BasicOperations.writeFile(BasicOperations.java:76)
at alluxio.examples.BasicOperations.call(BasicOperations.java:63)
at alluxio.examples.BasicOperations.call(BasicOperations.java:39)
at alluxio.cli.CliUtils.runExample(CliUtils.java:51)
at alluxio.cli.TestRunner.runTest(TestRunner.java:154)
at alluxio.cli.TestRunner.runTests(TestRunner.java:129)
at alluxio.cli.TestRunner.main(TestRunner.java:98)
Caused by: alluxio.exception.status.UnknownException: com.amazonaws.services.s3.model.AmazonS3Exception: Found (Service: Amazon S3; Status Code: 302; Error Code: 302 Found; Request ID: null; S3 Extended Request ID: null), S3 Extended Request ID: null
at alluxio.exception.status.AlluxioStatusException.from(AlluxioStatusException.java:176)
at alluxio.exception.status.AlluxioStatusException.fromThrift(AlluxioStatusException.java:130)
at alluxio.AbstractClient.retryRPCInternal(AbstractClient.java:432)
at alluxio.AbstractClient.retryRPC(AbstractClient.java:410)
at alluxio.client.file.RetryHandlingFileSystemMasterClient.createFile(RetryHandlingFileSystemMasterClient.java:112)
at alluxio.client.file.BaseFileSystem.createFile(BaseFileSystem.java:123)
... 7 more
Failed the test!

Regards
Mania

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Issue setup Alluxio with CEPH

adit
Can you please share your configuration?

On Sunday, December 2, 2018 at 2:46:50 PM UTC-8, Mania wrote:
Hi. I am trying to setup Alluxio with CEPH. I got the following error when I was running "alluxoi runTest" command. Any help is really appreciated to resolve the issue. 

alluxio.exception.AlluxioException: com.amazonaws.services.s3.model.AmazonS3Exception: Found (Service: Amazon S3; Status Code: 302; Error Code: 302 Found; Request ID: null; S3 Extended Request ID: null), S3 Extended Request ID: null
at alluxio.exception.status.AlluxioStatusException.toAlluxioException(AlluxioStatusException.java:119)
at alluxio.client.file.BaseFileSystem.createFile(BaseFileSystem.java:136)
at alluxio.examples.BasicOperations.writeFile(BasicOperations.java:76)
at alluxio.examples.BasicOperations.call(BasicOperations.java:63)
at alluxio.examples.BasicOperations.call(BasicOperations.java:39)
at alluxio.cli.CliUtils.runExample(CliUtils.java:51)
at alluxio.cli.TestRunner.runTest(TestRunner.java:154)
at alluxio.cli.TestRunner.runTests(TestRunner.java:129)
at alluxio.cli.TestRunner.main(TestRunner.java:98)
Caused by: alluxio.exception.status.UnknownException: com.amazonaws.services.s3.model.AmazonS3Exception: Found (Service: Amazon S3; Status Code: 302; Error Code: 302 Found; Request ID: null; S3 Extended Request ID: null), S3 Extended Request ID: null
at alluxio.exception.status.AlluxioStatusException.from(AlluxioStatusException.java:176)
at alluxio.exception.status.AlluxioStatusException.fromThrift(AlluxioStatusException.java:130)
at alluxio.AbstractClient.retryRPCInternal(AbstractClient.java:432)
at alluxio.AbstractClient.retryRPC(AbstractClient.java:410)
at alluxio.client.file.RetryHandlingFileSystemMasterClient.createFile(RetryHandlingFileSystemMasterClient.java:112)
at alluxio.client.file.BaseFileSystem.createFile(BaseFileSystem.java:123)
... 7 more
Failed the test!

Regards
Mania

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Issue setup Alluxio with CEPH

Mania
My configuration is: 

alluxio.master.hostname=sp-hd-1
alluxio.underfs.address=s3a://alluxio/
aws.accessKeyId=<MYACCESSKEY>
aws.secretKey=<MySecretKey>
alluxio.underfs.s3.endpoint=swift-kaizen.massopen.cloud
alluxio.underfs.s3.disable.dns.buckets=TRUE
#alluxio.underfs.s3a.inherit_acl=
alluxio.underfs.s3a.list.objects.v1=true
# Security properties
# alluxio.security.authorization.permission.enabled=true
# alluxio.security.authentication.type=SIMPLE
# Worker properties
alluxio.worker.memory.size=25GB
alluxio.worker.tieredstore.levels=1
alluxio.worker.tieredstore.level0.alias=MEM
alluxio.worker.tieredstore.level0.dirs.quota=25GB
alluxio.worker.tieredstore.reserver.enabled=false
alluxio.worker.evictor.class=alluxio.worker.block.evictor.LRUEvictor
# User properties
alluxio.user.file.readtype.default=CACHE
alluxio.user.file.writetype.default=THROUGH
alluxio.debug=true


Mania 


On Mon, Dec 3, 2018 at 10:46 AM <[hidden email]> wrote:
Can you please share your configuration?

On Sunday, December 2, 2018 at 2:46:50 PM UTC-8, Mania wrote:
Hi. I am trying to setup Alluxio with CEPH. I got the following error when I was running "alluxoi runTest" command. Any help is really appreciated to resolve the issue. 

alluxio.exception.AlluxioException: com.amazonaws.services.s3.model.AmazonS3Exception: Found (Service: Amazon S3; Status Code: 302; Error Code: 302 Found; Request ID: null; S3 Extended Request ID: null), S3 Extended Request ID: null
at alluxio.exception.status.AlluxioStatusException.toAlluxioException(AlluxioStatusException.java:119)
at alluxio.client.file.BaseFileSystem.createFile(BaseFileSystem.java:136)
at alluxio.examples.BasicOperations.writeFile(BasicOperations.java:76)
at alluxio.examples.BasicOperations.call(BasicOperations.java:63)
at alluxio.examples.BasicOperations.call(BasicOperations.java:39)
at alluxio.cli.CliUtils.runExample(CliUtils.java:51)
at alluxio.cli.TestRunner.runTest(TestRunner.java:154)
at alluxio.cli.TestRunner.runTests(TestRunner.java:129)
at alluxio.cli.TestRunner.main(TestRunner.java:98)
Caused by: alluxio.exception.status.UnknownException: com.amazonaws.services.s3.model.AmazonS3Exception: Found (Service: Amazon S3; Status Code: 302; Error Code: 302 Found; Request ID: null; S3 Extended Request ID: null), S3 Extended Request ID: null
at alluxio.exception.status.AlluxioStatusException.from(AlluxioStatusException.java:176)
at alluxio.exception.status.AlluxioStatusException.fromThrift(AlluxioStatusException.java:130)
at alluxio.AbstractClient.retryRPCInternal(AbstractClient.java:432)
at alluxio.AbstractClient.retryRPC(AbstractClient.java:410)
at alluxio.client.file.RetryHandlingFileSystemMasterClient.createFile(RetryHandlingFileSystemMasterClient.java:112)
at alluxio.client.file.BaseFileSystem.createFile(BaseFileSystem.java:123)
... 7 more
Failed the test!

Regards
Mania

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Issue setup Alluxio with CEPH

adit
Hi Mania,

Please add the following to log4j.properties and restart the master. This should give you information on why the Ceph gateway failed the request in the master log. 

log4j.logger.com.amazonaws=WARN
log4j.logger.com.amazonaws.request=DEBUG
log4j.logger.org.apache.http.wire=DEBUG

Which version and API (looks like s3a instead of swift) of Ceph do you intend on using?

A few properties to experiment with based on the version:
alluxio.underfs.s3a.inherit_acl=false
alluxio.underfs.s3a.signer.algorithm=S3SignerType
alluxio.underfs.s3a.list.objects.v1=true

Adit

On Monday, December 3, 2018 at 7:51:29 AM UTC-8, Mania wrote:
My configuration is: 

alluxio.master.hostname=sp-hd-1
alluxio.underfs.address=s3a://alluxio/
aws.accessKeyId=<MYACCESSKEY>
aws.secretKey=<MySecretKey>
alluxio.underfs.s3.endpoint=swift-kaizen.massopen.cloud
alluxio.underfs.s3.disable.dns.buckets=TRUE
#alluxio.underfs.s3a.inherit_acl=
alluxio.underfs.s3a.list.objects.v1=true
# Security properties
# alluxio.security.authorization.permission.enabled=true
# alluxio.security.authentication.type=SIMPLE
# Worker properties
alluxio.worker.memory.size=25GB
alluxio.worker.tieredstore.levels=1
alluxio.worker.tieredstore.level0.alias=MEM
alluxio.worker.tieredstore.level0.dirs.quota=25GB
alluxio.worker.tieredstore.reserver.enabled=false
alluxio.worker.evictor.class=alluxio.worker.block.evictor.LRUEvictor
# User properties
alluxio.user.file.readtype.default=CACHE
alluxio.user.file.writetype.default=THROUGH
alluxio.debug=true


Mania 


On Mon, Dec 3, 2018 at 10:46 AM <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="guSCXh9lCwAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">ad...@...> wrote:
Can you please share your configuration?

On Sunday, December 2, 2018 at 2:46:50 PM UTC-8, Mania wrote:
Hi. I am trying to setup Alluxio with CEPH. I got the following error when I was running "alluxoi runTest" command. Any help is really appreciated to resolve the issue. 

alluxio.exception.AlluxioException: com.amazonaws.services.s3.model.AmazonS3Exception: Found (Service: Amazon S3; Status Code: 302; Error Code: 302 Found; Request ID: null; S3 Extended Request ID: null), S3 Extended Request ID: null
at alluxio.exception.status.AlluxioStatusException.toAlluxioException(AlluxioStatusException.java:119)
at alluxio.client.file.BaseFileSystem.createFile(BaseFileSystem.java:136)
at alluxio.examples.BasicOperations.writeFile(BasicOperations.java:76)
at alluxio.examples.BasicOperations.call(BasicOperations.java:63)
at alluxio.examples.BasicOperations.call(BasicOperations.java:39)
at alluxio.cli.CliUtils.runExample(CliUtils.java:51)
at alluxio.cli.TestRunner.runTest(TestRunner.java:154)
at alluxio.cli.TestRunner.runTests(TestRunner.java:129)
at alluxio.cli.TestRunner.main(TestRunner.java:98)
Caused by: alluxio.exception.status.UnknownException: com.amazonaws.services.s3.model.AmazonS3Exception: Found (Service: Amazon S3; Status Code: 302; Error Code: 302 Found; Request ID: null; S3 Extended Request ID: null), S3 Extended Request ID: null
at alluxio.exception.status.AlluxioStatusException.from(AlluxioStatusException.java:176)
at alluxio.exception.status.AlluxioStatusException.fromThrift(AlluxioStatusException.java:130)
at alluxio.AbstractClient.retryRPCInternal(AbstractClient.java:432)
at alluxio.AbstractClient.retryRPC(AbstractClient.java:410)
at alluxio.client.file.RetryHandlingFileSystemMasterClient.createFile(RetryHandlingFileSystemMasterClient.java:112)
at alluxio.client.file.BaseFileSystem.createFile(BaseFileSystem.java:123)
... 7 more
Failed the test!

Regards
Mania

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="guSCXh9lCwAJ" rel="nofollow" onmousedown="this.href=&#39;javascript:&#39;;return true;" onclick="this.href=&#39;javascript:&#39;;return true;">alluxio-user...@googlegroups.com.
For more options, visit <a href="https://groups.google.com/d/optout" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;" onclick="this.href=&#39;https://groups.google.com/d/optout&#39;;return true;">https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.