test alluxio integrate with flink and alluxio master has below log:

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

test alluxio integrate with flink and alluxio master has below log:

riverbuilding
- Which version of Alluxio are you using?
1.6.1
- Which computation framework and version are you using?
flink 1.4.0
- Which under storage system and version are you using?
ssd
- Are you running with tiered storage what is your configuration?
  I deploy master and worker on same machine and below config:
  alluxio.underfs.address=/export/Data/alluxio1.6/underFSStorage
  # Security properties
  alluxio.security.authorization.permission.enabled=false
  alluxio.security.authentication.type=SIMPLE
  # Worker properties
  alluxio.worker.memory.size=10GB
- What is your OS version?
  CentOS release 6.6 (Final)
- What is your JAVA version?
  jdk1.8.0_60
problem:
test alluxio integrate with flink and alluxio master has below log:
2018-03-09 20:02:31,914 DEBUG DefaultFileSystemMaster - createDirectory /flink/chks/26fc41cb0b263f7c46b398e52595e8ed/chk-2
2018-03-09 20:02:31,914 DEBUG DefaultFileSystemMaster - createDirectory /flink/chks/26fc41cb0b263f7c46b398e52595e8ed/chk-2
2018-03-09 20:02:31,914 DEBUG FileSystemMasterClientServiceHandler - Exit (OK): CreateDirectory: path=/flink/chks/26fc41cb0b263f7c46b398e52595e8ed/chk-2, options=CreateDirectoryTOptions(persisted:false, recursive:true, allowExists:true, mode:511, ttl:-1, ttlAction:Delete)
2018-03-09 20:02:31,914 DEBUG TSaslTransport - writing data length: 32
2018-03-09 20:02:31,914 DEBUG TSaslTransport - writing data length: 32
2018-03-09 20:02:31,914 DEBUG InodeTree - createPath /flink/chks/26fc41cb0b263f7c46b398e52595e8ed/chk-2
2018-03-09 20:02:31,914 DEBUG FileSystemMasterClientServiceHandler - CreateDirectory: path=/flink/chks/26fc41cb0b263f7c46b398e52595e8ed/chk-2, options=CreateDirectoryTOptions(persisted:false, recursive:true, allowExists:true, mode:511, ttl:-1, ttlAction:Delete), Error=Path /flink/chks/26fc41cb0b263f7c46b398e52595e8ed/chk-2 does not exist

how does this happen sine recursive:true, allowExists:true?



--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: test alluxio integrate with flink and alluxio master has below log:

Gene Pang
Hi,

I have a few questions.

What is the command you are running, when running into this issue? Are you using this in a distributed environment?

Also, What is your under filesystem address? You mentioned SSD, so does that mean you are using the local filesystem path for your UFS?

Thanks,
Gene

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: test alluxio integrate with flink and alluxio master has below log:

riverbuilding


在 2018年3月13日星期二 UTC+8上午12:17:38,Gene Pang写道:
Hi,

I have a few questions.

What is the command you are running, when running into this issue?

 You mentioned SSD, so does that mean you are using the local filesystem path for your UFS?

Thanks,
Gene

 What is the command you are running, when running into this issue?
I don't know. flink is basic black box to me.
Are you using this in a distributed environment?
No
Also, What is your under filesystem address?
local file system

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: test alluxio integrate with flink and alluxio master has below log:

Gene Pang
Hi,

Were you able to resolve your issue?

Thanks,
Gene

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.