Can't start alluxio in localmode

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Can't start alluxio in localmode

Bill Graham
Hi,

I'm trying to run alluxio in localmode and it's not coming up property. I formatted and started as follows and things seem ok, but the master never opens port 19998 and the worker never connects. The following logs are repeated every 7 seconds, which seems like some local thrashing is happening. Any ideas how to best troubleshoot this?

I'm running 1.8.0 and started like this:
./bin/alluxio format
./bin/alluxio-start.sh local

Master logs
2018-07-26 19:03:08,260 INFO  BlockMasterFactory - Creating alluxio.master.block.BlockMaster
2018-07-26 19:03:08,262 INFO  FileSystemMasterFactory - Creating alluxio.master.file.FileSystemMaster
2018-07-26 19:03:08,262 INFO  MetricsMasterFactory - Creating alluxio.master.metrics.MetricsMaster
2018-07-26 19:03:08,264 INFO  MetaMasterFactory - Creating alluxio.master.meta.MetaMaster
2018-07-26 19:03:08,284 INFO  ExtensionFactoryRegistry - Loading core jars from /usr/lib/alluxio/lib
2018-07-26 19:03:08,301 INFO  ExtensionFactoryRegistry - Loading extension jars from /usr/lib/alluxio/extensions
2018-07-26 19:03:08,346 INFO  ExtensionFactoryRegistry - Loading core jars from /usr/lib/alluxio/lib
2018-07-26 19:03:08,355 INFO  ExtensionFactoryRegistry - Loading extension jars from /usr/lib/alluxio/extensions
2018-07-26 19:03:08,372 INFO  ExtensionFactoryRegistry - Loading core jars from /usr/lib/alluxio/lib
2018-07-26 19:03:08,381 INFO  ExtensionFactoryRegistry - Loading extension jars from /usr/lib/alluxio/extensions
2018-07-26 19:03:08,408 INFO  ExtensionFactoryRegistry - Loading core jars from /usr/lib/alluxio/lib
2018-07-26 19:03:08,418 INFO  ExtensionFactoryRegistry - Loading extension jars from /usr/lib/alluxio/extensions
2018-07-26 19:03:08,456 INFO  MountTable - Clearing mount table (except the root).
2018-07-26 19:03:08,461 INFO  ExtensionFactoryRegistry - Loading core jars from /usr/lib/alluxio/lib
2018-07-26 19:03:08,469 INFO  ExtensionFactoryRegistry - Loading extension jars from /usr/lib/alluxio/extensions
2018-07-26 19:03:08,475 INFO  MountTable - Mounting /tmp at /
2018-07-26 19:03:08,479 INFO  ProcessUtils - Starting Alluxio master @localhost/127.0.0.1:19998.
2018-07-26 19:03:08,481 INFO  UfsJournalCheckpointThread - BlockMaster: Journal checkpoint thread started.
2018-07-26 19:03:08,481 INFO  MountTable - Clearing mount table (except the root).
2018-07-26 19:03:08,484 INFO  UfsJournalCheckpointThread - FileSystemMaster: Journal checkpoint thread started.
2018-07-26 19:03:08,484 INFO  UfsJournalCheckpointThread - MetaMaster: Journal checkpoint thread started.
2018-07-26 19:03:08,485 INFO  UfsJournalCheckpointThread - BlockMaster: Journal checkpointer shutdown has been initiated.
2018-07-26 19:03:08,486 INFO  UfsJournalCheckpointThread - MetricsMaster: Journal checkpoint thread started.

Worker logs:
2018-07-26 19:07:48,790 INFO  AbstractClient - Alluxio client (version 1.8.0) is trying to bootstrap-connect with localhost/127.0.0.1:19998
2018-07-26 19:07:48,790 WARN  AbstractClient - Failed to handshake (34) with BlockMasterWorker @ localhost/127.0.0.1:19998: Failed to handshake with master localhost/127.0.0.1:19998 to load cluster default configuration values

thanks,
Bill

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Can't start alluxio in localmode

Andrew Audibert
Hi Bill,

Are the master logs the tail of the log file? Nothing in those master logs looks out of the ordinary. It would be helpful if you can share a larger part of the log, or the full log file. 

Additional questions:
1. Is there any output in logs/master.out?
2. Is the master process still running (can check with jps and look for "AlluxioMaster")?
3. Can you share your alluxio configuration file conf/alluxio-site.properties?

Thanks,
Andrew

On Thu, Jul 26, 2018 at 12:11 PM Bill Graham <[hidden email]> wrote:
Hi,

I'm trying to run alluxio in localmode and it's not coming up property. I formatted and started as follows and things seem ok, but the master never opens port 19998 and the worker never connects. The following logs are repeated every 7 seconds, which seems like some local thrashing is happening. Any ideas how to best troubleshoot this?

I'm running 1.8.0 and started like this:
./bin/alluxio format
./bin/alluxio-start.sh local

Master logs
2018-07-26 19:03:08,260 INFO  BlockMasterFactory - Creating alluxio.master.block.BlockMaster
2018-07-26 19:03:08,262 INFO  FileSystemMasterFactory - Creating alluxio.master.file.FileSystemMaster
2018-07-26 19:03:08,262 INFO  MetricsMasterFactory - Creating alluxio.master.metrics.MetricsMaster
2018-07-26 19:03:08,264 INFO  MetaMasterFactory - Creating alluxio.master.meta.MetaMaster
2018-07-26 19:03:08,284 INFO  ExtensionFactoryRegistry - Loading core jars from /usr/lib/alluxio/lib
2018-07-26 19:03:08,301 INFO  ExtensionFactoryRegistry - Loading extension jars from /usr/lib/alluxio/extensions
2018-07-26 19:03:08,346 INFO  ExtensionFactoryRegistry - Loading core jars from /usr/lib/alluxio/lib
2018-07-26 19:03:08,355 INFO  ExtensionFactoryRegistry - Loading extension jars from /usr/lib/alluxio/extensions
2018-07-26 19:03:08,372 INFO  ExtensionFactoryRegistry - Loading core jars from /usr/lib/alluxio/lib
2018-07-26 19:03:08,381 INFO  ExtensionFactoryRegistry - Loading extension jars from /usr/lib/alluxio/extensions
2018-07-26 19:03:08,408 INFO  ExtensionFactoryRegistry - Loading core jars from /usr/lib/alluxio/lib
2018-07-26 19:03:08,418 INFO  ExtensionFactoryRegistry - Loading extension jars from /usr/lib/alluxio/extensions
2018-07-26 19:03:08,456 INFO  MountTable - Clearing mount table (except the root).
2018-07-26 19:03:08,461 INFO  ExtensionFactoryRegistry - Loading core jars from /usr/lib/alluxio/lib
2018-07-26 19:03:08,469 INFO  ExtensionFactoryRegistry - Loading extension jars from /usr/lib/alluxio/extensions
2018-07-26 19:03:08,475 INFO  MountTable - Mounting /tmp at /
2018-07-26 19:03:08,479 INFO  ProcessUtils - Starting Alluxio master @localhost/127.0.0.1:19998.
2018-07-26 19:03:08,481 INFO  UfsJournalCheckpointThread - BlockMaster: Journal checkpoint thread started.
2018-07-26 19:03:08,481 INFO  MountTable - Clearing mount table (except the root).
2018-07-26 19:03:08,484 INFO  UfsJournalCheckpointThread - FileSystemMaster: Journal checkpoint thread started.
2018-07-26 19:03:08,484 INFO  UfsJournalCheckpointThread - MetaMaster: Journal checkpoint thread started.
2018-07-26 19:03:08,485 INFO  UfsJournalCheckpointThread - BlockMaster: Journal checkpointer shutdown has been initiated.
2018-07-26 19:03:08,486 INFO  UfsJournalCheckpointThread - MetricsMaster: Journal checkpoint thread started.

Worker logs:
2018-07-26 19:07:48,790 INFO  AbstractClient - Alluxio client (version 1.8.0) is trying to bootstrap-connect with localhost/127.0.0.1:19998
2018-07-26 19:07:48,790 WARN  AbstractClient - Failed to handshake (34) with BlockMasterWorker @ localhost/127.0.0.1:19998: Failed to handshake with master localhost/127.0.0.1:19998 to load cluster default configuration values

thanks,
Bill

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
--

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Can't start alluxio in localmode

Bill Graham
Thanks Andrew for the response, I just figured it out. I was using a process manager to run ./bin/alluxio-start.sh local, which starts the daemon in the background, which caused the process manager to repeatedly restart it. Once I aded the -w flag to block the start command all worked fine.

thanks,
Bill

On Thu, Jul 26, 2018 at 1:11 PM Andrew Audibert <[hidden email]> wrote:
Hi Bill,

Are the master logs the tail of the log file? Nothing in those master logs looks out of the ordinary. It would be helpful if you can share a larger part of the log, or the full log file. 

Additional questions:
1. Is there any output in logs/master.out?
2. Is the master process still running (can check with jps and look for "AlluxioMaster")?
3. Can you share your alluxio configuration file conf/alluxio-site.properties?

Thanks,
Andrew

On Thu, Jul 26, 2018 at 12:11 PM Bill Graham <[hidden email]> wrote:
Hi,

I'm trying to run alluxio in localmode and it's not coming up property. I formatted and started as follows and things seem ok, but the master never opens port 19998 and the worker never connects. The following logs are repeated every 7 seconds, which seems like some local thrashing is happening. Any ideas how to best troubleshoot this?

I'm running 1.8.0 and started like this:
./bin/alluxio format
./bin/alluxio-start.sh local

Master logs
2018-07-26 19:03:08,260 INFO  BlockMasterFactory - Creating alluxio.master.block.BlockMaster
2018-07-26 19:03:08,262 INFO  FileSystemMasterFactory - Creating alluxio.master.file.FileSystemMaster
2018-07-26 19:03:08,262 INFO  MetricsMasterFactory - Creating alluxio.master.metrics.MetricsMaster
2018-07-26 19:03:08,264 INFO  MetaMasterFactory - Creating alluxio.master.meta.MetaMaster
2018-07-26 19:03:08,284 INFO  ExtensionFactoryRegistry - Loading core jars from /usr/lib/alluxio/lib
2018-07-26 19:03:08,301 INFO  ExtensionFactoryRegistry - Loading extension jars from /usr/lib/alluxio/extensions
2018-07-26 19:03:08,346 INFO  ExtensionFactoryRegistry - Loading core jars from /usr/lib/alluxio/lib
2018-07-26 19:03:08,355 INFO  ExtensionFactoryRegistry - Loading extension jars from /usr/lib/alluxio/extensions
2018-07-26 19:03:08,372 INFO  ExtensionFactoryRegistry - Loading core jars from /usr/lib/alluxio/lib
2018-07-26 19:03:08,381 INFO  ExtensionFactoryRegistry - Loading extension jars from /usr/lib/alluxio/extensions
2018-07-26 19:03:08,408 INFO  ExtensionFactoryRegistry - Loading core jars from /usr/lib/alluxio/lib
2018-07-26 19:03:08,418 INFO  ExtensionFactoryRegistry - Loading extension jars from /usr/lib/alluxio/extensions
2018-07-26 19:03:08,456 INFO  MountTable - Clearing mount table (except the root).
2018-07-26 19:03:08,461 INFO  ExtensionFactoryRegistry - Loading core jars from /usr/lib/alluxio/lib
2018-07-26 19:03:08,469 INFO  ExtensionFactoryRegistry - Loading extension jars from /usr/lib/alluxio/extensions
2018-07-26 19:03:08,475 INFO  MountTable - Mounting /tmp at /
2018-07-26 19:03:08,479 INFO  ProcessUtils - Starting Alluxio master @localhost/127.0.0.1:19998.
2018-07-26 19:03:08,481 INFO  UfsJournalCheckpointThread - BlockMaster: Journal checkpoint thread started.
2018-07-26 19:03:08,481 INFO  MountTable - Clearing mount table (except the root).
2018-07-26 19:03:08,484 INFO  UfsJournalCheckpointThread - FileSystemMaster: Journal checkpoint thread started.
2018-07-26 19:03:08,484 INFO  UfsJournalCheckpointThread - MetaMaster: Journal checkpoint thread started.
2018-07-26 19:03:08,485 INFO  UfsJournalCheckpointThread - BlockMaster: Journal checkpointer shutdown has been initiated.
2018-07-26 19:03:08,486 INFO  UfsJournalCheckpointThread - MetricsMaster: Journal checkpoint thread started.

Worker logs:
2018-07-26 19:07:48,790 INFO  AbstractClient - Alluxio client (version 1.8.0) is trying to bootstrap-connect with localhost/127.0.0.1:19998
2018-07-26 19:07:48,790 WARN  AbstractClient - Failed to handshake (34) with BlockMasterWorker @ localhost/127.0.0.1:19998: Failed to handshake with master localhost/127.0.0.1:19998 to load cluster default configuration values

thanks,
Bill

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
--

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.