Zeppelin Interpreter error: Frame size (67108864) larger than max length (16384000)

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

Zeppelin Interpreter error: Frame size (67108864) larger than max length (16384000)

rbethune
Hello,

I'm attempting to use the Alluxio interpreter in Apache Zeppelin (0.7.3), but receive the following error when attempting to run "%alluxio ls /" Error: "Frame size (67108864) larger than max length (16384000)"

I confirmed I'm using the correct master port (19998).  I found the instructions to increase the default frame length (alluxio.network.thrift.frame.size.bytes.max) and have added  (alluxio.network.thrift.frame.size.bytes.max=64MB) to the alluxio-site.properties file. 

I have restarted Alluxio and confirmed the configuration update is visible in the the Alluxio master configuration UI: alluxio.network.thrift.frame.size.bytes.max 64MB SITE_PROPERTY (/opt/alluxio-1.7.0/conf/alluxio-site.properties)

After restarting Zepplin I receive the same error:


The following exceptions are thrown in the logs/master.log file:
============================================================================
2018-04-16 11:38:08,489 ERROR TThreadPoolServer - Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: Invalid status 0
        at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:269)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

Caused by: org.apache.thrift.transport.TTransportException: Invalid status 0
        at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
        at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:184)
        at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
        at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
        at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
        at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
        ... 4 more

Thank you,

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Zeppelin Interpreter error: Frame size (67108864) larger than max length (16384000)

Calvin Jia
Hi,

Which version of Alluxio are you using? Zeppelin is integrated out of the box with Alluxio 1.0.0, for later versions of Alluxio see this PR.

Hope this helps,
Calvin

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Zeppelin Interpreter error: Frame size (67108864) larger than max length (16384000)

rbethune
I confirmed the issue occurs with Alluxio 1.7.0 and Alluxio 1.7.1.  also confirmed I am able to complete the Alluxio runTests validation suite in both installations. I'm running Oracle Java (build 1.8.0_171-b11) on Ubuntu 16.04.4 LTS.

I've gone through the Zeppelin (0.7.3) Alluxio Interpreter code and this error is being generated by the Alluxio Master.


>> Zeppelin is integrated out of the box with Alluxio 1.0.0, for later versions of Alluxio
Yes, but looks like the integration is broken with a new standard installation.

Any suggestions?

Thank you



On Thursday, April 19, 2018 at 10:59:53 AM UTC-7, Calvin Jia wrote:
Hi,

Which version of Alluxio are you using? Zeppelin is integrated out of the box with Alluxio 1.0.0, for later versions of Alluxio see this <a href="https://github.com/apache/zeppelin/pull/2900" target="_blank" rel="nofollow" onmousedown="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fapache%2Fzeppelin%2Fpull%2F2900\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGMLIBSXvwy3Dg0j2aX2OziAy_e4g&#39;;return true;" onclick="this.href=&#39;https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2Fapache%2Fzeppelin%2Fpull%2F2900\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGMLIBSXvwy3Dg0j2aX2OziAy_e4g&#39;;return true;">PR.

Hope this helps,
Calvin

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Zeppelin Interpreter error: Frame size (67108864) larger than max length (16384000)

Calvin Jia
Hi,

If you are using Zeppelin with Alluxio 1.7, you will need to recompile Zeppelin with the upgraded dependency (you can checkout this PR). Are you saying that even after recompiling with the Alluxio 1.7 client, you still hit this error?

Thanks,
Calvin

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Zeppelin Interpreter error: Frame size (67108864) larger than max length (16384000)

rbethune
Thank you Calvin,

Yes, rebuilding Zeppelin with the Alluxio interpreter updates corrected the issue. I'm able to connect to Alluxio from the Zeppelin notebook.

Thanks again,
-S

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.
Reply | Threaded
Open this post in threaded view
|

Re: Zeppelin Interpreter error: Frame size (67108864) larger than max length (16384000)

Calvin Jia
Glad to hear, thanks for confirming the solution!

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.