-
Notifications
You must be signed in to change notification settings - Fork 14
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Write up instructions for using with a notebook #22
Comments
Thanks for this project. May I suggest also looking into Apache Zeppelin? |
@itayw As far as I know Zeppelin already incorporates Spark. So what exactly do you expect? |
Yep, they do have native support for Spark. I'm still learning about this project and when, so this issue maybe out of
|
@itayw yes Zeppelin seems like another good candidate. I don't know if it already has javascript support though? Whichever one (Zeppelin, Beaker, ...) my hope is that this shouldn't require any dev effort, just putting the pieces together... |
Here's a gist for building a Docker image that will allow you to run https://gist.github.com/itayw/553effc4ee0cff5d305e I've used beaker's image coupled with instructions taken from apache-node-spark Dockerfile. I managed to run snippets based on I'm continuing to learn more about the integration and ease-of-use. Please let me know of any feedback. |
@itayw Thanks, looks good after a short first look. I currently update the standard Dockerfile concerning new Spark and Node.js versions. I'll open a PR for this today. Going forward, I'd suggest to have two different Docker images, one for the standard REPL, and one for the Beaker notebook. @henridf could publish both on Docker Hub. |
Beaker seems like the best candidate, given its support for javascript and its polyglot nature.
My guess/hope is that this should be pretty simple...
The text was updated successfully, but these errors were encountered: