Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Write up instructions for using with a notebook #22

Open
henridf opened this issue Dec 17, 2015 · 6 comments
Open

Write up instructions for using with a notebook #22

henridf opened this issue Dec 17, 2015 · 6 comments

Comments

@henridf
Copy link
Owner

henridf commented Dec 17, 2015

Beaker seems like the best candidate, given its support for javascript and its polyglot nature.

My guess/hope is that this should be pretty simple...

@itayw
Copy link

itayw commented Jan 16, 2016

Thanks for this project.

May I suggest also looking into Apache Zeppelin?
https://zeppelin.incubator.apache.org/

@tobilg
Copy link
Contributor

tobilg commented Jan 16, 2016

@itayw As far as I know Zeppelin already incorporates Spark. So what exactly do you expect?

@itayw
Copy link

itayw commented Jan 16, 2016

Yep, they do have native support for Spark.

I'm still learning about this project and when, so this issue maybe out of
place. However, when I saw this ticket I thought it would be great to
somehow combine between Zeppelin and its capabilities and having the
freedom to use JavaScript instead of Java, Scala or python.
On Jan 16, 2016 6:41 PM, "Tobi" [email protected] wrote:

@itayw https://github.com/itayw As far as I know Zeppelin already
incorporate Spark. So what exactly do you expect?


Reply to this email directly or view it on GitHub
#22 (comment)
.

@henridf
Copy link
Owner Author

henridf commented Jan 16, 2016

@itayw yes Zeppelin seems like another good candidate. I don't know if it already has javascript support though? Whichever one (Zeppelin, Beaker, ...) my hope is that this shouldn't require any dev effort, just putting the pieces together...

@itayw
Copy link

itayw commented Jan 21, 2016

Here's a gist for building a Docker image that will allow you to run beaker with apache-node-spark.

https://gist.github.com/itayw/553effc4ee0cff5d305e

I've used beaker's image coupled with instructions taken from apache-node-spark Dockerfile. I managed to run snippets based on test/smokeTest.js without special issues.

I'm continuing to learn more about the integration and ease-of-use. Please let me know of any feedback.

@tobilg
Copy link
Contributor

tobilg commented Jan 21, 2016

@itayw Thanks, looks good after a short first look. I currently update the standard Dockerfile concerning new Spark and Node.js versions. I'll open a PR for this today.

Going forward, I'd suggest to have two different Docker images, one for the standard REPL, and one for the Beaker notebook. @henridf could publish both on Docker Hub.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants