gophernotes/README.md

264 lines
11 KiB
Markdown
Raw Permalink Normal View History

2017-09-19 17:33:31 -04:00
![alt tag](files/gophernotes-logo.png)
2016-01-23 14:19:24 -06:00
2018-06-29 16:00:56 +02:00
[![Build Status](https://travis-ci.org/gopherdata/gophernotes.svg?branch=master)](https://travis-ci.org/gopherdata/gophernotes)
2018-08-10 16:33:37 +02:00
[![License](https://img.shields.io/badge/License-MIT-blue.svg)](https://github.com/gopherdata/gophernotes/blob/master/LICENSE)
2018-06-29 16:00:56 +02:00
2017-09-19 17:26:51 -04:00
# gophernotes - Use Go in Jupyter notebooks and nteract
2016-01-23 06:11:05 -06:00
2017-09-19 17:26:51 -04:00
`gophernotes` is a Go kernel for [Jupyter](http://jupyter.org/) notebooks and [nteract](https://nteract.io/). It lets you use Go interactively in a browser-based notebook or desktop app. Use `gophernotes` to create and share documents that contain live Go code, equations, visualizations and explanatory text. These notebooks, with the live Go code, can then be shared with others via email, Dropbox, GitHub and the [Jupyter Notebook Viewer](http://nbviewer.jupyter.org/). Go forth and do data science, or anything else interesting, with Go notebooks!
2016-01-23 14:24:34 -06:00
**Acknowledgements** - This project utilizes a Go interpreter called [gomacro](https://github.com/cosmos72/gomacro) under the hood to evaluate Go code interactively. The gophernotes logo was designed by the brilliant [Marcus Olsson](https://github.com/marcusolsson) and was inspired by Renee French's original Go Gopher design.
2016-01-23 06:12:06 -06:00
2017-09-20 11:17:22 -04:00
- [Examples](#examples)
- Install gophernotes:
- [Prerequisites](#prerequisites)
- [Linux](#linux)
- [Mac](#mac)
- [Windows](#windows)
- [Docker](#docker)
- [Getting Started](#getting-started)
- [Limitations](#limitations)
- [Troubleshooting](#troubleshooting)
2017-09-19 17:54:48 -04:00
## Examples
2016-01-23 15:48:35 -06:00
### Jupyter Notebook:
2017-09-20 10:56:44 -04:00
![](files/jupyter.gif)
2017-09-19 17:56:24 -04:00
2017-09-20 10:56:44 -04:00
### nteract:
2017-09-19 17:56:24 -04:00
![](files/nteract.gif)
2016-01-23 15:48:35 -06:00
2016-01-24 07:07:48 -06:00
### Example Notebooks (dowload and run them locally, follow the links to view in Github, or use the [Jupyter Notebook Viewer](http://nbviewer.jupyter.org/)):
2017-09-20 10:56:44 -04:00
- [Worker Pools](examples/Worker_Pools.ipynb)
- [Matrix Operations](examples/Matrix_Operations.ipynb)
- [Facial Recognition](examples/Facial_Recognition_MachineBox.ipynb)
- [Display Images, HTML, LaTeX...](examples/Display.ipynb)
2016-01-23 15:51:10 -06:00
2016-03-01 10:50:07 -06:00
## Installation
2017-09-20 10:56:44 -04:00
### Prerequisites
2016-02-20 14:13:25 -06:00
- [Go 1.11+](https://golang.org/doc/install) - including GOPATH/bin added to your PATH (i.e., you can run Go binaries that you `go install`).
2017-09-20 10:56:44 -04:00
- [Jupyter Notebook](http://jupyter.readthedocs.io/en/latest/install.html) or [nteract](https://nteract.io/desktop)
- [ZeroMQ 4.X.X](http://zeromq.org/intro:get-the-software) - for convenience, pre-built Windows binaries (v4.2.1) are included in the zmq-win directory.
2017-10-07 11:00:16 -04:00
- [pkg-config](https://en.wikipedia.org/wiki/Pkg-config)
- [git](https://git-scm.com/download) - usually already present on Linux and Mac OS X. If not present, follow the instructions at [https://git-scm.com/download](https://git-scm.com/download)
On Windows, it can also be installed as part of MinGW as described below.
2016-01-24 06:22:49 -06:00
2017-09-20 10:56:44 -04:00
### Linux
2016-01-23 16:03:49 -06:00
Quick installation as module, requires Go 1.12+
2017-09-20 10:56:44 -04:00
```sh
$ env GO111MODULE=on go get github.com/gopherdata/gophernotes
2017-09-20 10:56:44 -04:00
$ mkdir -p ~/.local/share/jupyter/kernels/gophernotes
$ cd ~/.local/share/jupyter/kernels/gophernotes
$ cp "$(go env GOPATH)"/pkg/mod/github.com/gopherdata/gophernotes@v0.6.0/kernel/* "."
$ sed "s|gophernotes|$(go env GOPATH)/bin/gophernotes|" < kernel.json.in > kernel.json
2017-09-20 10:56:44 -04:00
```
2016-07-29 15:54:59 -05:00
Manual installation from GOPATH, also works with Go 1.11
```sh
$ env GO111MODULE=off go get -d -u github.com/gopherdata/gophernotes
$ cd "$(go env GOPATH)"/src/github.com/gopherdata/gophernotes
$ env GO111MODULE=on go install
$ mkdir -p ~/.local/share/jupyter/kernels/gophernotes
$ cp kernel/* ~/.local/share/jupyter/kernels/gophernotes
$ cd ~/.local/share/jupyter/kernels/gophernotes
2019-12-01 14:01:19 +01:00
$ sed "s|gophernotes|$(go env GOPATH)/bin/gophernotes|" < kernel.json.in > kernel.json
```
2016-01-24 15:31:56 -06:00
To confirm that the `gophernotes` binary is installed in GOPATH, execute it directly:
```sh
$ "$(go env GOPATH)"/bin/gophernotes
```
and you shoud see the following:
2017-09-20 10:56:44 -04:00
```sh
2017/09/20 10:33:12 Need a command line argument specifying the connection file.
```
2016-01-24 15:31:56 -06:00
2017-09-20 10:56:44 -04:00
**Note** - if you have the `JUPYTER_PATH` environmental variable set or if you are using an older version of Jupyter, you may need to copy this kernel config to another directory. You can check which directories will be searched by executing:
2017-09-20 10:56:44 -04:00
```sh
$ jupyter --data-dir
```
2016-02-10 14:31:34 -06:00
2017-09-20 11:17:22 -04:00
### Mac
2016-01-24 17:24:18 -06:00
**Important Note** - gomacro relies on the `plugin` package when importing third party libraries. This package works reliably on Mac OS X with Go 1.10.2+ as long as you **never** execute the command `strip gophernotes`.
2017-09-20 12:35:22 -04:00
Quick installation as module, requires Go 1.12+
2017-09-20 11:13:18 -04:00
```sh
$ env GO111MODULE=on go get github.com/gopherdata/gophernotes
2017-09-20 11:13:18 -04:00
$ mkdir -p ~/Library/Jupyter/kernels/gophernotes
$ cd ~/Library/Jupyter/kernels/gophernotes
$ cp "$(go env GOPATH)"/pkg/mod/github.com/gopherdata/gophernotes@v0.6.0/kernel/* "."
$ sed "s|gophernotes|$(go env GOPATH)/bin/gophernotes|" < kernel.json.in > kernel.json
2017-09-20 11:13:18 -04:00
```
Manual installation from GOPATH, also works with Go 1.11
```sh
$ env GO111MODULE=off go get -d -u github.com/gopherdata/gophernotes
$ cd "$(go env GOPATH)"/src/github.com/gopherdata/gophernotes
$ env GO111MODULE=on go install
$ mkdir -p ~/Library/Jupyter/kernels/gophernotes
$ cp kernel/* ~/Library/Jupyter/kernels/gophernotes
$ cd ~/Library/Jupyter/kernels/gophernotes
2019-12-01 14:01:19 +01:00
$ sed "s|gophernotes|$(go env GOPATH)/bin/gophernotes|" < kernel.json.in > kernel.json
```
2017-09-20 11:13:18 -04:00
To confirm that the `gophernotes` binary is installed in GOPATH, execute it directly:
```sh
$ "$(go env GOPATH)"/bin/gophernotes
```
and you shoud see the following:
2017-09-20 11:13:18 -04:00
```sh
2017/09/20 10:33:12 Need a command line argument specifying the connection file.
```
**Note** - if you have the `JUPYTER_PATH` environmental variable set or if you are using an older version of Jupyter, you may need to copy this kernel config to another directory. You can check which directories will be searched by executing:
2017-09-20 11:13:18 -04:00
```sh
$ jupyter --data-dir
```
2017-09-20 10:56:44 -04:00
### Windows
**Important Note** - gomacro relies on the `plugin` package when importing third party libraries. This package is only supported on Linux and Mac OS X currently. Thus, if you need to utilize third party packages in your Go notebooks and you are running on Windows, you should use the [Docker](#docker) install and run gophernotes/Jupyter in Docker.
2017-09-20 12:35:22 -04:00
2017-09-20 10:56:44 -04:00
Make sure you have the MinGW toolchain:
2017-09-20 10:59:01 -04:00
- [MinGW-w64](https://sourceforge.net/projects/mingw-w64/), for 32 and 64 bit Windows
- [MinGW Distro](https://nuwen.net/mingw.html), for 64 bit Windows only
2017-09-20 10:56:44 -04:00
Then:
2017-09-20 10:56:44 -04:00
1. build and install gophernotes (using the pre-built binaries and `zmq-win\build.bat`):
```
REM Download w/o building.
set GO111MODULE=off
go get -d -u github.com/gopherdata/gophernotes
2017-09-20 10:56:44 -04:00
cd %GOPATH%\src\github.com\gopherdata\gophernotes\zmq-win
REM Build x64 version.
build.bat amd64
move gophernotes.exe %GOPATH%\bin
copy lib-amd64\libzmq.dll %GOPATH%\bin
REM Build x86 version.
build.bat 386
move gophernotes.exe %GOPATH%\bin
copy lib-386\libzmq.dll %GOPATH%\bin
```
3. Copy the kernel config:
2017-09-20 10:59:01 -04:00
```
mkdir %APPDATA%\jupyter\kernels\gophernotes
xcopy %GOPATH%\src\github.com\gopherdata\gophernotes\kernel %APPDATA%\jupyter\kernels\gophernotes /s
```
2017-09-20 11:00:43 -04:00
Note, if you have the `JUPYTER_PATH` environmental variable set or if you are using an older version of Jupyter, you may need to copy this kernel config to another directory. You can check which directories will be searched by executing:
2017-09-20 10:59:01 -04:00
```
jupyter --data-dir
```
4. Update `%APPDATA%\jupyter\kernels\gophernotes\kernel.json` with the FULL PATH to your gophernotes.exe (in %GOPATH%\bin), unless it's already on the PATH. For example:
2017-09-20 10:59:01 -04:00
```
{
"argv": [
"C:\\gopath\\bin\\gophernotes.exe",
"{connection_file}"
],
"display_name": "Go",
"language": "go",
"name": "go"
}
```
2017-09-20 10:56:44 -04:00
### Docker
You can try out or run Jupyter + gophernotes without installing anything using Docker. To run a Go notebook that only needs things from the standard library, run:
2017-09-20 10:56:44 -04:00
```
$ docker run -it -p 8888:8888 gopherdata/gophernotes
```
Or to run a Go notebook with access to common Go data science packages (gonum, gota, golearn, etc.), run:
```
$ docker run -it -p 8888:8888 gopherdata/gophernotes:latest-ds
2017-09-20 10:56:44 -04:00
```
2017-09-20 12:35:22 -04:00
In either case, running this command should output a link that you can follow to access Jupyter in a browser. Also, to save notebooks to and/or load notebooks from a location outside of the Docker image, you should utilize a volume mount. For example:
```
$ docker run -it -p 8888:8888 -v /path/to/local/notebooks:/path/to/notebooks/in/docker gopherdata/gophernotes
```
## Getting Started
2017-09-20 10:56:44 -04:00
### Jupyter
- If you completed one of the local installs above (i.e., not the Docker install), start the jupyter notebook server:
```
jupyter notebook
```
2017-09-20 10:56:44 -04:00
- Select `Go` from the `New` drop down menu.
- Have fun!
### nteract
- Launch nteract.
2017-09-20 10:56:44 -04:00
- From the nteract menu select Language -> Go.
2017-09-20 10:56:44 -04:00
- Have fun!
2017-09-20 10:56:44 -04:00
## Limitations
2018-09-29 09:42:50 -07:00
gophernotes uses [gomacro](https://github.com/cosmos72/gomacro) under the hood to evaluate Go code interactively. You can evaluate most any Go code with gomacro, but there are some limitations, which are discussed in further detail [here](https://github.com/cosmos72/gomacro#current-status). Most notably, gophernotes does NOT support:
2017-09-20 10:56:44 -04:00
- third party packages when running natively on Windows - This is a current limitation of the Go `plugin` package.
- some corner cases on interpreted interfaces, as interface -&gt; interface type switch and type assertion, are not implemented yet.
- conversion from typed constant to interpreted interface is not implemented. Workaround: assign the constant to a variable, then convert the variable to the interpreted interface type.
- goto is only partially implemented.
- out-of-order code in the same cell is supported, but not heavily tested. It has some known limitations for composite literals.
## Troubleshooting
### gophernotes not found
2017-09-20 10:56:44 -04:00
Depending on your environment, you may need to manually change the path to the `gophernotes` executable in `kernel/kernel.json` before copying it to `~/.local/share/jupyter/kernels/gophernotes`. You can put the **full path** to the `gophernotes` executable here, and you shouldn't have any further issues.
### "Kernel error" in a running notebook
```
Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/notebook/base/handlers.py", line 458, in wrapper
result = yield gen.maybe_future(method(self, *args, **kwargs))
File "/usr/local/lib/python2.7/site-packages/tornado/gen.py", line 1008, in run
value = future.result()
...
File "/usr/local/Cellar/python/2.7.11/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 1335, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory
```
Stop jupyter, if it's already running.
Add a symlink to `/go/bin/gophernotes` from your path to the gophernotes executable. If you followed the instructions above, this will be:
```
sudo ln -s $HOME/go/bin/gophernotes /go/bin/gophernotes
```
Restart jupyter, and you should now be up and running.