How can I run Jupyter Notebooks on my institution's HPC cluster?

notebooks
jupyter
question

#1

I want to use Jupyter notebook to run an analysis which needs access to data stored on the cluster. How can I launch a notebook server on the cluster?

CURATOR: Raminder Singh


#3

I recent document this for Harvard users but its very generic. This can help to run Jupyter server remotely on compute nodes of the cluster and connect to your computational notebook using a local browser of your workstation/laptop. https://www.rc.fas.harvard.edu/jupyter-notebook-server-on-odyssey/


#2

On the Shared Computing Cluster (SCC) at Boston University, the steps to run Jupyter Notebooks are outlined on the following webpage:
http://www.bu.edu/tech/support/research/software-and-programming/common-languages/python/jupyter/


#4

The University of Arizona uses Ohio Supercomputing’s OnDemand software to provide Jupyter notebooks and remote desktops. It’s free, and easily installed and configured by an experienced admin. Run’s on CentOS/RHEL 7 and perhaps other Linux variants.

Intro is at https://www.osc.edu/resources/online_portals/ondemand

Install guide and other info is at https://osc.github.io/ood-documentation/master/


#5

A lot of clusters have web interfaces these days, but sometimes you just need basic ssh forwarding and wrappers to help users do it! To help with this, we have the forward tool at Stanford:

And several “tiny tutorials” in the README to help you get started. The ssh configurations are managed in the “ssh” folder and the batch submission jobs in the “batches” folder, so if you have a new cluster or job that you’ like to add, just open an issue and I’d be happy to do this for you (and write another mini tutorial!).