Project Jupyter

Project Jupyter (/ˈdʒuːpɪtər/ (listen)) is a nonprofit organization created to "develop open-source software, open-standards, and services for interactive computing across dozens of programming languages".[2] Spun off from IPython in 2014 by Fernando Pérez, Project Jupyter supports execution environments in several dozen languages. Project Jupyter's name is a reference to the three core programming languages supported by Jupyter, which are Julia, Python and R, and also a homage to Galileo's notebooks recording the discovery of the moons of Jupiter. Project Jupyter has developed and supported the interactive computing products Jupyter Notebook, JupyterHub, and JupyterLab.

Project Jupyter
AbbreviationJupyter
FormationFebruary 2015 (2015-02)
Typenonprofit organization
PurposeTo support interactive data science and scientific computing across all programming languages.[1]
Region served
Worldwide
Official language
English
Websitejupyter.org

History
Galileo Galilei's manuscript from 1610 with observations of Jupiter (⊛) and four of its moons (✱).

In 2014, Fernando Pérez announced a spin-off project from IPython called Project Jupyter.[3] IPython continues to exist as a Python shell and a kernel for Jupyter, while the notebook and other language-agnostic parts of IPython moved under the Jupyter name.[4][5] Jupyter is language agnostic and it supports execution environments (aka kernels) in several dozen languages among which are Julia, R, Haskell, Ruby, and of course Python (via the IPython kernel).[6]

In 2015, GitHub and the Jupyter Project announced native rendering of Jupyter notebooks file format (.ipynb files) on the GitHub platform.[7][8]

Philosophy

Project Jupyter's operating philosophy is to support interactive data science and scientific computing across all programming languages via the development of open-source software. According to the Project Jupyter website, "Jupyter will always be 100% open-source software, free for all to use and released under the liberal terms of the modified BSD license".[1]

Products

Jupyter Notebook

Jupyter Notebook (formerly IPython Notebooks) is a web-based interactive computational environment for creating Jupyter notebook documents. The "notebook" term can colloquially make reference to many different entities, mainly the Jupyter web application, Jupyter Python web server, or Jupyter document format depending on context. A Jupyter Notebook document is a JSON document, following a versioned schema, containing an ordered list of input/output cells which can contain code, text (using Markdown), mathematics, plots and rich media, usually ending with the ".ipynb" extension.

A Jupyter Notebook can be converted to a number of open standard output formats (HTML, presentation slides, LaTeX, PDF, ReStructuredText, Markdown, Python) through "Download As" in the web interface, via the nbconvert library[9] or "jupyter nbconvert" command line interface in a shell. To simplify visualisation of Jupyter notebook documents on the web, the nbconvert library is provided as a service through NbViewer[10] which can take a URL to any publicly available notebook document, convert it to HTML on the fly and display it to the user.

Jupyter Notebook interface

Jupyter Notebook provides a browser-based REPL built upon a number of popular open-source libraries:

Jupyter Notebook can connect to many kernels to allow programming in different languages. By default Jupyter Notebook ships with the IPython kernel. As of the 2.3 release[11][12] (October 2014), there are currently 49 Jupyter-compatible kernels for many programming languages, including Python, R, Julia and Haskell.[13]

The Notebook interface was added to IPython in the 0.12 release[14] (December 2011), renamed to Jupyter notebook in 2015 (IPython 4.0 – Jupyter 1.0). Jupyter Notebook is similar to the notebook interface of other programs such as Maple, Mathematica, and SageMath, a computational interface style that originated with Mathematica in the 1980s.[15] According to The Atlantic, Jupyter interest overtook the popularity of the Mathematica notebook interface in early 2018.[15]

Jupyter kernels

A Jupyter kernel is a program responsible for handling various types of requests (code execution, code completions, inspection), and providing a reply. Kernels talk to the other components of Jupyter using ZeroMQ, and thus can be on the same or remote machines. Unlike many other Notebook-like interfaces, in Jupyter, kernels are not aware that they are attached to a specific document, and can be connected to many clients at once. Usually kernels allow execution of only a single language, but there are a couple of exceptions.

JupyterHub

JupyterHub[16] is a multi-user server for Jupyter Notebooks. It is designed to support many users by spawning, managing, and proxying many singular Jupyter Notebook servers. While JupyterHub requires managing servers, third-party services like Jupyo[17] provide an alternative to JupyterHub by hosting and managing multi-user Jupyter notebooks in the cloud.

JupyterLab

JupyterLab is a newer user interface for Project Jupyter. It offers the building blocks of the classic Jupyter Notebook (notebook, terminal, text editor, file browser, rich outputs, etc.) in a flexible user interface. The first stable release was announced on February 20, 2018.[18]

Jupyter{Book}

Jupyter Book is an open source project for building books and documents from computational material.[19] It allows the user to construct the content in a mixture of Markdown, an extended version of Markdown called MyST,[20] Maths & Equations using MathJax, Jupyter Notebooks, reStructuredText, the output of running Jupyter Notebooks at build time. Multiple output formats can be produced (currently single files, multipage HTML web pages and PDF files).

nbgrader

nbgrader is a tool for creating and grading (marking) assignments in Jupyter notebooks.[21] It allows the instructor to create assignments that include coding exercises in python or any other supported kernel and text responses. The submitted assignments can be automatically marked, manually scored or a mixture of both.

Industry adoption

The Jupyter Notebook has become a popular user interface for cloud computing, and major cloud providers have adopted the Jupyter Notebook or derivative tools as a frontend interface for cloud users. Examples include Amazon's SageMaker Notebooks,[22] Google's Colaboratory[23] and Microsoft's Azure Notebook.[24]

Colaboratory
"Colaboratory" redirects here. It is not to be confused with Collaboratory.

Colaboratory (also known as Colab) is a free Jupyter notebook environment that runs in the cloud and stores its notebooks on Google Drive. Colab was originally an internal Google project; an attempt[25] was made to open source all the code and work more directly upstream, leading to the development of the "Open in Colab" Google Chrome extension,[26] but this eventually ended, and Colab development continued internally. As of October 2019, the Colaboratory UI only allows you to create notebooks with Python 2 and Python 3 kernels; however, if you have an existing notebook whose kernelspec is IR or Swift, that will work, since both R and Swift are installed in the container. Julia language can also work on Colab (with e.g. Python and GPUs; Google's tensor processing units also work with Julia on Colab[27]).[28][29]

Media coverage
  • On February 11, 2016, the LIGO collaboration announced the first observation of gravitational waves. The collaboration released the raw scientific data along with Jupyter Notebooks containing Python code to process the data and reproduce the figures from the discovery paper.[30]
  • On April 5, 2018, The Atlantic published an article entitled The Scientific Paper Is Obsolete, which discussed the role of the Jupyter Notebook and the Mathematica notebook in the future of scientific publishing.[15] This article led to responses from prominent scientists and academics, including economist Paul Romer.[31]

Grants and awards

See also

References
  1. "Project Jupyter - About Us". 2018-04-20. Retrieved 2018-05-03.
  2. "Project Jupyter". www.jupyter.org. Retrieved 2020-11-13.
  3. "Project Jupyter // Speaker Deck".
  4. "The Notebook, Qt console and a number of other pieces are now parts of Jupyter".
  5. "The Big Split™".
  6. "Project Jupyter | Home".
  7. sshirokov (2015-05-07). "GitHub + Jupyter Notebooks = <3". The GitHub Blog. Retrieved 2018-04-10.
  8. "Rendering Notebooks on GitHub – Jupyter Blog". Jupyter Blog. 2015-05-07. Retrieved 2018-04-10.
  9. "nbconvert: Convert Notebooks to other formats — nbconvert 6.0.8.dev0 documentation". nbconvert.readthedocs.io. Retrieved 2020-11-13.
  10. "nbviewer". nbviewer.jupyter.org. Retrieved 2020-11-13.
  11. "What's new in IPython > Issues closed in the 2.x development cycle".
  12. "What's new in IPython > 2.0 Series".
  13. "Jupyter kernels > List of (some) IPython compatible kernels".
  14. "Notebook's announcement- 0.12 release note".
  15. Somers, James. "The Scientific Paper Is Obsolete". The Atlantic. Retrieved 2018-04-10.
  16. https://jupyter.org/hub
  17. "Jupyo | Jupyter notebooks for Python, R, Julia in the cloud". jupyo.com. Archived from the original on 2019-01-03. Retrieved 2019-01-02.
  18. "JupyterLab is Ready for Users – Jupyter Blog". Jupyter Blog. 2018-02-20. Retrieved 2018-05-04.
  19. "Books with Jupyter". jupyterbook.org. Retrieved 2020-11-13.
  20. "The MyST Syntax Guide". myst-parser.readthedocs.io. Retrieved 2020-11-13.
  21. "nbgrader — nbgrader 0.6.1 documentation". nbgrader.readthedocs.io. Retrieved 2020-11-13.
  22. "Amazon SageMaker on AWS". Amazon Web Services, Inc. Retrieved 2018-05-09.
  23. "Welcome to Colaboratory". research.google.com. Retrieved 2018-05-09.
  24. "Microsoft Azure Notebooks - Online Jupyter Notebooks". notebooks.azure.com. Retrieved 2018-05-09.
  25. "Nerds rejoice: Google just released its internal tool to collaborate on AI". Quartz. Retrieved 2018-09-06.
  26. "Open in Colab GitHub repository". GitHub. Retrieved 2018-09-06.
  27. Julia on TPUs, JuliaTPU, 2019-12-03, retrieved 2019-12-03
  28. "Google Colaboratory". colab.research.google.com. Retrieved 2019-12-06.
  29. "gpu - Julia in Google Colab". Stack Overflow. Retrieved 2019-12-06.
  30. "LIGO Open Science Center". losc.ligo.org. Retrieved 2018-05-04.
  31. "Jupyter, Mathematica, and the Future of the Research Paper – Paul Romer". paulromer.net. Retrieved 2018-04-15.
  32. "Sloan Foundation Grant — IPython". ipython.org. Retrieved 2018-05-03.
  33. "An Open Source Framework for Interactive, Collaborative and Reproducible Scientific Computing and EducationOpen Source Tools for Interactive, Collaborative and Reproducible Computing". ipython.org. Retrieved 2018-05-03.
  34. Perez, Fernando (December 28, 2015). "IPython 2015 Final Report - Sloan Foundation" (PDF). ipython.org. Retrieved May 3, 2018.
  35. "UC Berkeley and Cal Poly to Expand and Enhance Open-Source Software for Scientific Computing and Data Science | Helmsley Charitable Trust". helmsleytrust.org. Retrieved 2018-05-03.
  36. "Software System Award". ACM Awards. Association for Computing Machinery. Retrieved April 28, 2016.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.