https://github.com/ipython/ipyparallel

IPython Parallel: Interactive Parallel Computing in Python
https://github.com/ipython/ipyparallel

jupyter parallel python

Last synced: about 1 month ago
JSON representation

IPython Parallel: Interactive Parallel Computing in Python

• Host: GitHub
• URL: https://github.com/ipython/ipyparallel
• Owner: ipython
• License: other
• Created: 2015-04-09T07:43:55.000Z (over 9 years ago)
• Default Branch: main
• Last Pushed: 2024-04-05T11:33:35.000Z (7 months ago)
• Last Synced: 2024-05-01T11:40:03.942Z (6 months ago)
• Topics: jupyter, parallel, python
• Language: Jupyter Notebook
• Homepage: https://ipyparallel.readthedocs.io/
• Size: 21.6 MB
• Stars: 2,551
• Watchers: 121
• Forks: 987
• Open Issues: 58
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: COPYING.md

Awesome Lists containing this project

• awesome-jupyter-resources - GitHub - 15% open · ⏱️ 16.08.2022): (Jupyter-Notebook工具)
• awesome-python-machine-learning-resources - GitHub - 15% open · ⏱️ 16.08.2022): (分布式机器学习)

README

        
# Interactive Parallel Computing with IPython

IPython Parallel (`ipyparallel`) is a Python package and collection of CLI scripts for controlling clusters of IPython processes, built on the Jupyter protocol.

IPython Parallel provides the following commands:

- ipcluster - start/stop/list clusters

- ipcontroller - start a controller

- ipengine - start an engine

## Install

Install IPython Parallel:

    pip install ipyparallel

This will install and enable the IPython Parallel extensions

for Jupyter Notebook and (as of 7.0) Jupyter Lab 3.0.

## Run

Start a cluster:

    ipcluster start

Use it from Python:

```python

import os

import ipyparallel as ipp

cluster = ipp.Cluster(n=4)

with cluster as rc:

    ar = rc[:].apply_async(os.getpid)

    pid_map = ar.get_dict()

```

See [the docs](https://ipyparallel.readthedocs.io) for more info.