https://github.com/xonsh/xontrib-distributed

Dask Distributed integration for Xonsh
https://github.com/xonsh/xontrib-distributed

xonsh xontrib

Last synced: about 1 month ago
JSON representation

Dask Distributed integration for Xonsh

• Host: GitHub
• URL: https://github.com/xonsh/xontrib-distributed
• Owner: xonsh
• License: mit
• Created: 2022-03-20T12:15:02.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2024-10-07T18:28:59.000Z (2 months ago)
• Last Synced: 2024-11-02T05:39:03.963Z (about 1 month ago)
• Topics: xonsh, xontrib
• Language: Python
• Homepage:
• Size: 53.7 KB
• Stars: 1
• Watchers: 5
• Forks: 1
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-xontribs - distributed - The [distributed](https://pypi.org/project/distributed/) parallel computing library hooks for xonsh. (Integrations / Prompt tweaks)

README

        


The distributed parallel computing library hooks for xonsh





If you like the idea click ⭐ on the repo and tweet.



Importantly this provides a substitute 'dworker' command

which enables distributed workers to have access to xonsh builtins.

Furthermore, this xontrib adds a 'DSubmitter' context manager

for executing a block remotely.

Moreover, this also adds a convenience function 'dsubmit()'

for creating DSubmitter and Executor instances at the same time.

Thus users may submit distributed jobs with::

```pycon

with dsubmit('127.0.0.1:8786', rtn='x') as dsub:

    x = $(echo I am elsewhere)

res = dsub.future.result()

print(res)

```

This is useful for long running or non-blocking jobs.

## Installation

To install use pip:

```bash

xpip install xontrib-distributed

# or: xpip install -U git+https://github.com/xonsh/xontrib-distributed

```

## Usage

```bash

xontrib load distributed

# TODO: what's next?

```

## Releasing your package

- Bump the version of your package.

- Create a GitHub release (The release notes are automatically generated as a draft release after each push).

- And publish with `poetry publish --build` or `twine`

## Credits

This package was created with [xontrib cookiecutter template](https://github.com/xonsh/xontrib-cookiecutter).