https://github.com/drorspei/dasker

monadic dask in separate process
https://github.com/drorspei/dasker

Last synced: 6 months ago
JSON representation

monadic dask in separate process

• Host: GitHub
• URL: https://github.com/drorspei/dasker
• Owner: drorspei
• License: mit
• Created: 2022-11-03T09:07:30.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2022-11-04T12:16:46.000Z (over 3 years ago)
• Last Synced: 2025-01-30T22:27:50.619Z (over 1 year ago)
• Language: Python
• Size: 3.91 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# dasker

monadic dask

example:

    dasker '{}' python -c "import dasker; print(dasker.get_client().submit(lambda: 'hello, world!').result())"

equivalent example, because it's a monad:

    dasker '{}' dasker '{}' python -c "import dasker; print(dasker.get_client().submit(lambda: 'hello, world!').result())"

if dasker wasn't used to start dask, a default client is used. example:

    python -c "import dasker; print(dasker.get_client().submit(lambda: 'hello, world!').result())"

if you want to override the contextual dask, use --force-new. example:

    dasker '{"processes": false}' dasker --force-new '{"processes": true, "nthreads": 1, "n_workers": 1}' command ...