Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/PSPDFKit-labs/sidetask
:awesome = Elixir's Task ++ Basho's sidejob library
https://github.com/PSPDFKit-labs/sidetask
Last synced: about 2 months ago
JSON representation
:awesome = Elixir's Task ++ Basho's sidejob library
- Host: GitHub
- URL: https://github.com/PSPDFKit-labs/sidetask
- Owner: PSPDFKit-labs
- License: mit
- Created: 2014-10-15T18:48:37.000Z (over 9 years ago)
- Default Branch: master
- Last Pushed: 2017-06-12T18:01:06.000Z (about 7 years ago)
- Last Synced: 2024-03-16T07:02:16.278Z (3 months ago)
- Language: Elixir
- Homepage:
- Size: 126 KB
- Stars: 70
- Watchers: 8
- Forks: 5
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
Lists
- awesome-elixir - sidetask - SideTask is an alternative to Task.Supervisor using Basho's sidejob library with parallelism and capacity limiting. (Cloud Infrastructure and Management)
- freaking_awesome_elixir - Elixir - SideTask is an alternative to Task.Supervisor using Basho's sidejob library with parallelism and capacity limiting. (Cloud Infrastructure and Management)
- awesome-elixir - sidetask - SideTask is an alternative to Task.Supervisor using Basho's sidejob library with parallelism and capacity limiting. (Cloud Infrastructure and Management)
- fucking-awesome-elixir - sidetask - SideTask is an alternative to Task.Supervisor using Basho's sidejob library with parallelism and capacity limiting. (Cloud Infrastructure and Management)
README
SideTask
========
[](https://travis-ci.org/PSPDFKit-labs/sidetask)
SideTask is an alternative to Elixir's
[Task.Supervisor](http://elixir-lang.org/docs/stable/elixir/Task.Supervisor.html) that uses Basho's
[sidejob](https://github.com/basho/sidejob) library for better parallelism and to support capacity
limiting of [Tasks](http://elixir-lang.org/docs/stable/elixir/Task.html).
Elixir's `Task.Supervisor` is implemented as a single `:simple_one_for_one` supervisor with the
individual `Task`s as children. This means starting a new task has to go through this single
supervisor. Furthermore there is no limit to the number of workers that can be running at the same
time.
Basho's sidejob library spawns multiple supervisors (one for each scheduler by default) and
uses ETS tables to keep track of the number of workers, thereby making it possible to start
workers in parallel while also putting an upper bound on the number of running workers.
SideTask provides an API similar to `Task.Supervisor`, with the addition that all calls that
start a new task require a sidejob resource as argument and can return `{:error, :overload}`.
Convenience functions for adding and deleting sidejob resources are provided.
## Example 1
```elixir
SideTask.add_resource(:example1, 50)
potential_tasks = for i <- 1..100 do
case SideTask.async(:example1, fn -> :timer.sleep(1000); i end) do
{:ok, task} ->
IO.puts "Task #{i} created"
task
{:error, :overload} ->
IO.puts "Task #{i} not created, overloaded"
nil
end
end
IO.inspect for task = %Task{} <- potential_tasks, do: Task.await(task)
```
## Example 2
```elixir
# Erlang spawns one scheduler per CPU core by default
schedulers = :erlang.system_info(:schedulers)
SideTask.add_resource(:example2, schedulers * 2)
for scheduler <- 1..schedulers do
spawn_link fn ->
for i <- Stream.iterate(0, &(&1+1)) do
SideTask.start_child :example2, fn ->
:timer.sleep(250);
IO.inspect scheduler: scheduler, count: i
end
end
end
end
```
## License
This software is licensed under [the MIT license](LICENSE).
## About
This project is maintained and funded by [PSPDFKit](https://pspdfkit.com/).
See [our other open source projects](https://github.com/PSPDFKit-labs), read [our blog](https://pspdfkit.com/blog/) or say hello on Twitter ([@PSPDFKit](https://twitter.com/pspdfkit)).