Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/hnc-agency/shq
Shared inter-process queues
https://github.com/hnc-agency/shq
erlang queues
Last synced: 2 months ago
JSON representation
Shared inter-process queues
- Host: GitHub
- URL: https://github.com/hnc-agency/shq
- Owner: hnc-agency
- License: isc
- Created: 2021-12-30T13:45:35.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2024-01-03T15:36:39.000Z (12 months ago)
- Last Synced: 2024-10-01T15:07:58.527Z (3 months ago)
- Topics: erlang, queues
- Language: Erlang
- Homepage:
- Size: 147 KB
- Stars: 10
- Watchers: 1
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# shq - Shared inter-process queues
![Tests](https://github.com/hnc-agency/shq/actions/workflows/ci.yml/badge.svg)
:link: [Hex package](//hex.pm/packages/shq)`shq` requires OTP 24 or later.
## Usage
### Starting a queue
```erlang
%% Start a non-linked queue
{ok, Pid} = shq:start(Opts).
{ok, Pid} = shq:start(ServerName, Opts).%% Start a linked queue
{ok, Pid} = shq:start_link(Opts).
{ok, Pid} = shq:start_link(ServerName, Opts).%% Start a monitored queue
{ok, {Pid, Mon}} = shq:start_monitor(Opts).
{ok, {Pid, Mon}} = shq:start_monitor(ServerName, Opts).
```
ServerName
- A server name as used when starting a named
gen_server
. Opts
- A map or property list of options
max => non_neg_integer() | infinity
- The maximum number of items the queue can hold (default:
infinity
).
### Inserting an item
```erlang
%% Insert an item at the rear
shq:in(ServerRef, Item).
shq:in(ServerRef, Item, Timeout).
%% Insert an item at the front
shq:in_r(ServerRef, Item).
shq:in_r(ServerRef, Item, Timeout).
```
ServerRef
- A server reference as used with
gen_server
. Item
- The item to insert.
Timeout
- A timeout to wait for a slot to become available if the queue is full (default:
0
).
The return value is either the atom `ok` if the item was queued, the atom `full` if the queue was
full, or the atom `closed` if the queue was not accepting new items at the time of the call.
When these functions return `full` or `closed`, it is guaranteed that the given item was not inserted,
and will not be inserted later without calling this function again.
### Retrieving an item
```erlang
%% Retrieving an item from the front
shq:out(ServerRef).
shq:out(ServerRef, Timeout).
%% Retrieving an item from the rear
shq:out_r(ServerRef).
shq:out_r(ServerRef, Timeout).
```
ServerRef
- See "Inserting".
Timeout
- A timeout to wait for an item to become available if the queue is empty (default:
0
).
The return value is either a tuple `{ok, Item}`, or the atom `empty`.
When these functions return `empty`, it is guaranteed that no item was removed from the queue, and
none will be removed later without calling this function again.
### Peeking
```erlang
%% Peek at the front
shq:peek(ServerRef).
%% Peek at the rear
shq:peek_r(ServerRef).
```
ServerRef
- See "Inserting".
Peeking is the same as retrieving, but without removing the item from the queue.
The operation will always return instantly, ie there is no way to wait for an item to become available
if the queue is empty.
### Draining a queue
```erlang
%% Draining a quee from the front
shq:drain(ServerRef).
%% Draining a queue from the rear
shq:drain_r(ServerRef).
```
ServerRef
- See "Inserting".
The return value is a list of all items that were in the queue at the time when the call was made,
including the ones that were waiting for insertion.
### Retrieving queue size
```erlang
shq:size(ServerRef).
```
ServerRef
- See "Inserting".
Retrieves the number of items in the queue.
The return value is a non-negative integer.
### Closing and Reopening a queue
```erlang
%% Closing a queue
ok=shq:close(ServerRef).
%% Reopening a queue
ok=shq:open(ServerRef).
```
ServerRef
- See "Inserting".
When a queue is closed, all subsequent insert operations will be rejected and return `closed`
until it is reopened.
The queue status can be queried via `shq:status(ServerRef)`.
### Stopping a queue
```erlang
ok=shq:stop(ServerRef).
```
ServerRef
- See "Inserting".
All items left will be lost when a queue is stopped.
## Notes
As `shq` queues are backed by `ets` tables of type `set`, the number of items in a queue does
not affect its performance. However, as `ets` tables live in memory, `shq` queues are not
suitable for storing vast numbers of large items. It is also noteworthy that items waiting to
be inserted into a queue that is currently full will still be stored in the backing table,
albeit temporarily, and thus still against available memory.
## Authors
* Maria Scott (Maria-12648430)
* Jan Uhlig (juhlig)