Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/bocadilloproject/aiodine
🧪 Async-first Python dependency injection library
https://github.com/bocadilloproject/aiodine
async asyncio dependency-injection library python
Last synced: 21 days ago
JSON representation
🧪 Async-first Python dependency injection library
- Host: GitHub
- URL: https://github.com/bocadilloproject/aiodine
- Owner: bocadilloproject
- License: mit
- Archived: true
- Created: 2019-02-27T12:23:40.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2021-09-07T04:35:00.000Z (about 3 years ago)
- Last Synced: 2024-08-09T04:07:38.590Z (3 months ago)
- Topics: async, asyncio, dependency-injection, library, python
- Language: Python
- Homepage:
- Size: 226 KB
- Stars: 53
- Watchers: 4
- Forks: 3
- Open Issues: 9
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
- awesome-dependency-injection-in-python - Aiodine - 🧪 Async-first Python dependency injection library. [🐍, MIT License]. (Software / Archived or unmaintained DI frameworks)
README
# aiodine
[](https://www.python.org)
[][pypi-url]
[](https://travis-ci.org/bocadilloproject/aiodine)
[](https://github.com/ambv/black)
[](https://codecov.io/gh/bocadilloproject/aiodine)
[][pypi-url]
[pypi-url]: https://pypi.org/project/aiodine/
aiodine provides async-first [dependency injection][di] in the style of [Pytest fixtures](https://docs.pytest.org/en/latest/fixture.html) for Python 3.6+.
- [Installation](#installation)
- [Concepts](#concepts)
- [Usage](#usage)
- [FAQ](#faq)
- [Changelog](#changelog)
## Installation
```bash
pip install "aiodine==1.*"
```
## Concepts
aiodine revolves around two concepts:
- **Providers** are in charge of setting up, returning and optionally cleaning up _resources_.
- **Consumers** can access these resources by declaring the provider as one of their parameters.
This approach is an implementation of [Dependency Injection][di] and makes providers and consumers:
- **Explicit**: referencing providers by name on the consumer's signature makes dependencies clear and predictable.
- **Modular**: a provider can itself consume other providers, allowing to build ecosystems of reusable (and replaceable) dependencies.
- **Flexible**: provided values are reused within a given scope, and providers and consumers support a variety of syntaxes (asynchronous/synchronous, function/generator) to make provisioning fun again.
aiodine is **async-first** in the sense that:
- It was made to work with coroutine functions and the async/await syntax.
- Consumers can only be called in an asynchronous setting.
- But provider and consumer functions can be regular Python functions and generators too, if only for convenience.
## Usage
### Providers
**Providers** make a _resource_ available to consumers within a certain _scope_. They are created by decorating a **provider function** with `@aiodine.provider`.
Here's a "hello world" provider:
```python
import aiodine
@aiodine.provider
async def hello():
return "Hello, aiodine!"
```
Providers are available in two **scopes**:
- `function`: the provider's value is re-computed everytime it is consumed.
- `session`: the provider's value is computed only once (the first time it is consumed) and is reused in subsequent calls.
By default, providers are function-scoped.
### Consumers
Once a provider has been declared, it can be used by **consumers**. A consumer is built by decorating a **consumer function** with `@aiodine.consumer`. A consumer can declare a provider as one of its parameters and aiodine will inject it at runtime.
Here's an example consumer:
```python
@aiodine.consumer
async def show_friendly_message(hello):
print(hello)
```
All aiodine consumers are asynchronous, so you'll need to run them in an asynchronous context:
```python
from asyncio import run
async def main():
await show_friendly_message()
run(main()) # "Hello, aiodine!"
```
Of course, a consumer can declare non-provider parameters too. aiodine is smart enough to figure out which parameters should be injected via providers, and which should be expected from the callee.
```python
@aiodine.consumer
async def show_friendly_message(hello, repeat=1):
for _ in range(repeat):
print(hello)
async def main():
await show_friendly_message(repeat=10)
```
### Providers consuming other providers
Providers are modular in the sense that they can themselves consume other providers.
For this to work however, providers need to be **frozen** first. This ensures that the dependency graph is correctly resolved regardless of the declaration order.
```python
import aiodine
@aiodine.provider
def email():
return "[email protected]"
@aiodine.provider
async def send_email(email):
print(f"Sending email to {email}…")
aiodine.freeze() # <- Ensures that `send_email` has resolved `email`.
```
**Note**: it is safe to call `.freeze()` multiple times.
A context manager syntax is also available:
```python
import aiodine
with aiodine.exit_freeze():
@aiodine.provider
def email():
return "[email protected]"
@aiodine.provider
async def send_email(email):
print(f"Sending email to {email}…")
```
### Generator providers
Generator providers can be used to perform cleanup (finalization) operations after a provider has gone out of scope.
```python
import os
import aiodine
@aiodine.provider
async def complex_resource():
print("setting up complex resource…")
yield "complex"
print("cleaning up complex resource…")
```
**Tip**: cleanup code is executed even if an exception occurred in the consumer, so there's no need to surround the `yield` statement with a `try/finally` block.
**Important**: session-scoped generator providers will only be cleaned up if using them in the context of a session. See [Sessions](#sessions) for details.
### Lazy async providers
Async providers are **eager** by default: their return value is awaited before being injected into the consumer.
You can mark a provider as **lazy** in order to defer awaiting the provided value to the consumer. This is useful when the provider needs to be conditionally evaluated.
```python
from asyncio import sleep
import aiodine
@aiodine.provider(lazy=True)
async def expensive_io_call():
await sleep(10)
return 42
@aiodine.consumer
async def compute(expensive_io_call, cache=None):
if cache:
return cache
return await expensive_io_call
```
### Factory providers
Instead of returning a scalar value, factory providers return a _function_. Factory providers are useful to implement reusable providers that accept a variety of inputs.
> This is a _design pattern_ more than anything else. In fact, there's no extra code in aiodine to support this feature.
The following example defines a factory provider for a (simulated) database query:
```python
import aiodine
@aiodine.provider(scope="session")
async def notes():
# Some hard-coded sticky notes.
return [
{"id": 1, "text": "Groceries"},
{"id": 2, "text": "Make potatoe smash"},
]
@aiodine.provider
async def get_note(notes):
async def _get_note(pk: int) -> list:
try:
# TODO: fetch from a database instead?
return next(note for note in notes if note["id"] == pk)
except StopIteration:
raise ValueError(f"Note with ID {pk} does not exist.")
return _get_note
```
Example usage in a consumer:
```python
@aiodine.consumer
async def show_note(pk: int, get_note):
print(await get_note(pk))
```
**Tip**: you can combine factory providers with [generator providers](#generator-providers) to cleanup any resources the factory needs to use. Here's an example that provides temporary files and removes them on cleanup:
```python
import os
import aiodine
@aiodine.provider(scope="session")
def tmpfile():
files = set()
async def _create_tmpfile(path: str):
with open(path, "w") as tmp:
files.add(path)
return tmp
yield _create_tmpfile
for path in files:
os.remove(path)
```
### Using providers without declaring them as parameters
Sometimes, a consumer needs to use a provider but doesn't care about the value it returns. In these situations, you can use the `@useprovider` decorator and skip declaring it as a parameter.
**Tip**: the `@useprovider` decorator accepts a variable number of providers, which can be given by name or by reference.
```python
import os
import aiodine
@aiodine.provider
def cache():
os.makedirs("cache", exist_ok=True)
@aiodine.provider
def debug_log_file():
with open("debug.log", "w"):
pass
yield
os.remove("debug.log")
@aiodine.consumer
@aiodine.useprovider("cache", debug_log_file)
async def build_index():
...
```
### Auto-used providers
Auto-used providers are **automatically activated** (within their configured scope) without having to declare them as a parameter in the consumer.
This can typically spare you from decorating all your consumers with an `@useprovider`.
For example, the auto-used provider below would result in printing the current date and time to the console every time a consumer is called.
```python
import datetime
import aiodine
@aiodine.provider(autouse=True)
async def logdatetime():
print(datetime.now())
```
### Sessions
A **session** is the context in which _session providers_ live.
More specifically, session providers (resp. generator session providers) are instanciated (resp. setup) when entering a session, and destroyed (resp. cleaned up) when exiting the session.
To enter a session, use:
```python
await aiodine.enter_session()
```
To exit it:
```python
await aiodine.exit_session()
```
An async context manager syntax is also available:
```python
async with aiodine.session():
...
```
### Context providers
> **WARNING**: this is an experimental feature.
Context providers were introduced to solve the problem of injecting **context-local resources**. These resources are typically undefined at the time of provider declaration, but become well-defined when entering some kind of **context**.
This may sound abstract, so let's see an example before showing the usage of context providers.
#### Example
Let's say we're in a restaurant. There, a waiter executes orders submitted by customers. Each customer is given an `Order` object which they can `.write()` their desired menu items to.
In aiodine terminilogy, the waiter is the [provider](#providers) of the order, and the customer is a [consumer](#consumers).
During service, the waiter needs to listen to new customers, create a new `Order` object, provide it to the customer, execute the order as written by the customer, and destroy the executed order.
So, in this example, the **context** spans from when an order is created to when it is destroyed, and is specific to a given customer.
Here's what code simulating this situation on the waiter's side may look like:
```python
from asyncio import Queue
import aiodine
class Order:
def write(self, item: str):
...
class Waiter:
def __init__(self):
self._order = None
self.queue = Queue()
# Create an `order` provider for customers to use.
# NOTE: the actually provided value is not defined yet!
@aiodine.provider
def order():
return self._order
async def _execute(self, order: Order):
...
async def _serve(self, customer):
# NOTE: we've now entered the *context* of serving
# a particular customer.
# Create a new order that the customer can
# via the `order` provider.
self._order = Order()
await customer()
# Execute the order and destroy it.
await self._execute(self._order)
self._order = None
async def start(self):
while True:
customer = await self.queue.get()
await self._serve(customer)
```
It's important to note that customers can do _anything_ with the order. In particular, they may take some time to think about what they are going to order. In the meantime, the server will be listening to other customer calls. In this sense, this situation is an _asynchronous_ one.
An example customer code may look like this:
```python
from asyncio import sleep
@aiodine.consumer
def alice(order: Order):
# Pondering while looking at the menu…
await sleep(10)
order.write("Pizza Margheritta")
```
Let's reflect on this for a second. Have you noticed that the waiter holds only _one_ reference to an `Order`? This means that the code works fine as long as only _one_ customer is served at a time.
But what if another customer, say `bob`, comes along while `alice` is thinking about what she'll order? With the current implementation, the waiter will simply _forget_ about `alice`'s order, and end up executing `bob`'s order twice. In short: we'll encounter a **race condition**.
By using a context provider, we transparently turn the waiter's `order` into a [context variable][contextvars] (a.k.a. `ContextVar`). It is local to the context of each customer, which solves the race condition.
[contextvars]: https://docs.python.org/3/library/contextvars.html
Here's how the code would then look like:
```python
import aiodine
class Waiter:
def __init__(self):
self.queue = Queue()
self.provider = aiodine.create_context_provider("order")
async def _execute(self, order: Order):
...
async def _serve(self, customer):
order = Order()
with self.provider.assign(order=order):
await customer()
await self._execute(order)
async def start(self):
while True:
customer = await self.queue.get()
await self._serve(customer)
```
Note:
- Customers can use the `order` provider just like before. In fact, it was created when calling `.create_context_provider()`.
- The `order` is now **context-local**, i.e. its value won't be forgotten or scrambled if other customers come and make orders concurrently.
This situation may look trivial to some, but it is likely to be found in client/server architectures, including in web frameworks.
#### Usage
To create a context provider, use `aiodine.create_context_provider()`. This method accepts a variable number of arguments and returns a `ContextProvider`. Each argument is used as the name of a new [`@provider`](#providers) which provides the contents of a [`ContextVar`][contextvars] object.
```python
import aiodine
provider = aiodine.create_context_provider("first_name", "last_name")
```
Each context variable contains `None` initially. This means that consumers will receive `None` — unless they are called within the context of an `.assign()` block:
```python
with provider.assign(first_name="alice"):
# Consumers called in this block will receive `"alice"`
# if they consume the `first_name` provider.
...
```
## FAQ
### Why "aiodine"?
aiodine contains "aio" as in [asyncio], and "di" as in [Dependency Injection][di]. The last two letters end up making aiodine pronounce like [iodine], the chemical element.
[asyncio]: https://docs.python.org/3/library/asyncio.html
[di]: https://en.wikipedia.org/wiki/Dependency_injection
[iodine]: https://en.wikipedia.org/wiki/Iodine
## Changelog
See [CHANGELOG.md](https://github.com/bocadilloproject/aiodine/blob/master/CHANGELOG.md).
## License
MIT