Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/devstopfix/ex_aws_bedrock
Elixir library for AWS Bedrock
https://github.com/devstopfix/ex_aws_bedrock
Last synced: 16 days ago
JSON representation
Elixir library for AWS Bedrock
- Host: GitHub
- URL: https://github.com/devstopfix/ex_aws_bedrock
- Owner: devstopfix
- Created: 2024-01-10T19:26:14.000Z (10 months ago)
- Default Branch: main
- Last Pushed: 2024-03-15T11:11:22.000Z (8 months ago)
- Last Synced: 2024-03-15T12:32:14.842Z (8 months ago)
- Language: Elixir
- Size: 66.4 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# ExAws.Bedrock
> The easiest way to build and scale generative AI applications with foundation models
> -- https://aws.amazon.com/bedrock/
Service module for [Elixir AWS](https://github.com/ex-aws/ex_aws).
This library supports listing and invoking models of text and images and streaming of responses. Agents are not yet supported.
[](https://github.com/devstopfix/ex_aws_bedrock/actions/workflows/ci.yml)
[](https://hex.pm/packages/ex_aws_bedrock)
[](https://hexdocs.pm/ex_aws_bedrock/ExAws.Bedrock.html)
## Installation
The package can be installed by adding `:ex_aws_bedrock` to your list of dependencies in `mix.exs`
along with `:ex_aws`, and your preferred HTTP client and JSON codec.
```elixir
def deps do
[
{:ex_aws, ">= 2.5.1"},
{:ex_aws_bedrock, "~> 2.5"},
{:hackney, "~> 1.9"},
{:jason, "~> 1.1"},
{:poison, "~> 3.0"}
]
end
```
***NOTE***:
* this requires a minimum `ex_aws` version of 2.5.1.
* if you wish to stream responses, please include `hackney` and `jason`.
## Unit tests
The default suite of unit tests verify the requests generated by this library.
If you wish to test against AWS with live requests then you need to
configure `ExAws` in the standard way as described in it's README.
For example you could create an `.env` file:
export AWS_ACCESS_KEY_ID="AK..."
export AWS_SECRET_ACCESS_KEY="..."
export AWS_REGION="us-east-1"
Then set the variables and run the tests with:
source .env && mix test --only aws
## Usage
The AWS bedrock actions and operations are defined in [ExAws.Bedrock module][mod].
Each model takes their inference parameters as JSON documents which are defined
in the [model parameters section of the AWS user guide][models]. You can pass
plain Elixir maps which are then JSON encoded, or define structs which implement
the encoder protocol of your chosen JSON codec. This library has an example
under [ExAws.Bedrock.Titan.TextModel](lib/ex_aws/bedrock/titan/text_model.ex).
The Meta models can be invoked with a pure map input:
```elixir
%{
"prompt" => "What is the best AWS client library for the Elixir programming language?",
"temperature" => 0.5,
"top_p" => 0.9,
"max_gen_len" => 80
}
```
## Example
Run the example script to sample the models and their quality of responses:
source .env && mix run examples.exs
Outputs:
Asking meta.llama2-70b-chat-v1 "Complete this riddle. Ruby is to Yukihiro Matsumoto as Elixir is to" with temperature=0.8
Answer: José Valim.
Explanation:
Ruby is a programming language created by Yukihiro Matsumoto, also known as Matz.
Elixir is a programming language created by José Valim, also known as José.
Therefore, the answer to the riddle is "José Valim".
Asking meta.llama2-70b-chat-v1 "What is the best AWS client library for the Elixir programming language?" with temperature=0.8
Answer: The best AWS client library for the Elixir programming language is the `ex_aws` library. It is a lightweight, idiomatic Elixir client for AWS services, providing a simple and intuitive API for interacting with AWS.
## License
The MIT License (MIT).
[json]: https://hexdocs.pm/jason/Jason.Encoder.html
[mod]: https://hexdocs.pm/ex_aws_bedrock/ExAws.Bedrock.html
[models]: https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters.html