An open API service indexing awesome lists of open source software.

https://github.com/pabroux/llm-engineers-handbook

LLM Engineer's Handbook by Paul Iusztin and Maxime Labonne with pixi.
https://github.com/pabroux/llm-engineers-handbook

aws fine-tuning-llm genai llm llm-evaluation llmops ml-system-design mlops pixi rag

Last synced: 3 months ago
JSON representation

LLM Engineer's Handbook by Paul Iusztin and Maxime Labonne with pixi.

Awesome Lists containing this project

README

          

# 👷 LLM Engineer's Handbook




License Badge




pixi Badge


This is a [Pixi](https://pixi.sh)-based adaptation of the official repository [LLM Engineer's Handbook](https://github.com/PacktPublishing/LLM-Engineers-Handbook) by [Paul Iusztin](https://github.com/iusztinpaul) and [Maxime Labonne](https://github.com/mlabonne). The primary modification is the replacement of [Poetry](https://github.com/python-poetry/poetry) and its [Poe the Poet](https://github.com/nat-n/poethepoet) plugin with Pixi.

## Table of contents

- [Requirements](#requirements)
- [Install](#install)
- [Usage](#usage)

## Requirements

Compared to the requirements of the official repository, only install the following instead of [Poetry](https://github.com/python-poetry/poetry) and its [Poe the Poet](https://github.com/nat-n/poethepoet) plugin:

- [Pixi](https://pixi.sh)

## Install

All Pixi commands are configured in the `pyproject.toml` file. The `pixi.lock` file records the exact package versions to guarantee reproducibility. These two files are the only ones that differ from the original repository. You can either clone this repository directly or copy just these two files into your clone of the official repository.

Once you have these two files in your repository, install the dependencies as follows:
```shell
pixi install -a
```

## Usage

Replace any call or task made in the book with `poe` by `pixi run`:
```shell
pixi run local-infrastructure-up # is the same as `poe local-infrastructure-up`
```

> [!NOTE]
> Like in the book, I created two other environments:
> - `dev`: related to QA operations.
> - `aws`: related to AWS.
>
> When you work with one of them, call the task by adding the option `-e` followed by the name of the environment. For instance, `poe lint-check` becomes `pixi run -e dev lint-check`.