Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/fiddler-labs/fiddler-auditor

Fiddler Auditor is a tool to evaluate language models.
https://github.com/fiddler-labs/fiddler-auditor

ai-observability evaluation generative-ai langchain llms nlp robustness

Last synced: 9 days ago
JSON representation

Fiddler Auditor is a tool to evaluate language models.

Host: GitHub
URL: https://github.com/fiddler-labs/fiddler-auditor
Owner: fiddler-labs
License: other
Created: 2023-05-18T22:58:28.000Z (over 1 year ago)
Default Branch: main
Last Pushed: 2024-03-11T02:49:45.000Z (8 months ago)
Last Synced: 2024-10-07T18:36:19.756Z (about 1 month ago)
Topics: ai-observability, evaluation, generative-ai, langchain, llms, nlp, robustness
Language: Python
Homepage:
Size: 1.73 MB
Stars: 165
Watchers: 8
Forks: 20
Open Issues: 15
Metadata Files:
- Readme: README.md
- License: LICENSE
- Audit: auditor/__init__.py
- Codeowners: CODEOWNERS

Awesome Lists containing this project

awesome-llmops - Fiddler AI - production to production. Ship more ML and LLMs into production, and monitor ML and LLM metrics like hallucination, PII, and toxicity. | ![GitHub Badge](https://img.shields.io/github/stars/fiddler-labs/fiddler-auditor.svg?style=flat-square) | (Security / Observability)

README

Auditing Large Language Models made easy!

[![lint](https://github.com/fiddler-labs/fiddler-auditor/actions/workflows/codelint.yml/badge.svg?event=schedule)](https://github.com/fiddler-labs/fiddler-auditor/actions/workflows/codelint.yml)
[![test](https://github.com/fiddler-labs/fiddler-auditor/actions/workflows/test.yml/badge.svg?event=schedule)](https://github.com/fiddler-labs/fiddler-auditor/actions/workflows/test.yml)

## What is Fiddler Auditor?

Language models enable companies to build and launch innovative applications to improve productivity and increase customer satisfaction.
However, it’s been known that LLMs can hallucinate, generate adversarial responses that can harm users, and even expose private information that they were trained on when prompted or unprompted. It's more critical than ever for ML and software application teams to minimize these risks and weaknesses before launching LLMs and NLP models. As a result, it’s important for you to include a process to audit language models thoroughly before production.
The Fiddler Auditor enables you to test LLMs and NLP models, identify weaknesses in the models, and mitigate potential adversarial outcomes before deploying them to production.

## Features and Capabilities

Fiddler Auditor supports

- Red-teaming LLMs for your use-case with prompt perturbation
- Integration with LangChain
- Custom evaluation metrics
- Generative and Discriminative NLP models
- Comparison of LLMs

An example report generated by the Fiddler Auditor for text-davinci-003.

## Installation

### From PyPI
Auditor is available on PyPI and we test on Python 3.8 and above. We recommend creating a virtual python environment and installing using the following command

```bash
pip install fiddler-auditor
```

### From source
You can install from source after cloning this repo using the following command

```bash
pip install .
```

## Quick-start guides
- [Fiddler Auditor Quickstart](https://github.com/fiddler-labs/fiddler-auditor/blob/main/examples/LLM_Evaluation.ipynb) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/fiddler-labs/fiddler-auditor/blob/main/examples/LLM_Evaluation.ipynb)
- [Evaluate LLMs with custom metrics](https://github.com/fiddler-labs/fiddler-auditor/blob/main/examples/Custom_Evaluation.ipynb) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/fiddler-labs/fiddler-auditor/blob/main/examples/Custom_Evaluation.ipynb)
- [Prompt injection attack with custom transformation](https://github.com/fiddler-labs/fiddler-auditor/blob/main/examples/Custom_Transformation.ipynb) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/fiddler-labs/fiddler-auditor/blob/main/examples/Custom_Transformation.ipynb)

## Contribution
We are continuously updating this library to support language models as they evolve.

- Contributions in the form of suggestions and PRs to Fiddler Auditor are welcome!
- If you encounter a bug, please feel free to raise issues in this repository.

For step-by-step instructions follow the [Contribution Guide](CONTRIBUTION.md).

## Community
- For questions and support, join the [Fiddler Community](https://www.fiddler.ai/slackinvite)
- Discover the latest guides, videos, and research with the [Fiddler Resources Library](https://www.fiddler.ai/resources)
- Stay informed by following us on [Twitter](https://twitter.com/fiddlerlabs)
- Subscribe to our [monthly newsletter](https://www.fiddler.ai/blog#subscribe)
- [Request a demo](https://www.fiddler.ai/demo)