An open API service indexing awesome lists of open source software.

https://github.com/javascript-pro/aki

Abgeschottet KI is a Prototype of a ringfenced AI powered Document Management for SMEs
https://github.com/javascript-pro/aki

kunstig-intelligens-programmering

Last synced: 14 days ago
JSON representation

Abgeschottet KI is a Prototype of a ringfenced AI powered Document Management for SMEs

Awesome Lists containing this project

README

          

## AKI° Abgeschottete künstliche Intelligenz (Air-gapped AI)

AKI° is an Open Source document assistant designed to help comply with legal and regulatory requirements when working with sensitive documents. By running all AI processing locally, AKI° ensures that confidential files and prompts never leave your device—helping you avoid accidental data leaks and stay on the right side of the law (e.g., GDPR, attorney/client privilege, or other professional secrecy obligations).

#### Ollama and Phi-3: Local AI Models

This project uses [Ollama](https://ollama.com/) to run large language models (LLMs) locally, ensuring your data never leaves your machine. Ollama is an open-source tool that lets you run and manage LLMs on your own device.

[Phi-3](https://azure.microsoft.com/en-us/blog/introducing-phi-3-redefining-whats-possible-with-slms/) is a family of lightweight, high-performance language models developed by Microsoft. In this project, you can run Phi-3 locally using Ollama for private, fast, and secure AI-powered document management. Many other LLMs, both free and commercial, are also available.

#### Prerequisites

| Tool | Version | Notes |
|------|---------|-------|
| [Node.js](https://nodejs.org) | 20 LTS or later | |
| [Yarn](https://yarnpkg.com) | 4.x (Berry) | Enabled via `corepack enable` |
| [Ollama](https://ollama.com) | latest | Runs the local LLM |

#### Quickstart: Setup and Run AKI° with Phi-3

1. **Clone the repository**

```bash
git clone https://github.com/goldlabelapps/aki.git
cd aki
```

2. **Install dependencies**

```bash
corepack enable # activates Yarn 4 from package.json#packageManager
yarn install
```

3. **Install Ollama**

- Download Ollama from [https://ollama.com/download](https://ollama.com/download) and install it for your OS (macOS, Windows, or Linux).
- Follow the installation instructions on the website.

4. **Pull the Phi-3 model**

```bash
ollama pull phi3
```

5. **Start the Ollama server**

```bash
ollama serve
```

6. **(Optional) Run other models**

You can also run other models, for example:
```bash
ollama run codellama
```

7. **Start AKI°**

This command starts the Ollama LLM server and loads the phi3 model:
```bash
yarn start
```

**Note:** The `package.json` includes scripts to start Ollama and run these models for convenience.

#### Test Prompts

> Simple cut+paste propmts to try. See if AKI° can give a sensible answer

Explain what machine learning weights which make LLM's work are in kindergarten terms

Wie könnten große Sprachmodelle deutschen Anwaltskanzleien bei der Recherche helfen?

What does the GDPR mean for a law firm in Europe that processes personal data?

What risks arise if companies send confidential files to a public AI service like ChatGPT?

Erkläre in einfachen Worten, was das Berufsgeheimnis für deutsche Rechtsanwälte bedeutet.

Explain in simple terms what professional secrecy means for UK lawyers.

What confidentiality obligations do firms have toward their clients?

## Contributing

See [CONTRIBUTING.md](./CONTRIBUTING.md) for guidelines on how to get involved.

## License

MIT — see [LICENSE](./LICENSE).