https://github.com/cysharp/aiapitracer
A reverse proxy for local development environments that intercepts requests to AI services like OpenAI, Anthropic, etc.., allowing you to trace request and response content.
https://github.com/cysharp/aiapitracer
ai csharp dotnet
Last synced: 12 months ago
JSON representation
A reverse proxy for local development environments that intercepts requests to AI services like OpenAI, Anthropic, etc.., allowing you to trace request and response content.
- Host: GitHub
- URL: https://github.com/cysharp/aiapitracer
- Owner: Cysharp
- License: mit
- Created: 2025-07-11T10:55:56.000Z (12 months ago)
- Default Branch: main
- Last Pushed: 2025-07-14T12:20:36.000Z (12 months ago)
- Last Synced: 2025-07-14T13:48:21.388Z (12 months ago)
- Topics: ai, csharp, dotnet
- Language: C#
- Homepage:
- Size: 1.67 MB
- Stars: 3
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# AIApiTracer
A reverse proxy for local development environments that intercepts requests to AI services like OpenAI, Anthropic, Azure OpenAI, and xAI, allowing you to trace request and response content.
Simply put, it's like [Cloudflare AI Gateway Logs](https://developers.cloudflare.com/ai-gateway/observability/logging/) specialized for local development environments. Note that it's not intended for auditing, monitoring, or team usage.
## Features
- Monitor locally without using external services
- Human-readable display of requests and responses
- Support for multiple AI services
- OpenAI
- Anthropic
- Microsoft Azure OpenAI
- xAI
- OpenAI Compatible APIs
- In-memory: No data persistence, retains up to 1000 records
## Quick Start
### 1. Run AIApiTracer
#### Using Docker
Run AIApiTracer using the Docker image (ghcr.io/cysharp/aiapitracer).
```bash
docker run -p 8080:8080 ghcr.io/cysharp/aiapitracer:latest
```
#### Using pre-build binary
You can download and run the pre-built application from the [Releases](https://github.com/Cysharp/AIApiTracer/releases) page.
```bash
./AIApiTracer --urls http://localhost:8080/
```
### 2. Open in your browser
Once started, you can view request traces by accessing `http://localhost:8080` in your web browser.
### 3. Change Various Endpoints to AIApiTracer
#### OpenAI
Specify `http://localhost:8080/endpoint/openai/v1` as the endpoint instead of `https://api.openai.com/v1`.
```bash
curl http://localhost:8080/endpoint/openai/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $API_KEY" \
-d '{
"messages": [
{
"role": "user",
"content": "Hello."
}
],
"model": "gpt-4.1-nano"
}'
```
```csharp
var openAIClient = new OpenAIClient(new ApiKeyCredential(apiKey), new OpenAIClientOptions
{
Endpoint = new Uri($"http://localhost:8080/endpoint/openai/v1"),
});
```
#### Anthropic
Specify `http://localhost:8080/endpoint/anthropic` as the endpoint instead of `https://api.anthropic.com/`.
#### Claude Code
```bash
export ANTHROPIC_BASE_URL=http://localhost:8080/endpoint/anthropic
```
#### Azure OpenAI
Specify `http://localhost:8080/endpoint/aoai/` as the endpoint instead of `https://.openai.azure.com/`.
```csharp
var azureClient = new AzureOpenAIClient(
new Uri("http://localhost:8080/endpoint/aoai/my-resource"),
new AzureKeyCredential(credential)
);
```
#### xAI
Specify `http://localhost:8080/endpoint/x/v1` as the endpoint instead of `https://api.x.ai/v1`.
```bash
curl http://localhost:8080/endpoint/x/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $API_KEY" \
-d '{
"messages": [
{
"role": "user",
"content": "Hello."
}
],
"model": "grok-3-latest"
}'
```
```csharp
var openAIClient = new OpenAIClient(new ApiKeyCredential(apiKey), new OpenAIClientOptions
{
Endpoint = new Uri($"http://localhost:8080/endpoint/x/v1"),
});
```
#### OpenAI Compatible
Specify `http://localhost:8080/endpoint/openai-compat/` as the endpoint.
⚠️ **Security Notice**: The OpenAI compatible endpoint is disabled by default for security reasons. You must explicitly enable it by setting the environment variable `AIApiTracer__EnableOpenAICompatForwarding` to `true`. When enabled, you should absolutely avoid making it accessible from external networks as it would become an open proxy.
Specify the address of the OpenAI compatible API endpoint after `openai-compat/`, including the scheme. For example, use `http://localhost:8080/endpoint/openai-compat/http://localhost:5273/v1`.
```bash
curl http://localhost:8080/endpoint/openai-compat/http://localhost:5273/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $API_KEY" \
-d '{
"messages": [
{
"role": "user",
"content": "Hello."
}
],
"model": "Phi-4-mini-instruct-cuda-gpu"
}'
```
```csharp
var openAIClient = new OpenAIClient(new ApiKeyCredential(apiKey), new OpenAIClientOptions
{
Endpoint = new Uri($"http://localhost:8080/endpoint/openai-compat/http://localhost:5273/v1"), // `http://localhost:5273/v1` is Foundry Local
});
```
## TODO
- [ ] Support for more AI services (Google Vertex AI, Amazon Bedrock)
## License
MIT License