https://github.com/thalesfsp/inference

Provides building blocks to integrate with AI / LLM providers and built-in, common, providers.
https://github.com/thalesfsp/inference

abstraction ai anthropic foundation inference llm ollama openai

Last synced: 28 days ago
JSON representation

Provides building blocks to integrate with AI / LLM providers and built-in, common, providers.

• Host: GitHub
• URL: https://github.com/thalesfsp/inference
• Owner: thalesfsp
• License: mit
• Created: 2024-10-18T16:29:44.000Z (about 1 month ago)
• Default Branch: main
• Last Pushed: 2024-10-19T03:13:50.000Z (30 days ago)
• Last Synced: 2024-10-19T08:11:30.055Z (29 days ago)
• Topics: abstraction, ai, anthropic, foundation, inference, llm, ollama, openai
• Language: Go
• Homepage:
• Size: 39.1 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Codeowners: .github/CODEOWNERS

Awesome Lists containing this project

README

        
## Overview

The `Inference` package serves as a core foundation for building AI/LLM (Large Language Model) providers, enabling integration with various AI/LLM platforms like OpenAI, Anthropic, and offline models via Ollama. It abstracts away the complexities of interacting with multiple LLM services by offering a standardized interface for inference requests, handling responses, and managing interactions, making it easier to integrate and scale AI-driven capabilities in applications.