{"id":24496325,"url":"https://github.com/satendrakumar/openlit-fastapi-poc","last_synced_at":"2026-04-28T12:02:28.141Z","repository":{"id":273495932,"uuid":"919884304","full_name":"satendrakumar/openlit-fastapi-poc","owner":"satendrakumar","description":" openlit integration with FastAPI using Ollama model server","archived":false,"fork":false,"pushed_at":"2025-01-24T15:04:50.000Z","size":118,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-10-24T10:11:22.087Z","etag":null,"topics":["docker-compose","fastapi","openlit","opentelemetry","oveservability","poetry","python"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/satendrakumar.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-01-21T07:29:35.000Z","updated_at":"2025-03-05T04:41:19.000Z","dependencies_parsed_at":"2025-10-04T18:24:33.544Z","dependency_job_id":"5bdacad5-446f-4e30-89a1-f42be1605350","html_url":"https://github.com/satendrakumar/openlit-fastapi-poc","commit_stats":null,"previous_names":["satendrakumar/openlit-fastapi-poc"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/satendrakumar/openlit-fastapi-poc","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/satendrakumar%2Fopenlit-fastapi-poc","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/satendrakumar%2Fopenlit-fastapi-poc/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/satendrakumar%2Fopenlit-fastapi-poc/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/satendrakumar%2Fopenlit-fastapi-poc/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/satendrakumar","download_url":"https://codeload.github.com/satendrakumar/openlit-fastapi-poc/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/satendrakumar%2Fopenlit-fastapi-poc/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32379629,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-28T11:25:28.583Z","status":"ssl_error","status_checked_at":"2026-04-28T11:25:05.435Z","response_time":56,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["docker-compose","fastapi","openlit","opentelemetry","oveservability","poetry","python"],"created_at":"2025-01-21T21:16:30.127Z","updated_at":"2026-04-28T12:02:28.126Z","avatar_url":"https://github.com/satendrakumar.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# openlit-fastapi-poc\n\n\n#### Start openlit server using docker compose:\n```shell\ncd openlit-docker\ndocker compose up -d \n# Open browser: \n  http://localhost:3000/\n  username - user@openlit.io\n  password - openlituser\n```\n\n#### Ollama setup on local:\n```shell\ndocker run -d -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama\n\ndocker exec -it ollama ollama run llama3.1\n```\n\n### Start openlit fastapi app:\n```shell\npoetry config virtualenvs.in-project true\npoetry install\nset -a;source .env; set +a\npython main.py\n### API docs\nhttp://localhost:8000/docs\n```\n\n#### Test using curl request:\n```shell\ncurl --location 'http://localhost:8000/v1/api/chat' \\\n--header 'Content-Type: application/json' \\\n--data '{\n  \"model\": \"llama3\",\n  \"question\": \"Tell me about Nvidia'\\''s Future?\"\n}'\n#### response:\n{\n    \"answer\": \"NVIDIA is a leading technology company that has been at the forefront of innovation in various fields, including graphics processing units (GPUs), high-performance computing, artificial intelligence (AI), and autonomous vehicles. Here are some potential future developments and trends related to NVIDIA:\\n\\n**Short-term (2023-2025)**\\n\\n1. **Advancements in AI**: NVIDIA will continue to push the boundaries of AI research and development, with a focus on areas like natural language processing, computer vision, and reinforcement learning.\\n2. **Increased adoption of GPUs for HPC**: As high-performance computing (HPC) becomes more widespread, NVIDIA's GPUs are expected to play an increasingly important role in accelerating simulations, modeling, and data analysis.\\n3. **Expansion of autonomous vehicle technology**: NVIDIA will continue to develop its Drive platform, which enables the development of Level 2-5 autonomous vehicles.\\n\\n**Mid-term (2025-2030)**\\n\\n1. **Quantum Computing**: NVIDIA is exploring the potential of quantum computing and has already demonstrated a proof-of-concept for a quantum-accelerated GPU.\\n2. **Advancements in Edge AI**: As edge computing becomes more prevalent, NVIDIA will focus on developing more efficient and powerful edge AI solutions that can be deployed at the edge of networks.\\n3. **Increased adoption of GPUs in data centers**: With the growing demand for cloud services, NVIDIA's GPUs are expected to become even more ubiquitous in data centers.\\n\\n**Long-term (2030-2040)**\\n\\n1. **Neuromorphic Computing**: NVIDIA is researching neuromorphic computing architectures that mimic the human brain's neural networks. This could lead to significant breakthroughs in AI and machine learning.\\n2. **Advancements in 3D XPoint Technology**: NVIDIA has acquired a company called Bright, which specializes in 3D XPoint technology (a type of non-volatile memory). This could enable faster and more efficient data storage solutions.\\n3. **Increased focus on sustainability**: As the world becomes increasingly aware of environmental concerns, NVIDIA may prioritize developing more energy-efficient and sustainable technologies.\\n\\n**Speculative Future Developments**\\n\\n1. **Brain-Computer Interfaces (BCIs)**: NVIDIA has already demonstrated a BCI prototype that enables people to control devices with their thoughts.\\n2. **Quantum-Accelerated AI**: As quantum computing advances, it's possible that NVIDIA will develop quantum-accelerated AI solutions that can solve complex problems in fields like medicine and climate modeling.\\n3. **Holographic Displays**: With the development of advanced display technologies, NVIDIA may explore the creation of holographic displays that enable immersive experiences.\\n\\nKeep in mind that these are just predictions based on current trends and NVIDIA's past innovations. The future is inherently uncertain, and actual developments may differ from these projections.\"\n}\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsatendrakumar%2Fopenlit-fastapi-poc","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsatendrakumar%2Fopenlit-fastapi-poc","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsatendrakumar%2Fopenlit-fastapi-poc/lists"}