https://github.com/HyperMink/inferenceable

Scalable AI Inference Server for CPU and GPU with Node.js | Utilizes llama.cpp and parts of llamafile C/C++ core under the hood.
https://github.com/HyperMink/inferenceable

ai chatgpt generative-ai gpt inference inference-engine llama llama3 llava llms localai nodejs phi3 vision vision-api

Last synced: about 1 month ago
JSON representation

Scalable AI Inference Server for CPU and GPU with Node.js | Utilizes llama.cpp and parts of llamafile C/C++ core under the hood.

• Host: GitHub
• URL: https://github.com/HyperMink/inferenceable
• Owner: HyperMink
• License: apache-2.0
• Created: 2024-05-29T00:11:23.000Z (about 1 month ago)
• Default Branch: main
• Last Pushed: 2024-05-30T06:04:33.000Z (about 1 month ago)
• Last Synced: 2024-05-30T14:56:35.646Z (about 1 month ago)
• Topics: ai, chatgpt, generative-ai, gpt, inference, inference-engine, llama, llama3, llava, llms, localai, nodejs, phi3, vision, vision-api
• Language: JavaScript
• Homepage: https://inferenceable.com
• Size: 4.86 MB
• Stars: 11
• Watchers: 1
• Forks: 0
• Open Issues: 0

Lists

• awesome-stars - HyperMink/inferenceable - Scalable AI Inference Server for CPU and GPU with Node.js | Utilizes llama.cpp and parts of llamafile C/C++ core under the hood. (JavaScript)