https://github.com/soodaayush/llamatalk

A chatbot powered by Meta's Codellama.
https://github.com/soodaayush/llamatalk

codellama css html javscript ollama scss

Last synced: about 1 month ago
JSON representation

A chatbot powered by Meta's Codellama.

• Host: GitHub
• URL: https://github.com/soodaayush/llamatalk
• Owner: soodaayush
• Created: 2024-02-01T21:39:50.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2025-03-08T23:57:09.000Z (over 1 year ago)
• Last Synced: 2025-03-09T00:24:28.674Z (over 1 year ago)
• Topics: codellama, css, html, javscript, ollama, scss
• Language: SCSS
• Homepage:
• Size: 66.4 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# LlamaTalk

![llamatalk](https://github.com/user-attachments/assets/d2fdb3f1-6871-4da9-8c0c-b210b9ba8be3)

## Inspiration

I’ve always wanted a personal chatbot that runs locally, something private, responsive, and customizable. When I discovered Ollama, which makes running LLMs locally super straightforward, I decided to build a minimal front-end that lets anyone interact with an LLM through a browser interface.

## Challenges

- Establishing a reliable connection between the front-end and the local LLM service

- Properly formatting the request and parsing the LLM's response

- Ensuring a seamless user experience with fast, local responses

## Lessons Learned

- How to run and interact with local LLMs via Ollama

- Sending and receiving JSON data using `fetch` in JavaScript

- Handling response objects and dynamically updating the UI

- Customizing models and experimenting with local inference setups

## The Website

LlamaTalk is a simple, sleek interface for chatting with locally hosted LLMs via Ollama. Powered by Meta's CodeLlama, LlamaTalk lets you ask questions and get intelligent responses, all while keeping everything on your own machine.

## Links

Ollama: https://ollama.com/