An open API service indexing awesome lists of open source software.

https://github.com/shiva-prasad-naroju/blog-generator

A lightweight Streamlit app that generates blog content using a locally hosted, quantized LLaMA 2 model.
https://github.com/shiva-prasad-naroju/blog-generator

genai genai-chatbot llama2 metaai

Last synced: 4 months ago
JSON representation

A lightweight Streamlit app that generates blog content using a locally hosted, quantized LLaMA 2 model.

Awesome Lists containing this project

README

          

# LLaMA 2 Blog Generator

A lightweight Streamlit application that generates human-like blog content using a locally hosted **LLaMA 2** model. Designed for low-end systems, this project eliminates the need for cloud-based APIs by running entirely on your machine with a quantized `.ggml` model.

## ๐Ÿš€ What It Does

- ๐Ÿ“ Generates blog posts from a topic and selected writing style.
- ๐ŸŽ›๏ธ Customizable word length and tone.
- โšก Runs efficiently on low-spec laptops using quantized inference.

## ๐Ÿง  Technology Stack

- **LLaMA 2 (Quantized)** โ€“ Local language model (e.g., `ggmlv3.q8_0.bin`)
- **CTransformers** โ€“ For loading and running LLaMA 2 without GPUs
- **LangChain** โ€“ Prompt templating and model invocation
- **Streamlit** โ€“ Simple UI for topic input and result display

## โœ… Use Cases

- ๐Ÿ“š Quick blog drafts for content creators
- ๐Ÿงช Experimentation with LLMs
- ๐Ÿง‘โ€๐ŸŽ“ Educational tool to learn LLM workflows
- ๐Ÿ”Œ API-free solution for writing assistance

## ๐Ÿ’ป Requirements

- Python 3.9+
- Minimum 8 GB RAM (recommended)
- Local storage for model (~4โ€“5 GB)
- 2 CPU cores (minimum)

## Result UI:

![Generated Blog Screenshot](result_ui_img/BlogGenerator.png)