https://github.com/dylancl/nextjs-sag-llm

A small Next.js app which utilises search results to feed context to the LLM.
https://github.com/dylancl/nextjs-sag-llm

llama llamacpp llm modelfusion rag sag typescript

Last synced: about 1 month ago
JSON representation

A small Next.js app which utilises search results to feed context to the LLM.

• Host: GitHub
• URL: https://github.com/dylancl/nextjs-sag-llm
• Owner: dylancl
• Created: 2024-04-04T07:08:19.000Z (10 months ago)
• Default Branch: main
• Last Pushed: 2024-04-04T07:30:10.000Z (10 months ago)
• Last Synced: 2024-10-30T00:52:25.517Z (3 months ago)
• Topics: llama, llamacpp, llm, modelfusion, rag, sag, typescript
• Language: TypeScript
• Homepage:
• Size: 162 KB
• Stars: 8
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
This is a [Next.js](https://nextjs.org/) project bootstrapped with [`create-next-app`](https://github.com/vercel/next.js/tree/canary/packages/create-next-app).

https://github.com/dylancl/nextjs-sag-llm/assets/14956708/0e88993d-d9e9-471c-bdf0-ac9a25e995c7

## Getting Started

### Llama.cpp

First, start a server for the LLM:

```bash

./server -m models/Hermes-2-Pro-Mistral-7B.Q4_K_S.gguf -c 12000

```

Then, start a server for the embedding model (on a different port, in this case `8081`):

```bash

./server -m models/nomic-embed-text-v1.Q5_K_S.gguf -c 8192 --embedding --port 8081

```

### Next.js

Run the development server:

```bash

npm run dev

# or

yarn dev

# or

pnpm dev

# or

bun dev

```

Open [http://localhost:3000](http://localhost:3000) with your browser to see the result.

You can start editing the page by modifying `app/page.tsx`. The page auto-updates as you edit the file.

This project uses [`next/font`](https://nextjs.org/docs/basic-features/font-optimization) to automatically optimize and load Inter, a custom Google Font.

## Learn More

To learn more about Next.js, take a look at the following resources:

- [Next.js Documentation](https://nextjs.org/docs) - learn about Next.js features and API.

- [Learn Next.js](https://nextjs.org/learn) - an interactive Next.js tutorial.

You can check out [the Next.js GitHub repository](https://github.com/vercel/next.js/) - your feedback and contributions are welcome!

## Deploy on Vercel

The easiest way to deploy your Next.js app is to use the [Vercel Platform](https://vercel.com/new?utm_medium=default-template&filter=next.js&utm_source=create-next-app&utm_campaign=create-next-app-readme) from the creators of Next.js.

Check out our [Next.js deployment documentation](https://nextjs.org/docs/deployment) for more details.