https://github.com/maxbleu/maui_anythinglm_rag
This app is designed to use LM Studio with AnythingLLM, allowing an AI to search and retrieve information from the documents you upload to the RAG system.
https://github.com/maxbleu/maui_anythinglm_rag
ai anythingllm csharp embeddings lm lmstudio maui mobile-app rag
Last synced: 16 days ago
JSON representation
This app is designed to use LM Studio with AnythingLLM, allowing an AI to search and retrieve information from the documents you upload to the RAG system.
- Host: GitHub
- URL: https://github.com/maxbleu/maui_anythinglm_rag
- Owner: Maxbleu
- Created: 2025-05-05T11:40:19.000Z (18 days ago)
- Default Branch: master
- Last Pushed: 2025-05-06T11:24:15.000Z (17 days ago)
- Last Synced: 2025-05-07T18:13:20.359Z (16 days ago)
- Topics: ai, anythingllm, csharp, embeddings, lm, lmstudio, maui, mobile-app, rag
- Language: C#
- Homepage:
- Size: 17.1 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# MauiApp with RAG's AnyThingLM
This app is designed to use LM Studio with AnythingLLM, allowing an AI to search and retrieve information from the documents you upload to the RAG system.
## Instalation dependences
So for this proyect you will need two software that before I have indicated you.
-
LMStudio
When you download LM Studio on your device, you will be able to start the setup steps.
1. First of all, if you want to load a small IA model, you will need to go the last option of
the left vertical menu named ```Discover```
2. Search in the bar for example ```llama-3.2-1b-instruct```, when you select
the model clicked in download button.
3. When you download the model, to load the model downloaded you will click
in the option above
```Select a model to load``` and click in ```Load model```
4. You need to put your LMStudio in server mode and you can do it,
clicking in the second option of the left vertical menu named ```Developer```
5. Finally, you need to activate in ```settings``` the first option ```serve on local network```
-
AnyThingLLM
When you download AnyThingLLM on your device, you will be able to start the setup steps.
-
IMPORTANT
¡For this step it is very important don't have open AnyThingLLM!
1. Before, you start to prepare AnyThingLLM, you will need to go to this PATH in your file explorer:
`C:\Users\your_username\AppData\Local\Programs\AnythingLLM\resources\backend`. Make click in `server.js`
2. Open in Visual Studio and use keyboard shortcut `Ctrl+F`, string to search indicate `127.0.0.1`
and for replace `0.0.0.0`. You will replace 5 references.
3. When the change is done close everything and you open AnyThingLLM. Later you go
to your browser put the ip of your device and the path to go to AnyThingLLM Swagger API.
Like: http://YOUR_IP:3001/api/docs
1. First of all, during the installation you will arrive a step what, you will need to
indicate your `LLM Providers` and you will put `LM Studio`, When you will
select `LM Studio` how LM provider will indicate in field **LM Studio Model** the model
that you selected.
2. After you have setuped and installed AnyThingLLM, you will go to configurations and
select LM preference and you should see your LM provider and LM Studio model selected. Check
it is everything okey.
3. Go to your workspace settings that you have created go to `chat configuration`.
You will indicate **query** in `chat mode` and translate the prompt to your
language.
4. You will go to configuration (the botton last option of the left bar), click
in `Tools` section and go to `API KEY`. Create a new API KEY to have api autorization.
5. Finally, when you start the app you will put your API KEY in settings to
start the conection the AnyThingLLM
