Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/mindsdb/mindsdb

The platform for building AI from enterprise data
https://github.com/mindsdb/mindsdb

ai ai-agents artificial-intelligence auto-gpt chatbot database forecasting gpt gpt4all hacktoberfest huggingface llm machine-learning ml mongodb mysql postgres semantic-search timeseries

Last synced: 5 days ago
JSON representation

The platform for building AI from enterprise data

Awesome Lists containing this project

README 

        








	MindsDB Release

	Python supported

	

	PyPI - Downloads

	Docker pulls



  


  



  

    MindsDB

  



  


    


    Website

    ·

    Docs

    ·

    Community Slack

  





----------------------------------------



MindsDB is the world's most effective solution for building AI applications that talk to messy enterprise data sources. Think of it as a librarian Marie Kondo.





  




A federated query engine that tidies up your data-sprawl chaos while meticulously answering every single question you throw at it. From structured to unstructured data, whether it's scattered across SaaS applications, databases, or... hibernating in data warehouses like that $100 bill in your tuxedo pocket from prom night, lost, waiting to be discovered.



## Install MindsDB Server 



MindsDB is an open-source server that can be deployed anywhere - from your laptop to the cloud, and everywhere in between. And yes, you can customize it to your heart's content.



  * [Using Docker Desktop](https://docs.mindsdb.com/setup/self-hosted/docker-desktop). This is the fastest and recommended way to get started and have it all running.

  * [Using Docker](https://docs.mindsdb.com/setup/self-hosted/docker). This is also simple, but gives you more flexibility on how to further customize your server.

  * [Using PyPI](https://docs.mindsdb.com/contribute/install). This option enables you to contribute to MindsDB.



## Connect Your Data



You can connect to hundreds of [data sources (learn more)](https://docs.mindsdb.com/integrations/data-overview). This is just an example of a Postgres database.



```sql

-- Connect to demo postgres DB

CREATE DATABASE demo_postgres_db

WITH ENGINE = "postgres",

PARAMETERS = {

  "user": "demo_user",

  "password": "demo_password",

  "host": "samples.mindsdb.com",

  "port": "5432",

  "database": "demo",

  "schema": "demo_data"

};

```



Once you've connected your data sources, you can [combine](https://docs.mindsdb.com/mindsdb_sql/sql/api/join-on), [slice it, dice it](https://docs.mindsdb.com/mindsdb_sql/sql/api/select), and [transform](https://docs.mindsdb.com/use-cases/data_enrichment/overview) it however your heart desires using good ol' standard SQL [(learn more)](https://docs.mindsdb.com/mindsdb_sql/overview). 



After you've whipped your data into shape, it's time to build AI that actually learns!



## Build AI Knowledge



Our Knowledge Bases are state-of-the-art autonomous RAG systems that can digest data from any source MindsDB supports. Whether your data is structured and neater than a Swiss watch factory or unstructured and messy as a teenager's bedroom, our Knowledge Base engine will figure out how to find the relevant information. 



**In this example** we will create a knowledge base that knows everything about amazon reviews. 



```sql

-- first create a knowledge base

CREATE KNOWLEDGE_BASE mindsdb.reviews_kb;



-- now insert everything from the amazon reviews table into it, so it can learn it

INSERT INTO mindsdb.reviews_kb (

  SELECT review as content FROM demo_pg_db.amazon_reviews

);



-- check the status of your loads here

SELECT * FROM information_schema.knowledge_bases;



-- query the content of the knowledge base

SELECT * FROM mindsdb.reviews_kb;

```



For the tinkerers and optimization enthusiasts out there, you can dive as deep as you want. [(Learn more about knowledge Bases)](https://docs.mindsdb.com/mindsdb_sql/agents/knowledge-bases)



+ Want to [hand-pick your embedding model? Go for it](https://docs.mindsdb.com/mindsdb_sql/agents/knowledge-bases#knowledge-base-with-openai-embedding-model)! 

+ Have strong [opinions about vector databases? We're here for it!](https://docs.mindsdb.com/mindsdb_sql/agents/knowledge-bases#knowledge-base-with-custom-vector-store). 



But if you'd rather spend your time on other things (like finally building that billion-dollar AI App), that's perfectly fine too. By default, it's all handled automatically - you don't need to worry about the nitty-gritty details like data embedding, chunking, vector optimization, etc.



## Search 



Now that your knowledge base is loaded and ready. Let's hunt for some juicy info!



#### Via SQL



```sql

-- Find the reviews that about Iphone in beast of lights

SELECT *  FROM mindsdb.reviews_kb

WHERE content LIKE 'what are the best kindle reviews'

LIMIT 10;

```



#### Via Python SDK



Install MindsDB SDK



```shell

pip install mindsdb_sdk

```



You can call this AI knowledge base from your app with the following code:



```python

import mindsdb_sdk



# connects to the specified host and port

server = mindsdb_sdk.connect('http://127.0.0.1:47334')



wiki_kb = server.knowledge_bases.get('mindsdb.reviews_kb');

df = my_kb.find('what are the best kindle reviews').fetch()



```



## 🤝 Contribute



Interested in contributing to MindsDB? Follow our [installation guide for development](https://docs.mindsdb.com/contribute/install?utm_medium=community&utm_source=github&utm_campaign=mindsdb%20repo).



You can find our [contribution guide here](https://docs.mindsdb.com/contribute/contribute?utm_medium=community&utm_source=github&utm_campaign=mindsdb%20repo).



We welcome suggestions! Feel free to open new issues with your ideas, and we’ll guide you.



This project adheres to a [Contributor Code of Conduct](https://github.com/mindsdb/mindsdb/blob/main/CODE_OF_CONDUCT.md). By participating, you agree to follow its terms.



Also, check out our [community rewards and programs](https://mindsdb.com/community?utm_medium=community&utm_source=github&utm_campaign=mindsdb%20repo).



## 🤍 Support



If you find a bug, please submit an [issue on GitHub](https://github.com/mindsdb/mindsdb/issues/new/choose).



Here’s how you can get community support:



* Ask a question in our [Slack Community](https://mindsdb.com/joincommunity?utm_medium=community&utm_source=github&utm_campaign=mindsdb%20repo).

* Join our [GitHub Discussions](https://github.com/mindsdb/mindsdb/discussions).

* Post on [Stack Overflow](https://stackoverflow.com/questions/tagged/mindsdb) with the MindsDB tag.



For commercial support, please [contact the MindsDB team](https://mindsdb.com/contact?utm_medium=community&utm_source=github&utm_campaign=mindsdb%20repo).



## 💚 Current Contributors





  




Generated with [contributors-img](https://contributors-img.web.app).



## 🔔 Subscribe for Updates



Join our [Slack community](https://mindsdb.com/joincommunity)