{"id":46600620,"url":"https://github.com/anonympins/data-primals-engine","last_synced_at":"2026-03-07T16:03:35.304Z","repository":{"id":305784553,"uuid":"1023942721","full_name":"anonympins/data-primals-engine","owner":"anonympins","description":"Manage and automate your data at scale 🚀 With data-primals-engine you get workflows, dashboards, alerts, i18n, client integration \u0026 AI assistant — all open-source, all MongoDB powered.","archived":false,"fork":false,"pushed_at":"2026-01-23T01:42:03.000Z","size":7776,"stargazers_count":2,"open_issues_count":7,"forks_count":1,"subscribers_count":0,"default_branch":"develop","last_synced_at":"2026-01-23T18:47:56.394Z","etag":null,"topics":["api","automation","data","data-analysis","data-engineer","data-visualization","database","expressjs","low-code","mongodb","nodejs","rest-api"],"latest_commit_sha":null,"homepage":"https://data.primals.net","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/anonympins.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-07-22T00:28:10.000Z","updated_at":"2026-01-23T01:42:06.000Z","dependencies_parsed_at":null,"dependency_job_id":"82d3c1f6-533e-4361-9b7f-78947ef85919","html_url":"https://github.com/anonympins/data-primals-engine","commit_stats":null,"previous_names":["anonympins/data-primals-engine"],"tags_count":44,"template":false,"template_full_name":null,"purl":"pkg:github/anonympins/data-primals-engine","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anonympins%2Fdata-primals-engine","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anonympins%2Fdata-primals-engine/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anonympins%2Fdata-primals-engine/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anonympins%2Fdata-primals-engine/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/anonympins","download_url":"https://codeload.github.com/anonympins/data-primals-engine/tar.gz/refs/heads/develop","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anonympins%2Fdata-primals-engine/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":30221193,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-07T14:02:48.375Z","status":"ssl_error","status_checked_at":"2026-03-07T14:02:43.192Z","response_time":53,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["api","automation","data","data-analysis","data-engineer","data-visualization","database","expressjs","low-code","mongodb","nodejs","rest-api"],"created_at":"2026-03-07T16:03:34.588Z","updated_at":"2026-03-07T16:03:35.299Z","avatar_url":"https://github.com/anonympins.png","language":"JavaScript","readme":"# data-primals-engine\n[![Node.js CI](https://github.com/anonympins/data-primals-engine/actions/workflows/node.js.yml/badge.svg?branch=main)](https://github.com/anonympins/data-primals-engine/actions/workflows/node.js.yml)\n![](https://img.shields.io/npm/dw/data-primals-engine)\n![](https://img.shields.io/npm/last-update/data-primals-engine)\n![](https://img.shields.io/github/v/release/anonympins/data-primals-engine)\n![](https://img.shields.io/github/license/anonympins/data-primals-engine)\n\n**data-primals-engine** is a powerful and flexible **Node.js** backend framework designed to accelerate the development of complex data-driven applications. Built on **Express.js** and **MongoDB**, it provides a solid foundation so you can focus on what makes your application unique.\n\n\u003e Whether you're building a CRM, e-commerce site, CMS, or SaaS platform, **data-primals-engine** provides the strong foundations so you can focus on what makes your application unique.\n\n---\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://data.primals.net/prez1.jpg\" target=\"_blank\"\u003e\u003cimg alt=\"Light\" src=\"https://data.primals.net/prez1.jpg\" width=\"35%\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://data.primals.net/prez6.jpg\" target=\"_blank\"\u003e\u003cimg alt=\"Light\" src=\"https://data.primals.net/prez6.jpg\" width=\"35%\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://data.primals.net/api-docs\" target=\"_blank\"\u003e\u003cimg alt=\"Dark\" src=\"https://data.primals.net/prez5.jpg\" width=\"25%\"\u003e\u003c/a\u003e\n\u003c/p\u003e\n---\n\n## 🚀 Key Features\n\n- **Visual Data Modeling**: Define and update schemas using a powerful UI Model Creator, or directly with JSON. No migrations required.\n- **Custom API Endpoints**: Create server-side logic and new API endpoints directly from the UI in a secure, sandboxed environment.\n- **Automation Workflows**: Trigger complex actions based on data events (create, update, delete) or schedules (cron).\n- **Advanced Querying \u0026 Aggregation**: Go beyond simple filters with a visual Condition Builder, deep relation expansion, complex lookups, and dynamic calculated fields.\n- **Rich UI Data Views**: Ready-to-use React components to display your data, including a powerful and configurable Data Table, a Kanban board, and a Calendar view.\n- **Integrated Backup \u0026 Restore**: Secure, encrypted user data backups with rotation policies, supporting both local and AWS S3 storage.\n- **Automatic Data Auditing**: Automatically tracks all changes (create, update, delete) for every record, providing a complete version history for auditing and traceability.\n- **Event-Driven \u0026 Extensible**: A core event system allows for deep customization and the easy creation of new modules or plugins.\n- **Authentication \u0026 Authorization**: Robust role-based access control (RBAC) and pluggable user providers.\n- **Built-in File Management**: Handle file uploads seamlessly with integrated support for AWS S3 storage.\n- **🧠 AI Integration**: Natively supports OpenAI, DeepSeek and Google Gemini models via LangChain for content generation, analysis, and more.\n- **🌐 Internationalization (i18n)**: Fully supports multilingual interfaces and user-specific translated data.\n- **📦 Starter Packs**: Quickly bootstrap applications with pre-built data packs for CRM, e-commerce, and more.\n- **📄Auto-Generated API Documentation**: Interactive API documentation available via the interface or at `/api-docs`.\n\n## 🌟 Why Choose data-primals-engine?\n\n- **Zero Boilerplate**: Focus on your business logic, not infrastructure\n- **Scalability**: Architecture designed for rapidly growing applications\n- **Modularity**: Enable/disable features as needed\n- **Batteries Included**: Everything you need to get started quickly\n- **Proven Performance**: Handles 50k+ documents efficiently\n- **AI Ready**: Built-in LangChain integration for main providers (OpenAI,Gemini,Anthropic,DeepSeek)\n\n---\n\n## 📊 Proven Performance\n\nThe engine has been rigorously tested to ensure stability and scalability. Load tests simulating complex, multi-step user journeys (including model creation, data import, and API interactions) show excellent results:\n- **Zero Failures**: 100% success rate under sustained concurrent load.\n- **Excellent Responsiveness**: Median response times as low as 15-30ms.\n- **Linear Scaling**: Predictable performance as user load increases.\n\nFor detailed reports, see the Performance Testing Documentation.\n\n---\n\n## ⚙️ Requirements\n\n- Node.js ≥ 20\n- MongoDB (local or remote), see installation guide\n- NPM or Yarn\n\n---\n\n## ⚡ Quick Start\n\n### 1. Prerequisites\n- **Node.js** ≥ 20\n- **MongoDB** (local or remote)\n\n### check\n```bash\n# Verify required versions\nnode -v # Must show ≥ v20\nmongod --version # Must be installed\n```\n\n### 2. Installation\n\n```bash\nnpm i data-primals-engine\n```\nor\n```bash\ngit clone https://github.com/anonympins/data-primals-engine.git\ncd data-primals-engine\nnpm install\n```\n\n### 3. Configuration\n\nCreate a `.env` file in the project root to configure the connection to your database :\n\n```env\nMONGO_DB_URL=mongodb://127.0.0.1:27017/my_database\nJWT_SECRET=a_long_and_random_secret\n```\n\nTo discover all available environment variables (AWS, SMTP, AI, etc.), consult the **configuration documentation**.\n\n### 4. Launch\n\n```bash\n# Development mode with automatic reloading\nnpm run devserver\n\n# Production mode\nnpm run server\n```\n\nBy default, the application is available at `http://localhost:7633`.\n\n---\n\n\n## 🧭 Explore the Platform\nDiscover the core features to get started building and managing your data.\nLink to the official documentation: https://data.primals.net/en/documentation/\n\n- 🧠 [Core Concepts](https://github.com/anonympins/data-primals-engine/wiki/Concepts): Explore the fundamentals of data modeling\n- 🔌 [Custom API Endpoints](https://github.com/anonympins/data-primals-engine/wiki/Custom-Endpoints): Create dynamic HTTP routes directly from the backend\n- 🏗️ [Data Models](https://data.primals.net/en/documentation/create-models): Structure your information.\n- 🗃️ [Data Management](https://data.primals.net/en/documentation/manage-data): Create, read, update, and delete your entries.\n- 📊 [Views (Table, Kanban)](Views): Visualize your data in different ways. *(Page to be created)*\n- 📈 [Dashboards, KPIs, and Charts](https://data.primals.net/en/documentation/dashboards): Track your key metrics.\n- 👥 [Users](https://data.primals.net/en/documentation/users): Manage access to the platform.\n- 🔐 [Roles and Permissions](https://data.primals.net/en/documentation/roles-permissions): Define who can see and do what.\n- ⚙️ [Automation with Workflows](https://data.primals.net/en/documentation/automation-workflows): Create automated processes.\n\n## 🔌 Integrate with your tools\nConnect the platform to your external applications and services via our API.\n\n- 📡 [API Requests](https://data.primals.net/en/documentation/api): The basics for interacting with the REST API.\n- 🚀 [Advanced Requests](https://data.primals.net/en/documentation/advanced-requests): Filters, sorts, projections, and more.\n- 📦 [Bulk Operations](https://data.primals.net/en/documentation/bulk-operations): Perform operations on large volumes of data.\n\n## 🧩 Extend Capabilities\nGo further by developing your own features and business logic.\n\n- ⚡ [Event System](Event-system): React to events in real time. *(Page to create)*\n- 🧠 [Advanced Workflows](Advanced-workflows): Create complex logic with custom scripts. *(Page to create)*\n- 📦 [Modules](Modules): Package and share your developments. *(Page to create)*\n- ❤️ [Contribute to the project (CONTRIBUTING.md)](https://github.com/anonympins/data-primals-engine/blob/main/CONTRIBUTING.md): Join the developer community.\n\n## 💻 For Developers\nEssential tools for a seamless development experience.\n\n- 📖 [Explore the API with Swagger](https://data.primals.net/api-docs/): Test API access points directly from your browser.\n- 📮 [Postman Collection](https://data.primals.net/doc/API.postman_collection.json): Import our collection to start querying in just a few clicks.\n\n## 🤝 Contribution\n\nContributions are welcome! Check out the open issues to get started.\n\n---\n\n## 📄 License\nDistributed under the **MIT License**. See the `LICENSE` file.","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fanonympins%2Fdata-primals-engine","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fanonympins%2Fdata-primals-engine","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fanonympins%2Fdata-primals-engine/lists"}