awesome-db-tools
Everything that makes working with databases easier
https://github.com/mgramin/awesome-db-tools
Last synced: 30 days ago
JSON representation
API
Samples
- Datasette - A tool for exploring and publishing data.
- DreamFactory - A open source REST API backend for mobile, web, and IoT applications.
- Graphweaver - Turn multiple data sources into a single GraphQL API.
- Hasura GraphQL Engine - Blazing fast, instant realtime GraphQL APIs on PostgreSQL with fine grained access control, also trigger webhooks on database events.
- PostgREST - REST API for any PostgreSQL database.
- prest - Is a way to serve a RESTful API from any databases written in Go.
- Remult - End-to-end type-safe CRUD via REST API for your database, with fine-grained access control.
- restSQL - SQL generator with Java and HTTP APIs, uses a simple RESTful HTTP API with XML or JSON serialization.
- resquel - Easily convert your SQL database into a REST API.
- sandman2 - Automatically generate a RESTful API service for your legacy database.
- soul - Automatic SQLite RESTful and realtime API server.
- VulcanSQL - Write templated SQL to automatically exposing RESTful APIs from your database/data warehouse/data lake.
- PostGraphile - Instantly spin-up a GraphQL API server by pointing PostGraphile at your existing PostgreSQL database.
- JdbcREST - REST API for any JDBC-backed database, a PostgREST clone written in Java.
- Prisma - Turns your database into a realtime GraphQL API.
Application platforms
Samples
- Appsmith - Powerful open source low code framework to build internal applications really quickly.
- Budibase - Low-code platform for creating internal apps in minutes.
- ILLA Cloud - Low-code internal tool building platform.
- Nhost - The Open Source Firebase Alternative with GraphQL.
- Saltcorn - Open source no-code builder for web database applications. Server and drag-and-drop UI builder, data stored in PostgreSQL or SQLite.
- SQLPage - Fast SQL-only data application builder. Automatically build a UI on top of SQL queries.
- Tooljet - Open-source low-code platform to build internal tools.
Backup
Samples
- pgbackrest - Reliable PostgreSQL Backup & Restore.
- pgcopydb - Copy a PostgreSQL database to a target PostgreSQL server (pg_dump | pg_restore on steroids).
- Databasus - Tool for scheduled PostgreSQL backups via web UI with external storages (local, S3, FTP, Google Drive, etc.), notifications (webhook, Discord, Slack, etc.) and team management.
- pg_probackup - A backup and recovery manager for PostgreSQL.
- Portabase - Agent-based platform for PostgreSQL backups and restores with decentralized execution and centralized orchestration.
CLI
dbcli
- athenacli - CLI tool for AWS Athena service that can do auto-completion and syntax highlighting.
- litecli - CLI for SQLite Databases with auto-completion and syntax highlighting.
- mssql-cli - A command-line client for SQL Server with auto-completion and syntax highlighting.
- mycli - A Terminal Client for MySQL with AutoCompletion and Syntax Highlighting.
- pgcli - PostgreSQL CLI with autocompletion and syntax highlighting.
- vcli - Vertica CLI with auto-completion and syntax highlighting.
- ipython-sql - Connect to a database for issue SQL commands within IPython or IPython Notebook.
- iredis - A Cli for Redis with AutoCompletion and Syntax Highlighting.
- pgcenter - Top-like admin tool for PostgreSQL.
- pg_top - Top for PostgreSQL.
- pspg - PostgreSQL Pager.
- sqlite-utils - CLI tools for manipulating SQLite database files - inserting data, running queries, creating indexes, configuring full-text search and more.
- SQLLine - Command-line shell for issuing SQL to relational databases via JDBC.
- usql - A universal command-line interface for PostgreSQL, MySQL, Oracle Database, SQLite3, Microsoft SQL Server, and many other databases including NoSQL and non-relational databases!
- diesel-guard - Linter for dangerous PostgreSQL migration patterns. It works seamlessly with PostgreSQL SQL files and integrates natively with projects using Diesel and SQLx.
Cloning
Samples
- Spawn - Cloud service for creating instant database copies for development and CI. No more local db installs, instant recovery to arbitrary save points, isolated copies for each feature branch or test. Instant provisioning regardless of database size.
- Database Lab Engine - Instant thin cloning for PostgreSQL to scale the development process.
- clone_schema - PostgreSQL clone schema utility without need of going outside of database.
Configuration Tuning
Zabbix
- MySQLTuner-perl - Script written in Perl that allows you to review a MySQL installation quickly and make adjustments to increase performance and stability.
-
PGConfigurator
- Free online tool to generate an optimized
postgresql.conf. - pgtune - PostgreSQL configuration wizard.
- postgresqltuner.pl - Simple script to analyse your PostgreSQL database configuration, and give tuning advice.
Data
Catalog
- Amundsen - Metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.
- DataHub - The Metadata Platform for the Modern Data Stack.
- Marquez - Collect, aggregate, and visualize a data ecosystem's metadata.
Compare
- data-diff - Command-line tool and Python library to efficiently diff rows across two different databases.
- KS DB Merge Tools - GUI to compare and sync DB schema and data. For Oracle Database, MySQL, MariaDB, SQL Server, PostgreSQL, SQLite, MS Access and Cross-DBMS.
Data Profilers
- Data Profiler - The DataProfiler is a Python library designed to make data analysis, monitoring, and sensitive data detection easy.
- Desbordante - An open-source data profiler specifically focused on discovery and validation of complex patterns in data.
- YData Profiling - A general-purpose open-source data profiler for high-level analysis of a dataset.
Generation/Masking/Subsetting
- Benerator - Generate, obfuscate (anonymize / pseudonymize) and migrate data for development, testing and training purposes.
- dbForge Data Generator for Oracle - Small but mighty GUI tool for populating Oracle schemas with tons of realistic test data.
- Faker - Generate massive amounts of fake data in the browser and Node.js.
- Noisia - Harmful workload generator for PostgreSQL.
- quick-seed - Database-agnostic seeding tool for generating realistic test data with support for PostgreSQL, MySQL, SQLite, Prisma, and Drizzle ORM.
- SQLable - Generate fake data in the browser.
- myanon - Streaming anonymizer for MySQL dump files. Reads mysqldump from stdin, writes anonymized version to stdout. Supports deterministic hashing, fixed values, JSON field anonymization, and Python extensions.
- Greenmask - Database anonymization and synthetic data generation tool for MySQL and PostgreSQL.
- dbForge Data Generator for MySQL - Powerful GUI tool for creating massive volumes of realistic test data.
- dbForge Data Generator for SQL Server - Powerful GUI tool for a fast generation of meaningful test data for databases.
- Synthesized TDK - DevOps' best friend for database masking and generation.
Lineage
- Dwh.dev - Nexgen data lineage for Snowflake.
Replication
- dtle - Distributed Data Transfer Service for MySQL.
- Litestream - Streaming replication for SQLite.
- pgsync - Sync PostgreSQL data between databases.
- pg_chameleon - MySQL to PostgreSQL replica system written in Python 3. The system use the library mysql-replication to pull the row images from MySQL which are stored into PostgreSQL as JSONB.
- PGDeltaStream - A Golang webserver to stream PostgreSQL changes at-least-once over websockets, using PostgreSQL logical decoding feature.
Scripts
- dbt - Transform your data by simply writing select statements, while dbt handles turning these statements into tables and views in a data warehouse.
- QuickTable - Empowers everyone to access, clean, analyze, transform, and model data with no code.
DevOps
Zabbix
- Toad DevOps Toolkit - Executes key database development functions within your DevOps workflow βwithout compromising quality, performance or reliability.
- DBmaestro - Accelerates release cycles & supports agility across the entire IT ecosystem.
Distributions
Zabbix
- BigSQL - A developer-friendly distribution of PostgreSQL.
- DBdeployer - Tool that deploys MySQL database servers easily.
- Postgres.app - Full-featured PostgreSQL installation packaged as a standard Mac app.
- Elephant Shed - Web-based PostgreSQL management front-end that bundles several utilities and applications for use with PostgreSQL.
- Pigsty - Battery-Included Open-Source Distribution for PostgreSQL with ultimate observability & Database-as-Code toolbox for developers.
- dbatools - PowerShell module that you may think of like a command-line SQL Server Management Studio.
GUI
- Adminer - Database management in a single PHP file.
- Another Redis Desktop Manager - Free Open Source Redis Manager. Available on Mac, Linux, Windows, Homebrew, Snap, winget, and more.
- Antares SQL - A modern, fast and productivity driven SQL client with a focus in UX. Available for Mac, Linux and Windows.
- Azure Data Studio - A data management tool that enables working with SQL Server, PostgreSQL, Azure SQL DB and SQL DW from Windows, macOS and Linux.
- Beekeeper Studio - Open Source SQL Editor and Database Manager with a privacy commitment in their mission statement.
- Clidey WhoDB - A lightweight database explorer with next-gen UX for all SQL, NoSQL, Caches, and Queues.
- DbGate - Database manager for MySQL, PostgreSQL, SQL Server, MongoDB, SQLite and others. Runs under Windows, Linux, Mac or as web application.
- DB Lens - Open Source PostgreSQL GUI - Automatic ER diagrams, Internal DB Insights, Disk Utilisation, Performance Metrics, Index Usage, Sequential scan counts and more.
- Jailer - Database Subsetting and Relational Data Browsing Tool/Client.
- Malewicz - Yet Another WEB client for DB schema exploring and performance analysis, but originally created specifically for hacking and extending.
- ocelotgui - For MySQL, MariaDB, and Tarantool. Developed for Linux but can run on Windows.
- OmniDB - Web tool for database management.
- Pgweb - Web-based database browser for PostgreSQL, written in Go and works on macOS, Linux and Windows machines.
- phpMyAdmin - A web interface for MySQL and MariaDB.
- Robo 3T - Shell-centric cross-platform MongoDB management tool.
- Sequel Ace - MySQL/MariaDB database management for macOS.
- Sequel Pro - Fast, easy-to-use Mac database management application for working with MySQL & MariaDB databases.
- sqlpad - Web-based SQL editor run in your own private cloud.
- SQLTools - Database management for VSCode.
- Tabix - SQL Editor & Open source simple business intelligence for Clickhouse.
- TablePlus - Modern, native, and friendly GUI tool for relational databases: MySQL, PostgreSQL, SQLite & more.
- Query.me - Collaborative SQL editor in Notebook format. Let's you reference query results using JINJA, visualize data, and schedule runs and exports.
- TeamPostgreSQL - PostgreSQL Web Administration GUI - use your PostgreSQL databases from anywhere, with rich, lightning-fast AJAX web interface.
- DbVisualizer - Universal database tool for developers, DBAs and analysts.
- phpLiteAdmin - Web-based SQLite database admin tool written in PHP with support for SQLite3 and SQLite2.
- JackDB - Direct SQL access to all your data, no matter where it lives.
- MissionKontrol - Modern drag & drop admin panel/client with full user permissions for non-technical users.
- PopSQL - Modern, collaborative SQL editor for your team.
- Postico - A Modern PostgreSQL Client for the Mac.
- SQLite Expert - Graphical interface supports all SQLite features.
- sqlite-tui - A TUI for viewing SQLite databases, written in Go.
- SQLPro - A simple, powerful PostgreSQL manager for macOS.
- SQuirreL - Graphical SQL client written in Java that will allow you to view the structure of a JDBC compliant database, browse the data in tables, issue SQL commands etc.
- SQLyog - The most complete and easy to use MySQL GUI.
HA/Failover/Sharding
Zabbix
- Citus - PostgreSQL extension that distributes your data and your queries across multiple nodes.
- Percona XtraDB Cluster - A High Scalability Solution for MySQL Clustering and High Availability.
- ShardingSphere - Distributed SQL transaction & query engine for data sharding, scaling, encryption, and more - on any database.
- stolon - Cloud native PostgreSQL manager for PostgreSQL high availability.
- pgslice - PostgreSQL partitioning as easy as pie.
- PostgreSQL Automatic Failover - High-Availability for PostgreSQL, based on industry references Pacemaker and Corosync.
- autobase - Open-source DBaaS that automates the deployment and management of highly available PostgreSQL clusters.
- Vitess - Database clustering system for horizontal scaling of MySQL through generalized sharding.
- pg_auto_failover - PostgreSQL extension and service for automated failover and high-availability.
IDE
- AnySQL Maestro - Premier multi-purpose admin tool for database management, control and development π° π.
- Coginiti Pro - Modern IDE for analyst and analytics engineers with powerful script and grid functionality π° π.
- DBHawk - Datasparc offers database security, database management, database governance and data analytics - all in one solution π° π.
- Navicat - A database development tool that allows you to simultaneously connect to MySQL, MariaDB, SQL Server, Oracle, PostgreSQL, and SQLite databases from a single application π° π.
- Oracle SQL Developer - Free, integrated development environment that simplifies the development and management of Oracle Database in both traditional and Cloud deployments π.
- pgAdmin3 - Long Term Support for pgAdmin3.
- PostgreSQL Maestro - Complete and powerful database management, admin and development tool for PostgreSQL π° π.
- Toad - Premier database solution for developers, admins and data analysts. Manage complex database changes with a single database management tool π° π.
- Valentina Studio - Create, administer, query and explore Valentina DB, MySQL, MariaDB, PostgreSQL and SQLite databases for FREE π° π.
- IBExpert - Comprehensive GUI tool for Firebird and InterBase π° π.
- Aqua Data Studio - Productivity software for Database Developers, DBAs, and Analysts π° π.
- DataStation - Easily query, script, and visualize data from every database, file, and API.
- DBeaver - Free universal database manager and SQL client.
- dbForge Edge - Multidatabase solution for DB development, design, management, and administration of MySQL, MariaDB, SQL Server, Oracle, PostgreSQL databases, and various cloud services π° π.
- dbForge Studio for Oracle - Powerful IDE for Oracle management, administration, and development π° π.
- dbKoda - Modern (JavaScript/Electron framework), open source IDE for MongoDB. It has features to support development, administration and performance tuning on MongoDB databases.
- HeidiSQL - A lightweight client for managing MySQL, MSSQL and PostgreSQL, written in Delphi.
- Kangaroo - A AI-powered SQL client and admin tool for popular databases(SQLite / MySQL / PostgreSQL / etc) on Windows / macOS / Linux, support table design, query, model, sync, export/import etc, focus on comfortable, fun and developer friendly.
- Querybook - Pinterest open-source Big Data Querying UI, combining collocated table metadata and a simple notebook IDE interface.
- Slashbase - The open-source collaborative IDE for your databases. Connect to your database, browse data, run a bunch of SQL commands or share SQL queries with your team, right from your browser.
- TOra - Open source SQL IDE for Oracle, MySQL and PostgreSQL dbs.
- WebDB - Free Efficient Database IDE. Featuring Server Discovery, ERD, Data Generator, AI, NoSQL Structure Manager, Database Versioning and many more.
- Database .net - Multiple database management tool with support for 20+ databases π.
- MySQL Workbench - Unified visual tool for database architects, developers, and DBAs.
- Database Workbench - Complete IDE for database design, development and testing for Oracle, SQL Server, PostgreSQL, MySQL, MariaDB, Firebird, InterBase, SQLite and NexusDB π° π.
- dbForge Studio for MySQL - Universal IDE for MySQL and MariaDB database development, management, and administration π° π.
- dbForge Studio for PostgreSQL - GUI tool for managing and developing databases and objects π° π.
- dbForge Studio for SQL Server - Powerful integrated development environment for SQL Server development, management, administration, data analysis, and reporting π° π.
- KeepTool - A professional suite of tools for Oracle Database developers, administrators and advanced application users π° π.
- pgAdmin - The most popular and feature rich Open Source administration and development platform for PostgreSQL, the most advanced Open Source database in the world.
- Sql Server Management Studio - Integrated environment for managing any SQL infrastructure, for SQL Server and Azure SQL Databases π.
- Toad Edge - Simplified database development tool for MySQL and PostgreSQL π° π.
Kubernetes
Zabbix
- PostgreSQL operator - The PostgreSQL Operator enables highly-available PostgreSQL clusters on Kubernetes (Kubernetes) powered by Patroni.
- Spilo - HA PostgreSQL Clusters with Docker.
- StackGres - Enterprise-grade, Full Stack PostgreSQL on Kubernetes.
- KubeDB - Making running production-grade databases easy on Kubernetes.
Machine Learning
Compare
Monitoring/Statistics/Performance
Prometheus
- pg_exporter - Fully customizable Prometheus exporter for PostgreSQL & Pgbouncer with fine-grained execution control.
- pgSCV - Metrics exporter for PostgreSQL and PostgreSQL-related services.
Samples
- Metis - Provides observability and performance tuning for SQL databases.
- Navicat Monitor - A safe, simple and agentless remote server monitoring tool that is packed with powerful features to make your monitoring effective as possible.
- Telegraf PostgreSQL plugin - Provides metrics for your PostgreSQL database.
- ASH Viewer - Provides a graphical view of active session history data within the Oracle and PostgreSQL DB.
- mssql-monitoring - Monitor your SQL Server on Linux performance using collectd, InfluxDB and Grafana.
- Percona Monitoring and Management - Open source platform for managing and monitoring MySQL and MongoDB performance.
- pganalyze collector - Pganalyze statistics collector for gathering PostgreSQL metrics and log data.
- pgbadger - A fast PostgreSQL Log Analyzer.
- PgHero - A performance dashboard for PostgreSQL - health checks, suggested indexes, and more.
- pgmetrics - Collect and display information and stats from a running PostgreSQL server.
- pgMonitor - All-in-one tool to easily create an environment to visualize the health and performance of your PostgreSQL cluster.
- pgstats - Collects PostgreSQL statistics, and either saves them in CSV files or print them on the stdout.
- pgwatch2 - Flexible self-contained PostgreSQL metrics monitoring/dashboarding solution.
- PostgreSQL Metrics - Service to extract and provide metrics on your PostgreSQL database.
- postgres-checkup - New-generation diagnostics tool that allows users to do a deep analysis of the health of PostgreSQL databases.
- Promscale - The open-source observability backend for metrics and traces powered by SQL.
- Monyog - Agentless & Cost-effective MySQL Monitoring Tool.
- pgDash - Measure and track every aspect of your PostgreSQL databases.
- pgMustard - A user interface for PostgreSQL explain plans, plus tips to improve performance.
- PostgreSQL Monitor - An easy-to-use monitoring service for PostgreSQL providing alerts, dashboards, query stats and dynamic recommendations.
- Releem - Performance monitoring and optimization tool for MySQL & MariaDB that delivers actionable insights and safe automation for misconfigurations, slow queries, schema issues, and deadlocks, reducing manual work at scale.
Zabbix
- Orabbix - Plugin designed to work with Zabbix Enterprise Monitor to provide multi-tiered monitoring, performance and availability reporting and measurement for Oracle Databases, along with server performance metrics.
- Mamonsu - Monitoring agent for PostgreSQL.
- pg_monz - This is the Zabbix monitoring template for PostgreSQL Database.
- Pyora - Python script to monitor Oracle Databases.
- ZabbixDBA - Fast, flexible, and continuously developing plugin to monitor your RDBMS.
Papers
Compare
- The "Database as Code" Manifesto - Treat your database as Code.
- Grokking Relational Database Design - A friendly illustrated guide to designing and implementing your first database.