Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/matrixorigin/matrixone

Hyperconverged cloud-edge native database
https://github.com/matrixorigin/matrixone

cloud-native database distributed-database distributed-systems go htap hyperconverged olap one-size-fits-all sql streaming

Last synced: about 2 months ago
JSON representation

Hyperconverged cloud-edge native database

Host: GitHub
URL: https://github.com/matrixorigin/matrixone
Owner: matrixorigin
License: apache-2.0
Created: 2021-02-18T09:07:17.000Z (over 3 years ago)
Default Branch: main
Last Pushed: 2024-04-17T17:11:06.000Z (5 months ago)
Last Synced: 2024-04-18T00:14:14.411Z (5 months ago)
Topics: cloud-native, database, distributed-database, distributed-systems, go, htap, hyperconverged, olap, one-size-fits-all, sql, streaming
Language: Go
Homepage: https://docs.matrixorigin.cn/en
Size: 86.1 MB
Stars: 1,673
Watchers: 34
Forks: 259
Open Issues: 684
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Codeowners: CODEOWNERS

Awesome Lists containing this project

awesome - matrixorigin/matrixone - Hyperconverged cloud-edge native database (Go)
awesome-golang-repositories - matrixone - edge native database (Repositories)

README

Docs

||

Official Website

English

||

简体中文

Connect with us:

If you are interested in MatrixOne project, please kindly give MatrixOne a triple `Star`, `Fork` and `Watch`, Thanks!

Contents
========

* [What is MatrixOne](#what-is-matrixone)
* [KeyFeatures](#key-features)
* [User Values](#user-values)
* [Architecture](#architecture)
* [Quick start](#quick-start)
* [Contributing](#contributing)
* [License](#license)

## What is MatrixOne?

MatrixOne is a hyper-converged cloud & edge native distributed database with a structure that separates storage, computation, and transactions to form a consolidated HSTAP data engine. This engine enables a single database system to accommodate diverse business loads such as OLTP, OLAP, and stream computing. It also supports deployment and utilization across public, private, and edge clouds, ensuring compatibility with diverse infrastructures.

MatrixOne

## 🎯 Key Features

### 💥 **Hyper-converged Engine**

Monolithic Engine
HTAP data engine that supports a mix of workloads such as TP, AP, time series, and machine learning within a single database.

Built-in Streaming Engine
Built-in stream computing engine that enables real-time data inflow, transformation, and querying.

### ☁️ **Cloud & Edge Native**

Storage-Computation Separation Structure
Separates the storage, computation, and transaction layers, leveraging a containerized design for ultimate scalability.

Multi-Infrastructure Compatibility
MatrixOne provides industry-leading latency control with optimized consistency protocol.

### 🚀 **Extreme Performance**

High-Performance Execution Engine
The flexible combination of Compute Node and Transaction node accommodates point queries and batch processing, delivering peak performance for OLTP and OLAP.

Enterprise-Grade High Availability
Establishes a consistently shared log under a leading Multi-Raft replication state machine model. It ensures high cluster availability while preventing data duplication, thus achieving RTO=0.

### 🖊️ **Ease of Use**

Built-in Multi-Tenancy Capability
Offers inherent multi-tenancy, where tenants are isolated from each other, independently scalable yet uniformly manageable. This feature simplifies the complexity of multi-tenancy design in upper-level applications.

High Compatibility with MySQL
MatrixOne exhibits high compatibility with MySQL 8.0, including transmission protocol, SQL syntax, and ecosystem tools, lowering usage and migration barriers.

### 💰 **Cost-Effective**

Efficient Storage Design
Employs cost-effective object storage as primary storage. High availability can be achieved through erasure coding technology with only about 150% data redundancy. It also provides high-speed caching capabilities, balancing cost and performance via a multi-tiered storage strategy that separates hot and cold data.

Flexible Resource Allocation
Users can adjust the resource allocation ratio for OLTP and OLAP according to business conditions, maximizing resource utilization.

### 🔒 **Enterprise-Level Security and Compliance**

MatrixOne employs Role-Based Access Control (RBAC), TLS connections, and data encryption to establish a multi-tiered security defense system, safeguarding enterprise-level data security and compliance.

## 💎 **User Values**

Simplify Database Management and Maintenance
With business evolution, the number of data engines and middleware enterprises employ increases. Each data engine relies on 5+ essential components and stores 3+ data replicas. Each engine must be independently installed, monitored, patched, and upgraded. This results in high and uncontrollable data engine selection, development, and operations costs. Under MatrixOne's unified architecture, users can employ a single database to serve multiple data applications, reducing the number of introduced data components and technology stacks by 80% and significantly simplifying database management and maintenance costs.

Reduce Data Fragmentation and Inconsistency
Data flow and copy between databases make data sync and consistency increasingly tricky. The unified and incrementally materialized view of MatrixOne allows the downstream to support real-time upstream updates and achieve end-to-end data processing without redundant ETL processes.

Decoupling Data Architecture From Infrastructure
Currently, the architecture design across different infrastructures is complicated, causing new data silos between cloud and edge, cloud and on-premise. MatrixOne is designed with a unified architecture to support simplified data management and operations across different infrastructures.

Extremely Fast Complex Query Performance
Poor business agility results from slow, complex queries and redundant intermediate tables in current data warehousing solutions. MatrixOne supports blazing-fast experience even for star and snowflake schema queries, improving business agility with real-time analytics.

Solid OLTP-like OLAP Experience
Current data warehousing solutions have the following problems: high latency and absence of immediate visibility for data updates. MatrixOne brings OLTP (Online Transactional Processing) level consistency and high availability to CRUD operations in OLAP (Online Analytical Processing).

Seamless and Non-disruptive Scalability
It is challenging to balance performance and scalability to achieve an optimum price-performance ratio in current data warehousing solutions. MatrixOne's disaggregated storage and compute architecture makes it fully automated and efficient to scale in/out and up/down without disrupting applications.

## 🔎 Architecture

MatrixOne's architecture is as below:

MatrixOne

For more details, you can checkout [MatrixOne Architecture Design](https://docs.matrixorigin.cn/en/1.2.0/MatrixOne/Overview/architecture/matrixone-architecture-design/).

## ⚡️ Quick start

### ⚙️ Install MatrixOne

MatrixOne supports Linux and MacOS. You can install MatrixOne either by [building from source](#building-from-source) or [using docker](#using-docker).
For other installation types, please refer to [MatrixOne installation](https://docs.matrixorigin.cn/en/1.2.0/MatrixOne/Get-Started/install-standalone-matrixone/) for more details.

**Step 1.Install Dependency**

- **Building from source**

1. Install Go (version 1.20 is required)

Click Go Download and install to enter its official documentation, and follow the installation steps to complete the **Go** installation.

2. Install GCC/Clang

Click GCC Download and install to enter its official documentation, and follow the installation steps to complete the **GCC** installation.

3. Install Git

Install Git via the [Official Documentation](https://git-scm.com/download).

4. Install and configure MySQL Client

Click MySQL Community Downloads to enter into the MySQL client download and installation page. According to your operating system and hardware environment.Configure the MySQL client environment variables.

- **Using docker**

1. Download and install Docker

Click Get Docker, enter into the Docker's official document page, depending on your operating system, download and install the corresponding Docker. It is recommended to choose Docker version 20.10.18 or later and strive to maintain consistency between the Docker client and Docker server versions.

2. Install and configure MySQL Client

__Note__: MySQL client version 8.0.30 or later is recommended.

**Step 2. Install the mo_ctl tool**

[mo_ctl](https://github.com/matrixorigin/mo_ctl_standalone) is a command-line tool for deploying, installing, and managing MatrixOne. It is very convenient to perform various operations on MatrixOne.

The mo_ctl tool can be installed through the following command:

```
wget https://raw.githubusercontent.com/matrixorigin/mo_ctl_standalone/main/install.sh && sudo -u $(whoami) bash +x ./install.sh
```

See [mo_ctl Tool](https://docs.matrixorigin.cn/en/1.2.0/MatrixOne/Maintain/mo_ctl/) for complete usage details.

**Step 3. Set mo_ctl parameters**

- **Building from source**

```
mo_ctl set_conf MO_PATH="yourpath" # Set custom MatrixOne download path
mo_ctl set_conf MO_DEPLOY_MODE=git # Set MatrixOne deployment method
```

- **Using docker**

```
mo_ctl set_conf MO_CONTAINER_DATA_HOST_PATH="/yourpath/mo/" # Set the data directory for host
mo_ctl set_conf MO_DEPLOY_MODE=docker # Set MatrixOne deployment method
```

**Step 4. One-click install Matrixone**

Depending on your needs, choose whether you want to keep your code up to date, or if you want to get the latest stable version of the code.

- *Option 1*: Get the MatrixOne(Develop Version)

The **main** branch is the default branch, the code on the main branch is always up-to-date but not stable enough.

```
mo_ctl deploy main
```

- *Option 2*: Get the MatrixOne(Stable Version)

If you want to get the latest stable version code released by MatrixOne, please switch to the branch of version **1.2.0** first.

```
mo_ctl deploy v1.2.0
```

**Step 5. Launch MatrixOne server**

Launch the MatrixOne service through the `mo_ctl start` command.

__Tips__: The initial startup of MatrixOne approximately takes 20 to 30 seconds. After a brief wait, you can connect to MatrixOne using the MySQL client.

**Step 6. Connect to MatrixOne**

One-click connection to MatrixOne service through `mo_ctl connect` command.

__Note__: The login account in the above code snippet is the initial account; please change the initial password after logging in to MatrixOne; see [Password Management](https://docs.matrixorigin.cn/en/1.2.0/MatrixOne/Security/password-mgmt/).

## 🙌 Contributing

Contributions to MatrixOne are welcome from everyone.
See [Contribution Guide](https://docs.matrixorigin.cn/en/1.2.0/MatrixOne/Contribution-Guide/make-your-first-contribution/) for details on submitting patches and the contribution workflow.

### 👏 All contributors

_Nnsgmsone

_XuPeng-SH

_Fagongzi

_Reusee

_Ouyuanning

_Daviszhen