https://github.com/francescorivola/mongodb-sharding-docker
MongoDB replicated shard cluster using docker
https://github.com/francescorivola/mongodb-sharding-docker
docker mongodb replica-set sharding
Last synced: about 1 month ago
JSON representation
MongoDB replicated shard cluster using docker
- Host: GitHub
- URL: https://github.com/francescorivola/mongodb-sharding-docker
- Owner: francescorivola
- Created: 2020-12-19T23:28:50.000Z (almost 5 years ago)
- Default Branch: main
- Last Pushed: 2021-02-27T21:43:36.000Z (over 4 years ago)
- Last Synced: 2025-03-15T15:18:28.964Z (7 months ago)
- Topics: docker, mongodb, replica-set, sharding
- Homepage:
- Size: 19.5 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# mongodb-sharding-docker
This repo contains a docker-compose to play with MongoDB Sharding. It has been created following the MongoDB official documentation guide to [convert a replica set to a replicated shard cluster](https://docs.mongodb.com/manual/tutorial/convert-replica-set-to-replicated-shard-cluster/).
The docker-compose allows you to setup and run a replicated shard cluster composed by 2 or 3 replicated shards (each replica set composed by 3 data-bearing members) and a replicated config server (composed by 3 config servers). Finally a mongos container as entry point of our shard cluster.
## Setup first Replica Set
Run the following docker-compose command to start the 3 data bearing nodes of the rs-sh1 replica set.
```sh
docker-compose up -d rs-sh1-01 rs-sh1-02 rs-sh1-03
```
Now, we have to initialize the replica set rs-sh1.
### Attach shell to rs-sh1-01
```
docker exec -it rs-sh1-01 /bin/bash
```
### Log in mongo shell
```sh
mongo --port 27011
```
### Initialize replica set
Run the following command to initialize the replica set
```javascript
rs.initiate(
{
_id : 'rs-sh1',
members: [
{ _id : 0, host : "rs-sh1-01:27011" },
{ _id : 1, host : "rs-sh1-02:27012" },
{ _id : 2, host : "rs-sh1-03:27013" }
]
}
)
```
## Setup config Replica Set
Run the following docker-compose command to start the 3 config servers of the rs-config replica set.
```sh
docker-compose up -d rs-config-01 rs-config-02 rs-config-03
```
Now, we have to initialize the replica set rs-config.
### Attach shell to rs-config-01
```sh
docker exec -it rs-config-01 /bin/bash
```
### Log in mongo shell
```sh
mongo --port 27017
```
### Initialize replica set
Run the following command to initialize the replica set
```javascript
rs.initiate(
{
_id : 'rs-config',
configsvr: true,
members: [
{ _id : 0, host : "rs-config-01:27017" },
{ _id : 1, host : "rs-config-02:27018" },
{ _id : 2, host : "rs-config-03:27019" }
]
}
)
```
## Run mongos
Run the following docker-compose command to start the container running the mongos process.
```sh
docker-compose up -d rs-mongos
```
### Attach shell to rs-mongos
```sh
docker exec -it rs-mongos /bin/bash
```
### Log in mongo shell
```sh
mongo --port 27020
```
## Add rs-sh1 to the shard cluster
Inside the mongos shell run the following command
```javascript
use admin
sh.addShard("rs-sh1/rs-sh1-01:27011,rs-sh1-02:27012,rs-sh1-03:27013");
```
## Setup second Replica Set
Run the following docker-compose command to start the 3 data-bearing nodes of the rs-sh2 replica set.
```sh
docker-compose up -d rs-sh2-01 rs-sh2-02 rs-sh2-03
```
Now, we have to initialize the replica set rs-sh2.
### Attach shell to rs-sh2-01
```sh
docker exec -it rs-sh2-01 /bin/bash
```
### Log in mongo shell
```sh
mongo --port 27014
```
### Initialize replica set
Run the following command to initialize the replica set
```javascript
rs.initiate(
{
_id : 'rs-sh2',
members: [
{ _id : 0, host : "rs-sh2-01:27014" },
{ _id : 1, host : "rs-sh2-02:27015" },
{ _id : 2, host : "rs-sh2-03:27016" }
]
}
)
```
## Add rs-sh2 to the shard cluster
Inside the mongos shell run the following command:
```javascript
use admin
sh.addShard("rs-sh2/rs-sh2-01:27014,rs-sh2-02:27015,rs-sh2-03:27016");
```
## Enabled shard at database level
Assuming we want to shard our database "test". From the mongos shell run the following command:
```javascript
sh.enableSharding( "test" )
```
## Shard a collection
Assuming we want to shard the collection named "messages" using the field type as partition key.
We must first create an index for partition key field.
```javascript
use test
db.messages.createIndex( { type : 1 } )
```
Let's shard a collection
```javascript
use test
sh.shardCollection( "test.messages", { "type" : 1 } )
```
## Setup an additional Replica Set
Run the following docker-compose command to start the 3 data-bearing nodes of the rs-sh3 replica set.
```sh
docker-compose up -d rs-sh3-01 rs-sh3-02 rs-sh3-03
```
Now, we have to initialize the replica set rs-sh3.
### Attach shell to rs-sh3-01
```sh
docker exec -it rs-sh3-01 /bin/bash
```
### Log in mongo shell
```sh
mongo --port 27021
```
### Initialize replica set
Run the following command to initialize the replica set
```javascript
rs.initiate(
{
_id : 'rs-sh3',
members: [
{ _id : 0, host : "rs-sh3-01:27021" },
{ _id : 1, host : "rs-sh3-02:27022" },
{ _id : 2, host : "rs-sh3-03:27023" }
]
}
)
```
## Add rs-sh3 to the shard cluster
Inside the mongos shell run the following command:
```javascript
use admin
sh.addShard("rs-sh3/rs-sh3-01:27021,rs-sh3-02:27022,rs-sh3-03:27023");
```
## Configure /etc/hosts
In order to connect to our replica sets from the docker host you can add the following entries in your /etc/hosts file:
```
127.0.0.1 rs-sh1-01
127.0.0.1 rs-sh1-02
127.0.0.1 rs-sh1-03
127.0.0.1 rs-sh2-01
127.0.0.1 rs-sh2-02
127.0.0.1 rs-sh2-03
127.0.0.1 rs-config-01
127.0.0.1 rs-config-02
127.0.0.1 rs-config-03
127.0.0.1 rs-sh3-01
127.0.0.1 rs-sh3-02
127.0.0.1 rs-sh3-03
```
## Connection strings
replica set sh1
```
mongodb://rs-sh1-01:27011,rs-sh1-02:27012,rs-sh1-03:27013/?replicaSet=rs-sh1
```
replica set sh2
```
mongodb://rs-sh2-01:27014,rs-sh2-02:27015,rs-sh2-03:27016/?replicaSet=rs-sh2
```
replica set config
```
mongodb://rs-config-01:27017,rs-config-02:27018,rs-config-03:27019/?replicaSet=rs-config
```
mongos
```
mongodb://localhost:27020
```
replica set sh3
```
mongodb://rs-sh3-01:27021,rs-sh3-02:27022,rs-sh3-03:27023/?replicaSet=rs-sh3
```
## Clean up
Remove all containers and network
```sh
docker-compose down
```
Remove all containers and named volumes
```sh
docker-compose down -v
```
Remove all containers, named volumes and mongodb image
```sh
docker-compose down -v --rmi all
```