GlusterFS 9 : Distributed + Replication2021/07/09 |
|
Configure Storage Clustering with GlusterFS.
For example, Create a Distributed + Replication volume with 6 Nodes.
Also Configure Arbiter Volume in order to avoid Split Brain.
|
+----------------------+ | +----------------------+
| [GlusterFS Server#1] |10.0.0.51 | 10.0.0.54| [GlusterFS Server#4] |
| node01.srv.world +----------+----------+ node04.srv.world |
| | | | |
+----------------------+ | +----------------------+
|
+----------------------+ | +----------------------+
| [GlusterFS Server#2] |10.0.0.52 | 10.0.0.55| [GlusterFS Server#5] |
| node02.srv.world +----------+----------+ node05.srv.world |
| | | | |
+----------------------+ | +----------------------+
|
+----------------------+ | +----------------------+
| [GlusterFS Server#3] |10.0.0.53 | 10.0.0.56| [GlusterFS Server#6] |
| node03.srv.world +----------+----------+ node06.srv.world |
| | | |
+----------------------+ +----------------------+
⇑ ⇑
file1, file3 ... file2, file4 ...
|
|
It is strongly recommended to use partitions for GlusterFS volumes that are different from the / partition.
On this example, it shows settings on the environment that all nodes has [sdb1] and mount it to [/glusterfs]. |
|
| [1] | |
| [2] | Create a Directory for GlusterFS Volume on all Nodes. |
|
[root@node01 ~]# mkdir -p /glusterfs/dist-replica |
| [3] | Configure Clustering like follows on a node. (it's OK on any node) |
|
# probe the nodes [root@node01 ~]# gluster peer probe node02 peer probe: success. [root@node01 ~]# gluster peer probe node03 peer probe: success. [root@node01 ~]# gluster peer probe node04 peer probe: success. [root@node01 ~]# gluster peer probe node05 peer probe: success. [root@node01 ~]# gluster peer probe node06 peer probe: success. # confirm status [root@node01 ~]# gluster peer status Number of Peers: 5 Hostname: node02 Uuid: 5011d4c4-22d6-4a96-b7dc-b392c52adaf9 State: Peer in Cluster (Connected) Hostname: node03 Uuid: 915835cc-2549-41fc-a736-4694703e7ec4 State: Peer in Cluster (Connected) Hostname: node04 Uuid: 3dc7728b-5032-40c6-932e-1ae7662f2c16 State: Peer in Cluster (Connected) Hostname: node05 Uuid: ec0b8580-300c-496e-8628-e2d621381535 State: Peer in Cluster (Connected) Hostname: node06 Uuid: 873c7fbe-99a5-4a73-b816-6d0634446ccd State: Peer in Cluster (Connected) # create volume [root@node01 ~]# gluster volume create vol_dist-replica replica 3 arbiter 1 transport tcp \ node01:/glusterfs/dist-replica \ node02:/glusterfs/dist-replica \ node03:/glusterfs/dist-replica \ node04:/glusterfs/dist-replica \ node05:/glusterfs/dist-replica \ node06:/glusterfs/dist-replica volume create: vol_dist-replica: success: please start the volume to access data # start volume [root@node01 ~]# gluster volume start vol_dist-replica volume start: vol_dist-replica: success # confirm volume info [root@node01 ~]# gluster volume info Volume Name: vol_dist-replica Type: Distributed-Replicate Volume ID: cd7e0f78-08f6-4972-bf2b-da62af7c89bd Status: Started Snapshot Count: 0 Number of Bricks: 2 x (2 + 1) = 6 Transport-type: tcp Bricks: Brick1: node01:/glusterfs/dist-replica Brick2: node02:/glusterfs/dist-replica Brick3: node03:/glusterfs/dist-replica (arbiter) Brick4: node04:/glusterfs/dist-replica Brick5: node05:/glusterfs/dist-replica Brick6: node06:/glusterfs/dist-replica (arbiter) Options Reconfigured: cluster.granular-entry-heal: on storage.fips-mode-rchecksum: on transport.address-family: inet nfs.disable: on performance.client-io-threads: off cluster.enable-shared-storage: enable |
| [4] |
| Sponsored Link |
|
|