{"id":1810,"date":"2020-10-17T19:30:30","date_gmt":"2020-10-17T10:30:30","guid":{"rendered":"https:\/\/www.kinryo.net\/?p=1810"},"modified":"2022-02-20T16:32:34","modified_gmt":"2022-02-20T07:32:34","slug":"drbd%e3%81%ab%e6%8c%91%e6%88%a6%ef%bc%9bdrbd%e3%81%ae%e3%82%a4%e3%83%b3%e3%82%b9%e3%83%88%e3%83%bc%e3%83%ab%ef%bc%9a5%ef%bc%88centos7","status":"publish","type":"post","link":"https:\/\/www.kinryo.net\/?p=1810","title":{"rendered":"DRBD\u306b\u6311\u6226\uff1bdrbd\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\uff1a5\uff08CentOS7)"},"content":{"rendered":"\r\n

ELRepo\u30ea\u30dd\u30b8\u30c8\u30ea\u30fc\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb
#<\/span> rpm -Uvh http:\/\/www.elrepo.org\/elrepo-release-7.0-2.el7.elrepo.noarch.rpm
DRBD\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb
# <\/span><\/span>yum -y install kmod-drbd84<\/span><\/p>\r\n

drbd\u306b\u5272\u308a\u5f53\u3066\u308b\u30c7\u30a3\u30b9\u30af\u306fLVM\u3067\u4f5c\u6210\u3057\u305d\u308c\u305e\u308c \/dev\/vdd \u306b\u306a\u3063\u3066\u3044\u308b
DRBD\u30ea\u30bd\u30fc\u30b9(r0.res)\u8a2d\u5b9a\u30d5\u30a1\u30a4\u30eb\u306e\u4f5c\u6210
#<\/span> gedit \/etc\/drbd.d\/r0.res<\/span><\/p>\r\n

\r\n\r\n<\/p>\r\n

resource r0 {<\/span>\u3000\u2190\u3000DRBD\u30ea\u30bd\u30fc\u30b9\u540d\u3092r0\u3068\u3059\u308b\r\n    device    \/dev\/drbd0;<\/span>\r\n    meta-disk internal;\r\n    on smb0 {<\/span>\u3000\u2190\u3000node1\u30db\u30b9\u30c8\u540d(\u300cuname -n\u300d\u30b3\u30de\u30f3\u30c9\u3067\u8868\u793a\u3055\u308c\u308b\u540d\u524d)\r\n        disk      \/dev\/vdd;<\/span>\u3000\u2190\u3000node1\u8ad6\u7406\u30dc\u30ea\u30e5\u30fc\u30e0\u540d\r\n        address   192.168.11.60:7780;<\/span>\u3000\u2190\u3000node1IP\u30a2\u30c9\u30ec\u30b9\r\n    }\r\n    on smb2 {<\/span>\u3000\u2190\u3000node2\u30db\u30b9\u30c8\u540d:\u672c\u6765\u306fsmb1(\u300cuname -n\u300d\u30b3\u30de\u30f3\u30c9\u3067\u8868\u793a\u3055\u308c\u308b\u540d\u524d)\r\n        disk      \/dev\/vdd;<\/span>\u3000\u2190\u3000node2\u8ad6\u7406\u30dc\u30ea\u30e5\u30fc\u30e0\u540d\r\n        address   192.168.11.61:7780;<\/span>\u3000\u2190\u3000node2IP\u30a2\u30c9\u30ec\u30b9\r\n    }\r\n}<\/span><\/pre>\r\n
\r\n\r\n<\/p>\r\n
\u30e1\u30bf\u30c7\u30fc\u30bf\u30fc\u306e\u4f5c\u6210
#<\/span> drbdadm create-md r0\u00a0 \uff08\u6ce8\uff1a\u30c7\u30fc\u30bf\u30fc\u306e\u3042\u308b\u30c7\u30a3\u30b9\u30af\u306b\u884c\u3063\u3066\u3082\u30c7\u30fc\u30bf\u306f\u6d88\u3048\u306a\u3044\uff09
<\/span><\/span>md_offset 499826814976
al_offset 499826782208
bm_offset 499811528704

Found some data

==> This might destroy existing data! <==
Do you want to proceed?
[need to type ‘yes’ to confirm]<\/span> yes<\/span>

initializing activity log
initializing bitmap (14896 KB) to all zero
Writing meta data\u2026
New drbd meta data block successfully created.
<\/span>\u3053\u308c\u306f\u524d\u306b\u4f55\u304b\u4f7f\u7528\u3057\u3066\u3044\u305f\u30c7\u30a3\u30b9\u30af\u306a\u306e\u3067\u3001Do you want to proceed? \u3068\u805e\u3044\u3066\u3044\u308b\u304c\u3001\u30de\u30c3\u30b5\u30e9\u306a\u30c7\u30a3\u30b9\u30af\u3060\u3068\u805e\u3044\u3066\u3053\u306a\u3044\u3002
\u3053\u3053\u307e\u3067\u3092 smb1\u3067\u3082\u3084\u308b<\/p>\r\n
\r\n\r\n<\/p>\r\n
drbd\u306e\u8d77\u52d5
#<\/span> systemctl start drbd
smb1\u3082\u8d77\u52d5\u3057\u306a\u3044\u3068\u30d7\u30ed\u30f3\u30d7\u30c8\u306b\u623b\u3063\u3066\u3053\u306a\u3044\u3002
\u307e\u305f\u3001\u3053\u3053\u307e\u3067\u3092smb1\u3067\u3082\u3084\u308b<\/span><\/span><\/p>\r\n
DRBD\u78ba\u8a8d
DRBD\u30c7\u30a3\u30b9\u30af\u521d\u671f\u540c\u671f\u30b9\u30ad\u30c3\u30d7(\u7a7a\u30c7\u30a3\u30b9\u30af\u306e\u5834\u5408\u306e\u307f)\u203b\u30c7\u30a3\u30b9\u30af\u306b\u30c7\u30fc\u30bf\u304c\u683c\u7d0d\u3055\u308c\u3066\u3044\u308b\u5834\u5408\u306f\u30b9\u30ad\u30c3\u30d7\u3057\u3066\u306f\u3044\u3051\u306a\u3044\u304c\u3001\u30e1\u30bf\u30c7\u30fc\u30bf\u30fc\u304c\u30a4\u30f3\u30bf\u30fc\u306a\u308b\u3060\u3068\u3001\u30c7\u30fc\u30bf\u30fc\u304c\u58ca\u3055\u308c\u3066\u3044\u308b\u4e8b\u3082\u8003\u3048\u3089\u308c\u308b<\/span><\/span>
# <\/span>drbdadm new-current-uuid –clear-bitmap r0\/0
<\/span>#<\/span> cat \/proc\/drbd<\/span><\/h4>\r\n
\r\n\r\n<\/p>\r\n
version: 8.4.11-1 (api:1\/proto:86-101)\r\nGIT-hash: 66145a308421e9c124ec391a7848ac20203bb03c build by mockbuild@, 2020-04-05 02:58:18\r\n 0: cs:Connected ro:Secondary\/Secondary ds:UpToDate\/UpToDate C r-----\r\n    ns:0 nr:0 dw:0 dr:0 al:8 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0<\/span><\/code><\/pre>\r\n
<\/p>\r\n
cs \u304c connected \u3067\u3001ro \u304c\u4e21\u65b9\u5171<\/em> Secondary(\u5f85\u6a5f\u72b6\u614b)\u306b\u306a\u3063\u3066\u3044\u308b\u4e8b\u3002
smb1\u5074\u3067\u3082\u884c\u3063\u3066\u540c\u3058\u306b\u306a\u3063\u3066\u3044\u308b\u4e8b\u3002smb0\u5074\u3067
#<\/span> drbdadm primary all<\/span>
#<\/span> cat \/proc\/drbd<\/span><\/p>\r\n
<\/p>\r\n
\u524d\u7565\r\n 0: cs:Connected ro:Primary\/Secondary ds:UpToDate\/UpToDate C r-----<\/span>\r\n\u5f8c\u7565<\/code><\/pre>\r\n
\r\n\r\n<\/p>\r\n
ro\u304cPrimary\/Secondary\u306b\u306a\u3063\u3066\u3044\u308b\u4e8b\u3002smb1\u5074\u3067\u3082\u884c\u3063\u3066ro\u304c Secondary\/Primary\u306b\u306a\u3063\u3066\u3044\u308b\u4e8b\u3002smb0 \u3067 DRBD\u30c7\u30d0\u30a4\u30b9(\/dev\/drbd0)\u306b\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u4f5c\u6210
#<\/span> mkfs.xfs \/dev\/drbd0<\/span><\/p>\r\n
\r\n\r\n<\/p>\r\n
meta-data=\/dev\/drbd0             isize=512    agcount=4, agsize=30506075 blks\r\n         =                       sectsz=512   attr=2, projid32bit=1\r\n         =                       crc=1        finobt=0, sparse=0\r\ndata     =                       bsize=4096   blocks=122024299, imaxpct=25\r\n         =                       sunit=0      swidth=0 blks\r\nnaming   =version 2              bsize=4096   ascii-ci=0 ftype=1\r\nlog      =internal log           bsize=4096   blocks=59582, version=2\r\n         =                       sectsz=512   sunit=0 blks, lazy-count=1\r\nrealtime =none                   extsz=4096   blocks=0, rtextents=0
<\/span><\/code><\/pre>\r\n\r\n\r\n\r\n
#<\/span> mount \/dev\/drbd0 \/SmbData\/<\/span>
#<\/span> df<\/span><\/p>\r\n\r\n\r\n\r\n
devtmpfs           2006988       0   2006988    0% \/dev\r\ntmpfs              2022644   93032   1929612    5% \/dev\/shm\r\ntmpfs              2022644    9764   2012880    1% \/run\r\ntmpfs              2022644       0   2022644    0% \/sys\/fs\/cgroup\r\n\/dev\/vda1         19520512 6486968  13033544   34% \/\r\n\/dev\/vdc          15718400 5144496  10573904   33% \/Download\r\ntmpfs               404532       4    404528    1% \/run\/user\/42\r\ntmpfs               404532      36    404496    1% \/run\/user\/0\r\n\/dev\/drbd0       487858868   32992 487825876    1% \/SmbData<\/span><\/code><\/pre>\r\n\r\n\r\n\r\n
SmbData\u306b\u30d5\u30a1\u30a4\u30eb\u3092\u4f5c\u3063\u3066\u51fa\u6765\u3066\u3044\u308b\u304b\u78ba\u8a8d
#<\/span> touch \/SmbData\/test.txt<\/span>
#<\/span> ll \/SmbData\/<\/span>
\u5408\u8a08 0<\/span>
-rw-r–r– 1 root root 0 10\u6708 18 04:36 test.txt<\/span>
\u6b21\u306b\u3001smb0\u3092seconday\u306b\u3057\u3001smb1\u3092primary\u306b\u3059\u308b\u304c\u3001\u30de\u30a6\u30f3\u30c8\u3092\u5916\u3055\u306a\u3044\u3068\u306a\u3089\u306a\u3044
#<\/span> umount \/SmbData<\/span>
df\u3067\u30de\u30a6\u30f3\u30c8\u3055\u308c\u3066\u3044\u306a\u3044\u4e8b\u3092\u78ba\u8a8d\u5f8c
#<\/span> drbdadm secondary all<\/span>
smb1\u3067
#<\/span> drbdadm primary all<\/span>
#<\/span> cat \/proc\/drbd<\/span>
\u3067\u3001ro:Secondary\/Primary \u306b\u306a\u3063\u3066\u3044\u308b\u4e8b\u3092\u78ba\u8a8d\u5f8c\u3001\u30de\u30a6\u30f3\u30c8\u3057df\u3067\u30de\u30a6\u30f3\u30c8\u3055\u308c\u3066\u3044\u308b\u4e8b\u3092\u78ba\u8a8d\u5f8c\u3001ll\u3067\u30d5\u30a1\u30a4\u30eb\u304csmb1\u306b\u3082\u3042\u308b\u304b\u78ba\u8a8d
#<\/span> mount \/dev\/drbd0 \/mnt<\/span>
#<\/span> df<\/span><\/p>\r\n\r\n\r\n\r\n
<pre class=\"wp-block-code\"><code><span style=\"color: #ff6600;\">devtmpfs           2006988       0   2006988    0% \/dev\r\ntmpfs              2022644   93032   1929612    5% \/dev\/shm\r\ntmpfs              2022644    9764   2012880    1% \/run\r\ntmpfs              2022644       0   2022644    0% \/sys\/fs\/cgroup\r\n\/dev\/vda1         19520512 6486968  13033544   34% \/\r\n\/dev\/vdc          15718400 5144496  10573904   33% \/Download\r\ntmpfs               404532       4    404528    1% \/run\/user\/42\r\ntmpfs               404532      36    404496    1% \/run\/user\/0\r\n\/dev\/drbd0       487858868   32992 487825876    1% \/SmbData<\/span><\/code><\/pre><\/span><\/code><\/span><\/pre>\r\n\r\n\r\n\r\n
#<\/span> ll \/SmbData<\/span>
\u5408\u8a08 0
-rw-r–r– 1 root root 0 10\u6708 18 04:36 test.txt
<\/span>\u305d\u3057\u3066<\/span>umount\u5f8c\u3001smb1\u3092secondary\u306b\u3059\u308b
#<\/span> umount \/SmbData<\/span>
#<\/span> drbdadm secondary all
<\/span>smb0\u3092promary\u306b\u3057\u3001
#<\/span> drbdadm primary all<\/span>
smb0\u3068smb1\u3067 cat \/Proc\/drbd \u3092\u884c\u3044smb0\u304cprimary, smb1\u304csecondary\u306b\u306a\u3063\u3066\u3044\u308b\u4e8b\u3092\u78ba\u8a8d<\/p>\r\n
DRBD\u30af\u30e9\u30b9\u30bf\u5316
\u30b0\u30eb\u30fc\u30d7\u540d\u306f\u524d\u306bsmbgroup\u3067\u5b9a\u7fa9\u3057\u3066\u3044\u308b
#<\/span> pcs resource create DRBD0 ocf:linbit:drbd drbd_resource=”r0″ –group smbgroup
<\/span>DRBD0\u3092master\/slave\u203b\u3068\u3057\u3066\u8a2d\u5b9a
#<\/span> pcs resource master MS_DRBD0 DRBD0 master-max=1 master-node-max=1 clone-max=2 clone-node-max=1 notify=true
DRBD\u306e\u30b9\u30c6\u30fc\u30bf\u30b9\u3092\u30af\u30ea\u30a2\u30fc<\/span>
#<\/span> pcs resource cleanup MS_DRBD0
Cleaned up DRBD0:0 on smb1<\/span>
Cleaned up DRBD0:0 on smb0<\/span>
Cleaned up DRBD0:1 on smb1<\/span>
Cleaned up DRBD0:1 on smb0<\/span>
Waiting for 1 reply from the CRMd. OK<\/span>
#<\/span> pcs resource show<\/span><\/h4>\r\n\r\n\r\n\r\n
 Resource Group: smbgroup\r\n     vipcheck_res\t(ocf::myres:VIPcheck):\tStarted smb0\r\n     VirtualIP\t(ocf::heartbeat:IPaddr2):\tStarted smb0\r\n Master\/Slave Set: MS_DRBD0 [DRBD0]\r\n     Masters: [ smb0 ]\r\n     Slaves: [ smb1 ]<\/span><\/code><\/pre>\r\n
<\/code>\/dev\/drbd0\u3092xfs\u5f62\u5f0f\u3067\/mnt\u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u3078\u30de\u30a6\u30f3\u30c8\u3059\u308b\u30af\u30e9\u30b9\u30bf\u30ea\u30bd\u30fc\u30b9\u3092FS_DRBD0\u3068\u3044\u3046\u540d\u524d\u3067\u8ffd\u52a0 
#<\/span> pcs resource create FS_DRBD0 ocf:heartbeat:Filesystem device=\/dev\/drbd0 directory=\/SmbData fstype=xfs –group smbgroup
#<\/span> pcs resource show<\/span>
<\/span><\/span><\/p>\r\n\r\n\r\n\r\n\r\n\r\n
 Resource Group: smbgroup\r\n     vipcheck_res\t(ocf::myres:VIPcheck):\tStarted smb0\r\n     VirtualIP\t(ocf::heartbeat:IPaddr2):\tStarted smb0\r\n     FS_DRBD0\t(ocf::heartbeat:Filesystem):\tStarted smb0\r\n Master\/Slave Set: MS_DRBD0 [DRBD0]\r\n     Masters: [ smb0 ]\r\n     Slaves: [ smb1 ]<\/span><\/code><\/pre>\r\n\r\n\r\n\r\n
FS_DRBD0\u304c\u3042\u308b\u3053\u3068\u3092\u78ba\u8a8d
DRBD\u304cmaster\u5074\u306e\u30ce\u30fc\u30c9\u3067\u30ea\u30bd\u30fc\u30b9\u30b0\u30eb\u30fc\u30d7(smbgroup)\u3092\u8d77\u52d5\u3059\u308b
#<\/span> pcs constraint order promote MS_DRBD0 then start smbgroup<\/span>
Adding MS_DRBD0 smbgroup (kind: Mandatory) (Options: first-action=promote then-action=start)
<\/span>DRBD\u304cMaster\u5074\u306e\u30ce\u30fc\u30c9\u3067FS_DRBD0\u30ea\u30bd\u30fc\u30b9\u3092\u8d77\u52d5\u3059\u308b
#<\/span> pcs constraint colocation add FS_DRBD0 MS_DRBD0 INFINITY with-rsc-role=Master<\/span>
#<\/span> pcs constraint order promote MS_DRBD0 then start FS_DRBD0<\/span>
Adding MS_DRBD0 FS_DRBD0 (kind: Mandatory) (Options: first-action=promote then-action=start)<\/span>
smb0\u3068smb1\u3067 df \u3092\u3084\u3063\u3066\u3001smb0\u3067SmbData\u304c\u30de\u30a6\u30f3\u30c8\u3055\u308c\u3066\u3044\u3066\u3001smb1\u5074\u3067\u306f\u30de\u30a6\u30f3\u30c8\u3055\u308c\u3066\u3044\u306a\u3044\u4e8b\u3092\u78ba\u8a8d\u3002smb0\u3092halt
#<\/span> halt -p<\/span>
smb1\u5074\u3067
#<\/span> pcs status<\/span>
<\/span><\/p>\r\n\r\n\r\n\r\n
Cluster name: mycluster\r\nStack: corosync\r\nCurrent DC: smb1 (version 1.1.21-4.el7-f14e36fd43) - partition with quorum\r\nLast updated: Sun Oct 18 07:11:48 2020\r\nLast change: Sun Oct 18 07:02:15 2020 by root via cibadmin on smb0\r\n\r\n2 nodes configured\r\n5 resources configured\r\n\r\nOnline: [ smb1 ]\r\nOFFLINE: [ smb0 ]\r\n\r\nFull list of resources:\r\n\r\n Resource Group: smbgroup\r\n     vipcheck_res\t(ocf::myres:VIPcheck):\tStarted smb1\r\n     VirtualIP\t(ocf::heartbeat:IPaddr2):\tStarted smb1\r\n     FS_DRBD0\t(ocf::heartbeat:Filesystem):\tStarted smb1\r\n Master\/Slave Set: MS_DRBD0 [DRBD0]\r\n     Masters: [ smb1 ]\r\n     Stopped: [ smb0 ]\r\n\r\nDaemon Status:\r\n  corosync: active\/enabled\r\n  pacemaker: active\/enabled\r\n  pcsd: active\/enabled\r\n<\/span><\/code><\/span><\/pre>\r\n\r\n\r\n\r\n
<\/code>smb0\u304coffline\u3067smb1\u304c\u30de\u30b9\u30bf\u30fc\u306b\u306a\u3063\u3066\u3044\u308b\u3053\u3068\u3092\u78ba\u8a8d
#<\/span> df<\/span>
\u3067 SmbData \u304c\u30de\u30a6\u30f3\u30c8\u3055\u308c\u3066\u3044\u308b\u4e8b\u3092\u78ba\u8a8d\u5f8c
smb0\u8d77\u52d5\u3057\u3001pcs status\u3067\u4e21\u65b9\u5171\u30aa\u30f3\u30e9\u30a4\u30f3\u306b\u306a\u3063\u3066\u3044\u308b\u4e8b\u3001\u30de\u30b9\u30bf\u30fc\u306f\u307e\u3060 smb1\u3067\u3042\u308b\u3053\u3068\u3092\u78ba\u8a8d
#<\/span> pcs cluster standby smb1<\/span>
#<\/span> pcs status<\/span>
\u3067 smb0 \u304c\u30de\u30b9\u30bf\u30fc\u306b\u306a\u3063\u3066\u3044\u308b\u4e8b\u3092\u78ba\u8a8d
#<\/span> pcs cluster unstandby smb1<\/span>
#<\/span> pcs status<\/span>
\u3067\u4e21\u65b9\u304c\u30aa\u30f3\u30e9\u30a4\u30f3\u306b\u306a\u3063\u3066\u3044\u308b\u4e8b\u3092\u78ba\u8a8d
#<\/span> df
\u3067 smb0\u5074\u306bSmbData\u304c\u30de\u30a6\u30f3\u30c8\u3055\u308c\u3066\u3044\u308b\u4e8b\u3092\u78ba\u8a8d<\/span><\/span><\/code><\/p>\r\n\r\n\r\n","protected":false},"excerpt":{"rendered":"
ELRepo\u30ea\u30dd\u30b8\u30c8\u30ea\u30fc\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb# rpm -Uvh http:\/\/www.elrepo.org\/elrepo-release-7.0-2.el7.elrepo.noarch.rpmDRBD\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb# yum … \u7d9a\u304d\u3092\u8aad\u3080 →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"vkexunit_cta_each_option":"","footnotes":""},"categories":[20],"tags":[],"class_list":["post-1810","post","type-post","status-publish","format-standard","hentry","category-drbdcentos7"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.kinryo.net\/index.php?rest_route=\/wp\/v2\/posts\/1810","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.kinryo.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.kinryo.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.kinryo.net\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.kinryo.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1810"}],"version-history":[{"count":55,"href":"https:\/\/www.kinryo.net\/index.php?rest_route=\/wp\/v2\/posts\/1810\/revisions"}],"predecessor-version":[{"id":2791,"href":"https:\/\/www.kinryo.net\/index.php?rest_route=\/wp\/v2\/posts\/1810\/revisions\/2791"}],"wp:attachment":[{"href":"https:\/\/www.kinryo.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1810"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.kinryo.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1810"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.kinryo.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1810"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}