How to deploy /dev/sdb ,/dev/sdc only use /dev/nvme0n1 as db device ? #1763
Description
Description of Issue/Question
How to deploy /dev/sdb ,/dev/sdc only use /dev/nvme0n1 as db device ?
or I just want to use a single NVME device as the db device
In addition, drive groups always look for system disks /dev/sda. Can you design to ignore a particular disk?
2 hdds
Vendor: VMware
Model: VMware Virtual S
Size: 10GB
3 NVMES:
Vendor: VMware
Model: VMware Virtual NVMe Disk
Size: 20GB
lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 20G 0 disk ├─sda1 8:1 0 1G 0 part /boot └─sda2 8:2 0 19G 0 part ├─vgoo-lvswap 254:0 0 2G 0 lvm [SWAP] └─vgoo-lvroot 254:1 0 17G 0 lvm / sdb 8:16 0 10G 0 disk sdc 8:32 0 10G 0 disk sr0 11:0 1 1024M 0 rom nvme0n1 259:0 0 20G 0 disk <===== only this as db_device nvme0n2 259:1 0 20G 0 disk nvme0n3 259:2 0 20G 0 disk
Setup
(Please provide relevant configs and/or SLS files (Be sure to remove sensitive info).)
cat /srv/salt/ceph/configuration/files/drive_groups.yml
drive_group_hdd_nvme:
target: 'I@roles:storage'
data_devices:
rotational: 1
db_devices:
rotational: 0
block_db_size: '2G'
disks report show me , use two nvme disk ,
salt-run disks.report
node003.example.com:
|_
- 2
- usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES [DB_DEVICES ...]]]
[--wal-devices [WAL_DEVICES [WAL_DEVICES ...]]]
[--journal-devices [JOURNAL_DEVICES [JOURNAL_DEVICES ...]]]
[--no-auto] [--bluestore] [--filestore]
[--report] [--yes] [--format {json,pretty}]
[--dmcrypt]
[--crush-device-class CRUSH_DEVICE_CLASS]
[--no-systemd]
[--osds-per-device OSDS_PER_DEVICE]
[--block-db-size BLOCK_DB_SIZE]
[--block-wal-size BLOCK_WAL_SIZE]
[--journal-size JOURNAL_SIZE] [--prepare]
[--osd-ids [OSD_IDS [OSD_IDS ...]]]
[DEVICES [DEVICES ...]]
ceph-volume lvm batch: error: GPT headers found, they must be removed on: /dev/sda
|_
- 0
-
Total OSDs: 1
Solid State VG:
Targets: block.db Total size: 19.00 GB
Total LVs: 1 Size per LV: 1.86 GB
Devices: /dev/nvme0n2
Type Path LV Size % of device
----------------------------------------------------------------------------------------------------
[data] /dev/sdb 9.00 GB 100.0%
[block.db] vg: vg/lv 1.86 GB 10%
|_
- 0
-
Total OSDs: 1
Solid State VG:
Targets: block.db Total size: 19.00 GB
Total LVs: 1 Size per LV: 1.86 GB
Devices: /dev/nvme0n3
Type Path LV Size % of device
----------------------------------------------------------------------------------------------------
[data] /dev/sdc 9.00 GB 100.0%
[block.db] vg: vg/lv 1.86 GB 10%
-----------------------------------------------------------------------------------------
cat /srv/salt/ceph/configuration/files/drive_groups.yml
drive_group_hdd_nvme:
target: 'I@roles:storage'
data_devices:
rotational: 1
db_devices:
rotational: 0
limit: 1 <==== use limit
block_db_size: '2G'
osds_per_device: 1
salt-run disks.report
node002.example.com:
|_
- 2
- usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES [DB_DEVICES ...]]]
[--wal-devices [WAL_DEVICES [WAL_DEVICES ...]]]
[--journal-devices [JOURNAL_DEVICES [JOURNAL_DEVICES ...]]]
[--no-auto] [--bluestore] [--filestore]
[--report] [--yes] [--format {json,pretty}]
[--dmcrypt]
[--crush-device-class CRUSH_DEVICE_CLASS]
[--no-systemd]
[--osds-per-device OSDS_PER_DEVICE]
[--block-db-size BLOCK_DB_SIZE]
[--block-wal-size BLOCK_WAL_SIZE]
[--journal-size JOURNAL_SIZE] [--prepare]
[--osd-ids [OSD_IDS [OSD_IDS ...]]]
[DEVICES [DEVICES ...]]
ceph-volume lvm batch: error: GPT headers found, they must be removed on: /dev/sda
node003.example.com:
|_
- 2
- usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES [DB_DEVICES ...]]]
[--wal-devices [WAL_DEVICES [WAL_DEVICES ...]]]
[--journal-devices [JOURNAL_DEVICES [JOURNAL_DEVICES ...]]]
[--no-auto] [--bluestore] [--filestore]
[--report] [--yes] [--format {json,pretty}]
[--dmcrypt]
[--crush-device-class CRUSH_DEVICE_CLASS]
[--no-systemd]
[--osds-per-device OSDS_PER_DEVICE]
[--block-db-size BLOCK_DB_SIZE]
[--block-wal-size BLOCK_WAL_SIZE]
[--journal-size JOURNAL_SIZE] [--prepare]
[--osd-ids [OSD_IDS [OSD_IDS ...]]]
[DEVICES [DEVICES ...]]
ceph-volume lvm batch: error: GPT headers found, they must be removed on: /dev/sda
admin:~ #
Versions Report
(Provided by running:
`salt-run deepsea.version` 0.9.23+git.0.6a24f24a0
rpm -qi salt-minion
rpm -qi salt-minion Name : salt-minion Version : 2019.2.0 Release : 6.3.5 Architecture: x86_64 Install Date: Fri Sep 20 09:14:33 2019 Group : System/Management Size : 41019 License : Apache-2.0 Signature : RSA/SHA256, Tue May 28 23:28:21 2019, Key ID 70af9e8139db7c82 Source RPM : salt-2019.2.0-6.3.5.src.rpm Build Date : Tue May 28 23:24:20 2019 Build Host : sheep28 Relocations : (not relocatable) Packager : https://www.suse.com/ Vendor : SUSE LLC URL : http://saltstack.org/ Summary : The client component for Saltstack Description : Salt minion is queried and controlled from the master. Listens to the salt master and execute the commands. Distribution: SUSE Linux Enterprise 15
rpm -qi salt-master
rpm -qi salt-master Name : salt-master Version : 2019.2.0 Release : 6.3.5 Architecture: x86_64 Install Date: Fri Sep 20 09:14:34 2019 Group : System/Management Size : 2936818 License : Apache-2.0 Signature : RSA/SHA256, Tue May 28 23:28:21 2019, Key ID 70af9e8139db7c82 Source RPM : salt-2019.2.0-6.3.5.src.rpm Build Date : Tue May 28 23:24:20 2019 Build Host : sheep28 Relocations : (not relocatable) Packager : https://www.suse.com/ Vendor : SUSE LLC URL : http://saltstack.org/ Summary : The management component of Saltstack with zmq protocol supported Description : The Salt master is the central server to which all minions connect. Enabled commands to remote systems to be called in parallel rather than serially. Distribution: SUSE Linux Enterprise 15 )