Ceph

Installing a new ceph monitor

To install a new ceph monitor. Execute the following steps. The order is important

1. Add the new ceph-monitor server to the hiera key profile::ceph::monitors
2. Run puppet on all existing ceph-monitors and ensure that the new ceph-mon is listed in both mon_initial_members and in mon_host in /etc/ceph/ceph.conf
3. If, and only if, ALL the existing ceph-monitors have discovered, and configured the new ceph-mon - install role::ceph::mon on the new ceph-mon.

Reinstalling a storage node

If a storage-node is reinstalled, either because it needs a newer OS or because the node moves from old to new infrastructure, there is no need to start with its OSD fresh. The OSD's can be reinstalled into the cluster if they have not been reformatted with the following steps:

1. Run "ceph-disk list" to see which disks are recognized by ceph
2. "chown" all the ceph disk's to be owned by the "ceph" user and the "ceph" group
3. Restart all the osd by running "ceph-disk activate <path-to-disk>" for each disk that "ceph-disk" lists as an "ceph data" disk.