{"id":261,"date":"2025-09-25T11:57:26","date_gmt":"2025-09-25T11:57:26","guid":{"rendered":"http:\/\/123.249.119.122\/Wordpress\/?p=261"},"modified":"2026-05-06T13:11:57","modified_gmt":"2026-05-06T13:11:57","slug":"how-to-deploy-the-ceph-cluster","status":"publish","type":"post","link":"http:\/\/123.249.119.122\/Wordpress\/index.php\/2025\/09\/25\/how-to-deploy-the-ceph-cluster\/","title":{"rendered":"How to Deploy the Ceph Cluster"},"content":{"rendered":"\n

Ceph is an open source SDS(Software Defined Storage) distributed memory.It has a high usability,expansiblility.It can store a large mount of data.<\/p>\n\n\n\n

1.The Preparation<\/em><\/strong><\/p>\n\n\n\n

Prepare 4 Virtual Machines or 4 servers.The cluster consists of a main host,two node hosts,and a client host.<\/p>\n\n\n\n

Configure the hostname in ‘\/etc\/hosts’<\/strong>,and set the hostname by ‘hostnamectl set-hostname (your hostname)’<\/strong> command.<\/p>\n\n\n\n

Configure the firewall service and SELinux.You can configure your security group rule to allow ports.The protocol of all ports are TCP.This is the common port of ceph cluster.<\/p>\n\n\n\n

Service<\/td>Port<\/td>Description<\/td><\/tr>
MON<\/td>6789,3300<\/td>Inner cluster communication. <\/td><\/tr>
OSD<\/td>6800-7300<\/td>Every osd occupied 4 ports,through public network, communicate with client and MON. <\/td><\/tr>
MDS<\/td>6800-7300<\/td>Communitate with metadata server.<\/td><\/tr>
MGR<\/td>8443<\/td>Login the graphical page by ssl.<\/td><\/tr>
RESTful manage module<\/td>8003<\/td>Communicate with RESRful manage module by ssl.<\/td><\/tr>
Prometheus manage module<\/td>9283<\/td>Communicate with the Prometheus plugin in ceph.<\/td><\/tr>
Prometheus alarm management<\/td>9093<\/td>Communicate with the alarming manage service of Prometheus.<\/td><\/tr>
Prometheus node exporter<\/td>9100<\/td>Communicate with the node exporter of Prometheus.<\/td><\/tr>
Grafana Server<\/td>3000<\/td>Communicate with Grafana service.<\/td><\/tr>
RGW<\/td>80<\/td>Communicate with RADOSGW.<\/td><\/tr>
Ceph iSCSI gateway<\/td>9287<\/td>Communicate with ceph iSCSI gateway.<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

Configure the chrony service.Use ‘dnf install -y chronyd’<\/strong> and ‘systemctl start chronyd’<\/strong> to install and start the service.Then edit ‘\/etc\/chrony.conf’<\/strong> to edit the chrony source and time synchronization.<\/p>\n\n\n\n

Comfigure the yum(dnf) source in ‘\/etc\/yum.repos.d’<\/strong>.Install the podman,and git clone the cephadm.<\/p>\n\n\n\n

2.Initialization<\/em><\/strong><\/p>\n\n\n\n

Initialize the ceph cluster by ‘cephadm bootstrap –mon-ip (IP address) –allow-fqdn-hostname –initial-dashboard-user (username) –initial-dashboard-password (password) –dashboard-password-noupdate’<\/strong> command.And you can acquire the url.You can login the ceph cluster by this url.The default port of ceph manager page is 8443,visit the manager page by ‘https:\/\/IP:8443’<\/strong>.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

This is the main page of ceph cluster.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

3.Add nodes for the cluster<\/em><\/strong><\/p>\n\n\n\n

Input ‘cephadm shell’<\/strong> to build the container.<\/p>\n\n\n\n

Then,make the public key of ceph cluster by ‘ceph cephadm get-pub-key > ~\/ceph.pub’<\/strong> command.<\/p>\n\n\n\n

And then,copy the public key to other hosts by ‘ssh-copy-id -f -i ~\/ceph.pub (username)@(hostname)’<\/strong> command.<\/p>\n\n\n\n

Finally,input ‘ceph orch host add (hostname)’<\/strong> to add hosts into the cluster.Input ‘ceph orch host rm (hostname)’<\/strong> to remove hosts.<\/p>\n\n\n\n

You can input ‘ceph orch host ls’<\/strong> to watch hosts in the cluster.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

If you want to add the admin label of the host,input ‘ceph orch label add (hostname) _admin’<\/strong> to add it.And then,services can be auto deployed in hosts.<\/p>\n\n\n\n

4.Initialize the ceph cluster<\/em><\/strong><\/p>\n\n\n\n

After the deployment of ceph cluster and the service of cluster,you can input ‘ceph orch ls’<\/strong> to check them.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Input ‘ceph orch ps’<\/strong> to check all components of the cluster.<\/p>\n\n\n\n

Input ‘ceph -s’<\/strong> to check the connection in the cluster.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

You can deploy the service manually or automatically.<\/p>\n\n\n\n

5.Add the hard disk as the osd.<\/em><\/strong><\/p>\n\n\n\n

Input ‘ceph orch daemon add osd (hostname):\/dev\/(disk)’<\/strong> to add.<\/p>\n\n\n\n

You can add all disks of all hosts:‘ceph orch apply osd –all-available-devices’<\/strong>.<\/p>\n\n\n\n

Input ‘ceph orch ps |grep osd’<\/strong> to check the status of osd.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

6.Hosts in the cluster.<\/em><\/strong><\/p>\n\n\n\n

You can check hosts in the ceph cluster after deployment.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Check physical disks and other components of the host.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Check services of the host.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

7.Components of the Ceph Cluster<\/em><\/strong><\/p>\n\n\n\n

After the deployment of ceph cluster,in the ‘cephadm shell’<\/strong>,input ‘ceph orch host ls’<\/strong> to check hosts,input ‘ceph orch ls’<\/strong> to check services,input ‘ceph orch ps’<\/strong> to check components.<\/p>\n\n\n\n

For example,there are 8 kinds of services.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

MGR(Ceph Manager):Ceph manager can provides graphical page to check the status of ceph cluster.Ceph manager can integrate third-party management plugins like grafana,zabbix,and so on.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

MON(Monitor):Maintenance of the ‘Cluster Map’.In the ceph cluster,the interaction and coordination among the various components of ceph need to be carried out according to ‘Cluster Map’.<\/p>\n\n\n\n

OSD(Ceph Object Storage Daemon):The building unit of the ceph cluster,the location of data storage.A node of ceph cluster run several OSDs.OSD storages data in the disk of node.Usually,every OSD corresponding to a disk.There are 4 status of OSD:’up and in’ means OSD are running normally and bearing at least 1 PG;’up and out’ means OSD are running normally but no PGs,new OSDs in the cluster are ‘up and out’ status;’down and in’ means OSD running abnormally and at least bearing 1 PG,can take measures to recover ‘up and in’ status;’down and out’ means OSD running abnormally and bearing no PGs.<\/p>\n\n\n\n

PG(Placement Groups):Subset of pool,gather of objects.<\/p>\n\n\n\n

Pool:The conception of ceph cluster,deposit objects.The pools are isolates from each other.<\/p>\n\n\n\n

Grafana:The default port of Grafana is 3000,visit the Grafana page by ‘https:\/\/IP:3000’<\/strong>.This is the home page of Grafana.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Browse ceph-dashboard in Grafana.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Monitor host details of the ceph cluster.<\/p>\n\n\n\n

\"\"<\/figure>\n","protected":false},"excerpt":{"rendered":"

Ceph is an open source SDS(Software Defined Storage) distributed memory.It has a high usability,expansiblility.It can store a large mount of data. 1.The Preparation Prepare 4 Virtual Machines or 4 servers.The cluster consists of a main host,two node hosts,and a client host. Configure the hostname in ‘\/etc\/hosts’,and set the hostname by ‘hostnamectl set-hostname (your hostname)’ command. […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-261","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"http:\/\/123.249.119.122\/Wordpress\/index.php\/wp-json\/wp\/v2\/posts\/261","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/123.249.119.122\/Wordpress\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/123.249.119.122\/Wordpress\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/123.249.119.122\/Wordpress\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/123.249.119.122\/Wordpress\/index.php\/wp-json\/wp\/v2\/comments?post=261"}],"version-history":[{"count":17,"href":"http:\/\/123.249.119.122\/Wordpress\/index.php\/wp-json\/wp\/v2\/posts\/261\/revisions"}],"predecessor-version":[{"id":363,"href":"http:\/\/123.249.119.122\/Wordpress\/index.php\/wp-json\/wp\/v2\/posts\/261\/revisions\/363"}],"wp:attachment":[{"href":"http:\/\/123.249.119.122\/Wordpress\/index.php\/wp-json\/wp\/v2\/media?parent=261"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/123.249.119.122\/Wordpress\/index.php\/wp-json\/wp\/v2\/categories?post=261"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/123.249.119.122\/Wordpress\/index.php\/wp-json\/wp\/v2\/tags?post=261"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}