{"id":3251,"date":"2024-03-15T10:58:25","date_gmt":"2024-03-15T14:58:25","guid":{"rendered":"https:\/\/arielantigua.com\/weblog\/?p=3251"},"modified":"2024-04-01T11:55:55","modified_gmt":"2024-04-01T15:55:55","slug":"ceph-on-proxmox-as-storage-provider","status":"publish","type":"post","link":"https:\/\/arielantigua.com\/weblog\/2024\/03\/ceph-on-proxmox-as-storage-provider\/","title":{"rendered":"Ceph on Proxmox as Storage Provider."},"content":{"rendered":"

For a few months, I\u2019ve been reading about Ceph and how it works, I love distributed stuff, maybe the reason is that I can have multiple machines and the idea of clustering has always fascinated me. In Ceph, the more the better!<\/p>\n

If you have multiple machines with lots of SSD\/NVME the Ceph performance will be a lot different than having a 3-node cluster with only one OSD per node. This is my case, and the solution has been working well.<\/p>\n

Installing Ceph on Proxmox is just a few clicks away, is already documented in https:\/\/pve.proxmox.com\/wiki\/Deploy_Hyper-Converged_Ceph_Cluster<\/a><\/p>\n

At first, I have two nodes and the state of Ceph was faulty.<\/p>\n

\"A<\/p>\n

The crush_map created by Proxmox is a 3-host configuration, that adds at least one OSD to the cluster, in this picture, there were only 2 hosts with 1 OSD each.<\/p>\n

<\/p>\n

After the third node was added, it started replicating data across all OSD to meet the crush_map policy.<\/p>\n

\"A<\/p>\n

\"A<\/p>\n

\"A<\/p>\n

Here you can see the PGs getting moved across the OSDs.<\/p>\n

One thing I didn\u2019t like about the storage usage on Proxmox, is the thin provision is nothing like VMware VMFS! It depends on the backend and the format of the virtual drive. I need to get used to this.<\/p>\n

\"A<\/p>\n

\"A<\/p>\n

This is the state of the Storage side of the Proxmox Cluster. I need to move more VMs into this Storage and see how Ceph performs with more IOPs demanding VMs.<\/p>\n

The hardware used in this cluster is documented:<\/p>\n

here: https:\/\/arielantigua.com\/weblog\/2024\/03\/ceph-as-my-storage-provider\/<\/a><\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

For a few months, I\u2019ve been reading about Ceph and how it works, I love distributed stuff, maybe the reason is that I can have multiple machines and the idea of clustering has always fascinated me. In Ceph, the more the better! If you have multiple machines with lots of SSD\/NVME the Ceph performance will […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7,19],"tags":[153,154,155],"class_list":["post-3251","post","type-post","status-publish","format-standard","hentry","category-general","category-virtualizacion","tag-ceph","tag-proxmox","tag-vmware_alternative"],"_links":{"self":[{"href":"https:\/\/arielantigua.com\/weblog\/wp-json\/wp\/v2\/posts\/3251","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/arielantigua.com\/weblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/arielantigua.com\/weblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/arielantigua.com\/weblog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/arielantigua.com\/weblog\/wp-json\/wp\/v2\/comments?post=3251"}],"version-history":[{"count":2,"href":"https:\/\/arielantigua.com\/weblog\/wp-json\/wp\/v2\/posts\/3251\/revisions"}],"predecessor-version":[{"id":3274,"href":"https:\/\/arielantigua.com\/weblog\/wp-json\/wp\/v2\/posts\/3251\/revisions\/3274"}],"wp:attachment":[{"href":"https:\/\/arielantigua.com\/weblog\/wp-json\/wp\/v2\/media?parent=3251"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/arielantigua.com\/weblog\/wp-json\/wp\/v2\/categories?post=3251"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/arielantigua.com\/weblog\/wp-json\/wp\/v2\/tags?post=3251"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}