Integrate Cephfs (Ceph v15.2.5) with K8s (v1.24.X) on BareMetal

General Discussions microk8s
, ,
1

Hi everyone,
I am trying to integrate Ceph (Ceph v15.2.5) as a filesystem with Kubernetes (v1.24.X) on bare metal setup. Storage class and provisioners are getting created but when we try to create the PVC using Dynamic method, it’s going to pending state.

I have checked online for solution and could not find the right one to fix.

My earlier Ceph (Ceph v15.2.5) and K8s (v1.19.X) cluster has been integrated without any issue and running for past 2years. I tried the same method as mentioned in the below link and it doesn’t work.
“URL:-https://computingforgeeks.com/ceph-persistent-storage-for-kubernetes-with-cephfs/”

I keep getting error as given below when PVC described.
“Warning ProvisioningFailed - waiting for a volume to be created, either by external provisioner “rbd.csi.ceph.com” or manually created by system administrator”

Can someone send a link related to Integration of Ceph with K8s latest version.

Regards,
Mark.

2

Hello Mark,

I am facing a similar issue,
Were you able to solve it?

Thank you,
G.A.

3

Hello all,

+1
couldn’t find documentation to how to configure CephFS

4

I discovered it, couldn’t find it in any documentation!
after you have configured rbd with connect-externalj-ceph command, and you have your rbd storageclass in microk8s already do the following:

Create a meta data pool for your CephFS

sudo ceph osd pool create cephfs_metadata 32 32

Create a data pool for your CephFS

sudo ceph osd pool create cephfs_data 64 64

Create CephFS using the two previous pools

sudo ceph fs new my_cephfs cephfs_metadata cephfs_data

then just run the “sudo microk8s connect-external-ceph” again and the storage class will show up in your microk8s deployments