Thursday, 2021-07-15

*** akekane_ is now known as abhishekk07:15
*** akekane_ is now known as abhishekk08:57
*** dviroel|out is now known as dviroel11:02
*** mabrams1 is now known as mabrams11:09
opendevreviewBrian Rosmaita proposed openstack/python-cinderclient master: Add QuotaSet class to cinderclient.v3  https://review.opendev.org/c/openstack/python-cinderclient/+/80094513:18
whoami-rajatgeguileo, hey, can you take a look at this since you had a previous +2 on it? https://review.opendev.org/c/openstack/python-cinderclient/+/78362813:45
opendevreviewBrian Rosmaita proposed openstack/python-cinderclient master: Add missing classes to cinderclient.v3  https://review.opendev.org/c/openstack/python-cinderclient/+/80094514:17
opendevreviewEric Harney proposed openstack/cinder master: mypy: service.py  https://review.opendev.org/c/openstack/cinder/+/78836714:19
opendevreviewEric Harney proposed openstack/cinder master: Add installation of mypy stubs packages  https://review.opendev.org/c/openstack/cinder/+/80030614:33
opendevreviewEric Harney proposed openstack/cinder master: Validate fields in encryption spec create/update  https://review.opendev.org/c/openstack/cinder/+/78960315:01
Mr_Freezeexgeguileo: Hi! If you want to continue the discussion we had yesterday about snapshot mirroring in the backup driver and about your concerns that the backup driver will have to worry about managing snapshots. Well it should be mostly fine because ceph itself manage a max number of mirror snapshots and will remove snapshots as they are replayed on the other cluster. So this is15:02
Mr_Freezeexonly about calling `mirror_image_create_snapshot` on the image after data transfer to improve the load on ceph and the RPO of the replication. There would not be any more logic on the cinder side than checking if the snapshot mirroring option is enabled basically.15:02
geguileoMr_Freezeex: what I was referring to, is that if we have the scheduler anabled on the cluster, why would we need to enable the feature in cinder?  won't the scheduler create the first snapshot and then not create more than 3?15:06
Mr_Freezeexgeguileo: the max snapshot is a setting handled through librbd. Basically this will be pretty similar than what the scheduler does but every x minutes. This will allow to not enable the scheduler on the backup pool and give a "hint" to ceph on when it matters to replcate the data.15:10
geguileoMr_Freezeex: that's the thing, if it can be done on the backend, we prefer that15:11
Mr_Freezeexgeguileo: even if it's a < 10 line patch that would improve both perfomance and RPO :(?15:12
Mr_Freezeex(to be fair I will pass if you really say no, my goal is to make this possible first but this little imprvement would ease the load on our cluster)15:15
geguileoMr_Freezeex: how would it easy it vs using the scheduler?15:16
* geguileo is not understanding something...15:16
geguileos/easy/ease15:16
Mr_Freezeexgeguileo: the scheduler will create many unecessary snapshots even if data didn't change. So then the rbd-mirror daemon will have to pickup all those snapshots try to diff with the previous one etc... In our case one daemon was able to handle 100 empty snapshots per minute.15:20
geguileoMr_Freezeex: I'm sold15:20
geguileothe feature makes sense15:21
geguileoMr_Freezeex: thanks for the explanation15:21
geguileoI would make it very clear that is the reason for adding the feature15:21
geguileoin the commit message, docs, etc15:22
Mr_Freezeexgeguileo: thanks for the approval ahah :D15:22
geguileooh, thank you for taking the time to explain the underlying issues that led to this driver improvement15:23
Mr_Freezeexgeguileo: Actually i don't think there is much documentation for replication in the ceph cinder-backup15:23
Mr_Freezeexgeguileo: sure no worries15:23
geguileobecause up till now it was only configured in the ceph cluster15:23
geguileoand that's how we wanted to keep it15:23
Mr_Freezeexgeguileo: Yes but well actually there is configuration difference between cinder and cinder-backup even on the pool15:24
geguileobut considering there is a considerable performance impact on the ceph cluster if done in the cluster, it makes sense to add it15:24
Mr_Freezeexgeguileo: So that's a bit misleading imo15:24
Mr_Freezeexgeguileo: I would happily add some docs for journaling and snapshot though :)15:25
geguileowhat do you mean there is config diff between cinder and backup?15:25
geguileoMr_Freezeex: docs are ALWAYS welcomed!!!15:25
Mr_Freezeexgeguileo: In cinder you should activate the per image mode on the pool, on the backup side you have to enable it on the whole pool15:25
geguileoMr_Freezeex: because one is the Cinder replication feature, and in the backup Cinder doesn't care15:26
geguileoso the difference is the level of integration15:26
geguileoin most cases people don't backup their backups15:26
geguileoso we leave it to the storage admins to decide how to implement that part15:27
geguileothough having docs would be great15:27
Mr_Freezeexgeguileo: yep I will try add that soon :D15:28
geguileothanks!!15:28
opendevreviewMerged openstack/os-brick master: Drop lower-constraints jobs  https://review.opendev.org/c/openstack/os-brick/+/78907917:10
amar7ibmHi team, if anyone has time could they please look at this fix : https://review.opendev.org/c/openstack/cinder/+/782405 and share your reviews/comments.17:12
opendevreviewMerged openstack/cinder master: Add installation of mypy stubs packages  https://review.opendev.org/c/openstack/cinder/+/80030617:22
*** amar7ibm is now known as amar__17:32
opendevreviewEric Harney proposed openstack/cinder master: mypy: create_volume flows  https://review.opendev.org/c/openstack/cinder/+/78093317:33
opendevreviewEric Harney proposed openstack/cinder master: mypy: image cache  https://review.opendev.org/c/openstack/cinder/+/78836317:35
opendevreviewEric Harney proposed openstack/cinder master: mypy: continued manager, scheduler, rpcapi  https://review.opendev.org/c/openstack/cinder/+/78445317:36
opendevreviewBrian Rosmaita proposed openstack/cinder master: Run cinder-mypy job in the check  https://review.opendev.org/c/openstack/cinder/+/79264218:04
opendevreviewBrian Rosmaita proposed openstack/os-brick master: Update mypy infrastructure  https://review.opendev.org/c/openstack/os-brick/+/80056818:09
opendevreviewAndrei proposed openstack/cinder master: Open-E JovianDSS: Addes multi-attach support  https://review.opendev.org/c/openstack/cinder/+/79496218:38
opendevreviewAndrei proposed openstack/cinder master: Open-E JovianDSS: Addes multi-attach support  https://review.opendev.org/c/openstack/cinder/+/79496218:43
opendevreviewEric Harney proposed openstack/cinder master: mypy: coordination.py  https://review.opendev.org/c/openstack/cinder/+/78836419:29
*** dviroel is now known as dviroel|brb19:53
opendevreviewEric Harney proposed openstack/os-brick master: mypy: initiator  https://review.opendev.org/c/openstack/os-brick/+/78673219:56
*** dviroel|brb is now known as dviroel20:27
*** dviroel is now known as dviroel|out21:24

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!