*** martinkennelly has quit IRC | 00:09 | |
*** zenkuro has quit IRC | 00:42 | |
*** whoami-rajat has quit IRC | 01:48 | |
opendevreview | Xuan Yandong proposed openstack/cinder master: Add timeout when execute ssh cmd. https://review.opendev.org/c/openstack/cinder/+/793264 | 02:57 |
---|---|---|
opendevreview | Xuan Yandong proposed openstack/cinder master: Add timeout when execute ssh cmd. https://review.opendev.org/c/openstack/cinder/+/793264 | 03:03 |
*** carloss has quit IRC | 03:21 | |
*** ricolin_ has joined #openstack-cinder | 04:32 | |
*** vishalmanchanda has joined #openstack-cinder | 04:35 | |
*** ricolin has quit IRC | 04:36 | |
*** ricolin_ is now known as ricolin | 04:36 | |
*** abhishekk has joined #openstack-cinder | 04:42 | |
opendevreview | Tushar Trambak Gite proposed openstack/cinderlib master: Moving to OFTC https://review.opendev.org/c/openstack/cinderlib/+/793881 | 04:45 |
opendevreview | Adrian Smith proposed openstack/cinder master: allow project_id/user_id in create_snapshot filter https://review.opendev.org/c/openstack/cinder/+/793885 | 05:32 |
*** josecastroleon has joined #openstack-cinder | 06:26 | |
*** hemna has quit IRC | 07:01 | |
*** hemna has joined #openstack-cinder | 07:01 | |
*** tosky has joined #openstack-cinder | 07:48 | |
*** tosky has quit IRC | 07:48 | |
*** martinkennelly has joined #openstack-cinder | 07:48 | |
*** jrosser has joined #openstack-cinder | 07:52 | |
*** tosky has joined #openstack-cinder | 08:08 | |
*** abhishekk has quit IRC | 08:35 | |
*** abhishekk has joined #openstack-cinder | 08:35 | |
*** stephenfin has quit IRC | 08:49 | |
*** martinkennelly has quit IRC | 08:50 | |
*** martinkennelly has joined #openstack-cinder | 08:50 | |
*** abhishekk has quit IRC | 08:56 | |
opendevreview | Girish Chilukuri proposed openstack/cinder master: [SVF]:Fix error message for volume with snapshot https://review.opendev.org/c/openstack/cinder/+/787262 | 09:12 |
*** josecastroleon has quit IRC | 09:14 | |
*** josecastroleon has joined #openstack-cinder | 09:15 | |
*** stephenfin has joined #openstack-cinder | 09:15 | |
opendevreview | Girish Chilukuri proposed openstack/cinder master: [SVF]:Bulk create Hyperswap volume is failing. https://review.opendev.org/c/openstack/cinder/+/779194 | 09:24 |
opendevreview | katari manoj kumar proposed openstack/cinder master: [SVF]:Fix add volumes to GMCV group https://review.opendev.org/c/openstack/cinder/+/784092 | 09:27 |
opendevreview | saikrishnagk proposed openstack/cinder master: [SVF] Fixed add volumes to clone group issue https://review.opendev.org/c/openstack/cinder/+/784779 | 09:30 |
*** amotoki has joined #openstack-cinder | 09:36 | |
opendevreview | Amar Rajeev Singuluri proposed openstack/cinder master: [SVF]: Fix mkvdisk volume name length issue https://review.opendev.org/c/openstack/cinder/+/790910 | 09:46 |
*** zenkuro has joined #openstack-cinder | 10:00 | |
opendevreview | Amar Rajeev Singuluri proposed openstack/cinder master: [SVF]: Fix extend issue for a clone of rep-volume https://review.opendev.org/c/openstack/cinder/+/782405 | 10:04 |
opendevreview | Helen Walsh proposed openstack/cinder master: PowerMax Driver - Re-use existing initiator group/host. https://review.opendev.org/c/openstack/cinder/+/787764 | 10:19 |
*** abhishekk has joined #openstack-cinder | 10:45 | |
*** carloss has joined #openstack-cinder | 10:54 | |
*** Luzi has joined #openstack-cinder | 10:57 | |
hemna | good morning | 11:29 |
opendevreview | Merged openstack/cinderlib master: Moving to OFTC https://review.opendev.org/c/openstack/cinderlib/+/793881 | 11:38 |
opendevreview | Victoria Martinez de la Cruz proposed openstack/devstack-plugin-ceph master: DNM https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/793952 | 11:39 |
*** whoami-rajat has joined #openstack-cinder | 11:55 | |
whoami-rajat | geguileo: hey i did the suggested changes in same patch, can you take another look? https://review.opendev.org/c/openstack/os-brick/+/789289 | 11:57 |
opendevreview | Rajat Dhasmana proposed openstack/cinder master: Add user messages for volume operations https://review.opendev.org/c/openstack/cinder/+/793515 | 11:57 |
*** dviroel has joined #openstack-cinder | 11:57 | |
*** fabiooliveira has joined #openstack-cinder | 12:03 | |
*** abhishekk has quit IRC | 12:04 | |
opendevreview | Girish Chilukuri proposed openstack/cinder master: [SVF]:Storwize HyperSwap snapshot clone is failing https://review.opendev.org/c/openstack/cinder/+/776307 | 12:05 |
opendevreview | Girish Chilukuri proposed openstack/cinder master: [SVF]:Fix error message for volume with snapshot https://review.opendev.org/c/openstack/cinder/+/787262 | 12:12 |
opendevreview | Girish Chilukuri proposed openstack/cinder master: [SVF]:Retype in-use hyperswap volume https://review.opendev.org/c/openstack/cinder/+/782390 | 12:29 |
*** rosmaita has joined #openstack-cinder | 12:33 | |
*** tbarron has quit IRC | 12:52 | |
*** eharney has joined #openstack-cinder | 12:53 | |
*** enriquetaso has joined #openstack-cinder | 12:53 | |
*** tbarron has joined #openstack-cinder | 13:07 | |
*** Luzi has quit IRC | 13:21 | |
*** abhishekk has joined #openstack-cinder | 13:35 | |
*** hemna has quit IRC | 13:53 | |
*** hemna has joined #openstack-cinder | 13:54 | |
rosmaita | hemna: thanks for keeping an eye on that ceph-iscsi-CI patch ... seems like everything *except* the ceph-iscsi job has been failing | 13:59 |
hemna | np | 13:59 |
hemna | hoping to get that to merge | 13:59 |
*** _pewp_ has joined #openstack-cinder | 14:01 | |
_pewp_ | hemna (✧∇✧)╯ | 14:04 |
hemna | rosmaita, geguileo, so the discussion the other day about the initialize_connection rpc timeouts/failures. The idea was to add a microversion and make initialize_connection async. The problem is, cinder doesn't know who to call back. Since the cinderclient can call initialize_connection (for the cinderclient os brick extension), cinder | 14:07 |
hemna | volume manager can't assume that we should call nova back after the driver is done w/ initialize_connection. | 14:07 |
geguileo | hemna: we can make the callback optional (only working for nova) and when there is no callback the client would do polling and then get information from the attachment | 14:08 |
rosmaita | hemna: what geguileo said | 14:09 |
hemna | so I think making it a callback is going to be really hard on the nova side of things | 14:09 |
hemna | as nova would have to somehow 'pause' the attachment process and wait | 14:10 |
geguileo | hemna: yes, that is the problem | 14:13 |
geguileo | the Nova side is the hard part | 14:13 |
rosmaita | guess we need to talk to the nova team about what ideas they have to address this | 14:14 |
hemna | my nova guy suggested polling from nova's side | 14:15 |
hemna | but I'm not sure really what to poll | 14:15 |
geguileo | hemna: alternatively we could do the first Nova implementation using polling, which simplifies the nova implementation | 14:15 |
geguileo | hemna: the attachment id | 14:15 |
hemna | like maybe repeatedly call initialize_connection and if cinder responds with 'not done yet', keep polling | 14:15 |
geguileo | hemna: it should have no connection info if it's still doing the export/map | 14:15 |
rosmaita | so, basically same thing someone would do using the cinderclient | 14:15 |
geguileo | hemna: before the initialize_connection call Nova already has an attachment id | 14:16 |
hemna | the reserve call creates the attachment and replies with the attachment id ? | 14:16 |
geguileo | hemna: and then calls cinder with that attachment id and the connector properties to do the attachment | 14:16 |
geguileo | hemna: I believe there is no longer a reserve call on the new attach mechanism | 14:16 |
geguileo | we have a create attachment without the connector properties | 14:17 |
hemna | I think there is, to get cinder to put the volume in attaching state early on | 14:17 |
hemna | to prevent someone else requesting an attach | 14:17 |
geguileo | which makes the volume go to reserved or whatever state its used for locking | 14:17 |
geguileo | hemna: there is no reserve, there is create attachment without connector properties | 14:17 |
geguileo | then you get an attachment id | 14:17 |
geguileo | and then there is an update to that attachment id with the connector properties | 14:18 |
geguileo | that call would be the one that should be changed to support async | 14:18 |
geguileo | and then nova would do the polling | 14:18 |
hemna | attachment_create (from nova side looks like). ok I see the nova/api.py call now, that superceeded the reserve_volume w/ the newer microversion | 14:19 |
geguileo | or if we want to make it even better/harder the async is only triggered if it takes longer than 45 seconds or whatever | 14:19 |
hemna | well the problem is on initialize_connection on cinder's side. That rpc call is what times out | 14:22 |
hemna | does attachment_update return anything? | 14:22 |
hemna | could we make initialize_connection async and then return immediately | 14:23 |
hemna | and the nova could call attachment_get as the polling mechanism | 14:23 |
hemna | cinder volume manager would stuff the connection_info from the driver's initialize_connection into the attachment entry | 14:23 |
hemna | the next call to attachment_get by nova could get it | 14:24 |
*** gouthamr_ has joined #openstack-cinder | 14:34 | |
*** gouthamr has joined #openstack-cinder | 14:40 | |
hemna | would just have to modify the volume manager to stuff the driver's connection info into the attachment db record......but that also includes the iscsi CHAP creds as well | 14:41 |
*** abishop has quit IRC | 14:43 | |
*** opendevreview has quit IRC | 14:44 | |
*** abishop has joined #openstack-cinder | 14:51 | |
hemna | ok looking at this a bit more, it seems that the volume manager's attachment_update sort of does this, but it also calls the driver's initialize_connection every time too | 14:54 |
hemna | and I see a bug in there. | 14:54 |
hemna | require_driver_initialized is called after _connection_create() which calls the driver's initialize_connection | 14:55 |
hemna | should we talk about removing the legacy volume attach process in nova? | 15:02 |
hemna | nova shouldn't be calling initialize_connection directly with the process we implemented ages ago now | 15:02 |
*** dviroel is now known as dviroel|lunch | 15:04 | |
hemna | nova's legacy_volume_attach was created by john back in 2017 | 15:04 |
*** luksky has joined #openstack-cinder | 15:09 | |
*** gouthamr_ has quit IRC | 15:12 | |
*** opendevreview has joined #openstack-cinder | 15:13 | |
opendevreview | Rajat Dhasmana proposed openstack/cinder master: Add user messages for volume operations https://review.opendev.org/c/openstack/cinder/+/793515 | 15:13 |
*** gouthamr has quit IRC | 15:13 | |
*** gouthamr has joined #openstack-cinder | 15:14 | |
hemna | so if attachment_create is called w/ a connector (which happens during nova's live migration), then initialize_connection is called as well. | 15:15 |
*** gouthamr is now known as identify | 15:18 | |
*** gouthamr has joined #openstack-cinder | 15:19 | |
*** identify has quit IRC | 15:20 | |
hemna | ok so the connection_info is saved in the db record currently by cinder api after the attachment_update rpc into the volume manager returns | 15:26 |
hemna | hrmm | 15:26 |
*** abishop has quit IRC | 15:28 | |
*** abishop has joined #openstack-cinder | 15:30 | |
opendevreview | Walt proposed openstack/cinder master: Ensure driver is initialized before attach https://review.opendev.org/c/openstack/cinder/+/794001 | 15:56 |
hemna | ^ moved require_driver_initialized prior to allow a call to initialize_connection | 15:57 |
*** dviroel|lunch is now known as dviroel | 16:11 | |
*** vishalmanchanda has quit IRC | 17:10 | |
*** abhishekk has quit IRC | 17:22 | |
*** zenkuro has quit IRC | 17:28 | |
hemna | other weirdness with attachment_update...... | 17:38 |
hemna | looks like we are doing multiple DB update calls instead of just 1 | 17:41 |
hemna | twice we write to the db for the attachment record | 17:41 |
hemna | cinder api does it here: https://github.com/openstack/cinder/blob/master/cinder/volume/api.py#L2246-L2252 | 17:41 |
hemna | but the volume manager also does it here: https://github.com/openstack/cinder/blob/39762e408ed2aaafb873cdcdbde90c3700792bbf/cinder/volume/manager.py#L4689 | 17:42 |
hemna | the volume manager has the connection_info, but doesn't write it to the db entry. it waits for cinder api to do it later ? | 17:42 |
opendevreview | Fernando Ferraz Silva proposed openstack/cinder master: [DNM] testing NetApp CI https://review.opendev.org/c/openstack/cinder/+/794021 | 18:09 |
*** sfernand has joined #openstack-cinder | 18:11 | |
*** _pewp_ has quit IRC | 18:11 | |
*** luksky has quit IRC | 21:59 | |
opendevreview | Merged openstack/cinder master: Update IRC info https://review.opendev.org/c/openstack/cinder/+/793230 | 22:25 |
*** tosky has quit IRC | 23:11 | |
*** martinkennelly has quit IRC | 23:52 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!