*** rchurch has quit IRC | 00:34 | |
*** zhanglong has joined #openstack-nova | 00:38 | |
*** grandchild has quit IRC | 01:00 | |
openstackgerrit | Gonéri Le Bouder proposed openstack/nova master: QEMU/KVM: accept vmxnet3 NIC https://review.opendev.org/738695 | 01:04 |
---|---|---|
openstackgerrit | Ghanshyam Mann proposed openstack/nova master: DNM: testing nova gate on ubuntu focal https://review.opendev.org/738126 | 01:05 |
*** Liang__ has joined #openstack-nova | 01:17 | |
*** markvoelker has joined #openstack-nova | 01:20 | |
*** markvoelker has quit IRC | 01:24 | |
*** gyee has quit IRC | 01:35 | |
openstackgerrit | Kevin Zhao proposed openstack/nova master: [WIP] CI: add tempest-integrated-compute-aarch64 job https://review.opendev.org/714439 | 01:37 |
*** yaawang has quit IRC | 01:42 | |
*** yaawang has joined #openstack-nova | 01:43 | |
*** Liang__ has quit IRC | 01:46 | |
openstackgerrit | Ghanshyam Mann proposed openstack/nova master: DNM: testing nova gate on ubuntu focal https://review.opendev.org/738126 | 01:49 |
openstackgerrit | Tony Su proposed openstack/nova master: Provider Config File: YAML file loading and schema validation https://review.opendev.org/673341 | 02:10 |
openstackgerrit | Tony Su proposed openstack/nova master: Provider Config File: Functions to merge provider configs to provider tree https://review.opendev.org/676522 | 02:10 |
openstackgerrit | Tony Su proposed openstack/nova master: Provider Config File: Enable loading and merging of provider configs https://review.opendev.org/693460 | 02:10 |
openstackgerrit | Tony Su proposed openstack/nova master: Provider Config File: Function to further validate and retrieve configs https://review.opendev.org/676029 | 02:10 |
openstackgerrit | Ghanshyam Mann proposed openstack/nova master: DNM: testing nova gate on ubuntu focal https://review.opendev.org/738126 | 02:22 |
openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Fix user creation with GRANT in MySQL 8.0(Ubuntu Focal) https://review.opendev.org/738723 | 02:27 |
openstackgerrit | Ghanshyam Mann proposed openstack/nova master: DNM: testing nova gate on ubuntu focal https://review.opendev.org/738126 | 02:28 |
gmann | dansmith: melwitt gibi Ubuntu Focal fix for tool/test-setup.sh - https://review.opendev.org/#/c/738723/ Testing it in https://review.opendev.org/#/c/738126/ . | 02:30 |
gmann | Result should be ready by morning. I will be on holiday tomorrow, so pinged before gate result. | 02:31 |
*** yaawang has quit IRC | 02:45 | |
*** yaawang has joined #openstack-nova | 02:46 | |
openstackgerrit | Wenping Song proposed openstack/nova master: Add instance project_id for cyborg arq https://review.opendev.org/738428 | 03:04 |
*** psachin has joined #openstack-nova | 03:33 | |
*** zhanglong has quit IRC | 03:42 | |
*** Liang__ has joined #openstack-nova | 03:58 | |
*** markvoelker has joined #openstack-nova | 04:03 | |
*** markvoelker has quit IRC | 04:08 | |
*** iurygregory has quit IRC | 04:31 | |
*** evrardjp has quit IRC | 04:33 | |
*** udesale has joined #openstack-nova | 04:33 | |
*** evrardjp has joined #openstack-nova | 04:33 | |
*** mugsie has quit IRC | 04:53 | |
*** mugsie has joined #openstack-nova | 04:57 | |
*** markvoelker has joined #openstack-nova | 05:03 | |
*** markvoelker has quit IRC | 05:07 | |
*** vishalmanchanda has joined #openstack-nova | 05:23 | |
*** links has joined #openstack-nova | 05:34 | |
*** yaawang has quit IRC | 05:45 | |
*** yaawang has joined #openstack-nova | 05:45 | |
*** ccamacho has quit IRC | 05:58 | |
*** factor has quit IRC | 06:03 | |
*** factor has joined #openstack-nova | 06:03 | |
*** icarusfactor has joined #openstack-nova | 06:05 | |
*** factor has quit IRC | 06:06 | |
*** jsuchome has joined #openstack-nova | 06:09 | |
*** zhanglong has joined #openstack-nova | 06:09 | |
*** ratailor has joined #openstack-nova | 06:12 | |
*** zhanglong has quit IRC | 06:18 | |
*** zhanglong has joined #openstack-nova | 06:20 | |
*** icarusfactor has quit IRC | 06:22 | |
*** mkrai has joined #openstack-nova | 06:28 | |
*** ccamacho has joined #openstack-nova | 06:31 | |
*** tetsuro has joined #openstack-nova | 06:33 | |
*** zhanglong has quit IRC | 06:42 | |
*** tetsuro has quit IRC | 06:43 | |
*** tetsuro has joined #openstack-nova | 06:43 | |
*** tetsuro has quit IRC | 06:43 | |
*** zhanglong has joined #openstack-nova | 06:43 | |
*** yaawang has quit IRC | 06:43 | |
*** yaawang has joined #openstack-nova | 06:51 | |
openstackgerrit | Jiri Suchomel proposed openstack/nova master: Move image verification and writing out of download method https://review.opendev.org/738738 | 06:55 |
*** tetsuro has joined #openstack-nova | 06:55 | |
*** yaawang has quit IRC | 06:55 | |
*** yaawang has joined #openstack-nova | 06:55 | |
*** tetsuro has quit IRC | 06:56 | |
*** bhagyashris is now known as bhagyashris|brb | 06:59 | |
*** luksky has joined #openstack-nova | 07:02 | |
*** rcernin has quit IRC | 07:02 | |
*** markvoelker has joined #openstack-nova | 07:04 | |
*** rcernin has joined #openstack-nova | 07:04 | |
*** iurygregory has joined #openstack-nova | 07:09 | |
*** markvoelker has quit IRC | 07:09 | |
*** mkrai has quit IRC | 07:10 | |
*** slaweq has quit IRC | 07:12 | |
*** slaweq has joined #openstack-nova | 07:13 | |
*** maciejjozefczyk has joined #openstack-nova | 07:15 | |
*** bhagyashris|brb is now known as bhagyashris | 07:15 | |
*** tesseract has joined #openstack-nova | 07:17 | |
*** markvoelker has joined #openstack-nova | 07:18 | |
*** markvoelker has quit IRC | 07:23 | |
*** rcernin has quit IRC | 07:30 | |
*** nightmare_unreal has joined #openstack-nova | 07:30 | |
*** Liang__ has quit IRC | 07:30 | |
*** Liang__ has joined #openstack-nova | 07:31 | |
*** ralonsoh has joined #openstack-nova | 07:33 | |
*** zhanglong has quit IRC | 07:34 | |
*** dtantsur|afk is now known as dtantsur | 07:35 | |
*** mkrai has joined #openstack-nova | 07:35 | |
*** zhanglong has joined #openstack-nova | 07:36 | |
*** tosky has joined #openstack-nova | 07:40 | |
*** ociuhandu has quit IRC | 07:41 | |
huaqiang | a | 07:43 |
*** rcernin has joined #openstack-nova | 07:50 | |
*** ttsiouts has joined #openstack-nova | 07:53 | |
*** ttsiouts has quit IRC | 07:53 | |
*** ttsiouts has joined #openstack-nova | 07:54 | |
*** xek has joined #openstack-nova | 07:58 | |
openstackgerrit | Jiri Suchomel proposed openstack/nova master: Move image verification and writing out of download method https://review.opendev.org/738738 | 07:58 |
*** xek has quit IRC | 07:59 | |
*** xek has joined #openstack-nova | 08:00 | |
*** rcernin has quit IRC | 08:06 | |
*** zhanglong has quit IRC | 08:11 | |
*** k_mouza has joined #openstack-nova | 08:15 | |
*** zhanglong has joined #openstack-nova | 08:15 | |
*** sapd1 has joined #openstack-nova | 08:18 | |
*** ociuhandu has joined #openstack-nova | 08:20 | |
*** martinkennelly has joined #openstack-nova | 08:24 | |
*** ttsiouts has quit IRC | 08:37 | |
*** ttsiouts has joined #openstack-nova | 08:38 | |
*** ttsiouts has quit IRC | 08:42 | |
*** derekh has joined #openstack-nova | 08:45 | |
*** yaawang has quit IRC | 08:46 | |
*** yaawang has joined #openstack-nova | 08:46 | |
*** lee1 has joined #openstack-nova | 08:51 | |
*** lee1 is now known as lyarwood | 08:52 | |
*** k_mouza has quit IRC | 09:00 | |
*** k_mouza has joined #openstack-nova | 09:05 | |
*** ttsiouts has joined #openstack-nova | 09:27 | |
*** yaawang has quit IRC | 09:30 | |
*** yaawang has joined #openstack-nova | 09:31 | |
*** tkajinam has quit IRC | 09:59 | |
*** xek has quit IRC | 10:05 | |
*** dtantsur is now known as dtantsur|brb | 10:27 | |
*** Liang__ has quit IRC | 10:40 | |
stephenfin | bauzas: Can you take a punt at https://review.opendev.org/#/c/733827/ ? | 10:57 |
bauzas | stephenfin: will look this afternoon | 10:58 |
stephenfin | Thanks | 10:58 |
*** priteau has joined #openstack-nova | 11:02 | |
*** kevinz has quit IRC | 11:11 | |
*** markvoelker has joined #openstack-nova | 11:15 | |
*** markvoelker has quit IRC | 11:19 | |
*** mkrai has quit IRC | 11:26 | |
*** raildo has joined #openstack-nova | 11:28 | |
*** udesale_ has joined #openstack-nova | 11:28 | |
*** udesale has quit IRC | 11:31 | |
*** zhanglong has quit IRC | 11:32 | |
*** csatari has quit IRC | 11:53 | |
*** owalsh_ has joined #openstack-nova | 11:55 | |
*** csatari has joined #openstack-nova | 11:56 | |
*** rnoriega_ has quit IRC | 11:58 | |
*** owalsh has quit IRC | 11:58 | |
*** rnoriega- has joined #openstack-nova | 11:58 | |
*** sapd1 has quit IRC | 12:05 | |
*** sapd1 has joined #openstack-nova | 12:05 | |
*** k_mouza has quit IRC | 12:13 | |
*** k_mouza has joined #openstack-nova | 12:13 | |
*** breizhkoala has joined #openstack-nova | 12:15 | |
*** irclogbot_3 has quit IRC | 12:16 | |
*** irclogbot_0 has joined #openstack-nova | 12:18 | |
*** derekh has quit IRC | 12:28 | |
*** martinkennelly has quit IRC | 12:40 | |
*** dtantsur|brb is now known as dtantsur | 12:45 | |
*** xek has joined #openstack-nova | 12:46 | |
*** trident has quit IRC | 12:46 | |
*** derekh has joined #openstack-nova | 12:48 | |
*** zhanglong has joined #openstack-nova | 12:48 | |
*** trident has joined #openstack-nova | 12:49 | |
*** tbachman has quit IRC | 12:57 | |
*** tbachman has joined #openstack-nova | 12:58 | |
*** nweinber has joined #openstack-nova | 12:59 | |
*** xek has quit IRC | 13:01 | |
lseki | Hello folks, could you give some suggestions on how to address this bug? | 13:08 |
lseki | https://bugs.launchpad.net/cinder/+bug/1870367 "Fail to extend attached volume using generic NFS driver" | 13:08 |
openstack | Launchpad bug 1870367 in Cinder "Fail to extend attached volume using generic NFS driver" [High,In progress] - Assigned to Silvan Kaiser (2-silvan) | 13:08 |
lseki | in summary, when trying to resize a volume in-use, `qemu-img resize` command fails to get the write lock, because `qemu` process has locked the volume file upon VM start. | 13:08 |
lseki | This was discussed on Cinder PTG, but we didn't come up with a solution yet | 13:08 |
*** mriedem has joined #openstack-nova | 13:13 | |
lyarwood | lseki: you can use --force-share to workaround the locks but I'm not sure that it would be the best approach here tbh | 13:16 |
lyarwood | lseki: but then again we were essentially doing that prior to QEMU taking the locks | 13:17 |
lyarwood | lseki: but without quessing the disk on the compute side first that might be problematic | 13:18 |
gibi | lyarwood: welcome back! | 13:21 |
lyarwood | gibi: \o hey thanks, glad to be back finally :) | 13:21 |
*** ratailor has quit IRC | 13:21 | |
*** xek has joined #openstack-nova | 13:22 | |
*** yankcrime has quit IRC | 13:22 | |
*** jhesketh has quit IRC | 13:22 | |
*** jhesketh has joined #openstack-nova | 13:24 | |
gibi | :) | 13:24 |
*** yankcrime has joined #openstack-nova | 13:24 | |
*** psachin has quit IRC | 13:31 | |
*** xek has quit IRC | 13:33 | |
sean-k-mooney | lyarwood: we do quiese the disk for vm snapshots right | 13:33 |
sean-k-mooney | if we are doing a live snapshot via the qemu-guest agent? | 13:34 |
sean-k-mooney | we use the monitor to invoke freeze | 13:34 |
sean-k-mooney | could we do the same for volume snapshots? | 13:34 |
*** zhanglong has quit IRC | 13:34 | |
*** dklyle has quit IRC | 13:35 | |
lyarwood | sean-k-mooney: we do for snapshots, we could for extend as well I guess but I'm not entirely sure if we need to tbh | 13:36 |
lseki | lyarwood: in my machine (without openstack, just qemu-kvm), I managed to resize an attached disk with the command | 13:36 |
lseki | `sudo virsh qemu-monitor-command ubuntu18.04 --hmp "block_resize drive-virtio-disk1 2G"` | 13:36 |
sean-k-mooney | lseki: well that is having qemu do the resize | 13:37 |
sean-k-mooney | lseki: which s not normally how a volume resize would work | 13:37 |
sean-k-mooney | lseki: a volume resize for other driver would have the backend to the resize | 13:37 |
sean-k-mooney | lseki: i think that only works because qemu is the thing with the lock | 13:38 |
lyarwood | well, c-vol resizes the underlying device, n-cpu then resizes the host device on the compute and then we resize the device within QEMU | 13:38 |
sean-k-mooney | we could special case but that would fail for iscsi backend and proably ceph | 13:38 |
lseki | sean-k-mooney: hmm would it be possible to add a condition to do that only when the backend driver is qemu? | 13:39 |
sean-k-mooney | lyarwood: right but presumably the nfs driver cant resize the file because qemu has locked the file right | 13:39 |
lyarwood | the issue here is that we are asking qemu-img to resize the host device, in this case a file. | 13:39 |
lyarwood | yeah | 13:39 |
lyarwood | but I guess c-vol is actually calling this | 13:40 |
sean-k-mooney | lseki: you mean the backedn driver is nfs | 13:40 |
lseki | sean-k-mooney: oops, yes | 13:40 |
sean-k-mooney | lyarwood: yes becasue if it was not attached to a vm then it would have to do the resize | 13:40 |
lyarwood | I think we should be safe to add --force-share to the qemu-img resize call in c-vol tbh | 13:40 |
sean-k-mooney | lyarwood: will that also resize the filesystem | 13:41 |
lyarwood | sean-k-mooney: no | 13:41 |
sean-k-mooney | jsut the qcow/raw file | 13:41 |
lyarwood | right, virt-resize does both | 13:41 |
lyarwood | or it's up to the user | 13:41 |
lyarwood | once n-cpu has called QEMU to resize the device within the domain | 13:41 |
*** bhagyashris is now known as bhagyashris|afk | 13:42 | |
sean-k-mooney | well i know for a server resize we resize the filesystem automatically | 13:43 |
lyarwood | that's only for ephemeral disks where we know the format right? | 13:44 |
*** liuyulong has joined #openstack-nova | 13:50 | |
sean-k-mooney | yes | 13:53 |
sean-k-mooney | basically whatever libguestfs supports | 13:53 |
sean-k-mooney | if it does recognise the filesytem i think it jsut resizes the block device | 13:54 |
*** mkrai has joined #openstack-nova | 13:56 | |
*** mlavalle has joined #openstack-nova | 13:58 | |
*** Liang__ has joined #openstack-nova | 14:02 | |
*** Liang__ is now known as LiangFang | 14:02 | |
*** xek has joined #openstack-nova | 14:07 | |
lseki | lyarwood: your suggestion is to add `--force-share` to `qemu-img resize` command? | 14:11 |
lseki | https://github.com/openstack/cinder/blob/f74c533382ec256ca7dda41e8e451392d81e2944/cinder/image/image_utils.py#L353 | 14:11 |
lyarwood | lseki: yeah correct | 14:11 |
lseki | oh | 14:12 |
lseki | https://www.irccloud.com/pastebin/LBtS5n4l/ | 14:12 |
lyarwood | lseki: which version of QEMU are you using? | 14:13 |
lyarwood | lseki: I can't recall which version we require to use that switch as Nova already requires it on the computesd | 14:14 |
* lyarwood checks | 14:14 | |
sean-k-mooney | so we can set the trasport we use for cold migration with https://docs.openstack.org/nova/latest/configuration/config.html#libvirt.remote_filesystem_transport | 14:14 |
lseki | https://www.irccloud.com/pastebin/U58tnfou/ | 14:14 |
sean-k-mooney | do we have a way to choose the ssh user? | 14:14 |
sean-k-mooney | like we do for live migration | 14:14 |
lyarwood | lseki: https://www.irccloud.com/pastebin/U58tnfou/ - hmm 2.11 should have it, we dropped the version check once we hit that | 14:16 |
lyarwood | or was that 2.12 | 14:16 |
sean-k-mooney | looks like no... i guess ill just excange ssh keys | 14:16 |
lyarwood | ah no that's 2.10 | 14:17 |
lyarwood | lseki: yeah weird you should have that | 14:17 |
lyarwood | maybe it's missing from resize? | 14:17 |
lyarwood | yeah it is | 14:18 |
lyarwood | odd | 14:18 |
*** dave-mccowan has quit IRC | 14:22 | |
*** dave-mccowan has joined #openstack-nova | 14:25 | |
lseki | oh... seems that there's no force-resize param for `img_resize` https://github.com/qemu/qemu/blob/6bb228190ef0b45669d285114cf8a280c55f4b39/qemu-img.c#L3856_L4053 | 14:33 |
lseki | oops wrong branch | 14:34 |
lyarwood | yeah I don't really know what we could do in this case | 14:34 |
lseki | but it's not in the master branch as well https://github.com/qemu/qemu/blob/master/qemu-img.c#L3856_#L4053 | 14:35 |
lseki | 😢 | 14:35 |
lyarwood | yeah apologies, I assumed it was an available option across the subcommands but that isn't the case | 14:36 |
lyarwood | we can just truncate RAW files | 14:37 |
lyarwood | but these are qcow2 | 14:37 |
sean-k-mooney | we dont allow resize down of attached volumes right | 14:38 |
sean-k-mooney | that sound bad | 14:38 |
lyarwood | no I don't think so | 14:38 |
sean-k-mooney | so you just mean use the truncate command but not to shrink | 14:38 |
lyarwood | https://docs.openstack.org/api-ref/block-storage/v3/index.html?expanded=extend-a-volume-size-detail#extend-a-volume-size | 14:38 |
lyarwood | sean-k-mooney: yeah you can use truncate to grow files | 14:38 |
lyarwood | sean-k-mooney: but that wouldn't work in this case as it wouldn't update the qcow2 headers to use the extra space | 14:39 |
sean-k-mooney | ya wasnt sure if you ment the command or not | 14:39 |
sean-k-mooney | yes | 14:39 |
lyarwood | a hackaround would be to use swap_volume in n-cpu to switch to a larger file | 14:40 |
sean-k-mooney | lyarwood: so what we likely need to do is if the volume is attach have the backend not resize it and have nova via the qemu monitor command have qemu do the resize | 14:41 |
lyarwood | tbh using that approach for all backends might be nicer anyway now I think about it | 14:41 |
sean-k-mooney | so if volume is available then c-vol will do the resize else nova will just invoke qemu to do it | 14:41 |
sean-k-mooney | and we never call qemu-img for nfs backend | 14:41 |
lyarwood | block resize by QEMU isn't going to resize the file | 14:42 |
lyarwood | just as it isn't going to resize host devices for other backends AFAIK | 14:42 |
sean-k-mooney | so `sudo virsh qemu-monitor-command ubuntu18.04 --hmp "block_resize drive-virtio-disk1 2G"` | 14:43 |
sean-k-mooney | wont grow the file | 14:43 |
sean-k-mooney | lseki: didnt you say that worked | 14:43 |
lyarwood | I don't believe so | 14:43 |
sean-k-mooney | for qcow it does not need to make the file physically bigger | 14:43 |
sean-k-mooney | just update the headers | 14:43 |
sean-k-mooney | so that qemu can allocate it when needed | 14:44 |
sean-k-mooney | which is what we want. e.g. keep the file sparse | 14:44 |
lyarwood | hmmm is that enough? | 14:44 |
sean-k-mooney | im not sure but lseki could test with dd? | 14:45 |
lyarwood | I thought you had to at least grow the sparse file so it looks like it's 2G before you can update the qcow2 headers to be 2G | 14:45 |
sean-k-mooney | not sure but it sounds like something we should test | 14:46 |
lyarwood | yup | 14:46 |
lyarwood | brb | 14:46 |
sean-k-mooney | lseki: can you try that. grow you iamge to like 10G and then use dd to crate a 5G file in the vm | 14:47 |
*** dkehn has quit IRC | 14:47 | |
lseki | sean-k-mooney: lyarwood oops, I was using a raw file instead of qcow | 14:47 |
sean-k-mooney | if it had less then 2G before that would fail | 14:47 |
sean-k-mooney | lseki: oh in that case what the size of the file on disk after that command | 14:47 |
sean-k-mooney | did it grow it to 2G | 14:47 |
*** LiangFang has quit IRC | 14:48 | |
lseki | yes it did, and `lsblk` inside the vm also is updated to 2G | 14:48 |
sean-k-mooney | could you convert it over to a qcow boot a vm with the new image and then grow it to say 4G | 14:48 |
sean-k-mooney | using the same command on the new vm | 14:49 |
sean-k-mooney | lets see if it will do the right thing in that case | 14:49 |
*** nweinber has quit IRC | 14:49 | |
sean-k-mooney | if so i think we have a way to adresss this | 14:49 |
*** dklyle has joined #openstack-nova | 14:49 | |
*** Liang__ has joined #openstack-nova | 14:51 | |
lseki | let me try that... | 14:51 |
*** nweinber has joined #openstack-nova | 14:53 | |
*** links has quit IRC | 14:55 | |
*** suryasingh has joined #openstack-nova | 15:01 | |
lyarwood | sean-k-mooney: TIL I didn't think blockResize did that, given that we resized the file before I guess that was the case and something has changed? | 15:03 |
sean-k-mooney | from the name that is what i would expect ti to do | 15:04 |
sean-k-mooney | maybe not for host devices | 15:04 |
sean-k-mooney | but for files at least | 15:04 |
lyarwood | yeah it can't for host devices | 15:04 |
lyarwood | I might be mixing things up with blockRebase tbh | 15:05 |
*** dave-mccowan has quit IRC | 15:08 | |
*** dave-mccowan has joined #openstack-nova | 15:11 | |
*** _mlavalle_1 has joined #openstack-nova | 15:19 | |
*** mlavalle has quit IRC | 15:22 | |
*** factor has joined #openstack-nova | 15:32 | |
*** Liang__ has quit IRC | 15:33 | |
*** JamesBenson has joined #openstack-nova | 15:37 | |
lseki | sean-k-mooney: I downloaded a cirros image and booted a vm from it. I successfully extended the volume to 4G. | 15:40 |
lseki | https://www.irccloud.com/pastebin/QF9Dk7Wa/ | 15:41 |
lseki | within the vm: | 15:42 |
lseki | https://www.irccloud.com/pastebin/QJ8flBUZ/ | 15:42 |
*** mkrai has quit IRC | 15:42 | |
lseki | though it didn't work when the disk was attached using the default IDE bus | 15:43 |
lseki | https://www.irccloud.com/pastebin/pv6e5QOF/ | 15:43 |
lseki | so I had to specify virtio bus while booting the vm `--disk cirros-0.5.1-x86_64-disk.img,bus=virtio` | 15:44 |
openstackgerrit | Merged openstack/nova master: Correct reported system memory https://review.opendev.org/733827 | 15:47 |
openstackgerrit | Merged openstack/nova master: Extend is_ipv6_supported() to cover more error cases https://review.opendev.org/736167 | 15:47 |
stephenfin | bauzas: Thanks for that review. You'd probably also be interested in gibi's follow-up fix here https://review.opendev.org/#/c/737508/ | 15:50 |
bauzas | stephenfin: ack, thanks for helping me to go off some hardware discussion, my brain being fried ;) | 15:50 |
stephenfin | :P | 15:50 |
stephenfin | anytime, buddy | 15:51 |
*** hamalq has joined #openstack-nova | 15:57 | |
*** hamalq_ has joined #openstack-nova | 15:58 | |
bauzas | gibi: stephenfin: holding my +W on https://review.opendev.org/#/c/737508/3 just for saying I honestly feel we should document this | 15:59 |
bauzas | and not leave operators discovering it by themselves | 15:59 |
bauzas | but, a FUP for course | 15:59 |
*** hamalq has quit IRC | 16:02 | |
*** liuyulong has quit IRC | 16:05 | |
*** ttsiouts has quit IRC | 16:06 | |
*** ttsiouts has joined #openstack-nova | 16:07 | |
*** ttsiouts has quit IRC | 16:11 | |
*** dkehn has joined #openstack-nova | 16:11 | |
*** udesale_ has quit IRC | 16:12 | |
*** derekh has quit IRC | 16:15 | |
*** etp has quit IRC | 16:16 | |
*** etp has joined #openstack-nova | 16:19 | |
*** k_mouza has quit IRC | 16:19 | |
*** etp has quit IRC | 16:24 | |
stephenfin | bauzas: To be honest, I thought that was assumed and I can't find anywhere easy to slot it in :-\ | 16:25 |
*** efried has quit IRC | 16:28 | |
*** xek has quit IRC | 16:29 | |
bauzas | stephenfin: right, hence my main comment | 16:30 |
bauzas | anyway, you saw it, +Wing | 16:30 |
*** breizhkoala has quit IRC | 16:41 | |
*** etp has joined #openstack-nova | 16:44 | |
*** dtantsur is now known as dtantsur|afk | 16:44 | |
*** ociuhandu_ has joined #openstack-nova | 16:45 | |
*** ociuhandu has quit IRC | 16:49 | |
sean-k-mooney | while the libvirt driver could work on non linux hosts. it has been deployed on freebsd years ago that has never really been supported | 16:50 |
sean-k-mooney | we make assumtions about linux in the code to day so i doubt you could make it work on say window easily even if you wanted too | 16:50 |
*** factor has quit IRC | 16:51 | |
*** icarusfactor has joined #openstack-nova | 16:51 | |
*** ociuhandu_ has quit IRC | 16:52 | |
*** efried has joined #openstack-nova | 16:56 | |
lseki | lyarwood: oh, and the volume size started with 39M, but after doing some dd inside the vm it growed to 2G | 16:57 |
*** ociuhandu has joined #openstack-nova | 16:59 | |
sean-k-mooney | lseki: so the qcow stayed sparse until we actuly wrote data too it | 16:59 |
sean-k-mooney | which is what we want right | 16:59 |
lseki | yes | 16:59 |
sean-k-mooney | so to summerise 1, we should modify the cinder nfs backend to only extend voluem if its not attached to a vm, 2 when we are using nfs voluem in nova we should skip calling qemu-image and jsut do a block resize via the qemu monitor command | 17:00 |
sean-k-mooney | lyarwood: ^ does that make sense too you? | 17:01 |
sean-k-mooney | lseki: for the ide case did you use the correct name? | 17:04 |
sean-k-mooney | i mean it wont be drive-virtio-disk0 right | 17:04 |
sean-k-mooney | it would be something like drive-ide-disk0 | 17:04 |
lseki | sean-k-mooney: I tried the one shown by dumpxml, which is simply `disk` | 17:05 |
lseki | let me try with `drive-ide-disk0` | 17:05 |
sean-k-mooney | well its just disk for virtio as well | 17:06 |
sean-k-mooney | <disk type='file' device='disk'> | 17:06 |
sean-k-mooney | i think you are looking for the alias element | 17:06 |
sean-k-mooney | <alias name='virtio-disk0'/ | 17:06 |
*** ociuhandu has quit IRC | 17:07 | |
lseki | oh that's right, so I should use `drive-ide0-0-0` for ide | 17:09 |
lseki | yeah it works :-) | 17:09 |
sean-k-mooney | cool | 17:09 |
sean-k-mooney | so we can lookup the alais from the xml | 17:09 |
sean-k-mooney | i assume its jsut ide0-0-0 | 17:09 |
sean-k-mooney | and we need to prepend drive- | 17:10 |
*** ralonsoh has quit IRC | 17:10 | |
*** ralonsoh has joined #openstack-nova | 17:10 | |
lseki | yes | 17:11 |
sean-k-mooney | im not going to ask you to test ceph but it might be intersting to see if we could use this patteren for other drivers too and avoid the calll to qemu-img | 17:13 |
sean-k-mooney | that can be a step 3 | 17:13 |
sean-k-mooney | after 1 and 2 | 17:13 |
sean-k-mooney | whcih will fix your usecase | 17:13 |
*** jdillaman has quit IRC | 17:15 | |
*** corvus has quit IRC | 17:15 | |
*** bnemec has quit IRC | 17:15 | |
*** mvkr has quit IRC | 17:15 | |
*** ganso has quit IRC | 17:15 | |
*** andreykurilin has quit IRC | 17:15 | |
*** ericyoung has quit IRC | 17:15 | |
*** factor has joined #openstack-nova | 17:16 | |
*** icarusfactor has quit IRC | 17:16 | |
*** ganso has joined #openstack-nova | 17:18 | |
*** corvus has joined #openstack-nova | 17:18 | |
*** ericyoung has joined #openstack-nova | 17:18 | |
*** jdillaman has joined #openstack-nova | 17:18 | |
*** andreykurilin has joined #openstack-nova | 17:19 | |
lseki | so currently cinder nfs driver calls qemu-img resize to extend a volume, attached or not | 17:19 |
lseki | https://github.com/openstack/cinder/blob/master/cinder/volume/drivers/nfs.py#L380 | 17:19 |
lseki | https://github.com/openstack/cinder/blob/master/cinder/image/image_utils.py#L408 | 17:19 |
lseki | the step 1 is to stop calling qemu-img resize if the volume is attached | 17:19 |
*** mvkr has joined #openstack-nova | 17:19 | |
*** _gryf has joined #openstack-nova | 17:20 | |
*** bnemec has joined #openstack-nova | 17:21 | |
lseki | but regarding the step 2, I'm not familiar with nova code... is there some workflow we can modify to make it call qemu monitor command? | 17:22 |
sean-k-mooney | this might be in os-brick im not certin | 17:22 |
sean-k-mooney | lseki: stephenfin or lyarwood have looked at this more recently then i have | 17:22 |
sean-k-mooney | lseki: is there a bug for this | 17:23 |
sean-k-mooney | lseki: if so can you summerise this in a comment | 17:24 |
lseki | https://bugs.launchpad.net/cinder/+bug/1870367 | 17:24 |
openstack | Launchpad bug 1870367 in Cinder "Fail to extend attached volume using generic NFS driver" [High,In progress] - Assigned to Silvan Kaiser (2-silvan) | 17:24 |
lseki | yeah I'll add a comment there | 17:24 |
lyarwood | sean-k-mooney / lseki ; we already call blockResize in n-cpu | 17:25 |
sean-k-mooney | lyarwood: ok so we just need to not call qemu-img in cinder or nova when using nfs | 17:26 |
*** rnoriega- has quit IRC | 17:26 | |
*** huaqiang has quit IRC | 17:26 | |
*** johanssone has quit IRC | 17:26 | |
*** mtreinish has quit IRC | 17:26 | |
*** zzzeek has quit IRC | 17:26 | |
*** gryf has quit IRC | 17:26 | |
sean-k-mooney | and the volume is attached | 17:26 |
lyarwood | sean-k-mooney: we just need to remove the call in c-vol | 17:26 |
lyarwood | https://github.com/lyarwood/nova/blob/d4c857dfcb1ccfa5410de55671e69c722bbc990e/nova/virt/libvirt/driver.py#L2044-L2048 | 17:27 |
lyarwood | https://github.com/lyarwood/nova/blob/d4c857dfcb1ccfa5410de55671e69c722bbc990e/nova/virt/libvirt/guest.py#L811-L819 | 17:27 |
*** hongbin has joined #openstack-nova | 17:28 | |
*** irclogbot_0 has quit IRC | 17:28 | |
*** gyee has joined #openstack-nova | 17:29 | |
*** rnoriega- has joined #openstack-nova | 17:29 | |
*** huaqiang has joined #openstack-nova | 17:29 | |
*** johanssone has joined #openstack-nova | 17:29 | |
*** mtreinish has joined #openstack-nova | 17:29 | |
*** zzzeek has joined #openstack-nova | 17:29 | |
*** nightmare_unreal has quit IRC | 17:29 | |
*** irclogbot_2 has joined #openstack-nova | 17:30 | |
*** dkehn has quit IRC | 17:37 | |
*** hoonetorg has quit IRC | 17:40 | |
*** tesseract has quit IRC | 17:41 | |
*** hoonetorg has joined #openstack-nova | 17:52 | |
*** xek has joined #openstack-nova | 17:54 | |
*** damien_r has joined #openstack-nova | 17:55 | |
lseki | lyarwood / sean-k-mooney: is blockResize called always, no matter what c-vol did before? | 18:03 |
lseki | testing it in a stable/train devstack here... | 18:15 |
*** eharney has quit IRC | 18:16 | |
*** slaweq has quit IRC | 18:25 | |
lyarwood | lseki: yes | 18:27 |
lseki | oh no | 18:34 |
lseki | https://www.irccloud.com/pastebin/hmybxXhk/ | 18:34 |
*** dasp_ has quit IRC | 18:39 | |
*** jsuchome has quit IRC | 18:40 | |
*** dasp has joined #openstack-nova | 18:41 | |
*** _gryf is now known as gryf | 18:41 | |
*** hongbin has quit IRC | 18:44 | |
*** factor has quit IRC | 18:46 | |
*** factor has joined #openstack-nova | 18:46 | |
lseki | the driver being used is `LibvirtNFSVolumeDriver`, with parent `LibvirtBaseFileSystemVolumeDriver` and grandpa `LibvirtBaseVolumeDriver` | 18:49 |
lseki | none of them implement `extend_volume` :-( | 18:49 |
*** dklyle has quit IRC | 18:54 | |
lseki | so it stops here https://github.com/lyarwood/nova/blob/d4c857dfcb1ccfa5410de55671e69c722bbc990e/nova/virt/libvirt/driver.py#L2100 before reaching `_resize_attached_volume` | 18:54 |
*** dklyle has joined #openstack-nova | 19:02 | |
*** factor has quit IRC | 19:04 | |
*** factor has joined #openstack-nova | 19:04 | |
lseki | I implemented `LibvirtNFSVolumeDriver.extend_volume` that just returns `requested_size`, and then attached extend worked! | 19:05 |
lseki | 🎉 | 19:05 |
*** ociuhandu has joined #openstack-nova | 19:06 | |
lseki | I'll update the bug report and submit the patches for both cinder and nova | 19:06 |
lseki | lyarwood: sean-k-mooney thank you for helping me! | 19:07 |
*** factor has quit IRC | 19:10 | |
*** _mlavalle_1 has quit IRC | 19:10 | |
*** _mlavalle_1 has joined #openstack-nova | 19:15 | |
*** hongbin has joined #openstack-nova | 19:18 | |
*** yoctozepto7 has joined #openstack-nova | 19:37 | |
*** yoctozepto has quit IRC | 19:45 | |
*** yoctozepto7 is now known as yoctozepto | 19:45 | |
*** vishalmanchanda has quit IRC | 19:47 | |
*** ralonsoh has quit IRC | 19:50 | |
*** spatel has joined #openstack-nova | 19:55 | |
openstackgerrit | Merged openstack/nova master: Prevent libvirt driver starting on non Linux platform https://review.opendev.org/737508 | 19:59 |
*** eharney has joined #openstack-nova | 19:59 | |
*** hongbin has quit IRC | 20:06 | |
*** slaweq has joined #openstack-nova | 20:25 | |
*** spatel has quit IRC | 20:29 | |
*** spatel has joined #openstack-nova | 20:30 | |
*** spatel has quit IRC | 20:30 | |
*** maciejjozefczyk has quit IRC | 20:36 | |
*** nweinber has quit IRC | 20:53 | |
*** hongbin has joined #openstack-nova | 20:54 | |
*** ircuser-1 has quit IRC | 21:03 | |
*** slaweq has quit IRC | 21:19 | |
*** xek has quit IRC | 21:20 | |
*** priteau has quit IRC | 21:21 | |
*** factor has joined #openstack-nova | 21:29 | |
*** factor has quit IRC | 21:33 | |
*** factor has joined #openstack-nova | 21:33 | |
*** factor has quit IRC | 21:49 | |
*** factor has joined #openstack-nova | 21:50 | |
*** haleyb has joined #openstack-nova | 21:52 | |
openstackgerrit | Merged openstack/nova master: Limit the number of concurrent snapshots https://review.opendev.org/736169 | 21:56 |
*** gregwork has joined #openstack-nova | 22:09 | |
*** zhanglong has joined #openstack-nova | 22:22 | |
*** luksky has quit IRC | 22:29 | |
*** icarusfactor has joined #openstack-nova | 22:33 | |
*** factor has quit IRC | 22:36 | |
*** rcernin has joined #openstack-nova | 22:36 | |
*** tkajinam has joined #openstack-nova | 22:46 | |
*** rcernin has quit IRC | 22:47 | |
*** rcernin has joined #openstack-nova | 22:47 | |
*** JamesBenson has quit IRC | 22:47 | |
*** JamesBenson has joined #openstack-nova | 22:49 | |
*** zhanglong has quit IRC | 22:50 | |
*** zhanglong has joined #openstack-nova | 22:52 | |
*** mriedem has left #openstack-nova | 22:54 | |
*** JamesBenson has quit IRC | 22:54 | |
*** spatel has joined #openstack-nova | 22:58 | |
*** jmlowe has quit IRC | 23:06 | |
*** spatel has quit IRC | 23:07 | |
*** hoonetorg has quit IRC | 23:08 | |
*** _mlavalle_1 has quit IRC | 23:11 | |
*** hongbin has quit IRC | 23:11 | |
*** hoonetorg has joined #openstack-nova | 23:11 | |
*** tosky has quit IRC | 23:16 | |
*** hongbin has joined #openstack-nova | 23:16 | |
*** zhanglong has quit IRC | 23:17 | |
*** jmlowe has joined #openstack-nova | 23:28 | |
*** JamesBenson has joined #openstack-nova | 23:29 | |
*** JamesBenson has quit IRC | 23:34 | |
*** hamalq_ has quit IRC | 23:41 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!