| *** bhagyashris is now known as bhagyashris|rover | 04:08 | |
| opendevreview | melanie witt proposed openstack/nova master: Tell oslo.limit how to count nova resources https://review.opendev.org/c/openstack/nova/+/713301 | 05:06 |
|---|---|---|
| opendevreview | melanie witt proposed openstack/nova master: Enforce resource limits using oslo.limit https://review.opendev.org/c/openstack/nova/+/615180 | 05:06 |
| opendevreview | melanie witt proposed openstack/nova master: Add legacy limits and usage to placement unified limits https://review.opendev.org/c/openstack/nova/+/713498 | 05:06 |
| opendevreview | melanie witt proposed openstack/nova master: Update quota apis with keystone limits and usage https://review.opendev.org/c/openstack/nova/+/713499 | 05:06 |
| opendevreview | melanie witt proposed openstack/nova master: Add reno for unified limits https://review.opendev.org/c/openstack/nova/+/715271 | 05:06 |
| *** rpittau|afk is now known as rpittau | 07:30 | |
| bauzas | good morning Nova | 07:31 |
| songwenping_ | bauzas: morning, have you verified the vgpu cleanup? | 07:53 |
| bauzas | no, sorry was working on an escalation yesterday | 07:55 |
| bauzas | will do this morning | 07:55 |
| songwenping_ | cool, thanks. | 07:55 |
| bauzas | I'm also this morning on the middle of using a new laptop | 07:57 |
| bauzas | :) | 07:57 |
| songwenping_ | new devstack env? | 08:14 |
| gibi | good (late) morning | 09:05 |
| bauzas | gibi: hola, do we need to paperwork something in Launchpad for the yoga series in https://launchpad.net/nova ? | 13:33 |
| bauzas | hah, the yoga series is already created | 13:33 |
| bauzas | gibi: I guess you did it ? | 13:33 |
| bauzas | hah, found it | 13:34 |
| bauzas | " | 13:34 |
| bauzas | 13:34 | |
| bauzas | Create the launchpad series for the next cycle | 13:34 |
| bauzas | 13:34 | |
| bauzas | Set the development focus of the project to the new cycle series | 13:34 |
| bauzas | 13:34 | |
| bauzas | Set the status of the new series to “active development” | 13:34 |
| bauzas | 13:34 | |
| bauzas | Set the last series status to “current stable branch release” | 13:34 |
| bauzas | 13:34 | |
| bauzas | Set the previous to last series status to “supported” | 13:34 |
| bauzas | 13:34 | |
| bauzas | Repeat launchpad steps ^ for python-novaclient | 13:34 |
| bauzas | " | 13:34 |
| bauzas | https://docs.openstack.org/nova/latest/contributor/ptl-guide.html#immediately-after-rc | 13:34 |
| bauzas | yeah, so we have paperwork to do... | 13:34 |
| sean-k-mooney | bauzas: yes but it takes very little time to do | 13:35 |
| bauzas | lemme see how to do it | 13:35 |
| bauzas | mmm, I don't have rights for modifying https://launchpad.net/nova/yoga | 13:36 |
| bauzas | gibi: ^ | 13:36 |
| sean-k-mooney | i have already done it for yoga | 13:36 |
| sean-k-mooney | in os-vif | 13:36 |
| bauzas | hah I'm not in https://launchpad.net/~nova-drivers | 13:37 |
| sean-k-mooney | bauzas: if your in the maintainer or driver list i think you jsut get a register a serise button on the dashboard | 13:37 |
| bauzas | hence the impossibility to touch | 13:37 |
| sean-k-mooney | yep | 13:37 |
| bauzas | I'm curious how gibi made the changes for the xena series :) | 13:37 |
| bauzas | did he bribed someone ? | 13:38 |
| sean-k-mooney | he is on the list | 13:38 |
| sean-k-mooney | https://launchpad.net/~nova-drivers/+members | 13:38 |
| bauzas | oh, I missed it | 13:38 |
| sean-k-mooney | dansmith: melwitt can ye add bauzas to that list | 13:38 |
| sean-k-mooney | since ye are admins | 13:38 |
| dansmith | done | 13:39 |
| bauzas | sean-k-mooney: you should be in that list too as you're now the new release czar | 13:39 |
| bauzas | dansmith: ta | 13:39 |
| bauzas | this went quick | 13:39 |
| sean-k-mooney | am sure i can go create the series for you if you like | 13:40 |
| dansmith | careful with that, | 13:40 |
| dansmith | drivers used to have a lot of control over things, definitely a subset of core | 13:40 |
| sean-k-mooney | ya i know which is why i did not ask for it :) | 13:41 |
| dansmith | I should prune some of the long gone people | 13:41 |
| bauzas | ok, I made the changes for the nova side | 13:42 |
| sean-k-mooney | bauzas: its takes 30 seconds to create the series its really not hard to do | 13:42 |
| sean-k-mooney | cool | 13:42 |
| bauzas | 'll do the same for novaclient | 13:42 |
| bauzas | I guess placement is out of context | 13:42 |
| bauzas | someone already created the milestones correctly, great | 13:43 |
| sean-k-mooney | https://storyboard.openstack.org/#!/project/openstack/placement its on storyboard | 13:43 |
| sean-k-mooney | which i dont thikn has the concept of series | 13:43 |
| sean-k-mooney | so ya not much to do there | 13:43 |
| sean-k-mooney | same with os-traits and os-resouce-classes | 13:44 |
| sean-k-mooney | and osc-placment https://storyboard.openstack.org/#!/project/list?q=placement | 13:44 |
| sean-k-mooney | bauzas: so you shoudl just need to do it for nova and python-novaclient | 13:44 |
| * bauzas shudders about storyboard | 13:45 | |
| bauzas | sean-k-mooney: ya that's my expectation | 13:46 |
| bauzas | gibi: sean-k-mooney: since xena was the current branch in LP, I guess that's why https://bugs.launchpad.net/nova/+bug/1944111 messed up appearing | 13:47 |
| bauzas | I mean the backport | 13:47 |
| bauzas | wow | 13:50 |
| bauzas | python-novaclient was left alone in the dark https://launchpad.net/python-novaclient/ | 13:50 |
| sean-k-mooney | normally we just have it tracked on trun and then the backport but ya | 13:50 |
| bauzas | ok, fixed on the client too | 13:57 |
| gibi | bauzas: yes, I did the paperwork for yoga in LP. | 13:58 |
| bauzas | I flipped the series | 13:58 |
| bauzas | + I cleaned up novaclient which was needing some treatment | 13:58 |
| gibi | bauzas: thanks | 14:00 |
| * gibi is pulled to a downstream escalation | 14:00 | |
| bauzas | no worries, I had this too :) | 14:00 |
| sean-k-mooney | bauzas: normally we set the current development focus to trunk | 14:07 |
| sean-k-mooney | and only use yoga after its released for backporting | 14:07 |
| bauzas | sean-k-mooney: that's not what the PTL guide says | 14:07 |
| bauzas | https://docs.openstack.org/nova/latest/contributor/ptl-guide.html#immediately-after-rc | 14:08 |
| bauzas | "Set the development focus of the project to the new cycle series" | 14:08 |
| sean-k-mooney | that what we had previously doen or evey open bug on mastere would have to be taked as yoga | 14:08 |
| bauzas | I can ask the release team to confirm | 14:08 |
| sean-k-mooney | it might work either way if you dont have a trunk seriese | 14:08 |
| sean-k-mooney | ya nova and neutron dont have trunk | 14:09 |
| sean-k-mooney | os-vif does and we never have to update it just add the series | 14:09 |
| sean-k-mooney | honestly its fine either way | 14:09 |
| bauzas | sean-k-mooney: we do have a trunk series | 14:09 |
| bauzas | https://launchpad.net/nova/+series | 14:09 |
| bauzas | but it became obsolete | 14:10 |
| sean-k-mooney | yes | 14:10 |
| bauzas | looks to me we no longer need it | 14:10 |
| bauzas | sean-k-mooney: guess what ? I'll stick with the yoga series :p | 14:11 |
| sean-k-mooney | hehe thats fine by me | 14:12 |
| sean-k-mooney | it proably makes working with blueprints simpler anyway | 14:12 |
| gibi | bauzas: yepp, I always followed the guide and it worked for me to set the ongogin cycle as current release | 14:20 |
| bauzas | ack | 14:22 |
| * bauzas disappears for taxi driving | 14:22 | |
| * gibi goes back to digging logs to find the root of a race | 14:24 | |
| bauzas | gibi: good luck with finding a race | 14:57 |
| bauzas | hint : use GMR maybe | 14:57 |
| *** rpittau is now known as rpittau|afk | 16:02 | |
| opendevreview | Lee Yarwood proposed openstack/nova master: WIP compute: Update volume_id within connection_info during swap_volume https://review.opendev.org/c/openstack/nova/+/807025 | 17:40 |
| opendevreview | Lee Yarwood proposed openstack/nova master: Add regression test for bug #1943431 https://review.opendev.org/c/openstack/nova/+/810755 | 17:40 |
| melwitt | dansmith: wondered if you are familiar with errors like this in the nova-ceph-multistore job? "rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'nova-resize' from b'e261ad81-e30f-4ac7-a22c-1e4fd2b87db5_disk')" https://zuul.opendev.org/t/openstack/build/b37b95d96d6a4ae0a6025e92b515cf80/log/controller/logs/screen-n-cpu.txt#40935 | 17:54 |
| dansmith | nope, but I'd go looking for ceph errors I think | 17:55 |
| dansmith | that's in code that is libvirt and rbd-specific AFAIK, so that's a ceph readonlyness, not a glance one I think | 17:56 |
| melwitt | ack | 17:58 |
| gibi | melwitt: we have a tracking bug for that error https://bugs.launchpad.net/nova/+bug/1932043 | 18:02 |
| gibi | but I have no clue what is causing it | 18:03 |
| melwitt | thanks gibi | 18:03 |
| opendevreview | Balazs Gibizer proposed openstack/nova master: Reproduce bug 1944759 https://review.opendev.org/c/openstack/nova/+/810763 | 18:14 |
| gibi | bauzas: that was the race ^^ :) | 18:37 |
| lyarwood | kashyap: https://zuul.opendev.org/t/openstack/build/0f9c492eb1f84c1fbde643a94896c878/log/controller/logs/screen-n-cpu.txt?severity=4#24297 - for the morning, can you take a look at this? I'll also ask in #virt. I'm seeing it on centos-8 stream CI runs after a while and instance creation starts failing. Doesn't appear to be due to memory pressure but I might be missing something. | 19:23 |
| ade_lee | lyarwood, ping - hey - how familiar are you with the cryptsetup? | 20:57 |
| lyarwood | ade_lee: yeah I know my way around, is this about test failures? | 20:58 |
| ade_lee | lyarwood, specifically, I have a tempest test that is failing under fips | 20:58 |
| ade_lee | yup | 20:58 |
| ade_lee | https://zuul.opendev.org/t/openstack/build/86cd01338d4a47d1854776b52d696ec9/log/controller/logs/screen-n-cpu.txt#58389 | 20:58 |
| ade_lee | it seems the os-brick is calling cryptsetup here which is failing because cryptsetup is using plain encryption and that uses ripemd160 by default -- which is invalid under fips | 20:59 |
| lyarwood | ade_lee: tbh plain cryptsetup encryption has been deprecated for a while now | 21:00 |
| lyarwood | ade_lee: so in terms of getting it to work here with FIPS I'm not entirely sure it's worth the effort | 21:00 |
| ade_lee | lyarwood, ack - thats what I was thinking too -- wanted to confirm that we just wanted to skip the test | 21:01 |
| lyarwood | https://github.com/openstack/os-brick/blob/4f63dd045ca07f66003d1ccbbb19423ee91cf926/os_brick/encryptors/cryptsetup.py#L137-L145 | 21:01 |
| lyarwood | the only reason we haven't removed it yet is because of the forced retype in cinder | 21:01 |
| lyarwood | and all of the fun that brings to the table | 21:02 |
| ade_lee | yup - I was just reading your note before :) | 21:02 |
| * lyarwood should really stop listing releases in TODOs lol | 21:02 | |
| ade_lee | ok -- so then this is a caveat we'll need to call out in case someone is updating their system to use fips | 21:03 |
| ade_lee | if you have any old volumes , you need to retype them | 21:03 |
| lyarwood | ack yeah | 21:04 |
| ade_lee | lyarwood, what about this then -- https://zuul.opendev.org/t/openstack/build/fdf2ddc92ae64021a1386b027c7eebcf/log/controller/logs/screen-c-vol.txt#16290 | 21:05 |
| opendevreview | Lee Yarwood proposed openstack/nova master: Add regression test for bug #1943431 https://review.opendev.org/c/openstack/nova/+/810755 | 21:06 |
| opendevreview | Lee Yarwood proposed openstack/nova master: compute: Update volume_id within connection_info during swap_volume https://review.opendev.org/c/openstack/nova/+/807025 | 21:06 |
| opendevreview | Lee Yarwood proposed openstack/nova master: fup: Move _wait_for_volume_{attach,detach} to os-volume_attachments https://review.opendev.org/c/openstack/nova/+/810775 | 21:06 |
| opendevreview | Lee Yarwood proposed openstack/nova master: fup: Refactor and simplify Cinder fixture GET volume mock https://review.opendev.org/c/openstack/nova/+/810776 | 21:06 |
| lyarwood | ade_lee: you can ignore that | 21:07 |
| ade_lee | lyarwood, eh? isn't it causing the test to fail? | 21:07 |
| lyarwood | ade_lee: That's just an initial check of the format of the device, if it's not LUKS we reformat. | 21:07 |
| lyarwood | it's not failing because of that | 21:08 |
| lyarwood | trace req-e52cdd22-a649-4134-9a83-75b41fc5f2d3 | 21:08 |
| lyarwood | the request continues, it's just poor logging from os-brick | 21:08 |
| ade_lee | lyarwood, seems like the cryptsetup isLuks is failing coz of "Running in FIPS mode.\nCommand failed with code -1 (wrong or missing parameters)." | 21:09 |
| ade_lee | lyarwood, not sure if thats because its not a luks device and we need to reformat or if the command simply wont work under fips | 21:11 |
| lyarwood | $ sudo cryptsetup isLuks --verbose /dev/vda | 21:12 |
| lyarwood | Command failed with code -1 (wrong or missing parameters). | 21:12 |
| lyarwood | Yeah the second part is what we see for unencrypted disks | 21:12 |
| lyarwood | the rest of the flow completes | 21:13 |
| lyarwood | there's another error when trying to use multipathd but again that looks like a poorly logged issue in os-brick and nothing to do with fips | 21:14 |
| lyarwood | Sep 08 17:16:49.575982 centos-8-stream-rax-dfw-0026368401 cinder-volume[109619]: INFO cinder.volume.manager [None req-e52cdd22-a649-4134-9a83-75b41fc5f2d3 tempest-TestEncryptedCinderVolumes-1784657899 None] Created volume successfully. | 21:14 |
| lyarwood | but that said | 21:16 |
| lyarwood | 2021-09-08 17:21:22,863 117508 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/NoyUrXJvjHTTbNBDCCkifIsv) | 21:16 |
| lyarwood | ^ that's dumped when we fail the test | 21:16 |
| lyarwood | so the guestOS didn't boot | 21:16 |
| lyarwood | ade_lee: Yeah this is weird, the volume creation looks fine but there's nothing being logged to the console of the instance | 21:22 |
| lyarwood | ade_lee: You might want to ask the Cinder folks to look at this tbh | 21:23 |
| lyarwood | from a Nova POV the instance boots correctly so the disk is at least currently encrypted with the expected passphrase etc | 21:23 |
| lyarwood | correctly* | 21:23 |
| ade_lee | lyarwood, ack thanks for looking. it is weird. | 21:24 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!