Wednesday, 2020-08-19

*** fyx has quit IRC00:03
*** fyx has joined #openstack-nova00:03
*** brinzhang0 has joined #openstack-nova00:09
*** tetsuro has joined #openstack-nova00:09
*** brinzhang_ has quit IRC00:12
*** markmcclain has quit IRC00:13
*** prometheanfire has left #openstack-nova00:14
*** markmcclain has joined #openstack-nova00:15
*** breizhkoala has quit IRC00:21
*** markmcclain has quit IRC00:24
*** tbachman has quit IRC00:27
*** songwenping__ has joined #openstack-nova00:34
*** songwenping_ has quit IRC00:37
*** slaweq has joined #openstack-nova00:39
*** slaweq has quit IRC00:45
*** slaweq has joined #openstack-nova00:46
*** brinzhang0 has quit IRC00:51
*** zhanglong has joined #openstack-nova00:52
*** slaweq has quit IRC00:53
*** tetsuro_ has joined #openstack-nova00:54
*** tetsuro has quit IRC00:58
*** slaweq has joined #openstack-nova01:02
*** songwenping_ has joined #openstack-nova01:04
*** slaweq has quit IRC01:07
*** songwenping__ has quit IRC01:07
*** slaweq has joined #openstack-nova01:15
*** songwenping__ has joined #openstack-nova01:18
*** slaweq has quit IRC01:20
*** songwenping_ has quit IRC01:21
*** slaweq has joined #openstack-nova01:26
*** slaweq has quit IRC01:31
*** slaweq has joined #openstack-nova01:45
*** tetsuro_ has quit IRC01:47
*** tetsuro has joined #openstack-nova01:48
*** tetsuro has quit IRC01:48
*** songwenping_ has joined #openstack-nova01:48
*** slaweq has quit IRC01:49
*** songwenping__ has quit IRC01:52
*** songwenping_ has quit IRC01:56
*** songwenping_ has joined #openstack-nova01:57
*** ociuhandu has joined #openstack-nova02:01
*** bbowen__ has joined #openstack-nova02:02
*** pots has quit IRC02:03
*** pots has joined #openstack-nova02:03
*** devfaz has quit IRC02:03
*** devfaz has joined #openstack-nova02:04
*** bbowen_ has quit IRC02:05
*** zzzeek has quit IRC02:05
*** mgoddard has quit IRC02:05
*** smcginnis has quit IRC02:05
*** gryf has quit IRC02:05
*** purplerbot has quit IRC02:06
*** benj_ has quit IRC02:06
*** ociuhandu has quit IRC02:06
*** smcginnis has joined #openstack-nova02:06
*** benj_ has joined #openstack-nova02:07
*** zzzeek has joined #openstack-nova02:11
*** slaweq has joined #openstack-nova02:12
*** mgoddard has joined #openstack-nova02:13
*** slaweq has quit IRC02:19
*** rcernin has quit IRC02:21
*** gryf has joined #openstack-nova02:22
*** tetsuro has joined #openstack-nova02:42
*** dave-mccowan has quit IRC02:44
*** slaweq has joined #openstack-nova02:46
*** slaweq has quit IRC02:51
*** slaweq has joined #openstack-nova02:54
*** slaweq has quit IRC02:58
*** rcernin has joined #openstack-nova02:59
*** slaweq has joined #openstack-nova03:00
*** slaweq has quit IRC03:04
*** slaweq has joined #openstack-nova03:21
*** slaweq has quit IRC03:25
*** vishalmanchanda has joined #openstack-nova03:30
*** psachin has joined #openstack-nova03:37
*** mkrai has joined #openstack-nova03:41
*** tetsuro_ has joined #openstack-nova03:47
*** slaweq has joined #openstack-nova03:50
*** tetsuro has quit IRC03:50
*** suryasingh has joined #openstack-nova03:51
*** slaweq has quit IRC04:01
*** zhanglong has quit IRC04:07
*** rcernin has quit IRC04:14
*** rcernin has joined #openstack-nova04:21
*** tetsuro has joined #openstack-nova04:24
*** tetsuro_ has quit IRC04:27
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-nova04:33
*** rcernin has quit IRC04:37
*** ratailor has joined #openstack-nova04:42
*** rcernin has joined #openstack-nova04:46
*** zhanglong has joined #openstack-nova05:17
*** kaisers has quit IRC05:17
*** gyee has quit IRC05:20
*** mvorwerk has joined #openstack-nova05:34
*** kaisers has joined #openstack-nova05:34
*** mvorwerk_ has joined #openstack-nova05:39
*** mvorwerk has quit IRC05:40
*** brinzhang has joined #openstack-nova05:42
*** links has joined #openstack-nova05:49
*** jmlowe has quit IRC05:50
*** tetsuro has quit IRC05:57
openstackgerritMamduh proposed openstack/os-vif master: Fix - os-vif fails to get the correct UpLink Representor  https://review.opendev.org/74683606:00
*** manuvakery has joined #openstack-nova06:01
openstackgerritMamduh proposed openstack/os-vif master: Refactor code of linux_net to more cleaner and increase performace  https://review.opendev.org/74667306:07
openstackgerritMamduh proposed openstack/os-vif master: Fix - os-vif fails to get the correct UpLink Representor  https://review.opendev.org/74589506:24
*** sapd1 has joined #openstack-nova06:25
*** jmlowe has joined #openstack-nova06:27
*** zhanglong has quit IRC06:29
*** happyhemant has joined #openstack-nova06:42
*** dklyle has quit IRC06:46
*** lpetrut has joined #openstack-nova06:51
*** brinzhang_ has joined #openstack-nova06:56
*** brinzhang has quit IRC07:00
*** mkrai has quit IRC07:13
*** mkrai has joined #openstack-nova07:13
*** tesseract has joined #openstack-nova07:14
*** slaweq has joined #openstack-nova07:14
*** damien_r has joined #openstack-nova07:17
*** belmoreira has joined #openstack-nova07:19
*** mkrai has quit IRC07:31
*** nightmare_unreal has joined #openstack-nova07:47
*** xinranwang__ has joined #openstack-nova07:55
*** kleini has joined #openstack-nova07:57
*** songwenping_ has quit IRC08:00
*** breizhkoala has joined #openstack-nova08:01
*** xek has joined #openstack-nova08:07
lyarwoodgmann: with the switch to focal, are we dropping support for bionic?08:11
*** dtantsur|afk is now known as dtantsur08:16
*** Yumeng has joined #openstack-nova08:17
*** belmoreira has quit IRC08:21
*** mkrai has joined #openstack-nova08:23
*** slaweq has quit IRC08:25
*** tosky has joined #openstack-nova08:28
*** martinkennelly has joined #openstack-nova08:29
*** mkrai has quit IRC08:31
*** mkrai_ has joined #openstack-nova08:32
*** ociuhandu has joined #openstack-nova08:34
stephenfinlyarwood++ Ta for reviewing those six patches by the way. I'm sure Takashi-san appreciates :)08:35
stephenfin*the reviews08:35
*** mkrai_ has quit IRC08:55
*** mkrai has joined #openstack-nova08:55
lyarwoodstephenfin: np08:59
*** k_mouza has joined #openstack-nova09:14
*** sapd1 has quit IRC09:23
*** ratailor has quit IRC09:27
*** ratailor_ has joined #openstack-nova09:27
*** artom has quit IRC09:27
*** slaweq has joined #openstack-nova09:29
*** martinkennelly has quit IRC09:33
*** mkrai has quit IRC09:39
*** mkrai_ has joined #openstack-nova09:39
*** rcernin has quit IRC09:43
*** martinkennelly has joined #openstack-nova09:45
*** martinkennelly has quit IRC09:48
*** jraju__ has joined #openstack-nova09:49
*** rcernin has joined #openstack-nova09:49
*** links has quit IRC09:49
*** Yumeng has quit IRC09:51
*** mkrai_ has quit IRC09:54
*** mkrai__ has joined #openstack-nova09:54
openstackgerritStephen Finucane proposed openstack/os-vif master: mypy: Add type annotations  https://review.opendev.org/74516209:56
openstackgerritStephen Finucane proposed openstack/os-vif master: mypy: Extend type annotations to 'vif_plug_noop'  https://review.opendev.org/74516309:56
openstackgerritStephen Finucane proposed openstack/os-vif master: windows: Add missing return  https://review.opendev.org/74687009:56
*** artom has joined #openstack-nova10:02
*** martinkennelly has joined #openstack-nova10:05
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Log exception when unable to import rbd  https://review.opendev.org/74687310:05
stephenfinlyarwood: https://review.opendev.org/#/c/734734/ might be of interest10:08
* lyarwood clicks10:09
lyarwoodstephenfin: reviewed, issue with the test but agree with blocking that in the API10:19
*** rcernin has quit IRC10:30
lyarwoodstephenfin: https://review.opendev.org/#/c/574301/ - Can you take a look at my notes/question in this, tl;dr we end up relying on [libvirt] specific configurables within nova.image.glance *if* the default ceph config doesn't provide access to the RBD pool hosting glance images.10:33
lyarwoodstephenfin: I'm fine addressing that in FUPs in the future by introducing [glance] specific configurables for this10:33
stephenfinsure10:34
lyarwoodstephenfin: but wanted other cores to agree with that approach before merging this10:34
lyarwoodstephenfin: kk thanks10:34
*** rcernin has joined #openstack-nova10:34
* lyarwood looks at the DNM job failure quickly10:35
*** mkrai__ has quit IRC10:36
lyarwoodah right cinder volumes10:36
openstackgerritLee Yarwood proposed openstack/nova master: DNM zuul: Enable [glance]/allowed_direct_url_schemes within nova-ceph-multistore  https://review.opendev.org/74322010:38
stephenfinlyarwood: yup, agreed with not using libvirt-specific stuff in a generic place. Left my comments on the patch10:47
*** rcernin has quit IRC10:48
*** rcernin has joined #openstack-nova10:52
*** rcernin has quit IRC11:07
*** sapd1 has joined #openstack-nova11:09
sean-k-mooneystephenfin: wehn you write c/c++ do you put the { on a new line after the funtion signiture followed by another new line before starting the body11:12
stephenfinPython isn't C11:13
stephenfinand I haven't written a lot of C in quite some time :(11:13
sean-k-mooneyi know but you are formating things like peopel that do that. i have all been in the  void myfunc(int arg) { camp or "auto myfunc(int arg) -> void {" where the code base is following almost always auto11:15
toskysean-k-mooney: if you change existing code, follow that style; there are different styles around11:15
sean-k-mooneytosky: yes i do11:16
toskytl;dr there is no correct answer :)11:16
sean-k-mooneywell stephenfin is pushing to change the styple of every function in os-vif to a new one which i dislike11:16
sean-k-mooneybut im still thinking about it11:16
sean-k-mooneyit just reminds me of a c codeing style i always hateded11:17
stephenfinI'll win you over eventually :P11:17
sean-k-mooneyi was just wondering if that was the style stephenfin was familar with11:17
stephenfinIn other news, I got the live migration with SR-IOV test working \o/11:18
sean-k-mooneywhich woudl explain his perfernce11:18
sean-k-mooneystephenfin: awsome11:18
sean-k-mooneyi tought we had some limited functional test before but maybe that was numa11:18
stephenfinNUMA, yeah11:18
stephenfinartom wrote them11:18
sean-k-mooneycool11:18
stephenfinbut no other live migration in nova.tests.functional.libvirt11:19
sean-k-mooneyya there were a few gaps which i guess you have not finished11:19
sean-k-mooneyin the neutron fixture as well as pci code?11:19
stephenfinthe gaps were in mocking11:20
sean-k-mooneyalthoguh i think we more or less had covered the pci stuff with numa11:20
sean-k-mooneyyes11:20
sean-k-mooneythat is what i ment11:20
stephenfinwith the neutron fixture mostly, yeah11:20
stephenfinwe had no SR-IOV with neutron coverage11:20
sean-k-mooneycorrect11:20
sean-k-mooneythat is why i did not add the functional tests in the first plance11:20
sean-k-mooneyit was trying to get it laned befor m3 and it then got pushed to early train11:21
*** rcernin has joined #openstack-nova11:21
sean-k-mooneyanyway got a link i can review11:21
stephenfinjust touching up the last few bits, making sure stuff passes11:24
sean-k-mooneywe dont have a good way to simultate different config right i know i did an example that everyone hated11:25
sean-k-mooneybut can we easily simulate different hardware toplogies on idfferent nodes11:26
sean-k-mooneywe would just need different pci info objects right11:26
stephenfinyup, exactly11:26
sean-k-mooneyi was wondering how easy it would be to create a repoducer for https://review.opendev.org/#/c/738432/311:27
*** belmoreira has joined #openstack-nova11:27
sean-k-mooneyi feel like it will be a little tricky as i dont think we mock the eth device lookup but it also might be simipale if that all i have to mock11:29
sean-k-mooneywe just need the netdev names to be different on each host which i think we can do with mocks11:29
stephenfinthat's the main reason for doing these tests11:30
stephenfinI haven't got a test case for that yet though11:30
stephenfinbaby steps and all that11:30
*** k_mouza has quit IRC11:30
sean-k-mooneyi know how that bug happens i repoduced it on my local setup and the v1 patch fixed it11:30
sean-k-mooneyi should proably test v311:30
*** raildo has joined #openstack-nova11:39
*** sapd1 has quit IRC11:43
*** _erlon_ has joined #openstack-nova11:44
openstackgerritMerged openstack/os-vif master: update tox envs and support pdf docs  https://review.opendev.org/72803712:09
openstackgerritLee Yarwood proposed openstack/nova master: Add ability to download Glance images into the libvirt image cache via RBD  https://review.opendev.org/57430112:21
openstackgerritLee Yarwood proposed openstack/nova master: rbd: Move rbd_utils out of libvirt driver under nova.storage  https://review.opendev.org/74690412:21
stephenfinlyarwood: I know you've started that already, but does this rbd direct download scheme make sense for other virt drivers?12:28
stephenfini.e. did you give thought to my suggestion on making this virt driver-configurable?12:29
stephenfinsean-k-mooney: what's the expected behavior rn if you try to live migrate an instance with PCI devices attached?12:29
sean-k-mooneyvia an alias12:30
stephenfinyes12:30
sean-k-mooneyit should be rejected in the conductor12:30
openstackgerritHao Sun proposed openstack/nova master: Add checks for volume status when rebuilding  https://review.opendev.org/73473412:30
stephenfinHmm, I'm seeing the request request fail with NoValidHost12:30
sean-k-mooneyyep12:30
sean-k-mooneywell let me check12:30
stephenfinoh, so it's not validated at the API layer12:30
sean-k-mooneyi think that could happen12:30
stephenfin?12:30
sean-k-mooneyi dont think so12:31
sean-k-mooneyhttps://github.com/openstack/nova/blob/master/nova/conductor/tasks/live_migrate.py#L229-L26412:31
lyarwoodstephenfin: yeah it is possible to do this in other virt drivers12:31
sean-k-mooneywe dont know at the api if the hosts are new enough12:31
sean-k-mooneylyarwood: actully its not12:31
lyarwoodyeah it is12:31
sean-k-mooneylyarwood: it would be possible to do it in other deivers12:32
sean-k-mooneybut you cant live migrate with pci device period12:32
lyarwoodsean-k-mooney: I'm replying to stephenfin from earlier about rbd imports12:32
sean-k-mooneythe pci-sig sriov spec does not provide a fasicalty for it12:32
lyarwoodsean-k-mooney: not whatever you're talking about now12:32
sean-k-mooneyoh :)12:32
lyarwood:D12:32
sean-k-mooneyok ignore me then12:32
stephenfinwe always do 0:)12:32
lyarwoodoh look it's princess eugenie12:33
sean-k-mooneystephenfin: anyway  _check_can_migrate_pci is the only check we do and thats in the conductor12:33
lyarwoodhttps://i.pinimg.com/originals/c6/42/73/c64273010126b4ca904a776dc7a079e7.jpg <- context sorry that was a very British joke12:34
*** k_mouza has joined #openstack-nova12:34
stephenfinheh12:34
sean-k-mooneysilly hats are silly12:34
sean-k-mooneystephenfin: you could add a check for pci aliase safely in the api12:35
*** purplerbot has joined #openstack-nova12:35
sean-k-mooneystephenfin: we currently do the check in this loop after schduling https://github.com/openstack/nova/blob/cff7382fb3de4eef7aeddc34b6ae3409cbe50ea0/nova/conductor/tasks/live_migrate.py#L523-L56712:36
sean-k-mooneywhich eliminates all the hosts and results in a no valid hosts i guess12:36
*** mvorwerk_ has quit IRC12:37
*** dave-mccowan has joined #openstack-nova12:38
*** mvorwerk has joined #openstack-nova12:38
sean-k-mooneyeventually _check_not_over_max_retries fires a MaxRetriesExceeded exception which gets translated to no valid host12:38
*** rcernin has quit IRC12:46
*** rcernin has joined #openstack-nova12:48
*** mkrai has joined #openstack-nova12:52
*** jraju__ has quit IRC12:59
*** nweinber has joined #openstack-nova12:59
*** k_mouza has quit IRC12:59
*** k_mouza has joined #openstack-nova13:05
*** ratailor_ has quit IRC13:19
openstackgerritHao Sun proposed openstack/nova master: Add checks for volume status when rebuilding  https://review.opendev.org/73473413:21
gmannlyarwood: Bionic will not be tested by default any more so we can say it is not tested so might work or might not. devstack drop the support (remove from supported distro list ) in next cycle from when we upgrade the distro so W cycle will be to drop the Bionic support in devstack.13:24
*** mkrai has quit IRC13:27
sean-k-mooneyfor vitoria we need it since we need it for grenade?13:28
lyarwoodgmann: kk, so for Nova we'd only bump our MIN_LIBVIRT_VERSION to the focal version in W13:28
sean-k-mooneybut form W on it will be 20.04 on both sides right13:28
sean-k-mooneylyarwood: i think kasyap has a workflow for this. when ever i have tried to change it i have got shouted at but apparently he is blessed13:29
sean-k-mooneylyarwood: are you thinkihng of bumping the min version to 613:30
gmannsean-k-mooney: yes, in V it will be Bionic->bionic upgrade testing and in W Focal->Focal13:30
sean-k-mooneygmann: yep because we dont do distro upgrades in grenade so we need to support bionic for one release longer13:30
gmannlyarwood: if no compatible issue then it is fine to bump in W which give upgrade compatibility also13:31
sean-k-mooneyby the way that is not a suggestion to start doing disto upgrade in grenade :)13:31
*** priteau has joined #openstack-nova13:31
lyarwoodsean-k-mooney: yeah, would be nice to move to >= 6.0.0 etc in W13:34
lyarwoodgmann: yeah there shouldn't be any issues moving to 6.0.0 in W assuming we also drop support for el7 distros13:35
gmannok13:35
sean-k-mooneyi think we need to bump https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L228 so to 613:35
*** nweinber has quit IRC13:35
aarentsHi there, lyarwood FYI, I resummit with the missing tempest config : https://review.opendev.org/#/c/743708/ thks!13:36
sean-k-mooneylyarwood: sorry https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L23513:36
*** nweinber has joined #openstack-nova13:37
lyarwoodaarents: looking13:38
sean-k-mooneyhttps://github.com/openstack/nova/commit/1b76c0f72ee1c1175a089b83a41e4ada9457082013:38
sean-k-mooneyso we should be moving to 5.0.0 in v ithink based on this13:38
sean-k-mooneywe bumped NEXT_MIN_LIBVIRT_VERSION in ussuri13:39
sean-k-mooneyto 5.0.013:39
sean-k-mooneylyarwood: we need a similar patch in V for W13:39
sean-k-mooneylooking at https://wiki.openstack.org/wiki/LibvirtDistroSupportMatrix and https://repology.org/project/libvirt/versions13:42
sean-k-mooney6.0.0 should be ok for W13:42
sean-k-mooneythe only really concern i see would be debian buster(10) has 5.0.0 but bullseye(11) has 6.0.013:43
*** manuvakery has quit IRC13:48
*** dklyle has joined #openstack-nova13:50
lyarwoodsean-k-mooney: yeah doesn't look like bullseye actually has a confirmed release date13:52
*** seba has quit IRC13:52
lyarwoodsean-k-mooney: still raising NEXT_MIN_LIBVIRT_VERSION in V is still correct13:52
* lyarwood writes up a patch13:52
sean-k-mooneylyarwood: yes raising next min is correct13:52
sean-k-mooneyyou can also technicaly bump the min version to 5.0.013:52
sean-k-mooneywe have 5.4 from ubuntu cloud archive on bionic13:53
sean-k-mooneylyarwood: actully we have 6.0.013:54
sean-k-mooneyin the ussuri repos13:54
sean-k-mooneyhttp://ubuntu-cloud.archive.canonical.com/ubuntu/dists/bionic-proposed/ussuri/main/binary-amd64/Packages13:54
lyarwoodwe do?13:54
lyarwoodah13:54
sean-k-mooneyyep13:54
sean-k-mooneyits in both proposed and updates repos13:55
sean-k-mooneyhttp://ubuntu-cloud.archive.canonical.com/ubuntu/dists/bionic-updates/ussuri/main/binary-amd64/Packages13:55
*** mkrai has joined #openstack-nova13:58
*** Liang__ has joined #openstack-nova13:59
*** Liang__ is now known as LiangFang14:00
*** KeithMnemonic has joined #openstack-nova14:09
*** happyhemant has quit IRC14:22
*** tkajinam has quit IRC14:33
lyarwoodstupid o.vo question if anyone has time, LibvirtLiveMigrateData is starting to gather fields that we no longer use, can we bump and remove these or do they need to stay forever?14:36
*** rcernin has quit IRC14:37
lyarwoodah just noticed notes about dropping things when we do a major version bump14:37
*** slaweq has quit IRC14:38
*** slaweq has joined #openstack-nova14:40
stephenfinlyarwood: FYI I went and updated the wiki a while back in preparation for version bump patches. Never did the actual bump though14:42
stephenfinso that might be helpful14:42
stephenfinalso, yeah, we can drop but it needs a major version bump. I don't think we've done one of those since the Instance 2.0 object so that'll be interesting to see :)14:42
* lyarwood adds a TODO and moves on14:43
*** mlavalle has joined #openstack-nova14:44
*** fumesover32 has quit IRC14:45
*** mriedem has joined #openstack-nova14:46
mandrehi, anyone knows if nova AZs are case sensitive? can we create distinct AZs named MyAZ and myaz?14:47
*** slaweq has quit IRC14:48
dansmithlyarwood: you need a bridge release where you can speak both versions, just like RPC14:49
dansmithso it probably needs to be a need (to drop something) vs want (to clean up some things) to make it feel worthwhile :)14:49
*** fumesover32 has joined #openstack-nova14:49
openstackgerritStephen Finucane proposed openstack/nova master: functional: Provide default 'host_info' for '_get_connection'  https://review.opendev.org/74694214:50
openstackgerritStephen Finucane proposed openstack/nova master: functional: Add 'start_compute' helper  https://review.opendev.org/74694314:50
openstackgerritStephen Finucane proposed openstack/nova master: functional: Use tempdir for CONF.instances_path  https://review.opendev.org/74694414:50
openstackgerritStephen Finucane proposed openstack/nova master: functional: Clean up PCI tests  https://review.opendev.org/74694514:50
openstackgerritStephen Finucane proposed openstack/nova master: functional: Add resize tests for PCI, SR-IOV servers  https://review.opendev.org/74694614:50
openstackgerritStephen Finucane proposed openstack/nova master: conductor: Don't use setattr  https://review.opendev.org/74694714:50
openstackgerritStephen Finucane proposed openstack/nova master: functional: Add test for SR-IOV neutron ports  https://review.opendev.org/74694814:50
openstackgerritStephen Finucane proposed openstack/nova master: fixtures: Handle binding of first port  https://review.opendev.org/74694914:50
openstackgerritStephen Finucane proposed openstack/nova master: functional: Add live migration tests for PCI, SR-IOV servers  https://review.opendev.org/74695014:50
stephenfinsean-k-mooney: Ta-da ^14:50
lyarwooddansmith: yeah understood thanks14:50
*** mvorwerk has quit IRC14:50
stephenfinIf you can think of ways I can improve those live migration tests to highlight bugs, lemme know14:50
stephenfintbh I was expecting the resize test to fail because I thought you'd said that was broken, but clearly not. Maybe I'm thinking of another move operation14:51
*** dklyle has quit IRC14:51
*** slaweq has joined #openstack-nova14:51
sean-k-mooneystephenfin: nice14:52
sean-k-mooneyill start working my way through them14:52
stephenfinas for why I was seeing the HTTP 500 for NoValidHost, it's the use of the CastAsCall fixture14:52
sean-k-mooneygibi_pto_24th: wehn your back ^ will be of interest14:52
sean-k-mooneystephenfin: resize is broken if it does a retry i think14:53
*** fumesover32 has quit IRC14:53
sean-k-mooneystephenfin: tere are edgecases that fail for all move operations except live_migration with vnic_type=direct14:54
stephenfinsean-k-mooney: Feel free to stick in comments. I'm happy to keep bulking out these tests14:54
stephenfingiven the hardwork is done now, I think14:54
sean-k-mooneyso i think it will be nice to assert the correct behavior of gibis attach/detach feature14:54
*** belmoreira has quit IRC14:55
*** mvorwerk has joined #openstack-nova14:55
sean-k-mooneystephenfin: but ya i have a list in the downstream emial i sent14:55
sean-k-mooneystephenfin: one example of something that is broke is we do not update the neutron port mac address for pf migration14:56
stephenfinCool. I can assert that kind of stuff in the test14:56
sean-k-mooneythat is broken for both cold and live migration14:56
sean-k-mooneydetach on livem migation with PFs is also broken14:57
*** fumesover32 has joined #openstack-nova14:57
stephenfincan you attach PFs via neutron?14:57
sean-k-mooneynot after the vm is booted14:57
sean-k-mooneybut on boot yes14:57
* stephenfin assumed it was only VFs14:57
sean-k-mooneyvnic_type=direct-phsyical14:57
sean-k-mooneyno it was rammed through as a feature without accounting form a bunch of basic edgecease14:58
sean-k-mooneyand broke backwards compatiablei of the pci alias14:58
stephenfinsounds like CPU pinning and PCI in general14:59
*** dklyle has joined #openstack-nova15:00
sean-k-mooneynot really15:01
*** larainema has joined #openstack-nova15:04
*** mriedem has left #openstack-nova15:04
*** xinranwang__ has quit IRC15:05
*** mvorwerk has quit IRC15:05
*** kberger_ has joined #openstack-nova15:08
*** KeithMnemonic has quit IRC15:10
*** mvorwerk has joined #openstack-nova15:13
iurygregorysean-k-mooney, hey I did the changes directly to the node (in setup time) and at least all non uefi/multinode jobs are green =)15:14
*** mvorwerk has quit IRC15:19
*** mvorwerk has joined #openstack-nova15:20
sean-k-mooneycool15:23
*** sapd1 has joined #openstack-nova15:26
*** brinzhang0 has joined #openstack-nova15:29
*** fumesover32 has quit IRC15:30
*** fumesover32 has joined #openstack-nova15:30
*** brinzhang_ has quit IRC15:32
*** mvorwerk has quit IRC15:33
*** mvorwerk has joined #openstack-nova15:34
*** LiangFang has quit IRC15:35
*** mvorwerk has quit IRC15:39
*** mvorwerk has joined #openstack-nova15:41
*** gyee has joined #openstack-nova15:44
*** seba has joined #openstack-nova15:45
*** mkrai has quit IRC16:04
stephenfingmann: suuuuper dumb question. I'm attempting to enable policy by default in all tests but seeing policy failures https://review.opendev.org/#/c/745906/16:05
stephenfingmann: some of the rules are using PROJECT_MEMBER_OR_SYSTEM_ADMIN but I'm seeing requests using the non-admin user rejected16:06
stephenfinI assume I need to toggle that "enable new system-scoped policy" config option to get this working?16:06
gmannstephenfin:  with PROJECT_MEMBER_OR_SYSTEM_ADMIN check_str we have is to validate the 'system:all' for SYSTEM_ADMIN part and projectid&&member role for PROJECT_MEMBER so non admin would not pass if it is different project16:08
gmannstephenfin: are you removing the old defaults also? if not then it should keep working16:08
gmannlet me check the patch16:08
*** mriedem has joined #openstack-nova16:08
stephenfingmann: okay, that's what I was expecting but it doesn't happen16:08
gmannif you enable enforce_scope then  it will start failing.  as it need scope checks also16:09
stephenfinif you could have a look, I'd be grateful :) I think it's a good idea (enabling policy by default)16:09
gmannstephenfin: yeah, that is really good idea to run tests with actual policy. though we might need to do lot of work on test side though16:10
gmannchecking..16:10
stephenfinnot as much as you'd fear16:10
*** xek has quit IRC16:10
gmannstephenfin: if you try to do with admin (super access role) then yes no much changes but tests with real policy will be to use reader, member, admin roles. GET APIs by reader role not admin and so on16:13
stephenfinyeah, to be fair, I've only tested with legacy policy config and I've been blasting through things with admin credentials where necessary /o\16:17
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Fix indentation in test__video_model_supported  https://review.opendev.org/74697916:25
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Add libvirt version mocks in test_private_destroy_* tests  https://review.opendev.org/74698016:25
openstackgerritLee Yarwood proposed openstack/nova master: WIP libvirt: Bump MIN_{LIBVIRT,QEMU}_VERSION and NEXT_MIN_{LIBVIRT,QEMU}_VERSION  https://review.opendev.org/74698116:25
openstackgerritLee Yarwood proposed openstack/nova master: WIP libvirt: Remove MIN_LIBVIRT_FILE_BACKED_DISCARD_VERSION  https://review.opendev.org/74698216:25
openstackgerritLee Yarwood proposed openstack/nova master: WIP libvirt: Remove MIN_{LIBVIRT,QEMU}_NATIVE_TLS_VERSION  https://review.opendev.org/74698316:25
openstackgerritLee Yarwood proposed openstack/nova master: WIP libvirt: Remove MIN_LIBVIRT_BETTER_SIGKILL_HANDLING  https://review.opendev.org/74698416:25
openstackgerritLee Yarwood proposed openstack/nova master: WIP libvirt: Remove MIN_LIBVIRT_VIDEO_MODEL_VERSIONS  https://review.opendev.org/74698516:25
openstackgerritLee Yarwood proposed openstack/nova master: WIP libvirt: Remove MIN_{LIBVIRT,QEMU}_PMEM_SUPPORT  https://review.opendev.org/74698616:25
gmannstephenfin: ok. for legacy policy, that is ok.16:28
*** xek has joined #openstack-nova16:30
*** ociuhandu_ has joined #openstack-nova16:30
gmannstephenfin: those failing test missing ADMIN_API=True, i checked admin_action failed tests. because by default it is non admin API request, sample tests need to set ADMIN_API for admin APIs - https://github.com/openstack/nova/blob/cff7382fb3de4eef7aeddc34b6ae3409cbe50ea0/nova/tests/functional/integrated_helpers.py#L103616:33
stephenfincool, that's what I've done in most cases16:33
*** ociuhandu has quit IRC16:34
*** ociuhandu_ has quit IRC16:34
gmannand for GET APIs where default is admin_or_owner they are failing for  missing admin fields in response which confirms this and no other policy issue16:35
stephenfinso I'm going to run all the servers tests as admin to get those extra fields16:38
stephenfinbut anything else, I'll just drop the admin-only fields from the response16:38
gmannstephenfin: from func sample tests?16:38
stephenfinyup16:38
gmanni think we should not, functional sample tests has complete response verification and we use that in api-ref also.16:39
gmannmaking servers tests as admin is ok i think16:40
stephenfinSure, for this like 'GET /servers/{id}'16:40
gmannand other tests also as admin if it involve admin APi16:40
stephenfinwhat about things like the rescue action?16:41
stephenfinthat's currently being tested as a non-admin user but the response we've documented in an admin-type response16:41
stephenfinI'm thinking those admin fields aren't important in that instance and we should keep showing a non-admin response16:42
stephenfinbut maybe not16:42
gmannrescue does not add admin-only fields. you mean rebuild?16:43
stephenfinSorry, I mean in the response16:43
stephenfinactually, never mind16:43
gmannyeah in response rescue return empty dict or admin_password16:43
stephenfinthis is what I was referring to https://github.com/openstack/nova/blob/master/nova/tests/functional/api_sample_tests/test_rescue.py#L9416:44
stephenfinbut that's only for internal validation purposes16:44
stephenfinthat sample response doesn't need admin-fields in it16:44
gmannstephenfin: ohk i got now. yes we can keep that with non-admin.  if sample is not complete then yes keep testing that with non-admin.16:46
*** xek has quit IRC16:46
gmannstephenfin: even such test can just check state from response explicitly instead of comparing it with sample file response.16:47
*** ociuhandu has joined #openstack-nova16:48
*** lpetrut has quit IRC16:50
*** ociuhandu has quit IRC16:52
*** psachin has quit IRC16:53
*** tesseract has quit IRC17:00
*** dtantsur is now known as dtantsur|afk17:01
*** artom has quit IRC17:05
*** k_mouza has quit IRC17:05
*** martinkennelly has quit IRC17:09
*** martinkennelly has joined #openstack-nova17:10
*** k_mouza has joined #openstack-nova17:15
*** nightmare_unreal has quit IRC17:17
openstackgerritStephen Finucane proposed openstack/nova master: functional: Move single-use function to its caller  https://review.opendev.org/74590417:19
openstackgerritStephen Finucane proposed openstack/nova master: functional: Drop '_api' suffix from placement fixture  https://review.opendev.org/74590517:19
openstackgerritStephen Finucane proposed openstack/nova master: functional: Enable real policy fixture by default  https://review.opendev.org/74590617:19
openstackgerritStephen Finucane proposed openstack/nova master: functional: Add and use 'GlanceFixture'  https://review.opendev.org/74590717:19
openstackgerritStephen Finucane proposed openstack/nova master: tests: Remove '_FakeImageService'  https://review.opendev.org/74590817:19
stephenfingmann: ^17:19
stephenfinI might have missed one or two tests (there were 109 failures, after all) but that should be pretty correct now :)17:19
*** k_mouza has quit IRC17:20
gmannstephenfin: ok, waiting for gate result17:21
*** sapd1 has quit IRC17:28
*** sapd1 has joined #openstack-nova17:29
stephenfindansmith: melwitt: Can you folks look at https://review.opendev.org/#/c/744958/ again today?17:31
openstackgerritStephen Finucane proposed openstack/nova master: compute: Add type hints for resize functions  https://review.opendev.org/74534117:32
openstackgerritStephen Finucane proposed openstack/nova master: WIP: compute: Add more type hints for resize functions  https://review.opendev.org/74567517:32
*** artom has joined #openstack-nova17:34
*** xek has joined #openstack-nova17:44
*** maciejjozefczyk_ has joined #openstack-nova17:47
*** brinzhang_ has joined #openstack-nova17:47
*** maciejjozefczyk has quit IRC17:48
*** maciejjozefczyk has joined #openstack-nova17:49
*** sapd1 has quit IRC17:50
*** brinzhang0 has quit IRC17:51
*** maciejjozefczyk_ has quit IRC17:52
*** k_mouza has joined #openstack-nova17:54
*** xek_ has joined #openstack-nova17:55
artomstephenfin, lyarwood, did any of you start backporting Stephen's func tests refactors to train? Or did we want to socialize that a bit first?17:55
artomNothing that I can find in gerrit, at any rate. Shall I start?17:56
*** xek has quit IRC17:57
lyarwoodartom: I've not had a chance to get back to it so feel free to start17:58
*** k_mouza has quit IRC17:59
lyarwoodelod: https://review.opendev.org/#/c/746529/ - that reminds me can you take a look at this series from artom when you have time please17:59
*** xek_ has quit IRC18:00
artomlyarwood, yep, thanks for poking elod for me18:01
dansmithartom: I think stephenfin did what you asked here, so can you throw your +1 back on it? https://review.opendev.org/#/c/744950/418:01
dansmither, s/back//18:01
lyarwoodmelwitt: https://review.opendev.org/#/c/745512/ - trivial test cleanup if you have time today btw18:06
*** k_mouza has joined #openstack-nova18:08
*** lpetrut has joined #openstack-nova18:10
*** k_mouza has quit IRC18:14
*** lpetrut has quit IRC18:17
openstackgerritLee Yarwood proposed openstack/nova master: rbd: Move rbd_utils out of libvirt driver under nova.storage  https://review.opendev.org/74690418:20
openstackgerritLee Yarwood proposed openstack/nova master: Add ability to download Glance images into the libvirt image cache via RBD  https://review.opendev.org/57430118:20
*** k_mouza has joined #openstack-nova18:23
melwittlyarwood: took too long to find what I was looking for, but commented on your patch that there's a fixture for doing that18:23
dansmithso that would only work with eventlet,18:25
dansmithwhich seems like an odd thing to favor18:25
yankcrimehey folks, i think i'm hitting this bug with an instance that was created circa rocky, but now a user has stopped and is attempting to start it again for this first time under ussuri: https://bugs.launchpad.net/nova/+bug/186402018:26
openstackLaunchpad bug 1864020 in OpenStack Compute (nova) "libvirt.libvirtError: Requested operation is not valid: format of backing image %s of image %s was not specified in the image metadata (See https://libvirt.org/kbase/backing_chains.html for troubleshooting)" [Undecided,Fix committed] - Assigned to Lee Yarwood (lyarwood)18:26
yankcrimeif i'm reading right, it's related to libvirt 6.0 and that fix only applies to new instances that are created with this vesion of libvirt18:26
*** k_mouza has quit IRC18:26
*** martinkennelly has quit IRC18:30
lyarwoodyankcrime: yeah I thought libvirt then relaxed this in a later release?18:30
*** artom has quit IRC18:30
melwittdansmith: yeah I guess loopingcall uses eventlet for its looping https://github.com/openstack/oslo.service/blob/master/oslo_service/loopingcall.py18:31
lyarwoodyankcrime: sorry need to drop for the day now but if this isn't resolved by a later release of libvirt then you might need to convert the disks in place to include the format details of the backing file18:32
* lyarwood drops18:33
dansmithyeah that seems weird to me -- if we were to convert some of our stuff to real threads as we've discussed before, that'd be a problem18:33
yankcrimelyarwood: yeah that's the conclusion i'm coming to, wanted to make sure i wasn't missing anything18:34
openstackgerritLee Yarwood proposed openstack/nova master: WIP libvirt: Remove MIN_LIBVIRT_FILE_BACKED_DISCARD_VERSION  https://review.opendev.org/74698218:34
openstackgerritLee Yarwood proposed openstack/nova master: WIP libvirt: Remove MIN_{LIBVIRT,QEMU}_NATIVE_TLS_VERSION  https://review.opendev.org/74698318:34
openstackgerritLee Yarwood proposed openstack/nova master: WIP libvirt: Remove MIN_LIBVIRT_BETTER_SIGKILL_HANDLING  https://review.opendev.org/74698418:34
openstackgerritLee Yarwood proposed openstack/nova master: WIP libvirt: Remove MIN_LIBVIRT_VIDEO_MODEL_VERSIONS  https://review.opendev.org/74698518:34
openstackgerritLee Yarwood proposed openstack/nova master: WIP libvirt: Remove MIN_{LIBVIRT,QEMU}_PMEM_SUPPORT  https://review.opendev.org/74698618:34
lyarwoodyankcrime: yup sorry, I was sure the libvirt folks backed down after we complained about this but I can't seem to find the change18:34
lyarwoodyankcrime: kashyap is the person to speak to about this, I'll follow up with him in the morning18:35
* lyarwood really drops this time18:35
yankcrimelyarwood: damn, fwiw i'm on 6.0.0-0ubuntu8.1~cloud018:35
yankcrimelyarwood: thanks!18:35
*** maciejjozefczyk has quit IRC18:36
melwittdansmith: yeah, if we convert then we'd have to add support to loopingcall or stop using loopingcall I guess18:36
*** maciejjozefczyk has joined #openstack-nova18:37
*** k_mouza has joined #openstack-nova18:40
*** k_mouza has quit IRC18:40
*** martinkennelly has joined #openstack-nova18:43
*** vishalmanchanda has quit IRC18:49
*** jdillaman has joined #openstack-nova18:57
*** martinkennelly has quit IRC19:00
*** ociuhandu has joined #openstack-nova19:04
openstackgerritStephen Finucane proposed openstack/nova master: tests: Add reproducer for bug #1879878  https://review.opendev.org/74495019:32
openstackbug 1879878 in OpenStack Compute (nova) "VM become Error after confirming resize with Error info CPUUnpinningInvalid on source node " [Medium,In progress] https://launchpad.net/bugs/1879878 - Assigned to Stephen Finucane (stephenfinucane)19:32
openstackgerritStephen Finucane proposed openstack/nova master: Don't unset Instance.old_flavor, new_flavor until necessary  https://review.opendev.org/74495819:32
openstackgerritStephen Finucane proposed openstack/nova master: manager: Move context manager up one level  https://review.opendev.org/74567419:32
openstackgerritStephen Finucane proposed openstack/nova master: compute: Add type hints for resize functions  https://review.opendev.org/74534119:32
openstackgerritStephen Finucane proposed openstack/nova master: WIP: compute: Add more type hints for resize functions  https://review.opendev.org/74567519:32
stephenfindansmith: Addressed your comments ^ If you could take the third one in that series too, that'd be great (split out per your request)19:33
*** ociuhandu has quit IRC19:34
*** priteau has quit IRC19:44
*** efried has quit IRC19:49
*** efried has joined #openstack-nova19:49
*** artom has joined #openstack-nova20:11
openstackgerritMerged openstack/nova master: libvirt: Mock LoopingCallBase._sleep in rbd tests  https://review.opendev.org/74551220:16
*** breizhkoala has quit IRC20:19
*** ociuhandu has joined #openstack-nova20:22
mnaserfyi, ceph jobs are breaking often and i tracked it down to https://review.opendev.org/74703020:26
mnaserhoping to land that when we can :)20:26
melwittthanks mnaser. looks like cinder core are core on devstack-plugin-ceph20:33
*** dustinc has quit IRC20:49
*** nweinber has quit IRC21:01
*** raildo has quit IRC21:01
*** ociuhandu has quit IRC21:06
*** slaweq has quit IRC21:07
*** maciejjozefczyk has quit IRC21:08
*** damien_r has quit IRC21:12
*** kaisers1 has joined #openstack-nova21:15
*** kaisers has quit IRC21:17
*** slaweq has joined #openstack-nova21:19
openstackgerritMerged openstack/python-novaclient master: zuul functional job: drop the custom playbooks  https://review.opendev.org/74664921:21
*** slaweq has quit IRC21:23
*** slaweq has joined #openstack-nova21:34
*** slaweq has quit IRC21:38
*** tosky has quit IRC21:47
*** tony_su has quit IRC21:49
*** efried has quit IRC21:59
*** xek has joined #openstack-nova22:05
*** xek has quit IRC22:07
*** xek has joined #openstack-nova22:08
*** xek has quit IRC22:12
*** xek has joined #openstack-nova22:15
*** mriedem has left #openstack-nova22:21
*** efried has joined #openstack-nova22:27
*** xek has quit IRC22:31
*** efried has quit IRC22:49
gmannstephenfin: commented about server tag test failing with non-admin even this API is admin-or-owner.  that is because of different project_id of server in SingleCellSimple and OSAPIFixture - https://review.opendev.org/#/c/745906/2/nova/tests/functional/api_sample_tests/test_server_tags.py@2222:50
gmannalso there are few tests does not need ADMIN_API=true which were passing with non-admin also in previous PS22:51
*** tkajinam has joined #openstack-nova22:58
*** efried has joined #openstack-nova22:59
*** rcernin has joined #openstack-nova22:59
*** mlavalle has quit IRC23:03
*** ociuhandu has joined #openstack-nova23:06
*** ociuhandu has quit IRC23:11
*** spatel has joined #openstack-nova23:24
*** mvorwerk_ has joined #openstack-nova23:25
*** mvorwerk has quit IRC23:28
*** spatel has quit IRC23:30
*** suryasingh has quit IRC23:37
*** spatel has joined #openstack-nova23:40
*** tetsuro has joined #openstack-nova23:44
*** tetsuro has quit IRC23:57

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!