Thursday, 2021-04-29

« Wednesday, 2021-04-28 Index Friday, 2021-04-30 »
*** k_mouza has joined #openstack-nova00:27
*** k_mouza has quit IRC00:32
*** gyee has quit IRC00:32
*** brinzhang0 is now known as brinzhang00:33
brinzhanggibi, gmann: the nova-grenade-multinode task always failed, is there a bug tracing?00:34
brinzhanghttps://zuul.opendev.org/t/openstack/builds?job_name=nova-grenade-multinode00:34
gmannbrinzhang: i see error 'Failed to start rtslib-fb-targetctl.service: Unit rtslib-fb-targetctl.service is not loaded properly: Exec format error.'00:52
gmannbut that is passing sometime00:52
gmannnot 100% failure00:52
gmannclarkb: ^^ are you aware of this error - https://zuul.opendev.org/t/openstack/build/599cfa422a0648168c8b00a27fbd3114/log/logs/grenade.sh.txt#46891-4691200:53
gmannbrinzhang: if you see, there are some passing job also on master gate https://zuul.opendev.org/t/openstack/builds?job_name=nova-grenade-multinode00:55
gmannbut yes, it is happening more frequently00:56
*** brinzhang_ has joined #openstack-nova01:05
*** brinzhang has quit IRC01:08
*** __ministry has joined #openstack-nova01:17
brinzhang_gmann: yes, there are always failed in https://review.opendev.org/c/openstack/nova/+/76429201:18
*** sapd1_x has joined #openstack-nova01:20
gmannbrinzhang_: this one https://askubuntu.com/questions/1334619/failed-to-start-rtslib-fb-targetctl-service01:21
*** sapd1_x has quit IRC01:25
brinzhang_gmann: ok, it seems there is no answer with this question01:26
*** hamalq has quit IRC01:34
*** macz_ has joined #openstack-nova01:35
*** macz_ has quit IRC01:40
*** macz_ has joined #openstack-nova01:56
*** swp20 has joined #openstack-nova01:59
*** swp20 is now known as wenpingsong02:00
*** macz_ has quit IRC02:00
*** brinzhang_ is now known as brinzhang02:07
*** sapd1_x has joined #openstack-nova02:12
*** dasp_ has quit IRC02:31
*** dasp has joined #openstack-nova02:35
*** rcernin has quit IRC02:35
*** rcernin has joined #openstack-nova02:42
*** hemanth_n has joined #openstack-nova02:45
*** _erlon_ has quit IRC03:21
*** boxiang_ has quit IRC03:31
*** sapd1_x has quit IRC03:34
*** mkrai has joined #openstack-nova03:36
*** sapd1_x has joined #openstack-nova03:41
*** mkrai has quit IRC03:55
*** macz_ has joined #openstack-nova03:55
openstackgerritXinran WANG proposed openstack/nova-specs master: Repropose smartnic support spec  https://review.opendev.org/c/openstack/nova-specs/+/78363203:56
*** rcernin has quit IRC03:59
*** rcernin has joined #openstack-nova04:00
*** macz_ has quit IRC04:00
*** vishalmanchanda has joined #openstack-nova04:24
*** terdei has quit IRC04:30
*** terdei has joined #openstack-nova04:33
*** aarents has quit IRC04:42
*** ratailor has joined #openstack-nova04:52
*** openstackgerrit has quit IRC05:01
*** erbarr has joined #openstack-nova05:16
erbarrhi, is there an issue with configdrive and ussuri?05:22
*** sapd1_x has quit IRC05:44
*** slaweq has joined #openstack-nova05:55
*** macz_ has joined #openstack-nova05:56
*** ratailor_ has joined #openstack-nova05:58
*** ratailor has quit IRC05:59
*** macz_ has quit IRC06:00
*** ralonsoh has joined #openstack-nova06:25
*** luksky has joined #openstack-nova06:39
*** macz_ has joined #openstack-nova06:46
*** aarents has joined #openstack-nova06:47
*** macz_ has quit IRC06:52
*** wenpingsong has quit IRC06:59
*** rcernin has quit IRC07:04
*** ociuhandu has joined #openstack-nova07:06
*** ociuhandu has quit IRC07:07
*** ociuhandu has joined #openstack-nova07:07
gibigmann, brinzhang: https://review.opendev.org/c/openstack/devstack/+/788429 should have fixed the grenade issue07:10
gibigmann, brinzhang: and when this https://review.opendev.org/c/openstack/nova/+/778885 finally lands07:11
gibiwe don't need to pin ISCSI_HELPER any more07:11
*** andrewbonney has joined #openstack-nova07:19
*** ociuhandu has quit IRC07:21
*** ociuhandu has joined #openstack-nova07:22
*** macz_ has joined #openstack-nova07:25
*** ociuhandu has quit IRC07:27
*** rpittau|afk is now known as rpittau07:27
*** macz_ has quit IRC07:30
*** gokhani has joined #openstack-nova07:32
*** ociuhandu has joined #openstack-nova07:34
*** boxiang has joined #openstack-nova07:35
*** sapd1_x has joined #openstack-nova07:39
*** dtantsur|afk is now known as dtantsur07:40
*** sapd1_x has quit IRC07:43
*** tosky has joined #openstack-nova07:44
*** sapd1_x has joined #openstack-nova07:59
*** martinkennelly has joined #openstack-nova08:02
*** sapd1_x has quit IRC08:04
*** lucasagomes has joined #openstack-nova08:05
brinzhanggibi: ack08:09
*** ociuhandu has quit IRC08:11
*** ociuhandu has joined #openstack-nova08:12
*** swp20 has joined #openstack-nova08:14
*** dklyle has quit IRC08:18
*** ociuhandu has quit IRC08:18
*** sapd1_x has joined #openstack-nova08:18
*** macz_ has joined #openstack-nova08:37
*** macz_ has quit IRC08:41
*** links has joined #openstack-nova08:43
*** ociuhandu has joined #openstack-nova08:50
*** ociuhandu has quit IRC08:56
*** k_mouza has joined #openstack-nova09:01
*** tesseract has joined #openstack-nova09:17
*** ociuhandu has joined #openstack-nova09:19
*** ociuhandu has quit IRC09:24
*** bnemec has quit IRC09:27
*** ociuhandu has joined #openstack-nova09:27
*** bnemec has joined #openstack-nova09:28
*** k_mouza has quit IRC09:32
*** derekh has joined #openstack-nova09:32
*** ociuhandu has quit IRC09:35
*** ociuhandu_ has joined #openstack-nova09:35
*** k_mouza has joined #openstack-nova09:39
*** xinranwang has quit IRC09:40
*** zzzeek has quit IRC09:42
*** zzzeek has joined #openstack-nova09:43
*** ociuhandu_ has quit IRC09:44
*** k_mouza has quit IRC09:44
*** k_mouza has joined #openstack-nova09:47
*** tobberydberg has quit IRC09:47
*** tobberydberg has joined #openstack-nova09:52
*** openstackgerrit has joined #openstack-nova10:08
openstackgerritLee Yarwood proposed openstack/nova master: zuul: Replace grenade and nova-grenade-multinode with grenade-multinode  https://review.opendev.org/c/openstack/nova/+/77888510:08
openstackgerritLee Yarwood proposed openstack/nova master: zuul: Remove nova-dsvm-multinode-base  https://review.opendev.org/c/openstack/nova/+/77890810:08
lyarwoodgibi: ^ that series was still using the older detach flow and seeing errors, I've rebased to pickup your new code and hopefully that should allow it to pass10:08
gibihm, I thought zuul rebases the patches10:09
gibibefore running the tests10:09
*** sapd1_x has quit IRC10:09
*** macz_ has joined #openstack-nova10:10
gibianyhow I +Ad them10:10
sean-k-mooneygibi: zuul merges the patch with the head of master and if you use depends on in the same repor it merged with that too10:13
sean-k-mooneygibi: so not a rebase but similar10:13
gibithen it should have picked up my detach fixes10:13
lyarwoodAFAICT it didn't10:14
*** ociuhandu has joined #openstack-nova10:14
lyarwoodthis is just in the check queue btw10:14
lyarwoodit didn't make it to the gate this run10:14
sean-k-mooneyyep check should do the same10:14
sean-k-mooneyit will speculetlivly merge and then run on the result10:14
sean-k-mooneyits why sometimes test pass locally and fail in the gate10:15
*** macz_ has quit IRC10:15
sean-k-mooneyand you have to do a local rebase to see the isssues locally10:15
sean-k-mooneycould it have just been a timing thing?10:16
sean-k-mooneycheck jobs dont restart if something merges10:16
lyarwoodhttps://zuul.opendev.org/t/openstack/build/02d0c22ca9334a1094782df2f9570c35/log/compute1/logs/screen-n-cpu.txt and req-d017e833-5df2-4c5e-b348-f2625a2a608d is the old flow as it's using loopingcall10:16
sean-k-mooneyunlike gate10:16
* gibi clicks10:17
gibiyepp the logs are from the old code10:18
lyarwoodanyway it's rebased now10:18
lyarwoodso hopefully10:18
gibifingers crossed10:18
*** __ministry has quit IRC10:18
gibilyarwood: it is a grenade run, so I guess before the upgrade it have to run the old code from Wallaby10:19
lyarwoodaaaaaaaah10:19
lyarwoodright10:19
lyarwoodI didn't even think10:19
lyarwoodso is this still v to w?10:19
gibiI think it is w to master10:20
gibibut we only merged the fix to master10:20
sean-k-mooneyoh ya10:20
lyarwoodwe did talk about backporting your change to wallaby10:20
sean-k-mooneywell grenade shoudl be wallaby to xena10:21
* lyarwood needs to jump on a call brb10:21
lyarwoodsean-k-mooney: yeah I think this is the live migration test between the two10:21
lyarwoodsean-k-mooney: with the compute still on w10:21
sean-k-mooneyback porting the change for libvirt events to wallaby would be nice form a downstrem perspecitve too10:22
sean-k-mooneywe talked about trying that downstream but while i like the idea of doing that i was not personally sure we wanted to diverge form upstream in this case10:23
gibilyarwood: the delta between w and current master should be small, so I can fire up the cherry-picks10:24
gibiahh there are already merge conflicts :/10:29
*** zzzeek has quit IRC10:33
*** zzzeek has joined #openstack-nova10:34
lyarwoodyeah that might be my fault sorry10:36
lyarwoodactually yeah it is10:36
lyarwoodsean-k-mooney: yeah I did bring it up upstream as well as it's also a bugfix IMHO10:36
gibiit is nobody's fault, we needed those fixes10:37
*** tbachman has quit IRC10:43
*** tbachman has joined #openstack-nova10:43
*** tbarron has joined #openstack-nova10:48
*** whoami-rajat has joined #openstack-nova10:52
*** ratailor__ has joined #openstack-nova10:53
*** hemanth_n has quit IRC10:53
*** iurygregory has quit IRC10:54
*** ratailor_ has quit IRC10:56
*** sapd1_x has joined #openstack-nova10:56
*** iurygregory has joined #openstack-nova10:58
*** damien_r has quit IRC11:02
*** macz_ has joined #openstack-nova11:02
*** damien_r has joined #openstack-nova11:03
*** macz_ has quit IRC11:06
*** tbachman has quit IRC11:07
openstackgerritVlad Gusev proposed openstack/nova master: libvirt: Abort live-migration job when monitoring fails  https://review.opendev.org/c/openstack/nova/+/76443511:08
openstackgerritDaniel Bengtsson proposed openstack/nova master: Use the new type HostDomainOpt.  https://review.opendev.org/c/openstack/nova/+/78824011:10
*** damien_r has quit IRC11:15
*** k_mouza has quit IRC11:29
*** k_mouza has joined #openstack-nova11:29
*** gokhani has quit IRC11:38
*** dave-mccowan has quit IRC11:40
*** ociuhandu has quit IRC11:41
*** ociuhandu has joined #openstack-nova11:42
*** dave-mccowan has joined #openstack-nova11:42
*** macz_ has joined #openstack-nova11:42
*** ociuhandu has quit IRC11:47
*** macz_ has quit IRC11:47
*** ociuhandu has joined #openstack-nova11:48
*** ociuhandu has quit IRC11:53
*** macz_ has joined #openstack-nova12:03
*** ratailor__ has quit IRC12:07
*** macz_ has quit IRC12:08
*** ratailor has joined #openstack-nova12:10
*** ratailor has quit IRC12:10
openstackgerritBalazs Gibizer proposed openstack/nova stable/wallaby: Replace blind retry with libvirt event waiting in detach  https://review.opendev.org/c/openstack/nova/+/78872012:13
openstackgerritBalazs Gibizer proposed openstack/nova stable/wallaby: Move the guest.get_disk test to test_guest  https://review.opendev.org/c/openstack/nova/+/78872112:13
openstackgerritBalazs Gibizer proposed openstack/nova stable/wallaby: Enable mypy on libvirt/guest.py  https://review.opendev.org/c/openstack/nova/+/78872212:13
openstackgerritBalazs Gibizer proposed openstack/nova stable/wallaby: Follow up type hints for a634103  https://review.opendev.org/c/openstack/nova/+/78872312:13
openstackgerritBalazs Gibizer proposed openstack/nova stable/wallaby: libvirt: Remove dead error handling code  https://review.opendev.org/c/openstack/nova/+/78872412:13
openstackgerritBalazs Gibizer proposed openstack/nova stable/wallaby: Move instance power state check to _detach_with_retry  https://review.opendev.org/c/openstack/nova/+/78872512:13
*** ociuhandu has joined #openstack-nova12:14
gibilyarwood, sean-k-mooney: ^^ here is the backport series. I'm not 100% confident about it as there was hairy conflicts in the tests12:14
openstackgerritBalazs Gibizer proposed openstack/nova stable/wallaby: Consolidate device detach error handling  https://review.opendev.org/c/openstack/nova/+/78872612:14
*** dave-mccowan has quit IRC12:15
*** dave-mccowan has joined #openstack-nova12:17
*** ociuhandu has quit IRC12:20
gibilyarwood: fyi, there is a rescue + volume + RBD bug in our untriaged list https://bugs.launchpad.net/nova/+bug/192660112:26
openstackLaunchpad bug 1926601 in OpenStack Compute (nova) "Rescuing RBD volume-backed instance does not work" [Undecided,New]12:26
sean-k-mooneythis is hte rbd images backend12:29
sean-k-mooneyand a bfv guest12:29
lyarwoodgibi: ack yeah just on a call but I'll triage it today12:29
*** gokhani has joined #openstack-nova12:30
gibithanks12:30
sean-k-mooneyit sound like we are just not creating the rescue disk in ceph but trying to use it12:31
sean-k-mooneyi wonder is that becaue of the fact the vm is bfv.12:32
*** ociuhandu has joined #openstack-nova12:33
*** k_mouza has quit IRC12:34
sean-k-mooneythey are on victoria so they should have https://specs.openstack.org/openstack/nova-specs/specs/ussuri/implemented/virt-bfv-instance-rescue.html12:34
sean-k-mooneymy guess is that  we are creating the rescue disk as a cinder volumn but then trying to use it form teh vms pool since the rbd images backend is enabeld12:35
*** tbachman has joined #openstack-nova12:40
*** damien_r has joined #openstack-nova12:41
*** k_mouza has joined #openstack-nova12:43
sean-k-mooneyso this is going to use the image_backed specified in the nova.conf so the disk it returns would be basedon the rbd image backend which will use the vms pool12:43
sean-k-mooneyhttps://github.com/openstack/nova/blob/eba9d596daa91d8f702b719afb88cb89f2d5bb32/nova/virt/libvirt/driver.py#L517012:44
*** ociuhandu has quit IRC12:44
*** ociuhandu has joined #openstack-nova12:45
*** damien_r has quit IRC12:45
sean-k-mooney_create_image is going too check if its a bfv guest here https://github.com/openstack/nova/blob/eba9d596daa91d8f702b719afb88cb89f2d5bb32/nova/virt/libvirt/driver.py#L450012:47
sean-k-mooneywhich will be passed to _create_and_inject_local_root https://github.com/openstack/nova/blob/eba9d596daa91d8f702b719afb88cb89f2d5bb32/nova/virt/libvirt/driver.py#L457812:48
sean-k-mooneywhich will not create teh image becuase bfv willl be true https://github.com/openstack/nova/blob/eba9d596daa91d8f702b719afb88cb89f2d5bb32/nova/virt/libvirt/driver.py#L466412:49
sean-k-mooneyso we will just take the else branch12:49
sean-k-mooneylyarwood: gibi ^ pretty sure that is the root cause of https://bugs.launchpad.net/nova/+bug/192660112:50
openstackLaunchpad bug 1926601 in OpenStack Compute (nova) "Rescuing RBD volume-backed instance does not work" [Undecided,New]12:50
gibisean-k-mooney: nice analysis12:50
lyarwoodhmm I was sure we had tempest tests for this12:53
*** k_mouza has quit IRC12:53
lyarwoodand I also verified it during the bfv rescue work a few cycles ago12:53
* lyarwood looks12:53
*** mkrai has joined #openstack-nova12:55
*** ociuhandu_ has joined #openstack-nova12:58
*** ociuhandu has quit IRC13:01
*** k_mouza has joined #openstack-nova13:01
*** jraju__ has joined #openstack-nova13:13
*** links has quit IRC13:13
*** macz_ has joined #openstack-nova13:15
*** macz_ has quit IRC13:20
lyarwoodsean-k-mooney: thanks for the pointers, the real issue is that the request was even allowed as we don't support bfv rescue outside of also requesting a stable device rescue.13:26
lyarwoodappears I never encoded that in the compute API so it's accepted and passed down to the virt driver that was never changed to support this with legacy rescue attempts (rescue device first etc)13:27
lyarwoodstable device rescues of bfv instances works just fine and is tested in tempest13:27
lyarwoodI'll write up a regression test and add some logic in the compute API to avoid this13:28
lyarwoodhttps://docs.openstack.org/nova/latest/user/rescue.html#instance-rescue I did at least call it out in the docs13:29
*** vishalmanchanda has quit IRC13:30
*** sapd1_x has quit IRC13:33
*** sapd1_x has joined #openstack-nova13:34
*** zzzeek has quit IRC13:34
sean-k-mooneylyarwood: ok so  for the bug i guess we coudl do two things. one explain how to use stabel rescue13:35
*** tesseract has quit IRC13:35
sean-k-mooneyand second update it to track blocking it in the api with a 40013:35
*** tesseract has joined #openstack-nova13:35
lyarwoodyup indeed, I'll sort both out shortly13:36
*** zzzeek has joined #openstack-nova13:37
*** zzzeek has quit IRC13:40
*** zzzeek has joined #openstack-nova13:41
*** k_mouza has quit IRC13:42
*** zzzeek has quit IRC13:42
*** haleyb has quit IRC13:43
*** zzzeek has joined #openstack-nova13:43
*** haleyb has joined #openstack-nova13:47
*** ociuhandu_ has quit IRC13:49
*** ociuhandu has joined #openstack-nova13:50
*** macz_ has joined #openstack-nova13:52
*** dave-mccowan has quit IRC13:52
*** dave-mccowan has joined #openstack-nova13:56
*** macz_ has quit IRC13:57
*** ociuhandu has quit IRC13:59
*** ociuhandu has joined #openstack-nova14:01
*** ociuhandu has quit IRC14:06
*** mkrai has quit IRC14:07
lyarwoodsean-k-mooney: https://bugs.launchpad.net/nova/+bug/1926375 seen this?14:07
openstackLaunchpad bug 1926375 in OpenStack Compute (nova) "nova-compute service failed to start up" [Undecided,New]14:07
*** ociuhandu has joined #openstack-nova14:09
*** ociuhandu has quit IRC14:12
*** ociuhandu has joined #openstack-nova14:13
*** ociuhandu has quit IRC14:13
*** ociuhandu has joined #openstack-nova14:14
*** ociuhandu has quit IRC14:19
sean-k-mooneylyarwood: i can see why that would happen14:21
sean-k-mooneyif the binding profile in the neutorn port was currupted and the pci_slot key was removed that would happen14:22
gibisean-k-mooney: yeah, but we cannot really prove anyithing as the logs does not have an instance uuid or port uuid to map it back to the neutron state14:24
sean-k-mooneywell we can see plugin='ovs',port_profile=VIFPortProfileOpenVSwitch14:25
sean-k-mooneyand .plug_hw_veb14:25
sean-k-mooneyso this is hardware offloaded ovs which does not support trusted VF14:25
gibiohh, so we only support trusted VF with the sriov agent?14:28
gibiI did not know that14:28
sean-k-mooneyif it works with anything else its by acident wew never extended support to anything else14:28
gibiit seems they are using it :)14:30
*** ociuhandu has joined #openstack-nova14:33
sean-k-mooneywell im pretty sure that it wont work the way they intend14:34
sean-k-mooneyit might allow them to change the mac adress but ovs wont make the port promisous and the security group rules will still be enforced14:35
*** belmoreira has joined #openstack-nova14:37
*** dave-mccowan has quit IRC14:38
*** ociuhandu has quit IRC14:38
sean-k-mooneygibi: ok i have marked it as incomplete for now https://bugs.launchpad.net/nova/+bug/192637514:40
openstackLaunchpad bug 1926375 in OpenStack Compute (nova) "nova-compute service failed to start up" [Undecided,Incomplete]14:40
gibisean-k-mooney: ack, thanks14:41
*** links has joined #openstack-nova14:44
*** jraju__ has quit IRC14:44
*** dave-mccowan has joined #openstack-nova14:44
*** k_mouza has joined #openstack-nova14:44
*** dklyle has joined #openstack-nova14:47
*** macz_ has joined #openstack-nova14:54
*** zzzeek has quit IRC15:09
*** xek_ is now known as xek15:09
*** zzzeek has joined #openstack-nova15:10
*** ociuhandu has joined #openstack-nova15:21
*** tesseract has quit IRC15:26
openstackgerritBalazs Gibizer proposed openstack/nova master: Fix bond_mode enum 802.1ad -> 802.3ad  https://review.opendev.org/c/openstack/nova/+/78879015:49
gibisean-k-mooney: could you double check that I understood this right ^^ ?15:50
*** gyee has joined #openstack-nova15:52
gibinova meeting starts in 8 minutes in #openstack-meeting-315:52
*** gokhani has quit IRC15:55
gibidansmith: regarding yesterday service version check discussion. You said that you think the version alias is wrong. I've double checked and I don't see the problem. 54 was the first Wallaby service version. 52 is the first Victoria service version15:57
sean-k-mooneygibi: am sure15:58
*** ociuhandu_ has joined #openstack-nova15:58
openstackgerritMerged openstack/nova master: zuul: Replace grenade and nova-grenade-multinode with grenade-multinode  https://review.opendev.org/c/openstack/nova/+/77888515:58
openstackgerritMerged openstack/nova master: zuul: Remove nova-dsvm-multinode-base  https://review.opendev.org/c/openstack/nova/+/77890815:59
lyarwood\o/16:00
sean-k-mooneygibi: ya 802.3ad is lacp bonding 802.1 is QinQ16:00
gibilyarwood: ++16:00
gibisean-k-mooney: thanks16:00
*** ociuhandu has quit IRC16:02
*** mlavalle has joined #openstack-nova16:02
*** lucasagomes has quit IRC16:03
*** ociuhandu_ has quit IRC16:03
sean-k-mooneyit shows how frequetly people use the network jsone templating if we are only seeing this now16:04
sean-k-mooneythis is used to validate https://docs.openstack.org/nova/latest/configuration/config.html#DEFAULT.injected_network_template right16:05
gibisean-k-mooney: ooh, I did not know about that16:06
gibibut I guess yes16:06
openstackgerritGhanshyam proposed openstack/nova master: DNM: testing bionic drop  https://review.opendev.org/c/openstack/nova/+/78879116:07
sean-k-mooneywell im not sure what we might be using the network.json for other then the network metadta consumed by cloud init which i think is generated by that template16:07
gibiit make sense16:10
gibibtw sean-k-mooney you promised on the PTG to add periodic jobs for placement and then we can look at the results in regularly on the nova meeting16:11
gibilet me know if you need help adding them16:12
sean-k-mooneyoh i should be in the meeting didn realise it started16:12
gibi:)16:12
sean-k-mooneyhttps://review.opendev.org/c/openstack/placement/+/78750816:13
sean-k-mooneyyou looked at the patch already16:13
gibisean-k-mooney: lol, I totally forgot16:14
gibithanks again16:15
*** hamalq has joined #openstack-nova16:22
*** ociuhandu has joined #openstack-nova16:23
*** hamalq has quit IRC16:23
*** hamalq has joined #openstack-nova16:24
elodlyarwood: I've checked the placement patch meanwhile and +2+W'd as it looks appropriate16:26
lyarwoodack thanks16:26
gmannelod: lyarwood its base patch too -https://review.opendev.org/c/openstack/placement/+/787525/216:26
*** ociuhandu has quit IRC16:27
gibiand if you are reviewing placement already could you please hit this too https://review.opendev.org/c/openstack/placement/+/787508 ?16:29
gibisimple job addition16:29
elodgmann: +2+W'd, too16:29
gmannelod: thanks16:31
elodnp16:31
gmanngibi: lgtm, +A16:33
gmanngibi: sean-k-mooney that is good idea. I will try this for few of QA repos too where we do not have frequent changes and end up finding failing gate if there is any change.16:34
sean-k-mooneygmann: the weekly pipeline give a nice cadence to them too16:37
*** zzzeek has quit IRC16:37
kashyaplyarwood: Hey16:38
sean-k-mooneybeing realistinc peopel are not going to check them daily and if its a 2 second line item in the weekly meeting just to make sure the last build ran and it was green then i think its useful16:38
kashyaplyarwood: We don't use "virtio-blk,scsi=on" as a SCSI passthrough, right?  From my `grep`ing around, we don't...16:38
*** zzzeek has joined #openstack-nova16:39
kashyaplyarwood: I ask because, QEMU folks pinged me to tell that support for it was removed in Linux v5.6; and QEMU deprecated it in 5.016:39
gmannsean-k-mooney: true, we check periodic jobs in QA office hours weekly and it will hell to add these type of jobs in less-active repo16:39
sean-k-mooneykashyap: i dont belive we do16:39
kashyapCool; figured as much16:39
*** macz_ has quit IRC16:40
sean-k-mooneygmann: i have tought about doing it for os-vif in the past but i tened to test that trasitivly enough in my local devstack but its useful in any repo that does not ahve a patch proplsed at least once a week16:41
gmann+1, what i encounter is trying to add some change but see gate is already failing for long and we did not knw about it and end up spending time on that in release time or so :)16:43
*** BLZbubba has joined #openstack-nova16:44
BLZbubbahi guys, when i create a uefi image with openstack image create and specify "os_secure_boot=disabled", this property is ignored and nova forces the uefi secboot bios instead.  interestingly it is only ignored when I also specify "hw_firmware_type=uefi"  so it must be happening at a higher level than just glance.... any idea how to stop nova from trying the secboot version of ovmf?16:47
BLZbubbaapart from the gross hack I've been using, which is rm /usr/share/OVMF/OVMF_CODE.secboot.fd16:48
BLZbubbathe glance people said to ask here16:49
*** dtantsur is now known as dtantsur|afk16:49
sean-k-mooneyBLZbubba: so secure boot shoudl be disabled by default16:58
*** iurygregory has quit IRC16:58
sean-k-mooneyif you jsut set hw_firmware_type=uefi it should use the non secure boot firmware16:58
*** rpittau is now known as rpittau|afk16:59
sean-k-mooneyunless the recnelty added secure boot support feature regressed that behavior16:59
sean-k-mooneystephenfin: kashyap ^16:59
stephenfinBLZbubba: what version of nova?17:00
*** derekh has quit IRC17:01
stephenfinsean-k-mooney: Prior to the secure boot feature, we defaulted the secure boot firmware https://github.com/openstack/nova/commit/363710b655434a15b6b85d9ca65343210b104e5617:02
sean-k-mooneystephenfin: but we did not enable secureboot in the xml so it was disabled in the geust17:02
stephenfinthough we didn't set the necessary flags, so it should be using the firmware but not enabling the feature17:02
stephenfinyes17:02
sean-k-mooneyso the firmwar was capable fo secure boot but qemu woudl not try to use it17:03
sean-k-mooneyso we should still have the same behavior17:03
stephenfinyes17:03
sean-k-mooneyBLZbubba: is this breaking you some how?17:03
sean-k-mooneyBLZbubba: os_secure_boot prior to the wallaby relesae was only suppoted by hyperv17:04
BLZbubbaI'm using ubunbu lts: 2:21.1.2-0ubuntu117:05
sean-k-mooneyso ussuri17:06
BLZbubbayes17:06
sean-k-mooneyin that release the libvirt dirver does not support securebot or os_secure_boot17:06
sean-k-mooneyonly the hyperv driver supported os_secure_boot at that time17:07
sean-k-mooneyBLZbubba: your vms are not actlly using secure boot in this case17:07
BLZbubbaok thanks for the info.  I just know that if OVMF_CODE.secboot.fd is in the libvirt xml (which it is by default) they fail to boot.  but it sounds like it should work... i'll play around with the qemu options and see if I can figure this out.17:10
BLZbubbathanks!17:10
sean-k-mooneysound like there is a bug in the ovmf package that canonical is shiping in 20.0417:11
sean-k-mooneyi think they recently rebased the version fo qemu they ship in the cloud archive17:12
sean-k-mooneymaybe that broke something17:12
*** k_mouza has quit IRC17:16
*** k_mouza has joined #openstack-nova17:17
*** andrewbonney has quit IRC17:19
*** k_mouza has quit IRC17:22
*** ralonsoh has quit IRC17:26
erbarrhello, what could be causing this, I stacked last night with FORCE_CONFIG_DRIVE on ussuri and ran into it. Didn't see it on other branches up to train https://usercontent.irccloud-cdn.com/file/p1kmwH0W/image.png17:28
sean-k-mooneyits a python 3 issue17:29
sean-k-mooneyin this case i thik its cause by libguestfs17:30
sean-k-mooneylyarwood: gibi ^ is that the libguestfs issue ye were seeing in the gate17:30
lyarwoodthat's ironic so I wouldn't think so17:31
lyarwoodand configdrive related17:31
*** iurygregory has joined #openstack-nova17:31
*** iurygregory has quit IRC17:31
sean-k-mooneywell maybe its form makeiso17:32
openstackgerritMerged openstack/placement stable/wallaby: Add a reproduction test for bug story/2008831  https://review.opendev.org/c/openstack/placement/+/78752517:32
*** zzzeek has quit IRC17:32
sean-k-mooneyits the same bytes vs str issue17:32
lyarwoodhard to tell from that trace tbh17:32
lyarwoodyeah17:32
lyarwoodit's that underlying issue17:32
sean-k-mooneyso that being raised form here https://github.com/openstack/nova/blob/stable/ussuri/nova/virt/ironic/driver.py#L544-L54817:34
sean-k-mooneybut i feel like the excption is actully happening in ironic17:34
sean-k-mooneyand they are just propagating it up to us17:35
sean-k-mooneyerbarr: do you ahve any error in the ironic conductor for the deploy17:35
*** zzzeek has joined #openstack-nova17:36
*** iurygregory has joined #openstack-nova17:38
openstackgerritMerged openstack/placement stable/wallaby: Make sure the policy upgrade check get a valid config  https://review.opendev.org/c/openstack/placement/+/78752617:39
erbarrsean-k-mooney, looks similar and that's the only errors there: https://usercontent.irccloud-cdn.com/file/aPWzwmpk/image.png17:43
sean-k-mooneyyep the node is the same17:45
sean-k-mooneyso its an ironic bug17:45
openstackgerritMerged openstack/placement master: Add weekly jobs  https://review.opendev.org/c/openstack/placement/+/78750817:45
erbarrokay, thanks17:46
sean-k-mooneyhttps://opendev.org/openstack/ironic/src/branch/stable/ussuri/ironic/conductor/deployments.py#L351-L36017:46
sean-k-mooneythe file is being opened in text mode17:46
sean-k-mooneymode=wt17:47
sean-k-mooneyso im not sure why its saying it need a byte like obejct17:47
sean-k-mooneyoh there we go https://opendev.org/openstack/ironic/commit/0da73cdd30f6726548992090bb3626292e3518b017:47
sean-k-mooneyerbarr: your missing ^17:47
sean-k-mooneyerbarr: do you have [deploy]configdrive_use_object_store=True set17:49
sean-k-mooneythat was only merge 2 months ago so you likely are just missing that in your deployment but that shoudl fix your issue17:50
erbarri stacked yesterday, so does that go in ironic.conf?17:51
erbarrthat is set to true :(17:52
sean-k-mooneywhen you say stacked you mean devstack. unless you have RECLONE=True set it wont update your repos17:52
sean-k-mooneyso you might need to manually do a pull on the ironic one17:53
sean-k-mooneybecareful with RECLONE=ture if you do developemnt in the repos in /opt/stack17:53
sean-k-mooneysince it will delete them17:53
erbarrit was a fresh vm17:54
sean-k-mooneywell not quite but it will erase any work you dont have commited so if you use it you shoudl keep the reposyou work on somehere else.17:54
sean-k-mooneyerbarr: ok well maybe the have regressed it17:54
erbarri'll check the code and play around with it, thanks!17:55
sean-k-mooneyerbarr: i would doble check the file to be sure and if you see mode=wt then ping the ironic channel and ask17:55
sean-k-mooneyno worries hopfully its something tirvial17:55
sean-k-mooneyerbarr: dtantsur|afk: wrote the previous fix so they will like know where to look to fix it if its still happening17:56
erbarrcool, thanks!17:57
*** dave-mccowan has quit IRC18:06
*** dave-mccowan has joined #openstack-nova18:07
*** macz_ has joined #openstack-nova18:09
*** macz_ has quit IRC18:14
*** belmoreira has quit IRC18:16
*** links has quit IRC18:24
*** tbachman has quit IRC18:28
*** zzzeek has quit IRC18:41
*** zzzeek has joined #openstack-nova18:42
*** k_mouza has joined #openstack-nova19:17
*** k_mouza has quit IRC19:23
*** macz_ has joined #openstack-nova19:25
*** macz_ has quit IRC19:25
*** macz_ has joined #openstack-nova19:26
*** ociuhandu has joined #openstack-nova19:47
*** ociuhandu has quit IRC19:54
*** tbachman has joined #openstack-nova19:57
*** jobewan has quit IRC20:03
*** amodi has quit IRC20:04
*** amodi has joined #openstack-nova20:15
*** amodi has quit IRC20:17
*** amodi has joined #openstack-nova20:24
*** amodi has quit IRC20:26
*** amodi has joined #openstack-nova20:32
openstackgerritmelanie witt proposed openstack/nova stable/queens: Use subqueryload() instead of joinedload() for (system_)metadata  https://review.opendev.org/c/openstack/nova/+/76181420:36
*** macz_ has quit IRC20:37
*** slaweq has quit IRC21:21
*** rcernin has joined #openstack-nova21:44
*** martinkennelly has quit IRC21:51
*** rcernin has quit IRC21:56
*** rcernin has joined #openstack-nova22:02
*** haleyb has quit IRC22:20
*** haleyb has joined #openstack-nova22:22
*** luksky has quit IRC22:24
*** rcernin has quit IRC22:37
*** martinkennelly has joined #openstack-nova22:49
*** whoami-rajat has quit IRC23:13
*** k_mouza has joined #openstack-nova23:18
*** rcernin has joined #openstack-nova23:19
*** k_mouza has quit IRC23:22
*** tosky has quit IRC23:40
*** martinkennelly has quit IRC23:48
*** k_mouza has joined #openstack-nova23:57
« Wednesday, 2021-04-28 Index Friday, 2021-04-30 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!