Friday, 2019-09-13

openstackgerritMerged openstack/nova master: Support reverting migration / resize with bandwidth  https://review.opendev.org/67614000:02
*** kaliya has joined #openstack-nova00:03
*** kaliya has quit IRC00:08
donnydsean-k-mooney: is FN giving you any issues?00:09
donnydlooks like you have some jobs running00:09
*** gbarros has quit IRC00:28
*** henriqueof1 has joined #openstack-nova00:45
*** henriqueof has quit IRC00:45
*** gbarros has joined #openstack-nova00:49
*** Garyx_ has quit IRC00:49
*** gyee has quit IRC00:53
*** gbarros has quit IRC00:59
*** markvoelker has joined #openstack-nova01:01
*** Garyx has joined #openstack-nova01:03
*** markvoelker has quit IRC01:05
brinzhangmelwitt: mriedem: Thanks01:10
*** mlavalle has quit IRC01:10
*** mriedem_afk has quit IRC01:23
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove an unused file and a related description  https://review.opendev.org/68195501:41
*** mkrai has joined #openstack-nova01:42
*** tbachman has joined #openstack-nova01:48
*** dolpher has quit IRC01:49
*** tkajinam has quit IRC01:54
*** brinzhang_ has joined #openstack-nova01:59
*** brinzhang_ has quit IRC02:01
*** brinzhang_ has joined #openstack-nova02:01
*** brinzhang has quit IRC02:02
*** kaliya has joined #openstack-nova02:05
*** kaliya has quit IRC02:09
*** tkajinam has joined #openstack-nova02:11
*** markvoelker has joined #openstack-nova02:26
*** gaoyan has joined #openstack-nova02:27
*** hongbin has joined #openstack-nova02:32
*** tkajinam has quit IRC02:36
*** markvoelker has quit IRC02:36
*** markvoelker has joined #openstack-nova02:38
*** markvoelker has quit IRC02:43
*** tkajinam has joined #openstack-nova02:56
*** dklyle has quit IRC02:57
*** sapd1 has joined #openstack-nova03:00
*** dklyle has joined #openstack-nova03:00
openstackgerritMerged openstack/nova master: Add nova-status to man-pages list  https://review.opendev.org/68173303:15
*** tbachman has quit IRC03:29
openstackgerritMerged openstack/nova master: trivial: Remove single-use classmethod  https://review.opendev.org/68175103:31
*** tbachman has joined #openstack-nova03:32
*** hongbin has quit IRC03:34
*** factor has quit IRC03:35
*** shilpasd has joined #openstack-nova03:56
*** shilpasd has quit IRC03:57
*** eharney has joined #openstack-nova04:11
*** markvoelker has joined #openstack-nova04:16
*** markvoelker has quit IRC04:21
*** eharney has quit IRC04:27
*** zhubx has quit IRC05:00
*** zhubx has joined #openstack-nova05:01
*** pcaruana has joined #openstack-nova05:02
*** sapd1_x has joined #openstack-nova05:05
*** udesale has joined #openstack-nova05:08
*** ratailor has joined #openstack-nova05:08
*** Luzi has joined #openstack-nova05:23
*** mkrai has quit IRC05:23
*** mkrai has joined #openstack-nova05:25
*** damien_r has joined #openstack-nova05:31
*** damien_r has quit IRC05:36
*** gaoyan has quit IRC05:50
*** tkajinam has quit IRC05:54
gibihappy rechecking morning nova06:02
*** tkajinam has joined #openstack-nova06:03
*** xek has joined #openstack-nova06:03
*** rpittau|afk is now known as rpittau06:08
*** xek has quit IRC06:12
*** xek has joined #openstack-nova06:13
*** ralonsoh has joined #openstack-nova06:14
*** tkajinam_ has joined #openstack-nova06:19
*** sapd1_x has quit IRC06:20
*** tkajinam has quit IRC06:22
gibiok I think I rechecked every approved but failed nova patch06:24
*** mkrai has quit IRC06:25
*** mkrai_ has joined #openstack-nova06:25
gibi32 approved nova patches in the check queue 3 in the gate queue06:26
*** henriqueof has joined #openstack-nova06:27
*** henriqueof1 has quit IRC06:28
*** avolkov has joined #openstack-nova06:29
*** sapd1_x has joined #openstack-nova06:46
*** slaweq has joined #openstack-nova06:50
*** maciejjozefczyk has joined #openstack-nova06:52
*** lpetrut has joined #openstack-nova06:54
*** trident has quit IRC06:55
*** xek has quit IRC06:56
*** sapd1_x has quit IRC06:59
gibiThe todays killer bug is: bug 1813147 - p35 jobs are failing with subunit.parser ... FAILED06:59
openstackbug 1813147 in OpenStack Compute (nova) "p35 jobs are failing with subunit.parser ... FAILED" [High,In progress] https://launchpad.net/bugs/1813147 - Assigned to Balazs Gibizer (balazs-gibizer)06:59
*** jkulik has joined #openstack-nova07:02
*** udesale has quit IRC07:04
*** trident has joined #openstack-nova07:07
*** mkrai_ has quit IRC07:10
*** Florian has joined #openstack-nova07:10
*** damien_r has joined #openstack-nova07:12
*** henriqueof has quit IRC07:12
*** henriqueof has joined #openstack-nova07:12
*** tesseract has joined #openstack-nova07:15
openstackgerritMerged openstack/nova master: Add user_id and project_id column to Migration  https://review.opendev.org/67399007:15
openstackgerritMerged openstack/nova master: Cleanup reno live-migration-with-PCI-device  https://review.opendev.org/68194207:15
*** gaoyan has joined #openstack-nova07:18
*** ralonsoh has quit IRC07:19
brinzhang_good morning gibi07:19
gibibrinzhang_: good morning07:20
*** tssurya has joined #openstack-nova07:20
*** ralonsoh has joined #openstack-nova07:21
*** ttsiouts has joined #openstack-nova07:26
*** jaosorior has joined #openstack-nova07:35
*** ttsiouts has quit IRC07:36
*** ttsiouts has joined #openstack-nova07:37
*** ttsiouts has quit IRC07:41
bauzasgood morning folks07:45
gibigood morning bauzas07:47
openstackgerritTakashi NATSUME proposed openstack/nova master: doc: mark the max microversion for train  https://review.opendev.org/68198207:49
*** priteau has joined #openstack-nova07:57
kashyapefried: aspiers: I was ill yesterday (and partly today).  Reading the relevant bits.07:59
*** ttsiouts has joined #openstack-nova07:59
*** ivve has joined #openstack-nova08:00
kashyapaspiers: No, that reference to 'vexpress-a15' is _not_ correct: it should be 'virt' for ARMv7 or AArch64.08:00
kashyapaspiers: See the releasenotes/notes/Use-virt-as-machine-type-for-ARMv7-cd2c252336057ec8.yaml08:01
*** tkajinam_ has quit IRC08:01
kashyapaspiers: That Glance doc should be updated08:02
bauzasgibi: I eventually went unable to join yesterday evening08:02
bauzasgibi: any idea on where we are ?08:02
bauzasdid we cut the cord ?08:02
*** mkrai_ has joined #openstack-nova08:02
bauzasI see a lot of merge conflicts as expected08:02
kashyapaspiers: For reference, see this: https://opendev.org/openstack/nova/commit/e155baefb008:03
gibibauzas: the bw series is approved. I see vpmem in also approved08:03
bauzasgibi: actually, nevermind, I'll read the nova meeting logs08:03
bauzasgibi: the cpu-resources too, but it got conflicts08:03
gibibauzas: yepp08:04
*** awalende has joined #openstack-nova08:04
*** takashin has left #openstack-nova08:05
bauzasokay, so tl;dr: let's continue trying to merge stuff that was previously approved08:07
* bauzas now looks at the gate08:07
bauzasgibi: how is your series ? still in the weeds ?08:07
gibibauzas: one patch merged during the night, rest is in check queue after recheck08:09
bauzasack08:11
kashyapaspiers: Sent the doc fix to Glance: https://review.opendev.org/681990 useful-image-properties: Update note on machine types08:13
*** ccamacho has joined #openstack-nova08:14
*** ccamacho has quit IRC08:14
*** ccamacho has joined #openstack-nova08:18
*** BlackDex has left #openstack-nova08:31
openstackgerritIvaylo Mitev proposed openstack/nova master: VMware: Update flavor-related metadata on resize  https://review.opendev.org/68100408:33
*** mkrai_ has quit IRC08:38
*** mkrai__ has joined #openstack-nova08:38
luyaostephenfin: are you around, I see you string the vpmems and cpu resources, they merge conflict now08:38
luyaostephenfin: I'll rebase to master branch08:39
*** mkrai__ has quit IRC08:39
*** mkrai__ has joined #openstack-nova08:40
luyaostephenfin: this is the last patch , right ? https://review.opendev.org/#/c/674895/4108:41
*** raghavendrat has joined #openstack-nova08:42
*** markvoelker has joined #openstack-nova08:44
*** derekh has joined #openstack-nova08:45
*** mkrai__ has quit IRC08:45
*** markvoelker has quit IRC08:49
*** ralonsoh has quit IRC08:51
*** IvensZambrano has joined #openstack-nova08:54
openstackgerritLuyao Zhong proposed openstack/nova master: db: Add resources column in instance_extra table  https://review.opendev.org/67844708:55
openstackgerritLuyao Zhong proposed openstack/nova master: object: Introduce Resource and ResourceList objs  https://review.opendev.org/67844808:55
openstackgerritLuyao Zhong proposed openstack/nova master: Add resources dict into _Provider  https://review.opendev.org/67844908:55
openstackgerritLuyao Zhong proposed openstack/nova master: Retrieve the allocations early  https://review.opendev.org/67845008:55
openstackgerritLuyao Zhong proposed openstack/nova master: Claim resources in resource tracker  https://review.opendev.org/67845208:55
openstackgerritLuyao Zhong proposed openstack/nova master: libvirt: Enable driver discovering PMEM namespaces  https://review.opendev.org/67845308:55
openstackgerritLuyao Zhong proposed openstack/nova master: libvirt: report VPMEM resources by provider tree  https://review.opendev.org/67845408:55
openstackgerritLuyao Zhong proposed openstack/nova master: libvirt: Support VM creation with vpmems and vpmems cleanup  https://review.opendev.org/67845508:55
openstackgerritLuyao Zhong proposed openstack/nova master: Parse vpmem related flavor extra spec  https://review.opendev.org/67845608:55
openstackgerritLuyao Zhong proposed openstack/nova master: libvirt: Enable driver configuring PMEM namespaces  https://review.opendev.org/67964008:55
openstackgerritLuyao Zhong proposed openstack/nova master: libvirt: Start reporting PCPU inventory to placement  https://review.opendev.org/67179308:55
openstackgerritLuyao Zhong proposed openstack/nova master: libvirt: '_get_(v|p)cpu_total' to '_get_(v|p)cpu_available'  https://review.opendev.org/67269308:55
openstackgerritLuyao Zhong proposed openstack/nova master: objects: Add 'InstanceNUMATopology.cpu_pinning' property  https://review.opendev.org/68010608:55
openstackgerritLuyao Zhong proposed openstack/nova master: Validate CPU config options against running instances  https://review.opendev.org/68010708:55
openstackgerritLuyao Zhong proposed openstack/nova master: trivial: Use sane indent  https://review.opendev.org/68022908:55
openstackgerritLuyao Zhong proposed openstack/nova master: objects: Add 'NUMACell.pcpuset' field  https://review.opendev.org/68010808:55
openstackgerritLuyao Zhong proposed openstack/nova master: hardware: Differentiate between shared and dedicated CPUs  https://review.opendev.org/67180008:55
openstackgerritLuyao Zhong proposed openstack/nova master: libvirt: Start reporting 'HW_CPU_HYPERTHREADING' trait  https://review.opendev.org/67557108:55
*** ralonsoh has joined #openstack-nova08:55
bauzasluyao: AFAICS, looks like stephenfin rebased his series on top of yours to prevent more merge conflicts08:59
bauzasstephenfin: correct ?08:59
*** jaosorior has quit IRC09:00
luyaobauzas: I think so, I handled the merge conflict due to my first two patches09:01
*** ttsiouts has quit IRC09:02
*** ttsiouts has joined #openstack-nova09:03
*** kaliya has joined #openstack-nova09:03
bauzascool09:05
*** ttsiouts has quit IRC09:07
*** kaliya has quit IRC09:08
*** ttsiouts has joined #openstack-nova09:14
*** udesale has joined #openstack-nova09:15
*** Florian has quit IRC09:19
*** FlorianFa has joined #openstack-nova09:19
*** jawad_axd has joined #openstack-nova09:19
aspierskashyap: thanks, please see also https://review.opendev.org/#/c/681866/09:24
*** boxiang has joined #openstack-nova09:24
kashyapaspiers: Ah, it's the other thing you mentioned; metadata props.  Nice09:25
*** zhubx has quit IRC09:27
kashyapaspiers: +1, FWIW.  Wauw, given the number of values/props, could spot no typos :D09:30
*** ivve has quit IRC09:32
* bauzas disappears 09:40
*** mkrai has joined #openstack-nova09:41
aspierskashyap: why is ARM singled out in these docs when we have other defaults for other archs?09:41
kashyapaspiers: I don't know who wrote it originally.  But I agree, we should be complete and specify the defaults for other arches, too?09:43
aspiersThat was my thought09:43
stephenfinluyao: Correct. Looks like you have it handled. Thanks :)09:43
kashyapMention it in the review, please.09:43
aspierskashyap: We probably also need comments in the nova code "# if you change this, don't forget to change useful-image-properties.rst in glance"09:43
kashyapaspiers: Yes, good reminder, to keep things in sync09:44
*** mdbooth has quit IRC09:44
aspierskashyap: I'll do that now09:44
*** mdbooth has joined #openstack-nova09:46
aspierskashyap: hw_machine_type is not the only thing needing a reminder, what else?09:47
*** ralonsoh has quit IRC09:48
*** ralonsoh has joined #openstack-nova09:48
aspiershw_*_bus is one09:49
*** gaoyan has quit IRC09:50
*** ralonsoh has quit IRC09:50
*** ralonsoh has joined #openstack-nova09:53
kashyapaspiers: Yeah, hw_*_bus and machine type are the only things that come to mind09:55
*** udesale has quit IRC09:56
*** udesale has joined #openstack-nova09:57
*** ttsiouts has quit IRC09:57
*** ttsiouts has joined #openstack-nova09:57
openstackgerritAdam Spiers proposed openstack/nova master: Add reminder to update corresponding glance docs  https://review.opendev.org/68201210:01
aspierskashyap: ^^^10:01
*** cdent has joined #openstack-nova10:01
*** ttsiouts has quit IRC10:02
kashyapaspiers: Already has it open10:04
*** tkajinam has joined #openstack-nova10:05
*** ivve has joined #openstack-nova10:05
*** ociuhandu has joined #openstack-nova10:06
*** ociuhandu has quit IRC10:07
kashyapaspiers: Reviewed; only thing is - do you want to spell out the name of the document?10:10
aspierskashyap: I removed that from the first version, because it could change, and anyway there are multiple files10:10
aspiersthere's the metadefs JSON too10:10
kashyapaspiers: Okay, thought so.10:10
* cdent waves10:11
* kashyap waves back10:11
kashyapaspiers: And on casing, is my guess correct?10:11
*** pcaruana has quit IRC10:11
aspierskashyap: replied10:22
*** ociuhandu has joined #openstack-nova10:23
*** mkrai has quit IRC10:24
*** ociuhandu has quit IRC10:28
kashyapaspiers: So I have to "unlearn" the capitalization everywhere except at the start of sentence.10:31
aspierskashyap: IIUC10:31
kashyapOkido; regardless, the change is ready for merge :-)10:32
* kashyap --> bbiab10:32
*** luksky has joined #openstack-nova10:36
*** ociuhandu has joined #openstack-nova10:38
openstackgerritTakashi Kajinami proposed openstack/nova master: Add an option to pass extra parameters for libvirt migration uri  https://review.opendev.org/68201910:40
stephenfingibi: I'd say hold on rechecking the mox patches10:40
stephenfinWe discussed it in the meeting last night and decided to wait until U to merge those now since the gate is busted10:41
openstackgerritTakashi Kajinami proposed openstack/nova master: Add an option to pass extra parameters for libvirt migration uri  https://review.opendev.org/68201910:43
*** ociuhandu has quit IRC10:44
*** tbachman has quit IRC10:45
openstackgerritTakashi Kajinami proposed openstack/nova master: Add an option to pass extra parameters for libvirt migration uri  https://review.opendev.org/68201910:49
*** awalende has quit IRC10:52
*** awalende has joined #openstack-nova10:53
*** elod has quit IRC10:54
*** awalende has quit IRC10:54
*** awalende has joined #openstack-nova10:54
openstackgerritMerged openstack/nova master: Func test for migrate re-schedule with bandwidth  https://review.opendev.org/67697210:55
*** jawad_axd has quit IRC10:55
*** elod has joined #openstack-nova10:55
*** jawad_axd has joined #openstack-nova10:55
tkajinamping stephenfin10:58
*** luksky has quit IRC11:09
openstackgerritTakashi NATSUME proposed openstack/nova master: Fix a misuse of assertGreaterEqual  https://review.opendev.org/68202511:11
*** takashin has joined #openstack-nova11:13
takashinHi, core reviewers. Would you review this patch https://review.opendev.org/#/c/682025/ related to a gate failure?11:14
cdentgood find takashin11:17
*** lpetrut has quit IRC11:20
*** sapd1_x has joined #openstack-nova11:22
*** pcaruana has joined #openstack-nova11:24
*** luksky has joined #openstack-nova11:26
*** luksky11 has joined #openstack-nova11:28
*** takashin has left #openstack-nova11:29
*** luksky has quit IRC11:31
*** jawad_axd has quit IRC11:37
*** jawad_axd has joined #openstack-nova11:37
*** udesale has quit IRC11:40
*** luksky11 has quit IRC11:40
*** udesale has joined #openstack-nova11:41
*** ociuhandu has joined #openstack-nova11:41
*** lpetrut has joined #openstack-nova11:42
*** ociuhandu has quit IRC11:42
*** luksky11 has joined #openstack-nova11:56
*** raghavendrat has quit IRC11:57
*** lpetrut has quit IRC11:59
*** lpetrut has joined #openstack-nova11:59
*** awalende has quit IRC12:01
*** awalende has joined #openstack-nova12:02
*** tbachman has joined #openstack-nova12:04
*** markvoelker has joined #openstack-nova12:04
sean-k-mooneydonnyd: i have had no issue with any of the FN jobs that have been run in the last 24 hours. they all completed fine. the reson we are rechcking them is to pick up different versions fo the code. i am using a feature of how zuul works to mean i dont need to keep rebasing the zuul job to test diffent parts of the code via an in repo depends on12:06
*** awalende has quit IRC12:06
*** awalende has joined #openstack-nova12:09
donnydsean-k-mooney: that is great news12:14
donnydLet me know if there is anything else I can do12:14
sean-k-mooneydonnyd: at this point we are just waiting on zuul. also my brain is mostly fried after the last few days so im not going to be doing much more until next week12:16
gibistephenfin: ack12:17
sean-k-mooneydonnyd: my next ci task is to create the nodepool lable for nested-virt-bionic and update my ovs-dpdk job https://review.opendev.org/#/c/656580/ then work with limestone and/or vexxhost to expand the multi-numa lable to them and try and enable the whitebox tempest pluging in the nfv job we have been Running against FN12:19
*** ttsiouts has joined #openstack-nova12:19
*** ratailor has quit IRC12:20
sean-k-mooneydonnyd: the white box tempest pluging, combined with writing some new standard test will allow me to compress the many fo the temport jobs down into 1 job12:21
sean-k-mooneydonnyd: which im hoping to run as a perodic job intially and eventuly move to check after its stableised.12:21
sean-k-mooneydonnyd: so for now relax, you have done more then enough to help with this effort12:22
*** luksky11 has quit IRC12:22
*** ociuhandu has joined #openstack-nova12:22
donnydI'm very glad I could be helpful.12:23
*** luksky11 has joined #openstack-nova12:23
*** tkajinam has quit IRC12:25
sean-k-mooneydonnyd: for what its worth this is the set of ci topic we talked about last PTG https://etherpad.openstack.org/p/nova-ptg-train-ci12:26
*** jaosorior has joined #openstack-nova12:27
sean-k-mooneydonnyd: line 36 multi numa guests and basically everytin form line 31 to 45 is what you have allowed us to start testing12:28
donnydWell if fn can do anything else,  never be afraid to ask12:30
*** sapd1_x has quit IRC12:31
sean-k-mooneyefried: speaking of that etherpad line 29 https://etherpad.openstack.org/p/nova-ptg-train-ci can i anounce/propose the deprectation fo libvirt with virt-type uml12:32
*** ociuhandu has quit IRC12:32
sean-k-mooneyefried: there are other virt types that also shoudl be marked experimenal or deprecated but too slince they have no testing. lxc is almost workign again but there are defiently gaps12:33
sean-k-mooneyso i kind of want to hold off on that until Ussuri12:34
*** boxiang has quit IRC12:35
sean-k-mooneyefried: mriedem has an experimal lxc job and we have patches to fixed some of the short comings with cloud init https://review.opendev.org/#/c/667976/12:35
*** boxiang has joined #openstack-nova12:35
*** jawad_ax_ has joined #openstack-nova12:38
*** ociuhandu has joined #openstack-nova12:39
*** jawad_axd has quit IRC12:41
openstackgerritBalazs Gibizer proposed openstack/nova master: Follow up for I220fa02ee916728e241503084b14984bab4b0c3b  https://review.opendev.org/68081012:42
*** dave-mccowan has joined #openstack-nova12:44
*** lpetrut has quit IRC12:48
*** henriqueof1 has joined #openstack-nova12:49
*** belmoreira has quit IRC12:49
*** henriqueof has quit IRC12:50
*** lpetrut has joined #openstack-nova12:53
*** ociuhandu has quit IRC12:58
*** dave-mccowan has quit IRC12:58
donnydsean-k-mooney: I'm pretty interested in lxc functionality due to my resources not being as much as some others out there12:59
sean-k-mooneyya it would be nice to get it working fully again13:00
sean-k-mooneyi was able to boot a contianer and inject keys with that cloud init patch13:00
donnydAnd knocking down targets from the ptg is a good thing too13:01
sean-k-mooneythe next gap for lxc that i hit while testing it is we are not correctly resizing the filesystme in the image to match the route disk on the flaovr13:02
sean-k-mooneyand you cant do it inside the contianer13:02
sean-k-mooneyso we would have to fix that before i would be comfortable useing it in production13:02
*** Luzi has quit IRC13:06
*** luksky11 has quit IRC13:06
*** ociuhandu has joined #openstack-nova13:07
openstackgerritLee Yarwood proposed openstack/nova master: Use os-brick locking for volume attach and detach  https://review.opendev.org/61419013:09
lyarwood^ any cores around, is it too late in the cycle to land bugfixes that bump requirements.txt?13:10
lyarwoodor is that not even a thing until rc?13:10
*** ociuhandu has quit IRC13:12
*** ociuhandu has joined #openstack-nova13:16
stephenfingibi: You should probably hit https://review.opendev.org/#/c/682025/13:17
stephenfinlyarwood: I've no idea. Might be a good thing to ask on #openstack-requirements ?13:18
stephenfinor wait for mriedem, I guess13:18
*** mriedem has joined #openstack-nova13:18
*** jawad_ax_ has quit IRC13:18
*** jawad_axd has joined #openstack-nova13:19
stephenfinspeak of the devil13:20
mriedemmuwahahahaha?13:21
* tbachman wonders how mriedem knew he was the devil13:22
stephenfin<openstackgerrit> Lee Yarwood proposed openstack/nova master: Use os-brick locking for volume attach and detach  https://review.opendev.org/61419013:22
stephenfin<lyarwood> ^ any cores around, is it too late in the cycle to land bugfixes that bump requirements.txt?13:22
stephenfinmriedem: ^13:22
*** jawad_ax_ has joined #openstack-nova13:22
mriedemseems a bit risky to land that right now,13:23
mriedemthat's something i'd rather land early in U and let it bake13:23
mriedemb/c fallout from that would probably be weird and hard to determine13:23
*** jawad_axd has quit IRC13:24
lyarwoodyup that's fair and on me for not pushing this earlier in the cycle13:25
mriedemi think it's also a low severity issue,13:26
mriedemi left some comments in the patch13:26
lyarwoodack thanks13:26
*** jaosorior has quit IRC13:26
*** jawad_ax_ has quit IRC13:28
*** jawad_axd has joined #openstack-nova13:29
efriedsean-k-mooney: "deprectation fo libvirt with virt-type uml" I don't know what that means.13:31
*** ttsiouts has quit IRC13:31
efriedSo, sure, you can propose it, but someone who knows more than me might reject your proposal :)13:31
*** ttsiouts has joined #openstack-nova13:32
sean-k-mooneythe libvirt virt dirver support multiple virt-types that match to different dirver in libvirt13:32
sean-k-mooneyUML is user mode linux13:32
sean-k-mooneyi dont think we have ever had ci for that and dont know of anyone that support it in a product13:33
*** eharney has joined #openstack-nova13:33
*** jawad_axd has quit IRC13:33
sean-k-mooneywe talked about deprecating libvirt virt types that do not have ci at the ptg in the test/ci session13:34
*** ttsiouts_ has joined #openstack-nova13:34
sean-k-mooneysince we are going to do that for xenserver i was wondering if we should do it for uml13:34
*** ttsiouts has quit IRC13:35
sean-k-mooneyagain its more of a shot across the bow.13:35
dansmithsean-k-mooney: I'd be fine with deprecation or straight removal, but I'm not sure it's worth it13:35
dansmiththe xen deprecation brings benefit, I'm not sure deprecating or removing uml is anything other than more work13:36
sean-k-mooneywe have a few conditional in the libvirt dirver to handel it13:36
dansmithI know13:36
sean-k-mooneyso we could remove those13:36
sean-k-mooneybut it not a huge benifit13:36
dansmithwhich is work for minimal benefit :)13:36
sean-k-mooneyya13:37
dansmithbut if you want to do it I don't think there's any reason to keep it13:37
sean-k-mooneywell its not like anyone has filed a bug for it in years13:37
sean-k-mooneywhicih is proably the primary inicator no one is useing it13:38
sean-k-mooneywell there is one https://bugs.launchpad.net/nova/+bug/159775413:38
openstackLaunchpad bug 1597754 in OpenStack Compute (nova) "Unable to boot instance using UML" [Low,Triaged]13:38
sean-k-mooneythat seams like an imporant action for a virt type to support :)13:39
efriedHell, even powervm could do THAT.13:41
sean-k-mooney:)13:41
dansmithI'd guess that was someone bored on a thursday evening, just trying to see if it still works13:42
dansmithI'd bet it's less flexible than ironic even, probably fails the support matrix test13:42
sean-k-mooneyit was reported by mdbooth so i suspect it was filed when he was working on https://review.opendev.org/#/q/status:abandoned+topic:libvirt-imagebackend13:43
dansmithheh13:43
* dansmith didn't even clic13:43
sean-k-mooneyhe fixed it in his image backend erfactor which we never merged.13:44
efriedSo I'm having kind of a hard time believing that nova's gate throughput is on par with everyone else's, even in absolute numbers. Are small projects literally getting like two results every three hours?13:45
efriedi.e. the algorithm is broken13:46
sean-k-mooneyefried: we are effectivly down 2 ci providres at the momemnt i think13:46
efriedoh?13:46
sean-k-mooneyi think FN is still scaled down and we are having issue with vexxhost and boot form volume13:47
sean-k-mooneyand by we i mean infra13:47
sean-k-mooneyso maybe13:47
mriedemtoday is then a docs and education friday!13:49
efriedOkay, well, I'm going to more or less take the day off, just watch and recheck.13:49
efriedI think mriedem has me on some messaging app or other if I'm needed.13:50
mriedemhow about commenting on the highlights patch which is due today https://review.opendev.org/#/c/681943/13:51
efriedhave I not done that?13:51
mriedemdansmith: ^ words on the live migration + numa + cpu pinning + huge pages thing?13:51
mriedemefried: oh i guess you did13:52
mriedemor artom i guess ^13:52
efriedI'm basically +1 on whatever you wind up with. alex_xu or luyao could add some words about vpmem, but I'm not sure if that's supposed to be a tech preview or a trumpet-from-rooftops, or whatever13:52
efriedalso, I think "first draft" was due today, so we're done :P13:53
artommriedem, I'm happy with it, left a note13:54
*** cdent has quit IRC13:57
*** ratailor has joined #openstack-nova14:00
stephenfindansmith/mriedem/efried: This is going to cause gate issues and should be merged, right? https://review.opendev.org/68202514:07
*** gbarros has joined #openstack-nova14:07
* stephenfin thinks the original patch was to fix gate issues14:07
mriedemsob14:11
mriedemno wonder this didn't go down :/ http://status.openstack.org/elastic-recheck/#184361514:12
* mriedem gets out the harakiri sword14:12
*** JamesBenson has joined #openstack-nova14:15
sean-k-mooneymriedem: i did get a passing test run with numa+pcpus+vpmem last night by the way14:21
mriedemhow are you testing vpmem in the gate?14:22
sean-k-mooneyhttps://review.opendev.org/#/c/681771/ https://zuul.opendev.org/t/openstack/build/6a67b28d6e9e4b739e7575df7943a69d14:22
mriedemdoesn't that require special hardware?14:22
sean-k-mooneyit just had the code merged14:22
sean-k-mooneydidnt test the feature14:22
mriedemstephenfin: thanks for calling that out - infra just pushed it to the gate14:22
stephenfinnp14:23
sean-k-mooneybut we did test with pinning+hugepage+multi numa https://review.opendev.org/#/c/681771/2/playbooks/nfv/nfv.yaml14:23
*** ratailor has quit IRC14:24
mriedemsean-k-mooney: iow, vpmem didn't obviously regress any RT stuff with numa+pcpu in the same run14:24
sean-k-mooneymriedem: right14:25
sean-k-mooneyno idea if it works14:25
sean-k-mooneybut when its not used it does not seam to break anything14:25
sean-k-mooneyunfortuetly it looks like the intel pmem ci did not run on that14:26
mriedemidk if it's the new version of firefox i'm on, but i can't copy text from gerrit comments anymore, which is super annoying14:27
dansmithfrom non-editing ones, I have the same issue in chrome14:27
dansmithnot always consistent, but sometimes.. it's weird14:28
sean-k-mooneyi have been having issue with that too but i can sometimes get ti to work14:28
*** panda|ruck has quit IRC14:28
*** panda has joined #openstack-nova14:29
*** xek has joined #openstack-nova14:32
*** xek_ has joined #openstack-nova14:35
*** mlavalle has joined #openstack-nova14:35
melwittyeah, same. I couldn't remember if copying from comments in gerrit was ever possible (I guess it was)14:36
*** xek has quit IRC14:37
sean-k-mooneyi can get ctrl+insert to wrok and ctrl+c to work in some cases but its really inconsitent14:40
*** rcernin has quit IRC14:42
*** jangutter has quit IRC14:42
*** lpetrut has quit IRC14:43
mriedemdo we have a patch up to mark train in the rest api history doc?14:45
*** ociuhandu has quit IRC14:45
openstackgerritMatt Riedemann proposed openstack/nova master: Denote max version for Train in REST API history doc  https://review.opendev.org/68206914:47
*** tbachman has quit IRC14:48
dansmithmriedem: do you want to throw an rpc alias in there?14:50
mriedemseparate patch?14:51
dansmithboth are aliases right?14:51
mriedemsean-k-mooney: adrianc: shouldn't the note here https://docs.openstack.org/nova/latest/admin/pci-passthrough.html be updated to mention sriov live migratoin support in train?14:51
mriedemdansmith: feel free to throw something up, i'm trying to wrap up these cycle highlights14:51
dansmithjust seemed like appropriate for the same patch but okay14:51
sean-k-mooneynot really14:52
sean-k-mooneythat is flavor based pci passthouhg14:52
*** gbarros has quit IRC14:53
sean-k-mooneywe could not that if you dont use this you can doe neutron based sriov and live migate14:53
sean-k-mooneyif that is what you ment14:53
sean-k-mooneybut i prefer to keep the flavor based apparoch which uses an alias seperate form the neutron port approch which does not14:53
sean-k-mooneythe sriov live migration only work for neutron ports14:54
mriedemoh right yeah,14:54
mriedemguess i wouldn't have thought about that except for the conditionals in the RT claims code14:54
sean-k-mooneyya the proabme with generic pci devices is that even if the supprot sriov and you passthogh the PF14:58
sean-k-mooney*VF14:58
sean-k-mooneyguest kerenls generall dont expect gpus or fpga to go away and we  dont have an indireciton mecanisum like macvtap14:58
sean-k-mooneyso its not realy safe to detatch them wtihout impacting the guest14:58
*** ociuhandu has joined #openstack-nova14:59
sean-k-mooneyvfio-mediated device or mdev14:59
sean-k-mooneygive you that indrection but few thing support that yet14:59
sean-k-mooneywhich is why we declare all of the flavor based stuff out of scope and just did the simpelest thing which is nics14:59
sean-k-mooneythat is also what most people wanted15:00
mriedemhmm, i wonder if i should clarify that in the highlights,15:02
mriedembecause it just says "live migration support for sriov ports when using the libvirt driver"15:02
mriedemi guess "ports" is good enough?15:02
sean-k-mooneyam maybe but i would leave that up to more docs focused people15:03
sean-k-mooneyports is enough for me15:03
*** ociuhandu has quit IRC15:03
sean-k-mooneywe coudl say neutron ports15:03
mriedemas opposed to,15:04
mriedemwhat was that neutron replacement from cisco?15:04
sean-k-mooneyas aopposed to just sriov port say sriov neutron ports15:04
sean-k-mooneyvpp15:04
mriedemit had another name15:04
sean-k-mooney?15:04
sean-k-mooneyoh yes am15:04
mriedemthat yaml based port definition thing that was a drop in for neutron15:04
mriedemquark?15:04
sean-k-mooneyno but it was like that15:05
sean-k-mooneyprothon or some partical thing15:05
mriedemporthole15:05
mriedemanyway, saying "neutron ports" in openstack is redundant15:05
sean-k-mooneyya as i said it looks fine to me15:06
sean-k-mooneystephenfin: any opipion ^15:06
stephenfinnope :)15:06
*** tbachman has joined #openstack-nova15:09
*** awalende has quit IRC15:13
*** ociuhandu has joined #openstack-nova15:13
*** awalende has joined #openstack-nova15:13
mriedemstephenfin: wasn't this supposed to fail https://review.opendev.org/#/c/681938/ ?15:15
stephenfinYes. Yes it was.15:15
stephenfinSo my diagnosis is wrong15:16
stephenfinThat code is definitely wrong, on account of it leaving Nones in there, but what did I do to trigger it...15:16
* stephenfin investigates. 15:16
mriedemunless my patch is wrong15:16
stephenfinit looks okay15:16
*** ociuhandu has quit IRC15:18
mriedemi see that the flavor is configured properly from the n-cpu logs15:18
mriedemhttps://zuul.opendev.org/t/openstack/build/a7ae03ac0af24dc6b474a54de9d5cf86/log/controller/logs/screen-n-cpu.txt.gz#192415:18
mriedemSep 13 04:50:30.647385 ubuntu-bionic-rax-ord-0011241791 nova-compute[18284]: DEBUG nova.virt.hardware [None req-f2beffe4-882b-4f73-ab07-ba3c859361ab tempest-AggregatesAdminTestJSON-598247452 tempest-AggregatesAdminTestJSON-598247452] Getting desirable topologies for flavor Flavor(created_at=2019-09-13T04:48:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={trait:COMPUTE_NET_ATTACH_I15:18
mriedemFACE='required'},flavorid='42',id=11,is_public=True,memory_mb=64,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='443b7623e27ecf03dc9e01ee93f67afe',container_format='bare',created_at=2019-09-13T04:45:17Z,direct_url=<?>,disk_format='qcow2',id=e085b93e-a43c-42f1-9496-2b46f103dd3d,min_disk=0,min_ram=0,name='cirros-0.4.0-x86_64-disk',owner='432315:18
mriedemf86c41da98dc6230d777d7c4',properties=ImageMetaProps,protected=<?>,size=12716032,status='active',tags=<?>,updated_at=2019-09-13T04:45:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=18284) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}15:18
*** awalende_ has joined #openstack-nova15:18
*** awalende has quit IRC15:18
stephenfinmriedem: I know - you don't have cpu_model set on the host15:19
stephenfinor cpu_flags15:19
stephenfinboth in the 'libvirt' group15:19
mriedemand the scheduling request in placement15:19
mriedemhttps://zuul.opendev.org/t/openstack/build/a7ae03ac0af24dc6b474a54de9d5cf86/log/controller/logs/screen-placement-api.txt.gz#33715:19
stephenfinI missed that /o\15:19
mriedemoh15:20
mriedemso this is only if you use the cpu flag traits stuff15:20
stephenfinNot quite15:20
openstackgerritMerged openstack/nova master: Find instance in another cell during floating IP re-association  https://review.opendev.org/65659415:20
stephenfinIt's only if you have '[libvirt] cpu_model' and '[libvirt] cpu_flags' (or maybe just the first - I'll check) set on the host15:21
stephenfinwhich I _think_ most people will have because (a) live migration and (b) spectre/meltdown15:21
mriedemyou mean cpu_models and cpu_model_extra_flags yeah?15:21
stephenfinthat's the one15:22
mriedemand yeah those are both [] in this run15:22
stephenfinBecause we're not actually using the libvirt driver in the functional tests, it should be possible set both of those in a functional tests15:23
*** awalende_ has quit IRC15:23
stephenfinI'll check15:23
*** maciejjozefczyk is now known as mjozefcz|away15:23
mriedemso cpu_model was renamed to cpu_models in train, right?15:23
stephenfinit was. It's now a list15:24
mriedembecause i see https://docs.openstack.org/nova/stein/configuration/config.html#libvirt.cpu_model in stein but not in train and https://docs.openstack.org/nova/latest/configuration/config.html#libvirt.cpu_models in train but not stein15:24
mriedemso,15:24
*** TxGirlGeek has joined #openstack-nova15:24
mriedemif cpu_model isn't deprecated with a rename how is the upgrade handled? just checking for cpu_models first and if not found use cpu_model and log a warning to use the new option?15:24
stephenfindeprecated_name15:25
mriedembnemec: is there any kind of flag in oslo.config that says "kill the service on startup if using config options that aren't actually defined"?15:25
stephenfinListOpt works just like StrOpt if you only list one item15:25
mriedemoh there it is15:25
mriedembnemec: ignore15:25
*** tesseract has quit IRC15:25
*** igordc has joined #openstack-nova15:25
*** ociuhandu has joined #openstack-nova15:26
*** igordc has quit IRC15:27
*** igordc has joined #openstack-nova15:27
*** tbachman has quit IRC15:28
*** ivve has quit IRC15:29
mriedemso is there a model i could use in this devstack job that we could expect to be in a gate run, like IvyBridge? and i could probably just set cpu_model_extra_flags to pcid?15:29
mriedemor vmx or something?15:30
*** udesale has quit IRC15:30
*** udesale has joined #openstack-nova15:31
*** weshay|ruck has quit IRC15:31
sean-k-mooneyvmx would need nested virt but ya pcid would proably work15:31
stephenfinI'm using this https://gist.github.com/stephenfin/31a44d9cc40d9ce7abffadb5a6830cb1#file-local-conf-master-L25-L2815:31
*** gbarros has joined #openstack-nova15:31
stephenfinand that's on 6+ year old hardware so it should do the trick15:31
mriedemok i'll update my devstack patch15:31
*** igordc has quit IRC15:32
*** tbachman has joined #openstack-nova15:33
sean-k-mooney pcid was added in the first gen xeon i think back like 11 years ago15:33
*** ociuhandu has quit IRC15:33
sean-k-mooneyso ya that is safe15:33
sean-k-mooneywell15:33
sean-k-mooneyas long as the geate is useing it15:33
*** macz has joined #openstack-nova15:33
sean-k-mooneyit will proably work however15:34
mriedemwe'll see https://review.opendev.org/#/c/681938/15:34
*** dklyle has quit IRC15:35
mriedemupdated release cycle highlights https://review.opendev.org/68194315:36
*** dklyle has joined #openstack-nova15:36
*** ttsiouts_ has quit IRC15:37
*** ttsiouts has joined #openstack-nova15:38
*** damien_r has quit IRC15:40
*** ociuhandu has joined #openstack-nova15:42
*** ttsiouts has quit IRC15:42
*** artom has quit IRC15:43
*** mjozefcz|away has quit IRC15:43
aspiersI've just drafted a blog post on SEV. Feedback welcome: https://blog.adamspiers.org/?p=1871&preview=1&_ppp=1bfc4e4f7e15:45
*** ociuhandu has quit IRC15:46
*** IvensZambrano has quit IRC16:06
*** owalsh has quit IRC16:11
openstackgerritMatt Riedemann proposed openstack/nova master: api-ref: remove mention about os-migrations no longer being extended  https://review.opendev.org/68210216:18
*** mriedem is now known as mriedem_afk16:19
openstackgerritMatt Riedemann proposed openstack/nova master: api-ref: remove mention about os-migrations no longer being extended  https://review.opendev.org/68210216:19
*** rpittau is now known as rpittau|afk16:22
stephenfinaspiers: Can you check something for me?16:24
* stephenfin gets links16:24
*** eharney has quit IRC16:25
*** owalsh has joined #openstack-nova16:29
aspiersstephenfin: I'll try16:30
stephenfinsorry, got distracted16:31
stephenfinaspiers: https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L69716:31
stephenfinIsn't that line wrong? Should it read:16:31
stephenfinself._host.get_capabilities().host.cpu.model (not .arch) ?16:31
stephenfin*shouldn't it16:31
stephenfin(Actually, "shouldn't it" is colloquial. Oops :))16:32
*** owalsh has quit IRC16:34
sean-k-mooneyhttps://review.opendev.org/#/c/634827/ failed withthe 6 not greathan 7 notificaiton thing again16:39
*** derekh has quit IRC16:40
stephenfinsean-k-mooney:  https://review.opendev.org/68202516:40
sean-k-mooneyso the numa serise will block until https://review.opendev.org/#/c/682025/ is mergd16:40
sean-k-mooneyya16:40
sean-k-mooneyjust pointing out there is no point recheck untill that has merged16:40
sean-k-mooneywow that was the fix...16:41
stephenfinyup16:44
stephenfintbf, I've made that same mistake myself many times16:44
openstackgerritStephen Finucane proposed openstack/nova master: DNM: Reproducer for bug #1843836  https://review.opendev.org/68211116:44
openstackbug 1843836 in OpenStack Compute (nova) "Failure to schedule if flavor contains non-CPU flag traits" [Undecided,In progress] https://launchpad.net/bugs/1843836 - Assigned to Stephen Finucane (stephenfinucane)16:44
stephenfinmriedem_afk: ^16:44
*** gyee has joined #openstack-nova16:44
sean-k-mooneyi think it was enqued directly to gate so it should merge soon i hope16:44
*** markvoelker has quit IRC16:45
stephenfinmriedem_afk: there's a WIP functional reproducer for the bug. I'll clean it up Monday once I'm done investigating the other issue that reproducer highlighted16:45
stephenfin*potential issue16:45
stephenfinsean-k-mooney: It sure was, yup16:45
aspiersstephenfin: that github link is basically a DoS attack on my browser X-D16:47
stephenfinaspiers: Hahahaha16:48
stephenfinyeah...don't try to load it on a phone16:48
*** bnemec is now known as beekneemech16:48
aspiersno that was on my laptop16:48
*** markvoelker has joined #openstack-nova16:49
stephenfinif there was ever a sign that a file had grown too large...16:49
aspiersright?16:49
stephenfinfunnily enough, libvirt source files tend to be huuuuge as well16:49
sean-k-mooneythats not uncommon in c16:49
*** tssurya has quit IRC16:50
*** markvoelker has quit IRC16:53
*** gbarros has quit IRC16:53
*** owalsh has joined #openstack-nova16:54
aspiersstephenfin: anyway yes it looks wrong to me17:00
stephenfin\o/17:01
*** gbarros has joined #openstack-nova17:01
stephenfinAnother one to fix on Monday17:01
stephenfinThanks for taking a look, aspiers17:01
*** artom has joined #openstack-nova17:03
*** cfriesen has quit IRC17:08
*** xek_ has quit IRC17:08
*** ralonsoh has quit IRC17:11
aspiersBTW I'm off next week17:17
aspiersstephenfin: In case you missed it, I've just drafted a blog post on SEV. Feedback welcome: https://blog.adamspiers.org/?p=1871&preview=1&_ppp=1bfc4e4f7e17:18
stephenfinaspiers: Won't get to it today but I'll try early next week. Enjoy your time off!17:23
*** luksky11 has joined #openstack-nova17:25
aspierscheers :)17:25
*** priteau has quit IRC17:28
artomWhere's the part you call us all poopyheads for not reviewing your code enough?17:28
*** udesale has quit IRC17:36
sean-k-mooneydamit... mriedem_afk https://review.opendev.org/#/c/682025/ is going to fail17:49
sean-k-mooneysubunit parser is exploding17:50
*** markvoelker has joined #openstack-nova17:51
*** mriedem_afk is now known as mriedem17:51
mriedemdrats17:51
*** eharney has joined #openstack-nova17:51
sean-k-mooneyhttps://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_897/682025/1/gate/openstack-tox-py37/89752ac/testr_results.html.gz17:51
artomWhat even causes those?17:53
sean-k-mooneylarge amount of output to standard out or error17:53
sean-k-mooneylike all the logging of the host capablities17:53
mriedemthose seem to have spiked against recently so something must have merged that is causing us to tip over17:54
mriedemhttp://status.openstack.org/elastic-recheck/#181314717:54
mriedem#2 top most fail in the check queue right now17:55
sean-k-mooneyits happening in other jobs too not just py35 but ya17:55
sean-k-mooneybefore it was due to a bunch of deprecation warnings17:56
mriedemthe name of the bug is old17:57
sean-k-mooneycan we force submit that change? im running the unit test locally to see if it explodes but i dont expect it to17:58
mriedemas in get it re-queued?17:58
mriedemi think you'd have to rebase17:58
mriedemwhich will put it back through check17:58
sean-k-mooneyas in ask infra to override zuul17:58
mriedemi asked for it to be promoted to gate earlier in infra17:59
sean-k-mooneybut we could requeu it too17:59
mriedemjesus look at this https://4c970d31e6335324d673-0d0b23b7f62d479822a1b52b605369e3.ssl.cf1.rackcdn.com/682025/1/gate/nova-tox-functional-py36/5f76307/job-output.txt17:59
mriedemsearch for inprogress17:59
mriedemsee the wall of 00s17:59
artomThose subunit things appear to start on september... 4th?18:00
mriedemwtf is that18:00
artomPicking up on the 5th and 6th18:00
mriedemartom: we only have 10 days of logs18:00
artomI thought it was 30?18:00
mriedem10 days of indexed logs in ES18:00
artomAha18:00
mriedemand we need to filter out glance,18:01
mriedembut yeah i can check that in logstash18:01
sean-k-mooneyi think htat is the empty buffer that subunit was trying to use or somthing like that18:01
sean-k-mooneyValueError: Not a text type application/octet-stream18:01
sean-k-mooneywas that a local issue or was that just one of the things we saw when subunit blows up18:02
*** panda has quit IRC18:02
mriedemyou get the valuerror when subunit blows up18:02
mriedemi have'nt seen that wall of 00s before though,18:03
mriedemand in the unit test fail https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_897/682025/1/gate/openstack-tox-py37/89752ac/job-output.txt18:03
mriedemdumping the libvirt host capabilities seems to be new18:03
mriedemwhich i wouldn't be surprised if something from the sev series added that18:03
mriedemINFO [nova.virt.libvirt.host] kernel doesn't support AMD SEV"18:03
*** panda has joined #openstack-nova18:03
sean-k-mooneyya i saw that18:03
sean-k-mooneythat might be related although i did not see that in the other failed run18:04
sean-k-mooneyhttps://4c970d31e6335324d673-0d0b23b7f62d479822a1b52b605369e3.ssl.cf1.rackcdn.com/682025/1/gate/nova-tox-functional-py36/5f76307/testr_results.html.gz18:04
mriedemthe other failed run is a functional job18:04
mriedemlooks like nova.tests.unit.virt.libvirt.test_driver.LibvirtConnTestCase.test_xml_and_uri ?18:05
sean-k-mooneysame wall of 00s18:05
sean-k-mooneyoh damb i got the same issue locally18:06
sean-k-mooneywith master18:06
mriedemif you look at a functional-py36 run that didn't fail, you'll still see lots of stuff dumped to output on passing tests https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_529/656594/7/gate/nova-tox-functional-py36/529d847/job-output.txt18:08
mriedemtest_create_server_with_network_create_port_has_resource_request18:08
sean-k-mooneylike this http://paste.openstack.org/show/775781/18:08
mriedemtest_boot_reschedule_fill_provider_mapping_raises18:08
artomDumb solution, but move that capabilities logging to debug?18:09
sean-k-mooneyits proably the 6 INFO [nova.virt.libvirt.host] Libvirt host capabilities <capabilities>' call18:09
mriedemartom: i have a better solution18:09
mriedemplease hold18:09
* artom trembles18:09
mriedemwith anticipation?18:10
artomPartially.18:10
sean-k-mooneyso we remove https://github.com/openstack/nova/blob/master/nova/virt/libvirt/host.py#L660 yes18:12
sean-k-mooneyyou mock it in the tests18:12
mriedemi'm going to move it into a separate method and stub it out in the libvirt fixture18:12
sean-k-mooneymriedem: ya that is a good way to handel that18:13
artomWhat about tests that don't use the fixture? All the fakelibvirt'y tests18:13
sean-k-mooneynormally this would only print once as we cache the result18:13
artomOr just move it to init_host18:14
artomAnd not on every damn get_capabilities call18:15
sean-k-mooneyit does not log on every call18:15
sean-k-mooneyit logs once but we keep recreating the driver in the tests18:15
artomAh, right, only if self._caps isn't set18:15
sean-k-mooneyyes18:15
mriedemLibvirtConnTestCase is the bad one and that uses the fixture so i think we'll be ok18:15
*** mjozefcz|away has joined #openstack-nova18:18
openstackgerritMatt Riedemann proposed openstack/nova master: libvirt: stub logging of host capabilities  https://review.opendev.org/68213318:21
mriedemtremble before this ^18:21
*** TxGirlGeek has quit IRC18:22
sean-k-mooneyisnt it awsome how it conflits with everything18:22
mriedemha18:23
sean-k-mooneyim running the tests localy18:23
artomDon't we have a thing about not changing code to work around CI?18:23
sean-k-mooneythis is not a ci bug18:23
sean-k-mooneyits a subunit parser bug18:23
artomTru18:23
artome18:23
sean-k-mooneyso the alteritive is disbable test. which is worse or 1 day after FF replace our test framework with somethin that does not use stestr18:24
mriedemhttp://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22subunit.parser%5C%22%20AND%20message%3A%5C%22FAILED%5C%22%20AND%20tags%3A%5C%22console%5C%22%20AND%20voting%3A1%20AND%20project%3A%5C%22openstack%2Fnova%5C%22&from=7d18:24
mriedemfor the recent nova hits on that bug18:24
mriedemhttp://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22subunit.parser%5C%22%20AND%20message%3A%5C%22FAILED%5C%22%20AND%20tags%3A%5C%22console%5C%22%20AND%20voting%3A1%20AND%20project%3A%5C%22openstack%2Fnova%5C%22&from=10d i guess is better18:24
sean-k-mooney so far it seams to be working locallly. do you want to rebases https://review.opendev.org/#/c/682025/ on top of combine them?18:27
mriedemi do'nt want to combine them18:27
mriedemand i don't know if we have cores around to approve the libvirt one18:28
mriedemlooking at the other tracebacks in a passing functional test job, i see a lot of _allocate_network_async which makes me think (and i think these are negative scenario tests) that we're triggering a failure to satisfy the test,18:28
mriedembut then dropping something in the code,18:28
mriedemwhich gets logged and i'm thinking we might want to have a fixture that makes _allocate_network_async serial18:29
mriedemlike the fixtures we have for spawn_n18:29
mriedemi mean we're hitting NetworkInfoAsyncWrapper which calls utils.spawn(_allocate_network_async)18:29
sean-k-mooneywe use a fixture like that for the cells scater gather code too right18:29
mriedemso we might just not be using the spawn fixture in several places18:30
sean-k-mooneythere are quite a few SADeprecationWarning too18:33
sean-k-mooneyThe Engine.contextual_connect() method is deprecated.18:33
mriedemand lots of "Detected removed column"18:34
mriedemwe should probably squash alembic logging in tests18:34
sean-k-mooneywell im not sure we would notice it was deprected if we did but maybe18:35
mriedemi'm talking about a different issue18:35
mriedemthese18:35
mriedem2019-09-13 17:33:40.316170 | ubuntu-bionic | 2019-09-13 17:33:40.248 4439 INFO alembic.autogenerate.compare [req-d6f4db5b-4ad9-4096-9832-08d8692555d7 fake fake - - -] Detected removed column 'build_requests.vm_state'[00m18:35
sean-k-mooneyoh ok18:36
mriedemthere are columns from the build_requests table that were removed from the model but not the schema18:36
sean-k-mooneylike the vpmem coloum in the instance_extra table18:37
sean-k-mooneydont we normally whitelist to be ingored. i would have expected that to not be logged18:38
sean-k-mooneybut i guess not18:38
mriedemidk18:38
mriedemidk where the message is coming from18:38
mriedemprobably the walk migrations stuff18:38
mriedemyeah there is a whitelist in filter_metadata_diff18:39
sean-k-mooneythe deprecation warnings at lesast are not coming form nova they are form sqlaclamate migrate18:39
sean-k-mooneyeventrulally we will need to move off that18:40
mriedemyeah that's an old one18:40
mriedemi disagree18:40
mriedemjust fix this https://bugs.launchpad.net/sqlalchemy-migrate/+bug/181428818:40
openstackLaunchpad bug 1814288 in sqlalchemy-migrate "DeprecationWarning: inspect.getargspec() is deprecated, use inspect.signature() instead" [Medium,Confirmed]18:40
mriedemsqlalchemy.migrate is opened by openstack, i'm a core, it's in maintenance mode, and changing nova to go from migrate to alembic is not worth the trouble18:41
sean-k-mooneymriedem: didnt the maintainer say the did not want to maintain sqlalcamey migrate anymore18:41
mriedemat least not while i'm around18:41
sean-k-mooneyoh ok18:41
mriedemopenstack has maintained it for like 5 years now18:41
mriedemso patches welcome to fix https://bugs.launchpad.net/sqlalchemy-migrate/+bug/181428818:42
openstackLaunchpad bug 1814288 in sqlalchemy-migrate "DeprecationWarning: inspect.getargspec() is deprecated, use inspect.signature() instead" [Medium,Confirmed]18:42
mriedemmigrate is probably due for a release in ussuri18:42
sean-k-mooneywell if i can squash some of those message simple then sure18:42
sean-k-mooneythats the allcoate error right http://paste.openstack.org/show/775783/18:43
sean-k-mooneyalso http://paste.openstack.org/show/775785/18:44
sean-k-mooneythe functional test seamed to pass but i know that the subunit thing is somewhat non determinisitc18:45
sean-k-mooneyhuh when i open it in pycharm it sticts through getaragspec and tell you how to fix it18:51
openstackgerritmelanie witt proposed openstack/nova-specs master: Amend "Configure max number of volumes to attach" spec  https://review.opendev.org/68213618:51
mriedemi'm working on http://paste.openstack.org/show/775783/18:51
sean-k-mooneyok i was going to fix the migrate issue since it seam simpler18:52
mriedemi can't quite figure out what's wrong with test_boot_reschedule_fill_provider_mapping_raises18:52
sean-k-mooneyalso you sounded like you had an idea how to fix it18:52
mriedemprobably need gibi18:52
mriedemusing the SpawnIsSynchronous fixture in test_boot_reschedule_fill_provider_mapping_raises definitely makes it fail on that IndexError18:52
mriedemi'm just not sure why yet18:53
mriedembut i think it's because it's stubbing out fill_provider_mapping18:53
sean-k-mooneyill open it and take a look but i dont know if ill be able to help i gues i can run it in a debugger and step in18:53
*** xek_ has joined #openstack-nova18:54
sean-k-mooneyor not... its one of those test where the debuger does not work18:56
artompysnoop18:57
sean-k-mooneyits the placmenet fixture18:57
sean-k-mooneybut i could use that i dont think it will help however18:57
mriedemgot it18:57
*** mjozefcz|away has quit IRC19:01
*** markvoelker has quit IRC19:04
*** markvoelker has joined #openstack-nova19:06
openstackgerritMatt Riedemann proposed openstack/nova master: Use SpawnIsSynchronousFixture in reschedule functional tests  https://review.opendev.org/68214019:08
mriedemsean-k-mooney: ^19:08
sean-k-mooneyit seams to get rid fo the error19:10
sean-k-mooneyhow is mock_fill in scope?19:12
sean-k-mooneyit refers to the mock you are creating in the with statemnet but you are using it in the stub fill provider mapping funciton19:13
mriedempython magic19:14
mriedemit's used in the function which isn't used until after the mock is setup19:14
mriedemanyway, as for https://review.opendev.org/#/c/682133/ i'm going to do a full py26,func-py36,pep8 locally and if that's good clark is going to promote to the gate19:14
sean-k-mooneyright so its parsing the function signiture but not the body untill its used19:14
*** lpetrut has joined #openstack-nova19:14
mriedemyar19:14
mriedemthat's something that always trips me up with python19:14
sean-k-mooneyand by the time its use its inscope19:14
sean-k-mooneythat is slightly terrifying but ok19:15
artomWait, what?19:15
*** lpetrut has quit IRC19:15
artomThe function can refer to its own mock?19:16
*** lpetrut has joined #openstack-nova19:16
sean-k-mooneydont look too closely https://review.opendev.org/#/c/682140/1/nova/tests/functional/test_servers.py@680819:16
sean-k-mooneyyou might go insane19:16
artomToo late, I clicked19:16
*** markvoelker has quit IRC19:16
sean-k-mooneybut ya i get how it could work19:16
artomThere's gotta be a less funky clever way of doing that19:16
sean-k-mooneyi think there is a mock.wraps that does something similar19:17
artomYeah19:17
artomOr even with side_effect19:17
*** markvoelker has joined #openstack-nova19:17
artomSomething like side_effect=[original_fill] + itertools.repeat(raise)19:17
sean-k-mooneyit is a side effect19:17
sean-k-mooneythat is how the fuction is used19:18
sean-k-mooney*stub_fuction19:18
artomRight, I meant... we don't need the weirdly scoped function introspecting itself thing19:18
sean-k-mooneywith all that said what mriedem worte appeares to work19:18
artomNot that it's not clever19:18
artomIt'll just cause headaches to whoever has to work with it next19:18
* artom starts the afternoon kids/home logistics19:26
artomo/ see ya Monday19:26
*** artom has quit IRC19:26
sean-k-mooneyoh i see what its doing its filling the provider mapping if tis not filled19:27
sean-k-mooneyand raise an exception if called again19:28
*** slaweq has quit IRC19:52
*** lpetrut has quit IRC19:58
*** panda has quit IRC20:05
*** panda has joined #openstack-nova20:08
*** igordc has joined #openstack-nova20:10
*** tbachman has quit IRC20:31
*** dannins has quit IRC20:44
mriedemsean-k-mooney: heh, of course now the libvirt logging patch failed in the gate b/c of the functional notifications patch20:51
*** openstackgerrit has quit IRC20:51
sean-k-mooneynothing else would do sure :) i has to keep up the tradtion of the rest20:54
*** henriqueof1 has quit IRC20:54
mriedemcorvus is going to promote both20:56
*** markvoelker has quit IRC20:57
sean-k-mooneyif they fail again we might need to squash them. the  failures are not determisitic so we should be able to merge them on there own but we might not want to retry them that much20:59
*** pcaruana has quit IRC21:03
efriedo/21:09
efriedchecking in21:09
efriedI assume we're holding rechecks until we can merge some of those gate fixes mriedem?21:09
efriedI've got eight or so lined up.21:10
efriedrechecks, not fixes21:10
*** slaweq has joined #openstack-nova21:11
mriedemefried: yeah21:11
mriedemcorvus just promoted to top of gate21:11
efriednice of him21:12
mriedemi think i just bring out the best in people21:12
mriedemyou know?21:12
efriedthreats of violence will do that21:12
mriedemha21:12
efrieddo you want me to merge https://review.opendev.org/#/c/682140/ ?21:13
efrieddespite artom hatin on it21:13
*** luksky11 has quit IRC21:14
efriedeven though you spelled stacktrace wrong21:14
*** slaweq has quit IRC21:16
sean-k-mooneyhe did. unsurpisingly i did not notice21:17
mriedemi got it correct in one spot21:18
mriedemi was rushing21:18
mriedemit's up to me if you want to approve it or let it sit, it's not the big blow up like the libvirt host capabilities one21:18
*** KeithMnemonic has quit IRC21:19
mriedemi think both your alternative and artom's are equally gross21:20
sean-k-mooneyya that one does not actully casuse the test to fail and the log mesage is like 20 lines vs 100s21:20
efriedhow many times do we actually need to raise?21:20
sean-k-mooneywell once really. the stub raises if its called more then once21:21
sean-k-mooneyi doubt we will call it again if we raise21:21
*** zhubx has joined #openstack-nova21:22
sean-k-mooneyi +1'd it because a.) it works and b.) while it was surpising at first glance i understand how it works after looking at it for 30 seconds21:22
mriedemyou can't use wraps because we need to side effect the error in the 2nd call,21:22
sean-k-mooneyya you cant21:23
sean-k-mooneyi tried21:23
mriedemand we can't just mock it because the test fails if you don't actually call the original method on the first pass21:23
sean-k-mooneyyep21:23
mriedemand that was the bug i uncovered21:23
sean-k-mooneyout of interest why do you dislike moveing the stub function inside the mock context manager21:24
*** boxiang has quit IRC21:24
sean-k-mooneyfunctionally its identiacla to what you wrote but im just wondering out of interest21:25
efriedI approved it.21:28
mriedemsean-k-mooney: but it's late on a friday and i don't feel like updating the patch :)21:29
mriedemand i'm trying to do some education stuff21:29
mriedem*b/c21:29
sean-k-mooneythat totally fair21:30
sean-k-mooneyi was just wondering if you had a technical reason i missed21:30
sean-k-mooneyas i said i +1 because i was ok with what you wrote and didnt think it was really worth a respin21:31
efriedokay, unless there's something else I can do here, I'm going to bugger back off and just monitor the gate21:32
efriedlooks like we're back up to a 12h delay \o/21:32
*** efried is now known as efried_afk21:35
*** tbachman has joined #openstack-nova21:36
*** xek_ has quit IRC21:46
*** JamesBenson has quit IRC21:46
*** xek has joined #openstack-nova21:47
*** openstackgerrit has joined #openstack-nova21:48
openstackgerritMatt Riedemann proposed openstack/nova stable/stein: Fix a misuse of assertGreaterEqual  https://review.opendev.org/68216821:48
*** tbachman has quit IRC21:48
*** xek has quit IRC21:49
*** xek has joined #openstack-nova21:49
*** mriedem has left #openstack-nova21:49
*** xek_ has joined #openstack-nova21:52
*** xek has quit IRC21:55
*** mriedem has joined #openstack-nova22:04
*** markvoelker has joined #openstack-nova22:09
*** slaweq has joined #openstack-nova22:11
*** markvoelker has quit IRC22:14
*** slaweq has quit IRC22:16
*** hemna has joined #openstack-nova22:21
openstackgerritMatt Riedemann proposed openstack/nova stable/stein: neutron: refactor nw info cache refresh out of associate_floating_ip  https://review.opendev.org/68218122:24
openstackgerritMatt Riedemann proposed openstack/nova stable/stein: Trap and log errors from _update_inst_info_cache_for_disassociated_fip  https://review.opendev.org/68218222:24
openstackgerritMatt Riedemann proposed openstack/nova stable/stein: Find instance in another cell during floating IP re-association  https://review.opendev.org/68218322:24
mriedemgibi: just so you're aware we're trying to get https://review.opendev.org/#/c/682133/ and https://review.opendev.org/#/c/682025/ through the gate since things keep failing on those bugs22:28
*** mriedem is now known as mriedem_afk22:30
*** macz has quit IRC22:58
*** xek_ has quit IRC22:59
*** hemna has quit IRC23:03
*** tbachman has joined #openstack-nova23:08
*** JamesBenson has joined #openstack-nova23:23
*** JamesBenson has quit IRC23:27
*** gyee has quit IRC23:32
*** gyee has joined #openstack-nova23:35
*** gyee has quit IRC23:51
*** ozzzo has quit IRC23:51
*** rcernin has joined #openstack-nova23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!