Thursday, 2019-08-15

openstackgerritShilpa Devharakar proposed openstack/nova master: Nova object changes for forbidden aggregates request filter  https://review.opendev.org/67107200:03
openstackgerritShilpa Devharakar proposed openstack/nova master: DB API changes to get non-matching aggregates from metadata  https://review.opendev.org/67107400:05
openstackgerritShilpa Devharakar proposed openstack/nova master: Add a new request filter to isolate aggregates  https://review.opendev.org/67107500:05
efrieddansmith, melwitt: If you're still around, this iteration of that fixture passed zuul: https://review.opendev.org/#/c/676495/00:06
efriedwould be nice to have it merged by morning to unwedge https://review.opendev.org/#/c/676457/00:06
openstackgerritShilpa Devharakar proposed openstack/nova master: Enable request filter isolate_aggregates  https://review.opendev.org/66795200:06
*** ociuhandu has joined #openstack-nova00:16
*** markvoelker has joined #openstack-nova00:24
melwittefried: looking00:26
efriedthanks melwitt00:28
melwittguh, I don't know what I'm looking at here00:31
efriedmelwitt: I can splain if you got a minute00:31
melwittok. I see mordred said earlier that he thinks it looks good, if he could +1 it again that would be helpful too00:32
efriedWithout any fixturing, unit and functional tests fail because many of them hit paths that try to use placement, and placement now uses sdk.00:36
efriedWhen we try to load up sdk, it normally does some discovery for us, things like checking the service catalog and asking for version documents.00:36
efriedAnd in unit/functional tests, we don't care about any of that.00:36
efriedThe problem is that the discovery stuff is done through ksa - and we have other things (glance, cinder, ironic...) that rely on those ksa-isms either not being mocked at all, or being mocked a certain way in their own tests.00:36
efriedSo I can't just mock away the ksa stuff - which was my first PS on this fix - because then those all puke.00:36
efriedSo instead I'm mocking the thing in the sdk that triggers that discovery. And I'm making it do almost all of what it would do anyway - just skipping that one part that hits ksa.00:36
efriedThe linked patch shows the code I cribbed from.00:36
melwittok, thanks00:37
efriedAs before, this is just making sure that unit/func tests that only care about a default no-op-ish ksa Adapter actually get something that looks like an Adapter.00:38
efriedThe problem is that sdk is a moving target right now, which is why I had to change it; but hopefully this version will stick for a little while longer until we can get real fixtures from sdk.00:38
melwittyeah, I was looking through wondering why mocking get_endpoint didn't work00:39
*** gyee has quit IRC00:40
melwittlike, you're skipping around the get_endpoint call in the new mock, but yet mocking get_endpoint itself didn't work. and I wasn't seeing what/how this avoids the problem00:40
efriedRight - if you look at the PS1 failures, you can see where things like glance and cinder are relying on get_endpoint to "work" and be un-mocked.00:40
efriedSo whereas mocking get_endpoint gets around the paths where *placement* tries to create an Adapter, it makes those other ones puke.00:41
melwittefried: could you have mocked get_endpoint conditionally if self.service_type is placement to get the same thing or no?00:44
efriedmelwitt: I think then in tests that hit placement *and* one of the other things, it would still get mocked - possibly at an unpredictable time in the test00:46
melwittok. sorry for all the questions, this is confusing to me00:47
efriedthe right solution, long-term, and mordred is working on this, is for openstacksdk to publish fixtures that we can just import and use. Because openstacksdk will always know what it's doing internally and how.00:47
efriedThis - like the previous iteration of the fixture that mocked Adapter.get_major_api_version - is just a stopgap to let us move forward until that happens.00:48
efriedand it's only affecting unit/func tests. The real proof that sdk is working for us is in the fact that all the tempest tests - which all use placement, which uses sdk - pass.00:49
melwittyeah, I get that part, I just didn't want to fast approve something I had zero understanding of. I'll look at it some more and if I can grok it, I'll send it on00:49
melwittthanks for explaining all that00:50
efriedThanks for looking.00:50
efriedI think alex_xu might be arriving on the scene soon, so if you prefer not to +W it, he might be able to do so while we sleep.00:50
*** markvoelker has quit IRC00:51
*** markvoelker has joined #openstack-nova00:52
melwittit might just take me a bit longer to get this00:52
efriedIt's not the end of the world if it has to wait for morning.00:53
efriedIt would just be nice to be able to recheck the u-c patch and have it merged by morning so I can move on with the stuff that builds on it.00:53
melwittyeah, I understand. I'll keep looking at it, just need a bit more time00:54
efriedthanks melwitt00:55
*** brinzhang has joined #openstack-nova00:56
*** hongbin has joined #openstack-nova00:58
*** markvoelker has quit IRC01:01
*** ociuhandu has quit IRC01:02
*** ricolin has joined #openstack-nova01:03
*** markvoelker has joined #openstack-nova01:05
*** markvoelker has quit IRC01:11
*** markvoelker has joined #openstack-nova01:16
*** bhagyashris has joined #openstack-nova01:25
*** spsurya has joined #openstack-nova01:28
*** takashin has joined #openstack-nova01:35
openstackgerritDongcan Ye proposed openstack/nova master: Libvirt: Rename _guest_add_memory_balloon  https://review.opendev.org/67653401:43
openstackgerritTakashi NATSUME proposed openstack/nova master: Fix 'has_calls' method calls in unit tests  https://review.opendev.org/67653601:45
*** Tianhao_Hu has joined #openstack-nova01:48
openstackgerritMohammed Naser proposed openstack/nova master: cleanup: remove osapi_v21.project_id_regex  https://review.opendev.org/67653701:53
melwittefried: +W (finally)01:58
openstackgerritTakashi NATSUME proposed openstack/nova master: Fix 'has_calls' method calls in unit tests  https://review.opendev.org/67653602:02
yonglihemelwitt: Hi,  I hope the comments address your concern, very nice to have you review that, thank. https://review.opendev.org/#/c/627765/02:06
openstackgerritMohammed Naser proposed openstack/nova master: config: remove deprecated checksum options  https://review.opendev.org/67653902:14
openstackgerritMohammed Naser proposed openstack/nova master: Remove nova.image.download.modules extension point  https://review.opendev.org/67654002:29
melwittyonglihe: I'll try to take a look tomorrow, sorry for the delay02:32
*** BjoernT has joined #openstack-nova02:36
*** BjoernT_ has joined #openstack-nova02:43
*** BjoernT has quit IRC02:44
*** takashin has left #openstack-nova03:01
*** markvoelker has quit IRC03:10
openstackgerritCHENGLEI proposed openstack/nova stable/pike: Insert the description of the change.  https://review.opendev.org/67654103:13
*** altlogbot_0 has quit IRC03:16
*** altlogbot_2 has joined #openstack-nova03:17
*** brinzhang has quit IRC03:21
*** brinzhang has joined #openstack-nova03:22
*** hongbin has quit IRC03:27
*** markvoelker has joined #openstack-nova03:55
*** markvoelker has quit IRC04:00
*** BjoernT_ has quit IRC04:12
*** dave-mccowan has joined #openstack-nova04:26
*** ociuhandu has joined #openstack-nova04:30
*** dave-mccowan has quit IRC04:31
*** ociuhandu has quit IRC04:35
*** brinzhang has quit IRC04:38
*** brinzhang has joined #openstack-nova04:39
*** brinzhang has quit IRC04:44
*** brinzhang has joined #openstack-nova04:45
*** markvoelker has joined #openstack-nova04:50
*** tkajinam has quit IRC04:53
*** tkajinam has joined #openstack-nova04:54
*** markvoelker has quit IRC04:54
*** brinzhang has quit IRC04:55
*** brinzhang has joined #openstack-nova04:55
*** brinzhang has quit IRC04:56
*** tkajinam has quit IRC05:00
*** tkajinam has joined #openstack-nova05:05
*** Tianhao_Hu has quit IRC05:12
*** jaosorior has joined #openstack-nova05:16
openstackgerritZhengMa proposed openstack/nova master: Check container_format on instance creation  https://review.opendev.org/67340705:17
*** tkajinam has quit IRC05:31
*** markvoelker has joined #openstack-nova05:35
*** markvoelker has quit IRC05:41
*** brinzhang has joined #openstack-nova05:45
*** Tianhao_Hu has joined #openstack-nova05:49
*** mgoddard has quit IRC05:54
*** mgoddard has joined #openstack-nova06:01
*** tkajinam has joined #openstack-nova06:04
*** hongbin has joined #openstack-nova06:28
*** hongbin has quit IRC06:32
*** tkajinam has quit IRC06:49
*** belmoreira has joined #openstack-nova06:55
*** tkajinam has joined #openstack-nova07:00
*** ricolin_ has joined #openstack-nova07:03
*** ricolin has quit IRC07:05
*** Tianhao_Hu has quit IRC07:06
*** d34dh0r53 has quit IRC07:07
*** d34dh0r53 has joined #openstack-nova07:10
*** alemgeta has joined #openstack-nova07:19
*** jaosorior has quit IRC07:23
*** jawad_axd has joined #openstack-nova07:26
*** tssurya has joined #openstack-nova07:32
*** ricolin_ is now known as ricolin07:33
*** helenafm has joined #openstack-nova07:40
gibisean-k-mooney: thanks for the devstack conf with the mixed sriov ovs setup07:52
*** ivve has joined #openstack-nova07:53
*** boxiang has joined #openstack-nova07:58
*** boxiang has quit IRC08:00
*** boxiang has joined #openstack-nova08:00
gibisean-k-mooney: did you set up connectivity between br-ex and enp1s0f1 on the physical host?08:11
*** jaosorior has joined #openstack-nova08:17
*** markvoelker has joined #openstack-nova08:20
openstackgerritGhanshyam Mann proposed openstack/nova master: Pass RequestContext to oslo_policy  https://review.opendev.org/67403808:24
*** markvoelker has quit IRC08:25
openstackgerritZhengMa proposed openstack/nova master: Check container_format on instance creation  https://review.opendev.org/67340708:28
sean-k-mooneygibi: that config does it automatically08:28
sean-k-mooneyit add enp1sof1 to the br-ex08:28
sean-k-mooney*adds08:29
sean-k-mooneyi also put the echo to allocate the vf in the local.conf and set the pci whitelist based on the vendor id and procut id of the vf so it automaticl allows the correect vfs08:30
sean-k-mooneywhen stacking compltes you are basiaclly ready to boot a vm with an sriov port and it will get a dhcp adress for the dhcp agent attached to ovs08:31
sean-k-mooneyi say basiacally ready as cirros may not have your nic driver so you might need to upload a new image first08:32
*** derekh has joined #openstack-nova08:40
*** gibi has quit IRC08:42
openstackgerritGhanshyam Mann proposed openstack/nova master: Add test coverage of existing os-services policies  https://review.opendev.org/66918108:45
*** tkajinam has quit IRC08:47
openstackgerritGhanshyam Mann proposed openstack/nova master: Add test coverage of existing os-services policies  https://review.opendev.org/66918108:49
openstackgerritGhanshyam Mann proposed openstack/nova master: Introduce scope_types in os-services  https://review.opendev.org/64542708:50
openstackgerritGhanshyam Mann proposed openstack/nova master: Add new default roles in os-services API policies  https://review.opendev.org/64848008:51
*** cdent has joined #openstack-nova08:52
openstackgerritGhanshyam Mann proposed openstack/nova master: Add test coverage of existing admin_actions policies  https://review.opendev.org/65769808:54
openstackgerritGhanshyam Mann proposed openstack/nova master: Ensure we pass a target in admin actions  https://review.opendev.org/66309508:54
*** gibi has joined #openstack-nova08:59
gibisean-k-mooney: thanks09:03
*** gibi has quit IRC09:05
*** gibi has joined #openstack-nova09:06
*** ricolin has quit IRC09:07
openstackgerritGhanshyam Mann proposed openstack/nova master: Add test coverage of existing os-agents policies  https://review.opendev.org/66957809:14
gibigmann: hi! If you have time, could you give your oppinion in https://review.opendev.org/#/c/675371/ ?09:19
openstackgerritMerged openstack/nova master: Enhance SDK fixture for 0.34.0  https://review.opendev.org/67649509:23
*** jawad_axd has quit IRC09:29
*** zbr|flu is now known as zbr09:33
*** alemgeta has quit IRC09:36
gmanngibi: sure, i will check.09:39
openstackgerritGhanshyam Mann proposed openstack/nova master: Add new default roles and mapping in policy base class  https://review.opendev.org/64545209:42
openstackgerritGhanshyam Mann proposed openstack/nova master: Add new default roles in os-services API policies  https://review.opendev.org/64848009:42
*** sapd1_x has joined #openstack-nova09:45
*** dpawlik has joined #openstack-nova09:48
*** bhagyashris has quit IRC09:49
*** jangutter has joined #openstack-nova09:51
*** hamzy_ has joined #openstack-nova09:51
openstackgerritGhanshyam Mann proposed openstack/nova master: Add test coverage of existing admin_actions policies  https://review.opendev.org/65769809:54
openstackgerritGhanshyam Mann proposed openstack/nova master: Ensure we pass a target in admin actions  https://review.opendev.org/66309509:54
*** hamzy has quit IRC09:54
*** belmoreira has quit IRC10:03
*** helenafm has quit IRC10:04
openstackgerritGhanshyam Mann proposed openstack/nova master: Introduce scope_types in Admin Actions  https://review.opendev.org/65782310:14
*** helenafm has joined #openstack-nova10:14
openstackgerritGuo Jingyu proposed openstack/nova master: define and catch InstanceGuestAgentNotRunning for set-password failure  https://review.opendev.org/67666710:19
*** hongbin has joined #openstack-nova10:22
*** markvoelker has joined #openstack-nova10:36
openstackgerritGuo Jingyu proposed openstack/nova master: define and catch InstanceAgentNotRunning for set-password failure  https://review.opendev.org/67666710:39
*** jangutter has quit IRC10:41
*** markvoelker has quit IRC10:41
openstackgerritGhanshyam Mann proposed openstack/nova master: Add policy deprecation fixture and Suppress warnings in tests  https://review.opendev.org/67667010:42
openstackgerritGhanshyam Mann proposed openstack/nova master: Add new default roles in os-services API policies  https://review.opendev.org/64848010:44
openstackgerritGhanshyam Mann proposed openstack/nova master: Add new default roles in os-services API policies  https://review.opendev.org/64848010:44
openstackgerritGhanshyam Mann proposed openstack/nova master: Add new default roles in os-services API policies  https://review.opendev.org/64848010:48
openstackgerritChris Dent proposed openstack/nova master: Add a "Caveats" section to the eventlet profiling docs  https://review.opendev.org/67667210:53
sean-k-mooneywhat time does matt normally log on? about 1-2 hours form now?10:56
*** jangutter has joined #openstack-nova10:57
stephenfinsean-k-mooney: We have a conflict with cpu-resources10:57
sean-k-mooneyi started early today so it feels weird to have been online for a while and not see the us folks about10:57
sean-k-mooneywe do?10:57
sean-k-mooneywith what10:57
stephenfinThere's a workaround option to disable VCPU -> PCPU flavor translation and we've decided to report both PCPUs and VCPUs for compute nodes without explicit CPU pinset configuration10:58
sean-k-mooneyyes10:58
sean-k-mooneyi was talking about this yesterday10:58
stephenfinIf I reshape, I move every allocation for pinned instances on that host from VCPUs to PCPUs10:58
sean-k-mooneyright10:58
sean-k-mooneywhich is why i raised that workaround option as an issue10:59
stephenfinBut if you enable the workaround option (so your pinned instances continue to request VCPUs), more pinned instances will land on that host that use VCPUs instead of PCPUs10:59
sean-k-mooneyyes10:59
stephenfinso those two things can't coexist10:59
sean-k-mooneyyes you cant reshap until you disabel the workaround11:00
stephenfinyup, and the workaround needs to be set on every single host, and toggled on every host at the same time11:00
sean-k-mooneywell currently its only set on the schduler11:00
stephenfincompute nodes and controllers (well, scheduler hosts)11:00
sean-k-mooneybut it would have to be if you were to use11:00
sean-k-mooneyit to contol the reshape11:00
stephenfinI'm tempted to drop the config option, to be honest11:01
*** jangutter has quit IRC11:01
sean-k-mooneywell the translation is on by default11:01
stephenfinYup. I'd rather we didn't support turning it off again11:01
sean-k-mooneyso im ok with saying that it should nver be set on a new host11:01
stephenfinYou just need to make sure you upgrade sufficient hosts at once or you'll see degraded scheduling performance due to lack of viable hosts11:02
stephenfin*a sufficient number of compute nodes at once11:02
sean-k-mooneye.g. you should only use it if and only if you want to first upgrade to train then when all node are on train enable this feature11:02
stephenfinso you'd rather keep the config option and make it global?11:03
sean-k-mooneywe could remove it but it there for host with vms that cant be migrated11:03
stephenfinwhy not? The hosts just have to be updated11:03
sean-k-mooneyit cant really be global unless you mean set in ever host11:03
stephenfinI do. I think that's the only way this could work11:03
sean-k-mooneyya11:04
sean-k-mooneyso if we keep it i think it needs to be set on all host11:04
sean-k-mooneyand your reshap code needs to check it11:04
stephenfinIt would need to toggle (a) flavor translation, (b) whether we report PCPUs (since that's a heuristic we rely on to detect if reshapes are needed) and (c) whether we reshape11:04
stephenfinIs it worth the effort?11:04
sean-k-mooneyand we need to document that it must be set too the same value on all hosts11:04
stephenfinYup11:04
sean-k-mooneycan you support inplacem upgrade without live migration without it11:05
stephenfinand turned off again on the controller first11:05
stephenfinotherwise the compute nodes will have reshaped everything but the scheduler will still be making requests for VCPUs11:06
sean-k-mooneythe workflow you be. set workatound on all hosts-> upgrade->disbale workaound on all hosts. and yes it would have to toggel all those things11:06
openstackgerritBalazs Gibizer proposed openstack/nova master: Support reverting migration / resize with bandwidth  https://review.opendev.org/67614011:07
openstackgerritBalazs Gibizer proposed openstack/nova master: Allow migrating server with port resource request  https://review.opendev.org/67149711:07
stephenfin"can you support inplacem upgrade without live migration without it" what do you mean?11:07
sean-k-mooneyin which case we shoudl renable it to disable_pcpus_in_placment or something11:07
sean-k-mooneyi mean for edge deployment11:07
sean-k-mooneywhere we may not ever be able to cold or live migrate instances11:08
sean-k-mooneyfor those deployments wee need to supprot  inplace updates11:08
sean-k-mooneyand we need to support updating differen edge cells at differnet times11:08
*** belmoreira has joined #openstack-nova11:09
sean-k-mooneydoes that make sense?11:09
*** belmoreira has quit IRC11:11
openstackgerritYumengBao proposed openstack/nova master: [WIP] add cyborg tempest job  https://review.opendev.org/67099911:12
stephenfinsean-k-mooney: Why would I want to live migrate an instance as part of the upgrade though?11:12
stephenfinI pull in the latest packages, I restart the controllers followed by compute nodes, the controllers start requesting PCPUs instead of VCPUs and the compute nodes reshape their allocations so pinned instances are consuming PCPUs instead of VCPUs11:14
sean-k-mooneyyou dont but we cant assume that you will upgrade part of the host first. allow them to reshape and then upgrade the rest11:14
stephenfinAgain, not sure how that's an issue11:14
*** belmoreira has joined #openstack-nova11:14
sean-k-mooneyin edge deployment that is not a thing as we dont have spare hosts and we cant assume we can do a rolling upgrade of subset of hosts within an edge site11:14
stephenfinwhat would they be doing instead of a rolling upgrade?11:15
sean-k-mooneythe upgrade all nodes within an edge site together and fail over traffic to a different edgesite11:15
sean-k-mooneybut that does not mean that all edge site will be upstad at the same time.11:16
stephenfinWhy would that be an issue?11:16
stephenfinOh, that on the other hand, yea11:16
stephenfin*yeah11:16
*** hongbin has quit IRC11:16
sean-k-mooneythey do a rolling update at the site level rather then host level at least in some cases11:16
sean-k-mooneyso for an edge deployment you would have to update all edge sites to disabel the workaround11:17
stephenfinDo those different sites share controllers or is there a controller per site?11:17
sean-k-mooneyi think that depends. i think each site is a different cell but they all share the same schduler11:17
stephenfin*scheduler11:17
stephenfinthen we're kind of stuck whatever way we go11:18
*** jaosorior has quit IRC11:18
stephenfinif we have a config option, then we need to make sure every site has the config option toggled at the same time or things break11:18
sean-k-mooneywell the 3 step update with the config option will work11:18
sean-k-mooneyyes11:18
stephenfinwell, things don't break but you won't be able to schedule instances to hosts that still have the config option toggled11:19
sean-k-mooneyyou could do it another way11:19
stephenfinbecause they won't be reporting PCPU inventory11:19
stephenfinshoot11:19
sean-k-mooneywe could use host_aggreate metadata to contol it instead11:19
*** ircuser-1 has quit IRC11:21
stephenfinHmm, not sure how that helps11:21
sean-k-mooneythat would requrie the traslation to be moved to a prefilter proably11:21
sean-k-mooneyit would make the traslation non global.11:22
sean-k-mooneyits not ideal however11:22
openstackgerritGhanshyam Mann proposed openstack/nova master: Add new default roles in os-services API policies  https://review.opendev.org/64848011:22
openstackgerritGhanshyam Mann proposed openstack/nova master: Add test coverage of existing admin_actions policies  https://review.opendev.org/65769811:23
openstackgerritGhanshyam Mann proposed openstack/nova master: Ensure we pass a target in admin actions  https://review.opendev.org/66309511:23
openstackgerritGhanshyam Mann proposed openstack/nova master: Introduce scope_types in Admin Actions  https://review.opendev.org/65782311:23
sean-k-mooneystephenfin: i would be good to get dansmith opipion on how much of an issue the edge deplopment case is likely to be11:24
stephenfinYeah, we need to have a discussion on this. I'll start a mailing list post about it11:24
sean-k-mooneyeven in an edge deployment the n=>n+1 version compatiable still applies so we would expect edge sites to be updated at the same cadance as teh main datacenter11:26
openstackgerritBalazs Gibizer proposed openstack/nova stable/pike: Stabilize unshelve notification sample tests  https://review.opendev.org/67667711:27
sean-k-mooneybelmoreira: you work at cern correct? or am i mixing you your irc nic?11:27
belmoreirasean-k-mooney: yes I do11:28
sean-k-mooneygood :) am ye have a hevaily multi cell deployment. how do ye go about upgradeign cells11:29
sean-k-mooneydo ye do upgrades cell by cell or do ye do it some other way11:29
sean-k-mooneyim just wondering how long it takes ye to go form all host on version N to all on N+1 and if multiple cells alters that11:30
sean-k-mooneyi dont know if ye have done a major version update since ye moved to cellsv2 but it might be good input for stephenfin cpu pinning in plamcent issue11:31
belmoreiraI upgrade all the control plane! nova-api, nova-scheduler, nova-conductor "super", nova-conductor "cells", ... (This has downtime! ) later upgrade compute-nodes11:31
sean-k-mooneyok but you do all the contol plane including the cell conductors all in one go11:32
sean-k-mooneythen upgrade the computes after11:32
belmoreirayes11:32
sean-k-mooneyand would setting a config uption on each host before the upgrade be problematic for you in that case?11:32
sean-k-mooneyi guess it would be annoying but it should be managable?11:33
belmoreirawhat do you mean?11:33
sean-k-mooneyfor cpu pinning in placment there is currently a workaound config option to disable using the new resouce class11:33
sean-k-mooneyif we keep it then you would have to set that on all hosts. upgrade to train and only disable it after all host are on train11:34
openstackgerritBalazs Gibizer proposed openstack/nova stable/pike: Stabilize unshelve notification sample tests  https://review.opendev.org/67667711:34
belmoreirathat looks reasonable. I don't have a big issue with that11:35
sean-k-mooneyroughly how long do your upgrades take end to end after you have done contol plane11:36
belmoreiraI'm still not familiar with the changes for the cpu pinning for train11:36
sean-k-mooneywould it be days/week or are we talking a few months11:36
sean-k-mooneybelmoreira: they allow pinned and unpinned guest on the same host and move counting pinned core to placement11:37
openstackgerritChris Dent proposed openstack/nova master: add InstanceList.get_all_uuids_by_hosts() method  https://review.opendev.org/62355711:37
openstackgerritChris Dent proposed openstack/nova master: single pass instance info fetch in host manager  https://review.opendev.org/62355811:37
openstackgerritChris Dent proposed openstack/nova master: DNM: add profiling to scheduler  https://review.opendev.org/67481011:37
belmoreirain my case the control plane upgrade is less that ~1 hour, then all the compute nodes are upgraded during the next 24h.11:38
sean-k-mooneybelmoreira: to allow pinned and unpinned guest on the same host we need to have two resouce classes in placement instead of 1 vCPUs(shared) and pCPUs(dedicated) and as part of that we need too update exsiting allcoation to the new type11:38
sean-k-mooneycool11:38
sean-k-mooneyso ya that updating to the new type is what i was discussing with stephenfin11:39
sean-k-mooneyand what teh config option would be contolling11:39
sean-k-mooneystephenfin: weel there is one data point but still good to bring this up on the list and bug dansmith about when he is online11:40
belmoreiraand what you are suggesting is to keep it disabled (config option) and then only enable when everything is upgraded11:40
sean-k-mooneyyes11:40
*** markvoelker has joined #openstack-nova11:40
belmoreirain that case I may suggest that the default of the config is "disabled" just in case the operator is not aware11:41
sean-k-mooneyyou may. we were hoping to have the feature enable by defualt so that it just worked for new deployment but i guess we could handel that in installers11:45
sean-k-mooneyit would simplify things11:46
sean-k-mooneyif it was disabel by default11:46
sean-k-mooneyas you would just upgrade normally11:46
sean-k-mooneythe set teh config option if you wanted the feature.11:47
sean-k-mooneyi guess we could also cahge the default in U and remove the option in V11:47
sean-k-mooneyso it give people 3 cycle to switch instead of 1 which is what we were planning11:47
sean-k-mooneystephenfin: ^ thoughts?11:48
* stephenfin looks11:48
stephenfinLet me finish that email and then I'll think about this11:48
sean-k-mooneytl;dr global config pcpus_in_placement=False by default in train change to true in U and remove in V. which completely disables the  feature11:49
sean-k-mooneyonce you set it to true you do it globally and cant set it back to false11:50
sean-k-mooneyin the V release we drop all support fo deploying without it enabled. in U its on by default and train its off by default11:50
sean-k-mooneythen we modify installer to enable it by defualt for new installs in train11:51
*** tbachman has quit IRC11:52
mnaserif i am not wrong, it seems like we're installing `psycopg2` in test-requirements.txt for no reason?11:58
mnaseri cant find any psycopg2 references except in test-requirements?11:58
*** jaosorior has joined #openstack-nova11:58
sean-k-mooneyit used if you are using postgres via sqlalcambe for you db i think11:59
stephenfinDo we still support that? There was talk of dropping it some time back, though cfriesen had objections11:59
mnaserright but you'd have to install that yourself (i.e. it shouldn't be inside test-requirements.txt in openstack/nova ?)11:59
mnaseroh i found this https://review.opendev.org/#/c/296604/11:59
stephenfinWhat's the opportunistic testing he refers to?12:00
mnaserthis is 3 years ago, but i think there's a tc patch saying we dont support postgres.12:00
sean-k-mooneywe have a db mixing that will use mysql or postgress instead of sqlitght if it avioable i think12:01
cdentmnaser: that patch never landed in full12:01
sean-k-mooneymnaser: there was discussion or it yes12:01
mnaserah, ok.12:01
cdentinstead we decided that we wouldn't explicitly disallow it12:01
mnaseri'm just annoyed by it because i just had tox fail on me cause i didnt have postgres development headers..12:02
cdentinstead projects could try to use sqlachemy in the way it was intended if they like12:02
sean-k-mooneymnaser: are you just annoyed by the fact that requires use to install the postgres client and complie it12:02
sean-k-mooneyand that breaks  on stable12:02
sean-k-mooneyya12:02
mnaseri have to get the postgres client to run tox locally (its inside test-requirements, not requirements)12:02
sean-k-mooneywe could replacy it with psycopg2-binary12:02
mnaseroh thats a reasonable suggestion12:03
sean-k-mooney"The binary package is a practical choice for development and testing but in production it is advised to use the package built from sources.£12:03
cdentmnaser: yeah, in placement we did this: https://review.opendev.org/#/c/671249/ which may be a method for possible hacking around things12:03
sean-k-mooneywe are using it for testing so i think it makes sense12:03
mnaseroh thats a nice workaround too12:04
mnaserTIL about sys_platform12:04
openstackgerritSurya Seetharaman proposed openstack/nova master: API microversion 2.76: Add 'power-update' external event  https://review.opendev.org/64561112:04
sean-k-mooneycdent: so when you develop on macos you dont run all the db test and leave the gate check it12:04
sean-k-mooneyunfortunetly i dont think we will be allowed do the same on linux12:05
sean-k-mooneymaybe i should go back ot using windows12:05
cdentsean-k-mooney: the db tests are opportunistic so the migrations are testing on sqlite but not msyql/postgresql12:05
cdenti'm not suggesting that we do exactly what's done in that patch, rather that there might be _some_ strategy for making those requirements optional12:06
sean-k-mooneyya but back to the binary package is there any reason not to jsut use that instead12:06
sean-k-mooneycdent: well we could make it a tox siblig too12:06
sean-k-mooneyrather then have it in test requirements12:07
openstackgerritGhanshyam Mann proposed openstack/nova master: Add new default roles in Admin Action API policies  https://review.opendev.org/67668212:12
openstackgerritMohammed Naser proposed openstack/nova master: config: remove deprecated checksum options  https://review.opendev.org/67653912:18
openstackgerritMohammed Naser proposed openstack/nova master: Remove nova.image.download.modules extension point  https://review.opendev.org/67654012:18
openstackgerritMohammed Naser proposed openstack/nova master: requirements: move to using psycopg2-binary  https://review.opendev.org/67668412:18
*** luksky has joined #openstack-nova12:22
stephenfincdent: That's easy - 'extras'12:25
stephenfine.g. https://github.com/openstack/oslo.messaging/blob/master/setup.cfg#L22-L2912:25
sean-k-mooney stephenfin ah ya that is what i was tihnking of when i said tox siblings12:26
sean-k-mooneybut we would have to be able to use tox -e py37[mysql,postgres] or whatever in the upstream gate12:27
sean-k-mooneyif we could not run the tox env with the extras installed then it wont help12:27
*** nweinber__ has joined #openstack-nova12:28
stephenfinsean-k-mooney: Not necessarily12:28
stephenfinsean-k-mooney: https://tox.readthedocs.io/en/latest/config.html#conf-extras12:29
sean-k-mooneythe goal is to not need to install postgres header locally to be able to run tox12:30
sean-k-mooneybut to still enable all the testing with the optional deps in the gate12:30
sean-k-mooneyso im not sure that actully helps12:31
*** smcginnis is now known as smcginnis|pto12:34
*** nweinber__ has quit IRC12:36
openstackgerritGhanshyam Mann proposed openstack/nova master: Pass the target in os-services APIs policy  https://review.opendev.org/67668812:36
*** ricolin has joined #openstack-nova12:37
openstackgerritGhanshyam Mann proposed openstack/nova master: Introduce scope_types in Admin Actions  https://review.opendev.org/65782312:38
*** dpawlik has quit IRC12:38
openstackgerritGhanshyam Mann proposed openstack/nova master: Add new default roles in Admin Action API policies  https://review.opendev.org/67668212:39
openstackgerritGhanshyam Mann proposed openstack/nova master: Ensure we pass a target in admin actions  https://review.opendev.org/66309512:39
*** hongbin has joined #openstack-nova12:43
*** hongbin has quit IRC12:43
*** dpawlik has joined #openstack-nova12:50
*** tbachman has joined #openstack-nova12:51
*** dpawlik has quit IRC12:55
*** eharney has joined #openstack-nova12:55
*** tbachman has quit IRC13:01
*** helenafm has quit IRC13:02
*** BjoernT has joined #openstack-nova13:03
*** tssurya has quit IRC13:03
*** tssurya has joined #openstack-nova13:04
*** tbachman has joined #openstack-nova13:08
*** tbachman_ has joined #openstack-nova13:14
*** tbachman has quit IRC13:15
*** tbachman_ is now known as tbachman13:15
*** tbachman has quit IRC13:17
*** mriedem has joined #openstack-nova13:18
*** tbachman has joined #openstack-nova13:19
gmannmelwitt: can you review this. This is followup fix for policy default refresh spec - https://review.opendev.org/#/c/669196/13:20
gmannmelwitt: johnthetubaguy  also I have prepared the first set of changes and looking for feedback before I proceed on other policy changes.13:21
gmannmelwitt: johnthetubaguy this and its base patches are the complete set of os-services policy change - https://review.opendev.org/#/c/676688/ and13:22
gmannsent the review guide on ML also http://lists.openstack.org/pipermail/openstack-discuss/2019-August/008504.html13:22
*** noonedeadpunk has left #openstack-nova13:28
*** luksky has quit IRC13:33
*** priteau has joined #openstack-nova13:38
mriedemgibi: sorry i didn't address these before rebasing yesterday, but replied now https://review.opendev.org/#/c/635080/3813:40
sean-k-mooneymriedem: o/13:42
sean-k-mooneymriedem: i played around with lxc a bit last night13:42
sean-k-mooneyso i managed to boot a contianer but there are issues13:42
sean-k-mooneyi was able to boot with the .img  file in  https://cloud-images.ubuntu.com/bionic/current/bionic-server-cloudimg-amd64.tar.gz13:43
sean-k-mooneythat is a img file create from a raw ext4 partion with the full file system13:44
sean-k-mooneyi confimed the cirros image seam to use /init instead of /sbin/init and we hardcode the path13:44
*** belmoreira has quit IRC13:45
sean-k-mooneyhttps://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L5055-L505713:45
sean-k-mooneybut i also found we do not resize the image and as a result cloud init does not run13:45
sean-k-mooney* we might resize the image but we dont resize the filesystem in the image13:46
gmannalex_xu: cc for ^^ policy default refresh changes review and early feedback- http://lists.openstack.org/pipermail/openstack-discuss/2019-August/008504.html13:47
gmannmriedem: can you check this now, added functional tests - https://review.opendev.org/#/c/676275/13:47
sean-k-mooneymriedem: so tl;dr if you have a image preprepared with enough space for cloud-init to run we might be oke but i dont know if cloud inti can resize the file system when dealing with lxc13:48
*** sapd1_x has quit IRC13:50
*** belmoreira has joined #openstack-nova13:51
openstackgerritChris Dent proposed openstack/nova master: DNM: add profiling to scheduler  https://review.opendev.org/67481013:55
*** sapd1_x has joined #openstack-nova13:56
*** sapd1_x has quit IRC13:57
yonglihemriedem:  I got Alex's +2, you recently reviewed this patch,  Hope you had bandwidth to review it again: https://review.opendev.org/#/c/621476/14:02
efriedmelwitt: Thank you for sending that. The u-c bump merged as well. That opens up several improvements in nova.14:02
mordredefried: did your mock.patch thing wind up working?14:12
efriedyes!14:12
gibimriedem: ack, I try to look at it today14:12
efriedmordred: which excites me not because it's a lovely solution, but because it lets me use all those shiny new features in nova now.14:13
*** tbachman has quit IRC14:13
sean-k-mooneyefried: you are not useing mock.patch outside of tests are you?14:13
efriedwhich I will start doing just as soooon as I wake up.14:13
efriedsean-k-mooney: Why, would that be a bad thing?14:14
efriedit's exactly the same as temporary_mutation14:14
openstackgerritMohammed Naser proposed openstack/nova master: config: remove deprecated checksum options  https://review.opendev.org/67653914:14
openstackgerritMohammed Naser proposed openstack/nova master: Remove nova.image.download.modules extension point  https://review.opendev.org/67654014:14
openstackgerritMohammed Naser proposed openstack/nova master: requirements: move to using psycopg2-binary  https://review.opendev.org/67668414:14
efriedsean-k-mooney: I'm yanking your chain. We're talking about this https://review.opendev.org/67649514:14
sean-k-mooneybecause you are monkeypatchin other code at runtime which can fail in really hard to debug ways14:14
sean-k-mooney:)14:15
sean-k-mooneyok that is less scary14:15
cdentsigh: the nova functional tests are _still_ reading /etc/nova/nova.conf (if it exists). I thought we fixed that?14:16
sean-k-mooneywhat test?14:17
sean-k-mooneyits proably missing a config fixture14:17
* aspiers has been wrestling with mock.PropertyMock for two hours now, and is still losing :-(14:17
aspiersAFAICS it just doesn't do what it claims to14:18
tssuryamriedem, dansmith: hmm I was thinking for the UnexpectedTaskStateError exception for the power-update event, should we also handle the faults/error notifications in case its actually another action that won the race ?14:18
tssuryaas of now if we simply return the event is considered as a successful attempt14:18
dansmithtssurya: I'm not sure what you're asking14:19
openstackgerritChris Dent proposed openstack/nova master: single pass instance info fetch in host manager  https://review.opendev.org/62355814:20
mriedemyonglihe: i can review again based on my previous comments but i likely won't be approving that change, because (1) we're trying to land tssurya's change for 2.76 since there is an approved ironic change that depends on the nova change (see the ML) and (2) i can't vote on the low-level contents of what's going into the numa topology response, i think dansmith or others that were more involved in the spec approval should revie14:20
mriedemose details.14:20
mriedemsean-k-mooney: ack on the lxc thing; we can define an image to use in the job, but if that hard-coding in the libvirt driver is a problem we'll need to do something about that.14:21
mriedemsean-k-mooney: i'm not sure how much we care about cloud-init in the lxc job, but someone does have some patches up for making cloud-init work with lxc (so saying that, it might not work today anyway)14:21
*** sapd1_x has joined #openstack-nova14:21
tssuryadansmith: ah nvm, I got the answer14:21
mriedemsean-k-mooney: yeah this https://review.opendev.org/#/c/667976/14:21
tssurya:D sorry for the noise14:22
openstackgerritEric Fried proposed openstack/nova master: Bump minimum ksa (3.16.0) and sdk (0.34.0)  https://review.opendev.org/67670714:22
dansmithtssurya: heh, okay, sorry14:22
cdentmriedem: I reckon that single pass instance info thing ^ is a real winner. I've removed some dead code (I think jay had future plans) but I'm a bit lost on what to do test wise, so if you have ideas, I've got ears.14:22
sean-k-mooney"/sbin/init" has been the location of the init script for decades so i think cirros just need to add a symlink14:22
dansmithsean-k-mooney: I have that open in a tab, working on trying to focus on it for a bit... is there a change coming?14:22
sean-k-mooneyim more worried about the symlink14:22
sean-k-mooney*filesystem14:22
sean-k-mooneye.g not resizing it before starting the container14:22
sean-k-mooneyi dont know if you can resize it inside the container and a spent a while trying to do it last night and failed14:23
efriedaspiers: what are you trying to do with PropertyMock?14:23
aspierstrying to patch objects.Instance.image_meta to return my image_meta fixture14:23
mriedemcdent: fwiw track_instance_changes might be true in grenade jobs, would need to check, but grenade jobs don't run in superconductor mode14:24
aspiersbut it just returns a mock object instead14:24
sean-k-mooneydansmith: sorry context are you refering to stephens chagnes?14:24
sean-k-mooneyor something else14:24
dansmithsean-k-mooney: gah, sorry that was supposed to be aimed at tssurya14:24
sean-k-mooneyah14:24
aspierscalling instance.image_meta() returns the fixture I want, but not without the ()14:24
tssuryadansmith: ok no wait I didn't get the answer :( . So in the API we do the action_start thing which creates the instance-action event, however when we specially handle the UnexpectedTaskStateError (so that we can continue to process other events) in the manager, the "compute_power_update' event is recorded as a success14:24
cdentmriedem: there's something in devstack comments about that, lemme refresh memory14:25
aspiersit's infuriating, been staring for hours and can't see what I'm doing wrong14:25
tssuryawhich is wrong right ?14:25
dansmithtssurya: ah, yeah, can we record that as fail instead in the exception handler?14:25
mriedemcdent: having said that, i'm crunched for time today, leaving this afternoon for a long weekend14:25
sean-k-mooneymriedem: ill look at the cloud-init patch but without it we are not doing the ssh key injection or creating a user so you would have to build all that into the image14:25
cdenti don't think there's any rush on this, just think it is definitely worth bring back from the dead14:26
tssuryadansmith: yea probably, let me check what does that14:26
*** mlavalle has joined #openstack-nova14:26
dansmithtssurya: it would be super good if we can get mriedem's ack on that patch before he leaves and then you leave14:26
tssuryawait mriedem is also going on vacation soon ?14:26
dansmithfor a day yeah14:27
tssuryahmm, ok I am just a bit confused with instance faults/actions/error notification handling for the UnexpectedTaskStateError part14:27
mriedemif you're trapping that error, there will be no fault14:28
mriedemor error notification14:28
dansmithoh14:28
dansmithyeah, mriedem just answered14:28
mriedemyou'll only record a fault or send an error notification if something raises, like NotImplementedError14:28
mriedem@wrap_instance_event will record a start and finish event on entry and exit of the method regardless of how it exits14:28
dansmithyou can log and re-raise maybe?14:29
mriedemthe event gets record on the instance action (Created in the api) keyed by instance uuid and context.request_id14:29
mriedem*recorded14:29
tssuryamriedem: yea but since I do a return from the preemption if any it records a success I guess ?14:29
mriedemyes, it will say it was successful14:30
mriedemhttps://github.com/openstack/nova/blob/872a823d9a02f31e266882bfb499673c51fb4075/nova/compute/utils.py#L130214:30
mriedemhttps://github.com/openstack/nova/blob/872a823d9a02f31e266882bfb499673c51fb4075/nova/objects/instance_action.py#L18414:31
aspiersefried: *finally* figured it. patch(..., new_callable=mock.PropertyMock), *not* patch(..., new_callable=mock.PropertyMock(name='fake_prop'))14:31
mriedemi think i mentioned something in my earlier big round of comments that the functional test should assert the events are recorded as expected for the compute_power_update event14:31
tssuryamriedem: yea I added that14:32
tssuryabut this should not be a  success for the task_state race error right ?14:32
mriedemidk14:32
mriedemyesterday i thought we said that we'd handle UnexpectedTaskStateError, log and return14:32
mriedemif you want to record the action as failed, then you'd log and re-raise14:33
yonglihemriedem: ok if i need to bump up minor version, i gonna do that,  but thanks.14:33
tssuryaok yea14:33
tssuryaI'll do that14:33
dansmithmriedem: I didn't grasp that detail about letting it go14:33
mriedemwell, what does dansmith think14:33
mriedemoh14:33
mriedemnote that ironic at this point has got a response and moved on14:33
dansmithironic doesn't care,14:33
mriedemso this is only useful for an admin debugging that power-update exchange and if it worked14:33
dansmiththis is more like what a user would see14:33
dansmithor the user itself right?14:34
tssuryayea14:34
mriedemthe user can see the actions on their server yeah14:34
tssuryaI am also concerned because of the instance-action CLI show thing14:34
efriedaspiers: That's a facet of new= vs new_callable=14:34
mriedemand the events after a certain microversion (but not traceback details unless they are admin)14:34
aspiersefried: yeah, I realise that *now*, after two hours :-(14:34
yonglihedansmith: I need to bother you with it then. https://review.opendev.org/#/c/621476/14:34
dansmithI can see it both ways:14:34
aspiersefried: I was misled by some existing nova tests which use it incorrectly14:35
dansmitheither they see an action that started/finished, but nothing happened because it was basically dropped, which might be weird,14:35
efriedaspiers: If you need to customize your PropertyMock, you would use new=PropertyMock(...)14:35
*** spatel has joined #openstack-nova14:35
dansmithand they might see an action start/fail and think something is wrong14:35
dansmithso I dunno14:35
* aspiers blames everyone else14:35
dansmithmriedem: tssurya ^14:35
aspiersit can't possibly be me just being stupid14:35
efriedaspiers: Feel free to propose a patch to fix those bogus usages14:35
tssuryadansmith: yea let me check how it is for other actions like pause14:35
aspiersefried: I certainly will14:35
efriedI see three-ish14:35
tssuryawhich are not implemented in ironic driver14:35
tssuryawonder if that records a success action14:36
openstackgerritChris Dent proposed openstack/nova master: DNM: add profiling to scheduler  https://review.opendev.org/67481014:36
mriedemtssurya: it wouldn't,14:36
mriedemhttps://github.com/openstack/nova/blob/872a823d9a02f31e266882bfb499673c51fb4075/nova/compute/manager.py#L497714:36
tssuryayea it doesn't14:36
mriedemit would record a failure b/c of NotImplementedError14:36
tssuryayea14:37
tssuryadansmith, mriedem: if you are both ok with the whole success and return thing I can do that14:38
tssuryabut if you feel its confusing for the users I can reraise and log and ignore raise14:38
dansmithtssurya: I dunno, that I have a strong feeling about which is right or not14:38
tssuryadansmith: ack14:39
mriedemgmann: then why have these unit tests still? https://review.opendev.org/#/c/676275/4/novaclient/tests/unit/v2/test_shell.py14:39
mriedemthey are just asserting what the stub is doing https://review.opendev.org/#/c/676275/4/novaclient/tests/unit/v2/fakes.py14:39
mriedemwhich might be wrong if there is a bug in the stub14:39
mriedemidk either - the user is going to see a stop or start action with a compute_power_update event, they likely won't know what that event means. does the user know that someone powered on or off their bm instance out-of-band?14:41
*** mlavalle has quit IRC14:41
mriedemand since this isn't an action initiated by the user (at least directly in the compute api) but by ironic, is it just best effort and we shouldn't record a failed event if that operatoin lost a race?14:41
*** mlavalle has joined #openstack-nova14:42
mriedemif it's best effort and we don't consider losing a race a failure, then we shouldn't record the overall action as failed, but just "processed"14:42
dansmithmriedem: yeah, that's a valid way to look at it I think14:42
dansmithit's best effort, a hint so to speak, so failure isn't really failure14:43
tssuryafair enough14:43
tssuryaand its easier that way for me :)14:43
dansmithjust put "it's easier for tssurya" in the spec and then you're good ;)14:43
tssuryaI'll stick to what we discussed yesterday then14:43
tssuryadansmith: hehe14:44
mriedemthinking about volume-extended events, we definitely want those to be failed so the user sees because it's initiated by the user resizing their volume in the cinder api14:44
tssuryamriedem: this was a another doubt I had14:44
tssuryathat means we block the rest of the events in the queue no ?14:44
tssuryabecause one volume-extend event broke ?14:44
tssuryaand you raise14:44
mriedemwe wouldn't get a volume-extended and power-update event in the same request14:45
mriedemunless someone sends that manually14:45
mriedemthere might be a bug in the volume-extended event handling in compute that's not handling that properly, but that's a separate bug14:45
tssuryamriedem: got it14:45
mriedemtssurya: how much longer are you going to be around today?14:46
tssuryamriedem: do you have a sample functional test that you have written for such races14:46
tssurya?14:46
tssuryaI couldn't find a way to hack the task_state in between my code14:47
tssuryafor the functional teste14:47
tssuryamriedem: i'll be around only for 2 more hours14:47
mriedemyou'd have to stub/mock something in between to change the task_state after the compute manager sets it and the driver code gets it14:47
mriedemi'm not sure we need the functional test to cover that though14:47
mriedemthat's pretty unit-y test level to me14:48
tssuryabut its ok, I'll be online and if you have comments will update them during vacation14:48
tssuryamriedem: ok then I'll just do a unit test14:48
dansmithyep, unit test makes sense to me14:49
dansmithjust to make sure we catch it and do the right thing14:49
tssuryadansmith: yea I'll do that14:49
mriedemtssurya: but i won't be around to review the updates until monday... and people are held up on this microversion, so i'll review it in detail now before you make another push14:51
tssuryamriedem: ok sounds good14:52
tssuryaeven if I am on vacation I do intend to work on this patch to get it in, so I hope to not block everyone14:52
tssuryas/not block/unblock soon14:53
atmarkhello, I have mix setup of  local disk computes and rbd backed computes. In nova.conf of local disk computes, I have images_type=raw and in the rbd backed compute  image_type=rbd. I can spin up VMs fine in both setup however the when RESIZE a local disk VM, I get 'boot failed: not a bootable disk' from the VM's console14:55
atmarkresizing a RBD VM works. Resizing local disk VMs fails14:56
*** gyee has joined #openstack-nova14:57
mriedemtssurya: doesn't test_external_instance_event_power_update_unexpected_task_state already cover the race you were asking about testing?15:12
tssuryamriedem: yes15:13
tssuryathat's the unit test I have15:13
mriedemthen we don't need a functional test wrinkle for that15:13
tssuryaI didn't have a functional test hence asked15:13
tssuryaah ok15:13
tssuryacool15:13
openstackgerritBalazs Gibizer proposed openstack/nova master: Test heal port allocations in nova-next  https://review.opendev.org/66987915:14
*** READ10 has joined #openstack-nova15:15
mriedemtssurya: dansmith: comments posted https://review.opendev.org/#/c/645611/15:18
*** artom has joined #openstack-nova15:18
tssuryathanks15:18
mriedemif you run out of time, post what you have and i'll fix the rest and +215:20
*** dave-mccowan has joined #openstack-nova15:22
*** READ10 has quit IRC15:24
*** belmoreira has quit IRC15:26
*** macz has joined #openstack-nova15:26
*** belmoreira has joined #openstack-nova15:28
*** jamesdenton has quit IRC15:29
*** dave-mccowan has quit IRC15:30
*** macz has quit IRC15:31
*** ivve has quit IRC15:35
*** belmoreira has quit IRC15:38
openstackgerritEric Fried proposed openstack/nova master: Introduces SDK to IronicDriver and uses for node.get  https://review.opendev.org/64289915:39
openstackgerritEric Fried proposed openstack/nova master: Use SDK for node.list  https://review.opendev.org/65602715:39
openstackgerritEric Fried proposed openstack/nova master: Use SDK for validating instance and node  https://review.opendev.org/65602815:39
openstackgerritEric Fried proposed openstack/nova master: Use SDK for setting instance id  https://review.opendev.org/65969015:39
openstackgerritEric Fried proposed openstack/nova master: Use SDK for add/remove instance info from node  https://review.opendev.org/65969115:39
openstackgerritEric Fried proposed openstack/nova master: Use SDK for getting network metadata from node  https://review.opendev.org/67021315:39
efrieddustinc: Rebased and with requirements bump to sdk 0.34.0 ^15:39
dustincthanks15:39
efriedthat should fix `fields`. I'm hoping it also fixes the remaining patches15:39
dustinc🤞15:40
efriedcause I also added a dep to the devstack patch15:40
efriedhmm15:40
efriedWill the second patch still observe the dep from the first?15:40
mriedemyes15:42
openstackgerritEric Fried proposed openstack/nova master: WIP: Limit get_sdk_adapter to requested service type  https://review.opendev.org/67467815:44
*** markvoelker has quit IRC15:44
efriedcool15:45
*** efried has quit IRC15:46
mriedemi guess forbidden aggregates is never getting out of a runway slot15:48
*** markvoelker has joined #openstack-nova15:48
*** efried has joined #openstack-nova15:50
mriedemsean-k-mooney: if you can get a new patch set for https://review.opendev.org/#/c/671338/ today it would be good as well, since it was pretty close15:51
openstackgerritMohammed Naser proposed openstack/nova master: config: remove deprecated checksum options  https://review.opendev.org/67653915:51
openstackgerritMohammed Naser proposed openstack/nova master: Remove nova.image.download.modules extension point  https://review.opendev.org/67654015:51
openstackgerritMohammed Naser proposed openstack/nova master: requirements: move to using psycopg2-binary  https://review.opendev.org/67668415:51
sean-k-mooneyok i was doing som sriov testing but ill priorities that and get it updated today15:52
sean-k-mooneymriedem: ill ping you when its done15:52
*** cdent has quit IRC15:53
*** mlavalle has quit IRC15:53
openstackgerritMohammed Naser proposed openstack/nova master: constraints: bump psycopg2 to 2.8  https://review.opendev.org/67672515:53
mriedembrinzhang: i'm going to move https://blueprints.launchpad.net/nova/+spec/support-specifying-az-when-restore-shelved-server into the open runway slot though you'll likely have to rebase it again once 2.76 is taken by the power-update change15:54
*** luksky has joined #openstack-nova15:55
*** mlavalle has joined #openstack-nova15:57
*** sapd1_x has quit IRC15:58
melwitttssurya: what do you think about multi-cell archive deleted rows skipping disabled cells? or would you rather expect it to try each cell and move on if can't connect instead15:59
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Mock libvirt'y things globally  https://review.opendev.org/67672715:59
tssuryamelwitt: you mean down cells ?16:00
tssuryadisabled cells should be archived without distinction16:00
mriedemdisabled16:00
mriedemwouldn't one want to disable a cell if it's down?16:00
*** slaweq has joined #openstack-nova16:00
mriedemso the scheduler doesn't try to pull computes from it and timeout?16:00
tssuryayea but its only a workaround for scheduling right ?16:01
tssuryapeople could also have disabled the cells since its new16:01
melwitttssurya: ok. that's kinda what I was thinking, not to assume because disabled to skip. because otherwise you (operator) would have to enable any disabled cells in order to archive and I thought maybe that would be annoying16:01
tssuryanot necessarily down16:01
mriedemmelwitt: well, you could just archive them directly16:01
mriedemlike you do today16:01
mriedemanyway, it was a question - feel free to ignore it until it's a problem16:01
tssuryamelwitt: right yea16:01
*** markvoelker has quit IRC16:02
melwittok, just wanted to take the opportunity to ask tssurya since I saw her around16:02
mriedemcould add a --skip-disabled later if people want that16:03
openstackgerritStephen Finucane proposed openstack/nova master: Add reshaper for PCPU  https://review.opendev.org/67489516:03
openstackgerritStephen Finucane proposed openstack/nova master: Follow up for I491eb7abe1405b27c552cdef142c688a46e914f2  https://review.opendev.org/67558916:03
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Fold in argument to '_update_provider_tree_for_vgpu'  https://review.opendev.org/67672916:03
melwittaye16:03
openstackgerritMatt Riedemann proposed openstack/nova stable/stein: Add functional regression recreate test for bug 1839560  https://review.opendev.org/67650716:03
openstackbug 1839560 in OpenStack Compute (nova) stein "ironic: moving node to maintenance makes it unusable afterwards" [High,In progress] https://launchpad.net/bugs/1839560 - Assigned to Matt Riedemann (mriedem)16:03
openstackgerritMatt Riedemann proposed openstack/nova stable/stein: Restore soft-deleted compute node with same uuid  https://review.opendev.org/67650916:03
mriedemmnaser: ^ functional test should be fixed now16:04
stephenfinmriedem, efried: When you've a chance, could you look at my two TODOs here to make sure I'm understanding what placement is doing correctly? (it's for the VCPU -> PCPU reshape) https://review.opendev.org/#/c/674895/8/nova/virt/libvirt/driver.py@7373 https://review.opendev.org/#/c/674895/8/nova/virt/libvirt/driver.py@738916:06
openstackgerritAkihiro Motoki proposed openstack/nova master: DNM: WIP: PDF documentation build  https://review.opendev.org/67673016:07
openstackgerritMerged openstack/nova stable/queens: Fix misuse of nova.objects.base.obj_equal_prims  https://review.opendev.org/67629116:09
*** markvoelker has joined #openstack-nova16:11
efriedstephenfin: It is true that *today* the compute node provider is the only provider of *CPU resources. So adding new code with that assumption ingrained is safe, but adds to the tech debt we have to pay off when we model NUMA nodes.16:11
stephenfinefried: Is that a fair assumption for the reshape operation though16:11
stephenfin?16:11
openstackgerritSurya Seetharaman proposed openstack/nova master: API microversion 2.76: Add 'power-update' external event  https://review.opendev.org/64561116:12
stephenfinGiven that in order to get a NUMA topology, we'd have to had reshaped first16:12
efriedstephenfin: What's the upgrade path? Would there be a way to FFU past Train and straight into U?16:13
efriedHow are we enforcing the order of different reshapes?16:13
efriedBecause that's what we're talking about here.16:13
tssuryamriedem, dansmith: ^ thanks for all the help16:13
openstackgerritAkihiro Motoki proposed openstack/nova master: DNM: WIP: PDF documentation build  https://review.opendev.org/67673016:13
stephenfinI have no idea. sean-k-mooney and I have been discussing that16:13
dansmithmelwitt: I agree with tssurya that archive should not look at the disabled flag16:13
stephenfinI'm not even sure how reshapes and FFU work in general16:14
efriedstephenfin: My point, when you write the NUMA reshaper, is it also going to account for VCPU->PCPU-ness?16:14
stephenfinAh, gotcha16:14
efriedwell... they don't, yet.16:14
*** slaweq has quit IRC16:14
stephenfinI guess we could just do it in order?16:14
efriedyeah. Though we don't yet have any kind of infrastructure set up for "do these reshapes in this order".16:15
efriedLike what happens for db migrations (right?)16:15
stephenfinSo as we add reshapers, we follow the pattern started with vgpu and keep adding new '_update_provider_tree_for_foo' functions16:15
stephenfini.e. https://review.opendev.org/#/c/674895/8/nova/virt/libvirt/driver.py@692616:15
mriedemstephenfin: replied16:15
stephenfin*adding new functions below the existing functions16:15
melwittdansmith: ack, thanks16:16
stephenfinmriedem: ta16:16
*** ricolin has quit IRC16:17
efriedstephenfin: Yes, that's the idea. I suppose it would be nice to have it more codified. Especially since we're going to want some way to invoke these generically (i.e. from a non-virt-driver-specific engine) for FFU.16:17
* mriedem gets out his red pen just for tssurya16:17
*** tssurya has quit IRC16:18
melwittand..... she left16:18
efriedstephenfin: I draw your attention to http://lists.openstack.org/pipermail/openstack-discuss/2019-March/004204.html16:18
mriedemefried: the FFU support for VGPU never happened right?16:18
efriedmriedem:  jinx16:18
mriedemwonder if anyone has hit the reshape for vgpu in stein - mnaser, did vexxhost have vgpu resources in rocky?16:18
mnaserno, we do not use vgpus, sorry16:18
mriedemor only physical gpu passthrough16:19
mriedemok16:19
mnaseronly physical passthrough16:19
mriedemhave you ever heard of anyone providing vgpus?16:19
mnasersomeone contributed a patch to OSA to enable vgpu support16:19
mnaserand it seemed like they knew what they were doing in it, maybe i can find them16:19
mnaser(osa does the whole mdev lookup and stuff)16:19
mriedemi think i remember hearing cern didn't use them b/c they didn't get the performance needed compared to physical passthorugh16:19
*** eharney has quit IRC16:20
mriedemthough people have been pushing the patches to hide the hypervisor in the guest to hack around nvidia licensing stuff16:20
mnaserhttps://review.opendev.org/#/c/597183/16:20
mnaserlooks like that person was testing it with the i915 gvt stuff16:20
mriedemmaybe that was OVH?16:20
mnaseraccording to the review16:20
mnaserValentin Boucher <valentin.boucher@kontron.com>16:21
mriedemok i'm thinking ovh was checking out vgpus16:21
mriedembut not sure how to ask, amorin ^?16:21
mnaseroh look at that16:21
mnaservalentin lives in montreal16:21
mriedem*who16:21
mriedemmnaser: i may be 'merican but i know montreal != france :)16:21
melwittdansmith, mriedem: what do you think about moving onto the next cell if anything fails (down cells)? on the surface, it seemed like a good idea to me but now I'm wondering if that could possibly mislead anyone by making them think archive "completed" when it didn't?16:21
mnaseroh no i was just surprised he's a local :)16:22
mriedemmelwitt: can we avoid handling down cells in that already too big patch?16:22
melwittsure16:22
mriedeme.g. leave a todo in the code where a down cell thing could be handled, which is either log and continue or fail16:22
dansmithagree16:22
dansmithbut also, yes I think skip/warn unreachable cells16:23
melwittyeah, I was thinking just "except Exception" log continue16:24
mriedemstephenfin: i'm guessing i just ruined your day with the "what about pending resizes and migration allocation consumers" thing16:26
mriedemyou're welcome16:26
stephenfinyeah, way to bum me out16:26
*** slaweq has joined #openstack-nova16:31
mriedemdansmith: before i address my comments in https://review.opendev.org/#/c/645611/14 do you want to make a pass?16:34
mriedems/do you want to/will you please/16:35
dansmithmriedem: I read your comments before and commented on that physical thing, are there other  questions?16:35
mriedemnot questions no,16:36
dansmithbecause tbh, it's fine enough for me and I'd just merge it to claim the version and then address the nits and otherthings later16:36
mriedembut if you have comments on the diff itself, make them now before i make changes16:36
mriedemok i'll start updating then16:36
dansmithoh are you pushing the next verison?16:36
mriedemyes16:36
mriedemsurya is gone16:36
dansmithoh, sorry, she pushed again, my bad16:36
dansmithbeen distracted16:37
*** slaweq has quit IRC16:38
mriedemefried: do you want me to respin for that unrelated change in https://review.opendev.org/#/c/675218/4 ?16:39
dansmithmriedem: there was one legit test failure in the last run, IIRC, but I didn't look into it.. is that fixed?16:39
dansmithotherwise, yeah, I'm fine with current plus your planned changes16:39
efriedmriedem: Might as well, it doesn't seem worth a whole fup. I'm here to re+2 it quick.16:40
mriedemdansmith: idk, but i can test locally https://logs.opendev.org/11/645611/13/check/openstack-tox-py27/7deb014/testr_results.html.gz16:40
mriedemefried: ack will do16:40
efriedcoo16:40
dansmithookie16:41
openstackgerritMatt Riedemann proposed openstack/nova stable/rocky: Add functional regression recreate test for bug 1839560  https://review.opendev.org/67651316:43
openstackbug 1839560 in OpenStack Compute (nova) stein "ironic: moving node to maintenance makes it unusable afterwards" [High,In progress] https://launchpad.net/bugs/1839560 - Assigned to Matt Riedemann (mriedem)16:43
openstackgerritMatt Riedemann proposed openstack/nova stable/rocky: Restore soft-deleted compute node with same uuid  https://review.opendev.org/67651416:43
*** slaweq has joined #openstack-nova16:48
openstackgerritMatt Riedemann proposed openstack/nova master: Re-use DB MetaData during archive_deleted_rows  https://review.opendev.org/67521816:50
artomdansmith, mriedem, hey, you guys were the main reviewers of NUMA LM in Stein, will have bandwidth to do the same in Train, or should I be sucking up to other cores? ;)16:57
artom*will you have16:57
dansmithI will try16:58
artomdansmith, ack, thanks :)16:58
openstackgerritsean mooney proposed openstack/nova master: Libvirt: add support for vPMU configuration.  https://review.opendev.org/67133816:58
mriedemartom: not today17:01
mriedemartom: you should also beat down the starlingx people's door,17:02
artommriedem, I wasn't really expecting today :)17:02
mriedembecause at the ptg and last summit they were saying this was the big ticket thing they needed17:02
artomI meant in general17:02
mriedemso if this is so critical for starlingx they should have people reviewing and testing it17:02
artommriedem, yeah, I emailed the ML, and dtroyer and Gerry personally17:02
artomRadio silence :/17:02
mriedemcfriesen is probably the best starlingx person to review the series but he's been out of nova for awhile now17:03
sean-k-mooneywell that and sriov numa policies was on the list too.17:03
sean-k-mooneyi think we almost have everything this cycle?17:03
artomGerry Kopec (not upstream as far as I can tell, though he did leave some reviews) tested it17:03
artomAnd found some problems17:03
artomWas hoping he'd step up again17:03
artomRadio silence so far. Which is weird, because Dean actually emailed me first17:04
artomAsking how it was going17:04
sean-k-mooneyartom: i need to set up a second node but when im done testign a sriov thing i plan to test your numa live migration code with stephens cpu pinning stuff and my sriov migration code and report back17:05
sean-k-mooneyeta on that is sometime next week17:05
*** derekh has quit IRC17:05
artomsean-k-mooney, my series has conflicts with stephenfin's, so not sure how you'll test those together17:06
artomWell, resolve manually, I suppose17:06
mriedemcpu pinning stuff == PCPU?17:06
sean-k-mooneyya i was thinking of doign that but if there are a lot ill test them seperatly17:06
sean-k-mooneyyes17:06
sean-k-mooneyi would also like to test gibis bandwith stuff17:06
mriedemif it were me, i'd test artom's numa live migration stuff w/o trying to wrangle the PCPU stuff in17:07
mriedemjesus17:07
mriedemso yo'ud like to actually not get anything done :)17:07
sean-k-mooneywell ill test  them seperatly first17:07
artomHe'll become a master at git rebasing and conflict resolution though :)17:07
sean-k-mooneybut i want to actully test those 4 features in 1 vm in train17:08
sean-k-mooneyi guess it better to wait untill some/all have merged to do that17:08
mriedemwell i applaud your efforts for at least trying to test this stuff17:09
mriedemsince no one else is17:09
mriedemtogether i mean17:09
sean-k-mooneywell people will want to combine those so i want to test them before i get the bug report17:09
mriedemdon't worry, the bug report will be in 18+ months17:10
mriedemyou might not even be working on openstack at that point17:10
*** cdent has joined #openstack-nova17:10
sean-k-mooneyya.... if we are lucky and people deploy train by then17:10
artomI still don't think testing them together before they're even merged is a good idea17:11
sean-k-mooneyTIL we still have at least 1 customer with a suppor exception for liberty until 2021 ...17:11
artomLaudable, but not good ;)17:11
*** prometheanfire has joined #openstack-nova17:11
prometheanfirenova still has an issue with the latest libvirt https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/logs_16/675816/5/check/cross-nova-py36/a6c71f8/testr_results.html.gz17:11
sean-k-mooneyartom: well in that case ill just test them 1 by one17:11
artomBut yeah, I totally get mriedem's gripe about the RH dev/QE lag17:12
*** tbachman has joined #openstack-nova17:12
openstackgerritAdam Spiers proposed openstack/nova master: Fix use of mock.patch with new_callable=PropertyMock  https://review.opendev.org/67673817:12
aspiersefried: ^^^ hope that's right, still trying to wrap my head around some of this stuff17:12
artomIt's been half-assedly brought up internally, but it takes a lot of work (literally - force over a distance) for a long time to change that17:13
mriedemartom: well it's not really only RH, it's any distro that EOLs an old series and customers are forced to move up17:13
aspiersany other mock experts wanna review that?17:13
mriedemwhich is why we get all the RH queens bug reports bubblin gup now17:13
artommriedem, are there other significant distros besides OSP at this point? Honest question17:14
cdentefried: I assume you probably know this already and we're merely following protocol: but I didn't write that "single pass instance info fetch in host manager". My ressurection of it was solely based on the profiling benefits. So a) I'll have to dig deeper to respond to the comment, b) the comments make that digging easier.17:14
artomCommercial, I mean17:14
mriedemcanonical? VIO? suse? idk ask their devs17:14
sean-k-mooneyi think ubuntu still has more deplopyment then osp17:14
efriedaspiers: lgtm, thank you.17:14
artomAh, SUSE, right17:15
artom(With apologies to aspiers)17:15
mriedemartom: you can ask aspiers how suse is ramping up for rolling out rocky with SEV forks :)17:15
sean-k-mooneyand canonical openstack17:15
aspiersartom: what are you apologising for? :)17:15
artomaspiers, forgetting you exist, essentially ;)17:15
aspiershaha17:15
aspierseasily done17:15
aspiersmriedem: yeah sadly that's probably gonna happen17:16
efriedcdent: ack. If we want to land this pretty much as-is, we just need unit/func test coverage in this patch. The rest can be FUPed.17:16
aspiersNot 100% sure though. We have a policy of trying to stay as close to upstream as humanly possible, even on stable branches.17:16
aspiersartom: let me know if I can help with anything from the distro angle17:16
sean-k-mooneyso do we but PMs have a different opipion on that when there are $$$$17:17
artomaspiers, thank you :) Though we were just discussing dev/QE lag17:17
artomaspiers, and how the RH QE is lagging behind upstream17:17
artomSo we'll do an RFE, and like a year later, we find out if never worked17:17
artom(Only slightly exaggerating)17:18
aspiersartom: well at least you do QE on upstream :)17:18
artomaspiers, we don't, hence the lag17:18
aspiersI mean eventually17:18
artomBy the time stuff's in our builds, it's been months, if not years17:18
*** nweinber has joined #openstack-nova17:18
aspierslag implies it happens eventually :)17:18
aspiersIf it never happens, that's infinite lag17:18
aspiersalthough maybe I kinda just contradicted myself17:19
*** cdent has quit IRC17:19
openstackgerritMatt Riedemann proposed openstack/nova master: API microversion 2.76: Add 'power-update' external event  https://review.opendev.org/64561117:20
mriedemdansmith: ^17:20
* mriedem gets lunch17:20
*** eharney has joined #openstack-nova17:32
dansmithmriedem: looks good17:35
*** priteau has quit IRC17:39
*** bbowen__ has quit IRC17:52
*** nweinber has quit IRC17:55
*** nweinber has joined #openstack-nova17:55
*** nweinber has quit IRC17:55
melwittargh why does it do "An auth plugin is required to determine endpoint URL" when I'm using the PlacementFixture18:03
efriedmelwitt: You need to use the sdk fixture :)18:04
melwittthis is what happens when I don't use ServersTestBase18:04
melwittoh. ok18:04
efried(as well as PlacementFixture, if what you're trying to do involves real placement calls)18:04
melwittthe sdk fixture is in test.TestCase18:05
efriedmelwitt: are you getting the error locally or in zuul?18:06
efriedlocally => upgrade your ksa and sdk in your virtualenv18:06
efriedzuul => rebase and recheck, since the u-c bump landed overnight.18:06
melwittlocally. I'm trying to change from deriving from ServersTestCase to just TestCase18:06
melwittok18:07
efriedyeah, I bet it's because ksa and/or sdk in your venv is downlevel OR those are latest but you don't have the new fixture you merged last night.18:07
melwittI had just recreated my venv. but yeah let me just rebase again in case that helps. I can never remember how this works with pulling u-c18:10
*** ivve has joined #openstack-nova18:10
efriedmelwitt: If you recreated your venv without https://review.opendev.org/676707 then you might still have the old libs, I'm not actually sure.18:12
efriedYou can check with18:12
efried.tox/$env/bin/pip show openstacksdk keystoneauth118:12
efried...and of course you'll want your change rebased against latest master to pick up last night's fixture change to accommodate that.18:13
melwitt0.34.0 and 3.16.018:13
efriedthose are latest, good; so you'll have a problem if your change is based earlier than the fixture commit from yesterday.18:13
efried...and if all that is up to date, then it's a legit code problem :)18:14
melwittit is. thanks, rebasing now18:14
*** boxiang has quit IRC18:14
efriedokay, cool, lmk if you still get errors of this ilk, I'm tracking closely.18:14
melwittthanks18:15
*** boxiang has joined #openstack-nova18:15
openstackgerritsean mooney proposed openstack/nova master: Deprecate Aggregate[Core|Ram|Disk]Filters  https://review.opendev.org/67349618:16
sean-k-mooneymelwitt: care to take a look at ^18:16
*** Sundar has joined #openstack-nova18:16
melwittno18:17
melwittjk18:17
sean-k-mooneyi would not blame you :P18:18
sean-k-mooneybut you more or less deprecated them with your mail post like 18 months ago but we never actully did18:18
melwittI feel attacked18:18
melwittyeah, I know. I'll look at it18:19
sean-k-mooneycool im going to finish one last test and then call it a day18:19
sean-k-mooneythanks18:19
mriedem"no" was the correct answer18:20
openstackgerritAdam Spiers proposed openstack/nova master: Add <launchSecurity> and <driver iommu='on' /> to config.py  https://review.opendev.org/63631818:23
openstackgerritAdam Spiers proposed openstack/nova master: Apply SEV-specific guest config when SEV is required  https://review.opendev.org/64456518:23
openstackgerritAdam Spiers proposed openstack/nova master: Enable booting of libvirt guests with AMD SEV memory encryption  https://review.opendev.org/66661618:23
openstackgerritAdam Spiers proposed openstack/nova master: Allow assertXmlEqual() to pass options to matchers.XMLMatches  https://review.opendev.org/67462818:32
openstackgerritAdam Spiers proposed openstack/nova master: Fix libvirt driver tests to use LibvirtConfigCapsGuest instances  https://review.opendev.org/67462918:32
openstackgerritAdam Spiers proposed openstack/nova master: Track libvirt host/domain capabilities for multiple machine types  https://review.opendev.org/67315118:32
openstackgerritAdam Spiers proposed openstack/nova master: Provide HW_CPU_X86_AMD_SEV trait when SEV is supported  https://review.opendev.org/63868018:32
openstackgerritAdam Spiers proposed openstack/nova master: Add extra spec parameter and image property for memory encryption  https://review.opendev.org/66442018:32
openstackgerritAdam Spiers proposed openstack/nova master: Extract SEV-specific bits on host detection  https://review.opendev.org/63633418:32
openstackgerritAdam Spiers proposed openstack/nova master: Add <launchSecurity> and <driver iommu='on' /> to config.py  https://review.opendev.org/63631818:32
openstackgerritAdam Spiers proposed openstack/nova master: Apply SEV-specific guest config when SEV is required  https://review.opendev.org/64456518:32
openstackgerritAdam Spiers proposed openstack/nova master: Enable booting of libvirt guests with AMD SEV memory encryption  https://review.opendev.org/66661618:32
mriedemsean-k-mooney: melwitt: i reviewed that deprecation patch (again)18:43
mriedemmore docs fun18:43
mriedemmelwitt: btw i missed that you split this all up https://review.opendev.org/#/c/640898/ - bug me next week to review that series; i wanted to play with it in devstack while reviewing, which i won't have time for today18:44
sean-k-mooneymriedem: jsut looked ya i can fix up those issues and repin ill likely do it tomrrow however18:45
melwittmriedem: cool, will do. I'm gonna respin it to address tetsuro's comments, then I'll bug you next week18:46
melwittthanks18:46
mriedemit's only ~8pm, you've got 5 more hours to put in sean18:46
sean-k-mooney for once i started at 9 this moring18:46
sean-k-mooneywell 9 ish18:46
*** nweinber has joined #openstack-nova18:50
*** spsurya has quit IRC18:53
*** ociuhandu has joined #openstack-nova18:56
mriedemwhat time do you usually start?18:58
sean-k-mooneyaround 10:30 or 1118:58
mriedemcripes18:58
*** ociuhandu has quit IRC18:58
mriedemi could watch the price is right every day18:58
sean-k-mooneyand i usually take an hour or two break between around 6:30 ish and come back on line around 7 or 8 with the intent of finsih up before 818:59
sean-k-mooney*1018:59
sean-k-mooneyi often dont but that in theory is the plan19:00
mriedemsean-k-mooney: vpmu comments as well https://review.opendev.org/#/c/671338/19:11
artomHe waved us good night on the internal channel19:12
mriedembah19:12
mriedemi know he can't quite this early19:12
mriedemhttps://www.youtube.com/watch?v=nsmY0tFJEIE19:14
*** gregwork has quit IRC19:16
*** gregwork has joined #openstack-nova19:17
melwittyessssss func test "OK"19:17
artommriedem, that's a very unhealthy relationship to have with a piece of software ;)19:17
artomI suppose that could change in the future once AI becomes better19:18
mriedemartom: i'll let you make the firmware joke here19:18
artomYou have to flash it.19:19
mriedemHI-O19:19
artom*finger guns*19:20
*** nweinber has quit IRC19:22
*** nweinber has joined #openstack-nova19:22
efriedmriedem: grenade jobs have been failing a lot today, any ideas?19:26
*** nweinber has quit IRC19:27
mriedemlinke me19:28
mriedem*link19:28
mriedemartom: trying to push the starlingx folk publicly as well19:28
artommriedem, you're asking me to push them, or saying you're doing it?19:29
mriedemi called them out in the ML19:29
mriedemartom: i'm assuming starlingx has a weekly meeting, it would probably be good if you can get your thing on their agenda as a reminder19:30
mriedemhttps://wiki.openstack.org/wiki/Starlingx/Meetings19:30
*** vesper11 has quit IRC19:30
mriedem"Bi-weekly Marketing Call" hells yeah19:31
mriedemi have no idea which sub-project meeting this would come up in though19:31
mriedemi guess, "Weekly Community Call"19:31
efriedmriedem: https://review.opendev.org/#/c/676539/ and its successor in the series19:33
artommriedem, dtroyer is in #openstack-qa, we can just ping him19:34
mriedemhttps://object-storage-ca-ymq-1.vexxhost.net/v1/86bbbcfa8ad043109d2d7af530225c72/logs_39/676539/4/check/nova-grenade-live-migration/bd182b5/logs/grenade.sh.txt.gz19:34
mriedemdie 198 'SSH to the client did not work, something very wrong'19:34
mriedemssh fail19:34
mriedemefried: so, that's like any other random ssh fail, and likely coming from the stein side where devstack doesn't run n-api-meta with caching19:38
mriedemso recheck19:38
efriedokay, I just saw like four or five runs in a row come in with grenade failures, didn't want you to bugger off on a bear-baiting trip if there was something actually wrong.19:39
mriedemi've got a call in 20 minutes anyway so i'm stuck here for a bit19:39
mriedembut after that it's pants off dance off19:39
artomRock out with your, err, rooster out?19:40
* artom is getting *nothing* done :(19:41
artomSick puns tho19:42
mriedemso just a normal day huh19:42
artom*ZING*19:42
* mriedem calls the fire dept19:42
artomhttps://en.wikipedia.org/wiki/List_of_burn_centres_in_Canada#Quebec19:44
artomOh damn, there's only 1 for adults19:44
openstackgerritDustin Cowles proposed openstack/nova master: Provider config file schema and loader  https://review.opendev.org/67334119:44
openstackgerritDustin Cowles proposed openstack/nova master: WIP: Public method to retrieve custom resource providers  https://review.opendev.org/67602919:44
openstackgerritDustin Cowles proposed openstack/nova master: WIP: Load the custom resource providers to resource tracker  https://review.opendev.org/67652219:44
mriedemefried: you can recheck on bug 184035519:59
openstackbug 1840355 in grenade "cinder server ping check intermittently fails in the gate with "SSH to the client did not work, something very wrong"" [Undecided,Confirmed] https://launchpad.net/bugs/184035519:59
*** gouthamr is now known as gouthamr|brb20:02
*** eharney has quit IRC20:08
*** phasespace has joined #openstack-nova20:13
*** nweinber has joined #openstack-nova20:16
*** hemna has quit IRC20:24
openstackgerritmelanie witt proposed openstack/nova master: nova-manage db archive_deleted_rows is not multi-cell aware  https://review.opendev.org/50748620:27
openstackgerritmelanie witt proposed openstack/nova master: Verify archive_deleted_rows --all-cells in post test hook  https://review.opendev.org/67284020:27
*** spatel has quit IRC20:27
melwittmriedem: hopefully got all your comments addressed ^ I added another unit test for the until_complete=True case. and I will have to update the post test hook patch later20:28
mriedemmelwitt: ok i won't be able to look until next week20:28
melwittok, cool20:29
melwittI have to run for now. will miss the nova meeting20:29
mriedemsame20:29
*** gouthamr|brb is now known as gouthamr20:30
*** hemna has joined #openstack-nova20:36
efriedthanks mriedem20:40
*** nweinber has quit IRC20:41
*** spatel has joined #openstack-nova20:48
*** takashin has joined #openstack-nova20:48
*** slaweq has quit IRC20:50
efriednova meeting in 9 minutes in #openstack-meeting20:51
efriedsounds like it may be a sparse one...20:52
*** spatel has quit IRC20:53
*** vesper11 has joined #openstack-nova20:53
*** Sundar has quit IRC20:59
*** mriedem has quit IRC21:00
edleafe"sparse" is putting it lightly :)21:09
*** slaweq has joined #openstack-nova21:11
openstackgerritTakashi NATSUME proposed openstack/python-novaclient master: Deprecate the '--config-drive' option  https://review.opendev.org/65368321:15
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (13)  https://review.opendev.org/57602021:16
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (14)  https://review.opendev.org/57602721:16
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (15)  https://review.opendev.org/57603121:16
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (16)  https://review.opendev.org/57629921:17
*** slaweq has quit IRC21:17
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (17)  https://review.opendev.org/57634421:17
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (18)  https://review.opendev.org/57667321:17
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (19)  https://review.opendev.org/57667621:18
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (20)  https://review.opendev.org/57668921:18
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (21)  https://review.opendev.org/57670921:18
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (22)  https://review.opendev.org/57671221:19
openstackgerritTakashi NATSUME proposed openstack/nova stable/rocky: Replace glance command with openstack command  https://review.opendev.org/63706021:19
openstackgerritTakashi NATSUME proposed openstack/nova master: Add a live migration regression test  https://review.opendev.org/64120021:19
openstackgerritTakashi NATSUME proposed openstack/nova master: Fix non-existent method of Mock  https://review.opendev.org/67504121:20
*** BjoernT has quit IRC21:28
*** markvoelker has quit IRC21:29
*** artom has quit IRC21:30
*** luksky has quit IRC22:01
*** trident has quit IRC22:03
*** markvoelker has joined #openstack-nova22:05
*** markvoelker has quit IRC22:09
*** trident has joined #openstack-nova22:10
*** slaweq has joined #openstack-nova22:11
*** markvoelker has joined #openstack-nova22:11
*** slaweq has quit IRC22:16
openstackgerritMerged openstack/nova stable/pike: Fix misuse of nova.objects.base.obj_equal_prims  https://review.opendev.org/67629222:40
*** markvoelker has quit IRC22:40
openstackgerritAdam Spiers proposed openstack/nova master: Track libvirt host/domain capabilities for multiple machine types  https://review.opendev.org/67315122:40
openstackgerritAdam Spiers proposed openstack/nova master: Provide HW_CPU_X86_AMD_SEV trait when SEV is supported  https://review.opendev.org/63868022:41
openstackgerritAdam Spiers proposed openstack/nova master: Add extra spec parameter and image property for memory encryption  https://review.opendev.org/66442022:41
openstackgerritAdam Spiers proposed openstack/nova master: Extract SEV-specific bits on host detection  https://review.opendev.org/63633422:41
openstackgerritAdam Spiers proposed openstack/nova master: Add <launchSecurity> and <driver iommu='on' /> to config.py  https://review.opendev.org/63631822:41
openstackgerritAdam Spiers proposed openstack/nova master: Apply SEV-specific guest config when SEV is required  https://review.opendev.org/64456522:41
openstackgerritAdam Spiers proposed openstack/nova master: Enable booting of libvirt guests with AMD SEV memory encryption  https://review.opendev.org/66661622:41
*** prometheanfire has quit IRC22:42
*** ivve has quit IRC22:46
*** tkajinam has joined #openstack-nova23:00
*** slaweq has joined #openstack-nova23:11
*** slaweq has quit IRC23:16
openstackgerritTakashi NATSUME proposed openstack/nova stable/stein: Fix non-existent method of Mock  https://review.opendev.org/67683823:28
openstackgerritMerged openstack/nova master: API microversion 2.76: Add 'power-update' external event  https://review.opendev.org/64561123:39
openstackgerritMerged openstack/nova master: Fix non-existent method of Mock  https://review.opendev.org/67504123:40
openstackgerritMohammed Naser proposed openstack/nova master: requirements: move to using psycopg2-binary  https://review.opendev.org/67668423:44
openstackgerritMohammed Naser proposed openstack/nova master: constraints: bump psycopg2 to 2.8  https://review.opendev.org/67672523:44
openstackgerritMohammed Naser proposed openstack/nova master: constraints: bump psycopg2 to 2.8  https://review.opendev.org/67672523:44
*** markvoelker has joined #openstack-nova23:45
*** igordc has joined #openstack-nova23:46
*** spatel has joined #openstack-nova23:48
brinzhangmriedem: it's not matter, thanks.23:49
*** markvoelker has quit IRC23:50
*** mlavalle has quit IRC23:51
*** spatel has quit IRC23:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!