Friday, 2018-08-17

openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (22)  https://review.openstack.org/57671200:03
openstackgerritmelanie witt proposed openstack/nova master: Update api-guide and api-ref to be clear about forced-down  https://review.openstack.org/49253300:04
openstackgerritmelanie witt proposed openstack/nova master: Update contributor process doc for stein  https://review.openstack.org/59276600:13
*** brinzhang has joined #openstack-nova00:26
openstackgerritmelanie witt proposed openstack/nova master: Update contributor docs for stein  https://review.openstack.org/59276600:29
*** tbachman has joined #openstack-nova00:29
*** tbachman has quit IRC00:33
*** tbachman has joined #openstack-nova00:36
*** nicolasbock has quit IRC00:36
*** liuyulong has joined #openstack-nova00:51
*** mriedem has joined #openstack-nova00:52
mriedemo/00:52
melwittmriedem: I resurrected this old docs patch from sdague based on a bug I closed today. you used to be +2 on it https://review.openstack.org/492533 I'd +2 it but I rebased it out of merge conflict00:55
mriedemyeah...that got caught up in committee00:56
melwittyeah. maybe it's not perfect but it's definitely a big improvement over the docs we currently have00:57
melwittI was thinking, "we should add more info to the docs" and then I stumbled upon the abandoned patch while looking for something else00:58
*** dave-mccowan has joined #openstack-nova00:58
mriedemyeah, there are a couple of small things we can improve from PS2 comments so i'll mark those00:59
mriedembut yes i was +2 before because it's a big improvement over nothing00:59
melwittok00:59
melwittyup ++00:59
*** hongbin has joined #openstack-nova01:04
*** slaweq has joined #openstack-nova01:06
mriedemmelwitt: ok comments inline01:14
*** sambetts has quit IRC01:14
melwittthanks01:14
*** slaweq has quit IRC01:16
*** mhen has quit IRC01:17
*** sambetts_ has joined #openstack-nova01:17
*** mhen has joined #openstack-nova01:17
*** mriedem has quit IRC01:20
*** ileixe has joined #openstack-nova01:23
openstackgerritfupingxie proposed openstack/nova master: Support list for alias in pci section in nova.conf  https://review.openstack.org/59224301:31
*** r-daneel has quit IRC01:35
openstackgerritmelanie witt proposed openstack/nova master: Update api-guide and api-ref to be clear about forced-down  https://review.openstack.org/49253301:42
*** tetsuro has joined #openstack-nova01:44
*** tetsuro has quit IRC01:44
openstackgerritBrin Zhang proposed openstack/nova-specs master: Add support specify volume type when boot instance  https://review.openstack.org/57952001:47
ileixeHi guys, Does anybody have optimal solution for nova-schedulers' race condition? I just tried to increase try attempts but wonder how others do..01:49
openstackgerritBrin Zhang proposed openstack/nova-specs master: Support deleting data volume when destroy instance  https://review.openstack.org/58033601:50
*** Dinesh_Bhor has joined #openstack-nova01:51
*** luzC has quit IRC01:52
*** luzC has joined #openstack-nova01:55
*** mriedem has joined #openstack-nova01:55
openstackgerritMatt Riedemann proposed openstack/nova master: Add zvm admin intro and hypervisor information  https://review.openstack.org/53312502:05
openstackgerritTao Li proposed openstack/nova master: Rollback instance vm_state to original where instance claims failed  https://review.openstack.org/59225202:08
mriedemefried: powervm supports snapshot right? if so, it should be able to claim shelve support https://review.openstack.org/#/c/533512/14/doc/source/user/feature-matrix-gp.ini02:09
mriedemwhich is just snapshot, destroy and spawn from snapshot elsewhere02:09
melwittileixe: you mean race with parallel requests? are you using an older version of nova? as of the pike version, the scheduler is claiming resources with placement, which solves the parallel requests race02:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add zvm CI information  https://review.openstack.org/53351202:09
melwittileixe: if you are using an older version than pike, you can increase the retries (max_attempts) the way you have. you can also use the scheduler_host_subset_size config option to randomize the selection of compute host during scheduling, if you are OK with spreading instances rather than packing them https://docs.openstack.org/ocata/config-reference/compute/schedulers.html02:12
*** liuyulong has quit IRC02:12
ileixemelwitt: Yes, exactly. We did not upgrade the placement api yet, and I also expect the api solve the synchronize problem but I could not find the related logic in master branch.02:12
ileixeThanks for the answer, I will try to find the logic if it solve the problem.02:13
melwittileixe: this is the spec for the work https://specs.openstack.org/openstack/nova-specs/specs/pike/implemented/placement-claims.html and the blueprint https://blueprints.launchpad.net/nova/+spec/placement-claims where you can find links to related patches02:13
ileixemelwitt: Thanks!02:14
melwittif you are on a version older than pike, I would increase the scheduler_host_subset_size option to reduce the chances of collisions with parallel requests02:14
melwittyw02:14
ileixeYes actually we increased the configs exactly what you mentioned. And it still sometime happens so I tried to alternatives :)02:15
melwittoh, I see. got it02:15
*** gcb_ has joined #openstack-nova02:19
mriedemileixe: are you using the CachingScheduler or FilterScheduler?02:23
mriedemand are you running multiple scheduler workers?02:24
ileixeYes 4 FilterScheduler02:24
mriedemok, that's normal,02:24
mriedemthen yes host_subset_size will need to be >1, which you've done02:24
mriedemmaybe check your weigher configuration?02:25
ileixe10 we've been used02:26
ileixeand default for retry attempt02:26
ileixeSo I was going to increase try attepmts.02:27
ileixeBut placement api seems to be optimal solution. :)02:27
openstackgerritMerged openstack/nova master: Add zvm admin intro and hypervisor information  https://review.openstack.org/53312502:27
*** HW_Peter has quit IRC02:36
mriedemileixe: yes placement will do an atomic claim on vcpu,ram,disk in the scheduler rather than the late racy claim on the compute host02:36
mriedemyou can still race to fail claims for things like numa/pci since we don't model that in placement yet02:36
mriedembut maybe that's not your major issue02:36
ileixemriedem: Greate. Oh, I found now resources are updated in scheduler itself.02:39
ileixeThanks guys. Lovely change.02:40
*** Nel1x has joined #openstack-nova02:49
*** erlon has quit IRC02:54
*** Cardoe has quit IRC02:55
openstackgerritMatt Riedemann proposed openstack/nova master: Add zvm CI information  https://review.openstack.org/53351202:58
mriedemmelwitt: final zvm docs change is approved02:59
mriedemshould be able to cut rc2 after that merges02:59
mriedem+2 on that forced_down docs change as well03:01
*** Cardoe has joined #openstack-nova03:04
*** sapd1 has quit IRC03:09
openstackgerritTakashi NATSUME proposed openstack/nova master: Update contributor guide for Stein  https://review.openstack.org/59125803:10
*** Nel1x has quit IRC03:11
openstackgerritMerged openstack/nova master: Add zvm CI information  https://review.openstack.org/53351203:21
Kevin_Zhengmriedem just came to my head, another thing that strict project to cells won't help much for us is that, we have admin softwares that queries with --all_tenants03:24
*** trungnv has joined #openstack-nova03:25
mriedemKevin_Zheng: well, it wouldn't help that specific software, but it would help user server list response timem03:26
mriedem*time03:26
mriedemCERN obviously would have the same issue for admin tooling03:26
Kevin_Zhengyeah I know03:26
*** dave-mccowan has quit IRC03:45
*** udesale has joined #openstack-nova03:47
*** Dinesh_Bhor has quit IRC03:52
*** Dinesh_Bhor has joined #openstack-nova03:56
*** hongbin has quit IRC03:57
*** vivsoni_ has quit IRC03:59
*** Dinesh_Bhor has quit IRC04:04
*** Bhujay has joined #openstack-nova04:06
*** vivsoni has joined #openstack-nova04:25
*** janki has joined #openstack-nova04:39
*** abhishekk has joined #openstack-nova04:49
*** jamesdenton has quit IRC04:51
*** Dinesh_Bhor has joined #openstack-nova04:59
*** ratailor has joined #openstack-nova05:16
*** ShilpaSD_ has joined #openstack-nova05:28
*** takashin has left #openstack-nova05:31
*** sapd1 has joined #openstack-nova05:44
*** josecastroleon has joined #openstack-nova05:51
openstackgerritTao Li proposed openstack/nova master: Rollback instance vm_state to original where instance claims failed  https://review.openstack.org/59225205:54
*** nehaalhat has joined #openstack-nova06:04
*** mriedem has quit IRC06:05
*** Tahvok has quit IRC06:06
*** Bhujay has quit IRC06:07
*** Tahvok has joined #openstack-nova06:11
*** skatsaounis has quit IRC06:18
nehaalhatstephenfin: Hi do you know any periodic task that will update the aggregates list in Nova?06:21
*** Dinesh_Bhor has quit IRC06:34
*** links has joined #openstack-nova06:37
*** Dinesh_Bhor has joined #openstack-nova06:41
*** pcaruana has joined #openstack-nova06:54
*** alexchadin has joined #openstack-nova06:54
*** rcernin has quit IRC06:55
*** abhishekk has quit IRC06:56
*** slaweq has joined #openstack-nova06:57
*** skatsaounis has joined #openstack-nova07:03
*** gibi is now known as giblet07:03
*** tssurya has joined #openstack-nova07:07
*** sahid has joined #openstack-nova07:07
*** dpawlik has joined #openstack-nova07:08
openstackgerritGhanshyam Mann proposed openstack/nova master: Remove the deprecated API extensions policies  https://review.openstack.org/58687207:11
*** dpawlik has quit IRC07:13
*** dpawlik has joined #openstack-nova07:14
*** Bhujay has joined #openstack-nova07:16
*** cz2 has left #openstack-nova07:23
*** josecastroleon has quit IRC07:26
*** rha has joined #openstack-nova07:41
*** jpena|off is now known as jpena07:46
*** jaosorior has quit IRC07:47
*** zhenguo has joined #openstack-nova07:50
*** davidsha has joined #openstack-nova07:51
openstackgerritMerged openstack/nova master: Update api-guide and api-ref to be clear about forced-down  https://review.openstack.org/49253307:58
*** mvkr has quit IRC08:08
*** ejat has joined #openstack-nova08:12
*** josecastroleon has joined #openstack-nova08:12
*** Dinesh_Bhor has quit IRC08:18
*** gcb_ has quit IRC08:20
*** Dinesh_Bhor has joined #openstack-nova08:21
*** luksky has joined #openstack-nova08:23
openstackgerritSurya Seetharaman proposed openstack/nova master: Merge extended_status extension response into server view builder  https://review.openstack.org/59209208:26
*** derekh has joined #openstack-nova08:35
openstackgerritSurya Seetharaman proposed openstack/nova master: Add get_by_cell_and_project() method to InstanceMappingList  https://review.openstack.org/59165608:40
openstackgerritSurya Seetharaman proposed openstack/nova master: API microversion bump for handling-down-cell  https://review.openstack.org/59165708:40
openstackgerritSurya Seetharaman proposed openstack/nova master: Return a minimal construct for nova list when a cell is down  https://review.openstack.org/56778508:41
openstackgerritSurya Seetharaman proposed openstack/nova master: Return a minimal construct for nova show when a cell is down  https://review.openstack.org/59165808:41
openstackgerritSurya Seetharaman proposed openstack/nova master: Return a minimal construct for nova service-list when a cell is down  https://review.openstack.org/58482908:41
openstackgerritTao Li proposed openstack/nova master: Rollback instance vm_state to original where instance claims failed  https://review.openstack.org/59225208:50
*** mvkr has joined #openstack-nova08:55
openstackgerritBalazs Gibizer proposed openstack/nova-specs master: Placement: any traits in allocation_candidate query  https://review.openstack.org/56573009:04
*** alexchadin has quit IRC09:07
*** panda|off is now known as panda09:08
*** alexchadin has joined #openstack-nova09:09
*** Bhujay has quit IRC09:13
*** Bhujay has joined #openstack-nova09:15
*** sambetts_ is now known as sambetts09:25
openstackgerritBalazs Gibizer proposed openstack/nova-specs master: Placement: support mixing required traits with any traits  https://review.openstack.org/56574109:25
*** udesale has quit IRC09:31
kosamaraefried: about trait "ownership": Given RP ownership, the only issue that I see trait ownership addressing is the separation of generated and user-provided traits. I see your discussion with Sundar (https://review.openstack.org/#/c/579359/10/doc/source/specs/rocky/device-passthrough.rst@173), but is this actually an issue if RPs are owned by the drivers?09:39
kosamaraefried: And for separating user and generated traits, I would also like to hear your argument. When you say "conflict" between the 2, you imply a set of rules that make some traits mutually exclusive?09:44
sean-k-mooneykosamara: we promised operators the ablitiy to add traits to any resouce provider in the past09:47
sean-k-mooneyso there is a confilt in that the virt drivers would like to fully own the traits on the resouces they create and the fact that we said operator can add traits to resouce provirers that the virt driver may not be able to determin itself09:48
sean-k-mooneykosamara: also some traits could be multally inclusive such as a disk can both be an ssd and mechanical09:51
sean-k-mooneykosamara: we dont model the compatiablity of traits anyehere and curerntly assume the entity adding the traits will do the right thing09:52
sean-k-mooneyfor standard traits we might be able to handel that in os-tratis but in general it a problem that we cant fix directly.09:53
sean-k-mooneyat least in the CUSTOM_ case09:53
kosamarasean-k-mooney: ok, so the namespacing addresses the operator vs generated part. What I actually don't understand is why the driver *must* fully own the traits, over the operator. If we accept that, then namespacing makes sense, so please explain to me that.09:57
*** zhenguo has quit IRC10:00
sean-k-mooneywell im not sure how namespacing is proposed to work. my understanind is that prevent both the operator and virt drivers form both using stadard traits as such i do not see that as a viable option10:00
sean-k-mooneye.g. either the operator or the virt direver would be able to use the un namespaced standard tratis10:01
*** Dinesh_Bhor has quit IRC10:04
*** josecastroleon has quit IRC10:06
kosamarasean-k-mooney: See here the traits sections of my 2nd PS draft: https://etherpad.openstack.org/p/device-placement-passthrough-210:06
kosamarasean-k-mooney: exactly, that could be an issue. But still I'm not clear on this, let's wait for efried's input10:07
sean-k-mooneykosamara: i would be stongly opposed to having a CUSTOM_%(virt_driver)_ prefix if i ever need to set that in a flavor to match against it10:09
sean-k-mooneywell that depends10:09
*** sapd1 has quit IRC10:09
sean-k-mooneyif the driver ever generated a CUSTOM_%(virt_driver)_ trait for something that was a standard trait then i think that is a very bad design10:10
sean-k-mooneye.g. i should be able to jsut say HW_CPU_X86_AVX not CUSTOM_LIBVIRT_HW_CPU_X86_AVX10:11
sean-k-mooneyif a virt driver has a capablity that is truely unique to it, then i can see it useing a CUSTOM_%(virt_driver) trait that siad i would still prefer them to standarise it in os-tratis10:13
*** alexchadin has quit IRC10:15
*** trungnv has quit IRC10:19
*** Dinesh_Bhor has joined #openstack-nova10:21
sean-k-mooneykosamara: i have added a potentally dumb alternitive to https://etherpad.openstack.org/p/device-placement-passthrough-210:23
*** cdent has joined #openstack-nova10:23
*** ileixe_ has joined #openstack-nova10:27
*** udesale has joined #openstack-nova10:31
*** ileixe_ has quit IRC10:32
*** ociuhandu has joined #openstack-nova10:32
*** ociuhandu has quit IRC10:34
*** nicolasbock has joined #openstack-nova10:35
*** claudiub has joined #openstack-nova10:45
*** alexchadin has joined #openstack-nova10:45
*** alexchadin has quit IRC10:51
*** dklyle has quit IRC10:55
*** david-lyle has joined #openstack-nova10:55
*** tikitavi has joined #openstack-nova11:02
*** jpena is now known as jpena|lunch11:04
*** cdent_ has joined #openstack-nova11:07
*** cdent has quit IRC11:07
*** cdent_ is now known as cdent11:07
*** maciejjozefczyk has quit IRC11:21
*** josecastroleon has joined #openstack-nova11:22
*** alexchadin has joined #openstack-nova11:24
*** udesale has quit IRC11:26
*** alexchadin has quit IRC11:29
*** Dinesh_Bhor has quit IRC11:33
*** brinzhang has quit IRC11:36
*** maciejjozefczyk has joined #openstack-nova11:37
*** alexchadin has joined #openstack-nova11:38
*** jamesdenton has joined #openstack-nova11:47
*** breton has left #openstack-nova11:51
*** cdent has quit IRC11:51
*** erlon has joined #openstack-nova11:53
*** mdbooth has quit IRC11:56
*** jpena|lunch is now known as jpena12:00
*** jaypipes has quit IRC12:16
*** maciejjozefczyk has quit IRC12:17
*** dpawlik has quit IRC12:18
*** eharney has joined #openstack-nova12:22
*** ratailor has quit IRC12:23
*** dpawlik has joined #openstack-nova12:25
kosamarasean-k-mooney I think any custom trait is suboptimal to standard ones, therefore I'll explicitly say that the drivers must use a standard trait for a capability if it exists. What's the point otherwise.12:28
*** efried has quit IRC12:28
*** mchlumsky has joined #openstack-nova12:29
*** efried has joined #openstack-nova12:29
*** dpawlik has quit IRC12:29
*** jamesdenton has quit IRC12:48
openstackgerritJose Castro Leon proposed openstack/nova master: Fix get_device_path from network mounted volume  https://review.openstack.org/59018812:48
*** jamesdenton has joined #openstack-nova12:49
*** josecastroleon has quit IRC12:52
*** jamesdenton has quit IRC12:52
*** alexchadin has quit IRC12:52
*** TheJulia is now known as needssleep12:55
*** tikitavi has quit IRC12:55
*** edleafe has joined #openstack-nova12:56
*** jamesdenton has joined #openstack-nova12:57
*** maciejjozefczyk has joined #openstack-nova12:58
*** dpawlik has joined #openstack-nova12:58
*** janki has quit IRC13:08
*** cdent has joined #openstack-nova13:09
*** janki has joined #openstack-nova13:12
*** efried is now known as fried_rice13:12
fried_ricemriedem: I thought there was a reason we don't claim shelve support. edmondsw?13:13
fried_ricekosamara, sean-k-mooney: It would not be for something like CUSTOM_LIBVIRT_HW_CPU_X86_AVX. The purpose of the separation is so that an operator doesn't attempt to "spoof" some capability that the compute doesn't really have. (Or, easier to manage, if the operator removes a trait the compute really does have - by accident or on purpose - the driver should restore it.)13:17
fried_riceNamespacing is an easy way to do it with custom traits, but I agree having the driver name in there is potentially problematic. The reason I did that was exactly so that it wouldn't conflict with traits we standardized later on.13:18
fried_riceBecause I was implementing in an OOT driver :)13:18
fried_riceSo if I start with CUSTOM_POWERVM_IOSLOT_VENDOR_ID_XXXX and then we integrate into nova where it becomes POWERVM_DEVICE_VENDOR_ID_XXXX they can both coexist, and when we've had enough time for people to migrate over to the new one, we can remove the old one.13:19
fried_riceBut I agree this is also problematic for standard traits.13:20
fried_riceThe other obvious way to do it is for the driver to maintain a comprehensive list of all the traits it owns - i.e. all the traits it could *ever* decide to set.13:20
fried_riceAnd on every iteration, it needs to go through that list and unset any of those traits that shouldn't be set, and set the ones that should.13:21
edmondswfried_rice mriedem I think we can change that to say shelve is supported13:25
*** awaugama has joined #openstack-nova13:26
fried_riceedmondsw: Cool, you going to propose?13:26
edmondswfried_rice sure13:26
openstackgerritMatthew Edmonds proposed openstack/nova master: comment correction for libvirt multiattach  https://review.openstack.org/59305013:29
*** derekh has quit IRC13:38
*** imacdonn has quit IRC13:42
*** imacdonn has joined #openstack-nova13:42
openstackgerritMatthew Edmonds proposed openstack/nova master: Doc: PowerVM does support shelve  https://review.openstack.org/59305213:44
edmondswfried_rice mriedem ^13:44
fried_riceack13:44
fried_riceedmondsw: Do we have a way to test that in the CI?13:45
fried_riceedmondsw: Or at least a local run?13:45
*** erlon has quit IRC13:49
edmondswfried_rice I presume there are tempest tests for this...13:51
fried_riceedmondsw: I presume that too, but have not investigated. Guessing we could grep our blacklist?13:51
openstackgerritChen proposed openstack/nova master: Fix evacuate logging  https://review.openstack.org/59305513:53
*** derekh has joined #openstack-nova13:53
*** dansmith is now known as steelydan13:58
*** steelydan is now known as SteelyDan13:58
*** Bhujay has quit IRC13:59
*** hoonetorg has quit IRC14:02
*** hoonetorg has joined #openstack-nova14:03
melwitt.14:04
*** cdent has quit IRC14:05
fried_riceō/ melwitt14:07
*** gbarros has joined #openstack-nova14:09
*** hoonetorg has quit IRC14:09
*** derekh has quit IRC14:11
*** giblet is now known as gibi_off14:11
*** josecastroleon has joined #openstack-nova14:21
SteelyDansean-k-mooney: you confirmed that the new approach works for LB right? If so, can you comment on this patch? https://review.openstack.org/#/c/59173514:30
SteelyDan*the new waiting during live migration approach14:30
*** hoonetorg has joined #openstack-nova14:34
*** maciejjozefczyk has quit IRC14:43
*** r-daneel has joined #openstack-nova14:44
*** janki has quit IRC14:46
*** jamesdenton has quit IRC14:46
*** rpittau has quit IRC14:54
*** r-daneel has quit IRC15:00
*** cburgess has quit IRC15:02
*** dpawlik has quit IRC15:02
*** cburgess has joined #openstack-nova15:03
*** cdent has joined #openstack-nova15:05
*** josecastroleon has quit IRC15:06
*** cburgess has quit IRC15:08
*** cburgess has joined #openstack-nova15:09
openstackgerritLee Yarwood proposed openstack/nova master: WIP Add regression for bug 1787606  https://review.openstack.org/59307315:14
openstackbug 1787606 in OpenStack Compute (nova) "Multi instance creation rescheduling fails due to a lack of alternates" [Undecided,New] https://launchpad.net/bugs/178760615:14
openstackgerritLee Yarwood proposed openstack/nova master: WIP scheduler: Only skip the selected host when finding alternates  https://review.openstack.org/59307415:14
cdentmelwitt, SteelyDan: Do either of you recall if this be taken back to ocata standalone or the whole stack associated with topic is needed?15:18
cdentmelwitt, SteelyDan https://review.openstack.org/#/c/580498/15:19
SteelyDancdent: needs to be taken? was taken?15:19
melwittcdent: if that can be taken standalone?15:20
cdentcan be, sorry15:20
cdentlooks like probably not, but the commit message kind of implies maybe it could15:20
SteelyDanI dunno, I'd have to look pretty closely, because ocata had very different allocation behavior15:21
SteelyDanso in general I would expect few things that applied to pike to apply directly to ocata15:21
cdentyeah.15:21
melwittyeah, that's what I wasn't sure about, since a lot of foundational stuff was done in pike, whether this does the right thing on its own without other pike changes in placement15:22
SteelyDanplacement didn't change as a result of this,15:23
*** erlon has joined #openstack-nova15:23
SteelyDanit was the difference in how/where nova does the allocations in placement in ocata vs. pike15:23
melwittthat is, why wasn't this proposed to ocata along with pike, if there was a reason for that15:23
SteelyDanlike, the doubling of the allocations for a migation15:23
melwittusually things get backported to all applicable places at the same time15:24
SteelyDanalthough I guess if you're deleting an instance you should delete both15:24
SteelyDancdent: are you in a hurry such that waiting to ask matt isn't reasonable?15:24
SteelyDannot sure he'll remember more, but..15:25
cdentSteelyDan: no, not in a super rush, just happened to cross my radar because of some internal flim flammery15:25
cdenti'm going to see what happens if I try to pick just it15:25
SteelyDanin ocata the compute node is authoritative over the allocations,15:26
SteelyDanbut even post pike it will be for deleted instances only,15:26
SteelyDanso I'm not positive why this was even a thing on pike15:26
*** slaweq has quit IRC15:27
melwittwhat do you mean? the compute node will remove allocations for a local deleted instance on pike?15:27
melwittvia auto-heal or something?15:27
SteelyDanyes,15:28
SteelyDanit used to always auto-heal everything,15:28
SteelyDanbut as of pike it should only do it for deleted instances once all the ocata computes are gone15:28
cdentlooking a bit more closely, it seems the real issue on the internal discussion is this part of the bug fix: https://review.openstack.org/#/c/580499/ , for cleaning up host mappings15:28
SteelyDanlet me see if I an find that15:28
melwittI see15:28
openstackgerritmelanie witt proposed openstack/nova stable/rocky: add zvm into support matrix  https://review.openstack.org/59307915:28
openstackgerritmelanie witt proposed openstack/nova stable/rocky: Add zvm admin intro and hypervisor information  https://review.openstack.org/59308015:28
openstackgerritmelanie witt proposed openstack/nova stable/rocky: Add zvm CI information  https://review.openstack.org/59308115:28
SteelyDanmelwitt: https://github.com/openstack/nova/blob/stable/pike/nova/compute/resource_tracker.py#L1249-L125815:29
SteelyDanmelwitt: prior to pike, the other conditions in that heal/check loop would heal things, but as of pike only the instance.deleted one would15:29
SteelyDanbecause as of pike the scheduler/conductor/api are authoritative for allocations15:30
melwitta-ha, thanks15:30
cdentle sigh. it seems the root cause of the internal problem is: we messed various database tables and now things don't look like they should15:31
* cdent flips table15:32
cdentdoctor it hurts when I punch myself!15:32
*** tbachman has quit IRC15:32
fried_riceChoke yourself instead. Self-limiting.15:35
cdentwhat you do in the privacy of your own home...15:39
SteelyDanhehe, thanks I was looking for how to acknowledge the kink15:40
*** ShilpaSD_ has quit IRC15:42
cdentsaid SteelyDan15:49
SteelyDan:)15:49
*** tbachman has joined #openstack-nova15:59
*** r-daneel has joined #openstack-nova16:04
*** gbarros has quit IRC16:05
*** luksky has quit IRC16:06
*** jamesdenton has joined #openstack-nova16:20
*** macza has joined #openstack-nova16:23
*** fried_rice is now known as efried_pto16:29
*** sahid has quit IRC16:29
*** erlon has quit IRC16:34
SteelyDansean-k-mooney: did you see my query here earlier?16:35
sean-k-mooneyoh am no ill scoll back16:35
SteelyDan(repeat) sean-k-mooney: you confirmed that the new approach works for LB right? If so, can you comment on this patch? https://review.openstack.org/#/c/59173516:36
sean-k-mooneyi confimed that the current code on master works. this is the queens backport of the same?16:37
SteelyDansean-k-mooney: you don't need to confirm it separately for queens16:37
SteelyDanbut if you could comment there I'd appreciate it16:37
sean-k-mooneyyes ill just triple check i have the commit in question on the relevent nodes16:38
*** tssurya has quit IRC16:38
SteelyDanI think we've already established when the event is sent from neutron in the LB case, so it really shouldn't even be an issue, but...16:38
sean-k-mooneyyep i have the master change on both linux bidge node an the conf change. ill comment to that effect16:39
*** jpena is now known as jpena|off16:40
*** pas-ha has quit IRC16:41
*** pas-ha has joined #openstack-nova16:42
*** links has quit IRC16:43
sean-k-mooneyspeaking of LM testing i should work on that email to the list.16:47
*** davidsha has quit IRC16:48
*** gyee has joined #openstack-nova16:52
melwittSteelyDan: docs changes for rc2 proposed starting here https://review.openstack.org/593079 if you could pls take a look16:57
melwittbackports16:57
SteelyDanugh okay, I'll add it to the list16:57
melwittthanks16:57
*** sambetts is now known as sambetts|afk17:09
SteelyDanmelwitt: don't we know that zvm doesn't support rebuild?17:11
melwittSteelyDan: mriedem asked them to change it from missing => unknown because since they support spawn and destroy, it sounds like it could work https://review.openstack.org/#/c/532720/8/doc/source/user/support-matrix.ini@37817:14
melwittbut they aren't testing that path, so "unknown"17:15
SteelyDanit's not implemented in the driver, and untested, which sounds a lot more like "unsupported" than "maybe it'll work if code we wrote long ago to handle it for normal hypervisors, which zvm is not"17:17
SteelyDanbut.. okay17:17
melwittyeah, I think that's why they put "missing" initially17:18
SteelyDan...yeah17:18
SteelyDanso glad we added this17:18
SteelyDanso are we looking for fast approvals on these I assume?17:19
SteelyDanor do you want to wait for another stabler on monday?17:19
melwittI was thinking mriedem could get them on monday17:19
melwittI wanted them to be ready to go. I wasn't sure if we need to fast approve17:20
melwittI guess I could ask smcginnis17:20
SteelyDanyou know better than I at this point when rc2 will be, which is why I'm asking17:21
melwittfinal RCs are due Aug 23, so AFAIK we are fine until then17:22
*** luksky has joined #openstack-nova17:26
*** dpawlik has joined #openstack-nova17:36
SteelyDanack17:37
*** dpawlik has quit IRC17:40
*** awaugama has quit IRC17:47
*** awaugama has joined #openstack-nova17:56
* smcginnis looks around18:07
*** r-daneel_ has joined #openstack-nova18:07
*** r-daneel has quit IRC18:08
*** r-daneel_ is now known as r-daneel18:08
smcginnismelwitt: The question was whether to do another RC?18:08
melwittsmcginnis: no, question was, should we be looking at fast-approving doc backports to stable/rocky for RC2 today (other stable cores are not around) or is it fine to wait until monday?18:14
melwittmy understanding is final RCs are due Aug 23, so there isn't a rush. but please correct me if I'm wrong18:15
smcginnismelwitt: That's correct. You have until next Thursday if there is a need to do another RC.18:18
melwittok thank you18:19
smcginnismelwitt: So if there isn't a need to get that proposed RC2 out right away, and you know there's likely to be more, it might make sense to hold off on that for now and just do the RC2 next week.18:19
smcginnismelwitt: But if there is a need to get the commits since RC1 out there right away, we can definitely do RC2 now and another RC3 next week.18:19
smcginnisIn general we just like to minimize the number of RCs, but practically it doesn't really matter too much.18:20
melwittI see. thanks, that's helpful18:20
mnasersuper unrelated, but have you seen 'sh: write error: No space left on device' in console logs for cirros in tempest much?18:24
mnaseri'm having problems with the (i think) last issue to get centos passing on openstack ansible, it's failing to ssh to the floating ip with a timeout .. http://logs.openstack.org/78/590778/6/check/openstack-ansible-deploy-aio_metal-centos-7/fdd9d28/logs/openstack/aio1-utility/stestr_results.html18:24
mnaserthe console logs seem to show that it fails to add teh default route and out of space writing things on disk18:24
melwittanecdotally, I've run out of disk space using ubuntu cloud images with devstack + ceph because the devstack-plugin-ceph defaults to 8GB disk space and the ubuntu xenial cloud image comes with 10GB disk space by default18:26
melwittnot sure where you're getting your images from but it could be something like that? I dunno18:26
mnaserwe're using cirros qcow2 images, so i think it shouldn't be too wildly different18:27
mnaserxenial works fine which makes me a bit curious18:27
melwittoh, right I see, you're saying image is same, host OS is different18:28
mnaseryes18:28
melwittyeah, I haven't heard about that before18:28
mnaseri can see the floating ip getting assigned successfully too, ill dig in some more18:29
openstackgerritDan Smith proposed openstack/nova master: Batch results per cell when doing cross-cell listing  https://review.openstack.org/59269818:32
openstackgerritDan Smith proposed openstack/nova master: WIP: Make instance_list perform per-cell batching  https://review.openstack.org/59313118:32
*** eharney has quit IRC18:33
SteelyDanmelwitt: ^ split that patch and also put ideas for how to configure this in the second one18:33
SteelyDanwhich you might want to opine on18:33
melwittcoolness, adding to my list18:36
*** cseader has joined #openstack-nova18:39
*** josecastroleon has joined #openstack-nova18:40
*** gyee has quit IRC18:43
*** r-daneel_ has joined #openstack-nova18:43
*** r-daneel has quit IRC18:44
*** r-daneel_ is now known as r-daneel18:44
*** r-daneel has quit IRC18:46
*** josecastroleon has quit IRC18:49
* melwitt will bbl19:02
openstackgerritDan Smith proposed openstack/nova master: Batch results per cell when doing cross-cell listing  https://review.openstack.org/59269819:06
openstackgerritDan Smith proposed openstack/nova master: WIP: Make instance_list perform per-cell batching  https://review.openstack.org/59313119:06
*** cdent has quit IRC19:13
*** r-daneel has joined #openstack-nova19:15
*** owalsh_ has joined #openstack-nova19:16
*** owalsh has quit IRC19:20
*** owalsh_ has quit IRC19:20
*** owalsh has joined #openstack-nova19:21
*** owalsh_ has joined #openstack-nova19:32
*** owalsh has quit IRC19:35
*** owalsh has joined #openstack-nova19:36
*** owalsh_ has quit IRC19:37
*** jamesdenton has quit IRC19:46
*** erlon has joined #openstack-nova19:47
*** nicolasbock has quit IRC19:50
*** eharney has joined #openstack-nova19:51
*** nicolasbock has joined #openstack-nova19:55
openstackgerritJoshua Harlow proposed openstack/nova master: Add exact match aggregate image properties matcher/filter  https://review.openstack.org/59316720:17
openstackgerritJoshua Harlow proposed openstack/nova master: Add exact match aggregate image properties matcher/filter  https://review.openstack.org/59316720:18
openstackgerritJoshua Harlow proposed openstack/nova master: Add exact match aggregate image properties matcher/filter  https://review.openstack.org/59316720:18
openstackgerritJoshua Harlow proposed openstack/nova master: Add exact match aggregate image properties matcher/filter  https://review.openstack.org/59316720:27
*** awaugama has quit IRC20:37
*** erlon has quit IRC20:41
needssleepOut of curiosity, have any changes merged to resource tracking in say the last couple days?20:51
needssleepon the current state of master branch20:51
needssleephttp://logs.openstack.org/87/592387/1/check/ironic-inspector-tempest-dsvm-python3/3aba945/logs/screen-n-cpu.txt.gz#_Aug_16_14_31_27_527100 is why I'm curious20:51
*** erlon has joined #openstack-nova20:56
openstackgerritJoshua Harlow proposed openstack/nova master: Add exact match aggregate image properties matcher/filter  https://review.openstack.org/59316720:57
*** marvin_mhg has joined #openstack-nova21:00
*** gbarros has joined #openstack-nova21:04
*** masayukig has quit IRC21:10
*** jianghuaw_ has quit IRC21:20
openstackgerritDmitry Sutyagin proposed openstack/nova-specs master: Allow disabling KSM / mem-merge via extra spec  https://review.openstack.org/59319721:25
mnaserok, managed to resolve that first issue but now21:36
mnaserhttp://logs.openstack.org/78/590778/7/gate/openstack-ansible-deploy-aio_metal-opensuse-423/a4388cf/logs/openstack/aio1-nova/nova-compute.log.txt.gz (warning, large log file as usual)21:36
mnaserthe instance gets setup, started paused, resumes (twice?) and pauses again21:36
mnaserafaik.. normal behaviour is that it just goes paused => resumed ?21:37
mnaserinstance id 51f86e01-8372-4a6f-b9aa-4af75b6d9bf8 if it helps looking at logs21:37
mnaserhttp://logs.openstack.org/78/590778/7/gate/openstack-ansible-deploy-aio_metal-opensuse-423/a4388cf/logs/openstack/aio1-nova/nova-compute.log.txt.gz#_2018-08-17_21_05_55_51421:37
mnaserwell, libvirt logs show it going from paused to resumed to paused http://paste.openstack.org/show/728337/21:41
mnaserhttp://logs.openstack.org/78/590778/7/gate/openstack-ansible-deploy-aio_metal-opensuse-423/a4388cf/logs/host/libvirt/qemu/instance-00000001.log.txt.gz hmm21:41
*** erlon has quit IRC21:42
*** gbarros_ has joined #openstack-nova21:43
*** gbarros has quit IRC21:44
*** nicolasbock has quit IRC21:59
*** gbarros_ has quit IRC22:16
*** gbarros has joined #openstack-nova22:16
*** gbarros has quit IRC22:17
*** macza has quit IRC22:56
*** r-daneel has quit IRC23:01
*** luksky has quit IRC23:25
openstackgerritMerged openstack/nova master: comment correction for libvirt multiattach  https://review.openstack.org/59305023:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!