*** Ablu has quit IRC | 00:05 | |
*** slaweq has joined #openstack-meeting-alt | 00:11 | |
*** Ablu has joined #openstack-meeting-alt | 00:15 | |
*** slaweq has quit IRC | 00:15 | |
*** d0ugal has quit IRC | 00:15 | |
*** d0ugal has joined #openstack-meeting-alt | 00:27 | |
*** oikiki has joined #openstack-meeting-alt | 00:37 | |
*** oikiki has quit IRC | 00:40 | |
*** oikiki has joined #openstack-meeting-alt | 00:51 | |
*** caowei has joined #openstack-meeting-alt | 00:57 | |
*** dave-mccowan has joined #openstack-meeting-alt | 01:07 | |
*** yangyapeng has joined #openstack-meeting-alt | 01:10 | |
*** tovin07_ has joined #openstack-meeting-alt | 01:12 | |
*** junboli has joined #openstack-meeting-alt | 01:16 | |
*** daidv has joined #openstack-meeting-alt | 01:20 | |
*** daidv_ has joined #openstack-meeting-alt | 01:20 | |
*** daidv_ has quit IRC | 01:24 | |
*** mguiney is now known as help | 01:31 | |
*** help is now known as valkyrja | 01:31 | |
*** leakypipes has quit IRC | 01:39 | |
*** valkyrja is now known as mguiney | 01:40 | |
*** hongbin has joined #openstack-meeting-alt | 02:03 | |
*** dalgaaf has quit IRC | 02:12 | |
*** dalgaaf has joined #openstack-meeting-alt | 02:14 | |
*** zhurong has joined #openstack-meeting-alt | 02:46 | |
*** hongbin has quit IRC | 03:09 | |
*** dave-mccowan has quit IRC | 03:09 | |
*** hongbin has joined #openstack-meeting-alt | 03:09 | |
*** hongbin has quit IRC | 03:10 | |
*** hongbin has joined #openstack-meeting-alt | 03:10 | |
*** hongbin has quit IRC | 03:10 | |
*** hongbin has joined #openstack-meeting-alt | 03:11 | |
*** hongbin has quit IRC | 03:12 | |
*** hongbin has joined #openstack-meeting-alt | 03:13 | |
*** hongbin has quit IRC | 03:14 | |
*** hongbin has joined #openstack-meeting-alt | 03:15 | |
*** yamahata has joined #openstack-meeting-alt | 03:16 | |
*** oikiki has quit IRC | 03:25 | |
*** yamamoto has joined #openstack-meeting-alt | 03:58 | |
*** yamamoto has quit IRC | 04:03 | |
*** chhavi has joined #openstack-meeting-alt | 04:08 | |
*** junboli has quit IRC | 04:10 | |
*** hongbin has quit IRC | 04:19 | |
*** bhavik1 has joined #openstack-meeting-alt | 04:33 | |
*** chhavi has quit IRC | 04:39 | |
*** gcb has joined #openstack-meeting-alt | 04:41 | |
*** sridharg has joined #openstack-meeting-alt | 04:44 | |
*** oikiki has joined #openstack-meeting-alt | 04:49 | |
*** bhavik1 has quit IRC | 04:50 | |
*** zhurong has quit IRC | 04:52 | |
*** caowei has quit IRC | 04:52 | |
*** anilvenkata has joined #openstack-meeting-alt | 04:57 | |
*** yamamoto has joined #openstack-meeting-alt | 05:04 | |
*** yamamoto has quit IRC | 05:12 | |
*** yangyapeng has quit IRC | 05:16 | |
*** yangyapeng has joined #openstack-meeting-alt | 05:17 | |
*** janki has joined #openstack-meeting-alt | 05:28 | |
*** skramaja has joined #openstack-meeting-alt | 05:30 | |
*** caowei has joined #openstack-meeting-alt | 05:30 | |
*** mikal has quit IRC | 05:33 | |
*** shaohe_feng has quit IRC | 05:38 | |
*** dsariel has joined #openstack-meeting-alt | 05:39 | |
*** shaohe_feng has joined #openstack-meeting-alt | 05:42 | |
*** dsariel has quit IRC | 05:44 | |
*** oikiki has quit IRC | 05:50 | |
*** zhurong has joined #openstack-meeting-alt | 05:51 | |
*** pgadiya has joined #openstack-meeting-alt | 05:53 | |
*** efried has quit IRC | 06:08 | |
*** janki has quit IRC | 06:17 | |
*** janki has joined #openstack-meeting-alt | 06:18 | |
*** efried has joined #openstack-meeting-alt | 06:18 | |
*** yamahata has quit IRC | 06:32 | |
*** chhavi has joined #openstack-meeting-alt | 06:33 | |
*** florianf has joined #openstack-meeting-alt | 06:39 | |
*** dsariel has joined #openstack-meeting-alt | 06:41 | |
*** oikiki has joined #openstack-meeting-alt | 06:44 | |
*** oikiki has quit IRC | 06:45 | |
*** jbadiapa has joined #openstack-meeting-alt | 06:47 | |
*** feldmann has joined #openstack-meeting-alt | 06:51 | |
*** coolsvap has joined #openstack-meeting-alt | 06:51 | |
*** liuyulong has joined #openstack-meeting-alt | 06:54 | |
*** mjura has joined #openstack-meeting-alt | 06:55 | |
*** reedip has quit IRC | 06:55 | |
*** mjura has quit IRC | 06:55 | |
*** mjura has joined #openstack-meeting-alt | 06:57 | |
*** marios has joined #openstack-meeting-alt | 07:05 | |
*** reedip has joined #openstack-meeting-alt | 07:07 | |
*** apopovych has quit IRC | 07:13 | |
*** ChrisPriceAB has quit IRC | 07:13 | |
*** jungleboyj has quit IRC | 07:13 | |
*** aprice has quit IRC | 07:13 | |
*** margaret has quit IRC | 07:13 | |
*** aprice has joined #openstack-meeting-alt | 07:13 | |
*** apopovych has joined #openstack-meeting-alt | 07:13 | |
*** jungleboyj has joined #openstack-meeting-alt | 07:13 | |
*** margaret has joined #openstack-meeting-alt | 07:13 | |
*** ChrisPriceAB has joined #openstack-meeting-alt | 07:14 | |
*** karthiks has joined #openstack-meeting-alt | 07:36 | |
*** arnewiebalck_ has joined #openstack-meeting-alt | 07:41 | |
*** dsariel has quit IRC | 07:49 | |
*** sridharg has quit IRC | 07:59 | |
*** sridharg has joined #openstack-meeting-alt | 08:00 | |
*** sridharg has quit IRC | 08:08 | |
*** sridharg has joined #openstack-meeting-alt | 08:08 | |
*** tesseract has joined #openstack-meeting-alt | 08:09 | |
*** jtomasek has joined #openstack-meeting-alt | 08:12 | |
*** anilvenkata has quit IRC | 08:13 | |
*** anilvenkata has joined #openstack-meeting-alt | 08:13 | |
*** fzdarsky has joined #openstack-meeting-alt | 08:17 | |
*** pabelanger has quit IRC | 08:19 | |
*** weshay has quit IRC | 08:19 | |
*** honza has quit IRC | 08:20 | |
*** honza has joined #openstack-meeting-alt | 08:20 | |
*** pabelanger has joined #openstack-meeting-alt | 08:20 | |
*** weshay has joined #openstack-meeting-alt | 08:20 | |
*** honza is now known as Guest14500 | 08:20 | |
*** jpena has joined #openstack-meeting-alt | 08:38 | |
*** oidgar has joined #openstack-meeting-alt | 08:44 | |
*** gibi_away is now known as gibi | 08:44 | |
*** MarkBaker has joined #openstack-meeting-alt | 08:50 | |
*** tobiash has joined #openstack-meeting-alt | 08:50 | |
*** rossella_s has joined #openstack-meeting-alt | 08:53 | |
*** skramaja_ has joined #openstack-meeting-alt | 08:54 | |
*** skramaja has quit IRC | 08:54 | |
*** skramaja has joined #openstack-meeting-alt | 08:59 | |
*** skramaja_ has quit IRC | 08:59 | |
*** bfernando has joined #openstack-meeting-alt | 09:03 | |
*** dsariel has joined #openstack-meeting-alt | 09:07 | |
*** rcernin has quit IRC | 09:07 | |
*** Guest14500 is now known as honza | 09:14 | |
*** finucannot is now known as stephenfin | 09:16 | |
*** ircuser-1 has joined #openstack-meeting-alt | 09:18 | |
*** danpawlik has joined #openstack-meeting-alt | 09:23 | |
*** fzdarsky has quit IRC | 09:39 | |
*** derekh has joined #openstack-meeting-alt | 09:46 | |
*** erlon has joined #openstack-meeting-alt | 09:54 | |
*** ganso has joined #openstack-meeting-alt | 09:56 | |
*** rossella_s has quit IRC | 09:59 | |
*** rossella_s has joined #openstack-meeting-alt | 09:59 | |
*** gcb has quit IRC | 10:02 | |
*** zhurong has quit IRC | 10:02 | |
*** pbourke has quit IRC | 10:12 | |
*** pbourke has joined #openstack-meeting-alt | 10:12 | |
*** tovin07_ has quit IRC | 10:21 | |
*** egallen has joined #openstack-meeting-alt | 10:38 | |
*** rossella_s has quit IRC | 10:46 | |
*** rossella_s has joined #openstack-meeting-alt | 10:46 | |
*** rochapor1o has quit IRC | 10:50 | |
*** sambetts|afk is now known as sambetts | 10:50 | |
*** caowei has quit IRC | 11:00 | |
*** numans has quit IRC | 11:06 | |
*** numans has joined #openstack-meeting-alt | 11:08 | |
*** rfolco has joined #openstack-meeting-alt | 11:21 | |
*** zhurong has joined #openstack-meeting-alt | 11:35 | |
*** fzdarsky has joined #openstack-meeting-alt | 11:36 | |
*** chhavi has quit IRC | 11:38 | |
*** chhavi has joined #openstack-meeting-alt | 11:39 | |
*** anilvenkata has quit IRC | 11:50 | |
*** jkilpatr has quit IRC | 11:50 | |
*** sdague has joined #openstack-meeting-alt | 12:00 | |
*** zhongjun has quit IRC | 12:06 | |
*** raildo has joined #openstack-meeting-alt | 12:09 | |
*** dave-mccowan has joined #openstack-meeting-alt | 12:09 | |
*** gcb has joined #openstack-meeting-alt | 12:13 | |
*** jkilpatr has joined #openstack-meeting-alt | 12:22 | |
*** liuyulong has quit IRC | 12:24 | |
*** janki has quit IRC | 12:24 | |
*** MarkBaker has quit IRC | 12:30 | |
*** jpena is now known as jpena|lunch | 12:33 | |
*** julim_ has quit IRC | 12:37 | |
*** julim has joined #openstack-meeting-alt | 12:38 | |
*** julim has quit IRC | 12:42 | |
*** dave-mccowan has quit IRC | 12:47 | |
*** dave-mccowan has joined #openstack-meeting-alt | 12:49 | |
*** rcernin has joined #openstack-meeting-alt | 13:00 | |
*** zhurong has quit IRC | 13:01 | |
*** MarkBaker has joined #openstack-meeting-alt | 13:01 | |
*** hieulq has quit IRC | 13:04 | |
*** skramaja has quit IRC | 13:05 | |
*** hieulq has joined #openstack-meeting-alt | 13:05 | |
*** chhavi has quit IRC | 13:08 | |
*** chhavi has joined #openstack-meeting-alt | 13:10 | |
*** rcernin has quit IRC | 13:16 | |
*** chhavi has quit IRC | 13:22 | |
*** chhavi has joined #openstack-meeting-alt | 13:23 | |
*** anilvenkata has joined #openstack-meeting-alt | 13:24 | |
*** cleong has joined #openstack-meeting-alt | 13:28 | |
*** yamamoto has joined #openstack-meeting-alt | 13:28 | |
*** jpena|lunch is now known as jpena | 13:31 | |
*** jkilpatr has quit IRC | 13:31 | |
*** diga has joined #openstack-meeting-alt | 13:35 | |
*** coolsvap has quit IRC | 13:36 | |
*** jkilpatr has joined #openstack-meeting-alt | 13:45 | |
*** brault has joined #openstack-meeting-alt | 13:48 | |
*** dprince has joined #openstack-meeting-alt | 13:51 | |
*** jaypipes has joined #openstack-meeting-alt | 13:55 | |
*** yamamoto has quit IRC | 13:56 | |
*** yamamoto has joined #openstack-meeting-alt | 13:57 | |
*** cdent has joined #openstack-meeting-alt | 13:57 | |
*** takashin has joined #openstack-meeting-alt | 13:57 | |
*** GeraldK has joined #openstack-meeting-alt | 13:59 | |
efried | #startmeeting nova_scheduler | 14:00 |
---|---|---|
openstack | Meeting started Mon Jan 8 14:00:00 2018 UTC and is due to finish in 60 minutes. The chair is efried. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
*** openstack changes topic to " (Meeting topic: nova_scheduler)" | 14:00 | |
openstack | The meeting name has been set to 'nova_scheduler' | 14:00 |
efried | https://wiki.openstack.org/wiki/Meetings/NovaScheduler#Agenda_for_next_meeting | 14:00 |
takashin | o/ | 14:00 |
efried | Greetings all. Welcome to the first Nova Scheduler meeting of the year. | 14:00 |
alex_xu_ | o/ | 14:00 |
* bauzas waves back from the sloppy snowy hills | 14:00 | |
efried | I'll be your host, while edleafe is somewhere on I-35 | 14:00 |
*** yamamoto has quit IRC | 14:01 | |
cdent | o/ | 14:01 |
efried | There's some interesting stuff on the agenda today. jaypipes around? (It'd be nice to have dansmith, but it's 6am for him, so...) | 14:02 |
jaypipes | I am | 14:02 |
efried | Cool, let's get started. | 14:02 |
efried | Reviews: Nested RPs. | 14:03 |
efried | ComputeDriver.update_provider_tree() series starting with: https://review.openstack.org/#/c/521685/ | 14:03 |
efried | This has prompted some discussion topics which we'll get to later. | 14:03 |
jaypipes | I'm three patches deep in the nested with allocation candidates series. making decent progress. | 14:03 |
efried | ^^ Nested affordance in GET /allocation_candidates series starting with: https://review.openstack.org/#/c/531443/ | 14:04 |
* jaypipes puts on brakes | 14:04 | |
efried | Granular resource requests (https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bp/granular-resource-requests) waiting for ^^ | 14:04 |
efried | Anyone have anything they want to bring up on those? | 14:04 |
efried | ...other than the "open discussion" stuff | 14:05 |
bauzas | I need to review the nested RP stuff | 14:05 |
bauzas | I see the update_provider_tree() changes as WIP, correct ? | 14:05 |
efried | bauzas Only the top couple of patches. The bottom two or three are ready. | 14:05 |
bauzas | efried: those aren't the driver side | 14:05 |
bauzas | amirite ? | 14:06 |
* alex_xu_ happy to review more sql | 14:06 | |
efried | Correct; they're in report client and its helpers. | 14:06 |
bauzas | k | 14:06 |
efried | All framework needed to get support in the driver side. | 14:06 |
efried | But yeah, bauzas I noticed you were looking to use this stuff for libvirt vgpu work. | 14:06 |
bauzas | I'm cool with that, just wanted to make things clear, since you were pointing out | 14:07 |
bauzas | (15:03:27) efried: ComputeDriver.update_provider_tree() series starting with: https://review.openstack.org/#/c/521685/ | 14:07 |
bauzas | efried: definitely Rocky for me | 14:07 |
efried | okay. | 14:07 |
bauzas | efried: I'm still beating with loving libvirt and nvidia fancy popping up issues | 14:07 |
bauzas | tl:dr: no docs, just words of mouth | 14:07 |
efried | Good times. "Someone" should write the docs :) | 14:08 |
efried | Anything else on NRP? | 14:08 |
efried | Moving on. | 14:08 |
efried | Alternate hosts (edleafe): | 14:08 |
efried | Series now starts with test case patch https://review.openstack.org/#/c/531022/ | 14:08 |
efried | Revealed bug: https://bugs.launchpad.net/nova/+bug/1741125 | 14:08 |
openstack | Launchpad bug 1741125 in OpenStack Compute (nova) "Instance resize intermittently fails when rescheduling" [High,In progress] - Assigned to Ed Leafe (ed-leafe) | 14:08 |
bauzas | the Xen folks are probably the best customers for the NRP usecase | 14:08 |
bauzas | they are way more advanced than me | 14:08 |
efried | bauzas Noted. They're on my radar. | 14:09 |
alex_xu_ | efried: does nrp still target to this release? | 14:09 |
bauzas | the more we can merge, the better it will be | 14:09 |
efried | alex_xu_ As far as I know, yes. | 14:09 |
bauzas | at least the compute side is critical | 14:09 |
bauzas | not the scheduling one | 14:10 |
alex_xu_ | efried: ok, just looks like the time is tight | 14:10 |
bauzas | alex_xu_: aaaaand I haven't harassed you with beggy asks for reviews on my VGPU changes :p | 14:10 |
efried | I believe the scope of the work is limited to what's described above, which I feel is doable if we stay aggressive. | 14:10 |
efried | jaypipes Thoughts on that? | 14:11 |
alex_xu_ | bauzas: heh :) | 14:11 |
* cdent gets up on the balls of his feet | 14:11 | |
*** yangyapeng has quit IRC | 14:11 | |
efried | Anything on alt hosts? | 14:12 |
jaypipes | efried: I believe we can get n-r-p in reportclient, n-r-p in alloc candidates, and xen as first client/consumer done in Queens. | 14:12 |
efried | jaypipes ++ | 14:12 |
bauzas | I agree | 14:12 |
alex_xu_ | \o/ | 14:12 |
jaypipes | efried: what I *don't* believe will be done is the crazy-pants numa/pci stuff. | 14:13 |
jaypipes | efried: that will need more extensive testing | 14:13 |
*** julim has joined #openstack-meeting-alt | 14:13 | |
efried | jaypipes Agree. That is driver consumption of the stuff we're putting into Queens, yes? | 14:13 |
jaypipes | efried: so we will continue to need both the PciPassthroughFilter and the NUMATopologyFilter in the scheduler for at least Queens. | 14:13 |
cdent | I think on alt hosts, the only pending thing is fixing that bug (on the agenda). And any subsequent fall out from it existing | 14:13 |
jaypipes | efried: yes, xactly. | 14:13 |
bauzas | driver consumption or inventory ? | 14:14 |
alex_xu_ | is granular request part of nrp? | 14:14 |
bauzas | I thought the former | 14:14 |
bauzas | oops | 14:14 |
efried | alex_xu_ yes | 14:14 |
bauzas | I thought the /latter/ | 14:14 |
alex_xu_ | efried: cool | 14:14 |
jaypipes | bauzas: driver consumption *is* inventory :) | 14:14 |
bauzas | dammit, speak French folks | 14:14 |
jaypipes | bauzas: by "driver consumption", we're referring to the virt driver API's proposed update_provider_tree() method, which is responsible for inventory tracking. | 14:15 |
bauzas | the driver will *provide* the inventory ala new way, better ? | 14:15 |
jaypipes | ++ | 14:15 |
efried | bauzas jaypipes It's two-pronged, really. The driver will have to supply the RP picture via update_provider_tree; and will also have to have the code to do the device creation/assignment to the VM based on the allocations from the scheduler. | 14:15 |
bauzas | jaypipes: that looks like a provider terminology to me, not a consumer, but meh :p | 14:16 |
jaypipes | efried: sure, yes. | 14:16 |
bauzas | anyway, I'm seriously diverting | 14:16 |
* bauzas shuts up | 14:16 | |
jaypipes | bauzas: agreeed. | 14:16 |
efried | Providing inventory by consuming new interfaces :) | 14:16 |
jaypipes | ok, moving on... | 14:16 |
* efried realizes total failure to use #topic thus far | 14:17 | |
efried | #topic Bugs | 14:17 |
*** openstack changes topic to "Bugs (Meeting topic: nova_scheduler)" | 14:17 | |
efried | https://bugs.launchpad.net/nova/+bugs?field.tag=placement | 14:17 |
jaypipes | no bugs. ever. next topic. | 14:17 |
efried | 25 of these, probably a good time to do a scrub. | 14:18 |
efried | Make sure the status is appropriate. E.g. the other day I found a moldy one (but I only looked at the one). | 14:18 |
efried | Volunteers? | 14:18 |
efried | <crickets> | 14:19 |
jaypipes | not me, sorry. I need to focus on reviews this week. | 14:19 |
efried | I'll try to skim through them. | 14:19 |
efried | Anything else on bugs? | 14:19 |
cdent | i look every week, but usually the status hasn't changed much. will continue to do so | 14:19 |
efried | Thanks | 14:19 |
efried | #topic Open discussion | 14:20 |
*** openstack changes topic to "Open discussion (Meeting topic: nova_scheduler)" | 14:20 | |
efried | First on the list: Using the limits recently made available on GET /allocation_candidates. | 14:20 |
efried | Dan put up a WIP on Friday: https://review.openstack.org/#/c/531517/ | 14:20 |
efried | So I guess any discussion can happen on that review. | 14:21 |
efried | Anything to talk about here & now on that? | 14:21 |
jaypipes | nope | 14:22 |
efried | Next. | 14:22 |
efried | There's been lots of words in the reviews of https://review.openstack.org/#/c/526539 | 14:23 |
cdent | "careful handling of conflicts" is a) probably right, b) scary, c) sigh making because b | 14:23 |
cdent | efried: can you expand on generation handing on aggregates? | 14:23 |
cdent | (the necessity thereof) | 14:24 |
efried | Sure. | 14:24 |
cdent | (for sake of completeness) | 14:24 |
efried | If we want to allow multiple threads, possibly/usually on different hosts, to manage the same RP, we need a way to handle race conditions. | 14:25 |
efried | ...a way that isn't process/thread level locking. | 14:25 |
efried | So the db record of a provider includes a 'generation', which is a monotonically increasing integer indicating the "revision" of the RP. | 14:26 |
bauzas | not sure I get the problem and/or the context of that conversation | 14:26 |
efried | You GET the provider, change something about it, and PUT it back. You don't change the generation in that payload. | 14:26 |
efried | bauzas It's this: If thread A GETs the provider and makes a change, and thread B GETs the provider and makes a change, then thread A PUTs it back, then thread B puts it back, thread B's changes will overwrite thread A's changes. | 14:27 |
cdent | that part's mostly understood, but with aggregates we had originally decided not to. What's different? Instead of generation, do we need a way to add/remove a single member from an aggregate collection? | 14:27 |
jaypipes | correct. | 14:27 |
cdent | (if it's already there or already not there, do nothing, it's OK) | 14:28 |
jaypipes | cdent: no, I think we just need to do the exact same thing we do with the traits collection of an rp. | 14:28 |
efried | bauzas Is it clear how generation fixes that, or should I explain further? | 14:28 |
bauzas | I know why we have the generation bit, so I guess the problem is with aggregates that *don't* have this ? | 14:28 |
cdent | jaypipes: that's fine, just trying to make sure the picture is clear | 14:28 |
jaypipes | cdent: the trick is we need to deprecate the old API (that doesn't supply a generation) and add a new microversion that supplies a generation for PUT /aggregates | 14:29 |
efried | bauzas Right, today if you change the aggregates associated with a provider, that provider's generation is *not* incremented. | 14:29 |
efried | bauzas We're suggesting that's a bad thing, and needs to be fixed. | 14:29 |
jaypipes | efried: right. it's the only rp-related endpoint (that modifies something) that doesn't have a generation marker. | 14:29 |
*** sean-k-mooney has joined #openstack-meeting-alt | 14:30 | |
*** ktibi has joined #openstack-meeting-alt | 14:30 | |
bauzas | well, if the RP doesn't change, why should we increment the generation bit ? | 14:30 |
efried | bauzas Changing aggregate associations *is* changing the RP. | 14:30 |
efried | Just like changing the traits is changing the RP. | 14:30 |
jaypipes | bauzas: because the rp's generation is the lock for all things related to the rp. inventory, allocations, traits, etc | 14:30 |
bauzas | I'm maybe missing something, but if that's just a matter of incrementing the gen bit, why should we need to modify the REST API ? | 14:31 |
bauzas | for passing the new generation bit ? | 14:31 |
bauzas | sorry, see, I'm rusty | 14:31 |
*** lpetrut has joined #openstack-meeting-alt | 14:31 | |
efried | No, the payload structures don't change. | 14:31 |
jaypipes | bauzas: because we need the thing that is attempting to change the rp to say what its latest view of the rp was. | 14:32 |
jaypipes | efried: yes, they do. | 14:32 |
efried | Oh yeah | 14:32 |
jaypipes | efried: unless you plan on passing the generation in a header... | 14:32 |
bauzas | jaypipes: right, we need to pass the index where we are | 14:32 |
efried | cause right now GET /rp/{uuid}/aggs doesn't include generation. | 14:32 |
bauzas | gotcha | 14:32 |
jaypipes | efried: which I don't recommend. | 14:32 |
cdent | it will make cdent very fussy | 14:33 |
efried | Because why? | 14:33 |
jaypipes | and we don't want that. | 14:33 |
cdent | two ways to do the same thing: bad | 14:33 |
jaypipes | efried: because it would be very inconsistent. | 14:33 |
cdent | jinx | 14:33 |
jaypipes | efried: so let's move on :) | 14:33 |
bauzas | do we consider those race conditions as being often ? | 14:33 |
bauzas | after all, Nova aggregates don't have any concurrency management in place | 14:34 |
efried | Okay, I got confused. We *do* want to include the generation in the payload? | 14:34 |
cdent | we consider them to be very possible when bring up several pieces of new hardware, especially in clustered envs, but then stabilize | 14:34 |
jaypipes | bauzas: originally, cdent and I did not envision aggs changing a) often or b) by the compute virt driver. but drivers like PowerVM and vCenter apparently have designs to do this. | 14:34 |
*** ktibi has left #openstack-meeting-alt | 14:34 | |
bauzas | jaypipes: I thought the former as well, so I'm surprised | 14:34 |
jaypipes | bauzas: which is why we need to solve this problem now and not later with some distributed locking hacky thing | 14:34 |
bauzas | okay, is that a thing for now or Rocky? | 14:35 |
bauzas | because that's an API microversion bump, right? | 14:35 |
bauzas | I mean, surely we can | 14:35 |
cdent | we've bumped the placement microversion 6 times this cycle, we can afford a few more | 14:35 |
bauzas | but I just know we have a shit number of other things to merge | 14:36 |
cdent | (6 is a guesstimate) | 14:36 |
bauzas | then, Just Do It (c) | 14:36 |
efried | ++ | 14:36 |
bauzas | and see when we can merge | 14:36 |
jaypipes | bauzas: yeah, I'm in the just do it camp. | 14:36 |
efried | Who would like to propose this patch? | 14:36 |
jaypipes | so... *who* should do it? | 14:36 |
jaypipes | jinx | 14:36 |
bauzas | a-ha! | 14:36 |
cdent | I can do the placement side | 14:36 |
jaypipes | ++ | 14:37 |
jaypipes | excellent. | 14:37 |
efried | Thanks cdent | 14:37 |
* cdent adds to to do likst | 14:37 | |
gibi | I have one silly question | 14:37 |
efried | #action cdent to propose generations-on-aggregate placement microversion | 14:37 |
gibi | When adding an aggregate to an RP we will increase the generation of that RP or every RP that aggregate is connected to? | 14:37 |
* efried finds the #action keyword | 14:37 | |
efried | gibi Excellent question, as always. | 14:38 |
jaypipes | gibi: no, only update generation when *that* RP's set of aggs changes | 14:38 |
efried | That seems reasonable to me. | 14:38 |
sean-k-mooney | gibi: i would guess the generation number of the aggregate and the RP added but not other RPs in that aggregate | 14:38 |
efried | (sean-k-mooney the aggregate doesn't have a generation) | 14:38 |
efried | (but yeah) | 14:38 |
cdent | gibi: clearly not a silly question gibi, especially since there's no such thing as a silly question | 14:39 |
gibi | OK, the answer seems consistent :) | 14:39 |
efried | Okay, so cdent pointedly said "placement side". The client side... | 14:39 |
efried | That's probably on me, unless someone else wants to volunteer. | 14:39 |
cdent | I figured splitting it up was probably better to avoid serializing. | 14:40 |
efried | suresure | 14:40 |
efried | Right now the report client doesn't have any kind of retry on 409. | 14:40 |
cdent | and also since my savvy of the ProviderTree stuff is limited | 14:40 |
efried | cdent Actually I don't think ProviderTree enters into it much or at all for this. | 14:41 |
cdent | there's code in there somewhere for the Retry exception that jaypipes (I think?) created | 14:41 |
efried | oh? | 14:41 |
* efried looks | 14:41 | |
cdent | which can probalby be reused | 14:41 |
cdent | (with some tweaks) | 14:41 |
efried | report.py has class Retry and a @retries decorator. Will investigate. | 14:42 |
efried | So now the big question: | 14:42 |
cdent | I realize that the ProviderTree just uses the report client, but the larger context is the ProviderTree doing an effectivce sync of whatever the virt driver tells it | 14:42 |
*** yamamoto has joined #openstack-meeting-alt | 14:42 | |
cdent | that's the part I haven't got close knowledge of, and is the driver for all this stuff, and the part that we want to be the working result | 14:42 |
jaypipes | cdent: you talking about reportclient or ProviderTree? ProviderTree does not interface with placement API. | 14:43 |
efried | cdent That's an interesting point. I had been thinking we would do the retry logic at the low level report client methods that do the PUTs. | 14:43 |
cdent | efried: yes, so would I | 14:43 |
efried | i.e. ProviderTree not involved - it calls those guys and they just work, with however many retries they need. | 14:43 |
jaypipes | cdent: ProviderTree doesn't use reportclient :) | 14:44 |
cdent | a thing which uses ProvideerTree and reportclient is trying to manage the picture of the world | 14:44 |
cdent | the picture of the world is the thing I'm trying to say we should care most about | 14:44 |
efried | agreed | 14:44 |
cdent | that is: I'm trying to say: it's not the unit tests that matter here | 14:44 |
cdent | it's the end result | 14:44 |
jaypipes | cdent: reportclient builds the ProviderTree. ProviderTree simply implements thread-safe ability to set traits and inventory information for providers, and then we can pass that ProviderTree to the reportclient and reportclient will inspect it and call the placement REST API accordingly. | 14:45 |
*** feldmann has quit IRC | 14:45 | |
cdent | yes, that's been my understanding all along | 14:45 |
jaypipes | k | 14:45 |
efried | It'll be a report client method that diffs two ProviderTrees and flushes the changes back to placement. I'm saying that method will call the low-level PUT wrappers, and those wrappers will have the retry logic in 'em. | 14:45 |
cdent | so the provider tree is the central/key data structure that drivers the pictuyre of the world | 14:45 |
cdent | efried: yes | 14:46 |
jaypipes | cdent: yes. | 14:46 |
* cdent is apparently more data structure oriented than he thought | 14:46 | |
efried | The diff/flush method is the to-be-written one here: https://review.openstack.org/#/c/520246/19/nova/compute/resource_tracker.py@886 | 14:46 |
*** yamamoto has quit IRC | 14:47 | |
cdent | see above about "scary" | 14:47 |
cdent | I know it is just a simple matter of programming | 14:47 |
efried | #action efried to start on conflict retry logic. | 14:47 |
efried | So the big question: | 14:47 |
efried | Can we do this in report client in such a way that it works for all (reasonable) use cases? | 14:48 |
efried | See the most recent review missive on https://review.openstack.org/#/c/526539/7 | 14:48 |
efried | It is not always definitely clear how a conflict should be handled. | 14:49 |
efried | Consider especially the case where two hosts are creating the aggregate for a shared provider. | 14:49 |
efried | It's certainly legal for a shared provider to be a member of multiple aggregates. | 14:49 |
efried | So when we retry, how do we know whether to add our aggregate to the mix, or see that the aggregate was created by the "other thread" and just skip? | 14:50 |
jaypipes | that's the issue with >1 thing creating aggregates :) | 14:52 |
efried | In the general view, I contend that only the specific virt driver can know this answer for a specific shared provider. | 14:52 |
efried | ...assuming the picture where it's the virt driver controlling the shared provider. | 14:52 |
jaypipes | efried: yes, I think that's the case... | 14:52 |
efried | If so, then how do we manage this without giving virt the reins to do the placement update & conflict resolution itself? | 14:53 |
sean-k-mooney | efried: you are assuming that the virt driver will always know. if the shared resouce is not a compute releated resouce will it have that knoladge | 14:53 |
jaypipes | efried: the virt driver needs to be the thing that answers the question "ok, so the state of things changed. check if my desired state is now in play before I go trying to create that new desired state" | 14:53 |
efried | jaypipes So maybe if conflict is detected, reinvoke update_provider_tree? | 14:54 |
jaypipes | efried: all the generation change stuff means is "*something changed*!". it doesn't mean "this thing changed". | 14:54 |
bauzas | FWIW, 5 mins left-ish | 14:54 |
jaypipes | efried: I think it depends. certainly if you get a 409, then I would re-read all the provider's information (traits, inventory, etc) | 14:55 |
efried | So perhaps where this leads us is actually a lot broader and simpler than I had been thinking. | 14:55 |
jaypipes | efried: and then check to see if the desired state is already existing. and if so, do nothing. if not, then call the update/set again. | 14:55 |
*** yamahata has joined #openstack-meeting-alt | 14:56 | |
efried | Instead of having the low-level PUT method detect 409s and redrive, have the resource tracker trap the 409 and reinvoke update_provider_tree. | 14:56 |
efried | That gives the driver the control it needs. | 14:56 |
jaypipes | efried: that "desired state" is going to be different depending on the virt driver and depending on what the virt driver is attempting to do (for example, changing a provider's inventory is different from changing the provider's set of traits) | 14:56 |
jaypipes | efried: yes, precisely what you said. | 14:56 |
efried | Because update_provider_tree is always doing as jaypipes says: checking whether the "current" state is the "desired" state. | 14:56 |
jaypipes | efried: that is the original design. | 14:56 |
jaypipes | efried: client-driven state retries, that is. | 14:57 |
efried | Dig. | 14:57 |
efried | Well, that was the only real-world case where I had thought there might be a reason for virt to talk directly to placement. | 14:59 |
efried | The last open discussion topic is on that point in general. | 14:59 |
cdent | If a ProviderTree has state A, with hierarchy, and there is a conflict, such that it should be reset to state B, if that leaves orphans in the hierarchy, who/what cleans up those orphans and how does anything know? | 14:59 |
*** yangyapeng has joined #openstack-meeting-alt | 14:59 | |
efried | cdent The aforementioned method. | 14:59 |
cdent | it deletes resource providers? | 15:00 |
efried | Yes | 15:00 |
cdent | maybe something else wants them too? | 15:00 |
efried | We're over time. Continue in -nova? | 15:00 |
* cdent nods | 15:00 | |
efried | #endmeeting | 15:00 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:00 | |
openstack | Meeting ended Mon Jan 8 15:00:29 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:00 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/nova_scheduler/2018/nova_scheduler.2018-01-08-14.00.html | 15:00 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/nova_scheduler/2018/nova_scheduler.2018-01-08-14.00.txt | 15:00 |
openstack | Log: http://eavesdrop.openstack.org/meetings/nova_scheduler/2018/nova_scheduler.2018-01-08-14.00.log.html | 15:00 |
*** takashin has left #openstack-meeting-alt | 15:01 | |
*** hongbin has joined #openstack-meeting-alt | 15:01 | |
*** sean-k-mooney has left #openstack-meeting-alt | 15:01 | |
*** manjeet has joined #openstack-meeting-alt | 15:01 | |
*** Guest8485 is now known as dansmith | 15:02 | |
*** dansmith is now known as Guest62501 | 15:02 | |
*** fzdarsky has quit IRC | 15:03 | |
*** fzdarsky has joined #openstack-meeting-alt | 15:03 | |
*** sdague has quit IRC | 15:04 | |
*** Guest62501 is now known as dansmith | 15:05 | |
*** pgadiya has quit IRC | 15:07 | |
*** gouthamr has joined #openstack-meeting-alt | 15:11 | |
*** cdent has left #openstack-meeting-alt | 15:12 | |
*** felipemonteiro has joined #openstack-meeting-alt | 15:15 | |
*** yamamoto has joined #openstack-meeting-alt | 15:27 | |
*** markstur has joined #openstack-meeting-alt | 15:29 | |
*** rmart04 has joined #openstack-meeting-alt | 15:31 | |
*** yamamoto has quit IRC | 15:32 | |
*** ssathaye has joined #openstack-meeting-alt | 15:34 | |
*** diga has quit IRC | 15:34 | |
*** gcb has quit IRC | 15:48 | |
*** matrohon has joined #openstack-meeting-alt | 15:52 | |
*** yamamoto has joined #openstack-meeting-alt | 15:53 | |
*** yamamoto has quit IRC | 15:53 | |
*** felipemonteiro has quit IRC | 15:54 | |
*** felipemonteiro has joined #openstack-meeting-alt | 15:55 | |
*** TxGirlGeek has joined #openstack-meeting-alt | 15:59 | |
*** shamail has joined #openstack-meeting-alt | 16:01 | |
*** ijw has joined #openstack-meeting-alt | 16:03 | |
*** rmart04 has quit IRC | 16:03 | |
*** chyka has joined #openstack-meeting-alt | 16:05 | |
*** sridharg has quit IRC | 16:06 | |
*** manjeet has quit IRC | 16:06 | |
*** shamail has quit IRC | 16:08 | |
*** mjura has quit IRC | 16:12 | |
*** feldmann has joined #openstack-meeting-alt | 16:18 | |
*** anilvenkata has quit IRC | 16:19 | |
*** anilvenkata has joined #openstack-meeting-alt | 16:21 | |
*** krtaylor has quit IRC | 16:27 | |
*** felipemonteiro has quit IRC | 16:27 | |
*** krtaylor_ has joined #openstack-meeting-alt | 16:27 | |
*** ijw has quit IRC | 16:29 | |
*** kumarmn has joined #openstack-meeting-alt | 16:29 | |
*** ganso has left #openstack-meeting-alt | 16:30 | |
*** feldmann has quit IRC | 16:31 | |
*** d0ugal has quit IRC | 16:35 | |
*** chhavi has quit IRC | 16:38 | |
*** kmalloc has joined #openstack-meeting-alt | 16:38 | |
*** gyee has joined #openstack-meeting-alt | 16:39 | |
*** GeraldK has quit IRC | 16:43 | |
*** jkilpatr has quit IRC | 16:44 | |
*** jpena is now known as jpena|brb | 16:44 | |
*** david-lyle has quit IRC | 16:47 | |
*** david-lyle has joined #openstack-meeting-alt | 16:48 | |
*** yamahata has quit IRC | 16:48 | |
*** david-lyle has quit IRC | 16:52 | |
*** yamamoto has joined #openstack-meeting-alt | 16:53 | |
*** Leo_m has joined #openstack-meeting-alt | 16:55 | |
*** d0ugal has joined #openstack-meeting-alt | 16:59 | |
*** jkilpatr has joined #openstack-meeting-alt | 17:00 | |
*** slaweq has joined #openstack-meeting-alt | 17:00 | |
*** iyamahat has joined #openstack-meeting-alt | 17:01 | |
*** yamamoto has quit IRC | 17:02 | |
*** oidgar has quit IRC | 17:06 | |
*** bhavik1 has joined #openstack-meeting-alt | 17:10 | |
*** TxGirlGeek has quit IRC | 17:11 | |
*** bhavik1 has quit IRC | 17:11 | |
*** slaweq has quit IRC | 17:11 | |
*** egallen has quit IRC | 17:11 | |
*** d0ugal has quit IRC | 17:11 | |
*** egallen has joined #openstack-meeting-alt | 17:12 | |
*** dsariel has quit IRC | 17:16 | |
*** TxGirlGeek has joined #openstack-meeting-alt | 17:16 | |
*** ijw has joined #openstack-meeting-alt | 17:17 | |
*** yamahata has joined #openstack-meeting-alt | 17:20 | |
*** egallen has quit IRC | 17:22 | |
*** jpena|brb is now known as jpena | 17:24 | |
*** oikiki has joined #openstack-meeting-alt | 17:25 | |
*** fzdarsky is now known as fzdarsky|afk | 17:28 | |
*** matrohon has quit IRC | 17:31 | |
*** david-lyle has joined #openstack-meeting-alt | 17:34 | |
*** egallen has joined #openstack-meeting-alt | 17:42 | |
*** yamamoto has joined #openstack-meeting-alt | 17:43 | |
*** yamamoto has quit IRC | 17:43 | |
*** felipemonteiro has joined #openstack-meeting-alt | 17:45 | |
*** egallen has quit IRC | 17:47 | |
*** egallen_ has joined #openstack-meeting-alt | 17:47 | |
*** david-lyle has quit IRC | 17:47 | |
*** marios has quit IRC | 17:49 | |
*** derekh has quit IRC | 18:01 | |
*** slaweq has joined #openstack-meeting-alt | 18:05 | |
*** rmascena has joined #openstack-meeting-alt | 18:05 | |
*** raildo has quit IRC | 18:08 | |
*** bfernando has quit IRC | 18:16 | |
*** slaweq has quit IRC | 18:17 | |
*** jpena is now known as jpena|off | 18:18 | |
*** jkilpatr has quit IRC | 18:19 | |
*** slaweq has joined #openstack-meeting-alt | 18:21 | |
*** egallen_ has quit IRC | 18:24 | |
*** slaweq has quit IRC | 18:31 | |
*** jkilpatr has joined #openstack-meeting-alt | 18:33 | |
*** slaweq has joined #openstack-meeting-alt | 18:34 | |
*** beekneemech is now known as bnemec | 18:34 | |
*** tesseract has quit IRC | 18:35 | |
*** corey_ has joined #openstack-meeting-alt | 18:39 | |
*** cleong has quit IRC | 18:40 | |
*** lpetrut has quit IRC | 18:41 | |
*** Leo_m has quit IRC | 18:43 | |
*** yamamoto has joined #openstack-meeting-alt | 18:44 | |
*** Leo_m has joined #openstack-meeting-alt | 18:44 | |
*** Leo_m has quit IRC | 18:49 | |
*** yamamoto has quit IRC | 18:52 | |
*** TxGirlGeek has quit IRC | 18:55 | |
*** TxGirlGeek has joined #openstack-meeting-alt | 18:56 | |
*** TxGirlGeek has quit IRC | 18:56 | |
*** oikiki has quit IRC | 18:58 | |
*** oikiki has joined #openstack-meeting-alt | 18:59 | |
*** TxGirlGeek has joined #openstack-meeting-alt | 18:59 | |
*** slaweq has quit IRC | 19:01 | |
*** yamamoto has joined #openstack-meeting-alt | 19:01 | |
*** slaweq has joined #openstack-meeting-alt | 19:02 | |
*** TxGirlGeek has quit IRC | 19:04 | |
*** slaweq has quit IRC | 19:06 | |
*** slaweq has joined #openstack-meeting-alt | 19:09 | |
*** harlowja has joined #openstack-meeting-alt | 19:19 | |
*** slaweq has quit IRC | 19:19 | |
*** TxGirlGeek has joined #openstack-meeting-alt | 19:22 | |
*** slaweq has joined #openstack-meeting-alt | 19:28 | |
*** jkilpatr has quit IRC | 19:33 | |
*** lpetrut has joined #openstack-meeting-alt | 19:41 | |
*** felipemonteiro_ has joined #openstack-meeting-alt | 19:41 | |
*** david-lyle has joined #openstack-meeting-alt | 19:43 | |
*** felipemonteiro has quit IRC | 19:45 | |
*** dmsimard has joined #openstack-meeting-alt | 19:48 | |
*** Leo_m has joined #openstack-meeting-alt | 19:49 | |
*** yamamoto has quit IRC | 19:53 | |
*** fzdarsky|afk has quit IRC | 20:00 | |
*** sdague has joined #openstack-meeting-alt | 20:00 | |
dave-mccowan | #startmeeting barbican | 20:01 |
openstack | Meeting started Mon Jan 8 20:01:35 2018 UTC and is due to finish in 60 minutes. The chair is dave-mccowan. Information about MeetBot at http://wiki.debian.org/MeetBot. | 20:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 20:01 |
*** openstack changes topic to " (Meeting topic: barbican)" | 20:01 | |
openstack | The meeting name has been set to 'barbican' | 20:01 |
dave-mccowan | #topic roll call | 20:01 |
*** openstack changes topic to "roll call (Meeting topic: barbican)" | 20:01 | |
dave-mccowan | o/ | 20:01 |
*** yamamoto has joined #openstack-meeting-alt | 20:04 | |
*** dsariel has joined #openstack-meeting-alt | 20:06 | |
*** yamamoto has quit IRC | 20:09 | |
ssathaye | o/ | 20:10 |
ssathaye | Hi Dave | 20:10 |
dave-mccowan | Hi ssathaye | 20:10 |
ssathaye | Thought at least I will show up...still continue to look for b/w to contribute. | 20:11 |
ssathaye | Hopefully soon. | 20:11 |
dave-mccowan | Looks like a short meeting today. | 20:11 |
*** jkilpatr has joined #openstack-meeting-alt | 20:11 | |
ssathaye | ok | 20:11 |
dave-mccowan | #topic Queens Deadlines | 20:12 |
*** openstack changes topic to "Queens Deadlines (Meeting topic: barbican)" | 20:12 | |
dave-mccowan | just in case people read these logs.... | 20:12 |
dave-mccowan | Queens deadlines are coming up. | 20:12 |
ssathaye | ok | 20:12 |
dave-mccowan | Deadline for Queens release of Castellan and python-barbicanclient patches will be week of Jan 15 | 20:13 |
dave-mccowan | https://releases.openstack.org/queens/schedule.html | 20:13 |
dave-mccowan | Feb 5 is feature freeze for Barbican service, Feb 28 is release candidate date. | 20:13 |
dave-mccowan | Anyone with patches that should go in Queens, please get our attention for reviews. | 20:14 |
dave-mccowan | that's all i have. | 20:14 |
dave-mccowan | anything you want to bring up ssathaye ? | 20:14 |
ssathaye | not really. One little patch that I submitted to the docs - I got feedback on. Now need to re-submit. | 20:15 |
ssathaye | Will do this week. | 20:15 |
dave-mccowan | ssathaye sounds good. thanks! | 20:16 |
dave-mccowan | see you later.... | 20:17 |
dave-mccowan | #endmeeting | 20:17 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 20:17 | |
openstack | Meeting ended Mon Jan 8 20:17:10 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 20:17 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/barbican/2018/barbican.2018-01-08-20.01.html | 20:17 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/barbican/2018/barbican.2018-01-08-20.01.txt | 20:17 |
openstack | Log: http://eavesdrop.openstack.org/meetings/barbican/2018/barbican.2018-01-08-20.01.log.html | 20:17 |
ssathaye | thanks Dave! | 20:18 |
*** openstack has quit IRC | 20:38 | |
*** openstack has joined #openstack-meeting-alt | 20:42 | |
*** ChanServ sets mode: +o openstack | 20:42 | |
*** TxGirlGeek has quit IRC | 20:45 | |
*** TxGirlGeek has joined #openstack-meeting-alt | 20:46 | |
*** feldmann has joined #openstack-meeting-alt | 20:49 | |
*** TxGirlGeek has quit IRC | 20:51 | |
*** egallen has quit IRC | 20:53 | |
*** TxGirlGeek has joined #openstack-meeting-alt | 20:54 | |
*** egallen has joined #openstack-meeting-alt | 20:54 | |
*** TxGirlGeek has quit IRC | 20:55 | |
*** TxGirlGeek has joined #openstack-meeting-alt | 20:56 | |
*** jtomasek has quit IRC | 20:58 | |
*** Arkady_Kanevsky has joined #openstack-meeting-alt | 21:01 | |
Arkady_Kanevsky | hello PWG | 21:01 |
*** alee has joined #openstack-meeting-alt | 21:02 | |
*** dprince has quit IRC | 21:06 | |
*** matrohon has joined #openstack-meeting-alt | 21:07 | |
*** MeganR has joined #openstack-meeting-alt | 21:11 | |
*** rcernin has joined #openstack-meeting-alt | 21:18 | |
*** gouthamr has quit IRC | 21:22 | |
*** egallen has quit IRC | 21:24 | |
*** corey_ has quit IRC | 21:25 | |
*** julim has quit IRC | 21:27 | |
*** david-lyle has quit IRC | 21:28 | |
*** alee has left #openstack-meeting-alt | 21:29 | |
*** rcernin has quit IRC | 21:33 | |
*** Arkady_Kanevsky has quit IRC | 21:35 | |
*** gouthamr has joined #openstack-meeting-alt | 21:37 | |
*** yamamoto has joined #openstack-meeting-alt | 21:39 | |
*** yamamoto has quit IRC | 21:47 | |
*** MeganR has quit IRC | 21:49 | |
*** slaweq has quit IRC | 21:50 | |
*** TxGirlGeek has quit IRC | 21:50 | |
*** feldmann has quit IRC | 21:55 | |
*** Shrews has joined #openstack-meeting-alt | 21:57 | |
*** TxGirlGeek has joined #openstack-meeting-alt | 21:58 | |
*** TxGirlGeek has quit IRC | 21:59 | |
*** matrohon has quit IRC | 22:00 | |
mrhillsman | o/ | 22:00 |
corvus | any zuul folks around? | 22:00 |
clarkb | hello | 22:00 |
mrhillsman | yar | 22:00 |
tobiash | hi | 22:00 |
pabelanger | o/ | 22:00 |
fungi | i'm around, but about to not be. sorry :/ | 22:00 |
corvus | #startmeeting zuul | 22:01 |
openstack | Meeting started Mon Jan 8 22:01:07 2018 UTC and is due to finish in 60 minutes. The chair is corvus. Information about MeetBot at http://wiki.debian.org/MeetBot. | 22:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 22:01 |
dmsimard | \o | 22:01 |
*** openstack changes topic to " (Meeting topic: zuul)" | 22:01 | |
openstack | The meeting name has been set to 'zuul' | 22:01 |
Shrews | hey | 22:01 |
corvus | #link agenda https://wiki.openstack.org/wiki/Meetings/Zuul | 22:01 |
* mordred waves to humans | 22:02 | |
corvus | #link release roadmap https://storyboard.openstack.org/#!/board/53 | 22:02 |
corvus | let's go through the 3.0 things real quick -- | 22:02 |
corvus | did someone pick up the github ingestion via zuul-web yet? | 22:03 |
corvus | i guess that's the last thing that's still in the old webapp, and once we get rid of that we can drop it entirely? | 22:03 |
tobiash | I picked this up before christmas | 22:04 |
corvus | tobiash: ah great -- it's https://review.openstack.org/504267 right? | 22:04 |
tobiash | What's missing is an end to end test yet | 22:04 |
pabelanger | corvus: I thought was assigned jlk, but seen he's moved onto new job recently. | 22:04 |
corvus | pabelanger: jlk handed it off to tobiash | 22:05 |
tobiash | corvus: yes | 22:05 |
SpamapS | o/ | 22:05 |
pabelanger | ack, I missed that | 22:05 |
corvus | tobiash: i agree with your last comment there -- we probably only need one or a few explicit tests for this | 22:05 |
corvus | tobiash: are you planning on finishing it up like that? | 22:05 |
corvus | (i updated the assignment in storyboard) | 22:06 |
tobiash | Probably not this week as we're going productive this week | 22:06 |
tobiash | But I hope next week | 22:06 |
corvus | tobiash: congrats and good luck :) | 22:06 |
corvus | tobiash: that sounds great, thanks | 22:06 |
corvus | dmsimard: are you still planning on fixing the zuul_json issue? | 22:06 |
*** rcernin has joined #openstack-meeting-alt | 22:06 | |
tobiash | thanks | 22:07 |
Shrews | oh, we lost jlk as a contributor? :( | 22:07 |
tobiash | :-) | 22:07 |
dmsimard | yes, in fact I rebased the patch last week in order to reproduce the issue (which would have been easier to troubleshoot, now that I'm root) but for some reason it did not trigger | 22:07 |
corvus | Shrews: i haven't heard that from jlk | 22:07 |
dmsimard | I've looked around and saw some fixes in upstream ansible for that issue but it is confusing since we should not have those fixes yet in our version of Ansible. | 22:08 |
*** egallen has joined #openstack-meeting-alt | 22:08 | |
* dmsimard gets link | 22:08 | |
pabelanger | Shrews: he just posted on twitter he is working as SRE at github.com :)So, hope not. | 22:08 |
SpamapS | I think jlk is just busy getting inserted into his new job matrix. | 22:08 |
SpamapS | Last we talked, he hoped to continue Zuul'ing in some capacity. | 22:08 |
mordred | that is also what I have heard from jlk | 22:08 |
dmsimard | https://github.com/ansible/ansible/commit/c30ee42fe1f0a9666a90f4d63121780f2a186c54 should fix our issue | 22:08 |
fungi | hopefully he's busy inserting zuul into his new job matrix ;) | 22:09 |
corvus | i see no reason why working at github would preclude contributing to zuul -- in fact, it's a position uniquely suited to doing so. i hope he will continue. :) | 22:09 |
dmsimard | it also claims performance and memory improvements but I dunno. | 22:09 |
mordred | we have a human on the inside now to bug with API questions :) | 22:09 |
pabelanger | mordred: ++ | 22:09 |
dmsimard | didn't know he was at github now, grats him | 22:09 |
Shrews | yes, let us all infiltrate all the places | 22:09 |
corvus | also, the big thing jlk is working on right now is getting github3.py released so we can release. that seems very likely to meet with github.com supervisory approval, i'd think :) | 22:10 |
mordred | dmsimard: well, today is his first day, so not knowing is totally fair :) | 22:10 |
mordred | corvus: I certainly hope so! | 22:10 |
dmsimard | corvus: in summary, I don't know whether or not there is something to fix yet since I am now unable to reproduce the issue and there has been an (unreleased) fix upstream. | 22:10 |
dmsimard | I'll add my findings in the story. | 22:10 |
corvus | dmsimard: do you mean you've been unable to repro using our production zuul, or locally? | 22:11 |
dmsimard | doing a recheck/rebase on https://review.openstack.org/#/c/504238/ typically reproduced the issue | 22:11 |
dmsimard | it no longer does | 22:11 |
* fungi has to disappear now, but will catch up on the rest of the meeting from the log later tonight | 22:11 | |
corvus | dmsimard: oh interesting. okay. so maybe we can drop this from the 3.0 blockers? | 22:12 |
dmsimard | it's possible a change occurred in zuul-stream fixed it | 22:12 |
dmsimard | corvus: I don't know yet -- I could try reproducing the issue without the patch (that was supposed to address the issue..) and see what happens. | 22:12 |
*** egallen has quit IRC | 22:12 | |
dmsimard | should be fairly easy | 22:12 |
corvus | dmsimard: okay. if you decide it's no longer an issue, go ahead and drop the zuulv3.0 tag from the story when you update it, please | 22:13 |
dmsimard | ack | 22:13 |
corvus | mordred: did i see you post something about a zuul-stream refactor? | 22:13 |
corvus | https://review.openstack.org/531171 looks like | 22:13 |
corvus | mordred: is that a start to addressing the 'refactor zuul-stream and add testing' story? | 22:14 |
corvus | the story for that is "It's currently largely untested and difficult to make changes to." | 22:14 |
*** TxGirlGeek has joined #openstack-meeting-alt | 22:14 | |
corvus | mordred: please let me know when you are back | 22:15 |
mordred | corvus: it's sort of a patch related to that - but that's a little bit more about changing how the log stream data gets schelpped around to be potentially more something we could upstream | 22:16 |
corvus | oh hai! | 22:16 |
mordred | I also wrote up a proposal here: https://github.com/ansible/proposals/issues/92 | 22:16 |
clarkb | and I guess it could help testing because we could have it log to a file/buffer in tests and check the contents rather than needing to build up a full on daemon process and listener and all that | 22:17 |
corvus | clarkb: well, spinning things up and tearing them down isn't really a problem for the test runner | 22:18 |
*** florianf has quit IRC | 22:18 | |
corvus | i think it's more that there's a structural issue with the fact that most of this behaves differently if you are sshing into a remote node vs locally | 22:18 |
mordred | yah - and also things like rebooting a test node will kill the zuul_console process | 22:19 |
corvus | mordred: well, i'm talking about unit tests | 22:19 |
mordred | so the aim here is that we won't need a zuul_console process, and also that the surface area for things breaking will reduce | 22:19 |
mordred | corvus: ah- yes, well, that as well :) | 22:19 |
mordred | amongst the issues with the current system are surprise, fear and an almost fanatical devotion to the pope ... | 22:20 |
corvus | the reason this story was created was because there are, even now, still a lot of times we put something in the console log that we shouldn't, or don't put something in that we should. and we have zero testing for any of that, and any time we try to change it, we break production, so it's effectively frozen.. | 22:20 |
corvus | so that's the thing that we need to get unblocked before the v3.0 release | 22:21 |
corvus | we need to be able to accept a bug report from someone saying "this should have been in the console log" and act on it | 22:21 |
mordred | yup. and that refactor is still on the todo-list - and is largerly orthogonal to the above patch | 22:21 |
Shrews | mmm, largerly | 22:21 |
corvus | okay that's helpful | 22:21 |
mordred | or, I *believe* it's orthogonal | 22:21 |
mordred | it's possible we'll discover that the other patch enables the refactor in important ways | 22:22 |
corvus | mordred: yeah, i could see it interseting if testing somehow becomes more feasible with the above, otherwise, i'd be terrified to land the above anyway | 22:22 |
mordred | ++ | 22:22 |
SpamapS | +1 for not needing zuul_console process! I've been having reboot issues actually. :) | 22:22 |
dmsimard | Do we no longer have a zuulv3-dev node that we could test sensitive things on ? | 22:23 |
pabelanger | no, we deleted it | 22:23 |
dmsimard | We could hook it up to openstack-dev/sandbox or something | 22:23 |
corvus | pabelanger, leifmadsen_: i see you're working on the docs -- anything blocking you there? | 22:23 |
*** erlon has quit IRC | 22:24 | |
clarkb | dmsimard: for stuff like this I think the effort is likely better spent adding tests to the test suite | 22:24 |
corvus | yeah, we're not landing anything else without tests :) | 22:24 |
pabelanger | corvus: just discussing where we want the example config project repo to live, that was about it. We should have some rst docs up this week I believe | 22:24 |
corvus | pabelanger: example config project repo? | 22:25 |
pabelanger | corvus: some of the discussions were just about having something existing online, so we can use the git driver connection for it. But, possible we want to docs to also include more details how to build that out | 22:26 |
corvus | pabelanger: since we don't expect anyone to actually reuse that, how about we just inline the content into the docs and walk people through creating their own? | 22:26 |
pabelanger | corvus: yah, that is an option for sure. | 22:26 |
*** rcarrillocruz has joined #openstack-meeting-alt | 22:26 | |
corvus | i mean, we should document using zuul-base-jobs (which will need to be a config repo -- but it only holds jobs). and zuul-jobs, of course. | 22:26 |
corvus | but i don't think we have plans for a reusable repo with, say, pipelines at the moment. | 22:27 |
*** lpetrut has quit IRC | 22:27 | |
corvus | that's still something everyone will need to create locally. for now. :) | 22:27 |
pabelanger | okay, I'll bring it up with leifmadsen_ tomorrow and we can discuss it more in #zuul | 22:28 |
tobiash | Making that more generic would ne cool | 22:28 |
corvus | yep, but a very long-term task :) | 22:28 |
corvus | pabelanger, mordred: what's the status of reporting on github from openstack-infra? | 22:28 |
pabelanger | I last tested it before holiday break, but haven't progressed more due to upcoming refactor of things into zuul-web. But it was working, except for 1 thing I cannot remember ATM | 22:29 |
corvus | pabelanger: were there any errors in the logs? | 22:30 |
pabelanger | corvus: nope | 22:30 |
mordred | corvus: I was waiting for the injest patches to land before moving forward | 22:30 |
corvus | pabelanger: ok. mordred: maybe you want to turn on your shade test? | 22:30 |
mordred | corvus: it's possible I didnt communicate that to anyone ... | 22:30 |
corvus | why is that a blocker? | 22:30 |
mordred | corvus: it's not - I just figured that scalability was one of the larger concerns and the injest patch changes the structure of how that works... | 22:31 |
mordred | corvus: BUT- can *totally* turn on the shade patch very easily and we can see how it goes | 22:31 |
pabelanger | yah, I think getting more data from shade patch works for me | 22:32 |
corvus | mordred: i'm not going to say 'no' to more data :) i say go for it whenever you're ready :) | 22:32 |
corvus | and hopefully we'll have the injest patch in next week too | 22:32 |
corvus | i'm far enough with the cross-source deps work (which is the next item on the list) to say i think we can have it landed in the next few days / end of week at latest. | 22:33 |
mordred | corvus: kk. I'll get that going | 22:33 |
corvus | so once that lands, we'll have some *really fun* things to test | 22:33 |
pabelanger | Yay | 22:33 |
corvus | mordred: istr you said your shade job could be used to verify the cross-source work as well? | 22:34 |
*** chhavi has joined #openstack-meeting-alt | 22:34 | |
corvus | mordred: also, i think you were 90% of the way through js tooling patches before the holidays -- i've added a patch to your series which we can use to validate that all the URLs that we expect to work do work | 22:36 |
Shrews | would that be the whole "changes to ansible openstack modules triggers shade tests and reporting" thing? b/c that would be exciting | 22:36 |
corvus | Shrews: yep | 22:36 |
* Shrews is giddy with excitement | 22:37 | |
*** dave-mccowan has quit IRC | 22:37 | |
corvus | mordred: so when you pick that up, we can test the three different ways of serving the webapp that we know about | 22:37 |
mordred | corvus: yup! | 22:37 |
mordred | (to all of the things) | 22:37 |
corvus | cool | 22:37 |
corvus | the nodepool static driver from tristanC is in review | 22:38 |
corvus | Shrews: are we running the finger gw in openstack prod now? | 22:38 |
Shrews | corvus: yes | 22:38 |
corvus | Shrews: \o/ | 22:38 |
pabelanger | Oh, nice! | 22:38 |
*** chhavi has quit IRC | 22:38 | |
Shrews | finger UUID@zuulv3.openstack.org works | 22:39 |
clarkb | I think we are still running the executors on a low port right? | 22:39 |
pabelanger | are we at a point to remove root user from zuul-executor now? | 22:39 |
Shrews | pabelanger: yes | 22:39 |
corvus | Shrews: do you want to delete all the special user handling code from the executors, and have them serve finger on port XX79 by default? | 22:39 |
pabelanger | Shrews: awesome | 22:39 |
Shrews | corvus: sure | 22:39 |
Shrews | i love deleting code | 22:39 |
corvus | Shrews: cool, i think that's probably the last thing there and we can clear that from the list | 22:39 |
corvus | pabelanger, leifmadsen_: ^ fyi quickstart docs change :) | 22:39 |
pabelanger | corvus: ++ | 22:40 |
corvus | as mentioned, jlk is working on getting github3.py released... | 22:40 |
corvus | and finally, clarkb put 2 new things on the list about secrets and branches | 22:40 |
clarkb | these came out of the zuulv3-issues etherpad | 22:41 |
*** kumarmn has quit IRC | 22:41 | |
clarkb | my understanding of this is that without fixing this you cannot use the same secret name on different branches? | 22:41 |
*** TxGirlGeek has quit IRC | 22:41 | |
clarkb | which seems like something we should fix | 22:41 |
*** kumarmn has joined #openstack-meeting-alt | 22:42 | |
clarkb | I want to say it was kolla that ran into this and they worked around it by using different names | 22:42 |
corvus | clarkb: yeah, i agree these seem like release-blocking bugs | 22:42 |
corvus | okay. that's the list. i won't go through it again next meeting, but i thought it would be good to reset after the holiday break. | 22:43 |
corvus | #topic RAM governor for the executors | 22:44 |
*** openstack changes topic to "RAM governor for the executors (Meeting topic: zuul)" | 22:44 | |
corvus | dmsimard: i think this is your topic? | 22:44 |
*** hongbin has quit IRC | 22:45 | |
corvus | dmsimard: lemme know when you're back | 22:46 |
corvus | #topic mailing lists | 22:46 |
*** openstack changes topic to "mailing lists (Meeting topic: zuul)" | 22:46 | |
*** kumarmn has quit IRC | 22:46 | |
*** TxGirlGeek has joined #openstack-meeting-alt | 22:46 | |
corvus | i'll send out an email about this, but while (most of us) are here... we should now have the infrastructure in place to host mailing lists at lists.zuul-ci.org | 22:47 |
corvus | i would like to have a zuul-announce list, where we make release announcements and notifications about changes to job syntax/deprecation/etc (which will be important for things like the shared zuul-jobs repo) | 22:47 |
SpamapS | +1 | 22:48 |
corvus | and obviously, we need at least one other list for discussion... should we create a zuul-discuss list? or a zuul-dev list? or both? | 22:48 |
mordred | I kind of think both | 22:48 |
corvus | (ie, do we need a dev/other split, or can we start without that and just have a combined list?) | 22:48 |
pabelanger | zuul-discuss for end user support? | 22:48 |
mordred | corvus: but I could see starting with zuul-discuss and splitting a zuul-dev later if it gets too much for people | 22:49 |
* fungi returns early and catches up | 22:49 | |
pabelanger | what about zuul-users | 22:50 |
clarkb | I really don't like the dev/general split we have for openstack | 22:50 |
clarkb | and also ops. | 22:50 |
clarkb | It creates a ton of cross posting confusion and also easy ways to ignore important threads | 22:50 |
corvus | there's a lot of overlap -- any dev work we do will affect users and could benefit from general discussion, so for that, i like having one list. i don't want people to feel like they're "bothering the devs" though if they have questions like "how should i write a job that does ..." | 22:50 |
mordred | corvus: yes - those are both sides of my thoughts :) | 22:51 |
mordred | I think there are at *least* 3 personas "I am running a zuul" "I am writing jobs for a zuul" and "I am developing zuul" - many of us here are all three | 22:52 |
corvus | i feel like maybe it's safer to start with one, and create more if needed -- so maybe we should have "zuul-announce" and "zuul-discuss" for now? | 22:52 |
mordred | wfm | 22:52 |
clarkb | sounds good | 22:52 |
pabelanger | sure | 22:52 |
*** TxGirlGeek has quit IRC | 22:53 | |
corvus | ok, i'll email the infra list with that as a proposal, get feedback from folks not here ("we decided in irc what the mailing lists should be!" is especially ironic), then make lists in a day or 2. | 22:53 |
corvus | #topic open discussion | 22:53 |
*** openstack changes topic to "open discussion (Meeting topic: zuul)" | 22:53 | |
SpamapS | I had one question come into my mind this last week | 22:54 |
*** kumarmn has joined #openstack-meeting-alt | 22:54 | |
mordred | corvus: mentioned in #openstack-infra, but as a followup from earlier, https://review.openstack.org/#/q/topic:turn-on-ansible has the patches to start running stuff on ansible patches | 22:54 |
clarkb | https://etherpad.openstack.org/p/zuulv3-issues is almost cleared out of active items. I've marked things as fixed that were fixed, gotten a few things fixed that weren't, and filed bugs for items that need longer term tracking | 22:54 |
corvus | mordred: thx | 22:54 |
SpamapS | IIRC we had some kind of plan to merge feature/zuulv3 into master before the 3.0 release. I don't recall what the prereqs for that were. | 22:55 |
clarkb | it would be great if everyone could take a look over that and make sure their items are accurate and possibly open bugs for them if they need longer term tracking | 22:55 |
clarkb | then I can unpin the tab in my browser :) | 22:55 |
clarkb | SpamapS: we need to update the puppet-openstackci deployment tooling to handle master as v3 | 22:55 |
*** david-lyle has joined #openstack-meeting-alt | 22:55 | |
corvus | SpamapS: yes! it's still imminent -- we want to land something to puppet-openstackci like https://review.openstack.org/523951 first | 22:55 |
corvus | so that we don't introduce zuulv3 to the world of openstack third-party ci ops by automatically upgrading them | 22:56 |
SpamapS | Ok, just looking for targets of opportunity. :) | 22:56 |
SpamapS | but a puppeteer.. I am not | 22:56 |
corvus | afaik that's the only thing blocking that, as soon as it lands we'll merge | 22:56 |
corvus | and then i will need to unlearn 2 years of "git reset --hard origin/feature/zuulv3" | 22:57 |
clarkb | thats ok I always check out master first then have to switch to feature/zuuvl3 | 22:57 |
fungi | that'll unlearn itself pretty quickly when we delete the branch | 22:57 |
fungi | fatal: ambiguous argument 'origin/feature/zuulv3': unknown revision or path not in the working tree. | 22:58 |
*** slaweq has joined #openstack-meeting-alt | 22:58 | |
*** kumarmn has quit IRC | 22:59 | |
corvus | the stuff of dreams | 22:59 |
SpamapS | :-D | 23:00 |
corvus | time's up, thanks everyone! | 23:00 |
corvus | #endmeeting | 23:00 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 23:00 | |
openstack | Meeting ended Mon Jan 8 23:00:28 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 23:00 |
fungi | thanks! | 23:00 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/zuul/2018/zuul.2018-01-08-22.01.html | 23:00 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/zuul/2018/zuul.2018-01-08-22.01.txt | 23:00 |
openstack | Log: http://eavesdrop.openstack.org/meetings/zuul/2018/zuul.2018-01-08-22.01.log.html | 23:00 |
*** Shrews has left #openstack-meeting-alt | 23:00 | |
*** slaweq has quit IRC | 23:00 | |
*** gcb has joined #openstack-meeting-alt | 23:01 | |
*** chyka_ has joined #openstack-meeting-alt | 23:06 | |
*** kumarmn has joined #openstack-meeting-alt | 23:09 | |
*** chyka has quit IRC | 23:09 | |
*** jaypipes has quit IRC | 23:12 | |
*** david-lyle has quit IRC | 23:12 | |
*** david-lyle has joined #openstack-meeting-alt | 23:13 | |
*** chyka_ has quit IRC | 23:13 | |
*** chyka has joined #openstack-meeting-alt | 23:14 | |
*** TxGirlGeek has joined #openstack-meeting-alt | 23:14 | |
*** kumarmn has quit IRC | 23:20 | |
*** gcb has quit IRC | 23:20 | |
*** kumarmn has joined #openstack-meeting-alt | 23:21 | |
*** sambetts is now known as sambetts|afk | 23:22 | |
*** rmascena has quit IRC | 23:29 | |
*** kumarmn has quit IRC | 23:29 | |
*** chyka_ has joined #openstack-meeting-alt | 23:32 | |
*** chyka has quit IRC | 23:35 | |
*** felipemonteiro_ has quit IRC | 23:46 | |
*** kumarmn has joined #openstack-meeting-alt | 23:47 | |
*** chyka_ has quit IRC | 23:48 | |
*** chyka has joined #openstack-meeting-alt | 23:49 | |
*** kumarmn has quit IRC | 23:52 | |
*** kumarmn has joined #openstack-meeting-alt | 23:53 | |
*** Leo_m has quit IRC | 23:55 | |
*** chyka_ has joined #openstack-meeting-alt | 23:55 | |
*** chyka has quit IRC | 23:55 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!