Wednesday, 2017-01-04

jeblairShrews: yeah, i think you're right -- using DataWatcher we can probably drop the re-connect event queue stuff i just wrote :)00:21
jeblairmy initial stab at that looks promising; i just need to clean it up a bit before i push it up00:22
*** saneax is now known as saneax-_-|AFK00:42
openstackgerritJames E. Blair proposed openstack-infra/zuul: Re-submit node requests on ZooKeeper disconnect  https://review.openstack.org/41635701:03
jeblairShrews: considerably less code, and, I think, much more simple and self-contained.  thanks!  :)01:04
openstackgerritJames E. Blair proposed openstack-infra/zuul: Re-submit node requests on ZooKeeper disconnect  https://review.openstack.org/41635701:08
*** ianw is now known as ianw_pto02:07
*** jamielennox is now known as jamielennox|away03:51
*** jamielennox|away is now known as jamielennox03:59
openstackgerritJamie Lennox proposed openstack-infra/nodepool: Ensure env-vars are strings in config validate  https://review.openstack.org/41642704:02
*** saneax-_-|AFK is now known as saneax04:53
*** bhavik1 has joined #zuul06:07
*** bhavik1 has quit IRC06:34
*** Cibo_ has joined #zuul07:42
openstackgerritAndreas Jaeger proposed openstack-infra/zuul: Cloner: use zuul_url always when project set  https://review.openstack.org/38985107:58
openstackgerritAndreas Jaeger proposed openstack-infra/zuul: Cloner: add extra project test  https://review.openstack.org/38985207:58
*** saneax is now known as saneax-_-|AFK08:44
*** Cibo_ has quit IRC09:03
*** saneax-_-|AFK is now known as saneax09:03
*** hashar has joined #zuul09:19
*** rcarrillocruz has quit IRC10:49
*** bhavik1 has joined #zuul11:07
*** bhavik1 has quit IRC11:12
*** saneax is now known as saneax-_-|AFK11:23
*** openstackgerrit has quit IRC12:33
*** rcarrillocruz has joined #zuul13:03
*** bhavik1 has joined #zuul14:10
*** bhavik1 has quit IRC14:19
*** openstackgerrit has joined #zuul15:28
openstackgerritKevin Prettre proposed openstack-infra/zuul: Fix infinite loop when Gerrit close connection  https://review.openstack.org/41658615:28
pabelangerYay, tickets obtained for OpenStack PTG15:34
Shrewsabout that... jeblair, fungi: are there certain days assigned at PTG where zuulv3 things will be discussed where my attending might be useful?15:45
Shrewsi'd be willing to come for a day or two if there are discussions around it, but spending 5 days in Atlanta is not something I want to do15:47
fungiShrews: i have similar disdain for atlanta15:48
fungiShrews: infra's assigned days are monday and tuesday15:48
fungiso if you're looking to make it a short trip, those would be the two to target15:48
Shrewsfungi: it should have been held at Hilton Head  :)15:50
pabelangerYa, that's my plan too. Aim for monday and tuesday15:55
pabelangerwednesday - friday is day by day right now15:55
fungiShrews: so true15:58
*** pabelanger has quit IRC16:19
*** pabelanger has joined #zuul16:19
*** hashar has quit IRC17:05
openstackgerritJames E. Blair proposed openstack-infra/zuul: Re-submit node requests on ZooKeeper disconnect  https://review.openstack.org/41635717:11
SpamapSI quite enjoyed Hotlanta last time17:14
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Add getNodeRequest ZK API method  https://review.openstack.org/41667117:15
ShrewsSpamapS: you shut your mouth. we do not speak of last time17:16
Shrewsnever happened17:16
Shrewsjeblair: i chose to use the kazoo recipe for 671 ^^^. I quite liked the logic17:17
Shrewsand it still works with how you are putting items into the queue17:17
SpamapSusing kazoo recipes++17:18
ShrewsSpamapS: well, some of them have a big red warning flag not to use them  :)17:18
SpamapSOf course17:19
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Add getNodeRequest ZK API method  https://review.openstack.org/41667117:24
jeblairShrews: the recipe removes items from the queue, but we can not do that17:26
Shrewsjeblair: ugh17:27
Shrewsyeah, you're right17:27
Shrewswell, i can copy the code i guess17:27
Shrewsminus the delete() part17:27
jeblairShrews: well, i don't really think it's the same thing at all17:27
jeblairShrews: we just need to walk the queue in sorted order, then lock the request using the side-band lock17:28
Shrewsah right. we do need that locked17:29
Shrewsjeblair: from the spec, "If at any point Nodepool detects that the ephemeral request node has been deleted, it should return any allocated nodes to the pool."17:38
Shrewsjeblair: so, nodepool will not know that a request node has been deleted unless we set a watch on it (not specified in the spec, i don't think)17:39
Shrewsjeblair: also, the mapping of the node ids used for that request is gone once a request is deleted. how do we know what nodes to delete?17:40
*** bhavik1 has joined #zuul17:41
jeblairShrews: yeah, setting a watch is an option, or perhaps the thread that's handling the request could check on it at certain points during the process, or in the very edge case of it being deleted after fulfillment but before use, a periodic cleanup thread could handle it.17:41
*** bhavik1 has quit IRC17:42
Shrewsthat edge case is what i'm wondering about. we'd need to store the request ID with the nodes, i think17:43
jeblairShrews: re the second thing: the spec says that zuul should lock the nodes before deleting the request, so nodepool always has a way of determining if a request has been "abandoned" -- either the request is deleted (before node use), or the node locks vanish (after node use)17:43
jeblair(i'm writing the 'zuul locks nodes' bit right now)17:46
Shrewsk. i think i follow that bit better now after mapping it about my head17:47
*** bhavik1 has joined #zuul17:57
*** bhavik1 has quit IRC18:00
openstackgerritJames E. Blair proposed openstack-infra/zuul: Lock nodes when nodepool request is fulfilled  https://review.openstack.org/41670018:34
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Add ZK API methods for node requests  https://review.openstack.org/41667118:37
*** dmsimard has quit IRC19:35
*** dmsimard has joined #zuul19:35
*** pabelanger has quit IRC19:36
*** SotK has quit IRC19:36
*** adam_g has quit IRC19:36
*** bstinson has quit IRC19:36
*** Zara has quit IRC19:36
*** tristanC has quit IRC19:36
*** clarkb has quit IRC19:36
*** tristanC has joined #zuul19:36
*** bstinson has joined #zuul19:36
*** SotK has joined #zuul19:36
*** Zara has joined #zuul19:36
*** adam_g has joined #zuul19:36
*** pabelanger has joined #zuul19:36
*** clarkb has joined #zuul19:36
*** adam_g has quit IRC19:36
*** adam_g has joined #zuul19:36
*** hashar has joined #zuul20:29
openstackgerritJames E. Blair proposed openstack-infra/zuul: Lock nodes when nodepool request is fulfilled  https://review.openstack.org/41670020:39
*** hashar has quit IRC21:02
openstackgerritJames E. Blair proposed openstack-infra/zuul: Mark nodes as 'in-use' before launching jobs  https://review.openstack.org/41673721:18
openstackgerritJames E. Blair proposed openstack-infra/zuul: Return nodes after use  https://review.openstack.org/41673921:29
openstackgerritJames E. Blair proposed openstack-infra/zuul: Lock nodes when nodepool request is fulfilled  https://review.openstack.org/41670021:45
openstackgerritJames E. Blair proposed openstack-infra/zuul: Return nodes after use  https://review.openstack.org/41673921:45
openstackgerritJames E. Blair proposed openstack-infra/zuul: Mark nodes as 'in-use' before launching jobs  https://review.openstack.org/41673721:45
openstackgerritJames E. Blair proposed openstack-infra/zuul: Return nodes after use  https://review.openstack.org/41673921:49
openstackgerritJames E. Blair proposed openstack-infra/zuul: Mark nodes as 'in-use' before launching jobs  https://review.openstack.org/41673721:49
jheskethMorning21:50
*** openstack has joined #zuul22:56
*** jamielennox is now known as jamielennox|away23:11
*** jamielennox|away is now known as jamielennox23:14
openstackgerritJames E. Blair proposed openstack-infra/zuul: Lock nodes when nodepool request is fulfilled  https://review.openstack.org/41670023:29
openstackgerritJames E. Blair proposed openstack-infra/zuul: Return nodes after use  https://review.openstack.org/41673923:29
openstackgerritJames E. Blair proposed openstack-infra/zuul: Mark nodes as 'in-use' before launching jobs  https://review.openstack.org/41673723:29
openstackgerritJames E. Blair proposed openstack-infra/zuul: Copy nodeset when making node requests  https://review.openstack.org/41677223:29
openstackgerritJames E. Blair proposed openstack-infra/zuul: Lock nodes when nodepool request is fulfilled  https://review.openstack.org/41670023:45
openstackgerritJames E. Blair proposed openstack-infra/zuul: Return nodes after use  https://review.openstack.org/41673923:45
openstackgerritJames E. Blair proposed openstack-infra/zuul: Mark nodes as 'in-use' before launching jobs  https://review.openstack.org/41673723:45
openstackgerritJames E. Blair proposed openstack-infra/zuul: Copy nodeset when making node requests  https://review.openstack.org/41677223:45

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!