Monday, 2017-03-06

openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Merge branch 'master' into feature/zuulv3  https://review.openstack.org/44173102:31
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Merge branch 'master' into feature/zuulv3  https://review.openstack.org/44173102:38
openstackgerritJoshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Merge branch 'master' into feature/zuulv3  https://review.openstack.org/44173102:42
openstackgerritMerged openstack-infra/zuul feature/zuulv3: A couple small test improvements  https://review.openstack.org/43759202:47
*** abregman has joined #zuul06:15
*** bhavik1 has joined #zuul06:50
*** saneax-_-|AFK is now known as saneax06:55
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Correct the quota/availability algorithm  https://review.openstack.org/44078007:04
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Only use ready nodes from the same provider.  https://review.openstack.org/44127007:06
*** Cibo has joined #zuul07:40
*** Cibo has quit IRC07:44
*** Cibo has joined #zuul07:52
*** Cibo has quit IRC08:08
*** isaacb has joined #zuul09:04
*** abregman is now known as abregman|mtg09:42
*** abregman|mtg has quit IRC09:42
*** abregman has joined #zuul09:44
*** Cibo has joined #zuul10:25
*** abregman has quit IRC10:29
*** bhavik1 has quit IRC10:29
*** openstackgerrit has quit IRC10:33
*** abregman has joined #zuul10:42
*** Cibo has quit IRC11:07
*** isaacb has quit IRC11:29
*** Cibo has joined #zuul11:55
*** isaacb has joined #zuul12:08
*** Cibo has quit IRC12:11
*** Cibo has joined #zuul12:13
*** GK_1wm__SU has joined #zuul12:22
*** GK_1wm__SU has quit IRC12:28
Shrewsjhesketh: morning! saw your comment on 441470, but afraid I'm not following (probably due to lack of coffee and being Monday)12:43
Shrewsi want to tweak that algorithm a bit anyway, so expect another patchset12:44
Shrewsresponded inline12:49
*** jamielennox is now known as jamielennox|away12:50
*** abregman has quit IRC12:59
*** abregman has joined #zuul13:00
*** abregman is now known as abregman|mtg13:03
*** Cibo has quit IRC13:06
*** isaacb has quit IRC13:08
*** openstackgerrit has joined #zuul13:17
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Group nodes by availability zone  https://review.openstack.org/44147013:17
Shrewsjhesketh: jeblair: ^^^ I tweaked the AZ grouping algorithm slightly to guarantee we use nodes from the READY node pool13:18
Shrewsdescribed in the commit message13:19
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Group nodes by availability zone  https://review.openstack.org/44147013:21
Shrewsugh, that's wrong13:24
mordredShrews: your face is wrong13:26
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Group nodes by availability zone  https://review.openstack.org/44147013:28
Shrewsmordred: i know, i know13:28
Shrewsbut that patch set is right13:29
* Shrews now coffees13:29
*** abregman|mtg has quit IRC13:31
openstackgerritAlexander Evseev proposed openstack-infra/zuul master: Use ssh-agent instead of ugly ssh-wrapper scripts  https://review.openstack.org/33114813:33
*** hashar has joined #zuul13:39
*** abregman|mtg has joined #zuul13:43
*** Cibo has joined #zuul13:45
*** abregman|mtg has quit IRC14:04
*** isaacb has joined #zuul14:17
*** abregman|mtg has joined #zuul14:19
*** Cibo has quit IRC14:19
*** Cibo has joined #zuul14:22
*** saneax is now known as saneax-_-|AFK15:09
*** Cibo has quit IRC15:16
*** Cibo has joined #zuul15:18
*** Cibo has quit IRC15:58
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Use devstack's zookeeper support  https://review.openstack.org/44120916:10
pabelangermorning16:12
*** bhavik1 has joined #zuul16:16
openstackgerritCullen Taylor proposed openstack-infra/zuul feature/zuulv3: Re-enable test_tags  https://review.openstack.org/43985816:44
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Fix comment about AZ selection  https://review.openstack.org/44202916:44
pabelangerShrews: woah, I think we are having a zk issue on zuulv3-dev.o.o.16:45
pabelangerShrews: http://paste.openstack.org/show/601610/16:45
pabelangerjeblair: ^^might be interested16:45
pabelangerit is spamming the log now16:46
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Merge branch 'master' into feature/zuulv3  https://review.openstack.org/44173116:46
jeblairfascinating!16:46
Shrewspabelanger: neat!16:46
jeblairmaybe this is an idle timeout, and nodepool is chatty enough with zk that this doesn't happen there, but when we leave zuul idle over the weekend, it does time out?16:47
Shrewsis the zk server available?16:47
Shrewsjeblair: ah, likely. but, you'd think it would reconnect16:48
jeblairoh, nl01 is reporting the same error16:48
jeblairnb01: http://paste.openstack.org/show/601615/16:49
Shrewswow16:50
pabelangerwas AFK, haven't looked at nl0116:50
jeblairsame on nb0216:50
jeblair2017-03-06 16:43:35,103 [myid:] - ERROR [main:ZooKeeperServer@272] - Severe unrecoverable error, exiting16:50
jeblairjava.io.IOException: No space left on device16:50
pabelangereep16:50
jeblairthat splains that.  :)16:50
Shrewsi cannot connect from nodepool.o.o16:51
Shrewsoh, yeah16:51
Shrews:)16:51
jeblairlet's take this over to #openstack-infra16:51
pabelangerI just deleted some qcow2 images from my home folder16:51
pabelanger++16:51
SpamapSis anyone else a little bit terrified that this exists? https://github.com/coreos/zetcd#zetcd16:55
*** abregman|mtg has quit IRC16:55
*** hashar is now known as hasharErrand16:58
ShrewsSpamapS: yes16:59
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Suspend NodeCleanupWorker on ZK suspension  https://review.openstack.org/44204217:03
*** mgagne_ has quit IRC17:05
*** mgagne_ has joined #zuul17:05
openstackgerritMerged openstack-infra/nodepool master: Clarification about the rate parameter  https://review.openstack.org/43699317:23
openstackgerritMerged openstack-infra/nodepool master: Fix potential race in image upload cleanup  https://review.openstack.org/43493417:30
Shrewsmordred: can i persuade you to take a gander at https://review.openstack.org/441470 today? i'll give you alcohols17:34
jeblairShrews: ethyl or methyl?17:34
Shrewsjeblair: isopropyl17:35
jeblairoof17:35
Shrewspabelanger could grab it, too. whomever.  :)17:37
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Merge branch 'master' into feature/zuulv3  https://review.openstack.org/44173117:40
*** isaacb has quit IRC17:52
*** hasharErrand has quit IRC18:02
dmsimard-9k lines, wow :P18:05
jeblairi don't know how to read those in merge commits; i don't know how well that maps to our ideas of what's going on.  :/18:08
*** bhavik1 has quit IRC18:17
*** hashar has joined #zuul18:25
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Remove spurious with from comment  https://review.openstack.org/44210718:43
mordredjeblair: started reviewing the 440760 stack - there was a comment thing on the first patchset - which I decided to just push a follow up patch for18:44
jeblairmordred: thx +318:46
mordredjeblair: also, jhesketh has comments on https://review.openstack.org/#/c/43594818:49
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Report layout config errors for config repos  https://review.openstack.org/44076018:49
jeblairmordred: good suggestion; i'll pull that one out and put it at the end when i redo it.  :)18:54
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Catch gear.InterruptedError  https://review.openstack.org/44078918:55
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Switch to yaml.safe_load  https://review.openstack.org/44128518:55
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Report YAML parse errors  https://review.openstack.org/44128618:56
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Port SQLAlchemy reporter to v3 driver structure  https://review.openstack.org/44211418:57
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Remove spurious with from comment  https://review.openstack.org/44210719:03
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Port SQLAlchemy reporter to v3 driver structure  https://review.openstack.org/44211419:09
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Move alembic into sql driver  https://review.openstack.org/44212419:18
jeblairit is not fun having to remember to run 'git review -R' on child changes underneath a merge commit19:18
mordredjeblair: merge commits are weird19:34
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add missing pauses in reconfiguration tests  https://review.openstack.org/44213619:37
jeblairthat ^ fixes a spurious test failure19:37
jeblairmordred: can you fast-approve so it doesn't block any merges?19:38
pabelangerShrews: +2 on 44147019:40
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Group nodes by availability zone  https://review.openstack.org/44147019:44
mordredjeblair: yup19:45
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Fix comment about AZ selection  https://review.openstack.org/44202919:45
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Suspend NodeCleanupWorker on ZK suspension  https://review.openstack.org/44204219:45
mordredjeblair: done19:45
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Add missing pauses in reconfiguration tests  https://review.openstack.org/44213620:01
*** Cibo has joined #zuul20:46
*** jamielennox|away is now known as jamielennox21:00
*** pabelanger has quit IRC21:14
*** pabelanger has joined #zuul21:14
*** Cibo has quit IRC21:18
jeblairpabelanger: fyi i replaced 'zuul ansible running' with 'zuul sample jobs' in the status updates portion of the zuul meeting.  hope that's okay.  :)21:23
pabelangerjeblair: WFM21:25
jeblairpabelanger: iirc, you were going to make two competing tox job definitions for us to discuss... can you point me at those?21:28
pabelangerjeblair: right, I haven't created the 2nd one yet.  I can quickly do that now and WIP the patch21:29
jeblairpabelanger: was the other going to use zuul job 'vars' to set the role for tox?21:30
pabelangerjeblair: right21:31
pabelangerjeblair: 438281,11 was the example of using vars in .zuul.yaml. Single playbook, and latest 438281 is per job playbooks21:32
jeblairpabelanger: right; i'd like both things to be a change so that we can refine both of them in parallel and then merge the best approach.21:32
jeblairpabelanger: also, please see my comment in 438281,12 and ,23 on the word 'eventlist'21:33
pabelangerjeblair: yes, a typo. I'll adjust in a moment.21:36
pabelangerjeblair: as for both approaches, I can update 438281 to do that, if that is what you are suggesting21:36
jeblairpabelanger: no, i'm suggesting *two* separate changes in gerrit.21:37
pabelangerack21:37
jeblairwe're only going to merge one of them.21:38
jeblairbut they should each get the opportunity to represent the best of both approaches.21:38
openstackgerritPaul Belanger proposed openstack-infra/zuul feature/zuulv3: Add generic tox job  https://review.openstack.org/44218021:43
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Provide file locations of config syntax errors  https://review.openstack.org/44160621:46
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove unused mergeChangeQueue method  https://review.openstack.org/43595021:46
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Use hostname in Nodepool requests  https://review.openstack.org/43594921:46
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Clarify Job/Build/BuildSet docstrings  https://review.openstack.org/43594821:46
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add a test for a broken config on startup  https://review.openstack.org/44149921:46
pabelangerjeblair: I'll hold off on patching eventlist (spamming) on 438281 until we decide how to move forward21:47
pabelanger442180 is the alternate patch21:48
jeblairpabelanger: well, what i'm trying to get going here is that we refine *both* things in parallel so they represent the best of both approaches.  that doesn't work if we hold off on making one better.21:48
jeblairpabelanger: so if you're worried about the spamming, maybe just don't update the child patches yet?21:48
pabelangerjeblair: sure, I can do that too21:49
openstackgerritPaul Belanger proposed openstack-infra/zuul feature/zuulv3: Add generic tox job  https://review.openstack.org/43828121:52
SpamapSreminder, Zuul meeting in 521:55
jheskethMorning21:57
jeblairjhesketh: morning!  thanks for the merge commit!  i pushed up a revision to 441731 and two more changes on top of it21:59
jheskethjeblair: no worries. I'm reworking the sql driver too. Should have that today22:00
jeblairjhesketh: oh, er, that was one of the things i added :|22:00
jeblairjhesketh: sorry...22:00
jheskethOh that's cool22:01
jheskethI'll take a look after the meeting22:01
jeblaircool, thanks.  i hope i didn't step on your toes too hard22:01
jeblairzuul meeting now in #openstack-meeting-alt22:01
jheskethjeblair: all good :-)22:02
Shrewspabelanger: stopping nodepool-launcher on nl01... k?22:20
pabelangerShrews: ++22:21
Shrewspabelanger: does infracloud-chocolate have AZs?22:35
Shrewsif so, we need to add those to nodepool.yaml22:35
Shrewsfor nl0122:36
pabelangerShrews: no, we don't have them enabled22:36
Shrewspabelanger: ok. was hoping to see the new AZ grouping in action.22:37
Shrewsbut if there are no AZs...22:38
pabelangerShrews: I should say, we have the default settings.22:38
pabelangerbut, we could update them22:38
SpamapSjeblair: yeah searching for openstack-infra/zuul + tag:low-hanging-fruit is effectively the same thing for now23:00
jeblairSpamapS: yes.  will also need to search for nodepool.  right this moment though, the only lhf nodepool task is also on zuul, so we lucked out.  :)23:01
SpamapSjeblair: I think this is worth driving into storyboard23:03
SpamapSshould be relatively straight forward to achieve23:03
jeblairSpamapS: agreed on the first part.  on the second, i don't know if it's a client or server side limitation.... (that has very different implications on simplicity for me)23:04
SpamapStrue23:04
SpamapSIt's most likely both23:05
SpamapSbut if we can fix server side at least we can publish a list of links somewhere until the client side works23:05
jeblairjhesketh: unless you object, i'm going to take your affirmative comment on 441731 (the merge commit) as permission to merge23:05
jheskethjeblair: yep, please do23:05
jheskethjust looking at your subsequent changes23:06
jeblairjhesketh: cool, thx23:06
Shrewsjhesketh: thx for the nodepool reviews23:08
jheskethno worries :-)23:09
openstackgerritPaul Belanger proposed openstack-infra/zuul feature/zuulv3: Add generic tox job  https://review.openstack.org/44218023:11
Shrewsjeblair: https://review.openstack.org/435949 makes me sad we have divergent model classes. That new field could be useful in nodepool logs, too23:12
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Merge branch 'master' into feature/zuulv3  https://review.openstack.org/44173123:13
* Shrews hears the dinner bell23:14
*** hashar has quit IRC23:15
pabelangerjeblair: Shrews: at this point, I think I'm ready to be pointed into the next direction, at least until we decided on the zuulv3-ansible topic.23:16
pabelangergoing to checkout storyboard for items still assigned to me, but willing to take direction too23:17
jeblairpabelanger: what do you think about mentioning the tox jobs at the infra meeting and get some more folks to weigh in on it?23:18
pabelangerjeblair: great idea23:19
*** saneax-_-|AFK is now known as saneax23:21
jeblairjhesketh: if you have some more time, there are changes at 435944 that could use some review23:45
jheskethsure23:46
jheskethjeblair: I've got a comment on the first two23:50
SpamapSoh wow23:53
SpamapSstoryboard uses FULLTEXT23:54
SpamapSweird23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!