| *** matsuhashi has joined #openstack-infra | 00:01 | |
| *** Guest41065 is now known as StevenK | 00:06 | |
| *** e0ne has joined #openstack-infra | 00:17 | |
| *** CaptTofu has joined #openstack-infra | 00:18 | |
| *** adalbas has quit IRC | 00:26 | |
| *** ildikov_ has joined #openstack-infra | 00:29 | |
| *** fifieldt has joined #openstack-infra | 00:30 | |
| *** ildikov has quit IRC | 00:31 | |
| *** shakamunyi has joined #openstack-infra | 00:31 | |
| *** shakamunyi has quit IRC | 00:37 | |
| *** adalbas has joined #openstack-infra | 00:42 | |
| *** mestery has joined #openstack-infra | 00:48 | |
| openstackgerrit | David Pursehouse proposed a change to openstack-infra/jenkins-job-builder: Add support for multiple Gerrit servers in Gerrit trigger https://review.openstack.org/86843 | 00:53 |
|---|---|---|
| *** wchrisj has joined #openstack-infra | 00:56 | |
| *** unicell has joined #openstack-infra | 00:57 | |
| *** ildikov has joined #openstack-infra | 00:59 | |
| *** mriedem1 has quit IRC | 01:01 | |
| *** ildikov_ has quit IRC | 01:01 | |
| *** mriedem has joined #openstack-infra | 01:05 | |
| *** nati_ueno has joined #openstack-infra | 01:12 | |
| *** derekh has quit IRC | 01:15 | |
| *** ianw has quit IRC | 01:16 | |
| *** ianw has joined #openstack-infra | 01:16 | |
| *** CaptTofu has quit IRC | 01:29 | |
| *** CaptTofu has joined #openstack-infra | 01:29 | |
| *** wchrisj has quit IRC | 01:32 | |
| *** yaguang has joined #openstack-infra | 01:36 | |
| *** nosnos has joined #openstack-infra | 01:41 | |
| *** saschpe has quit IRC | 01:42 | |
| *** slagle has joined #openstack-infra | 01:43 | |
| *** saschpe has joined #openstack-infra | 01:43 | |
| openstackgerrit | David Pursehouse proposed a change to openstack-infra/jenkins-job-builder: Add support for triggering on unreviewed patches https://review.openstack.org/87152 | 01:45 |
| *** miqui has joined #openstack-infra | 01:53 | |
| *** e0ne has quit IRC | 02:01 | |
| *** mriedem has quit IRC | 02:04 | |
| *** dstanek has quit IRC | 02:14 | |
| *** nati_ueno has quit IRC | 02:21 | |
| *** dstanek has joined #openstack-infra | 02:22 | |
| *** e0ne has joined #openstack-infra | 02:27 | |
| *** jcoufal has quit IRC | 02:28 | |
| *** e0ne has quit IRC | 02:30 | |
| *** e0ne_ has joined #openstack-infra | 02:30 | |
| *** pcrews__ has joined #openstack-infra | 02:33 | |
| *** CaptTofu has quit IRC | 02:35 | |
| *** CaptTofu has joined #openstack-infra | 02:35 | |
| *** coolsvap|afk is now known as coolsvap | 02:38 | |
| *** amotoki has quit IRC | 02:38 | |
| *** CaptTofu has quit IRC | 02:40 | |
| *** zhiyan_ is now known as zhiyan | 02:41 | |
| *** Longgeek has joined #openstack-infra | 02:48 | |
| *** adalbas has quit IRC | 02:51 | |
| *** talluri has quit IRC | 03:14 | |
| *** nati_ueno has joined #openstack-infra | 03:23 | |
| *** asettle is now known as alex-lunch | 03:29 | |
| *** matsuhashi has quit IRC | 03:31 | |
| *** nati_ueno has quit IRC | 03:35 | |
| *** CaptTofu has joined #openstack-infra | 03:36 | |
| *** pcrews__ has quit IRC | 03:40 | |
| *** CaptTofu has quit IRC | 03:40 | |
| *** aconrad has joined #openstack-infra | 03:47 | |
| *** nosnos has quit IRC | 03:49 | |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Allow zuul-server to run a merger process https://review.openstack.org/86498 | 03:49 |
| *** nati_ueno has joined #openstack-infra | 03:50 | |
| *** talluri has joined #openstack-infra | 04:03 | |
| *** nati_ueno has quit IRC | 04:05 | |
| *** zhiyan is now known as zhiyan_ | 04:07 | |
| *** alex-lunch is now known as asettle | 04:13 | |
| *** thuc has joined #openstack-infra | 04:19 | |
| *** msabramo has joined #openstack-infra | 04:20 | |
| *** thuc_ has joined #openstack-infra | 04:20 | |
| *** aconrad has quit IRC | 04:24 | |
| *** thuc has quit IRC | 04:24 | |
| *** e0ne_ has quit IRC | 04:27 | |
| *** Ryan_Lane has joined #openstack-infra | 04:30 | |
| *** matsuhashi has joined #openstack-infra | 04:38 | |
| *** nosnos has joined #openstack-infra | 04:48 | |
| *** thuc_ has quit IRC | 04:51 | |
| *** chandan_kumar has joined #openstack-infra | 04:52 | |
| *** thuc has joined #openstack-infra | 04:52 | |
| *** thuc has quit IRC | 04:56 | |
| *** ildikov has quit IRC | 04:58 | |
| *** medieval1 has quit IRC | 05:11 | |
| *** skraynev_afk is now known as skraynev | 05:12 | |
| Longgeek | https://bugs.launchpad.net/openstack-ci/+bug/1306967 | 05:19 |
| uvirtbot | Launchpad bug 1306967 in openstack-ci "thstack-ci service account" [Undecided,New] | 05:19 |
| *** CaptTofu has joined #openstack-infra | 05:24 | |
| *** CaptTofu has quit IRC | 05:29 | |
| *** unicell has quit IRC | 05:31 | |
| *** om has joined #openstack-infra | 05:35 | |
| *** nosnos_ has joined #openstack-infra | 05:36 | |
| *** nosnos has quit IRC | 05:36 | |
| *** unicell has joined #openstack-infra | 05:40 | |
| *** nati_ueno has joined #openstack-infra | 05:42 | |
| *** zhiyan_ is now known as zhiyan | 05:43 | |
| *** zul has quit IRC | 05:46 | |
| zaro | rcarrillocruz: gerrit upgrade is scheduled for may 1st-7th. | 05:55 |
| *** nati_ueno has quit IRC | 05:56 | |
| *** ildikov has joined #openstack-infra | 05:58 | |
| *** matsuhas_ has joined #openstack-infra | 06:00 | |
| *** zul has joined #openstack-infra | 06:00 | |
| *** thuc has joined #openstack-infra | 06:03 | |
| *** matsuhashi has quit IRC | 06:03 | |
| *** thuc has quit IRC | 06:08 | |
| rcarrillocruz | k, thx zaro | 06:08 |
| *** afazekas has joined #openstack-infra | 06:12 | |
| *** unicell has quit IRC | 06:12 | |
| *** skolekonov has joined #openstack-infra | 06:13 | |
| *** unicell has joined #openstack-infra | 06:22 | |
| *** Ryan_Lane has quit IRC | 06:23 | |
| *** amotoki has joined #openstack-infra | 06:24 | |
| *** nosnos has joined #openstack-infra | 06:32 | |
| *** nosnos_ has quit IRC | 06:32 | |
| *** _nadya_ has joined #openstack-infra | 06:34 | |
| *** msabramo has quit IRC | 06:36 | |
| *** matsuhas_ has quit IRC | 06:37 | |
| *** matsuhashi has joined #openstack-infra | 06:37 | |
| *** matsuhashi has quit IRC | 06:37 | |
| *** matsuhashi has joined #openstack-infra | 06:38 | |
| *** sdake_ has joined #openstack-infra | 06:41 | |
| *** sdake_ has quit IRC | 06:41 | |
| *** sdake_ has joined #openstack-infra | 06:41 | |
| *** e0ne has joined #openstack-infra | 06:42 | |
| *** _sweston_ has joined #openstack-infra | 06:45 | |
| *** _nadya_ has quit IRC | 06:46 | |
| *** _sweston_ has quit IRC | 06:49 | |
| *** sweston has joined #openstack-infra | 06:49 | |
| *** mrmartin has joined #openstack-infra | 07:06 | |
| *** milki has quit IRC | 07:08 | |
| *** andreaf has joined #openstack-infra | 07:08 | |
| *** e0ne_ has joined #openstack-infra | 07:11 | |
| *** CaptTofu has joined #openstack-infra | 07:12 | |
| *** e0ne has quit IRC | 07:14 | |
| *** jgallard has joined #openstack-infra | 07:17 | |
| *** CaptTofu has quit IRC | 07:17 | |
| *** flaper87|afk is now known as flaper87 | 07:17 | |
| *** dizquierdo has joined #openstack-infra | 07:17 | |
| *** reed has joined #openstack-infra | 07:17 | |
| *** yolanda_ has joined #openstack-infra | 07:17 | |
| *** jamielennox is now known as jamielennox|away | 07:18 | |
| *** jcoufal has joined #openstack-infra | 07:22 | |
| *** e0ne_ has quit IRC | 07:32 | |
| *** e0ne has joined #openstack-infra | 07:33 | |
| *** asettle has quit IRC | 07:35 | |
| *** rallegre has joined #openstack-infra | 07:37 | |
| *** e0ne has quit IRC | 07:37 | |
| *** talluri has quit IRC | 07:42 | |
| *** e0ne has joined #openstack-infra | 07:43 | |
| *** matrohon has joined #openstack-infra | 07:44 | |
| *** rallegre has quit IRC | 07:46 | |
| *** ihrachyshka has joined #openstack-infra | 07:53 | |
| *** morganfainberg is now known as morganfainberg_Z | 08:00 | |
| *** ildikov_ has joined #openstack-infra | 08:02 | |
| *** rallegre has joined #openstack-infra | 08:02 | |
| *** praneshp has quit IRC | 08:04 | |
| *** yassine has joined #openstack-infra | 08:04 | |
| *** ihrachyshka has quit IRC | 08:05 | |
| *** ildikov has quit IRC | 08:05 | |
| *** ihrachyshka has joined #openstack-infra | 08:05 | |
| *** simonluo has joined #openstack-infra | 08:09 | |
| *** jpich has joined #openstack-infra | 08:10 | |
| *** mrda is now known as mrda_away | 08:14 | |
| rcarrillocruz | zaro: the gerrit upgrade raises a question on two bugs i was working on | 08:15 |
| rcarrillocruz | one of them there's already a change for it | 08:15 |
| *** alexpilotti has joined #openstack-infra | 08:16 | |
| rcarrillocruz | should I rewrite the code to make it work with the current gerrit and with gerrit 2.8? | 08:16 |
| rcarrillocruz | or should I dump the code and make it work with just 2.8 since it will be released in two weeks ( and await for testing/reviews then) | 08:17 |
| rcarrillocruz | ? | 08:17 |
| rcarrillocruz | in Gerrit 2.8, the change-abandoned hook passes the --commit argument, whereas on current review.openstack.org gerrit does not, so I had to write a method to pull that info from the gerritdb | 08:19 |
| *** talluri has joined #openstack-infra | 08:24 | |
| *** ildikov has joined #openstack-infra | 08:25 | |
| *** dizquierdo has quit IRC | 08:25 | |
| *** jooools has joined #openstack-infra | 08:28 | |
| *** ildikov_ has quit IRC | 08:28 | |
| *** achuprin_ has joined #openstack-infra | 08:29 | |
| reed | hello | 08:30 |
| *** achuprin has quit IRC | 08:31 | |
| *** ominakov has joined #openstack-infra | 08:31 | |
| *** talluri_ has joined #openstack-infra | 08:33 | |
| *** talluri has quit IRC | 08:35 | |
| *** che-arne has joined #openstack-infra | 08:39 | |
| rcarrillocruz | from the refs/changes/ git log rather than DB, sorry | 08:41 |
| *** rallegre has quit IRC | 08:56 | |
| *** rallegre has joined #openstack-infra | 08:58 | |
| *** jlibosva has joined #openstack-infra | 08:58 | |
| *** CaptTofu has joined #openstack-infra | 09:00 | |
| *** pblaho has joined #openstack-infra | 09:03 | |
| *** CaptTofu has quit IRC | 09:05 | |
| *** talluri_ has quit IRC | 09:06 | |
| *** fbo_away is now known as fbo | 09:18 | |
| *** katyafervent_awa is now known as katyafervent | 09:20 | |
| *** derekh has joined #openstack-infra | 09:21 | |
| *** jp_at_hp has joined #openstack-infra | 09:25 | |
| *** zehicle has quit IRC | 09:28 | |
| *** zhiyan is now known as zhiyan_ | 09:30 | |
| *** jp_at_hp has quit IRC | 09:34 | |
| *** rallegre has quit IRC | 09:35 | |
| *** StevenK has quit IRC | 09:44 | |
| *** JoshNang has quit IRC | 09:46 | |
| *** soren has quit IRC | 09:46 | |
| *** spredzy has quit IRC | 09:46 | |
| *** soren has joined #openstack-infra | 09:47 | |
| *** spredzy has joined #openstack-infra | 09:47 | |
| *** JoshNang has joined #openstack-infra | 09:48 | |
| *** yassine has quit IRC | 09:48 | |
| *** jp_at_hp has joined #openstack-infra | 09:52 | |
| *** dizquierdo has joined #openstack-infra | 09:56 | |
| *** rallegre has joined #openstack-infra | 09:59 | |
| *** rallegre has quit IRC | 10:03 | |
| *** rallegre has joined #openstack-infra | 10:08 | |
| *** fbo is now known as fbo_away | 10:10 | |
| *** sahumada has quit IRC | 10:12 | |
| *** rallegre has quit IRC | 10:12 | |
| *** sahumada has joined #openstack-infra | 10:12 | |
| *** jgallard has quit IRC | 10:16 | |
| *** ianw has quit IRC | 10:17 | |
| *** rallegre has joined #openstack-infra | 10:35 | |
| *** rallegre has quit IRC | 10:36 | |
| *** ihrachyshka has quit IRC | 10:36 | |
| *** matsuhashi has quit IRC | 10:40 | |
| *** matsuhashi has joined #openstack-infra | 10:41 | |
| *** CaptTofu has joined #openstack-infra | 10:46 | |
| *** david-lyle has joined #openstack-infra | 10:46 | |
| *** simonluo has quit IRC | 10:49 | |
| *** matsuhashi has quit IRC | 10:50 | |
| *** matsuhas_ has joined #openstack-infra | 10:52 | |
| *** coolsvap is now known as coolsvap|afk | 10:52 | |
| *** ihrachyshka has joined #openstack-infra | 10:53 | |
| *** Longgeek has quit IRC | 10:54 | |
| *** Longgeek has joined #openstack-infra | 10:54 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/devstack-gate: normalize the services for a post grizzly world https://review.openstack.org/84287 | 10:54 |
| *** chandan_kumar has quit IRC | 10:55 | |
| *** rallegre has joined #openstack-infra | 10:57 | |
| *** ihrachyshka has quit IRC | 10:57 | |
| *** rallegre has quit IRC | 10:58 | |
| *** Longgeek has quit IRC | 10:58 | |
| *** rallegre has joined #openstack-infra | 10:59 | |
| *** matsuhas_ has quit IRC | 11:00 | |
| *** yassine has joined #openstack-infra | 11:01 | |
| *** Longgeek has joined #openstack-infra | 11:01 | |
| *** rallegre has quit IRC | 11:03 | |
| *** matsuhas_ has joined #openstack-infra | 11:04 | |
| *** rallegre has joined #openstack-infra | 11:08 | |
| *** chandan_kumar has joined #openstack-infra | 11:08 | |
| *** slagle has quit IRC | 11:09 | |
| *** rallegre has quit IRC | 11:11 | |
| *** slagle has joined #openstack-infra | 11:11 | |
| *** CaptTofu has quit IRC | 11:15 | |
| *** matsuhas_ has quit IRC | 11:15 | |
| *** CaptTofu has joined #openstack-infra | 11:15 | |
| *** lcostantino has joined #openstack-infra | 11:15 | |
| *** chandan_kumar has quit IRC | 11:16 | |
| *** matsuhashi has joined #openstack-infra | 11:16 | |
| *** CaptTofu has quit IRC | 11:19 | |
| *** mbacchi has joined #openstack-infra | 11:21 | |
| *** Longgeek has quit IRC | 11:26 | |
| *** fbo_away is now known as fbo | 11:26 | |
| *** Shrews has joined #openstack-infra | 11:27 | |
| *** amotoki has quit IRC | 11:28 | |
| *** jhesketh has quit IRC | 11:29 | |
| *** weshay has joined #openstack-infra | 11:29 | |
| *** chandan_kumar has joined #openstack-infra | 11:30 | |
| *** weshay has quit IRC | 11:32 | |
| *** e0ne has quit IRC | 11:36 | |
| *** e0ne has joined #openstack-infra | 11:37 | |
| *** sandywalsh has joined #openstack-infra | 11:38 | |
| *** e0ne has quit IRC | 11:41 | |
| *** david-lyle has quit IRC | 11:41 | |
| *** yaguang has quit IRC | 11:44 | |
| *** matsuhashi has quit IRC | 11:46 | |
| *** StevenK has joined #openstack-infra | 11:48 | |
| sdague | fungi: it seems that nodepool in hp region-b still isn't getting the fedora x86_64 image. Any ideas there? | 11:49 |
| *** om has quit IRC | 11:50 | |
| *** om has joined #openstack-infra | 11:51 | |
| *** matsuhashi has joined #openstack-infra | 11:51 | |
| *** msabramo has joined #openstack-infra | 11:52 | |
| *** CaptTofu has joined #openstack-infra | 11:55 | |
| *** nosnos has quit IRC | 12:01 | |
| *** enikanorov has quit IRC | 12:04 | |
| *** enikanorov has joined #openstack-infra | 12:04 | |
| *** e0ne has joined #openstack-infra | 12:07 | |
| *** e0ne_ has joined #openstack-infra | 12:09 | |
| *** e0ne has quit IRC | 12:09 | |
| *** Longgeek has joined #openstack-infra | 12:13 | |
| *** dkranz has joined #openstack-infra | 12:15 | |
| *** rfolco has joined #openstack-infra | 12:16 | |
| *** pdmars has joined #openstack-infra | 12:17 | |
| *** aysyd has joined #openstack-infra | 12:20 | |
| *** rallegre has joined #openstack-infra | 12:26 | |
| YorikSar | jamespage: ping | 12:27 |
| jamespage | hello | 12:27 |
| YorikSar | jamespage: I've finally reproduced that bug in Python 2.7.3 we talked about on Friday | 12:27 |
| *** e0ne_ has quit IRC | 12:27 | |
| *** e0ne has joined #openstack-infra | 12:27 | |
| YorikSar | jamespage: bug #1307479 | 12:27 |
| uvirtbot | Launchpad bug 1307479 in python2.7 "multiprocessing.managers doesn't work due to Python stdlib bug" [Undecided,New] https://launchpad.net/bugs/1307479 | 12:27 |
| *** zhiyan_ is now known as zhiyan | 12:27 | |
| YorikSar | (or was it Thursday?..) | 12:28 |
| jamespage | YorikSar, do you have a nice test case for this? something say that someone who does not use openstack can reproduce? | 12:29 |
| jamespage | it will make the SRU process alot easier - I can ping doko to get his attention on this (python maintainer) | 12:29 |
| *** matsuhashi has quit IRC | 12:29 | |
| YorikSar | jamespage: You can take devstack and run it with the lates patchset in https://review.openstack.org/84667 | 12:30 |
| *** matsuhashi has joined #openstack-infra | 12:30 | |
| YorikSar | jamespage: It's not very nice... I can try to write some simple scripte demonstrating the problem though. | 12:30 |
| jamespage | YorikSar, that would be awesome | 12:30 |
| jamespage | YorikSar, what's the criticality of this bug? its it blocking juno work atm? | 12:31 |
| *** om has quit IRC | 12:31 | |
| YorikSar | jamespage: Oh, wait. There's example in bug description in Python's bugtracker. | 12:31 |
| YorikSar | jamespage: Basically, yes. We want to push rootwrap daemon work as early in Juno as possible and this bug won't let tests pass. | 12:32 |
| YorikSar | And my workarounds somehow won't work :( | 12:32 |
| jamespage | YorikSar, ok - understand - but might not be this week - as 14.04 release is thurs as well | 12:33 |
| *** weshay has joined #openstack-infra | 12:33 | |
| jamespage | :-) | 12:33 |
| *** BobBall_ has quit IRC | 12:33 | |
| *** adalbas has joined #openstack-infra | 12:33 | |
| *** matsuhashi has quit IRC | 12:34 | |
| YorikSar | jamespage: I wonder if our gate will switch to 14.04 as well... | 12:34 |
| YorikSar | "as well" => "after that" | 12:35 |
| *** zhiyan is now known as zhiyan_ | 12:36 | |
| *** zhiyan_ is now known as zhiyan | 12:36 | |
| YorikSar | jamespage: I've updated bug description to point to the example. | 12:37 |
| YorikSar | jamespage: Can I do anything to help the process besides (stopping) poking you about it? | 12:38 |
| *** matsuhashi has joined #openstack-infra | 12:42 | |
| *** ildikov_ has joined #openstack-infra | 12:44 | |
| *** om has joined #openstack-infra | 12:45 | |
| *** lascii is now known as alaski | 12:46 | |
| *** ociuhandu has quit IRC | 12:46 | |
| *** ildikov has quit IRC | 12:46 | |
| *** zul has quit IRC | 12:48 | |
| *** zul has joined #openstack-infra | 12:51 | |
| *** freyes has joined #openstack-infra | 12:54 | |
| *** skolekonov has quit IRC | 12:54 | |
| *** mfer has joined #openstack-infra | 12:55 | |
| *** freyes has quit IRC | 12:58 | |
| *** thuc_ has joined #openstack-infra | 12:59 | |
| *** fifieldt has quit IRC | 12:59 | |
| *** dprince has joined #openstack-infra | 13:05 | |
| *** bknudson has quit IRC | 13:06 | |
| *** matsuhashi has quit IRC | 13:06 | |
| *** blamar has joined #openstack-infra | 13:07 | |
| *** thomasem has joined #openstack-infra | 13:07 | |
| *** jeckersb_gone is now known as jeckersb | 13:08 | |
| *** matsuhas_ has joined #openstack-infra | 13:10 | |
| *** jpeeler has joined #openstack-infra | 13:12 | |
| *** jpeeler has quit IRC | 13:12 | |
| *** jpeeler has joined #openstack-infra | 13:12 | |
| *** mriedem has joined #openstack-infra | 13:18 | |
| *** HenryG has quit IRC | 13:21 | |
| *** om has quit IRC | 13:28 | |
| *** Longgeek has quit IRC | 13:28 | |
| *** om has joined #openstack-infra | 13:29 | |
| *** jgrimm has quit IRC | 13:30 | |
| *** Longgeek has joined #openstack-infra | 13:31 | |
| *** rallegre has quit IRC | 13:33 | |
| *** msabramo has quit IRC | 13:34 | |
| *** rallegre has joined #openstack-infra | 13:35 | |
| *** ociuhandu has joined #openstack-infra | 13:38 | |
| *** dkliban_afk is now known as dkliban | 13:38 | |
| *** yfried__ has quit IRC | 13:39 | |
| *** mwagner_lap has quit IRC | 13:39 | |
| slagle | hi, i don't *think* this change has been applied to gerrit yet, https://review.openstack.org/#/c/85485/ | 13:41 |
| slagle | is there a way to check? | 13:41 |
| slagle | i don't see the acl overrides when i look at https://review.openstack.org/#/admin/projects/openstack/tripleo-image-elements,access | 13:42 |
| *** matsuhas_ has quit IRC | 13:42 | |
| *** salv-orlando has joined #openstack-infra | 13:43 | |
| *** basha_ has joined #openstack-infra | 13:49 | |
| *** basha_ has left #openstack-infra | 13:49 | |
| *** rlandy has joined #openstack-infra | 13:49 | |
| *** prad has joined #openstack-infra | 13:51 | |
| *** freyes has joined #openstack-infra | 13:51 | |
| *** matsuhashi has joined #openstack-infra | 13:52 | |
| *** yfried__ has joined #openstack-infra | 13:54 | |
| *** matsuhashi has quit IRC | 13:54 | |
| *** skraynev is now known as skraynev_afk | 13:55 | |
| *** eharney has joined #openstack-infra | 13:57 | |
| *** enikanorov_ has joined #openstack-infra | 13:57 | |
| *** mestery_ has joined #openstack-infra | 13:58 | |
| *** basha_ has joined #openstack-infra | 13:58 | |
| *** mestery has quit IRC | 13:58 | |
| *** wchrisj has joined #openstack-infra | 13:58 | |
| *** enikanorov has quit IRC | 13:59 | |
| *** thuc has joined #openstack-infra | 13:59 | |
| *** zns has joined #openstack-infra | 14:00 | |
| *** zns has quit IRC | 14:00 | |
| *** signed8bit has joined #openstack-infra | 14:00 | |
| *** thuc__ has joined #openstack-infra | 14:00 | |
| *** zns has joined #openstack-infra | 14:00 | |
| SergeyLukjanov | slagle, hey | 14:01 |
| SergeyLukjanov | Reference: | 14:01 |
| SergeyLukjanov | refs/heads/milestone-proposed | 14:01 |
| SergeyLukjanov | Label Approved Exclusive | 14:01 |
| SergeyLukjanov | diskimage-builder-core | 14:01 |
| SergeyLukjanov | Label Code-Review Exclusive | 14:01 |
| SergeyLukjanov | diskimage-builder-core | 14:01 |
| SergeyLukjanov | slagle, everything is ok now | 14:01 |
| SergeyLukjanov | slagle, oops, you're talking about stable/* | 14:02 |
| *** thuc_ has quit IRC | 14:02 | |
| slagle | SergeyLukjanov: yes :) | 14:02 |
| slagle | i heard the gerrit acl configs are applied manually on fridays | 14:03 |
| slagle | i don't know if that happened last week or not | 14:03 |
| *** thuc has quit IRC | 14:04 | |
| *** basha_ has quit IRC | 14:05 | |
| *** jgrimm has joined #openstack-infra | 14:06 | |
| *** basha_ has joined #openstack-infra | 14:06 | |
| *** basha_ has left #openstack-infra | 14:06 | |
| SergeyLukjanov | slagle, looks like changes aren't applied, so, you need to ask someone from infra root to check | 14:07 |
| slagle | SergeyLukjanov: ok, thanks | 14:08 |
| *** rwsu has joined #openstack-infra | 14:09 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: added query for neutron migrations issue https://review.openstack.org/87274 | 14:12 |
| *** dkehn has quit IRC | 14:13 | |
| *** dkehnx has quit IRC | 14:14 | |
| *** om has quit IRC | 14:17 | |
| *** beekneemech is now known as bnemec | 14:18 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: added query for neutron migrations issue https://review.openstack.org/87274 | 14:20 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: added query for neutron migrations issue https://review.openstack.org/87274 | 14:21 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: added query for neutron migrations issue https://review.openstack.org/87274 | 14:28 |
| *** wchrisj has quit IRC | 14:31 | |
| *** zns has quit IRC | 14:31 | |
| *** wchrisj has joined #openstack-infra | 14:32 | |
| *** mestery_ is now known as mestery | 14:32 | |
| *** zns has joined #openstack-infra | 14:33 | |
| *** dims has quit IRC | 14:35 | |
| sdague | salv-orlando: I made the bug critical as well, because I think right now it's probably the most pressing issue to address in neutron, as it has a lot of systemic issues | 14:37 |
| *** MarkAtwood has joined #openstack-infra | 14:37 | |
| salv-orlando | sdague: it's ok to say it critical… but I'd say that probably this is more than a simple bug. Anyway, it's good to track it somehow. | 14:38 |
| sdague | salv-orlando: agreed, as I think the unwind is going to be more extensive | 14:38 |
| sdague | I think there will need to be a blueprint to address the bug, but the bug is at least useful for tracking (and things like elastic recheck need a bug) | 14:39 |
| *** rallegre has quit IRC | 14:39 | |
| *** Longgeek has quit IRC | 14:40 | |
| *** ameade has joined #openstack-infra | 14:40 | |
| *** thuc has joined #openstack-infra | 14:40 | |
| *** pcrews__ has joined #openstack-infra | 14:40 | |
| *** bknudson has joined #openstack-infra | 14:41 | |
| *** dims has joined #openstack-infra | 14:42 | |
| *** thuc__ has quit IRC | 14:43 | |
| *** thuc has quit IRC | 14:44 | |
| *** rallegre has joined #openstack-infra | 14:47 | |
| *** amotoki has joined #openstack-infra | 14:47 | |
| *** HenryG has joined #openstack-infra | 14:48 | |
| *** wenlock has joined #openstack-infra | 14:53 | |
| *** zz_gondoi is now known as gondoi | 14:54 | |
| *** zhiyan is now known as zhiyan_ | 14:54 | |
| anteaya | sdague: you were looking for fungi earlier | 14:54 |
| anteaya | he is away for two weeks | 14:54 |
| anteaya | he is getting married this weekend | 14:55 |
| sdague | oh, nice | 14:55 |
| anteaya | yeah, sorry you didn't know | 14:55 |
| anteaya | he doesn't make much fuss | 14:55 |
| *** miqui has quit IRC | 14:55 | |
| *** miqui has joined #openstack-infra | 14:55 | |
| sdague | ok, I'll leave that as post release week issue | 14:56 |
| Guest38269 | sdague: good morning | 14:57 |
| Guest38269 | oh no! | 14:57 |
| *** Guest38269 is now known as jeblair | 14:57 | |
| jeblair | sdague, anteaya: good morning! :) | 14:57 |
| sdague | morning :) | 14:57 |
| *** jeblair is now known as Guest34642 | 14:57 | |
| Guest34642 | i'm back from pycon; sleep deprived but hopefully should be able to start catching up | 14:57 |
| Guest34642 | okay gimme a sec | 14:58 |
| *** mwagner_lap has joined #openstack-infra | 14:58 | |
| sdague | man, your irc client doesn't like you this morning :) | 14:58 |
| *** gondoi is now known as zz_gondoi | 14:58 | |
| Guest34642 | it gets grumpy when i ignore it for too long :) | 14:58 |
| *** Guest34642 is now known as corvus | 14:58 | |
| *** thedodd has joined #openstack-infra | 14:59 | |
| *** thuc has joined #openstack-infra | 15:00 | |
| anteaya | corvus: morning | 15:00 |
| corvus | storyboard meeting time in #openstack-meeting-3 | 15:00 |
| openstackgerrit | Randy Coulman proposed a change to openstack-infra/jenkins-job-builder: Support the Store SCM plugin https://review.openstack.org/85729 | 15:01 |
| *** zz_gondoi is now known as gondoi | 15:03 | |
| *** doddstack has joined #openstack-infra | 15:06 | |
| phschwartz | Morning infra | 15:07 |
| *** thedodd has quit IRC | 15:08 | |
| *** basha_ has joined #openstack-infra | 15:10 | |
| *** chandan_kumar has quit IRC | 15:11 | |
| *** aconrad has joined #openstack-infra | 15:12 | |
| *** basha_ has quit IRC | 15:12 | |
| *** jpich has quit IRC | 15:12 | |
| *** dims has quit IRC | 15:13 | |
| SergeyLukjanov | phschwartz, morning | 15:14 |
| openstackgerrit | Randy Coulman proposed a change to openstack-infra/jenkins-job-builder: Support the Store SCM plugin https://review.openstack.org/85729 | 15:14 |
| krotscheck | Hey, clarkb: ElasticSearch for storyboard: Good idea/bad idea? | 15:14 |
| *** nijaba has quit IRC | 15:14 | |
| *** nijaba has joined #openstack-infra | 15:15 | |
| *** nijaba has joined #openstack-infra | 15:15 | |
| *** basha_ has joined #openstack-infra | 15:18 | |
| *** jpich has joined #openstack-infra | 15:19 | |
| openstackgerrit | David Caro proposed a change to openstack-infra/jenkins-job-builder: Added parallelization options https://review.openstack.org/75514 | 15:19 |
| *** om has joined #openstack-infra | 15:21 | |
| *** basha_ has quit IRC | 15:21 | |
| *** kmartin has joined #openstack-infra | 15:24 | |
| *** zul has quit IRC | 15:24 | |
| *** coolsvap|afk is now known as coolsvap | 15:25 | |
| *** zul has joined #openstack-infra | 15:25 | |
| *** branen has joined #openstack-infra | 15:27 | |
| *** dkehn has joined #openstack-infra | 15:29 | |
| *** dizquierdo has quit IRC | 15:31 | |
| *** chuck_ has joined #openstack-infra | 15:31 | |
| *** zul has quit IRC | 15:31 | |
| *** chuck_ is now known as zul | 15:32 | |
| *** gyee has joined #openstack-infra | 15:32 | |
| *** matjazp has joined #openstack-infra | 15:33 | |
| *** dkehn_ has joined #openstack-infra | 15:35 | |
| *** dkehn is now known as dkehnx | 15:35 | |
| *** dkehn_ is now known as dkehn | 15:35 | |
| openstackgerrit | A change was merged to openstack-infra/reviewday: Quit smoking. https://review.openstack.org/86104 | 15:36 |
| *** dkehn has quit IRC | 15:36 | |
| *** atiwari has joined #openstack-infra | 15:36 | |
| *** dkehn has joined #openstack-infra | 15:36 | |
| *** melwitt has joined #openstack-infra | 15:37 | |
| openstackgerrit | Dirk Mueller proposed a change to openstack-dev/hacking: Open 0.9.0 development https://review.openstack.org/87301 | 15:38 |
| *** dims has joined #openstack-infra | 15:39 | |
| *** BadCub01 has joined #openstack-infra | 15:39 | |
| *** pblaho has quit IRC | 15:39 | |
| *** thuc has quit IRC | 15:39 | |
| *** thuc has joined #openstack-infra | 15:39 | |
| *** gokrokve has joined #openstack-infra | 15:40 | |
| *** freyes has quit IRC | 15:43 | |
| *** thuc has quit IRC | 15:44 | |
| openstackgerrit | Doug Hellmann proposed a change to openstack-infra/config: Add cross-project unit tests for oslo libraries https://review.openstack.org/85487 | 15:44 |
| *** enikanorov_ has quit IRC | 15:45 | |
| *** basha_ has joined #openstack-infra | 15:46 | |
| zaro | rcarrillocruz: could you please provide a pointer to the changes? | 15:46 |
| dhellmann | SergeyLukjanov: regarding the non-voting jobs in ^^, should I split those out? I want to make them voting very soon, but I don't want to break everything when that commit lands | 15:46 |
| zaro | morning | 15:46 |
| zaro | aconrad: hi | 15:47 |
| SergeyLukjanov | dhellmann, hey, looking | 15:47 |
| aconrad | hi zaro | 15:47 |
| dhellmann | SergeyLukjanov: and as far as the number of jobs, I can't do much about that. jeblair, fungi, and I talked through some alternatives a while back, but all of them fail to meet some of our requirements | 15:48 |
| *** asselin has joined #openstack-infra | 15:49 | |
| SergeyLukjanov | dhellmann, yup, re number of jobs the only idea is complex "oslo" job to test all oslo libs in one job | 15:50 |
| dhellmann | SergeyLukjanov: that was one idea, but it introduces gate blocking for projects on libraries they don't use | 15:50 |
| SergeyLukjanov | dhellmann, re non-voting gate jobs, I'm ok with adding them if you're going to make them voting soon | 15:51 |
| dhellmann | SergeyLukjanov: it also doesn't support the libraries gating on changes in the apps | 15:51 |
| SergeyLukjanov | dhellmann, yup, it sounds not very good | 15:51 |
| dhellmann | SergeyLukjanov: yeah, I would love to have this all sorted out before the summit | 15:51 |
| SergeyLukjanov | dhellmann, ok, I'll take a look one more time and +2 if everything is ok | 15:52 |
| *** dims has quit IRC | 15:52 | |
| dhellmann | SergeyLukjanov: I'm open to suggestions on alternative implementations; I just haven't found one that works. :-/ | 15:53 |
| dhellmann | SergeyLukjanov: cool, thanks! | 15:53 |
| *** gothicmindfood has quit IRC | 15:53 | |
| SergeyLukjanov | dhellmann, yup, I don't see better solutions for it atm | 15:54 |
| dhellmann | SergeyLukjanov: does jjb support passing a list of values to a job template (and the template receiving them as a list)? | 15:55 |
| dhellmann | I could define 2 jobs, one for checking projects on libs and one for checking libs on projects, and pass the right list of inputs to it | 15:55 |
| *** gondoi is now known as zz_gondoi | 15:55 | |
| SergeyLukjanov | dhellmann, I don't know jjb enough well to answer this question | 15:55 |
| *** mrmartin has quit IRC | 15:55 | |
| dhellmann | I would hate to learn that the unit tests for one app break the tests for another, though, so I'm not sure I want to combine those into a single job | 15:56 |
| *** gothicmindfood has joined #openstack-infra | 15:57 | |
| dhellmann | anyway, I'm completely happy to revisit and reimplement this if we come up with something better, but I'd like to at least start with this version for now until the better idea comes along :-) | 15:57 |
| *** e0ne has quit IRC | 15:59 | |
| *** e0ne has joined #openstack-infra | 15:59 | |
| *** sabari2 has joined #openstack-infra | 16:00 | |
| *** jcoufal has quit IRC | 16:01 | |
| *** coolsvap1 has joined #openstack-infra | 16:02 | |
| *** zul has quit IRC | 16:02 | |
| *** e0ne has quit IRC | 16:03 | |
| *** coolsvap1 has quit IRC | 16:03 | |
| *** zul has joined #openstack-infra | 16:04 | |
| *** coolsvap1 has joined #openstack-infra | 16:04 | |
| *** zul has quit IRC | 16:04 | |
| *** dims has joined #openstack-infra | 16:05 | |
| *** jergerber has joined #openstack-infra | 16:07 | |
| *** coolsvap1 has quit IRC | 16:08 | |
| *** zul has joined #openstack-infra | 16:08 | |
| sdague | krotscheck: what's the problem that elastic search is trying solve in storyboard, maybe we can start there and move backwards | 16:09 |
| *** thuc has joined #openstack-infra | 16:09 | |
| sdague | because ES is a lot of infrastructure, and a storyboard data set seems small in comparison | 16:09 |
| corvus | sdague: full text searhc | 16:10 |
| *** thuc has quit IRC | 16:10 | |
| corvus | or something like that, possibly with letters in the right order. i don't know if we're picky though. :) | 16:10 |
| krotscheck | corvus sdague: Which, to be fair, we probably won’t get to for another week or three - we’ve got a lot of things we can do with a pure filter approach. | 16:11 |
| sdague | I locally managed lucene would be a ton less effort and weight I'd think | 16:11 |
| krotscheck | sdague: I thought that ES was built on Lucene? | 16:11 |
| *** thuc has joined #openstack-infra | 16:11 | |
| sdague | it is | 16:11 |
| krotscheck | sdague: Another alternative is Sphinx | 16:11 |
| krotscheck | sdague: Or MySQL fulltext indexes. | 16:11 |
| corvus | sdague: we _definitely_ don't want to have to run a logstash-sized cluster for openstack's storyboard; so yeah, ideally i think a storyboard instance of our size should not be outweighed by its full-text indexer | 16:12 |
| corvus | i don't know what a 'small' es installation looks like, so that's part of the open question for me | 16:12 |
| sdague | right, I think ES only really makes sense if you need the E part | 16:12 |
| *** dims has quit IRC | 16:13 | |
| sdague | I think for small data sets - http://lucene.apache.org/pylucene/ might actually make more sense. Then it could be fully managed by the storyboard server. Probably easier to deploy and run. | 16:14 |
| corvus | sdague: or run solr and use the api? | 16:15 |
| sdague | sure | 16:15 |
| sdague | you just add weight to run another service like that | 16:16 |
| krotscheck | …..I get a strange satisfaction by seeing that pylucene is actually java :) | 16:16 |
| *** jaypipes has joined #openstack-infra | 16:16 | |
| sdague | well everything that talked to lucene at function level needs java somewhere :) | 16:16 |
| *** rallegre has quit IRC | 16:17 | |
| *** rallegre has joined #openstack-infra | 16:18 | |
| sdague | honest at this stage full text search in mysql is probably totally good enough | 16:18 |
| sdague | as long at the plug point is clean enough to plug in other search in the future | 16:19 |
| sdague | that's basically how mediawiki and drupal function | 16:19 |
| *** zz_gondoi is now known as gondoi | 16:19 | |
| *** moted has quit IRC | 16:19 | |
| *** moted has joined #openstack-infra | 16:20 | |
| *** jpich has quit IRC | 16:24 | |
| *** dims has joined #openstack-infra | 16:27 | |
| *** mrmartin has joined #openstack-infra | 16:28 | |
| *** basha_ has quit IRC | 16:28 | |
| ruhe | folks, lucene is too low-level | 16:29 |
| corvus | sdague: have a link to your zuul depends-on etherpad? i thought of a concern we need to keep in mind | 16:30 |
| *** ominakov has quit IRC | 16:30 | |
| *** thuc has quit IRC | 16:30 | |
| *** thuc has joined #openstack-infra | 16:31 | |
| sdague | corvus: https://etherpad.openstack.org/p/zuul-depends-on | 16:31 |
| corvus | heh i never would have guessed that. :) | 16:32 |
| *** chandan_kumar has joined #openstack-infra | 16:33 | |
| *** thuc_ has joined #openstack-infra | 16:33 | |
| *** thuc__ has joined #openstack-infra | 16:34 | |
| *** thuc has quit IRC | 16:35 | |
| *** thuc has joined #openstack-infra | 16:36 | |
| *** thuc has quit IRC | 16:36 | |
| *** mrmartin has quit IRC | 16:36 | |
| *** thuc has joined #openstack-infra | 16:37 | |
| *** thuc_ has quit IRC | 16:38 | |
| *** om has quit IRC | 16:38 | |
| *** thuc__ has quit IRC | 16:39 | |
| mordred | sdague: there is no full text search in mysql | 16:40 |
| mordred | that is usable | 16:40 |
| *** yassine has quit IRC | 16:40 | |
| mordred | it's only there on myisam tables | 16:40 |
| mordred | and I employ every ounce of my ability to veto things to veto any use of myisam | 16:40 |
| mordred | lucene sounds great | 16:41 |
| mordred | krotscheck to me | 16:41 |
| mordred | gah | 16:41 |
| mordred | to me | 16:41 |
| mordred | krotscheck: ^^ | 16:41 |
| mordred | is what I meant to type | 16:41 |
| mordred | doesn't new gerrit also use lucene for searching? | 16:41 |
| ruhe | if you compare Lucene with ES or Solr, it'll be like a socket compared to REST API over HTTP. It is a very low-level thing | 16:43 |
| corvus | sdague: okay, added some food for thought at the bottom | 16:44 |
| krotscheck | mordred: Are you sure it’s only available on MyISAM? | 16:44 |
| sdague | ruhe: yeh, low level is fine in this case I think | 16:44 |
| krotscheck | mordred: https://dev.mysql.com/doc/refman/5.6/en/innodb-table-and-index.html#innodb-fulltext-index | 16:44 |
| mordred | krotscheck: oh! wow. I don't know anything about mysql anymore | 16:45 |
| * mordred retracts statements | 16:45 | |
| mordred | except... | 16:45 |
| mordred | we're using mysql via cloud servers | 16:45 |
| krotscheck | mordred: Yeah, no idea what version that dropped on. | 16:46 |
| ruhe | sdague: i don't think so. with lucene you need to write additional code, with ES you just send your data to it to persist. then send http queries for data | 16:46 |
| corvus | mordred: it's that oracley goodness | 16:46 |
| mordred | and it's running 5.1.73 | 16:46 |
| ruhe | sdague: and the amount of additional code overweights ES maintenance сosts | 16:46 |
| krotscheck | mordred: Looks like it’s new in 5.6 | 16:47 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: make postgresql job not use config drive https://review.openstack.org/87318 | 16:47 |
| sdague | ruhe: running an ES cluster is non trivial | 16:48 |
| *** mrmartin has joined #openstack-infra | 16:48 | |
| ruhe | sdague: yes it is. but figuring out how to adopt lucene for a search engine is also non trivial. and from my experience i say that running an ES cluster is easier compared to writing your own code around Lucene :) | 16:50 |
| *** rallegre has quit IRC | 16:50 | |
| *** che-arne has quit IRC | 16:50 | |
| ruhe | i didn't maintain ES cluster, but i've used both Lucene and Solr (which is very similar to ES) | 16:50 |
| sdague | yeh, I've used lucene before, it's not that bad :) | 16:51 |
| sdague | mordred: honestly, iteration 1 with LIKE strings is probably fine for the size data set that storyboard has | 16:52 |
| corvus | maybe solr is easier? :) | 16:52 |
| ruhe | and *maybe* it is OK to run ES on a single node | 16:52 |
| sdague | maybe, managing a lucene indexer for a small set of data isn't that bad. That being said, is "really good search" really a near term need? | 16:53 |
| corvus | sdague: yeah, i think we're on the same page about the priority here; it's not at the top of the list; i think it's just something we want to start thinking about because we will probably need it for the 'all the openstack bugs' stage | 16:53 |
| corvus | openstack has a lot of bugs ;) | 16:53 |
| sdague | sure, though some of the other categorization needs probably happen first. Like being able to see artifacts created by you, or assigned to you | 16:53 |
| *** harlowja_away is now known as harlowja | 16:54 | |
| anteaya | can someone with ssh access to the git farm run `ps aux | grep salt` on any git server and paste the output, please? | 16:54 |
| sdague | that actually raise a meta question, should I report bugs in storyboard as stories? | 16:54 |
| corvus | sdague: yeah; check out the storyboard meeting log for the full context. that's where we're spending most of our time. just trying to back-burner this one so we don't completely leave it out of the design | 16:54 |
| corvus | sdague: absolutely | 16:54 |
| sdague | ok, will do | 16:54 |
| corvus | sdague: also future-work can go there | 16:55 |
| *** afazekas has quit IRC | 16:55 | |
| *** SumitNaiksatam has quit IRC | 16:56 | |
| *** fbo is now known as fbo_away | 16:56 | |
| mordred | anteaya: [mordred@git01 ~]$ ps aux | grep salt | 16:56 |
| mordred | mordred 24100 0.0 0.0 103244 864 pts/0 S+ 16:56 0:00 grep salt | 16:56 |
| anteaya | mordred: thanks | 16:57 |
| anteaya | this confirms corvus' belief that salt-minions are not currently running on git servers | 16:57 |
| openstackgerrit | A change was merged to openstack-infra/devstack-gate: normalize the services for a post grizzly world https://review.openstack.org/84287 | 16:57 |
| anteaya | so ssh it is | 16:57 |
| mordred | anteaya: I have a patch for you to check out | 16:58 |
| *** rallegre has joined #openstack-infra | 16:58 | |
| anteaya | mordred: looking at it now | 16:59 |
| anteaya | https://review.openstack.org/#/c/80976/ | 16:59 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Drive puppet from the master over ssh https://review.openstack.org/80976 | 16:59 |
| mordred | anteaya: I have an update that's betterer | 16:59 |
| anteaya | ah new hotness | 16:59 |
| * anteaya moves to the new hotness | 16:59 | |
| mordred | nibalizer: ^^ you may also want to look at that, you had some comments on the puppet kick version | 17:00 |
| *** jdurgin has quit IRC | 17:00 | |
| mordred | corvus: btw - I LOVE the idea of making this a non-slave zuul worker | 17:00 |
| mordred | corvus: it makes several places where this one is designed like poo much better | 17:00 |
| *** jdurgin has joined #openstack-infra | 17:01 | |
| corvus | mordred: ++ | 17:01 |
| mordred | corvus: but I think that can potentially be a step 2 | 17:01 |
| *** derekh has quit IRC | 17:03 | |
| *** nati_ueno has joined #openstack-infra | 17:04 | |
| anteaya | mordred: does this patch do anything with the return code? so far I see it returned but that is it | 17:04 |
| mordred | anteaya: no, it does not. it should | 17:05 |
| mordred | there are two more changes I think I want to make in this | 17:06 |
| nibalizer | mordred: so I still don't think you'll be able to run every machine in 15 minutes... | 17:07 |
| mordred | corvus: you know - although I Do not think that ansible playbooks will help with this task at all and would introduce needless complexity - the "run parallel invocations" feature might be useful to address nibalizer's concern ^^ | 17:07 |
| * mordred goes to make a quick poc patch to show a thought there | 17:07 | |
| *** dkliban is now known as dkliban_afk | 17:07 | |
| *** dkliban_afk is now known as dkliban | 17:07 | |
| nibalizer | mordred: i think an xargs -P 10 -n 1 is the correct solution | 17:08 |
| * anteaya pulls up mordred's paste from a week ago: http://paste.openstack.org/show/75261/ | 17:08 | |
| mordred | nibalizer: ooh. I hadn't thought of that | 17:08 |
| nibalizer | that way you run 10 at a time(so you dont kill the master) but they all get done asap | 17:08 |
| nibalizer | and of course '10' is a number to adjust | 17:08 |
| mordred | nibalizer: yup. love it | 17:09 |
| nibalizer | i mean i love devops tools, dont get me wrong | 17:09 |
| nibalizer | but sometimes its time to use the shell | 17:09 |
| mordred | nibalizer: can I xargs a shell function? | 17:09 |
| nibalizer | heck yea | 17:09 |
| chmouel | clarkb: hey clark i was wondering what was the status tox.ConfigError: ConfigError: substitution key 'posargs' not found | 17:09 |
| corvus | chmouel: i talked to holger at pycon; he's going to look more closely at clarkb's merge request | 17:10 |
| corvus | chmouel: but the problem is still there in the latest tox, so we pin to an older vesion | 17:10 |
| chmouel | corvus: ah nice, (i am at pycon at the moment as well) | 17:10 |
| corvus | chmouel: i'm back at home now (flew back yesterday) | 17:10 |
| *** amcrn has joined #openstack-infra | 17:11 | |
| corvus | chmouel: (i'm jeblair, in case you don't know my alternick) | 17:11 |
| chmouel | corvus: ah yeah i didn't know your altenick :) | 17:11 |
| chmouel | corvus: so yeah i def saw you ;) | 17:11 |
| *** corvus is now known as jeblair | 17:11 | |
| jeblair | there we go; freenode likes me now | 17:12 |
| *** SumitNaiksatam has joined #openstack-infra | 17:12 | |
| mordred | nibalizer: how do I remove OVERRIDE_LIST from FULL_LIST? | 17:12 |
| nibalizer | comm? | 17:12 |
| mordred | hang on - I got it | 17:12 |
| *** mrodden has quit IRC | 17:12 | |
| *** Ryan_Lane has joined #openstack-infra | 17:13 | |
| *** jooools has quit IRC | 17:13 | |
| sdague | jeblair / mordred: https://review.openstack.org/87318 - turns out we broke our expected testing config back in jan. We should get that through soonish to make sure we don't regress | 17:13 |
| *** yolanda_ has quit IRC | 17:13 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Drive puppet from the master over ssh https://review.openstack.org/80976 | 17:16 |
| mordred | nibalizer: how about that ^^ | 17:16 |
| *** gokrokve_ has joined #openstack-infra | 17:16 | |
| *** thuc has quit IRC | 17:17 | |
| zaro | aconrad: what app are you building on top of jjb? | 17:17 |
| *** thuc has joined #openstack-infra | 17:18 | |
| aconrad | zaro: a command line interface that prompts the user for questions and generates a YAML file out of it. | 17:19 |
| nibalizer | mordred: i like it | 17:19 |
| nibalizer | an idea: do you think it would be advantageous to use ssh -o Connectiontimeout=something versus the way you're doing it with shell timeout? | 17:19 |
| aconrad | I'm trying to get my company on Jenkins, but Jenkins is messy and I'm trying to make it easier for our developers to hook up their github project onto Jenkins | 17:19 |
| *** gokrokve has quit IRC | 17:19 | |
| zaro | aconrad: a wizard to build jjb jobs? is it on github? | 17:20 |
| aconrad | no, not yet | 17:20 |
| aconrad | I'm trying to think how I can open source it | 17:20 |
| mordred | aconrad: patches to jjb? | 17:20 |
| aconrad | zaro: because the questions asked are somewhat specific to my company, so I'm not sure how to make it very generic | 17:20 |
| mordred | oh. in that case - me shuts up | 17:21 |
| nibalizer | mordred: looks good! | 17:21 |
| mordred | nibalizer: awesome | 17:21 |
| nibalizer | i left a comment on the authorized key thing | 17:21 |
| mordred | nibalizer: re: ssh connectiontimeout - if puppet hangs and ssh just timeouts the connection, could se leave a stale hung puppet on the box? | 17:21 |
| aconrad | zaro: specific, but also quite generic. Like "do you want to build pull requests?", "do you want to prevent code coverage regression?", "what is the command to run your tests", ... | 17:22 |
| aconrad | I'd say the flow is specific. | 17:22 |
| zaro | aconrad: what is a 'file-like' object? | 17:22 |
| aconrad | StringIO | 17:22 |
| *** MarkAtwood has quit IRC | 17:22 | |
| *** thuc has quit IRC | 17:22 | |
| aconrad | zaro: ... or anything that quacks like a file (duck-typing) | 17:22 |
| *** MarkAtwood has joined #openstack-infra | 17:23 | |
| aconrad | zaro: basically, in our case, an object that has a .read() method. | 17:23 |
| aconrad | zaro: are you at PyCon? | 17:23 |
| anteaya | aconrad: no, he isn't | 17:24 |
| *** UtahDave has joined #openstack-infra | 17:24 | |
| zaro | aconrad: missed it this time. i was at confoo. | 17:24 |
| nibalizer | mordred: im not sure... googling isn't telling me the answer | 17:24 |
| aconrad | zaro: ah right | 17:24 |
| nibalizer | but I do know that the timeout command you're using sends a TERM by default, so maybe we'd want to upgrade it to timeout -s 9 puppet agent --test | 17:24 |
| *** mrodden has joined #openstack-infra | 17:24 | |
| aconrad | I met with James B., very nice guy | 17:25 |
| mordred | nod. also, is 60m too long? | 17:25 |
| *** thuc has joined #openstack-infra | 17:25 | |
| *** thuc has quit IRC | 17:26 | |
| mgagne | zaro: they wish to build some kind of wizard abstracting Jenkins and JJB for a bunch of developers who never heard about Jenkins or CI. The tool asks a bunch of predefined questions and build the appropriate JJB configs based on those answers. My understanding is this tool will integrate with the JJB "internal api" instead of relying on the CLI. | 17:26 |
| *** denis_makogon_ has joined #openstack-infra | 17:26 | |
| *** thuc has joined #openstack-infra | 17:26 | |
| nibalizer | also might be considered useful to run puppet with --logdest=syslog because I think when we use 'puppet agent --test' we have to specify that | 17:26 |
| openstackgerrit | Trent Geerdes proposed a change to openstack/requirements: Adding default branch and remote in .gitreview file. https://review.openstack.org/87335 | 17:26 |
| mgagne | zaro: that's why they are proposing to add the ability to interact with "file like objects" | 17:26 |
| nibalizer | mordred: im okay with 60m, its super long but it fits my definition of $BIG_NUMBER, which I think is its intended purpose | 17:27 |
| *** thuc has quit IRC | 17:27 | |
| aconrad | I heard there was an openstack room porting OpenStack to Python3 @ PyCon | 17:27 |
| mgagne | zaro: file like object being the instance returned by open() or anything derivated | 17:27 |
| anteaya | aconrad: yes, 518B | 17:27 |
| *** thuc has joined #openstack-infra | 17:27 | |
| aconrad | I met with mgagne, too! ;) | 17:27 |
| *** hogepodge has joined #openstack-infra | 17:27 | |
| mgagne | aconrad: I have no recall of meeting you :D /jk | 17:27 |
| *** thuc has quit IRC | 17:27 | |
| aconrad | :p | 17:28 |
| *** jeckersb is now known as jeckersb_gone | 17:28 | |
| *** thuc has joined #openstack-infra | 17:28 | |
| anteaya | mordred: so how do you want to deal with the return code from run_ssh? | 17:29 |
| anteaya | since taht is teh magic piece for automating manage-projects | 17:29 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Drive puppet from the master over ssh https://review.openstack.org/80976 | 17:29 |
| mordred | nibalizer: I updated to use the ssh_authorized_keys type per your suggestion | 17:30 |
| mordred | anteaya: in the latest vesrion - it actually does respond to the return code in the for loop | 17:30 |
| *** khyati has joined #openstack-infra | 17:30 | |
| mordred | with if ! ; then break | 17:30 |
| zaro | aconrad: that sounds neat, the wizard seems useful but kinda targeted. thanks for the explanation mgagne, i was wondering what the use case would be. | 17:31 |
| anteaya | mordred: it breaks | 17:32 |
| *** ominakov has joined #openstack-infra | 17:32 | |
| *** jeckersb_gone is now known as jeckersb | 17:32 | |
| anteaya | can it log an error? | 17:32 |
| mgagne | zaro: yes, it's kinda targeted however the changes proposed are generic enough IMO | 17:32 |
| anteaya | or perhaps sleep and try again? | 17:33 |
| mordred | anteaya: it will sleep and try again in about 15 minutes - as for logging - we might want to write a local log just in case we want to track down problems later | 17:33 |
| mordred | for the most part I think the intent is that we can see puppet errors in puppetboard | 17:34 |
| *** ominakov has quit IRC | 17:34 | |
| *** ominakov has joined #openstack-infra | 17:34 | |
| anteaya | if it hits the break, what will show up in puppetboard, just a failure? | 17:34 |
| *** ominakov has quit IRC | 17:35 | |
| anteaya | would it show up in this list of reports? http://puppetboard.openstack.org/reports/git03.openstack.org | 17:37 |
| *** gokrokve_ has quit IRC | 17:37 | |
| *** denis_makogon_ is now known as denis_makogon | 17:37 | |
| *** SumitNaiksatam_ has joined #openstack-infra | 17:39 | |
| *** SumitNaiksatam has quit IRC | 17:39 | |
| *** SumitNaiksatam_ is now known as SumitNaiksatam | 17:39 | |
| *** yolanda_ has joined #openstack-infra | 17:40 | |
| *** yolanda_ has quit IRC | 17:40 | |
| *** yolanda_ has joined #openstack-infra | 17:40 | |
| anteaya | how does @override_list get its value? | 17:44 |
| mordred | anteaya: it _may_ | 17:44 |
| mordred | anteaya: it gets passed in from the thign - one sec - I'll give a link | 17:44 |
| anteaya | k | 17:44 |
| mordred | anteaya: https://review.openstack.org/#/c/80976/6/manifests/site.pp | 17:44 |
| *** ildikov_ has quit IRC | 17:45 | |
| nibalizer | mordred: awesome | 17:45 |
| anteaya | ah yes, thanks | 17:46 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Move to using ssh_authorized_key type https://review.openstack.org/87340 | 17:47 |
| mordred | nibalizer: there ^^ is a patch to update all of our creation of such files | 17:47 |
| anteaya | so I am looking here: http://puppetboard.openstack.org/node/ci-puppetmaster.openstack.org | 17:47 |
| anteaya | the reports seem circular | 17:47 |
| anteaya | I am having trouble finding out what actually ran | 17:47 |
| anteaya | so I probably don't know how to read the reports | 17:48 |
| mordred | anteaya: well - it doesn't report a lot on success | 17:48 |
| mordred | which we like | 17:48 |
| mordred | anteaya: http://puppetboard.openstack.org/report/ci-puppetmaster.openstack.org/34a5d4853b1cbee6675bf061bc9440c4db3bb22b for instance | 17:48 |
| mordred | (the first report linked) | 17:48 |
| mordred | shows that puppet ran and was happy and nothing changed | 17:49 |
| mordred | this is what we expect to happen most times | 17:49 |
| anteaya | that is what that tells me | 17:49 |
| mordred | if you look at a report where something changed: http://puppetboard.openstack.org/report/review.openstack.org/00c4033e4af7ba8d657374641148e94303897f76 | 17:49 |
| anteaya | okay thanks | 17:49 |
| mordred | you'll see what it looks like when it does take actions and is happy about it | 17:49 |
| mordred | and if you look here: http://puppetboard.openstack.org/report/storyboard.openstack.org/1334836edbaaf0556958f35a785fe343edaee9c0 | 17:49 |
| mordred | you'll see what it looks like when it does something and it's unhappy about it | 17:50 |
| anteaya | what is v'0' | 17:50 |
| mordred | nibalizer: btw ^^ I have NO IDEA why runs on storyboard alternate between success and failure in that way | 17:50 |
| anteaya | sorry u'0' | 17:50 |
| mordred | anteaya: the return code for teh command was 0 | 17:50 |
| anteaya | ah okay | 17:50 |
| mordred | nibalizer: it only seems to break on storyboard in that particular way - pip and virtualenv ARE on that system | 17:51 |
| anteaya | if it is unhappy about it, why did it report success for everything? | 17:51 |
| anteaya | sorry, wrong link, I see the failure message now | 17:51 |
| *** enikanorov_ has joined #openstack-infra | 17:52 | |
| anteaya | jenkins doesn't like the linting for 80976 yet | 17:53 |
| mordred | oops | 17:53 |
| anteaya | so this is to get this in place and then there can be a further patch that says if override list runs without breaking, trigger manage-projects | 17:54 |
| *** coolsvap is now known as coolsvap|afk | 17:54 | |
| *** rallegre has quit IRC | 17:55 | |
| anteaya | and honestly since override_list is just the git_farm I would be in favour of calling the variable the git_farm | 17:55 |
| anteaya | unless you want to keep it open to adding more servers in the future | 17:55 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Move to using ssh_authorized_key type https://review.openstack.org/87340 | 17:57 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Drive puppet from the master over ssh https://review.openstack.org/80976 | 17:57 |
| mordred | anteaya: I may want to add more servers in the future - it's realy about "run these in order and fail if any of them fail" and the second part is "run all of tehse and we dont' care" | 17:57 |
| anteaya | k | 17:58 |
| anteaya | so paint the bridge that says, this ran successfully on all git servers fire manage-projects | 17:59 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Revert "Revert "Revert "Stop running manage-projects""" https://review.openstack.org/87342 | 17:59 |
| *** matjazp has quit IRC | 17:59 | |
| *** matjazp has joined #openstack-infra | 18:00 | |
| *** marun has joined #openstack-infra | 18:00 | |
| jeblair | i love that, btw. :) | 18:00 |
| *** gema has quit IRC | 18:01 | |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Revert "Revert "Revert "Stop running manage-projects""" https://review.openstack.org/87343 | 18:02 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Move to using ssh_authorized_key type https://review.openstack.org/87340 | 18:02 |
| *** pcrews_ has joined #openstack-infra | 18:02 | |
| *** zehicle_at_dell has joined #openstack-infra | 18:02 | |
| mordred | anteaya: and actually - thanks for reminding me - ^^ there is the patch (the revert revert revert one) that adds manage-projects back in | 18:02 |
| anteaya | mordred: so where is the bit that says only run manage-projects _after_ override_list has run successfully? | 18:03 |
| *** gema has joined #openstack-infra | 18:04 | |
| nibalizer | mordred: gets my +1 | 18:04 |
| *** pcrews__ has quit IRC | 18:04 | |
| nibalizer | mordred: I don't have time to debug storyboard right now, maybe this evening | 18:04 |
| mordred | anteaya: it doesn't - review.openstack.org is in override_list | 18:04 |
| jeblair | oh the ssh_autherized_key is lovely! | 18:04 |
| mordred | anteaya: so puppet will only run on review.openstack.org after successful runs of puppet on git* | 18:05 |
| *** matjazp has quit IRC | 18:05 | |
| anteaya | so that is the race we have been looking to address | 18:05 |
| mordred | anteaya: yup | 18:05 |
| mordred | we address it not by associating manage-projects with pupept on git* - but by making pupept on review run m-p and by associating puppet on review with puppet on git* | 18:05 |
| anteaya | I am not seeing that puppet will only run on reviw.o.o after success on puppet on git | 18:05 |
| anteaya | I will look again | 18:05 |
| jeblair | nibalizer: thanks for enlightening us on that :) | 18:05 |
| mordred | anteaya: look in run_remote_puppet | 18:05 |
| mordred | jeblair: right? pretty isnt' it? (we'll need to land that one by hand because we'll need to change a few keys in hiera at the same time) | 18:06 |
| mordred | jeblair: since they have the header and comment baked in in hiera | 18:06 |
| jeblair | mordred: what's the 'disable puppet' story? i saw a comment from nibalizer but didn't see the answer | 18:07 |
| anteaya | override_list has to be run in order and review.o.o is at the bottom of the list | 18:07 |
| mordred | jeblair: oh - how to deal with puppet being disabled on a host? | 18:07 |
| jeblair | mordred: yeah, or phrased slightly differently, what's the process to disable puppet in the nwo? | 18:07 |
| *** _nadya_ has joined #openstack-infra | 18:08 | |
| *** nati_ueno has quit IRC | 18:08 | |
| mordred | jeblair: for the hosts that arent' git* and review, I think "puppet agent --disable 'insert comment here'" should still dtrt. | 18:08 |
| mordred | jeblair: hrm - wait - I may be wrong about something... | 18:08 |
| mordred | that still won't let us avoid the remote trigger while we're wanting to locally test | 18:09 |
| mordred | let me noodle on it | 18:09 |
| *** nati_ueno has joined #openstack-infra | 18:09 | |
| * mordred REALLY wished that there was a way to run puppet agent --test with puppet agent --disable in place | 18:10 | |
| *** pcrews__ has joined #openstack-infra | 18:10 | |
| jeblair | mordred: does 'puppet agent --disable' write a file that we could check for? | 18:10 |
| mordred | like "puppet agent --test --force" | 18:10 |
| mordred | jeblair: it does | 18:10 |
| jeblair | mordred: so maybe "if file dne puppet agent --test" | 18:10 |
| jeblair | should be the ssh command | 18:10 |
| mordred | jeblair: /var/lib/puppet/state/puppetdlock | 18:11 |
| jeblair | hehe i read that as "puppet deadlock" | 18:11 |
| mordred | jeblair: there will be a minor race condition for people doing local testing | 18:11 |
| jeblair | mordred: why? | 18:11 |
| mordred | in that you can't run puppet yourself if agent is disabled | 18:11 |
| clarkb | eyes still dilated. hope to be useful soonish | 18:12 |
| mordred | so you'll have to do "puppet agent --enable ; puppet agent --test ; puppet agent --disable" and hope the the global run_all doesn't also try to run in the window | 18:12 |
| jeblair | mordred: you can't run 'puppet agent --test' if it is disabled? | 18:12 |
| mordred | jeblair: sadly, no | 18:12 |
| *** praneshp has joined #openstack-infra | 18:12 | |
| jeblair | then we don't need to do anything special for the ssh trigger | 18:12 |
| anteaya | clarkb: rest your eyes | 18:13 |
| *** pcrews_ has quit IRC | 18:13 | |
| jeblair | mordred: maybe we should just make another file and ignore puppet agent --test | 18:13 |
| jeblair | er | 18:13 |
| jeblair | ignore puppet agent --disable | 18:13 |
| anteaya | they heal fast but they need to rest while they are healing | 18:13 |
| mordred | jeblair: that actually isnt' a terrible idea - since puppet agent --disable is pretty terrible | 18:14 |
| mordred | btw - you can give a message to --disable to list a reason | 18:14 |
| mordred | but puppet does not print that reason if you try to run --test while it's disabled | 18:15 |
| *** tjones has joined #openstack-infra | 18:15 | |
| *** morganfainberg_Z is now known as morganfainberg | 18:15 | |
| mordred | jeblair: oh - biggest problem - our ssh key would also have to have access to run the check for the flag | 18:15 |
| nibalizer | mordred: puppet agent --enable && puppet agent --test ; puppet agent --disable 'message' | 18:16 |
| mordred | nibalizer: right - but there's a race there | 18:16 |
| mordred | what we WANT is "puppet agent --test --force" which will allow a one-time manual run even if disabled | 18:16 |
| nibalizer | oh there si a way | 18:17 |
| nibalizer | haha | 18:17 |
| nibalizer | right | 18:17 |
| nibalizer | you do puppet agent --test --lockfile=someotherfile | 18:17 |
| mordred | hahahaha | 18:17 |
| nibalizer | its not actually that argument tho | 18:18 |
| nibalizer | give me a sec to figure it out again | 18:18 |
| tjones | hi - i am trying to run tox on mavericks and I am getting this error clang: error: unknown argument: '-mno-fused-madd' [-Wunused-command-line-argument-hard-error-in-future]. i think i know how to fix it but when i patch .tox/py27/lib/python2.7/site-packages/setuptools/command/easy_install.py it appears to get overwritten with something without my fix. anyone already fixed this issue? | 18:18 |
| mordred | tjones: hi! well, you can't patch anything in the .tox dir like that - those are all files genearted as part of the virtualenv | 18:18 |
| *** doddstack has quit IRC | 18:19 | |
| mordred | the bug is probably either in easy_install upstream in its support for clang on mavericks, or in the particular package it's trying to install | 18:19 |
| *** doddstack has joined #openstack-infra | 18:19 | |
| mordred | nibalizer: puppet agent --test --puppetdlockfile=/tmp/foo | 18:20 |
| *** andreaf has quit IRC | 18:20 | |
| mordred | jeblair: ok - if we just use puppet agent --disable | 18:20 |
| *** e0ne has joined #openstack-infra | 18:20 | |
| mordred | then as we're testing, we can use the above to skip being blocked by disable | 18:20 |
| tjones | mordred: yeah that is what i suspected. ugh | 18:21 |
| jeblair | mordred: wfm; a ci doc patch for that would probably be good (along with maybe 'splainin the ssh thing) | 18:21 |
| nibalizer | mordred: awesome | 18:21 |
| jeblair | (cause i'll forget that) | 18:22 |
| nibalizer | i found agent_disabled_lockfile but --puppetdblockfile sounds more like what I remember | 18:22 |
| mordred | jeblair: nod | 18:22 |
| mordred | jeblair: I'll do that in a bit | 18:23 |
| lcostantino | qq, is there a channel for devstack? | 18:24 |
| anteaya | lcostantino: for getting going with devstack #openstack-dev is probably your best bet | 18:25 |
| anteaya | for devstack development, #openstack-qa is the one you want | 18:25 |
| mordred | anteaya: does the patch/patches make sense to you? | 18:25 |
| lcostantino | anteaya, great thanks | 18:25 |
| anteaya | mordred: I am working though them | 18:25 |
| anteaya | the --disable bit I am catching up on | 18:26 |
| anteaya | I don't understand why it needs a file passed to the command to enable it | 18:26 |
| anteaya | lcostantino: welcome | 18:26 |
| mordred | anteaya: so, sometimes we want to disable automatic runs of puppet on a server, because we're doing manual maintainence or testing of something | 18:26 |
| * anteaya nods | 18:27 | |
| mordred | so when we do that, if we just run "puppet agent --disable" on the server, it will happily not run puppet on the host from the script | 18:27 |
| mordred | but we still need to be able to run puppet on the host ourselves so we can do our testing | 18:27 |
| mordred | so for that, we would run "puppet agent --test --puppetdlockfile=/tmp/foo" - which will fool puppet into letting us run it even though it's generally enabled | 18:28 |
| * anteaya notes a foggy understanding | 18:28 | |
| mordred | cool | 18:28 |
| anteaya | can I hear it again in different words? | 18:28 |
| anteaya | what is the relationshipw between --test and --disable | 18:29 |
| anteaya | --test is used when puppet has been disabled? | 18:29 |
| *** jlibosva has quit IRC | 18:29 | |
| *** peddamat has joined #openstack-infra | 18:30 | |
| mordred | no - --test is the poorly-named option which says "puppet, please run one time and do not start a daemon" | 18:30 |
| *** peddamat has quit IRC | 18:30 | |
| anteaya | oh | 18:30 |
| mordred | so "puppet agent --test" is just the command one uses to run puppet | 18:30 |
| anteaya | something just clicked | 18:30 |
| mordred | woot! | 18:30 |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: add ability to parse from a file object https://review.openstack.org/85177 | 18:30 |
| anteaya | --disable stops the daemon | 18:30 |
| *** sdake_ has quit IRC | 18:31 | |
| jeblair | we use --test in both cases (from the ssh script and when locally testing) because in both cases we want to wait until the end of the run and see if everything worked | 18:31 |
| anteaya | --test runs puppet without starting the daemon | 18:31 |
| * anteaya nods | 18:31 | |
| anteaya | I'm still not a 100% on why you need to pass a file as an argument | 18:32 |
| anteaya | what is expected to be the contents of the file? | 18:32 |
| mordred | nothing | 18:32 |
| anteaya | an empty file | 18:32 |
| mordred | it's a path to where puppet will make a lock file | 18:32 |
| anteaya | ah | 18:32 |
| mordred | so passing it is a hack | 18:32 |
| anteaya | why does it need to make a lock file? | 18:33 |
| mordred | aroudn the fact that puppet has already made a "puppet is disabled" lockfile at the default location | 18:33 |
| anteaya | ah | 18:33 |
| anteaya | got it | 18:33 |
| anteaya | a disabled puppet has a lockfile | 18:33 |
| nibalizer | anteaya: --test is also 'please give me output' | 18:34 |
| clarkb | mordred: have we tested deleting the ec2 facter file yet? I think I am going to kick off more nodepool image builds now if necessary | 18:35 |
| anteaya | yes, I felt that was an important bit fitting into the whole we need a return code | 18:35 |
| *** matjazp has joined #openstack-infra | 18:35 | |
| clarkb | I guess that is actually an easy thing for me to test on a VM of my own | 18:35 |
| *** matjazp has quit IRC | 18:35 | |
| anteaya | nibalizer: do you happen to have a sample paste of what kind of output --test might offer? | 18:36 |
| nibalizer | sure, sec | 18:36 |
| anteaya | nibalizer: thanks | 18:36 |
| anteaya | clarkb: how are your eyes? | 18:36 |
| *** e0ne has quit IRC | 18:37 | |
| mordred | clarkb: no, I have not testied it | 18:37 |
| nibalizer | mordred: anteaya in puppet 3 at least you can do puppet agent --onetime --detailed-exit-codes --no-daemonize and it won't go to the background, produce output, or start the daemon | 18:37 |
| clarkb | anteaya: I have the foil sunglasses things they give you on :) and that helps a ton | 18:38 |
| nibalizer | http://pastie.org/9080354 | 18:38 |
| nibalizer | anteaya: ^ | 18:38 |
| clarkb | mordred: ok, I will take a stab at that now | 18:38 |
| anteaya | clarkb: k, yes my sister had the dialeted eyes once, she was blind most of the rest of the day | 18:39 |
| clarkb | anteaya: last time it went for a few hours. I figure I am about half way done | 18:39 |
| *** gokrokve has joined #openstack-infra | 18:39 | |
| anteaya | clarkb: cool | 18:39 |
| anteaya | nibalizer: looking | 18:39 |
| openstackgerrit | Derek Higgins proposed a change to openstack-infra/config: Add a check for nova-docker https://review.openstack.org/86910 | 18:39 |
| *** thuc has quit IRC | 18:40 | |
| *** thuc has joined #openstack-infra | 18:40 | |
| nibalizer | anteaya: so thats most puppet runs | 18:41 |
| nibalizer | usually puppet doesn't make changes | 18:41 |
| anteaya | nibalizer: how could we get this output in a log file should --test fail to exit 0? | 18:41 |
| nibalizer | anteaya: --logdest=filename or --logdest=syslog will put it to syslog | 18:41 |
| anteaya | lots of work | 18:41 |
| anteaya | where could that go in mordred's patch? | 18:41 |
| *** e0ne has joined #openstack-infra | 18:42 | |
| *** aysyd has quit IRC | 18:42 | |
| clarkb | mordred: so that just totally worked on my precise test box. Going to spin up a centos6 machine now | 18:43 |
| anteaya | nibalizer: that would put everything to syslog even runs with exit code 0, would it not? | 18:43 |
| *** thuc has quit IRC | 18:45 | |
| nibalizer | yes | 18:45 |
| nibalizer | anteaya: in the run_puppet function i believe | 18:45 |
| anteaya | too noisy methinks | 18:45 |
| *** MarkAtwood has quit IRC | 18:45 | |
| anteaya | I just made a comment on patch 6 | 18:45 |
| mordred | clarkb: awesome | 18:46 |
| mordred | nibalizer: I don't think that'll do what you're thinking it will do | 18:46 |
| mordred | there are two things we need - one is logs of the puppet run if puppet failed - those are already going to puppetmaster, pupeptdb and then puppetboard | 18:47 |
| *** ildikov has joined #openstack-infra | 18:47 | |
| mordred | we don't need to do anything with logdest to get that | 18:47 |
| mordred | the other thing we _might_ need is a log of the run_all script itself - so taht we can catch a timeout failure | 18:47 |
| *** hogepodge has quit IRC | 18:48 | |
| *** _nadya_ has quit IRC | 18:51 | |
| *** zns has quit IRC | 18:51 | |
| *** zns has joined #openstack-infra | 18:53 | |
| nibalizer | mordred: i agree that logdest is probably not needed, just mentioning its existence. Right now logs go to syslog i believe and we'd have to set logdest=syslog to maintain that behavior... which I agree we probably don't need to do | 18:53 |
| mordred | nibalizer: nod | 18:54 |
| nibalizer | mordred: right and you have a TODO in there with a case to perform some action if the puppet node failed | 18:54 |
| *** aysyd has joined #openstack-infra | 18:55 | |
| *** khyati has quit IRC | 18:56 | |
| *** jcoufal has joined #openstack-infra | 18:57 | |
| *** mrda_away is now known as mrda | 18:58 | |
| *** _nadya_ has joined #openstack-infra | 18:58 | |
| *** dstanek has quit IRC | 18:59 | |
| *** zehicle_at_dell has quit IRC | 19:00 | |
| *** MarkAtwood has joined #openstack-infra | 19:00 | |
| *** nati_ueno has quit IRC | 19:01 | |
| *** pdmars_ has joined #openstack-infra | 19:01 | |
| *** nati_uen_ has joined #openstack-infra | 19:02 | |
| clarkb | pleia2: you don't happen to know where fedora20 hides facter's libs do you? | 19:03 |
| clarkb | pleia2: I am digging around on a tripleo-f20 image and learning I don't know how to yum | 19:03 |
| *** markmc has joined #openstack-infra | 19:03 | |
| *** khyati has joined #openstack-infra | 19:04 | |
| anteaya | clarkb: she is flying | 19:04 |
| *** pdmars has quit IRC | 19:05 | |
| anteaya | she might get wifi when she hits chicago, in an hour or so I think | 19:05 |
| *** dstanek has joined #openstack-infra | 19:05 | |
| *** dripton is now known as dripton_afk | 19:05 | |
| clarkb | ah thanks | 19:05 |
| anteaya | np | 19:05 |
| *** _nadya_ has quit IRC | 19:06 | |
| *** jswarren_ has joined #openstack-infra | 19:06 | |
| anteaya | mordred: I'm waiting on a new patchset for 80976 that addresses nibalizer's comments | 19:07 |
| anteaya | I'm good with the patches taht depend on it | 19:07 |
| *** jswarren has quit IRC | 19:08 | |
| *** gondoi is now known as zz_gondoi | 19:09 | |
| *** dstanek has quit IRC | 19:09 | |
| *** doddstack has quit IRC | 19:10 | |
| *** aysyd has quit IRC | 19:10 | |
| clarkb | pleia2: anteaya: found it. If you install yum-utils you can `repoquery --list packagename` to get a list of files | 19:10 |
| *** thedodd has joined #openstack-infra | 19:10 | |
| anteaya | clarkb: \o/ | 19:11 |
| *** ociuhandu has quit IRC | 19:13 | |
| nibalizer | also rpm -ql facter | 19:13 |
| *** aysyd has joined #openstack-infra | 19:16 | |
| aconrad | zaro: thanks for reviewing my patch | 19:17 |
| *** dripton_afk is now known as dripton | 19:17 | |
| aconrad | zaro: what's the release cycle of jjb? when you I expect a new release of the package? | 19:17 |
| aconrad | when should I expect* | 19:18 |
| *** Ajaeger1 has joined #openstack-infra | 19:18 | |
| *** thedodd has quit IRC | 19:19 | |
| *** thedodd has joined #openstack-infra | 19:20 | |
| *** zz_gondoi is now known as gondoi | 19:22 | |
| *** thedodd has quit IRC | 19:22 | |
| *** reed has quit IRC | 19:22 | |
| *** chandan_kumar has quit IRC | 19:22 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/config: Change names for duplicate neutron jobs https://review.openstack.org/83172 | 19:23 |
| *** pcrews_ has joined #openstack-infra | 19:23 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Remove facter ec2 metadata facts. https://review.openstack.org/87360 | 19:23 |
| clarkb | mordred: jeblair ^ is tested on precise and centos6 but not fedora20 yet, but I don't expect facter to act differently on fedora | 19:23 |
| *** reed has joined #openstack-infra | 19:23 | |
| Ajaeger1 | Hi clarkb: could you remove your -1 from https://review.openstack.org/#/c/82384/ , please ? the translation team really likes to have these in - see Akhiro and Sascha's comments | 19:23 |
| *** thedodd has joined #openstack-infra | 19:24 | |
| clarkb | Ajaeger1: looking | 19:24 |
| clarkb | Ajaeger1: I would really rather I left my -1 there so others can add their comments | 19:24 |
| clarkb | I defer to you guys on what actually merges, but without the -1 other reviewers may not see there is some conflict | 19:25 |
| slagle | anyone around who can apply this change to gerrit? https://review.openstack.org/#/c/85485/ | 19:26 |
| *** pcrews__ has quit IRC | 19:26 | |
| *** enikanorov_ has quit IRC | 19:26 | |
| *** vhoward has left #openstack-infra | 19:26 | |
| *** enikanorov_ has joined #openstack-infra | 19:27 | |
| slagle | i think maybe they're supposed to get applied manually on fridays? but i don't see that it has been applied when i look at the project acl's in gerrit | 19:27 |
| *** pcrews has joined #openstack-infra | 19:27 | |
| *** pcrews_ has quit IRC | 19:27 | |
| Ajaeger1 | clarkb: understood | 19:27 |
| Ajaeger1 | anybody else that wants to comment on https://review.openstack.org/#/c/82384/ in either way? | 19:28 |
| *** amcrn is now known as notamrith | 19:28 | |
| clarkb | slagle: last week was a pretty terrible week for us and I am pretty sure we simply didn't run the script on friday | 19:28 |
| clarkb | slagle: it turns out when the entirety of the Internet becomes untrusted it makes for a terrible week | 19:28 |
| slagle | clarkb: sure, totally understood, i'm just asking politely :) | 19:29 |
| Ajaeger1 | clarkb: I hope https://review.openstack.org/#/c/82573/ and https://review.openstack.org/#/c/85973/ are less controversial - could you review those as well as time permits, please? The first is an optimization that will make some projects happy, the second is avoiding the duplicated IDs | 19:30 |
| clarkb | slagle: I can try to get to it tomorrow | 19:30 |
| slagle | i'm not sure if it was applied, but didn't do what i expect, or wasn't applied is all | 19:30 |
| slagle | clarkb: thanks | 19:30 |
| clarkb | slagle: I don't think it would've applied at all | 19:30 |
| clarkb | Ajaeger1: looking | 19:30 |
| *** lcostantino has quit IRC | 19:31 | |
| *** notamrith is now known as amcrn | 19:32 | |
| clarkb | Ajaeger1: reviewed the first one. One small command issue otehrwise lgtm | 19:36 |
| *** gondoi is now known as zz_gondoi | 19:36 | |
| *** _nadya_ has joined #openstack-infra | 19:36 | |
| Ajaeger1 | clarkb: thanks, just reading your comments and will update quickly | 19:37 |
| rcarrillocruz | hey guys, could anyone please review https://review.openstack.org/#/c/86382/ ? | 19:37 |
| rcarrillocruz | not sure if i should write the code for Gerrit 2.8 hooks given that we will upgrade presumably in May | 19:37 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Move to using ssh_authorized_key type https://review.openstack.org/87340 | 19:38 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Revert "Revert "Revert "Stop running manage-projects""" https://review.openstack.org/87343 | 19:38 |
| clarkb | rcarrillocruz: I will look in a bit | 19:38 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Drive puppet from the master over ssh https://review.openstack.org/80976 | 19:38 |
| nibalizer | hahaahah | 19:38 |
| rcarrillocruz | thx clarkb | 19:38 |
| nibalizer | revert revert revert | 19:38 |
| clarkb | you haven't lived until you have 3 nested reverts | 19:39 |
| anteaya | hehe | 19:39 |
| mordred | jeblair, nibalizer: I have added docs | 19:39 |
| rcarrillocruz | clarkb: Gerrit 2.8 does contain --commit in the change-abandoned hook, the change above is against Gerrit 2.4.2 | 19:39 |
| nibalizer | mordred: awesome! /me loves docs | 19:39 |
| mordred | I also added a puppet defaults file to turn "start on boot" off for the pupept agent | 19:39 |
| rcarrillocruz | i'm doubtful if i should write the change against 2.4.2 AND 2.8 | 19:39 |
| rcarrillocruz | land it as is | 19:39 |
| rcarrillocruz | or rewrite it completey against 2.8 | 19:40 |
| *** nkinder has quit IRC | 19:40 | |
| mordred | clarkb: also - you may wan tto look at those three patches - nibalizer, anteaya, jeblair and I talked through them a little bit while you were having your eyes gouged | 19:40 |
| nibalizer | ya, might also want to put a puppet agent --disable on 'install_puppet.sh' since the ubuntu package will start the daemon up on install | 19:40 |
| nibalizer | or not disable | 19:40 |
| clarkb | Ajaeger1: has the --ignore-obsoluete chaneg been tested? should it just be --ignore-obsolete instead of --ignore-obsolete=true? | 19:40 |
| nibalizer | i mean disable the service | 19:40 |
| clarkb | Ajaeger1: reading the babel docs it isn't quite clear to me | 19:40 |
| clarkb | anteaya: looking at http://babel.pocoo.org/docs/cmdline/#update | 19:40 |
| Ajaeger1 | clarkb: I tested it - and it needed --ignore-obsolee=true | 19:40 |
| mordred | nibalizer: I think it installs with the start to fase though | 19:41 |
| clarkb | Ajaeger1: ok thanks | 19:41 |
| mordred | nibalizer: I just had to remove a bunch of docs about how to enable the agent to run | 19:41 |
| nibalizer | mordred: oh that would be amazing, puppetlabs++ for packaging right | 19:41 |
| mordred | ++ | 19:41 |
| clarkb | Ajaeger1: approved that one | 19:41 |
| mordred | clarkb: awesome | 19:42 |
| Ajaeger1 | clarkb: thanks! | 19:42 |
| Ajaeger1 | clarkb: will keep an eye on the jobs | 19:42 |
| clarkb | mordred: can you chime in on https://review.openstack.org/#/c/82384/ for Ajaeger1 ? | 19:42 |
| *** lcostantino has joined #openstack-infra | 19:42 | |
| mordred | clarkb: only if you'll review my patches while I do :) | 19:43 |
| clarkb | mordred: okay | 19:43 |
| Ajaeger1 | clarkb, mordred: Thanks! | 19:43 |
| mordred | Ajaeger1: so - still looking - but to set the stage here | 19:44 |
| mordred | Ajaeger1: often times people prefer to have a thing a certain way to solve a problem | 19:44 |
| mordred | we find many times that the problem trying to be solved by other communities is framed different in the face of the infra automation machine | 19:45 |
| mordred | (which is just my thoughts based on "There has been quite some discussion on the opensuse-i18n mailing list and for some projects, translators prefer to have the files in - and thus we need to handle this.") | 19:45 |
| *** jcoufal has quit IRC | 19:46 | |
| anteaya | mordred: looks good to me | 19:46 |
| Ajaeger1 | mordred: history of this patch is that the jobs where failing since we had .tx/config in the repos, then it was manually updated, removed, added after complaints,... | 19:46 |
| mordred | Ajaeger1: yah - so, why not change it to git reset -- ? | 19:47 |
| mordred | instead of git add? | 19:47 |
| *** nati_uen_ has quit IRC | 19:47 | |
| *** e0ne has quit IRC | 19:47 | |
| mordred | I can see why it's possible someone might want it tin the rpo - is there a valid use case where our update scripts might want to change its value? | 19:47 |
| Ajaeger1 | mordred: would work as well but then it needs manual update eventually... | 19:47 |
| *** e0ne has joined #openstack-infra | 19:48 | |
| *** dprince has quit IRC | 19:48 | |
| Ajaeger1 | mordred: Yes, whenever a new file gets added. For example in openstack-manuals, when we create a new manual | 19:48 |
| *** ociuhandu has joined #openstack-infra | 19:48 | |
| Ajaeger1 | Since this is a post job, failures are not really seen ;( | 19:48 |
| mordred | Ajaeger1: oh - wow, really? | 19:48 |
| Ajaeger1 | unless somebody monitors them. | 19:48 |
| adam_g | are the devstack-gate nodes setup with any special local iptables rules that would affect connections to $HOST_IP? | 19:49 |
| clarkb | adam_g: yes | 19:49 |
| Ajaeger1 | mordred: yeah, that's part of the underlying problem why I'd like this done foolproof ;) | 19:49 |
| clarkb | adam_g: iptables is fairly locked down | 19:49 |
| mordred | Ajaeger1: ok. I think I can be on board with the add | 19:49 |
| adam_g | clarkb, ah! | 19:49 |
| mordred | I mean, the world sucks and all | 19:49 |
| clarkb | adam_g: let me show you what heat does to fix it | 19:49 |
| *** e0ne has quit IRC | 19:50 | |
| Ajaeger1 | ;) | 19:50 |
| mordred | Ajaeger1: +2 - you'll need to convince SergeyLukjanov or jeblair too - since fungi is out this week | 19:50 |
| clarkb | adam_g: https://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/manifests/single_use_slave.pp#n26 heat specific rule additions. YOu can also run iptables directly in your test (just be sure to put rules at the beginning of the ruleset and not the end if you do that) | 19:50 |
| mgagne | is there any schedule available for Friday 16th? | 19:51 |
| Ajaeger1 | mordred: thanks, will do at another time. | 19:51 |
| mordred | mgagne: for what? | 19:51 |
| Ajaeger1 | Now fixing the problems that clarkb pointed out... | 19:51 |
| Ajaeger1 | ... on my other patch | 19:51 |
| clarkb | mgagne: the 16th isn't friday | 19:51 |
| mgagne | mordred: whatever there is left | 19:51 |
| mordred | oh - at the summit | 19:52 |
| mgagne | mordred: yep, May | 19:52 |
| mgagne | clarkb: sorry, context: openstack summit | 19:52 |
| clarkb | mgagne: gotcha | 19:52 |
| adam_g | clarkb, awesome. thanks. | 19:52 |
| clarkb | adam_g: running iptables direclty in your test might be a good place to test the fix then we can formalize it in puppet | 19:53 |
| *** sarob has joined #openstack-infra | 19:53 | |
| clarkb | nice thing about test specific is then you aren't waiting for us when images need to update | 19:53 |
| *** mrmartin has quit IRC | 19:53 | |
| clarkb | mordred: so I udnerstand, we are running all puppet jobs from this cron after your change? | 19:54 |
| clarkb | mordred: the number of servers isn't raelly big so should be fine. Just making sure I grok the intent | 19:54 |
| openstackgerrit | Andreas Jaeger proposed a change to openstack-infra/config: Reduce number of files send for propose_translation https://review.openstack.org/82573 | 19:54 |
| mordred | clarkb: yes | 19:54 |
| Ajaeger1 | clarkb: updated the patch - the nit you noticed was a real bug | 19:54 |
| mgagne | clarkb: so, is there a schedule available for Friday? mostly design sessions? | 19:54 |
| adam_g | clarkb, yeah--ill put it in the devstack deployment to see if it helps | 19:54 |
| mordred | clarkb: then, follow up step - we turn run_all/run_remote_puppet into python and make it a non-jenkins-slave zuul worker | 19:55 |
| mordred | clarkb: so that we can trigger runs of it in the post pipeline | 19:55 |
| clarkb | mgagne: I am not involved in summit planning but my understanding is it will be all design sessions | 19:55 |
| clarkb | mgagne: conference runs monday to thursday and design session tuesday to friday | 19:55 |
| openstackgerrit | A change was merged to openstack-infra/config: Do not generate obsolete translations https://review.openstack.org/85973 | 19:55 |
| zaro | aconrad: i don't have the power to release jjb (*yet*) | 19:55 |
| mordred | but for now, having a script in a cron seems more better | 19:56 |
| mordred | zaro: weren't we working on that? | 19:56 |
| mgagne | clarkb: cool, trying to see if it's worth it staying until Saturday or not. Some people aren't technical so it's hard to justify it =) | 19:56 |
| zaro | mordred: not approved yet, https://review.openstack.org/#/c/56823/ | 19:57 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Drive puppet from the master over ssh https://review.openstack.org/80976 | 19:57 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Move to using ssh_authorized_key type https://review.openstack.org/87340 | 19:58 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Revert "Revert "Revert "Stop running manage-projects""" https://review.openstack.org/87343 | 19:58 |
| *** zz_gondoi is now known as gondoi | 19:58 | |
| * mordred missed rocketships | 19:58 | |
| zaro | aconrad: i'll probably try to do every 3months if given the power. | 19:58 |
| clarkb | Ajaeger1: lgtm | 19:59 |
| *** fbo_away is now known as fbo | 19:59 | |
| mordred | clarkb: is there a reason we've not approved the jjb patch? | 19:59 |
| mordred | clarkb: it has 5 +2's on it | 20:00 |
| clarkb | mordred: which jjb patch? | 20:00 |
| Ajaeger1 | clarkb: thanks for the review! | 20:00 |
| mordred | https://review.openstack.org/#/c/56823/ | 20:00 |
| clarkb | mordred: ah, I didn't realize jeblair had changed his position | 20:00 |
| *** e0ne has joined #openstack-infra | 20:00 | |
| clarkb | mordred: in that case no, I think it can be approved | 20:00 |
| mordred | done | 20:01 |
| aconrad | zaro: Ok cool. Well, I'll try to keep an eye on the release. Once it's released, I'll patch my wizard tool to pass file objects to JJB rather than filenames | 20:01 |
| tjones | mordred: i think i have "solved" the issue i have with clang and mavericks. is there a good place to document this so others don't suffer as much? | 20:01 |
| aconrad | (it's already patched, I'll just need to wait for jjb to get released before merging it upstream) | 20:02 |
| mordred | tjones: hrm. not sure - I thnk there is a "getting started" section on the wiki about getting dev workstations set up | 20:02 |
| mordred | anteaya: ^^ do you know where taht section of the wiki is? | 20:02 |
| clarkb | tjones: mordred: also individual projects have docs for getting tests running | 20:02 |
| zaro | rcarrillocruz: i would make 86382 work with gerrit 2.8. your change is unlikely to land before upgrading anyways. | 20:02 |
| clarkb | in doc/source/somethingsometing | 20:02 |
| aconrad | what are +2 code reviews? | 20:02 |
| mordred | aconrad: reviews from core reviewers | 20:03 |
| aconrad | ah, weighting | 20:03 |
| mordred | aconrad: we require as a general policy for patches to have 2 +2 reviews before landing them | 20:03 |
| aconrad | mordred: I see. Gerrit should have a total count of upvotes | 20:04 |
| aconrad | (and down-votes) | 20:04 |
| anteaya | mordred: I will look | 20:04 |
| zaro | aconrad: we don't think there's value in that. | 20:05 |
| aconrad | and what's the green check? | 20:05 |
| zaro | aconrad: same as +2 | 20:05 |
| aconrad | I thought these were core-reviewers | 20:05 |
| aconrad | ah ok | 20:05 |
| Ajaeger1 | Can anybody help me where I can find the jenkins logs easily for the latest runs of the translation jobs? I used to look at jenkins.openstack.org but api-site-manuals-propose-translation-update was run there 5 days ago - and no other jenkins has the logs... | 20:05 |
| *** _nadya_ has quit IRC | 20:05 | |
| *** _nadya_ has joined #openstack-infra | 20:05 | |
| *** markmc has quit IRC | 20:05 | |
| Ajaeger1 | here's the link: https://jenkins.openstack.org/view/All/job/api-site-manuals-propose-translation-update/ | 20:06 |
| zaro | aconrad: although i think you can make gerrit have total up votes with some config settings | 20:06 |
| anteaya | this is the only wikipage I see that deals with setting up devstack: https://wiki.openstack.org/wiki/DevStackVirtualbox | 20:07 |
| anteaya | and it is dated | 20:07 |
| Ajaeger1 | something is broken - http://status.openstack.org/zuul/ shows me a running job for openstack-manuals with job openstack-manuals-manuals-upstream-translation-update: but clicking on the link, I get a 404. | 20:07 |
| Ajaeger1 | This is the link: https://jenkins.openstack.org/job/openstack-manuals-manuals-upstream-translation-update/221/ | 20:08 |
| Ajaeger1 | is jenkins.openstack.org broken? | 20:08 |
| anteaya | the gerrit workflow page: https://wiki.openstack.org/wiki/Gerrit_Workflow | 20:08 |
| anteaya | links to this page for devstack: https://wiki.openstack.org/wiki/DevStack | 20:08 |
| anteaya | which doesn't show up in the wiki search | 20:08 |
| clarkb | Ajaeger1: https://jenkins.openstack.org/job/openstack-manuals-manuals-upstream-translation-update/167/console is the last run job there with a console log | 20:09 |
| clarkb | Ajaeger1: and that console log looks suspiciously wrong. Not sure what is happening there | 20:09 |
| clarkb | hrm, could this be related to my reload config off disk stuff that happened last week? | 20:09 |
| *** UtahDave has quit IRC | 20:09 | |
| anteaya | it doesn't show up for "installing a devstack" search | 20:09 |
| Ajaeger1 | clarkb: five days ago? | 20:09 |
| *** e0ne has quit IRC | 20:09 | |
| Ajaeger1 | clarkb: exactly, there're the jobs missing. | 20:10 |
| clarkb | Ajaeger1: yeah that is about when te jenkins config loading happened | 20:10 |
| *** e0ne has joined #openstack-infra | 20:10 | |
| Ajaeger1 | clarkb: the job was run, see http://logs.openstack.org/7f/7f2d1e15e55f1f215611e6741a1133ee68c004ba/post/openstack-manuals-manuals-upstream-translation-update/625b38c/ | 20:10 |
| annegentle | mordred: three reverts in a row in a sentence? Wowsa | 20:10 |
| Ajaeger1 | but jenkins does not know about it | 20:10 |
| *** e0ne has quit IRC | 20:11 | |
| sdague | annegentle: mordred is the king of the triple negative | 20:11 |
| clarkb | Ajaeger1: that is amazing | 20:11 |
| clarkb | Ajaeger1: I am looking on disk now to see if maybe permissions are breaking jenkins or similar | 20:11 |
| annegentle | sdague: two reverts make it a vert? | 20:11 |
| *** e0ne has joined #openstack-infra | 20:11 | |
| sdague | annegentle: or a horiz? | 20:11 |
| anteaya | currently the devstack documentation is in a github repo, dtroyer is working on some steps to bring it into the fold | 20:11 |
| clarkb | Ajaeger1: it looks fine on disk | 20:12 |
| clarkb | mordred: jeblair should I do a full restart of jenkins.o.o and see if that fixes it? I have never seen this before | 20:12 |
| mordred | clarkb: fine by me? | 20:13 |
| *** pcrews has quit IRC | 20:13 | |
| clarkb | putting it in shutdown mode now | 20:13 |
| clarkb | and no jobs running so restarting it | 20:14 |
| rcarrillocruz | ok zaro, will do that then, thx | 20:14 |
| *** BadCub01 has quit IRC | 20:15 | |
| chmouel | anteaya: http://summit.openstack.org/cfp/details/305 | 20:15 |
| openstackgerrit | A change was merged to openstack-infra/config: proposal to allow additional people to release jjb https://review.openstack.org/56823 | 20:15 |
| *** e0ne has quit IRC | 20:16 | |
| clarkb | Ajaeger1: that appears to have fixed it | 20:16 |
| aconrad | hah! | 20:16 |
| clarkb | Ajaeger1: jenkins bug I guess | 20:16 |
| *** e0ne has joined #openstack-infra | 20:17 | |
| anteaya | chmouel: great, thanks for submitting that | 20:17 |
| Ajaeger1 | clarkb: indeed. Now I see many run jobs ;) Too many to review tonight ;) | 20:17 |
| annegentle | jeblair: hey what's an example of a crippled open-core project? (I need a history lesson in open source I think) | 20:19 |
| *** e0ne_ has joined #openstack-infra | 20:20 | |
| *** e0ne has quit IRC | 20:20 | |
| clarkb | annegentle: nginx, mysql, puppet(sort of) I can probably think of more if given time | 20:20 |
| mordred | annegentle: Eucalyptus | 20:21 |
| aconrad | hey jeblair, can you send me in PM your email? I think I left your card at my hotel room. I'd like to send you this email about the painful process of submitting a patch to openstack | 20:21 |
| annegentle | clarkb: so in this case, the meaning is, unless you use all the "commercial" plugins it's sort of useless standalone? | 20:21 |
| mordred | in that there are features you only get if you buy something | 20:21 |
| mordred | and mainly, that those features are REALLY something that the main thing should have | 20:21 |
| aconrad | or maybe I can write a blog post | 20:21 |
| annegentle | got it, thanks mordred and clarkb | 20:21 |
| *** gokrokve has quit IRC | 20:21 | |
| mordred | and that they've been held out of the main thing so that they can be offered as a for-purchase add-on | 20:21 |
| annegentle | jeblair: no need to define :) | 20:21 |
| mordred | annegentle: yah | 20:21 |
| *** mwagner_lap has quit IRC | 20:22 | |
| mordred | clarkb: actually, thus far mysql has amanzingly managed to remain not open core | 20:22 |
| mordred | clarkb: the management at the time I was there kept wanting to make it so, and we kept successfully fending them off | 20:23 |
| clarkb | mordred: huh, I thought you paid money to sun/oracle for the good stuff | 20:23 |
| mordred | nope | 20:23 |
| clarkb | what do you pay for then? | 20:23 |
| *** _nadya_ has quit IRC | 20:23 | |
| mordred | there are add-ons like an external monitoring service | 20:23 |
| *** Ajaeger1 has quit IRC | 20:23 | |
| mordred | but that's not really part ofa db server | 20:23 |
| mordred | you pay for support | 20:23 |
| annegentle | clarkb: mordred: yeah mysql felt like "one of these things is not like the other" | 20:23 |
| clarkb | mordred: I swear you paid and got non gpl extras | 20:24 |
| clarkb | but maybe tat was just so you could hack on it without the gpl? | 20:24 |
| mordred | clarkb: if you buy support, they will ship you a copy of the "enterprise dashboard" - but you are very unlikely to actually ever insall or use it | 20:24 |
| mordred | clarkb: that is the other thig you can pay for - a non-gpl licensed version | 20:24 |
| annegentle | ok, then my next question, is the open core problem what we're running away from by making integration quite wide? I mean, is there a happy medium between killing say docs, infra, qa with a bunch of integration and keeping OpenStack useful? | 20:25 |
| mordred | annegentle: I'd say yes and no | 20:25 |
| annegentle | I think there is but the scaling of integration is really scare | 20:25 |
| annegentle | scary | 20:25 |
| clarkb | annegentle: clearly my opinion is wrong here, but I think openstack would be quite useful if we just said only mysql, rabbit, and kvm are supported with openvswitch | 20:25 |
| annegentle | clarkb: hey man, that's useful stuff | 20:25 |
| mordred | annegentle: for me, pulling in docs and infra into the _effort_ called openstack | 20:26 |
| clarkb | the breadth of supported technology doesn't ahve much to do with usefulness as accomodating particulargroups of people and their expertise imo | 20:26 |
| mordred | is about recognizing that the work going in to those is essential to the project and is no more or less important than work on nova | 20:26 |
| *** pcrews has joined #openstack-infra | 20:26 | |
| clarkb | which is a very valid raeson to do it, but doesn't necessarily make openstack more useful | 20:26 |
| mordred | annegentle: on the other hand, I think that additional integrated projects are about providing features that end-users want | 20:26 |
| sdague | is there a place where this conversation started? I feel like I'm not finding it in the backlog. | 20:27 |
| *** dizquierdo has joined #openstack-infra | 20:27 | |
| clarkb | sdague: I have no idea | 20:27 |
| *** cody-somerville has joined #openstack-infra | 20:27 | |
| clarkb | sdague: but it seems close to my proposed session so I am jumping in :) | 20:27 |
| annegentle | sdague: I read jeblair's TC candidacy email | 20:27 |
| mordred | sdague: annegentle just started asking questions,so I started answering them :) | 20:27 |
| annegentle | :) | 20:27 |
| mordred | ah - me goes to read | 20:27 |
| clarkb | mordred: ok, for some erason I thought non gpl came with extras | 20:27 |
| sdague | heh, ok. I didn't read jeblair's TC candidacy :) | 20:27 |
| mordred | clarkb: nope | 20:27 |
| annegentle | yeah context and me, not so much introduced | 20:27 |
| annegentle | jumping in is fun! | 20:28 |
| mordred | I completely agree with jeblair's platform, btw | 20:29 |
| mordred | annegentle: so, to put words in his mouth, one of the fears _I_ have with the core definition stuff is any time I hear the words "OpenStack shouldn't do X because company Y is using that as a vector for monetization" | 20:29 |
| clarkb | mordred: ok, first of your changes has been reviewed, please see comments but +2 | 20:30 |
| annegentle | mordred: we're not allergic to money | 20:30 |
| *** e0ne_ has quit IRC | 20:30 | |
| mordred | I support company Y doing X for moneteization, but if it makes sense for us to be doing it, I'm not going to not do it just because they are | 20:30 |
| *** e0ne has joined #openstack-infra | 20:30 | |
| annegentle | mordred: yes and I'm only allergic to more upstream work if it's not really meant to be for lots of users | 20:30 |
| mordred | annegentle: right - but just because piston and nebula AND canonical have each written their own bare metal provisioning framework, does not mean that openstack should avoid doing so | 20:31 |
| annegentle | mordred: ah the converse too. Yes same with training guides in the community. | 20:31 |
| mordred | annegentle: in fact, the fact that ALL of them have done it and have not collaborated on it and have used it as a vehicle to lock users in to their product proves to me that it's a needed thing adn that the world will be a better place if we have an opinion | 20:32 |
| sdague | annegentle: and, another part of the counter to that is this - https://blogs.akamai.com/2014/04/heartbleed-update-v3.html | 20:32 |
| mordred | annegentle: otoh - I don't think we need to just take on every project just because it's there | 20:32 |
| *** dkranz has quit IRC | 20:32 | |
| *** nati_ueno has joined #openstack-infra | 20:32 | |
| clarkb | sdague: that was funny | 20:32 |
| sdague | akamai had a patch to openssl that they thought protected them from heartbleed, they kept it to themselves | 20:32 |
| sdague | as soon as they openned it, the community immediately found a vulnerability in it | 20:33 |
| clarkb | sdague: it was fundamentally flawed | 20:33 |
| *** melwitt has quit IRC | 20:33 | |
| sdague | it was not openned because "it was assumed to not be interesting for general users" | 20:33 |
| *** melwitt has joined #openstack-infra | 20:33 | |
| *** e0ne has quit IRC | 20:33 | |
| sdague | clarkb: sure | 20:34 |
| *** gokrokve has joined #openstack-infra | 20:35 | |
| mordred | annegentle: exactly. so the real trick to us to make sure that we accept or reject projects and features on their merits and weigh those against teh cost to us as we have been doing | 20:35 |
| mordred | annegentle: I think it's essentially not our job AT ALL to weigh those against the potential negative impact in teh market it may have on a company who has based a product aroudn a lack of a given feature in openstack | 20:36 |
| annegentle | mordred: yes and I need to let go of the "cost to docs" because of scaling... perhaps not let go but find more ways to enable teams | 20:37 |
| sdague | annegentle: yeh, I think that's something that all the cross project teams face | 20:37 |
| sdague | at 5 integrated projects, I think the cross project teams were the primary generators of the content | 20:38 |
| annegentle | sdague: yes that seems to be the crucial breaking point for valuing integration as much as we do | 20:38 |
| sdague | but at 11+ | 20:38 |
| sdague | they have to be more review and mentoring | 20:38 |
| sdague | and the content functions drive back to the project teams | 20:38 |
| annegentle | sdague: yes the near-doubling is what has me doing the doc contribution survey and considering tool changes and requirements | 20:38 |
| *** jp_at_hp has quit IRC | 20:38 | |
| sdague | yep | 20:39 |
| mordred | annegentle: ++ | 20:39 |
| sdague | because the cross project teams are never going to grow as fast at the # of integrated projects | 20:39 |
| annegentle | mordred: glad you like it since I'll surely need help with tooling :) | 20:39 |
| annegentle | sdague: measuring by contributors? Nova still dwarfs us all (ha star terms) | 20:39 |
| *** mdenny has quit IRC | 20:40 | |
| *** sarob has quit IRC | 20:40 | |
| annegentle | sdague: not doubting, just wondering | 20:41 |
| sdague | annegentle: the way I think about it is by people that are only dedicated to that team | 20:41 |
| ekarlso | What's the discussion about ? | 20:42 |
| sdague | honestly, this is something I've definitely thought about as we evolved the QA team | 20:42 |
| annegentle | sdague: oh for sure... same kind of ratios as dev:doc | 20:42 |
| sdague | because it used to be the core team members did most of the test cases. Now, honestly, very few do | 20:42 |
| *** mdenny has joined #openstack-infra | 20:42 | |
| sdague | the core team members do plumbling and reviews, and most of the test code comes from non core contributors | 20:42 |
| annegentle | ekarlso: I was asking for examples of crippled core from Jim's TC candidacy email, I don't have as much open source project history as this group so they're a good group to ask | 20:42 |
| annegentle | ekarlso: plus they put up with my dumb questions | 20:43 |
| sdague | who are often part of other project teams | 20:43 |
| annegentle | sdague: ah okay so you're ahead of docs in that way I'd say | 20:43 |
| clarkb | mordred: did you see my comments on my change? | 20:43 |
| sdague | annegentle: I just assumed all the docs folks were super human. Because honestly I could never imagine keeping up with all of the projects at this point :) | 20:44 |
| mordred | clarkb: me lookie lookie | 20:44 |
| *** dstanek has joined #openstack-infra | 20:44 | |
| clarkb | mordred: and where I said my change I meant your change | 20:44 |
| *** msabramo has joined #openstack-infra | 20:44 | |
| mordred | clarkb: first comment - I added the key just the other day, so I'm fairly certain it's not in use for something else | 20:44 |
| annegentle | sdague: oh it's nuts and we do tend to get super human efforts around release time, but that's the unsustainable model :) | 20:44 |
| *** cody-somerville has quit IRC | 20:45 | |
| mordred | clarkb: on the before- do you mind if we do that as a follow on? or do you think we should do it now? | 20:45 |
| annegentle | sdague: your qa contributions seem sustainable. I've got to write an email about pre-incubating and incubating projects and docs so this is all good research, thanks. | 20:45 |
| clarkb | mordred: well, I think it can happen as a followup | 20:46 |
| clarkb | since puppet should do it implicitly for us on file resource | 20:46 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Add a requirement on /root/.ssh https://review.openstack.org/87381 | 20:47 |
| mordred | clarkb: there ya go | 20:47 |
| *** MarkAtwood has quit IRC | 20:47 | |
| *** yamahata has joined #openstack-infra | 20:47 | |
| *** nati_ueno has quit IRC | 20:48 | |
| openstackgerrit | Marc Abramowitz proposed a change to openstack-infra/jenkins-job-builder: Add tox "coverage" target https://review.openstack.org/87382 | 20:48 |
| *** sarob has joined #openstack-infra | 20:49 | |
| mordred | ok. I've gotta run | 20:50 |
| openstackgerrit | Ramy Asselin proposed a change to openstack-infra/config: nodepool image update works behind a http proxy https://review.openstack.org/87384 | 20:51 |
| *** nati_uen_ has joined #openstack-infra | 20:52 | |
| * zaro takes a walk. | 20:52 | |
| *** MIDENN_ has joined #openstack-infra | 20:54 | |
| openstackgerrit | Marc Abramowitz proposed a change to openstack-infra/jenkins-job-builder: `test` command read/write stdin/stdout by default https://review.openstack.org/84778 | 20:55 |
| *** mdenny has quit IRC | 20:55 | |
| *** nati_uen_ has quit IRC | 20:56 | |
| msabramo | harlowja: Howdy Josh! | 20:56 |
| asselin | clarkb, fungi, jeblair, mattoliverau thanks for your help getting prepare_node to work behind a http proxy. I just submitted my solution: https://review.openstack.org/87384 | 20:56 |
| *** Sukhdev has joined #openstack-infra | 20:57 | |
| *** fbo is now known as fbo_away | 20:59 | |
| *** markmcclain has joined #openstack-infra | 21:00 | |
| *** nati_ueno has joined #openstack-infra | 21:00 | |
| *** mfer has quit IRC | 21:01 | |
| *** nati_ueno has quit IRC | 21:01 | |
| *** nati_ueno has joined #openstack-infra | 21:02 | |
| openstackgerrit | Ramy Asselin proposed a change to openstack-infra/config: nodepool image update works behind a http proxy https://review.openstack.org/87384 | 21:06 |
| *** sabari2 has quit IRC | 21:07 | |
| dhellmann | mordred, clarkb, jeblair : is there any chance I could get one of you to look at https://review.openstack.org/#/c/85487/ tonight or tomorrow morning? SergeyLukjanov left +2 but I lost fungi's when I had to rebase. | 21:08 |
| harlowja | msabramo howdy! | 21:12 |
| msabramo | harlowja: all you tigers seem to have landed in OpenStack. Amazing. | 21:14 |
| harlowja | msabramo hey :) | 21:15 |
| harlowja | ya | 21:15 |
| harlowja | some of them ;) | 21:15 |
| harlowja | *not all* | 21:15 |
| harlowja | haha | 21:15 |
| msabramo | harlowja: Sure. I see. As soon as I leave Yahoo, *then* you guys all start using Python ;-) | 21:15 |
| harlowja | ;) | 21:15 |
| harlowja | well somewhat, lol | 21:15 |
| msabramo | well maybe "as soon" was several years in fact :-) | 21:16 |
| *** ameade has quit IRC | 21:16 | |
| harlowja | well also python still not super-approved, we have special rights | 21:16 |
| harlowja | its dumb still | 21:16 |
| harlowja | lol | 21:16 |
| harlowja | *still somewhat dumb* | 21:16 |
| *** ameade has joined #openstack-infra | 21:16 | |
| harlowja | not all perfect yet, lol | 21:17 |
| *** imcsk8_l1p has quit IRC | 21:17 | |
| *** imcsk8_lap has joined #openstack-infra | 21:17 | |
| harlowja | msabramo u can help make https://wiki.openstack.org/TaskFlow :-P | 21:17 |
| harlowja | make it even better :-P | 21:17 |
| *** melwitt has quit IRC | 21:18 | |
| *** marcoemorais has joined #openstack-infra | 21:18 | |
| *** melwitt has joined #openstack-infra | 21:18 | |
| *** jeckersb is now known as jeckersb_gone | 21:20 | |
| harlowja | marcoemorais msabramo more tigers, ha | 21:20 |
| *** ameade has quit IRC | 21:22 | |
| *** sdake_ has joined #openstack-infra | 21:27 | |
| openstackgerrit | Derek Higgins proposed a change to openstack-infra/config: Add a check for nova-docker https://review.openstack.org/86910 | 21:27 |
| msabramo | Cool! marcoemorais too! Hello as well! | 21:27 |
| *** sarob has quit IRC | 21:28 | |
| marcoemorais | harlowja msabramo howdy! | 21:30 |
| harlowja | marcoemorais hi! | 21:30 |
| marcoemorais | harlowja: (as he looks at my cube) | 21:31 |
| harlowja | uma can be found somewhere, though not usually on irc | 21:31 |
| harlowja | and ed and ken sometimes to | 21:31 |
| *** dcramer_ has joined #openstack-infra | 21:32 | |
| msabramo | ok so we should just rename this channel to #tiger_reunion :) | 21:32 |
| *** dkehnx has quit IRC | 21:33 | |
| *** MarkAtwood has joined #openstack-infra | 21:34 | |
| *** aconrad has quit IRC | 21:35 | |
| *** aconrad has joined #openstack-infra | 21:35 | |
| *** dcramer_ has quit IRC | 21:36 | |
| *** nkinder has joined #openstack-infra | 21:39 | |
| harlowja | ha | 21:40 |
| clarkb | dhellmann: that change is really dense :P so my biggest concern off the bat is it looks like we are adding a ton of new tests | 21:41 |
| clarkb | dhellmann: looks like this is almost doubling the number of tests we run? | 21:41 |
| clarkb | and we already fell over when down to one cloud provider... | 21:42 |
| dhellmann | I don't know about doubling, I don't know the base number | 21:42 |
| clarkb | jeblair: mordred SergeyLukjanov ^ is that somethign we should be worried about | 21:42 |
| clarkb | dhellmann: it looks like between 2 and 5 new tests per project | 21:42 |
| dhellmann | the goal is to avoid the issue we had with oslo.config during icehouse where releases broke unit tests in applications because of subtle internal details changing | 21:42 |
| clarkb | ya, I think it tackles a real problem, but I am not sure this is sustainable | 21:43 |
| *** pcrews_ has joined #openstack-infra | 21:43 | |
| dhellmann | yeah, SergeyLukjanov had similar feedback | 21:43 |
| dhellmann | we talked about figuring out if there's a way to run all of the tests for an application in one job (cross test it against one lib at a time, but all in one job) | 21:44 |
| dhellmann | and vice versa, I guess | 21:44 |
| *** mrmartin has joined #openstack-infra | 21:44 | |
| dhellmann | I'm not sure if that's any better -- the jobs might take a long time that way, does that matter? | 21:44 |
| *** dkehn_ has joined #openstack-infra | 21:44 | |
| clarkb | ya people get cranky when tests take a long time | 21:45 |
| * dhellmann is people | 21:45 | |
| clarkb | but they also get cranky when we go from two cloud providers down to one and tests queue for hours | 21:45 |
| * dhellmann hates people | 21:45 | |
| *** dkehn_ is now known as dkehnx | 21:46 | |
| harlowja | peopel sux | 21:46 |
| dhellmann | fwiw, I share your concern | 21:46 |
| dhellmann | this is the best we've been able to come up with, so far :-/ | 21:46 |
| *** pcrews has quit IRC | 21:46 | |
| sdague | what if we did what we do with d-g, and have the unit tests run on the projects with the git versions of this libs | 21:46 |
| dhellmann | some of the libs that don't change often wouldn't need to have every app tested against them, so that's one area we can cut down later on | 21:46 |
| dhellmann | but the big ones, like config and messaging, I think we want those in the mix | 21:47 |
| dhellmann | i18n maybe less so | 21:47 |
| clarkb | I am reviewing it and willing to give it a shot, but also pointing on the concerns as I go | 21:47 |
| clarkb | s/on/out/ | 21:47 |
| sdague | then you'd just be adding a bunch of tests on the oslo* side to by symetric | 21:47 |
| dhellmann | sdague: yeah, these are all symmetric now | 21:47 |
| sdague | right, but they are symetric by adding jobs to the projects | 21:47 |
| sdague | vs. changing the existing jobs | 21:47 |
| dhellmann | what if the unit test jobs in the gate installed oslo libs from source instead of pypi? | 21:48 |
| sdague | right | 21:48 |
| *** nkinder has quit IRC | 21:48 | |
| sdague | that's just a ton of nodes to burn to block bugs that should be easily resolvable | 21:49 |
| dhellmann | yep | 21:49 |
| dhellmann | ok, I guess I can look at changing the tox job definition to do that | 21:49 |
| *** chuck_ has joined #openstack-infra | 21:50 | |
| dhellmann | it'll have to be smart about finding a list of requirements to update, by knowing what's an oslo lib somehow | 21:50 |
| sdague | sure | 21:50 |
| dhellmann | and I suppose it's going to piss people off if the tests work locally but not in the gate | 21:50 |
| dhellmann | so we need some way for them to do the same thing on their local system | 21:51 |
| *** zul has quit IRC | 21:51 | |
| dhellmann | if they want, that is | 21:51 |
| *** mrmartin has quit IRC | 21:52 | |
| * dhellmann considers naming the script folgers.sh ("we've replaced their normal coffee with...") | 21:52 | |
| *** jhesketh has joined #openstack-infra | 21:52 | |
| *** mriedem has quit IRC | 21:53 | |
| jeblair | if we run all the unit tests in one job, won't it lake a very long time? | 21:53 |
| jhesketh | Morning | 21:53 |
| jeblair | sdague, dhellmann: eg, don't we already have 30-40 minute unit tests runs for a single project? | 21:53 |
| *** chuck_ has quit IRC | 21:53 | |
| *** zul has joined #openstack-infra | 21:53 | |
| jeblair | jhesketh: good morning | 21:53 |
| clarkb | jhesketh: o/ | 21:53 |
| dhellmann | jeblair: yes, we would still need separate jobs for the oslo libs | 21:53 |
| jhesketh | how's pycon going? | 21:54 |
| sdague | jeblair: yes, the neutron unit tests can hit 60 minutes on py26 4x | 21:54 |
| dhellmann | jeblair: but the new idea is to just install oslo libs from source when running the unit tests for an app | 21:54 |
| jeblair | dhellmann: oh in the normal jobs? | 21:54 |
| dhellmann | jeblair: so there's only one unit test job, and it always runs from source -- or maybe we add a 2nd to do that? | 21:54 |
| mgagne | jeblair: any ETA for that one? https://review.openstack.org/#/c/86627/ | 21:55 |
| *** Sukhdev_ has joined #openstack-infra | 21:55 | |
| jeblair | dhellmann: hrm, i worry about that a bit; i think one of our goals is to make sure that projects work with their specified deps | 21:55 |
| dhellmann | jeblair: yeah, the more I think of it the more I think a second job works better | 21:56 |
| dhellmann | one with deps from pypi and a second with oslo deps from source overriding the pypi packages | 21:56 |
| *** eharney has quit IRC | 21:56 | |
| dhellmann | s/pypi/our mirror/g | 21:56 |
| *** bhuvan has joined #openstack-infra | 21:57 | |
| jeblair | jhesketh: i'm back from pycon now; others are still there for the sprints | 21:57 |
| *** zul has quit IRC | 21:57 | |
| *** Sukhdev__ has joined #openstack-infra | 21:57 | |
| jeblair | mgagne: it looks like we were too short-staffed to import that on friday | 21:57 |
| jhesketh | jeblair: ah, you're missing the fun! (I'm assuming :-P). How was the conf main? | 21:57 |
| *** Sukhdev_ has quit IRC | 21:57 | |
| *** dims has quit IRC | 21:57 | |
| *** Ryan_Lane has quit IRC | 21:57 | |
| jeblair | mgagne: i think it was just clarkb and mordred on friday, and i guess they didn't get to it | 21:58 |
| *** asettle has joined #openstack-infra | 21:58 | |
| mgagne | jeblair: next friday? =) | 21:58 |
| clarkb | I am going to give it a try tomorrow | 21:58 |
| jeblair | mgagne: so next chance is next friday, or, it's possible mordred's fixes to manage-projects may be close to ready, in which case it can happen as soon as they merge and we start that | 21:58 |
| clarkb | if there are no objects to that | 21:58 |
| *** Sukhdev has quit IRC | 21:58 | |
| jeblair | clarkb: give what a try? | 21:59 |
| clarkb | manage-projects | 21:59 |
| jeblair | clarkb: manually, or trying mordred's thing? | 21:59 |
| dhellmann | sdague, jeblair, clarkb : I'll take a stab at defining the oslo-ified-unit-test job tomorrow, if you think that's a better approach? | 21:59 |
| clarkb | initially was thinking manually but mordreds thing is close too, can probably give the switchover a shot too | 21:59 |
| jeblair | jhesketh: i spent pretty much the entire time talking to people | 21:59 |
| sdague | dhellmann: it seems like we can get coverage with only 1 extra job per core project, which is good | 21:59 |
| clarkb | dhellmann: not sure, I am willing to give the current change a shot if others are on board | 21:59 |
| clarkb | but the proposed idea sounds good | 22:00 |
| dhellmann | sdague: yeah, we still need N jobs for the libs themselves, but only for integrated projects | 22:00 |
| clarkb | this matrix checker is good I think | 22:01 |
| jeblair | dhellmann: i think i have a gap in my conception -- | 22:01 |
| *** markmcclain has quit IRC | 22:01 | |
| clarkb | doesn't add any new config which is nice | 22:01 |
| sdague | dhellmann: explain? just to make sure we're on the same page | 22:01 |
| jeblair | dhellmann: what can, eg, nova do to break working with oslo.test? | 22:01 |
| *** UtahDave has joined #openstack-infra | 22:01 | |
| dhellmann | sdague: I want oslo.messaging changes gated on the unit tests of every app that uses it, so we don't break those apps with a new release | 22:01 |
| sdague | dhellmann: sure | 22:02 |
| jeblair | (in the delta from latest-release to master) | 22:02 |
| *** sarob has joined #openstack-infra | 22:02 | |
| jeblair | dhellmann: that part makes perfect sense to me | 22:02 |
| dhellmann | jeblair: if nova makes an assumption about how oslo.test works, we need to prevent changes to oslo.test that would break nova's unit tests | 22:02 |
| jeblair | in fact, we've talked about doing that for certain third party libraries | 22:02 |
| jeblair | dhellmann: so basically, from a really high level view, we're trying to identify/prevent api violations (or identify areas where the api is unclear)? | 22:03 |
| dhellmann | a specific example we had was neutron's tests using a private data member in a cliff class, so when cliff renamed that member their tests started breaking | 22:03 |
| dhellmann | so it was private, and they shouldn't have been mocking it, but they did and that caused a lot of heartburn when we cut a release months after making the change to cliff | 22:04 |
| dhellmann | took us a while to figure out the cause of the issue | 22:04 |
| *** om has joined #openstack-infra | 22:04 | |
| *** amcrn has quit IRC | 22:04 | |
| jeblair | dhellmann: but that is much more likely to show up in the gate-oslo-on-project side, not the other way around, right? | 22:05 |
| dhellmann | we have a gap now between the code being tested in an app and the master branch of any given library -- unless we cut a release on every merge, we'll always have a gap | 22:05 |
| sdague | dhellmann: sure, but there is a risk profile as well | 22:05 |
| dhellmann | sdague: I think every time we release oslo.config it breaks someone | 22:06 |
| sdague | right, but that's oslo.config releasing | 22:06 |
| sdague | not nova unit test adds | 22:06 |
| jeblair | aconrad: <jeblair@openstack.org> (it's a rather public address, no need to pm :), and thanks -- very much looking forward to to that | 22:06 |
| *** sarob has quit IRC | 22:07 | |
| aconrad | jeblair: I'm actually writing a blog post | 22:07 |
| aconrad | I'll send you the link soon | 22:07 |
| dhellmann | sdague: so you think we should just block lib changes on the way the apps are using them? because I'm not ok with that -- too many uses of private stuff in unit test mocks would keep us locked up in oslo | 22:07 |
| dhellmann | once I change something, I don't want new tests added that use the old form | 22:07 |
| sdague | dhellmann: ok, that's fair | 22:08 |
| clarkb | dhellmann: ++ | 22:08 |
| dhellmann | because most of the devs on the other projects aren't paying attention to internals of the libs, and end up copying behavior from other places | 22:08 |
| sdague | so we're really then talking about py27git | 22:08 |
| jeblair | dhellmann: i'm just thinking that nothing about this actually stops someone from adding use of a private member in a project | 22:08 |
| clarkb | jeblair: it will because it gates changes symetrically | 22:08 |
| dhellmann | jeblair: no, it doesn't, but at least this way I can find them before I break things with a release | 22:08 |
| clarkb | so you can't add them in the first place | 22:08 |
| sdague | jeblair: that's true, it only stops them adding more uses after it's removed | 22:08 |
| clarkb | er oh I see | 22:08 |
| jeblair | dhellmann: if someone adds a ref to oslo.messaging._foo in neutron, it will pass the proposed test | 22:08 |
| clarkb | ya you are right | 22:08 |
| clarkb | it prevents code from breaking, not private access | 22:08 |
| sdague | jeblair: it's the backslide issue | 22:08 |
| dhellmann | yes, that's right, and if I rename _foo to _bar then I'll know to go fix their bad test | 22:09 |
| sdague | where oslo.config tries to remove something | 22:09 |
| sdague | it breaks neutron | 22:09 |
| sdague | they fix neutron | 22:09 |
| sdague | and remove it | 22:09 |
| sdague | but if it's not enforced on the neutron side, it might backslide | 22:09 |
| sdague | because oslo.config isn't released with that change yet | 22:09 |
| jeblair | sdague, dhellmann: yes, but perhaps this happens rarely enough that in such a case you could release? | 22:10 |
| sdague | jeblair: that would be another option | 22:10 |
| dhellmann | sure, the other thing I thought of doing was weekly alpha releases | 22:10 |
| dhellmann | every monday, say | 22:10 |
| *** dims has joined #openstack-infra | 22:10 | |
| dhellmann | that felt onerous, but maybe I can automate that | 22:10 |
| sdague | dhellmann: why? | 22:11 |
| dhellmann | or delegate | 22:11 |
| jeblair | new-project-friday and break-everything-monday. ;) | 22:11 |
| dhellmann | jeblair: right | 22:11 |
| sdague | I mean why do alpha releases | 22:11 |
| sdague | if you test git, just cut a new minor release | 22:11 |
| *** prad has quit IRC | 22:11 | |
| sdague | I feel like in the ci world, alpha releases don't do anyone any good | 22:11 |
| *** gondoi is now known as zz_gondoi | 22:11 | |
| sdague | because the machines are consuming it | 22:11 |
| dhellmann | sdague: markmc and I have this discussion periodically. For the oslo.* libs he started going official releases with the apps | 22:11 |
| dhellmann | sdague: yeah, that was another issue; I didn't know if we had alpha wheel publishing to our mirror working properly or not | 22:12 |
| sdague | yes, and I think that's an idea whose time has passed | 22:12 |
| sdague | because if we are publishing 10 libraries only at the release boundaries... | 22:12 |
| sdague | stop making it 10 libraries | 22:12 |
| dhellmann | sdague: http://summit.openstack.org/cfp/details/69 | 22:12 |
| sdague | just call it oslo | 22:13 |
| sdague | and be 1 git tree | 22:13 |
| jesusaurus | why is config stuck on such an old version of the apache module? | 22:13 |
| clarkb | btw https://bitbucket.org/hpk42/tox/issue/150/posargs-configerror#comment-9664854 we may have a fix for the posargs thing. I still think it is the wrong fix (and way over thought, why is shlex not appropriate?) because it isn't a generic fix. It is posargs specific | 22:13 |
| dhellmann | sdague: I need to split up the tree so I can have different expert groups managing the libs | 22:13 |
| clarkb | jesusaurus: because the new apache module versions are terrible and remove features | 22:13 |
| *** Sukhdev__ has quit IRC | 22:14 | |
| sdague | dhellmann: you can't enforce that by culture? | 22:14 |
| clarkb | jesusaurus: with 0.4 you can provide a vhost template and do whatever you want | 22:14 |
| jesusaurus | clarkb: what features? | 22:14 |
| clarkb | jesusaurus: with new apache you are beholden to whatever the module has implemented | 22:14 |
| dhellmann | sdague: but the idea of just using regular releases would work ok | 22:14 |
| dhellmann | sdague: maybe? | 22:14 |
| *** msabramo has quit IRC | 22:14 | |
| clarkb | jesusaurus: mod rewrite stuff is the big one, we do some non trivial thing with mod rewrite | 22:14 |
| openstackgerrit | Joshua Harlow proposed a change to openstack/requirements: Add wrapt library https://review.openstack.org/87395 | 22:15 |
| sdague | dhellmann: there are parts of the nova tree I'll never +2 code on, because I don't feel confident about it. And that's all culture enforced (not rules enforced) and generally works pretty well | 22:15 |
| *** mdenny has joined #openstack-infra | 22:15 | |
| * dhellmann nods | 22:15 | |
| *** MIDENN_ has quit IRC | 22:15 | |
| sdague | clarkb: there is a config inject in the newest on | 22:16 |
| * dhellmann hears a drink calling from the other room | 22:16 | |
| jeblair | dhellmann: cheers! | 22:16 |
| clarkb | sdague: oh good, maybe it is useable again | 22:16 |
| sdague | custom_fragment | 22:16 |
| *** pcrews_ has quit IRC | 22:16 | |
| sdague | I just switched over my linode to this this weekend, hit a few bumps, but seems ok | 22:17 |
| *** zul has joined #openstack-infra | 22:17 | |
| clarkb | I still think the first release was the bset one :) | 22:17 |
| clarkb | it was simple and worked | 22:17 |
| sdague | on the upside, they take patches pretty quickly | 22:18 |
| jeblair | annegentle: sorry i was out for a bit; but mordred explained my (our i guess?) position very well i thought. but let me know if you have any further questions. after all, i was trying to make sure people understood how i think about things. :) | 22:19 |
| sdague | I've submitted 2 PRs, and in both cases they were merged in < 48hrs | 22:19 |
| jeblair | zaro: would you mind preparing an etherpad for tomorrow's infra meeting with the outstanding changes and any decisions we still need to make for gerrit 2.8? | 22:20 |
| clarkb | sdague: I think that may be why 0.4 was the best release :) | 22:20 |
| clarkb | sdague: too much merging and less thinking about useability | 22:20 |
| sdague | heh | 22:20 |
| jeblair | zaro: i think we'll be focusing on that for the next couple of weeks, so it's time to make sure we have everything in order | 22:20 |
| clarkb | which is a nice to contributors but not necessary a good thing overall | 22:20 |
| sdague | yeh, the current one is definitely a world view | 22:20 |
| mnaser | this place is sure as hell more active than #openstack-dev :p | 22:20 |
| *** sarob has joined #openstack-infra | 22:21 | |
| sdague | I thought about going my own here, but felt useful to understand it's quirks | 22:21 |
| *** zul has quit IRC | 22:21 | |
| jeblair | mnaser: oh hi! i saw you took that nova bug :) | 22:21 |
| *** zul has joined #openstack-infra | 22:21 | |
| mnaser | jeblair: hey, actually i got most of the patch done, just need to fix the tests :) | 22:21 |
| mnaser | added a reported_at field which is relied on instead of updated_at | 22:21 |
| jeblair | mnaser: and i did some fun nova debugging during a devstack walkthrough at pycon | 22:22 |
| *** slagle has quit IRC | 22:22 | |
| mnaser | heh, yeah, the patch turned out to be huge so far lol | 22:22 |
| clarkb | sdague: I think a lot of puppetmodules go overboard in making every little thing expressed in puppet DSL which means you lag in actual features | 22:22 |
| jeblair | i now think that all devstack walkthroughs should have lab equipment that kernel panics just to keep things interesting ;) | 22:22 |
| mnaser | the bigger the changes, the more worried i get from git review | 22:22 |
| mnaser | :p | 22:23 |
| clarkb | sdague: it certainly makes things very puppety but presumably if I need apache I can edit a vhost file | 22:23 |
| sdague | clarkb: I agree. There are actually some goofy wrong values in here because of it | 22:23 |
| *** praneshp has quit IRC | 22:23 | |
| jeblair | mnaser: one thing you can do is to keep a local branch with lots of little commits and then squash that for git review; that way if it gets out of hand, you still have incremental history | 22:23 |
| *** slagle has joined #openstack-infra | 22:23 | |
| mnaser | jeblair: i'm not as worried about that as much as i'm worried about being told "well this doesn't look like, do it this way" :p | 22:24 |
| clarkb | jeblair: you can install kernel drivers to induce kernel panics :) should be easy to set that up | 22:24 |
| sdague | jeblair: nice. What was the context of the devstack walkthrough? | 22:24 |
| *** zul has quit IRC | 22:24 | |
| *** chuck_ has joined #openstack-infra | 22:25 | |
| *** praneshp has joined #openstack-infra | 22:25 | |
| *** sarob has quit IRC | 22:26 | |
| *** rlandy has quit IRC | 22:26 | |
| mnaser | jeblair: http://paste.openstack.org/show/75722/ - far from a "trivial" fix | 22:26 |
| mnaser | haha | 22:26 |
| mnaser | (still not done, need more work as some tests are failing because of the extra field added) | 22:27 |
| jeblair | sdague: the rax user exp folks did sort of a drop-in lab environment. most people were in the 'new to openstack' camp, a few were ready to hack on something so hands-on with devstack was helpful for them | 22:27 |
| *** jergerber has quit IRC | 22:27 | |
| *** mrmartin has joined #openstack-infra | 22:27 | |
| *** denis_makogon has quit IRC | 22:27 | |
| sdague | nice | 22:27 |
| *** om has quit IRC | 22:28 | |
| mnaser | sdague: we actually discovered a bug in nova in that small 2 hours | 22:28 |
| zaro | jeblair: will do. | 22:28 |
| sdague | cool | 22:29 |
| jeblair | mnaser: yeah, it changes a few things ;) but from what i've seen (i'm far from a nova expert here), the approach of separating the record update time from downtime detection sounds like it deserves serious consideration | 22:29 |
| jeblair | mnaser runs a cloud provider in montreal | 22:30 |
| *** pcrews_ has joined #openstack-infra | 22:30 | |
| mnaser | jeblair: the point of updated_at is to give the time the record was last updated, not the time it last reported | 22:30 |
| mnaser | probably one of the biggest changes i've written so let's hope it goes through reviews well, heh (once it's all done) | 22:30 |
| jeblair | mnaser: yep | 22:31 |
| *** marun has quit IRC | 22:31 | |
| mnaser | got busy with other stuff but i'll hack at it later tonight and finish it hopefully | 22:31 |
| jeblair | cool, nice to see you around here! :) | 22:32 |
| mnaser | likewise! :) | 22:32 |
| *** chuck_ is now known as zul | 22:34 | |
| sdague | jeblair: you have a moment to ponder the branchless tempest implications? | 22:35 |
| jeblair | sdague: i have been doing that for the past few minutes in fact! :) | 22:37 |
| *** sarob has joined #openstack-infra | 22:37 | |
| sdague | :) | 22:37 |
| jeblair | sdague: just read the spec; agree with everything and anticipate no issues. i'm worried that means i'm tired. :) | 22:37 |
| jeblair | i mean, not no issues, but you know, no disagreements on approach or anything... of course there will be issues.... | 22:38 |
| jeblair | sdague: one thing that comes to mind... | 22:38 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Make jenkins proposal jobs use dedicated user. https://review.openstack.org/87026 | 22:38 |
| jeblair | sdague: is that we should try to keep the feature-flag enabling logic nice and modular/compartmentalized in devstack-gate | 22:38 |
| *** gokrokve has quit IRC | 22:38 | |
| clarkb | jeblair: ^ I apparently missed a comma when I did the first pass of that chang | 22:38 |
| *** derekh has joined #openstack-infra | 22:39 | |
| clarkb | jeblair: everything outside of puppet is ready for it, any chance I can get a rereview? | 22:39 |
| sdague | jeblair: right, that's actually what I wanted to hit you up about | 22:39 |
| jeblair | sdague: since it's currently doing double-duty as "way to set up lots of projects together" and "way to configure devstack/tempest" | 22:39 |
| sdague | because feature-flag logic is going to include *every* extension (82 extensions in nova as of icehouse) | 22:39 |
| jeblair | i think the long term evolution of that is something like hashar's setup script, but it's not quite ready yet | 22:39 |
| sdague | which means I think we need to move that logic out of bash | 22:39 |
| clarkb | sdague: api extensions? | 22:39 |
| sdague | clarkb: yes | 22:39 |
| sdague | api extensions, by definition, are optional | 22:40 |
| jeblair | sdague: non-bash sounds fine for me | 22:40 |
| *** Ryan_Lane has joined #openstack-infra | 22:41 | |
| sdague | jeblair: ok, so I had this idea for having a yaml definition of the matrix which we could process in python into a string that we get back into the existing d-g scripts | 22:41 |
| sdague | all in the d-g repo | 22:41 |
| jeblair | sdague: what happens with that string? | 22:41 |
| sdague | ENABLED_SERVICES | 22:41 |
| sdague | and a set of vars for the extensions lists | 22:41 |
| *** reed has quit IRC | 22:41 | |
| sdague | that pass through to tempest | 22:42 |
| *** adalbas has quit IRC | 22:42 | |
| jeblair | sdague: ok. should we think about having this script do more of what's already there? (localrc generation, etc?) | 22:42 |
| sdague | jeblair: that's possible | 22:42 |
| sdague | I mostly wanted to solve the more immediate problem first | 22:42 |
| sdague | so I was going for taking over the minimum amount of function | 22:43 |
| jeblair | sdague: okay. that sounds good, and i'm open to more of that. i suspect the long term evolution of d-g is that we move the 'set up git repos' part out of it and into a general purpose tool, and what's in d-g shrinks back down to "set up different ways of running tempest" | 22:43 |
| jeblair | and i think all this fits into that well | 22:43 |
| sdague | yep, that sounds good | 22:43 |
| jeblair | sdague: https://review.openstack.org/#/c/86577/ +1 | 22:44 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Hard delte for tasks https://review.openstack.org/86531 | 22:44 |
| jeblair | sdague: and thanks! | 22:44 |
| sdague | the main reason we'll have to generate an explicit extension list is the feature flag for tempest for compute_extensions defaults to 'all' | 22:44 |
| *** sabari2 has joined #openstack-infra | 22:44 | |
| sdague | but the moment nova wants to test a new extension that's juno only, we'll actually have to make stable/icehouse default to the list (- that extension) | 22:45 |
| *** mrodden has quit IRC | 22:45 | |
| jeblair | sdague: it might be worth considering how this affects the "run stack.sh" base case -- will running devstack with pure defaults still be tested adequately? | 22:45 |
| clarkb | I was thinking taht the flag could be more optparsy too to be less hackish | 22:45 |
| clarkb | then instead of evaluating some env vars one at a time optparse could set the flags and we could make smarter choices | 22:46 |
| sdague | jeblair: that's a good question. it would only impact stable/* branches of devstack | 22:46 |
| *** gokrokve has joined #openstack-infra | 22:46 | |
| sdague | it is possible that we could handle this there instead | 22:47 |
| sdague | however.... | 22:47 |
| sdague | doing it in d-g might actually solve things like cells testing | 22:47 |
| sdague | because we could just make a much shorter api extension list | 22:47 |
| sdague | which it should pass | 22:47 |
| sdague | because there are only supposed to be a few extensions that it can't work with | 22:48 |
| jeblair | clarkb: the env vars are getting a wee bit out of hand... :) | 22:48 |
| clarkb | ya | 22:48 |
| clarkb | optparse won't fix all of the problems with this but may make it a bit more clear and maintainable | 22:48 |
| *** aconrad has quit IRC | 22:48 | |
| *** gokrokve has quit IRC | 22:48 | |
| *** dizquierdo has quit IRC | 22:48 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Collate story metadata for status https://review.openstack.org/86452 | 22:48 |
| *** nati_ueno has quit IRC | 22:49 | |
| derekh | Anybody know why that first 5 jobs in the check-tripleo queue are still there? looks to me like they finished ages ago | 22:49 |
| sdague | my thinking about the yaml matrix is to let options both add and *remove* items. So we could start with base cases and go both directions | 22:49 |
| *** nati_ueno has joined #openstack-infra | 22:49 | |
| clarkb | derekh: the tripleo-f20 job is still runnin | 22:49 |
| sdague | like defining base case with n-net enabled, and neutron case adds all the q-* services and removes n-net | 22:49 |
| sdague | which would help on some of the else logic | 22:49 |
| sdague | anyway, I'll provide a sketch | 22:49 |
| sdague | and we'll review from there | 22:49 |
| jeblair | sdague: yeah that sounds good | 22:50 |
| clarkb | derekh: oh huh, finished 11 hours ao | 22:50 |
| derekh | clarkb: not acording to jenkins | 22:50 |
| clarkb | and zuul didn't see it | 22:50 |
| clarkb | jeblair: ^ | 22:50 |
| * clarkb finds logs | 22:50 | |
| sdague | and it's dinner time, so see folks in the morning | 22:50 |
| *** wenlock has quit IRC | 22:50 | |
| jeblair | sdague: bon appetit | 22:50 |
| jeblair | i'm not sure "finished" is the best way to describe that job's current state | 22:52 |
| jeblair | the console log ends with: | 22:52 |
| jeblair | 2014-04-14 12:20:55.547 | Waiting for the overcloud stack to be ready | 22:52 |
| jeblair | 2014-04-14 12:20:55.586 | + wait_for_stack_ready 300 10 overcloud | 22:52 |
| jeblair | and lacks the normal jenkins job result boilerplate | 22:53 |
| jeblair | clarkb: so there are no logs from the jenkins master | 22:54 |
| jeblair | i think they may be owned by the wrong user | 22:54 |
| jeblair | which may be the result of some previous jenkins deb package fubaring | 22:55 |
| clarkb | jeblair: jenkins.o.o had log issues too, I restarted it and it became happy | 22:55 |
| *** jerryz has joined #openstack-infra | 22:55 | |
| clarkb | but the log permissions on jenkins.o.o looked fine. I figured it may have been rlated to loading configs off of disk | 22:56 |
| clarkb | but it may be the upgrade fubar too | 22:56 |
| jeblair | jenkins06 is running no jobs and has no active slaves | 22:56 |
| clarkb | oh huh, it must be really wedged then | 22:56 |
| clarkb | it has a lot of offline slaves | 22:56 |
| *** sarob has quit IRC | 22:57 | |
| jeblair | seems it's the only one | 22:57 |
| jeblair | i will stop it, remove all slaves from config, then start | 22:57 |
| *** dims has quit IRC | 22:57 | |
| clarkb | fwiw zuul didn't really get anything new from that test on 86315,2 | 22:57 |
| clarkb | jeblair: ok | 22:57 |
| clarkb | so zuul's logs are quiet too | 22:57 |
| *** sarob has joined #openstack-infra | 22:57 | |
| *** asettle is now known as alex-afk | 22:57 | |
| jeblair | clarkb: yeah, i suspect everything is still connected and idle, waiting for something to happen on 06; but hard to diagnose what without logs. | 22:57 |
| *** adalbas has joined #openstack-infra | 22:57 | |
| jeblair | we could try to look at stacktraces, but i don't want to without logs | 22:58 |
| clarkb | ya | 22:58 |
| clarkb | it is a lot of noise without logs | 22:58 |
| jeblair | i expect that to cause something to happen with the jobs in zuul | 22:58 |
| jeblair | either failing or restarting | 22:58 |
| jeblair | but apparently not | 22:59 |
| *** yamahata has quit IRC | 23:01 | |
| *** sarob has quit IRC | 23:01 | |
| jeblair | we might need to check on tcp keepalives in gear | 23:02 |
| *** mbacchi has quit IRC | 23:02 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Collate story metadata for status https://review.openstack.org/86452 | 23:02 |
| *** doddstack has joined #openstack-infra | 23:03 | |
| jeblair | clarkb: i'll restart zuul to clean that up, then re-enqueue | 23:04 |
| jeblair | sound good? | 23:04 |
| *** thedodd has quit IRC | 23:04 | |
| jeblair | good. :) | 23:05 |
| *** jamielennox|away is now known as jamielennox | 23:06 | |
| *** mrodden1 has joined #openstack-infra | 23:06 | |
| jeblair | restarting jenkins06 | 23:06 |
| clarkb | jeblair: yes sounds good | 23:06 |
| jeblair | which is now logging | 23:06 |
| clarkb | I have to say finding the login page for the openstack foundation is hard | 23:07 |
| clarkb | but its under 'profile' not foundation | 23:07 |
| *** melwitt has quit IRC | 23:07 | |
| *** doddstack has quit IRC | 23:08 | |
| *** ameade has joined #openstack-infra | 23:09 | |
| *** mwagner_lap has joined #openstack-infra | 23:11 | |
| *** bknudson has quit IRC | 23:12 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Run check-tripleo jobs on stale changes https://review.openstack.org/85854 | 23:13 |
| clarkb | I am going to afk soon | 23:14 |
| clarkb | jeblair: need me to help with any of the jenkins stuff? | 23:14 |
| jeblair | clarkb: all done; no worries | 23:14 |
| jeblair | derekh: ^ | 23:15 |
| clarkb | the sun is being sunny and I need to run more errands | 23:15 |
| openstackgerrit | A change was merged to openstack-infra/config: Reduce number of files send for propose_translation https://review.openstack.org/82573 | 23:15 |
| clarkb | but hey the spot on the back of my eye isn't melanoma so bring on the sun \o/ | 23:15 |
| jeblair | mordred: your run puppet over ssh has 2x+2s; you want to merge that yourself when you're ready to take care of it? | 23:16 |
| *** lcostantino has quit IRC | 23:16 | |
| jeblair | clarkb: yay it's not melanoma! at least, not yet! :) | 23:16 |
| clarkb | apparently sun exposure isn't correlated to melanoma of the eyeball so shouldn't worry about the sun at all in that way | 23:17 |
| *** dcramer_ has joined #openstack-infra | 23:17 | |
| derekh | jeblair: clarkb thanks | 23:18 |
| *** sabari2 has quit IRC | 23:18 | |
| *** dcramer_ has left #openstack-infra | 23:19 | |
| *** dcramer_ has joined #openstack-infra | 23:19 | |
| *** gokrokve has joined #openstack-infra | 23:21 | |
| *** nati_ueno has quit IRC | 23:21 | |
| *** dims has joined #openstack-infra | 23:22 | |
| nibalizer | mordred: i stll don't understand why the updatepuppetmaster and run the world cron is a 15 minute cron with a random splay | 23:22 |
| *** nati_ueno has joined #openstack-infra | 23:22 | |
| nibalizer | can you explain that? | 23:22 |
| jhesketh | clarkb: if you have a chance to look at this review I'd greatly appreciate it: https://review.openstack.org/#/c/85540/ | 23:23 |
| *** mrmartin has quit IRC | 23:23 | |
| clarkb | jhesketh: looking | 23:23 |
| jhesketh | you, sir, are a good person :-) | 23:23 |
| *** flaper87 is now known as flaper87|afk | 23:23 | |
| clarkb | hrm do we know if fungi swapped those creds yet? | 23:24 |
| *** mrodden has joined #openstack-infra | 23:24 | |
| *** alex-afk is now known as asettle | 23:24 | |
| jerryz | Hi folks, what do i need to do to get a stackforge project monitored by jeepyb hook that integrates with launchpad? | 23:25 |
| *** atiwari has quit IRC | 23:26 | |
| *** pdmars_ has quit IRC | 23:26 | |
| *** mrodden1 has quit IRC | 23:27 | |
| clarkb | jhesketh: doesn't look like fungi updated teh swift creds, I am going to +2 it but not approve until someone can swap out those credentials | 23:27 |
| clarkb | jhesketh: I need to run errands now but maybe jeblair can do that? | 23:28 |
| jhesketh | clarkb: okay, thanks :-) | 23:28 |
| clarkb | anyways +2 with that one todo item | 23:29 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Added status filter to story API https://review.openstack.org/87410 | 23:30 |
| *** blamar has quit IRC | 23:31 | |
| *** MarkAtwood has quit IRC | 23:32 | |
| *** wenlock has joined #openstack-infra | 23:33 | |
| jhesketh | ta | 23:34 |
| jerryz | I checked the jeepyb code , i believe the hook applies to every project as long as it is on review.o.o. but when i referenced a bug number in my commit message, comment didn't show up in launchpad | 23:37 |
| *** nati_ueno has quit IRC | 23:40 | |
| clarkb | jerryz does the project name on launchpad match the name on review.o.o? and you may need to add an account to the projects bug drivers group on lp | 23:41 |
| *** nati_ueno has joined #openstack-infra | 23:42 | |
| clarkb | I always forget which account it is but you can check other projects | 23:42 |
| jerryz | clarkb: the project does not match precisely with the one on launchpad | 23:42 |
| jerryz | clarkb: there are 2 sub projects on review.o.o and the prefix is the same | 23:42 |
| clarkb | in that case you need to map them in the config projects.yaml file | 23:43 |
| jerryz | clarkb: thank you. i will take a look | 23:44 |
| *** ianw has joined #openstack-infra | 23:47 | |
| *** ameade has quit IRC | 23:47 | |
| jerryz | clarkb: do you mean the group field in review.projects.yaml? | 23:47 |
| *** yamahata has joined #openstack-infra | 23:47 | |
| *** moted has quit IRC | 23:48 | |
| *** arborism has joined #openstack-infra | 23:49 | |
| *** vhoward has joined #openstack-infra | 23:51 | |
| *** moted has joined #openstack-infra | 23:52 | |
| *** ameade has joined #openstack-infra | 23:55 | |
| *** ameade has quit IRC | 23:55 | |
| *** yamahata has quit IRC | 23:56 | |
| *** Alexandra_ has joined #openstack-infra | 23:56 | |
| *** asettle has quit IRC | 23:56 | |
| *** Alexandra_ has quit IRC | 23:57 | |
| *** asettle has joined #openstack-infra | 23:57 | |
| *** arborism is now known as amcrn | 23:58 | |
| *** wchrisj has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!