Saturday, 2014-08-23

*** tomoe_ has quit IRC00:02
*** ArxCruz has quit IRC00:03
*** annegentle has joined #openstack-infra00:04
*** gyee has quit IRC00:07
*** ominakov has joined #openstack-infra00:08
*** ominakov has quit IRC00:10
openstackgerritAtin Ruia proposed a change to openstack-infra/jenkins-job-builder: Adding feature to specify the user id for jenkins user credentials  https://review.openstack.org/10972300:15
*** annegentle has quit IRC00:15
*** Sukhdev has quit IRC00:15
*** chuckC has joined #openstack-infra00:17
*** torandu has joined #openstack-infra00:18
*** tomoe_ has joined #openstack-infra00:18
*** marcoemorais has quit IRC00:21
*** praneshp has quit IRC00:22
*** IAX has quit IRC00:23
*** lcheng has joined #openstack-infra00:27
*** tonytan4ever has quit IRC00:28
*** annegentle has joined #openstack-infra00:36
*** baoli has joined #openstack-infra00:39
openstackgerritK Jonathan Harker proposed a change to openstack-infra/infra-specs: Put the puppet modules in their own projects/repos  https://review.openstack.org/9999000:42
*** bhuvan has quit IRC00:43
*** otherwiseguy has joined #openstack-infra00:43
*** baoli has quit IRC00:44
*** lcheng has quit IRC00:46
*** RicoLin has joined #openstack-infra00:48
harlowjahmmm, ya, looks like it didn't work, clarkb maybe a new template should be made bhy someone who is more of an expert on where it should go than me :-P00:50
harlowjaclarkb http://logs.openstack.org/88/116388/3/check/gate-config-layout/61a10ea/console.html00:50
*** annegentle has quit IRC00:51
*** bdpayne_ has quit IRC00:52
*** annegentle has joined #openstack-infra00:58
*** praneshp has joined #openstack-infra00:58
*** dimsum_ has joined #openstack-infra00:59
*** dims_ has joined #openstack-infra01:01
*** esker has joined #openstack-infra01:02
*** dimsum_ has quit IRC01:04
openstackgerritDarragh Bailey proposed a change to openstack-infra/jenkins-job-builder: Added recursive option  https://review.openstack.org/8510601:05
*** dims_ has quit IRC01:08
*** dimsum_ has joined #openstack-infra01:08
*** dane_leblanc has quit IRC01:10
*** pcm__ has quit IRC01:12
*** dimsum_ has quit IRC01:12
*** annegentle has quit IRC01:14
*** marcusvrn has joined #openstack-infra01:15
*** praneshp_ has joined #openstack-infra01:21
*** praneshp has quit IRC01:23
*** praneshp_ is now known as praneshp01:23
openstackgerritDarragh Bailey proposed a change to openstack-infra/jenkins-job-builder: Some tweaks to get closer to Python 3 compat  https://review.openstack.org/8781001:30
*** rcarrillocruz has quit IRC01:31
*** cad has joined #openstack-infra01:32
*** rcarrillocruz has joined #openstack-infra01:35
openstackgerritDarragh Bailey proposed a change to openstack-infra/jenkins-job-builder: Added recursive option  https://review.openstack.org/8510601:36
*** baoli has joined #openstack-infra01:39
*** baoli has quit IRC01:44
*** tomoe_ has quit IRC01:45
*** annegentle has joined #openstack-infra01:48
*** rick_ has joined #openstack-infra01:49
rick_anteaya: HI01:49
rick_clarkb: HI01:50
*** mwagner_lap has quit IRC01:51
*** annegentle has quit IRC01:53
*** Sukhdev has joined #openstack-infra01:56
*** gargola has quit IRC01:57
*** gargola has joined #openstack-infra01:57
*** stevemar has joined #openstack-infra01:57
charzanteaya: Just make sure, is our third party service account ready today?02:00
*** rick_ has quit IRC02:00
*** stevemar has quit IRC02:00
*** stevemar has joined #openstack-infra02:01
*** che-arne has quit IRC02:10
*** che-arne has joined #openstack-infra02:11
*** rcarrillocruz has quit IRC02:13
*** gargola has quit IRC02:13
*** harlowja_at_home has joined #openstack-infra02:14
*** jerryz has quit IRC02:14
*** dimsum_ has joined #openstack-infra02:15
*** rcarrillocruz has joined #openstack-infra02:17
*** otter768 has joined #openstack-infra02:25
*** harlowja is now known as harlowja_away02:27
*** pcrews has quit IRC02:27
*** RicoLin has quit IRC02:36
*** Ryan_Lane1 has quit IRC02:36
*** mmaglana has joined #openstack-infra02:39
*** Ryan_Lane1 has joined #openstack-infra02:39
*** trinaths has joined #openstack-infra02:40
*** baoli has joined #openstack-infra02:40
*** ramashri has quit IRC02:40
*** rpodolyaka1 has joined #openstack-infra02:43
trinathsHi All Good Morning/ Good Evening.02:45
*** baoli has quit IRC02:45
*** rick_ has joined #openstack-infra02:49
rick_Does anyone know how to debug macros.yami of jenins? Because I change example.yami to output console.log, it seems not work.02:50
*** otherwiseguy has quit IRC02:52
*** kmartin has quit IRC02:52
*** kmartin has joined #openstack-infra02:53
*** otherwiseguy has joined #openstack-infra02:53
*** harlowja_at_home has quit IRC02:54
*** rcarrillocruz has quit IRC02:56
*** rpodolyaka1 has quit IRC02:57
*** Ryan_Lane1 has quit IRC02:58
*** rcarrillocruz has joined #openstack-infra02:59
*** otter768 has quit IRC03:05
*** dimsum_ has quit IRC03:06
*** otter768 has joined #openstack-infra03:12
*** _nadya_ has joined #openstack-infra03:12
*** jpeeler has quit IRC03:16
*** bdpayne has joined #openstack-infra03:18
*** asselin has quit IRC03:26
*** kmartin has quit IRC03:26
*** rcarrillocruz has quit IRC03:26
*** asselin has joined #openstack-infra03:26
*** kmartin has joined #openstack-infra03:27
*** asselin has quit IRC03:27
*** kmartin has quit IRC03:27
*** kmartin has joined #openstack-infra03:28
*** asselin has joined #openstack-infra03:28
*** asselin has quit IRC03:28
*** kmartin has quit IRC03:28
*** kmartin has joined #openstack-infra03:29
*** asselin has joined #openstack-infra03:29
*** rcarrillocruz has joined #openstack-infra03:30
*** kmartin has quit IRC03:30
*** asselin has quit IRC03:30
*** adalbas has quit IRC03:31
*** asselin has joined #openstack-infra03:31
*** kmartin has joined #openstack-infra03:31
*** bdpayne has quit IRC03:36
*** Ryan_Lane1 has joined #openstack-infra03:39
*** ominakov has joined #openstack-infra03:39
*** Ryan_Lane has quit IRC03:40
*** Ryan_Lane has joined #openstack-infra03:41
*** baoli has joined #openstack-infra03:41
*** chandankumar has joined #openstack-infra03:43
*** chandankumar has quit IRC03:45
*** chandankumar has joined #openstack-infra03:45
*** baoli has quit IRC03:46
*** lttrl has quit IRC03:50
*** otherwiseguy has quit IRC03:50
*** Ryan_Lane1 has quit IRC03:54
*** Sukhdev has quit IRC03:56
*** Ryan_Lane has quit IRC03:57
*** rcarrillocruz has quit IRC03:59
*** mmaglana has quit IRC04:00
*** mmaglana has joined #openstack-infra04:00
*** otter768 has quit IRC04:01
*** otter768 has joined #openstack-infra04:01
*** Ryan_Lane has joined #openstack-infra04:02
*** rcarrillocruz has joined #openstack-infra04:03
*** garyh has quit IRC04:09
*** lcheng has joined #openstack-infra04:12
*** Ryan_Lane1 has joined #openstack-infra04:20
*** rcarrillocruz has quit IRC04:22
*** rcarrillocruz has joined #openstack-infra04:24
*** hdd has joined #openstack-infra04:30
*** lcheng has quit IRC04:31
*** ominakov has quit IRC04:31
*** harlowja_away has quit IRC04:32
*** annegentle has joined #openstack-infra04:36
*** annegentle has quit IRC04:41
*** baoli has joined #openstack-infra04:42
*** sdake_ has joined #openstack-infra04:44
*** _nadya_ has quit IRC04:45
*** praneshp has quit IRC04:45
*** praneshp has joined #openstack-infra04:46
*** Ryan_Lane has quit IRC04:46
*** baoli has quit IRC04:47
*** rcarrillocruz has quit IRC04:48
*** emagana has joined #openstack-infra04:50
*** garyh has joined #openstack-infra04:50
*** rcarrillocruz has joined #openstack-infra04:52
*** tsg has joined #openstack-infra04:52
*** praneshp_ has joined #openstack-infra04:52
*** hdd has quit IRC04:54
*** YorikSar has quit IRC04:54
*** yamahata has joined #openstack-infra04:55
*** praneshp has quit IRC04:55
*** praneshp_ is now known as praneshp04:55
*** YorikSar has joined #openstack-infra04:56
*** emagana has quit IRC04:58
*** emagana has joined #openstack-infra04:59
*** Ryan_Lane has joined #openstack-infra05:01
*** emagana has quit IRC05:03
*** rcarrillocruz has quit IRC05:11
*** emagana has joined #openstack-infra05:12
*** chandankumar has quit IRC05:12
*** emagana has quit IRC05:13
*** rcarrillocruz has joined #openstack-infra05:15
*** reed has joined #openstack-infra05:15
*** flaviof is now known as flaviof_zzz05:17
*** Ryan_Lane has quit IRC05:20
*** chandankumar has joined #openstack-infra05:21
*** trinaths has quit IRC05:25
*** yamahata has quit IRC05:26
*** marcusvrn has quit IRC05:31
*** rcarrillocruz has quit IRC05:33
*** rcarrillocruz has joined #openstack-infra05:36
*** otter768 has quit IRC05:37
*** tsg has quit IRC05:40
*** _buzz has quit IRC05:42
*** baoli has joined #openstack-infra05:42
*** reed has quit IRC05:46
*** baoli has quit IRC05:47
*** rcarrillocruz has quit IRC05:53
*** rcarrillocruz has joined #openstack-infra05:57
*** mmaglana has quit IRC05:58
*** mmaglana has joined #openstack-infra05:59
*** mmaglana has quit IRC06:03
*** otherwiseguy has joined #openstack-infra06:04
*** Ryan_Lane has joined #openstack-infra06:15
*** Ryan_Lane1 has quit IRC06:18
*** rcarrillocruz has quit IRC06:19
*** rcarrillocruz has joined #openstack-infra06:21
*** dkliban has quit IRC06:25
*** rick_ has quit IRC06:26
*** mmaglana has joined #openstack-infra06:29
*** Ryan_Lane has quit IRC06:30
*** mmaglana has quit IRC06:34
*** stevemar has quit IRC06:38
*** dkliban has joined #openstack-infra06:40
*** tsg has joined #openstack-infra06:40
*** baoli has joined #openstack-infra06:43
*** baoli has quit IRC06:48
*** rcarrillocruz has quit IRC06:51
*** rcarrillocruz has joined #openstack-infra06:53
*** praneshp has quit IRC07:09
*** rcarrillocruz has quit IRC07:09
*** rcarrillocruz has joined #openstack-infra07:13
*** p5ntangle has quit IRC07:13
*** mmaglana has joined #openstack-infra07:29
*** trinaths has joined #openstack-infra07:29
*** rcarrillocruz has quit IRC07:33
*** mmaglana has quit IRC07:33
*** AlexF has joined #openstack-infra07:36
*** annegentle has joined #openstack-infra07:36
*** rcarrillocruz has joined #openstack-infra07:36
*** annegentle has quit IRC07:40
*** baoli has joined #openstack-infra07:44
*** baoli has quit IRC07:48
*** otherwiseguy has quit IRC07:51
*** rcarrillocruz has quit IRC07:59
*** rcarrillocruz has joined #openstack-infra08:03
*** Longgeek has joined #openstack-infra08:05
*** alexpilotti has joined #openstack-infra08:07
openstackgerritlokesh s proposed a change to openstack-infra/config: Adding windows disk-image builder project  https://review.openstack.org/11056208:11
*** rcarrillocruz has quit IRC08:22
*** rcarrillocruz has joined #openstack-infra08:26
openstackgerritlokesh s proposed a change to openstack-infra/config: Adding windows disk-image builder project  https://review.openstack.org/11056208:28
*** Longgeek has quit IRC08:29
*** mmaglana has joined #openstack-infra08:29
*** Longgeek has joined #openstack-infra08:29
*** MaxV has joined #openstack-infra08:32
*** Longgeek has quit IRC08:33
*** Longgeek has joined #openstack-infra08:33
*** mmaglana has quit IRC08:34
*** luqas has joined #openstack-infra08:42
*** ildikov_ has joined #openstack-infra08:43
*** tsg has quit IRC08:43
*** baoli has joined #openstack-infra08:45
*** ildikov has quit IRC08:45
*** luqas has quit IRC08:46
*** baoli has quit IRC08:49
*** AlexF has quit IRC08:51
*** rcarrillocruz has quit IRC08:52
*** rcarrillocruz has joined #openstack-infra08:53
*** luqas has joined #openstack-infra08:57
*** penguinRaider has quit IRC08:57
openstackgerritChristian Fetzer proposed a change to openstack-infra/jenkins-job-builder: Add support for the Jenkins Valgrind publisher plugin.  https://review.openstack.org/11311709:04
openstackgerritlokesh s proposed a change to openstack-infra/config: Adding windows disk-image builder project  https://review.openstack.org/11056209:09
*** cnesa7 has joined #openstack-infra09:11
*** rcarrillocruz has quit IRC09:12
*** penguinRaider has joined #openstack-infra09:13
*** rcarrillocruz has joined #openstack-infra09:15
*** luqas has quit IRC09:21
*** luqas has joined #openstack-infra09:26
*** luqas has quit IRC09:28
*** mmaglana has joined #openstack-infra09:29
*** mmaglana has quit IRC09:33
*** penguinRaider has quit IRC09:34
*** rcarrillocruz has quit IRC09:38
*** rcarrillocruz has joined #openstack-infra09:41
*** baoli has joined #openstack-infra09:45
*** baoli has quit IRC09:50
*** tomoe_ has joined #openstack-infra09:56
*** penguinRaider has joined #openstack-infra10:02
*** rcarrillocruz has quit IRC10:04
*** Clabbe has quit IRC10:04
*** tomoe_ has quit IRC10:05
*** rcarrillocruz has joined #openstack-infra10:07
*** Clabbe has joined #openstack-infra10:09
*** masayukig has quit IRC10:09
*** masayukig has joined #openstack-infra10:15
*** Ryan_Lane has joined #openstack-infra10:18
*** Ryan_Lane has quit IRC10:19
*** MaxV has quit IRC10:20
*** rcarrillocruz has quit IRC10:24
*** rcarrillocruz has joined #openstack-infra10:28
*** mmaglana has joined #openstack-infra10:29
*** mmaglana has quit IRC10:33
*** rcarrillocruz has quit IRC10:44
*** rcarrillocruz has joined #openstack-infra10:48
*** rcarrillocruz has left #openstack-infra10:54
*** chandankumar has quit IRC10:58
*** penguinRaider has quit IRC11:03
*** afazekas has joined #openstack-infra11:06
*** chandankumar has joined #openstack-infra11:11
*** penguinRaider has joined #openstack-infra11:14
*** lttrl has joined #openstack-infra11:23
*** tomoe_ has joined #openstack-infra11:24
*** mmaglana has joined #openstack-infra11:29
*** loquacities has quit IRC11:33
*** mmaglana has quit IRC11:34
*** loquacities has joined #openstack-infra11:34
*** jamielennox|away has quit IRC11:35
*** jamielennox|away has joined #openstack-infra11:36
*** annegentle has joined #openstack-infra11:36
*** morganfainberg_Z has quit IRC11:37
*** tnurlygayanov has quit IRC11:37
*** paul-- has quit IRC11:37
*** annegentle has quit IRC11:41
*** _buzz has joined #openstack-infra11:42
*** Longgeek has quit IRC11:45
*** baoli has joined #openstack-infra11:47
*** baoli has quit IRC11:52
*** morganfainberg has joined #openstack-infra12:08
*** paul-- has joined #openstack-infra12:08
*** Alexei_987 has joined #openstack-infra12:11
*** morganfainberg has quit IRC12:14
*** morganfainberg has joined #openstack-infra12:14
*** dane_leblanc has joined #openstack-infra12:28
*** mmaglana has joined #openstack-infra12:29
*** chandankumar has quit IRC12:31
*** adalbas has joined #openstack-infra12:33
*** annegentle has joined #openstack-infra12:33
*** mmaglana has quit IRC12:34
*** _nadya_ has joined #openstack-infra12:40
*** _nadya_ has quit IRC12:44
*** Longgeek has joined #openstack-infra12:46
*** _nadya_ has joined #openstack-infra12:46
*** baoli has joined #openstack-infra12:48
*** Longgeek has quit IRC12:50
*** baoli has quit IRC12:52
*** Longgeek has joined #openstack-infra12:58
*** annegentle has quit IRC13:02
*** smcginnis_ has joined #openstack-infra13:04
*** Longgeek has quit IRC13:13
*** _nadya_ has quit IRC13:18
*** dimsum_ has joined #openstack-infra13:18
*** dimsum_ has quit IRC13:18
*** dimsum_ has joined #openstack-infra13:19
*** yamahata has joined #openstack-infra13:19
*** dimsum_ is now known as dims13:19
*** Longgeek has joined #openstack-infra13:19
*** vladan has quit IRC13:22
*** vladan has joined #openstack-infra13:22
*** dims has quit IRC13:23
*** tomoe_ has quit IRC13:25
*** mrda has quit IRC13:25
*** mrda has joined #openstack-infra13:26
*** hdd has joined #openstack-infra13:26
*** tomoe_ has joined #openstack-infra13:28
*** pcm_ has joined #openstack-infra13:31
smcginnis_Anyone around with experience setting CI using Jay Pipes instructions?13:37
smcginnis_I know we don't want comments posted of "Starting check jobs". Where is that done and how can I remove it?13:38
openstackgerritMaru Newby proposed a change to openstack-infra/config: Minimize service installation for neutron func job  https://review.openstack.org/11441613:38
*** marun has joined #openstack-infra13:38
*** dane_leblanc has quit IRC13:39
openstackgerritMaru Newby proposed a change to openstack-infra/config: Minimize service installation for neutron func job  https://review.openstack.org/11441613:44
openstackgerritMaru Newby proposed a change to openstack-infra/config: Externalize hooks for neutron functional jobs  https://review.openstack.org/11645813:44
*** garyh has quit IRC13:45
*** morganfainberg has quit IRC13:45
*** paul-- has quit IRC13:45
*** baoli has joined #openstack-infra13:48
leakypipessmcginnis_: I'm here :)13:49
smcginnis_leakypipes: Hey! Can you give a newbie some pointers? Where do I go to change that behavior?13:51
*** leakypipes is now known as jaypipes13:52
jaypipessmcginnis_: one minute... looking something up in zuul.13:52
smcginnis_jaypipes: np, thanks!13:52
*** marun has quit IRC13:52
*** baoli has quit IRC13:53
*** paulrad has joined #openstack-infra13:58
*** hdd has quit IRC13:58
*** annegentle has joined #openstack-infra14:02
jaypipessmcginnis_: still looking...14:04
openstackgerritA change was merged to openstack-infra/zuul: Handle latest testtools tearDown checks  https://review.openstack.org/11639314:05
*** annegentle has quit IRC14:07
*** morganfainberg has joined #openstack-infra14:07
*** paul-- has joined #openstack-infra14:07
*** dims has joined #openstack-infra14:09
*** dims has quit IRC14:12
*** ominakov has joined #openstack-infra14:12
*** dane_leblanc has joined #openstack-infra14:12
jaypipessmcginnis_: can you pastebin your zuul layout.yaml please?14:13
smcginnis_jaypipes: Yep, one moment.14:13
smcginnis_jaypipes: http://paste.openstack.org/show/99211/14:15
*** garyh has joined #openstack-infra14:16
smcginnis_jaypipes: Unrelated, but I see I need to update the recheck myvendor piece.14:16
*** _nadya_ has joined #openstack-infra14:19
smcginnis_jaypipes: Also have an issue that I see my CI post the verfication started comment to my sandbox commit, but in Jenkins never actually see the noop job kick off.14:21
smcginnis_jaypipes: But one at a time. :)14:22
jaypipessmcginnis_: remove the "start:" sections.14:23
smcginnis_jaypipes: Knew it would be something simple. Just didn't know enough to know where it had to change. Thanks!14:24
smcginnis_jaypipes: Any idea why I never see my job run? And after that initial starting checks comment I never see a vote or results.14:25
*** garyh has quit IRC14:26
*** mmaglana has joined #openstack-infra14:29
*** tsg has joined #openstack-infra14:30
*** cad has quit IRC14:32
*** cad has joined #openstack-infra14:32
jaypipessmcginnis_: most likely a zuul merger issue. check the zuul-merger.log (and make sure zuul-merger is running :)14:32
*** tomoe_ has quit IRC14:32
*** chandankumar has joined #openstack-infra14:33
*** mmaglana has quit IRC14:34
smcginnis_* zuul-merger is not running14:34
smcginnis_jaypipes: Thank you sir, I appreciate the help.14:34
*** cad has quit IRC14:36
*** hdd has joined #openstack-infra14:39
*** tomoe_ has joined #openstack-infra14:41
openstackgerritJeremy Stanley proposed a change to openstack-infra/nodepool: Correct use of label.providers dict  https://review.openstack.org/11646014:41
fungijeblair: clarkb: ^ next iteration in broken image updating14:42
smcginnis_jaypipes: Hm, started the zuul-merger service but still no go. And can't find a zuul-merger.log file.14:42
jaypipessmcginnis_: hmm... and zuul-merger is definitely running?14:43
*** pcm_ has quit IRC14:43
smcginnis_jaypipes: Checking again. Looks like it starts up, runs for ~minute, then dies.14:44
smcginnis_jaypipes: Looking for the cause now.14:44
*** tomoe_ has quit IRC14:44
*** cad has joined #openstack-infra14:45
jaypipessmcginnis_: that's typically due to a bad SSH user/key combination14:45
smcginnis_jaypipes: Any recommendations on how to check and verify that?14:46
jaypipessmcginnis_: since zuul-merger is what pulls the git changes from Gerrit and manages the SSH'ing to the Gerrit SSH server14:46
jaypipessmcginnis_: yes. go ahead and try to do:14:46
jaypipesssh -T $USER@review.openstack.org -p 2941814:46
jaypipessmcginnis_: *as the Jenkins/Zuul operating system user*14:47
smcginnis_jaypipes: As zuul user, but $USER would be our CI account, right?14:48
jaypipessmcginnis_: corret.14:49
jaypipescorrect14:49
*** baoli has joined #openstack-infra14:49
*** dane_leblanc has quit IRC14:49
smcginnis_jaypipes: Yeah, permission denied. Does it just try to use $ZUUL_HOME/.ssh/id_rsa?14:50
jaypipessmcginnis_: yes. might want to double-check with fungi or someone else from infra if your SSH key and user account is kosher.14:51
smcginnis_jaypipes: Yeah, account has been verified elsewhere. No keys in $ZUUL_HOME/.ssh/.14:53
smcginnis_Are the puppet scripts supposed to put it there?14:54
*** baoli has quit IRC14:54
fungismcginnis_: /var/lib/zuul/ssh/id_rsa by default14:54
smcginnis_jaypipes: Copied over from my data repo and chmod'd/chown'd and able to connect now. Starting service.14:54
fungi(no .)14:54
jaypipesfungi: I think he's referring to the os-ext-testing puppet module.14:55
*** tomoe_ has joined #openstack-infra14:55
fungiahh, nevermind. the zuul puppet module puts in there anyway14:55
jaypipessmcginnis_: you need to put your key into your /data repo...14:55
smcginnis_fungi: jaypipes: Yep, thanks fungi. I see it in /var/lib/zuul/ssh. Just the private key.14:55
jaypipessmcginnis_: see the README here: https://github.com/jaypipes/os-ext-testing-data14:56
smcginnis_jaypipes: Yep, did that.14:56
jaypipesok, cool.14:56
*** che-arne|2 has joined #openstack-infra14:56
smcginnis_So I am able to ssh manually (albeit with keys in ~/.ssh) but zuul-merger is still dying shortly after starting.14:56
*** AlexF has joined #openstack-infra14:57
jaypipessmcginnis_: and there's no logging at all? :(14:57
jaypipessmcginnis_: anything in the /var/log/zuul/debug.log?14:57
*** che-arne has quit IRC14:57
smcginnis_jaypipes: Nothing in merger.log or merger-debug.log.14:57
*** _nadya_ has quit IRC14:58
jaypipessmcginnis_: poo.14:58
smcginnis_jaypipes: Looking back through zuul/debug.log to see if there is anything in there.14:58
jaypipeskk14:58
jeblairif there's no log output from the merger, you should be able to start it from the command line with the '-d' flag to tell it to not run as a daemon, and output to the terminal14:59
jeblairhopefully that should tell you what's wrong14:59
smcginnis_jeblair: Thanks, I'll give that a shot.15:00
jaypipesoooh, nice thought jeblair15:00
jeblairfungi: is there an extant patch to fix the nodepool tests?15:00
fungijeblair: i was about to write one--i don't think there is yet15:00
smcginnis_jaypipes: A few mentiones of merger in the zuul/debug.log of MergeClient: Submitting job merger:merge.15:00
smcginnis_jaypipes: Possibly from when I started it up. So maybe it did something then died. Will try jeblairs suggestion now.15:01
jaypipesk15:01
fungijeblair: oh, actually ianw has a couple testing-related fixes around setup and addcleanup15:01
*** dane_leblanc has joined #openstack-infra15:01
*** paulrad has quit IRC15:01
jeblairsmcginnis_: msgs like that would be zuul-server giving jobs to zuul-merger (it does that regardless of whether one is online; they get queued)15:02
jeblairfungi: i haven't been paying attention to the testtools thing, i don't know off hand what needs to be done to fix it15:02
fungijeblair: nor i but i'll figure it out15:03
*** dims has joined #openstack-infra15:03
jeblairi kinda thought the nodepool dib stuff was more tested :(15:03
smcginnis_jeblair: Great suggestion! Started it up and immediately after message I saw in zuul/debug.log it prompted me if I wanted to accept RSA key thumbprint.15:04
fungiyeah, the scheduled image updates seem not to have been tested with it15:04
smcginnis_As soon as I did that it continued on.15:04
jeblairsmcginnis_: ah yeah; i think we have our puppet scripts install a known_hosts file with gerrit's fingerprint15:04
smcginnis_Got an email that it posted results in at least one of my sandbox reviews.15:04
jeblairbut i also wouldn't mind if zuul just accepted the fingerprint if there was none (but of course still rejected it if it changed)15:05
smcginnis_Bummer. Tried to run as service again and it died shortly after.15:06
*** dane_leblanc has quit IRC15:07
jeblairsmcginnis_: if it's working with -d but not without, i'd check that the piddir and log dirs are writable by the zuul user15:07
jeblairsmcginnis_: those should be the only things that are different15:07
fungijeblair: yep, ianw fixed our tests with https://review.openstack.org/115844 (which i'm approving now)15:08
smcginnis_jeblair: is piddir /var/run, or does it put that somewhere else?15:10
jeblairsmcginnis_: /var/run/zuul/ by default; it's configurable in zuul.conf15:10
smcginnis_jeblair: Able to write to both /var/run/zuul and /var/log/zuul.15:11
fungismcginnis_: and no stale pid file left over in /var/run/zuul?15:11
smcginnis_I see a zuul.pid there. Assuming that's the main zuul server pid? No zuul-merger.pid.15:12
jeblairsmcginnis_: oops, /var/run/zuul-merger/ is the default pidfile location for zuul-merger15:12
* smcginnis_ checking15:12
smcginnis_jeblair: Still good.15:12
smcginnis_Didn't run -d as zuul user before. Trying that now.15:14
smcginnis_Seems to have started up OK.15:14
openstackgerritA change was merged to openstack-infra/nodepool: Remove setUp() call from setup_config  https://review.openstack.org/11584415:14
jeblairsmcginnis_: oh, looks like zuul-merger will use the logging config regardless of '-d'.  so you may want to remove 'log_config' from '[merger]' in zuul.conf to force it to log to the terminal15:14
smcginnis_Last output was Starting merge listener. Still running and no error.15:15
smcginnis_jeblair: Will restart with that.15:15
*** Longgeek_ has joined #openstack-infra15:15
smcginnis_zuul_url is empty in zuul.conf. Is that normal?15:15
*** garyh has joined #openstack-infra15:16
jeblairsmcginnis_: i think it is required in the '[merger]' section15:16
smcginnis_jeblair: What should that be?15:17
smcginnis_Commented out logging in merge section.15:17
*** dims has quit IRC15:17
smcginnis_Restarted on command line and lots more output.15:17
smcginnis_Still looks good though.15:17
*** Longgeek has quit IRC15:18
*** ominakov has quit IRC15:18
smcginnis_url must default15:18
smcginnis_Shows it connecting correctly to localhost:4730.15:18
jeblairsmcginnis_: it should be the url for the merger; ours are like 'http://zm01.openstack.org/p'15:19
smcginnis_jeblair: Sorry still learning. Is that the URL to talk to zuul, or is that something else?15:19
jeblairsmcginnis_: it's the url the merger serves the git repos15:20
jeblairsmcginnis_: explanation here: http://ci.openstack.org/zuul/merger.html#configuration15:20
smcginnis_jaypipes: Following your setup, do you know what the merge url should be?15:21
* smcginnis_ reading the fine manual15:21
jeblairsmcginnis_: i'm assuming you're still running zuul-merger as the zuul user, right?15:22
smcginnis_jeblair: Correct. Still appears to be running fine from command line15:22
jeblairsmcginnis_: okay, so i think the only difference should be the pidfile; you're certain the directory is writable... is it empty before you start it?15:22
*** cad has quit IRC15:23
jeblairsmcginnis_: (and are there no old zuul-merger processes running in 'ps' output?)15:23
*** cad has joined #openstack-infra15:23
smcginnis_jeblair: Ah, yes, there are pid files in that directory already.15:24
smcginnis_jeblair: Assuming I should clear that out and try starting service again?15:24
jeblairfungi: suggested an alternate fix to nodepool that changes less code15:26
jeblairsmcginnis_: that's probably it; it was probably refusing to start because of that15:26
smcginnis_jeblair: Looks promising.15:26
jeblairsmcginnis_: i'd put the log_config back in zuul.conf then restart15:26
*** garyh has quit IRC15:26
smcginnis_jeblair: Service hasn't died and it's longer than before. Will stop again, fix up conf file, then start and do a sandbox test.15:27
smcginnis_Many thanks to all for all the help. Hopefully I can know enough to pay it forward soon.15:27
jaypipessmcginnis_: unfortunately, I have to run... it's move-in day for me and the wifey in our new house... lots of fun :)15:27
jaypipessmcginnis_: no worries. feel free to email me at jaypipes@gmail.com if you run into issues with os-ext-testing15:28
*** jaypipes has quit IRC15:28
smcginnis_jamespd: Congrats on the new house! Big busy day. Good luck!15:28
smcginnis_jamespd: Oops, sorry jamespd. Tab completed too late after jay left. :)15:28
*** mmaglana has joined #openstack-infra15:29
*** alkari has joined #openstack-infra15:29
fungijeblair: i actually went that route because it changed *less* code. there were more places in nodepool.yaml using the dict keys for providers directly than not, but i can invert those instead if you prefer that pattern15:31
fungis/nodepool.yaml/nodepool.py/15:31
jeblairfungi: well, presumably the others aren't causing problems right now :)15:33
*** mmaglana has quit IRC15:34
fungisure, i could just correct the one place where it's an issue, but i think the inconsistent treatment of label providers throughout the script is what likely led to that typo in the first place15:35
jeblairyeah15:36
*** dims has joined #openstack-infra15:36
*** Longgeek_ has quit IRC15:38
openstackgerritJeremy Stanley proposed a change to openstack-infra/nodepool: Correct use of label.providers dict  https://review.openstack.org/11646215:40
*** dims has quit IRC15:40
fungioops--forgot to reuse the change-id on that one... discarding15:40
openstackgerritJeremy Stanley proposed a change to openstack-infra/nodepool: Correct use of label.providers dict  https://review.openstack.org/11646015:41
fungiokay, that switches all the direct key access to using the object attributes from the values instead15:42
*** dims has joined #openstack-infra15:42
fungii guess it was fewer places than i thought15:42
*** smcginnis_ has quit IRC15:44
jeblairfungi: cool, and looks like those were all introduced together15:44
*** loki184 has joined #openstack-infra15:44
fungiagreed, so it makes more sense to clean them up together. good suggestion!15:44
*** dims has quit IRC15:46
*** dims has joined #openstack-infra15:46
*** baoli has joined #openstack-infra15:50
*** timfreund has quit IRC15:50
*** dims has quit IRC15:51
*** otherwiseguy has joined #openstack-infra15:51
*** alkari has quit IRC15:53
openstackgerritA change was merged to openstack-infra/nodepool: Move pool.stop into addCleanup  https://review.openstack.org/11547515:53
*** baoli has quit IRC15:54
*** hdd has quit IRC15:56
*** garyh has joined #openstack-infra15:57
openstackgerritA change was merged to openstack-infra/nodepool: Correct use of label.providers dict  https://review.openstack.org/11646016:01
jeblairhuzzah16:01
*** alkari has joined #openstack-infra16:04
*** SumitNaiksatam has quit IRC16:06
*** SumitNaiksatam has joined #openstack-infra16:07
fungisince the gate is relatively calm, i've restarted nodepool with that new version installed now16:07
*** garyh has quit IRC16:07
*** tomoe_ has quit IRC16:10
fungii've disabled puppet agent on nodepool.o.o briefly and switched the image update time from 14:14 to 16:14 so it should hopefully trigger momentarily16:11
fungionce i see images building properly i'll reenable puppet agent and let it set the config back16:12
jeblairfrom the sparkline, it looks like the gate throughput has been generally slow (because of resets?) but then had a good run for a while, then got slow again16:13
fungithat's how i was interpreting it as well16:15
*** reed has joined #openstack-infra16:15
*** tsg has quit IRC16:15
fungithough http://jogo.github.io/gate/ looks fairly reasonable from a stability standpoint16:15
*** ramashri has joined #openstack-infra16:16
*** wendar_ is now known as wendar16:21
*** _nadya_ has joined #openstack-infra16:22
*** _nadya_ has quit IRC16:22
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for heat UserKeyPairMissing bug 1360415  https://review.openstack.org/11636316:24
uvirtbotLaunchpad bug 1360415 in heat "test_nova_keypair_resources fails with UserKeyPairMissing" [Undecided,New] https://launchpad.net/bugs/136041516:24
*** _nadya_ has joined #openstack-infra16:25
*** reed has quit IRC16:25
trinathsGood Morning All.16:27
fungigah! when i redid the new patchset, i only corrected the working but inconsistent uses and forgot to go back and fix the broken one :/16:29
openstackgerritJeremy Stanley proposed a change to openstack-infra/nodepool: Actually correct use of label.providers dict  https://review.openstack.org/11646616:29
fungithat ^ is hand-applied on the server and working16:29
fungiand we have images at least claiming to be in the process of updating now with it in place. i'll keep an eye on it for a bit16:30
jeblairaprvd16:30
fungithanks16:30
fungiESATURDAY16:30
fungior something16:30
*** garyh has joined #openstack-infra16:38
*** yamahata has quit IRC16:42
*** gargola has joined #openstack-infra16:44
*** wenlock has joined #openstack-infra16:47
*** garyh has quit IRC16:48
*** baoli has joined #openstack-infra16:51
*** loki184 has quit IRC16:54
*** rkukura has quit IRC16:55
*** baoli has quit IRC16:55
*** rkukura has joined #openstack-infra16:56
*** alkari has quit IRC16:56
*** _nadya_ has quit IRC17:03
*** _nadya_ has joined #openstack-infra17:07
*** annegentle has joined #openstack-infra17:08
*** zz_dimtruck is now known as dimtruck17:10
*** trinaths has quit IRC17:11
*** _nadya_ has quit IRC17:13
*** annegentle has quit IRC17:14
openstackgerritA change was merged to openstack-infra/nodepool: Actually correct use of label.providers dict  https://review.openstack.org/11646617:15
*** mmaglana has joined #openstack-infra17:15
*** praneshp has joined #openstack-infra17:20
*** stevemar has joined #openstack-infra17:27
*** __afazekas has quit IRC17:31
*** wenlock has quit IRC17:31
*** todd_dsm has joined #openstack-infra17:35
*** annegentle has joined #openstack-infra17:37
*** dalgaaf_ has joined #openstack-infra17:38
*** garyh has joined #openstack-infra17:38
fungiokay, all nodepool images successfully updated and puppet has been reenabled on nodepool.o.o now17:40
fungii am going to wander off to accomplish weekend things for a while17:40
*** mriedem has joined #openstack-infra17:43
*** praneshp_ has joined #openstack-infra17:47
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for test_db_archive_deleted_rows pg fail  https://review.openstack.org/11646917:47
*** praneshp has quit IRC17:48
*** praneshp_ is now known as praneshp17:48
*** garyh has quit IRC17:49
*** baoli has joined #openstack-infra17:51
*** HeOS has quit IRC17:52
*** annegentle has quit IRC17:53
*** praneshp has quit IRC17:56
*** baoli has quit IRC17:56
*** marun has joined #openstack-infra17:57
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for test_db_archive_deleted_rows pg fail  https://review.openstack.org/11646917:57
openstackgerritJames E. Blair proposed a change to stackforge/gertty: Add test results to top of change view  https://review.openstack.org/11647117:58
jeblairthat took longer than it should have :/17:59
*** AlexF has quit IRC18:01
*** annegentle has joined #openstack-infra18:05
*** ramashri has quit IRC18:09
*** todd_dsm has quit IRC18:11
*** todd_dsm has joined #openstack-infra18:27
*** praneshp has joined #openstack-infra18:28
*** cad has quit IRC18:29
openstackgerritMaru Newby proposed a change to openstack-infra/config: Externalize hooks for neutron functional jobs  https://review.openstack.org/11645818:35
*** dims has joined #openstack-infra18:37
*** garyh has joined #openstack-infra18:38
*** masayukig has quit IRC18:39
*** dims is now known as dimsum18:43
*** dimsum is now known as dimsum_18:43
openstackgerritJames E. Blair proposed a change to stackforge/gertty: Hide fully reviewed projects by default  https://review.openstack.org/9959118:44
openstackgerritJames E. Blair proposed a change to stackforge/gertty: Change actvie project toggle key  https://review.openstack.org/11647418:44
*** dimsum_ has quit IRC18:45
*** dimsum_ has joined #openstack-infra18:45
*** masayukig has joined #openstack-infra18:46
*** tsg has joined #openstack-infra18:47
*** tgohad has joined #openstack-infra18:47
*** garyh has quit IRC18:48
*** dimsum_ has quit IRC18:50
openstackgerritJames E. Blair proposed a change to stackforge/gertty: Hide fully reviewed projects by default  https://review.openstack.org/9959118:51
openstackgerritJames E. Blair proposed a change to stackforge/gertty: Change active project toggle key  https://review.openstack.org/11647418:51
openstackgerritJames E. Blair proposed a change to stackforge/gertty: Don't hide inactive projects when listing all.  https://review.openstack.org/10661518:51
*** baoli has joined #openstack-infra18:52
*** praneshp_ has joined #openstack-infra18:54
*** praneshp has quit IRC18:55
*** praneshp_ is now known as praneshp18:55
*** baoli has quit IRC18:57
*** annegentle has quit IRC19:14
*** harlowja_at_home has joined #openstack-infra19:19
*** todd_dsm has quit IRC19:20
*** todd_dsm has joined #openstack-infra19:25
*** harlowja_at_home has quit IRC19:26
*** Guest19211 has quit IRC19:27
*** dimtruck is now known as zz_dimtruck19:30
*** Guest19211 has joined #openstack-infra19:30
*** ihrachyshka has joined #openstack-infra19:31
*** garyh has joined #openstack-infra19:38
*** rpodolyaka1 has joined #openstack-infra19:40
*** rpodolyaka1 has quit IRC19:41
*** AlexF has joined #openstack-infra19:42
*** alexpilotti has quit IRC19:42
*** loki184 has joined #openstack-infra19:44
*** rpodolyaka1 has joined #openstack-infra19:45
*** garyh has quit IRC19:49
*** jdahlin has joined #openstack-infra19:50
*** baoli has joined #openstack-infra19:53
*** ihrachyshka has quit IRC19:54
*** Ryan_Lane has joined #openstack-infra19:56
*** rpodolyaka1 has quit IRC19:56
*** baoli has quit IRC19:58
*** Ryan_Lane has quit IRC19:58
*** praneshp_ has joined #openstack-infra19:58
*** Ryan_Lane has joined #openstack-infra19:59
*** loki184 has quit IRC19:59
*** praneshp has quit IRC20:01
*** praneshp_ is now known as praneshp20:01
*** rpodolyaka1 has joined #openstack-infra20:03
*** Guest19211 has quit IRC20:07
*** jdahlin has left #openstack-infra20:07
*** Guest19211 has joined #openstack-infra20:09
*** todd_dsm has quit IRC20:10
*** AlexF has quit IRC20:10
*** rpodolyaka1 has quit IRC20:10
*** annegentle has joined #openstack-infra20:11
*** _nadya_ has joined #openstack-infra20:14
*** todd_dsm has joined #openstack-infra20:15
*** annegentle has quit IRC20:15
*** imcsk8 has quit IRC20:15
*** imcsk8 has joined #openstack-infra20:16
*** adalbas has quit IRC20:18
*** _nadya_ has quit IRC20:18
*** Guest19211 has quit IRC20:19
*** pcrews has joined #openstack-infra20:26
*** jamespage has joined #openstack-infra20:28
*** todd_dsm has quit IRC20:32
*** annegentle has joined #openstack-infra20:37
*** garyh has joined #openstack-infra20:38
*** AlexF has joined #openstack-infra20:43
*** zz_dimtruck is now known as dimtruck20:47
*** garyh has quit IRC20:49
*** HenryG has quit IRC20:52
*** harlowja_at_home has joined #openstack-infra20:52
*** HenryG has joined #openstack-infra20:52
*** dimtruck is now known as zz_dimtruck20:53
*** zz_dimtruck is now known as dimtruck20:53
*** baoli has joined #openstack-infra20:54
*** YorikSar has quit IRC20:54
*** YorikSar has joined #openstack-infra20:56
*** dkehnx has quit IRC20:57
*** baoli has quit IRC20:58
*** garyh has joined #openstack-infra20:59
*** todd_dsm has joined #openstack-infra21:02
*** dimtruck is now known as zz_dimtruck21:03
*** otherwiseguy has quit IRC21:06
*** yfried has joined #openstack-infra21:07
*** pcrews has quit IRC21:07
*** alkari has joined #openstack-infra21:08
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for testools 0.9.36 setUp bug 1360252  https://review.openstack.org/11647921:08
uvirtbotLaunchpad bug 1360252 in glance "testtools 0.9.36+ breaks unit tests for multiple projects" [Undecided,Confirmed] https://launchpad.net/bugs/136025221:08
*** marun is now known as marun_afk21:09
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for testools 0.9.36 setUp bug 1360252  https://review.openstack.org/11647921:12
uvirtbotLaunchpad bug 1360252 in glance "testtools 0.9.36+ breaks unit tests for multiple projects" [Undecided,Confirmed] https://launchpad.net/bugs/136025221:12
*** tgohad__ has joined #openstack-infra21:13
*** alkari has quit IRC21:14
*** tsg has quit IRC21:16
*** AlexF has quit IRC21:23
*** gargola has quit IRC21:28
*** gargola has joined #openstack-infra21:30
*** changbl has quit IRC21:33
*** garyh has quit IRC21:36
nibalizerpleia2: i hear rumours that you're at debconf?21:36
*** gargola has quit IRC21:39
*** sressot has joined #openstack-infra21:40
*** krtaylor has quit IRC21:42
*** HeOS has joined #openstack-infra21:45
*** cnesa has joined #openstack-infra21:53
*** baoli has joined #openstack-infra21:55
*** dimsum_ has joined #openstack-infra21:58
*** baoli has quit IRC21:59
*** Ryan_Lane has quit IRC21:59
*** tgohad has quit IRC22:03
*** annegentle has quit IRC22:03
*** tgohad__ has quit IRC22:03
*** dimsum_ has quit IRC22:04
*** dimsum_ has joined #openstack-infra22:05
*** garyh has joined #openstack-infra22:06
*** dimsum_ has quit IRC22:10
*** cnesa has quit IRC22:10
*** krtaylor has joined #openstack-infra22:10
*** krtaylor has quit IRC22:12
*** krtaylor has joined #openstack-infra22:12
*** stevemar has quit IRC22:14
*** dalgaaf_ has quit IRC22:16
*** garyh has quit IRC22:17
*** cnesa has joined #openstack-infra22:29
*** esker has quit IRC22:30
*** pcm_ has joined #openstack-infra22:35
*** harlowja_at_home has quit IRC22:36
*** Ryan_Lane has joined #openstack-infra22:44
*** baoli has joined #openstack-infra22:55
*** pcm_ has quit IRC22:59
*** baoli has quit IRC23:00
*** dimsum_ has joined #openstack-infra23:04
*** garyh has joined #openstack-infra23:06
*** stevemar has joined #openstack-infra23:09
lifelessdhellmann: ping; what would you think of doing a pbr release to get the current improvements out there ?23:11
*** garyh has quit IRC23:17
dimsum_lifeless: will talk to him about it on monday. Still seem to have some open items, did you already look to see if we need any of those? - https://review.openstack.org/#/q/status:open+project:openstack-dev/pbr,n,z23:23
*** dimsum_ has quit IRC23:24
*** dimsum_ has joined #openstack-infra23:25
*** dimsum_ has quit IRC23:29
*** sdake_ has quit IRC23:36
*** yamahata has joined #openstack-infra23:37
*** mriedem has quit IRC23:38
*** tsg has joined #openstack-infra23:42
*** tgohad has joined #openstack-infra23:42
*** annegentle has joined #openstack-infra23:46
*** dimsum_ has joined #openstack-infra23:49
*** dimsum_ is now known as dims23:49
*** dims is now known as Guest7482223:50
*** Guest74822 has quit IRC23:52
*** baoli has joined #openstack-infra23:56
*** stevemar has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!