Tuesday, 2014-08-19

*** unicell1 is now known as unicell00:00
*** unicell has joined #openstack-infra00:00
*** tsg has joined #openstack-infra00:00
*** oomichi has joined #openstack-infra00:00
openstackgerritA change was merged to openstack-infra/config: Check and gate PEP8 for stackforge/gerrit-dash-creator  https://review.openstack.org/11276700:01
*** signed8bit_ZZZzz is now known as signed8bit00:05
*** ZZelle_ has quit IRC00:06
*** ramashri has quit IRC00:08
*** Alexandra_ has joined #openstack-infra00:11
*** asettle has quit IRC00:12
*** Alexandra_ is now known as a00:13
*** a is now known as asettle00:13
jogoclarkb: ping00:13
*** Ish__ has quit IRC00:14
jeblairjogo: he mentioned he would be mostly afk today, back tomorrow00:14
jogooh, I will fl a bug then00:14
jogofile*00:14
jogolooks like we are missing some !console logs in logstash00:14
jeblairjogo: feel free to flog one too00:15
jeblairjogo: tripleo or otherwise?  (i saw a change in review for tripleo i think)00:15
jogootherwise00:16
jogojeblair: still digging in00:16
*** Ish__ has joined #openstack-infra00:16
openstackgerritA change was merged to openstack-infra/config: Add python33 job for python-rallyclient  https://review.openstack.org/11281400:16
*** yamahata has joined #openstack-infra00:18
*** otherwiseguy has joined #openstack-infra00:22
jogohere is the bug for clarkb to look at https://bugs.launchpad.net/openstack-ci/+bug/135855000:24
uvirtbotLaunchpad bug 1358550 in openstack-ci "some files are not getting added to logstash.openstack.org" [Undecided,New]00:24
*** signed8bit has quit IRC00:26
*** aysyd has quit IRC00:26
*** signed8bit has joined #openstack-infra00:29
*** harlowja is now known as harlowja_away00:29
*** homeless has quit IRC00:31
*** homeless has joined #openstack-infra00:32
*** _buzz_ has quit IRC00:34
*** Ish__ has quit IRC00:35
*** marcoemorais has quit IRC00:35
*** _buzz has joined #openstack-infra00:35
*** rwsu has quit IRC00:37
*** signed8bit has quit IRC00:37
openstackgerritJames E. Blair proposed a change to stackforge/gertty: Fix immediate sync of change by change ID  https://review.openstack.org/11515600:38
*** crc32 has quit IRC00:40
openstackgerritA change was merged to openstack-dev/pbr: Teach pbr about post versioned dev versions.  https://review.openstack.org/8044900:44
*** homeless has quit IRC00:44
*** armax has quit IRC00:50
*** rwsu has joined #openstack-infra00:50
*** terryw has joined #openstack-infra00:51
*** Ish__ has joined #openstack-infra00:52
*** ramashri has joined #openstack-infra00:52
*** otherwiseguy has quit IRC00:54
*** andreaf_ has joined #openstack-infra00:54
*** dims has joined #openstack-infra00:54
*** marcoemorais has joined #openstack-infra00:55
*** harlowja_away is now known as harlowja00:56
*** andreaf has quit IRC00:56
*** otherwiseguy has joined #openstack-infra00:59
*** ramashri has quit IRC01:01
*** SumitNaiksatam has joined #openstack-infra01:01
*** ramashri has joined #openstack-infra01:01
*** terryw has quit IRC01:02
openstackgerritA change was merged to openstack-infra/config: Enable profiling in rally-jobs  https://review.openstack.org/11281601:02
openstackgerritA change was merged to openstack-infra/config: Change selenium and jshint to voting for tuskar-ui  https://review.openstack.org/11351001:03
*** rick__ has joined #openstack-infra01:04
*** bhuvan has quit IRC01:05
*** Ish__ has quit IRC01:06
*** praneshp has quit IRC01:09
*** gokrokve has joined #openstack-infra01:10
openstackgerritA change was merged to openstack-infra/config: Make Ceilometer MongoDB jobs check instead of experimental  https://review.openstack.org/11420801:12
*** mmaglana_ has quit IRC01:17
*** gokrokve has quit IRC01:17
*** gokrokve has joined #openstack-infra01:18
*** gokrokve has quit IRC01:22
*** bknudson has quit IRC01:23
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Add in job to run pip missing requirements  https://review.openstack.org/11413701:24
*** mbacchi has quit IRC01:25
*** gokrokve has joined #openstack-infra01:25
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Send python-job logs to swift  https://review.openstack.org/10948501:28
*** yaguang has joined #openstack-infra01:28
*** yaguang has quit IRC01:29
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Add in job to run pip missing requirements  https://review.openstack.org/11413701:30
*** yaguang has joined #openstack-infra01:32
*** hdd has joined #openstack-infra01:32
*** trinathS has quit IRC01:32
*** signed8bit has joined #openstack-infra01:32
*** changbl has joined #openstack-infra01:36
*** hdd has quit IRC01:39
openstackgerritJoshua Hesketh proposed a change to openstack-infra/jenkins-job-builder: Start libification of jjb  https://review.openstack.org/10772401:42
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Send python-job logs to swift  https://review.openstack.org/10948501:43
*** otherwiseguy has quit IRC01:44
*** Ish__ has joined #openstack-infra01:47
*** nosnos has joined #openstack-infra01:47
*** Ish__ has quit IRC01:47
*** changbl has quit IRC01:48
*** signed8bit has quit IRC01:48
*** oomichi has quit IRC01:48
*** tsg has quit IRC01:48
*** jamespag` has quit IRC01:48
*** che-arne|2 has quit IRC01:48
*** dmsimard_away has quit IRC01:48
*** stevemar has joined #openstack-infra01:52
*** gokrokve_ has joined #openstack-infra01:56
*** xchu has joined #openstack-infra01:56
*** changbl has joined #openstack-infra01:57
*** signed8bit has joined #openstack-infra01:57
*** oomichi has joined #openstack-infra01:57
*** tsg has joined #openstack-infra01:57
*** jamespag` has joined #openstack-infra01:57
*** che-arne|2 has joined #openstack-infra01:57
*** dmsimard_away has joined #openstack-infra01:57
*** gokrokve_ has quit IRC01:58
*** Daisy has joined #openstack-infra01:58
*** ChuckC has joined #openstack-infra01:58
*** gokrokve_ has joined #openstack-infra01:59
*** gokrokve has quit IRC01:59
*** otherwiseguy has joined #openstack-infra01:59
*** arnaud__ has quit IRC02:01
*** gokrokve has joined #openstack-infra02:08
*** alexpilotti has quit IRC02:09
*** gokrokve_ has quit IRC02:09
*** trinathS has joined #openstack-infra02:10
*** RicoLin has joined #openstack-infra02:10
*** mwagner_lap has joined #openstack-infra02:10
*** directxman12 has joined #openstack-infra02:12
*** morganfainberg is now known as morganfainberg_Z02:14
*** Ryan_Lane has quit IRC02:15
*** hdd has joined #openstack-infra02:25
*** Krast_ has quit IRC02:26
*** Krast has joined #openstack-infra02:26
*** otter768 has joined #openstack-infra02:29
*** marcoemorais has quit IRC02:31
*** hdd has quit IRC02:32
*** gokrokve has quit IRC02:34
*** annegentle has joined #openstack-infra02:34
*** gokrokve has joined #openstack-infra02:34
*** arnaud has quit IRC02:35
*** dims has quit IRC02:35
*** amotoki_ has quit IRC02:37
*** gokrokve has quit IRC02:39
*** trinathS has quit IRC02:40
*** otherwiseguy has quit IRC02:41
*** arnaud has joined #openstack-infra02:41
*** dims has joined #openstack-infra02:42
*** dims has quit IRC02:47
*** daya_k has joined #openstack-infra02:48
openstackgerritA change was merged to openstack-infra/devstack-gate: Allow for grenade upgrades within a release  https://review.openstack.org/11109402:49
*** ramashri has quit IRC02:53
*** ramashri has joined #openstack-infra02:55
*** adalbas has quit IRC03:01
*** _buzz has quit IRC03:02
*** bdpayne has joined #openstack-infra03:03
*** _buzz has joined #openstack-infra03:03
*** dims has joined #openstack-infra03:12
*** sdake_ has joined #openstack-infra03:13
mikalSo... tempest is failing for a nova change, and logs that there are non-whitelisted errors in the logs03:14
mikalIs that what's causing the failure?03:14
clarkbmikal: it could be. If tempest said X tests ran passed but the job still fails then the non whitelisted errors would be at fault03:15
mikalYah, it says all the tests passed03:15
mikalSo... Ceilometer hates me then03:15
mikalhttps://review.openstack.org/#/c/115158/103:15
mikalDoh, not that one03:15
mikalhttp://logs.openstack.org/07/114007/4/check/check-tempest-dsvm-full/1f74423/console.html03:15
mikalThat one03:15
mikalDoes tempest only fail on logs related to the thing under test?03:16
mikalOr any non-whitelisted error on an integrated project?03:16
*** KanagarajM has joined #openstack-infra03:17
*** dims has quit IRC03:17
*** bdpayne has quit IRC03:17
*** AlexF has joined #openstack-infra03:18
clarkbany non whitelisted error03:19
mikalHmmm03:20
*** markmcclain has quit IRC03:24
*** Sukhdev has joined #openstack-infra03:27
*** bdpayne has joined #openstack-infra03:30
*** gyee_ has quit IRC03:32
*** amotoki has joined #openstack-infra03:33
openstackgerritJames E. Blair proposed a change to stackforge/gertty: Add unified diff view  https://review.openstack.org/11516603:37
jeblairfungi: ^ let me know what you think03:37
*** bdpayne has quit IRC03:41
*** Azher has joined #openstack-infra03:42
*** SumitNaiksatam has quit IRC03:47
*** tsg has quit IRC03:47
*** SumitNaiksatam has joined #openstack-infra03:48
*** annegentle has quit IRC03:51
*** shashankhegde has joined #openstack-infra03:53
*** hogepodge has quit IRC03:53
*** lttrl has quit IRC03:55
*** sdake_ has quit IRC03:57
*** Ish__ has joined #openstack-infra03:58
*** imeerovi has quit IRC04:00
*** hdd has joined #openstack-infra04:00
*** stevemar has quit IRC04:00
*** xianghuihui has quit IRC04:03
*** xianghuihui has joined #openstack-infra04:04
*** AlexF has quit IRC04:07
*** harlowja is now known as harlowja_away04:08
*** garyh has quit IRC04:09
*** asettle has quit IRC04:10
*** alexandra has joined #openstack-infra04:10
*** alexandra is now known as asettle04:10
*** Ish__ has quit IRC04:11
*** otherwiseguy has joined #openstack-infra04:13
*** shashankhegde has quit IRC04:16
*** xianghuihui has quit IRC04:18
*** xianghui has joined #openstack-infra04:21
*** otherwiseguy has quit IRC04:24
*** Daisy has quit IRC04:26
*** arosen1 has joined #openstack-infra04:27
*** flaviof_zzz is now known as flaviof04:30
*** otter768 has quit IRC04:32
*** camunoz has joined #openstack-infra04:35
openstackgerritIan Wienand proposed a change to openstack-infra/nodepool: Clean up 'images' documentation  https://review.openstack.org/11516804:41
*** hdd has quit IRC04:43
openstackgerritKanagaraj Manickam proposed a change to openstack-infra/config: namos - Device and service manager  https://review.openstack.org/10949404:44
*** achanda has joined #openstack-infra04:51
*** bradm has quit IRC04:52
*** tsg has joined #openstack-infra04:52
*** garyh has joined #openstack-infra04:52
*** Ish__ has joined #openstack-infra04:53
*** harlowja_at_home has joined #openstack-infra04:57
*** hdd has joined #openstack-infra04:58
*** harlowja_at_home has quit IRC04:59
*** arnaud has quit IRC05:00
*** dims has joined #openstack-infra05:01
*** bdpayne has joined #openstack-infra05:02
*** Ish__ has quit IRC05:02
*** signed8bit has quit IRC05:03
*** harlowja_at_home has joined #openstack-infra05:04
*** hdd has quit IRC05:05
*** dims has quit IRC05:06
*** Ish__ has joined #openstack-infra05:06
*** Krast has quit IRC05:08
*** pcrews has quit IRC05:08
*** ramashri has quit IRC05:09
*** directxman12 has quit IRC05:15
*** ctracey has quit IRC05:16
*** chuckC_ has joined #openstack-infra05:16
*** afazekas has quit IRC05:17
*** ctracey has joined #openstack-infra05:20
*** e0ne has joined #openstack-infra05:21
*** loki184 has joined #openstack-infra05:21
*** e0ne has quit IRC05:23
*** hdd has joined #openstack-infra05:24
*** Daisy has joined #openstack-infra05:25
*** arnaud has joined #openstack-infra05:26
*** Sukhdev has quit IRC05:27
*** e0ne has joined #openstack-infra05:27
*** e0ne has quit IRC05:30
*** arnaud has quit IRC05:31
*** simonmcc_ has quit IRC05:31
*** chuckC_ has quit IRC05:32
*** simonmcc__ has joined #openstack-infra05:34
*** e0ne has joined #openstack-infra05:34
*** shashankhegde has joined #openstack-infra05:34
*** e0ne has quit IRC05:35
*** k4n0 has joined #openstack-infra05:36
*** Ish__ has left #openstack-infra05:36
*** Alex_Gaynor has quit IRC05:37
*** frank_zhou has joined #openstack-infra05:38
*** e0ne has joined #openstack-infra05:40
*** frank_zhou has quit IRC05:40
*** willroberts has quit IRC05:40
*** morganfainberg_Z is now known as morganfainberg05:41
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Add check-requirements to devstack-gate  https://review.openstack.org/11413905:41
*** Alex_Gaynor_ has joined #openstack-infra05:41
*** reed has quit IRC05:42
*** willroberts has joined #openstack-infra05:42
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Add new template stackforge-specs-jobs  https://review.openstack.org/11321105:44
*** hdd has quit IRC05:45
*** e0ne has quit IRC05:45
*** e0ne has joined #openstack-infra05:50
*** rwsu has quit IRC05:51
*** e0ne has quit IRC05:53
*** Alex_Gaynor_ is now known as Alex_Gaynor05:55
*** Alex_Gaynor has quit IRC05:55
*** Alex_Gaynor has joined #openstack-infra05:55
*** e0ne has joined #openstack-infra05:58
*** ildikov has quit IRC05:58
*** ildikov has joined #openstack-infra05:58
*** e0ne has quit IRC06:01
*** arnaud has joined #openstack-infra06:04
openstackgerritJoshua Hesketh proposed a change to openstack-infra/os-loganalyze: Add support for non-text files  https://review.openstack.org/10726706:04
*** ildikov has quit IRC06:04
*** baohua has joined #openstack-infra06:07
*** rwsu has joined #openstack-infra06:07
*** bdpayne has quit IRC06:08
*** achanda has quit IRC06:08
*** mmaglana has joined #openstack-infra06:11
*** shashankhegde has quit IRC06:13
*** fabo has quit IRC06:13
*** fabo has joined #openstack-infra06:13
*** Krast has joined #openstack-infra06:14
*** arnaud__ has joined #openstack-infra06:16
*** bdpayne has joined #openstack-infra06:20
openstackgerritSteve Kowalik proposed a change to openstack-infra/config: Add python3-jobs to diskimage-builder  https://review.openstack.org/11518306:20
*** harlowja_at_home has quit IRC06:23
*** sdake has quit IRC06:26
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Fix pep8 issues  https://review.openstack.org/11518706:27
*** Krast has quit IRC06:28
*** baohua_ has joined #openstack-infra06:29
*** mrda has quit IRC06:30
*** baohua has quit IRC06:32
*** mrda has joined #openstack-infra06:33
*** rdopieralski has joined #openstack-infra06:35
openstackgerritRadomir Dopieralski proposed a change to openstack-infra/config: Create a repository for additional Tuskar-UI plugins  https://review.openstack.org/10810206:40
*** arnaud has quit IRC06:40
*** arnaud__ has quit IRC06:40
*** maxbit has joined #openstack-infra06:44
*** flaper87|afk is now known as flaper8706:46
*** lukego has joined #openstack-infra06:46
*** bradm has joined #openstack-infra06:49
*** e0ne has joined #openstack-infra06:50
*** frank_zhou has joined #openstack-infra06:52
*** rdopieralski has joined #openstack-infra06:53
*** ildikov has joined #openstack-infra06:54
*** MaxV has joined #openstack-infra06:54
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Add check-requirements to devstack-gate  https://review.openstack.org/11413906:55
*** ihrachyshka has joined #openstack-infra06:59
*** denis_makogon has joined #openstack-infra06:59
*** chandankumar has joined #openstack-infra07:04
*** e0ne has quit IRC07:04
*** dtantsur|afk is now known as dtantsur07:06
*** camunoz is now known as camunoz_gone07:08
*** e0ne has joined #openstack-infra07:09
*** ihrachyshka has quit IRC07:10
*** melwitt1 has quit IRC07:11
*** MaxV has quit IRC07:11
*** afazekas has joined #openstack-infra07:12
*** mwagner_lap has quit IRC07:13
*** hashar has joined #openstack-infra07:13
*** ildikov_ has joined #openstack-infra07:14
*** ildikov has quit IRC07:15
*** bdpayne has quit IRC07:15
*** jlibosva has joined #openstack-infra07:18
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Add gerrit reviews into patchset approvals  https://review.openstack.org/9739007:21
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Allow a pipeline to specify alternative gerrit acc  https://review.openstack.org/9739107:21
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Add support for negative requirements  https://review.openstack.org/10272607:21
openstackgerritJoshua Hesketh proposed a change to openstack-infra/os-loganalyze: Add support for non-text files  https://review.openstack.org/10726707:22
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Remove Jenkins EnvInject plugin from production  https://review.openstack.org/10110107:23
*** yolanda_ has joined #openstack-infra07:23
*** yolanda has quit IRC07:24
*** Longgeek has joined #openstack-infra07:26
*** dizquierdo has joined #openstack-infra07:26
openstackgerritJoshua Hesketh proposed a change to openstack-infra/nodepool: Remove the need for zmq in proper demand calcs.  https://review.openstack.org/9830607:26
*** jcoufal has joined #openstack-infra07:26
yolanda_hi, were you able to merge nodepool dib change?07:28
*** _nadya_ has joined #openstack-infra07:28
AJaegerflaper87, are you looking into zuul-specs as well?07:32
flaper87AJaeger: will do that in a bit, I just got back from vacations. Sorry :D07:33
AJaegerflaper87, ah, you're catching up ;) Thanks!07:33
flaper87AJaeger: going through tons of emails right now :(07:33
flaper87yeah07:33
flaper87AJaeger: btw, thanks for following up on all those rename changes. I appreciate it07:34
AJaegerflaper87, thanks to to SergeyLukjanov and jeblair as well.07:34
flaper87AJaeger: agreed. SergeyLukjanov and jeblair, thanks guys. :)07:34
AJaegerzaqar-specs is the only repo AFAIK that needs some more handholding - I wrote you an email as well. So, go ahead and dig into your inbox ;)07:35
*** e0ne has quit IRC07:40
*** pblaho has joined #openstack-infra07:42
*** hashar has quit IRC07:42
*** MaxV has joined #openstack-infra07:44
*** jcoufal has quit IRC07:51
*** che-arne|2 has quit IRC07:52
*** fifieldt_ has joined #openstack-infra07:58
*** arosen1 has quit IRC07:59
*** Guest36489 has joined #openstack-infra07:59
*** imeerovi has joined #openstack-infra07:59
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Fix pep8 issues  https://review.openstack.org/11518708:01
*** jpich has joined #openstack-infra08:02
*** jcoufal has joined #openstack-infra08:03
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Fix pep8 issues  https://review.openstack.org/11518708:03
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Add gerrit reviews into patchset approvals  https://review.openstack.org/9739008:04
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Allow a pipeline to specify alternative gerrit acc  https://review.openstack.org/9739108:04
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Add support for negative requirements  https://review.openstack.org/10272608:04
*** Longgeek has quit IRC08:04
*** Longgeek has joined #openstack-infra08:05
openstackgerritJoshua Hesketh proposed a change to openstack-infra/zuul: Fix up status page dependencies  https://review.openstack.org/9802808:05
*** Longgeek has quit IRC08:06
*** Longgeek has joined #openstack-infra08:06
*** ihrachyshka has joined #openstack-infra08:07
openstackgerritMaxime Vidori proposed a change to openstack-infra/config: Add XStatic-angular-* packages for Horizon  https://review.openstack.org/11494708:08
*** ihrachyshka has quit IRC08:13
*** ihrachyshka has joined #openstack-infra08:13
*** trinaths has joined #openstack-infra08:17
MaxVAJaeger: For https://review.openstack.org/#/c/114947/ I just have to add08:19
MaxVtemplate:08:19
MaxV      - name: merge-check08:19
MaxVon each project08:20
AJaegerMaxV: Yes.08:20
MaxVok08:20
*** [1]trinaths has joined #openstack-infra08:20
AJaegerThis was done yesterday on all projects, so yours should have it now as well.08:20
AJaegerBut first rebase your change to head - then you see it ;)08:20
*** trinaths has quit IRC08:21
*** [1]trinaths is now known as trinaths08:21
*** Krast has joined #openstack-infra08:22
*** jp_at_hp has joined #openstack-infra08:23
openstackgerritJulien Danjou proposed a change to openstack-infra/config: Use python3-jobs template where possible  https://review.openstack.org/11025608:23
*** derekh has joined #openstack-infra08:23
openstackgerritMaxime Vidori proposed a change to openstack-infra/config: Add XStatic-angular-* packages for Horizon  https://review.openstack.org/11494708:25
openstackgerritJulien Danjou proposed a change to openstack-infra/config: Enable Python 3 job for oslo.messaging  https://review.openstack.org/11520808:25
loki184AJaeger: hi, is the merge-check template mandatory https://review.openstack.org/#/c/110562/08:26
*** gpocente1 is now known as gpocentek08:27
*** gpocentek has joined #openstack-infra08:27
openstackgerritRadomir Dopieralski proposed a change to openstack-infra/config: Create a repository for stackforge/xstatic-font-awesome  https://review.openstack.org/11520908:28
*** doude has joined #openstack-infra08:31
*** tsg has quit IRC08:32
*** amuller has joined #openstack-infra08:32
openstackgerritRadomir Dopieralski proposed a change to openstack/requirements: Add xstatic-font-awesome for Horizon  https://review.openstack.org/11521108:33
*** loki184 has quit IRC08:35
*** hashar has joined #openstack-infra08:35
*** loki184 has joined #openstack-infra08:35
*** xchu has joined #openstack-infra08:36
*** Longgeek has quit IRC08:42
*** Longgeek has joined #openstack-infra08:43
*** xchu has quit IRC08:45
*** frank_zhou has left #openstack-infra08:47
*** Longgeek has quit IRC08:47
openstackgerritA change was merged to openstack-infra/config: Updated storyboard build to use new test modules  https://review.openstack.org/10619308:48
openstackgerritA change was merged to openstack-infra/config: Updated vinz build to use new test modules  https://review.openstack.org/11212808:49
*** Longgeek has joined #openstack-infra08:49
AJaegerloki184, yes, it's mandatory. See also http://ci.openstack.org/stackforge.html08:52
*** p5ntangle has joined #openstack-infra08:52
AJaegerloki184, rebase to head first...08:53
loki184Ajaeger: i have to trouble lifeless again to give +1 for the new patch i upload so asked you whether mandatory08:54
*** denis_makogon has quit IRC08:54
loki184Ajaeger: i will put a new patch08:54
AJaegerloki184, I'm sure fungi will scroll up in the history and notice that lifeless agreed with the plan... If not ask him friendly08:55
loki184Ajaeger: ok ty :)08:56
*** omrim has joined #openstack-infra08:56
omrimHello08:57
*** yamahata has quit IRC08:57
*** ihrachyshka_ has joined #openstack-infra08:59
*** hashar has quit IRC09:00
*** amuller has quit IRC09:01
*** ihrachyshka has quit IRC09:02
*** proffalken has quit IRC09:04
*** jedimike has joined #openstack-infra09:05
*** amuller has joined #openstack-infra09:06
*** rfolco has quit IRC09:07
omrimI have a question..Can someone help please?:)09:08
*** andreaf_ has quit IRC09:10
*** pelix has joined #openstack-infra09:10
*** proffalken has joined #openstack-infra09:11
*** skolekonov has joined #openstack-infra09:13
openstackgerritlokesh s proposed a change to openstack-infra/config: Adding windows disk-image builder project  https://review.openstack.org/11056209:14
openstackgerritFrançois Magimel proposed a change to openstack-infra/config: Added python-cloudkittyclient to stackforge projects  https://review.openstack.org/11250709:14
rdopieralskiomrim: the rule is that you have to ask the question first, and then if anybody knows the answer, they will answer09:15
omrimrdopieralski: Thank you09:17
pleia2clarkb: will need to chat about some pootle issues we ran into tonight, currently have a spinning progress thing stuck on the main page following attempting to upload a po file09:17
pleia2but for now I'm going to bed :)09:17
*** e0ne has joined #openstack-infra09:17
*** ociuhandu has quit IRC09:17
openstackgerritFrançois Magimel proposed a change to openstack-infra/config: Added cloudkitty-dashboard to stackforge projects  https://review.openstack.org/11278909:17
*** fifieldt_ has quit IRC09:18
AJaegerloki184, did you rebase?09:18
omrimI have an issue with my Zuul-Gearman protocol.09:19
*** marekd has joined #openstack-infra09:19
omrimWhen a job start to run I notice that the job flagged as NOT_REGISTERED..09:20
omrimIs someone familiar with that?09:21
*** yolanda__ has joined #openstack-infra09:21
loki184Ajaeger: Yes09:21
AJaegerloki184, looking at your file, it looks old. Did you "git pull origin/master" first?09:22
omrimI assume that the issue came from the following src code (gearman.py):         if not self.isJobRegistered(gearman_job.name):             self.log.error("Job %s is not registered with Gearman" %                            gearman_job)             self.onBuildCompleted(gearman_job, 'NOT_REGISTERED')             return build09:23
*** amuller has quit IRC09:23
AJaegerloki184, looking at https://review.openstack.org/#/c/110562/14/modules/openstack_project/files/zuul/layout.yaml I would expect to see merge-check with each project09:23
*** amuller has joined #openstack-infra09:23
AJaegerbut it'S not in those that are shown - that's why I think you did not rebase properly against head09:23
*** Mithrandir_ has joined #openstack-infra09:24
loki184Ajaeger: let me check09:24
*** Daisy has quit IRC09:24
*** proffalken has quit IRC09:24
*** yolanda_ has quit IRC09:25
*** Mithrandir has quit IRC09:26
*** Mithrandir_ is now known as Mithrandir09:26
*** cnesa7 has joined #openstack-infra09:27
*** proffalken has joined #openstack-infra09:27
loki184Ajaeger: i have rebased it and i dont see merge-check again all the projects09:28
*** proffalken has quit IRC09:29
openstackgerritNadya Privalova proposed a change to openstack-infra/reviewstats: Add nprivalova and ildikov to ceilometer-core  https://review.openstack.org/11522309:29
*** proffalken has joined #openstack-infra09:30
AJaegerloki184, just check http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/layout.yaml#n258409:30
*** baohua_ has quit IRC09:31
AJaegerThat's the current version of the file, line 2587 contains the merge-check for tuskar-ui but it's not in your patch09:31
AJaegerloki184, try:09:33
AJaegergit fetch origin09:33
AJaegerdoes this download files?09:33
openstackgerritFrançois Magimel proposed a change to openstack-infra/config: Added python-cloudkittyclient to stackforge projects  https://review.openstack.org/11250709:33
*** kashyap is now known as kashyapc09:34
openstackgerritFrançois Magimel proposed a change to openstack-infra/config: Added cloudkitty-dashboard to stackforge projects  https://review.openstack.org/11278909:34
*** dims has joined #openstack-infra09:35
loki184AJaeger:  i think something wrong with my branch i will do it again09:35
AJaegerloki184, always work on a branch ...09:36
AJaegerloki184, you could do the following:09:36
AJaegergit checkout master09:36
AJaegergit reset --hard origin/master09:37
AJaegergit review -d 110562 # this downloads your change09:37
AJaegergit rebase origin/master # this rebases your change09:37
AJaegerresolve the merge conflict...09:37
AJaegerand send for review again09:38
loki184Ajaeger: Ty, i was doing the same let me recheck09:38
AJaegerloki184, if you want, I could also update the patch for you...09:38
loki184AJaeger: if you wish you can do it09:39
*** dims has quit IRC09:39
*** andreaf has joined #openstack-infra09:42
loki184Ajaeger: i have change ready i will commit it09:42
*** che-arne has joined #openstack-infra09:43
openstackgerritA change was merged to openstack-infra/config: Do not fail the install_puppet.sh on 2th run  https://review.openstack.org/10500209:43
*** Daviey has quit IRC09:44
openstackgerritlokesh s proposed a change to openstack-infra/config: Adding windows disk-image builder project  https://review.openstack.org/11056209:44
*** alexpilotti has joined #openstack-infra09:45
loki184AJaeger: i submitted again please review09:45
openstackgerritStéphane Albert proposed a change to openstack-infra/config: Added Read the Docs hook to cloudkitty job  https://review.openstack.org/11319409:46
AJaegerloki184, let me check09:47
AJaegerloki184, yeah, looks fine now.09:48
loki184AJaeger: Thanks for the help :)09:49
*** unicell has quit IRC09:51
SergeyLukjanovanteaya, I'm ok with Sahara Community CI or Sahara Mirantis CI if you like09:51
SergeyLukjanovanteaya, Sahara Cluster CI is mostly fair too09:51
*** hashar has joined #openstack-infra09:52
*** ociuhandu has joined #openstack-infra09:58
*** mmaglana has quit IRC09:59
*** pblaho is now known as pblaho|afk10:00
*** bookwar has joined #openstack-infra10:00
*** AJaeger has quit IRC10:00
*** rick__ has quit IRC10:01
*** linkid has joined #openstack-infra10:01
*** MaxV has quit IRC10:03
*** doude has quit IRC10:10
*** Daviey has joined #openstack-infra10:11
*** doude has joined #openstack-infra10:12
*** amuller has quit IRC10:14
*** Guest36489 has quit IRC10:17
*** rlandy has joined #openstack-infra10:18
*** Longgeek has quit IRC10:24
omrimHi, What is the reson that my jobs are not registered with Gearman?10:26
*** _nadya_ has quit IRC10:27
*** _nadya_ has joined #openstack-infra10:27
*** e0ne has quit IRC10:29
*** pblaho|afk is now known as pblaho10:29
*** pcm_ has joined #openstack-infra10:30
*** andreaf has quit IRC10:33
*** zul has quit IRC10:36
*** AlexF has joined #openstack-infra10:42
*** hashar has quit IRC10:42
*** MaxV has joined #openstack-infra10:44
*** Longgeek has joined #openstack-infra10:53
openstackgerritJulie Pichon proposed a change to openstack-infra/config: Add integration tests to the Horizon gate  https://review.openstack.org/11500410:59
*** Azher has quit IRC10:59
*** yaguang_ has joined #openstack-infra11:00
*** amuller has joined #openstack-infra11:01
*** yaguang has quit IRC11:02
*** ihrachyshka_ is now known as ihrachyshka11:04
*** ppai has joined #openstack-infra11:07
openstackgerritA change was merged to openstack-infra/os-loganalyze: Support Designate's log for severity filtering  https://review.openstack.org/10770111:07
*** KanagarajM has quit IRC11:11
*** e0ne has joined #openstack-infra11:15
*** dims has joined #openstack-infra11:17
*** dalgaaf_ has joined #openstack-infra11:18
openstackgerritA change was merged to openstack-infra/config: Add instructions to rename gerrit groups  https://review.openstack.org/11476511:18
*** andreaf has joined #openstack-infra11:19
*** RicoLin has quit IRC11:23
*** Longgeek has quit IRC11:26
*** Longgeek has joined #openstack-infra11:26
openstackgerritRussell Bryant proposed a change to openstack-infra/config: Disable ironic job on stable branches  https://review.openstack.org/11524811:28
jedimikeomrim, hi, I had this problem this morning too, it was because my jenkins jobs were tagged to only build on certain slaves, but I didn't have any slaves online with those tags11:30
jedimikeomrim, so when zuul tried to run the jobs, gearman returns NOT_REGISTERED, which means it doesn't have any suitable nodes registered for the job to run on11:30
openstackgerritPrashanth Pai proposed a change to openstack-infra/config: Add swiftonfile project to stackforge  https://review.openstack.org/11525011:31
omrimjedimike: Unfortunately It's not the issue in my case11:32
omrimjedimike: I do have machines that are indeed ready for each job11:33
omrimjedimike: When some job start I notice that in the gerrit there is the label: NOT_REGISTERED11:34
jedimikeomrim, I wish I could help more, I've only just started looking at our problem so that's all I've discovered so far. I'm not sure what else it might be, sorry11:34
*** loki184 has quit IRC11:37
*** dmsimard_away is now known as dmsimard11:39
*** oanufriev has quit IRC11:39
omrimjedimike: Thank you anyway :)11:40
*** yaguang_ has quit IRC11:41
*** salv-orlando_ has joined #openstack-infra11:43
omrimIs there someone that know why my jobs are not registered with Gearman?11:43
*** salv-orlando has quit IRC11:43
*** salv-orlando_ is now known as salv-orlando11:43
openstackgerritRussell Bryant proposed a change to openstack-infra/config: Remove an unused node type  https://review.openstack.org/11328011:46
openstackgerritRussell Bryant proposed a change to openstack-infra/config: Set min-ready=0 for dsvm-precise-krnl  https://review.openstack.org/11525311:46
*** SumitNaiksatam_ has joined #openstack-infra11:48
*** baohua has joined #openstack-infra11:49
*** SumitNaiksatam has quit IRC11:49
*** SumitNaiksatam_ has quit IRC11:49
rcarrillocruzFYI, puppet-lint 1.0.0 has been released a couple of days ago. It checks newer things that it didn't before, just in case you see all of the sudden puppet-lint check errors when pushing changes11:49
*** salv-orlando has quit IRC11:49
openstackgerritPrashanth Pai proposed a change to openstack-infra/config: Add swiftonfile project to stackforge  https://review.openstack.org/11525011:49
*** SumitNaiksatam has joined #openstack-infra11:49
*** pblaho has quit IRC11:50
openstackgerritA change was merged to openstack-infra/reviewstats: Add nprivalova and ildikov to ceilometer-core  https://review.openstack.org/11522311:54
*** salv-orlando has joined #openstack-infra11:55
*** dkranz has joined #openstack-infra11:56
*** dims has quit IRC11:56
*** weshay has joined #openstack-infra11:57
*** ppai has quit IRC11:58
*** dprince has joined #openstack-infra12:00
*** weshay is now known as weshay_mtg12:00
marcusvrnHi guys...my job dsvm-tempest-full works well the first time that I start it.....if I start the job again, it always returns FAILURE....I found only one error: "ERROR: InvocationError: '/bin/bash tools/pretty_tox.sh..."12:02
openstackgerritA change was merged to openstack-infra/reviewstats: Update documentation setup  https://review.openstack.org/11431912:02
*** Krast has quit IRC12:02
*** sdague has joined #openstack-infra12:04
jpichrussellb: Hello! Thank you for your comments on https://review.openstack.org/#/c/115004/ , I really appreciate it! I am wondering about your last comment: does this mean that this should actually be sufficient to get an experimental job set up, or more simply that you can't see anything egregiously wrong with it at this point?12:04
*** hdd has joined #openstack-infra12:04
russellbjpich: yeah, i think it's OK, as far as i can tell12:06
russellbjpich: assuming you have a py27integration env set up12:06
russellbjpich: the only other thing I thought about suggesting is a change that would make it so "gate" doesn't have to be hard coded, and could be check or gate depending on which pipeline it's in12:07
russellbbut that's really just beatification, not important IMO12:07
jpichrussellb: Oh cool, I thought there'd me more trickstery to it all. The tox environment does exist12:08
russellbjpich: yeah, it's kind of amazing, really12:08
jpichrussellb: Noted for the rest as well, I'll see what I can do. Cheers!12:08
russellbup to you, it's not a big deal12:09
jpichGot it12:09
russellbif you really want to mess with it, it's basically changing "job" to "job-template" and then changing the name to something like "{pipeline}-horizon-integration{branch-designator}'12:09
russellbswift.yaml would be a good example of that12:09
*** dims has joined #openstack-infra12:09
russellbit's close to what you're doing12:09
*** Guest36489 has joined #openstack-infra12:10
*** kashyapc is now known as kashyap12:10
jpichWhat could possibly go wrong12:11
russellbi'd probably just leave it as is and see if someone complains :)12:11
jpichI just might :-) Thanks for the hints either way!12:12
russellbsure np12:12
jpichMaybe I'll do that when it's promoted to a non-experimental job later on12:12
*** pblaho has joined #openstack-infra12:14
*** kashyap is now known as kashyapc12:16
*** ZZelle has joined #openstack-infra12:20
*** pcm__ has joined #openstack-infra12:22
*** rfolco has joined #openstack-infra12:22
*** pblaho has quit IRC12:24
*** jab has joined #openstack-infra12:25
*** pcm_ has quit IRC12:26
*** pdmars has joined #openstack-infra12:26
*** aysyd has joined #openstack-infra12:26
*** kgiusti has joined #openstack-infra12:26
*** pblaho has joined #openstack-infra12:27
*** jab is now known as bradjones12:27
*** annegentle has joined #openstack-infra12:30
*** gargola has joined #openstack-infra12:30
*** bswartz has joined #openstack-infra12:30
*** adalbas has joined #openstack-infra12:32
*** mbacchi has joined #openstack-infra12:35
*** dims has quit IRC12:37
openstackgerritJulien Danjou proposed a change to openstack-infra/config: Use python3-jobs template where possible  https://review.openstack.org/11025612:38
*** dims has joined #openstack-infra12:38
*** AlexF has quit IRC12:39
*** julim has joined #openstack-infra12:42
*** julim has quit IRC12:43
*** unicell has joined #openstack-infra12:45
*** hdd has quit IRC12:45
*** hdd has joined #openstack-infra12:46
*** hashar has joined #openstack-infra12:46
*** trinaths has quit IRC12:46
*** pblaho has quit IRC12:48
*** dizquierdo has quit IRC12:49
*** markmc has joined #openstack-infra12:49
*** maxbit has quit IRC12:50
*** maxbit has joined #openstack-infra12:50
*** annegentle has quit IRC12:52
fungijeblair: awesome--thanks! i'll try out the whole patch series here shortly12:53
*** dkranz has quit IRC12:54
*** pblaho has joined #openstack-infra12:56
openstackgerritTimur Sufiev proposed a change to openstack-infra/config: Create merlin repo  https://review.openstack.org/11032512:56
*** nosnos has quit IRC12:56
*** dkliban_afk is now known as dkliban12:57
*** dkranz has joined #openstack-infra12:57
*** heyongli has joined #openstack-infra13:00
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Add new template stackforge-specs-jobs  https://review.openstack.org/11321113:00
*** jgrimm has joined #openstack-infra13:00
*** pblaho is now known as pblaho|meeting13:00
*** jpeeler has joined #openstack-infra13:01
*** jpeeler has quit IRC13:01
*** jpeeler has joined #openstack-infra13:01
*** amotoki has quit IRC13:03
*** julim has joined #openstack-infra13:03
rcarrillocruzfungi: hi there, how often do you update nodepool images?13:05
Mmikercarrillocruz: daily, if the docs are fine13:05
fungircarrillocruz: daily starting at 1400utc (usually finishes by 1530)13:05
rcarrillocruzjust as a FYI, http://bombasticmonkey.com/2014/08/19/puppet-lint-1.0.0/13:06
rcarrillocruzour bare precise images were updated, and so did the puppet-lint13:06
rcarrillocruzwhich broke a lot of manifests13:06
fungircarrillocruz: oh, neat!13:06
rcarrillocruzjust a FYI in case you guys see puppet-lint job failures as i did13:06
rcarrillocruzit seems it's pickier than it was before13:06
fungircarrillocruz: noted. if we need to, we can pin it or something i guess13:07
rcarrillocruzfor example, it requires ONLY one space between the longest attribute of a class and the '=>'13:07
rcarrillocruzotherwise, you get arrow alignment check failures13:07
rcarrillocruzyep, just in case13:07
rcarrillocruzbbl, lunch13:07
* fungi loves tools which are picky about non-semantic whitespace. such a great waste of everyone's time13:08
mattymocan an abandoned patchset be restored by anyone except the owner?13:08
*** dustins has joined #openstack-infra13:11
fungimattymo: any core reviewer for the same project too13:11
mattymofungi, thanks!13:11
*** bknudson has joined #openstack-infra13:12
*** pradk has joined #openstack-infra13:12
flaper87is there a good way to debug "git clone" issues in the gate? I'm hitting this http://logs.openstack.org/65/115265/3/check/gate-tempest-dsvm-large-ops/ba64713/logs/devstacklog.txt.gz#_2014-08-19_12_24_19_15013:13
flaper87but the same git_clone command seem to work locally13:13
flaper87and I don't see any git error in the logs13:13
*** p5ntangle has quit IRC13:14
*** mriedem has joined #openstack-infra13:15
*** mfer has joined #openstack-infra13:16
*** ominakov has joined #openstack-infra13:17
flaper87ah nvm... (facepalm)13:19
*** miqui has joined #openstack-infra13:19
*** paulrad has joined #openstack-infra13:20
*** ilyashakhat has joined #openstack-infra13:21
*** gfidente has joined #openstack-infra13:21
gfidenteguys, I'm not sure where gerrit is picking up the list of uses when adding someone to a review but today my name/email appears twice in that list and neither of two work, as I get a message saying it doesn't not map to a user/identity13:22
gfidenteany idea what is going on? maybe needs some cleanup?13:22
*** dizquierdo has joined #openstack-infra13:23
*** pdmars has quit IRC13:23
*** ildikov_ has quit IRC13:23
*** pdmars has joined #openstack-infra13:23
*** radez_g0n3 is now known as radez13:25
fungiflaper87: it looks like you're running afoul of the reclone restrictions in devstack--you probably need to dig into how to go about that. also i doubt we want to be cloning from git directly there... instead we should be using the same precloned git sources we use for all the other projects in our integration tests, right?13:27
*** pdmars has quit IRC13:28
fungiflaper87: anyway, probably #openstack-qa will be a better venue to discuss that sort of design requirement13:28
gfidenteso I cannot add my user as reviewer to the submissions; any idea what is gerrit doing there? something I can look into by myself?13:28
fungigfidente: there may be multiple gerrit accounts for you13:28
openstackgerritA change was merged to openstack-infra/config: Create a repository for additional Tuskar-UI plugins  https://review.openstack.org/10810213:28
*** penguinRaider has quit IRC13:29
gfidentefungi, yeah that seems to be but both have same name/email and the thing is that neither seems to work13:29
*** hdd has quit IRC13:29
*** jaypipes has joined #openstack-infra13:29
flaper87fungi: I'll ask there. I was not aware of the precloned git sources. Following what glance does there, I thought that was the desired thing. I also looked into what oslo.messaging does since the case is similar13:29
flaper87fungi: thanks for the feedback, I'll dig a bit more13:29
fungigfidente: i've seen that when users change something on lp, which causes lp to decide to switch them to a new openid url, then gerrit reimports their e-mail address for the new account and starts breaking because of the e-mail address conflicting (gerrit assumes e-mail addresses will be unique, but does not enforce that when adding them from an openid provider)13:30
gfidentefungi, AAAh, I see that now13:30
fungigfidente: did you switch lp accounts, rename one or merge it with another recently?13:31
*** ildikov has joined #openstack-infra13:31
gfidentefungi, I played a bit with the groups memberships13:31
*** pblaho|meeting is now known as pblaho13:31
fungihrm, usually i wouldn't expect changing lp team membership to affect that13:31
*** penguinRaider has joined #openstack-infra13:32
*** pdmars has joined #openstack-infra13:32
gfidenteuhm and we have no control over LP anyway13:32
*** pcrews has joined #openstack-infra13:33
fungigfidente: yeah, basically i need to ferret out whatever various accounts it ended up creating for you and try to disable the ones you're not using to eliminate the conflict. just a moment13:33
*** ildikov_ has joined #openstack-infra13:34
*** ildikov has quit IRC13:34
*** pcrews_ has joined #openstack-infra13:34
openstackgerritJulien Danjou proposed a change to openstack-infra/config: Import pylockfile  https://review.openstack.org/10191113:34
*** pblaho has quit IRC13:34
*** pdmars has quit IRC13:35
openstackgerritA change was merged to openstack-infra/config: Create refs permission isn't needed for sahara now  https://review.openstack.org/11383413:35
openstackgerritJulien Danjou proposed a change to openstack-infra/config: Import pylockfile  https://review.openstack.org/10191113:35
*** hashar_ has joined #openstack-infra13:35
*** pdmars has joined #openstack-infra13:35
*** pcrews__ has joined #openstack-infra13:36
*** heyongli has quit IRC13:37
*** eharney has joined #openstack-infra13:37
*** pblaho has joined #openstack-infra13:37
*** pcrews has quit IRC13:38
*** hashar has quit IRC13:38
*** penguinRaider has quit IRC13:39
*** homeless has joined #openstack-infra13:39
*** pcrews_ has quit IRC13:39
*** ominakov_ has joined #openstack-infra13:40
*** dmellado has joined #openstack-infra13:41
*** pcrews__ has quit IRC13:41
gfidentefungi, if there is anything I can do myself, please let me know13:41
gfidenteI did not intend to bother with this, thought was more of a generic problem13:41
*** ominakov has quit IRC13:41
*** penguinRaider has joined #openstack-infra13:41
fungigfidente: yep, two accounts for you in gerrit, both with the same full name and preferred e-mail address. creation date on the more recent one is about two weeks ago13:41
*** dizquierdo has quit IRC13:42
*** oomichi has quit IRC13:42
gfidentetwo weeks ago I suppose can be deleted, after I'm logged in gerrit, I can see all submissions both older and newer than two weeks13:43
*** pcrews has joined #openstack-infra13:43
gfidenteso I suppose something happened 2 weeks ago, but lucky me never logged in with that account?13:43
fungigfidente: well, you did log in with that account, which is how it ended up being created in gerrit (accounts are autocreated based on the openid url passed back from external authentication, in this case launchpad)13:44
fungii've moved that openid to be an additional one on your old account and then deactivated the newer account13:44
gfidentewasn't login.ubuntu.com updated few weeks back?13:45
fungigfidente: log out of gerrit and back in, and then see if things are working any better13:45
fungigfidente: yeah, they did some new theming at least to match ubuntu one's interface better, but not sure if that had any backend implications13:45
*** jcoufal has quit IRC13:45
*** jcoufal has joined #openstack-infra13:46
*** HenryG_ has joined #openstack-infra13:46
gfidenteI logged out and back in13:46
*** zz_dimtruck is now known as dimtruck13:46
*** HenryG has quit IRC13:47
gfidenteI see two identities, one from login.ubuntu.com and one from login.launchpad.net in gerrit settings13:47
gfidentemaybe that was it?13:47
fungigfidente: quite possibly13:48
gfidentefungi, but I was able to add my accunt to a review now so I'm fine with current setup13:49
gfidentethanks a lot13:49
fungigfidente: and yeah, i wouldn't be surprised if they (very briefly) while updating login.launchpad.net configured it to report as login.ubuntu.com instead, then switched it back as soon as they realized it broke everyone using it, but you logged into gerrit during that window and ended up with a second account. if so, there are possibly more users in the same boat13:50
gfidenteI see what you mean13:51
openstackgerritDan Prince proposed a change to openstack-infra/config: Import os-net-config project under TripleO  https://review.openstack.org/11233113:52
*** RicoLin has joined #openstack-infra13:54
openstackgerritMalini Kamalambal proposed a change to openstack-infra/config: Update Marconi to Zaqar  https://review.openstack.org/11529113:55
*** gargola has quit IRC13:57
*** gargola has joined #openstack-infra13:58
*** hashar_ is now known as hashar13:58
*** stevemar has joined #openstack-infra14:03
*** marun has joined #openstack-infra14:04
*** marun is now known as marun_afk14:05
flaper87fungi: I think I need to add glance.store to the list of the pre-cloned repos. Any hint? I've no idea how to do that.14:05
fungiflaper87: yeah, let me find it for you14:06
fungiflaper87: probably at least in lib/glance14:07
*** HenryG_ is now known as HenryG14:07
fungiwhich you already tried in your change14:07
*** markmcclain has joined #openstack-infra14:07
flaper87fungi: right :/14:08
*** dmakogon_ is now known as denis_makogon14:08
fungioh, i know where to find it14:08
*** enikanorov__ has joined #openstack-infra14:09
fungihrm, you also already added it to stackrc14:10
*** enikanorov has quit IRC14:10
*** stevemar has quit IRC14:11
*** tnurlygayanov has quit IRC14:11
fungiflaper87: oh, you may *first* need to add it to the PROJECTS list in openstack-infra/devstack-gate:devstack-vm-gate-wrap.sh14:11
*** stevemar has joined #openstack-infra14:11
flaper87fungi: ah there you go, I think that's what I was looking for14:12
flaper87fungi: thanks D14:12
flaper87:D14:12
*** amotoki has joined #openstack-infra14:12
*** oomichi has joined #openstack-infra14:12
*** dizquierdo has joined #openstack-infra14:13
openstackgerritFlavio Percoco proposed a change to openstack-infra/devstack-gate: Add glance.store to the list of projects  https://review.openstack.org/11529914:14
openstackgerritFlavio Percoco proposed a change to openstack-infra/devstack-gate: Add glance.store to the list of projects  https://review.openstack.org/11529914:14
flaper87fungi: ^14:14
flaper87thanks for your help here, fungi14:14
fungiflaper87: yw!14:15
*** nelsnelson has joined #openstack-infra14:16
*** abhishekk has joined #openstack-infra14:16
*** oomichi has quit IRC14:17
abhishekkhi, I have submitted this patch https://review.openstack.org/#/c/102215/ for updating the version of websockify library14:17
abhishekkwhich is merged14:17
*** chandankumar has quit IRC14:17
abhishekkbut still I am not able to see the latest websockify in http://pypi.openstack.org/openstack/websockify/14:17
abhishekkcan anybody help me to understand how this latest websockify will be uploaded to http://pypi.openstack.org/openstack/websockify/14:18
*** lttrl has joined #openstack-infra14:18
*** mfer has quit IRC14:23
*** david-lyle has joined #openstack-infra14:24
*** linkid has quit IRC14:24
*** malini has joined #openstack-infra14:25
*** maxbit_ has joined #openstack-infra14:25
maliniHello..Can I get a couple of reviews for https://review.openstack.org/#/c/115291/ ? We need this to unblock Zaqar (Marconi) gate14:25
*** reed has joined #openstack-infra14:26
*** ramashri has joined #openstack-infra14:26
*** reed has quit IRC14:26
*** reed has joined #openstack-infra14:26
*** marun_afk has quit IRC14:27
*** maxbit has quit IRC14:28
*** hdd has joined #openstack-infra14:30
*** ramashri has quit IRC14:30
*** tonytan4ever has joined #openstack-infra14:34
*** markvoelker has joined #openstack-infra14:34
openstackgerritLonggeek proposed a change to openstack-infra/puppet-apparmor: Add Rakefile file and update puppet coding style  https://review.openstack.org/10279414:35
*** tsg has joined #openstack-infra14:35
*** ramashri has joined #openstack-infra14:35
openstackgerritLonggeek proposed a change to openstack-infra/puppet-dashboard: Add Rakefile file and dd variables and document  https://review.openstack.org/10279614:35
markvoelkerAnybody around to have a look at https://review.openstack.org/#/c/100632/?  Seems that review got lost in the gate. It is Workflow +1 but never seems to have gotten picked up.14:36
openstackgerritA change was merged to openstack-infra/config: Add tripleo to specs.o.o  https://review.openstack.org/11158814:36
*** maxbit_ has quit IRC14:36
*** dangers_away is now known as dangers14:37
*** rdopieralski has quit IRC14:37
*** ildikov_ has quit IRC14:38
*** mestery_afk is now known as mestery14:39
abhishekkhi, can any one help me to understand how to upload latest library in http://pypi.openstack.org/openstack/websockify/14:40
fungiabhishekk: look in http://pypi.openstack.org/simple/websockify/ instead14:40
fungiabhishekk: the other url is our old mirror which we don't use/update any longer14:40
abhishekkfungi: thank you14:41
fungiabhishekk: also, our mirror now updates basically as soon as something is uploaded to pypi.python.org. we no longer base it on the global-requirements.txt contents14:41
abhishekkfungi:thank you for the update14:42
*** datsun180b has joined #openstack-infra14:43
*** Guest36489 has quit IRC14:43
*** dmellado has quit IRC14:44
*** kashyapc is now known as kashyap14:45
*** dizquierdo has quit IRC14:46
*** pblaho is now known as pblaho|afk14:46
*** atiwari has joined #openstack-infra14:46
yolanda__anteaya, fungi, if i want to update documentation on http://ci.openstack.org/nodepool/, where should i clone from?14:47
*** wenlock has joined #openstack-infra14:47
*** pblaho|afk is now known as pblaho14:47
openstackgerritFelipe Reyes proposed a change to openstack-infra/elastic-recheck: Add fingerprint for bug 1358779  https://review.openstack.org/11530614:48
uvirtbotLaunchpad bug 1358779 in openstack-ci "swift: no space left on device" [Undecided,New] https://launchpad.net/bugs/135877914:48
fungiyolanda__: that's the documentation in the nodepool repository14:48
*** kashyap is now known as kashyapc14:48
fungiyolanda__: http://git.openstack.org/cgit/openstack-infra/nodepool/tree/doc/source14:49
*** kashyapc is now known as kashyap14:49
*** tonytan4ever has quit IRC14:51
*** markmcclain has quit IRC14:52
*** hdd has quit IRC14:53
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add fingerprint for nova unit test bug 1357578  https://review.openstack.org/11468014:53
uvirtbotLaunchpad bug 1357578 in nova "Unit test:  nova.tests.integrated.test_multiprocess_api.MultiprocessWSGITest.test_terminate_sigterm timing out in gate" [Undecided,New] https://launchpad.net/bugs/135757814:53
*** tnurlygayanov has joined #openstack-infra14:53
*** markmcclain has joined #openstack-infra14:53
*** mfer has joined #openstack-infra14:54
omrim Is there someone that know why my jobs are not registered with Gearman?14:57
*** hdd has joined #openstack-infra14:58
fungiomrim: perhaps you have a firewall or some local packet filtering restricting traffic between your zuul server's gearman service and the gearman plugin on your jenkins master?14:58
*** afazekas has quit IRC14:58
fungiomrim: or you haven't enabled the plugin?14:59
*** julim has quit IRC14:59
*** dkranz has quit IRC15:00
fungiomrim: have you done a 'echo status|nc -q 3 localhost 4730' on your zuul server and looked through the output to see if your jobs are registered incorrectly (rather than not at all)?15:00
*** mestery is now known as mestery_afk15:01
yolanda__fungi, thx, i was thinking in some manuals repo15:02
*** imeerovi has quit IRC15:02
yolanda__were you able to merge nodepool dib changes?15:02
*** arosen1 has joined #openstack-infra15:03
omrimfungi: First Yes I indeed enable the Gearman Jenkins Plugin Second I run this command and I saw that all of the jobs have a worker and they do run correctly15:03
*** annegentle has joined #openstack-infra15:03
*** arosen1 has quit IRC15:03
*** skolekonov has quit IRC15:03
*** gokrokve has joined #openstack-infra15:03
*** annegentle has quit IRC15:03
*** AlexF has joined #openstack-infra15:03
fungiyolanda__: they merged but we haven't restarted nodepool yet to implement them15:03
*** arosen1 has joined #openstack-infra15:03
*** arosen1 has quit IRC15:04
*** annegentle has joined #openstack-infra15:04
fungiomrim: have you looked in zuul's debug log to find out what job-name:node-label combination it's seeking for those jobs? when it determines a job is not registered it logs what it thought should be registered which wasn't15:04
phschwartzMorning infra15:05
fungiyolanda__: perhaps later this evening once the test volume drops off we can try to remember to do that15:06
*** tonytan4ever has joined #openstack-infra15:06
fungiphschwartz: hey there. did you see my comment yesterday about those mystery issues in dfw?15:06
*** arosen1 has joined #openstack-infra15:06
*** arosen1 has quit IRC15:06
*** mmaglana has joined #openstack-infra15:06
*** tsg has quit IRC15:07
omrimYes I take a look  into the logs15:07
*** Guest36489 has joined #openstack-infra15:07
fungiphschwartz: to recap, since our daily image update on friday went into effect, we've seen no recurrence of any of those three symptoms we were tracking15:08
*** marun has joined #openstack-infra15:08
omrimfungi: Now I will take a look again to sfor you suggestion15:08
fungiphschwartz: so just wondering if anything was perhaps found/fixed in dfw on friday... if so i'll go ahead and close out the bugs we have open on our end15:08
*** marun has quit IRC15:09
*** marun has joined #openstack-infra15:09
*** marun has quit IRC15:09
*** abhishekk has quit IRC15:10
*** marun has joined #openstack-infra15:10
*** marun has quit IRC15:10
*** directxman12 has joined #openstack-infra15:12
*** markmcclain has quit IRC15:12
*** marun has joined #openstack-infra15:14
*** dkranz has joined #openstack-infra15:14
*** maxbit has joined #openstack-infra15:15
*** ramashri has quit IRC15:15
*** directxman12 has quit IRC15:15
*** Guest36489 has quit IRC15:16
*** primeministerp has joined #openstack-infra15:17
*** primemin1sterp has joined #openstack-infra15:17
*** primemin2sterp has joined #openstack-infra15:18
*** linkid has joined #openstack-infra15:18
*** alexpilotti has quit IRC15:18
*** amuller_ has joined #openstack-infra15:18
*** flaper87 is now known as flaper87|afk15:19
*** hogepodge has joined #openstack-infra15:20
*** amuller has quit IRC15:20
lxslifungi: https://review.openstack.org/#/c/108737/ has 2x +2 now, please would you review and maybe approve?15:20
lxslior any other infra core :)15:20
*** marun has quit IRC15:22
*** ihrachyshka has quit IRC15:22
*** zz_gondoi is now known as gondoi15:23
fungilxsli: i suppose my concerns about applying iptables rules peculiar to tripleo's infrastructure network to all of our job workers regardless of provider were not shared by other infra cores...15:23
jeblairfungi: oh, i didn't read that as a very strong objection15:25
*** isaacb_ has joined #openstack-infra15:26
jeblairfungi, lxsli: but now that you mention it, why doesn't devtest just do this?15:27
isaacb_Hi15:27
*** che-arne has quit IRC15:28
*** roaet has left #openstack-infra15:28
omrimfungi: I found somtinh like that: 2014-08-19 16:05:16,227 INFO zuul.Gearman: Launch job Check-MLNX-Neutron-ML2-Sriov-driver for change <Change 0x7f0b08239b50 74134,9> with dependent changes [] 2014-08-19 16:05:16,227 ERROR zuul.Gearman: Job <gear.Job 0x7f0b081699d0 handle: None name: build:Check-MLNX-Neutron-ML2-Sriov-driver unique: 8bea9eb4c36c4144b3c662bc2201043c> is not registered with Gearman 2014-08-19 16:05:16,227 INFO15:28
*** lukego has quit IRC15:28
omrimfungi: what is the reason for the error: "is not registered with Gearman"15:29
isaacb_anyone has experience with dsvm-tempest-full?15:29
jeblairisaacb_: lots of us do, but you might want to ask a more specific question.15:30
*** baohua has quit IRC15:30
*** e0ne has quit IRC15:31
*** lcheng has joined #openstack-infra15:32
*** atiwari has quit IRC15:32
fungijeblair: lxsli: they weren't strong concerns, but this is a case of something else in another part of tripleo's cloud communicating with the worker over the backend network, applicable to a very limited set of jobs15:32
fungiso it seemed preferable to only apply that to the specialized workers which run them15:32
lxslifungi jeblair: I think other cores felt the alternative (new kind of node) was less appealing than this wafer-thin change15:33
*** e0ne has joined #openstack-infra15:33
fungibut i agree our puppet (if that's the best place to address it) would require some fairly complex added layering to accomplish it15:33
lxslifungi: the devtest script runs on the Jenkins node whereas the hole needs to be added from the nodepool node15:33
jeblairlxsli: the jenkins node is the nodepool node15:34
fungilxsli: the jenkins slave and the nodepool node are the same machine15:34
*** hashar has quit IRC15:34
jeblairlxsli: so it seems like devtest could just run an iptables command to add the hole15:34
*** Ish__ has joined #openstack-infra15:34
jeblairmuch like devstack does similar things15:35
lxslitwo secs have fetched help, I think I may have used incorrect terminology15:36
lxsliby the nodepool node, I meant the libvirt pool node15:37
*** praneshp has joined #openstack-infra15:39
*** mestery_afk has quit IRC15:39
phschwartzfungi: Awesome for the follow up. We are watching though just in case15:40
*** isaacb_ has quit IRC15:41
*** gyee has joined #openstack-infra15:41
fungiphschwartz: so no clue what may have been fixed? i always worry about problems which quietly vanish :/15:41
*** che-arne has joined #openstack-infra15:42
*** afazekas has joined #openstack-infra15:42
phschwartzfungi: No changes at all on our end as we had not located an issue yet.15:42
fungispooky15:42
phschwartzWorries me too15:42
lxslifungi jeblair: does that make more sense?15:43
*** dimtruck is now known as zz_dimtruck15:44
*** juzuluag has joined #openstack-infra15:45
fungilxsli: so... the script called directly by the jenkins job (which runs in the same context as our nodepool prep scripts have puppeted the original firewall rules into the boot snapshot) would be a place to make it happen. maybe that's not actually devtest itself... i need to review the job definition15:45
*** dtantsur is now known as dtantsur|brb15:45
*** e0ne has quit IRC15:46
fungilxsli: the commit message doesn't mention any particular job... what job(s) are going to need that?15:48
lxsliThe whole check-tripleo pipeline I believe15:48
lxsliIt's to do with seed standup so it affects everything15:48
fungilxsli: most of the jobs in jenkins_job_builder/config/tripleo.yaml seem to call a custom devstack-gate gate_hook of toci_gate_test.sh15:49
openstackgerritAishwarya Thangappa proposed a change to openstack-infra/storyboard: Added a subscription_events table & subscription hander  https://review.openstack.org/11301615:49
fungiseed standup?15:49
fungii'm not sure i follow. what's the seed?15:49
fungiand how does it stand up?15:49
lxsliOK, stop me if I'm overexplaining15:50
lxsliTripleO is the Openstack-on-Openstack program15:50
lxslidesigned to allow an openstack system (the overcloud) to be deployed using openstack tooling15:50
*** IvanBerezovskiy has left #openstack-infra15:50
* fungi knows most of the background, just not familiar with the internal implementation details for toci15:51
lxslito do this it deploys an undercloud, the compute nodes of which run instances which provide the overcloud compute nodes and backplace15:51
lxsli*backplane15:51
lxslithe seed does the same job for the undercloud, for bootstrap reasons - eventually we hope it'll not be needed15:52
*** derekh has quit IRC15:52
fungilxsli: the single_use_slave.pp you're trying to modify in 108737 is (intended to be) used exclusively to configure the context in which the jenkins slave agent is running15:52
lxsliso if the seed doesn't stand up due to the race condition the fix dependent on this firewall hole fixes, the undercloud and overcloud can't stand up15:52
*** loki184 has joined #openstack-infra15:53
*** shashankhegde has joined #openstack-infra15:54
lxsliHow is the libvirt pool configured then?15:54
fungilxsli: i have no idea what a libvirt pool is15:54
fungilxsli: explanation from the other end...15:55
*** armax has joined #openstack-infra15:55
fungithe nodepool server connects to the tripleo test cloud api endpoint15:55
lxslithat's what lifeless calls it :x15:55
*** wenlock has quit IRC15:55
*** mriedem has quit IRC15:55
*** sdague has quit IRC15:55
loki184fungi: hi, lifeless gave +1 for the patch https://review.openstack.org/#/c/110562/ can you please review the patch15:55
fungithe nodepool server then asks that cloud to nova boot an instance from a base image15:56
fungiin glance15:56
*** sdake has joined #openstack-infra15:56
*** sdake has quit IRC15:56
*** sdake has joined #openstack-infra15:56
lxsliThat sounds like it - the "tripleo test cloud"15:56
*** zz_dimtruck is now known as dimtruck15:57
fungionce that "template" instance is booted, the nodepool server logs into it via ssh and runs a "prep" script which calls other scripts, applies that openstack_project::single_use_slave puppet class and does some other things15:57
*** chandankumar has joined #openstack-infra15:57
lxsliNick is agreeing with this15:57
fungithen the nodepool server asks the tripleo test cloud to stop that template instance and take a snapshot15:57
fungilater, the nodepool server asks the tripleo test cloud to nova boot some arbitrary number of instances from that template snapshot image15:58
fungieach of those instances runs a jenkins slave agent, and is registered into a jenkins master as a new slave15:58
*** Guest36489 has joined #openstack-infra15:58
openstackgerritAdrian Otto proposed a change to openstack-infra/config: OpenStack Containers Service  https://review.openstack.org/11532815:59
fungithese nodepool nodes, which are also jenkins slaves, are assigned a group label which marks them as suitable for running tripleo-specific jenkins jobs15:59
*** emagana has joined #openstack-infra15:59
*** dims has quit IRC15:59
*** dims has joined #openstack-infra15:59
fungiwhen zuul decides a job should be run, the configuration for those jobs (as templated via jenkins-job-builder in the tripleo.yaml) are executed on an available nodepool node16:00
*** otherwiseguy has joined #openstack-infra16:00
*** MarkAtwood has joined #openstack-infra16:00
fungilxsli: so basically, things can either be preconfigured and baked into the snapshot image for those nodes (via puppet/prep script) or applied at job run time by shell called from the jenkins job16:01
fungibut either way, they're both configuring behavior within that same context (the system which is the nodepool node, which is also where the jenkins slave agent is running)16:02
lxsliSo you're suggesting instead of affecting all nodepool nodes, we could run a shell step in tripleo.yaml to punch the hole?16:02
*** primemin1sterp has quit IRC16:02
*** primeministerp has quit IRC16:03
*** ildikov has joined #openstack-infra16:03
*** primemin2sterp has quit IRC16:03
fungipossibly, if it's acceptable to do that at job run time rather than having it baked into the snapshot image so that it's already in place as each nodepool node is booted16:03
*** primeministerp has joined #openstack-infra16:03
*** wenlock has joined #openstack-infra16:03
*** mriedem has joined #openstack-infra16:03
*** sdague has joined #openstack-infra16:03
*** dims has quit IRC16:04
*** alexpilotti has joined #openstack-infra16:04
*** mika has quit IRC16:04
openstackgerritMatt Kovacs proposed a change to openstack-infra/config: Adding project saml-generator  https://review.openstack.org/11037816:05
*** arnaud has joined #openstack-infra16:05
fungithe current complication with modifying the snapshot as it's built is that all our nodepool nodes derive from a single puppet class, so if you try to modify that behavior in puppet it's going to end up applying to pretty much all nodepool nodes unless we add further conditional indirection in puppet16:05
*** AlexF has quit IRC16:05
*** alexpilotti has quit IRC16:06
fungibecause of this we mostly differentiate our nodepool node snapshot image configurations using the various node-label-specific nodepool prep scripts16:06
*** alexpilotti has joined #openstack-infra16:06
fungi(though differences peculiar to particular operating system distributions are handled deeper in the puppet manifest through platform-specific conditional blocks)16:07
*** timrc is now known as timrc-afk16:08
*** dkranz has quit IRC16:08
*** rdopieralski has joined #openstack-infra16:09
*** atiwari has joined #openstack-infra16:09
fungilabel-specific nodepool prep scripts are specified in http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/templates/nodepool/nodepool.yaml.erb via provider.images.setup parameters16:09
fungiand the contents of those scripts are found at http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/nodepool/scripts/16:10
*** hashar has joined #openstack-infra16:10
*** emagana has quit IRC16:11
*** ramashri has joined #openstack-infra16:11
*** emagana has joined #openstack-infra16:12
*** mfer has quit IRC16:12
fungiso for example the "tripleo-precise" nodes are configured by running prepare_node_tripleo.sh (which is a wrapper around both prepare_node.sh and prepare_tripleo.sh)16:12
*** emagana has quit IRC16:12
*** emagana has joined #openstack-infra16:12
*** tomhe has joined #openstack-infra16:13
fungiif the firewall rule needs to be added before the node is booted rather than at the start of the jenkins job, it might make sense to implement it within prepare_tripleo.sh where the other internal network interface configuration is happening16:14
lxsliSo it looks like my patch https://review.openstack.org/#/c/110653/ is what you're suggesting?16:14
lxslimodulo several errors16:14
*** Guest36489 has quit IRC16:14
*** jlibosva has quit IRC16:14
*** afazekas_ has joined #openstack-infra16:14
lxsliI can fix the errors and unabandon if that's the correct solution?16:14
lxsliWe don't care which lands, you're the infra guy, just need this hole :)16:15
*** pblaho has quit IRC16:15
*** tsg has joined #openstack-infra16:16
fungilxsli: i probably should debate this with clarkb once he's around. i don't think he directly rejected that design any more than i'm directly rejecting the other design, we should just discuss the tradeoffs for each and come to a decision16:16
jeblairfungi, lxsli: what about the run-time design?16:16
fungiright, we also need to know if both these other designs are actually unneeded (if it can just be done as teh job runs rather than baked into configuration in advance)16:17
*** sdake has quit IRC16:17
*** sdake has joined #openstack-infra16:17
*** MaxV has quit IRC16:18
zaropelix: do you have any suggestions for testing this change? https://review.openstack.org/#/c/8510616:18
*** MaxV has joined #openstack-infra16:18
*** omrim has quit IRC16:19
*** amuller__ has joined #openstack-infra16:19
*** sdake has quit IRC16:20
*** sdake has joined #openstack-infra16:20
*** marun has joined #openstack-infra16:21
*** marcoemorais has joined #openstack-infra16:21
tomhejeblair: I upgraded our internal (non-openstack) Zuul this weekend (coming from March 14 Fix ZUUL_COMMIT in certain conditions) and since the upgrade Zuul fails to detect patchset-created for patch set #1 on changes. Following patch sets (#2, #3, ...) gets detected and put in pipelines. Any hints on how to debug? I don't see any obvious errors in the log files.16:22
pelixzaro: thanks for the reminder on that, since with your changes in for testing the cmdline it should be easy to add something to test16:22
pelixzaro: could try mocking the recurse_path or the os.walk function to return a predefined set of values and then mock the builder.update_job method to check the final data passed through16:22
*** MaxV has quit IRC16:23
*** amuller_ has quit IRC16:23
*** marun has quit IRC16:23
zaropelix: maybe suggest that to the author?16:23
*** arnaud has quit IRC16:24
*** melwitt has joined #openstack-infra16:24
*** marun has joined #openstack-infra16:24
pelixzaro: I will, or if he's busy I'll look at uploading a new version since the current patch is a combination of both our approaches16:24
*** marun has quit IRC16:25
zaropelix: sounds good, thanks!16:25
*** shashankhegde has quit IRC16:26
*** julim has joined #openstack-infra16:27
zarohashar, pelix : this one is confusing me.  https://review.openstack.org/#/c/10002016:27
*** Guest36489 has joined #openstack-infra16:27
*** cody-somerville has quit IRC16:28
zaroseems like it's a dup of https://review.openstack.org/#/c/85336 and this one merged.16:28
zaroi'm confused as to what we are doing there.16:28
pelixsubstitution happening in slight different places16:29
*** Ish__ has quit IRC16:30
*** Ish__ has joined #openstack-infra16:31
hasharzaro: https://review.openstack.org/#/c/85336 has been reverted by https://review.openstack.org/#/c/105156/ and this is being reproposed16:31
pelixhttps://review.openstack.org/#/c/103134/ probably gives a better description, but https://review.openstack.org/#/c/85336 introduced a regression which causes problems that weren't caught at the time16:31
hasharyeah that caused a regression with my jobs definitions :/16:31
hashardarragh eventually added some hack to make it work.16:32
pelixThink we should get https://review.openstack.org/#/c/105155/ in first as that tests the existing behaviour and then go through the original change and see if my hack is really the best solution to the problem16:32
*** marun has joined #openstack-infra16:32
pelixSorry wrong change16:33
*** AlexF has joined #openstack-infra16:33
*** markmcclain has joined #openstack-infra16:34
openstackgerritAlexis Lee proposed a change to openstack-infra/config: Add firewall traffic on port 27410  https://review.openstack.org/11065316:34
openstackgerritFelipe Reyes proposed a change to openstack-infra/elastic-recheck: Add fingerprint for bug 1358779  https://review.openstack.org/11530616:35
uvirtbotLaunchpad bug 1358779 in openstack-ci "swift: no space left on device" [Undecided,New] https://launchpad.net/bugs/135877916:35
lxslifungi: updated ^^  please have a look16:35
lxslithanks very much for your help16:35
lxslifungi: https://review.openstack.org/11065316:35
zarohashar, pelix : should we go ahead and merge https://review.openstack.org/#/c/103134 then?  i've already gave it a +2.16:36
*** SumitNaiksatam has quit IRC16:36
hasharzaro: yeah I think both are fine16:37
*** SumitNaiksatam has joined #openstack-infra16:37
hashar103134 is an integration test I wrote to highlight the regression16:37
*** datsun180b has quit IRC16:37
fungilxsli: have you inquired as to why this needs to be done during the image build rather than when the jobs are run?16:37
*** datsun180b has joined #openstack-infra16:37
hasharzaro: so if integration test from 103134 pass that means parent change https://review.openstack.org/#/c/100020/ is fine :D16:37
pelixhashar: I think you meant https://review.openstack.org/#/c/105157/16:37
pelixthat has the regression test without the hack ;-)16:38
hasharoh16:38
hasharsee I am confused16:38
lxslifungi: tripleo sees the node as a black box so it's hard to do at runtime16:38
pelixI think we need to cherry-pick https://review.openstack.org/#/c/100020 and https://review.openstack.org/#/c/10313416:39
openstackgerritLadislav Smola proposed a change to openstack/requirements: Update xstatic-rickshaw to >= 1.5.0  https://review.openstack.org/11094816:39
*** jedimike has quit IRC16:39
fungilxsli: i'm still lacking sufficient detail there... you're saying that the socket needs to be reachable early during the node boot process rather than when the job starts?16:39
jeblairtomhe: do you see any activity in the zuul debug log related to the first patchset created?  if not, you might enable debug logging for the gerrit zuul module to see exactly what zuul is receiving from gerrit16:40
jeblairtomhe: [logger_gerrit]16:40
jeblairtomhe: level=DEBUG16:40
lxslifungi: from the devtest script, we don't know where the libvirt node is so we don't know that we need to punch a hole16:40
jeblairtomhe: in the zuul logging config (we leave ours set to INFO normally because it's verbose)16:40
lxslifungi: usually the script runs on the same node as the libvirt instance but in CI it doesn't16:41
*** Ish__ has quit IRC16:41
tomhejeblair: Thanks, I'll enable more debugging and see what I can find.16:41
fungilxsli: right, which is why i was suggesting to run it in the job rather than wherever devtest script is running16:41
openstackgerritAlexis Lee proposed a change to openstack-infra/config: Add firewall traffic on port 27410  https://review.openstack.org/11065316:42
*** timrc-afk is now known as timrc16:42
fungilxsli: the jenkins slave is the same instance you're configuring by changing the puppet manifest16:42
*** RicoLin has quit IRC16:42
lxsliso for dummies, in the tripleo.yaml?16:42
pelixzaro hashar: https://review.openstack.org/#/c/100020 could go in now, may need rebasing to apply (doc changes), https://review.openstack.org/#/c/103134 should either be added after a new submission of https://review.openstack.org/#/c/85336 including the hack from https://review.openstack.org/#/c/105155/ (or a alternative approach), or combined with the previous two.16:42
fungilxsli: right, or in the gate_hook script being called from there16:43
*** amuller__ is now known as amuller16:43
*** gokrokve_ has joined #openstack-infra16:43
jeblairor whatever the gate_hook calls16:43
*** mmaglana has quit IRC16:43
hasharpelix: will attempt to look at it later in the evening. In meeting right now then dinner time :D16:43
fungilxsli: or possibly implemented in a pre_test_hook if needed to happen before devstack setup16:43
pelixhashar: no worries, I'm still not back up to speed since my holiday ;-)16:43
*** RicoLin has joined #openstack-infra16:44
hasharpelix: I have been busy upgrading our Zuul version :D16:44
jeblairhashar: did you see the 'merge-check' stuff i added?16:44
hasharjeblair: havent see. Mind adding me to reviewers ? :)16:45
*** tomhe has quit IRC16:45
*** SumitNaiksatam has quit IRC16:45
*** e0ne has joined #openstack-infra16:46
*** e0ne has quit IRC16:46
*** pballand has joined #openstack-infra16:46
*** SumitNaiksatam has joined #openstack-infra16:46
*** Ish__ has joined #openstack-infra16:47
*** gokrokve has quit IRC16:47
*** RicoLin has quit IRC16:48
jeblairhashar: already merged16:49
zaropelix, hashar : for clarification, the sequence is.. 100020 -> 85336 and 105155 -> 103134 ?16:49
lxslifungi: ok put up yet another alternative :)  https://review.openstack.org/#/c/115341/16:49
jeblairhashar: i'll point you to it in just a sec16:49
lxsliis that what you were thinking?16:49
*** RicoLin has joined #openstack-infra16:49
*** markmcclain has quit IRC16:49
jeblairhashar: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/layout.yaml#n23416:50
jeblairhashar: it performs a merge-check of every open change in a project each time a change merges16:50
*** tonytan4ever has quit IRC16:50
*** _nadya_ has quit IRC16:51
*** markvoelker has quit IRC16:51
openstackgerritAlexis Lee proposed a change to openstack-infra/config: Add firewall traffic on port 27410  https://review.openstack.org/11065316:51
homelesshi guys, can anyone review this -> https://review.openstack.org/#/c/113598/16:52
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Fix typo in merge-check pipeline description  https://review.openstack.org/11534416:53
*** e0ne has joined #openstack-infra16:53
*** arnaud has joined #openstack-infra16:54
*** sarob_ has joined #openstack-infra16:54
fungilxsli: yes, that was what i think jeblair and i were suggesting. that way it applies at job run-time specifically where it's needed rather than globally to all nodepool nodes for any provider environment16:54
clarkbso much sb and mail to catch up on16:55
pelixzaro: yes - took a sec to parse :)16:55
*** markmcclain has joined #openstack-infra16:55
lxslifungi: ok fantastic, thanks again for your help, please could you +1?16:55
*** emagana has quit IRC16:56
*** amotoki has quit IRC16:56
jeblairrcarrillocruz: are you re-working 109816?16:56
hasharjeblair: thanks for the pointer, will have to look at that merge-check carefully :]  For now commute, dinner time16:56
*** amotoki has joined #openstack-infra16:56
*** emagana has joined #openstack-infra16:56
hasharzaro: pelix: send myself a reminder. Will attempt to look at the JJB patches tonight.16:56
*** harlowja_away is now known as harlowja16:56
hasharfor now sorry gotta rush16:56
*** hashar has quit IRC16:57
*** rdopieralski has quit IRC16:57
clarkbfungi lxsli my concern with that one change is that it was complicated. diff of 45 lines compared to 316:57
clarkbdoing the change at job runtime is fine too16:57
*** ihrachyshka has joined #openstack-infra16:58
lxsliclarkb: ok thanks :)16:58
krtaylordoes anyone know media wiki templates? I am really close to being able to set color in a table cell created by a template (CI system status)16:58
openstackgerritJames E. Blair proposed a change to stackforge/gertty: Add unified diff view  https://review.openstack.org/11516616:58
fungilxsli: except for the syntax error16:59
krtaylorAJaeger isn't on - anyone else?16:59
*** maxbit has quit IRC17:00
lxslifungi: yep fixed already :x17:00
*** emagana has quit IRC17:01
*** paulrad has quit IRC17:02
*** maxbit has joined #openstack-infra17:02
*** mriedem1 has joined #openstack-infra17:02
*** arosen1 has joined #openstack-infra17:02
*** arosen1 has quit IRC17:02
*** arnaud has quit IRC17:02
jeblairfungi: do you know how 110562 (windows-diskimage-builder) is going to be tested?17:02
fungilxsli: closer, but i think it may still be wrong. can you see my latest comment and confirm?17:02
*** bswartz has left #openstack-infra17:02
jeblairfungi: afaik, windows is not one of our supported platforms17:03
*** mriedem has quit IRC17:03
fungijeblair: i haven't the faintest idea... hopefully the tripleo spec indicates what they plan for testability17:03
*** SumitNaiksatam has quit IRC17:03
fungichecking17:03
jeblairfungi: nope, it just says "it runs on windows and uses native windows commands"17:03
*** e0ne has quit IRC17:03
jeblairhttps://blueprints.launchpad.net/tripleo/+spec/build-windows-images17:03
clarkbIts powershell iirc17:04
fungifun!17:04
clarkbso not tested at all by us17:04
fungithen i too have the same question as jeblair17:04
alexpilottijeblair fungi: we can maybe take care of it in the Hyper-V CI17:04
jeblairthen i'm not sure it should be in openstack17:04
fungiclarkb: if it's not tested, it's broken! ;)17:04
alexpilottiprimeministerp ociuhandu: ^^17:04
*** paulrad has joined #openstack-infra17:04
lxslifungi: thanks, Nick thinks we need it both ways so I've pushed a new patchset17:05
*** dkranz has joined #openstack-infra17:05
fungilxsli: we probably already allow all traffic on the default output chain17:05
fungilxsli: checking now to confirm17:05
clarkbwe do17:05
fungioh, clarkb confirms faster than my fingers17:05
lxsliRight you are, thanks for that, will change17:06
*** hdd has quit IRC17:07
zarohashar, pelix: thanks.  will review soon,  hopefully we can just move it thru.17:07
zaroclarkb: you in office anymore?17:07
*** shashankhegde has joined #openstack-infra17:07
*** e0ne has joined #openstack-infra17:07
clarkbzaro I am. I should be in today17:08
*** hogepodge has quit IRC17:08
clarkbhttps://review.openstack.org/#/c/100632/ didnt have gate jobs run /me togglesci17:09
fungijeblair: so if it's a new development effort outside of openstack, it doesn't seem like it's directly addressing an openstack spec. but i guess it's up to tripleo if they want to have specs which are just "this should be possible, but it's not something we can do officially"17:09
*** paulrad_ has joined #openstack-infra17:09
jeblairfungi: yeah, i think the latest ps puts it in 'openstack/' though, under the tripleo program17:10
clarkblooks like check was still in progress and it didnt promote it because?17:10
*** johnthetubaguy is now known as zz_johnthetubagu17:10
jeblairfungi: if it were in stackforge, i'd butt-out :)17:10
fungijeblair: i butted in when it was a project proposed to stackforge claiming to implement an official openstack spec17:10
fungidilemma17:10
*** paulrad has quit IRC17:10
jeblairfungi: heh, yeah.  i agree that's also awkward and should be discussed.  but i think "tripleo should support this use case via external tooling" is an answer that doesn't run afoul of any governance issues.17:12
fungiclearly we just need microsoft to set all the windows source code free. then this would cease to be an issue17:12
lxslihttps://review.openstack.org/#/c/115341 is looking good in CI, it's run the iptables command :)17:12
jeblair(if that were in fact to be the answer)17:12
jeblairfungi: that would work17:12
*** loki184 has quit IRC17:12
*** e0ne has quit IRC17:12
jeblairclarkb: it says 'started gate'; did it not actually end up in the queue?17:12
clarkbjeblair that is after the reverify17:13
clarkbit didnt start gate after the approval earlier17:13
jeblairclarkb: the one from ihar?17:13
fungiclarkb: that started shortly before the zuul restart and was not reenqueued into check after17:13
jeblairthere was a zuul restart yesterday?17:14
*** dtantsur|brb is now known as dtantsur17:14
fungijeblair: no17:14
alexpilottifungi: I cannot provide you the source code for WIndows, but we can do those tests and build the images in tehe Microsoft CI :-)17:14
fungi08-12 22:11 was when it reacted to the vmware recheck comment, and then17:14
fungiwe restarted zuul just after that17:14
fungiand so it had no jenkins verify vote on it when it got approved17:15
clarkbjeblair yes ihar17:15
*** jpich has quit IRC17:15
fungithus jobs didn't trigger again until the reverify17:15
jeblairfungi: oh, gotcha17:15
*** annegentle has quit IRC17:15
fungiso that behavior is easily explained17:15
clarkbbecause it was verify 0?17:16
jeblairi don't know what a cloudkitty is, but i feel like i'd be much happier if i could use python-cloudkittyclient for something17:16
*** mmaglana has joined #openstack-infra17:16
*** AlexF has quit IRC17:17
fungiclarkb: yep17:17
*** dmsimard is now known as dmsimard_away17:17
clarkbthanks17:17
*** bdpayne has joined #openstack-infra17:17
fungiclarkb: at least the way we have things configured now (and ever since the clean check implementation) is that approve only triggers jobs if there is a jenkins vertify vote value other than 017:17
fungiverify17:18
fungiactually probably only if there is a +1 in fact17:18
fungichecking17:18
clarkbya and removing clean check will fix that right?17:18
fungiahh, right, if there's any nonzero jenkins verify vote >24 hours, it will enqueue into check17:19
*** tomhe has joined #openstack-infra17:20
jeblairyeah, not sure we can do "on workflow+1 with no vote from jenkins, enqueue into check"17:20
jeblairoh right17:20
*** bdpayne has quit IRC17:20
jeblairjhesketh wrote negative requirements, they might be able to do that17:21
*** marekd has left #openstack-infra17:21
jeblair(but last i checked that change depended on the multi-user change which was still in review)17:21
*** _nadya_ has joined #openstack-infra17:21
tomhejeblair: http://pastebin.com/rudfJZvm ERROR zuul.GerritEventConnector: Exception moving Gerrit event: Exception: Change 12471,1 not found17:21
jeblairtomhe: what gerrit version are you using?17:21
tomhe2.917:22
*** bdpayne has joined #openstack-infra17:22
fungiooh, some new breakage we can look forward to i guess17:22
jeblairtomhe: what happens if you run "gerrit query --format json --all-approvals --comments --commit-message --current-patch-set --dependencies --files --patch-sets --submit-records 12471"17:22
jeblairtomhe: i'm wondering if there's a timing issue or something17:23
primeministerpalexpilotti: ping17:24
*** emagana has joined #openstack-infra17:24
linkidjeblair: oh, thank you for your review for cloudkitty's repos :)17:24
*** Guest36489 has quit IRC17:24
jeblairfungi, tomhe: that's also the same behavior we saw a couple times when querying some old changes in openstack's gerrit17:24
alexpilottiprimeministerp: jeblair and fungi were discussing about the WIndows images build script17:25
tomhejeblair: looks good to me: http://pastebin.com/mrKsLNmR17:25
*** markmcclain has quit IRC17:25
*** markmcclain has joined #openstack-infra17:25
primeministerpalexpilotti: the one we already have on the cbs github repos?17:25
alexpilottiprimeministerp: I thought it was a good topic for Microsoft :-)17:25
primeministerpalexpilotti: definately17:25
alexpilottiprimeministerp: this is the stuff that HP contributed17:25
primeministerpalexpilotti: do we need licenses17:25
alexpilottiprimeministerp: it’s using cloudbase-init17:25
fungiprimeministerp: alexpilotti: no, from an official upstream perspective we can't (and won't) test on proprietary platforms17:26
jeblairtomhe: do you have a secondary search index configured?17:26
*** AlexF has joined #openstack-infra17:26
*** loki184 has joined #openstack-infra17:26
primeministerpfungi: fair enough17:26
alexpilottifungi: how do you plan to build those images?17:27
fungiprimeministerp: alexpilotti: though a third-party ci could perform testing on such a thing, we can't probably have something which can only be run/tested on a proprietary platform as an official openstack project17:27
*** AlexF has quit IRC17:27
fungialexpilotti: i don't think we did plan to. tripleo had a blueprint approved to add windows disk image building support to disk-image-builder17:27
tomhejeblair: Not sure. Probably not.17:27
fungialexpilotti: so they might have some input on how they expected to test it17:28
jeblairtomhe: so it's starting to seem like a race condition, where zuul got an event, did a query, and got no results, but now, much later, you can do the query and get results17:28
jeblairtomhe: does this happen with other changes?17:28
primeministerpfungi: I was aware of the tripleo folks interest in windows/ironic support17:28
jeblairtomhe: oh, you already said so earlier... nm.17:29
primeministerpfungi: as far as I knew the hp folks were the one looking into doing some testing as well17:29
primeministerpfungi: but I have to admit, those discussions happen sporatically over hk->atl17:29
fungialexpilotti: primeministerp: jeblair: one question i have though, is would the argument be somehow different if there was a feature within the openstack/disk-image-builder project which was not testable on officially-supported platforms (and got tested via third-party ci). if so, this is not especially dissimilar to nova's vmware hypervisor, or the slew of proprietary drivers in neutron/cinder17:29
openstackgerritFrançois Magimel proposed a change to openstack-infra/config: Added python-cloudkittyclient to stackforge projects  https://review.openstack.org/11250717:29
tomhejeblair: Happens to most changes. I've seen some that Zuul picked up, but most gets lost on patch set #117:29
fungialexpilotti: primeministerp: jeblair: and so does having it implemented as disjoint code within an official openstack project, some of which can be tested in upstream ci, differ from having it split into a separate git repository and why (philosophy time!)17:30
jeblairfungi: i suspect that would be less of an issue because at least the whole project would not require the proprietary platform17:30
jeblairtomhe: what zuul commit did you say you were on?17:31
jeblair(before you upgraded to master)17:31
tomhejeblair: Just checked and we are using LUCENE as secondary index17:31
*** hogepodge has joined #openstack-infra17:33
tomhejeblair: before upgrade we were on bb1fe50c6f32042625cc602dd5b55f76c9d1d38417:33
*** adalbas has quit IRC17:33
openstackgerritFrançois Magimel proposed a change to openstack-infra/config: Added cloudkitty-dashboard to stackforge projects  https://review.openstack.org/11278917:33
*** emagana has quit IRC17:34
*** emagana has joined #openstack-infra17:35
*** loki184 has quit IRC17:37
*** ChuckC has quit IRC17:37
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: DO NOT MERGE - test race condition in gerrit query  https://review.openstack.org/11535717:38
jeblairtomhe: would you be interested in running that change locally to collect some more data? ^17:39
*** chandankumar has quit IRC17:39
tomhejeblair: sure, will do17:39
*** emagana has quit IRC17:39
tomhejeblair: also thought to try what happens with a sleep() right before self.updateChange(change). Will test your change first though.17:40
*** paulrad_ has quit IRC17:41
*** pcrews has quit IRC17:41
jeblairtomhe: yeah, that's pretty equivalent; i mostly did it this way to try to characterize if it is a race, how slow is it.  :)17:41
mtreinishclarkb: have a few secs to push some buttons in the gerrit gui and perform the manual steps from: http://git.openstack.org/cgit/openstack-infra/config/commit/modules?id=fe5f398d02f758b17958da1c07f8feb1f0418f5617:41
jeblairtomhe: (also doing the query first should mean at least one failure, so we can still be sure we're seeing the problem)17:41
*** pcrews has joined #openstack-infra17:41
*** tonytan4ever has joined #openstack-infra17:42
*** lukego has joined #openstack-infra17:44
*** loki184 has joined #openstack-infra17:44
*** emagana has joined #openstack-infra17:45
clarkbmtreinish as soon as I get to the office sure17:45
clarkbmtreinish is tempest ready for tox upgrade?17:45
mtreinishclarkb: ok cool, thanks17:45
mtreinishclarkb: should be we landed the hash seed = 0 patch17:46
clarkbperfect17:46
openstackgerritA change was merged to openstack-infra/jenkins-job-builder: git: Support timeout option  https://review.openstack.org/11128017:46
*** sirushti has joined #openstack-infra17:47
*** _nadya_ has quit IRC17:47
*** crc32 has joined #openstack-infra17:47
*** _nadya_ has joined #openstack-infra17:48
*** otherwiseguy has quit IRC17:50
jeblairfungi: i think puppet-lint may be failing everything17:50
jeblairhttp://logs.openstack.org/94/113194/3/gate/gate-config-puppet-lint/96d10b0/console.html17:51
*** adalbas has joined #openstack-infra17:51
*** otherwiseguy has joined #openstack-infra17:52
jeblairdo we get anything useful out of puppet lint?17:52
jeblairclarkb, fungi: ^?17:52
linkidjeblair: I had this error too and I did a rebase to see it was ok, then. But it seems that files which had failed were not modify, I think17:52
*** dims has joined #openstack-infra17:53
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Remove puppet lint  https://review.openstack.org/11536117:53
clarkbjeblair rcarrilocruz mentioned that. there is a new version17:53
jeblairclarkb: yes, i understand.  i'm confirming that we can merge nothing because of it.17:53
jeblairalso, i think we need the puppet apply jobs for the new puppet modules17:53
jeblairbecause otherwise we'll lose our best puppet testing as we move them out17:53
clarkbwe get consistency in our format other than that the other tests help more17:54
clarkb++17:54
*** atiwari has quit IRC17:55
*** mfink has joined #openstack-infra17:55
jeblairclarkb, fungi: ^ well you have a choice in front of you: hit +2 on my change or go fix a bunch of whitespace ;).  i'm not actually partial to which solution we do.17:55
*** loki184 has quit IRC17:55
jeblairbiab17:55
tomhejeblair: Should I expect Zuul to always detect the patch set with this? Tried a couple of times and I see no error.17:55
jeblairtomhe: no, it should still fail the first time17:55
jeblairtomhe: i mean, it should log a message at debug level17:56
tomheOk, will try some more.17:56
jeblairtomhe: you should see a msg like "Change 12471,1 not found" in the debug logs at least once, then it should succeed17:56
tomhejeblair: Yes, looked for "retrying"17:57
jeblairyeah, that one :)17:57
*** mfink has quit IRC17:57
*** _nadya_ has quit IRC17:58
*** radez is now known as radez_g0n317:58
yolanda__clarkb, jeblair, the dib change got finally merged?17:59
tomhejeblair: Nothing yet. Time for a break to put my kids to bed. Will debug more later.17:59
openstackgerritA change was merged to openstack/requirements: Fix ordering of requests_mock package  https://review.openstack.org/11510418:00
*** mfer has joined #openstack-infra18:00
*** ChuckC has joined #openstack-infra18:00
fungijeblair: yes, new puppet-lint today, and according to rcarrillocruz it now is even more picky about rocket alignment whitespace than before, so we probably want to pin it18:01
fungioh, clarkb also just said that18:02
*** chuckC_ has joined #openstack-infra18:02
*** bdpayne has quit IRC18:03
*** sarob_ has quit IRC18:04
*** doude has quit IRC18:04
fungiyeah, i think i'm in favor of eliminating puppet-lint for now. if they relax it again upstream, make it more flexible in what it enforces, or someone wants to go through and make a huge whitespace-only change to get it working again, we can always add it back later18:04
*** radez_g0n3 is now known as radez18:05
*** _nadya_ has joined #openstack-infra18:05
fungiit's worth expecting that we'll backslide on our current conformance between now and then as well18:05
clarkbcan we just pin it?18:06
clarkbkeep what we had18:06
*** _nadya_ has quit IRC18:07
clarkbI think the current zuul backslide is not a good thibg18:07
*** lcheng has quit IRC18:07
fungiclarkb: want to propose a pin in thick_slave.pp? (assuming the gem package provider supports that)?18:08
*** sirushti has left #openstack-infra18:08
fungilooks like it must, since we already pin rake that way18:09
clarkbya I can do that18:09
*** pradk has quit IRC18:09
fungieither way, we'll probably have to manually merge it, since the change will be deadlocked18:09
*** prad has joined #openstack-infra18:10
fungiand with the pin, we have to rebuild all our bare-{precise?,trusty?} images18:10
fungiso i think i'm in favor of removing the job until tomorrow18:10
fungiat least18:10
*** hdd has joined #openstack-infra18:10
*** annegentle has joined #openstack-infra18:10
*** paulrad has joined #openstack-infra18:13
*** abhishekk has joined #openstack-infra18:16
*** che-arne has quit IRC18:16
*** cnesa7 has quit IRC18:16
abhishekkfungi:hi, you around?18:17
*** emagana has quit IRC18:17
fungiabhishekk: what's up?18:17
abhishekkfungi:having one doubt18:17
*** emagana has joined #openstack-infra18:17
jeblairclarkb: can you -1/+3 https://review.openstack.org/#/c/115361/ ?18:18
abhishekkfungi:does devstack use http://pypi.openstack.org/openstack/ mirror to install libraries?18:18
*** paulrad has quit IRC18:18
fungiabhishekk: no, it uses http://pypi.openstack.org/simple/18:18
clarkbjeblair: I am going to propose a pin for it now18:19
*** dmsimard_away is now known as dmsimard18:19
fungiabhishekk: at least in the official openstack ci. if you're asking in regards to your own ci system or test environment then you probably want to use something else, like https://pypi.python.org/18:20
openstackgerritJoe Gordon proposed a change to openstack-infra/config: Move rally-dsvm-fakevirt-heat to experimental  https://review.openstack.org/11438718:20
jeblairclarkb: regardless, can you please either -1 or +3 https://review.openstack.org/#/c/115361/ ?18:20
fungiclarkb: we still have to wait for image rebuilds if we pin it18:20
mgagnefor whoever asked to be able to disable some puppet lint checks with a per-line flag: http://puppet-lint.com/controlcomments/18:21
abhishekkfungi:so in nova's requirement.txt websockify version is mentioned as >=0.5.1,<0.7.0 then will devstack install webscockify 6.0?18:21
fungiclarkb: so in the meantime, being able to get work done would be cool18:21
clarkbfungi: right and that change won't actually pass until after the pin18:21
*** emagana_ has joined #openstack-infra18:21
clarkbI guess I will go ahead and approve it then work the pin back in18:21
*** weshay_mtg has quit IRC18:21
fungiclarkb: the pin change won't pass either18:21
clarkbright18:21
*** bdpayne has joined #openstack-infra18:21
*** weshay has joined #openstack-infra18:21
fungiunless we stop running the job for now18:21
jeblairclarkb: if i had some idea from you as to whether you were okay with https://review.openstack.org/#/c/115361/ i would be happy to force merge it.  :)18:21
*** kmartin has joined #openstack-infra18:21
*** emagana has quit IRC18:21
clarkbfungi: I am reading your comment and agreeing18:21
clarkbjeblair: +2 force merge sounds good to me18:22
*** jp_at_hp has quit IRC18:22
fungiclarkb: got it. conversational lag ;)18:22
*** dtantsur is now known as dtantsur|afk18:22
fungiabhishekk: presumably, yes. did it not?18:22
openstackgerritA change was merged to openstack-infra/config: Remove puppet lint  https://review.openstack.org/11536118:22
abhishekkfungi:it's still installing minor version18:23
*** mriedem has joined #openstack-infra18:23
abhishekkfungi:i.e websockify 0.5.118:23
*** dmsimard is now known as dmsimard_away18:24
fungiabhishekk: have a link to a log you're looking at?18:24
*** mriedem1 has quit IRC18:24
*** lukego has quit IRC18:25
abhishekkfungi:I am installing it locally with latest code18:25
fungimgagne: is it possible to disable the more restrictive rocket alignment checking in today's new release?18:25
mgagnefungi: checking18:25
openstackgerritClark Boylan proposed a change to openstack-infra/config: Pin puppet lint to 0.3.2.  https://review.openstack.org/11537018:25
fungiabhishekk: oh, so not in our ci. then you probably configured your system to use a mirror, possibly our old one. you should unconfigure that18:25
jeblairttx: can you take a look at 11383318:26
mgagnefungi: PuppetLint.configuration.send('disable_arrow_alignment')18:26
mgagnefungi: http://puppet-lint.com/checks/arrow_alignment/18:26
fungiabhishekk: look in your .pip/pip.conf and ~/.pydistutils.cfg18:26
abhishekkfungi:can you help me little bit on how to change the mirror18:26
abhishekkfungi:ok, I have a look on the same18:26
mgagnethat's in the Rakefile, I'm sure you can create a .puppet-lint.rc file somewhere18:26
*** bdpayne has quit IRC18:27
fungiabhishekk: if you remove any index_url/index-url lines in those, pip should go back to using normal pypi.python.org18:27
mgagnethey removed the class_parameter_defaults check too18:27
abhishekkfungi:thank you, i will check it, brb18:27
*** radez is now known as radez_g0n318:28
*** bdpayne has joined #openstack-infra18:28
fungimgagne: interesting. anyway we noticed that the new version they just released decided to complain about additional space now before => so if your longest parameter has more than one space after it before the rocket, fail18:28
*** chandankumar has joined #openstack-infra18:28
*** pelix has quit IRC18:28
mgagnefungi: lot of fun ^^'18:29
fungimgagne: i guess if you want to stop it from complaining about that, you have to remove the alignment check entirely now18:29
jeblairi have no idea why we think this sort of thing is so critically important we are willing to waste time with it instead of doing real work18:29
clarkbmgagne: fungi we want arrow alignment though18:29
*** bdpayne has quit IRC18:29
clarkbproblem is the rule changed rather than adding a new rulke18:30
* fungi wonders who "we" is in this case, but okay ;)18:30
jeblairclarkb: you may be using the "royal we" :)18:30
mgagnelets not open a pandora's box =)18:30
clarkbin any case linting doesn't actually catch many actual issues18:30
clarkbso I am fine with it disabled18:30
jeblairpretty sure mordred opened that one years ago with pep8, and i'll never forget him for it :)18:30
clarkbin fairness flake8 does catch some real issues :)18:32
mgagneanyone still affected by bug #1277538 ? it's damn annoying18:32
jeblairclarkb: pyflakes does catch real issues.18:33
uvirtbotLaunchpad bug 1277538 in tempest "Non-zero exit code (2) from test listing" [Undecided,In progress] https://launchpad.net/bugs/127753818:33
*** bdpayne has joined #openstack-infra18:33
*** hdd has quit IRC18:35
*** dims has quit IRC18:37
linkiddo you think I have to recheck my commit, due to the puppet-lint, or is it ok ?18:38
jeblairlinkid: if it got a -1 because of lint, you should 'recheck'18:38
linkidI rechecked it after a -1 but before lint was out18:39
linkidI will recheck it, then18:39
openstackgerritClark Boylan proposed a change to openstack-infra/config: Tox fixed the openstack breaking bug use latest  https://review.openstack.org/10851518:39
clarkbfungi: jeblair ^ is the first half of tomorrow's upgrade fun18:39
* clarkb preps precise to trusty default change now18:39
*** hdd has joined #openstack-infra18:40
*** gokrokve has joined #openstack-infra18:40
openstackgerritFrançois Magimel proposed a change to openstack-infra/config: Added cloudkitty-dashboard to stackforge projects  https://review.openstack.org/11278918:42
jeblairstevebaker: can you review https://review.openstack.org/#/c/114387/ please?18:43
jeblairstevebaker: (it's a heat related infra change)18:43
*** gokrokve_ has quit IRC18:44
lifelesslxsli: libvirt pool, whats that?18:44
openstackgerritClark Boylan proposed a change to openstack-infra/config: Set default test node to trusty for all projects.  https://review.openstack.org/11537618:45
tomhejeblair: Uploaded somewhere around 20 changes with no misses yet. I'll keep monitoring tomorrow when under normal system load when people are back to work (Europe time here) and I'll let you know what I find.18:45
clarkbfungi: jeblair ^ and that is the other18:45
*** e0ne has joined #openstack-infra18:45
*** gokrokve has quit IRC18:45
jeblairtomhe: okay, make sure you are still logging at debug level in the gerrit logger (or maybe change that log line to .info)18:46
jeblairtomhe: to make sure you're not accidentally missing it18:46
ttxjeblair: done18:47
tomhejeblair: didn't change the logging. But I'll change to info and run some more changes.18:48
*** Sukhdev has joined #openstack-infra18:48
*** lyxus has joined #openstack-infra18:49
*** emagana_ has quit IRC18:50
*** david-ly_ has joined #openstack-infra18:50
lyxusHi, I am trying to do a gerrit query to find the the latest patch for the last X hours. Does anyone has this thing handy ?18:51
*** david-lyle has quit IRC18:51
jeblairlyxus: "-age:Xh"18:52
lyxusI came up with this age:6h AND project:openstack/neutron AND branch:master but it will show every single patchset18:52
*** SumitNaiksatam has joined #openstack-infra18:52
*** lukego has joined #openstack-infra18:52
jeblairlyxus: i think that's older than 6h, '-age' should be newer than 6h18:53
*** emagana has joined #openstack-infra18:53
*** erlon has joined #openstack-infra18:55
lyxusjeblair, interesting on the jenkins plugin the -age doesn't work but it work on the webinterface18:57
*** atiwari has joined #openstack-infra18:58
*** amuller has quit IRC18:59
*** dims has joined #openstack-infra19:00
*** dims has quit IRC19:00
fungimeeting time, once keystone wraps up19:00
*** dims has joined #openstack-infra19:01
*** _nadya_ has joined #openstack-infra19:02
jeblairmeeting time for realz19:02
fungireally for reals19:02
tomhejeblair: Switched back to "pre your patch" and got the problem right away. Reset to your patch and no Exceptions, no errors. Ran serveral new changes. So it appears that the for loop you added changes the timings enough to always suceed with the query.19:03
jeblairtomhe: wow, that suggests an extremely tight race19:03
*** abhishekk has quit IRC19:03
*** homeless has quit IRC19:03
tomhejeblair: I'll run with your code tomorrow, but maybe with 30 s instead of 300 and see how that goes.19:04
*** homeless has joined #openstack-infra19:04
*** hdd has quit IRC19:05
*** dims has quit IRC19:05
*** Longgeek has quit IRC19:06
*** gyee has quit IRC19:08
*** Ish__ has quit IRC19:10
malinijeblair: Can you please review https://review.openstack.org/#/c/115291/ when you have a minute? will help us unblock zaqar gate19:10
clarkbmalini: can you make sure that my change to devstack-gate is complete as well?19:11
*** ramashri has quit IRC19:11
maliniclarkb: sure!19:11
clarkbmalini: I wasn't entirely sure if features.yaml's update was completely correct depending on how you go about it19:11
* clarkb digs up link19:11
clarkbmalini: https://git.openstack.org/cgit/openstack-infra/devstack-gate/commit/?id=340d2388d2e0a9d63ed1e0fcc113c0561132968e19:12
malinithanks clarkb! checking now19:13
*** harlowja has quit IRC19:13
*** harlowja has joined #openstack-infra19:13
*** david-ly_ is now known as david-lyle19:13
*** tonytan4ever has quit IRC19:14
openstackgerritAdam Gandelman proposed a change to openstack-infra/config: Consolidate and rename Ironic jobs  https://review.openstack.org/11213419:14
*** Guest64178 is now known as med_19:14
*** med_ has joined #openstack-infra19:14
*** med_ is now known as medberry19:14
yolanda__clarkb, jeblair, sorry to push so much. Can you give me status of nodepool-dib? working on documentation updates right now, but wanted to be sure that change was merged and working19:15
clarkbyolanda__: we need to restart nodepool but your latest change merged19:15
maliniclarkb: We have renamed the marconi-server to zaqar-server. So https://review.openstack.org/#/c/114771/1/features.yaml will need to be updated..I'll submit a patch19:16
clarkbmalini: thanks19:16
yolanda__clarkb, but not tested yet? i saw comments about that yesterday, about some problems with UpdateImage but wasn't sure what was about19:16
malinithank you clarkb!19:16
*** ihrachyshka has quit IRC19:16
clarkbyolanda__: we are over in openstack-meeting right now, but I am sure jeblair or fungi can fill in about yesterday's stuff19:16
*** hashar has joined #openstack-infra19:17
*** Ish__ has joined #openstack-infra19:17
*** tonytan4ever has joined #openstack-infra19:17
*** markmcclain has quit IRC19:17
yolanda__ok, jeblair, fungi, please let me know if there is some issue with the changes. I'll be sending  a patch for documentation tomorrow19:18
jrollis there a way to change the owner on a review?19:23
*** ildikov_ has joined #openstack-infra19:23
clarkbjroll: I don't think so. initial uploader is the owner19:23
jrollclarkb: boo, thanks19:23
fungiyolanda__: other than an oversight in the image-update cli subcommand, nothing else is wrong that i'm aware of... but we haven't restarted nodepool since merging that either, so i expect to know more once we do (maybe this afternoon?)19:23
*** emagana has quit IRC19:24
clarkbfungi: yolanda__ I am happy to give it a go again this afternoon19:24
asselin_yolanda__, there was an issue with nodepool image-update. I submitted a patch that fixed it:  https://review.openstack.org/#/c/115125/19:24
*** ildikov has quit IRC19:24
*** gokrokve has joined #openstack-infra19:24
*** emagana has joined #openstack-infra19:24
fungithanks again for spotting (and fixing) that asselin_!19:24
yolanda__oh, let me check19:24
*** emagana has quit IRC19:25
asselin_fungi, glad to "pay back" you're all very helpful.19:25
*** paulrad has joined #openstack-infra19:25
yolanda__asselin_ , thx for fixing that silly mistake19:26
yolanda__that way19:26
yolanda__you see that i only tested with the "all" keyword19:26
*** rcarrillocruz has quit IRC19:26
openstackgerritMalini Kamalambal proposed a change to openstack-infra/devstack-gate: Update Marconi to Zaqar  https://review.openstack.org/11538419:26
asselin_yeah, that was my workaround :)19:26
*** hdd has joined #openstack-infra19:27
*** rcarrillocruz has joined #openstack-infra19:28
*** _nadya_ has quit IRC19:28
*** shashankhegde has quit IRC19:30
*** tsg has quit IRC19:30
*** malini has quit IRC19:32
*** lukego has quit IRC19:32
*** emagana has joined #openstack-infra19:34
*** RicoLin has quit IRC19:34
*** ihrachyshka has joined #openstack-infra19:35
*** tonytan4ever has quit IRC19:37
*** dmsimard_away is now known as dmsimard19:38
*** dmsimard is now known as dmsimard_away19:39
openstackgerritA change was merged to openstack-infra/config: Bump postgres module version  https://review.openstack.org/11356119:42
*** tonytan4ever has joined #openstack-infra19:45
*** dhellman_ has joined #openstack-infra19:46
*** signed8bit has joined #openstack-infra19:49
*** adalbas has quit IRC19:49
notmynamewhat version of gerrit is being used?19:49
*** marun has quit IRC19:49
clarkbnotmyname: 2.8 + a backported patch of a change in 2.919:49
notmynameclarkb: thanks19:49
*** markmcclain has joined #openstack-infra19:50
*** dhellman_ has left #openstack-infra19:51
phschwartzIs there a way to do the opposite of jjb and pull the jobs out to yaml files for an existing jenkins server?19:52
clarkbphschwartz: no there isn't19:52
phschwartz:(19:52
phschwartzdarn19:52
*** lttrl has quit IRC19:52
phschwartzThat would be a great tool. lol19:52
clarkbit would be hard to write19:53
*** unicell has quit IRC19:53
phschwartzYeah, I know. I was hoping though19:53
notmynameclarkb: do you have any idea why our gerrit doesn't work with the "is:mergeable" search?19:53
clarkbnotmyname: I think all of that stuff is new in 2.919:53
*** dmsimard_away is now known as dmsimard19:54
*** Ryan_Lane has joined #openstack-infra19:54
clarkbnotmyname: jeblair is working on zuul based merge checks though19:54
clarkbwhich should be in now19:54
openstackgerritA change was merged to openstack-infra/config: Add jshint job for horizon as non-voting  https://review.openstack.org/11382519:54
notmynameclarkb: ah, yes. it would seem that a search for "gerrit 2.8 docs" did indeed take me to the 2.9 docs19:54
*** tsg has joined #openstack-infra19:54
*** shashankhegde has joined #openstack-infra19:55
*** daya_k has quit IRC19:55
*** dmsimard is now known as dmsimard_away19:56
*** chandankumar has quit IRC19:56
*** dmsimard_away is now known as dmsimard19:58
*** RicoLin has joined #openstack-infra19:58
*** rlandy has quit IRC19:59
*** stevebaker has quit IRC20:00
*** stevebaker has joined #openstack-infra20:00
openstackgerritClark Boylan proposed a change to openstack-infra/config: Use new d-g GRENADE flags in jenkins jobs.  https://review.openstack.org/11185320:01
openstackgerritClark Boylan proposed a change to openstack-infra/config: Add ironic and neutron sideways upgrade jobs  https://review.openstack.org/11243120:01
clarkbjeblair: SergeyLukjanov ^ thank you for catching the derp in 111853 I have no idea where that came from20:01
clarkbbut those should be good to go now20:01
pleia2clarkb: when you have some time today, there are some issues with the pootle install, if you want to add my ssh key to the server I can poke around, but I think we might have some permissions issues - if you nagivate to the site you get a spinning progress thing, that started last night during our demo when we tried to upload .po files20:01
nibalizerif you 'check experimental' does zuul just do it and not respond?20:02
funginotmyname: to be on the safe side, i usually read the docs bundled in our gerrit... https://review.openstack.org/Documentation/index.html20:02
nibalizeri.e. im kind of expecting a 'ya im on it, boss'20:02
clarkbnibalizer: correct you can check the zuul status20:02
nibalizerokay cool20:02
*** kgiusti has left #openstack-infra20:02
nibalizerjust making sure20:02
clarkbpleia2: hrm let me look20:02
pleia2so uploading didn't work, and had to do the demo over on another server dwayne had20:02
pleia2all worked out ok, just oops broken :)20:02
anteayaI welcome input in the third party scaling problem20:03
pleia2I'm working with the zanata folks now on getting a wildfly instance up on one of my HPCloud VMs20:03
openstackgerritElizabeth K. Joseph proposed a change to openstack-infra/config: Add third party announce and request mailing lists  https://review.openstack.org/11539220:03
funginibalizer: the *only* reason zuul currently responds with a comment when enqueuing into the check pipeline is to support freshness and clean-check use cases (since gerrit didn't consider simply removing a vote to be a significant enough event to update a timestamp)20:04
anteayajust as a data point, I'm guessing now is not the time20:04
anteayaand i should get back to slides20:04
funginibalizer: we're looking forward to ripping that back out soon, i believe20:04
pleia2anteaya: I put your email address in, I can show you how to do list admin (happy to be another admin too, but didn't want to put my email in there since you're the leader here)20:04
nibalizerfungi: oh wow20:04
*** penguinRaider has quit IRC20:04
*** amalagon has joined #openstack-infra20:04
clarkbpleia2: glad it worked out and sorry it didn't work on our server20:05
nibalizerim not sure i reccomend that, i think zuul telling everybody that its on it is a good feature20:05
anteayapleia2: fair enough20:05
clarkbfungi: I think we can rip it out today20:05
pleia2clarkb: no worries, I should have poked around our server a bit more before the demo20:05
anteayayes, I will need to do the list admin tutorial?20:05
clarkbfungi: gerrit 2.8 mostly fixed that issue and fixed it for the zuul case20:05
fungiclarkb: i believe so too. looking back over the change now20:05
fungiclarkb: oh, that part20:05
clarkbfungi: if you specify a string in the comment then that is enough to update the timestamp20:05
anteayacan we do it friday, can you be list admin until then? I present on thursday20:05
clarkband zuul adds a comment20:05
clarkbpleia2: there are tracebacks20:08
clarkbpleia2: http://paste.openstack.org/show/97470/ I don't think it is related to permissions issues20:09
clarkbunless submissions is on disk?20:09
pleia2hrm :\20:09
clarkba quick check of the po/ perms shows pootle:nogroup owns everything20:10
pleia2ok20:10
pleia2and we do need the user profile pages working, Daisy wants to look into how stats and things are displayed and those require working profile pages20:11
*** andreaf_ has joined #openstack-infra20:11
pleia2maybe I should come up with a list, we need the API enabled too if it's not :)20:11
*** andreaf_ has quit IRC20:12
*** bdpayne has quit IRC20:12
clarkbuser profiles work right? (other than the openid issues and this new thing)20:12
ianwanteaya: this is just a vague feeling, but i feel like 3rd party CI is really for the 3rd party, not the developer.  that was/is my opinion of my external testing -- the things that are core we care about get pushed upstream (centos7 and current fedora, in red hat case).  sometimes i feel like that distinction i've made is not universal20:12
*** andreaf_ has joined #openstack-infra20:12
pleia2clarkb: http://23.253.231.198/profiles/lyz20:12
clarkbif the api is enabled by default we hsould have it running20:12
*** andreaf_ has quit IRC20:12
anteayaianw: you are correct20:12
anteayaianw: and that was the conclusion we reached in germany20:13
*** andreaf_ has joined #openstack-infra20:13
pleia2clarkb: and the API is disabled by default, need to install django-tastypie and add POOTLE_ENABLE_API = True to config20:13
anteayaianw: the problem is getting these folks from the perspective which they have when they enter openstack to the perspective you just outlined20:13
anteayaianw: *I'm* in agreement with you20:13
pleia2clarkb: http://pootle.readthedocs.org/en/latest/api/ has some details20:13
anteayathat doesn't change the fact that there is a lot of work to be done with this group20:14
anteayaianw: some in this space share that perspective _now_20:14
anteayaianw: but when they come in?20:14
anteayaianw: they usually enter blind and hungry and chased by wolves20:14
*** andreaf has quit IRC20:14
krtaylorbut, I believe, it will be useful to the developer someday20:14
*** Ish__ has quit IRC20:15
krtaylorit is just painful now20:15
anteayakrtaylor: it is useful to the devloper when the operator of the ci comments on their patch20:15
krtaylorwell, when it works20:15
anteayawith the line that is breaking that operators ci20:15
*** e0ne has quit IRC20:15
anteayaand hopefully with a fix that won't break that operators ci20:15
anteayathen is it useful to the developer20:16
anteayawe have a long way to go20:16
krtaylorbut if it does break their ci, then it worked too20:16
krtayloras long as it is reliable20:16
anteayayou missed what I said20:16
krtaylorthat is the key20:16
anteayathat is where we are now, we have to take that further for it to be useful to the developer20:16
krtayloragreed20:16
anteayaand like ianw for the operator to own their ci20:16
anteayathe operator needs to be the one commenting on the developer's patch20:17
anteayathe operator has to be the consumer of the results of their ci20:17
anteayathen it is useful for the developer20:17
krtaylorit is a MUCH bigger commitment than most operators realize20:17
anteayayes20:17
anteayayes it is20:18
anteayabut it is still the goal20:18
krtaylorI think eventually it can be automated20:18
krtaylorno operator in the middle20:18
anteayaand we are working towards it as a group (both devs and ci) in incremental steps20:18
anteayakrtaylor: then the automation just breaks20:18
krtayloragreed, baby steps20:18
*** Ish__ has joined #openstack-infra20:18
anteayabut anyway that is incidental since we are a long way from the goal20:18
krtaylorI believe it can be made reliable20:19
anteayabut moving in that direction20:19
krtaylorso true20:19
anteayakrtaylor: I'm glad20:19
anteayaI don't share your belief but I will support it20:19
asselin_is there a way to see the review status of a particular ci inside gerrit?20:20
*** markmc has quit IRC20:21
openstackgerritA change was merged to openstack-infra/config: Update Marconi to Zaqar  https://review.openstack.org/11529120:21
anteayaasselin_: which ci, I can show you a query20:21
asselin_any. how abot hp storage ci :)20:21
asselin_*about20:21
anteayahere is a start: https://review.openstack.org/#/q/reviewer:%22HP+Storage+CI+%253Chp.cinder.ci%2540external.groups.hp.com%253E%22,n,z20:22
*** MaxV has joined #openstack-infra20:23
clarkbpleia2: cool I can make that change and restart it20:23
clarkbpleia2: I really have no idea what those tracebacks mean20:23
anteayaasselin_: and then use this url: http://paste.openstack.org/show/97475/ and replace the ci name in the url with yours20:25
anteayaasselin_: if you are happy with the results do share with others20:25
anteayaasselin_: and thanks20:25
pleia2clarkb: thanks, and yeah, I don't know either, after it's restarted I can see about trying to upload again and see if we get any new info20:27
clarkbpleia2: it is restarted20:27
pleia2hmm, and still showing that progress spinner20:28
*** cmart13 has joined #openstack-infra20:28
clarkbpleia2: yup I see the same traceback20:28
*** atiwari has quit IRC20:28
pleia2ok, I'll poke around their bug tracker20:29
clarkbit almost looks like we have a db model and internal model mismatch20:29
clarkbmaybe their migrations aren't quite working on mysql? /me pokes in the db20:29
pleia2clarkb: oh, profile-wise I see my user is just broken probably due to the openid thing, can see Daisy's page http://23.253.231.198/profiles/daisy-ycguo20:30
clarkbpleia2: I can see yours too20:31
clarkbpleia2: maybe you can't see yourself when logged in? I can't see myself20:31
cmart13hello (and sorry to bother). Is there any jslint/jshint build check implemented that I could look for? We are trying to add a js check in our builds20:31
clarkbcmart13: there is, the storyboard jobs use it iirc20:31
pleia2clarkb: ah, interesting20:31
clarkbcmart13: in openstack-infra/config/modules/openstack_project/files/jenkins_job_builder/config you should be able to find it20:31
*** maxbit has quit IRC20:32
cmart13clarkb: great! I'll check that. Thanks20:33
openstackgerritColleen Murphy proposed a change to openstack-infra/config: Update version of puppetlabs-stdlib in install_modules.sh  https://review.openstack.org/10935120:33
*** dprince has quit IRC20:34
clarkbpleia2: http://paste.openstack.org/show/97478/ I think unit_id being NULL there is why that traceback happens20:34
*** pdmars has quit IRC20:34
*** maxbit has joined #openstack-infra20:35
pleia2clarkb: odd, I don't know what that should be20:35
*** gyee has joined #openstack-infra20:36
linkidjeblair: if you have some time, could you take a look to my commits about cloudkitty, please ? (https://review.openstack.org/#/c/112507/ & https://review.openstack.org/#/c/112789/)20:36
pleia2I think I still have my local test vm around somewhere, let me see what it looks like there (not running 2.6, but hopefully it's similar)20:37
*** dmsimard is now known as dmsimard_away20:37
*** dims has joined #openstack-infra20:37
pleia2but after lunch, the 1AM translations meeting last night is catching up with me :)20:37
cmart13clarkb: I found this: gate-horizon-jshint at horizon. Should I look for horizon code in order to know how it's configured?20:39
cmart13clarkb: *horizon.yaml, in the path you said20:39
clarkbpleia2: I think it is a foreign key for pootle_store_unit20:40
clarkbpleia2: so you do a submission with a pointer to where the submission is stored?20:40
clarkbcmart13: I would look at storyboard instead20:40
clarkbcmart13: I think horizon stopped running that test?20:40
pleia2clarkb: not a clue20:41
*** stevebaker has quit IRC20:41
clarkbpleia2: I double checked and there are no other errors in the log output from pootle20:41
*** stevebaker has joined #openstack-infra20:41
cmart13clarkb: I really don´t know.. Where can I find the storyboard jobs?20:41
pleia2clarkb: ok, good to know20:41
clarkbcmart13: looks like javascript.yaml?20:42
*** emagana has quit IRC20:44
*** dims has quit IRC20:45
*** emagana has joined #openstack-infra20:45
jeblairmordred, SergeyLukjanov, jhesketh, clarkb, fungi: public service announcement: before approving new projects that go into openstack/ make sure that the relevant ptl has signed off on them joining the program.20:46
jeblairmordred, SergeyLukjanov, jhesketh, clarkb, fungi: you might want to make sure there is also an openstack/governance change to add it20:46
fungithanks, and agreed--good idea20:46
jeblairmordred, SergeyLukjanov, jhesketh, clarkb, fungi: https://review.openstack.org/#/c/106361/8 was approved without ptl approval, and currently the ptl doesn't know if it should be in the program or not20:46
jeblairso we may have to yank it back _out_ of openstack/20:47
clarkbjeblair: :/ noted20:47
fungioh, ick20:47
*** hashar has quit IRC20:47
*** Sukhdev has quit IRC20:48
cmart13clarkb: great! Now I have to find the  .jshintrc that is being used, right?20:49
*** mestery has joined #openstack-infra20:49
clarkbcmart13: maybe? https://git.openstack.org/cgit/openstack-infra/storyboard/tree is where I would start20:49
jeblairrelevant governance review: https://review.openstack.org/#/c/107585/120:49
*** emagana has quit IRC20:49
*** miqui has quit IRC20:49
*** mestery has quit IRC20:49
*** mestery has joined #openstack-infra20:50
*** atiwari has joined #openstack-infra20:50
clarkbpleia2: I wonder if it is trying to write to someplace else on disk and not only where I told it to put po files?20:51
clarkbpleia2: then silently failing when that happens?20:51
clarkbpleia2: I can drop the db and try again if you like20:51
pleia2clarkb: that might be the best option20:51
clarkbI can figure out how to get more verbose logs too20:52
clarkblet me go ahead and do that. I assume there isn't anything in that install you need or want to keep?20:52
pleia2nope20:52
clarkbhrm looks like I already log at debug or that was the attempt anyways20:53
*** jgrimm has quit IRC20:53
*** denis_makogon_ has joined #openstack-infra20:54
*** andreaf_ has quit IRC20:54
*** andreaf_ has joined #openstack-infra20:54
*** andreaf_ has quit IRC20:54
*** sdake has quit IRC20:55
*** cmart13 has quit IRC20:55
*** bdpayne has joined #openstack-infra20:56
*** ramashri has joined #openstack-infra20:58
clarkbpleia2: ok go ahead and register again20:59
clarkbI can make you superuser21:00
*** bdpayne has quit IRC21:00
pleia2clarkb: lyz user created21:00
clarkbyou are super user now21:00
pleia2looks good, thanks21:01
clarkbI think I made changes to get more debugging now. I see a giant traceback when trying to go to my profile while logged in21:01
clarkbya I can hit our profiles while logged out21:01
*** weshay has quit IRC21:01
clarkbI am guessing that particular thing is a real pootle bug?21:01
*** emagana has joined #openstack-infra21:02
pleia2seems like21:02
*** bdpayne has joined #openstack-infra21:03
*** mbacchi has quit IRC21:04
SergeyLukjanovjeblair, /me noted too, I'm always trying to make sure that it's a legal changee, but was sure about glance.store because of familiar author/committer21:04
*** IAX has joined #openstack-infra21:04
*** juzuluag_ has joined #openstack-infra21:05
jeblairfungi: did you get a chance to try unified diff?21:05
*** rfolco has quit IRC21:06
fungijeblair: no, still trying to catch up on e-mail from this morning, and need to go get dinner now. hopefully in a couple hours21:06
*** juzuluag has quit IRC21:07
*** cody-somerville has joined #openstack-infra21:07
*** nuritv has joined #openstack-infra21:09
SergeyLukjanovfungi, clarkb, folks, please, could you take a look on https://review.openstack.org/#/c/113833/ ?21:09
*** lttrl has joined #openstack-infra21:10
*** e0ne has joined #openstack-infra21:10
*** cody-somerville_ has joined #openstack-infra21:11
openstackgerritFelipe Reyes proposed a change to openstack-infra/elastic-recheck: Add fingerprint for bug 1358779  https://review.openstack.org/11530621:11
uvirtbotLaunchpad bug 1358779 in openstack-ci "swift: no space left on device" [Undecided,New] https://launchpad.net/bugs/135877921:11
*** Sukhdev has joined #openstack-infra21:11
*** julim has quit IRC21:11
*** aysyd has quit IRC21:12
*** cody-somerville has quit IRC21:14
*** e0ne has quit IRC21:16
*** cody-somerville_ has quit IRC21:16
nuritvHi, i have a question -  i would like to post a question / help request over the mailing list regarding our CI system. is there a specific subject i need to add (i mean the subjects in [])21:16
*** mfer has quit IRC21:20
clarkbnuritv: I don't think there is a specific answer. In general I would use the project name of the thing you are testing and maybe [infra'21:24
clarkber [infra]21:24
*** dustins has quit IRC21:25
clarkbpleia2: were you going to try and reproduce? I can give it a go too if you like (I know you are tired)21:26
clarkbpleia2: was it just upload a .pot file to a project?21:26
* clarkb gives it a whirl21:26
nuritvclarkb: thanks you clarkb. and also, should i post it on dev list or infra list?21:26
*** dmellado has joined #openstack-infra21:26
fungiheading out to grab a quick bite, back shortly21:27
*** fifieldt has quit IRC21:27
clarkbnuritv: again I think it depends. If your questions are about running the infrastructure definitely do the infra list. If you are looking from feedback from devs on what to test and so on I would use the -dev list21:27
*** gokrokve has quit IRC21:28
nuritvclarkb: thanks. i just don't want to trash the lists... will start on infra list. thanks again21:29
*** crc32 has quit IRC21:31
*** dkranz has quit IRC21:34
*** crc32 has joined #openstack-infra21:35
*** crc32 has quit IRC21:35
clarkbwow I cannot figure out how to give pootle a .pot file for a project21:36
*** mestery_ has joined #openstack-infra21:36
clarkbdo I have to do this on disk?21:37
*** mestery has quit IRC21:37
*** malini has joined #openstack-infra21:38
*** ominakov_ has quit IRC21:40
*** mestery_ is now known as mestery21:40
*** fifieldt has joined #openstack-infra21:41
clarkbpleia2: ok I reproduced. my extra logging didn't log anything for this thing21:43
clarkbthere is a fly out to upload template files after you add templates to a project as a "language"21:43
*** emagana has quit IRC21:43
*** emagana has joined #openstack-infra21:44
*** gokrokve has joined #openstack-infra21:45
*** crc32 has joined #openstack-infra21:45
*** mestery has quit IRC21:45
*** signed8bit has quit IRC21:46
*** mestery has joined #openstack-infra21:46
*** emagana_ has joined #openstack-infra21:46
*** emagana has quit IRC21:46
clarkbpleia2: when I try to delete the pot via web ui I get ERROR Error while trying to delete /templates/clarktest//templates/clarktest/nova.pot21:49
clarkbpleia2: so there appears to be path things that are broken21:49
clarkbthe .pot file ends up in the correct place though21:49
*** gondoi is now known as zz_gondoi21:53
*** dimtruck is now known as zz_dimtruck21:57
*** bdpayne has quit IRC21:58
clarkbpleia2: I am going to do another round of db drop and retry I think I found a db option that may be partially to blame for some of this22:00
*** gokrokve has quit IRC22:00
*** bdpayne has joined #openstack-infra22:00
*** mestery has quit IRC22:01
*** annegentle has quit IRC22:01
*** zz_dimtruck is now known as dimtruck22:02
*** otherwiseguy has quit IRC22:03
clarkbpleia2: well that didn't fix the import via web ui issue22:03
*** denis_makogon_ has quit IRC22:04
mattoliverauMorning22:06
*** malini has quit IRC22:06
*** malini has joined #openstack-infra22:06
clarkbhi there22:06
*** sdake has joined #openstack-infra22:07
*** sdake has quit IRC22:07
*** sdake has joined #openstack-infra22:07
*** malini1 has joined #openstack-infra22:08
*** malini has quit IRC22:08
*** hogepodge has quit IRC22:08
clarkbpleia2: I managed to get stuff working if I manually put the file in place22:10
clarkbpleia2: but deletions are still broken too22:10
*** MaxV has quit IRC22:12
*** gokrokve has joined #openstack-infra22:12
*** ihrachyshka has quit IRC22:14
jeblairsdague: welcome back :)  while you were gone, we got the post-merge mergability-check thing going (it's running now on all projects).  when you are settled and have a minute, i'd like to talk about dropping the freshness check: https://review.openstack.org/#/c/114626/22:15
clarkbfungi: jeblair I am completely confused by https://review.openstack.org/#/c/11359822:16
clarkber sorry jhesketh ^22:16
sdagueok, cool. I'm going to be sort of intermittent this week with linuxcon, at least until later in the week.22:16
clarkbwhy did we change names?22:16
*** malini1 has quit IRC22:16
*** malini has joined #openstack-infra22:16
clarkbthat is a backward incompatible change, is there a change in config to deal with that?22:16
clarkbsdague: the d-g change for sideways upgrade merged, changes to use it are up for review22:17
sdagueclarkb: cool. Honestly I just made it through the mailing list backlog on the plane. Haven't even openned gerrit yet :)22:17
*** HenryG_ has joined #openstack-infra22:17
pleia2clarkb: sigh, I wonder if this is all due to it being an RC? I didn't imagine it would be this bad, I'll browse bug tracker and see what else I can dig up22:17
clarkbfungi: jhesketh I am not a fan of the current setup. What am I missing that patchset 4 didn't solve?22:18
jeblairsdague: okay cool; mondays and tuesdays are our biggest days for freshness-check derived load (>3000 nodes/day), so if we have the conversation before the weekend, that would be great22:18
clarkbpleia2: its possible, I got the feeling not much was tested after hitting the openid stuff22:18
clarkbpleia2: but also possible the docs/config is wrong22:18
*** gokrokve has quit IRC22:19
*** HenryG has quit IRC22:19
*** malini has quit IRC22:19
*** gokrokve has joined #openstack-infra22:19
*** malini has joined #openstack-infra22:19
clarkbfungi: jhesketh: is that inversion with the flag needed because otherwise we can't tell it to remove them?22:19
clarkbarg22:19
pleia2clarkb: yeah22:19
*** otherwiseguy has joined #openstack-infra22:20
*** malini has quit IRC22:20
*** malini has joined #openstack-infra22:21
jeblairthe current merge-check queue is 274 with a 20 minute wait time (a nova change merged); it's not terrible, but we might consider spinning up a zm0322:21
*** malini has quit IRC22:21
*** malini has joined #openstack-infra22:21
jeblair261. it took me a while to type that.22:21
jeblairbut this is a bursty thing, so it's not putting us over the edge in terms of queue processing or anything22:22
* jeblair thinks it's pretty cool you can watch it on the zuul status page22:23
*** juzuluag_ has quit IRC22:23
*** gokrokve has quit IRC22:24
clarkbjeblair: ya we may want zm03 especially for feature freeze time period22:24
clarkbsince we tend to merge a ton of code that week22:24
mtreinishjeblair: only 261, I would have assumed it would be far higher than that...22:25
*** nuritv has quit IRC22:25
mtreinishbut I guess it is a slower week22:25
*** tonytan4ever has quit IRC22:26
jeblairhttp://graphite.openstack.org/render/?from=-8hours&width=800&height=600&target=color%28stats.gauges.zuul.pipeline.merge-check.current_changes,%20%276b8182%27%29&_t=0.2328968844721383#140848725893022:26
clarkbnibalizer: https://review.openstack.org/#/c/100363/4/specs/public_hiera.rst what is the symlink for?22:26
clarkbnibalizer: at first glance that seems like a bug22:26
jeblairlooks like it peaked at 56022:26
clarkbnibalizer: because it will make puppet apply clunky22:26
*** markmcclain has quit IRC22:26
jeblairmtreinish: the theoretical max for that is the set of all open changes in all projects22:26
*** kmartin has quit IRC22:27
nibalizerclarkb: not sure why that will make puppet clunky, but we symlink them together becuase puppet uses /etc/hiera/hiera.yaml and the 'hirea' command line tool uses /etc/hiera.yaml22:27
nibalizerif they are linked there can be no confusion22:27
clarkbnibalizer: thats, I don't even22:27
nibalizerthe hiera command line tool is good for debugging the hierarchy, and can be used with ansible to set the right parameters to the commands it will run on the agents22:27
clarkbnibalizer: clunky because you would have to do a symlink then run puppet apply but apparently that is only for the hiera command22:28
nibalizerya puppet doesn't require /etc/hiera.yaml22:28
clarkbnibalizer: can puppet be told to use the /etc/hiera.yaml file?22:28
clarkbsince that is where hiera wants the info?22:28
nibalizermaybe?22:28
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Add zm03  https://review.openstack.org/11541722:28
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Use zm03  https://review.openstack.org/11541822:28
nibalizeri think in puppet 2.7 'hiera config file' literally is $confdir/hiera.yaml which would imply no22:28
nibalizerbut im happy to be wrong about that22:28
mtreinishjeblair: yeah that makes sense, I just would thought the numbers would have been bigger, but I guess I just didn't have a realistic idea of how many open changes there were22:29
clarkbits a separate issue anyways22:29
*** otter768 has joined #openstack-infra22:29
clarkbnibalizer: also is it not weird that hiera can't really speak to different DBs?22:29
clarkbnibalizer: because that is extremely weird to me (its so reliant on a default /etc/hiera.yaml file)22:29
jeblairmtreinish: heh, based on gerrit's ui, my internal understanding is that there are more than 25 changes open. ;)22:29
clarkbnibalizer: can we tell hiera to use /etc/puppet/hiera.yaml?22:29
mtreinishjeblair: heh, I switched it to 100/page on my account22:30
nibalizerclarkb: 'use different dbs' what do you mean?22:30
clarkbnibalizer: I mean when using the hiera tool I should be able to tell it to talk to /etc/puppet/hiera.yaml without a symlink22:31
clarkbnibalizer: the hiera tool shouldn't assume a single source of data22:31
nibalizerwell hold on22:31
nibalizerso hiera.yaml is just a config file22:31
nibalizerpointing to where the data is22:31
clarkbright22:32
nibalizerand you can pick one at runtime with hiera -c myfile.yaml22:32
clarkboh well then can we not make that symlink?22:32
nibalizeri dont follow? what do you propose?22:32
clarkbnibalizer: put hiera.yaml in /etc/puppet/hiera.yaml. Don't make a symlink. Anything that wants to use the hiera cli tool can use the -c flag22:33
clarkbnibalizer: its extremely confusing otherwise22:33
nibalizerits extremely confusing otherwise22:33
clarkbya, why would you have two config files that in theory do two different things be the same thing22:33
nibalizeryou dont want to be debugging 'WHY PUPPET BROKE' and then facepalm 'i was supposed to be passing -c !!!!!?!??!!?!'22:33
clarkbnibalizer: when you use -c it is explicit22:33
greghaynesnibalizer: needs a few more !'s22:33
clarkband says please talk to my puppet hiera data22:34
clarkbwhcih is what I want to talk to22:34
*** sdake has quit IRC22:34
nibalizerthe only possible reason to use the hiera command line utility is to debug hiera or MAYBE to look up data to pass to ansible or puppet apply22:34
nibalizerclarkb: i dont know what to tell you, puppetlabs should have made them the same file22:34
nibalizerthey didn't22:34
nibalizereveryone just symlinks it22:34
*** paulrad has quit IRC22:34
clarkbnibalizer: ok if that is the expectation I can live with it22:35
clarkbnibalizer: usually when you have a distinction like that its important22:35
nibalizerokay22:37
*** kmartin has joined #openstack-infra22:38
*** harlowja has quit IRC22:39
*** harlowja has joined #openstack-infra22:39
*** prad has quit IRC22:39
*** hogepodge has joined #openstack-infra22:41
*** AlexF has joined #openstack-infra22:42
*** lttrl has quit IRC22:42
*** tomhe has quit IRC22:43
*** bdpayne has quit IRC22:44
*** linkid has left #openstack-infra22:47
clarkbjeblair: fungi jesusaurus nibalizer https://review.openstack.org/#/c/99990/ see comments there22:48
clarkbthat is a very light -1. Mostly since others have indicated confusion on the why of the thing I htink we should make it more clear22:48
*** AlexF has quit IRC22:48
clarkbalso I think it is worth calling out that we will continuously deploy these modules (unless there is strong opposition to doing it that way)22:48
*** mriedem has quit IRC22:49
jeblairclarkb: good comments22:49
*** melwitt has quit IRC22:51
*** Ish__ has quit IRC22:52
*** mestery has joined #openstack-infra22:53
clarkbjeblair: and commented onyour related spec too22:54
*** hdd has quit IRC22:55
fungiclarkb: added some clarification to my -1 for 113598. i thought i had updated the review after discussing with homeless in irc, but i seem to have forgotten to do so22:55
lifelessahahaha22:55
lifelessso my next pbr patch fails22:55
lifelessbecause it works22:55
lifelesshttp://logs.openstack.org/69/108269/16/check/check-grenade-dsvm/058a91b/logs/old/devstacklog.txt.gz22:55
lifeless2014-08-18 03:02:55.051 |     ValueError: git history requires a target version of pbr.version.SemanticVersion(2014.1.3), but target version is pbr.version.SemanticVersion(2014.1.2)22:55
fungilifeless: you win at pbr22:56
lifeless2014-08-18 03:02:55.051 |     error in setup command: Error parsing /opt/stack/old/nova/setup.cfg: ValueError: git history requires a target version of pbr.version.SemanticVersion(2014.1.3), but target version is pbr.version.SemanticVersion(2014.1.2)22:56
lifelessoops, doublepaste22:56
clarkbfungi: oh good points22:56
lifelessI wonder how many projects will need fixing22:57
clarkblifeless: why would that fail? shouldn't it update the version to that version?22:57
clarkblifeless: I thought the whole point was that it would be automagic22:57
lifelessclarkb: its preversioned22:57
lifelessclarkb: preversioned is defined as winning22:58
clarkboh I see22:58
lifelessclarkb: perhaps we should change that22:58
fungibuncha preverts22:58
lifelessclarkb: but it would be - AIUI - quite a conceptual change22:58
clarkblifeless: ya22:58
clarkbI grok now22:58
clarkbso for preversioned stuff can we turn off semantic versioning?22:58
clarkbthen remove preversioning22:58
*** arnaud has joined #openstack-infra22:59
lifeless2014.1.2-7-g27eea59 <- nova's stable/icehouse22:59
lifelessfrom git describe22:59
lifelessclarkb: what do you mean ?23:00
lifelessclarkb: I was thinking to just go fix the versions - e.g. stable/icehouse should now say 2014.1.3 in its setup.cfg23:00
lifelesssince thats the version its working towards23:00
lifelessby the preversioning rules23:00
*** dimtruck is now known as zz_dimtruck23:00
clarkbjeblair: and responded to your comments again. thanks23:01
clarkblifeless: I mean stop supporting pre versioning23:01
*** bknudson has quit IRC23:01
lifelessclarkb: I see little need for it, but maybe others still want it.23:01
* fungi still thinks pre-versioned release candidates are a release process albatross that we, as a society, have realized are suboptimal in modern practice (complicated to compare against other relative version numbers, thus a pain for downstream consumers). ttx and i will have to agree to disagree on that point, i think23:01
clarkblifeless: to get there we have to make pbr forward and backward compat, but then we can make openstack use sane versioning (via pbr semver), then we can remove preversioning23:01
*** dkliban is now known as dkliban_afk23:02
*** mestery_ has joined #openstack-infra23:02
*** mestery has quit IRC23:02
*** hdd has joined #openstack-infra23:03
lifelessclarkb: you're proposing not enforcing this check if the tree is preversioned23:03
lifelessclarkb: I can clearly do that, I'm not sure if its a good idea.23:03
clarkblifeless: correct, but only long enough for us to stop using preversioned23:03
clarkbgranted as fungi points out ttx will need to buy in23:03
lifelessclarkb: we could just fix the projects it impacts - which will be primarily the API servers plus a few other projects that cargo culted preversioning when they didn't want or need it23:04
lifelesssee e.g. https://review.openstack.org/11542623:04
fungiwow... just received via e-mail from a service provider (the benefits provider my employer contracts with, but irrelevant)... "[foo] will be performing an annual disaster recovery test next weekend to ensure that our products and services remain available to our clients in the event of a natural or man-made disaster. [foo services] will be unavailable at the following times during this annual23:04
fungidisaster recovery test. [list of affected services]"23:04
lifelessdo they get the irony?23:05
fungiindeed23:05
clarkblifeless: but won't this be a persistent issue? any time the preversion and the actual version get out of sync it will break. or will this be self gated?23:05
lifelessclarkb: so grenade is blocking the pbr change to enforce this.23:06
lifelessclarkb: once we get the change into pbr, projects will be told and we won't end up broken again.23:06
*** mestery_ has quit IRC23:07
*** mestery has joined #openstack-infra23:07
jheskethMorning23:08
pleia2morning jhesketh23:08
*** otherwiseguy has quit IRC23:09
clarkblifeless: gothca23:09
*** otherwiseguy has joined #openstack-infra23:09
lifelessirrespective of the way forward, projects that need a patch like https://review.openstack.org/115427 are already broken23:09
lifelessso I'm going to send a note to -dev now23:10
lifelessand then look at scripting a bulk check23:10
lifelesswhere's the script to mirror all of openstack23:10
*** Sukhdev has quit IRC23:11
lifelessclarkb: ^23:12
jeblairlifeless: cache_git_repos.py from the nodepool scripts could do it23:12
lifelessjeblair: thanks23:12
clarkblifeless: for project in `ssh -p 29418 review.o.o ls-projects` ; do git clone review.o.o/$project ; done23:12
*** mestery has quit IRC23:12
fungilifeless: well, as long as we're relying on prerelease version numbering, we'll have to store the "next expected version" somewhere pbr can find it (since it can't just guess without a lot of additional mechanics describing the numbering plan) and setup.cfg seems like as good a place as any. to change that paradigm, we need release manager buy-in23:12
*** mestery has joined #openstack-infra23:13
lifelessfungi: its in setup.cfg23:13
jeblairclarkb: even shorter :)23:13
jeblairclarkb, lifeless: but nicer if you clone from git.o.o23:13
lifelessfungi: semver can do roughly equivalent as soon as you tag just one alpha23:13
fungilifeless: hrm, good point23:14
*** tsg has quit IRC23:14
lifelessfungi: e.g. tag 2014.7.0.0a1 and after that semver knows where you're going.23:14
*** camunoz_gone is now known as camunoz23:14
lifelessfungi: if we've got it right, that is :)23:14
lifelessclarkb: ssh -p 29418 review.openstack.org ls-projects23:14
lifelessGerrit Code Review: ls-projects: not found23:14
fungiclarkb: that's basically what i do, except i test for the .git subdir of each and then either remote update+reset --hard or rm -rf and clone fresh23:14
jeblairlifeless: 'gerrit ls-projects'23:15
lifelessah thanks23:15
clarkbjeblair: can you see my comments on https://review.openstack.org/#/c/110793/ I don't quite think they need a -1 but figured specs review is more conversational so let me know what you think23:15
fungibut i'm also religious about using git stash and/or commit to a topic branch if i have work in progress not pushed to gerrit. maybe destructive for anyone not doing that23:15
*** maxbit has quit IRC23:15
*** maxbit has joined #openstack-infra23:16
lifelessI have a separate tree for working in, just gertty has this set of trees :)23:16
sdaguejeblair: https://review.openstack.org/#/c/114626/ lgtm. I figure if the unpassable gate changes show up later, we can address it then23:17
fungilifeless: yeah, i didn't think about inferring target release from prior prerelease versions--that's an awesome optimization and gets rid of annoying version numbers in setup.cfg entirely23:17
clarkbsdague: jeblair: does this mean I can review and approve?23:18
fungilifeless: so basically your dev versioning is a postrelease snapshot until the first prerelease tag in your history, and then you use prerelease versions23:18
jeblairsdague: okay; our toolbox is getting pretty big now too -- we could also do things like drop the 72 hour check but keep the 24h one, etc23:19
clarkbjeblair: can we do verified: [-2, -1, 0] for check test require approvals?23:19
sdaguejeblair: yeh23:19
clarkbjeblair: to fix the approve on verified = 0 issue?23:19
sdaguejeblair: that's what I assume we can bring back if it's actually an issue23:20
sdaguebut maybe the merge check will flush most of those23:20
lifelessfungi: its a prerelease snapshot of the smallest semver increment23:20
fungiclarkb: do we still rely on removing the vote as a locking semaphore to indicate that the change is being tested?23:20
lifelessfungi: its never a postrelease snapshot23:20
jeblairclarkb: i don't think we can require verified=0; i think with jhesketh's change we might be able to require not veried!=0, which would let us do that.  i think i mentioned that earlier.23:20
fungilifeless: oh, also a very good point23:20
sdagueat any rate, given that we're in node crunch, I'm happy to give it a shot23:20
clarkbfungi: ya I think we do23:21
lifelessfungi: first commit after 2014.1.0 will be 2014.1.1.dev1.g123567823:21
clarkbjeblair: oh I see23:21
lifelessfungi: so the first tag is to say 'I want a much higher version, thanks'23:21
clarkbjeblair: is that because verified: 0 isn't a thing in the gerrit event?23:21
* clarkb streams events23:21
fungilifeless: yep. makes total sense now23:21
jeblairclarkb: i think in this case, it's not the stream, but rather the query23:22
jeblairclarkb: i don't think the lack of an approval shows up as an approval :)23:22
fungilifeless: and we rely on semver to define what the smallest divisible subcomponent is... so keystone 2014.1.2.1 would not really have been allowed23:22
lifelessfungi: right23:24
fungilifeless: i guess that means we need to socialize that we should never use an explicit fourth version component as that's a reserved automagic space?23:24
clarkbjeblair: it isn't in the stream either23:24
clarkbseems like that is a gerrit bug. the comment shows -Verified but there is no Verified: 023:24
*** emagana_ has quit IRC23:25
jeblairclarkb: i think it might be a matter of semantics :)23:25
*** emagana has joined #openstack-infra23:25
fungiclarkb: gerrit seems to treat setting a vote to 0 as removal of the vote. 0 and null/none are synonymous for it23:26
clarkbfungi: ya23:26
lifelessfungi: also pbr will just ignore it :)23:26
clarkbjeblair: cool looks like you will update the docs publishing spe23:26
clarkb*spec23:26
lifelessfungi: with +version = 3.4.5.623:26
lifelessfungi: in setup.cfg23:26
*** datsun180b has quit IRC23:26
lifelesssdist builds23:26
fungilifeless: i ignore all sorts of things all the time... i'm starting to feel a kinship with pbr now23:27
lifelessaking hard links in os-apply-config-3.4.5.dev1.g58760d2...23:27
*** emagana has quit IRC23:27
clarkbdid we restart nodepool today?23:27
fungiclarkb: not yet23:27
clarkbthe node graph looks funny23:27
fungiclarkb: it does indeed23:27
clarkbfungi: still want to do that?23:27
fungimaybe someone else started it? or maybe we emptied very briefly... or maybe we rebooted23:27
jheskethso I'm pretty sure this has been discussed before, but why do we delete and boot new nodes instead of rebuilding them?23:27
fungiit wasn't rebooted at least23:28
*** emagana has joined #openstack-infra23:28
clarkbjhesketh: mordred hasn't finished the nodepool feature to do rebuilds23:28
fungiprocess started on the 15th23:28
*** gargola has quit IRC23:28
jeblairfungi, clarkb: we should see if it lines up with a zuul merge-check spike23:28
fungiclarkb: jeblair: is that gap in the graph...23:28
fungiyeah, that's what i was about to surmise23:28
lifelessor are you pleased to see me?23:28
lifelessboom, tish23:28
clarkbwait but merge-check is independent of nodepool23:29
lifelesshmm, I might be a little tired still :)23:29
fungiclarkb: but it's not necessarily independent of zuul handing out more work23:29
jheskethclarkb: oh, so it's in progress?23:29
jeblairwe can probably overlay the jobs launched on top of that too... i'll see if i can construct a graph23:29
clarkbjhesketh: it is something that is being worked on, but I think mordred ran into some corner cases, like races between deletes and rebuilds (because you eventually do want to delete if you don't need the node)23:29
fungiclarkb: if zuul got busy with mergability checks, it may have given jobs a chance to wrap up and nodepool an opportunity to recover a ready pool23:30
*** hdd has quit IRC23:30
clarkboh23:30
*** jpeeler has quit IRC23:30
fungiclarkb: the slope tail leading into the gap is basically the same as what we see when we put zuul into shutdown23:31
clarkbjhesketh: I don't see a change pushed for it though, maybe mordred never pushed it23:31
clarkbjhesketh: he was talking about it at one time though23:31
clarkbmordred: can you update us on your nodepool using nova rebuild stuff?23:31
jheskethokay23:31
*** atiwari has quit IRC23:31
jeblairclarkb: i don't think mordred is going to be updating us on anything for a few weeks23:32
*** ociuhandu has quit IRC23:32
clarkbjeblair: ya he was around earlier today but apparently that is that23:32
* fungi did not know there was a nova rebuild... should learn about this openstack stuff23:32
jeblairha nice23:32
jeblairalso, it's kind of an implementation detail that we expect that to be faster23:33
fungiclarkb: did he construct a network access terminal in the desert out of sand and human excrement?23:33
jeblair(i also think that some minor nova enhancements may be required for the rebuild stuff)23:33
*** maxbit has quit IRC23:33
jeblair(to be truly and reliably faster)23:33
*** KurtMartin has joined #openstack-infra23:33
clarkbfungi: apparently23:33
jeblairat least, i think phschwartz mentioned something to that effect a while ago23:34
clarkbfungi: jeblair how do you guys feel about restarting nodepool now?23:34
*** ZZelle_ has joined #openstack-infra23:34
clarkbwe seem caught up with demand for the current running tests23:34
fungiclarkb: we're surprisingly not gobsmacked with node demand to the point we're flatlining at our quota, so probably okay?23:35
clarkbI am happy to do it if others feel it is ok23:35
*** ZZelle has quit IRC23:36
*** kmartin has quit IRC23:36
clarkbjhesketh: jeblair: this and the reuse of floating IPs makes we want to rewrite bits of nodepool to have an explicit state machine for each node and each provider23:36
clarkbto make it a little easier to reason about where in an allocation we are for a provider or where in the life of a node we are23:36
jeblairhttps://etherpad.openstack.org/p/EyLv8op0Wo23:36
jeblairclarkb, fungi: ^ graph23:37
jeblairclarkb: it has a state machine; it's stored in the state column of the node table23:37
openstackgerritA change was merged to openstack-infra/config: Remove freshness check  https://review.openstack.org/11462623:37
clarkbjeblair: right, but the actual dispatch of actions based on that isn't always clear23:38
clarkbjeblair: so I don't think the details of the machine change, but we can make the transitions cleaner23:38
clarkbbut maybe I am overthinking it23:38
jeblairclarkb, fungi: i'm interpreting that graph as supporting evidence the merge check slowed the launching of new jobs sufficiently to affect node use23:38
jeblairso we should probably approve that zm03 change :)23:38
clarkbjeblair: yup the grey line matches up with the blue one pretty well23:39
*** KurtMartin has quit IRC23:39
clarkbjeblair: you ok with nodepool restart?23:39
fungijeblair: i agree with your analysis23:39
jeblairclarkb: i'm totally cool adding more states, or adding substates (eg, DELETE/jenkins; DELETE/removeip, DELETE/delete, ....)23:40
jeblairclarkb: nodepoor restart ok23:40
jeblairthen we will be noderich23:40
* clarkb restarts nodepool23:41
jeblair(the red line in the graph is zuul jobs launched per 10 minutes)23:41
clarkbafte rconfirming the install23:41
funginodepoor in spirit, noderich in life23:41
clarkboh right stopped puppet there, /me gets that going again23:41
*** mestery has quit IRC23:41
*** HenryG_ is now known as HenryG23:42
jeblairi except the rate of merge-check falloff depends on the repos in question.  ie, slower for nova because it takes almost 30 seconds to do a merge check there23:42
jeblairexpect even23:43
*** mestery has joined #openstack-infra23:44
fungiseems probable23:44
clarkbarg pip23:44
*** david-lyle has quit IRC23:44
clarkbit says nodepool's installed version is ancient23:44
*** david-lyle has joined #openstack-infra23:45
*** david-lyle has quit IRC23:45
* clarkb does surgery23:45
*** mestery has quit IRC23:45
jeblairbtw, check out the relationship between build/available during that window, it's almost pure sin/cos23:45
fungii was hoping for kicked pendulum chaos, but not every system is a strange attractor i guess23:46
openstackgerritA change was merged to openstack-infra/config: Add zm03  https://review.openstack.org/11541723:46
fungianyway, there ^23:47
*** kmartin has joined #openstack-infra23:47
fungiwho wants to launch it and find out what we've broken in our launch scripts lately?23:47
clarkbsomehow now we have a version installed that isn't in git23:47
clarkbI don't even23:47
fungiclarkb: that may have been the local revert jeblair put in plave?23:47
fungiplace?23:47
clarkbwas there a local revert?23:48
clarkbwhat I did last week was check out HEAD~1 and isntall that23:48
clarkbjeblair: ^23:48
fungiclarkb: yes. we didn't merge a revert of the dib bits, just reverted locally on the nodepool server and stopped puppet23:48
fungi(i think?)23:48
clarkbfungi: no that wasn't a revert. that was just git checkout HEAD~123:48
clarkband pip install that23:48
fungioh, huh23:48
clarkbI think the issue here is that we don't have a tag on nodepool23:49
*** crc32 has quit IRC23:49
clarkbso the versions are hash based and not necessarily increasing23:49
fungiooh, does pip see many of them as older version numbers as a result?23:49
fungiwe should consider releasing 0.0.1 as our initial commit of any pip-installable project in the future23:50
fungiyeah, not much is going to top 9661501 for a random 7-digit hex value23:51
fungi(currently you have a 4% chance of constructing a commit pip will view as a higher version number)23:52
lifelessinteresting nova/stable/havana is setup correctly :)23:52
fungi(actually less than that because i think it's only considering hex values with digits in the decimal range)23:53
lifelessclarkb: I have a fix for that in pbr23:53
*** yamahata has joined #openstack-infra23:53
*** ociuhandu has joined #openstack-infra23:54
lifelessclarkb: 1758998881ef5e3c81a76910755ce1e33688b9e0 -23:54
lifelessclarkb: which is landed but not in a release yet.23:54
lifelessfungi: ^23:54
*** wenlock has quit IRC23:55
fungilifeless: oh, neat. glad to see that will eventually cease being an issue23:56
*** marun has joined #openstack-infra23:56
clarkbfungi: lifeless: I am going to pip uninstall nodepool, remove stuff in dist-packages then reinstall23:57
clarkbthen we can restart23:57
clarkbjeblair: fungi: but ya a 0.0.1 tag would be nice23:57
fungiclarkb: seems reasonable. you could probably force it to "downgrade"23:57
fungibut however is easier for you23:57
*** markmc has joined #openstack-infra23:57
clarkbya that worked starting restart now23:58
*** sdake has joined #openstack-infra23:58
clarkbit is doing stuff post restart23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!