Monday, 2014-11-17

*** harlowja_at_home has quit IRC00:01
*** yamamoto has quit IRC00:01
*** yamamoto has joined #openstack-infra00:02
*** yamamoto has quit IRC00:04
*** baoli has quit IRC00:11
*** otter768 has quit IRC00:15
*** Alexandra_ has joined #openstack-infra00:19
*** baoli has joined #openstack-infra00:22
*** gokrokve has joined #openstack-infra00:24
*** gokrokve has quit IRC00:29
*** yamamoto has joined #openstack-infra00:31
*** ryanpetrello has joined #openstack-infra00:31
*** dims has quit IRC00:32
*** dims has joined #openstack-infra00:32
*** erikmwilson_ has joined #openstack-infra00:34
*** sarob has quit IRC00:36
*** markmcclain has quit IRC00:42
*** markmcclain has joined #openstack-infra00:43
*** ryanpetrello has quit IRC00:47
openstackgerritBradley Klein proposed openstack-infra/project-config: Move puppet-monasca to Stackforge  https://review.openstack.org/13465800:49
*** baoli has quit IRC00:51
*** nosnos has joined #openstack-infra01:01
*** ryanpetrello has joined #openstack-infra01:03
*** weshay has quit IRC01:03
*** baoli has joined #openstack-infra01:05
*** otter768 has joined #openstack-infra01:05
*** baoli has quit IRC01:06
*** banix has joined #openstack-infra01:13
*** banix has quit IRC01:14
*** ivar-lazzaro has joined #openstack-infra01:16
*** banix has joined #openstack-infra01:19
*** banix has quit IRC01:19
*** ryanpetrello has quit IRC01:25
*** ryanpetrello has joined #openstack-infra01:26
*** yaguang has joined #openstack-infra01:30
*** Alexandra_ has quit IRC01:31
*** yongli has joined #openstack-infra01:33
*** banix has joined #openstack-infra01:36
*** ryanpetrello has quit IRC01:38
*** achanda has quit IRC01:39
*** otherwiseguy has joined #openstack-infra01:41
*** fandi has quit IRC01:43
*** achanda has joined #openstack-infra01:43
*** yamahata has joined #openstack-infra01:46
*** jamespd has left #openstack-infra01:47
*** ivar-lazzaro has quit IRC01:49
*** ivar-lazzaro has joined #openstack-infra01:49
*** yamahata has quit IRC01:52
*** yamahata has joined #openstack-infra01:53
*** unicell has joined #openstack-infra02:06
*** markvan has quit IRC02:06
*** markvan has joined #openstack-infra02:07
*** unicell has quit IRC02:11
*** achanda has quit IRC02:13
*** harlowja_at_home has joined #openstack-infra02:16
*** adalbas has quit IRC02:17
*** dims has quit IRC02:18
*** dims has joined #openstack-infra02:19
*** gokrokve has joined #openstack-infra02:24
*** dims has quit IRC02:25
*** dims has joined #openstack-infra02:25
*** oomichi has joined #openstack-infra02:28
*** gokrokve has quit IRC02:29
*** jerryz has joined #openstack-infra02:31
*** pcrews has quit IRC02:31
*** ivar-lazzaro has quit IRC02:39
*** bradjones has quit IRC02:44
*** fifieldt has quit IRC02:45
*** bradjones has joined #openstack-infra02:46
*** zz_dimtruck is now known as dimtruck02:46
*** jyuso has joined #openstack-infra02:52
*** harlowja_at_home has quit IRC02:54
*** salv-orlando has quit IRC03:00
*** otherwiseguy has quit IRC03:00
*** ivar-lazzaro has joined #openstack-infra03:06
*** boris-42 has quit IRC03:07
*** koolhead17 has joined #openstack-infra03:10
*** koolhead17 has quit IRC03:10
*** koolhead17 has joined #openstack-infra03:10
*** achanda has joined #openstack-infra03:14
*** amotoki has joined #openstack-infra03:18
*** achanda has quit IRC03:19
*** dims_ has joined #openstack-infra03:20
*** dims has quit IRC03:23
*** gokrokve has joined #openstack-infra03:24
*** JaDonG has quit IRC03:28
*** Longgeek has joined #openstack-infra03:28
*** dims_ has quit IRC03:29
*** dims has joined #openstack-infra03:29
*** gokrokve has quit IRC03:29
*** Longgeek has quit IRC03:33
*** baoli has joined #openstack-infra03:37
*** yamamoto has quit IRC03:37
*** talluri has joined #openstack-infra03:40
*** baoli has quit IRC03:42
*** baoli has joined #openstack-infra03:42
*** markmcclain has quit IRC03:43
*** markmcclain has joined #openstack-infra03:44
*** baoli has quit IRC03:45
*** talluri has quit IRC03:47
*** nosnos has quit IRC03:49
*** koolhead17 has quit IRC03:51
*** koolhead17 has joined #openstack-infra03:52
*** koolhead17 has quit IRC03:57
*** pensu has joined #openstack-infra03:57
*** pensu has quit IRC04:03
*** bhunter71 has quit IRC04:11
*** talluri has joined #openstack-infra04:16
openstackgerritKen'ichi Ohmichi proposed openstack-infra/devstack-gate: WIP: Specify Nova XML API tests clearly for juno/icehouse  https://review.openstack.org/13485204:22
*** ivar-lazzaro has quit IRC04:22
*** gokrokve has joined #openstack-infra04:22
*** rushiagr_away is now known as rushiagr04:22
*** vigneshvar has joined #openstack-infra04:25
*** vigneshvar has quit IRC04:31
*** koolhead17 has joined #openstack-infra04:31
*** koolhead17 has quit IRC04:33
*** koolhead_ has joined #openstack-infra04:33
*** yamahata_ has quit IRC04:38
*** yamahata_ has joined #openstack-infra04:39
*** yamahata_ has quit IRC04:40
*** isq has joined #openstack-infra04:40
*** koolhead17 has joined #openstack-infra04:40
*** koolhead17 has joined #openstack-infra04:40
*** koolhea__ has joined #openstack-infra04:41
*** koolhead_ has quit IRC04:42
*** AlexF has joined #openstack-infra04:43
*** shashankhegde has joined #openstack-infra04:43
*** Longgeek has joined #openstack-infra04:44
*** koolhead17 has quit IRC04:45
*** nosnos has joined #openstack-infra04:46
*** vigneshvar has joined #openstack-infra04:46
*** mmedvede has quit IRC04:48
*** Longgeek has quit IRC04:48
*** mmedvede has joined #openstack-infra04:49
*** vponomaryov has quit IRC04:50
*** vponomaryov has joined #openstack-infra04:51
*** gokrokve has quit IRC04:53
*** achanda has joined #openstack-infra04:53
*** gokrokve has joined #openstack-infra04:53
*** bhuvan has joined #openstack-infra04:54
*** ivar-lazzaro has joined #openstack-infra04:55
*** talluri has quit IRC04:55
*** gokrokve has quit IRC04:58
*** mmaglana has joined #openstack-infra05:00
*** gokrokve has joined #openstack-infra05:02
*** banix has quit IRC05:04
*** banix has joined #openstack-infra05:06
*** _nadya_ has joined #openstack-infra05:08
*** banix has quit IRC05:09
*** oomichi has quit IRC05:11
*** BharatK has joined #openstack-infra05:16
*** pcrews has joined #openstack-infra05:18
*** gokrokve has quit IRC05:18
*** gokrokve has joined #openstack-infra05:18
*** chandankumar has joined #openstack-infra05:20
*** dimtruck is now known as zz_dimtruck05:21
*** cpowell has joined #openstack-infra05:21
*** gokrokve has quit IRC05:23
*** cpowell has quit IRC05:26
*** AlexF has quit IRC05:27
*** jamielennox is now known as jamielennox|away05:34
*** mmaglana_ has joined #openstack-infra05:34
*** mmaglana has quit IRC05:36
*** Longgeek has joined #openstack-infra05:37
*** viglesias has quit IRC05:41
*** jamielennox|away is now known as jamielennox05:41
*** zz_dimtruck is now known as dimtruck05:42
*** shashankhegde has quit IRC05:45
*** ivar-lazzaro has quit IRC05:46
*** gokrokve has joined #openstack-infra05:49
*** ivar-lazzaro has joined #openstack-infra05:49
*** gokrokve has quit IRC05:50
*** nosnos_ has joined #openstack-infra05:50
*** gokrokve has joined #openstack-infra05:51
*** nosnos has quit IRC05:51
*** stevemar has joined #openstack-infra05:52
*** dimtruck is now known as zz_dimtruck05:54
*** yfried has quit IRC05:54
*** pcrews has quit IRC05:54
*** yaguang has quit IRC05:54
*** gokrokve has quit IRC05:56
*** nosnos_ has quit IRC05:57
*** nosnos has joined #openstack-infra05:59
*** mdbooth has quit IRC05:59
*** hogepodge has quit IRC06:01
*** mdbooth has joined #openstack-infra06:04
*** ivar-lazzaro has quit IRC06:06
*** ivar-lazzaro has joined #openstack-infra06:07
*** mmaglana_ has quit IRC06:09
*** _nadya_ has quit IRC06:10
*** ivar-lazzaro has quit IRC06:11
*** viglesias has joined #openstack-infra06:11
*** talluri has joined #openstack-infra06:16
*** Longgeek has quit IRC06:17
*** Longgeek has joined #openstack-infra06:18
*** Longgeek_ has joined #openstack-infra06:18
*** miqui has quit IRC06:22
*** Longgeek has quit IRC06:22
*** ryanpetrello has joined #openstack-infra06:23
*** nosnos_ has joined #openstack-infra06:23
*** nosnos has quit IRC06:23
*** hogepodge has joined #openstack-infra06:24
*** gokrokve has joined #openstack-infra06:24
*** gokrokve has quit IRC06:29
*** KanagarajM has joined #openstack-infra06:30
*** ildikov has quit IRC06:41
*** jerryz has quit IRC06:42
*** erikmwilson_ has quit IRC06:44
*** markmcclain has quit IRC06:45
*** markmcclain has joined #openstack-infra06:46
*** jerryz has joined #openstack-infra06:47
*** rkukura_ has joined #openstack-infra06:50
*** rkukura has quit IRC06:51
*** rkukura_ is now known as rkukura06:51
*** yaguang has joined #openstack-infra06:51
*** HeOS has quit IRC06:53
*** koolhea__ has quit IRC06:53
*** koolhead17 has joined #openstack-infra06:54
*** Longgeek_ has quit IRC06:56
*** Longgeek has joined #openstack-infra06:57
*** koolhead17 has quit IRC06:59
*** markmcclain has quit IRC07:01
*** achanda has quit IRC07:02
*** ryanpetrello has quit IRC07:02
*** markmcclain has joined #openstack-infra07:08
*** otter768 has quit IRC07:10
*** ashaeron has joined #openstack-infra07:14
openstackgerritPraveen Kumar proposed openstack-infra/jenkins-job-builder: Add perlcritic capability to violations method since new jenkins-violation plugin already have support for it  https://review.openstack.org/13486707:19
*** yfried has joined #openstack-infra07:21
*** miqui_ has quit IRC07:22
*** gokrokve has joined #openstack-infra07:24
*** camunoz has quit IRC07:25
*** stevemar has quit IRC07:27
*** Longgeek has quit IRC07:27
*** Longgeek has joined #openstack-infra07:28
*** hdd has joined #openstack-infra07:29
*** gokrokve has quit IRC07:29
*** koolhead17 has joined #openstack-infra07:33
*** bhuvan has quit IRC07:35
*** yfried is now known as yfried|afk07:35
*** ildikov has joined #openstack-infra07:39
*** yfried|afk is now known as yfried07:40
*** Longgeek_ has joined #openstack-infra07:41
*** bhunter71 has joined #openstack-infra07:42
openstackgerritSpencer Krum proposed openstack-infra/system-config: Create puppet-forge credentials on the pypi slave  https://review.openstack.org/13483507:45
*** Longgeek has quit IRC07:45
*** e0ne has joined #openstack-infra07:47
*** e0ne has quit IRC07:50
openstackgerritSpencer Krum proposed openstack-infra/system-config: Making the apply test easier to read  https://review.openstack.org/13487107:51
openstackgerritSpencer Krum proposed openstack-infra/system-config: Create puppet-forge credentials on the pypi slave  https://review.openstack.org/13483507:52
*** bmwiedemann1 has left #openstack-infra07:54
openstackgerritSpencer Krum proposed openstack-infra/system-config: Turn off color in module install  https://review.openstack.org/13487207:55
*** p5ntangle has joined #openstack-infra07:56
*** p5ntangle has quit IRC07:58
*** p5ntangle has joined #openstack-infra07:59
*** bhunter71 has quit IRC08:00
*** p5ntangle has quit IRC08:03
*** achuprin_ has quit IRC08:07
*** talluri has quit IRC08:07
*** fifieldt has joined #openstack-infra08:09
*** belmoreira has joined #openstack-infra08:09
*** HeOS has joined #openstack-infra08:10
*** hashar has joined #openstack-infra08:12
*** links has joined #openstack-infra08:13
tchaypoIt seems to have been almost a year since https://pypi.python.org/pypi/zuul/2.0.0 was released08:15
tchaypoAre there any plans to do another release?08:15
*** achuprin_ has joined #openstack-infra08:19
hashartchaypo: most people run it directly from source08:19
*** doude has joined #openstack-infra08:19
hashar2.0.0 was tagged when Zuul switched to use Gearman to trigger jobs (instead of using the Jenkins REST API)08:20
*** p5ntangle has joined #openstack-infra08:20
*** yamahata has quit IRC08:20
hashartchaypo: if there is a need for a new release, I guess you can ask on the openstack-infra mailing list08:21
*** p5ntangle has quit IRC08:21
*** _nadya_ has joined #openstack-infra08:21
tchaypoI’m rewriting a tool to use zuul_merger rather than shelling out to git to do the same thing zuul_merger already does08:23
*** mrmartin has joined #openstack-infra08:24
*** gokrokve has joined #openstack-infra08:24
tchaypobut zuul_merger isn’t in a released version, so I think I’m going to have to need to include a git repo in the requirements08:25
*** salv-orlando has joined #openstack-infra08:29
*** gokrokve has quit IRC08:29
*** jgallard has joined #openstack-infra08:31
*** yongli has quit IRC08:31
*** yongli has joined #openstack-infra08:32
*** luqas has joined #openstack-infra08:33
*** yongli has quit IRC08:36
*** yongli has joined #openstack-infra08:38
jerryztchaypo: you want to use zuul_merger in psr?08:39
hashartchaypo: note Zuul uses GitPython to handle git operations :)08:40
hashartchaypo: so the shell out is probably in that module (  source is https://github.com/gitpython-developers/GitPython , use the 0.3 branch )08:40
tchaypoHeh08:41
tchaypoYes, I'm looking at tweaking psr to use zuul_merger, on the theory that it would be nice to avoid having two bits of OpenStack code that do the same thing08:42
tchaypoZuul_merger has a library that seems to have the bits I need, but no cli to do what I need08:42
hasharand for what it is worth, I wrote the zuul-cloner cli utility which reproduces what devstack-gate does08:42
*** Guest78052 has joined #openstack-infra08:42
hashari.e. clone multiple repositories, look up the Zuul ref or fallback to the patchset branch08:43
tchaypoZuul_cloner doesn't do what I need - it assumes zuul_merger has merged in the patches08:43
tchaypoie, has already created "the zuul ref"08:43
hasharindeed08:43
tchaypoPsr takes a list of Gerrit changes and merges them08:44
tchaypoConceptually similar, but the list is coming from the user rather than zuul08:44
hashartchaypo: maybe you can add to Zuul a  zuul-merge command liner?08:46
*** unicell has joined #openstack-infra08:47
tchaypoMaybe that's a better way to approach it08:47
hashartchaypo: the logic is in zuul/merger/merger.py   Merger class08:47
tchaypoWhat Timezone are you in?08:47
tchaypoI need08:47
*** _nadya_ has quit IRC08:47
hasharI am in Europe08:48
tchaypoTo go away to make breakfast08:48
hasharso that is the beginning of my day work :]08:48
tchaypoCool. Let's talk about this more after breakfast :)08:48
*** berendt has joined #openstack-infra08:48
hasharsure08:48
tchaypoI'm in Nimes this week :)08:48
hasharlucky!08:48
*** berendt has quit IRC08:49
*** berendt has joined #openstack-infra08:49
*** gilliard has quit IRC08:51
*** gilliard has joined #openstack-infra08:51
*** jpich has joined #openstack-infra08:52
*** koolhead_ has joined #openstack-infra08:59
*** GheRivero has quit IRC08:59
*** koolhead17 has quit IRC09:01
*** Guest78052 has quit IRC09:03
*** talluri has joined #openstack-infra09:06
*** IvanBerezovskiy has joined #openstack-infra09:06
*** fabo_ is now known as fabo09:07
*** amuller has joined #openstack-infra09:08
*** derekh has joined #openstack-infra09:11
openstackgerrityolanda.robla proposed openstack-infra/storyboard-webclient: Dynamically refresh events on task changes  https://review.openstack.org/12654209:13
*** reed has joined #openstack-infra09:13
*** jgallard has quit IRC09:16
*** jgallard has joined #openstack-infra09:16
*** BobBall_ is now known as BobBall09:17
*** jgallard has quit IRC09:18
*** jgallard has joined #openstack-infra09:18
*** iain-king has quit IRC09:19
*** ildikov has quit IRC09:19
*** skolekonov has joined #openstack-infra09:19
*** bauzas has left #openstack-infra09:22
*** leopoldj has joined #openstack-infra09:22
*** cnesa has quit IRC09:23
*** che-arne has joined #openstack-infra09:24
*** gokrokve has joined #openstack-infra09:24
*** ildikov has joined #openstack-infra09:25
*** gokrokve has quit IRC09:25
*** gokrokve has joined #openstack-infra09:26
*** mpaolino has joined #openstack-infra09:26
*** jedimike has joined #openstack-infra09:27
*** dizquierdo has joined #openstack-infra09:29
*** e0ne has joined #openstack-infra09:31
*** gokrokve has quit IRC09:31
*** che-arn0 has joined #openstack-infra09:32
openstackgerritIvan Udovichenko proposed openstack-infra/system-config: Remove hardcoded variables from openstack_project module (Etherpad)  https://review.openstack.org/13197809:33
*** che-arn0 has quit IRC09:33
*** che-arne has quit IRC09:34
*** che-arne has joined #openstack-infra09:34
*** MaxV has joined #openstack-infra09:35
*** che-arne has quit IRC09:36
*** jp_at_hp has joined #openstack-infra09:37
*** matel has joined #openstack-infra09:40
*** rediskin has joined #openstack-infra09:41
openstackgerrityolanda.robla proposed openstack-infra/devstack-gate: Add option for is_debian to support it  https://review.openstack.org/13076809:42
*** yolanda has joined #openstack-infra09:42
*** rediskin has left #openstack-infra09:42
*** rediskin has joined #openstack-infra09:42
*** jp_at_hp has quit IRC09:43
*** flaper87 has quit IRC09:43
*** flaper87 has joined #openstack-infra09:43
matelHey guys, I'm getting errors like: Exception: Failed to clone stackforge/murano-specs - do you know what could be causing it?09:44
matelAlso in the logs: warning: remote HEAD refers to nonexistent ref, unable to checkout.09:44
matelAnd that's coming from /opt/nodepool-scripts/cache_git_repos.py09:45
*** markmcclain has quit IRC09:46
tchaypowheee09:46
matelAh, I think it's driven by https://git.openstack.org/cgit/openstack-infra/project-config/ plain/gerrit/projects.yaml09:46
tchaypohrm.09:47
tchaypohttp://git.openstack.org/cgit/stackforge/murano-specs09:47
*** markmcclain has joined #openstack-infra09:47
tchaypo“repository seems empty"09:47
matelYep, quite empty09:47
matelIs it causing issues only fot me?09:48
tchaypoI can see why it’s having trouble finding the re09:48
tchaypof09:48
matelI tried it via cmd as well:09:48
*** isviridov_away is now known as isviridov09:49
matel$ git clone git://git.openstack.org/stackforge/murano-specs.git blahblah09:49
matelCloning into 'blahblah'...09:49
matelChecking connectivity... done.09:49
matelwarning: remote HEAD refers to nonexistent ref, unable to checkout.09:49
matelBut return value is 0, so that must not be the problem.09:50
*** marcusvrn has joined #openstack-infra09:50
*** jp_at_hp has joined #openstack-infra09:50
*** Guest78052 has joined #openstack-infra09:50
matelgit reset --hard HEAD is returning non-zero09:51
matelAnd that's causing some issues.09:52
*** ihrachyshka has joined #openstack-infra09:52
*** yfried is now known as yfried|afk09:52
*** belmoreira has quit IRC09:55
mateltchaypo: Who could fix this issue?09:57
*** ihrachyshka has quit IRC09:57
*** Guest78052 has quit IRC09:58
*** Guest78052 has joined #openstack-infra09:59
*** johnthetubaguy has joined #openstack-infra10:00
*** yfried|afk is now known as yfried10:01
johnthetubaguyhey, just noticed some of the images infra are currently trying to build on the rackspace cloud are broken, and always failing to build, like "a73e5d84-eef6-4ed8-a46a-bcac06cbac3c" in DFW, can I help?10:02
johnthetubaguyLooks like either some image metadata has gone missing, or the grub boot file is wrong, or at least confusing xenserver's pygrub10:02
*** yamahata has joined #openstack-infra10:03
*** achanda has joined #openstack-infra10:06
*** Hal has joined #openstack-infra10:07
*** Guest78052 has quit IRC10:07
*** Hal is now known as Guest7628210:07
*** rlandy has joined #openstack-infra10:08
*** achanda has quit IRC10:10
*** yfried is now known as yfried|afk10:12
*** nadya_ has joined #openstack-infra10:16
*** dizquierdo has quit IRC10:18
*** yfried|afk is now known as yfried10:18
mateljohnthetubaguy: is it related to the XenServer CI?10:21
johnthetubaguymatel: I thought you had your own cloud account?10:23
johnthetubaguymatel: if you PM me your tenant id, I can check10:23
mateljohnthetubaguy: I hav10:23
matelLet me search for the ID you gave me10:23
johnthetubaguymatel: the errors are all from the infra tenant id, AFAIK10:23
mateljohnthetubaguy: Ok, that's not my table.10:24
*** gokrokve has joined #openstack-infra10:24
johnthetubaguymatel: that image belongs to infra, as far as I can tell, and lives in DFW10:24
*** unicell has quit IRC10:27
*** yfried is now known as yfried|afk10:28
*** gokrokve has quit IRC10:29
*** katyafervent is now known as katyafervent_awa10:29
*** yfried|afk is now known as yfried10:30
*** teran has quit IRC10:31
*** boris-42 has joined #openstack-infra10:33
*** mkerrin has joined #openstack-infra10:34
*** Guest76282 has quit IRC10:36
*** yfried has quit IRC10:39
*** yfried has joined #openstack-infra10:39
*** pelix has joined #openstack-infra10:40
*** ldnunes has joined #openstack-infra10:42
*** aysyd has joined #openstack-infra10:49
*** yfried is now known as yfried|afk10:50
*** yfried|afk is now known as yfried10:51
*** belmoreira has joined #openstack-infra10:53
*** denis_makogon has joined #openstack-infra10:55
*** chandankumar has quit IRC10:56
*** mfink has quit IRC10:58
*** adalbas has joined #openstack-infra11:01
*** Guest76282 has joined #openstack-infra11:02
*** KanagarajM has quit IRC11:04
tchaypomatel: I don’t know - I’m guessing it would need to be someone with commit access to the repo11:04
tchaypoI’m not in infra myself and the people I’d normally ping aren’t in this timezone11:05
tchaypooh, except derekh11:05
tchaypo(I’m sure there are people in this timezone, I just don’t know them because I’m not from here)11:05
mateltchaypo: thanks.11:06
matelderekh: ping11:06
derekhmatel: tchaypo: whats the question?11:06
*** pc_m has joined #openstack-infra11:06
matelderekh: I'm getting errors while cloning murano-specs.git11:06
matelthrough cache_git_repos.py11:07
matelderekh: let me paste the error somewhere11:07
derekhmatel: no need, I can't clone it either11:08
*** chandankumar has joined #openstack-infra11:08
matelderekh: http://paste.openstack.org/show/134048/11:08
*** pc_m has quit IRC11:08
derekhand the web interface seems to think its empty11:08
derekhhttp://git.openstack.org/cgit/stackforge/murano-specs/11:08
*** pc_m has joined #openstack-infra11:09
matelderekh: The problem that it's halting my image building process, and that's suboptimal.11:09
derekhmatel: I'm afraid I can only confirm its not just you who is seeing a problem, somebody with access to the servers will probably have to take a look11:10
matelderekh: Who's gonna be that?11:10
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Make bashate voting on system-config  https://review.openstack.org/12966711:12
derekhmatel: one of jeblair fungi clarkb or SergeyLukjanov  shoud be able to help out, most of whom probably wont be around for a few hours11:13
*** dizquierdo has joined #openstack-infra11:13
*** AJaeger has joined #openstack-infra11:14
matelderekh: Thanks for that, I'll ping em.11:14
*** jgallard has quit IRC11:14
mordredit seems to be an empty repo11:16
mordredon the git mirrors - but it's got content in gerrit11:18
*** koolhead17 has joined #openstack-infra11:18
*** amotoki has quit IRC11:19
*** koolhead_ has quit IRC11:19
AJaegermurano-specs was created as an empty repository11:20
mordredyah - it's got the .gitreview commit in it in gerrit11:20
AJaegermordred: does it? https://review.openstack.org/#/q/project:stackforge/murano-specs,n,z does not show me anything at all...11:22
*** mase_x200 has joined #openstack-infra11:22
mase_x200nibalizer:11:22
mordredAJaeger: http://git.openstack.org/cgit/stackforge/murano-specs/commit/?id=715ca3d238fe557f8710bee4a8be857a170b98d211:22
mordredAJaeger: I retriggered replication for it11:22
*** skraynev has quit IRC11:22
mordredAJaeger: I do not know why it was unhappy11:22
mase_x200nibalizer: just curious about the chicken / egg problem, how are they identified ?11:23
mordredAJaeger: part of the "create empty repo" logic in manage-projects creates a commit for the .gitreview nad pushes that as the initial repo11:23
mordredAJaeger: it won't show up as a change in gerrit11:23
*** koolhead17 has quit IRC11:23
mase_x200as in how do you know before they need to be applied together11:23
*** rfolco has joined #openstack-infra11:23
AJaegermordred, matel: That seems to have done the trick - now I can clone it.11:24
*** gokrokve has joined #openstack-infra11:24
matelAJaeger: thanks for that, I'm removing the workarounds.11:24
AJaegermatel: mordred did the work11:24
AJaegermordred: thanks for the explanation11:25
matelmordred: thanks for that11:25
*** hashar has quit IRC11:27
AJaegermordred, sdague, fungi: What do you think of merging https://review.openstack.org/#/c/129496/ (openstack-infra/puppet-httpd) and https://review.openstack.org/#/c/126448/ (split out github as module) ?11:27
*** gokrokve has quit IRC11:29
*** yamahata has quit IRC11:30
*** vigneshvar has quit IRC11:30
*** yamahata has joined #openstack-infra11:31
*** rediskin has left #openstack-infra11:31
*** hashar has joined #openstack-infra11:32
*** skraynev has joined #openstack-infra11:33
*** rediskin has joined #openstack-infra11:34
*** teran has joined #openstack-infra11:35
*** koolhead17 has joined #openstack-infra11:35
*** Guest76282 has quit IRC11:35
*** hashar has quit IRC11:36
*** rfolco has quit IRC11:36
mordredAJaeger: +311:39
*** yamahata has quit IRC11:39
AJaegerthanks, mordred11:40
*** mase_x200 has quit IRC11:40
openstackgerritMerged openstack-infra/project-config: Add openstack-infra/puppet-httpd  https://review.openstack.org/12949611:42
*** yfried_ has joined #openstack-infra11:44
*** yfried has quit IRC11:44
*** hdd has quit IRC11:47
sdaguemorning all11:47
*** talluri has quit IRC11:48
AJaegermorning, sdague !11:48
*** talluri has joined #openstack-infra11:48
*** openstackgerrit has quit IRC11:48
*** openstackgerrit has joined #openstack-infra11:49
*** ZZelle has joined #openstack-infra11:49
*** yaguang has quit IRC11:49
*** dims has quit IRC11:50
johnthetubaguysdague: not sure the best person to reach out too, but looks like quite a few of the builds in the rackspace cloud are failing due to a "bad" image, happy to help someone debug that11:50
*** dims has joined #openstack-infra11:50
sdaguejohnthetubaguy: got a pointer to a job that's failing?11:50
johnthetubaguysdague: I have an image-id, let me dig that out again, was one in DFW11:51
sdaguejohnthetubaguy: or is this just the nodepool nightly rebuild11:51
johnthetubaguysdague: so, build errors seemed to be happening all day11:51
sdaguejohnthetubaguy: ok, I don't have enough access to do a useful thing with an image-id11:51
johnthetubaguyon a specific image11:51
*** talluri has quit IRC11:51
johnthetubaguysdague: let me see if the name gives me any clues, one sec11:51
*** ZZelle has quit IRC11:52
*** ZZelle has joined #openstack-infra11:53
johnthetubaguysdague: one of them was devstack-precise-rax-dfw-3019365.slave.openstack.org11:53
johnthetubaguysdague: who should I ask about nodepool?11:55
sdaguejohnthetubaguy: so, honestly, I think we need to wait for fungi to get up and poke a bunch. That will be a couple of hours. My guess is it's related to nodepool image builds11:55
johnthetubaguysdague: cool, agreed, certainly looks like the node pool image has gone "bad", possibly its just missing some metadata11:55
sdagueyeh, so the real question is whether or not that's actually impacting anything else11:56
*** ildikov has quit IRC11:59
*** yamahata has joined #openstack-infra12:02
*** ZZelle has quit IRC12:07
*** ZZelle has joined #openstack-infra12:08
*** rfolco has joined #openstack-infra12:10
*** teran_ has joined #openstack-infra12:12
*** ildikov has joined #openstack-infra12:12
*** teran has quit IRC12:15
johnthetubaguysdague: good question, i suspect the poll of worker VMs that are available from rackspace is limited, but its not causing an impact while we are less busy, but thats a pure guess12:15
johnthetubaguyfungi: would be good to catch up on the rackspace build failures (in DFW with precise) when you wake up12:16
johnthetubaguyfungi: its not that urgent, but worth a dig soon12:16
*** mpaolino has quit IRC12:17
*** jaypipes has joined #openstack-infra12:18
*** cpowell has joined #openstack-infra12:18
*** stevemar has joined #openstack-infra12:22
*** nadya_ has quit IRC12:22
*** cpowell has quit IRC12:23
*** ZZelle has quit IRC12:23
*** rfolco has quit IRC12:23
*** ZZelle has joined #openstack-infra12:24
*** gokrokve has joined #openstack-infra12:24
*** AJaeger has quit IRC12:27
*** jyuso has quit IRC12:28
*** gokrokve has quit IRC12:29
*** Guest76282 has joined #openstack-infra12:30
*** katyafervent_awa is now known as fervent12:33
*** fervent is now known as katyafervent_awa12:34
*** katyafervent_awa is now known as fervent12:34
*** fervent is now known as katyafervent12:34
*** katyafervent is now known as katyafervent_awa12:36
*** nosnos_ has quit IRC12:39
*** ryanpetrello has joined #openstack-infra12:41
*** katyafervent_awa is now known as fervent12:43
*** fervent is now known as katyafervent12:44
*** markmcclain has quit IRC12:47
openstackgerritLucas Dutra Nunes proposed openstack-infra/jenkins-job-builder: xUnit publisher: add support to CTest  https://review.openstack.org/13492112:47
openstackgerritLucas Dutra Nunes proposed openstack-infra/jenkins-job-builder: xUnit publisher: add test-time-margin extra config option  https://review.openstack.org/13492212:47
openstackgerritLucas Dutra Nunes proposed openstack-infra/jenkins-job-builder: xUnit publisher: add option to skip if there are no tests files  https://review.openstack.org/13492312:47
*** markmcclain has joined #openstack-infra12:48
*** matel is now known as matel_feeding12:48
*** hdd has joined #openstack-infra12:52
*** ryanpetrello has quit IRC12:54
*** ryanpetrello_ has joined #openstack-infra12:54
*** ryanpetrello_ is now known as ryanpetrello12:54
*** stevemar has quit IRC12:56
*** dmsimard_away is now known as dmsimard12:58
*** ddieterly has quit IRC12:59
*** ZZelle has quit IRC13:01
*** cnesa has joined #openstack-infra13:01
*** ZZelle has joined #openstack-infra13:01
*** baoli has joined #openstack-infra13:02
*** yfried_ is now known as yfried|afk13:03
*** yfried|afk is now known as yfried_13:04
*** rcarrill` has left #openstack-infra13:04
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/devstack-gate: Switch to enable/disable Nova V2 XML Support  https://review.openstack.org/13471413:05
*** hdd has quit IRC13:06
*** cnesa2 has joined #openstack-infra13:06
belmoreiraHi, is mariaDB used in the gate or only mysql?13:06
*** mbacchi has joined #openstack-infra13:06
belmoreiraI'm asking because some distributions (RHEL) are using mariaDB as default13:06
*** cnesa has quit IRC13:08
clarkbmysql on unittest slaves and whatever devstack uses on the other nodes. pretty sure its predominantly mysql but f20 and centos7 may be mariadb if devstack sets that up13:09
*** mpaolino has joined #openstack-infra13:12
*** cnesa2 is now known as cnesa13:12
*** rushiagr is now known as rushiagr_away13:12
*** dprince has joined #openstack-infra13:13
belmoreiraclarkb: on centos7 devstack sets up mariaDB13:13
*** katyafervent is now known as katyafervent_awa13:14
*** gokrokve has joined #openstack-infra13:14
*** katyafervent_awa is now known as katyafervent13:15
belmoreiraclarkb: my concern is to move to mariaDB if is not being tested at same level as mysql13:15
*** dmsimard is now known as dmsimard_away13:16
*** yfried_ is now known as yfried|afk13:16
*** alexpilotti has joined #openstack-infra13:16
*** mugsie_ is now known as mugsie13:18
*** bswartz has quit IRC13:20
*** AlexF_ has joined #openstack-infra13:22
sdaguezomg early for clarkb :)13:25
greghaynesjet lag is harsh13:25
*** dizquierdo has quit IRC13:25
*** dkranz has joined #openstack-infra13:26
*** nadya_ has joined #openstack-infra13:26
*** dmsimard_away is now known as dmsimard13:27
*** tristanC_ is now known as tristanC13:27
*** persia__ is now known as persia13:28
*** persia has quit IRC13:28
*** persia has joined #openstack-infra13:28
*** ZZelle has quit IRC13:29
clarkbya I will be in zombie mode today. I have to wait until 10am to get a burrito :(13:29
*** ZZelle has joined #openstack-infra13:29
*** ddieterly has joined #openstack-infra13:29
*** ZZelle has quit IRC13:30
*** ZZelle has joined #openstack-infra13:30
*** ZZelle has quit IRC13:31
*** ZZelle has joined #openstack-infra13:32
*** ZZelle has quit IRC13:32
*** ZZelle has joined #openstack-infra13:32
*** unicell has joined #openstack-infra13:32
ttxinfra-folk: would appreciate a review of https://review.openstack.org/#/c/134163/ today so I can use the Kilo-powered release status page in 1:1 syncs tomorrow13:33
*** dprince has quit IRC13:33
anteayaclarkb: where were you that you are up this early?13:33
*** ZZelle has quit IRC13:34
*** ddieterly has quit IRC13:34
*** ZZelle has joined #openstack-infra13:34
*** ZZelle has quit IRC13:34
*** ZZelle has joined #openstack-infra13:34
anteayattx where is the canonical reference for release dates for me to verity the patch?13:34
anteayattx is it the wikipage?13:35
ttxanteaya: https://wiki.openstack.org/wiki/Kilo_Release_Schedule13:35
clarkbanteaya europe13:35
anteayattx thanks13:35
anteayaclarkb: ah okay13:36
*** yfried|afk is now known as yfried_13:37
*** erikmwilson has joined #openstack-infra13:37
*** unicell has quit IRC13:37
*** dizquierdo has joined #openstack-infra13:37
*** mfink has joined #openstack-infra13:38
*** gokrokve has quit IRC13:38
*** matel_feeding is now known as matel13:38
*** gokrokve has joined #openstack-infra13:39
*** unicell has joined #openstack-infra13:39
*** k4n0_ has quit IRC13:39
openstackgerritLucas Dutra Nunes proposed openstack-infra/jenkins-job-builder: builders: add Hudson cmakebuilder plugin support  https://review.openstack.org/13419913:40
anteayattx +113:41
anteayathe only one I don't understand in the list of projects in that patch is oslo-incubator13:41
anteayabut that is because I dont' understand oslo-incubator13:41
*** kgiusti has joined #openstack-infra13:42
*** gokrokve has quit IRC13:43
*** sandywalsh has joined #openstack-infra13:44
openstackgerritThierry Carrez proposed openstack-infra/project-config: Add a project for OpenStack meetings descriptions  https://review.openstack.org/13448913:44
openstackgerritValeriy Ponomaryov proposed openstack-infra/project-config: Add testr logs publishing for manilaclient functional tests job  https://review.openstack.org/13493813:44
anteayattx what is the status of gerrit-powered-agenda?13:46
ttxanteaya: getting closer.13:46
anteayaor should I check logs of a meeting13:46
anteayahow long until it is useful?13:46
ttxanteaya: a couple of weeks, hopefully13:47
ttxStill need to work on check tests (which would test for a conflict), but need the repos split first13:47
*** ZZelle has quit IRC13:48
*** yfried_ is now known as yfried|afk13:48
*** bcourt has joined #openstack-infra13:49
anteayaoh13:51
anteayawhat prompted the need to split the repos?13:51
*** dkliban_pto is now known as dkliban13:51
anteayais there a conversation I can reference?13:51
*** dims has quit IRC13:52
*** ryanpetrello has quit IRC13:53
*** dims has joined #openstack-infra13:53
*** unicell has quit IRC13:53
*** unicell has joined #openstack-infra13:54
*** dkranz has quit IRC13:55
sdagueclarkb: can you +A this - https://review.openstack.org/#/c/134246/ - it tries a gwt on review-dev that I think will make our theming and parsing easier13:55
*** hdd has joined #openstack-infra13:55
*** _buzz has joined #openstack-infra13:56
fungiokay, so build failures and something wrong with some people being unable to clone murano-specs13:56
fungitaking a look13:56
fungianteaya: the split is pretty logical on that one... domain expertise needed to judge a calendar entry add/change/delete is substantially different from that needed to judge a change to the calendar building/hosting software13:58
clarkbfungi mordred fixed murano specs with a force sync13:58
fungiclarkb: oh, excellent13:58
*** katyafervent is now known as katyafervent_awa13:58
clarkbprobably another race in project creation13:58
fungiclarkb: seems likely13:58
*** bswartz has joined #openstack-infra13:58
*** ryanpetrello has joined #openstack-infra13:59
clarkbsdague: done13:59
sdagueclarkb: thanks13:59
*** julim has quit IRC14:00
*** baoli has quit IRC14:00
*** dkranz has joined #openstack-infra14:00
*** zul has joined #openstack-infra14:00
*** unicell has quit IRC14:02
*** baoli has joined #openstack-infra14:02
*** dprince has joined #openstack-infra14:03
anteayafungi: sure just wondering if there was some history there14:05
anteayathat I could reference14:05
clarkbbeing awake this early is counterproductive. no burritos14:05
fungihow can there be no burritos?14:05
openstackgerritMerged openstack-infra/storyboard: DB Migration config read  https://review.openstack.org/13186314:06
anteayaI'm missing the connection to burritos?14:06
fungihas portland never heard of the "breakfast burrito?"14:06
greghaynesfungi: unfortunately, no :(14:06
clarkbfungi it has but not until 10am14:06
greghaynesat which point I think it qualifies as a brunch burrito14:06
clarkbgreghaynes cha cha cha has breakfast burritos. does not open until 10am :(14:06
fungicraziness14:07
*** dustins has joined #openstack-infra14:07
anteayabreakfast burritos should be available by 7am14:07
anteayadidn't they read the memo?14:07
nibalizerlos gorditos opened at 8am14:08
nibalizerbut you have to go to SE division14:08
sdagueanteaya: if you make them at home, they are open at all times :)14:08
nibalizeroh its not even 8am there, rotating world is weird14:08
*** jamespage_ has joined #openstack-infra14:08
clarkbnibalizer its 6am nothing is open14:08
sdaguenibalizer: which part of the world are you still in?14:09
anteayasdague: very true14:09
anteayasdague: how's laundry?14:09
openstackgerritMerged openstack-infra/system-config: deploy the non obfuscated css version of gerrit to review-dev  https://review.openstack.org/13424614:09
*** gokrokve has joined #openstack-infra14:09
sdaguebreakfast burritos are one of our fallback meals when all other inspiration fails us14:09
nibalizersdague: im in ireland14:10
*** yfried|afk is now known as yfried_14:10
openstackgerritMerged openstack-infra/storyboard: Launchpad Import now imports multi-project bugs.  https://review.openstack.org/13408414:10
sdagueanteaya: mostly under control14:10
fungi1. scramble things in skillet, 2. wrap in warm tortilla, 3. stuff in face14:10
openstackgerritThomas Järvstrand proposed openstack-infra/jenkins-job-builder: Add logstash builder  https://review.openstack.org/13456014:10
sdaguefungi: ++14:10
clarkbsdague nice. I actuallt need to hit store for bread and eggs and other staples I am currently out of14:10
*** miqui has joined #openstack-infra14:10
nibalizeri prefer all foods to come in tortillas14:10
clarkbhowever I cant compete with cha cha cha14:10
anteayafood made by someone else tastes better14:11
anteayasomeone did a study14:11
*** krtaylor has joined #openstack-infra14:11
fungistudies done by someone else are more accurate14:11
anteaya:D14:12
nibalizerit'll be one more week before any mexican comes my way, its gonna be so good though14:13
*** gokrokve has quit IRC14:14
*** jgriffit1 is now known as jgriffith14:16
* jeblair waves14:16
fungiwelcome back, jeblair14:17
*** jgriffith is now known as Guest1011714:17
jeblairfungi: getting closer :)  i fly cdg-sfo tomorrow, so back for reals on wednesday14:17
fungijeblair: oh, fly safe!14:17
nibalizerjeblair: where is your home base?14:18
*** Guest10117 is now known as jdg14:18
jeblairnibalizer: berkeley, ca14:18
anteayajeblair: were you nice and touristy?14:18
anteayadid you see all the things?14:18
*** ayoung has quit IRC14:18
*** koolhead17 has quit IRC14:18
fungijeblair: i can chair the infra meeting tomorrow, lurk in tc/project meetings, whatever else as needed14:19
jeblairanteaya: yes, i've been having a great time, thanks!14:19
anteayawonderful14:19
*** koolhead17 has joined #openstack-infra14:19
jeblairfungi: thank you.  i think there's nothing substantial on the tc agenda (at least, not last i looked)14:19
fungiperfect14:19
*** ryanpetrello has quit IRC14:19
anteayaderekh: do you have time to discuss https://review.openstack.org/#/c/124335/14:20
*** cpowell has joined #openstack-infra14:20
jeblairoh, it has grown since then.. looking more :)14:20
*** zz_dimtruck is now known as dimtruck14:20
*** jdg is now known as jgriffith14:20
derekhanteaya: sure, I've been meaning to get back to it but got a little side tracked14:21
anteayaokay so that patch has a parent, which has two new patchsets since the -214:22
anteayayou have elected to retain the dependency14:22
*** ddieterly has joined #openstack-infra14:22
sdagueclarkb: how long does it take for review-dev to deploy?14:22
clarkbsdague should be one puppet run ~half hour worst case14:23
*** ddieterly has quit IRC14:23
sdagueok, coolio14:23
*** ZZelle has joined #openstack-infra14:23
*** vigneshvar has joined #openstack-infra14:23
fungiclarkb: it doesn't restart gerrit though14:23
nibalizersdague: you can also track it in puppetboard.o.o14:23
fungisdague: i can knock out the gerrit restart on it in a sec14:23
clarkboh I thought it did when we change wars14:23
*** ddieterly has joined #openstack-infra14:23
clarkbfungi is that a bug or new? it definitely did in the past14:24
*** otherwiseguy has joined #openstack-infra14:24
fungihrm... maybe we added that, but i thought we left it waiting for manual intervention14:24
*** koolhead17 has quit IRC14:24
*** gokrokve has joined #openstack-infra14:24
fungii'll check in on it14:24
derekhanteaya: yes, the dependency is needed because it is what allows me to remove all of the duplicate code,14:24
*** ZZelle has quit IRC14:24
anteayaderekh: okay do you feel the parent is in the right shape to address jeblair's concerns so that he lifts the -2?14:25
*** ddieterly has quit IRC14:25
*** ZZelle has joined #openstack-infra14:25
*** ddieterly has joined #openstack-infra14:26
fungisdague: ahh, yep, clarkb is correct. gerrit service was restarted on review-dev a couple minutes ago14:26
*** ayoung has joined #openstack-infra14:26
derekhanteaya: I think so yes, at least last time I looked, they also depend on a patch in the tripleo-ci repo https://review.openstack.org/#/c/124334/14:26
*** mfink has quit IRC14:26
clarkbfungi changing the war is special and restarts. all other changes dont restart automagically14:26
*** ddieterly has quit IRC14:27
derekhanteaya: I'll take a look through them all and make sure everything is up to date today14:27
*** mfink has joined #openstack-infra14:27
anteayaderekh: all right, let's mark the series wip until the tripleo-ci patch gets in14:27
fungisdague: seems to be correct... Powered by Gerrit Code Review (2.8.4-17-g13ac409)14:27
sdagueoh, hey, look at that - https://review-dev.openstack.org/#/c/5295/14:27
*** ddieterly has joined #openstack-infra14:27
derekhanteaya: ok, will do14:27
sdagueactually classes (if you are on new screen)14:27
anteayaderekh: since nothing should be marked +A until that happens14:27
ZZellefungi, hi14:27
anteayaderekh: thanks14:28
fungiZZelle: i saw you were poking at figuring out what was causing the git-review test failures over the weekend. did it end up being the global config?14:28
ZZellefungi, i finally found the trouble with git-review CI ...14:29
*** gokrokve has quit IRC14:29
derekhanteaya: no problem,14:29
derekhanteaya: al 3 set to WIP14:29
sdaguenibalizer: https://review.openstack.org/#/c/126448/ is in merge conflict14:29
*** hashar has joined #openstack-infra14:29
ZZellefungi, i don't know why but on test nodes gitreview.rebase == false  in git global config file (~/.gitconfig)14:29
ZZellefungi, and git-review tests are not correctly isolated14:30
*** ZZelle has quit IRC14:30
nibalizersdague: hrm okay will rebase14:30
nibalizersdague: others https://review.openstack.org/#/c/134371/ if we could land that i would be so happy14:31
*** ZZelle has joined #openstack-infra14:31
*** ZZelle has quit IRC14:31
anteayaderekh: thank you14:31
*** Guest18472 has joined #openstack-infra14:31
Guest18472fungi, this change https://review.openstack.org/134807 solves the trouble14:32
*** belmoreira has quit IRC14:32
*** BharatK has left #openstack-infra14:32
*** Guest18472 is now known as ZZelle-backup14:32
*** hdd has quit IRC14:33
*** bcourt has quit IRC14:33
*** ZZelle-backup has quit IRC14:33
*** bcourt has joined #openstack-infra14:34
*** ZZelle-backup has joined #openstack-infra14:34
*** mriedem has joined #openstack-infra14:34
fungiZZelle: it's possible we have something setting that in our puppet manifest. i didn't think to check for that. anyway i'm reviewing your fix now--thanks again!14:34
*** ZZelle-backup has quit IRC14:34
*** ZZelle-backup has joined #openstack-infra14:34
*** dprince has quit IRC14:35
ZZelle-backupfungi, this change https://review.openstack.org/134807 solves the trouble14:36
jeblairanteaya, derekh: do i need to review something now?14:36
*** ryanpetrello has joined #openstack-infra14:36
fungiZZelle: it's possible we have something setting that in our puppet manifest. i didn't think to check for that. anyway i'm reviewing your fix now--thanks again!14:36
anteayajeblair: nope, we are waiting on a tripleo-ci patch to merge first14:36
anteayajeblair: then derekh will come knocking on your door14:36
derekhjeblair: its been sitting there a while waiting on a tripleo patch, I'll make sure everything is uptodate and then come back to you, thanks14:37
*** ZZelle-backup is now known as ZZelle_14:37
jeblairk, np14:37
*** unicell has joined #openstack-infra14:37
*** ZZelle_ has quit IRC14:38
*** ZZelle_ has joined #openstack-infra14:39
*** ZZelle_ has quit IRC14:39
*** ZZelle_ has joined #openstack-infra14:39
*** ZZelle_ has quit IRC14:40
openstackgerrityolanda.robla proposed openstack-infra/storyboard-webclient: Dynamically refresh events on task changes  https://review.openstack.org/12654214:40
*** ZZelle_ has joined #openstack-infra14:40
openstackgerritSpencer Krum proposed openstack-infra/project-config: Split out github as it's own module  https://review.openstack.org/12644814:40
*** ZZelle_ has quit IRC14:40
nibalizersdague: fixed :)14:40
mtreinishfungi, clarkb, jeblair: when is a good time to add a worker for subunit2sql so we can start to populate the db?14:41
*** ZZelle_ has joined #openstack-infra14:41
openstackgerritMerged openstack-infra/project-config: Remove obsolete rtfd-id entry  https://review.openstack.org/13156914:41
fungimtreinish: are we at the point where we just need to build a server to run it?14:42
*** lttrl has left #openstack-infra14:42
jeblairsdague, fungi, ttx: regarding "Discussion with Foundation staff on how to relax trademark name checks in the big tent" on the tc agenda14:42
*** ZZelle_ has quit IRC14:42
*** cdent has joined #openstack-infra14:42
jeblairsdague, fungi, ttx: i can't find supporting evidence atm, but could ask around if needed -- at netflix their policy for naming new open source projects is to "google the name and see if it looks like it would be a problem".  that seems to work out fairly well for them, and would probably work for us too in some circumstances.14:42
*** ZZelle_ has joined #openstack-infra14:42
sdaguejeblair: that sounds like a viable step 014:42
*** stevemar has joined #openstack-infra14:42
mtreinishfungi: yep, it should just need a server created, and a a couple of lines in site.pp14:42
fungijeblair: sounds reasonable14:43
sdagueit's not like current naming policy kept us from having to rename :)14:43
fungimtreinish: want to draft up the change to site.pp? i can launch the server once that's in14:43
*** ZZelle_ has quit IRC14:43
*** dimtruck is now known as zz_dimtruck14:43
ttxjeblair: I also think it's realtively fine for a project in "the OpenStack community" to do basic checks14:43
mtreinishfungi: sure, what should I use for the hostname?14:43
jeblairsdague: right? :)14:43
ttxnot the same as a project under trademark programs14:43
clarkbjeblair yet they still used "zuul" :)14:43
ttxor one that wants to call itself OpenStack FooBar14:44
fungimtreinish: do we expect to have a farm of multiple workers for this, or just one?14:44
*** ZZelle_ has joined #openstack-infra14:44
*** ZZelle_ has quit IRC14:44
jeblairclarkb: i guess they didn't think it'd be a problem :)14:44
clarkbbut ya a simple google check would do wonders imo14:44
*** rushiagr_away is now known as rushiagr14:44
ttx("FooBar, a project from the OpenStack community" sounds like it would less be a threat to the OpenStack Foundation)14:45
mtreinishwell, to start I was thinking 1, but I think the intent was to have a farm of them eventually14:45
fungimtreinish: subunit2sql01.openstack.org then?14:45
ttxjeblair: renamed openstack/openstack-meetings to openstack-infra/irc-meetings btw14:45
jeblairanyway, wanted to throw that out there in case the tc meeting gets to the bottom of the agenda :)14:45
fungimtreinish: or just subunit01.o.o?14:45
jeblairttx: sounds good, thanks14:45
ttxjeblair: https://review.openstack.org/13448914:45
clarkbfungi -workerXX suffix would be like existing worker names14:46
mtreinishfungi: hmm, either or works, we could also do subunit2sql-worker01.o.o14:46
fungimtreinish: i like clarkb's suggestion14:46
*** bknudson has joined #openstack-infra14:46
fungiyep, let's go with that14:46
ttxfungi, jeblair, clarkb: would appreciate a review of https://review.openstack.org/#/c/134163/ today so I can use the Kilo-powered release status page in 1:1 syncs tomorrow14:46
jeblairttx: will review both asap14:47
*** chandankumar has quit IRC14:47
ttxjeblair: the only question left for openstack-infra/irc-meetings is if it makes sense to be included in openstack-ci projectgroup. I actually don't expect bugs to be filed against it or anything14:48
clarkbttx +214:48
fungiand +314:48
jeblairfungi, clarkb: subunit2sql is ok with me, but would subunit-worker01 be sufficient while being easier to say/type? :)14:48
fungialso wfm14:49
clarkbjeblair that wfm14:49
openstackgerritMatthew Treinish proposed openstack-infra/system-config: Add subunit2sql workers  https://review.openstack.org/13495814:49
ttxjeblair: I take it your train successfully arrived at its destination14:49
mtreinishfungi, jeblair, clarkb: ^^ I can switch it to subunit easily14:49
*** katyafervent_awa is now known as katyafervent14:50
jeblairttx: it did, without incident, and i'm watching planes take off from cdg now.  heading back into paris for real food tonight, then flying tomorrow morning14:50
fungiclarkb: also now that you're around, 131305 could use prioritizing so we don't diverge in the new repo again. i'm happy to approve and baby-sit if you +214:51
jeblairfungi: i saw "new project creation race" earlier; should i avoid approving a project import change?14:52
clarkbfungi I was semi -1 on that wanting to get through the lower hanging modules first14:52
openstackgerritMatthew Treinish proposed openstack-infra/system-config: Add subunit2sql workers  https://review.openstack.org/13495814:52
*** xyang0 has joined #openstack-infra14:52
mtreinishfungi: ^^^ ok updated to subunit01.o.o14:53
*** weshay has joined #openstack-infra14:53
fungiclarkb: unfortunately the import for it got approved so we have a project for it now and will need to keep applying changes to it and system-config in parallel if we want to wait14:53
clarkbjeblair I dont think so. it was gerrit not replicating to git farm which is minimally problematic (affectsimage builds)14:53
clarkbfungi oh we did that again...14:54
clarkbI can review then and wont -1 for philosophical reasons :)14:54
fungiclarkb: yeah, we had to push --force into it to catch it up to the state of system-config since it had already diverged between when the initial repo was split out and when the import change got approved14:54
ttxjeblair: backup plan: "Les Etoiles" at the Sheraton is supposedly decent14:55
openstackgerritMerged openstack-infra/system-config: Switch release status tracking to Kilo  https://review.openstack.org/13416314:57
* anteaya disappears to have a welcome back cup of tea with my sister14:57
*** ZZelle_ has joined #openstack-infra14:58
*** sandywalsh has quit IRC14:58
jeblairttx: import change +3; and thanks (also, that's suprising)14:58
*** gokrokve has joined #openstack-infra14:58
*** Longgeek_ has quit IRC14:59
*** sandywalsh has joined #openstack-infra15:00
*** otherwiseguy has quit IRC15:00
*** koolhead17 has joined #openstack-infra15:00
nibalizerclarkb: so I'm pretty sure the forge doesn't have the idea of acls15:01
nibalizerif you have the password for that user then you can upload to that namespace and thats about it15:01
clarkbwow :/15:01
*** nelsnelson has quit IRC15:01
*** nelsnelson has joined #openstack-infra15:02
openstackgerritMerged openstack-infra/project-config: Add a project for OpenStack meetings descriptions  https://review.openstack.org/13448915:02
nibalizerbut litreally the only authenticated operations are 'upload' and 'delete' so I think these things end up being equivalent15:02
clarkbnibalizer so I feel pretty strongly about not impersonating other people15:03
nibalizeryou dont feel that you represent stackforge?15:03
clarkbdoes someone already have a "stackforge" user?15:04
crinkleyes15:04
clarkbthen no I dont represent them on the puppet forge15:04
nibalizercrinkle: isn't the stackforge name on the forge just being held by plabs until juno release when the modules go to stackforge?15:05
jeblairttx: ^ https://review.openstack.org/134489 merged; should show up after some puppet magic in a bit; probably by 15:20utc15:05
*** radez_g0n3 is now known as radez15:05
crinklenibalizer: it's held by me and will still be held by me until the modules go to stackforge15:06
crinklei mean when the modules go15:06
*** belmoreira has joined #openstack-infra15:06
*** julim has joined #openstack-infra15:08
*** marun has joined #openstack-infra15:09
nibalizerokay im sensing some resistance from both of you, so it sounds like the automation gains are not worth the pains of credential transfer and escrow, so ill just back off15:09
crinklei'm not opposed to the idea15:09
*** zz_dimtruck is now known as dimtruck15:09
Shrewsfungi: hi!15:09
fungihi Shrews15:10
clarkbnibalizer idealy we would start with automation rather than juggle an account transfer15:10
Shrewsfungi: Can you recall if there are any Ubuntu distributions that ship a broken (for us) tox still? Or is that no longer a worry?15:10
nibalizerclarkb: can you clarify that? I dont understand15:10
fungimtreinish: can i assume subunit2sql_db_uri isn't in hiera yet? i'll add it in a bit if not15:10
clarkbbut if the intent is to fully hand over a thibg at some point (rather than sharing) that may work too15:10
*** enikanorov_ has joined #openstack-infra15:10
fungiShrews: oh, jeez, no idea. the first thing we do is pull in tox from pypi15:11
clarkbnibalizer infra creates user(s) and only ever uses those15:11
fungiShrews: even on my personal systems, i install latest tox in a virtualenv15:11
Shrewsfungi: gotcha. thx15:11
clarkbshrews fungi you want tox < 1.7 > 1.7.115:11
mtreinishfungi: it should be we used to run the migrations on the db15:12
Shrewsclarkb: thx15:12
mtreinishfungi: I just copied that section from logstash.o.o where the migrations are run from15:12
*** tonytan4ever has joined #openstack-infra15:13
nibalizerclarkb: crinkle so in my ideal world we could make signed tags of puppet modules (both infra and stackforge) and when they were pushed, a forge release would appear, in much the same way pip things work now15:14
fungimtreinish: oh, cool15:14
nibalizerfor that to happen infra needs to know the stackforge user on puppet forge's password (at least as far as I understand things)15:15
*** cnesa2 has joined #openstack-infra15:15
clarkbnibalizer yup and I think that is ok as long as no one lese knows thw password15:15
clarkbit shouldnt be a shared account15:15
fungiclarkb: Shrews: except that too-old tox gets you pip which pulls in alpha packages when available15:15
ttxjeblair: thx!15:15
clarkbyou dont give infra passwords you would give it the account15:16
Shrewsfungi: eewww15:16
*** cnesa has quit IRC15:16
clarkboh right so >1.6<1.7>1.7.1 should work15:16
nibalizercrinkle: does that line up with your goals?15:17
*** ChuckC has quit IRC15:18
mmedvedeso this got merged: https://review.openstack.org/#/c/134489/ . Does it mean we should be able to do 'git clone git://git.openstack.org/openstack-infra/irc-meetings.git' ? Or existence of the new irc-meetings is not a prerequisite?15:19
mmedvedenevermind, I guess it just got created15:20
*** amitgandhinz has joined #openstack-infra15:20
fungimmedvede: it takes a few minutes to get imported and replicated to our git server farm15:20
mmedvedefungi: yup15:20
*** nikhil_k|afk is now known as nikhil_k15:20
*** zz_gondoi is now known as gondoi15:22
*** bo_sh has joined #openstack-infra15:22
*** banix has joined #openstack-infra15:23
*** jlibosva has joined #openstack-infra15:24
*** weshay has quit IRC15:24
*** sabeen1 has joined #openstack-infra15:24
openstackgerritSpencer Krum proposed openstack-infra/project-config: Split out github as it's own module  https://review.openstack.org/12644815:25
*** jlibosva has quit IRC15:26
*** bhuvan has joined #openstack-infra15:26
*** superdan is now known as dansmith15:28
*** rodvm has joined #openstack-infra15:29
*** atiwari has joined #openstack-infra15:30
*** harlowja_at_home has joined #openstack-infra15:31
crinklenibalizer: that could work15:32
*** AlexF_ has quit IRC15:32
*** cnesa2 has quit IRC15:32
crinklebut it makes me nervous to give up manual control of that account15:32
crinklethe forge is finicky15:32
*** eharney has joined #openstack-infra15:33
*** pcrews has joined #openstack-infra15:33
nibalizerhrm well then howabout we beta test it on openstack-infra puppet modules over the next $CHUNK_OF_TIME and see how it goes15:35
crinklesgtm15:35
crinklealso having metadata lint checks gate it would be good ;)15:35
nibalizerpuppet-blacksmith doesn't have the ability to handle multiple cred stores yet anyways and the infra modules have a greater cadence of releasing im thinking15:35
crinkleyeah we hardly ever release and most people don't use the releases15:36
crinklethe second might be caused by the first15:36
crinklebut still, means it's not a super high priority atm15:36
*** markmcclain has quit IRC15:40
*** markmcclain has joined #openstack-infra15:40
*** tlbr has quit IRC15:41
*** tlbr has joined #openstack-infra15:41
*** jamespage_ has quit IRC15:42
*** wenlock has joined #openstack-infra15:42
*** jamespage_ has joined #openstack-infra15:42
*** erikmwilson has quit IRC15:43
*** erikmwilson has joined #openstack-infra15:44
*** otherwiseguy has joined #openstack-infra15:44
clarkbfungi: ok I am going to review 131305 now and will likely let you babysit if it looks good15:45
clarkbfungi: I need to refill food stores and do laundry and other post travel things today so will be in and out15:45
*** radez is now known as radez_g0n315:45
fungiclarkb: coolies. also ZZelle's patch to fix git-review tests would help us move forward with stuck changes on that front15:46
clarkbkk15:46
openstackgerritLucas Dutra Nunes proposed openstack-infra/jenkins-job-builder: builders: add Hudson cmakebuilder plugin support  https://review.openstack.org/13419915:46
clarkbit is very weird to be typing on a proper keyboard (model M) again15:47
fungiclarkb: if you're cool with merging the git-review test fix, i'll go recheck the previously failing changes once it merges15:47
*** gyee has joined #openstack-infra15:47
clarkbfungi: 131305 lgtm. I am going to double check that the new jenkins git repo runs the integration tests too (so that we can't break system-config from the other side)15:48
*** achanda has joined #openstack-infra15:49
fungiclarkb: i think it does, but good to make sure yes15:49
*** zul has quit IRC15:49
clarkbya it has the infra puppet apply job template applied to it in layout.yaml so I think 131305 is ready to go15:49
*** ashaeron has quit IRC15:50
*** belmoreira has quit IRC15:50
*** zul has joined #openstack-infra15:50
*** dangers_` is now known as dangers15:51
*** ChuckC has joined #openstack-infra15:52
fungipretty sure i pointed that out as missing on a previous patchset which prompted its addition15:53
openstackgerritJakub Libosvar proposed openstack-infra/project-config: Promote check-grenade-dsvm-neutron to voting job  https://review.openstack.org/13453215:54
*** hdd has joined #openstack-infra15:54
*** rwsu has joined #openstack-infra15:56
*** beekneemech is now known as bnemec15:56
openstackgerritSpencer Krum proposed openstack-infra/project-config: Split out github as it's own module  https://review.openstack.org/12644815:57
*** tlbr has quit IRC15:58
clarkbsdague: I swear you guys covered a better way of doing the mocking in https://review.openstack.org/#/c/134807/9/git_review/tests/test_unit.py during that friday video thing15:58
clarkbsdague: jaypipes ^ any chance you have an opinion on that ?15:58
*** tlbr has joined #openstack-infra15:58
*** zz_jgrimm is now known as jgrimm15:59
*** baoli has quit IRC15:59
jaypipesclarkb: we generally recommend doing @mock.patch.object(cmd, 'LOCAL_MODE') as a decorator on the test method15:59
sdagueclarkb: there is a decorator15:59
jaypipesclarkb: and have local_mock be an arg to the test method15:59
sdagueright, like jaypipes said16:00
*** katyafervent is now known as katyafervent_awa16:00
krotscheckStoryBoard meeting in #openstack-meeting-316:00
jaypipesclarkb: you can stack the decorators too, so you would patch os.exists in the same way;16:00
jaypipesclarkb: which means the test method contents can stick to a single indent level and be a little more readable16:00
fungii sort of glossed over the setup method there, other than confirming it still seemed to run tests and perform the expected interactions, but yes a closer look from people who write lots of tests would be awesome16:00
*** baoli_ has joined #openstack-infra16:01
clarkbjaypipes: ya the nesting is what I remembered being cleaner somehow.16:01
*** gokrokve_ has joined #openstack-infra16:01
*** thedodd has joined #openstack-infra16:01
*** mestery is now known as mestery_afk16:01
clarkband it looks like that decorator is used elsewhere so it may be worth updating the patch for consistency16:01
*** dizquierdo has quit IRC16:02
clarkbI am also not sure if those existing mock.patch calls need to use the new shorter path?16:02
*** tlbr has quit IRC16:02
clarkb(I hate mock)16:02
krotscheckDid meetbot just die?16:02
*** marun has quit IRC16:02
jaypipesclarkb: whatcha mean by "shorter path"?16:03
*** tlbr has joined #openstack-infra16:03
clarkbjaypipes: the import when from import git_review to from git_review import cmd16:03
clarkbjaypipes: but there are calls to mock.patch that use "git_review.cmd.thing"16:03
fungikrotscheck: openstack (meetbot) still seems to be in here...16:03
*** radez_g0n3 is now known as radez16:04
jaypipesclarkb: ah. either is fine. it's whatever you prefer really (I personally prefer mock.patch('git_review.cmd...') over mock.pathc.object, but it's a personal thing.16:04
krotscheckfungi: Yeah, but it never completely initialized our meeting.16:04
*** gokrokve has quit IRC16:04
*** yfried_ has quit IRC16:04
fungikrotscheck: yep, it seems to have at some point reconnected when chanserv wasn't around to op it16:05
*** dkranz has quit IRC16:05
*** erikmwilson_ has joined #openstack-infra16:08
clarkbZZelle_: ^ any chance you are still around?16:08
ZZelle_clarkb, hi :)16:08
*** jamespage_ has quit IRC16:08
*** erikmwilson has quit IRC16:08
clarkbZZelle_: I think we can make the tests a bit more readable using the @mock.patch() decorator16:08
fungikrotscheck: i've convinced chanserv to re-op openstack on all the meeting channels now16:09
clarkbZZelle_: it is already in use in the existing tests of that file. Then test_gitreview_local_mode() becomes a lot smaller16:09
*** achanda has quit IRC16:09
clarkbZZelle_: did you have a preference for the context manager approach?16:09
ZZelle_clarkb, not really, neutron uses mock contexts :)16:10
ZZelle_clarkb, i can replace one by the other16:11
clarkbZZelle_: let me drop that into a review I definitely prefer the decorator as it makes the code a lot more concise and easier to see what we are testing16:11
*** david-lyle_afk is now known as david-lyle16:11
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add missing docimpact for fuel repos  https://review.openstack.org/13498616:11
ZZelle_clarkb, oki16:11
mmedvedefungi: it seems the new repo git://git.openstack.org/openstack-infra/irc-meetings.git is still empty, even though the source it points to is has content (git://github.com/ttx/openstack-meetings.git). Is it expected?16:12
clarkbZZelle_: fungi ok commented16:13
ZZelle_clarkb, i change from import git_review to from git_review import cmd ... because git_review.cmd in L59 should not work16:13
clarkbZZelle_: ya I think that change is fine16:13
*** reed has quit IRC16:13
*** reed has joined #openstack-infra16:13
fungimmedvede: yeah, i started to look at it. either we have a bug in import creation automation or something wasn't quite right about the change to bring it in. i'll look closer once i'm freed up a little16:15
*** tlbr has quit IRC16:16
*** katyafervent_awa is now known as katyafervent16:16
mmedvedefungi: thanks :). I was trying to rebuild my nodepool image and am blocked on that repo to become functional. Would try to work around it for now16:16
*** dizquierdo has joined #openstack-infra16:16
*** ildikov has quit IRC16:17
openstackgerritDouglas Mendizábal proposed openstack-infra/project-config: Add barbican-cover to check pipeline  https://review.openstack.org/13358216:18
*** bo_sh has left #openstack-infra16:18
clarkbsdague: fungi jeblair I think https://review.openstack.org/#/c/106043/ is ready now. I have +2'd and will be updating my change that sits atop that to do nova multinode multi host in a bit16:18
*** katyafervent is now known as katyafervent_awa16:19
*** marun has joined #openstack-infra16:19
*** dkranz has joined #openstack-infra16:20
*** sdake has joined #openstack-infra16:20
*** sdake has quit IRC16:20
*** sdake has joined #openstack-infra16:20
*** mpaolino has quit IRC16:20
ttxKilo release status is now live @ http://status.openstack.org/release/ -- thx!16:20
jrollanybody with a free moment for an easy dsg patch? https://review.openstack.org/#/c/134438/ :)16:20
anteayattx yay16:21
fungijroll: oh, too bad, i already +2'd that one16:21
jrollfungi: :)16:21
*** leopoldj has quit IRC16:21
sdagueclarkb: ok, I'll give it a deep look later today16:21
*** dannywilson has joined #openstack-infra16:22
openstackgerritCedric Brandily proposed openstack-infra/git-review: Isolate tests from user/system config  https://review.openstack.org/13480716:22
openstackgerritMerged openstack-infra/project-config: Promote check-grenade-dsvm-neutron to voting job  https://review.openstack.org/13453216:23
*** doug-fish has joined #openstack-infra16:23
*** berendt has quit IRC16:23
*** bhunter71 has joined #openstack-infra16:24
*** skolekonov has quit IRC16:24
krotscheckfungi: Thanks16:24
*** dannywil_ has joined #openstack-infra16:24
*** dannywilson has quit IRC16:25
*** fandi has joined #openstack-infra16:25
anteayafungi: my understanding of the current status of requests for stackforge ci acccounts is that mordred was going to reply to these requests16:25
anteayafungi: that doesn't seem to have happened that I can see and requests are piling up16:25
anteayafungi: has there been a different understanding evolve in my absence?16:26
*** cnesa has joined #openstack-infra16:28
fungianteaya: yeah, i do remember him agreeing to do that, but with no detail on what he was going to do16:28
openstackgerritValeriy Ponomaryov proposed openstack/requirements: Add manilaclient to requirements  https://review.openstack.org/13500716:28
anteayafungi: okay, glad we remember the same thing16:28
anteayafungi: would you be adverse to me adding an agenda item to tomorrow's meeting?16:29
anteayaor would you like to wait for jeblair?16:29
fungianteaya: i'd be happy to just add the accounts and get on with our lives16:30
*** armax has joined #openstack-infra16:31
anteaya:(16:31
fungianteaya: it's stackforge projects wanting to run some tests on their changes which they can't run in our infrastructure. we already have quite a few accounts for that in gerrit, setting a precedent16:31
*** rfolco has joined #openstack-infra16:32
fungianteaya: i feel like suddenly claiming that third-party testing is only allowed for official project changes cuts out a reasonable use case16:32
*** cnesa has quit IRC16:32
*** dizquierdo has quit IRC16:32
rodvmhi a have a question about how you manage your release and the tagging of your commints, i have read this documentations, https://wiki.openstack.org/wiki/Branch_Model, https://wiki.openstack.org/wiki/Release_Cycle, but i don't have very clear how do you do the tagging  or how do you do the tarball?16:32
openstackgerritCedric Brandily proposed openstack-infra/git-review: Isolate tests from user/system config  https://review.openstack.org/13480716:32
anteayafungi: I'm not saying that16:32
anteayafungi: I'm concerned about the naming16:33
anteayarodvm: can I ask why you ask?16:33
clarkbrodvm: we git tag locally then push that to gerrit. The arrival of new tag refs in gerrit triggers jobs that build tarballs for us16:33
fungianteaya: the bits of the discussion i remember were around requiring stackforge projects to fabricate irrelevant information so that it would fit with the naming scheme we require of accounts testing specific official projects16:33
anteayathanks16:33
*** mpaolino has joined #openstack-infra16:34
*** chandankumar has joined #openstack-infra16:34
anteayathat hurts me that you would characterize it that way16:34
fungianteaya: it seems silly to tell them that the account for their project's ci can't mention the name of their project16:34
anteayahere is my problem16:34
anteayawe decided on a naming format in germany16:35
anteayawe have not decided on a naming format for this group16:35
anteayadecison by attrition doesn't work well for third party16:35
*** mjturek has quit IRC16:35
*** cnesa has joined #openstack-infra16:35
anteayasince their ability to wear down anything exceeds our ability to protect it16:35
*** hashar has quit IRC16:35
*** gokrokve has joined #openstack-infra16:36
fungii felt like we decided on a format for names of accounts testing official projects, and included the "can't mention project name" restriction because we didn't want 50 accounts testing neutron to all have "neutron" redundantly appearing in their name. when it's _the_ third-party ci for a particular stackforge project, i'm unsure why that restriction is relevant16:36
*** rfolco has quit IRC16:36
anteayaI have been labouring under apparently the mis-guided opinion that I was protecting something16:36
anteayaif only the sanity of infra people16:36
anteayaif I am incorrect, please do expand16:36
rodvmclarkb: ok, you are using the tag gate of zuul, or te pre-release? or this one https://github.com/openstack-infra/release-tools?16:36
anteayafungi: that's fine16:37
anteayaand I would like to have that discussion when mordred and jeblair are around16:37
anteayaand share my thoughts as well16:37
*** shashankhegde has joined #openstack-infra16:37
anteayasince getting this group to change after the fact is very very difficult16:37
fungianteaya: in the case of projects which have multiple third-party ci systems (e.g. neutron, nova, cinder...) each system is testing specific things and we wanted their names to reflect what they were testing. for a project with only one third-party ci system which is seen by that project as the "official" third-party reporting on their changes, what's being tested is that project16:38
*** nadya_ has quit IRC16:38
anteayayes I see that16:38
anteayaI'm not saying I don't see the use case16:39
*** Guest76282 has quit IRC16:39
anteayaI'm saying that you and I deciding is a poor way to create a process16:39
anteayaand I would like a process to be discussed and agreed upon16:39
anteayaand right now we don't have one16:39
*** gokrokve_ has quit IRC16:39
*** r-daneel has joined #openstack-infra16:39
fungii'm just worried that we're getting into the habit of defining hard and fast rules and then following the rules for their own sake instead of keeping in mind why we made those rules and where it's relevant to apply or not apply them16:40
*** mjturek has joined #openstack-infra16:40
anteayano question there16:40
anteayaand if they dynamics of this group of people was different i would agree16:40
anteayabut it isn't16:40
anteayaI wish I had 300 clones of dprince16:40
anteayabut alas that is not the case16:40
*** matel has quit IRC16:41
anteayaand the key word here is relevant16:41
anteayaand I would also float the use of the word reasonable16:41
fungibut sure, i'm happy for that discussion to play out in a larger audience than the two of us and get some consensus around one solution or another16:42
anteayatwo words that heretofore have not be easily applied to third party16:42
anteayafungi: thanks16:42
anteayaso do you want to wait for jeblair then?16:42
fungiit sounds like you want to wait for jeblair and/or others to be present for the discussion, so that's fine with me16:43
*** erikmwilson_ has quit IRC16:44
*** AlexF_ has joined #openstack-infra16:44
fungimy key concern is that we're asking third-party ci operators who are stackforge project communities testing their own projects' changes in relative isolation to provide information which doesn't actually exist on the blind assumption that they're the same situation as the neutron/nova/cinder third-party ci ecosystems16:44
*** erikmwilson has joined #openstack-infra16:44
openstackgerritCedric Brandily proposed openstack-infra/git-review: Isolate tests from user/system config  https://review.openstack.org/13480716:44
*** dizquierdo has joined #openstack-infra16:45
anteayafungi: unless we come up with a different process16:45
anteayaand if we come up with a different process I would like it logged so we all follow the same process16:46
*** banix has quit IRC16:46
anteayaI'll add it to the agenda for next week then16:47
fungiyep. proposal: when a third-party ci is operated by and exclusively testing changes for a single project, it's allowable for their project name to appear as the subsystem being tested within the account display name16:48
anteayaI will capture that proposal in the agenda16:48
anteayathanks fungi16:48
fungiyw!16:48
jerryzfungi: does gerrit hook change the status of a launchpad bug if the patch is on non-master branch?16:50
jerryzfungi: i have a patch with Closes-bug but only comment is left when patch submitted or merged, no bug status change was made.16:51
*** annegent_ has joined #openstack-infra16:51
fungijerryz: it does _if_ there's a series created in lp matching that branch name and as long as someone has added a series task for that to the bug before hand16:52
fungijerryz: then the series task gets its own status and assignee16:53
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Enable nova multi host on aiopcpu tests  https://review.openstack.org/13160416:53
clarkbI think I did that properly. experimental tests will tell us I am correct16:53
*** dkranz has quit IRC16:54
*** chuckC_ has joined #openstack-infra16:55
clarkb*if I am correct16:56
*** koolhead17 has quit IRC16:56
*** rodvm has quit IRC16:56
jerryzfungi: sorry, but what is series task?16:57
*** erikmwilson has quit IRC16:57
*** jamespage_ has joined #openstack-infra16:58
fungijerryz: a bug task for a series, which can be added by a bug supervisor (usually prompted by a nominate-for-series option checked on the bug). and a series is something you create for the project in question16:58
*** sarob has joined #openstack-infra16:58
clarkbkrotscheck: fungi: now that I am caught up on multinode the next thing I wanted to check in on was storyboard. Any outstanding items with that I can help with?16:58
fungiclarkb: the women of openstack are chomping at the bit to start using https://review.openstack.org/134355 if you have a sec to review that and the parent change16:59
* clarkb looks16:59
*** erikmwilson_ has joined #openstack-infra17:00
*** harlowja_at_home has quit IRC17:00
clarkbfungi: +2 to both. there are only 2 cores that are not afk this week right? I should probably go ahead and approve those changes then?17:00
*** jamespage_ has quit IRC17:00
fungiyeah, or i can approve17:01
*** jamespage_ has joined #openstack-infra17:01
fungiself-approve i mean17:01
clarkbI will approve17:01
ZZelle_clarkb, fungi, git-review change updated17:01
fungiZZelle_: thanks!17:02
*** reed has quit IRC17:02
*** ZZelle_ is now known as ZZelle17:02
*** chandankumar has quit IRC17:03
*** rwsu has quit IRC17:03
*** erikmwilson_ has quit IRC17:04
*** erikmwilson has joined #openstack-infra17:04
*** chuckC_ has quit IRC17:04
clarkbZZelle: awesome thank you. +217:04
*** chuckC_ has joined #openstack-infra17:05
fungiclarkb: i agree, that is easier to follow17:05
zarosdague: hey. i'm gonna be out starting tomorrow until the after the thxgiving holiday so won't be able to raise the gerrit upgrade issue at the next 2 infra meetings.17:06
*** annegent_ has quit IRC17:06
*** dkranz has joined #openstack-infra17:06
clarkbzaro: what is the issue? just that we should plan to do it?17:06
*** erikmwilson has quit IRC17:06
fungizaro: i can bring it up, if there are specific gotchas we need to highlight/discuss17:06
zaroyep.  sdague wanted the conflict detection feature.17:06
*** erikmwilson has joined #openstack-infra17:07
krotscheckclarkb: The stories are migrated17:07
clarkbkrotscheck: fungi: iirc we need to "kill" the infra lp side bugtrackers and announce the move?17:07
zaroclarkb, fungi: this would be my concern: https://groups.google.com/d/msg/repo-discuss/4va1DH520to/p293AJYxIXUJ17:07
*** chuckC_ has quit IRC17:07
fungiclarkb: except openstack-ci because elastic-recheck is going to continue using that for now17:08
*** chuckC_ has joined #openstack-infra17:08
clarkbzaro: gotcha, that tricky stream events bug....17:08
clarkbfungi: krotscheck: should we go ahead and do that work today?17:08
clarkbI can probably stab at it once I have a burrito17:08
fungiclarkb: yeah, i agreed during the storyboard meeting to take care of the lp config adjustments17:09
fungialso ttx pointed out we haven't delegated ownership of the infra projects to openstack-admins17:09
fungi(in lp)17:10
krotscheckclarkb: You can look at these for us :) owner:"Michael Krotscheck" status:open branch:master topic:storyboard17:10
krotscheckArgh17:10
krotscheckSec17:10
clarkbkrotscheck: I can copy pasta that17:10
krotscheckhttps://review.openstack.org/#/q/owner:%22Michael+Krotscheck%22+status:open+branch:master+topic:storyboard,n,z17:10
clarkbeven better17:10
* clarkb pins a storyboard tab in prep17:11
*** chuckC_ has quit IRC17:12
*** chuckC_ has joined #openstack-infra17:12
*** tlbr has joined #openstack-infra17:12
clarkbkrotscheck: fungi: are there plans to clean up the old bugs for projects that do not have 6 or 7 digits in their numbers?17:12
clarkb(might reduce confusion when searching and paging)17:13
*** erikmwilson has quit IRC17:13
*** jp_at_hp has quit IRC17:14
fungiclarkb: hrm... maybe we should pick some range just under the high starting point we selected for autoincrementer and add that to the early story numbers? on the other hand we may already have refereneces to those early stories17:14
*** shashankhegde has quit IRC17:14
*** reed has joined #openstack-infra17:15
*** hdd has quit IRC17:16
*** rwsu has joined #openstack-infra17:16
*** amuller has quit IRC17:16
*** [BNC]erikmwilson has joined #openstack-infra17:16
openstackgerritMerged openstack-infra/git-review: Isolate tests from user/system config  https://review.openstack.org/13480717:17
clarkbfungi: ya I think they may be redundant17:17
*** otherwiseguy has quit IRC17:17
clarkbfungi: from some initial syncing? the exceptions would be proijects like gertty but we should be able to handle those on a case by case basis?17:17
clarkbs/case by case/project by project/17:17
fungiclarkb: no idea... have an example?17:18
*** otherwiseguy has joined #openstack-infra17:18
jerryzfungi: thanks. i just saw update_bug.py in jeepyb. the problem was the our non-master branch didn't start with proposed or stable17:18
*** koolhead17 has joined #openstack-infra17:18
*** [BNC]erikmwilson is now known as erikmwilson17:18
*** rwsu has quit IRC17:18
clarkbfungi: https://storyboard.openstack.org/#!/story/147 that one jumped out at me17:19
clarkbfungi: not sure yet if it came in via an import though17:19
openstackgerritMerged openstack-infra/system-config: Clean up openstack_project::lists class  https://review.openstack.org/13435417:19
fungiclarkb: i opened that one in sb because i was at that time under the (mistaken) impression we were opening new zuul issues as stories17:20
*** shashankhegde has joined #openstack-infra17:20
clarkbI see17:20
fungiso not from an import17:20
*** bdpayne has joined #openstack-infra17:20
clarkbthen maybe I shouldn't worry about stories like that17:21
*** rwsu has joined #openstack-infra17:21
fungii also just noticed i forgot to mark it as merged, but have now done so17:21
*** flashgordon is now known as jogo17:22
*** hdd has joined #openstack-infra17:22
*** atiwari has quit IRC17:23
*** atiwari has joined #openstack-infra17:23
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard: Split Token DB API into separate file  https://review.openstack.org/13440817:24
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard: User token API  https://review.openstack.org/13440917:24
openstackgerritMerged openstack-infra/jenkins-job-builder: Write cache to file on CacheStorage object delete  https://review.openstack.org/11783817:24
*** jpich has quit IRC17:24
*** shashankhegde has quit IRC17:26
*** jamespage_ has quit IRC17:27
*** tlbr has quit IRC17:29
*** achuprin_ has quit IRC17:30
*** lttrl has joined #openstack-infra17:31
*** atiwari has quit IRC17:31
*** derekh has quit IRC17:32
*** atiwari has joined #openstack-infra17:32
*** weshay has joined #openstack-infra17:34
*** hdd has quit IRC17:34
openstackgerritMerged openstack-infra/system-config: Add a Women of OpenStack mailing list  https://review.openstack.org/13435517:36
jogoclarkb: I have been playing around with getting aiopcpu passing tempest-full17:37
jogoand hit something: devstack is using 10.208.33.221 (eth1) for nova's host_ip but using devstack-gate is using eth1 23.253.73.134 (eth0) to set up ssh host keys17:38
jogosdague: ^17:38
*** HeOS has quit IRC17:38
*** chandankumar has joined #openstack-infra17:38
jogonot sure what the desired behavior is here, should devstack be using the other interface for host_ip?17:39
*** jcoufal has joined #openstack-infra17:39
*** SumitNaiksatam has joined #openstack-infra17:40
clarkbjogo: I think that afazekas may have removed the code to accept the keys in his latest patchset for some reason17:41
*** jamespage_ has joined #openstack-infra17:41
clarkbjogo: but you have added even better stuff to accept it17:41
*** rfolco has joined #openstack-infra17:41
*** harlowja_away is now known as harlowja17:41
*** kmartin has joined #openstack-infra17:42
*** whoops has joined #openstack-infra17:42
clarkbjogo: looks like my latest patchset failed for a similar reason17:42
clarkbhttps://jenkins02.openstack.org/job/check-tempest-dsvm-aiopcpu/21/console17:43
clarkbits timing out not hitting hostkey checks17:43
*** achuprin_ has joined #openstack-infra17:46
openstackgerritKhai Do proposed openstack-infra/jenkins-job-builder: include publisher.xunit test as doc  https://review.openstack.org/13503417:46
jogoclarkb: I added it in as a dependant patch17:47
*** MaxV has quit IRC17:47
jogonova needs ssh to work17:47
clarkbjogo: I know17:48
clarkband it does work17:48
clarkbotherwise the tempest tests that do run would not pass17:48
clarkbso something funny is happening17:48
clarkbjogo: nova ssh's to do resize node17:48
jogoclarkb: see https://review.openstack.org/#/c/134639/717:48
clarkbits mind boggling to me but that is what it does and resize does run in afazekas' change17:49
jogoclarkb: http://logs.openstack.org/39/134639/7/experimental/check-tempest-dsvm-aiopcpu/31adb1f/logs/23.253.74.25/screen-n-cpu.txt.gz?level=TRACE17:49
clarkbjogo: ya so you need to setup host keys with the private network addrs17:49
jogoclarkb: resize doesn't run on afazekes's change AFAIK17:49
clarkbwhich is your other change right?17:49
clarkbjogo: it does17:49
jogosince its only running smoke17:49
clarkbjogo: because it failed on me17:49
jogoclarkb: link17:49
jogoclarkb: hmm17:49
clarkbuntil I figured out that nova is weird17:49
clarkband that the logs are useless17:50
jogooh right17:50
jogoclarkb: so this is resize or other commands failing that are moving the VM between compute nodes17:50
clarkbyes17:50
clarkbjogo: so, back to my question. isn't this what your other change is fixing?17:51
clarkband if so why is this controversial? shouldnt we just accept the keys and move on?17:51
jogoclarkb: https://review.openstack.org/#/c/134670/6 adds keys17:51
jogobut that isn't enough17:51
jogohostkeys*17:51
clarkbwhy is it not enough?17:51
jogothe aio gets  the private interface for the subnodes17:52
jogoso that works17:52
jogobut the http://logs.openstack.org/39/134639/7/experimental/check-tempest-dsvm-aiopcpu/31adb1f/logs/screen-n-cpu.txt.gz?level=TRACE17:52
clarkboh your change is using the public IPs17:52
jogohas no stacktraces17:52
clarkbyou need the private IPs17:52
clarkbfor node in sub_nodes_private do17:53
clarkbinstead of sub_nodes17:53
jogoahh17:53
jogolet me try that17:53
clarkbjogo: also17:53
*** yamahata has quit IRC17:53
*** bdpayne has quit IRC17:53
clarkbjogo: you should probably make a known_hosts file on the primary node with all the usbnodes in it, then just copythat file to the subnodes17:53
clarkbjogo: rather than doing the remote command keyscans17:54
jogomy_ip = 23.253.74.2517:54
openstackgerritMerged openstack-infra/system-config: Split out jenkins module  https://review.openstack.org/13130517:54
jogomy_ip = 23.253.73.13417:54
jogoin nova.conf files17:54
clarkbjogo: I think that is correct17:54
jogokk17:54
clarkbI dunno. I honestly find this part of nova to be silyl and ridiculous17:54
jogoclarkb: new revision coming soon17:54
clarkband I made my comments to that effect a couple weeks ago17:54
jogoclarkb: well this is not ssh to localhost17:55
clarkbjogo: I know17:55
clarkbjogo: but the logging is still useless17:55
jogoso not sure what you find silly here17:55
jogooh the logging17:55
*** asselin has joined #openstack-infra17:55
clarkbwhich makes your debugging hard17:55
jogonot sure why you say that, the stacktrace was pretty clear17:55
jogobut yeah our logging is poor17:55
fungibtw, i'm keeping an eye on the jenkins module split-out now that it's merged17:55
clarkbjogo: the stacktrace is not clear on what nova is doing17:55
clarkbjogo: it is clear ssh failed17:55
clarkbjogo: whcih is mostly useless17:55
fungii'll fire up a test image here shortly17:55
clarkbssh for what to what etc17:56
clarkbthat is what is valuable in a log17:56
jogoclarkb: unless you know hat nova is doing  already :)17:56
jogobut true17:56
jogoclarkb: patches welcome :)17:56
*** AlexF_ has quit IRC17:56
jogoclarkb: can you -1 https://review.openstack.org/#/c/134670/6 with your comments17:56
clarkbjogo: but it is also possible that devstack's my_ip determination is faulty for one of our clouds (rackspace, my_ip on hpcloud should always be the internal address)17:57
clarkbjogo: if that is the case we can set it in d-g using the data provided by nodepool17:57
clarkbI sitll don't know why my change failed17:58
*** markvan has quit IRC17:59
jogoclarkb: I have seen similar failures17:59
*** markvan has joined #openstack-infra17:59
jogoclarkb: where it looks like the second node isn't responding18:00
*** ivar-lazzaro has joined #openstack-infra18:00
*** yamahata has joined #openstack-infra18:00
clarkbjogo: https://review.openstack.org/#/c/106043/22..23/devstack-vm-gate.sh it may be related to the code removal on line 466 of the left side of that diff18:00
clarkbthat was allowing all traffic between nodes18:01
clarkbthough we should already allow ssh everywhere18:01
jogohttp://logs.openstack.org/39/134639/1/experimental/check-tempest-dsvm-aiopcpu/58d4f4a/console.html.gz18:01
*** hdd has joined #openstack-infra18:01
clarkbhuh18:02
*** sarob has quit IRC18:02
*** jamespage_ has quit IRC18:02
clarkbcould also be that nodepool is cleaning up subnodes but not removing the primary node? definitely a fwe things that could be going wrong there18:03
*** arborism has joined #openstack-infra18:03
*** arborism is now known as amcrn18:03
jogoclarkb: yeah there could be a few things wrong here18:03
*** tonytan4ever has quit IRC18:04
*** annegent_ has joined #openstack-infra18:06
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard: User token API  https://review.openstack.org/13440918:08
*** AlexF has joined #openstack-infra18:09
*** AlexF has quit IRC18:13
*** otter768 has joined #openstack-infra18:13
openstackgerritValeriy Ponomaryov proposed openstack/requirements: Add manilaclient to requirements  https://review.openstack.org/13500718:14
*** denis_makogon has quit IRC18:14
*** amitgandhinz has quit IRC18:15
openstackgerritAdam Gandelman proposed openstack-infra/project-config: Update ironic pxe job names to reflect voting status  https://review.openstack.org/13462018:15
*** mrmartin has quit IRC18:16
*** thedodd has quit IRC18:16
*** denis_makogon has joined #openstack-infra18:17
*** slogan has joined #openstack-infra18:17
*** mpaolino has quit IRC18:18
*** bdpayne has joined #openstack-infra18:18
*** yfried_ has joined #openstack-infra18:19
*** mrmartin has joined #openstack-infra18:22
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: Setup ssh_known_host files for aiopcpu  https://review.openstack.org/13467018:22
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full  https://review.openstack.org/13463918:22
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: Turn off nova_allow_move_to_same_host if in aiopcpu  https://review.openstack.org/13504418:22
jogoclarkb: ^ lets see if that works18:22
*** med_` is now known as medberry18:23
*** medberry is now known as Guest5059918:24
*** Guest50599 is now known as med_18:25
*** med_ has joined #openstack-infra18:25
*** achanda has joined #openstack-infra18:25
*** chandankumar has quit IRC18:25
*** obowersa has joined #openstack-infra18:26
*** dizquierdo has quit IRC18:26
*** sabeen1 has quit IRC18:26
*** patrickeast has joined #openstack-infra18:28
*** Ryan_Lane has joined #openstack-infra18:30
*** achanda has quit IRC18:30
fungiclarkb: if you're cool with https://review.openstack.org/134958 i can go ahead and launch the worker instance18:30
*** ildikov has joined #openstack-infra18:30
*** MaxV has joined #openstack-infra18:30
clarkbfungi: approved18:31
clarkbjogo: I restarted experimental tests for afazekas' change too18:31
*** e0ne has quit IRC18:33
*** achanda has joined #openstack-infra18:35
fungik18:35
annegent_anyone here remember if there's a gerrit review for an idea for four different release patterns? Or was it an etherpad? sdague or dhellmann or anyone, did I imagine this thing existing?18:36
annegent_Ah, found  it. https://review.openstack.org/#/c/131227/2/reference/project-release-schedules.rst18:36
annegent_see as soon as I ask the question...18:37
*** banix has joined #openstack-infra18:37
openstackgerritMerged openstack-infra/system-config: Add subunit2sql workers  https://review.openstack.org/13495818:37
*** johnthetubaguy is now known as zz_johnthetubagu18:38
*** AlexF has joined #openstack-infra18:39
*** gokrokve_ has joined #openstack-infra18:39
*** rushiagr is now known as rushiagr_away18:40
fungimtreinish: in a few minutes i'll give that ^ a spin18:40
*** nadya_ has joined #openstack-infra18:40
*** yamahata has quit IRC18:41
mtreinishfungi: ok cool, I should be around if there are issues18:41
* mtreinish would be surprised if it just worked18:41
fungihopefully you'll be surprised. i've got a lot going on today ;)18:41
*** gokrokve has quit IRC18:42
obowersaHey all. Hopefully a quick question ( I reckon I know the answer ). Is there any documentation around the zuul triggering system ? I've got some work to do on another project in regards to integrating it with a couple of other sources. The codes good and I can probably kludge my way about. Just seeing if there's any gotchas I've missed.18:43
*** gokrokve_ has quit IRC18:43
*** AlexF has quit IRC18:44
anteayaobowersa: have you seen this page yet: http://ci.openstack.org/zuul.html18:45
*** gyee has quit IRC18:45
fungiobowersa: and also http://ci.openstack.org/zuul/18:45
*** gyee has joined #openstack-infra18:45
fungiwhich is the actual zuul documentation (also included in rst format in its source code, under the doc dubtree)18:46
fungis/dubtree/subtree/18:46
*** shashankhegde has joined #openstack-infra18:48
*** zul has quit IRC18:48
*** mestery_afk is now known as mestery18:48
obowersaThanks for the link. I'd had a read through previously. I think the main stumbling block is the correlation between zuul-merger and (as an example) the gerrit-triggers. From what I can tell, at least for the initial demo environment I'm building I can pretty much just ignore the merger component.18:49
*** yjiang5_away is now known as yjiang518:50
sdaguejogo: is host ip being specified (I don't remember)18:50
clarkbobowersa: the merger component is required. It is the thing that "compiles" the refs that are tested18:50
clarkbsdague: iirc it is. but my_ip isn't18:50
sdagueI thought I was sorting by interface name for consistency18:51
clarkbhrm afazekas' change fails check experimental now too18:51
clarkbso something must've changed18:51
*** tonytan4ever has joined #openstack-infra18:52
*** mattfarina has joined #openstack-infra18:53
jogosdague: yeah I think its some sort of devtack foo that picks it18:53
obowersaclarkb: Thanks for the info. Looks like there's a gap in my understanding of how it all fits together. I'll reread and see where I'm at afterwards.18:53
*** jedimike has quit IRC18:54
jogosdague clarkb: it looks like my_ip is the public address18:54
*** AlexF has joined #openstack-infra18:54
*** talluri has joined #openstack-infra18:54
*** weshay has quit IRC18:55
*** links has quit IRC18:55
*** thedodd has joined #openstack-infra18:55
*** annegent_ has quit IRC18:55
jogoclarkb: http://logs.openstack.org/43/106043/23/experimental/check-tempest-dsvm-aiopcpu/2c0d809/logs/testr_results.html.gz is the failure your seeing right?18:56
*** dtantsur|afk is now known as dtantsur18:57
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Loosen name restrictions for dedicated 3rd-parties  https://review.openstack.org/13505018:58
fungianteaya: ^ i'll start an infra ml thread around that18:58
anteayafungi: okay18:58
anteayabefore you do perhaps I should share my thoughts18:58
anteayasince I hadn't before18:58
anteayaI see a real abuse of our system by marketing motivations18:59
fungianteaya: sure thing18:59
anteayaI see that certain accounts with certain names are desirable by some to drive their marketing plans18:59
anteayaI see that as a mis-use of our energy18:59
fungianteaya: probably not going to be the case when it's the only third-party ci system reporting on a given project?19:00
anteayaand an end run around quality19:00
*** amitgandhinz has joined #openstack-infra19:00
anteayaI have seen marketing mis-use things I didn't think possible19:00
anteayaI am continually shocked and surprised by what some in this group will do to further their goals19:00
anteayawith complete disregard to the consequences of others19:00
*** annegent_ has joined #openstack-infra19:01
anteayaincluding the others in the same space who wish to use the system as it was intended19:01
anteayathese are my concerns19:01
anteayaI don't have a clear path to addressing them19:01
mtreinishjogo: is that the same heat failure sdague was mentioning this morning?19:01
fungianteaya: understandable. how do those concerns apply to my proposal?19:01
anteayasince the creative ability to mis-use surpasses my imagingation19:01
anteayaI don't yet know19:01
anteayasince I haven't read it19:02
jogomtreinish: don't know19:02
anteayabut I did what to share my thoughts before you launched a ml thread19:02
sdaguejogo: take a look at ER19:02
clarkbjogo will look after my burrito19:02
sdague#2 & #3 are heat fails19:02
openstackgerritSpencer Krum proposed openstack-infra/project-config: Split out github as it's own module  https://review.openstack.org/12644819:02
*** luqas has quit IRC19:03
fungianteaya: sure, my intention is entirely around clarifying the "this is my communities stackforge project, we run an external ci to test things which can't be tested in openstack'd ci, what do we name our account?" situation19:03
anteayafungi: right19:03
anteayaand you changes are clear19:03
*** nadya_ has quit IRC19:03
anteayaand how this will manage to be co-opted is yet to be seen19:03
*** HeOS has joined #openstack-infra19:03
anteayabut experience tells me someone will try19:03
openstackgerritSpencer Krum proposed openstack-infra/project-config: Split out github as it's own module  https://review.openstack.org/12644819:03
fungii think the projects in that specific situation are confused as to how to formulate their account requests, and some of us are confused as to how we're allowed to name their account19:04
fungis19:04
fungisince the current naming scheme seems to be written entirely from the "i'm one of 50+ accounts reporting on changes to neutron" case instead19:04
*** pelix has quit IRC19:04
jogosdague: sigh heat19:05
anteayaI agree19:05
*** talluri has quit IRC19:05
anteayaand I think what you propose is reasonable19:06
anteayaI am just on edge to see how someone will try to abuse this is all19:06
*** vigneshvar_ has joined #openstack-infra19:06
anteayawhich can't be prevented, it just seems to be part of the pattern19:06
*** cpowell has quit IRC19:08
krtaylorsweston, ping, re: best place for third-party ci monitoring dashboard spec?19:10
*** slogan has quit IRC19:10
swestonkrtaylor, pong19:10
*** vigneshvar has quit IRC19:10
*** cpowell has joined #openstack-infra19:10
*** HeOS has quit IRC19:10
*** [HeOS] has joined #openstack-infra19:10
swestonkrtaylor, is this the first cross-project spec?19:11
krtaylorsweston, not sure19:11
krtaylorsweston, so I guess push the spec to openstack-infra/infra-specs19:12
krtaylorif anyone complains we can change it :)19:12
*** slogan has joined #openstack-infra19:12
krtaylorsweston, I think the main thing is to just get it pushed out so that others can start reviewing19:13
*** Rockyg has joined #openstack-infra19:13
openstackgerritMorgan Fainberg proposed openstack-infra/project-config: Add a keystone-specs-core gerrit group  https://review.openstack.org/13505519:13
swestonkrtaylor, Ok will do.  May I send you the first draft over email?  I am not sure about the specific wording of some of the sections.19:14
morganfainberganteaya, ^ not sure if I need to do anything else for that change19:14
morganfainberganteaya, but we have some people starting to emerge from the Keystone community that should have +2 on specs but not on code, so time to revisit core groups.19:14
*** bknudson has quit IRC19:15
*** bknudson has joined #openstack-infra19:15
fungimorganfainberg: i find what you said there mildly fright-inducing ;)19:15
anteayamorganfainberg: +219:15
morganfainbergfungi, ironic has an operator that has +2 on specs but not on code! ;)19:16
fungimorganfainberg: lemming defense!19:16
anteayayes, +2 in that the patch is organized correctly to meet your goal, no opinion on folks who can reveiw specs but can't review code19:16
krtayloranteaya, any project preference on the CI monitoring dashboard spec? openstack-infra/infra-specs19:16
anteayakrtaylor: nice meeting today, let's use the phrase additional meeting time rather than alternate meeting time19:17
morganfainbergfungi, haha, i actually have some people who are really good at doing standards review, whether this is a good idea from a "direction of the project". But when it comes to code review either they aren't reviewing a ton of code or not familiar with the internals of keystone to make a direct call on "is this code the right approach".19:17
anteayakrtaylor: it appears the two options for the spec were cross-project or infra?19:17
krtayloranteaya, good feedback, I keep doing that, mental block of mine19:17
*** talluri has joined #openstack-infra19:17
fungimorganfainberg: it's your call, i'm just a little taken aback that projects would want people approving specifications who aren't trusted to approve the changes implementing those same specifications19:17
morganfainbergfungi, differing areas of specialties19:17
anteayakrtaylor: that is okay19:17
*** xyang0 has quit IRC19:17
krtayloranteaya,  is there a cross-project-specs?19:17
openstackgerritCedric Brandily proposed openstack-infra/git-review: Support authentication in run_http_exc  https://review.openstack.org/12441019:17
openstackgerritCedric Brandily proposed openstack-infra/git-review: Handle correctly http error raise in run_http_exc  https://review.openstack.org/12439619:17
morganfainbergfungi, it's a one or two person special case.19:17
fungigot it19:18
JayFfungi: morganfainberg: I'm the core reviewer on ironic-specs but not ironic itself :)19:18
morganfainbergfungi, it isn't something i expect to be "common". But this helps guard against the "don't +2 code, promise me you wont" conversation. :)19:18
*** weshay has joined #openstack-infra19:18
JayFSo feel free to talk about me as if I'm actually here19:18
JayFlol19:18
fungiJayF: hah19:18
morganfainbergJayF, i couldn't rememebr who it was ;)19:18
morganfainbergJayF, otherwise i would have point to you specifically19:19
JayFI know, that's why I volunteer19:19
*** talluri has quit IRC19:19
krtaylorsweston, sure if you want, but I 'd say don't worry about the wording, the review will fix that  :)19:19
anteayakrtaylor: http://git.openstack.org/cgit/openstack/openstack-specs/19:19
swestonkrtaylor, anteaya, there is a dependencies section in the spec, which seems to address cross project needs.  But I do not know of a project for cross-project.19:19
JayFto hurt your argument for a special case though: I am core on an Ironic project (IPA)19:19
*** talluri has joined #openstack-infra19:19
mtreinishfungi: qq, looking at puppet board I saw: http://puppetdb.openstack.org/report/logstash.openstack.org/6ba754431d701ed96ae9e42c80802ed77dfa86f719:19
morganfainbergJayF, the person i'm talking about is already core on a keystone project as well19:19
swestonkrtaylor, Ok :-).  I will just push it to gerrit, then.19:20
mtreinishdoes that mean we're running the migration tool every 15min?19:20
morganfainbergJayF, pycadf - just not on keystone server19:20
anteayasweston krtaylor if you want to have a cross-project spec I suggest you consult with ttx first as to how to go about it, and whether this qualifies19:20
anteayasweston krtaylor it will save time posting to openstack-specs and having the spec -2 due to the wrong space19:20
*** marcusvrn has quit IRC19:21
fungimorganfainberg: okay, that makes total sense19:21
JayFmorganfainberg: then it's the same case and makes a lot of sense :) I think the "ok"-ness of someone outside core reviewr on the core project being a core on specs would have to go down to their own ability to know their limits :)19:21
anteayasweston krtaylor and I would really like to see radar repo used if at all possible19:21
*** MaxV has quit IRC19:21
fungimorganfainberg: you could have phrased your initial statement in an entirely different manner ;)19:21
morganfainbergfungi, haha true.19:22
krtayloranteaya, understood, sweston has a repo he has been working out of, but we did agree earlier that we'd use radar19:22
*** Ark has joined #openstack-infra19:22
morganfainbergfungi, but this is really about giving someone who i trust (and the Keystone team trusts quite a bit) the ability to +2 specs and -2 (where appropriate) from the "standards" perspective. [same reason they're core on pycadf]19:22
morganfainbergfungi, less about that they are arleady core somewhere in Keystone.19:23
swestonanteaya, krtaylor I will look into the radar repo next.  Getting the initial framework created has been quite time consuming.  I would like to use a new repo for this, if that is agreeable, and repurpose the radar code19:23
*** Ark is now known as Guest235719:23
*** AlexF has quit IRC19:23
sdaguemorganfainberg: +A19:23
morganfainbergsdague, thanks!19:23
fungimorganfainberg: sure, makes sense that people with capacity to judge one section of the codebase may also be trusted to gauge specs over the entire program19:23
anteayasweston: since radar is already in stackforge it is best to use it, since importing code from github to a current stackforge repo isn't in our workflow19:24
clarkbwe may need to reauire burritos be available at all summit locations19:24
*** talluri has quit IRC19:24
morganfainberg++19:24
anteayasweston: can you talk with mikal since he is the owner of the radar stackforge repo19:24
clarkbnot sure how I survived without19:24
fungimorganfainberg: the counterargument is "managers without coding expertise approving specs, developers without control over specs reviewing code" which is somewhere you definitely don't want to be19:24
*** talluri has joined #openstack-infra19:24
morganfainbergfungi, and that is a fair point19:25
anteayasweston: I'm just not in favour of creating yet another code repo19:25
anteayawhen the goal is to bring together what we have already19:25
morganfainbergfungi, if the person wasn't an active code contributor - i couldn't justify them as specs core19:25
*** liam_ has joined #openstack-infra19:26
sdaguefungi: why I understand that alergy, we also have people that do very much understand the design points needed for openstack to operate in their env that are valuable gate keepers for specs ideas. And I think it's valid to let projects decide they have those people in their community.19:26
*** liam_ is now known as Guest6375119:26
morganfainbergsdague, fungi, it definitely wont be19:26
*** mattfarina has quit IRC19:26
morganfainbergcommon place in keystone.19:26
morganfainbergi fully expect most specs core will always be code-core.19:26
*** otherwiseguy has quit IRC19:26
*** Guest63751 has quit IRC19:26
sdaguemorganfainberg: personally, I don't need justification on it. I think keystone can decide who their core teams are that make the most sense for their project19:27
fungisdague: yep, mostly just concerned that there is a risk of people who aren't doing any of the dev work being the sole reviewers on a design spec19:27
JayFYeah AFAIK only specs cores on Ironic that aren't code cores are myself and russell_h (and russell_h doesn't use it, so doesn't matter)19:27
JayFand we're both cores on ironic-python-agent19:27
fungisdague: and i acknowledged up front that it was keystone's call regardless19:27
JayFAgain it just mainly boils down to the integrity of the core: If you don't have the knowledge to +2 something; don't +2 something :)19:27
JayFCore status is almost as much as desigation of trust as it can be a designation of technical contribution/prowess19:28
morganfainbergJayF, i think that is largely the case.19:28
swestonanteaya, understood.  I will consult with Mikal today.  In order to continue development, though, I would it be ok to use my current github repo until we can merge it into radar?19:28
morganfainbergthere are people who are very very good developers but that I don't want +2ing code19:28
*** bdpayne has quit IRC19:29
fungisdague: and i understand that specs projects are still projects just like any other project, with their own domains of expertise and potentially their own dedicated review teams who may or may not overlap with those of other related projects19:29
*** talluri has quit IRC19:29
anteayasweston: that is what I am saying, we have no ability to merge a github repo with a stackforge repo19:29
*** hdd has quit IRC19:29
fungisdague: i was mostly just curious what the specific situation was, given that i also care about openstack as a whole19:29
*** bdpayne has joined #openstack-infra19:29
anteayasweston: the only time we can import code into a stackforge repo from a github repo is when the stackforge repo is created19:30
anteayasweston: after the creation, all code in the stackforge repo must arrive as gerrit patches19:30
morganfainberghmm.19:30
anteayasweston: so if you want to work on your github repo and then copy your work and create gerrit patches to stackforge, that is your right to do so19:30
morganfainbergi need to come up with a new name for oslo-policy now so we can graduate it.19:30
morganfainbergwhoopse wrong window19:30
*** bdpayne has quit IRC19:31
openstackgerritMerged openstack-infra/project-config: Add a keystone-specs-core gerrit group  https://review.openstack.org/13505519:32
swestonanteaya: I see.  Ok, let me discuss it further with Mikal then.19:32
anteayasweston: okay thanks19:32
anteayasweston: I want you to know I admire your work19:32
anteayasweston: thank you for doing it19:32
anteayasweston: a big part of this will be co-ordination with what already exists19:33
*** AlexF has joined #openstack-infra19:33
anteayathe huge beneifit and stumbling block with openstack is that all the pieces are intended to fit together19:33
morganfainbergfungi, sdague, when that group is created - who do i bug to be placed in it initally (if someone just adds me I can take care of the rest)19:33
fungimorganfainberg: you can bug me19:33
anteayasweston: so co-ordinating the pieces is often more work than the work19:33
fungimorganfainberg: give it about 15 minutes to show up19:34
*** nadya_ has joined #openstack-infra19:34
morganfainbergfungi, k, will keep my eyes on it and bug ya when it shows upo19:34
*** banix has quit IRC19:34
*** banix has joined #openstack-infra19:34
swestonanteaya: Thank you 😃  Yes, I understand the co-ordination requirement now, although initially it wasn't a consideration.  I will certainly move forward with this in mind as one of the components in this project.19:35
*** zul has joined #openstack-infra19:35
anteayasweston: thanks :D19:35
*** bdpayne has joined #openstack-infra19:36
swestonkrtaylor, anteaya, I think this probably wraps up our discussion, unless there is anything else to go over?19:36
krtaylorsweston, I don't think so, let's get ttx to comment on cross project or not and then we'll address how to move forward with repos19:38
krtayloranteaya, thanks for the input19:38
*** yfried_ has quit IRC19:39
*** bdpayne has quit IRC19:40
swestonkrtaylor, ok.  How to we initiate the discussion? email, irc, agenda on a meeting?19:40
*** MaxV has joined #openstack-infra19:40
*** otherwiseguy has joined #openstack-infra19:40
anteayaI'd say ping him on irc19:40
anteayahe is in France19:40
anteayaso first thing tomorrow ping him in here and see what he suggests19:41
swestonanteaya: ok.19:41
anteayakrtaylor: and you are welcome, happy to see y'all leaving the nest19:41
krtaylorsweston, yeah, here or in -dev first thing19:41
*** AlexF has quit IRC19:41
*** dustins_ has joined #openstack-infra19:41
swestonkrtaylor, anteaya, ok, will do.  thanks, both of you for your time, today and always :-)19:42
anteayaof course19:42
anteaya:D19:42
*** nadya_ has quit IRC19:42
krtaylorsweston, email me if you want pre-review19:42
*** sabeen has joined #openstack-infra19:42
asselinanteaya, would you like to review these specs for puppet module split? We'd like to get them merged soonish. https://review.openstack.org/#/c/129768/19:42
krtaylorsweston, thanks for driving this19:42
asselinanteaya, https://review.openstack.org/#/c/132129/19:42
anteayaasselin: I will review19:43
*** gokrokve has joined #openstack-infra19:43
krtaylorasselin, perfect timing, that was my next ping  :)19:43
asselin:)19:43
asselinkrtaylor, I added the agenda item.19:43
swestonkrtaylor, You bet. I think this will be very beneficial to the community, and am excited to be involved!19:44
openstackgerritClayton O'Neill proposed openstack-infra/jenkins-job-builder: Move extended-choice support to parameters module  https://review.openstack.org/11670419:44
*** dustins has quit IRC19:44
morganfainbergfungi, specs-core has appeared19:44
morganfainbergfungi, if you wouldn't mind adding me to it, that would be great.19:45
*** tonytan4ever has quit IRC19:45
fungimorganfainberg: done!19:47
morganfainbergfungi, much appreciated!19:47
fungidon't mention it19:48
jogoclarkb: changing to the private interface didn't help19:48
*** bdpayne has joined #openstack-infra19:49
*** atiwari has quit IRC19:49
clarkbjogo ok I think we need to fix the base change first19:49
jogoclarkb: the issue is my_ip in nova is the public ip19:49
jogoclarkb: http://logs.openstack.org/39/134639/8/experimental/check-tempest-dsvm-aiopcpu/b9a81a6/logs/etc/nova/nova.conf.txt.gz19:49
jogowhats wrong with the base change?19:50
clarkbit doesnt work19:50
clarkbfailed tests19:50
jogoclarkb:  that failure is unrelated to this one I think19:51
clarkbprobably but it needs fixing first19:51
jogoclarkb: link to the failure on the bottom change?19:51
clarkbotherwise how do you debug?19:51
jogoclarkb: I assume you haven't gotten to the bottom of it19:51
clarkbI havent even looked yet :)19:51
jogoclarkb: I already know the problem with my test19:52
jogoclarkb: already debugged, different IP addresses19:52
clarkbbut you cant test it...19:52
jogoclarkb: I can test it, different tests are failing19:52
anteayaasselin: https://review.openstack.org/#/c/134393/ needs some attention19:52
clarkbI dont think so19:52
*** baoli_ has quit IRC19:53
clarkbbecause it fails early in the base change19:53
*** teran_ has quit IRC19:53
clarkbso your change should hit that too19:53
asselinanteaya, yes it does19:53
jogoclarkb: odd, it didn't fail early in my patch19:53
jogoclarkb: base tempest failure: http://logs.openstack.org/43/106043/23/experimental/check-tempest-dsvm-aiopcpu/2c0d809/logs/testr_results.html.gz19:53
asselinanteaya, I'm going to try to get answers today, but if not, tomorrow in the infra meeting19:53
jogomine: http://logs.openstack.org/39/134639/8/experimental/check-tempest-dsvm-aiopcpu/b9a81a6/logs/testr_results.html.gz19:54
nibalizerzaro: are you about?19:54
clarkbjogo are these todays runs?19:54
jogosdague: do you know what ip devstack should be setting19:54
nibalizeri have questions about the gearman jenkins plugin19:54
jogoclarkb: yup19:54
jogoclarkb: from moments ago19:54
clarkbsorry I am on phone grocery shopping19:54
nibalizeri will trade you hubot time19:54
anteayaasselin: okay great19:54
jogoclarkb: haha, lets chat when your done19:54
sdaguejogo: can you definite the question further19:54
*** unicell has quit IRC19:54
*** jcoufal has quit IRC19:55
clarkbwas gone for 2 weeks and power went out while gone too19:55
anteayaasselin: another person who could review puppet changes is crinkle19:55
*** e0ne has joined #openstack-infra19:55
jogosdague: sure, devstack i setting nova's my_ip to the public IP http://logs.openstack.org/39/134639/8/experimental/check-tempest-dsvm-aiopcpu/b9a81a6/logs/etc/nova/nova.conf.txt.gz19:55
jogobut in the aiopcpu work we are moving to using private interfaces19:55
*** weshay has quit IRC19:55
jogoright now I am sorting out the ssh hostkey stuff19:55
clarkbjogo set my ip to the nodepool provided private addr19:56
asselinanteaya, ok will do19:56
jogosdague: so what clarkb said. Does that sound right?19:56
jogoI don't know the history behind why that value was set like that in devstack and wanted to double check19:56
clarkbjogo its naive in devstack iirc19:57
sdagueit's set to HOST_IP because it works in most cases19:57
sdagueis there a reason to not change HOST_IP to the private addr as well?19:57
jogosdague: so should we change what HOST_IP is set to?19:57
crinklei've been pinged19:58
asselinhi crinkle, could you review some puppet module split spec updates?19:58
clarkbjogo sdague that should work19:58
sdagueclarkb: ... except on node 2, right?19:58
asselincrinkle, https://review.openstack.org/#/c/132129/  & https://review.openstack.org/#/c/129768/319:58
*** tkelsey has joined #openstack-infra19:58
jogoclarkb sdague: cool I'll give it a shot19:59
crinkleasselin: sure i can try to look in a bit19:59
asselincrinkle, thanks20:00
*** hashar has joined #openstack-infra20:01
fungiclarkb: nodepool dib-image-list says devstack-precise-dib and devstack-trusty-dib are slightly over 4 days old. can i assume this is not (yet) a known issue?20:01
fungiclarkb: also, it occurs to me, we aren't keeping the previous dib build around like we do with traditional snapshots. does it try share the same rotation mechanism, or reimplement it?20:03
clarkbsdague node 2?20:03
*** sabeen2 has joined #openstack-infra20:03
*** dtantsur is now known as dtantsur|afk20:04
*** sabeen has quit IRC20:04
clarkbfungi it should share20:05
fungiclarkb: okay, then we've probably got an off-by-one somewhere20:05
clarkbit was keeping 2 for a while20:05
*** sarob has joined #openstack-infra20:05
*** sarob has quit IRC20:05
*** sarob has joined #openstack-infra20:06
*** tonytan4ever has joined #openstack-infra20:06
*** omnibus7 is now known as davidlenwell20:06
openstackgerritSpencer Krum proposed openstack-infra/system-config: Removing github module.  https://review.openstack.org/12645020:06
*** SumitNaiksatam has quit IRC20:06
*** sabeen1 has joined #openstack-infra20:06
*** SumitNaiksatam has joined #openstack-infra20:07
openstackgerritSpencer Krum proposed openstack-infra/system-config: Removing github module.  https://review.openstack.org/12645020:08
mtreinishfungi: btw, did you see my question about puppetboard, a bit ago? I think it might have gotten lost in the noise20:08
*** tonytan4ever has quit IRC20:08
*** tonytan_brb has joined #openstack-infra20:08
fungimtreinish: how big do you think the subunit-worker01.o.o instance should be (8gb ram?)20:08
*** sabeen2 has quit IRC20:08
nibalizermtreinish: fungi whats up with puppetboard?20:08
mtreinishfungi: that's probably fine, running subunitsql will probably be more network bound than anything20:08
mtreinishnibalizer: it was a question about the output20:08
fungimtreinish: smaller then?20:08
fungimtreinish: oh, i saw it and it was lost in my addlebrained attempts at holding down a dozen simultaneous conversations20:09
mtreinishfungi: well it'll start up 4 worker daemons IIRC I don't think the memory footprint will be too big, but I really don't have a good sense20:09
mtreinishfungi: no worries :020:09
*** SumitNaiksatam has quit IRC20:10
mtreinishit was basically does something like this: http://puppetdb.openstack.org/report/logstash.openstack.org/6ba754431d701ed96ae9e42c80802ed77dfa86f7 mean the command is being re-executed on every puppet refresh?20:10
openstackgerritAndrew Laski proposed openstack-infra/project-config: Filter out some Tempest tests for Nova cells  https://review.openstack.org/13506420:10
fungimtreinish: the upgrade_subunit2sql_db exec ran on logstash.o.o and returned a 0 exit code according to that20:10
jogoclarkb: how do I get the private address of the current subnode20:11
jogodevstack-vm-gate line 30720:11
clarkbjogo nodepool provides it in /etc/nodepool in a file20:11
mtreinishfungi: ok yeah that's what I thought. I guess that means the subsribe to pip doesn't do what we thought (only run on an install)20:11
clarkbNodepool docs cover all that data but I dont know off the top of my head20:11
mtreinishbecause we shouldn't be running that all the time, just when a new version exists20:12
*** Sukhdev has joined #openstack-infra20:12
*** yjiang5 is now known as yjiang5_away20:12
*** SumitNaiksatam has joined #openstack-infra20:12
anteayaso for in zuul/layout.yaml for publishing tarballs, I see it in the python-jobs macro as {name}-branch-tarball in the post pipeline and I also see it on a per project basis in pre-release and release20:12
anteayado projects need to create and post tarballs in 3 different pipelines?20:12
*** e0ne has quit IRC20:13
clarkbyes, as the versions are different in each pipeline20:13
*** stevemar has quit IRC20:13
*** mpaolino has joined #openstack-infra20:13
*** sarob has quit IRC20:13
*** ZZelle_ has joined #openstack-infra20:13
*** sabeen1 has quit IRC20:13
*** sabeen1 has joined #openstack-infra20:14
*** hdd has joined #openstack-infra20:14
openstackgerritSpencer Krum proposed openstack-infra/system-config: Create puppet-forge credentials on the pypi slave  https://review.openstack.org/13483520:14
anteayaclarkb: hmmmm, okay thanks20:15
*** ldnunes has quit IRC20:15
*** bhuvan has quit IRC20:16
fungianteaya: the post jobs create branch tarballs which get replaced with each new commit, pre-release and release tarballs create one-time tarballs with pre-release or release version numbers (and potentially trigger different follow-up actions to upload both tarballs and wheels or just wheels)20:16
mtreinishclarkb, fungi: any suggestions on how to get the tool to only exec when a new pip version is released? Do you think it's just a bug in the pip puppet class?20:17
*** sarob has joined #openstack-infra20:17
clarkbmtreinish oh ya its abug iirc20:17
fungimtreinish: not sure. i need to look at what that manifest is doing20:17
clarkbyou can install from source instead and subscribe to a vcsrepo20:17
crinkleasselin: reviewed, my only comments would be regarding Modulefile vs metadata.json but that wasn't part of these changes20:17
fungidoes latest trigger notification even on non-action?20:17
clarkbfungi ya iirc pip provider uses hammer approach20:18
fungieek20:18
mtreinishclarkb: ok, that's what I was trying to avoid, because I was only planning to guarantee migrations wouldn't change at release boundaries20:18
clarkband does pip install --upgrade if using latest or some such20:18
anteayafungi: ah okay thanks20:18
mtreinishbut if there isn't another choice I can switch it20:18
*** todd_dsm has joined #openstack-infra20:19
jogoclarkb: hmm this means we need different localrc files per sub node20:19
clarkbjogo yes20:19
clarkbwe already do that20:19
jogoclarkb: can I just set HOST_IP_IFACE20:19
mtreinishI guess I'll just have to be more vigilent about what I self approve on the subunit2sql repo20:19
jogoclarkb: we do? I couldn't find a place where the localrc file is different *per* subnode20:19
clarkbjogo if you know what the interface is20:19
openstackgerritSpencer Krum proposed openstack-infra/system-config: Source modules.env from apply-test.sh  https://review.openstack.org/13472320:20
jogoclarkb: will that be consistent?20:20
clarkbnope20:20
clarkbbecause clouds20:20
jogoclarkb: :/  yeah20:20
*** gokrokve has quit IRC20:20
*** gokrokve has joined #openstack-infra20:21
openstackgerritCedric Brandily proposed openstack-infra/git-review: Prefer git-config over git-review config files  https://review.openstack.org/11603520:21
*** otter768 has quit IRC20:22
*** annegent_ has quit IRC20:22
clarkbjogo so I wouldnt worry about >2 nodes a ton now20:22
jogoclarkb: kk20:22
clarkbI really think we are trying to do too much20:22
clarkbwe need base change in and working on 2 nodes20:22
clarkbthen layer on that20:23
sdaguedear ubuntu, some times I hate you so much - http://logs.openstack.org/15/134915/2/check/check-tempest-dsvm-full/7ee5c2d/console.html#_2014-11-17_19_04_31_70020:23
clarkband 3 nodes should be independent of full tempest20:23
sdagueclarkb: ++20:23
jogoclarkb:  agreed20:23
sdaguebaby steps20:23
*** annegent_ has joined #openstack-infra20:24
clarkbI am going to debug base change failures shortly20:24
clarkbalmost done with errands20:24
*** koolhead17 has quit IRC20:24
*** denis_makogon_ has joined #openstack-infra20:24
*** denis_makogon has quit IRC20:25
*** denis_makogon_ is now known as denis_makogon20:25
*** koolhead17 has joined #openstack-infra20:25
*** dmakogon_ has joined #openstack-infra20:25
fungimtreinish: Error: Could not retrieve catalog from remote server: Error 400 on SERVER: Duplicate declaration: Package[python-daemon] is already declared in file /opt/system-config/production/modules/subunit2sql/manifests/worker.pp:26; cannot redeclare at /opt/system-config/production/modules/subunit2sql/manifests/worker.pp:26 on node subunit-worker01.openstack.org20:25
*** gokrokve has quit IRC20:25
fungimtreinish: looks like you doubled up20:26
jogowhat is the bashfoo to get the first value in /etc/nodepool/sub_nodes_private20:26
mtreinishfungi: oops, I'll push out a patch in a sec20:27
openstackgerritK Jonathan Harker proposed openstack-infra/git-review: Convert add_remote to use GitReviewExceptions  https://review.openstack.org/13237520:27
jogohead -1 sub_nodes_private20:27
mtreinishfungi: hmm, I only see it once in worker.pp, and it's not in init.pp20:29
*** koolhead17 has quit IRC20:29
*** shashankhegde has quit IRC20:30
clarkbjogo thats not what you want20:30
fungimtreinish: i think that manifest is being applied twice20:30
clarkbjogo there is a file withbonly current nodes private ip in it20:30
openstackgerritMerged openstack-infra/project-config: remove duplicated acls file between congress and congressclient  https://review.openstack.org/13443020:30
jogoclarkb: right, but the localrc file for both primary and sub appears to be generated on the same node20:30
jogounless I am missing something20:31
clarkboh I see. just append dest ip before copying file?20:31
jogoclarkb: yeah that would work20:31
mtreinishfungi: hmm, let me check openstack_project::subunit_worker then20:31
jogoI'll do it that way20:31
jogowell I think this should work20:32
jogoclarkb: we can refactor later, right now this is just a test20:32
jogoI have a hunch we will have to change more anyway20:32
*** spzala has joined #openstack-infra20:32
fungimtreinish: i think maybe the include subunit2sql line is to blame?20:32
sdaguejogo: yes, generating both on the same node was intentional, as it would be easier to figure out what's wrong by knowing what the localrc was on the subnode if it died20:32
*** MarkAtwood has joined #openstack-infra20:32
jogosdague: make sense20:32
mtreinishfungi: probably, but I stole that bit from openstack_project::logstash_worker20:33
fungimtreinish: ahh, no, it's the multiple subunit2sql::worker instantiations. they can't duplicate resources20:33
mtreinishfungi: ah, ok, so I should move the package definitions to init.pp then20:33
fungimtreinish: so worker.pp will probably need to wrap package reqources in an ifdef20:33
fungimtreinish: or into the init.pp if it makes sense, yeah20:34
*** mwhudson has quit IRC20:35
*** mwhudson has joined #openstack-infra20:35
openstackgerritMerged openstack-infra/project-config: Update channel config for stable branches  https://review.openstack.org/13328420:35
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full  https://review.openstack.org/13463920:36
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: Set HOST_IP to the private interface  https://review.openstack.org/13507020:36
openstackgerritMatthew Treinish proposed openstack-infra/system-config: Move package definitions into subunit2sql init.pp  https://review.openstack.org/13507120:36
mtreinishfungi: ^^^20:36
jogoclarkb sdague: by changing the HOST_IP I think we may be changing the IP address that the REST APIs bind to20:37
*** MaxV has quit IRC20:37
jogoso service_host and others may need changing20:37
mtreinishfungi: it should be fine, the packages aren't really needed on the server definition, but it doesn't hurt20:37
clarkbjogo I think that may be correct. basically need to move everythibg to private IPs20:37
mtreinishoh, wait unless they'll conflict with something already on logstash.o.o20:37
clarkbwhich will be more consistent but require derping20:37
mtreinishI guess the apply job will complain if that's the case?20:39
jogoclarkb: yup20:39
sdaguejogo: it looked like the glance host was already on that20:39
sdagueas long as it's accessible, it doesn't really matter20:39
fungimtreinish: well, the apply job seems not to have ideal coverage. otherwise it should have complained about the previous patch20:39
*** tonytan_brb has quit IRC20:40
mtreinishfungi: good point, I guess I should look... :)20:40
*** atiwari has joined #openstack-infra20:40
fungihoboy... we have gate job 'splosions20:41
anteayanibalizer: this being a new job my first inclination would be to request it in the experiemental pipeline: https://review.openstack.org/#/c/134834/3/zuul/layout.yaml20:42
*** MaxV has joined #openstack-infra20:42
mtreinishfungi: yep it'll conflict with what's already on logstash.o.o, I guess ifdefs in worker.pp it is20:42
mtreinishfungi: can you paste me the example syntax for that and I'll respin the patch20:42
sdagueproject-config question20:42
sdaguewhat do I need as a job definition to run ./run_tests.sh in the devstack source tree for devstack unit tests?20:43
anteayafungi: I'm seeing heat-slow fail in all three top patches20:43
mtreinishsdague: it should already exist in one of the job definitions, I believe you added it for devstack already20:43
nibalizeranteaya: well release and experimental are both opt-in right? is it possible to do what the release pipleline does in the expermental?20:44
fungianteaya: nova unit tests, tempest and grenade jobs...20:44
clarkbsdague: you basically need what the gate-name-python27 job does but s/run-unittests/run_tests.sh/20:44
fungicurrently trying to rule out whether the jenkins module split is to blame, or if this is something else20:44
jogohmm looks like nova REST APIs listen to 0.0.0.0 so we should be fine20:44
anteayafungi: two minutes from starting slow heat tests to returning that no tests actually ran20:45
mtreinishsdague: nope I guess it's not there anymore. I remember trying to use it for an earlier attempt at specs unit tests but I guess we removed the definition20:45
mtreinishanteaya: that means there was an import error20:45
*** sarob has quit IRC20:45
mtreinishanteaya: well, normally assuming something else didn't go wrong20:45
clarkbfungi: a quick look at a failed nova test makes it seem like nova is at fault20:46
clarkbbut that was in check /me looks at gate fails20:46
*** rlandy has quit IRC20:46
anteayalooking at a partial-ncpu failure the the base smoke test ran for about 18 minutes before falling over20:47
*** baoli has joined #openstack-infra20:47
clarkbhrm one other user using the database in the unittest which should not be related to puppet20:47
clarkbsince we don't puppet on the slaves post image build20:47
openstackgerritSean Dague proposed openstack-infra/project-config: add support for running devstack unit tests  https://review.openstack.org/13507520:47
sdagueclarkb: ... like that?20:47
*** mriedem has quit IRC20:47
fungiclarkb: right, it dawns on me that the module split change landed after image updates completed (i have a test bare-trusty build going now to exercise that but it hasn't copmpleted yet)20:48
clarkbsdague: almost, you need gerrit git prep too, and probably revoke suod?20:48
sdagueclarkb: ok, sure20:48
openstackgerritSean Dague proposed openstack-infra/project-config: add support for running devstack unit tests  https://review.openstack.org/13507520:49
anteayasorry that was 8 minutes, not 1820:49
clarkbsdague: oh and you need to publish the logs with a publisher20:49
*** openstackgerrit has quit IRC20:49
*** openstackgerrit has joined #openstack-infra20:49
clarkbsdague: there are examples in that file though (you probably just need to publish console-logs20:49
openstackgerritSean Dague proposed openstack-infra/project-config: add support for running devstack unit tests  https://review.openstack.org/13507520:49
sdagueok, added20:49
sdagueoh, do I need the publisher as well?20:50
clarkbyup, otherwise you will just get "pass" or "fail" from zuul :)20:50
anteayaand another grenade-dsvm where base smoke tests ran for 15 minutes before falling over20:50
openstackgerritSean Dague proposed openstack-infra/project-config: add support for running devstack unit tests  https://review.openstack.org/13507520:50
sdagueanteaya: the ubuntu mirrors got wonky recently as well, I had all my jobs fall over on one patch20:51
fungioh, that was probably a bunch of the failures there20:51
anteayahmmmm, I'm watching the heat-slow test on the tempest patch in the lineup20:52
anteayait is currently running devstack20:52
clarkbsdague: is http://logs.openstack.org/43/106043/23/experimental/check-tempest-dsvm-aiopcpu/2c0d809/console.html#_2014-11-17_18_40_41_556 the heat thing you were mentioning over in -qa?20:52
sdagueclarkb: yep20:52
clarkbok so I won't worry about that much then20:52
clarkbjogo: ^ I think that means base change is still mostly fine20:53
fungimtreinish: examples... http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/zuul/manifests/init.pp#n7120:53
anteayasdague: it does feel like some form of dependency error20:53
asselincrinkle, thanks. You can add you comments to this review: https://review.openstack.org/#/c/134393/120:53
anteayanothing seems to be able to get enough to get rolling20:53
sdagueyeh, ignore any heat failures here, they are probably completely unrelated20:53
fungimtreinish: line 93 is likely identical to what you need20:53
*** hamzy has quit IRC20:53
anteayathe slow heat tests are running on the tempest patch, let's see what happens in the next two minutes20:54
*** bhuvan has joined #openstack-infra20:54
*** achanda has quit IRC20:54
anteayanope20:55
openstackgerritSean Dague proposed openstack-infra/project-config: add support for running devstack unit tests  https://review.openstack.org/13507520:55
sdagueok, now with actually running it on devstack20:55
clarkbjogo: looking at afazekas' change service_host is set to private ip20:55
clarkbjogo: as are a bunch of the other host IPs (mysql, rabbit, et al)20:56
anteayafailed within two mintues the logs look like the rest: https://jenkins05.openstack.org/job/gate-tempest-dsvm-neutron-heat-slow/6750/console20:56
*** sabeen1 has quit IRC20:56
*** sabeen2 has joined #openstack-infra20:56
openstackgerritMatthew Treinish proposed openstack-infra/system-config: Ensure we only define subunit worker packages once  https://review.openstack.org/13507120:56
mtreinishfungi: ^^^ that should do it I think20:57
fungimtreinish: i agree20:57
clarkbjogo: I think we should change all of the iteration across /etc/nodepool/sub_nodes to /etc/nodepool/sub_nodes_private for consistency though20:58
anteayaso do we have a candidate for what is causing so many failures in the gate and check?20:59
*** bhuvan has quit IRC20:59
anteayaand should we update channel status?21:00
jogoclarkb: agreed21:00
clarkbanteaya: Ithink its the heat thing21:00
anteayawhat heat thing is the heat thing?21:01
jogoclarkb: waiting to see if my current iteration at least works before going forward21:01
anteayaI see heat tests breaking21:01
sdagueyeh, something is super wonky with the heat tests now21:01
clarkbjogo: sounds good.21:01
anteayasdague: I agree with that21:01
clarkbsdague: jogo: I still think we should probably merge afazekas' change as is21:01
anteayadoes heat know this?21:01
clarkbit gets us 90% of what we need21:01
clarkband it will be easier to refine once that is in21:01
jogoclarkb: agreed21:02
clarkbrefine by doing things like moving everything to private IPs and doing nova multinode and making tempest run full and doing >=3 node deployments21:02
*** stevemar has joined #openstack-infra21:02
clarkbanteaya: sdague was working it earlier today21:02
shardyhi, anteaya21:02
anteayashardy: thanks21:02
anteayaso right now many things are failing in the gate and check21:03
shardyI've just uploaded a patch which fixes our sample config, broken by oslo.db releasing21:03
anteayacurrent theory is it is heat related21:03
shardyis that the issue you're seeing?21:03
anteayaI don't know21:03
*** vigneshvar_ has quit IRC21:03
shardyI assumed it would only affect our project pep check job21:03
anteayaI don't have enough log info to tell21:03
sdagueshardy: so that might be another thing21:03
anteayawell right now heat-slow grenade jobs and others are being taken out21:04
anteayanot sure if it is heat or not21:04
anteayadon't have any other clues though21:04
sdagueshardy: http://status.openstack.org/elastic-recheck/#137417521:04
stevebakeryo21:04
anteayastevebaker: thanks21:04
sdaguethat's the one that's been bouncing my patches much of today21:04
*** ryansb has joined #openstack-infra21:04
anteayagate and check are fairly red: http://status.openstack.org/zuul/21:04
clarkbI really wish I knew why afazekas removed the iptables rule to allow internode connections on all ports though21:05
shardySo we're talking about Bug 1297560 - *tempest-dsvm-neutron-heat-slow fails with WaitConditionTimeout?21:06
uvirtbotLaunchpad bug 1297560 in tempest "*tempest-dsvm-neutron-heat-slow fails with WaitConditionTimeout" [Undecided,Fix released] https://launchpad.net/bugs/129756021:06
mtreinishfungi: I'm going to transition home, I'll bbiab if something else comes up on the subunit2sql stuff21:06
*** nikhil_k is now known as nikhil_k|afk21:06
fungimtreinish: cool. as soon as jenkins +1's your latest patch i'll see if i can get a second +2 on it, and then test it after dinner21:06
stevebakeris it all test_server_cfn_init? we have an equivalent test in check-heat-dsvm-functional-mysql so I'm fine with it being deleted or skipped21:07
sdaguestevebaker: it is21:07
clarkbfungi: off the top of your head do we allow "private" network talking between nodes by default?21:08
clarkbfungi: I didn't think we did21:08
clarkbbut this works somehow21:08
fungiclarkb: not to my knowledge21:08
fungiclarkb: on the other hand, we may apply iptables just on eth021:08
stevebakerit wouldn't take much effort to move the remaining heat-slow tests to check-heat-dsvm-functional-mysql, then heat-slow can be removed entirely21:08
shardystevebaker: +121:08
clarkbwe allow ssh, which is enough for setting things up but once tempest runs I would have expected failures due to the openstack services being blocked21:08
clarkbfungi: I don't think we do that, but maybe we do21:09
fungiclarkb: oh, though i think the devstack worker port list may be largeish21:09
fungias far as what we open on them21:09
shardystevebaker: Are we seeing less of these broken-network-or-slow-vm-timeout related issues in the functional job?21:09
clarkbfungi: oh good point the image builds do open some stuff for devstack21:09
fungiclarkb: so maybe necessary services are just covered on every interface21:09
stevebakershardy: I'm not sure, the volume test failures mask the other failures ;)21:10
sdaguestevebaker / shardy would be awesome21:10
shardystevebaker: heh, well we can skip that too then, I guess21:10
sdagueso I proposed a skip on the scenario test for now21:10
sdaguebut if you guys think you have it covered in functional, we can do a delete for it21:10
*** thedodd has quit IRC21:10
stevebakersdague: but to be clear, I would be beer that those tests are failing for non-heat reasons. Either slow undercloud nodes or regressions in other projects21:11
stevebaker*bet* beer21:11
clarkb"slow undercloud nodes" I think you just defined our available resources21:11
mordredstevebaker: I would beer21:12
* stevebaker sad lols21:12
sdaguestevebaker: might be21:12
sdaguethough 900s... is a long time21:12
clarkbfungi: any chance you can nodepool hold 3047933 for me? I don't have my key handy right this second21:12
*** shashankhegde has joined #openstack-infra21:13
clarkbfungi: that will catch a pair of nodes running the mutlinode nova stuff which I can look at shortly (once I have my key handy)21:13
fungiclarkb: done21:13
clarkbdanke21:13
anteayathe heat slow tests fail, which log file would capture the failures for the heat slow tests? http://logs.openstack.org/08/135008/2/gate/gate-tempest-dsvm-neutron-heat-slow/8b9eb1e/logs/21:14
shardystevebaker: given the constant issues with any test that boots a full fedora image, is it worth considering reworking everything to only use cirros?21:14
sdagueshardy: ++21:14
sdagueI think the experience of fedora as a 2nd level guest has proved that it's really hard to keep working21:14
shardysdague: the disadvantage is we lose all coverage of the in-instance tools we care about :(21:14
stevebakershardy: but the full fedora image tests agent code that we *really* want to test21:14
*** hdd has quit IRC21:15
shardystevebaker: Yeah, I'm just not sure, given recent experience, if it's feasable to do it every commit and keep it working :(21:15
clarkbfungi: there are definitely iptbales rules on each of the nodes that allow all traffic between them21:16
clarkbmaybe the code that was removed was redundant21:17
sdaguecan you decouple the in-instance testing, so you don't need to boot that on devstack 2nd level, but could just boot fedora/ubuntu on the cloud and test the in instance parts as a cloud guest21:17
fungiclarkb: oh! also i think devstack mangles iptables too21:17
ryansbshardy: you thinking a periodic job?21:17
clarkbfungi: oh you know what. I think the node ready script does it for us21:18
shardyryansb: Yeah, maybe a periodic job which tests heat-cfntools, if we can figure out a strategy which avoids us ignoring it21:18
fungiclarkb: ahhhhh21:18
stevebakershardy: the volumes test is cirros, so that doesn't fix all the problems21:18
clarkbok its all coming back to me :)21:19
shardystevebaker: If we got the tripleo jobs voting, that would provide coverage of SoftwareConfig and os-* right?21:19
anteayashould we update channel status?21:19
clarkbtl;dr fungi sdague please review afazekas' change I am happy with it21:19
clarkbanteaya: I don't think so21:19
shardystevebaker: Yeah, that's a different problem, I wish I knew whay that's so broken21:19
clarkbits no different than any of the other gate melt downs21:19
anteayaokay21:19
clarkb(I don't like the idea that a gate melt down is a firealarm, it happens and we should expect it and people should work through it)21:20
*** jdandrea has joined #openstack-infra21:20
anteayaright21:20
anteayabut if we tell them what to do might that not help?21:20
nibalizerso gertty question: i tried to build a dashboard like "status:open project:stackforge/puppet-nova project:stackforge/puppet-horizon" but nothing im trying seems to work21:20
fungiif ~all jobs are broken because the infra team made a mistake or is engaged in flighting some blocking fire, then we update channel topics. otherwise it's situation normal21:20
nibalizerhow do?21:20
anteayafungi: okay21:20
stevebakeronce it is possible to use a diskimage-builder-built fedora as our test image then there is possiblilty to up the required systemd timeouts to mitigate slow boot times21:21
anteayanibalizer: that query doesn't work in gerrit21:22
*** fifieldt_ has joined #openstack-infra21:22
anteayanibalizer: find query syntax that works in gerrit first21:22
*** tkelsey has quit IRC21:22
*** baoli has quit IRC21:22
anteayanibalizer: try `status:open project:stackforge/puppet-nova OR project:stackforge/puppet-horizon`21:23
nibalizeroh derp21:23
*** fifieldt has quit IRC21:23
*** hdd has joined #openstack-infra21:23
*** thedodd has joined #openstack-infra21:24
sdaguestevebaker: it does seem like there should be better ways to validate that at a lower level, because if it requires 15+ minutes to boot a guest reliably, the amount of coverage you can get in any real timebox is very small21:24
nibalizeranteaya: so that works in gerrit web, but in gertty it comes up empty21:24
lifelessstevebaker: what are you trying to validate?21:25
clarkbnibalizer: are you subscribed to those projects?21:25
fungisdague: stevebaker: is this something we could test natively on a fedora worker instead of virtualizing inside a virtual machine?21:25
anteayanibalizer: hmmmm, now you've got me21:25
fungior does it need all of devstack around it?21:25
sdaguefungi: that was my open question as well21:26
anteayanibalizer: I'd look at the gertty syntax for queries then, maybe it doesn't parse OR yet21:26
boris-42fungi: hi21:26
nibalizerclarkb: i am subscribed21:26
boris-42fungi: could you help me a bit.... with advice21:26
*** radez is now known as radez_g0n321:27
clarkbsdague: fungi stevebaker or containerize it21:27
boris-42fungi:  I am trying to setup dsvm job for osprofiler library (it's already in global requirments + in some of project requirments)21:27
boris-42fungi:  so I don't know how to install it from master* and not from pypi..21:27
openstackgerritRichard Jones proposed openstack-infra/storyboard: Switch to "serve" verb, and a minor clean up.  https://review.openstack.org/13336121:27
clarkbI actually think that we should look into that more as trove and I assume other projects have more and more need for second level guests that are not terrible21:27
*** achanda has joined #openstack-infra21:28
clarkbboris-42: devstack should do that for you21:28
clarkband if not devstack proper then a devstack plugin thing21:28
fungiboris-42: there's a devstack-gate environment variable which can specify a list of libs to install from git repo source instead of from pypi21:28
boris-42fungi:  ahh21:28
boris-42fungi:  lemme take a look21:29
fungiboris-42: assuming this is for a job using osprofiler but not running on changes made *to* osprofiler21:29
boris-42clarkb: thanks21:29
*** cnesa has quit IRC21:29
boris-42fungi: hm?21:29
boris-42fungi:  I would like to run it on change to osprofler21:29
*** miqui has quit IRC21:29
fungiboris-42: when testing a change to osprofiler, it should get installed from source automatically21:29
clarkbfungi: but not if devstack doesn't know about rall21:29
boris-42fungi: hmm21:29
clarkbfungi: which I think is the case? because rally is its own devsatck thing? or am I mistaken21:30
boris-42clarkb: ya21:30
sdaguefungi: right, I don't think devstack knows about it21:30
boris-42fungi: it's about oslo21:30
boris-42clarkb: wait a sec=)21:30
boris-42clarkb:  osprofiler != rally21:30
boris-42clarkb:  it's 2 different things=)21:30
clarkboh I don't know why I mixed those up21:30
sdagueboris-42: follow the pattern with how oslo.config is done through devstack and devstack-gate21:30
clarkbI blame jet lag21:30
*** julim has quit IRC21:30
sdagueosprofiler support should look like that21:30
fungioh, right. so there's also an environment variable which can be used to extend the list of projects devstack-gate knows about for a given job definition21:30
boris-42sdague: okay thanks21:30
*** gokrokve has joined #openstack-infra21:31
boris-42sdague: fungi clarkb thanks guys!21:31
sdagueyou'll need devstack and devstack-gate changes for it21:31
clarkbjogo: ok, I have tests running with my nova multi node change now. it just failed resize host, likely for the same reason yours failed21:31
fungiclarkb: if you're okay with mtreinish's 135071 i can test launching another node when i get back from dinner21:32
clarkbjogo: which if so will give us a smaller case to test and fix this stuff21:32
boris-42sdague: maybe just hack this https://github.com/openstack-dev/devstack/blob/master/lib/stackforge#L37-L47 ?)21:32
boris-42sdague: to install from master?)21:32
*** jamespage_ has joined #openstack-infra21:33
clarkbfungi: mtreinish: a nicer way to do that is put the common package deps in a class, then include that class in each define21:33
sdagueboris-42: so you should really do it the way oslo.config works21:34
sdagueboris-42: it's part of oslo, right?21:34
*** tonytan4ever has joined #openstack-infra21:34
sdaguehttps://github.com/openstack-dev/devstack/blob/master/lib/oslo21:34
boris-42sdague:  nope it is not21:34
dhellmannsdague: no, that's why he's looking for advice21:34
sdagueboris-42: oh... I thought it was21:35
boris-42sdague: yep that is why I am looking for advices21:35
boris-42sdague: ya21:35
boris-42sdague: maybe exception for this lib?21:35
nibalizeranteaya: seems like it supports or http://git.openstack.org/cgit/stackforge/gertty/tree/gertty/search/parser.py#n4521:35
boris-42sdague:  just put it like it is osprofiler?)21:35
boris-42dhellmann: ^21:35
boris-42oslo**21:35
mtreinishclarkb: I tried that(look at rev 1), but the issue is that since server.pp uses the same class and that gets used in logstash.o.o there would still be a conflict21:35
*** Ark has joined #openstack-infra21:35
jogoclarkb: link?21:35
sdagueboris-42: ok, so start with the devstack-gate change to prep the repo21:36
*** Rockyg has quit IRC21:36
sdaguebecause that's the same regardless21:36
clarkbjogo: https://jenkins07.openstack.org/job/check-tempest-dsvm-aiopcpu/9/console21:36
*** Ark is now known as Guest137421:36
*** cpowell has left #openstack-infra21:36
clarkbjogo: its still running21:36
nibalizeroh i bet it doesn't have project21:36
*** Guest1374 has quit IRC21:36
*** Guest2357 has quit IRC21:36
sdagueboris-42: so including it in stackforge is probably right... however, that needs some lib conversion (I missed it)21:37
jogoclarkb: ahhh I see yeah21:37
boris-42sdague: hm what kind of lib conversion?)21:37
jogoclarkb: if resize goes across hosts then it should fail21:37
jogoand that i somewhat random so makes sense21:37
sdagueI can do that tomorrow, and will add osprofiler if you get it into the nodepool image21:38
boris-42sdague: okay thanks21:38
sdagueboris-42: https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate-wrap.sh#L35-L10021:38
boris-42sdague: so I should add there osprofiler?21:39
sdaguehmmm.... we dumped all of the stackforge libs from there?21:39
sdaguewhen did that happen?21:39
boris-42sdague:  be back in 15 minutes..21:39
*** alexpilotti has quit IRC21:39
*** prad has joined #openstack-infra21:40
sdaguefungi: what's the d-g policy around stackforge and d-g? I guess I missed when wsme and friends were completely dropped21:40
clarkbjogo: it should fail due to the ssh thing? or something else?21:40
clarkbjogo: wanting to make sure I understand "it should fail"21:40
fungisdague: i think the original list was "projects we want to cache" and then we determined we could just cache all projects on our workers regardless21:40
stevebakerclarkb: yes, I'd consider patching in the nova docker driver on check-heat-dsvm-functional-mysql, but is there any protection against internal nova plugin api changes breaking the docker driver?21:41
*** reed has quit IRC21:41
*** baoli has joined #openstack-infra21:41
*** reed has joined #openstack-infra21:41
clarkbstevebaker: no clue21:41
*** teran has joined #openstack-infra21:42
*** reed has quit IRC21:42
stevebakerclarkb: afaik Solum does that, so its worth a look21:42
hasharhello :]21:42
hasharI was wondering how to get some Zuul patches to land?  should I list them on the wiki page for tomorrow meeting?21:43
*** dizquierdo has joined #openstack-infra21:43
*** aysyd has quit IRC21:43
clarkbstevebaker: there is an lxc driver too iirc21:43
fungiclarkb: i +2'd 106043 (the multi-node change) but did not approve since it's a relatively intrusive d-g patch and i'm about to disappear to dinner21:43
clarkbfungi: thank you21:44
*** cdent has quit IRC21:44
*** teran has quit IRC21:45
*** teran has joined #openstack-infra21:45
sdaguefungi: oh, ok, so it's already cached?21:46
openstackgerritMerged openstack-infra/system-config: Ensure we only define subunit worker packages once  https://review.openstack.org/13507121:46
sdaguestevebaker: there are no guaruntees21:46
clarkbjogo: ya that resize failed because subnode tried to ssh to primary node's public IP21:46
sdaguedocker driver needs to come back in tree for that to be the case21:47
clarkbjogo: so I think same issue you are running into21:47
*** kgiusti has left #openstack-infra21:47
jogoclarkb: yeah, and the host ssh key isn't known21:47
jogoclarkb: yup http://logs.openstack.org/04/131604/11/experimental/check-tempest-dsvm-aiopcpu/ee91d63/logs/104.130.27.198/screen-n-cpu.txt.gz?level=TRACE#_2014-11-17_21_30_11_03521:48
clarkbjogo: I thought afazekas already handled known host files properly21:49
clarkbbut now I don't see it21:49
stevebakersdague: they seem to be quite happy out of tree for now21:50
sdaguestevebaker: sure21:50
sdaguebut it means they don't get a driver contract21:50
fungisdague: it's cached in /opt/git/stackforge/osprofiler but not copied from there into the devstack warm cache21:50
jogoclarkb: not on the nova side21:51
jogoclarkb: he did that for the devstack-gate stuff21:51
clarkbjogo: but he didn't do it for d-g either21:51
fungiclarkb: in good news, the jenkins module split seems not to have broken the nodepool images i tested updating (bare-trusty and devstack-trusty)21:51
clarkbhe just ignored the keys21:51
jogoclarkb: his patch just turns off known host stuff21:51
jogoright21:51
clarkbjogo: right and I think that is what we want (I just commented on your change)21:52
jogoclarkb: so on my patch series: http://logs.openstack.org/39/134639/9/experimental/check-tempest-dsvm-aiopcpu/6509fdd/logs/screen-n-cpu.txt.gz?level=TRACE21:52
*** tkelsey has joined #openstack-infra21:52
jogothat is new21:52
*** reed has joined #openstack-infra21:52
clarkbbut part of that setup should also make sure nova has the correct known hosts21:52
* fungi wanders off to locate food. back soon21:52
clarkbjogo: also you didn't check https://review.openstack.org/#/c/135070/21:52
*** salv-orlando has quit IRC21:52
jogoclarkb:  I checked on the dependant patch21:53
clarkbjogo: and I don't think that is right ether21:53
reedanteaya, would groups-portal work for https://review.openstack.org/#/c/134330/?21:53
clarkbjogo: your patchset series confuses the hell out of me :)21:53
*** hdd has quit IRC21:53
jogoclarkb: heh21:53
jogoclarkb: I am trying to get tempest-full working21:53
jogoclarkb: so https://review.openstack.org/#/c/134639/921:53
reedfungi, margarita is food :)21:54
jogoclarkb: and http://logs.openstack.org/39/134639/9/experimental/check-tempest-dsvm-aiopcpu/6509fdd/logs/is the latest run on that patch21:54
clarkbjogo: I know and I will say it again. I thinkyou are biting off too much21:54
clarkbjogo: it makes debugging much harder21:54
clarkbthere are about 20 different things going on in that series all completely unrelated to each other21:54
jogoclarkb: as for leaving functions.sh as is, that works for me. we can add a separate step to add the keys21:55
jogoclarkb: they are all related21:55
clarkbhttps://review.openstack.org/#/c/135044/1/devstack-vm-gate.sh is not necessary aiui for example21:55
clarkbotherwise my test would work21:55
*** gokrokve has quit IRC21:55
jogoclarkb: well that one is needed less21:55
clarkbjogo: well hold on. they are related in that we need a few things to get stuff working21:55
*** alexpilotti has joined #openstack-infra21:55
jogoclarkb: that one forces nova to not evaluate localhost for resize21:55
clarkbbut they are not related in the sense that we are logically working on one thing21:55
jogoclarkb: right, they are steps to get tempest-full working in aiopcpu21:56
*** tkelsey has quit IRC21:56
clarkbso I think the first thing you want is consistent HOST_IP21:56
clarkbthen you want ssh_keys21:56
clarkbthen nova no local thing if necessary21:56
clarkbfinally tempest full21:56
jogoclarkb: I haven't really done any ordering of those patches yes21:56
clarkbchecking tempest full at the bottom of that stack tells you ver little about how any of the intermediate steps are working21:57
sdagueok, the gate splosion is testtools 1.4.021:57
jogoclarkb: I have been comparing each step21:57
anteayareed: groups-portal would work for me, yes thank you21:57
jogoclarkb: so I have been doing the delta's in my head21:57
sdagueit broke regex support in testr, some how21:57
jogosdague: wee21:58
*** amitgandhinz has quit IRC21:58
*** amitgandhinz has joined #openstack-infra21:58
reedanteaya, is "-" acceptable?21:58
*** bhunter71 has quit IRC21:58
jogoclarkb: although at this point i just hit a new failure condition: http://logs.openstack.org/39/134639/9/experimental/check-tempest-dsvm-aiopcpu/6509fdd/logs/screen-n-cpu.txt.gz?level=TRACE#_2014-11-17_21_12_12_97821:58
reedanteaya, I mean, do I have to escape it somehow?21:58
clarkbjogo: so hold on21:58
jogohave to dig into the logs a bit more21:58
clarkbjogo: your HOST_IP change is completely wrong21:58
jogoclarkb: oh?21:59
anteayareed: oh I don't know if you have to escape hypens21:59
clarkbjogo: and this is why I think you should rethink how you are doing this21:59
clarkbjogo: HOST_IP is being set to the primary private IP21:59
reedanteaya, I'll try without escaping and see what happens :)21:59
clarkbsub_node=cat primary_private21:59
anteayareed: it is yaml, I don't think hyphens need to be escaped in yaml21:59
anteayareed: good call21:59
*** bhunter71 has joined #openstack-infra22:00
openstackgerritMatthew Treinish proposed openstack/requirements: Exclude testtools 1.4.0  https://review.openstack.org/13509222:01
jogoclarkb: woops that was a typo22:01
*** salv-orlando has joined #openstack-infra22:02
*** bswartz has quit IRC22:03
mordredsdague: testtools sploded the gate _again_?22:04
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/devstack-gate: Add oslo.context to devstack-vm-gate-wrap.sh  https://review.openstack.org/13509322:04
openstackgerritStefano Maffulli proposed openstack-infra/project-config: Grouping the two projects Groups portal in storyboard  https://review.openstack.org/13433022:04
*** jamespage_ has quit IRC22:04
jogoclarkb: so you think set HOST_IP should be first22:05
sdaguemordred: yes22:05
jogoclarkb: although just doing that and resize will still fail22:05
*** michchap_ has quit IRC22:05
*** michchap has joined #openstack-infra22:05
clarkbjogo: and your else there will break normal devstack runs22:06
clarkbjogo: yes, because we can't debug anything else sanely without that first :)22:06
sdagueso, can we just ninja merge all of the testtools blocks?22:06
clarkbjogo: and with it at the end we are compeltely failing at debugging it22:06
sdaguebecause otherwise no one gets to merge code tonight22:06
jogoclarkb: thinking put nova_allow_move_to_same_host at the bottom to make current aiopcpu runs to fail more consistently first22:07
*** Hefeweizen has joined #openstack-infra22:07
clarkbjogo: ya we can do that one first to tickle the bugs more consistentyly22:07
jogothen HOST_IP to make sure standard devstack aio runs work (not aiopcpu)22:07
jogothen go from there22:07
*** shashankhegde has quit IRC22:08
jogoclarkb: these are currently ordered in the order I hit them22:08
jogowhich isn't the order they should be fixed22:08
clarkbwell HOST_IP to make sure standard devsatck works and that aiopcpu uses the expected IP22:08
*** ianw has quit IRC22:08
clarkbthen we do known host setup for those IPs22:08
jogoyup22:08
*** ianw has joined #openstack-infra22:08
*** dkliban is now known as dkliban_afk22:08
jogoclarkb: new patch series going up now22:08
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: Setup ssh_known_host files for aiopcpu  https://review.openstack.org/13467022:09
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: Turn off nova_allow_move_to_same_host if in aiopcpu  https://review.openstack.org/13504422:09
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full  https://review.openstack.org/13463922:09
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: Set HOST_IP to the private interface  https://review.openstack.org/13507022:09
*** spzala has quit IRC22:09
clarkbjogo: 135070 is still really broken though22:09
jogoclarkb: although we will have to wait https://jogo.github.io/gate/22:09
clarkbjogo: it has to do with the if, if else, blocks22:09
clarkbjogo: not really, we can just ignore heat and iterate22:10
*** gondoi is now known as zz_gondoi22:10
sdagueclarkb / fungi - can we ninja merge - https://review.openstack.org/#/q/I561e98bf363d2dd8e8b3a20cea7d2dcbfa034e98,n,z22:10
clarkbjogo: you need to nest the if node type = setup ; else blocks in the if block just before22:10
clarkbsdague: I mean, from the commit message I feel like we haven't really even tested that22:11
jogoclarkb: want to amend the patch, as it sounds like you have a clear picture of what it should be22:11
clarkbsdague: can't we let the gate do what it is supposed to and test it for us?22:11
sdagueclarkb: it's been tested locally22:11
sdagueclarkb: for the gate to do what it does, it will be 12+hrs of blockage22:11
*** Sukhdev has quit IRC22:12
clarkbsdague: why?22:12
sdaguebecause of grenade linkage you need to get icehouse to pass check + gate22:12
sdaguethen recheck juno check + gate22:12
sdaguethen recheck master check + gate22:12
clarkbthats ~3 hours22:12
sdagueit's at least 622:12
sdagueyou can't check juno until icehouse is merged22:13
sdagueand that assumes active sitting on it22:13
sdaguewe *know* this breaks us22:13
clarkbsdague: so the commit message does not say that22:14
clarkbit says "we think this breaks us but it may be tempest's fault or something else but meh"22:14
sdaguemtreinish: can you update the commit message22:14
*** eharney has quit IRC22:14
mtreinishsdague: sure, but update the commit message to say what?22:15
*** tonytan4ever has quit IRC22:16
jogoclarkb: or at least -1 that patch, because I don't see the issue (don't know devstack-gate very well)22:16
*** banix has quit IRC22:17
*** sabeen2 has quit IRC22:18
*** ChuckC has quit IRC22:18
sdaguemtreinish: to whatever clarkb feels is strong enough language to merge this, because your commit message apparently isn't clear enough that this is the reason that everything is broken22:19
*** banix has joined #openstack-infra22:19
mmedvedeThis could be unrelated to the current gate issues, but just in case: we have rebuilt our image 2 hours ago. Now the gate we run does not get to tempest, it fails on devstack, usually failing to install oslo.concurrency: http://dal05.objectstorage.softlayer.net/v1/AUTH_3d8e6ecb-f597-448c-8ec2-164e9f710dd6/pkvmci/134332/17/check-ibm-tempest-dsvm-postgres-full/189e79e/logs/devstacklog.txt.gz22:19
*** ace05 has joined #openstack-infra22:20
mmedvedeGiven, our configuration is not exact copy of upstream, but still22:21
*** asettle has quit IRC22:21
clarkbjogo: ya sorry, I was updating it22:22
anteayammedvede: how do you usually install oslo.concurrency? where do you download it from?22:22
jogoclarkb: thanks22:22
*** hdd has joined #openstack-infra22:22
clarkbsdague: mtreinish: so my concern is you want me to ninja merge changes that basicall say "shrug"22:22
clarkbwe don't ninja merge things like that22:22
jogoharlowja: FYI https://review.openstack.org/#/c/106043/2322:22
harlowjajogo intersting22:23
mtreinishclarkb: 1.4.0 definitely breaks setting attrs with tempest, I'm still trying to dig up why though22:23
clarkbalso I am not entirely convinced that ninja merging things to fix items that are working properly is really what we want to do22:23
sdagueclarkb: I guess that's fine, though that means that fixing bad requirements is orders of magnitude harder than breaking them.22:23
sdagueclarkb: we're effectively asymetric here22:23
sdaguewe ninja merge the breaks by being open ended22:23
*** annegent_ has quit IRC22:23
clarkbsdague: ya I think we need a better way of dealing with this22:24
sdagueif we don't have a fast path to fix it, it just means we're broken a lot, and I lose my afternoon figuring out why22:24
clarkband really all I wanted was a commit message that said enough so that I don't get yelled at for ninja merging it22:24
jogoharlowja: we are working on multi node testing already22:24
sdagueclarkb: I get that22:24
clarkb"Let's exclude this release to unblock the gate, we can always remove the version exclude if it's a bug in tempest's regex or elsewhere."22:25
clarkbis what I have issue with22:25
mtreinishclarkb: ok I'll just drop the last sentence then22:25
clarkbif its a bug in tempest then we should fix tempest22:25
harlowjajogo ya, so thats a start, can add multi-node ABC soon after i guess (where ABC is some other service, redis for example)22:25
mtreinishclarkb: that's what I'm digging into22:25
jogoharlowja: yes, but babysteps22:26
harlowjaagreed22:26
mtreinishthe issues is with: http://git.openstack.org/cgit/openstack/tempest/tree/tempest/test.py#n47 doesn't seem to work with 1.4.0, but it works on all the other testtools releases22:26
*** bhuvan has joined #openstack-infra22:26
jogoharlowja: and we really want multinode nova/neutron first22:26
anteayammedvede: I think pypi.o.o went away, when was the last time you updated your images?22:26
*** gokrokve has joined #openstack-infra22:26
sdagueclarkb: so the question is do we block everyone in openstack while we get to root cause, or do we get people working again, and figure out the root cause without blocking 100+ devs22:26
mmedvedeanteaya: I am investigating the exact reason. Last image update was 2 hours ago.22:26
harlowjajogo sure, gotta start somewhere22:27
*** hashar has quit IRC22:27
*** hdd has quit IRC22:28
anteayammedvede: the image update prior to the one 2 hours ago?22:29
*** mpaolino has quit IRC22:30
mmedvedeanteaya: oh, the prior one was about 4 days22:30
*** Ark has joined #openstack-infra22:31
clarkbsdague: but we aren't blocking everyone. I don't feel blocked at least22:31
*** Ark is now known as Guest8975022:31
clarkb(and I am working on things that are affected and am not in ap uppet corner)22:31
*** dkranz has quit IRC22:31
anteayammedvede: odd, since I thought I reviewed a pypi.o.o change older than 4 days ago22:32
anteayammedvede: it still hasn't merged: https://review.openstack.org/#/c/119466/22:33
*** banix has quit IRC22:33
clarkbjogo: this rebase got nasty somehow :(22:34
anteayammedvede: though this one did on Oct. 28: https://review.openstack.org/#/c/131474/22:34
*** ayoung is now known as ayoung-dadmode22:34
jogorebases do that sometimes22:34
*** jamespage_ has joined #openstack-infra22:34
mmedvedeanteaya: that helps. Looking through my logs now. Thank you22:36
sdagueclarkb: no one can merge code22:36
*** dustins_ has quit IRC22:36
sdagueI'm sitting on a stack of to be merged reviews that I'm throwing out until tomorrow now because it's kind of pointless to build context, then recheck grind on them22:37
sdagueI'm going to have to just stop caring that people can merge code :P22:38
anteayammedvede: np, thanks for sharing22:38
*** banix has joined #openstack-infra22:38
jogosdague: that sounds like the easier solution to me ;)22:38
sdagueand that's how we drive all the developers away from the project22:38
anteayaI have to say I'm sitting on sdague bench on this one22:39
*** jamespage_ has quit IRC22:39
jogoit would be good to have a bug in those commit messages though22:40
mtreinishjogo: is there a bug open for it?22:40
jogomtreinish: don't know been heads down on other things22:41
jogomtreinish: but you can open one22:41
clarkbsdague: I am still waiting for commit message update...22:42
clarkbI didn't say I wouldn't do it22:42
clarkbjust that the commit message puts me in a terrible position22:42
sdaguemtreinish: ?22:42
mtreinishclarkb: oh, sorry I was heads down trying get to the root cause of the testtools bug22:42
mtreinishforgot to remove that sentence22:42
vishyjeblair: have you considered adding github support to gertty?22:42
vishyi bet it would get a ton of usage22:43
anteayavishy: he'll be back on Wednesday22:43
vishydoh!22:43
vishy:)22:43
anteaya:D22:43
*** camunoz has joined #openstack-infra22:44
openstackgerritMatthew Treinish proposed openstack/requirements: Exclude testtools 1.4.0  https://review.openstack.org/13509222:44
SpamapSOk you are all my pip/distutils fail experts..22:45
SpamapShttp://paste.ubuntu.com/9062030/22:45
SpamapSany ideas why this would be failing? 127.0.0.1 is a devpi server22:45
SpamapSWhich happily serves this request when I point from outside a diskimage build.22:45
mtreinishclarkb, sdague: ok I updated the commit message22:46
*** jamespage_ has joined #openstack-infra22:46
jogoSpamapS: check the devpi-server logs22:46
sdaguemtreinish: cool, thanks, I +2/+A all the changes22:46
SpamapS2014-11-17 14:44:12,429 INFO  [req1151] GET /root/pypi/+simple/oslo.middleware/22:46
SpamapS2014-11-17 14:44:12,456 INFO  [req1152] GET /root/pypi/+simple/markupsafe/22:46
jogoSpamapS: I have occasionally have had odd issues and just updated devpi-server22:47
SpamapSI installed this devpi server on Friday. :-P22:47
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Setup ssh_known_host files for aiopcpu  https://review.openstack.org/13467022:47
SpamapSand it actually successfully built an image on Friday22:47
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full  https://review.openstack.org/13463922:47
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Use private addresses everywhere with aiopcpu  https://review.openstack.org/13507022:47
clarkbjogo: ^ that is what I had in mind22:47
*** jamespage_ has quit IRC22:48
* SpamapS adds a break after-error and will check pip.log22:48
jogoclarkb: ahh that make sense22:48
jogoSpamapS: :/ hmm22:49
jogoclarkb: I was wondering why the role block was outside of the  topology if block22:49
clarkbjogo: can you check experimental them?22:49
jogoclarkb: sure22:49
* clarkb goes to looking at requirements changes22:49
SpamapSjogo: /markupsafe does redirect to /MarkupSafe22:49
clarkbjogo: actually if you wait a minute we may have fixed heat tests22:50
clarkbsdague: and 1.4.0 was released to fix trove or some such?22:50
SpamapSjogo: so I'm kind of thinking whatever path we are finding to markupsafe doesn't handle redirects22:50
*** obowersa has quit IRC22:50
jogoSpamapS: yeah that is a good guess, come to think of it I may have seen things like that before22:51
sdagueclarkb: yep22:51
clarkbfungi: mordred: any opposition to me ninja merging the testtools 1.4.0 exclusion with new commit message?22:51
* clarkb has reviewed them and is +2 on the changes regardless22:52
*** alexpilotti has quit IRC22:52
clarkb(though I havne't applied the +2 yet as I can do that when I ninja)22:52
mordredclarkb: do it22:52
jogoSpamapS: I pinged r1chardj0n3s in -dev for you22:52
jogoSpamapS: he should be able to help I think22:52
sdagueclarkb: I'm also going to start a thread on a couple of options here to figure out a better long term game plan, because I think we should come up with some systemic changes to hopefully make this less painful22:53
openstackgerritMerged openstack/requirements: Exclude testtools 1.4.0  https://review.openstack.org/13509222:53
clarkbninjaing complete22:54
sdagueclarkb: thanks!22:55
*** SumitNaiksatam has quit IRC22:56
*** SumitNaiksatam has joined #openstack-infra22:56
*** otherwiseguy has quit IRC22:57
*** dmsimard is now known as dmsimard_away22:57
clarkbjogo: https://review.openstack.org/#/c/134670/9/devstack-vm-gate.sh may hit perms issues on the remote file copy22:57
*** salv-orlando has quit IRC22:58
clarkbjogo: I am not entirely sure how all that magic works22:58
*** bhunter71 has quit IRC22:58
clarkbjogo: but I figured getting the intent up early was good so that we would be on the same page22:59
*** pc_m has quit IRC22:59
*** ryanpetrello has quit IRC23:00
*** salv-orlando has joined #openstack-infra23:00
*** gokrokve has quit IRC23:01
jogoclarkb: I think you forgot to update the ssh_known_hosts for the primary node23:01
*** shashankhegde has joined #openstack-infra23:01
*** gokrokve has joined #openstack-infra23:02
clarkbjogo: oh damn, good catch23:02
*** alexpilotti has joined #openstack-infra23:02
clarkbjogo: its your patchset want to go ahead and just update it?23:02
clarkb(I can as well)23:03
jogoclarkb: go for it23:03
jogoclarkb: I am about to go AFK and relocate to a coffee shop23:03
*** alex7376 has joined #openstack-infra23:03
*** alex7376 is now known as asettle23:03
*** marun has quit IRC23:04
*** gokrokve has quit IRC23:06
*** Guest89750 has quit IRC23:07
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Setup ssh_known_host files for aiopcpu  https://review.openstack.org/13467023:08
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full  https://review.openstack.org/13463923:08
clarkbjogo: ^ I think that will handle potential perms issues too23:08
fungiclarkb: testtools 1.4.0 breaks the world when trying to fix trove tests?23:11
clarkbfungi: yes23:12
*** dizquierdo has quit IRC23:12
fungireviewing now23:12
fungioh, looks like they're all merged23:13
fungiback to getting work done then ;)23:13
*** r-daneel has quit IRC23:14
*** dimtruck is now known as zz_dimtruck23:16
banixThe Neutron OpenDaylight CI does not seem to work properly: https://review.openstack.org/#/c/113999/ I have not been able to trigger a recheck for this CI. Would someone from this CI system  please look into this. Have already emailed them using the address associated with the CI. Thanks.23:17
*** ryansb has left #openstack-infra23:18
*** doug-fish has left #openstack-infra23:19
*** ace05 has quit IRC23:21
*** gyee has quit IRC23:21
*** markmcclain has quit IRC23:22
mtreinishfungi: yeah, although I think I have a 2 part fix on the tempest side now: https://review.openstack.org/#/c/135115/ and https://review.openstack.org/#/c/135108/23:23
jogoclarkb: looks better23:23
*** nelsnelson has quit IRC23:23
*** SumitNaiksatam has quit IRC23:27
fungimtreinish: looks like you need similar wrapping around /usr/local/bin/subunit-gearman-worker.py (puppet sees it as a suplicate declaration because the containing class is instantiated four times on the node)23:28
*** dims_ has joined #openstack-infra23:28
fungiError: Could not retrieve catalog from remote server: Error 400 on SERVER: Duplicate declaration: File[/usr/local/bin/subunit-gearman-worker.py] is already declared in file /opt/system-config/production/modules/subunit2sql/manifests/worker.pp:73; cannot redeclare at /opt/system-config/production/modules/subunit2sql/manifests/worker.pp:73 on node subunit-worker01.openstack.org23:29
*** SumitNaiksatam has joined #openstack-infra23:29
fungis/suplicate/duplicate/23:29
mtreinishfungi: hmm, ok one sec I'll push a patch up for that too23:29
*** zul has quit IRC23:31
*** dims has quit IRC23:32
*** ddieterly has quit IRC23:33
*** mfink has quit IRC23:33
*** banix has quit IRC23:34
jogoit appears running  check experimental23:34
*** ChuckC has joined #openstack-infra23:34
jogo doesn't halt the previous job23:34
jogothat was running23:34
fungijogo: for an earlier patchset?23:36
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Setup ssh_known_host files for aiopcpu  https://review.openstack.org/13467023:36
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full  https://review.openstack.org/13463923:36
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Use private addresses everywhere with aiopcpu  https://review.openstack.org/13507023:36
clarkbjogo: ^ slowly making progress here23:36
*** yjiang5_away is now known as yjiang523:36
fungijogo: if so, then maybe we want dequeue-on-new-patchset for the experimental pipeline23:37
*** amitgandhinz has quit IRC23:37
openstackgerritMatthew Treinish proposed openstack-infra/system-config: Move worker pieces that are only need once to init.pp  https://review.openstack.org/13512123:38
mtreinishfungi: ^^^ I think that should do it23:38
mtreinishwe were going to hit it on every item there which didn't have the suffix var in the name23:38
clarkbI will approve afazekas' change tomorrow once the testtools fallout settles23:38
clarkbfungi: ^23:38
jogofungi: same patch set23:39
jogoor at least I thought it was the same23:39
*** ChuckC has quit IRC23:39
*** banix has joined #openstack-infra23:40
jogofungi: yeah patch https://review.openstack.org/#/c/135044/223:40
*** annegent_ has joined #openstack-infra23:40
fungijogo: oh, well check experimental is like recheck... it only works if it's not already got that patchset already in the pipeline23:40
jogothe previous run failed because of  the testtools stuff23:40
jogofungi: yeah makes sense, I am just impatient ;)23:41
fungiheh23:41
*** mfink has joined #openstack-infra23:41
*** reed has quit IRC23:41
*** annegent_ has quit IRC23:42
*** Ark has joined #openstack-infra23:42
mtreinishfungi, jogo: what, you mean it's not like elevators where the more times you push the button the faster they come?23:42
*** Ark is now known as Guest6090923:42
jogomtreinish: hehe23:42
*** soren has quit IRC23:44
*** unicell has joined #openstack-infra23:47
fungithe current gate subway map would make a great demo screenshot23:47
fungiclarkb: oh, btw, i've so far been unable to identify the logstash queue backlog. was looking at it last week and the cluster is green, no missing systems, i even restarted all 80 of the log worker processes, still no dice23:49
fungimtreinish: that last change still needs work... i think maybe a scoping issue in the config template? http://logs.openstack.org/21/135121/1/check/gate-infra-puppet-apply-precise/b2e7cf9/console.html#_2014-11-17_23_39_51_87523:51
clarkbfungi: its mtreinish's subunit things right?23:51
fungiclarkb: yeah23:51
fungiCould not find value for 'subunit2sql_db_uri' at /home/jenkins/workspace/gate-infra-puppet-apply-precise/openstack-infra/system-config/modules/subunit2sql/templates/subunit2sql.conf.erb:423:51
mtreinishfungi: sigh, I hate puppet23:52
clarkbfungi: I think serfey spun up the DB in trove for us23:52
mtreinishI have to move the subunit2sql config file back into worker.pp where the db_uri gets passed in23:52
fungiclarkb: yeah, this is still a matter of ironing out design issues in the puppet manifest i think23:52
mtreinishgranted that's not a puppet issue, it's just me being sloppy23:52
*** signed8bit has joined #openstack-infra23:53
*** denis_makogon has quit IRC23:54
fungiclarkb: on the jenkins split front i also tested a bare-centos6 image build and that worked too, so hopefully when all the images rebuild en masse tomorrow, everything will be fine23:54
*** melwitt has joined #openstack-infra23:55
*** otherwiseguy has joined #openstack-infra23:55
*** bknudson has quit IRC23:56
*** achanda has quit IRC23:57
openstackgerritMatthew Treinish proposed openstack-infra/system-config: Move worker pieces that are only need once to init.pp  https://review.openstack.org/13512123:58
mtreinishfungi: ^^^ another attempt23:58
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Setup ssh_known_host files for aiopcpu  https://review.openstack.org/13467023:58
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full  https://review.openstack.org/13463923:58
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Use private addresses everywhere with aiopcpu  https://review.openstack.org/13507023:58
clarkbjogo: eventually I should get this right ^23:58
*** bhuvan has quit IRC23:58
fungiclarkb: moar patchsets23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!