Monday, 2016-10-03

*** amitgandhinz has quit IRC00:04
*** darrenc has quit IRC00:07
*** darrenc has joined #openstack-infra00:07
*** mcarden has quit IRC00:07
*** mcarden has joined #openstack-infra00:09
*** akshai has quit IRC00:23
*** yamamoto_ has joined #openstack-infra00:27
*** sshnaidm|afk has quit IRC00:28
*** Goneri has joined #openstack-infra00:32
*** sshnaidm|afk has joined #openstack-infra00:34
*** yamamoto_ has quit IRC00:35
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for cinder/pycparser bug 1629726  https://review.openstack.org/38088200:41
openstackbug 1629726 in Cinder "cinder-manage db sync fails with recompiled pycparser 2.14" [Undecided,Confirmed] https://launchpad.net/bugs/162972600:41
*** Shrews has quit IRC00:47
*** phschwartz has quit IRC00:47
openstackgerritMerged openstack-infra/elastic-recheck: Add query for cinder/pycparser bug 1629726  https://review.openstack.org/38088200:47
openstackbug 1629726 in Cinder "cinder-manage db sync fails with recompiled pycparser 2.14" [Undecided,Confirmed] https://launchpad.net/bugs/162972600:47
*** mordred has quit IRC00:48
*** Shrews has joined #openstack-infra00:48
*** phschwartz has joined #openstack-infra00:50
*** mordred has joined #openstack-infra00:52
*** tonytan4ever has joined #openstack-infra00:52
*** tonytan_brb has joined #openstack-infra00:53
*** tonytan_brb has quit IRC00:53
*** tonytan_brb has joined #openstack-infra00:53
*** mriedem has quit IRC00:55
*** thorst has joined #openstack-infra00:55
*** tonytan4ever has quit IRC00:58
*** tuanluong has joined #openstack-infra00:58
*** amitgandhinz has joined #openstack-infra01:00
*** rfolco has joined #openstack-infra01:02
*** thorst has quit IRC01:04
*** Naeil has joined #openstack-infra01:21
*** AnarchyAo has joined #openstack-infra01:22
*** Goneri has quit IRC01:27
*** baoli has joined #openstack-infra01:28
*** zz_dimtruck is now known as dimtruck01:30
*** dimtruck is now known as zz_dimtruck01:30
*** amitgandhinz has quit IRC01:34
*** baoli has quit IRC01:35
*** kaisers_ has joined #openstack-infra01:37
*** zul has joined #openstack-infra01:40
*** kaisers_ has quit IRC01:41
*** tonytan_brb has quit IRC01:42
*** tonytan4ever has joined #openstack-infra01:50
*** EricGonczer_ has quit IRC01:51
*** EricGonczer_ has joined #openstack-infra01:52
*** esikachev has joined #openstack-infra01:53
*** dkehn has quit IRC01:56
*** esikachev has quit IRC01:58
*** sputnik13 has joined #openstack-infra02:00
*** tqtran has joined #openstack-infra02:02
*** thorst has joined #openstack-infra02:03
*** EricGonczer_ has quit IRC02:04
*** salv-orlando has joined #openstack-infra02:04
*** tqtran has quit IRC02:07
*** dkehn has joined #openstack-infra02:07
*** rfolco has quit IRC02:08
*** salv-orlando has quit IRC02:08
*** thorst has quit IRC02:10
*** pcrews has quit IRC02:14
*** pcrews has joined #openstack-infra02:15
*** sdake has quit IRC02:29
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4  https://review.openstack.org/37120902:29
*** amitgandhinz has joined #openstack-infra02:30
*** hongbin has joined #openstack-infra02:41
*** cardeois has joined #openstack-infra02:43
*** cardeois has quit IRC02:49
*** r1chardj0n3s has joined #openstack-infra02:51
r1chardj0n3sOhai folks02:51
r1chardj0n3sI'm seeing a consistent failure in Horizon's dsvm tempest job in the devstack setup that looks like this: http://logs.openstack.org/36/379236/1/gate/gate-horizon-dsvm-tempest-plugin-ubuntu-xenial/43146b0/console.html02:52
*** yuanying has quit IRC02:52
r1chardj0n3sI'm not entirely sure what's going on, but the error is down a stack of os_brick->oslo.privsep->cffi02:52
*** yuanying has joined #openstack-infra02:53
jheskethr1chardj0n3s: it's possibly related to pycparser release (see os-dev list)02:54
r1chardj0n3sthanks jhesketh02:54
*** mtanino has joined #openstack-infra02:55
*** lezbar has quit IRC03:03
*** lezbar has joined #openstack-infra03:03
*** amitgandhinz has quit IRC03:04
*** salv-orlando has joined #openstack-infra03:04
*** thorst has joined #openstack-infra03:06
*** salv-orlando has quit IRC03:09
*** thorst has quit IRC03:14
*** akshai has joined #openstack-infra03:18
*** sdake has joined #openstack-infra03:21
*** akshai has quit IRC03:21
*** cody-somerville has joined #openstack-infra03:25
*** kaisers_ has joined #openstack-infra03:26
*** vikrant has joined #openstack-infra03:30
*** yamamoto_ has joined #openstack-infra03:31
*** kaisers_ has quit IRC03:31
*** sdake_ has joined #openstack-infra03:38
*** sdake has quit IRC03:40
*** coolsvap has joined #openstack-infra03:41
*** tiswanso has joined #openstack-infra03:42
*** yuanying has quit IRC03:44
*** vikrant is now known as vikrant|brb03:45
*** tiswanso has quit IRC03:46
*** jamesdenton has quit IRC03:47
*** baoli has joined #openstack-infra03:47
*** links has joined #openstack-infra03:49
*** yuanying has joined #openstack-infra03:51
*** baoli has quit IRC03:52
*** hongbin has quit IRC03:53
*** vikrant|brb is now known as vikrant04:00
*** amitgandhinz has joined #openstack-infra04:01
*** salv-orlando has joined #openstack-infra04:05
*** pgadiya has joined #openstack-infra04:09
*** salv-orlando has quit IRC04:10
*** thorst has joined #openstack-infra04:12
*** thorst has quit IRC04:19
*** Sukhdev has joined #openstack-infra04:21
*** amitgandhinz has quit IRC04:35
*** yamamoto_ has quit IRC04:38
*** hichihara has joined #openstack-infra04:51
*** nadya has joined #openstack-infra04:54
*** gouthamr has quit IRC04:56
*** tonytan4ever has quit IRC04:58
*** esikachev has joined #openstack-infra04:59
*** yuanying has quit IRC04:59
*** yuanying_ has joined #openstack-infra04:59
*** esikachev has quit IRC05:03
*** jaosorior has joined #openstack-infra05:04
*** salv-orlando has joined #openstack-infra05:04
*** esikachev has joined #openstack-infra05:15
*** kaisers_ has joined #openstack-infra05:15
*** bhavik1 has joined #openstack-infra05:15
*** bhavik1 has quit IRC05:17
*** thorst has joined #openstack-infra05:18
*** esikachev has quit IRC05:19
*** kaisers_ has quit IRC05:19
*** thorst has quit IRC05:24
*** adriant has quit IRC05:25
ediardoo/05:25
*** nadya has quit IRC05:26
*** Naeil has quit IRC05:26
r1chardj0n3sohai ediardo05:28
ediardoHi r1chardj0n3s05:28
*** yamamoto_ has joined #openstack-infra05:28
*** amitgandhinz has joined #openstack-infra05:31
*** links has quit IRC05:31
*** jaosorior has quit IRC05:31
*** e0ne has joined #openstack-infra05:31
*** nadya has joined #openstack-infra05:32
*** jaosorior has joined #openstack-infra05:32
*** nadya has quit IRC05:34
openstackgerritMasayuki Igawa proposed openstack-infra/devstack-gate: Remove unused tempest runnings  https://review.openstack.org/37397105:34
openstackgerritMasayuki Igawa proposed openstack-infra/devstack-gate: SUPER WIP: Use new tempest run workflow  https://review.openstack.org/35566605:34
*** ccamacho has joined #openstack-infra05:35
*** e0ne has quit IRC05:35
*** Naeil has joined #openstack-infra05:39
*** ccamacho has left #openstack-infra05:39
*** links has joined #openstack-infra05:44
*** esikachev has joined #openstack-infra05:49
*** amotoki has joined #openstack-infra05:49
*** mugsie has quit IRC05:50
*** mugsie has joined #openstack-infra05:51
*** sandanar has joined #openstack-infra05:53
*** esikachev has quit IRC05:54
*** nadya has joined #openstack-infra05:54
*** drifterza has quit IRC05:54
*** salv-orlando has quit IRC06:00
*** nadya has quit IRC06:01
*** rcernin has joined #openstack-infra06:04
*** tqtran has joined #openstack-infra06:04
*** esikachev has joined #openstack-infra06:04
*** amitgandhinz has quit IRC06:06
*** Ravikiran_K has joined #openstack-infra06:06
*** Sukhdev has quit IRC06:09
*** tqtran has quit IRC06:09
*** esikachev has quit IRC06:09
*** dtardivel has joined #openstack-infra06:17
yolandagood morning06:19
*** dizquierdo has joined #openstack-infra06:19
*** r1chardj0n3s has left #openstack-infra06:20
*** esikachev has joined #openstack-infra06:21
*** sdake has joined #openstack-infra06:22
*** thorst has joined #openstack-infra06:22
*** sdake_ has quit IRC06:23
*** rlu has joined #openstack-infra06:24
*** rlu has quit IRC06:25
*** esikachev has quit IRC06:25
*** Naeil has quit IRC06:26
*** rlu has joined #openstack-infra06:28
*** thorst has quit IRC06:29
*** links has quit IRC06:31
*** yuanying_ has quit IRC06:33
*** kevinbenton has quit IRC06:42
*** jtomasek has joined #openstack-infra06:44
*** links has joined #openstack-infra06:44
*** kevinbenton has joined #openstack-infra06:46
*** nadya has joined #openstack-infra06:46
*** salv-orlando has joined #openstack-infra06:50
*** hichihara has quit IRC06:53
*** pcaruana has joined #openstack-infra06:53
*** e0ne has joined #openstack-infra06:54
*** tonytan4ever has joined #openstack-infra06:59
*** amitgandhinz has joined #openstack-infra07:02
*** tesseract- has joined #openstack-infra07:03
*** tonytan4ever has quit IRC07:04
*** nickola has joined #openstack-infra07:04
*** nickola has quit IRC07:09
*** mptacekx has joined #openstack-infra07:09
*** esikachev has joined #openstack-infra07:10
*** sdake_ has joined #openstack-infra07:14
*** sdake_ has quit IRC07:14
*** esikachev has quit IRC07:15
*** sdake has quit IRC07:15
openstackgerritMasayuki Igawa proposed openstack/gertty: Add color style for size column by threshold  https://review.openstack.org/38095007:16
*** matrohon has joined #openstack-infra07:18
*** esikachev has joined #openstack-infra07:18
*** Hal has joined #openstack-infra07:19
*** jpena|off is now known as jpena07:20
*** amoralej|off is now known as amoralej07:22
*** sputnik13 has quit IRC07:23
*** sdake has joined #openstack-infra07:26
*** thorst has joined #openstack-infra07:27
*** drifterza has joined #openstack-infra07:29
*** Hal has quit IRC07:32
*** tnovacik has joined #openstack-infra07:33
*** thorst has quit IRC07:34
*** hashar has joined #openstack-infra07:35
*** amitgandhinz has quit IRC07:36
*** Hal has joined #openstack-infra07:37
*** zigo has quit IRC07:39
*** zigo has joined #openstack-infra07:42
*** zigo is now known as Guest2475607:42
*** jpich has joined #openstack-infra07:43
*** salv-orl_ has joined #openstack-infra07:44
*** dizquierdo is now known as dizquierdo_afk07:45
*** kaisers_ has joined #openstack-infra07:47
*** salv-orlando has quit IRC07:48
openstackgerritIan Y. Choi proposed openstack-infra/git-review: Document for mac users  https://review.openstack.org/38096407:52
*** yuval has joined #openstack-infra07:53
*** yuval has quit IRC07:53
*** bhavik1 has joined #openstack-infra07:54
*** lezbar has quit IRC07:55
*** lezbar has joined #openstack-infra07:56
*** shardy has joined #openstack-infra07:58
*** sdake has quit IRC07:58
*** zzzeek has quit IRC08:00
*** tonytan4ever has joined #openstack-infra08:00
*** zzzeek has joined #openstack-infra08:00
*** kevinbenton has quit IRC08:01
*** dizquierdo_afk is now known as dizquierdo08:02
*** kevinbenton has joined #openstack-infra08:03
*** kevinbenton has quit IRC08:04
*** tonytan4ever has quit IRC08:05
*** kevinbenton has joined #openstack-infra08:06
*** pilgrimstack has joined #openstack-infra08:10
*** ArxCruz has joined #openstack-infra08:14
*** sshnaidm|afk is now known as sshnaidm08:15
*** jordanP has joined #openstack-infra08:22
*** mkarpin has left #openstack-infra08:24
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Undercloud install with tripleo-quickstart  https://review.openstack.org/35891908:24
openstackgerrityolanda.robla proposed openstack-infra/puppet-infracloud: Add the ability to configure dhcp_static_mask  https://review.openstack.org/38097708:30
*** sandanar_ has joined #openstack-infra08:30
*** sandanar__ has joined #openstack-infra08:31
*** thorst has joined #openstack-infra08:32
*** amitgandhinz has joined #openstack-infra08:33
*** lezbar has quit IRC08:33
*** lezbar has joined #openstack-infra08:34
*** sandanar has quit IRC08:34
*** sandanar_ has quit IRC08:35
*** dtantsur|afk is now known as dtantsur08:37
*** thorst has quit IRC08:40
*** mhickey has joined #openstack-infra08:41
*** john-davidge has joined #openstack-infra08:45
*** derekh has joined #openstack-infra08:47
openstackgerrityolanda.robla proposed openstack-infra/puppet-infracloud: Add the ability to pass devuser password to DIB  https://review.openstack.org/38098308:52
*** _degorenko|afk is now known as degorenko08:52
*** Guest24756 is now known as zigo08:54
*** rossella_ has quit IRC08:56
*** rossella_s has joined #openstack-infra08:56
*** yuanying has joined #openstack-infra08:59
strigaziHi yolanda AJaeger is there anything we can do at project level about the pycparser issue? https://github.com/eliben/pycparser/issues/14709:00
*** esikachev has quit IRC09:01
yolandastrigazi, you better check with requirements cores. I fixed one of the projects by setting pycparser to 2.1309:04
yolandabut i see it's listed as pycparser==2.14 on upper requirements09:04
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE TESTING  https://review.openstack.org/31643609:04
yolandaso that better needs to be fixed globally09:04
*** dizquierdo has quit IRC09:05
strigaziyolanda, ok thanks09:05
*** amitgandhinz has quit IRC09:06
*** flepied has quit IRC09:11
*** sambetts|afk is now known as sambetts09:18
*** yolanda has quit IRC09:18
openstackgerritIan Y. Choi proposed openstack-infra/irc-meetings: I18n: change time and chair information  https://review.openstack.org/38099809:19
*** yolanda has joined #openstack-infra09:23
*** jaosorior is now known as jaosorior_lunch09:25
*** electrofelix has joined #openstack-infra09:28
*** esikachev has joined #openstack-infra09:31
strigaziyolanda, I tried to do the same for magnum and it didn't work https://review.openstack.org/#/c/380996/09:32
onovyhi, anyone for final +A pls? https://review.openstack.org/#/c/379400/09:33
yolandastrigazi, i see errors on cinder http://logs.openstack.org/96/380996/1/check/gate-functional-dsvm-magnum-k8s/9f73ce5/logs/devstacklog.txt.gz09:34
yolandaso you shall contact them09:34
yolandaas it's devstack, i guess every project involved shall have it fixed09:34
*** tuanluong has quit IRC09:34
yolandathat's why i think it needs to be managed globally09:34
zigoIt used to take about 1 minute to provision a Jessie VM, now we're back to where we were a few weeks before: it taks 5 minutes now.09:35
*** ramishra has quit IRC09:35
zigoAny idea what happened?09:35
onovyyolanda: thanks09:36
*** thorst has joined #openstack-infra09:37
zigoyolanda: Could you also have a quick look there? https://review.openstack.org/379989 and https://review.openstack.org/38077909:37
yolandasure09:37
zigo(adding deb-zaqar-ui and deb-glare)09:37
zigoCheers.09:38
*** tuanluong has joined #openstack-infra09:38
*** ramishra has joined #openstack-infra09:41
openstackgerritMerged openstack-infra/project-config: Set track-upstream for Swift related Debian packaging projects  https://review.openstack.org/37940009:41
*** tiswanso has joined #openstack-infra09:42
*** flepied has joined #openstack-infra09:43
*** flepied has quit IRC09:43
*** sdake has joined #openstack-infra09:44
*** thorst has quit IRC09:44
*** flepied has joined #openstack-infra09:45
*** flepied has quit IRC09:45
*** flepied has joined #openstack-infra09:46
openstackgerritMerged openstack-infra/project-config: Add deb-zaqar-ui  https://review.openstack.org/37998909:47
*** tiswanso has quit IRC09:47
*** tosky has joined #openstack-infra09:48
*** ihrachys has joined #openstack-infra09:48
*** bauwser is now known as bauzas09:54
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Undercloud install with tripleo-quickstart  https://review.openstack.org/35891909:55
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: Testing undercloud install with oooq  https://review.openstack.org/38101209:57
*** jaosorior_lunch is now known as jaosorior10:01
*** amitgandhinz has joined #openstack-infra10:03
zigoyolanda: Do you know how much HDD space we have in infra instances?10:03
zigoI'm asking, that's to setup swift & cinder scratch disks to run tempest...10:03
zigoMaybe there's ways to get attached disks?10:03
zigo(ie: additional storage...)10:04
*** esikachev has quit IRC10:05
*** tqtran has joined #openstack-infra10:05
yolandazigo i checked on an osic node and we have 90G on /10:07
zigoAh, nice !10:07
zigoyolanda: Is it the same with all providers?10:07
zigoFYI, I'm currently testing with a real bare-metal node & Jenkins, away from infra, but using the Deb repo from there.10:08
zigoI'd like to move it to infra completely, and make it a gate.10:08
*** tqtran has quit IRC10:10
yolandazigo, it depends on provider. For infracloud we have 75G, depending on how flavors are configured10:11
*** tuanluong has quit IRC10:19
*** EricGonczer_ has joined #openstack-infra10:22
*** yamamoto_ has quit IRC10:24
openstackgerritIhar Hrachyshka proposed openstack-infra/project-config: Disable cross check for upper-constraints.txt against swift  https://review.openstack.org/38103110:27
bauzasyolanda: ihrachys made a proposal to temporarly detangle Swift from the u-c job above ^ because that's needed for us merging fixes without cycling over the depends-on10:30
yolandachecking10:31
yolandaAJaeger, around for another +2 on https://review.openstack.org/#/c/381031/1 ?10:32
ihrachysyolanda: I uploaded backports for the version downgrade patch, all depends on their own Change-Id. I see that PS2 is not triggered for 381011 in zuul. Does it mean change-ids are probably messed making zuul failing to recognize the intent?10:33
ihrachysyolanda: if so, should I then reupload backports with different change-ids?10:34
*** rossella_s has quit IRC10:34
*** rossella_s has joined #openstack-infra10:35
sambettsyolanda: https://review.openstack.org/#/c/378502/ this has 2 +2s and the dependent patch is now merged, can you +W it?10:36
*** amitgandhinz has quit IRC10:37
yolandaihrachys, yes, better use different change ids10:39
ihrachysyolanda: ok, respinning. I will probably need to abandon those.10:40
sambettsyolanda: thanks!!10:41
yolandaanytime10:41
*** thorst has joined #openstack-infra10:42
*** tosky has quit IRC10:42
openstackgerritMerged openstack-infra/project-config: Add jobs to networking-cisco for testing version compat  https://review.openstack.org/37850210:45
*** esikachev has joined #openstack-infra10:46
ihrachysyolanda: with different change-ids: https://review.openstack.org/#/q/topic:bug/162983010:48
*** openstackgerrit has quit IRC10:48
ihrachysI will need to recheck when 381031 is in10:48
*** openstackgerrit has joined #openstack-infra10:48
*** thorst has quit IRC10:49
*** ramishra has quit IRC10:49
*** ramishra has joined #openstack-infra10:50
*** EricGonczer_ has quit IRC10:51
*** kaisers_ has quit IRC10:52
*** bhavik1 has quit IRC10:52
*** jkilpatr has quit IRC10:58
*** Ravikiran_K has quit IRC10:59
yolandaihrachys, checking11:00
ihrachysyolanda: whom to pull in for 2nd +2 on https://review.openstack.org/#/c/381031/ ?11:04
yolandaat this time either AJaeger or rcarrillocruz11:05
rcarrillocruzhey11:05
yolandai summoned him :)11:05
rcarrillocruzfrom  bed!11:06
rcarrillocruz+A11:06
*** tosky has joined #openstack-infra11:07
yolandathx11:07
*** martinkopec has joined #openstack-infra11:07
*** slagle has joined #openstack-infra11:10
*** sdake_ has joined #openstack-infra11:12
*** salv-orl_ has quit IRC11:14
*** sdake has quit IRC11:14
*** nadya has quit IRC11:14
openstackgerritMerged openstack-infra/project-config: Disable cross check for upper-constraints.txt against swift  https://review.openstack.org/38103111:15
*** salv-orlando has joined #openstack-infra11:18
ihrachysyolanda: project-config fix in, I respinned all patches to retrigger jobs11:18
yolandanice11:19
*** psanchez has joined #openstack-infra11:21
*** rtheis has joined #openstack-infra11:23
*** yamamoto has joined #openstack-infra11:26
*** lucas-afk is now known as lucasagomes11:26
*** ldnunes has joined #openstack-infra11:32
*** jkilpatr has joined #openstack-infra11:33
*** amitgandhinz has joined #openstack-infra11:33
*** jrollen has joined #openstack-infra11:34
openstackgerritIan Y. Choi proposed openstack-infra/irc-meetings: I18n: change time and chair information  https://review.openstack.org/38099811:40
*** rfolco has joined #openstack-infra11:40
*** rfolco has quit IRC11:41
*** gouthamr has joined #openstack-infra11:41
openstackgerritMerged openstack-infra/puppet-infracloud: Add the ability to configure dhcp_static_mask  https://review.openstack.org/38097711:42
*** thorst has joined #openstack-infra11:47
*** lezbar has quit IRC11:49
*** lezbar has joined #openstack-infra11:50
*** sdake_ is now known as sdake11:52
*** Hal has quit IRC11:53
*** dprince has joined #openstack-infra11:56
*** artmr has joined #openstack-infra11:58
*** Ravikiran_K has joined #openstack-infra11:58
dimsyolanda : if we nuke the pycparser wheel in our pypi mirror  (not the tar.gz!) will bandersnatch pull them again?12:00
dimsAJaeger : ^12:00
openstackgerritPawel Koniszewski proposed openstack-infra/project-config: Add new job to test live migration with grenade  https://review.openstack.org/36480912:00
*** tonytan4ever has joined #openstack-infra12:02
*** dragonmaster has joined #openstack-infra12:02
*** tpsilva has joined #openstack-infra12:03
*** tonytan4ever has quit IRC12:06
*** tqtran has joined #openstack-infra12:06
*** trown|outtypewww is now known as trown12:07
openstackgerritMerged openstack-infra/puppet-infracloud: Add the ability to pass devuser password to DIB  https://review.openstack.org/38098312:07
*** amitgandhinz has quit IRC12:08
*** chlong has joined #openstack-infra12:08
dragonmasterhello12:10
*** psilvad has joined #openstack-infra12:11
*** tqtran has quit IRC12:11
openstackgerritJakub Libosvar proposed openstack-infra/project-config: Add scenarios from Neutron to multinode dvr full job  https://review.openstack.org/35534412:11
*** raildo has joined #openstack-infra12:14
openstackgerritThomas Goirand proposed openstack-infra/project-config: Add deb-glare  https://review.openstack.org/38077912:14
*** chlong has quit IRC12:14
*** pradk has joined #openstack-infra12:14
*** nadya has joined #openstack-infra12:15
*** kgiusti has joined #openstack-infra12:16
*** jrollen has quit IRC12:18
*** tuannguyen has joined #openstack-infra12:19
*** yamamoto has quit IRC12:21
AJaegerdims: I expect it will pull it again.12:21
dimsAJaeger : hmm, thanks! was worth a shot12:22
AJaegerdims: but fungi, clarkb, pabelanger will now better on what options we have12:22
dimsthanks AJaeger12:22
*** edmondsw has joined #openstack-infra12:23
*** chlong has joined #openstack-infra12:26
*** mdrabe has joined #openstack-infra12:30
*** kzaitsev_mb has joined #openstack-infra12:34
openstackgerritIan Y. Choi proposed openstack-infra/git-review: Document for mac users  https://review.openstack.org/38096412:36
*** ralonsoh has joined #openstack-infra12:36
*** pgadiya has quit IRC12:37
*** kashyap has joined #openstack-infra12:38
*** tonytan4ever has joined #openstack-infra12:39
*** erlon has joined #openstack-infra12:40
*** fguillot has joined #openstack-infra12:40
*** kaisers_ has joined #openstack-infra12:40
*** jrollen has joined #openstack-infra12:41
*** moravec has quit IRC12:42
*** jpena is now known as jpena|lunch12:43
*** kaisers_ has quit IRC12:45
*** jrollen has quit IRC12:45
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB  https://review.openstack.org/38109412:45
*** jrollen has joined #openstack-infra12:45
openstackgerritPawel Koniszewski proposed openstack-infra/devstack-gate: DNM: test live-migration + multinode + grenade  https://review.openstack.org/38084012:48
*** rfolco has joined #openstack-infra12:51
*** Goneri has joined #openstack-infra12:53
*** jroll has quit IRC12:53
*** pgadiya has joined #openstack-infra12:54
*** jrollen is now known as jroll12:55
*** kaisers_ has joined #openstack-infra12:57
*** degorenko is now known as _degorenko|afk12:58
*** baoli has joined #openstack-infra12:58
*** mtanino has quit IRC13:02
*** yamamoto has joined #openstack-infra13:04
*** amitgandhinz has joined #openstack-infra13:04
*** Hal has joined #openstack-infra13:06
*** dtantsur is now known as dtantsur|brb13:07
*** gordc has joined #openstack-infra13:08
*** esberglu has joined #openstack-infra13:09
*** esberglu has quit IRC13:10
*** Hal has quit IRC13:10
*** tiswanso has joined #openstack-infra13:10
*** Hal has joined #openstack-infra13:11
cloudnullmornings13:11
*** pgadiya has quit IRC13:12
*** tonytan4ever has quit IRC13:16
*** vikrant has quit IRC13:17
openstackgerritIan Y. Choi proposed openstack-infra/git-review: Document for mac users  https://review.openstack.org/38096413:18
*** matt-borland has joined #openstack-infra13:19
*** amitgandhinz has quit IRC13:20
*** paulobanon has joined #openstack-infra13:20
*** amitgandhinz has joined #openstack-infra13:21
*** amitgandhinz has quit IRC13:23
*** jpeeler has left #openstack-infra13:23
*** amitgandhinz has joined #openstack-infra13:23
*** pgadiya has joined #openstack-infra13:24
*** martinkopec has quit IRC13:25
*** smarcet1981 has joined #openstack-infra13:25
*** akshai has joined #openstack-infra13:26
*** martinkopec has joined #openstack-infra13:28
*** EricGonczer_ has joined #openstack-infra13:31
*** jaosorior has quit IRC13:31
*** jaosorior has joined #openstack-infra13:32
*** tonytan4ever has joined #openstack-infra13:32
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute070.chocolate public and provisioning IP addresses  https://review.openstack.org/38112313:33
*** tonytan4ever has quit IRC13:33
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute071.chocolate public and provisioning IP addresses  https://review.openstack.org/38112513:35
openstackgerritIan Y. Choi proposed openstack-infra/git-review: Document for mac users  https://review.openstack.org/38096413:35
*** esberglu has joined #openstack-infra13:38
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Add compute071.chocolate to Puppetmaster Ansible inventory  https://review.openstack.org/38112813:38
*** tonytan4ever has joined #openstack-infra13:38
anteayamorning cloudnull13:39
*** EricGonczer_ has quit IRC13:39
*** eharney has joined #openstack-infra13:41
*** martinkopec_ has joined #openstack-infra13:41
*** martinkopec has quit IRC13:42
*** dizquierdo has joined #openstack-infra13:42
*** jpena|lunch is now known as jpena13:42
*** moravec has joined #openstack-infra13:43
*** salv-orl_ has joined #openstack-infra13:44
*** Hal has quit IRC13:44
openstackgerritMerged openstack-infra/system-config: Update compute070.chocolate public and provisioning IP addresses  https://review.openstack.org/38112313:46
*** salv-orlando has quit IRC13:47
*** hongbin has joined #openstack-infra13:47
*** cardeois has joined #openstack-infra13:48
*** eharney has quit IRC13:49
openstackgerritMerged openstack-infra/system-config: Update compute071.chocolate public and provisioning IP addresses  https://review.openstack.org/38112513:49
*** Hal has joined #openstack-infra13:50
*** Hal has quit IRC13:51
*** EricGonczer_ has joined #openstack-infra13:52
*** mtanino has joined #openstack-infra13:52
*** Hal has joined #openstack-infra13:52
*** EricGonczer_ has quit IRC13:53
*** EricGonczer_ has joined #openstack-infra13:53
openstackgerritMerged openstack-infra/system-config: Add compute071.chocolate to Puppetmaster Ansible inventory  https://review.openstack.org/38112813:54
*** alyson_ has joined #openstack-infra13:56
*** EricGonczer_ has quit IRC13:56
*** moravec has quit IRC14:00
*** tuannguyen has quit IRC14:01
*** eharney has joined #openstack-infra14:01
*** moravec has joined #openstack-infra14:02
*** amitgandhinz has quit IRC14:03
*** dizquierdo has quit IRC14:03
*** tuannguyen has joined #openstack-infra14:03
*** amitgandhinz has joined #openstack-infra14:03
anteayapleia2: happy Rosh Hashanah14:05
*** claudiub has joined #openstack-infra14:05
anteayaif that is the appropriate wish for the event14:06
cloudnullo/ anteaya14:07
*** mriedem has joined #openstack-infra14:07
*** burgerk has joined #openstack-infra14:07
openstackgerritIan Y. Choi proposed openstack-infra/git-review: Document for mac users  https://review.openstack.org/38096414:09
*** woodster_ has joined #openstack-infra14:10
openstackgerritRodolfo Alonso Hernandez proposed openstack-infra/project-config: Add new project: devstack-plugin-libvirt-qemu  https://review.openstack.org/37792014:10
*** martinkopec has joined #openstack-infra14:11
*** rbrndt has joined #openstack-infra14:11
*** tiswanso has quit IRC14:12
*** ricardoas has joined #openstack-infra14:13
*** tiswanso has joined #openstack-infra14:13
*** andreww has quit IRC14:13
*** martinkopec_ has quit IRC14:14
mriedemclarkb: i notice that we're not getting e-r updates? http://status.openstack.org//elastic-recheck/index.html Last Elastic Search Index Update: Thu Sep 29 2016 13:55:08 GMT-0500 (Central Standard Time)14:15
mriedemis the service running?14:16
anteayamriedem: we had issues that we addressed friday night and workers were running when we signed off for the evening14:17
*** pblaho has joined #openstack-infra14:17
anteayahowever yes, if the index hasn't updated since thursday there needs to be further examination14:17
*** beekneemech is now known as bnemec14:18
*** dtantsur|brb is now known as dtantsur14:20
*** jed56 has joined #openstack-infra14:21
*** _degorenko|afk is now known as degorenko14:22
*** martinkopec has quit IRC14:26
anteayalooking at cacti the logstash workers appear to be working14:27
anteayalogstash17 and logstash10 have very strange graphs for internal traffic I note14:27
*** krtaylor has quit IRC14:28
*** rodrigods has quit IRC14:29
*** rodrigods has joined #openstack-infra14:29
*** rajinir has joined #openstack-infra14:29
*** moravec has quit IRC14:31
*** Hal has quit IRC14:31
rajinirIs any seeing this error in the gates? Running setup.py bdist_wheel for cryptography: finished with status 'error'14:32
anteayarajinir: is it this issue? https://github.com/eliben/pycparser/issues/14714:32
rajiniranteaya>: Yes14:33
dimsrajinir : the proposed fixes for downgrading pycparser have merged (https://review.openstack.org/#/q/status:merged+project:openstack/requirements++topic:bug/1629830)14:34
anteayadims: thank you, that was my next question :)14:34
*** rossella_s has quit IRC14:34
dimsrajinir : please recheck the review/job(s) that failed14:34
*** rlu has quit IRC14:35
rajinirdims: Thanks , will check14:35
*** martinkopec has joined #openstack-infra14:35
*** rossella_s has joined #openstack-infra14:35
anteayarajinir: have a tea first, give them another 30 minutes or so to propigate14:35
rajiniranteaya: Sure thank14:36
rajinirs14:36
anteayathe one to master merged about 40 minutes ago, it might not be out on the nodes yet14:36
anteayathank you14:36
*** pgadiya has quit IRC14:37
*** andreww has joined #openstack-infra14:37
prometheanfirethings slow?14:37
prometheanfiregit fetch git://git.openstack.org/openstack-infra/project-config refs/changes/65/310865/10 && git format-patch -1 --stdout FETCH_HEAD14:37
prometheanfiretaking forever (minutes at least)14:38
anteayaprometheanfire: what service do you feel is slow, the git servers?14:39
*** cody-somerville has quit IRC14:39
*** xyang1 has joined #openstack-infra14:39
*** cody-somerville has joined #openstack-infra14:39
*** martinkopec has quit IRC14:39
prometheanfireya14:39
*** annegentle has joined #openstack-infra14:40
prometheanfirenot sure if something is going on, but that fetch seems to be timing out to my eyes14:40
*** testazef has joined #openstack-infra14:40
*** martinkopec has joined #openstack-infra14:41
*** testazef has quit IRC14:41
anteayaprometheanfire: I looked at the farm in cacti and so far don't see anything unusual14:43
anteayaI also cloned from each git server individually and didn't have an issue14:44
prometheanfiremhayden: run this for me14:44
prometheanfiregit fetch git://git.openstack.org/openstack-infra/project-config refs/changes/65/310865/10 && git format-patch -1 --stdout FETCH_HEAD14:44
anteayaare you working from your normal work environment?14:44
prometheanfiremight be firewall, this is my normal env, but work likes changing the firewall...14:44
anteayaah14:45
*** psilvad has quit IRC14:45
anteayayes if someone decided that co-workers needed some monday firewall fun there isn't much I can do14:45
prometheanfireyarp14:45
*** spzala has joined #openstack-infra14:46
*** psilvad has joined #openstack-infra14:46
openstackgerritPawel Koniszewski proposed openstack-infra/devstack-gate: DNM: test live-migration + multinode + grenade  https://review.openstack.org/38084014:46
*** moravec has joined #openstack-infra14:48
openstackgerritJakub Libosvar proposed openstack-infra/project-config: Add scenarios from Neutron to multinode dvr full job  https://review.openstack.org/35534414:48
*** john-davidge has quit IRC14:52
*** narayrak has joined #openstack-infra14:54
fungidims: what's the problem with the pycparser wheel? do you have a bug you can link to so i can read up on it?14:55
openstackgerritMatthew Thode proposed openstack-infra/project-config: Add Gentoo support to nodepool  https://review.openstack.org/31086514:55
fungimaybe there's something in an ml message i haven't gotten to yet14:55
anteayadims: https://github.com/eliben/pycparser/issues/14714:56
openstackgerritMatthew Thode proposed openstack-infra/project-config: Build Gentoo image for basic testing in OSA  https://review.openstack.org/31586514:56
anteayaprometheanfire: looks like you figured out your issue?14:56
anteayafungi: I haven't seen a ml thread about it14:57
*** moravec has quit IRC14:57
prometheanfireya, just switched to https for now14:57
anteayafungi: sorry I highlighted dims and meant to highlight you on the bug link14:57
anteayaprometheanfire: okay14:57
fungianteaya: thanks14:58
anteayawelcome14:58
*** bin_ has joined #openstack-infra14:58
dimsfungi : anteaya thanks, the ML discussion was on http://markmail.org/message/6kmnatglvbeyawy214:59
*** Hal has joined #openstack-infra14:59
dimsirc traffic was in -requirements channel14:59
anteayaah gate completely borked, yeah15:00
fungidims: i believe bandersnatch will normally delete anything that's deleted on pypi15:00
*** cardeois has quit IRC15:01
dimsfungi : the release tar.gz was fine, the wheel on pypi was busted. so was trying to see if we can nuke just the wheel from our mirrors and get by15:01
fungidims: right, and i'm saying it's supposed to do that automatically since it was deleted from pypi according to that github issue15:01
fungii'm going to check our bandersnatch logs in a moment to see what serial that's reflected in15:02
*** annegentle has quit IRC15:02
*** annegentle has joined #openstack-infra15:02
*** cardeois has joined #openstack-infra15:03
*** r-mibu has quit IRC15:03
*** links has quit IRC15:04
*** r-mibu has joined #openstack-infra15:04
*** yamamoto has quit IRC15:04
*** fguillot has quit IRC15:04
fungi2016-10-03 14:55:02,899 INFO: Syncing package: pycparser (serial 2377706)15:05
fungiso in theory this should have updated ~5-10 minutes ago15:05
jeblairAJaeger: are we certain that openstack-manuals is putting a .root-marker at / ?15:05
*** martinkopec has quit IRC15:05
openstackgerritMatthew Thode proposed openstack-infra/project-config: Add Gentoo support to nodepool  https://review.openstack.org/31086515:06
fungidims: i no longer see any pycparser-2.14-py2.py3-none-any.whl at, e.g., http://mirror.iad.rax.openstack.org/pypi/simple/pycparser/15:06
*** vinaypotluri has joined #openstack-infra15:06
AJaegerjeblair: good morning15:06
AJaegerrunning tox -e checkbuild I see it in15:07
AJaegerjeblair: ... in publish-docs/.root-marker15:07
AJaegerjeblair: and directly after a merge the content is there - including the root-marker. But then the next publishing jobs removes it again.15:07
vsaienk0clarkb, devstack-gate core please review: https://review.openstack.org/#/c/364830. Update patch according to clarkb suggestions.15:08
jeblairAJaeger: okay, i'll look into some ideas based on the assumption that is working15:08
AJaegerjeblair: So, I wonder whether we need to put in root-marker files into each guide - but wonder how to update the top-level directory in that case15:08
prometheanfireAJaeger: https://review.openstack.org/310865 is ready now :D15:08
openstackgerritMatthew Thode proposed openstack-infra/project-config: Build Gentoo image for basic testing in OSA  https://review.openstack.org/31586515:08
*** dtantsur is now known as dtantsur|mtg15:08
prometheanfire^ isn't needed as much right now15:09
dimsfungi : thanks. looks like they yanked it https://github.com/eliben/pycparser/issues/147#issuecomment-25112790415:09
automagicallyHello infra, wondering if someone here could help me understand what’s going with http://logs.openstack.org/33/381133/1/check/gate-openstack-ansible-os_ceilometer-ansible-func_gnocchi-ubuntu-xenial-nv/24c4a97/console.html#_2016-10-03_14_39_11_89945315:09
AJaegerfungi, pabelanger, could you check 310865 as well, please? The non-rebased version looked sane15:09
AJaegerjeblair: suggested test case: Take a tree, copy over openstack-manuals (after building with tox -e publishdocs) and then copy over anything else15:10
AJaegerjeblair: if you have some test framework, I can try to find some time later and help checking where it goes wrong15:10
*** cody-somerville has quit IRC15:11
AJaegerautomagically: your tox line seems to be too long and the interpreter is not found?15:11
fungidims: yep, that was the comment to which i was referring15:12
AJaegerautomagically: yeah, that looks like the issue. You need to shorten the job15:12
automagicallyAJaeger: Thx, appreciate the help15:12
dimsfungi : gotcha. thanks for checking15:13
*** ianychoi has quit IRC15:13
*** dizquierdo has joined #openstack-infra15:14
*** sandanar__ has quit IRC15:15
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute093.chocolate public and provisioning IP addresses  https://review.openstack.org/38118115:17
*** pcaruana has quit IRC15:18
*** narayrak has quit IRC15:19
*** andreww is now known as xarses15:19
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute095.chocolate public and provisioning IP addresses  https://review.openstack.org/38118315:19
*** cardeois has quit IRC15:19
*** rcernin has quit IRC15:19
*** hashar is now known as hasharAway15:20
*** EricGonczer_ has joined #openstack-infra15:21
openstackgerritTravis Truman (automagically) proposed openstack-infra/project-config: Shorten OSA role job names  https://review.openstack.org/38118515:21
automagicallyAJaeger: ^ guessing that should resolve the issue, right?15:21
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute092.chocolate public and provisioning IP addresses  https://review.openstack.org/38118615:22
AJaegerautomagically: subject looks fine;) let me check15:22
automagicallyThx again15:22
*** cardeois has joined #openstack-infra15:22
*** Guest92 has joined #openstack-infra15:23
*** Guest92 is now known as rushil15:23
AJaegeryou reference now a job that does not exist15:23
*** yamamoto has joined #openstack-infra15:23
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute094.chocolate public and provisioning IP addresses  https://review.openstack.org/38118315:23
AJaegerautomagically: sorry, can't help further now, will be back later...15:24
openstackgerritMatthew Thode proposed openstack-infra/project-config: Add Gentoo support to nodepool  https://review.openstack.org/31086515:25
prometheanfireAJaeger: amended with a note, also cleaned up the laid down file15:25
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute093.chocolate public and provisioning IP addresses  https://review.openstack.org/38118115:25
openstackgerritMatthew Thode proposed openstack-infra/project-config: Build Gentoo image for basic testing in OSA  https://review.openstack.org/31586515:26
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute093.chocolate public, provisioning and iLO IP addresses and add metadata   https://review.openstack.org/38118115:26
*** cardeois has quit IRC15:28
*** Sukhdev has joined #openstack-infra15:28
*** cardeois has joined #openstack-infra15:28
*** artom has joined #openstack-infra15:32
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute091.chocolate public, provisioning and iLO and add metadata  https://review.openstack.org/38119315:33
*** cardeois_ has joined #openstack-infra15:33
*** artom has left #openstack-infra15:34
*** vhosakot has joined #openstack-infra15:34
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB  https://review.openstack.org/38109415:35
*** AnarchyAo has quit IRC15:35
*** cardeoi__ has joined #openstack-infra15:35
*** cardeois has quit IRC15:35
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute090.chocolate public and provisioning IP addresses  https://review.openstack.org/38119615:36
*** rhe00 has joined #openstack-infra15:37
*** davidlenwell has quit IRC15:37
*** artom has joined #openstack-infra15:37
*** cardeois_ has quit IRC15:37
artomIs this the right place to harass folks about openstack planet blog inclusion?15:38
anteayaartom: well you can ask15:38
*** cody-somerville has joined #openstack-infra15:38
artomanteaya, consider it asked :)15:38
anteayasorry I missed the question15:38
anteayaare you questioning a blog that is included or are you wondering how to include your own?15:39
fungiartom: we aren't the ones who generally review proposed changes for it, but the sysadmins for the server it runs on coordinate work in here15:39
jeblairartom: it's managed in this repo: https://git.openstack.org/cgit/openstack/openstack-planet15:39
artomanteaya, shamlessly pushing my review here: https://review.openstack.org/#/c/378780/15:39
artomjeblair, ^^15:40
rcarrillocruzon nice, i didn't know the planet was version controlled15:40
rcarrillocruz++15:40
anteayaartom: so you are looking for a review of you planet patch, now I understand15:41
fungircarrillocruz: the contents aren't, but the configuration is15:41
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute089.chocolate public and provisioning IP addresses  https://review.openstack.org/38119815:41
anteayaartom: you need to find two of these people: https://review.openstack.org/#/admin/groups/93,members15:41
*** jtomasek_ has joined #openstack-infra15:41
*** moravec has joined #openstack-infra15:41
*** eranrom has quit IRC15:42
*** e0ne has quit IRC15:42
*** dprince has quit IRC15:42
rcarrillocruzyup, i figured15:42
artomanteaya, somehow bugging mordred for this seems... inappropriate? :D15:42
rcarrillocruzi always toyed with the idea of including my blog, but given my erratic blogging i better not15:42
artomrcarrillocruz, is there a minimum posts/month requirement? ;)15:43
rcarrillocruzfungi, pabelanger : can i get your eyes on https://review.openstack.org/#/c/378996/ when you get a sec pls ?15:43
*** mfisch` is now known as mfisch15:43
artomanteaya, thanks for your help, btw :)15:43
jeblairartom: why would that be inappropriate?15:43
*** mfisch is now known as Guest722315:43
rcarrillocruzartom: if i had asked myself that question i would have put it as 'if there a minimum post / per 5 years requirement ' :D15:43
anteayaartom: well you just did, I'm not sure why asking someone who is listed as a core reviewer on a repo to review a patch15:43
anteayaand you are welcome, now that we understand what you need15:44
openstackgerritTravis Truman (automagically) proposed openstack-infra/project-config: Shorten OSA role job names  https://review.openstack.org/38118515:44
*** lezbar has quit IRC15:44
anteayaartom: to finish, to review a patch would be considered inappropriate15:45
*** lezbar has joined #openstack-infra15:45
*** moravec1 has joined #openstack-infra15:45
artomanteaya, eh? I'm not sure I understand15:46
*** tuannguyen has quit IRC15:47
jeblairartom: anteaya and i are both wondering why it would be inappropriate for you to ask mordred to review your patch15:47
openstackgerritMerged openstack-infra/system-config: Update compute093.chocolate public, provisioning and iLO IP addresses and add metadata   https://review.openstack.org/38118115:47
anteayajeblair: thank you, yes my two part question approach isn't the best15:47
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute089.chocolate public and provisioning addresses plus the rack metadata  https://review.openstack.org/38120215:47
openstackgerritTravis Truman (automagically) proposed openstack-infra/project-config: Shorten OSA role job names  https://review.openstack.org/38118515:48
*** moravec has quit IRC15:48
anteayaautomagically: I don't think that will do it, that takes you from 75 characters to 70, when I played this game last week with someone15:48
automagicallyanteaya: What’s the magic limit?15:48
artomjeblair, in my head it'd be like asking Linus to err, I dunno, <insert trivial tag here>.15:48
anteayaansible again and celometer again strangely enough, 63 characters were too much15:48
anteayaautomagically: I don't know but less than 6315:49
*** esikachev has quit IRC15:49
*** Guest7223 is now known as mfisch15:49
*** mfisch has quit IRC15:49
*** mfisch has joined #openstack-infra15:49
jeblairartom: oh, because mordred is such an esteemed personage?15:49
automagicallyThx anteaya15:49
anteayaha ha ha15:49
fungiartom: clearly you've not spent much time with mordred ;)15:49
anteayaautomagically: welcome, should you discover the limit do share15:49
artomjeblair, not necessarily esteemed - I mean, that's subjective, and I don't know him well enough15:49
automagicallyWill do15:49
artomBut, err, historic?15:49
anteayaautomagically: right now the best I have is <6315:49
jeblairartom: well, we don't got in for the cult of personality much around here15:49
anteayahistoric he is15:49
*** davidlenwell has joined #openstack-infra15:50
fungiartom: also, openstack has no bdfl. mordred is just as much a cog in the machine as the rest of us15:50
jeblairartom: and if he doesn't review patches, he can get removed from the core group, just like anyone else :)15:50
jeblairartom: so you'd be doing him a favor by asking him15:50
artomjeblair, hehe, OK, thanks for putting my impressions in line with reality15:51
artomAnd I did ping him earlier, so...15:51
artomThe ball's in his court15:51
*** harlowja_at_home has joined #openstack-infra15:53
pabelangerrcarrillocruz: double check with fungi, but I think we just put the proper hostname in vhost section then just point local hosts to IP of cacti02.o.o for testing15:53
*** eliqiao has quit IRC15:53
*** Sukhdev has quit IRC15:54
fungircarrillocruz: pabelanger: right, that's what i mean by "getting rid of fqdnisms in our puppet modules"15:54
*** Sukhdev has joined #openstack-infra15:54
fungithere are a lot of baked-in assumptions right now about things like that the vhost site name is the same as the server's fqdn. instead it needs to get parameterized and plumbed all the way through from the instantiating class15:55
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute088.chocolate public and provisioning addresses plus the rack metadata  https://review.openstack.org/38120215:55
fungiwhich is why we've mostly only been putting effort into doing that for new services we're bringing online, but if you want to tackle making an established module support it (with backward-compatible defaults for the benefit of existing downstream consumers) then that's fine by me15:56
*** eliqiao has joined #openstack-infra15:56
*** tesseract- has quit IRC15:56
ShrewsTIL that people actually respect mordred for some odd reason15:58
*** jtomasek_ has quit IRC15:58
*** moravec1 has quit IRC15:58
lcastellHi guys, anyone can tell me what configuration I need to put/change/remove in project-config in order to get rid of the 'docs' job at the gate?15:58
jeblairShrews: if mordred gets wind of this, we will never hear the end of it15:58
Shrewsjeblair: QUICK! ERASE THE INTERNET!15:59
*** mriedem1 has joined #openstack-infra15:59
jeblair^L15:59
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Add cacti2 replacement node to Puppet  https://review.openstack.org/37899615:59
rcarrillocruzpabelanger , fungi : published edit15:59
clarkblcastell: there are two portions, jenkins/jobs/ to configure the job itself and zuul/layout.yaml to decide when the jobs run. Ehat are you trying to achieve?15:59
*** Teresita-Warrior has joined #openstack-infra16:00
*** mriedem has quit IRC16:00
*** shardy has quit IRC16:00
*** mhickey has quit IRC16:00
*** fguillot has joined #openstack-infra16:00
*** moravec has joined #openstack-infra16:01
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute091.chocolate public, provisioning and iLO and add metadata  https://review.openstack.org/38119316:01
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute089.chocolate public and provisioning IP addresses  https://review.openstack.org/38119816:01
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute090.chocolate public and provisioning IP addresses  https://review.openstack.org/38119616:01
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute092.chocolate public and provisioning IP addresses  https://review.openstack.org/38118616:01
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute089.chocolate public and provisioning addresses plus the rack metadata  https://review.openstack.org/38120216:01
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute095.chocolate public and provisioning IP addresses  https://review.openstack.org/38118316:01
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute087.chocolate public and provisioning IP addresses  https://review.openstack.org/38120616:01
*** mriedem1 is now known as mriedem16:01
lcastelljust want to disable the docs job in a project since it does't need it clarkb16:01
*** tiswanso has quit IRC16:01
lcastellI think my problem is I'm using python-jobs16:01
*** baoli has quit IRC16:01
*** devananda|away is now known as devananda16:02
*** tiswanso has joined #openstack-infra16:02
*** csomerville has joined #openstack-infra16:02
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute086.chocolate public and provisioning IP addresses  https://review.openstack.org/38120816:03
*** baoli has joined #openstack-infra16:03
*** baoli has quit IRC16:03
*** dragonmaster has quit IRC16:03
fungilcastell: alternatively, grab the sphinx boilerplate from the cookiecutter repo. you can use it to do things like publish your readme even if you don't have any more formal docs (yet), and that way you're easily set up to add such additional documentation later16:03
jeblairlcastell: yes, probably so, but remember the famous proverb: "every project needs a docs job"16:03
*** baoli has joined #openstack-infra16:04
lcastellthat sounds like a good option too fungi :)16:05
lcastellThanks!16:05
*** dtantsur|mtg is now known as dtantsur16:05
*** ianychoi has joined #openstack-infra16:05
*** cody-somerville has quit IRC16:06
*** artom has left #openstack-infra16:06
*** chlong has quit IRC16:06
*** tqtran has joined #openstack-infra16:08
*** chem has quit IRC16:08
*** esikachev has joined #openstack-infra16:08
dtantsurpublishing the readme is something I did once or twice to get a placeholder for the docs job16:08
*** tuannguyen has joined #openstack-infra16:09
*** krtaylor has joined #openstack-infra16:09
*** matrohon has quit IRC16:09
*** Ravikiran_K_ has joined #openstack-infra16:10
openstackgerritMike Fedosin proposed openstack-infra/project-config: Create glare-specs project  https://review.openstack.org/37074916:10
*** Ravikiran_K has quit IRC16:10
rcarrillocruzin other news, ansible 2.2 RC1 is out16:11
rcarrillocruzi love this from the announcement mail16:11
rcarrillocruz"Major performance improvements. In many cases, you should see a 2-3x improvement over 2.1/2.0"16:11
rcarrillocruzand let's not forget inclusion of http://docs.ansible.com/ansible/include_role_module.html16:11
fungidtantsur: i don't even consider that a placeholder. it's a perfectly reasonable solution for projects that only need a one-page document16:11
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute085.chocolate public and provisioning IP addresses  https://review.openstack.org/38121316:12
fungiwell, rather i don't _necessarily_ consider it a placeholder16:12
automagicallyanteaya: The limit seems to come from the max length of a shebang, see https://github.com/pypa/virtualenv/issues/59616:12
dtantsurfair, yeah, back then our whole documentation was one huge readme :)16:12
*** tqtran has quit IRC16:12
fungiautomagically: yep, it's a well-known issue and we encourage projects to try and keep job names brief for their tox-based jobs16:12
*** tuannguyen has quit IRC16:14
fungibasically you can count up the length of the path by knowing that the shebang tox will use in its virtualenvs fits a pattern of /home/jenkins/workspace/<jobname>/.tox/<envname>/bin/python16:14
clarkbmaybe we should use a bsd for the jobs16:14
automagicallyThx fungi16:14
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute084.chocolate public and provisioning IP addresses  https://review.openstack.org/38121516:14
*** gyee has joined #openstack-infra16:15
*** caphrim007 has joined #openstack-infra16:15
pabelangerrcarrillocruz: so, still seeing a few launch failures when we upload a new image. Need to see what the default timeout is when we download an image for the first time.16:16
rcarrillocruzyeah16:16
rcarrillocruzi've been cautious of not bringing chocolate yet16:16
rcarrillocruzat least till we get the new cacti16:17
*** dprince has joined #openstack-infra16:17
pabelangerya16:17
rcarrillocruzwho knows if the current workaround of swapfile is not enough, i've brought up a ton of computes in chocolate16:17
pabelangerI was trying to see how much bandwidth we were using, but see the blank spots16:17
jeblairyeah, it's pretty much continuously swapping, so that's no good :)16:18
*** tphummel has joined #openstack-infra16:19
*** ihrachys has quit IRC16:19
openstackgerritMerged openstack-infra/system-config: Update compute095.chocolate public and provisioning IP addresses  https://review.openstack.org/38118316:20
*** nadya has quit IRC16:25
*** vinaypotluri has left #openstack-infra16:27
*** smarcet1981 has quit IRC16:28
fungiright, i think the load and vmem utilization indicate that we want a 4gb flavor for the replacement16:28
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute083.chocolate public and provisioning IP addresses  https://review.openstack.org/38123016:28
*** jpich has quit IRC16:28
cloudnullwhere are we with newton16:29
cloudnullha. wrong channel16:29
cloudnulldisregard16:29
rcarrillocruzfungi: yeah, the replacement is there, used a 4GB16:30
*** sdake has quit IRC16:30
*** moravec has quit IRC16:30
*** csomerville has quit IRC16:30
rcarrillocruzare we all good with https://review.openstack.org/#/c/378996/ then?16:30
rcarrillocruzcacti puppet node change ^16:31
anteayaautomagically: thank you for sharing16:31
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Update compute082.chocolate public and provisioning IP addresses  https://review.openstack.org/38123516:32
anteayarcarrillocruz: you have cacti02 on a trusty node?16:32
rcarrillocruzyes16:32
fungicurious why it wasn't cacti01, but whatever. a name's a name16:33
anteayaokay thank you16:33
openstackgerritMerged openstack-infra/system-config: Update compute092.chocolate public and provisioning IP addresses  https://review.openstack.org/38118616:33
rcarrillocruzyeah, it will be renamed afterwards anyways16:33
openstackgerritMerged openstack-infra/system-config: Update compute091.chocolate public, provisioning and iLO and add metadata  https://review.openstack.org/38119316:33
openstackgerritMerged openstack-infra/system-config: Update compute090.chocolate public and provisioning IP addresses  https://review.openstack.org/38119616:33
rcarrillocruzthanks16:33
fungircarrillocruz: looking at the change now. it doesn't appear to be generalized for an arbitrary number of hosts yet16:34
*** sdake has joined #openstack-infra16:34
fungircarrillocruz: renamed?16:34
fungircarrillocruz: i don't understand. why would it be renamed?16:34
*** Swami has joined #openstack-infra16:34
*** trown is now known as trown|lunch16:34
rcarrillocruzwe chatted last week that you normally just spin a new VM with the same name, as the inventory uses a different UUID16:34
rcarrillocruzbut in some cases you opted for creating a new node, with other name16:35
rcarrillocruzthen do the import of content16:35
rcarrillocruzand get rid of the thing16:35
rcarrillocruzand the latter is what I'm after16:35
fungino, we spin up a node with a new name and then cname the friendly name to it16:35
fungiwe don't rename it16:35
rcarrillocruzjust for sanity, i'd just replace cacti02 to cacti once the old one is decommissioned16:35
*** drifterza has quit IRC16:35
*** mriedem has quit IRC16:35
rcarrillocruzthat works too16:36
fungifor example, see firehose01.openstack.org, which has a firehose.openstack.org cname16:36
fungior signing01.ci.openstack.org which has a signing node label16:36
rcarrillocruzi mean, i can just reanme to cacti02 to or 01 to follow the current naming16:36
rcarrillocruzthen do the cname you depicted16:36
fungii'm not really comfortable renaming servers in place. would rather just launch a new one if you're wanting to give it a different name16:37
openstackgerritMerged openstack-infra/system-config: Update compute089.chocolate public and provisioning IP addresses  https://review.openstack.org/38119816:37
openstackgerritMerged openstack-infra/system-config: Update compute089.chocolate public and provisioning addresses plus the rack metadata  https://review.openstack.org/38120216:37
openstackgerritMerged openstack-infra/system-config: Update compute087.chocolate public and provisioning IP addresses  https://review.openstack.org/38120616:37
openstackgerritMerged openstack-infra/system-config: Update compute086.chocolate public and provisioning IP addresses  https://review.openstack.org/38120816:37
fungialso we should move the rrd files onto a cinder volume, so it's easier to relocate them from the old system to the new one (and for future convenience)16:38
openstackgerritMerged openstack-infra/system-config: Update compute085.chocolate public and provisioning IP addresses  https://review.openstack.org/38121316:38
rcarrillocruzok16:38
rcarrillocruzso new node16:38
rcarrillocruzwith cacti01 as name16:38
rcarrillocruzwith a volume attached16:38
*** mriedem has joined #openstack-infra16:38
rcarrillocruzall good?16:38
fungiwell, attach the volume to the old server. then we need a brief outage on cacti.o.o to move the rrd files into it before detaching and reattaching to the new server and mounting at the right location where the software expects to find it16:39
*** nadya has joined #openstack-infra16:40
rcarrillocruzoh, so you want to do the move of rrd files on the volume in the current cacti first16:40
rcarrillocruzok16:40
*** harlowja_still_a has joined #openstack-infra16:40
openstackgerritMerged openstack-infra/system-config: Update compute084.chocolate public and provisioning IP addresses  https://review.openstack.org/38121516:40
rcarrillocruzi've wiped the puppet node change, as i'll create a new vm as 'cacti01'16:40
rcarrillocruzerm, WIP'd16:41
rcarrillocruzwiped has a completely different meaning16:41
*** harlowja_at_home has quit IRC16:44
*** amitgandhinz has quit IRC16:44
openstackgerritMerged openstack-infra/system-config: Update compute083.chocolate public and provisioning IP addresses  https://review.openstack.org/38123016:44
*** nadya has quit IRC16:45
*** harlowja_still_a has quit IRC16:46
anteayaindeed it does16:47
anteayathanks for clarifying16:47
strigaziHi infra, in magnum we consistently a *LOT* of these timeouts in rabbit: http://logs.openstack.org/16/379316/4/check/gate-functional-dsvm-magnum-k8s/9ad3de4/logs/screen-magnum-api.txt.gz#_2016-10-03_14_32_28_623 Whenever  I see this is usually rabbit is out of memory. Any advice? Did anything changed recently in infra related to rabbit or memory allocation of the nodes?16:49
rcarrillocruzhmm, not sure what's going on puppetmaster, i'm being challenged by a password when running osc commands against the rax cloud16:49
rcarrillocruz?16:49
rcarrillocruzany infra-root seeing ^16:49
cloudnullohai folks. It would seem I'm missing the TC election email. Sadly I have gerrit tied with my @rackspace.com email address and I believe that RAX email may have filtered or dropped the message. IDK if others using @rackspace.com email have run into this issue or if I and a couple others are isolated cases but I figured I'd mention it here.16:49
anteayacloudnull: thank you16:50
anteayacloudnull: yes, if folks with rackspace email addresses didn't get ballots, that is an issue16:50
openstackgerritMerged openstack-infra/system-config: Update compute082.chocolate public and provisioning IP addresses  https://review.openstack.org/38123516:50
cloudnullIf others using @rackspace.com in gerrit have not recieved the ballots it'd be good to know.16:51
*** clenimar has joined #openstack-infra16:51
anteayacloudnull: are you able to confer with anyone knowledgable about rackspace email?16:51
anteayacloudnull: indeed it would16:51
clarkbstrigazi: no change to memory on test hosts, they should all have about 8GB ram16:51
cloudnullI've reached out to a few folks, more soon I hope16:51
*** ianychoi has quit IRC16:51
*** ianychoi has joined #openstack-infra16:52
rcarrillocruznm, i really needed openstackci-rax cloud16:52
anteayacloudnull: have you found anyone using a rackspace email as their gerrit preferred email (identified in https://review.openstack.org/#/settings/contact) that has recieved their ballot?16:52
pabelangerrcarrillocruz: Ya, that works for me16:52
cloudnullyes. i know of two (three including myself) at this point.16:53
anteayacloudnull: that _have_ recieved their ballot?16:53
cloudnullsorry that have not.16:53
strigaziclarkb, any idea how to debug this? We can't get anything pass16:53
anteayaah okay, so 3 people confirm they haven't16:53
cloudnullI know rackers that have gotten the message but they have a personal email address there.16:53
anteayacloudnull: and so far you haven't found any using rackspace email that have?16:53
cloudnullnot yet16:54
anteayacloudnull: okay thanks16:54
*** piet_ has joined #openstack-infra16:54
anteayacloudnull: well any subsequent ballots will go to the same email address16:54
anteayaso first the rackspace email has to allow ballots to come through16:54
anteayacloudnull: what has to happen for rackspace email to be able to do that?16:54
*** derekh has quit IRC16:55
jeblairamrith: you seem to be listed on the tc ballot as "Amrith Amrith"16:55
amrithjeblair, yes. I noticed that and it appears that there is no easy way to change it at this point.16:55
cloudnullanteaya: idk the controls that are in place for @rackspace.com email.16:55
cloudnullsorry.16:55
amrithI don't think it makes sense to upset the election for that; I'll just appeal to the supreme court if I don't get elected :)16:56
anteayacloudnull: do you know who does?16:56
jeblairamrith: :(16:56
clarkbstrigazi: looks like its a timeout? where are you seeing memory issues? but I would look at the dstat logs to see what is using the memory and see what you can do from there to reduce the total needed16:56
cloudnullto fix the issue for myself going forward i've switched my address to a personal one.16:56
anteayacloudnull: that won't make a difference now16:56
amrithin all seriousness, I think it is not a big deal; the election officials looked into it16:56
amrithand it isn't easy to change and I don't think it is worth restarting the election process for it.16:57
amrithbut thanks for pointing it out jeblair ...16:57
anteayareplacement ballots get sent to the email that was set as the gerrit preferred email when the electoral roll was created16:57
cloudnullanteaya: we have internal teams that handle all of that.16:57
amrithhaven't chatted in a while jeblair how's you?16:57
cloudnullim trying to reach out to them now.16:57
anteayacloudnull: great, thanks let us know how you do16:57
strigaziclarkb, I don't see a memory issue explicitly, but usually that is the case. I can't reproduce the problem locally16:57
cloudnullbut if other rackers could chime in here it'd be great to know.16:58
anteayacloudnull: indeed16:58
clarkbstrigazi: ok then I would start by isolating the issue. Could be networking for example16:58
*** tnovacik has quit IRC16:58
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Add chocolate compute082 to compute094 to Puppetmaster Ansible inventory  https://review.openstack.org/38124516:58
jeblairamrith: i'm well, though i have confused myself with a problem i have created.  :)16:59
*** yamamoto has quit IRC16:59
anteayacloudnull: the larger issue is that the electorate is somewhere north of 2000 voters now, so waiting for rackers to ask for another ballot one at a time will mean many rackers that are eligible won't even know to ask for a replacement ballot16:59
*** Sukhdev has quit IRC16:59
anteayathe ones that used their rackspace email17:00
amrithjeblair, :) I do that regularly ... and I go bug others to help me untangle it ...17:00
*** armax has joined #openstack-infra17:00
rcarrillocruzfungi: size of cinder volume for cacti the same as /var/lib/cacti ?17:00
rcarrillocruzi.e. 20GB17:00
rcarrillocruz?17:00
strigaziclarkb, What kind of networking issue? The magnum-api is accesible so as rabbit. And the thing is that it happen half of the times but locally it doesn't happen at all17:01
*** ralonsoh has quit IRC17:01
*** csomerville has joined #openstack-infra17:02
clarkbstrigazi: like for example devstack/neutrons recent breaking of routing for 10/8 which affects osic17:02
*** amitgandhinz has joined #openstack-infra17:02
clarkbstrigazi: I wouldnt be surprised if that is the actual issue depending on how connections to rabbit are made17:03
*** yamahata has joined #openstack-infra17:03
pabelangeranteaya: cloudnull: Maybe step 12 can help here, http://civs.cs.cornell.edu/faq.html#setting_up I am not sure who a CIVS supervisor is, is that the elections team?17:03
strigaziclarkb, from here I can tell that is in osic right?17:03
fungircarrillocruz: oh! it's possible /dev/xvdb there is already a cinder volume, in which case it's taken care of17:04
anteayapabelanger: sorry which item should I be reading?17:04
fungircarrillocruz: i'm double-checking that now17:04
clarkbstrigazi: yes that ran in osic17:04
anteayapabelanger: you said step 12, sorry17:04
AJaegerjeblair: confused with openstack-manuals? We can try a different solution - e.g. blacklist the index files and I create root-marker for each guide...17:04
* anteaya reads 1217:04
clarkbstrigazi: the cloud and region are in the hostname and recorded at the beginning of the console log17:04
jeblairAJaeger: i'm not ready for that yet, i'm still looking into some things17:05
anteayapabelanger: well the email address wasn't bad17:05
fungircarrillocruz: indeed... | 39117da9-95ce-4939-85c1-e1ef9f59e586 | cacti.openstack.org/main01                           | in-use    |   75 | Attached to cacti.openstack.org on /dev/xvdb              |17:05
anteayapabelanger: the rackspace email server didn't serve it up17:05
AJaegerjeblair: ah, ok;) Didn't want to push - just came back online and read the comment...17:05
anteayapabelanger: if this affects all of rackspace email holders, that is a lot of people17:05
strigaziclarkb, I think it is always in osic, but I have to double check17:05
*** kzaitsev_mb has quit IRC17:05
fungircarrillocruz: so basically we need to move that cinder device from the old server to the replacement around the same time that we update firewalls everywhere17:05
*** armax has quit IRC17:05
anteayapabelanger: and sending replacement ballots to new email addresses could result in double ballots issued17:06
pabelangeranteaya: right, checking for a bounced email could provide some additional information17:06
rcarrillocruzah nice17:06
anteayapabelanger: which is why I only would issue replacement ballots to the same email address, since that is the only way to ensure there weren't two ballots sent to the same email17:06
fungircarrillocruz: also i just ran `OS_CLIENT_CONFIG_FILE=/etc/openstack/all-clouds.yaml openstack --os-cloud openstackci-rax --os-region-name DFW volume list` and didn't get a password prompt, so not sure what the circumstances are where you're being prompted17:06
rcarrillocruzyeah, seeing pvdisplay output i now see the lvm volume is bound to the xvdb volume17:06
anteayapabelanger: agreed, this is what I'm hoping cloudnull can find someone to look into17:06
fungioh, you figured it out17:06
*** Sukhdev has joined #openstack-infra17:07
rcarrillocruzfungi: i believe the issue is i used OS_CLOUD plus OS_REGION_NAME , possibly oscc doesn't like the combination of the two17:07
pabelangerCIVS supervisor should have access too, I am not sure if that is the poll creator or Cornell staff17:07
*** moravec has joined #openstack-infra17:07
anteayapabelanger: I once sent a replacement ballot to a different email address but that was a long chain of emails, many confirmations regarding the work email server and a hand written note promising not to use the other ballot if it ever showed up17:07
anteayapabelanger: I do'nt see that scaling out to the crowd that would be using rackspace emails17:08
rcarrillocruzah, and i was also using openstack-rax as the cloud17:08
*** larainema has quit IRC17:08
rcarrillocruzanyways, switching to OS_CLOUD openstackci-rax worked for me17:09
anteayapabelanger: the poll supervisor can send replacement ballots to the same email address, yes17:09
anteayathe person who runs the app will not get involved in something like this17:09
anteayamy impression is based on my interactions with him in the past17:09
mtreinishanteaya: we could run our own civs in infra17:10
anteayawe could17:10
*** larainema has joined #openstack-infra17:10
*** alyson_ has quit IRC17:10
*** piet_ has quit IRC17:10
anteayawe still could do anything should rackspace decide to deny ballots to rackspace emails17:10
anteayacouldn't17:10
anteayaplus17:10
*** tuannguyen has joined #openstack-infra17:10
*** Naeil has joined #openstack-infra17:10
openstackgerritMerged openstack-infra/system-config: Add chocolate compute082 to compute094 to Puppetmaster Ansible inventory  https://review.openstack.org/38124517:11
anteayaone of the arguments for not running our own server is to ensure we can't fiddle with anything in the background17:11
*** piet_ has joined #openstack-infra17:11
anteayaas is the case now17:11
*** alyson_ has joined #openstack-infra17:11
fungianteaya: the main up-side in situations like this is that we could at least have access to the originating mta logs so we can confirm that the ballots were rejected or deferred/queued17:11
strigaziclarkb, I can tell with certaintly that most of the times happens in osic17:11
anteayafungi: yes access to mta logs would indeed be helpful17:11
*** salv-orl_ has quit IRC17:12
mtreinishanteaya: well infra root can't, but the people who run civs.cs.cornell.edu can17:12
fungianteaya: but i agree, right now we get an (ostensibly) independent third party arbitrating our election, which is a big thing to lose17:12
anteayathe one person who runs it is very very busy17:12
*** AnarchyAo has joined #openstack-infra17:12
*** amitgandhinz has quit IRC17:12
anteayawe could email him though I do think rackspace email admins is the best next step, but he might not reply for a week or two17:12
anteayathis app is his hobby17:12
*** amitgandhinz has joined #openstack-infra17:13
*** tnovacik has joined #openstack-infra17:13
anteayafungi: agreed17:13
ianychoiamrith, hello. Related to your name in Gerrit just show 'amrith', not full name. I think you need to change your display name in Launchpad..17:13
anteayaif rackspace email admins can allow ballots through then tonyb can just resend ballots to anyone with a rackspace email17:13
*** armax has joined #openstack-infra17:14
*** rushil has quit IRC17:14
strigaziclarkb, The problem started late last week17:15
anteayacloudnull: any luck contacting anyone? if not I think posting to the mailing list is in order17:15
clarkbstrigazi: ya I think its possible they are related then. check how you are connecting to rabbit17:15
cloudnullnone yet. i'll give them an a little while to respond17:16
anteayacloudnull: okay thanks17:16
*** tuannguyen has quit IRC17:16
*** bin_ has quit IRC17:17
*** tuannguyen has joined #openstack-infra17:17
*** Sukhdev has quit IRC17:18
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Add cacti01 replacement node to Puppet  https://review.openstack.org/37899617:18
*** kzaitsev_mb has joined #openstack-infra17:19
*** flepied has quit IRC17:20
*** e0ne has joined #openstack-infra17:20
*** salv-orlando has joined #openstack-infra17:20
prometheanfireclarkb: ianw: can you look at https://review.openstack.org/#/c/310865/ (couldn't find your emails to cc)17:20
AJaegerwow, quite a few interesting candidates for the TC election - makes it difficult. That's a healthy sign!17:21
*** trevormc has joined #openstack-infra17:21
*** trown|lunch is now known as trown17:21
fungiindeed, i was having a hard time prioritizing some of them17:21
prometheanfireyep, more good choices then normal :D17:21
*** Naeil has quit IRC17:22
*** tongli has joined #openstack-infra17:22
*** csomerville has quit IRC17:23
fungithe loss of several incumbents scared a lot of the community into making sure the ballot was stacked in favor of getting good replacements for them17:23
ianychoiAnd also lots of discussions on TC candidates are in dev ml.. wow.. :)17:23
AJaegerfungi: ah ;)17:24
AJaegerany project-config core around to +2A the ansible-ceilometer change of job name - the one that was far too long? Please review https://review.openstack.org/#/c/38118517:27
AJaegero, there's still a depends-on...17:27
strigaziclarkb, not sure what to check, here are the relevant parts https://github.com/openstack/magnum/blob/master/magnum/common/rpc.py https://github.com/openstack/magnum/blob/master/magnum/common/rpc_service.py17:29
openstackgerritMerged openstack-infra/project-config: OFAgent CI should be run for only liberty and mitaka  https://review.openstack.org/37910317:29
*** zara_the_lemur__ has joined #openstack-infra17:30
*** tuannguyen has quit IRC17:32
*** Guest92 has joined #openstack-infra17:32
*** amitgandhinz has quit IRC17:32
ianychoiAnd.. can I get some reviews for training-guides activities: https://review.openstack.org/#/c/375834/ (project-config) and https://review.openstack.org/#/c/367005/ (system-config)?17:33
*** amitgandhinz has joined #openstack-infra17:33
*** tuannguyen has joined #openstack-infra17:33
AJaegerfungi, could you check 375834, please? team, that change looks fine from a syntax perspective but since it changes the gropus for the sandbox repository, I'd like to raise it...17:34
clarkbstrigazi: you want to determine what ip address you are attempting to connect to.anything in 10.0.0.0/8 wont be happy until devstack fix gets in17:34
strigaziclarkb, in magnum conf there is 127.0.0.117:36
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB  https://review.openstack.org/38109417:36
*** degorenko is now known as _degorenko|afk17:36
*** tqtran has joined #openstack-infra17:37
*** yamahata has quit IRC17:37
*** Guest92 has quit IRC17:37
*** kzaitsev_mb has quit IRC17:37
anteayaianychoi: any bugs related to sandbox are addressed by the infra team, that repo uses storyboard so issues are filed there not on launchpad17:38
*** tosky has quit IRC17:38
*** sdake has quit IRC17:39
ianychoiAJaeger, thank you for raising up for 375834. I agree that this repo is special and so many first time comers use the repo.17:39
anteayaianychoi: if you want to help address stories filed for the sandbox repo that is most welcome17:39
*** cody-somerville has joined #openstack-infra17:39
*** cody-somerville has joined #openstack-infra17:39
AJaegeranteaya: good catch - ianychoi "use-storyboard: true" is the keyword.17:40
anteayaianychoi: https://storyboard.openstack.org/#!/project/69717:40
ianychoianteaya, Oh storyboard..! I noticed the existence of storyboard when I initially uploaded my patch.17:40
*** electrofelix has quit IRC17:40
anteayaI'm not sure how to uncreate a launchpad page, having https://launchpad.net/openstack-dev-sandbox show up on someone's search results will cause confusion17:41
ianychoianteaya, training-guides team thinks sandbox repo is used for learning purposes. We target the launchpad not for 'bug' management issues. We want use launchpad for exercises.17:41
anteayathat's fine17:42
anteayabut it is an infra repo and its issues are filed on storyboard17:42
*** lezbar has quit IRC17:42
anteayaif you would like that to be altered, confiring with the infra team is a first step17:42
anteayaI suggest adding an item to tomorrow's infra team meeting agenda17:42
AJaegerianychoi: and we're planning to switch all projects in the future to storyboard, so a training should include storyboard17:43
*** lezbar has joined #openstack-infra17:43
clarkbstrigazi: one way to check if that is the issue easily is depends on https://review.openstack.org/#/c/379543/17:43
*** smarcet1981 has joined #openstack-infra17:43
*** tuannguy_ has joined #openstack-infra17:43
*** Apoorva has joined #openstack-infra17:43
clarkbstrigazi: then check if jobs pass when run on osic17:43
AJaegerianychoi: I gave a -1 since for the change to do what you want, you need to remove the storyboard line.17:43
ianychoianteaya, then flooding arbitary bugs on storyboard would be also fine?17:43
AJaegerianychoi: if you clean them up again ;)17:43
*** tuannguyen has quit IRC17:43
anteayaianychoi: that is something that needs to be discussed17:44
ianychoiAJaeger, I understand current situation :) Thanks17:44
anteayaI can't speak for the entire team17:44
*** sdake has joined #openstack-infra17:44
anteayaI do think creating the launchpad page was a bit premature17:44
pabelangerclarkb: Made excellent failures in SSH failures with nodepool, our launch failures are down dramatically. However, I can confirm we are still having SSHd restart on ubuntu-trusty.  Diving more into it now17:44
anteayaianychoi: can it be hiddend from search until this is discussed?17:44
ianychoianteaya, Yep I agree that discussion is needed17:44
anteayaianychoi: great thank you17:44
anteayaI appreciate your enthusiasum on getting things working well for new contributors17:45
ianychoiSo it can it be a topic on next infra team meeting?17:45
anteayabut we have to ensure we are not creating confusion17:45
anteayaianychoi: that is my preference17:45
*** rbrndt has quit IRC17:45
ianychoianteaya, hiding launchpad is possible?17:45
anteayaI don't know17:45
AJaegerianychoi: please just add to the agenda - fungi might prioritize it based on what's else available17:45
anteayaI've never created a launchpad page17:45
anteayaI'm asking if hiding the page is an option17:46
anteayauntil we come to agreement17:46
ianychoianteaya, okay.. I will check now..! AJaeger yep I will :)17:46
anteayaianychoi: great thank you17:46
*** jpena is now known as jpena|away17:46
ianychoianteaya, it's my pleasure!17:46
anteaya:)17:47
AJaegeranteaya, ianychoi: If we can discuss it tomorrow, I'm fine with leaving it up for the extra day. But if we cannot come to a conclusion tomorrow, let's try to hide it.17:47
jeblairAJaeger: i think i found it17:47
mtreinishinfra-root: health.openstack.org is returning a 500 on every request, can someone please kick it :)17:47
AJaegerglad to hear, jeblair ! Thanks for debugging.17:48
ianychoianteaya, I cannot find how to hide LP but I can modify description like: Please go to storyboard with link17:48
anteayaianychoi: that would be great for the moment, thank you17:49
ianychoianteaya, ok :)17:49
anteayaianychoi: after the team has had a chance to discuss it we can go from there17:49
anteaya:)17:49
*** adrian_otto has joined #openstack-infra17:49
*** pvaneck has joined #openstack-infra17:51
strigaziclarkb, I added the dependncy, let's wait now17:52
anteayamtreinish: I have heard you, alas I can not help :(17:52
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: Fix afs publisher root detection  https://review.openstack.org/38126117:52
jeblairAJaeger: ^ that should fix17:52
*** salv-orlando has quit IRC17:53
jeblairAJaeger: i believe it was other jobs which published to '/', such as the translation jobs, which triggered that behavior.17:53
*** strigazi is now known as strigazi_AFK17:53
*** amoralej is now known as amoralej|off17:54
mtreinishanteaya: thanks, solidarity does help. But, I'll just continue to glare at my monitor as root users' nicks go by on irc and wait patiently :)17:55
mtreinishanteaya: heh, it's either that or do real work17:55
anteayamtreinish: I picture you glaring17:55
*** jordanP has quit IRC17:55
openstackgerritPaul Belanger proposed openstack-infra/glean: Add ssh dependency for glean  https://review.openstack.org/38126317:55
anteayaoh the glaring, definitely the glaring17:55
pabelangerclarkb: ^ should be our fix17:55
pabelangerclarkb: using 'or' should cause glean to start if ssh is missing, not that it is an issue for us.17:56
AJaegerjeblair: I don't know the code good enough to really bless but the comments you make and changes you do support what I noticed: Thanks!17:56
anteayamtreinish: I have to go chop kindling and bring in a load of wood, happy glaring17:57
*** artmr has quit IRC17:57
openstackgerritPaul Belanger proposed openstack-infra/glean: Add ssh dependency for glean  https://review.openstack.org/38126317:57
pabelangerclarkb: building images now for testing17:57
jeblairAJaeger: this is the script i used to test: http://paste.openstack.org/show/584059/17:58
AJaegerjeblair: if you merge this and I'm still around, I can quickly push some openstack-manuals change through for testing...17:58
jeblairAJaeger: you can play with adding/removing the '/' in the find/printf and see the behavior change (if you are curious)17:58
*** docaedo has quit IRC17:58
*** john-davidge has joined #openstack-infra17:58
jeblairpabelanger: can you +3 https://review.openstack.org/381261 ?17:59
AJaegerjeblair: the test case seems to be what I saw. So, if this works now, I'm confident it will work in real life as well17:59
jeblairfungi: i'd like to hard-restart the launchers when that lands.  do you think that will be okay?18:00
*** lezbar has quit IRC18:00
pabelangerjeblair: +318:00
*** sdake has quit IRC18:01
*** lezbar has joined #openstack-infra18:01
fungijeblair: yeah, we don't look very backed up. should be mostly imperceptible18:01
*** drifterza has joined #openstack-infra18:01
*** dtantsur is now known as dtantsur|afk18:02
AJaegerjeblair: played a bit with it - works fine18:02
*** sambetts is now known as sambetts|afk18:02
fungircarrillocruz: i've added some comments on 378996 for other bits that are still missing18:04
clarkbpabelanger: but doesn't starting networking run before starting ssh?18:06
pabelangerclarkb: nope18:06
clarkbpabelanger: or are you saying because both start on starting networking they can go in different orders?18:06
openstackgerritMerged openstack-infra/zuul: Ansible launcher: Fix afs publisher root detection  https://review.openstack.org/38126118:06
*** jaosorior has quit IRC18:07
pabelangerclarkb: with trusty, glean will be before networking, ssh before runtime 2345(?). And I have no idea why that is18:08
clarkbhuh18:08
clarkbpabelanger: is ssh on trusty an upstart init script or a sysv init script? I wonder if that is part of it18:09
ianychoiAJaeger, and anteaya: I added a meeting agenda on Wiki: https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting and changed the desc in LP: https://launchpad.net/openstack-dev-sandbox . Thank you!18:09
pabelangerclarkb: upstart /etc/init/ssh.conf exists, but let me see what init.d has18:09
fungianteaya: technically, the sandbox repo is not an infra repo (we don't claim it as one of ours in governance). it's just an unofficial repo which is used for arbitrary testing of gerrit and related tools18:12
pabelangerclarkb: wow, both /etc/init/ssh.conf and /etc/init.d/ssh exist18:13
*** annegentle has quit IRC18:13
clarkbpabelanger: ugh, I bet taht is why its weird though. I discovered when trying to make logstash workers more reliable on boot that usptarts sysv compat layer is very thin18:14
clarkbpabelanger: basically you can't really dep between those and upstart scripts relaible (or if you can the method was completely not clear to me)18:14
*** Teresita-Warrior has quit IRC18:14
*** flepied has joined #openstack-infra18:15
pabelangerclarkb: So, I don't think sysv init script is starting, trying to confirm that now.  But guess we could remove it with puppet18:15
*** yamahata has joined #openstack-infra18:15
fungimtreinish: infra-root: looks like http://status.openstack.org/openstack-health/ is still throwing an api error, so looking into it now18:16
clarkbmriedem: I will take a look at why e-r is unhappy18:17
pabelangerclarkb: Ya, rcd.2 doesn't list ssh18:17
pabelangerso, I think we are good there18:17
clarkbpabelanger: kk18:17
*** Teresita-Warrior has joined #openstack-infra18:18
*** zz_dimtruck is now known as dimtruck18:19
pabelangertest image uploaded, testing now18:20
fungimtreinish: i found lots of this in the apache error log... http://paste.openstack.org/show/58406318:20
*** dimtruck is now known as zz_dimtruck18:20
clarkbmriedem: mtreinish e-r error: http://paste.openstack.org/show/584064/18:21
*** sbalukoff has quit IRC18:21
*** Ravikiran_K_ has quit IRC18:21
*** kaisers_ has quit IRC18:22
*** Guest92 has joined #openstack-infra18:22
clarkbmriedem: mtreinish I think you should be able to reproduce locally since its using the public api to ES18:23
*** john-davidge has quit IRC18:25
automagicallyanteaya: Would you mind reconsidering your vote on https://review.openstack.org/#/c/381185/18:25
AJaegerjeblair: sorry, have to leave now, so can't approve an openstack-manuals change later anymore...18:27
*** tuannguy_ has quit IRC18:27
dmsimardnodepool question: what does "nodepool alien-list" return exactly? orphan virtual machines that can safely be deleted because they are not tracked by nodepool ?18:27
jeblairAJaeger: if you approve one now, that would help18:27
AJaegerjeblair: that I can do...18:27
clarkbdmsimard: VMs that do not belong to that particular nodepool provider. Currently we can't trust its output in osic without additional filtering because we have 3 logical osic nodepool providers that share the tenant18:28
fungidmsimard: yes, more specifically it returns the list of nova instances in that tenant/project which are not represented in nodepool's database18:28
clarkbdmsimard: but generally yes as long as that provider isn't sharing a tenant with anything else you shoujld be able to delete those instances18:28
AJaegerjeblair: just approved https://review.openstack.org/#/c/381154/18:28
jeblairAJaeger: thanks18:28
*** alyson_ has left #openstack-infra18:28
jeblairi'm restarting the launchers now18:28
dmsimardclarkb: ack, this is for RDO's nodepool instance but yes, thanks for confirmation18:28
* AJaeger waves good night18:28
dmsimardfungi: thanks18:28
*** Sukhdev has joined #openstack-infra18:28
jeblairAJaeger: good night!18:28
fungihave a good night, AJaeger!18:29
AJaegerthanks!18:29
*** yamahata has quit IRC18:29
*** pcaruana has joined #openstack-infra18:29
jeblairfyi, a bunch of changes in the gate all recently failed gate-*-python34-db with a unittest 'discover' failure18:29
clarkbthere was a change that went by to remove discover from global requirements. Maybe we actually do need ti still?18:30
*** yamamoto has joined #openstack-infra18:30
clarkbhrm except we weren't installing it on python3 anyways so likely not18:31
clarkbmaybe related to pycparser?18:31
clarkbhttps://review.openstack.org/#/c/381192/ is ahead of the fails in the gate18:31
*** rcernin has joined #openstack-infra18:31
*** dizquierdo is now known as dizquierdo_afk18:31
jeblairmaybe. i reckon requiremests probably doesn't run a py34 cross test...?18:32
fungiunfortunate those workarounds are still percolating through the gate18:32
fungithe problem was solved upstream hours ago now18:32
*** docaedo has joined #openstack-infra18:32
*** Swami has quit IRC18:32
fungithat broken wheel has been eradicated18:33
clarkbfungi: maybe that wasn't sufficient? pip will make a new wheel when installing from sdist18:33
*** Swami has joined #openstack-infra18:33
fungiclarkb: the sdist was working fine, but then upstream uploaded a broken wheel18:34
*** eranrom has joined #openstack-infra18:34
*** rossella_s has quit IRC18:34
clarkbah18:34
fungiclarkb: that sdist is over a year old, a busted wheel for the same version was uploaded by its maintainer today18:34
fungiand subsequently deleted from pypi again after a number of people complained that it was nonfunctional18:35
*** rossella_s has joined #openstack-infra18:35
fungimriedem: should 381192 be abandoned before someone needs to add a revert for it?18:35
fungioh, nevermind. that's the revert18:35
jeblairfungi: i'm not sure i follow 'those workarounds are still percolating through the gate' -- i was pointing out gate jobs that are failing behind https://review.openstack.org/#/c/381192/18:36
fungijeblair: yep, i misread the change subject and missed that it was a revert18:36
jeblair(i do not know if 192 is related to the problem)18:36
clarkbya I don't know if it is the problem but the python34 jobs ahead of it did pass18:37
fungiit's doubtful. i've run into a dead end tracking down the es_url parameter issue with openstack-health and will have a look at the discover failures now18:37
clarkbfungi: mtreinish I wonder if healt hsi running into the same thing as e-r that I pasted above?18:38
*** harlowja has quit IRC18:38
*** uxdanielle has quit IRC18:39
*** harlowja has joined #openstack-infra18:39
jeblairnova fails quietly: http://logs.openstack.org/17/378717/4/gate/gate-nova-python34-db/ff5fb1a/console.html#_2016-10-03_17_56_47_17045118:39
jeblaircinder less so: http://logs.openstack.org/48/375248/1/gate/gate-cinder-python34-db/3578343/console.html#_2016-10-03_18_01_18_38183918:39
*** rbrndt has joined #openstack-infra18:39
*** xarses has quit IRC18:39
*** moravec has quit IRC18:39
fungiclarkb: jeblair: oh, maybe we copy wheels from pypi into our wheel mirrors and then don't delete them later? http://logs.openstack.org/17/378717/4/gate/gate-nova-python34-db/ff5fb1a/tox/py34-1.log18:40
jeblair(nova uses 'pretty_tox2' cinder does not)18:40
jeblairpretty_tox318:40
fungierrors are never pretty ;)18:40
*** Teresita-Warrior has quit IRC18:40
clarkbfungi: ya I don't think pip/wheel has an evict step18:40
clarkbwe would have to add that over the top of our current wheel process18:40
fungiugh18:40
fungiso we need to manually delete this wheel from the wheel mirrors now?18:41
mtreinishfungi: oh, I bet asselin's change to e-r broke o-h's usage of it18:41
fungithe error in the cinder log matches https://github.com/eliben/pycparser/issues/14718:42
clarkbhttp://mirror.dfw.rax.openstack.org/wheel/ubuntu-16.04-x86_64/pycparser/ ya that timestamp looks like we need to remove it18:42
*** sbalukoff has joined #openstack-infra18:42
fungii'll get to work adjusting the contents of our wheel mirrors now18:42
clarkbok18:42
mtreinishclarkb: I'm not sure it's the same issue with the uncategorized script as on o-h18:43
anteayaautomagically: if that is what you want18:43
automagicallyanteaya: I’d appreciate it, I _believe_ this will put us back under the limit18:43
edmondswwhat would cause a defect to get flipped to "Fix Released" when something is committed instead of to "Fix Committed"?18:43
anteayafungi: thanks for clarifying, I do think though having bugs in both launchpad and storyboard is confusing18:44
edmondswe.g. https://bugs.launchpad.net/os-client-config/+bug/162769018:44
openstackLaunchpad bug 1627690 in os-client-config "AttributeError: 'OpenStackConfig' object has no attribute 'register_argparse_options'" [Undecided,Fix released]18:44
anteayafungi: and historically we have maintained it18:44
fungianteaya: i agree. we should do one or the other18:44
clarkbedmondsw: the release team decided a cycle or two back to not bother with the multistep transition18:44
clarkbedmondsw: it was dhellmann that sent mail to the list about it if you want to search for it in logs/archives18:44
edmondswugh... ok...18:44
anteayafungi: but sorry I mis-spoke on the ownership or lack thereof of the sandbox repo18:46
jeblairfungi, clarkb: yeah, i see no delete step in http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/wheel-copy.sh18:47
fungii just kstarted a bash session as jenkins on our centos7 wheel builder and did `rm /afs/.openstack.org/mirror/wheel/*/p/pycparser/pycparser-2.14-py2.py3-none-any.whl`18:48
fungii suppose i should do a vos release on each of /afs/.openstack.org/mirror/wheel/* now?18:48
clarkbfungi: or wait for the next mirror update pulse18:49
SotKianychoi: you could flood storyboard-dev.openstack.org with arbitrary bugs if you need to play around with a storyboard18:49
jeblairclarkb, fungi: wheel mirrors are released by jobs, and none are running, so i'd release it manually18:50
*** drifterza has quit IRC18:50
anteayaSotK: the use case is people playing around with the sandbox repo18:50
anteayaSotK: the target audience is developers learning the openstack workflow18:51
openstackgerritK Jonathan Harker proposed openstack-infra/puppet-log_processor: Allow passing arbitrary arguments to the client daemon  https://review.openstack.org/38127018:51
anteayathe issue might be that if we point them at the storyboard-dev server for their learning, they might file bugs on the dev server18:51
anteayaI don't know18:51
jesusaurclarkb: i see that you turned off the logprocessor client debug log, but i find that file useful. i've proposed 381270 as a way of making it optional18:52
mtreinishfungi, clarkb. asselin: I believe this is the fix for openstack health: https://review.openstack.org/#/c/381271/18:53
clarkbjesusaur: ok will review. (it was filling / every day)18:53
jesusauroh, eww18:53
*** Hal has quit IRC18:53
*** gyee has quit IRC18:54
*** tuannguyen has joined #openstack-infra18:54
anteayajesusaur: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=422&rra_id=all18:54
SotKanteaya: good point, in that case I guess filing bugs against openstack/sandbox in storyboard.o.o wouldn't be particularly disruptive, and would match the gerrit workflow nicely18:55
jesusauranteaya: ah, thanks for the link18:55
rcarrillocruzfungi: thx, i'll amend and create a dependent changes for the iptables stuff18:55
*** nadya has joined #openstack-infra18:55
anteayaSotK: it is a good thought, I think I would like to hear more when we address it in the meeting and find out what kind of volume is expected and as AJaeger suggests what kind of cleanup they plan on doing18:56
anteayaSotK: and yeah, I agree18:56
anteayajesusaur: welcome, filling 40G daily was impressive I have to say18:56
*** dtardivel has quit IRC18:57
*** eranrom has quit IRC18:58
anteayajesusaur: so your change would allow you to turn on debug logging and for us to keep debug logging off?18:58
*** yamahata has joined #openstack-infra18:59
*** yamamoto has quit IRC19:00
fungiclarkb: jeblair: i've done `k5start -t -f /etc/afsadmin.keytab service/afsadmin -- vos release -v mirror.wheel.$ARCH` now as jenkins on release.slave.o.o for cent7x64, trustyx64 and xenialx6419:00
fungihttp://mirror.ord.rax.openstack.org/wheel/ubuntu-14.04-x86_64/pycparser/ correctly lacks pycparser-2.14-py2.py3-none-any.whl so i think we're in the clear at this point19:02
fungii wonder if i should go ahead and promote the top change in the gate to get everything from that revert on down retesting with the broken wheels gone now19:03
jeblairfungi: ++19:03
fungion it19:03
clarkbsounds good19:03
fungidone19:04
*** cody-somerville has quit IRC19:05
fungii'll keep an eye on those changes behind 381192,1 and make sure they survive this time19:05
*** cody-somerville has joined #openstack-infra19:06
*** cody-somerville has joined #openstack-infra19:06
clarkbbrainstorming how to better make wheel mirrors. It would be nice if we could tell pip to ignore any that already have wheels in pypi for linux19:06
clarkbthat would give us minimal mirrors and any wheels we build localy should work? maybe?19:07
clarkbI guess if something in the build itself is broken then that may not be the case19:07
fungiindeed. maybe check pypi to see if the wheel you cached already exists there, and then delete/omit it from the cache before copying into afs?19:08
*** Hal has joined #openstack-infra19:08
clarkbya, we already prefer pypi's wheels to our wheels anyways so this shouldn't lead to any regressions on its own19:09
*** AnarchyAo has quit IRC19:10
clarkbbut in theory we had a pycparser wheel on our wheel mirrors that have worked since that release came out? so our local build process was fine19:10
*** ijw has joined #openstack-infra19:10
fungiright, the wheel they uploaded was universal, so it was preferred over the pyversion-specific ones we were building before19:11
pabelangerspeaking of wheels, I still need to finish up hacking on pep8 to pass --no-binary / --no-use-wheel to better flex bindep integrations19:12
fungiunfortunately since we also copied it into our independent wheel mirror from the cache when it was still live on pypi, we persisted a copy there indefinitely19:12
fungii'm following up to the ml now with details19:12
*** sabari has joined #openstack-infra19:14
*** jed56 has quit IRC19:15
clarkbmordred: rcarrillocruz Shrews if a patch went into ansible devel 6 days ago, then ansible 2.1.2.0 probably doesn't have it right? or are ansible's "19:17
clarkbstable" releases done off of devel too?19:17
clarkbrcarrillocruz: where can I find this ansible 2.2 RC2?19:18
clarkber RC119:18
rcarrillocruzclarkb: i believe cores need to explicitly backport to stable releases19:18
rcarrillocruzhttp://releases.ansible.com/ansible/19:19
clarkbok so it isn't on pypi?19:19
rcarrillocruzor you can also pull from a tag19:20
rcarrillocruzhttps://github.com/ansible/ansible/releases19:20
rcarrillocruzclarkb: right, it is not19:20
clarkbrcarrillocruz: sort of, its actually more complicated than just installing the tag :)19:20
rcarrillocruzonly stable are on pypi19:20
clarkbrcarrillocruz: you have to do a bunch of other git setup because of the submodules19:20
rcarrillocruzwell yeah, you know the submodule init update, so there you go :-)19:20
clarkbrcarrillocruz: ya but that still doesn't "just work" with pip is my point19:21
rcarrillocruzyup19:21
clarkbso I will have to hack around it whatever route I take. Thats fine I guess19:21
rcarrillocruzi've had to clone from github with editable packages on the launcher for some time19:21
rcarrillocruzas the 'stable' did not have a fix for a bug that was hitting us for a while19:21
clarkbthis is for devstack-gate. Will probably have to wait for fix to get mirrored to pypi before using it properly but I can push a test patch to make sure things work on 2.2 with some hacks19:22
jeblairclarkb: pip install https://github.com/ansible/ansible/archive/v2.2.0.0-0.1.rc1.tar.gz  ?19:22
*** sdake has joined #openstack-infra19:22
*** sdake has quit IRC19:22
clarkbjeblair: does that work? I guess there are sha files there so maybe it will19:22
clarkb(for some reason I was thinking you had to have md5sums for pip to be happy grabbing random sdists)19:23
jeblairclarkb: it seemed to have just worked for me in a venv19:23
clarkbya I just tested too it seems happy19:24
clarkbI guess it doesn't check hashes in that case but thats fine for this testing19:24
*** rtheis_ has joined #openstack-infra19:25
*** spzala has quit IRC19:26
*** mhickey has joined #openstack-infra19:26
*** rtheis has quit IRC19:26
*** kzaitsev_mb has joined #openstack-infra19:27
*** Guest92 has quit IRC19:27
*** spzala has joined #openstack-infra19:27
*** Guest92 has joined #openstack-infra19:27
*** Guest92 has quit IRC19:27
openstackgerritAndy Smith proposed openstack-infra/project-config: Update the gate-tempest-neutron-dsvm-src-oslo.messaging test  https://review.openstack.org/37150219:28
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Test new ansible empty subnodes  https://review.openstack.org/38127819:29
*** amitgandhinz has quit IRC19:29
*** amitgandhinz has joined #openstack-infra19:30
*** salv-orlando has joined #openstack-infra19:30
*** Hal has quit IRC19:30
*** annegentle has joined #openstack-infra19:30
*** spzala has quit IRC19:32
*** Hal has joined #openstack-infra19:32
* rcarrillocruz fires compute082-compute093 deployment19:34
clarkbit looks like those python34 jobs are happy after the mirror cleanup19:36
clarkbpabelanger: thanks for following up on that email to OVH looks like they saw it this time around so hopefully we can get to the bottom of that19:39
clarkbpabelanger: once we track down GRA1s problem we should not forget about BHS119:40
pabelangerclarkb: ++19:40
* clarkb is having a really slow start to this monday (just now catching up on email and its time for lunch)19:40
timrchttp://status.openstack.org/openstack-health/#/ looks sad :/19:40
clarkbtimrc: it is indeed sad. mtreinish has proposed a fix for it19:41
*** mptacekx has quit IRC19:41
*** spzala has joined #openstack-infra19:41
timrc\o/19:41
*** Teresita-Warrior has joined #openstack-infra19:42
*** salv-orl_ has joined #openstack-infra19:44
openstackgerritDougal Matthews proposed openstack-infra/tripleo-ci: Add Mistral to the CI status  https://review.openstack.org/37933519:45
*** ijw has quit IRC19:46
*** david-lyle has joined #openstack-infra19:47
*** salv-orlando has quit IRC19:47
*** amitgandhinz has quit IRC19:49
openstackgerritEmilien Macchi proposed openstack-infra/project-config: layout: update tempest jobs coverage for puppet  https://review.openstack.org/38128519:50
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: WIP - Testing undercloud upgrade  https://review.openstack.org/38128619:51
fungiclarkb: agreed, the formerly failing nova and cinder changes look like they'll merge in ~7 minutes now19:51
pabelangerclarkb: testing 25 launches on ovh-gra1 for upstart fix, then will try on infracloud-vanilla19:51
*** amitgandhinz has joined #openstack-infra19:52
*** piet_ has quit IRC19:53
*** ijw has joined #openstack-infra19:54
*** tonytan4ever has quit IRC19:55
*** Hal has quit IRC19:59
*** ijw has quit IRC19:59
*** Hal has joined #openstack-infra20:00
*** esikachev has quit IRC20:02
*** Teresita-Warrior has quit IRC20:02
*** hasharAway is now known as hashar20:03
*** e0ne has quit IRC20:05
*** jpena|away is now known as jpena20:05
*** sdake has joined #openstack-infra20:05
*** tnovacik has quit IRC20:10
*** esikachev has joined #openstack-infra20:10
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: Full quickstart gate run on OVB  https://review.openstack.org/38109420:10
*** kaisers_ has joined #openstack-infra20:11
*** moravec has joined #openstack-infra20:11
*** jtomasek is now known as jtomasek|afk20:12
*** Apoorva has quit IRC20:15
*** kaisers_ has quit IRC20:15
*** tuannguyen has quit IRC20:16
*** Goneri has quit IRC20:16
*** dprince has quit IRC20:18
jeblairhttp://files.openstack.org/docs/ exists again; hopefully it will hold this time :)20:19
*** lucasagomes is now known as lucas-afk20:19
pabelangernice20:21
*** jpena is now known as jpena|off20:22
anteayayay it exists20:22
*** Apoorva has joined #openstack-infra20:23
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: [WIP] Add provider upload framework  https://review.openstack.org/37979520:23
*** tuannguyen has joined #openstack-infra20:24
Shrewsjeblair: that ^^^ is not ready quite yet, but implements the things we discussed20:27
*** Apoorva has quit IRC20:28
Shrewsor at least begins to20:28
*** cody-somerville has quit IRC20:30
*** david-lyle has quit IRC20:30
*** nadya has quit IRC20:30
*** drifterza has joined #openstack-infra20:31
*** cody-somerville has joined #openstack-infra20:31
*** zz_dimtruck is now known as dimtruck20:32
*** asselin__ has joined #openstack-infra20:34
*** david-lyle has joined #openstack-infra20:35
*** Jeffrey4l__ has joined #openstack-infra20:35
*** asselin_ has quit IRC20:35
*** Jeffrey4l_ has quit IRC20:35
openstackgerritBrian Haley proposed openstack-infra/devstack-gate: Support an IPv6 underlay network  https://review.openstack.org/34304120:37
*** jkilpatr has quit IRC20:37
*** kgiusti has quit IRC20:40
rcarrillocruz++20:42
*** ijw has joined #openstack-infra20:42
*** dimtruck is now known as zz_dimtruck20:42
*** ijw has quit IRC20:44
*** hashar has quit IRC20:44
*** uxdanielle has joined #openstack-infra20:44
*** david-lyle has quit IRC20:44
*** pcaruana has quit IRC20:45
*** esikachev has quit IRC20:45
*** signed8bit has joined #openstack-infra20:46
pabelangerclarkb: just going to run 25 launches on rax-iad then I think we finish reviewing: https://review.openstack.org/#/c/381263/20:48
pabelangerboth ovh and infracloud-vanilla were clean after 50 launch attempts each20:48
clarkbpabelanger: cool I have already +2'd it fwiw20:49
pabelangerthanks20:50
cloudnullanteaya: so the plot thickens. it would seem that some rackers got the message and others (including myself) have not.20:51
cloudnullso it would seem that there's no easy fix. sadly.20:51
*** trevormc has left #openstack-infra20:52
cloudnullwhich may or may not be something in the rax email system.20:52
*** hichihara has joined #openstack-infra20:53
*** tuannguyen has quit IRC20:53
*** tuannguyen has joined #openstack-infra20:55
anteayahmmmm20:55
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Test new ansible empty subnodes  https://review.openstack.org/38127820:55
*** tuannguyen has quit IRC20:56
anteayawell for starters I would contact tonyb and ask him to reissue your ballot and those of the other two folks affected20:56
*** adriant has joined #openstack-infra20:56
anteayaif this isn't a rackspace wide issue that is good20:56
anteayaperhaps reissuing ballots is enough20:56
anteayaI would encourage either you or tonyb to post to the mailing list so that other rackers check if they have a ballot if they are eligible20:57
anteayaother than taking tonyb's time there is no down side to him reissueing ballots to the same address he issued them to the first time20:58
*** thorst has quit IRC20:58
*** baoli has quit IRC20:59
*** Rockyg has joined #openstack-infra20:59
*** hexlibris has joined #openstack-infra20:59
*** tuannguyen has joined #openstack-infra20:59
njohnstonI'm also working the election, please feel free to send emails for people that need a re-send to me: openstacknate@gmail.com21:00
*** cody-somerville has quit IRC21:02
*** cody-somerville has joined #openstack-infra21:02
*** jkilpatr has joined #openstack-infra21:02
*** paulobanon has quit IRC21:03
clarkbbeing sick all weekend is not conducive to having a productive monday I am finding.21:03
anteayacloudnull: yes actually you have to email all the election officials about issues, not just one21:03
*** zz_dimtruck is now known as dimtruck21:03
cloudnullclarkb: ++21:03
cloudnullthats the truth21:03
*** ijw has joined #openstack-infra21:04
anteayabut since he is the supervisor of the poll tonyb os the only one who can reissue the ballot21:04
anteayaclarkb: :(21:04
clarkbunrelated but it seems to make firefox much much better for me. If you are firefox user you should enable electrolysis21:04
cloudnullok. i'll reach out to tony and direct other folks to as well21:04
cloudnullthanks again21:05
njohnstonanteaya: tonyb shared the URL to Tristan and me, so I was just able to reissue a ballot.21:05
cloudnullI still have messages out to the gateway teams within rax to see if it was something on our end21:05
cloudnullbut I'm now getting mixed reports.21:05
cloudnullnjohnston: you mind re-issuing mine?21:05
njohnstoncloudnull: Sure thing, what is your email?21:06
anteayanjohnston: I'm most familiar with decisions about how to address issues done in consultation with the other election offical21:06
*** trown is now known as trown|outtypewww21:06
anteayanot done on ones own21:06
cloudnullkevin.carter@rackspace.com || kevin@cloudnull.com21:06
cloudnullI now have both registered in gerrit21:06
*** raildo has quit IRC21:06
anteayanjohnston: you are of course going to issue only to the email you issued to when the poll went out yes?21:06
anteayaso as a noone will recieve a double ballot?21:07
njohnstonanteaya: Correct, I'll compare with the original list that was uploaded to CIVS21:07
*** john-davidge has joined #openstack-infra21:07
anteayaI never acted alone as an eleciton offical21:07
anteayaregardless of how trivial the action might seem21:07
njohnstonanteaya: I would rather act with maximum propriety, so I can wait and confer with whichever of the others is awake first21:08
*** lezbar has quit IRC21:10
*** adrian_otto has quit IRC21:10
*** john-davidge has quit IRC21:11
*** lezbar has joined #openstack-infra21:11
*** ijw has quit IRC21:11
*** ijw has joined #openstack-infra21:12
anteayaI have found that to be the best approach21:12
*** edmondsw has quit IRC21:14
*** ijw has quit IRC21:15
*** dimtruck is now known as zz_dimtruck21:15
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Undercloud upgrade for mitaka and newton  https://review.openstack.org/38128621:15
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - Test Undercloud upgrade mitaka -> newton  https://review.openstack.org/38130921:15
*** ldnunes has quit IRC21:15
openstackgerritAugustina Ragwitz proposed openstack-infra/irc-meetings: Update meeting chair for Nova Bugs Team  https://review.openstack.org/38131021:16
openstackgerritMerged openstack-infra/project-config: Add deb-glare  https://review.openstack.org/38077921:16
fungicloudnull: anteaya: njohnston: strangely, a friend of mine (also employed at rackspace) can't find his ballot either. but his address in the roll is a (working) private address of his rather than one on rackspace.com servers... so the employer may be a red herring at least in his case, which leaves me wondering whether there was a broader issue21:16
*** piet_ has joined #openstack-infra21:17
cloudnull fungi yea the mixed reports of missing ballots i'm seeing from within rax seems to indicate the same.21:17
funginjohnston: tristanC: tonyb: i don't recall seeing a "ballots have been sent" e-mail on the -dev ml today, so maybe if one gets sent that will make it more apparent to voters who didn't receive a ballot that they're missing one?21:17
cloudnull++21:18
anteayafungi: good call21:18
fungi(or -announce or wherever is most relevant)21:18
*** openstackgerrit has quit IRC21:19
*** openstackgerrit has joined #openstack-infra21:19
*** david-lyle has joined #openstack-infra21:19
anteayawhen it is sending out the emails the app with leave a response in the page (you have to keep the page open) if it encounters an ill formated email21:20
anteayahowever there is no access to information about email bounces etc21:20
anteayas/with leave/will leave21:20
*** thorst has joined #openstack-infra21:21
*** tuannguyen has quit IRC21:21
jheskethMorning21:21
*** rtheis_ has quit IRC21:21
anteayamorning jhesketh21:22
anteayajhesketh: did you get your tc ballot?21:23
*** cardeoi__ has quit IRC21:23
*** cardeois has joined #openstack-infra21:24
*** amitgandhinz has quit IRC21:25
*** eharney has quit IRC21:25
*** krtaylor has quit IRC21:25
*** Apoorva has joined #openstack-infra21:25
*** amitgandhinz has joined #openstack-infra21:25
*** mhickey has quit IRC21:26
*** thorst has quit IRC21:26
ianwwhat'd i miss?21:28
*** smarcet1981 has quit IRC21:28
jheskethanteaya: yep, and voted :-)21:29
anteayajhesketh: awesome21:29
*** Teresita-Warrior has joined #openstack-infra21:29
anteayadid the ballot go to a rackspace email address or other email address?21:29
*** tiswanso has quit IRC21:29
jheskethanteaya: my rackspace one21:30
*** Apoorva has quit IRC21:30
anteayaawesome thank you21:30
*** Goneri has joined #openstack-infra21:30
anteayawe have some sporadic reports of ballots not recieved, early theory was rackspace emails were affected, your data point helps show that early theory is erroneous21:31
anteayathank you for the data point :)21:31
asselin__mtreinish, hi, I didn't realize o-h used e-r apis....21:31
*** dizquierdo_afk has quit IRC21:32
asselin__mtreinish, also  a bit surprised the defaults don't work21:32
*** Apoorva has joined #openstack-infra21:34
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Correct compute082.chocolate public and provisioning addresses  https://review.openstack.org/38132121:35
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Add TripleO multinode in Nova experimental jobs  https://review.openstack.org/38132221:35
*** piet_ has quit IRC21:35
*** matt-borland has quit IRC21:35
*** akshai has quit IRC21:36
*** lin_yang has joined #openstack-infra21:37
*** ijw has joined #openstack-infra21:40
*** spzala has quit IRC21:41
*** psilvad has quit IRC21:42
*** ijw has quit IRC21:43
*** burgerk has quit IRC21:44
openstackgerritMerged openstack-infra/system-config: Correct compute082.chocolate public and provisioning addresses  https://review.openstack.org/38132121:44
*** ijw has joined #openstack-infra21:44
*** piet_ has joined #openstack-infra21:46
*** smarcet1981 has joined #openstack-infra21:47
*** baoli has joined #openstack-infra21:48
*** gouthamr has quit IRC21:49
*** esberglu has quit IRC21:50
*** smarcet1981 has quit IRC21:52
*** vhosakot has quit IRC21:52
*** piet_ has quit IRC21:52
tonybfungi: Hmm okay that's very strange. (the opening email not being sent/recieved)21:52
*** baoli has quit IRC21:53
fungitonyb: it's entirely possible i missed one. i'm checking the archive now to confirm21:53
pabelangerclarkb: welp, had a failure, after 100 launches. back to the drawing board21:53
clarkbpabelanger: maybe we should go look at how cloud-init configures itself on trusty?21:53
tonybfungi: I don't have one :(21:54
fungitonyb: nor i21:54
fungino sign of one in the -dev ml archive that i can find either21:54
pabelangerclarkb: ya, I can poke into that21:55
*** spzala has joined #openstack-infra21:55
tonybso I think that I should take the following steps. 1) Extend the TC vote by +24 hours, 2) (re)-send the opening email, with a note explaing why it's extended)  and 3) resend everyone's ballots21:55
tonybpeople that have already voted are still valid and everyone gets +5 business days to vote21:56
tonybtristanC, njohnston, fungi, anteaya, ttx: does that sound reasonable ?21:56
*** YorikSar has quit IRC21:56
*** YorikSar has joined #openstack-infra21:57
njohnstonThat sounds very fair to me, as long as the rules permit the duration of the election to be malleable by election officials in this way.21:57
tonybnjohnston: we've had to do it before21:58
fungitonyb: probably worth first making sure that any previous resends are reaching their intended recipients21:58
tonybnjohnston: though I don't recall the exact reason21:58
*** tiswanso has joined #openstack-infra21:58
openstackgerritDaniel Castellanos proposed openstack-infra/project-config: Update Jenkins jobs for craton-dashboard  https://review.openstack.org/38132721:58
*** smarcet1981 has joined #openstack-infra21:58
tonybcloudnull: ping? Can I use you as a test subject to verify that a resend arrives?21:58
cloudnullsure21:59
fungiand i do worry that resending all ballots again without first figuring out why some (significant number of) people didn't receive theirs risks having the mass resend end up just as spotty21:59
cloudnulltonyb: mail queued up and /me pressing f521:59
cloudnull:)21:59
*** xyang1 has quit IRC22:00
*** hichihara has quit IRC22:00
cloudnullrecieved22:00
*** kaisers_ has joined #openstack-infra22:00
tonybcloudnull: Great thanks.22:01
cloudnulland that was received in my RAX email22:01
*** piet_ has joined #openstack-infra22:02
cloudnullthanks tony.22:02
tonybcloudnull: cool.  That's the address we have for you22:02
anteayatonyb: you sent an opening email and it never hit the dev list?22:02
*** tiswanso has quit IRC22:03
openstackgerritBrian Haley proposed openstack-infra/devstack-gate: Support an IPv6 underlay network  https://review.openstack.org/34304122:03
*** Swami has quit IRC22:03
*** Naeil has joined #openstack-infra22:04
*** piet_ has quit IRC22:04
*** ijw has quit IRC22:04
*** piet_ has joined #openstack-infra22:04
*** kaisers_ has quit IRC22:05
*** ijw has joined #openstack-infra22:05
*** mdrabe has quit IRC22:05
openstackgerritJames E. Blair proposed openstack-infra/infra-specs: Zuul v3: update with Ansible role information  https://review.openstack.org/38132922:05
openstackgerritJames E. Blair proposed openstack-infra/infra-specs: Zuul v3: correct vagueness in describing job inheritance  https://review.openstack.org/38133022:05
*** EricGonczer_ has quit IRC22:05
jeblairfungi: ^ i'm going to put those on the agenda for tomorrow22:05
*** YorikSar has quit IRC22:05
*** smarcet1981 has quit IRC22:06
*** YorikSar has joined #openstack-infra22:06
*** amitgandhinz has quit IRC22:06
anteayawell the only way to investigate why the first flood of ballots missed some of their targets is if we can get our hands on the logs from the civs app22:06
fungijeblair: excellent. thanks for the ehads up22:06
fungiheads up too22:07
anteayatonyb: you can email the maintainer of the civs app and request the logs if you wish, I suggest ensuring you have the timestamp from when you sent the ballots22:07
anteayabut my experience with emailing the civs maintainer is his response time is measured in weeks, not hours22:07
tonybanteaya: I have the output form the ad_voter script which has only one issue.  I expect the CIVS maintainer to email be soon ish with a list of addresses that couldn't ve sent.22:08
anteayai don't have any ideas of identifying where the issue arrises without the email logs22:08
*** YorikSar is now known as YorikSar_22:08
*** YorikSar_ is now known as YorikSar22:09
*** david-lyle has quit IRC22:09
tonybanteaya: as such I'd like to make the corrective action as self-supporting as possible22:09
anteayatonyb: oh, okay when the maintainer emails you do you get logs or reasons?22:09
anteayatonyb: I'm in agreement there22:09
anteayatonyb: i don't have any argument against what you proposed above, that sounds fine to me22:10
anteayabut I do think fungi has a point in that we have no assurance this round won't miss some folks as well22:10
anteayaI also do'nt have a better suggestion22:10
fungitonyb: was the one issue you refer to something which needs adjusting in the owners.py script, or unrelated to roll generation?22:11
*** akshai has joined #openstack-infra22:12
tonybfungi: unrelated.  A voter's mail server send a temp reject which was the only issue the add-voter script reported22:12
tonybfungi: I have to say the roll generation worked really well22:12
anteayafungi: yay22:12
clarkbtonyb: that was with no special access, just the gerrit api?22:12
tonybclarkb: correct.22:13
fungitonyb: oh, thanks! i was hoping this would be an improvement over relying on infra-root admins22:13
*** mriedem has quit IRC22:13
tonybfungi: here's the wrapper I wrote for it .... http://git.openstack.org/cgit/openstack/election/tree/tools/generate-rolls.sh22:13
tonybfungi: which is really just a script version of your docs :)22:14
tonybanteaya: I get somethign like "delivery failed see transcript" but the transcripts are not typically attached22:14
*** piet_ has quit IRC22:15
anteayahmmm, maybe this time we will get lucky and you will get a transcript22:15
jeblairtonyb: the non-delivery report you got is through the civs tool?  (ie -- 'add-voter' is part of the civs tool?)22:15
openstackgerritLin Yang proposed openstack-infra/project-config: Rename rsc to valence  https://review.openstack.org/38133222:16
*** sdake has quit IRC22:16
*** zz_dimtruck is now known as dimtruck22:17
tonybjeblair: Yes there are 2 reports, one in quasi-real time from CIVS when you add a batch of voters with with add-voter.pl (which I've typed several diffent ways in the last 10 mins) just gives tou a message if the email address "appears" valid or an SMTP code if it gets one22:17
tonybjeblair: then some time later I get an email form the CIVS system along the lines of "the following addresses had a problem"22:18
*** krtaylor has joined #openstack-infra22:18
jeblairtonyb: gotcha.  do you know if civs will queue and retry tempfails?  (those might be greylisting in action)22:19
tonybjeblair: I suspect it does but I don't *know* that22:20
tonybjeblair: I suspect that some corporate mail systems saw an above average number of connectiosn form civs and caught all those messages22:20
anteayasince the civs app doesn't save the voters list, for anonimity, some behaviours are opaque22:21
*** tuannguyen has joined #openstack-infra22:22
openstackgerritJames E. Blair proposed openstack-infra/infra-specs: Zuul v3: correct vagueness in describing job inheritance  https://review.openstack.org/38133022:22
openstackgerritJames E. Blair proposed openstack-infra/infra-specs: Zuul v3: update with Ansible role information  https://review.openstack.org/38132922:22
*** rcernin has quit IRC22:25
*** tuannguyen has quit IRC22:26
*** adrian_otto has joined #openstack-infra22:27
*** salv-orlando has joined #openstack-infra22:28
*** salv-orl_ has quit IRC22:28
*** sdake has joined #openstack-infra22:33
*** rossella_s has quit IRC22:34
*** rossella_s has joined #openstack-infra22:35
*** akshai has quit IRC22:36
*** david-lyle has joined #openstack-infra22:36
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - Test Undercloud upgrade mitaka -> newton  https://review.openstack.org/38130922:38
*** Naeil has quit IRC22:39
*** Swami has joined #openstack-infra22:40
anteayatonyb: I got the election is open email22:41
anteayav222:41
anteayaas did the -dev list: http://lists.openstack.org/pipermail/openstack-dev/2016-October/105002.html22:41
*** cody-somerville has quit IRC22:41
*** Swami_ has joined #openstack-infra22:41
*** asselin__ has quit IRC22:42
*** dimtruck is now known as zz_dimtruck22:44
*** tuannguyen has joined #openstack-infra22:44
tonybanteaya: Thanks!22:45
*** Swami has quit IRC22:45
anteayathank you22:46
tonybanteaya: Not the way I wanted to start my Tuesday :(22:47
*** lezbar has quit IRC22:48
*** lezbar has joined #openstack-infra22:49
*** rbrndt has quit IRC22:49
*** camunoz has joined #openstack-infra22:50
anteayano kidding22:51
anteayayou had coffee yet?22:51
tonybanteaya: yes I have thank you :)22:52
tonybanteaya: I could probably do with another .....22:52
*** tiswanso has joined #openstack-infra22:53
anteayaI bet22:53
*** tiswanso has quit IRC22:53
anteayawas concerned you were walking into all of this without your caffenine armour22:53
*** tiswanso has joined #openstack-infra22:54
tonybanteaya: :)22:54
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Add cacti01 replacement node to Puppet  https://review.openstack.org/37899622:54
anteaya:)22:55
*** salv-orlando has quit IRC22:55
*** spzala has quit IRC22:55
*** gordc has quit IRC22:56
*** spzala has joined #openstack-infra22:56
*** john-davidge has joined #openstack-infra22:56
*** ijw has quit IRC22:56
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: make the final release tool smarter  https://review.openstack.org/38133822:57
*** aeng has joined #openstack-infra22:57
*** tongli has quit IRC22:57
*** zz_dimtruck is now known as dimtruck22:57
*** hongbin has quit IRC22:59
*** spzala has quit IRC23:01
*** john-davidge has quit IRC23:01
*** gordc has joined #openstack-infra23:01
*** asselin__ has joined #openstack-infra23:02
*** zara_the_lemur__ has quit IRC23:04
*** Teresita-Warrior has quit IRC23:04
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: make the final release tool smarter  https://review.openstack.org/38133823:04
*** Sukhdev has quit IRC23:06
openstackgerritMonty Taylor proposed openstack-infra/shade: Make sure we're matching image status properly  https://review.openstack.org/37716423:09
openstackgerritMonty Taylor proposed openstack-infra/shade: Normalize images  https://review.openstack.org/37716323:09
openstackgerritMonty Taylor proposed openstack-infra/shade: Add helper properties to generate location info  https://review.openstack.org/38133923:09
*** esberglu has joined #openstack-infra23:11
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Make bug name, type, and url explicit  https://review.openstack.org/37511323:12
pabelangerclarkb: resorting to debugging upstart now... which required updating grub.cfg23:12
pabelangerbut I can see glean running twice on ubuntu-trusty in some cases23:13
clarkbpabelanger: that sounds... "fun"23:13
pabelangernot sure why23:13
*** tpsilva has quit IRC23:14
*** adrian_otto has quit IRC23:17
mordredpabelanger: is it the udev rules?23:18
*** tiswanso has quit IRC23:18
pabelangermordred: I don't think they are installed for upstart23:19
*** adrian_otto has joined #openstack-infra23:20
*** thorst has joined #openstack-infra23:20
*** mtanino has quit IRC23:22
clarkbdevstack-gate cores: https://review.openstack.org/#/c/370442/1 is a simpleish change to d-g that fixes networking for multinode nova net testing. Would be great if we can get that reviewed to reduce the number of failures around nova net multinode23:23
clarkbit got bitten by the neutron + devstack + osic route issue on the neutron grenade job but I have a recheck for it and hopefully it comes back happy23:24
*** rajinir has quit IRC23:25
anteaya5th time's the charm23:25
*** ijw has joined #openstack-infra23:26
*** thorst has quit IRC23:28
*** tuannguyen has quit IRC23:28
*** lezbar has quit IRC23:28
*** thorst has joined #openstack-infra23:28
*** kaisers1 has quit IRC23:29
*** kaisers has quit IRC23:29
*** markvoelker has quit IRC23:29
*** lezbar has joined #openstack-infra23:29
*** annegentle has quit IRC23:29
*** kaisers has joined #openstack-infra23:29
*** ijw has quit IRC23:29
*** kaisers1 has joined #openstack-infra23:30
*** fguillot has quit IRC23:31
*** ArxCruz has quit IRC23:31
*** thorst has quit IRC23:31
*** thorst has joined #openstack-infra23:32
*** Swami_ has quit IRC23:32
*** Swami_ has joined #openstack-infra23:32
*** jamielennox is now known as jamielennox|away23:35
*** amitgandhinz has joined #openstack-infra23:37
*** gordc has quit IRC23:37
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Make bug name, type, and url explicit  https://review.openstack.org/37511323:38
*** dimtruck is now known as zz_dimtruck23:39
openstackgerritBrian Haley proposed openstack-infra/devstack-gate: Support an IPv6 underlay network  https://review.openstack.org/34304123:40
*** amitgandhinz has quit IRC23:42
*** cardeois has quit IRC23:43
*** david-lyle has quit IRC23:44
*** yamahata has quit IRC23:44
*** jamielennox|away is now known as jamielennox23:48
*** kaisers_ has joined #openstack-infra23:49
*** kaisers_ has quit IRC23:54
*** gildub has joined #openstack-infra23:55
*** spzala has joined #openstack-infra23:57
*** yamahata has joined #openstack-infra23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!