Wednesday, 2016-06-01

*** nwkarsten has joined #openstack-infra00:02
*** tonytan4ever has quit IRC00:04
*** Guest57304 has quit IRC00:06
*** zhurong has joined #openstack-infra00:07
*** thorst has joined #openstack-infra00:07
*** pradk_ has quit IRC00:07
*** Daisy has joined #openstack-infra00:07
*** nwkarsten has quit IRC00:07
*** dims has quit IRC00:14
*** EricGonczer_ has quit IRC00:15
openstackgerritPrakash Ramchandran proposed openstack-infra/project-config: add new project meghdwar  https://review.openstack.org/31946600:15
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: Switch to libguestfs for CentOS  https://review.openstack.org/32356000:15
*** kzaitsev_mb has quit IRC00:16
*** EricGonczer_ has joined #openstack-infra00:17
*** dims has joined #openstack-infra00:19
*** rellerreller has joined #openstack-infra00:20
*** tonytan4ever has joined #openstack-infra00:23
*** sflanigan has joined #openstack-infra00:27
*** ggillies has joined #openstack-infra00:27
*** aeng has joined #openstack-infra00:27
*** gema has joined #openstack-infra00:27
*** camunoz has joined #openstack-infra00:28
*** akshai has joined #openstack-infra00:28
*** akshai_ has joined #openstack-infra00:29
*** sdake_ has joined #openstack-infra00:29
*** sdake has quit IRC00:30
*** akshai has quit IRC00:32
*** amitgandhinz has joined #openstack-infra00:33
*** bpokorny has quit IRC00:35
*** pvaneck has quit IRC00:36
*** r-mibu has quit IRC00:36
*** r-mibu has joined #openstack-infra00:36
*** amitgandhinz has quit IRC00:38
*** sputnik13 has quit IRC00:39
*** Daisy has quit IRC00:39
*** tonytan4ever has quit IRC00:39
openstackgerritPrakash Ramchandran proposed openstack-infra/project-config: add new project meghdwar  https://review.openstack.org/31946600:39
*** akshai_ has quit IRC00:40
thinrichsdims: you there about the Congress pulp dependency?00:40
waynrbstinson: that's about as far as we got--talking about the need for distinct plugin info permissions for cases like this00:41
dimsthinrichs : pong00:41
dimsthinrichs : https://github.com/coin-or/pulp/pull/10700:41
*** rellerreller has quit IRC00:41
*** mtanino has quit IRC00:41
thinrichsdims: So your commit there will resolve the problem with pulp we're seeing?00:42
dimsthinrichs : hopefully, do you know anyone who works on PuLP?00:42
thinrichsdims: I don't unfortunately00:43
dimsthinrichs : ouch. ok. guess we'll have to wait00:43
*** Daisy has joined #openstack-infra00:46
thinrichsdims: You could try assigning https://github.com/stumitchell since he's the lead.  I tried but can't change the assignees.00:46
*** burgerk has quit IRC00:46
thinrichsdims: in the worst case, we can disable that functionality in Congress for the time-being.  It's better to have it in (someone asked about it just last week), but it's experimental.00:47
thinrichsdims: thanks so much for going the extra mile in tracking down the problem and patching it!00:48
*** piet has joined #openstack-infra00:49
dimsthinrichs : ack. if we don't hear by end of the week, let's nuke PuLP from g-r/u-c00:49
thinrichsdims: ack00:49
*** Daisy has quit IRC00:50
*** aspiers has quit IRC00:54
*** Sukhdev has quit IRC00:55
*** aspiers has joined #openstack-infra00:56
*** sdake has joined #openstack-infra00:56
*** Apoorva has quit IRC00:59
*** Julien-zte has joined #openstack-infra00:59
*** sdake_ has quit IRC00:59
*** piet has quit IRC01:00
*** Daisy has joined #openstack-infra01:00
*** Julien-zte has quit IRC01:00
*** mdrabe has joined #openstack-infra01:01
*** sdake has quit IRC01:02
*** Julien-zte has joined #openstack-infra01:02
*** piet has joined #openstack-infra01:03
*** ffrank has quit IRC01:03
*** ffrank has joined #openstack-infra01:03
*** rossella_s has quit IRC01:04
*** doug-fish has joined #openstack-infra01:06
*** Daisy has quit IRC01:06
*** Daisy has joined #openstack-infra01:06
*** fitoduarte has quit IRC01:07
openstackgerritPaul Belanger proposed openstack-infra/project-config: Revert "Move centos-7 on tripleo-test-cloud-rh1 to h2"  https://review.openstack.org/32362801:08
*** asettle has joined #openstack-infra01:08
*** Daisy has quit IRC01:09
*** Daisy has joined #openstack-infra01:09
*** doug-fish has quit IRC01:10
*** asettle has quit IRC01:13
*** yanyanhu has joined #openstack-infra01:13
openstackgerritPrakash Ramchandran proposed openstack-infra/project-config: add new project meghdwar  https://review.openstack.org/31946601:16
*** zhurong has quit IRC01:16
*** thinrichs has quit IRC01:16
*** zhurong has joined #openstack-infra01:17
*** piet has quit IRC01:17
*** yamamoto has joined #openstack-infra01:17
*** Daisy has quit IRC01:17
*** Daisy has joined #openstack-infra01:18
*** rhallisey has quit IRC01:19
*** EricGonc_ has joined #openstack-infra01:20
*** EricGonczer_ has quit IRC01:21
*** Daisy has quit IRC01:22
*** yamahata has joined #openstack-infra01:23
*** julim has joined #openstack-infra01:24
*** Daisy has joined #openstack-infra01:26
*** Daisy has quit IRC01:29
*** Daisy has joined #openstack-infra01:30
*** _sarob has quit IRC01:30
*** julim has quit IRC01:32
*** amitgandhinz has joined #openstack-infra01:34
*** Daisy has quit IRC01:35
*** pt_15 has quit IRC01:36
*** roxanaghe has joined #openstack-infra01:38
*** xarses has joined #openstack-infra01:39
*** amitgandhinz has quit IRC01:39
*** itisha has quit IRC01:40
*** doug-fish has joined #openstack-infra01:40
*** sdake has joined #openstack-infra01:41
*** sdake has quit IRC01:43
*** jyuso1 has quit IRC01:43
*** doug-fish has quit IRC01:44
*** hongbin has joined #openstack-infra01:46
*** sdake has joined #openstack-infra01:47
*** sdake_ has joined #openstack-infra01:48
*** jerryz has quit IRC01:51
*** sdake has quit IRC01:51
*** ffrank has quit IRC01:53
*** shashank_hegde has quit IRC01:54
*** yamamoto has quit IRC02:03
*** Daisy has joined #openstack-infra02:06
*** Daisy has quit IRC02:07
*** Daisy has joined #openstack-infra02:07
*** tqtran has quit IRC02:10
*** julim has joined #openstack-infra02:10
*** Daisy has quit IRC02:12
*** roxanaghe has quit IRC02:12
*** hogepodge has quit IRC02:13
*** bpokorny has joined #openstack-infra02:16
*** hogepodge has joined #openstack-infra02:17
*** EricGonc_ has quit IRC02:18
*** moravec has joined #openstack-infra02:19
*** thorst has quit IRC02:20
*** thorst has joined #openstack-infra02:21
*** hogepodge has quit IRC02:21
*** shashank_hegde has joined #openstack-infra02:22
*** Daisy has joined #openstack-infra02:25
*** bpokorny_ has joined #openstack-infra02:29
*** thorst has quit IRC02:29
*** bpokorny has quit IRC02:32
*** doug-fish has joined #openstack-infra02:32
*** bpokorny_ has quit IRC02:34
*** thorst has joined #openstack-infra02:35
*** amitgandhinz has joined #openstack-infra02:36
*** amrith is now known as _amrith_02:36
*** thorst has quit IRC02:37
*** shashank_hegde has quit IRC02:40
*** amitgandhinz has quit IRC02:40
*** yamahata has quit IRC02:43
*** Qiming has quit IRC02:43
*** bbroad has quit IRC02:45
*** gyee has quit IRC02:45
*** yuanying has quit IRC02:50
*** mdrabe has quit IRC02:51
*** Daisy has quit IRC02:53
*** Daisy has joined #openstack-infra02:54
*** yamamoto has joined #openstack-infra02:54
*** yamamoto has quit IRC02:54
*** Daisy has quit IRC02:58
openstackgerritTony Breeds proposed openstack-infra/irc-meetings: Modify Smaug meeting time  https://review.openstack.org/32271303:06
*** cody-somerville has joined #openstack-infra03:07
*** moravec has quit IRC03:08
*** moravec has joined #openstack-infra03:09
openstackgerritTony Breeds proposed openstack-infra/irc-meetings: Change Solum meeting time  https://review.openstack.org/32076203:09
*** ayoung has quit IRC03:09
*** doug-fish has quit IRC03:11
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge  https://review.openstack.org/32363903:12
openstackgerritMerged openstack-infra/irc-meetings: Change Solum meeting time  https://review.openstack.org/32076203:16
*** roxanaghe has joined #openstack-infra03:16
*** sarob has joined #openstack-infra03:16
*** moravec has quit IRC03:18
*** piet has joined #openstack-infra03:22
yanyanhuhi, guys, I met a weird problem when running a gate job. I wrote a description about it and very appreciated if anyone can give some hints.03:22
yanyanhuhttp://paste.openstack.org/show/506784/03:23
yanyanhuthank you so much03:23
*** Qiming has joined #openstack-infra03:23
*** cody-somerville has quit IRC03:27
*** cody-somerville has joined #openstack-infra03:34
*** piet has quit IRC03:36
*** amitgandhinz has joined #openstack-infra03:37
*** thorst has joined #openstack-infra03:38
*** mixos has joined #openstack-infra03:39
*** shashank_hegde has joined #openstack-infra03:40
*** amitgandhinz has quit IRC03:42
*** yamamoto has joined #openstack-infra03:42
openstackgerritIan Wienand proposed openstack/diskimage-builder: Update default to F23  https://review.openstack.org/24729603:42
*** hongbin has quit IRC03:45
*** thorst has quit IRC03:46
*** yuanying has joined #openstack-infra03:47
ianwyanyanhu: ]||[ looks wrong, you'll want spaces between that03:50
*** dimtruck is now known as zz_dimtruck03:50
*** nwkarsten has joined #openstack-infra03:53
*** abregman has quit IRC03:56
*** nwkarsten has quit IRC03:57
*** gnuoy has quit IRC04:00
*** jamespage has quit IRC04:00
*** shashank_hegde has quit IRC04:00
*** links has joined #openstack-infra04:00
*** gnuoy has joined #openstack-infra04:00
*** jamespage has joined #openstack-infra04:01
ianwprometheanfire: http://logs.openstack.org/96/247296/12/check/gate-dib-dsvm-functests-ubuntu-trusty-extras-nv/8a9fd70/console.html#_2016-06-01_03_46_18_320 <- weird ... have we destroyed the locales on the host system?04:01
ianwdoesn't happen on the centos build04:02
*** cody-somerville has quit IRC04:04
*** jamielennox is now known as jamielennox|away04:08
yanyanhuianw, you mean space between ],[ and || ?04:09
*** Julien-zte has quit IRC04:09
ianwyanyanhu: yes, you want a space in there04:09
yanyanhuianw, ok. but I tested locally and found it works04:10
yanyanhuwithout space between ] and ||04:10
yanyanhuso not sure whether there is something different in gate side04:10
yanyanhuianw, let me make some tests. Thank you so much for your kind help :)04:12
ianwyanyanhu: hmmm, yeah, maybe i mistyped04:12
*** psachin has joined #openstack-infra04:15
ianwyanyanhu: oh i see it04:15
ianwoh, no, you're appending PROJECTS ... hmm04:16
yanyanhuyes...04:16
*** sputnik13 has joined #openstack-infra04:16
*** sputnik13 has quit IRC04:16
yanyanhuso no overwriting here04:17
*** sarob has quit IRC04:18
*** shashank_hegde has joined #openstack-infra04:19
*** yamahata has joined #openstack-infra04:19
*** david-lyle has quit IRC04:21
*** Sukhdev has joined #openstack-infra04:26
*** piet has joined #openstack-infra04:29
*** psachin has quit IRC04:35
prometheanfireianw: I'm moving now04:35
ianwyanyanhu: it really seems like maybe the job hasn't been refreshed04:35
prometheanfireianw: was that me?04:36
prometheanfirethe locale thing04:36
yanyanhuianw, so you mean I should wait for a while for gate to refresh the job configuration?04:37
ianwyanyanhu: well it seems like it's been a few days since you put in the fix, it should be right ...04:37
*** amitgandhinz has joined #openstack-infra04:37
*** liusheng has quit IRC04:37
ianwpromethanfire: i don't know, haven't debugged it04:38
yanyanhuianw, I see. Will try it again later. Thanks :)04:38
*** liusheng has joined #openstack-infra04:39
yanyanhuor in worst case, will propose a patch to move it to the top of the script...04:40
ianwyanyanhu: you shouldn't have to move it; try running it a few times and see if any fail.  i'm not sure how to tell what jenkins host is running your jobs now, as we don't link it on the status page.04:42
*** amitgandhinz has quit IRC04:42
*** armax has quit IRC04:42
*** DanielSchieber has joined #openstack-infra04:43
yanyanhuianw, I see, will try more to see whether I can get expected result, thanks.04:44
*** thorst has joined #openstack-infra04:44
*** sputnik13 has joined #openstack-infra04:44
*** piet has quit IRC04:45
*** sputnik13 has quit IRC04:46
*** roxanaghe has quit IRC04:47
*** psachin has joined #openstack-infra04:47
*** thorst has quit IRC04:51
*** sree has joined #openstack-infra04:56
openstackgerritMatthew Treinish proposed openstack-infra/system-config: Set openstack-health cache_expiration to 5min  https://review.openstack.org/32365804:58
*** mrmartin has joined #openstack-infra05:01
*** Douhet has joined #openstack-infra05:02
*** rcernin has quit IRC05:04
*** DanielSchieber has quit IRC05:05
*** DanielSchieber has joined #openstack-infra05:05
DanielSchieberhi05:07
*** DanielSchieber has quit IRC05:09
*** Daisy has joined #openstack-infra05:10
*** fitoduarte has joined #openstack-infra05:18
*** prometheanfire has quit IRC05:20
*** DanielSchiber has joined #openstack-infra05:21
*** asettle has joined #openstack-infra05:24
*** _vsaienko has joined #openstack-infra05:24
*** mtanino has joined #openstack-infra05:25
*** Sukhdev has quit IRC05:26
*** _vsaienko has quit IRC05:26
*** hdaniel has joined #openstack-infra05:26
*** _vsaienko has joined #openstack-infra05:26
*** asettle has quit IRC05:28
*** bhavik has joined #openstack-infra05:29
*** fitoduarte has quit IRC05:29
*** fitoduarte has joined #openstack-infra05:30
*** Sukhdev has joined #openstack-infra05:30
*** mtanino has quit IRC05:31
*** Sukhdev_ has joined #openstack-infra05:33
*** Sukhdev has quit IRC05:34
openstackgerritMerged openstack-infra/shade: incorporate unit test in test_shade.py, remove test_router.py fix tenant_id in router add functional test test_create_router_project to functional/test_router.py add unit/test_router.py add project_id to create_router  https://review.openstack.org/31698705:36
*** nadya has joined #openstack-infra05:38
*** amitgandhinz has joined #openstack-infra05:38
*** guardianJ has joined #openstack-infra05:38
*** Julien-zte has joined #openstack-infra05:39
*** HeOS has joined #openstack-infra05:41
*** Daisy has quit IRC05:42
*** Daisy has joined #openstack-infra05:42
*** gildub has joined #openstack-infra05:42
*** rcernin has joined #openstack-infra05:43
*** amitgandhinz has quit IRC05:43
*** Daisy has quit IRC05:44
*** Daisy has joined #openstack-infra05:44
*** javeriak has joined #openstack-infra05:44
*** _vsaienko has quit IRC05:46
*** roxanaghe has joined #openstack-infra05:48
*** _vsaienko has joined #openstack-infra05:48
*** thorst has joined #openstack-infra05:49
*** nadya has quit IRC05:51
*** sdake has joined #openstack-infra05:52
*** roxanaghe has quit IRC05:52
*** nadya has joined #openstack-infra05:52
*** guardianJ has quit IRC05:53
*** sdake_ has quit IRC05:55
*** thorst has quit IRC05:57
*** woodster_ has quit IRC05:58
*** nadya has quit IRC05:58
*** xiangxinyong has joined #openstack-infra06:05
*** yamahata has quit IRC06:05
*** mrmartin has quit IRC06:07
*** oanson has joined #openstack-infra06:08
*** yolanda_ has quit IRC06:09
*** yolanda has joined #openstack-infra06:09
*** infra-red has joined #openstack-infra06:10
yolandagood morning06:12
*** Sukhdev_ has quit IRC06:14
*** Sukhdev has joined #openstack-infra06:15
*** sdake has quit IRC06:15
openstackgerritMerged openstack-infra/project-config: Add releasenotes jobs for python-manilaclient  https://review.openstack.org/32071506:16
*** asettle has joined #openstack-infra06:16
*** _vsaienko has quit IRC06:17
*** hdaniel has quit IRC06:19
*** zeih has joined #openstack-infra06:19
*** Sukhdev has quit IRC06:19
yanyanhuhi, yolanda, morning, are you still around?06:20
openstackgerritMerged openstack-infra/project-config: Remove integrated jobs from neutron-fwaas project config  https://review.openstack.org/32116006:20
*** _vsaienko has joined #openstack-infra06:20
openstackgerritMerged openstack-infra/project-config: Remove novnc service from smaug fullstack job  https://review.openstack.org/32331606:20
*** asettle has quit IRC06:21
*** yolanda_ has joined #openstack-infra06:22
*** yolanda_ has quit IRC06:22
*** yolanda_ has joined #openstack-infra06:22
*** markvoelker has quit IRC06:24
*** yolanda has quit IRC06:25
*** yolanda_ has quit IRC06:26
*** yolanda has joined #openstack-infra06:26
*** bswartz has quit IRC06:27
*** sarob has joined #openstack-infra06:30
*** hogepodge has joined #openstack-infra06:31
*** infra-red has quit IRC06:31
*** ihrachys has joined #openstack-infra06:34
*** _vsaienko has quit IRC06:34
*** nadya has joined #openstack-infra06:34
*** sarob has quit IRC06:36
*** beisner has quit IRC06:38
*** _vsaienko has joined #openstack-infra06:39
*** rlandy has quit IRC06:39
*** amitgandhinz has joined #openstack-infra06:39
*** nadya has quit IRC06:39
*** amitgandhinz has quit IRC06:44
*** Julien-zte has quit IRC06:45
*** nadya has joined #openstack-infra06:47
*** _vsaienko has quit IRC06:47
*** roxanaghe has joined #openstack-infra06:49
*** _vsaienko has joined #openstack-infra06:52
*** roxanaghe has quit IRC06:53
*** beisner has joined #openstack-infra06:54
openstackgerritMerged openstack-infra/zuul: Ansible launcher: remove excess newlines in ansible logs  https://review.openstack.org/32186606:56
*** _vsaienko has quit IRC06:58
*** _vsaienko has joined #openstack-infra06:58
*** sree has quit IRC06:58
openstackgerritChristian Schwede proposed openstack-infra/devstack-gate: Use subnodes for Swift storage nodes in a multinode setup  https://review.openstack.org/30446507:00
*** savihou has joined #openstack-infra07:02
*** _vsaienko has quit IRC07:02
yanyanhuhi, ianw, still around? It finally works :) I think just as you said, the latest configuration was not refreshed and thus failed the gate job.07:03
*** tesseract has joined #openstack-infra07:03
*** _vs has joined #openstack-infra07:04
*** slagle has quit IRC07:06
*** hdaniel has joined #openstack-infra07:07
*** javeriak has quit IRC07:08
*** _vs has quit IRC07:08
*** _vs has joined #openstack-infra07:08
openstackgerritMerged openstack-infra/shade: Add magnum baymodel calls to shade.  https://review.openstack.org/30800907:10
ianwyanyanhu: hey, so if you see a failure again, bring it up, one of the jenkins hosts might be out of sync07:11
*** ifarkas has joined #openstack-infra07:11
*** nmagnezi has joined #openstack-infra07:11
yanyanhuianw, yes07:12
*** javeriak has joined #openstack-infra07:12
yanyanhuwill keep testing, thanks :)07:12
*** Hal has joined #openstack-infra07:12
*** Hal is now known as Guest9621307:13
*** thorst has joined #openstack-infra07:14
*** _vs has quit IRC07:14
*** hichihara has joined #openstack-infra07:15
*** infra-red has joined #openstack-infra07:16
*** _vsaienko has joined #openstack-infra07:17
*** esikachev has joined #openstack-infra07:18
*** sree has joined #openstack-infra07:18
*** amoralej|off is now known as amoralej07:18
*** nadya has quit IRC07:21
*** mikelk has joined #openstack-infra07:21
*** jerryz has joined #openstack-infra07:22
*** thorst has quit IRC07:22
*** vincentll has joined #openstack-infra07:23
*** mrmartin has joined #openstack-infra07:24
*** bryan_att has joined #openstack-infra07:25
*** amotoki has joined #openstack-infra07:26
*** jlanoux has joined #openstack-infra07:26
*** pcaruana has joined #openstack-infra07:26
openstackgerritGhe Rivero proposed openstack-infra/shade: Add network quotas support  https://review.openstack.org/31914407:28
*** _vsaienko has quit IRC07:28
*** matrohon has joined #openstack-infra07:29
*** _vs has joined #openstack-infra07:29
*** yaume has joined #openstack-infra07:29
*** arxcruz has joined #openstack-infra07:29
*** e0ne has joined #openstack-infra07:32
*** _vs has quit IRC07:33
penguinologGood morning! Please, review https://review.openstack.org/#/c/320298/07:34
*** abregman has joined #openstack-infra07:34
*** dtantsur|afk is now known as dtantsur07:35
*** samuelBartel has joined #openstack-infra07:36
*** sree has quit IRC07:36
*** _vsaienko has joined #openstack-infra07:36
*** _vsaienko has quit IRC07:38
openstackgerrityolanda.robla proposed openstack-infra/shade: Add magnum services call to shade  https://review.openstack.org/31358307:39
*** amitgandhinz has joined #openstack-infra07:40
*** _vsaienko has joined #openstack-infra07:41
*** daemontool_ has joined #openstack-infra07:42
*** amitgandhinz has quit IRC07:44
*** gsagie has joined #openstack-infra07:45
gsagieanyone familiar with this error: http://logs.openstack.org/39/323439/3/check/gate-smaug-python34/76145ae/console.html07:46
gsagieImportError: No module named 'vine'07:46
gsagieFile "/home/jenkins/workspace/gate-smaug-python34/.tox/py34/lib/python3.4/site-packages/amqp/five.py", line 14, in <module>07:47
gsagie2016-06-01 06:27:36.962 |     import vine.five07:47
*** _vsaienko has quit IRC07:48
openstackgerrityolanda.robla proposed openstack-infra/shade: Add bay certificates to shade  https://review.openstack.org/31330807:48
*** _vsaienko has joined #openstack-infra07:49
*** roxanaghe has joined #openstack-infra07:49
*** shashank_hegde has quit IRC07:49
*** infra-red has quit IRC07:52
*** andymaier has joined #openstack-infra07:52
openstackgerritYanyan Hu proposed openstack-infra/project-config: Fix rally gate job for magnum  https://review.openstack.org/32370107:53
*** roxanaghe has quit IRC07:54
*** infra-red has joined #openstack-infra07:54
*** jerryz has quit IRC07:57
openstackgerritMonty Taylor proposed openstack-infra/project-config: Add os-client-config patches to infra channel  https://review.openstack.org/32370507:57
*** yamahata has joined #openstack-infra07:57
mordredyolanda: also, that ^^ (realized that I think infra folks don't always see occ patches(07:58
*** dizquierdo has joined #openstack-infra07:59
*** zzzeek has quit IRC08:00
yolandamordred, i'm doing a filter for openstack-infra projects, so i miss anything that is not on this pattern :(08:00
*** rossella_s has joined #openstack-infra08:01
*** zzzeek has joined #openstack-infra08:01
openstackgerritMerged openstack-infra/zuul: Ansible launcher: Do not log long ansible lines  https://review.openstack.org/32186908:02
*** _vsaienko has quit IRC08:03
*** _vsaienko has joined #openstack-infra08:03
openstackgerritMilan Kováčik proposed openstack-infra/project-config: Put inspector basic tempest job to check pipeline  https://review.openstack.org/32370808:06
openstackgerritMasayuki Igawa proposed openstack-infra/subunit2sql: Remove useless links from index page  https://review.openstack.org/32371108:06
*** hashar has joined #openstack-infra08:08
*** jaosorior has joined #openstack-infra08:08
*** Guest96213 has quit IRC08:09
*** ihrachys has quit IRC08:09
*** abregman is now known as abregman|mtg08:10
*** ihrachys has joined #openstack-infra08:11
*** infra-red has quit IRC08:12
*** mixos has quit IRC08:12
*** infra-red has joined #openstack-infra08:15
*** yamahata has quit IRC08:15
openstackgerritLiam Young proposed openstack-infra/project-config: Add missing Openstack Juju charm  https://review.openstack.org/32371608:15
*** yamahata has joined #openstack-infra08:16
ianwyolanda: looks like it's fixed? -> http://logs.openstack.org/periodic/dib-buildimage-atomic-f23/646136f/console.html08:17
*** ihrachys has quit IRC08:19
vponomaryovgsagie: you are not alone, it fails in manila project too - http://logs.openstack.org/46/317246/4/check/gate-manila-python34-db/696c2fb/console.html08:20
*** ihrachys has joined #openstack-infra08:20
*** thorst has joined #openstack-infra08:20
yolandaianw, yes, the refactor of yum-minimal fixed it08:21
gsagievponomaryov: seems like a problem in oslo.messaging08:22
*** mkoderer has quit IRC08:22
*** dtardivel has joined #openstack-infra08:22
*** cgross- has quit IRC08:22
*** lmiccini has quit IRC08:22
*** abregman|mtg has quit IRC08:22
*** mkoderer has joined #openstack-infra08:26
*** Hal has joined #openstack-infra08:26
*** Hal is now known as Guest8575908:26
*** thorst has quit IRC08:27
*** jordanP has joined #openstack-infra08:27
*** jordanP has quit IRC08:27
*** cgross has joined #openstack-infra08:27
*** jordan_ has joined #openstack-infra08:27
*** mhickey has joined #openstack-infra08:27
openstackgerritAnton Arefiev proposed openstack-infra/project-config: Move tempest-dsvm-ironic-inspector to check  https://review.openstack.org/32372608:28
*** andreas_s has joined #openstack-infra08:29
*** Na3iL has joined #openstack-infra08:29
*** abregman has joined #openstack-infra08:30
*** dizquierdo has quit IRC08:30
*** lmiccini has joined #openstack-infra08:31
*** dtantsur is now known as dtantsur|bbl08:31
*** mescanef_ has joined #openstack-infra08:31
*** lewo has quit IRC08:32
*** jyuso1 has joined #openstack-infra08:32
*** ihrachys has quit IRC08:32
*** lewo has joined #openstack-infra08:32
*** ihrachys has joined #openstack-infra08:33
*** ihrachys has quit IRC08:33
*** mescanef has quit IRC08:33
*** haaj has joined #openstack-infra08:34
openstackgerritMonty Taylor proposed openstack-infra/zuul: WIP: DNM - Add web-based console log streaming  https://review.openstack.org/32056308:35
savihou\08:35
*** electrofelix has joined #openstack-infra08:36
*** markvoelker has joined #openstack-infra08:37
*** dmk0202 has joined #openstack-infra08:38
*** hichihara has quit IRC08:39
*** amitgandhinz has joined #openstack-infra08:40
*** markvoelker has quit IRC08:42
*** Daisy has quit IRC08:42
*** yanyanhu has quit IRC08:43
*** jed56 has joined #openstack-infra08:45
*** amitgandhinz has quit IRC08:45
openstackgerritMerged openstack-infra/project-config: Remove more old Ironic ramdisk gates  https://review.openstack.org/31847708:47
*** derekh has joined #openstack-infra08:47
*** Daisy has joined #openstack-infra08:47
mordreddo we have any known sphinx build issues?08:48
openstackgerritMerged openstack-infra/project-config: fuel-devops: Docs is voting, use python-jobs template  https://review.openstack.org/32029808:48
*** dmk0202 has quit IRC08:48
*** roxanaghe has joined #openstack-infra08:50
yolandaseems there is some problem with publishing to static...08:52
yolandaat least my latest patches failed08:52
openstackgerritMerged openstack-infra/project-config: Enable freezer-api plugin in devstack job  https://review.openstack.org/32110208:52
openstackgerritMerged openstack-infra/project-config: Add testing jobs for TripleO Ci  https://review.openstack.org/32095708:52
*** arxcruz has quit IRC08:53
*** arxcruz has joined #openstack-infra08:54
openstackgerritMerged openstack-infra/system-config: Check openstack/openstack in rename process  https://review.openstack.org/31866508:55
mordredjeblair: http://logs.openstack.org/03/323703/1/check/gate-os-client-config-docs/02e6fc8/console.html ran on a zuul worker and was reported as failed, even though it succeeded08:56
yolandamordred, that's exact error i was seeing as well08:58
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Add ironic-staging-drivers-dsvm job  https://review.openstack.org/29931808:58
*** daemontool_ has quit IRC08:58
yolandaand some other jobs i had, they had status failed and logs were not present , 404 error when clicking the link08:58
strigaziHi jhesketh, I made a boo-boo https://review.openstack.org/#/c/32370108:58
*** daemontool has joined #openstack-infra08:59
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: [NO MERGY] Test a fake periodic job  https://review.openstack.org/22978908:59
*** psachin_ has joined #openstack-infra09:00
*** markusry has joined #openstack-infra09:01
*** psachin has quit IRC09:01
*** jaosorior has quit IRC09:02
*** jaosorior has joined #openstack-infra09:02
*** jlanoux has quit IRC09:02
*** jlanoux has joined #openstack-infra09:03
*** yamahata has quit IRC09:08
*** tosky has joined #openstack-infra09:08
*** _vsaienko has quit IRC09:08
*** Na3iL has quit IRC09:08
*** jlanoux has quit IRC09:08
*** jlanoux has joined #openstack-infra09:09
*** sambetts|afk is now known as sambetts09:09
*** Daisy_ has joined #openstack-infra09:09
*** kzaitsev_mb has joined #openstack-infra09:10
*** prometheanfire has joined #openstack-infra09:11
openstackgerritYann Voté proposed openstack-infra/jenkins-job-builder: Allow to configure workflow job in Groovy file  https://review.openstack.org/32374409:11
*** daemontool has quit IRC09:11
*** daemontool_ has joined #openstack-infra09:11
odyssey4meyolanda will AJaeger be available before this w/end? He has a block vote on https://review.openstack.org/299192 which needs to be done in the rename work this weekend.09:12
*** Daisy has quit IRC09:13
*** _vs has joined #openstack-infra09:15
*** haaj has quit IRC09:16
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Add Major upgrade function to the tripleo ci script  https://review.openstack.org/32375009:18
jd__yeah I'm seeing weird failures too…09:19
*** asettle has joined #openstack-infra09:20
*** jtomasek has joined #openstack-infra09:22
*** asettle has quit IRC09:22
openstackgerritMartin Mágr proposed openstack-infra/project-config: Retire monitoring-for-openstack  https://review.openstack.org/32375109:24
*** thorst has joined #openstack-infra09:25
yolandaodyssey4me, i don't know, he was on holiday but I don't know when he returns09:25
odyssey4meyolanda I guess if he hasn't come back by Friday I'll just have to publish a new patch to replace that one.09:28
odyssey4meyolanda thanks, just checking - do you know who's handling the renames?09:28
*** fitoduarte has quit IRC09:29
*** fitoduarte has joined #openstack-infra09:30
*** DanielSchiber has quit IRC09:30
yolandaodyssey4me, i guess it will team effort, although i have not been following closely on the latest times09:30
mordredoh. that reminds me. I have a patch I should push up for that09:32
*** thorst has quit IRC09:32
jheskethstrigazi: ah, sorry I missed that yesterday. +W09:34
odyssey4memordred haha, sleep is optional :p09:34
*** Daisy_ has quit IRC09:34
*** Daisy has joined #openstack-infra09:35
*** eezhova has joined #openstack-infra09:35
mordredodyssey4me: sleep is an option?09:38
*** Daisy has quit IRC09:39
*** amitgandhinz has joined #openstack-infra09:41
openstackgerritMerged openstack-infra/project-config: Fix rally gate job for magnum  https://review.openstack.org/32370109:42
strigazijhesketh: thanks09:42
*** vgridnev has joined #openstack-infra09:42
*** asettle has joined #openstack-infra09:43
vgridnevhello infra team, have you noticed strange failures caused by new release of amqp=2.0.1 ? Like this one http://logs.openstack.org/47/323747/1/check/gate-vitrage-python34/d00091a/console.html#_2016-06-01_09_41_03_130 or http://logs.openstack.org/36/323336/8/check/gate-sahara-python34-db/4410b3c/console.html#_2016-06-01_08_14_51_029 ?09:44
*** jamielennox|away is now known as jamielennox09:44
vgridnevthat is python34 jobs09:44
*** GheRivero has left #openstack-infra09:45
*** amitgandhinz has quit IRC09:46
*** matrohon has quit IRC09:47
openstackgerritMerged openstack-infra/project-config: Add Zaqar-UI translation settings  https://review.openstack.org/31916609:47
*** Jeffrey4l_ has quit IRC09:48
*** gildub has quit IRC09:50
*** roxanaghe has joined #openstack-infra09:51
*** Na3iL has joined #openstack-infra09:54
*** ifarkas has quit IRC09:55
*** roxanaghe has quit IRC09:55
*** julim has quit IRC09:55
*** BobBall_AWOL is now known as BobBall09:56
*** vdrok has joined #openstack-infra09:56
*** asettle has quit IRC09:57
*** amcguign has joined #openstack-infra09:57
*** ihrachys has joined #openstack-infra09:58
*** ifarkas has joined #openstack-infra09:58
*** daemontool_ has quit IRC10:00
*** rhallisey has joined #openstack-infra10:02
*** julim has joined #openstack-infra10:03
*** amcguign has quit IRC10:03
*** cdent has joined #openstack-infra10:04
rcarrillocruzanyone having issues with devstack nodes on ubuntu-trusty? http://logs.openstack.org/89/322189/9/check/gate-ansible-role-cloud-launcher-dsvm-ansible-func-ubuntu-trusty/eeb4c78/logs/devstacklog.txt.gz10:05
rcarrillocruzdevstack fails cos root user cannot access mysql on localhost10:06
*** dtantsur|bbl is now known as dtantsur10:06
*** cdent has left #openstack-infra10:06
*** Qiming has quit IRC10:06
rcarrillocruzsame test works on centos-7 node10:06
*** _degorenko|afk is now known as degorenko10:06
rcarrillocruzyolanda: rings a bell ^ ?10:07
yolandarcarrillocruz, let me see logs10:08
yolandacentos-7 uses same creds i guess?10:09
*** jlanoux has quit IRC10:09
*** pbourke_ has quit IRC10:09
*** jlanoux has joined #openstack-infra10:10
*** pbourke_ has joined #openstack-infra10:10
rcarrillocruzif you go to a succesful centos-7 job:10:10
rcarrillocruzhttp://logs.openstack.org/89/322189/9/check/gate-ansible-role-cloud-launcher-dsvm-ansible-func-centos-7/f5650e7/logs/devstacklog.txt.gz10:10
rcarrillocruzconfigure_database_mysql (ctrl-F)10:10
rcarrillocruzthe grant succeds, root can connect to mysql on localhost10:11
*** haaj has joined #openstack-infra10:11
*** dizquierdo has joined #openstack-infra10:13
yolandai looked and your creds look fine. Was the job successful at some point?10:15
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Add Major upgrade function to the tripleo ci script  https://review.openstack.org/32375010:16
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: [NO MERGY] Test a fake periodic job  https://review.openstack.org/22978910:18
*** _vs has quit IRC10:18
*** _vs has joined #openstack-infra10:18
rcarrillocruzthe ubuntu job has never been succesful10:18
rcarrillocruzwhereas the centos always is10:18
rcarrillocruzchange is https://review.openstack.org/#/c/322189/ btw10:21
*** csatari has joined #openstack-infra10:21
*** yolanda has quit IRC10:22
*** yolanda has joined #openstack-infra10:23
*** esikachev has quit IRC10:23
*** samuelBartel has quit IRC10:23
*** haaj has quit IRC10:27
*** lezbar has joined #openstack-infra10:28
*** asettle has joined #openstack-infra10:29
*** thorst has joined #openstack-infra10:29
*** rossella_s has quit IRC10:36
*** _vs has quit IRC10:36
*** rossella_s has joined #openstack-infra10:37
*** esikachev has joined #openstack-infra10:37
*** thorst has quit IRC10:38
*** _vs has joined #openstack-infra10:38
*** zhurong has quit IRC10:40
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Add Major upgrade function to the tripleo ci script  https://review.openstack.org/32375010:41
*** amitgandhinz has joined #openstack-infra10:42
*** ccamacho is now known as ccamacho|lunch10:44
*** sdague has joined #openstack-infra10:47
*** amitgandhinz has quit IRC10:47
openstackgerritJamie Lennox proposed openstack-infra/puppet-jenkins: Use servername and apache_name in vhost  https://review.openstack.org/32378810:50
*** haaj has joined #openstack-infra10:50
*** roxanaghe has joined #openstack-infra10:52
*** ifarkas has quit IRC10:52
openstackgerritLingxian Kong proposed openstack-infra/project-config: Add openstack-server-release-jobs to Mistral in zuul  https://review.openstack.org/32127110:52
*** moravec has joined #openstack-infra10:53
*** yamamoto has quit IRC10:55
*** roxanaghe has quit IRC10:56
*** bhavik has quit IRC10:58
*** _vs has quit IRC10:59
*** _vs has joined #openstack-infra11:00
*** Guest_85754 has joined #openstack-infra11:02
Guest_85754Allah is doing11:02
Guest_85754sun is not doing Allah is doing11:03
Guest_85754moon is not doing Allah is doing11:03
Guest_85754stars are not doing Allah is doing11:03
Guest_85754planets are not doing Allah is doing11:03
Guest_85754galaxies are not doing Allah is doing11:04
Guest_85754oceans are not doing Allah is doing11:06
*** claudiub has joined #openstack-infra11:06
odyssey4meIs it possible to have two groups configured as a core group for a repository? If so, can someone help me out with understanding how to do this?11:07
yolandaodyssey4me, what i've seen typically, is one group containing another11:08
*** weshay has joined #openstack-infra11:08
odyssey4meyolanda in this case I'd prefer not to do that - I'd rather have two distinct groups, each with their own rights11:09
*** notnownikki has joined #openstack-infra11:09
yolandaodyssey4me,cannot confirm 100%, but i think that if you add several lines with -2..+2 rights for different groups, it will work11:10
odyssey4mehow do I define the group though, if it's in the gerrit/acls/openstack/<repo name>.config file does it just get generated if it doesn't already exist?11:11
Guest_85754mountains are not doing Allah is doing11:11
yolandaodyssey4me, groups are created automatically when defined on the acl11:12
*** slagle has joined #openstack-infra11:13
yolandamaybe other infra cores can give feedback, because i cannot confirm 100% if that will work, or if it is a desired approach11:13
odyssey4meyolanda ah, I found my previous conversation with AJaeger - he mentioned gerrit/acls/openstack/trove-dashboard.config as an example11:13
yolandaok so that will work :)11:14
*** mrmartin has quit IRC11:14
*** raildo-afk is now known as raildo11:15
*** javeriak has quit IRC11:15
mordredodyssey4me: the other approach is similar to what yolanda said with groups containing groups ...11:15
Guest_85754trees are not doing Allah is doing11:15
*** javeriak has joined #openstack-infra11:15
yolandamordred, do you have powers to kick that user?11:16
mordredodyssey4me: which is to make a 3rd group for the repo in question, and then to add both groups to that group as an included group11:16
*** ZZelle has joined #openstack-infra11:16
*** lucasagomes is now known as lucas-hungry11:16
mordredbut whichever works for you11:16
*** ChanServ sets mode: +o mordred11:17
odyssey4methanks for confirming mordred & yolanda - let me take a crack at it11:17
*** Guest_85754 was kicked by mordred (Guest_85754)11:17
*** Qiming has joined #openstack-infra11:18
mordredyolanda: done! :)11:19
yolanda++11:19
*** nadya has joined #openstack-infra11:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Setup OSA os_swift core group  https://review.openstack.org/32380211:26
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Setup OSA os_swift core group  https://review.openstack.org/32380211:27
odyssey4meapologies for the spam - I missed the new file11:27
*** _amrith_ is now known as amrith11:27
odyssey4memordred yolanda does that look right?11:28
*** ccamacho|lunch is now known as ccamacho11:28
mordredodyssey4me: yah11:29
odyssey4meexcellent, I have a few more of those to work up11:29
*** ldnunes has joined #openstack-infra11:31
openstackgerritMerged openstack-infra/project-config: Add os-client-config patches to infra channel  https://review.openstack.org/32370511:32
*** rodrigods has quit IRC11:32
*** rodrigods has joined #openstack-infra11:32
*** gordc has joined #openstack-infra11:32
openstackgerritMerged openstack-infra/project-config: Create separate tacker-horizon-core ACL  https://review.openstack.org/32361311:33
*** _vs has quit IRC11:33
openstackgerritMerged openstack-infra/project-config: Add bitrot jobs for Manila  https://review.openstack.org/31867611:34
*** jlanoux has quit IRC11:34
*** eezhova has quit IRC11:34
*** _vs has joined #openstack-infra11:34
*** links has quit IRC11:34
*** jlanoux has joined #openstack-infra11:35
*** mrmartin has joined #openstack-infra11:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Setup OSA os_zaqar core group  https://review.openstack.org/32380611:35
*** ifarkas has joined #openstack-infra11:36
*** _vs has quit IRC11:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Setup OSA os_sahara core group  https://review.openstack.org/32381111:39
*** _vs has joined #openstack-infra11:40
*** puiterwijk|cld is now known as patricku11:41
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Setup OSA os_sahara core group  https://review.openstack.org/32381111:41
openstackgerritMichal Vanco proposed openstack-infra/zuul: Support for dependent pipelines with github  https://review.openstack.org/24750011:41
openstackgerritMichal Vanco proposed openstack-infra/zuul: Merge pull requests from github reporter  https://review.openstack.org/24325011:41
openstackgerritMichal Vanco proposed openstack-infra/zuul: GitHub file matching support  https://review.openstack.org/29237611:41
openstackgerritMichal Vanco proposed openstack-infra/zuul: Allow github trigger to match on branches/refs  https://review.openstack.org/25844811:41
openstackgerritMichal Vanco proposed openstack-infra/zuul: Encapsulate determining the event purpose  https://review.openstack.org/24748711:41
openstackgerritMichal Vanco proposed openstack-infra/zuul: Log GitHub API rate limit  https://review.openstack.org/29237711:41
openstackgerritMichal Vanco proposed openstack-infra/zuul: support github pull reqeust labels  https://review.openstack.org/24742111:41
openstackgerritMichal Vanco proposed openstack-infra/zuul: Better merge message for GitHub pull reqeusts  https://review.openstack.org/28066711:41
*** thorst has joined #openstack-infra11:41
*** zqfan has quit IRC11:43
*** amitgandhinz has joined #openstack-infra11:43
*** masayukig has quit IRC11:43
*** jlanoux has quit IRC11:44
*** jlanoux has joined #openstack-infra11:44
*** baoli has joined #openstack-infra11:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Setup OSA os_cloudkitty core group  https://review.openstack.org/32381311:44
*** patricku has quit IRC11:45
*** patricku has joined #openstack-infra11:45
*** haaj has quit IRC11:45
*** links has joined #openstack-infra11:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Setup OSA os_aodh core group  https://review.openstack.org/32381511:47
*** amitgandhinz has quit IRC11:48
*** zhurong has joined #openstack-infra11:49
*** masayukig has joined #openstack-infra11:50
*** _vs has quit IRC11:51
*** Na3iL has quit IRC11:53
*** roxanaghe has joined #openstack-infra11:53
*** _vs has joined #openstack-infra11:53
*** nadya has quit IRC11:57
*** roxanaghe has quit IRC11:58
*** baoli_ has joined #openstack-infra11:59
*** exploreshaifali has joined #openstack-infra11:59
*** aysyd has joined #openstack-infra11:59
*** haaj has joined #openstack-infra12:00
tdurakovclarkb: hey, are you around?12:01
*** baoli has quit IRC12:02
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Setup OSA os_ceilometer core group  https://review.openstack.org/32382312:04
*** _vs has quit IRC12:05
*** _vs has joined #openstack-infra12:07
*** pblaho has quit IRC12:08
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Setup OSA security core group  https://review.openstack.org/32382512:08
*** jcoufal has joined #openstack-infra12:08
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Better repo manipulation tools  https://review.openstack.org/22756312:09
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Cherrypick nova for https://bugs.launchpad.net/tripleo/+bug/1585641  https://review.openstack.org/32351612:09
openstackLaunchpad bug 1585641 in tripleo "CI: jobs failing with Message: No valid host was found. There are not enough hosts available., Code: 500"" [High,Triaged] - Assigned to James Slagle (james-slagle)12:09
*** moravec has quit IRC12:09
*** mrmartin has quit IRC12:09
*** pblaho has joined #openstack-infra12:09
*** javeriak has quit IRC12:11
*** jtomasek has quit IRC12:11
*** lucas-hungry is now known as lucasagomes12:12
*** sarob has joined #openstack-infra12:12
*** eezhova has joined #openstack-infra12:15
*** nadya has joined #openstack-infra12:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Setup OSA os_designate core group  https://review.openstack.org/32383012:16
*** jlanoux has quit IRC12:17
*** jlanoux has joined #openstack-infra12:17
*** sarob has quit IRC12:17
*** csatari_ has joined #openstack-infra12:17
*** openstackgerrit has quit IRC12:18
*** csatari has quit IRC12:18
*** openstackgerrit has joined #openstack-infra12:18
openstackgerritMerged openstack-infra/project-config: Setup OSA os_swift core group  https://review.openstack.org/32380212:18
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Cherrypick nova for bug 1585641  https://review.openstack.org/32351612:19
openstackbug 1585641 in tripleo "CI: jobs failing with Message: No valid host was found. There are not enough hosts available., Code: 500"" [High,Triaged] https://launchpad.net/bugs/1585641 - Assigned to James Slagle (james-slagle)12:19
*** nadya has quit IRC12:19
*** jtomasek has joined #openstack-infra12:20
*** tpsilva has joined #openstack-infra12:22
*** dprince has joined #openstack-infra12:23
*** markvoelker has joined #openstack-infra12:24
*** pradk has quit IRC12:24
*** nadya has joined #openstack-infra12:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Setup OSA os_ironic core group  https://review.openstack.org/32383512:25
*** ociuhandu has quit IRC12:26
*** EricGonczer_ has joined #openstack-infra12:26
*** trown|outtypewww is now known as trown12:27
*** anteaya has joined #openstack-infra12:27
*** samuelBartel has joined #openstack-infra12:28
*** nadya has quit IRC12:29
*** EricGonczer_ has quit IRC12:29
openstackgerritDaniel Koenig-Schieber proposed openstack-infra/project-config: Add networking-extreme project to neutron  https://review.openstack.org/32280312:30
*** zqfan has joined #openstack-infra12:30
openstackgerritJan Hruban proposed openstack-infra/zuul: Support GitHub PR webhooks  https://review.openstack.org/16311712:30
openstackgerritJan Hruban proposed openstack-infra/zuul: Make the string representation of change transparent  https://review.openstack.org/23894812:30
openstackgerritJan Hruban proposed openstack-infra/zuul: Lower the log level in tests  https://review.openstack.org/26336412:30
openstackgerritJan Hruban proposed openstack-infra/zuul: Merge pull requests from github reporter  https://review.openstack.org/24325012:30
openstackgerritJan Hruban proposed openstack-infra/zuul: Encapsulate determining the event purpose  https://review.openstack.org/24748712:30
openstackgerritJan Hruban proposed openstack-infra/zuul: Fix job hierarchy bug.  https://review.openstack.org/19245712:30
openstackgerritJan Hruban proposed openstack-infra/zuul: support github pull reqeust labels  https://review.openstack.org/24742112:30
openstackgerritJan Hruban proposed openstack-infra/zuul: Better merge message for GitHub pull reqeusts  https://review.openstack.org/28066712:30
openstackgerritJan Hruban proposed openstack-infra/zuul: Add 'push' and 'tag' github webhook events.  https://review.openstack.org/19120712:30
openstackgerritJan Hruban proposed openstack-infra/zuul: Add 'pr-comment' github webhook event  https://review.openstack.org/23920312:30
openstackgerritJan Hruban proposed openstack-infra/zuul: Support for dependent pipelines with github  https://review.openstack.org/24750012:30
openstackgerritJan Hruban proposed openstack-infra/zuul: Configurable SSH access to GitHub  https://review.openstack.org/23913812:30
openstackgerritJan Hruban proposed openstack-infra/zuul: GitHub file matching support  https://review.openstack.org/29237612:30
openstackgerritJan Hruban proposed openstack-infra/zuul: Allow github trigger to match on branches/refs  https://review.openstack.org/25844812:30
openstackgerritJan Hruban proposed openstack-infra/zuul: Log GitHub API rate limit  https://review.openstack.org/29237712:30
openstackgerritJan Hruban proposed openstack-infra/zuul: Allow using webapp from connections  https://review.openstack.org/21564212:30
openstackgerritJan Hruban proposed openstack-infra/zuul: Allow list values in template parameters.  https://review.openstack.org/19120812:30
openstackgerritJan Hruban proposed openstack-infra/zuul: Add basic Github Zuul Reporter.  https://review.openstack.org/19131212:30
*** EricGonczer_ has joined #openstack-infra12:32
*** jlanoux has quit IRC12:32
*** jlanoux has joined #openstack-infra12:33
openstackgerritSean Dague proposed openstack-infra/devstack-gate: don't set libvirt cpu_model  https://review.openstack.org/32092512:33
*** EricGonczer_ has quit IRC12:33
*** psilvad has joined #openstack-infra12:34
*** mhickey has quit IRC12:34
*** eharney has joined #openstack-infra12:36
*** esikachev has quit IRC12:37
*** EricGonczer_ has joined #openstack-infra12:37
*** amoralej is now known as amoralej|lunch12:40
*** esikachev has joined #openstack-infra12:40
mordredsdague: I'm excited about that ^^12:41
sdaguemordred: well, hopefully it all works12:41
*** rlandy has joined #openstack-infra12:41
mordredright12:42
mordredI mean12:42
mordredI'm excited by the theory of less complexity12:42
*** amitgandhinz has joined #openstack-infra12:44
*** regXboi has joined #openstack-infra12:44
pleia2good morning12:44
pleia2woo east coast12:44
*** ociuhandu has joined #openstack-infra12:47
*** PollyZ_ has joined #openstack-infra12:47
odyssey4memordred ++12:47
sdaguepleia2: it's finally not 90 degrees even12:48
pleia2I wish mailman let you discard attachments from moderated messages12:48
*** amitgandhinz has quit IRC12:48
pleia2sdague: hah, yeah, only supposed to get into the 70s today!12:48
mordredlook. it's a pleia2 !12:49
pleia2o/12:49
*** akshai has joined #openstack-infra12:49
*** jlanoux has quit IRC12:50
*** jlanoux has joined #openstack-infra12:51
*** matt-borland has joined #openstack-infra12:52
*** Goneri has joined #openstack-infra12:52
*** Jeffrey4l has joined #openstack-infra12:53
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Include moment-timezone to stop all the warnings about it  https://review.openstack.org/32339612:53
*** roxanaghe has joined #openstack-infra12:54
*** denisra has quit IRC12:54
*** markusry has quit IRC12:54
*** csatari_ has quit IRC12:57
*** roxanaghe has quit IRC12:58
*** sree has joined #openstack-infra12:58
*** javeriak has joined #openstack-infra12:58
*** kzaitsev_mb has quit IRC12:59
*** bltavare_ has joined #openstack-infra13:01
*** bltavare_ has quit IRC13:01
*** bswartz has joined #openstack-infra13:01
*** amitgandhinz has joined #openstack-infra13:02
*** amitgandhinz has quit IRC13:03
*** piet has joined #openstack-infra13:03
*** amitgandhinz has joined #openstack-infra13:03
*** burgerk has joined #openstack-infra13:06
*** xyang1 has joined #openstack-infra13:06
*** kzaitsev_mb has joined #openstack-infra13:06
*** kgiusti has joined #openstack-infra13:07
*** sdake has joined #openstack-infra13:09
*** Na3iL has joined #openstack-infra13:11
*** burgerk has quit IRC13:11
*** Na3iL has quit IRC13:11
*** ayoung has joined #openstack-infra13:12
phschwartzWhat is the suggested node amounts for the elk cluster? I want to run it with our downstream ci, just not sure if I should do it all in one or spread things out and add extra nodes as needed.13:14
mordredclarkb: ^^13:14
dmsimardmordred: o/ would love your input on https://review.openstack.org/#/c/321226/ -- you missed out on the meeting yesterday around it http://eavesdrop.openstack.org/irclogs/%23openstack-meeting/%23openstack-meeting.2016-05-31.log.html#t2016-05-31T19:56:0313:16
*** mdrabe has joined #openstack-infra13:16
openstackgerritFrank White proposed openstack-infra/storyboard: Updated documentation to make code snippet clearer  https://review.openstack.org/32385613:17
mordreddmsimard: I think it's great :)13:18
mordreddmsimard: I have not yet had a chance to play with it with an eye on infra use13:18
*** markusry has joined #openstack-infra13:19
dmsimardThe first step is to put it up there in the OpenStack ecosystem, no requirements on being an official OpenStack(-infra) project. The github pull requests are killing me.13:19
dmsimardNot seeing much core reviewer activity on the review though :(13:20
*** dizquierdo has quit IRC13:21
mordreddmsimard: well, I've been vacation and travelling - sorry, I'll get to it :)13:21
dmsimard<313:21
*** exploreshaifali has quit IRC13:21
*** _ari_ has joined #openstack-infra13:21
*** jlanoux has quit IRC13:21
*** banix has joined #openstack-infra13:22
pleia2going to start prepping the etherpad for our friday renames, but we still don't have a change for the openstack-infra/ansible-puppet -> openstack-infra/ansible-role-puppet one13:22
*** jlanoux has joined #openstack-infra13:22
pleia2mordred: do you know if that is that still a desired rename?13:22
*** andrey_veselov has joined #openstack-infra13:22
fungidmsimard: sorry about that. a lot of our reviewers were busy last week with our server upgrades sprint, plus major holidays in canada and the usa last week and this week, so review volume has been suffering13:22
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci: [NO MERGY] Test a fake periodic job  https://review.openstack.org/22978913:23
*** hichihara has joined #openstack-infra13:23
rcarrillocruzclarkb: i'd appreciate your input on https://review.openstack.org/#/c/322189/ , getting access denied for root@mysql during devstack run. Happens on ubuntu-trusty, works fine on centos-713:23
mordredphschwartz: yah - I need to make that change13:23
dmsimardfungi: aye, understandable13:23
*** njohnston has quit IRC13:24
*** esikachev has quit IRC13:24
*** jlanoux has quit IRC13:26
*** jlanoux has joined #openstack-infra13:26
*** piet has quit IRC13:27
openstackgerritPaul Belanger proposed openstack-infra/project-config: Prepare for bindep support  https://review.openstack.org/32386513:28
pleia2does ovh offer non-french emails? :)13:28
pleia2(working on mail filtering)13:28
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add support for bindep  https://review.openstack.org/32245613:28
*** deadnull_ has joined #openstack-infra13:29
pleia2pabelanger: I'm around this week if you want to chat about the issues I was seeing with planet13:29
pabelangerpleia2: sure, maybe after lunch?13:29
pleia2pabelanger: wfm13:29
*** fitoduarte has quit IRC13:30
*** adduarte has joined #openstack-infra13:30
*** haaj_ has joined #openstack-infra13:30
*** esikachev has joined #openstack-infra13:30
*** haaj has quit IRC13:31
*** rbrndt has joined #openstack-infra13:31
*** burgerk has joined #openstack-infra13:31
anteayayolanda tristanC mordred thank you for your reviews on the task tracker spec13:31
*** moravec has joined #openstack-infra13:32
matt-borlandHello...I'm researching the npm-run-lint failures in Horizon...where are the repo(s) that configure the jobs?  I've forgotten. :)13:32
anteayayolanda: um, I'm wondering about your nit, I would agree if the language didn't say, 'the first option, the second option' but the language enumerates13:32
anteayamatt-borland: you probably want to start with project-config13:32
matt-borlandanteaya, thanks!13:33
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Fix Puppet OpenStack Zuul layout ordering  https://review.openstack.org/32387013:33
anteayamatt-borland: I would start with the zuul/layout.yaml file in project-config and go from there13:33
odyssey4mehmm, mordred with https://review.openstack.org/323802 merged, https://review.openstack.org/#/admin/groups/1400 has been created - but has no members, and I have no rights to edit it :/ did I miss something or is this normal, how do I become a member/owner of the group?13:33
yolandaanteaya, i won't -1 for that, i just wanted to raise that, to enumerate the bullet points correctly, if there is another patch needed13:33
*** dizquierdo has joined #openstack-infra13:33
anteayaodyssey4me: you have to ask to be added13:33
*** exploreshaifali has joined #openstack-infra13:33
tristanCanteaya: you're welcome, by the way, i wasn't sure where to note that I'm volonteer to test vmt related requirement for task tracking13:34
pleia2odyssey4me: I'll have a look13:34
anteayayolanda: why do you consider numbering the bullet points correct?13:34
anteayayolanda: because when it is rendered the points are numbered13:34
*** sdake has quit IRC13:34
fungianteaya: i actually agree with yolanda because even though the rendered version will make it a proper numbered sequence, one of the benefits of rst is that it can be sane as plain text too, so there's no good reason not to correct the numbering (in a followup change of course)13:34
odyssey4mepleia2 anteaya thanks, I have a bunch more of the same waiting for review, so if the patches need changes to shortcut that process then I'll gladly change them: https://review.openstack.org/#/q/status:open+project:openstack-infra/project-config+branch:master+topic:osa-additional-core-teams13:35
yolandaanteaya, what fungi said13:35
*** yamamoto has joined #openstack-infra13:35
anteayatristanC: ah a comment would be great for that thank you13:35
pabelangerpleia2: anteaya: yolanda: When you have time, do you mind reviewing: 32362813:35
*** Na3iL has joined #openstack-infra13:35
anteayafungi: no I just thought it was a useful feature of rst, which I appreciated when I made my edit yesterday and didn't have to renumber the list13:36
fungitristanC: anteaya: yeah, i think identifying the testers/stakeholders probably belongs in the associated story or in an ancillary document13:36
fungitristanC: and also, thanks for volunteering!13:36
*** bdemers has joined #openstack-infra13:37
anteayaodyssey4me: no no shortcut to adding a first person to new gerrit groups, it is a manual process and requires a gerrit admin to add the first person13:37
odyssey4meanteaya ah ok, pity - but so be it :)13:37
pleia2odyssey4me: I've gone ahead and added you as the initial member of that group13:38
odyssey4methanks pleia213:38
anteayafungi: ah sorry I mis-understood tristan's statement, he was wanting to be identified as a stake holder, yes telling me is fine for now, thank you13:38
pleia2odyssey4me: once these patches finish merging, you could send an email to openstack-infra with a list so we can add them all at once13:38
odyssey4mepleia2 openstack-infra at openstack dot org ?13:39
*** _vs has quit IRC13:39
pleia2odyssey4me: openstack-infra@lists.openstack.org13:39
odyssey4mepleia2 ah ok, thanks - will do13:39
*** _vs has joined #openstack-infra13:41
anteayatristanC: and private stories are avialable for testing right now if you want to play with them on the storyboard-dev server, storyboard-dev.o.o13:42
*** pradk has joined #openstack-infra13:42
anteayatristanC: I do believe that the ability to create teams is in progress13:42
*** mriedem has joined #openstack-infra13:42
*** yaume has quit IRC13:43
*** yaume_ has joined #openstack-infra13:43
anteayatristanC: so just testing that you can create a private story and add someone else to be able to view the story and the story is not able to be viewed by anyone not specified13:43
strigaziyolanda: are you there?13:44
anteayastrigazi: best to ask the question13:44
strigaziI have a problem with this new gate that I setup http://logs.openstack.org/46/309546/6/check/gate-rally-dsvm-magnum-rally-nv/922e09c/logs/devstacklog.txt.gz13:45
anteayajob, you set up a job13:46
strigaziyes job13:46
strigazihere it is https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/rally.yaml#L11113:46
*** eharney has quit IRC13:46
yolandastrigazi, you need to export PROJECTS var, add magnum to the list of projects to clone13:47
tristanCanteaya: fungi: understood, i added myself in a note to "identify target users for this process" task.13:47
*** amoralej|lunch is now known as amoralej13:47
anteayatristanC: awesome, thank you13:47
anteayatristanC: you beat me to it :)13:47
yolandalook at other samples, basically you need to set "export PROJECTS=$PROJECTS openstack/magnum" , something around these lines13:47
*** EricGonczer_ has quit IRC13:47
yolandapabelanger, i arrived too late to my review, quite busy today :)13:48
*** njohnston has joined #openstack-infra13:48
strigaziyolanda: I have this https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/rally.yaml#L11113:48
*** edmondsw has joined #openstack-infra13:49
*** nwkarste_ has joined #openstack-infra13:49
*** jlanoux_ has joined #openstack-infra13:50
*** jlanoux has quit IRC13:50
*** eharney has joined #openstack-infra13:50
yolandastrigazi, env vars are set correctly? if magnum is not there, it may not be arriving to that clone13:50
*** whoops has joined #openstack-infra13:52
*** links has quit IRC13:52
*** psachin_ has quit IRC13:54
*** roxanaghe has joined #openstack-infra13:54
*** yaume_ has quit IRC13:55
*** sdake has joined #openstack-infra13:55
*** njohnston has quit IRC13:55
*** mtanino has joined #openstack-infra13:55
anteayaspammer in -meeting13:55
*** dizquierdo has quit IRC13:56
anteayachannel ops and infra-root^^13:56
*** deadnull_ has quit IRC13:56
openstackgerritMerged openstack-infra/project-config: Revert "Move centos-7 on tripleo-test-cloud-rh1 to h2"  https://review.openstack.org/32362813:57
pleia2sorted13:58
pabelangeryolanda: np13:58
*** roxanaghe has quit IRC13:59
*** zz_dimtruck is now known as dimtruck13:59
anteayapleia2: thank you13:59
*** haaj_ has quit IRC13:59
*** ramishra has quit IRC13:59
pleia2and clearly I should ban it14:00
pabelangerjeblair: I see a fair number of ready nodes in zl01, does that mean zl01 is online?14:00
anteayapleia2: that spammer appears to be in channel still14:00
strigazianteaya yolanda: I think magnum should be there: We have export PROJECTS="openstack/magnum $PROJECTS"14:00
anteayaah there we go, thank you14:00
pleia2fortunately no actual spam, just crazy blabbering14:00
*** ramishra has joined #openstack-infra14:01
pleia2(no advertising urls that land in our logs)14:01
anteayayeah14:01
*** yamahata has joined #openstack-infra14:02
*** vgridnev has quit IRC14:02
anteayaspammer was the word that came to mind rather than blabber14:02
anteayaI can try that another time though14:03
*** deadnull_ has joined #openstack-infra14:03
*** shamail has joined #openstack-infra14:04
*** nmagnezi has quit IRC14:04
*** _vs has quit IRC14:07
*** Swami has joined #openstack-infra14:07
*** vgridnev has joined #openstack-infra14:07
*** moravec1 has joined #openstack-infra14:08
*** xarses has quit IRC14:08
strigaziHow can I check the env vars? I think I have them set correctly14:08
*** xyang1 has quit IRC14:09
clarkbstrigazi: look in reproduce.sh it writes them all back out again14:09
*** xyang1_ has joined #openstack-infra14:09
clarkbalso you should be able to use that script to reproduce the error14:09
strigaziclarkb: checking14:09
sdaguehmmm... openstack proposal bot DOS attack means I think now is a good time to go for a bike ride14:10
sdagueas no one else gets to run tests for the next couple of hours14:10
pleia2infra-root email gets a lot of out of office messages14:10
*** moravec has quit IRC14:10
pleia2my new nemesis: out of office messages that send more than one notice14:10
anteayawooooo14:10
pleia2(also, the search tool in this email system)14:10
*** dizquierdo has joined #openstack-infra14:10
anteayathe fun you have14:10
pleia2:)14:10
openstackgerritMerged openstack-infra/storyboard-webclient: Include moment-timezone to stop all the warnings about it  https://review.openstack.org/32339614:11
*** _vs has joined #openstack-infra14:11
*** fedexo has joined #openstack-infra14:12
*** nadya has joined #openstack-infra14:13
*** zeih has quit IRC14:13
*** psachin_ has joined #openstack-infra14:14
shamailHi everyone, I wanted to give an update on wiki clean-up… I haven’t started yet but plan to start cleaning up soon… I was thinking about creating a wiki page that I would list all pages to be deleted on a weekly basis… I could send an email to openstack-dev saying these are marked for deletion and remove them after notice.  Does that seem like a reasonable approach?  This would allow people to raise concerns if necessary.14:14
anteayahi shamail thanks for thinking about this14:15
shamailI am hesitant about just deleting pages that havent been updated recently because the static content could still be useful14:15
shamailwithout notice*14:15
anteayathat approach would create quite a bit of visual traffic without much use for it14:15
anteayashamail: well perhaps you should make the acquaintance of dansmith14:15
shamailHow about just creating the wiki page and announcing its existance (and never sending another mail)?14:15
strigaziclarkb: it seems that the changes from this patch: https://review.openstack.org/#/c/323701 don't have effect yet14:15
anteayadansmith has been deleting wikipages successfully for a while now, to good effect14:16
shamailawesome, i’ll follow up with him14:16
anteayadansmith: shamail would like to help clean up the wiki but has hesitations, are you able to help alleviate his hesitations at all?14:16
shamailThanks anteaya14:16
anteayashamail: thank you for following up14:16
dansmithshamail: there are enough obviously stale pages to delete for quite a while before getting to the point where things might need discussion, IMHO14:17
shamaildansmith: +1 I noticed that14:17
shamailwe have a lot of bio pages that are not necessary at all anymore14:17
dansmithshamail: making a list of ones that you're not sure about might be good, but I'd say punt that until you run out of obviously stale ones14:17
dansmithshamail: yeah toooons of those to delete14:17
anteayadansmith: thank you14:17
shamailThanks dansmith, good advice14:17
shamailI’ll start with the obvious ones14:18
*** nadya has quit IRC14:18
shamailand note the ones that might need notice (for deletion/discssuion later)14:18
*** zul has quit IRC14:18
*** cody-somerville has joined #openstack-infra14:18
anteayashamail: sharing your progess in channel is a good idea, then we can support you on your path14:18
shamailanteaya: +114:18
anteayaI have to go run errands soon, do speak up if you need encouragement or guidance14:19
shamailSounds good. Thanks again.14:19
anteayashamail: go delete something in the next 20 minutes though, break that never deleted anything feeling14:20
shamailanteaya: :)14:20
*** jlanoux_ has quit IRC14:21
*** jlanoux has joined #openstack-infra14:21
*** zul has joined #openstack-infra14:21
*** nadya has joined #openstack-infra14:22
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: Build and upload instack.raw image  https://review.openstack.org/31507214:22
*** hongbin has joined #openstack-infra14:22
onovyhi, someone for final +A? https://review.openstack.org/#/c/256668/14:23
*** BobBall is now known as BobBall_AWOL14:23
*** cody-somerville has quit IRC14:24
pleia2onovy: wow, that's an old one :)14:25
*** d0ugal has quit IRC14:25
onovypleia2: yes :)14:25
*** sree has quit IRC14:25
pleia2I don't look at gear changes much, but that one is pretty straight forward14:25
onovythanks for +A14:26
*** ramishra has quit IRC14:26
onovyalready merged same patch to many many projects, just few of this last14:26
notmorganpleia2: if you're looking at gear changes.... could i sneak in a quick review from you?14:26
*** nadya has quit IRC14:26
notmorganpleia2: https://review.openstack.org/#/c/322352/ (hehe, sorry just being oportunistic)14:26
*** eezhova has quit IRC14:27
pleia2notmorgan: tox I can review intelligently, that one is trickier :\14:27
*** ramishra has joined #openstack-infra14:27
pleia2but actually it's not so bad14:27
*** mdrabe has quit IRC14:28
notmorganpleia2: it has a lot of info in it but minimal real changes14:28
* pleia2 nods14:28
notmorganpleia2: :) i wouldn't ask for a quick review on something too rough this early in the morning14:28
pleia2notmorgan: done!14:28
notmorganpleia2: w00t. tyvm! (now i just need to convince some folks to do a release and bump g-r)14:29
openstackgerritMerged openstack-infra/gear: Deprecated tox -downloadcache option removed  https://review.openstack.org/25666814:29
*** eezhova has joined #openstack-infra14:29
notmorganpleia2: that will make my py3 fixes easier to continue testing.14:30
* notmorgan goes back to lurking here.14:30
*** nadya has joined #openstack-infra14:31
*** _vs has quit IRC14:31
openstackgerritMerged openstack-infra/gear: Do not change object size when iterating  https://review.openstack.org/32235214:32
*** mhickey has joined #openstack-infra14:32
*** zeih has joined #openstack-infra14:32
*** jlanoux has quit IRC14:33
*** jlanoux has joined #openstack-infra14:33
*** nwkarsten has joined #openstack-infra14:33
*** _vs has joined #openstack-infra14:34
funginotmorgan: when did gear get added to global requirements?14:34
*** oanson has quit IRC14:34
fungi(rhetorical question)14:34
fungi(hint, it's not)14:34
notmorganfungi: oh maybe it isn't.14:34
*** jlanoux has quit IRC14:34
notmorganfungi: ignore me then, just need a release. i forget sometimes that nodepool doesn't use g-r14:35
*** d0ugal has joined #openstack-infra14:35
*** jlanoux has joined #openstack-infra14:35
*** nadya has quit IRC14:36
*** rossella_s has quit IRC14:36
*** nwkarste_ has quit IRC14:36
fungijeblair has been making most of the gear releases (it looks like i did an emergency patch release a couple years ago), so i'll leave it to him to tag unless he wants me to take care of it14:36
*** rossella_s has joined #openstack-infra14:36
notmorganfungi: yeah it's not a huge rush, i can work locally now w/o needing to hack site-packages for tox runs :)14:37
*** zeih has quit IRC14:37
notmorganfungi: fwiw, the py3 conversion(s) have been helping me understand nodepool and zuul. and hey, it's never a bad thing to have the ability to run on py3 :)14:38
*** sarob has joined #openstack-infra14:40
funginotmorgan: if you're looking for a fun py3k conversion, bindep would appreciate some love. its tests are written in mox, and i started trying to convert them to mock but didn't really get anywhere on it14:40
*** nadya has joined #openstack-infra14:40
fungibindep itself _should_ work just fine under python 3.x, but its tests _don't_14:40
notmorganfungi: sure. i can probably do that.14:40
*** _vs has quit IRC14:41
fungii mostly shelved it and figured i'd wait until someone who had already tackled a mox->mock conversion in another project came around to give it some added expertise14:41
notmorganfungi: i might be in a "all the things to py3" kind of mood lately14:41
*** deadnull_ has quit IRC14:41
notmorganyeah i've done mox->mock before. it *is not* fun.14:41
*** yujunz has joined #openstack-infra14:41
notmorganbut it isn't terrifyingly hard to do.14:41
*** nwkarsten has quit IRC14:42
fungiseems like it's mostly boilerplate conversions of certain setup/teardown to others, but looking at the documentation and example conversions in other projects i was still pretty lost14:42
*** jlanoux has quit IRC14:43
*** mdrabe has joined #openstack-infra14:43
notmorganfungi: i find leaning on the mockpatch fixture helps make it easier14:43
phschwartzclarkb: let me know when your around14:43
*** jlanoux has joined #openstack-infra14:43
clarkbphschwartz: I am sort of around now but will pop out in about 20 minutes (furnace is being installed)14:44
*** nwkarsten has joined #openstack-infra14:44
phschwartzclarkb: I can wait till you have more time if you want. mordred suggested earlier you would be able to answer my questions about ELK14:44
*** vhosakot has joined #openstack-infra14:44
clarkbthis might be the best time for the next couple weeka14:44
*** nadya has quit IRC14:45
*** sarob has quit IRC14:45
*** nwkarste_ has joined #openstack-infra14:45
openstackgerritJulien Danjou proposed openstack-infra/git-review: Set a default EXIT_CODE for GitReviewException  https://review.openstack.org/32395914:45
phschwartzclarkb: I am looking to add ELK to our downstream ci, currently the puppet-openstackci manifests look for it to all be installed as an all in one. What are your suggestions for sizing so I can set it up right and also put reviews up towards openstackci to allow separation14:46
*** _vsaienko has joined #openstack-infra14:46
clarkbsizing really dependa on your volume of logs14:47
clarkbour indexes float around 3tb right now iirc14:47
clarkbwith about 250gb per day14:47
*** d0ugal has quit IRC14:48
openstackgerritMerged openstack/os-client-config: Rename session_client to make_rest_client  https://review.openstack.org/32370214:48
*** d0ugal has joined #openstack-infra14:48
clarkbdefinitely run the elasticsearch cluster on instances with good bandwidth between them. 10Gbe on a shared switch is probably ideal14:48
openstackgerritPaul Carver proposed openstack-infra/project-config: Enable publishing of neutron-dynamic-routing docs  https://review.openstack.org/32396114:48
*** nwkarsten has quit IRC14:48
*** d0ugal has quit IRC14:48
clarkband good disk iops are important there too14:49
*** d0ugal has joined #openstack-infra14:49
clarkbwe run 6 x 60Gb ram 16vcpu with 1TB cinder volume14:49
*** nadya has joined #openstack-infra14:49
*** krtaylor has joined #openstack-infra14:50
clarkbon the logstash side its almost allcpu bound in the jvm. you need a bit of memory for that but not a ton and cpus14:50
clarkbour logstash processes use 2gb heap and 2 cpus iirc14:50
*** javeriak has quit IRC14:51
phschwartzok, so the basic 8gb vm's I was going to use won't cut it14:51
clarkbthe gear workers are really just byte movers and dont need anything special. run as many as you can without running out of memory14:51
jeblairit looks like the multiprocessing thing broke overnight14:52
*** e0ne has quit IRC14:52
*** abregman has quit IRC14:52
jeblairi'm seeing if there are any suggestive logs14:53
openstackgerritMerged openstack-infra/shade: Add function to update object metadata  https://review.openstack.org/32187814:53
*** EricGonczer_ has joined #openstack-infra14:53
*** hdaniel has quit IRC14:53
*** njohnston_ has joined #openstack-infra14:53
*** nadya has quit IRC14:54
jeblairwow.  not even remotely.14:55
*** roxanaghe has joined #openstack-infra14:55
jeblairi mean, there are tons of messages.  all of them are boring.14:55
*** Julien-zte has joined #openstack-infra14:58
*** yolanda_ has joined #openstack-infra14:58
*** jaosorior has quit IRC14:59
*** roxanaghe has quit IRC15:00
*** yolanda has quit IRC15:00
*** njohnston_ is now known as njohnston15:00
*** hichihara has quit IRC15:00
*** yolanda_ is now known as yolanda15:01
clarkbphschwartz: that will work if your log volume is low enough15:02
clarkbbut ya it all depends on your content15:02
*** sputnik13 has joined #openstack-infra15:02
*** sputnik13 has quit IRC15:02
*** nadya has joined #openstack-infra15:04
*** hashar has quit IRC15:04
*** hashar_ has joined #openstack-infra15:04
*** pcaruana has quit IRC15:04
*** asettle has quit IRC15:06
rcarrillocruzclarkb: around to look at https://review.openstack.org/#/c/322189/ ? not sure why devstack fails on connecting to mysql as root on ubuntu-trusty, works just fine on centos15:08
*** rhallisey has quit IRC15:08
*** eezhova has quit IRC15:09
*** rcernin has quit IRC15:09
*** d0ugal has quit IRC15:10
phschwartzclarkb: log volume will be from a max of about 300-400 jobs per week15:10
phschwartzclarkb: so we should be good with these vm's then15:10
*** zhurong has quit IRC15:11
clarkbrcarrillocruz: I am not sure looks like a devstck issue15:11
clarkb300-400 jobs should be small enough for that ya15:11
clarkbwe do 3x that every hour15:11
*** d0ugal has joined #openstack-infra15:11
*** yolanda_ has joined #openstack-infra15:14
*** yolanda has quit IRC15:14
*** mrmartin has joined #openstack-infra15:14
rcarrillocruzwhere do the devstack folks hang out, #openstack-dev yeah?15:14
*** asettle has joined #openstack-infra15:15
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Add tempest tests to periodic and experimental job  https://review.openstack.org/32101915:15
clarkbrcarrillocruz: -qa15:15
rcarrillocruzk, thx15:15
*** xarses has joined #openstack-infra15:15
*** yolanda_ is now known as yolanda15:16
*** andreas_s has quit IRC15:17
*** pblaho has quit IRC15:17
*** nwkarste_ has quit IRC15:18
timrcyolanda: Congrats on the new job!  Will you be working with pabelanger?15:18
*** pblaho has joined #openstack-infra15:18
*** tesseract has quit IRC15:18
*** Swami_ has joined #openstack-infra15:18
*** aysyd has quit IRC15:19
jeblairyolanda: oh! what's the new job?15:19
yolandahi timrc , not in the same team, but we are close15:19
notnownikkiyolanda: congratulations :)15:20
yolandahi jeblair, i am on Redhat as well. But related to NFV and partners, helping with infra and other projects15:20
pabelanger\o/15:20
pleia2yolanda: cool, congrats!15:20
yolandathanks!15:20
*** aysyd has joined #openstack-infra15:20
yolandahi notnownikki , we haven't talked in a long time, how are you? :)15:20
jeblairyolanda: oh that's cool!  i know they've been interested in how we ci for a while, so it will be really nice to have some cross-over there!15:20
notnownikkijeblair, oh, I hear you're doing clever things using the core of jjb in zuul to run jobs? Is there some code I could look at? I had a very similar idea and would be very interested15:21
*** nadya has quit IRC15:22
yolandajeblair, will do my best there. Today is the first day, so lots of new things to learn before I can be useful15:22
*** yujunz has quit IRC15:22
notnownikkiyolanda, i'm 95% recovered from surgery now, feeling a lot better :)15:22
yolandaglad to hear :)15:22
*** Swami has quit IRC15:22
*** scottda has joined #openstack-infra15:23
*** amrith is now known as _amrith_15:23
jeblairnotnownikki: yes, it's in the 'ansiblelauncher' in zuul master.  though it's just a stopgap until we can move to zuulv3 which is a much better way of describing jobs15:23
pabelangerjeblair: will it be ansiblelauncher in zuulv3 or something else?15:24
jeblairpabelanger: well, zuulv3 has an ansiblelauncher, but it does something very different15:24
notnownikkijeblair, awesome, thanks!15:24
*** hashar_ is now known as hashar15:25
*** mhickey has quit IRC15:25
*** cody-somerville has joined #openstack-infra15:26
*** infra-red has quit IRC15:27
* timrc pictures a t-shirt cannon launching ansibles at people15:27
*** nwkarsten has joined #openstack-infra15:27
*** Qiming has quit IRC15:28
pabelangerjeblair: Right, not sure what I was asking actually.  Mostly trying to understand how much of a refactor is needed in ansiblelauncher15:28
fungihrm, ttx pointed out that we have a job which claims to have been running in the post pipeline for >5 days15:28
pabelangerI know JJB is removed15:28
fungii've tracked it down in the zuul debug logs to being on jenkins0215:28
*** vincentll has quit IRC15:30
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Run {name}-announce-release for Puppet OpenStack modules  https://review.openstack.org/32398115:30
openstackgerritKaiyan Sheng proposed openstack-infra/project-config: [Monasca] Add check-requirements check job for monasca projects  https://review.openstack.org/32356715:30
_ari_zxiiro: can you look at this change when you get a chance - https://review.openstack.org/#/c/323495/15:31
fungihowever i don't see the associated slave (ubuntu-trusty-ovh-bhs1-1258021) on jenkins02 any longer15:31
jeblairpabelanger: you can take a look at ansiblelauncher.py in the feature/zuulv3 branch and seee15:31
*** EricGonc_ has joined #openstack-infra15:32
*** rhallisey has joined #openstack-infra15:32
*** rhallisey has quit IRC15:32
_ari_hashar: can you review this when you get a chance? - https://review.openstack.org/#/c/323495/15:32
jeblairpabelanger: but yeah, it's somewhat similar except without the jjb and zmq bits15:32
*** rhallisey has joined #openstack-infra15:32
fungialso the jenkins service on jenkins02 has been restarted more recently than 5 days ago15:32
*** permalac has joined #openstack-infra15:32
jeblairpabelanger: it expects to have some ansible passed to it from zuul15:33
*** ihrachys has quit IRC15:33
*** jlanoux_ has joined #openstack-infra15:33
*** jlanoux has quit IRC15:33
fungii'm guessing without a `zuul dequeue` we can't actually get that cleared from the post pipeline without a zuul restart15:33
*** _vsaienko has quit IRC15:34
fungi(or some way of reporting a fake result into gearman i guess)15:34
jeblairfungi: i don't think we can do the second thing15:34
hasharmaybe promote the change to have the job triggered again?15:35
*** EricGonczer_ has quit IRC15:35
*** _vsaienko has joined #openstack-infra15:35
openstackgerritJay Faulkner proposed openstack-infra/project-config: Use TinyIPA and iPXE for most Ironic jobs  https://review.openstack.org/31380015:35
hashar_ari_: actually figuring out a plan to dedicate a few hours of my weeks solely to review stuff on openstack gerrit15:35
hashar_ari_: I have not been much active on JJB development :(15:36
openstackgerritDavid Moreau Simard proposed openstack-infra/project-config: Create the ARA project  https://review.openstack.org/32122615:36
_ari_hashar: ah ok I understand anyone else you can recommend besides zxiiro zaro?15:36
*** dizquierdo has quit IRC15:36
_ari_zaro: zxiiro hashar any discussion on JJB support for the pipeline plugin?15:37
fungihashar: yeah, i guess i could make it rerun all the post pipeline jobs for that change that way15:38
hashar_ari_: is that multi job selector part of the copy artifact plugin or is that provided by a different plugin?15:39
fungihashar: oh, er i'm not sure we can promote in non-change pipelines15:39
fungihashar: or if we can i don't know how the ref is supposed to be formatted15:39
fungiAttributeError: 'Ref' object has no attribute 'number'15:40
hashar_ari_: cause the java namespace is different "com.tikal.jenkins.plugins.multijob"  which seems to suggest the selector is provided by another plugin. If so you will want to document that in the doc15:40
_ari_hashar: A different plugin15:40
hasharfungi: ah yeah promoting a ref ... sorry15:40
_ari_hashar: sure understood15:40
hasharfungi: a hardcore hacker would hook gdb to change the python object somehow :D15:40
*** exploreshaifali has quit IRC15:41
*** Swanson has joined #openstack-infra15:41
_ari_hashar: is the best place at the top where the required plugin for Copy Artifact is mentioned15:41
*** bhavik has joined #openstack-infra15:41
hasharfungi: or if that job is gone / no more around.  You can define a dummy one that just  /bin/true15:41
hasharfungi: and maybe zuul will trigger it15:41
fungihashar: it's not so much that, it's zuul is waiting for a result which will never come back from jenkins15:42
fungibecause the jenkins it thinks is running it doesn't even have the slave on which it was running any longer15:42
openstackgerritJay Faulkner proposed openstack-infra/project-config: Use TinyIPA and iPXE for most Ironic jobs  https://review.openstack.org/31380015:43
openstackgerritJay Faulkner proposed openstack-infra/project-config: Use TinyIPA and iPXE for most Ironic jobs  https://review.openstack.org/31380015:44
*** rhallisey has quit IRC15:44
hasharfungi: add a slave to that jenkins with whatever label/node name that is expected? :/15:45
*** rhallisey has joined #openstack-infra15:45
*** rhallisey has quit IRC15:45
pabelangerjeblair: Oh right, forgot about the branch15:45
*** rhallisey has joined #openstack-infra15:45
openstackgerritJay Faulkner proposed openstack-infra/project-config: Run Ironic Inspector jobs with TinyIPA  https://review.openstack.org/32399415:45
zxiiro_ari_: zaro and I are currently at pycon this week. I can take a look when I return home.15:46
*** jlanoux_ has quit IRC15:46
*** jlanoux has joined #openstack-infra15:46
pabelangerjeblair: I was also thinking, it might be useful to upload our ansible playbooks when we are archiving logs too. So we can see what the jobs look like from a configuration POV15:46
_ari_zxiiro: ah ok thanks I am making an update per hashar's review also at some point is there any discussion on JJB supporting pipeline15:46
*** _vsaienko has quit IRC15:46
zxiiro_ari_: i have personally not heard discussions about it but if it is something you need you can try implementing it. I haven't looked at pipelines yet so don't know what kind of work would be involved to get it going.15:48
*** rkukura_ has joined #openstack-infra15:49
notmorganpabelanger: i like that idea myself15:49
jeblairpabelanger: oh that's such a good idea.  way better than figuring out how to convince the launcher to keep them :)15:49
openstackgerritAri proposed openstack-infra/jenkins-job-builder: Adds support multijob support to the CopyArtifact plugin  https://review.openstack.org/32349515:50
jeblair(i added a --keep-jobdir option, but that keeps all of them, so is basically an alias for --fill-up-tmpdir  :)15:50
pabelangernotmorgan: jeblair: Nice!15:50
_ari_hashar: I made the update in the change15:50
hashar_ari_: I sent another comment.  Seems one can use multijob-build AND some other selector such as  last-successful15:51
*** rkukura_ has quit IRC15:51
hashar_ari_: so might want to adjust the yaml fixture to representthat15:51
*** _amrith_ is now known as amrith15:51
*** _vsaienko has joined #openstack-infra15:51
*** rkukura has quit IRC15:52
_ari_hashar: thanks!15:52
mtreinishfungi, jeblair: looking at the job reported as failed in: http://lists.openstack.org/pipermail/openstack-stable-maint/2016-June/004363.html I can't see where it actually failed15:52
fungijeblair: pabelanger: i like the playbook archiving idea. it's like the devstack-gate reproduce.sh taken to the next level15:52
mtreinishit looks like everything ran successfully15:52
hashar_ari_: then I have no idea how that multi job plugin works with copy artifact.  Usually I would install the plugin, craft a job with bunch of options and look at the XML result15:52
pabelangerfungi: Exactly, I was thinking of an easy way to reproduce our jobs.  Having access to the ansible playbooks makes that almost too easy15:53
hashar_ari_: then copy paste as a .xml fixture,  write some dummy yaml  and test until the code reproduce the plugin xml15:53
jeblairmtreinish: thanks -- that ran in zuul launcher, so could be my fault.  i will check logs.15:53
*** Rockyg has joined #openstack-infra15:53
_ari_hashar: in the case of multijob those sub options are not supported15:53
mtreinishalso, os-loganalyze went kinda off the rails there. Everything is yellow :)15:53
*** rajinir has joined #openstack-infra15:54
*** mrmartin has quit IRC15:54
*** mikelk has quit IRC15:54
*** tonytan4ever has joined #openstack-infra15:54
jeblairmtreinish: yeah, i suspect some regex fix is needed to accomodate some minor difference between zuul and jenkins logs15:54
*** bpokorny has joined #openstack-infra15:54
jeblair(if anyone wants to dig into that ^^ feel free :)15:54
*** Sukhdev has joined #openstack-infra15:54
*** e0ne has joined #openstack-infra15:54
*** sdake has quit IRC15:54
*** roxanaghe has joined #openstack-infra15:55
fungimtreinish: could the increased timestamp accuracy be throwing off regex matches?15:56
*** thinrichs has joined #openstack-infra15:56
fungihrm, it does seem to be matching on the timestamps correctly already15:57
jeblairfungi: i think the timestamp one is okay (i checked that) yeah15:57
mtreinishfungi: it looks like it's not clearing different levels properly15:58
jeblairmaybe the severity regex matches on <br/> or something, which isn't there since the zuul log is actually text15:58
*** oanson has joined #openstack-infra15:58
fungiit's identifying some lines as none level and some as info level, yet applying warning level css on them15:58
mtreinishfungi: it's INFO for everything after the first INFO line until there is "WARNING:" in a line15:58
fungimtreinish: oh, yep, it starts with the first warning15:58
mtreinishthen everything is marked as being at the warning level15:58
*** rkukura has joined #openstack-infra15:58
jeblairdid we merge a change to zuul?15:59
jeblairin the last 12 hours?15:59
fungii think the <span> tags arenpt getting closed at line endings15:59
fungis/think/know/15:59
funginevermind, they're closed at the next line start16:00
openstackgerritMerged openstack-infra/project-config: [Monasca] Add check-requirements check job for monasca projects  https://review.openstack.org/32356716:00
jeblairmtreinish: ah, that job failed because puppet reinstalled zuul which reverted an un-merged change i had staged on that server.  so it should be fixed once the in-flight changes land16:01
*** zeih has joined #openstack-infra16:01
*** esikachev has quit IRC16:01
_ari_hashar: I don't think another fixture is needed do you want me to just add the one I have to the docs16:01
jeblairmtreinish: sorry for the trouble, and thanks for letting me know16:01
*** kgiusti has quit IRC16:01
mtreinishjeblair: oh it doesn't bother me. It's a periodic stable job it doesn't actually mean anything :)16:01
mtreinishI was just confused looking at it16:02
*** woodster_ has joined #openstack-infra16:02
*** andrey_veselov has quit IRC16:02
hashar_ari_: ah. So maybe do some sanity check and raise an exception when one of the other selectors are listed and raise a JenkinsJobsException16:02
hasharor explicitly return / ignore the others16:03
fungiahh, yeah so not a rendering issue. it does in fact look like osla is setting warning class on all lines including and after the one starting WARNING: so i bet this is it thinking the rest of the lines are part of the same log entry16:03
hashar_ari_: I am in audio and then it will be dinner time.  Would follow up tomorrow16:03
jeblairclarkb, fungi, pabelanger, Shrews, mordred: brainstorming time!  here's what i have so far: https://etherpad.openstack.org/p/F4uqAtnOXi16:05
jeblairnotmorgan: ^16:05
jeblairclarkb, fungi, pabelanger, Shrews, mordred, notmorgan: i think i've just about talked myself into (e)16:05
*** nadya has joined #openstack-infra16:05
openstackgerritDavid Moreau Simard proposed openstack-infra/project-config: Create the ARA project  https://review.openstack.org/32122616:06
cloudnullo/ all, IDK if this is known but https://releases.openstack.org/newton/schedule.html is showing up w/ an insecure cert. -- ERROR: curl: (51) SSL: certificate subject name (static.openstack.org) does not match target host name 'releases.openstack.org'16:06
cloudnulljust a heads up to folks, if known, ignore me16:07
*** zeih has quit IRC16:07
*** jlanoux has quit IRC16:08
fungijeblair: option e seems reasonable given 1) our current scaling needs and 2) the projected lifespan of this solution16:09
fungicloudnull: you want http://releases.openstack.org/newton/schedule.html16:09
*** gyee has joined #openstack-infra16:09
fungicloudnull: if you try to use https there you're ending up at the default vhost which is serving up a cert for another site16:09
*** nwkarsten has quit IRC16:10
*** Apoorva has joined #openstack-infra16:10
*** nwkarsten has joined #openstack-infra16:10
*** itisha has joined #openstack-infra16:10
*** nadya has quit IRC16:10
*** sarob has joined #openstack-infra16:10
cloudnullok. My default is to https everything, I'll adjust if it's not supposed to have a cert.16:10
cloudnullthanks fungi16:10
fungicloudnull: we're intending to eventually add https for that site, just haven't gotten around to implementing it16:11
cloudnullno worries. :)16:12
* cloudnull presses f516:12
cloudnull:p16:12
*** dtantsur is now known as dtantsur|afk16:13
Shrewsjeblair: looking16:13
*** ccamacho is now known as ccamacho|afk16:13
*** nadya has joined #openstack-infra16:14
*** sarob has quit IRC16:15
*** eezhova has joined #openstack-infra16:15
fungijeblair: you could also look at it as a debugging opportunity. if the threaded version suffers the same failures but is less opaque to debug, then it may yield answers that make it easier to switch back to sockets16:15
*** fedexo has quit IRC16:15
jeblairfungi: oh sorry, the failure is that the multiprocessing manager up and quits16:15
fungigot it, so no luck there i guess16:16
*** nwkarste_ has joined #openstack-infra16:16
jeblair(it's the external processes the multiprocesing library starts to magically transparently handle passing data between processes)16:16
fungibut the other reasons still make option e compelling i think16:16
*** nwkarsten has quit IRC16:16
rcarrillocruzok16:17
rcarrillocruzi created a VM16:17
rcarrillocruzran reproduce.sh16:17
Shrewsjeblair: ah, that helps explain why mixing of subprocesses and threads16:17
fungijeblair: https://docs.python.org/2/library/multiprocessing.html#managers i guess?16:17
rcarrillocruzand got past the step where my job fails16:17
jeblairfungi: yep that's the thing16:17
rcarrillocruzclarkb: http://logs.openstack.org/89/322189/9/check/gate-ansible-role-cloud-launcher-dsvm-ansible-func-ubuntu-trusty/eeb4c78/logs/devstacklog.txt.gz can you or other core look what's up with ubuntu-trusty nodes?16:18
*** sdague has quit IRC16:18
*** savihou has quit IRC16:18
*** annegentle has joined #openstack-infra16:18
Shrewsjeblair: are you saying the launch server is dying mysteriously?16:19
*** armax has joined #openstack-infra16:19
*** sdake has joined #openstack-infra16:19
jeblairShrews: no, the multiprocessing manager process16:19
jeblairit's completely black box16:19
Shrewsoh. eeww16:19
jeblairi turned on internal multiprocessing library logging and still got nothing useful16:19
*** flepied1 has joined #openstack-infra16:19
jeblairthe python library motto: "batteries included", but the batteries are kind of leaky and explody.16:20
Shrewsjeblair: i lean towards c or e, mostly e b/c we're really only speculating impact based on something else16:20
fungijeblair: does the process terminate, or hang indefinitely?16:22
Shrewsjeblair: we could, at least, start with e since it seems easiest, then re-evaluate16:22
jeblairfungi: terminates16:22
fungijeblair: any indication what exit code it terminates with at least?16:22
jeblairfungi: nope :(16:23
*** sdake has quit IRC16:23
*** flepied has quit IRC16:23
jeblairfungi: we get one EOF error when reading, and then connection refused errors16:23
fungii guess it should be possible to catch that in the parent, but probably requires subclassing16:23
notmorganjeblair: E seems quite reasonable16:23
notmorganjeblair: but i agree with Shrews i'd also lean towards C as an option16:24
jeblairfungi: yeah, if we went with a, i would probably do something like that (handle running the multiprocessing manager myself, wrapping it with try/except, etc)16:24
notmorganthough it would be good to know what is up with multiprocessing16:24
notmorganjust in general16:24
jeblairnotmorgan: yeah, i would like to be a better python citizen, but i think it will be hard and disruptive to do so.16:25
jeblair(this only seems to happen with lots of traffic)16:25
notmorganweird.16:25
jeblairokay, off to hack.  biab.16:26
openstackgerritJoel Wright proposed openstack-infra/project-config: Publish python-swiftclient docs on every patch  https://review.openstack.org/32350116:26
*** sree has joined #openstack-infra16:26
*** vgridnev has quit IRC16:26
fungijeblair: i'm also curious if switching from sockets to pipes changes that behavior, though obviously that makes it not distributable to other systems over the network without a separate fifo proxy16:26
Shrewsjeblair: notmorgan: debugging that could be even more time consuming than doing all of the other options combined  :)16:26
*** abregman_ has joined #openstack-infra16:26
jeblairShrews: heh, yeah16:27
openstackgerritJoel Wright proposed openstack-infra/project-config: Publish python-swiftclient docs on every patch  https://review.openstack.org/32350116:27
notmorganShrews: fair point16:27
*** eezhova has quit IRC16:27
fungijeblair: what are the odds that signal handling in the parent is causing abnormal termination of the manager?16:28
fungii see quite a number of warnings/stories where people have discovered signal propagation was to blame for this16:29
notmorganfungi: the child is seeing the signal in some strange way? or recriving a something from the parent?16:29
notmorganfungi: because iirc multiprocessing should isolate most all of that16:29
fungithings like https://vimmaniac.com/blog/codejunkie/safe-use-of-unix-signals-with-multiprocessing-module-in-python/16:29
*** eezhova has joined #openstack-infra16:29
jeblairfungi: that was my first thought, and the main reason i switched to using the socket to trigger the reload16:30
fungiahh, yeah i wondered if that was the impetus16:30
*** sree has quit IRC16:30
jeblair(so we should not have gotten any stray signals last night)16:30
notmorganjeblair: and the socket didn't help?16:30
fungino log rotation or anything sending signals?16:30
* fungi can't remember if we use logrotate for zuul or have it handled internally... checking16:31
jeblairfungi: nope, log rotation is internal16:31
mtreinishnibalizer: want to run your script again, more 500s on: http://health.openstack.org/tests/recent/fail16:31
fungiyeah, can't think of anything else that would send stray signals in that case16:31
mtreinishone of these days I'm going to make a change that doesn't break something16:31
*** sdague has joined #openstack-infra16:31
*** nadya_ has joined #openstack-infra16:32
*** nadya has quit IRC16:32
*** dimtruck is now known as zz_dimtruck16:32
*** johnny has joined #openstack-infra16:32
notmorganfungi: yeah it's kindof odd. short of trapping *every* singnal itd going to be hard to know if that is happening16:32
*** johnny is now known as Guest3636416:32
*** sdake has joined #openstack-infra16:32
*** sarob has joined #openstack-infra16:32
notmorganjeblair: it fails at inconsistent times but only under load right?16:33
*** zz_dimtruck is now known as dimtruck16:33
*** adduarte has quit IRC16:33
*** amrith is now known as _amrith_16:34
jeblairnotmorgan: right.  seems to be when we're roughtly at capacity.16:35
*** _sarob has joined #openstack-infra16:35
*** _amrith_ is now known as amrith16:35
*** Guest85759 has quit IRC16:35
jeblairpabelanger, fungi: it looks like i have a bit more work to do on this stack, so i'm going to revert the zl01 project-config change and pull it out of rotation.16:35
notmorganjeblair: huh. that... that sounds VERY susicoous.16:36
notmorgansuspicious.16:36
*** jordan_ has quit IRC16:36
jeblairnotmorgan: well, i mean that translates to something like 75 subproceses.16:36
fungiit's gotta be hitting an exception of some kind and just not logging. i wonder if it would be possible to run it under pdb? probably perform terribly?16:37
notmorganjeblair: that is fine. i still feel like that it happens around capacity is "odd"16:37
jeblairnotmorgan: so, put another way, it seems to work fine with like 20, but we see problems at 70+.  (i'm guessing at numbers here, would have to check logs to be certain)16:37
pabelangerjeblair: okay16:37
notmorganjeblair: right i don't care about specific numbers :) general scale/scope of where it happens helps16:37
pabelangerA quick google of puppet-zookeeper leads me to https://github.com/deric/puppet-zookeeper16:38
*** sarob has quit IRC16:38
pabelangergoing to give is a spin and see how it works16:38
notmorganjeblair: 20 vs 70 is close enoughof a random guess for debugging.16:38
notmorganpabelanger: cool.16:38
*** nadya_ has quit IRC16:38
pabelangerso far it looks promising16:38
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: Do not merge  https://review.openstack.org/32401016:38
notmorganpabelanger: it was on my short list to see what i could find around that soon :)16:38
openstackgerritJames E. Blair proposed openstack-infra/project-config: Revert "Revert "Revert "Start using the Zuul Ansible launcher"""  https://review.openstack.org/32401116:38
*** yamahata has quit IRC16:38
*** zaro has quit IRC16:38
pabelangernotmorgan: Nice. Going to launch nodepool.o.o local now to test it16:39
*** zaro has joined #openstack-infra16:39
jeblairi'm self-approving and enqueing that ^16:39
pabelangerWFM16:39
*** jtomasek has quit IRC16:41
*** mhickey has joined #openstack-infra16:42
*** samuelBartel has quit IRC16:42
*** nwkarste_ has quit IRC16:43
phschwartzIs there an easy way to query nodepool for nodes?16:43
fungiphschwartz: nodepool list16:43
fungiphschwartz: or is that not what you meant?16:44
phschwartzfungi: from off of the host and not using nodepool list16:44
fungiphschwartz: oh, someone was proposing a status api for nodepool i think? but pretty sure that hasn't merged yet16:44
*** shashank_hegde has joined #openstack-infra16:45
phschwartzfungi: I might try to locate that16:45
*** moravec has joined #openstack-infra16:45
sdagueclarkb / mordred - https://review.openstack.org/#/c/320925/16:46
sdaguewe have a nova fix that eliminates the need for gate64 cpu model16:46
clarkbphschwartz: nova list16:46
*** moravec1 has quit IRC16:46
clarkbsdague: cool16:46
sdagueI should probably respin that to be a bit cleaner16:47
*** e0ne has quit IRC16:48
openstackgerritSean Dague proposed openstack-infra/devstack-gate: don't set libvirt cpu_model  https://review.openstack.org/32092516:50
openstackgerritMerged openstack-infra/project-config: Revert "Revert "Revert "Start using the Zuul Ansible launcher"""  https://review.openstack.org/32401116:50
*** Swami_ has quit IRC16:50
openstackgerritMerged openstack-infra/storyboard: Updated documentation to make code snippet clearer  https://review.openstack.org/32385616:51
rcarrillocruzyolanda held me a node , a ubuntu-trusty and a centos-7, confirmed again: reproduce.sh fails only on ubuntu-trusty, on a vm with ubuntu on my side works, on a gate centos-7 works16:52
*** trown is now known as trown|lunch16:52
*** nwkarsten has joined #openstack-infra16:53
*** derekh has quit IRC16:53
*** moravec1 has joined #openstack-infra16:53
phschwartzclarkb: I was looking for something that doesn't have the chance of returning none active nodes16:53
phschwartzclarkb: without having to hand filter it16:53
*** Hal has joined #openstack-infra16:54
*** Hal is now known as Guest8612116:55
*** moravec has quit IRC16:55
openstackgerritPaul Belanger proposed openstack-infra/project-config: Revert "Revert "Move centos-7 on tripleo-test-cloud-rh1 to h2""  https://review.openstack.org/32402216:57
*** gyee has quit IRC16:58
jeblairOpenStackCloudException: Tried to delete floating ip 169.45.71.87 associated with server 2e8d5e5c-f4ad-4563-8ae2-d4a66c9973cf but there was an error finding it. Something is exceptionally broken.16:58
pabelangerfungi: clarkb: Do you mind reviewing ^, that bumps tripleo-cloud to 30GB slaves. Between that and deleting data on the HDD, we should have enough to migrate to centos-7 now16:58
jeblairShrews, clarkb, mordred: ^16:58
jeblairpabelanger, fungi: i have restarted nodepool without the zuul launcher config, so we should regain the stale ready nodes.16:59
Shrewsjeblair: osic?16:59
*** PollyZ_ has quit IRC17:00
ShrewsAlso, very wow17:00
*** nwkarsten has quit IRC17:00
jeblairShrews: bluebox17:00
jeblairlemme grab more logs17:00
notmorganjeblair: i'm putting the FIP thing on my short list to start diving into soon.17:01
*** nwkarsten has joined #openstack-infra17:01
* Shrews about to stuff face hole17:01
notmorganjeblair: this keeps happening.17:01
pabelangerjeblair: great17:01
notmorganunless someone else is already spending significant time on it.17:01
*** shamail has left #openstack-infra17:01
*** arxcruz has quit IRC17:01
jeblairnotmorgan, Shrews: this is all i see: http://paste.openstack.org/17:01
*** links has joined #openstack-infra17:02
Shrewsnotmorgan: both mordred and myself have taken stabs at it. Mostly mordred. More eyes the better though17:02
*** baoli_ has quit IRC17:03
notmorganShrews: ok well i have a couple things to finish up on my current brain space and i'll start looking harder at the FIP stuff ater that.17:03
*** dizquierdo has joined #openstack-infra17:03
notmorganShrews: worst case, start of next week :)17:03
Shrewsjeblair: need better linky17:03
notmorganjeblair: yeah, do you have the end part of that URL handy? :)17:03
*** yamahata has joined #openstack-infra17:04
*** sputnik13 has joined #openstack-infra17:04
*** deadnull_ has joined #openstack-infra17:05
*** nwkarsten has quit IRC17:05
*** lucasagomes is now known as lucas-dinner17:05
*** moravec1 has quit IRC17:06
*** banix has quit IRC17:07
*** hashar has quit IRC17:08
*** jerryz has joined #openstack-infra17:10
*** Goneri has quit IRC17:11
*** larainema has quit IRC17:11
*** banix has joined #openstack-infra17:11
*** tonytan4ever has quit IRC17:11
*** EricGonczer_ has joined #openstack-infra17:12
jeblairShrews, notmorgan: http://paste.openstack.org/show/507000/17:12
*** larainema has joined #openstack-infra17:12
*** packet_sh has quit IRC17:12
openstackgerritPaul Belanger proposed openstack-infra/system-config: Fix deprecated warnings on clouds.yaml.erb  https://review.openstack.org/32402717:12
*** bbroad has joined #openstack-infra17:13
*** rossella_s has quit IRC17:13
*** EricGonc_ has quit IRC17:14
*** jcoufal_ has joined #openstack-infra17:15
*** baoli has joined #openstack-infra17:15
*** yamamoto has quit IRC17:15
*** asettle has quit IRC17:17
*** packet_sh has joined #openstack-infra17:17
*** vgridnev has joined #openstack-infra17:17
*** markusry has quit IRC17:17
*** jcoufal has quit IRC17:18
*** asettle has joined #openstack-infra17:18
openstackgerritMerged openstack-infra/system-config: Add election alias to governance.openstack.org  https://review.openstack.org/29267517:19
notmorganjeblair: ick17:19
*** mrmartin has joined #openstack-infra17:20
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: use a socket for reconfiguration  https://review.openstack.org/32235117:21
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: handle JJB with no macros  https://review.openstack.org/32233217:21
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: some ansible fixes  https://review.openstack.org/32233117:21
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: support static workers  https://review.openstack.org/32156917:21
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: use correct ZMQ port  https://review.openstack.org/32360517:21
jeblairthose are fixes requested yesterday... i will build the switch-to-threads change on top of that17:21
*** ociuhandu_ has joined #openstack-infra17:22
*** kzaitsev_mb has quit IRC17:25
*** Daisy_ has joined #openstack-infra17:26
*** nadya has joined #openstack-infra17:27
*** shamail has joined #openstack-infra17:30
*** shamail has quit IRC17:30
*** EricGonc_ has joined #openstack-infra17:30
*** Daisy_ has quit IRC17:31
*** fitoduarte has joined #openstack-infra17:32
fungidoes jlk still have access to the underlying environment in bluebox? wondering whether there are any backend insights into http://paste.openstack.org/show/507000/17:33
*** EricGonczer_ has quit IRC17:34
*** ociuhandu has quit IRC17:35
*** mriedem has quit IRC17:36
*** links has quit IRC17:36
*** Swami has joined #openstack-infra17:36
*** mrmartin has quit IRC17:36
openstackgerritCaleb Boylan proposed openstack-infra/shade: Add reno note for create_object and update_object  https://review.openstack.org/32355417:37
openstackgerritPaul Belanger proposed openstack-infra/system-config: Add zookeeper to nodepool.o.o  https://review.openstack.org/32403717:37
*** Sukhdev has quit IRC17:38
pabelangerjeblair: notmorgan: So, it was that easy to enable zookeeper on nodepool.o.o ^  Of course, that's using the default configuration settings. Right now, I don't know what settings we need17:38
pabelangerobviously, things like firewall rules will be needed if we are letting remote things connect17:39
*** Goneri has joined #openstack-infra17:39
*** electrofelix has quit IRC17:39
jlkfungi: I do.17:40
openstackgerritPaul Belanger proposed openstack-infra/system-config: Add zookeeper to nodepool.o.o  https://review.openstack.org/32403717:40
jlkfungi: or I can poke at people who do17:40
jlkfungi: it'd be great if nodepool / shade bubbled up the request ID...17:40
*** pt_15 has joined #openstack-infra17:41
*** nadya has quit IRC17:43
*** Na3iL has quit IRC17:45
*** mrmartin has joined #openstack-infra17:46
*** slaweq_ has joined #openstack-infra17:48
*** tqtran has joined #openstack-infra17:48
*** javeriak has joined #openstack-infra17:49
*** coreyob has quit IRC17:50
*** ccamacho|afk has quit IRC17:50
*** coreyob has joined #openstack-infra17:51
*** mrmartin has quit IRC17:53
*** vdrok has quit IRC17:53
*** mrmartin has joined #openstack-infra17:54
*** abregman_ has quit IRC17:54
*** psachin_ has quit IRC17:54
*** deadnull_ has quit IRC17:54
*** matt-borland has quit IRC17:55
*** javeriak_ has joined #openstack-infra17:55
*** mrmartin has quit IRC17:55
*** javeriak has quit IRC17:56
*** zeih has joined #openstack-infra17:56
openstackgerritPrakash Ramchandran proposed openstack-infra/project-config: add new project meghdwar  https://review.openstack.org/31946617:58
*** notmorgan has quit IRC17:58
*** notmorgan has joined #openstack-infra17:59
*** notmorgan has quit IRC17:59
*** notmorgan has joined #openstack-infra17:59
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: use a socket for reconfiguration  https://review.openstack.org/32235118:00
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: use correct ZMQ port  https://review.openstack.org/32360518:00
openstackgerritJames E. Blair proposed openstack-infra/zuul: Use threads for workers instead of subprocesses  https://review.openstack.org/32404418:00
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: Use threads for workers  https://review.openstack.org/32404418:01
*** zeih has quit IRC18:01
jeblairfungi, pabelanger, notmorgan (in absentia?), clarkb: along with https://review.openstack.org/324044 can you re-review its parents -- there were a few updates to the command socket change18:02
jeblairwith that, i think we'll be ready to try again after lunch (in ~2 hours)18:03
pabelangerclarkb: starting to look into devstack-gate more, would setting OVERRIDE_ENABLED_SERVICES be the fastest way to disable all configured services in devstack? Or should I be looking to another setting18:03
*** tonytan4ever has joined #openstack-infra18:04
*** sambetts is now known as sambetts|afk18:04
*** cloudtrainme has joined #openstack-infra18:05
clarkbpabelanger: that is probably simplest18:05
*** trown|lunch is now known as trown18:05
*** notmorgan has joined #openstack-infra18:06
*** notmorgan has quit IRC18:06
*** notmorgan has joined #openstack-infra18:06
*** moravec has joined #openstack-infra18:07
pabelangerclarkb: thanks18:07
*** amoralej is now known as amoralej|off18:07
fungijeblair: will do!18:10
*** cody-somerville has quit IRC18:11
*** abregman has joined #openstack-infra18:11
fungiapparently i need to gertty --fetch-missing-refs18:12
*** notmorgan has quit IRC18:12
openstackgerritMerged openstack-infra/project-config: Publish election data to static server  https://review.openstack.org/29267618:12
fungitrying to navigate to the first dependency crashed out18:12
*** thinrichs has quit IRC18:12
*** notmorgan has joined #openstack-infra18:13
*** abregman is now known as abregman|afk18:13
*** roxanaghe has quit IRC18:13
openstackgerritPaul Belanger proposed openstack-infra/devstack-gate: DO NOT MERGE: Testing tripleo-ci  https://review.openstack.org/32405118:13
*** HeOS has quit IRC18:14
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: Stop rebuilding locales on centos-7  https://review.openstack.org/31831118:15
sdagueclarkb: if we could get a review here - https://review.openstack.org/#/c/320925 on the d-g fix for live migration, it would be nice to get rid of the custom stuff and move forward (which unblocks any xenial transition)18:15
fungijeblair: interesting. even --fetch-missing-refs ends in a sync error... ValueError: SHA 5163429f3e82dd6f05674bec69e74e20309a1842 could not be resolved, git returned: '5163429f3e82dd6f05674bec69e74e20309a1842 missing'18:15
*** yamamoto has joined #openstack-infra18:16
*** mriedem has joined #openstack-infra18:16
fungilogged about 4 different resolution failures like that18:17
*** roxanaghe has joined #openstack-infra18:17
fungi(for different refs)18:17
jeblairfungi: strange... i don't have that object18:17
fungii'm going to make sure i'm updated to master of gertty and try some more18:18
jeblairfungi: oh, that's a gertty commit18:20
jeblairchange 13058718:21
fungiother's its complaining are missing: a864fc075363f9b1d904ddaeb59c46bfecf71e6d acdd1ef86fd26e85ef53ff4926b772c1ff53da3e 3a7c553cac18205ea8ce59ef3e82501d61bc071318:22
*** notnownikki has quit IRC18:22
pabelangerfungi: any more thought on the DNS question from yesterday? Are we okay with a CNAME record?18:22
krotscheckIs openstack_project::single_use_slave still the manifest I want to use when spinning up a local slave image?18:23
* krotscheck vaguely remembers that thick slave things are no longer a thing.18:23
*** Rockyg has quit IRC18:24
jeblair311459 47937 323605 respectively18:24
fungikrotscheck: yeah, single_use_slave is the entrypoint nodepool uses18:24
krotscheckfungi: Awesome, thanks18:24
*** degorenko is now known as _degorenko|afk18:24
*** nadya has joined #openstack-infra18:25
fungikrotscheck: or rather, that dib uses (on nodepool's behalf)18:25
pabelangerclarkb: https://review.openstack.org/#/c/321904/ removes our hacks for xenial-backports from configure_mirror.sh.  Its now properly populated on our mirrors18:25
*** matt-borland has joined #openstack-infra18:25
krotscheckfungi: Close enough. I'm writing a blog post on how to set one of those up to test builds locally18:25
*** e0ne has joined #openstack-infra18:26
jlkfungi: we're seeing some errors out of Neutron, trying to use rootwrap, to delete a conntrack listener inside the qrouter namespace. We apparently are missing a rootwrap filter to enable that action :/18:26
jlkfungi: Looks like in Mitaka at least the conntrack stuff isn't used anymore18:26
jlknot sure about Kilo18:26
jeblairyay! we're helping!18:26
jlk2016-06-01 07:27:10.517 1425 TRACE neutron.agent.linux.interface Stderr: '/usr/local/bin/neutron-rootwrap: Unauthorized command: ip netns exec qrouter-e9eb5a24-fb5e-4e14-a302-208978efcc81 conntrack -D -d 169.45.71.87 (no filter matched)\n'18:26
jlktop of hte error was18:27
jlk2016-06-01 07:27:10.517 1425 ERROR neutron.agent.linux.interface [-] Failed deleting ingress connection state of floatingip 169.45.71.8718:27
jlkunclear if failure to delete the connection state leads to failure to delete the IP itself.18:27
*** yamamoto has quit IRC18:27
*** nadya has quit IRC18:28
*** thinrichs has joined #openstack-infra18:28
fungijeblair: yep, if i ctrl-o and enter 311459 it crashes with the same traceback too. i tried running with -d and the last thing it does is https://review.openstack.org/a/changes/openstack-infra%2Fproject-config~master~I74bba9659a9767027e2daa649ec6f38bf822b65a?o=DETAILED_LABELS&o=ALL_REVISIONS&o=ALL_COMMITS&o=MESSAGES&o=DETAILED_ACCOUNTS&o=CURRENT_ACTIONS&o=ALL_FILES18:28
*** nadya has joined #openstack-infra18:28
*** thinrichs has quit IRC18:29
jlvillalfungi, Question on Depends-On.  Can I use multiple of them for the same project?18:29
*** bpokorny has quit IRC18:29
*** mrmartin has joined #openstack-infra18:30
jlvillalI currently have a patch chain of patches which aren't related to each other. But they are all needed to fix an issue.18:30
jlvillalI was hoping to stop making them a patch chain, and instead use Depends-On so that they could be merged in in any order.18:30
*** PollyZ_ has joined #openstack-infra18:30
jeblairjlvillal: yes you can do that18:31
fungijlvillal: well, depends-on won't allow them to be merged in _any_ order18:31
fungijlvillal: also be very careful you don't introduce dependency loops that way18:31
jlvillalfungi, What I mean is that one of the patches could be merged.18:31
jeblairif i understand, what's wanted is that D depends on A, B, and C.  but A,B,C, have no relationship with each other.18:32
fungijlvillal: yeah, as long as it doesn't depends-on a patch that hasn't merged yet18:32
jrolloh, neat18:32
openstackgerritDavid Moreau Simard proposed openstack-infra/project-config: Create the ARA project  https://review.openstack.org/32122618:32
jlvillalIf I currently have:  A <- B <- C <- D18:32
jrolljeblair: yep18:32
jlvillalThen I have to wait for everything before D can land.18:32
jlvillaljeblair, Correct on your exampl18:32
jlvillaljeblair, Correct on your example18:32
jeblairso yeah, you can have D have 3 Depends-On lines, one each for A, B, and C.  and they can all be in the same project18:32
jlvillaljeblair, Thanks!18:32
jeblairbut as fungi says, mind you don't make a loop18:33
jlvillalUnderstood18:33
* jroll needs to re-read this code because he didn't read it that way18:33
jeblairif you do, zuul will just refuse to do anything and not provide any feedback :)18:33
fungijlvillal: oh, so did it start following an upgrade maybe?18:33
fungier, jlk: ^18:33
fungisorry jlvillal18:33
* jlvillal was confused.. :)18:34
jeblairfungi: i'm stumped on the gertty thing18:34
* fungi needs to hit more keys before <tab>18:34
jlkfungi: we haven't upgraded your stack yet, we're planning on burning it down and building a new one, on Kilo instead of Juno, or waiting another month or two and doing it on Mitaka18:34
jlk(otherwise we'll upgrade kilo to mitaka)18:34
fungijeblair: i've been seeing it a lot in recent months. if previous experience holds, i will be able to "fix" it by manually fetching that ref into the repo myself18:34
jeblairfungi: is there a traceback?18:35
jeblairperhaps around the ValueError18:36
*** e0ne has quit IRC18:37
*** ihrachys has joined #openstack-infra18:37
fungijeblair: http://paste.openstack.org/show/50701418:37
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: Stop rebuilding locales on centos-7  https://review.openstack.org/31831118:37
jeblairfungi: what version?18:38
jeblairfungi: (in my version, that line is wrapped in a ValueError exception handler)18:38
fungicurrent master branch tip... Gertty version: 1.3.2.dev6618:39
matt-borlandkrotscheck, one note on the npm-run-test...I notice that it's after the *first* karma tests run (horizon, then openstack_dashboard) that it hangs.  Never starts openstack_dashboard tests.18:39
krotscheckmatt-borland: robcresswell had an example of it failing after the second yesterday18:39
jeblairfungi: ah, yep, that's fixed in a not-landed change: https://review.openstack.org/31520718:40
matt-borlandok, good.  I wonder if it's failing during the writing of the coverage files18:40
matt-borlandtyr had found problems with his file limit when running tests at one point18:40
fungijeblair: oh, thanks! testing now18:40
jeblairfungi: i like my branch tip which i've been using for a while; i'm pushing all those changes through now.18:41
*** krtaylor has quit IRC18:41
fungicool18:41
jeblairfungi: you may want to cherry-pick https://review.openstack.org/315927 and provide feedback to mattoliverau18:42
*** nadya has quit IRC18:42
*** ociuhandu_ has quit IRC18:42
*** eezhova has quit IRC18:42
*** Jeffrey4l has quit IRC18:42
fungijeblair: with 315207 applied, trying to open 311459 (eventually) works18:42
fungipauses a bit18:42
jeblairfungi: perfect!18:43
*** Jeffrey4l has joined #openstack-infra18:43
*** nwkarsten has joined #openstack-infra18:43
*** eezhova has joined #openstack-infra18:43
*** nadya has joined #openstack-infra18:43
*** e0ne has joined #openstack-infra18:44
*** cloudtrainme has quit IRC18:44
openstackgerritPrakash Ramchandran proposed openstack-infra/project-config: Can we now create the project repo "meghdwar" before we plan for API specs, web site and other meeting plans etc. as per governance. Please review code +1/0/-1 for any fixing or final repo creation please.  https://review.openstack.org/32405718:44
fungijeblair: mattoliverau: 315927 seems neat. i'm curious how it will play out in reality but i'll take it for a spin on some reviews and see what i think then18:45
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Run {name}-announce-release for Puppet OpenStack modules  https://review.openstack.org/32398118:47
*** bpokorny has joined #openstack-infra18:47
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: use a socket for reconfiguration  https://review.openstack.org/32235118:47
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: Use threads for workers  https://review.openstack.org/32404418:47
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: use correct ZMQ port  https://review.openstack.org/32360518:47
jeblair(just pep8 fixes)18:47
*** nadya has quit IRC18:49
*** ihrachys has quit IRC18:49
*** ifarkas has quit IRC18:50
*** nadya has joined #openstack-infra18:50
*** kzaitsev_mb has joined #openstack-infra18:52
*** ihrachys has joined #openstack-infra18:52
*** nadya_ has joined #openstack-infra18:52
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Cherrypick nova for bug 1585641  https://review.openstack.org/32351618:54
openstackbug 1585641 in tripleo "CI: jobs failing with Message: No valid host was found. There are not enough hosts available., Code: 500"" [High,Triaged] https://launchpad.net/bugs/1585641 - Assigned to James Slagle (james-slagle)18:54
*** nadya has quit IRC18:55
*** dizquierdo is now known as dizquierdo_afk18:55
*** mrmartin has quit IRC18:55
*** ihrachys has quit IRC18:55
*** nadya has joined #openstack-infra18:55
*** nadya_ has quit IRC18:55
openstackgerritMerged openstack/gertty: Show potential completions  https://review.openstack.org/31177118:56
openstackgerritMerged openstack/gertty: Make change list searchable  https://review.openstack.org/31177218:56
openstackgerritMerged openstack/gertty: Make project list searchable  https://review.openstack.org/31177318:56
openstackgerritMerged openstack/gertty: Add a short title to diff screen  https://review.openstack.org/31177418:57
openstackgerritMerged openstack/gertty: Add support for auth-type=form  https://review.openstack.org/16946718:57
openstackgerritMerged openstack/gertty: Add form authentication info to docs  https://review.openstack.org/31177518:57
openstackgerritMerged openstack/gertty: Add (quoted) reply button to change messages  https://review.openstack.org/31267218:57
openstackgerritMerged openstack/gertty: Fix unicode in change messages  https://review.openstack.org/31267318:57
openstackgerritMerged openstack/gertty: Default to prior approval values when (re-)reviewing  https://review.openstack.org/31267418:57
openstackgerritMerged openstack/gertty: Handle ValueError on missing git commit  https://review.openstack.org/31520718:57
openstackgerritMerged openstack/gertty: Handle SNIMissingWarning requests exception  https://review.openstack.org/31520818:57
openstackgerritSpencer Krum proposed openstack-infra/system-config: Git hook implementation of finglonger  https://review.openstack.org/32406118:57
openstackgerritSpencer Krum proposed openstack-infra/infra-specs: Add hoc automation: finglonger  https://review.openstack.org/31094818:59
*** nadya has quit IRC18:59
*** ihrachys has joined #openstack-infra18:59
*** tqtran has quit IRC19:00
*** eezhova has quit IRC19:00
*** tonytan4ever has quit IRC19:00
*** tqtran has joined #openstack-infra19:00
*** cody-somerville has joined #openstack-infra19:03
*** dizquierdo_afk is now known as dizquierdo19:04
*** krtaylor has joined #openstack-infra19:06
*** chem has quit IRC19:06
mriedemfungi: i'm going to go through project-config and kill the periodic-kilo jobs, do you know of any issue holding that up?19:07
mriedemmtreinish: ^19:07
mriedemlooks like Daviey did the 2015.1.4 kilo eol release 3 weeks ago19:07
mtreinishmriedem: nope, I did it a month ago for tempest19:07
mriedemok19:08
fungimriedem: he only did a handful of them though. tonyb was putting together a more complete list of repos to eol19:08
*** oanson has quit IRC19:08
fungii don't know how far he got with that19:08
mriedemfungi: well i'd at least do the 10 here that have a 2015.1.4 release http://releases.openstack.org/kilo/index.html19:09
mtreinishfungi: if you get a sec can you take a look at the logs on health.o.o? I broke something again: http://health.openstack.org/tests/recent/fail19:09
openstackgerritMerged openstack-infra/project-config: Revert "Revert "Move centos-7 on tripleo-test-cloud-rh1 to h2""  https://review.openstack.org/32402219:09
fungimriedem: the stable-maint team expressed interest in taking over the eol process, but i think they were surprised to discover that i/infra had been handling eol requests from far, far more projects than just those under stable-maint control19:10
*** dtardivel has quit IRC19:10
*** _sarob has quit IRC19:10
mtreinishfungi: heh, I knew you were doing that, and I think I'm technically part of that team :)19:11
*** kzaitsev_mb has quit IRC19:12
*** ccamacho has joined #openstack-infra19:12
pleia2could use some process review eyes on our rename doc for friday https://etherpad.openstack.org/p/repo-renaming-2016-06-0319:13
*** nadya has joined #openstack-infra19:13
*** ihrachys has quit IRC19:14
*** dizquierdo is now known as dizquierdo_afk19:15
fungimtreinish: http://paste.openstack.org/show/50701819:15
*** flwang has joined #openstack-infra19:15
mtreinishfungi: hmm, I wonder what's causing that19:16
mtreinishI wasn't expecting that :)19:16
fungimtreinish: i should clarify that the people in #openstack-stable suggesting they could take over eol process weren't considering how to handle eol for non-stable-maint controlled projects19:17
*** nwkarste_ has joined #openstack-infra19:17
fungiso i think it's stalled there for a bit19:17
anteayapleia2: I just got back from errands will look in a bit, thanks for taking care of that19:18
pleia2anteaya: thank you19:18
*** nadya has quit IRC19:19
*** infra-red has joined #openstack-infra19:19
*** nwkarsten has quit IRC19:19
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: Stop rebuilding locales on centos-7  https://review.openstack.org/31831119:20
fungimtreinish: first occurrence i see is Wed Jun 01 16:03:06.470977 201619:20
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Be more specific in Puppet OpenStack Zuul layout  https://review.openstack.org/32387019:20
mtreinishfungi: hmm the change which started using memcached before that: https://review.openstack.org/#/c/321245/19:21
craigeo/19:22
*** linuxmaniac has joined #openstack-infra19:22
mtreinishfungi: https://github.com/lericson/pylibmc/issues/184 seems to indicate we'll hit that when trying to cache something >1MB19:23
*** linuxmaniac_ has quit IRC19:23
mtreinishI doubt the json blob for a lists of tests that failed in the past 10 run failures got that big, but I guess it's possible19:23
anteayapleia2: :)19:24
fungimtreinish: sounds like something you might want an error handling safety valve for anyway19:24
mtreinishfungi: oh, I started the server locally and the JSON blob returned wa 1.2MB19:24
fungiyikes19:24
fungithat's a lot of curly brackets and semicolons19:25
mtreinishsigh, one test suite failed all of it's tests19:25
mtreinishhow did that even get into the gate...19:25
anteayafungi: this is an edit to the election content spec, it awaits your +A when you can add it to your pile, I do believe it is the last patch in jhesketh's add_elections gerrit topic19:25
anteayahttps://review.openstack.org/#/c/296141/119:25
Davieymriedem: Hi o/19:26
strigazihi, can someone help http://logs.openstack.org/46/309546/6/check/gate-rally-dsvm-magnum-rally-nv/4537292/logs/reproduce.sh, it seems that https://review.openstack.org/#/c/323701/1 has no effect19:26
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Remove periodic-db-kilo job from kilo-eol projects  https://review.openstack.org/32406719:27
mriedemDaviey: fungi: mtreinish: tonyb: ^19:27
mriedemthat's just the projects in http://releases.openstack.org/kilo/index.html that have a kilo-eol tag19:27
Davieymriedem / fungi: tonyb is (was?) working on a list to close the remaining kilo branches.  If he is blocked on it, i told him i'd take it on.19:27
mriedemthat's fine19:27
mtreinishfungi: http://logs.openstack.org/94/321594/1/gate/gate-networking-odl-python34/b209000/testr_results.html.gz and http://logs.openstack.org/86/323586/1/gate/gate-networking-cisco-python34/7296b87/testr_results.html.gz19:27
mriedembut we can kill the periodic kilo jobs in those known projects today19:27
Daviey+119:27
openstackgerritMerged openstack-infra/project-config: Make gate-grenade-dsvm-manila voting  https://review.openstack.org/32111519:28
mtreinishfungi: I think the 1MB size limit is gonna be a deal breaker. I'm intending to do more server side caching and I know some of the json blobs (especially on the numeric data) can get pretty large19:28
mtreinishI'm just really surprised we hit this on that recent failures list19:29
*** ociuhandu has joined #openstack-infra19:29
openstackgerritMerged openstack-infra/infra-specs: Further updates to defaulting to alt election repo  https://review.openstack.org/29614119:29
mtreinishI guess I was underestimating neutron drivers' ability to fail19:29
anteayafungi: thank you19:29
*** Sukhdev has joined #openstack-infra19:30
fungimtreinish: do you maybe want to put a governor of some kind in place to keep larger blobs from wrecking the cache, or switch to a different cache implementation?19:30
*** permalac has quit IRC19:30
mtreinishfungi: I'm thinking switching to a different cache implementation19:30
pleia2did a fair amount of infra-root email sifting today, will take another pass at it tomorrow with fresh eyes19:31
mtreinishfungi: the dbm file we were using before worked fine. It just precludes doing the async worker thing19:31
pleia2everything is in folders anyway, even if not quite all the filters are perfect19:31
mtreinishwhich is why I switched to memcached19:31
*** nadya has joined #openstack-infra19:31
pleia2(would help if hp/hpe didn't have 47 email addresses it sent thing from, and that cloud is gone!)19:31
*** Jeffrey4l_ has joined #openstack-infra19:31
pleia2((47 may be a slight exaggeration))19:32
fungipleia2: the other bit we discussed (which can come in a later phase) is updating the e-mail addresses we're using for provider accounts, to make it more likely we'll filter them into a more visible box19:32
pleia2fungi: yeah, we send some things to review@ which we really shouldn't use for anything but gerrit because it's a disaster19:32
anteayapleia2: thank you19:33
pleia2all the out of office replies...19:33
*** zqfan has quit IRC19:33
pleia2so tomorrow I'll work to get a better grasp on what we need to change19:33
anteayayay19:33
mtreinishfungi: hmm, let me see if I can get the async locking to work properly with the dbm backend19:33
mtreinishbecause that would probably be ideal19:34
fungipleia2: thanks so much for taking that on19:34
*** Jeffrey4l has quit IRC19:34
*** andymaier has quit IRC19:34
*** e0ne has quit IRC19:35
*** nadya has quit IRC19:36
*** thinrichs has joined #openstack-infra19:36
pleia2sure thing19:37
*** bpokorny has quit IRC19:37
*** bhavik has quit IRC19:38
*** amitgandhinz has quit IRC19:39
*** amitgandhinz has joined #openstack-infra19:40
*** e0ne has joined #openstack-infra19:40
*** e0ne has quit IRC19:43
mtreinishfungi: how much ram do we have on health.o.o?19:44
pleia2I can check19:44
anteayatristanC: if you feel like reviewing any storyboard patches that add ui bits for teams here is a link: https://review.openstack.org/#/q/project:openstack-infra/storyboard-webclient+branch:master+topic:teams19:44
pleia2mtreinish: 4G19:45
mtreinishpleia2: cool thanks19:45
mtreinishpleia2: thanks19:45
*** Apoorva has quit IRC19:45
fungipleia2: mtreinish can check too! ;) http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=2860&rra_id=all19:46
fungithat paints a far more interesting picture btw19:46
pleia2ah, good call19:46
*** e0ne has joined #openstack-infra19:48
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: Stop rebuilding locales on centos-7  https://review.openstack.org/31831119:48
mtreinishfungi: oops, yeah forgot about that19:48
mtreinishheh, I'm guess that spike was when we turned on memcached :)19:49
openstackgerritPaul Belanger proposed openstack-infra/system-config: Add zookeeper to nodepool.o.o  https://review.openstack.org/32403719:49
*** ociuhandu_ has joined #openstack-infra19:49
*** ociuhandu_ has quit IRC19:49
*** thinrichs has quit IRC19:49
pabelangerpleia2: I'm ready to catch up on planet.o.o if you are19:49
pleia2pabelanger: sure, let me grab the error messages and review real quick19:50
*** pvaneck has joined #openstack-infra19:50
pleia2pabelanger: http://paste.openstack.org/show/507023/19:52
*** cody-somerville has quit IRC19:52
*** zeih has joined #openstack-infra19:52
fungimtreinish: so... if it needs more ram, we can boot a replacement with more ram fairly easily19:52
pleia2pabelanger: it does pull in some feeds (see http://15.184.139.180/ - which I'll shut off in a minute but brought up to grab the logs), but only a fraction of them and never manages to generate a feed19:53
*** eezhova has joined #openstack-infra19:54
pleia2debian got a new version of the planet package in 2014, but it never made it to trusty19:54
*** bpokorny has joined #openstack-infra19:54
pabelangerpleia2: is it possible for us to use the debian package on trusty?19:54
pleia2the new version is in xenial and should work fine once we get the rest of our puppet-y stuff ready for xenial19:54
*** kzaitsev_mb has joined #openstack-infra19:55
*** matt-borland has quit IRC19:55
pleia2pabelanger: we could probably pull the one from xenial and put it on trusty, but we don't really make a habit of that19:55
pleia2(the xenial one is the debian one)19:56
pleia2could also go through the process of requesting it be added to trusty-backports19:56
pabelangerpleia2: Ya, I was just about to ask that19:56
*** zeih has quit IRC19:57
pabelangerif we can get it into trusty-backports, I think we'd be fine.  But moving to xenial could be in the cards too, I do know how much work is needed for puppet19:57
*** Apoorva has joined #openstack-infra19:57
pleia2since I really want to see us start to upgrade to xenial soon (we need it for Zanata), I'm more inclined to not do all this work to shoehorn it back into trusty and just deploy the new system on xenial19:57
mtreinishfungi: well that might just be a short term solution until we start caching a lot more19:58
fungimtreinish: i thought you could put an upper bound on the cache size?19:58
pabelangerpleia2: Right, I guess it depends on how soon we were moving to xenial. I was under the impression that was still about 12-18months out19:58
*** javeriak_ has quit IRC19:58
*** armax_ has joined #openstack-infra19:59
*** Sukhdev has quit IRC19:59
mtreinishfungi: I did, at 60% of ram: https://github.com/openstack-infra/puppet-openstack_health/blob/master/manifests/api.pp#L53-L5619:59
fungipleia2: pabelanger: i think we had agreed that running xenial where it's needed makes sense, but that we were going to wait before trying to mass upgrade all our infrastructure to it19:59
pleia2pabelanger: I guess we should talk about that :) I was hoping our first xenial systems could be launched in the next month or two19:59
*** armax has quit IRC19:59
*** armax_ is now known as armax19:59
mtreinishfungi: something else might be eating the ram20:00
fungipleia2: pabelanger had also mentioned wanting to run a freeswitch instance on xenial as well20:00
pleia2so we could do all our zanata testing+cutover before translations start in early September for Newton20:00
fungimtreinish: well, the spike has subsided now, so not sure what that was20:00
*** nwkarsten has joined #openstack-infra20:00
*** rockyg has joined #openstack-infra20:01
pabelangerfungi: pleia2: Right, I guess I was hoping for a few months before we started the great puppet upgrade for xenial work :) I admit, I'm not sure how much work that is.20:01
mtreinishfungi: hmm, ok20:02
*** dmanchad has quit IRC20:03
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Remove periodic-db-kilo job from kilo-eol projects  https://review.openstack.org/32406720:03
*** nwkarste_ has quit IRC20:03
openstackgerritMerged openstack-infra/project-config: Add support for xenial-backports  https://review.openstack.org/32190420:04
*** dmanchad has joined #openstack-infra20:05
*** david-lyle has joined #openstack-infra20:05
*** cody-somerville has joined #openstack-infra20:05
*** thinrichs has joined #openstack-infra20:05
*** flwang has quit IRC20:06
openstackgerritPaul Belanger proposed openstack-infra/system-config: Move planet.o.o directly to xenial  https://review.openstack.org/32408520:06
openstackgerritJames E. Blair proposed openstack-infra/puppet-zuul: Remove launcher socket option  https://review.openstack.org/32408620:06
pabelangerpleia2: fungi: Lets see if our puppet apply jobs work ^, then we can launch an instances to see what happens :)20:07
*** amitgandhinz has quit IRC20:08
*** ociuhandu has quit IRC20:08
SwansonGot bash: /opt/stack/new/devstack-gate/devstack-vm-gate.sh: No such file or directory in grenade. Anything up in infra or should I just recheck?20:08
*** _vsaienko has quit IRC20:08
*** amitgandhinz has joined #openstack-infra20:08
*** frme has joined #openstack-infra20:09
*** e0ne has quit IRC20:09
openstackgerritJames E. Blair proposed openstack-infra/project-config: Revert "Revert "Revert "Revert "Start using the Zuul Ansible launcher""""  https://review.openstack.org/32408720:09
jeblairSwanson: that seems unlikely to be a transient error20:10
EmilienMpabelanger: sorry I still have a request about zuul layout ... when you have time: https://review.openstack.org/#/c/323870/20:10
pleia2pabelanger: I did that the other week, got a pile of exim errors and some others (don't have my test box running now though, I think my condo got hot and the server shut down this morning (thanks for telling me, nagios!))20:10
*** nwkarste_ has joined #openstack-infra20:11
jeblairpleia2: if you didn't run nagios, would your condo be cooler? ;)20:11
mriedemDaviey: i noticed the neutron-*aas projects don't have a kilo-eol tag for final release,20:11
*** vgridnev has quit IRC20:11
*** haaj has joined #openstack-infra20:11
mriedemDaviey: not sure if they needed a final release?20:11
pleia2jeblair: probably :x20:11
mriedembut neutron has the kilo-eol tag20:11
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Remove kilo bitrot job definition and usage  https://review.openstack.org/32409120:12
*** joaotargino has joined #openstack-infra20:12
pabelangerpleia2: okay, I'll take a peak into exim20:12
pabelangerEmilienM: I thought we fixed it all?20:13
EmilienMpabelanger: well, I found issues... sorry..20:13
EmilienMpabelanger: this time I try to be more specific20:13
*** nwkarsten has quit IRC20:13
*** moravec has quit IRC20:14
openstackgerritMerged openstack-infra/zuul: Ansible launcher: support static workers  https://review.openstack.org/32156920:14
openstackgerritMerged openstack-infra/zuul: Ansible launcher: some ansible fixes  https://review.openstack.org/32233120:14
anteayamriedem: if there are still jobs using the definition, would you consider removing the job from the repos under your management and leave the definition for the folks still using it?20:15
openstackgerritMerged openstack-infra/zuul: Ansible launcher: handle JJB with no macros  https://review.openstack.org/32233220:15
phschwartzHow can I add a git repo to the list to be cached when DIB builds a nodepool node? basically I want it cached so gerrit-git-prep updates it to the latest rev from the merger20:15
fungiphschwartz: right now we build that from our list of repos in our gerrit with a dib element in project-config20:15
mriedemanteaya: my feeling is those repos probably have no idea they are even running those jobs, or what state they are in20:16
mriedemanteaya: so i lean toward just killing it20:16
*** jbernard has quit IRC20:16
fungiphschwartz: but you could add extra repo urls for dib to cache with an extra element of your own mixed in20:16
mriedemanteaya: i'll send something to the dev list as an FYI20:16
*** csomerville has joined #openstack-infra20:17
anteayamriedem: okay that satisfies me, thank you20:17
*** moravec has joined #openstack-infra20:17
anteayamriedem: and I concur with your assessment regarding the level of awareness the repos likey have regarding the jobs they are running20:17
anteayamriedem: your suggestion is a good way forward20:17
*** jbernard has joined #openstack-infra20:18
*** nwkarsten has joined #openstack-infra20:18
*** dizquierdo_afk has quit IRC20:18
*** lucas-dinner has quit IRC20:19
EmilienMpabelanger: the layout looks better now http://logs.openstack.org/70/323870/2/check/gate-project-config-layout/ad75ebb/console.html#_2016-06-01_19_31_11_95720:19
*** zeih has joined #openstack-infra20:19
*** cody-somerville has quit IRC20:19
*** nwkarste_ has quit IRC20:21
*** vgridnev has joined #openstack-infra20:22
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Be more specific in Puppet OpenStack Zuul layout  https://review.openstack.org/32387020:23
*** zeih has quit IRC20:24
*** lucasagomes has joined #openstack-infra20:25
*** eharney has quit IRC20:25
mtreinishfungi: this is what I'm working on to fix this issue: https://review.openstack.org/#/c/324094/220:26
*** roxanaghe has quit IRC20:26
*** nadya has joined #openstack-infra20:26
*** roxanaghe has joined #openstack-infra20:26
*** sree has joined #openstack-infra20:27
*** lucasagomes has quit IRC20:29
openstackgerritRyan Beisner proposed openstack-infra/project-config: Add tempest charm project to Juju Charms  https://review.openstack.org/32409620:30
*** flepied1 has quit IRC20:30
*** nadya has quit IRC20:30
*** abregman|afk has quit IRC20:31
frmejeblair: What do you think about generic job graphs instead of job trees? See https://review.openstack.org/#/c/231124/.20:32
*** sree has quit IRC20:33
*** tonytan4ever has joined #openstack-infra20:34
*** matt-borland has joined #openstack-infra20:35
*** flepied has joined #openstack-infra20:35
*** lucasagomes has joined #openstack-infra20:36
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Run {name}-announce-release for Puppet OpenStack modules  https://review.openstack.org/32398120:37
jeblairfrme: i think it's a good idea, though i would like to visit it in zuulv320:41
frmejeblair: What's the time plan for Zuul v3?20:43
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: Stop rebuilding locales on centos-7  https://review.openstack.org/31831120:43
jeblairfrme: we're working on it now, i can't yet say how long it will take20:43
*** nadya has joined #openstack-infra20:44
frmeI also have two commits to try at my company any time soon: 1. Change job name to gearman through the param-func. 2. Dynamically setup the job graph with a new post-func.20:45
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Be more specific in Puppet OpenStack Zuul layout  https://review.openstack.org/32387020:45
frmePatch 2 basically lets a job finish and then add new jobs to that QueueItem. This means e.g. that a first job can read tox.ini for environments and when the job is done, one job per env is added to the queue.20:46
jeblairfrme: those both sound like they are working around job configuration being insufficient somehow.20:46
jeblairfrme: ah, i think patch 2 will be well served by zuulv320:47
jeblairfrme: (it supports in-repo job configuration)20:47
jeblairfrme: but what made you want to do patch 1?20:47
frmeI don't want to setup new Jenkins jobs. Instead I reuse the same Jenkins job but push a parameter to say what to execute.20:48
jeblairfrme: ah, i think that is also well handled by zuulv3 :)20:49
frmejeblair: That way, the in-repo job configuration works well with Jenkins.20:49
*** nadya has quit IRC20:49
*** sdake has quit IRC20:49
jeblairfrme: take a look at http://specs.openstack.org/openstack-infra/infra-specs/specs/zuulv3.html#jobs and let me know if that way of configuring jobs would work for you20:49
frmejeblair: Basically, should I wait for zuulv3 instead of pushing to current master?20:50
*** david-lyle has quit IRC20:51
jeblairfrme: for these things, i think so.  i hope that those two patches aren't necessary in zuulv3 because of better job design.  the job graph still makes sense there -- but i'd like to add it to zuulv3 rather than master just to avoid making things more complex right now.20:53
*** nadya has joined #openstack-infra20:53
openstackgerritMerged openstack-infra/zuul: Ansible launcher: use a socket for reconfiguration  https://review.openstack.org/32235120:53
*** armax has quit IRC20:53
openstackgerritMerged openstack-infra/zuul: Ansible launcher: use correct ZMQ port  https://review.openstack.org/32360520:53
openstackgerritMerged openstack-infra/zuul: Ansible launcher: Use threads for workers  https://review.openstack.org/32404420:54
*** amitgandhinz has quit IRC20:54
*** eezhova has quit IRC20:55
*** ayoung has quit IRC20:55
*** nwkarsten has quit IRC20:56
openstackgerritPaul Belanger proposed openstack-infra/system-config: Move planet.o.o directly to xenial  https://review.openstack.org/32408520:57
*** Sukhdev has joined #openstack-infra20:58
*** PollyZ_ has quit IRC20:58
*** nadya has quit IRC20:58
*** PollyZ_ has joined #openstack-infra20:58
*** julim has quit IRC21:00
frmejeblair: In the example of tarball triggering pypi-upload, I would suggest chaning the format to the other way around. Specify all jobs in a list and add a variable 'dependencies' for all jobs, i.e. pypi-upload is dependent on tarball. That will create the job graph with a natural configuration.21:01
*** david-lyle has joined #openstack-infra21:01
*** trown is now known as trown|outtypewww21:01
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Remove kilo bitrot job definition and usage  https://review.openstack.org/32409121:02
*** raildo is now known as raildo-afk21:03
jeblairfrme: that is a good idea21:04
*** baoli has quit IRC21:04
openstackgerritMerged openstack-infra/project-config: Remove periodic-db-kilo job from kilo-eol projects  https://review.openstack.org/32406721:06
mtreinishfungi, pleia2: on health.o.o is /tmp on the disk or a tmpfs?21:07
fungifrme: jeblair: sounds pretty similar to modern dependency-graph init systems21:07
*** nwkarsten has joined #openstack-infra21:07
fungimtreinish: on the rootfs21:08
jeblairfungi: them's fightin' words :)21:08
mtreinishfungi: ok, cool21:09
mtreinishthanks21:09
frmejeblair: Regarding my patch 1, my goal is the in-repo configuration can setup new jobs without having to update the Jenkins configuration.21:09
*** moravec has quit IRC21:09
jeblairfungi: in this case, however, we can't express something even as simple as what you can do with sysvinit.21:09
*** _vsaienko has joined #openstack-infra21:10
*** nwkarsten has quit IRC21:10
openstackgerritMatthew Treinish proposed openstack-infra/puppet-openstack_health: Use the distributed memcached locked dbm cache backend  https://review.openstack.org/32410321:11
mtreinishfungi: ^^^ I think that should fix the latest issue on the api server21:11
mtreinishwell that and the o-h patch it depends on21:11
mtreinishit works for me in my local testing at least21:11
fungifrme: in-repo job configuration is a primary zuul v3 feature (arguably its killer feature)21:11
*** nadya has joined #openstack-infra21:11
*** banix has quit IRC21:12
*** ccamacho has quit IRC21:12
frmejeblair: (patch 1) So, the way I'm solving it now is to let the param-func return what Gearman/Jenkins job name to use and default it to the job name in the Zuul config. I can't find anything similar in the zuulv3 docs.21:12
jeblairfrme: yes -- in zuulv3 we stop using jenkins and launch jobs with ansible; those jobs are defined in the zuul configuration so you don't need to have two job configurations.  for the case of running a bunch of tox environments, in zuulv3 i would expect to define a single job "python-tox" centrally, and then in a given repo, have an in-repo config with a job for each tox environment, and each of those jobs inherits from "python-tox".  ...21:12
jeblair... because of the inheritance, that should only be a couple of lines of yaml for each job.21:12
*** Goneri has quit IRC21:13
frmejeblair: Okay, then I need to study ansible a bit first.21:14
*** nwkarsten has joined #openstack-infra21:14
*** burgerk has quit IRC21:15
jeblairbasically: that in-repo config would be "[{job: {python-tox-unittests: {environment: unittests}}}, {job: {python-tox-pep8: {environment: pep8}}}]"21:15
*** nadya has quit IRC21:16
frmejeblair: Regarding patch 2, the usecase is a bit wider. I actually let the user trigger jobs using comments in Gerrit and depending on the comment, a build graph is parsed an only the jobs wanted show up. Without the patch, I trigger hundreds of jobs of which 90% only exit with the message "not wanted by the user".21:16
jeblairfrme: we chose it because if you need to express how to run complex things on multiple hosts (like we need to do when setting up an openstack cluster for testing), you can do so.  *but* if you just want to run some shell script, that's just as easy as using jjb and jenkins.21:17
*** ldnunes has quit IRC21:17
jeblairfrme: ^ re ansible21:17
jeblairfrme: ah, we have that use case for patch 2 as well -- i was thinking that it might be good to solve that with a more descriptive trigger system, or some other kind of job filtering.  at least, i think it would be good to have it be able to be expressed in the configuration, rather than as a custom function.21:18
*** nwkarsten has quit IRC21:19
*** moravec has joined #openstack-infra21:19
EmilienMpabelanger: ok I double checked the layout in logs, and it should be fine now... https://review.openstack.org/#/c/323870/21:19
EmilienMpabelanger: sorry for the multiple iterations, I hope this one is better.21:20
*** nadya has joined #openstack-infra21:21
*** dizquierdo_afk has joined #openstack-infra21:22
frmejeblair: In my case, the jobs are set up through python scripts with "complicated" permutations. I'm not convinced that it fits right away in the configuration, but I have to think about it (and ansible) to be able to come with a good answer.21:22
jeblairfrme: re job filtering: i was imagining something vaguely like this: https://etherpad.openstack.org/p/lySSc0NKba21:24
openstackgerritJay Faulkner proposed openstack-infra/project-config: Use TinyIPA and iPXE for most Ironic jobs  https://review.openstack.org/31380021:24
jeblairfrme: (we could do a lot more than that, but maybe that gives the idea)21:24
frmejeblair: As a last note, these two are combined with a master repo tracking a bunch of submodules where submodule commits are not allowed unless the master is buildable. Sometimes several submodules need to be updated concurrently, but that's solved by kind of a hack in zuul with special commit message words.21:25
jeblairfrme: re permutations -- i know where you are coming from.  a lot of the design of the zuulv3 job descriptions comes from the fact that in openstack, we have over 9000 jenkins jobs, all automatically generated.  so we're trying to make a more expressive system.21:25
*** nwkarsten has joined #openstack-infra21:26
*** nadya has quit IRC21:26
*** _vsaienko has quit IRC21:26
jeblairfrme: interesting -- if you have time to send me an email with a description of what you are doing with submodules, i would appreciate that.21:26
frmejeblair: The job filter looks perfect. Run that job and all its dependencies.21:27
*** akshai has quit IRC21:30
*** gildub has joined #openstack-infra21:30
openstackgerritMerged openstack-infra/project-config: Revert "Revert "Revert "Revert "Start using the Zuul Ansible launcher""""  https://review.openstack.org/32408721:30
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Don't run *multinode-full jobs on stable/liberty  https://review.openstack.org/32410721:30
mriedemsdague: mtreinish: ^21:30
openstackgerritMerged openstack-infra/shade: Add reno note for create_object and update_object  https://review.openstack.org/32355421:30
*** thiagop has quit IRC21:31
*** gildub has quit IRC21:31
*** gildub has joined #openstack-infra21:31
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Don't run *multinode-full jobs on stable/liberty  https://review.openstack.org/32410721:31
*** kaisers_ has joined #openstack-infra21:32
*** frme has quit IRC21:33
*** _ari_ has quit IRC21:34
*** frme has joined #openstack-infra21:35
frmejeblair: I'll send an email, hopefully within a week.21:35
*** frme has left #openstack-infra21:36
jeblairfreerunner: thanks!21:37
*** csomerville has quit IRC21:38
*** haaj has quit IRC21:38
mtreinishfungi: is there an easy way to install the c libs needed to get around this in the unit test: http://logs.openstack.org/94/324094/6/check/gate-openstack-health-python27/7c946dd/console.html#_2016-06-01_21_22_23_194 ?21:41
rcarrillocruzhmm21:41
rcarrillocruzclarkb: i believe what the issue may be21:41
rcarrillocruzthe job has install-distro-packages21:42
rcarrillocruzwhich installs mysql server21:42
rcarrillocruzbut then devstack-gate installs mysql itself with preseed data, like the password21:42
rcarrillocruzbut debconf already set that, i.e. root with empty password21:43
rcarrillocruzdoes that sound like a good theory?21:43
jeblairfungi, pabelanger: zl is in prod again21:44
fungircarrillocruz: yes, install-distro-packages and devstack are incompatible21:44
rcarrillocruzweeeee21:45
rcarrillocruzk, let me push a patchset, thanks!21:45
fungircarrillocruz: or at least should be assumed to be, each is effectively a means of getting the system packages installed21:45
rcarrillocruzright21:46
*** HeOS has joined #openstack-infra21:47
jeblairwith 80 nodes i'm seeing 25% cpu from zuul-launcher.  machine load average is 9.21:47
jeblairthere are 8vcpus, so that's not crazy.21:47
*** zeih has joined #openstack-infra21:48
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/project-config: Remove bindep builder from cloud launcher dsvm job  https://review.openstack.org/32410921:48
*** _vsaienko has joined #openstack-infra21:48
*** jcoufal_ has quit IRC21:48
jeblairit looks like the publish-infra-docs-index job is violating some assumptions i had about publishers21:48
jeblairException: Target path /infra is not below site root21:49
rcarrillocruzfungi, jeblair : mind +W ^ ? the job is only used by the cloud launcher role, and my gate is broken till that lands :/21:49
*** timello has quit IRC21:49
*** sshnaidm has quit IRC21:50
*** edmondsw has quit IRC21:50
*** sdake has joined #openstack-infra21:50
*** flwang has joined #openstack-infra21:50
*** infra-red has quit IRC21:50
*** sshnaidm has joined #openstack-infra21:51
*** zeih has quit IRC21:52
*** sarob has joined #openstack-infra21:52
phschwartzIs subunit2sql being used for status.o.o/openstack-health/ ?21:52
*** dprince has quit IRC21:52
timothyb89phschwartz: yup21:53
*** _sarob has joined #openstack-infra21:53
phschwartztimothyb89: Is it being run from the jenkins jobs to pull push the data into the db or in another manner?21:53
pabelangerjeblair: thanks for the update21:54
*** mriedem has quit IRC21:54
timothyb89phschwartz: as I understand it, the gearman worker collects  results from finished gate jobs into the subunit2sql database: https://github.com/openstack-infra/puppet-subunit2sql/blob/master/files/subunit-gearman-worker.py21:55
jeblairrcarrillocruz: +2 with commentary :)21:55
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet/beaker/experimental: export puppet version on Xenial  https://review.openstack.org/32411121:56
phschwartztimothyb89: so the worker as in the nodepool node uses that to publish it over gear?21:56
rcarrillocruzmakes sense, i'm hoping with that will work , otherwise i'll change strategy :-)21:56
jeblairrcarrillocruz: sounds good :)21:56
*** sarob has quit IRC21:57
mtreinishphschwartz: http://blog.kortar.org/?p=212 has a brief overview of how it works21:57
*** Sukhdev has quit IRC21:57
phschwartzmtreinish: ty very much21:58
andreafhi - can I have reviews on this d-g change? https://review.openstack.org/#/c/322417/ - I'm trying to upload tempest accounts.yaml into the log server, it's useful for jobs running tempest with pre-provisioned creds21:58
phschwartzmtreinish: that helps a lot as I have a need to do this and don't want to expose db creds in my nodes21:58
mtreinishphschwartz: or you can watch the youtube video of my talk from austin on openstack-health if you were so inclined :)21:58
phschwartzmtreinish: your talk right?21:58
*** regXboi has quit IRC21:59
mtreinishphschwartz: right, that's why we reused this mechanism from logstash so we didn't have to put creds on the test slaves21:59
mtreinishphschwartz: https://www.youtube.com/watch?v=0__tD88oAlo21:59
phschwartzmtreinish: I will watch that and read through the code/blog22:00
*** sdake_ has joined #openstack-infra22:00
*** dizquierdo_afk has quit IRC22:01
*** david-lyle has quit IRC22:01
EmilienMhey infra, please review some zuul layout changes for Puppet OpenStack project, thanks! https://review.openstack.org/#/c/323870/ and https://review.openstack.org/32398122:02
*** sdake has quit IRC22:03
*** tosky has quit IRC22:06
*** mtanino has quit IRC22:06
*** annegentle has quit IRC22:07
*** xyang1_ has quit IRC22:09
*** tonytan4ever has quit IRC22:11
*** mdrabe has quit IRC22:11
*** moravec has quit IRC22:13
*** PollyZ_ has quit IRC22:13
*** vgridnev has quit IRC22:13
*** PollyZ has joined #openstack-infra22:15
*** zeih has joined #openstack-infra22:15
*** netsin has quit IRC22:15
*** david-lyle has joined #openstack-infra22:16
*** _vsaienko has quit IRC22:18
*** zeih has quit IRC22:19
*** slaweq_ has quit IRC22:19
*** rockyg has quit IRC22:19
*** _vs has joined #openstack-infra22:21
*** netsin has joined #openstack-infra22:21
*** sdake_ has quit IRC22:21
*** thinrichs has quit IRC22:23
*** thorst has quit IRC22:23
*** aeng has quit IRC22:24
sridhar_raminfra-team - this is a follow up to https://review.openstack.org/#/c/323613/ which created a new tacker-horizon-core group. Please add me as an admin user to this group. I'll take it from there. Thanks!22:26
*** aeng has joined #openstack-infra22:27
*** tpsilva has quit IRC22:27
openstackgerritMerged openstack-infra/project-config: Remove bindep builder from cloud launcher dsvm job  https://review.openstack.org/32410922:28
*** thorst has joined #openstack-infra22:30
*** vhosakot has quit IRC22:30
*** aysyd has quit IRC22:31
*** rbrndt has quit IRC22:31
*** nwkarsten has quit IRC22:31
*** sdake has joined #openstack-infra22:31
*** darrenc is now known as darrenc_afk22:32
*** _vs has quit IRC22:33
*** nwkarsten has joined #openstack-infra22:33
*** thorst has quit IRC22:34
*** nwkarste_ has joined #openstack-infra22:34
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: add pause/unpause support  https://review.openstack.org/32411822:34
*** matt-borland has quit IRC22:34
*** mtanino has joined #openstack-infra22:35
*** _vs has joined #openstack-infra22:35
*** Sukhdev has joined #openstack-infra22:37
*** nwkarsten has quit IRC22:37
*** nwkarste_ has quit IRC22:38
*** darrenc_afk is now known as darrenc22:39
*** mhickey has quit IRC22:41
*** EricGonc_ has quit IRC22:43
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Cherrypick nova for bug 1585641  https://review.openstack.org/32351622:45
jheskethMorning22:45
openstackbug 1585641 in tripleo "CI: jobs failing with Message: No valid host was found. There are not enough hosts available., Code: 500"" [High,Triaged] https://launchpad.net/bugs/1585641 - Assigned to James Slagle (james-slagle)22:45
*** yamahata has quit IRC22:45
openstackgerritK Jonathan Harker proposed openstack/gertty: Add support for the projects search term  https://review.openstack.org/32412222:46
openstackgerritMerged openstack-infra/subunit2sql: Fix docs warnings and errors  https://review.openstack.org/32273722:48
openstackgerritMerged openstack-infra/subunit2sql: Remove useless links from index page  https://review.openstack.org/32371122:48
*** thorst has joined #openstack-infra22:50
*** kzaitsev_mb has quit IRC22:50
*** xarses has quit IRC22:52
*** xarses has joined #openstack-infra22:52
*** thorst has quit IRC22:54
*** dimtruck is now known as zz_dimtruck22:54
*** amitgandhinz has joined #openstack-infra22:55
*** kzaitsev_mb has joined #openstack-infra22:56
*** ffrank has joined #openstack-infra22:57
*** amitgandhinz has quit IRC23:00
*** kurtmartin has joined #openstack-infra23:00
*** Goneri has joined #openstack-infra23:00
*** roxanaghe has quit IRC23:03
*** tqtran has quit IRC23:03
*** yamahata has joined #openstack-infra23:05
*** Goneri has quit IRC23:05
openstackgerritK Jonathan Harker proposed openstack-infra/project-config: Add integration tests between system-config and logstash-filters  https://review.openstack.org/32072923:06
*** sdague has quit IRC23:07
jeblair#status log zl01.openstack.org is back in production handling a portion of the job load23:08
openstackstatusjeblair: finished logging23:08
pabelangerjeblair: is it worth adding zl01 to cacti.o.o?23:09
jeblairjhesketh: good morning; i updated my changes based on your comments, then merged them and we're running ^ now23:09
jeblairpabelanger: yes23:09
pabelangerjeblair: okay, let me get a patch23:09
jeblairjhesketh: let me know what you think23:09
*** hongbin has quit IRC23:09
*** Qiming has joined #openstack-infra23:09
jeblairi have to head out for a while now23:10
openstackgerritPaul Belanger proposed openstack-infra/system-config: Add zl01.o.o to cacti.o.o  https://review.openstack.org/32412823:10
*** roxanaghe has joined #openstack-infra23:10
pabelangerjeblair: jhesketh: ^23:10
pabelangerjhesketh: also, morning23:10
*** _vs has quit IRC23:12
*** zqfan has joined #openstack-infra23:16
*** PollyZ has quit IRC23:17
*** pradk has quit IRC23:20
*** daytime has quit IRC23:22
*** roxanaghe has quit IRC23:25
*** fbo has quit IRC23:26
openstackgerritxiaodongwang991481 proposed openstack-infra/project-config: add networking-sfc gate for functional tests and tempest tests  https://review.openstack.org/32413523:30
*** nighttime has joined #openstack-infra23:31
*** roxanaghe has joined #openstack-infra23:33
*** gordc has quit IRC23:33
jheskethjeblair: oh awesome! Nice work :-)23:33
*** amotoki has quit IRC23:38
*** _sarob has quit IRC23:39
openstackgerritKaiyan Sheng proposed openstack-infra/project-config: [Monasca] Add Tempest Jobs as non-voting for monasca repos  https://review.openstack.org/31629323:40
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: add pause/unpause support  https://review.openstack.org/32411823:41
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: add release command  https://review.openstack.org/32413723:41
*** ffrank has quit IRC23:42
*** zeih has joined #openstack-infra23:43
*** thinrichs has joined #openstack-infra23:46
*** Guest36364 has quit IRC23:47
*** kzaitsev_mb has quit IRC23:48
*** zeih has quit IRC23:48
*** kien-ha has joined #openstack-infra23:48
*** mtanino has quit IRC23:49
*** Shrews has quit IRC23:51
*** Julien-zte has quit IRC23:51
*** gothicmindfood has quit IRC23:51
*** phschwartz has quit IRC23:52
*** afazekas has quit IRC23:52
*** zhurong has joined #openstack-infra23:52
openstackgerritMerged openstack-infra/system-config: Add zl01.o.o to cacti.o.o  https://review.openstack.org/32412823:53
*** banix has joined #openstack-infra23:54
*** thinrichs has left #openstack-infra23:54
*** sdake_ has joined #openstack-infra23:54
*** phschwartz has joined #openstack-infra23:56
*** afazekas has joined #openstack-infra23:56
*** Shrews has joined #openstack-infra23:56
*** zhurong has quit IRC23:56
*** EricGonczer_ has joined #openstack-infra23:56
*** amitgandhinz has joined #openstack-infra23:56
*** sdake has quit IRC23:58
anteayajhesketh: all the election patches merged, thanks for doing those23:58
anteayajhesketh: and good morning23:58
openstackgerritKaiyan Sheng proposed openstack-infra/project-config: [Monasca] Add Tempest Jobs as non-voting for monasca repos  https://review.openstack.org/31629323:58
*** gothicmindfood has joined #openstack-infra23:59
*** david-lyle has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!