Tuesday, 2017-08-22

*** thorst has quit IRC00:02
*** Apoorva_ has joined #openstack-infra00:04
*** Apoorva has quit IRC00:06
*** Swami has quit IRC00:17
*** yamamoto_ has joined #openstack-infra00:18
*** yamamoto_ has quit IRC00:24
*** thorst has joined #openstack-infra00:25
*** thorst has quit IRC00:26
*** slaweq has joined #openstack-infra00:28
*** esberglu has quit IRC00:33
*** slaweq has quit IRC00:33
*** zhurong has joined #openstack-infra00:45
*** mat128 has joined #openstack-infra00:51
*** cshastri has joined #openstack-infra00:59
*** gmann has joined #openstack-infra01:01
*** sbezverk has joined #openstack-infra01:07
*** LindaWang has joined #openstack-infra01:16
pabelangerianw: mind looking at https://review.openstack.org/496020/ would like to start uing ttl for our proxypass requests01:18
*** yamamoto_ has joined #openstack-infra01:21
ianwpabelanger: did we consider disablereuse?01:21
ianwdoes it make sense to have connection pooling to a cdn?01:21
pabelangerianw: haven't looked at that01:22
pabelangerianw: do you think we should stop pooling for the CDN?01:23
ianwhmm, trying to think through it ... do we have workers just sitting there with open connections to buildlogs waiting?01:24
pabelangerianw: not sure01:25
pabelangerbut we are getting connections closed01:25
ianwis it cloudfront?  just looking at netstat01:26
pabelangerno, hat is docker01:26
*** yamamoto_ has quit IRC01:26
*** thorst has joined #openstack-infra01:26
*** Julien-zte has quit IRC01:28
ianwsorry i mean is it actually going to a cdn?  is it buildlogs or rdoproject the major issue?01:28
*** s-shiono has joined #openstack-infra01:28
pabelangerbuildlogs from what I see01:28
ianwdoes that resolve for you as 162.252.80.138 ?01:29
pabelangerhttp://paste.openstack.org/show/618978/01:29
pabelanger185.93.0.2401:30
*** Julien-zte has joined #openstack-infra01:30
*** thorst has quit IRC01:31
*** bobh has quit IRC01:32
ianwinteresting01:33
*** signed8bit_Zzz is now known as signed8bit01:33
*** hongbin has joined #openstack-infra01:34
ianwactually the keepalive should be in the headers, maybe?01:35
pabelangerwell, looking at proxypass keepalive is false by default01:36
*** gcb has joined #openstack-infra01:36
pabelangerI think that is TCP01:36
pabelangerwe first wanted to add a ttl=12001:36
pabelangersee what happend, they try enabling keepalives, but that might also need OS tweaking01:37
pabelangerbut, if we don't want connection polling on the CND to start with, maybe disablereusue is an option too01:37
pabelangerbut it is network related for sure01:38
pabelangerand possible firewall between apache2 and backend is doing something01:38
ianwyeah; even curl locally to buildlogs.centos.org does reuse the connection; so it's not telling it not to.01:40
ianw(buildlogs isn't unsetting keepalive, i mean)01:41
ianwso it should be ok.  like you've identified, maybe connections sitting around hit something funky in an intermediate firewall01:42
pabelangerdisablereuse would be good to test too01:43
pabelangermaybe after we try enabling keepalives01:43
ianwthere are no shortage of options to try :)01:46
pabelangermaybe we also just need to increase our timeout on buildlogs too01:46
pabelangerwe default to 60s01:46
openstackgerritMerged openstack-infra/system-config master: Enable ttl=120 for ProxyPass  https://review.openstack.org/49602001:47
clarkbI like ttl because it doesnt require changing tcp kernel options hopefully it helps01:51
*** thorst has joined #openstack-infra01:51
*** thorst has quit IRC01:51
pabelangerya, happy to try it first01:52
mikalI think I broke gerrit01:52
mikalYou're welcome01:52
mikalOh, its back01:52
mikalI'll try harder next time01:52
pabelanger[Sun Aug 20 13:00:36.051501 2017] [proxy_http:error] [pid 6136:tid 140065325905664] (70007)The timeout specified has expired: [client 146.20.110.34:41154] AH01102: error reading status line from remote server buildlogs.centos.org:44301:53
pabelangerclarkb: ianw: the fact I see that in rax.iad would seem that buildlogs.centos.org is just slow to respond01:54
*** jamesdenton has joined #openstack-infra01:59
*** signed8b_ has joined #openstack-infra02:02
*** cuongnv has joined #openstack-infra02:02
*** iyamahat has quit IRC02:03
*** signed8bit has quit IRC02:05
*** liujiong has joined #openstack-infra02:08
*** yamahata has quit IRC02:10
ianwyeah ... but i guess "buildlogs.centos.org:443" could be any number of different actual hosts.  i wonder if you can get an ip address in there?  if it was consistent, that might indicate something02:11
*** gcb has quit IRC02:12
pabelangerwe do see the error happen time to time on rdoproject too02:14
pabelangerso, i can aleast debug with #rdo and see what they see02:14
*** gcb has joined #openstack-infra02:15
*** yamamoto_ has joined #openstack-infra02:22
*** shu-mutou has joined #openstack-infra02:22
ianwyeah, seeing what happened in that side of the logs would be interesting02:23
*** yamamoto_ has quit IRC02:28
*** signed8b_ is now known as signed8bit_Zzz02:29
*** ramishra has joined #openstack-infra02:31
*** Apoorva_ has quit IRC02:38
*** Apoorva has joined #openstack-infra02:38
*** Apoorva has quit IRC02:42
*** hongbin has quit IRC02:48
*** thorst has joined #openstack-infra02:52
*** hongbin has joined #openstack-infra02:54
*** yamamoto has joined #openstack-infra02:56
*** nicolasbock has quit IRC02:57
*** thorst has quit IRC02:57
*** bramleya has joined #openstack-infra03:00
*** yamamoto has quit IRC03:02
*** xinliang has quit IRC03:07
*** signed8bit_Zzz is now known as signed8b_03:08
*** signed8b_ has quit IRC03:08
*** apetrich has quit IRC03:12
*** funzo has joined #openstack-infra03:16
*** apetrich has joined #openstack-infra03:17
*** iyamahat has joined #openstack-infra03:17
*** funzo has quit IRC03:21
*** namnh has joined #openstack-infra03:21
*** sree has joined #openstack-infra03:26
*** ykarel has joined #openstack-infra03:29
*** sree has quit IRC03:31
*** bramleya has quit IRC03:33
*** dave-mccowan has quit IRC03:40
*** baoli has joined #openstack-infra03:40
*** udesale has joined #openstack-infra03:42
*** ykarel has quit IRC03:46
*** baoli has quit IRC03:47
*** jamesmcarthur has joined #openstack-infra03:47
*** links has joined #openstack-infra03:51
*** jamesmcarthur has quit IRC03:52
*** baoli has joined #openstack-infra03:53
*** mat128 has quit IRC03:53
*** thorst has joined #openstack-infra03:53
*** hongbin has quit IRC03:56
*** baoli has quit IRC03:58
*** hongbin has joined #openstack-infra03:58
*** thorst has quit IRC03:59
*** baoli has joined #openstack-infra03:59
*** yamamoto has joined #openstack-infra04:03
*** jamesmcarthur has joined #openstack-infra04:03
*** baoli has quit IRC04:04
*** hongbin has quit IRC04:04
*** baoli has joined #openstack-infra04:05
*** jamesmcarthur has quit IRC04:08
* frickler is also seeing gerrit slowness und the cacti memory graph seems to suggest a restart might be helpful, too04:08
*** ramishra has quit IRC04:08
*** yamamoto has quit IRC04:09
*** baoli has quit IRC04:09
*** ramishra has joined #openstack-infra04:10
*** baoli has joined #openstack-infra04:11
*** baoli has quit IRC04:15
*** jamesmcarthur has joined #openstack-infra04:19
*** esberglu has joined #openstack-infra04:21
*** sree has joined #openstack-infra04:22
*** jamesmcarthur has quit IRC04:23
ianwfrickler: hmm, still seeing issues?  not much happening on the host04:24
*** pgadiya has joined #openstack-infra04:30
*** esberglu has quit IRC04:31
*** jamesmcarthur has joined #openstack-infra04:34
*** ramishra has quit IRC04:37
*** jamesmcarthur has quit IRC04:38
*** ramishra has joined #openstack-infra04:39
*** ykarel has joined #openstack-infra04:45
*** sree has quit IRC04:47
*** sree has joined #openstack-infra04:48
*** dhajare_ has joined #openstack-infra04:48
*** jamesmcarthur has joined #openstack-infra04:50
*** thorst has joined #openstack-infra04:54
*** markvoelker has quit IRC04:54
*** jamesmcarthur has quit IRC04:54
*** pbourke has quit IRC04:56
*** ramishra has quit IRC04:56
*** pbourke has joined #openstack-infra04:58
*** ramishra has joined #openstack-infra04:58
*** thorst has quit IRC04:58
*** baoli has joined #openstack-infra05:00
*** masber has quit IRC05:02
*** baoli has quit IRC05:04
*** baoli has joined #openstack-infra05:04
*** yamamoto has joined #openstack-infra05:05
*** jamesmcarthur has joined #openstack-infra05:05
*** pgadiya has quit IRC05:09
*** jamesmcarthur has quit IRC05:10
*** yamamoto has quit IRC05:10
*** funzo has joined #openstack-infra05:17
*** jamesmcarthur has joined #openstack-infra05:21
*** gcb has quit IRC05:21
*** funzo has quit IRC05:22
*** gcb has joined #openstack-infra05:23
*** psachin has joined #openstack-infra05:24
*** jamesmcarthur has quit IRC05:25
ianwfungi: could we do a bindep release?  the rpm "--whatprovides" changes are required for testing to work with fedora26/python3.605:27
*** claudiub has joined #openstack-infra05:27
*** panda has quit IRC05:29
*** links has quit IRC05:30
ianw(ps happy to do it, just wanted to make sure nothing in flight i didn't know about)05:31
*** kjackal has joined #openstack-infra05:32
*** links has joined #openstack-infra05:33
*** pgadiya has joined #openstack-infra05:34
*** sree has quit IRC05:34
*** sree has joined #openstack-infra05:34
*** jamesmcarthur has joined #openstack-infra05:36
*** rodrigopaiva has joined #openstack-infra05:37
*** baoli has quit IRC05:37
*** sree has quit IRC05:39
*** pgadiya has quit IRC05:40
*** jamesmcarthur has quit IRC05:41
*** rodrigopaiva has quit IRC05:45
*** pgadiya has joined #openstack-infra05:51
*** jamesmcarthur has joined #openstack-infra05:52
*** masber has joined #openstack-infra05:55
*** thorst has joined #openstack-infra05:55
*** jamesmcarthur has quit IRC05:56
*** thorst has quit IRC05:59
*** pgadiya has quit IRC06:02
openstackgerritLiang Cui proposed openstack-infra/openstackweb master: modify some misspellings  https://review.openstack.org/49609606:04
*** slaweq has joined #openstack-infra06:04
*** kjackal has quit IRC06:04
*** yamamoto has joined #openstack-infra06:06
*** jamesmcarthur has joined #openstack-infra06:07
*** yamamoto has quit IRC06:12
*** jamesmcarthur has quit IRC06:12
*** rlandy|bbl is now known as rlandy06:12
*** pgadiya has joined #openstack-infra06:14
openstackgerritIan Wienand proposed openstack-infra/project-config master: Cleanup some devstack experimental jobs  https://review.openstack.org/49610306:18
*** ramishra has quit IRC06:19
*** pgadiya has quit IRC06:20
*** ramishra has joined #openstack-infra06:21
*** jamesmcarthur has joined #openstack-infra06:23
*** jamesmcarthur has quit IRC06:27
*** shardy has joined #openstack-infra06:27
openstackgerritArtur Basiak proposed openstack-infra/project-config master: Enable plugins for unified gates  https://review.openstack.org/49611006:31
*** yamahata has joined #openstack-infra06:33
*** pgadiya has joined #openstack-infra06:34
*** pgadiya has quit IRC06:34
*** arturb has joined #openstack-infra06:36
*** _jbadiapa has joined #openstack-infra06:38
*** jamesmcarthur has joined #openstack-infra06:38
*** jbadiapa_ has quit IRC06:38
*** jascott1 has quit IRC06:39
*** armax has quit IRC06:39
*** jascott1 has joined #openstack-infra06:40
*** jamesmcarthur has quit IRC06:43
*** jascott1 has quit IRC06:44
*** rcernin has joined #openstack-infra06:45
*** pcaruana has joined #openstack-infra06:45
*** jascott1 has joined #openstack-infra06:46
*** slaweq_ has joined #openstack-infra06:46
fricklerianw: was better for a bit but now things are getting slow again. not consistent but maybe 50% of the requests06:50
*** slaweq_ has quit IRC06:50
AJaegerinfra-root, gerrit needs a restart, I got several 502s...06:51
AJaegeror invalid proxy06:51
*** jistr is now known as jistr|trng06:53
AJaegerfrickler: I agree, gerrit is unusable here. ianw, if you're still around, could you restart gerrit, please?06:54
*** jpena|off is now known as jpena06:54
*** markvoelker has joined #openstack-infra06:55
*** coolsvap has joined #openstack-infra06:55
*** thorst has joined #openstack-infra06:56
*** thorst has quit IRC07:00
*** Hal has joined #openstack-infra07:03
*** Hal is now known as Guest7751407:03
*** csomerville has joined #openstack-infra07:05
*** cody-somerville has quit IRC07:05
*** florianf has joined #openstack-infra07:07
*** jamesmcarthur has joined #openstack-infra07:09
*** jamesmcarthur has quit IRC07:14
*** iyamahat has quit IRC07:18
*** funzo has joined #openstack-infra07:18
*** jtomasek has joined #openstack-infra07:18
*** dmellado has joined #openstack-infra07:18
*** cshastri has quit IRC07:19
*** tesseract has joined #openstack-infra07:20
*** cshastri has joined #openstack-infra07:21
*** panda has joined #openstack-infra07:22
*** funzo has quit IRC07:22
*** markvoelker has quit IRC07:29
*** amoralej|off is now known as amoralej07:29
AJaegeryolanda: do you have time to restart gerrit, please? ^07:30
*** yamahata has quit IRC07:31
yolandahi AJaeger , sure07:32
*** jpich has joined #openstack-infra07:34
*** psachin has quit IRC07:34
yolanda#status notice Gerrit is going to be restarted due to slow performance07:35
openstackstatusyolanda: sending notice07:35
AJaegerthanks07:35
-openstackstatus- NOTICE: Gerrit is going to be restarted due to slow performance07:36
yolanda#status ok Gerrit has been restarted successfully07:36
openstackstatusyolanda: finished sending notice07:38
openstackstatusyolanda: sending ok07:38
dmelladoyolanda: could you have a quick look at this patch? https://review.openstack.org/#/c/487928/07:40
dmelladothanks!07:40
-openstackstatus- NOTICE: Gerrit has been restarted successfully07:40
*** jamesmcarthur has joined #openstack-infra07:40
yolandahi dmellado , good morning! be polite! :)07:40
dmelladolol07:40
dmelladoI usually am! xD07:41
dmelladoI just didn't have my coffee yet xD07:41
dmelladohow're you doing?07:41
yolandanot so bad07:41
openstackstatusyolanda: finished sending ok07:43
*** jamesmcarthur has quit IRC07:44
*** jbadiapa_ has joined #openstack-infra07:46
*** priteau has joined #openstack-infra07:47
*** _jbadiapa has quit IRC07:48
*** isaacb has joined #openstack-infra07:49
*** egonzalez has joined #openstack-infra07:51
*** ykarel is now known as ykarel|lunch07:51
openstackgerritMerged openstack-infra/project-config master: Enable Octavia Variant  https://review.openstack.org/48792807:52
*** Guest77514 has quit IRC07:53
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Cleanup log translations  https://review.openstack.org/49614207:54
*** iyamahat has joined #openstack-infra07:54
AJaegerianychoi: seeing many projects still have log level pos in-tree, I decided to clean them up ^07:54
*** jamesmcarthur has joined #openstack-infra07:56
*** Hal has joined #openstack-infra07:56
openstackgerritMerged openstack-infra/project-config master: Enable plugins for unified gates  https://review.openstack.org/49611007:57
*** thorst has joined #openstack-infra07:57
*** Hal is now known as Guest1497107:57
openstackgerritMerged openstack-infra/project-config master: add qos extension to all congress dsvm jobs  https://review.openstack.org/49603907:58
*** jamesmcarthur has quit IRC08:00
*** bogdando has joined #openstack-infra08:01
openstackgerritMerged openstack-infra/project-config master: neutron-fwaas/vpnaas-dashboard: publish to PyPI  https://review.openstack.org/49573808:01
openstackgerritMerged openstack-infra/project-config master: n8g-bagpipe: tune PROJECTS to match dependencies  https://review.openstack.org/49584108:01
*** thorst has quit IRC08:01
*** makowals has quit IRC08:06
*** makowals has joined #openstack-infra08:06
*** alexchadin has joined #openstack-infra08:09
ianychoiAJaeger, I will see it - thanks!08:09
*** jogo has quit IRC08:09
*** jamesmcarthur has joined #openstack-infra08:11
*** liujiong_lj has joined #openstack-infra08:13
*** derekh has joined #openstack-infra08:13
*** jascott1 has quit IRC08:14
*** liujiong has quit IRC08:14
*** jascott1 has joined #openstack-infra08:14
*** jamesmcarthur has quit IRC08:16
*** jascott1 has quit IRC08:19
*** jogo has joined #openstack-infra08:19
*** jogo has quit IRC08:19
*** jogo has joined #openstack-infra08:19
*** iyamahat has quit IRC08:25
*** shardy has quit IRC08:25
*** liujiong has joined #openstack-infra08:25
*** markvoelker has joined #openstack-infra08:26
*** liujiong_lj has quit IRC08:26
*** jamesmcarthur has joined #openstack-infra08:27
*** liujiong_lj has joined #openstack-infra08:28
*** Guest14971 has quit IRC08:29
*** liujiong has quit IRC08:30
*** dingyichen has quit IRC08:30
*** jamesmcarthur has quit IRC08:31
openstackgerritDaniel Mellado proposed openstack-infra/project-config master: Move experimental kuryr-k8s octavia job to check  https://review.openstack.org/49574408:34
*** yamamoto has joined #openstack-infra08:35
openstackgerritColleen Murphy proposed openstack-infra/puppet-pip master: (WIP) Fix the wheel url in functional tests' mirror config  https://review.openstack.org/49602708:36
*** dtantsur|afk is now known as dtantsur08:36
*** tosky has joined #openstack-infra08:38
*** jamesmcarthur has joined #openstack-infra08:42
*** ykarel|lunch is now known as ykarel08:44
*** jbadiapa_ has quit IRC08:45
*** Hal has joined #openstack-infra08:47
*** Hal is now known as Guest4846808:47
*** jamesmcarthur has quit IRC08:47
*** cuongnv has quit IRC08:49
*** makowals has quit IRC08:49
*** Guest48468 has quit IRC08:49
*** makowals_ has joined #openstack-infra08:50
*** thorst has joined #openstack-infra08:57
*** jamesmcarthur has joined #openstack-infra08:58
*** yamamoto has quit IRC08:59
*** yamamoto has joined #openstack-infra08:59
*** yamamoto has quit IRC08:59
*** ociuhandu has quit IRC08:59
*** markvoelker has quit IRC09:00
bogdandoPTAL e-r queries https://review.openstack.org/#/c/493535/ https://review.openstack.org/#/c/493525/  https://review.openstack.org/#/c/493520/ to reduce unknown/uncategorised numbers09:01
bogdandoelastic-recheck folks, your feedback is needed please ! ^^09:01
*** jbadiapa_ has joined #openstack-infra09:01
*** thorst has quit IRC09:02
*** jamesmcarthur has quit IRC09:02
*** electrofelix has joined #openstack-infra09:03
*** pblaho has joined #openstack-infra09:12
*** apetrich has quit IRC09:13
*** apetrich has joined #openstack-infra09:13
*** jamesmcarthur has joined #openstack-infra09:13
*** jamesmcarthur has quit IRC09:17
*** shardy has joined #openstack-infra09:18
*** funzo has joined #openstack-infra09:19
*** sambetts|afk is now known as sambetts09:21
*** apetrich has quit IRC09:23
*** funzo has quit IRC09:23
*** liujiong_lj has quit IRC09:27
openstackgerritColleen Murphy proposed openstack-infra/puppet-pip master: (WIP) Fix the wheel url in functional tests' mirror config  https://review.openstack.org/49602709:28
*** jamesmcarthur has joined #openstack-infra09:29
*** liujiong has joined #openstack-infra09:31
*** gixxer1k has joined #openstack-infra09:32
*** gixxer1k has quit IRC09:32
*** e0ne has joined #openstack-infra09:33
*** shu-mutou is now known as shu-mutou-AWAY09:33
*** jamesmcarthur has quit IRC09:33
*** apetrich has joined #openstack-infra09:35
*** s-shiono has quit IRC09:39
*** faizy has joined #openstack-infra09:40
*** jamesmcarthur has joined #openstack-infra09:44
*** cshastri has quit IRC09:46
*** jamesmcarthur has quit IRC09:48
*** csomerville has quit IRC09:50
*** jbadiapa_ has quit IRC09:52
*** jbadiapa_ has joined #openstack-infra09:52
openstackgerritBogdan Dobrelya proposed openstack-infra/tripleo-ci master: Rework the getthelogs helper script for wget recursive  https://review.openstack.org/49217809:55
*** nicolasbock has joined #openstack-infra09:56
*** markvoelker has joined #openstack-infra09:57
*** thorst has joined #openstack-infra09:58
*** makowals_ has quit IRC09:58
*** makowals has joined #openstack-infra09:59
*** yamamoto has joined #openstack-infra10:00
*** nicolasbock has quit IRC10:01
*** makowals_ has joined #openstack-infra10:02
*** stakeda has quit IRC10:02
*** thorst has quit IRC10:03
*** makowals has quit IRC10:05
*** yamamoto has quit IRC10:05
*** alexchadin has quit IRC10:05
*** alexchadin has joined #openstack-infra10:07
openstackgerritFlavio Percoco proposed openstack-infra/tripleo-ci master: Collect mistral-ansible execution files from /tmp  https://review.openstack.org/48386710:08
*** alexchadin has quit IRC10:10
*** alexchadin has joined #openstack-infra10:11
*** alexchadin has quit IRC10:13
*** nicolasbock has joined #openstack-infra10:13
*** liujiong has quit IRC10:13
*** jamesmcarthur has joined #openstack-infra10:15
*** zhurong has quit IRC10:17
*** jamesmcarthur has quit IRC10:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config master: OSA: Only try to copy file if if exists  https://review.openstack.org/49619110:21
odyssey4meandymccr hwoarang ^ your reviews would be appreciated10:23
*** apetrich has quit IRC10:23
hwoarangodyssey4me: lgtm +110:25
*** evrardjp has joined #openstack-infra10:26
odyssey4meevrardjp as incoming PTL for OSA I'd appreciate your review of https://review.openstack.org/49619110:26
openstackgerritAndy McCrae proposed openstack-infra/project-config master: OSA: Only try to copy file if it exists  https://review.openstack.org/49619110:27
evrardjpk10:27
odyssey4meit'll help the project-config reviewers to know that it's been reviewed by the PTL and therefore they can review purely on how it affects infra and whether it'll work10:27
*** jascott1 has joined #openstack-infra10:28
openstackgerritSam Betts proposed openstack-infra/glean master: Break systemd unit dependency cycle  https://review.openstack.org/48574810:28
openstackgerritSam Betts proposed openstack-infra/glean master: Fix bonding for RHEL and systemd based OSs  https://review.openstack.org/45563810:28
*** yamamoto has joined #openstack-infra10:30
*** raissa_ is now known as raissa10:30
*** markvoelker has quit IRC10:31
evrardjpodyssey4me: ofc :)10:31
*** jamesmcarthur has joined #openstack-infra10:31
*** rossella_s has joined #openstack-infra10:31
*** rossella_s has quit IRC10:31
*** sree has joined #openstack-infra10:35
*** jamesmcarthur has quit IRC10:35
*** udesale has quit IRC10:36
*** sree has quit IRC10:39
*** dtantsur is now known as dtantsur|bbl10:40
*** shardy has quit IRC10:42
*** baoli has joined #openstack-infra10:45
*** jamesmcarthur has joined #openstack-infra10:46
*** jkilpatr has quit IRC10:48
*** baoli has quit IRC10:49
*** yee379 has quit IRC10:50
*** yee379 has joined #openstack-infra10:51
*** jamesmcarthur has quit IRC10:52
*** markmcd has quit IRC10:52
hwoarangi am seeing a lot of dns/network related issues on opensuse jobs today10:52
hwoaranghttp://logs.openstack.org/99/496199/1/check/gate-openstack-ansible-pip_install-ansible-func-opensuse-423-nv/96d9ad0/console.html#_2017-08-22_10_49_25_97397010:53
hwoaranghttp://logs.openstack.org/80/495880/4/experimental/gate-openstack-ansible-openstack-ansible-aio-opensuse-423-nv/f28b83f/console.html#_2017-08-22_10_09_39_04931810:53
*** markmcd has joined #openstack-infra10:53
hwoarangis it known? i checked the backlog but I can't see similar reports10:53
*** wolverineav has joined #openstack-infra10:57
*** zeus has quit IRC10:59
*** slaweq_ has joined #openstack-infra10:59
*** zeus has joined #openstack-infra11:00
*** DinaBelova has quit IRC11:00
*** ruhe has quit IRC11:00
*** freerunner has quit IRC11:00
*** zeus is now known as Guest9069211:00
*** DinaBelova has joined #openstack-infra11:00
*** eventingmonkey has quit IRC11:00
*** kambiz has quit IRC11:00
*** njohnston has quit IRC11:00
*** quite has quit IRC11:00
*** StevenK has quit IRC11:00
*** junbo has quit IRC11:01
*** e0ne has quit IRC11:01
*** slaweq has quit IRC11:01
*** rcarrillocruz has quit IRC11:01
*** tobiash has quit IRC11:01
*** leifmadsen has quit IRC11:01
*** bkero has quit IRC11:01
*** Dinesh_Bhor has quit IRC11:01
*** ruhe has joined #openstack-infra11:01
*** tmorin has joined #openstack-infra11:01
*** kukacz has quit IRC11:01
*** lihi has quit IRC11:01
*** zerick has quit IRC11:01
*** stephenfin has quit IRC11:01
*** toabctl has quit IRC11:01
*** sshnaidm|off has quit IRC11:01
*** zerick has joined #openstack-infra11:02
*** e0ne has joined #openstack-infra11:02
*** StevenK has joined #openstack-infra11:02
*** eventingmonkey has joined #openstack-infra11:02
*** alex_xu has quit IRC11:02
*** tobiash has joined #openstack-infra11:03
*** luzC has quit IRC11:03
*** toabctl has joined #openstack-infra11:04
*** vryzhenkin has joined #openstack-infra11:04
*** Dinesh_Bhor has joined #openstack-infra11:05
*** junbo has joined #openstack-infra11:05
*** kambiz has joined #openstack-infra11:05
*** sshnaidm|off has joined #openstack-infra11:05
*** stephenfin has joined #openstack-infra11:05
*** quite has joined #openstack-infra11:05
*** lihi has joined #openstack-infra11:05
*** luzC has joined #openstack-infra11:05
*** rcarrillocruz has joined #openstack-infra11:05
*** alex_xu has joined #openstack-infra11:06
*** njohnston has joined #openstack-infra11:06
*** bkero has joined #openstack-infra11:06
*** leifmadsen has joined #openstack-infra11:06
hwoarangand another one http://logs.openstack.org/99/496199/1/experimental/gate-openstack-ansible-pip_install-ansible-func-opensuse-423-nv/4f7a8d8/console.html11:06
*** thorst has joined #openstack-infra11:07
*** kukacz has joined #openstack-infra11:07
*** jkilpatr has joined #openstack-infra11:07
*** thorst has quit IRC11:11
*** alexchadin has joined #openstack-infra11:13
tmorinhi infraroot, I've got a question related to Depends-On: I have a change in project X, with a Depends-on a change in project Y, but test job don't incorporate the project Y change... could someone help me fix that ?11:15
*** funzo has joined #openstack-infra11:16
*** funzo has quit IRC11:16
*** funzo has joined #openstack-infra11:16
*** yamamoto has quit IRC11:18
*** funzo has quit IRC11:21
AJaegerhwoarang: we made some changes with glean/dns AFAIK - best talk with pabelanger and clarkb later today11:21
AJaegertmorin: Read first https://docs.openstack.org/infra/manual/developers.html#limitations-and-caveats - it really depends how your test set up is done. If you install from pip, the depends-on is just an ordering. it only helps if the dependent repo is checked out from git.11:22
tmorinAJaeger: the case that is problematic to me is a networking-bagpipe change depending-on a networking-bgpvpn change, and networking-bagpipe *is* installing networking-bgpvpn via git ( https://github.com/openstack/networking-bagpipe/blob/master/tools/tox_install.sh#L65 )11:26
hwoarangAJaeger: ok thank you. I will try to talk to them later then11:26
tmorinAJaeger: also, I guess you meant "via PyPi", because installing with pip from git, works right ?11:27
*** markvoelker has joined #openstack-infra11:28
fricklertmorin: do you still have this issue after https://review.openstack.org/495841 merged?11:29
tmorinAJaeger: I have a hard time troubleshooting, devstack-gate checks out a commit I can't identify : http://logs.openstack.org/40/494240/3/check/gate-networking-bagpipe-dsvm-fullstack-ubuntu-xenial-nv/0bdcbc8/logs/devstack-gate-setup-workspace-new.txt.gz#_2017-08-22_08_23_30_49511:29
tmorinfrickler: yes :-(  hence my question here11:29
*** yamamoto has joined #openstack-infra11:30
AJaegertmorin: using zuul-cloner?11:32
tmorinAJaeger: yes11:32
tmorinfrickler, AJaeger: actually, devstack-gate seems to checkout the depends-on commit ( http://logs.openstack.org/40/494240/3/check/gate-networking-bagpipe-dsvm-fullstack-ubuntu-xenial-nv/0bdcbc8/logs/devstack-gate-setup-workspace-new.txt.gz#_2017-08-22_08_23_32_448 ), but the dsvm-fullstack job sees master HEAD commit: http://logs.openstack.org/40/494240/3/check/gate-networking-bagpipe-dsvm-fullstack-ubuntu-xenial-nv/0bdcbc8/conso11:33
tmorinle.html#_2017-08-22_08_31_38_98541111:33
AJaegertmorin: we just merged https://review.openstack.org/#/c/495841/ - are you using that change?11:33
AJaegertmorin: better recheck, your log file is older...11:34
AJaegertmorin: sorry, can't help debugging further right now, hope others can11:34
tmorinAJaeger: yes, I rechecked after 495841 merged11:35
tmorinAJaeger: see above devstack-gate seems to take the depends on into account, but somehow my job retrieves another change somewhere11:36
*** bramleya has joined #openstack-infra11:37
tmorinAJaeger: the job logs aren't older than the time of the "Change has been successfully merged into the git repository by Jenkins" message of the project config change11:38
tmorinAJaeger, frickler: I would investigate what tools/tox_install.sh has done when starting the tox job, but the tox logdir is empty: http://logs.openstack.org/40/494240/3/check/gate-networking-bagpipe-dsvm-fullstack-ubuntu-xenial-nv/0bdcbc8/tox/ ... any idea why ?11:39
*** bramleya has quit IRC11:41
*** ldnunes has joined #openstack-infra11:41
*** ociuhandu has joined #openstack-infra11:43
*** yamamoto has quit IRC11:46
*** yamamoto has joined #openstack-infra11:48
*** apetrich has joined #openstack-infra11:52
fricklertmorin: IIUC setting "--branch $BRANCH_NAME" in your zuul-cloner call in tools/tox_install.sh might override the ZUUL_REF that contains your dependency11:52
*** faizy has quit IRC11:55
*** faizy has joined #openstack-infra11:57
AJaegertmorin: your run is from 8:19, the change merged at 8:01 - and it takes another puppet run to make it effective. So, it might be that the project-config change was not there.11:58
*** faizy has quit IRC11:58
*** faizy has joined #openstack-infra11:58
tmorinAJaeger: if there is another step, then maybe, but devstack-gate seems to have seen the depends-on: http://logs.openstack.org/40/494240/3/check/gate-networking-bagpipe-dsvm-fullstack-ubuntu-xenial-nv/0bdcbc8/logs/devstack-gate-setup-workspace-new.txt.gz#_2017-08-22_08_23_32_44811:59
AJaegerBut still, that change is different from what tox-install does.11:59
tmorinAJaeger: ok, I'll do a recheck again then12:00
*** markvoelker has quit IRC12:01
tmorinfrickler: this sounds like a plausible explanation, if I add --zuul-ref $ZUUL_REF to the zuul-cloner command line in the case where $ZUUL_REF is non empty, would that work ?12:01
tmorinfrickler: (is ZUUL_REF inherited in the environment variables that tox sees and presumably passes on to the install_command ?)12:02
AJaegertmorin: let's figure out with the rest of the team the best approach - and then do us all a favour and sync all copies of tox_install.sh in the networking repos, each does it differently ;(12:02
AJaegertmorin, frickler I'm off again for a bit...12:02
*** yamamoto has quit IRC12:03
*** gildub has quit IRC12:03
tmorinAJaeger: I think some steps where taken to improve that, but I'll try to keep in mind to discuss the question during PTG12:03
*** yamamoto has joined #openstack-infra12:04
*** sshnaidm|off is now known as sshnaidm12:05
*** mat128 has joined #openstack-infra12:07
fricklertmorin: maybe the sudo here needs -E in order to pass the environment http://logs.openstack.org/40/494240/3/check/gate-networking-bagpipe-dsvm-fullstack-ubuntu-xenial-nv/0bdcbc8/console.html#_2017-08-22_08_31_33_03415212:07
*** baoli has joined #openstack-infra12:08
*** olaph has quit IRC12:08
*** yamamoto has quit IRC12:10
tmorinfrickler: indeed, good point, perhaps it might even be sufficient if zuul-cloner does the right thing when ZUUL_REF is set (?)12:10
tmorinfrickler: I will investigate this direction, thanks for the help !12:10
fricklertmorin: yes, that might make my earlier comment obsolete12:10
*** Julien-zte has quit IRC12:11
*** thorst has joined #openstack-infra12:11
*** ramishra has quit IRC12:12
*** yamamoto has joined #openstack-infra12:12
*** baoli has quit IRC12:12
*** Julien-zte has joined #openstack-infra12:12
*** rlandy has joined #openstack-infra12:12
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config master: OSA: Only try to copy file if if exists  https://review.openstack.org/49619112:13
*** ramishra has joined #openstack-infra12:14
*** amoralej is now known as amoralej|lunch12:14
*** faizy has quit IRC12:15
*** trown|outtypewww is now known as trown12:17
*** kjackal has joined #openstack-infra12:18
*** pblaho has quit IRC12:19
*** efoley has joined #openstack-infra12:20
*** dprince has joined #openstack-infra12:25
*** slaweq_ has quit IRC12:25
*** signed8bit has joined #openstack-infra12:25
*** slaweq has joined #openstack-infra12:26
*** olaph has joined #openstack-infra12:26
*** slaweq has quit IRC12:30
*** efoley_ has joined #openstack-infra12:31
*** efoley_ has quit IRC12:31
*** markvoelker has joined #openstack-infra12:32
*** dave-mccowan has joined #openstack-infra12:34
*** slaweq has joined #openstack-infra12:34
*** psachin has joined #openstack-infra12:35
*** gixxer1k has joined #openstack-infra12:36
*** gixxer1k has quit IRC12:37
*** udesale has joined #openstack-infra12:37
*** psachin has quit IRC12:39
*** psachin has joined #openstack-infra12:39
*** kjackal has quit IRC12:44
*** kjackal has joined #openstack-infra12:44
*** LindaWang has quit IRC12:47
*** thorst is now known as thorst_afk12:49
*** alexchadin has quit IRC12:51
*** alexchadin has joined #openstack-infra12:51
*** esberglu has joined #openstack-infra12:53
*** zhurong has joined #openstack-infra12:56
*** signed8bit is now known as signed8bit_Zzz12:56
*** jpena is now known as jpena|lunch12:58
*** bh526r has joined #openstack-infra12:58
*** kjackal has quit IRC13:00
*** kjackal__ has joined #openstack-infra13:00
*** felipemonteiro_ has joined #openstack-infra13:07
openstackgerritDavid Shrewsbury proposed openstack-infra/infra-manual master: Add Zuul v3 quickstart section  https://review.openstack.org/49597113:08
*** jcoufal has joined #openstack-infra13:10
*** signed8bit_Zzz is now known as signed8bit13:10
*** signed8bit has quit IRC13:12
*** yamamoto has quit IRC13:12
*** signed8b_ has joined #openstack-infra13:12
*** LindaWang has joined #openstack-infra13:13
*** yamamoto has joined #openstack-infra13:14
*** funzo has joined #openstack-infra13:17
*** baoli has joined #openstack-infra13:18
*** kgiusti has joined #openstack-infra13:18
*** funzo has quit IRC13:21
*** yamamoto has quit IRC13:22
*** baoli has quit IRC13:22
*** LindaWang has quit IRC13:27
*** felipemonteiro__ has joined #openstack-infra13:29
*** LindaWang has joined #openstack-infra13:30
*** Julien-zte has quit IRC13:32
*** felipemonteiro_ has quit IRC13:32
*** pblaho has joined #openstack-infra13:34
*** bobh has joined #openstack-infra13:35
*** amoralej|lunch is now known as amoralej13:36
*** xyang1 has joined #openstack-infra13:37
*** eharney has joined #openstack-infra13:38
*** Julien-zte has joined #openstack-infra13:39
*** ramishra has quit IRC13:40
*** sree has joined #openstack-infra13:41
*** ramishra has joined #openstack-infra13:43
*** pblaho has quit IRC13:43
*** jbadiapa_ has quit IRC13:43
*** sree has quit IRC13:45
*** Goneri has joined #openstack-infra13:48
*** apetrich has quit IRC13:48
*** shardy has joined #openstack-infra13:49
openstackgerritBogdan Dobrelya proposed openstack-infra/tripleo-ci master: Rework the getthelogs helper script for wget recursive  https://review.openstack.org/49217813:50
*** slaweq has quit IRC13:51
*** alexchadin has quit IRC13:55
*** alexchadin has joined #openstack-infra13:56
*** yamahata has joined #openstack-infra13:57
*** quite has quit IRC13:58
*** dhajare_ has quit IRC13:58
*** hongbin has joined #openstack-infra13:59
*** jbadiapa_ has joined #openstack-infra13:59
*** felipemonteiro__ has quit IRC14:02
*** iyamahat has joined #openstack-infra14:07
*** srobert has joined #openstack-infra14:08
*** ramishra has quit IRC14:10
*** marst has joined #openstack-infra14:11
*** ramishra has joined #openstack-infra14:12
*** armax has joined #openstack-infra14:14
*** LindaWang has quit IRC14:18
*** rbrndt has joined #openstack-infra14:18
*** zhurong has quit IRC14:19
*** links has quit IRC14:20
*** gagehugo has joined #openstack-infra14:23
*** yamamoto has joined #openstack-infra14:23
openstackgerritRabi Mishra proposed openstack-infra/project-config master: Fix amqp1 non-voting job failures  https://review.openstack.org/49624414:26
openstackgerritGiulio Fidente proposed openstack-infra/project-config master: Trigger TripleO scenario001 on Mistral workflow changes  https://review.openstack.org/49624514:28
*** yamamoto has quit IRC14:28
openstackgerritGiulio Fidente proposed openstack-infra/project-config master: Trigger TripleO scenario001 and 004 on Mistral workflow changes  https://review.openstack.org/49624514:30
pabelangerAJaeger: hwoarang: We added --skip-dns options to glean, which would force images to now use unbound.14:33
openstackgerritMerged openstack-infra/project-config master: Disable py2 dsvm on nodepool feature/zuulv3 branch  https://review.openstack.org/49262914:33
hwoarangpabelanger: i see. however, opensuse images now all fail with dns issues :(14:33
*** alexchadin has quit IRC14:34
pabelangerhttp://logs.openstack.org/99/496199/1/check/gate-openstack-ansible-pip_install-ansible-func-opensuse-423-nv/96d9ad0/logs/host/unbound.log.txt.gz14:34
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Set base environment as python3  https://review.openstack.org/49625114:34
pabelangerthat doesn't look right14:34
hwoarangyep14:34
*** eharney has quit IRC14:34
pabelangernot sure why dlv.isc.org is getting appending14:36
pabelangerI guess that is DNSSec14:36
*** jianghuaw has quit IRC14:40
openstackgerritRabi Mishra proposed openstack-infra/project-config master: Fix amqp1 non-voting job failures  https://review.openstack.org/49624414:41
pabelangerhwoarang: myguess is unbound.conf on opensuse is not the same as xenial or centos14:41
*** LindaWang has joined #openstack-infra14:41
hwoarangpabelanger: i wonder if we should use the same unbound.conf for the deployed images14:42
pabelangerhwoarang: yes, we likely should14:43
*** udesale has quit IRC14:44
hwoarangi should be mostly identical based on what i see on nodepool/elements/nodepool-base/finalise.d/89-unbound but who knows14:46
*** signed8b_ has quit IRC14:46
AJaegerpabelanger: openSUSE has unbound 1.5.10 - is that recent enough?14:47
*** sshnaidm is now known as sshnaidm|afk14:48
*** isaacb has quit IRC14:48
*** eharney has joined #openstack-infra14:49
pabelangerAJaeger: not sure, as long as it is newer they trusty, I think we'll be fine14:50
AJaeger;)14:51
clarkb1.4.22 on trusty14:53
clarkbI wonder if opensuse isn't installing the certs necessary to verify things properly14:53
hwoarangcan we reserve a host to  have a look at it? because using unbound on vanilla leap 42.3 works fine :/14:54
clarkbya we should be able to grab a host. I have a meeting in 5 minutes and can help after14:54
*** xarses has joined #openstack-infra14:55
*** felipemonteiro_ has joined #openstack-infra14:56
*** felipemonteiro__ has joined #openstack-infra14:57
*** gouthamr has joined #openstack-infra14:59
clarkbhwoarang: I'm guessing it is some side effect of our "minimal" install which likely has fewer items installed (like certs) than vanilla14:59
hwoarangour image pulls ca-certificates-mozilla which should be enough14:59
hwoarangbut maybe it needs more (like ca-certificates-cacert)15:00
hwoarangwe shall see15:00
*** felipemonteiro_ has quit IRC15:01
*** ykarel has quit IRC15:01
*** ykarel has joined #openstack-infra15:01
clarkbhwoarang: do you have an ssh public key published somewhere?15:02
*** jpena|lunch is now known as jpena15:02
hwoarangclarkb: http://dev.gentoo.org/~hwoarang/id_rsa_gentoo.pub15:04
hwoarangbut i can only do ipv4...15:04
AJaegerhwoarang: jump to suse.de and go from there ;)15:04
hwoarangtrue ;p15:04
clarkbwe don't have ipv6 only instances anymore15:05
*** cody-somerville has joined #openstack-infra15:06
*** cody-somerville has joined #openstack-infra15:06
*** windmoon has joined #openstack-infra15:07
*** jamesmcarthur has joined #openstack-infra15:08
*** baoli has joined #openstack-infra15:09
*** signed8bit has joined #openstack-infra15:11
*** ramishra has quit IRC15:13
*** dtantsur|bbl is now known as dtantsur15:13
*** baoli has quit IRC15:13
*** LindaWang has quit IRC15:14
*** baoli has joined #openstack-infra15:14
*** windmoon has quit IRC15:14
clarkbhwoarang: root@23.253.73.10815:14
*** markus_z has quit IRC15:15
hwoarangclarkb: im in15:15
*** rcernin has quit IRC15:15
clarkbhwoarang: dig google.com works at least15:16
clarkbresolver is localhost15:16
clarkband /etc/unbound/forwarding.conf looks correct15:17
*** funzo has joined #openstack-infra15:18
hwoarangyeah15:18
hwoarangdnssec validation works too15:18
*** baoli has quit IRC15:18
pabelangerare we running dnssec on other OS?15:21
clarkbpabelanger: ya dnssec should be enforced everywhere by unbound15:21
clarkbI'm wondering if maybe dns upstream of us broke dnssec and now the problem is no longer present?15:21
clarkbor maybe the job that ran on that host fixes it via some side effect, it ran an os ansible job15:22
*** Apoorva has joined #openstack-infra15:22
pabelangerclarkb: are you sure? our unbound.conf file on xenial is empty15:22
pabelangeris dnssec default enabled?15:22
*** tmorin has quit IRC15:23
*** funzo has quit IRC15:23
pabelanger dlv-anchor-file: "/etc/unbound/dlv.isc.org.key"15:24
pabelangerthat is set on opensuse15:24
pabelangerother operating systems don't have that15:24
pabelangerdefault is ""15:25
*** yamamoto has joined #openstack-infra15:25
openstackgerritIhar Hrachyshka proposed openstack-infra/project-config master: Remove grenade linuxbridge multinode job from neutron dashboard  https://review.openstack.org/49628715:25
pabelangerso, I think that is what is happening15:25
pabelangerinteresting15:25
pabelangerDefault  is "",  or  no  dlv anchor file. DLV is going to be decommissioned. Please do not use it any more.15:26
clarkbpabelanger: ya it was one of the features we wanted in moving away from provider dns15:27
hwoaranghmm15:27
hwoarangso was that a temp glitch in the dlv website?15:28
pabelangerclarkb: okay, I haven't really look at dnssec much. So, not sure if we are using it across all nodes or not15:28
*** bogdando has quit IRC15:28
pabelangerhwoarang: good question, we need to hit dlv for dnssec?15:28
clarkbpabelanger: https://www.unbound.net/documentation/howto_anchor.html the dlv-anchor-file is a separate thing15:30
*** yamamoto has quit IRC15:30
clarkbpabelanger: https://tools.ietf.org/html/rfc507415:31
clarkbso basically dlv is for trusting things that aren't able to normally be trusted all the way to the root if I am reading that properly. Its like a superset of dnssec15:31
hwoarangpabelanger: doesn't look like we talk directly to it15:31
hwoarangbut maybe the recursive dns does :/15:31
hwoarangno idea15:31
*** jamesmcarthur has quit IRC15:32
pabelangerclarkb: right, so should we remove that in opensuse, dlv-anchor-file15:32
hwoarangsounds like i need to open a bug to opensuse about it15:33
pabelangerworth asking, since unbound docs say not to use it15:33
clarkbsection 4 of that rfc says it is a higher query load15:33
clarkbbut has advantages in the security policy that it can implement15:33
clarkbso yes I think it a possibility that the remote servers were just having a sad at the time15:34
hwoarangif xenial unbound.conf is empty and everything works, can we wipe opensuse's one too?15:34
hwoaranga wild guess but..15:34
*** dougwig has joined #openstack-infra15:34
pabelangerI checked centos, it does have some defaults setup15:34
*** jamesmcarthur has joined #openstack-infra15:34
*** jamesmcarthur has quit IRC15:35
hwoarangopensuse's config is massive ;/15:35
*** jamesmcarthur has joined #openstack-infra15:35
clarkbI think we need the include directives15:35
hwoarangyeah but the nodepool element takes care of it15:35
hwoaranginjects some stuff so our custom .conf files are included15:35
clarkba better option is probably to just have our dib element comment out the dlv rather than rewriting the entire file15:35
hwoarangthat too15:35
hwoaranganyway let me open a bug for now15:36
*** dhajare_ has joined #openstack-infra15:36
clarkbhwoarang: I think a patch to comment out that line in the dib element is probably a good start15:36
clarkbif you want to push that. I can likely push one up after breakfast if you prefer15:36
*** ykarel has quit IRC15:36
hwoarangi may not have time to do it today15:37
hwoarangif yuo don't do it, i will do it tomorrow15:37
*** apetrich has joined #openstack-infra15:38
pabelangerinfra-root: Could you please add https://review.openstack.org/494672/ to your review pipeline, I'd like to start testing our publish-openstack-python-branch-tarball zuulv3 job.15:38
hwoarangbug opened15:39
hwoarangand i disconnected from teh node15:39
hwoarangclarkb: thank you15:39
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: External Calendar Sync  https://review.openstack.org/48768315:39
*** csomerville has joined #openstack-infra15:39
*** dougs1 has joined #openstack-infra15:41
*** seanhandley has quit IRC15:41
*** dhajare_ has quit IRC15:42
*** e0ne has quit IRC15:43
*** cody-somerville has quit IRC15:43
dougs1Can anyone point me in the right direction to create a 'bareon-release' group? (https://review.openstack.org/#/admin/groups/?filter=bareon)15:43
dougs1As required to create a new branch, according to the config here: https://github.com/openstack-infra/project-config/blob/a8124f45e1719332c4318e47897cde4faab308ad/gerrit/acls/openstack/bareon.config15:44
*** sshnaidm|afk is now known as sshnaidm15:44
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Fix on GetSummitById endpoint  https://review.openstack.org/49629415:47
dougs1sorry - scrap that - looks like I need to email the members15:47
clarkbdougs1: the group exists and has three members https://review.openstack.org/#/admin/groups/1209,members15:47
*** kjackal__ has quit IRC15:49
openstackgerritChris Hoge proposed openstack-infra/irc-meetings master: Update the refstack meeting with new chair/ptl  https://review.openstack.org/49629615:53
openstackgerritMerged openstack-infra/openstackid-resources master: Fix on GetSummitById endpoint  https://review.openstack.org/49629415:53
openstackgerritChris Hoge proposed openstack-infra/irc-meetings master: Update the refstack meeting with new chair/ptl  https://review.openstack.org/49629615:55
*** thorst_afk has quit IRC15:55
*** jascott1 has quit IRC15:55
*** thorst_afk has joined #openstack-infra15:57
openstackgerritSean McGinnis proposed openstack-infra/irc-meetings master: Switch meeting chair for Cinder Queens PTL  https://review.openstack.org/49629815:57
*** egonzalez has quit IRC15:59
*** dougs1 has left #openstack-infra16:00
*** thorst_afk has quit IRC16:01
*** aviau has quit IRC16:04
*** aviau has joined #openstack-infra16:04
*** tesseract has quit IRC16:04
*** thorst_afk has joined #openstack-infra16:05
*** shardy has quit IRC16:06
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Add devstack_localrc ansible module  https://review.openstack.org/49630116:06
*** kjackal has joined #openstack-infra16:06
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Add devstack_localrc ansible module  https://review.openstack.org/49630116:08
*** tosky has quit IRC16:09
*** tosky has joined #openstack-infra16:10
*** florianf has quit IRC16:11
amotokihi, infra-core, could you take a look https://review.openstack.org/#/c/476456/ ? this is nosehtmloutput python3 support and infra-core are the only core reviewers for this.16:12
amotokiI am waiting for reviews two months, so let me ask for reviews16:13
openstackgerritsebastian marcet proposed openstack-infra/openstackid master: Fixed bug on grants pagination  https://review.openstack.org/49630516:14
*** iyamahat has quit IRC16:15
*** yamahata has quit IRC16:16
pabelangerclarkb: so tripleo is in talks of decommissioning tripleo-test-cloud-rh1, in favor of using rdocloud. By doing this, they've also agreed to moving to 3rd party CI by standing up there own zuul / nodepool.16:17
pabelangerclarkb: would we be interested in helping them manage the mirror infrastructure for RDOcloud, from our ansible wheel?16:17
*** florianf has joined #openstack-infra16:18
clarkbI don't think so. Part of the struggle with rh1 has been that mixed managemetn where we don't have full control of our own tenant16:19
pabelangerclarkb: right, that's why I believe too. Trying to help them keep our system-config in sync for the mirror logic.  I guess we should see about moving that into puppet-openstackci16:20
*** signed8bit is now known as signed8bit_Zzz16:22
*** vryzhenkin is now known as freerunner16:25
*** yamamoto has joined #openstack-infra16:26
*** seanhandley has joined #openstack-infra16:27
openstackgerritClark Boylan proposed openstack-infra/project-config master: Don't use dlv-anchor-file with unbound  https://review.openstack.org/49631016:31
clarkbpost breakfast dibing16:31
*** jpena is now known as jpena|away16:31
*** ociuhandu has quit IRC16:31
*** yamamoto has quit IRC16:32
clarkbdoesn't look like sed errors if it doesn't make any changes so that should be fine without a conditional16:32
clarkbI am going to delete the suse node I held now16:33
*** Apoorva has quit IRC16:33
*** Apoorva has joined #openstack-infra16:34
*** signed8bit_Zzz is now known as signed8bit16:34
*** iyamahat has joined #openstack-infra16:35
*** yamahata has joined #openstack-infra16:36
clarkbfungi: if you are around, have you done infra project update sessions at previous summits?16:36
*** pcaruana has quit IRC16:37
clarkbfungi: I'ev got email that says we need to confirm our physical presence if planning on doing those, but I don't recall there having been one for infra in boston. There was on boarding session but not project update iirc16:37
*** Apoorva has quit IRC16:38
clarkbamotoki: its been ignored beacuse we really don't want people to use nose anymore16:39
clarkbI think that project is probably a good candidate for expanding the core group to individuals interested in keeping nose going16:39
clarkbinfra-root ^ thoughts?16:39
amotokiclarkb: i understand it as general suggestion16:40
amotokiclarkb: on the other hand, horizon and their plugin still use nose and migrating to testtools is not a simple change as far as I checked16:40
* mordred reads16:40
pabelangerclarkb: Ya, we talked about that at weekly meeting a while back. I offered to help if needed16:41
mordredclarkb: yes, I agree - we generally don't care about nose, but there are two projects still using it16:41
*** sree has joined #openstack-infra16:42
mordredI'd be fine personally expanding the core team - but I'd also really love to get those two remaining projects able to emit subunit even if they don't do it via testr16:42
jeblairclarkb: i'm fine with expanding, though i would note that the CTI sasy we use testr, so those projects are non-compliant with a tc standard.  https://governance.openstack.org/tc/reference/cti/python_cti.html16:43
mordred(like, it would be much better to get a good nose-subunit plugin for the folks stuck on nose for some reason than to put further work into nosehtmloutput16:43
mordredalso what jeblair said16:43
clarkbya I'm trying to remember what the horizon issue was and I think it had to do with django unittesting constructs?16:43
mordredyah16:43
mordredit's worth checking to see if that can be run in testr without converting the unittests themselves to testtools16:44
clarkbya its possible that subunit.run would just work16:44
mordredit's possible that we're far enough along that it owuld 'just work'16:44
clarkbespecially now that testtools is a lightweight shim over unittest216:45
pabelangerwould be a good project for zuulv3 tox + nose testing16:45
mordredand if there's an issue, solving that specific issue is likely less work than a nose testrunner subunit plugin or further improvements to nosehtmloutput16:45
mordredALL THAT SAID - I'm also fine expanding the nosehtmloutput core team if there are humans who value that program16:45
clarkbamotoki: ^ given that discussion is there any interest in attempting horizon unittests + subunit? and/or would you be interested in maintaining nosehtmloutput?16:46
amotokipersonally I would like to migrate to horizon unit tests to more standard way for a long term16:47
amotokifor a short term I am okay to maintain nosehtmloutput for a while16:47
mordredoh - right - it's that the django tests work via ./manage.py test16:49
*** kjackal has quit IRC16:49
openstackgerritMerged openstack-infra/project-config master: Add publish-openstack-python-branch-tarball job  https://review.openstack.org/49467216:49
clarkbI'm going to go ahead and approve the change for now, ist simple and straightforward. I think we will also need a release pushed before it addresses horizon's current problems16:50
openstackgerritMerged openstack-infra/nose-html-output master: Python 3 support  https://review.openstack.org/47645616:50
amotokiI haven't understood the discussion fully but django integration for testr is needed. it is worth explored16:50
clarkband if no one is opposed I will add amotoki to nose html output core16:51
mordred++16:51
jeblair++16:51
openstackgerritDarragh Bailey proposed openstack-infra/irc-meetings master: JJB meetings are being held in dedicated channel  https://review.openstack.org/49631416:51
*** florianf has quit IRC16:51
*** florianf has joined #openstack-infra16:53
mordredamotoki: so - as a stepping stone - we curently install https://pypi.python.org/pypi/openstack.nose_plugin which is pretty much unmaintained anyway - but it is a nose plugin we install while doing django nose unittests (it's for colored output) - there is also a VERY old nose-subunit plugin which looks to be incomplete and doesn't use subunitv2 (which is what we use) - but  might be worth looking at16:53
mordredfor hints https://github.com/liucougar/nose-subunit16:53
mordredamotoki: I think the 'easiest' next step would likely to be to write a good nose-subunit plugin that uses latest python-subunit so that it does subunit2 properly16:54
clarkbok I've done those things except for make a release. I will do that as soon as things merge. amotoki you have new core powers, you may have to hard refresh gerrit to see new voting options.16:54
amotokimordred: thanks for the pointers. while I need to explore some tools around testing, i will explore it16:56
amotokiclarkb: thanks. perhaps waiting for a while (one hour?) will solves gerrit voting options.16:57
AJaegerjeblair, aspiers brought just up that https://docs.openstack.org/infra/zuul/ is still the old content. Can we merge a simple change to publish the content again?16:58
aspiersAJaeger: it's not the old content, it's zero content :)16:58
*** efoley has quit IRC16:58
*** felipemonteiro__ has quit IRC16:58
AJaegeraspiers: "old" = the broken content from zuul-jobs16:58
pabelangerAJaeger: thanks for +317:00
AJaegerwelcome, pabelanger17:02
*** derekh has quit IRC17:03
*** Hal has joined #openstack-infra17:03
*** Hal is now known as Guest1505417:03
openstackgerritMerged openstack-infra/project-config master: Remove grenade linuxbridge multinode job from neutron dashboard  https://review.openstack.org/49628717:06
*** apetrich has quit IRC17:11
*** electrofelix has quit IRC17:12
*** Guest15054 has quit IRC17:13
*** thorst_afk has quit IRC17:13
*** apetrich has joined #openstack-infra17:14
*** sshnaidm is now known as sshnaidm|off17:15
AJaegergcb: please review https://review.openstack.org/49632517:18
*** funzo has joined #openstack-infra17:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config master: OSA: Add non-voting galera_server upgrade scenario test  https://review.openstack.org/49632617:20
*** jpena|away is now known as jpena17:22
*** eranrom_ has joined #openstack-infra17:22
*** sambetts is now known as sambetts|afk17:22
*** Swami has joined #openstack-infra17:23
*** funzo has quit IRC17:23
*** Swami has quit IRC17:23
*** Swami has joined #openstack-infra17:24
*** eranrom has quit IRC17:25
*** wolverineav has quit IRC17:26
*** wolverineav has joined #openstack-infra17:26
*** jpich has quit IRC17:28
openstackgerritAndreas Jaeger proposed openstack-infra/zuul master: Add link to Infra Manual  https://review.openstack.org/49632917:28
*** yamamoto has joined #openstack-infra17:28
AJaegerinfra-root, what do you think of merging ^ to publish the zuul docs again to docs.o.o/infra/zuul so that the content is accurate again?17:28
jeblairAJaeger: +317:28
AJaegerthanks, jeblair17:29
*** greghaynes has quit IRC17:29
AJaegeraspiers: ^17:31
aspiers\o/17:31
aspiersI'm out of date, what does +3 mean?17:32
aspiers+2+1?17:32
AJaegerproject-config cores, could you review https://review.openstack.org/496142 and https://review.openstack.org/49574217:32
aspierscode review and workflow?17:32
AJaegeraspiers: reviewed and approved - so, once that change is merged and the post jobs run, the content is available again17:32
aspiersthat sounds like a yes17:32
AJaegeraspiers: yeah - we've been typing at the same time ;)17:33
aspiers:)17:33
*** tosky has quit IRC17:33
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add a simple devstack job  https://review.openstack.org/49633017:34
*** yamamoto has quit IRC17:35
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Rename upload-twine to upload-pypi  https://review.openstack.org/49633117:35
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add non-OpenStack python tarball creation job  https://review.openstack.org/49633217:35
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add non-OpenStack PyPI upload job  https://review.openstack.org/49633317:35
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Consume upload-pypi role  https://review.openstack.org/49633417:35
*** Hal has joined #openstack-infra17:36
*** Hal is now known as Guest2662917:36
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add a simple devstack job  https://review.openstack.org/49633017:36
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: External Calendar Sync  https://review.openstack.org/48768317:38
*** trown is now known as trown|lunch17:42
*** greghaynes has joined #openstack-infra17:43
*** Guest26629 has quit IRC17:44
*** coolsvap has quit IRC17:45
clarkbamotoki: fyi https://pypi.python.org/pypi/nose-htmloutput is a thing that claims python3 support17:45
clarkbamotoki: I am pushing a tag for nose-html-output now17:45
*** jamesmcarthur has quit IRC17:45
*** sree has quit IRC17:46
*** jamesmcarthur has joined #openstack-infra17:46
clarkbamotoki: infra-root and that is done. Tag is pushed release publishing should happen soon17:49
*** thorst_afk has joined #openstack-infra17:49
*** jamesmcarthur has quit IRC17:50
clarkbpabelanger: when you get a chance can you review https://review.openstack.org/#/c/496310/ to address the dlv issue on suse?17:51
amotokiclarkb: thanks for all. I am leaving the channels for bed.17:51
*** florianf has quit IRC17:51
*** florianf has joined #openstack-infra17:52
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul-jobs master: Install build private key too  https://review.openstack.org/49430217:53
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul-jobs master: Add known_hosts generation for multiple nodes  https://review.openstack.org/49470017:53
AJaegerjeblair: did we remove all jobs for zuul master? I do not see https://review.openstack.org/#/c/496329/ tested - neither on status.o.o/zuul nor on zuulv3.openstack.org ;(17:53
openstackgerritMerged openstack-infra/openstackid master: Fixed bug on grants pagination  https://review.openstack.org/49630517:55
*** tosky has joined #openstack-infra17:56
openstackgerritMarkos Chandras (hwoarang) proposed openstack-infra/project-config master: nodepool: elements: Drop deprecated dlv-anchor-file option from unbound  https://review.openstack.org/49634117:57
hwoarangclarkb: pabelanger fyi^^17:57
AJaegerclarkb, pabelanger, could you review https://review.openstack.org/496142 , please? That's a translation update17:57
clarkbhwoarang: oh I pushed https://review.openstack.org/#/c/496310/17:58
hwoarangaahhh missed that17:58
*** jpena is now known as jpena|off17:59
*** Guest90692 is now known as zeus`18:01
*** vhosakot has joined #openstack-infra18:01
*** zeus` is now known as zeus18:02
*** zeus has quit IRC18:02
*** zeus has joined #openstack-infra18:02
*** dtantsur is now known as dtantsur|afk18:05
*** signed8b_ has joined #openstack-infra18:06
*** eharney has quit IRC18:07
*** jamesmcarthur has joined #openstack-infra18:08
*** signed8bit has quit IRC18:09
jeblairAJaeger: yes.  we may just want to trigger a docs job manually.18:18
*** pvaneck has joined #openstack-infra18:18
*** thorst_a_ has joined #openstack-infra18:18
*** thorst_afk has quit IRC18:20
*** Apoorva has joined #openstack-infra18:21
*** eharney has joined #openstack-infra18:23
clarkbjlvillal: would be good to get tonyb to weigh in on my comment on https://review.openstack.org/#/c/492231/2. devstack-gate already mostly handles that for us today except it includes pike18:25
*** amoralej is now known as amoralej|off18:27
jlvillalclarkb, Makes sense. I was trying to be safe and suggested that to make sure we didn't break stable/*18:28
clarkbya in theory things still work without tls (because we still test quite a few things that way) so it should be relatively safe, but tonyb would know best18:29
*** signed8bit has joined #openstack-infra18:29
*** bobh has quit IRC18:31
*** yamamoto has joined #openstack-infra18:31
AJaegerjeblair: I can abandon my change if you trigger one manually - or you force merge it, the post job is still there and should run...18:31
*** Adri2000 has quit IRC18:31
* AJaeger waves good bye18:31
*** signed8b_ has quit IRC18:32
*** Adri2000 has joined #openstack-infra18:33
*** Adri2000 has quit IRC18:33
*** Adri2000 has joined #openstack-infra18:33
*** yamamoto has quit IRC18:37
openstackgerritDavid Moreau Simard proposed openstack-infra/devstack-gate master: Unpin Paramiko  https://review.openstack.org/49635518:38
openstackgerritDavid Moreau Simard proposed openstack-infra/devstack-gate master: Update Ansible from 2.2.0.0 to 2.3.2.0  https://review.openstack.org/49635618:38
*** lin_yang has joined #openstack-infra18:41
*** slaweq has joined #openstack-infra18:42
*** slaweq has quit IRC18:45
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add non-OpenStack PyPI upload job  https://review.openstack.org/49633318:49
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add non-OpenStack python tarball creation job  https://review.openstack.org/49633218:49
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Rename upload-twine to upload-pypi  https://review.openstack.org/49633118:49
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Rename tox/tarball-post to python/tarball-post  https://review.openstack.org/49636418:49
*** florianf has quit IRC18:49
*** amotoki has quit IRC18:53
*** florianf has joined #openstack-infra19:00
clarkbinfra meeting time19:00
*** signed8bit is now known as signed8bit_Zzz19:03
*** signed8bit_Zzz is now known as signed8bit19:03
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Rename tox/tarball-post to python/tarball-post  https://review.openstack.org/49636419:07
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add non-OpenStack PyPI upload job  https://review.openstack.org/49633319:07
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add non-OpenStack python tarball creation job  https://review.openstack.org/49633219:07
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Rename upload-twine to upload-pypi  https://review.openstack.org/49633119:07
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Consume upload-pypi role  https://review.openstack.org/49633419:08
*** florianf has quit IRC19:13
*** funzo has joined #openstack-infra19:16
*** slaweq has joined #openstack-infra19:16
*** gixxer1k has joined #openstack-infra19:18
*** gixxer1k has quit IRC19:18
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Split ensuring tox is installed into a role  https://review.openstack.org/49637519:19
*** trown|lunch is now known as trown|brb19:20
*** trown|brb is now known as trown19:20
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Use the ensure-tox role in a pre-run playbook  https://review.openstack.org/49637719:21
*** funzo has quit IRC19:22
Shrewsafter the meeting, if someone could help me figure out why the changes in https://review.openstack.org/#/c/492629/6/zuul/layout.yaml are not filtering on the branch as expected? I'm seeing the new gate-dsvm-nodepool-py35 job run on master (it isn't supposed to), and still seeing gate-dsvm-nodepool running on feature/zuulv319:23
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Add publish-openstack-python-branch-tarball for zuul  https://review.openstack.org/49637919:26
pabelangerjeblair: mordred: do we want publish-openstack-python-branch-tarball for zuul in project-config or openstack-infra/zuul ?19:27
mordredpabelanger: openstack-infra/zuul19:28
pabelangermordred: ack19:28
openstackgerritPaul Belanger proposed openstack-infra/zuul feature/zuulv3: Add publish-openstack-python-branch-tarball post job  https://review.openstack.org/49638019:30
*** yamamoto has joined #openstack-infra19:33
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Rename tox/tarball-post to python/tarball-post  https://review.openstack.org/49636419:35
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add non-OpenStack PyPI upload job  https://review.openstack.org/49633319:35
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add non-OpenStack python tarball creation job  https://review.openstack.org/49633219:35
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Rename upload-twine to upload-pypi  https://review.openstack.org/49633119:35
openstackgerritDavid Moreau Simard proposed openstack-infra/devstack-gate master: Centralize the Ansible configuration parameters in ansible.cfg  https://review.openstack.org/49638419:35
openstackgerritDavid Moreau Simard proposed openstack-infra/devstack-gate master: Move the ansible.cfg file outside $WORKSPACE  https://review.openstack.org/49638519:35
*** sbezverk has quit IRC19:35
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add non-OpenStack PyPI upload job  https://review.openstack.org/49633319:37
*** sbezverk has joined #openstack-infra19:37
*** yamamoto has quit IRC19:38
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Update site_logs to use logs.o.o DNS  https://review.openstack.org/49638919:46
openstackgerritMerged openstack-infra/openstackid-resources master: External Calendar Sync  https://review.openstack.org/48768319:46
*** sree has joined #openstack-infra19:46
*** bh526r has quit IRC19:47
AJaegerShrews: see http://logs.openstack.org/29/492629/6/gate/gate-project-config-layout/dbe41f3/console.html#_2017-08-22_14_32_54_25633419:48
AJaegerShrews: don't know what overrides it, you have to check - just confirming it does19:49
ShrewsAJaeger: yeah, that looks like it's not hitting the branch filter at all19:50
*** sree has quit IRC19:50
clarkbalso looks like you've got two entries that match gate-dsvm-nodepool-py35? can probably collapse those into one19:52
*** armax has quit IRC19:52
Shrewsclarkb: yes, is that not allowed? I see two entries for the gearman-zk-shim branch too, but that log output seems to indicate that isn't (and has never) worked either19:53
clarkbShrews: well last match wins, they don't have overlapping attributes so its fine as is but potentially confusing if they were to grow overlapping attributes19:54
*** jkilpatr has quit IRC19:55
openstackgerritMonty Taylor proposed openstack-infra/openstack-zuul-jobs master: Add build-openstack-python-tarball job  https://review.openstack.org/49639019:55
*** e0ne has joined #openstack-infra19:55
*** slaweq has quit IRC19:56
clarkbis it possible that zuul launchers just hadn't updated their config yet when you saw the jobs run unexpectedly? though it adds the job to check too so if the job is running at all the branch attribute should be in place too19:56
Shrewsclarkb: how often do they update?19:58
clarkbShrews: puppet has been updating every half hour or so. Should haev updated within an hour after merging19:59
Shrewsyeah, i rechecked one well after that time20:00
clarkbis the gearman-zk-shim branch still a thing?20:00
ianwcmurphy: gem 'puppet-lint-empty_string-check' <- is that supposed to be removed as part of your change?20:00
clarkbor can we clean that out? I think may be best just to simplify this config as much as possible to make it easier to read and debug20:00
openstackgerritMerged openstack-infra/project-config master: Use artifact publication roles from zuul-jobs  https://review.openstack.org/49423120:00
ianwcmurphy: and what does "gem_checkout_method[:require] = false" do?20:01
Shrewsclarkb: i think we gave up on that20:01
Shrewsmordred: right? no more gearman-zk-shim?20:02
*** portdirect is now known as tintin20:03
*** tintin is now known as portdirect20:04
openstackgerritColleen Murphy proposed openstack-infra/puppet-pip master: (WIP) Try removing pip.conf entirely  https://review.openstack.org/49602720:04
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Move local.conf writing to a role  https://review.openstack.org/49639320:04
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Publish artifacts to tarballs.o.o for zuulv3  https://review.openstack.org/49639420:05
pabelangerinfra-root: ^ switches out zuulv3-dev.o.o secret with tarballs.o.o secret.20:05
clarkbShrews: AJaeger the first of the two rules is not a regex so it must match the name exactly, the second is a regex. I'm wondering if the behavior there is not quite last match wins (I know it is for regexes)20:06
clarkbShrews: AJaeger ya I think that may be it because the py35-src-nv job didn't run against master only the exact matching job name did20:07
clarkbthat said, out of curiousity why not run that job against master?20:08
*** jascott1 has joined #openstack-infra20:08
Shrewsclarkb: the py35-src-nv job? it's supposed to20:08
clarkblooks like it works and we will merge the feature branch into master at some point and that gets you the job set up20:08
cmurphyianw: hmm well it wasn't entirely intentional, it's the one linter gem we don't have standardized on every module but i'd rather get rid of it - but i should probably do that in a separate change20:08
clarkbShrews: https://review.openstack.org/#/c/490781/ looking at that nodepool master ran gate-dsvm-nodepool-py35 but not gate-dsvm-nodepool-py35-src-nv20:09
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Rename tox/tarball-post to python/tarball-post  https://review.openstack.org/49636420:10
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add non-OpenStack PyPI upload job  https://review.openstack.org/49633320:10
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add non-OpenStack python tarball creation job  https://review.openstack.org/49633220:10
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add upload-pypi role  https://review.openstack.org/49597220:10
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Remove tox-tarball job  https://review.openstack.org/49639520:10
Shrewsclarkb: yep. i used that to check on things on the master branch. the py35-src-nv is supposed to run, but not the new py35 one20:10
*** ldnunes has quit IRC20:10
openstackgerritMerged openstack-infra/shade master: Add option to force delete cinder volume  https://review.openstack.org/49470520:10
Shrewsclarkb: and on feature/zuulv3, both are supposed to run20:10
cmurphyianw: re gem_checkout_method the original Gemfile had an implied associative array {:git => ..., :require => false }, the change makes the associatie array named and gem_checkout_method[:require] = false is setting one key20:10
Shrewsclarkb: i may just revert my change since this messed up both master and feature/zuulv3 jobs20:11
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Consume upload-pypi role  https://review.openstack.org/49597320:12
ianwcmurphy: i mean more what does the require false bit actually do?20:12
clarkbShrews: I'm working on a simplification patch if you want to wait a minute20:12
Shrewsack20:12
cmurphyianw: oh, it means import the lib dynamically when it's required from a module instead of loading it when bundler is run20:13
cmurphyi don't think that's particularly important either, i could remove it to make it simpler20:13
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Move local.conf writing to a role  https://review.openstack.org/49639320:14
*** Goneri has quit IRC20:14
*** dprince has quit IRC20:14
*** jkilpatr has joined #openstack-infra20:15
*** makowals_ has quit IRC20:16
*** e0ne has quit IRC20:18
pabelangerclarkb: do you mind +3 on https://review.openstack.org/496394/ start publishing to tarballs.o.o20:18
ianwcmurphy: ok, well up to you?  might be easier to just approve if everything looks the same20:18
*** jokke_ has quit IRC20:18
openstackgerritColleen Murphy proposed openstack-infra/puppet-elasticsearch master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49558820:19
cmurphyianw: i'll fix them if that ^ looks good to you20:19
Shrewsclarkb: yeah, looking at an older layout job log, doesn't look like it was ever working correctly for the gearman-zk-shim branch (which is what i based my work on).20:20
openstackgerritClark Boylan proposed openstack-infra/project-config master: Drastically simplify nodepool dsvm zuul layout  https://review.openstack.org/49639920:20
clarkbShrews: AJaeger I think ^ should be what we want20:20
clarkbbasically run python2 and python3 on master, run only python3 on feature/zuulv3. Use -nv job names so that we can stop having explicit non voting rules20:22
cmurphyianw: also looks like pycrypto does build successfully if pip.conf is removed entirely http://logs.openstack.org/27/496027/4/check/gate-puppet-pip-puppet-beaker-rspec-ubuntu-xenial/5d8d1bb/console.html#_2017-08-22_20_17_01_358258 so something is weird there20:23
*** ldnunes has joined #openstack-infra20:23
Shrewsclarkb: that looks more sane. it adds the new dsvm-nodepool-py35 job to master, but that should be ok20:24
Shrewsit should work there, too20:24
clarkbShrews: ya it may not work immediately if the src job has things that are unreleased to make it work but its non voting and it should be made to work quickly (just needs releases if -src works)20:24
clarkbpabelanger: what is the name: fileserver used for?20:24
ianwcmurphy: ok, 495588 LGTM.  maybe get clarkb to confirm and we can have consensus that's a good global change20:25
clarkbpabelanger: is that what the secrets dict is exposed as to the playbook?20:25
*** kgiusti has left #openstack-infra20:25
pabelangerclarkb: yes, secret dict20:26
clarkbpabelanger: ok I've +2'd but not approved since swamped by all the review requiests right now. Feel free to approve if you can watch it20:26
pabelangerclarkb: great, thanks!20:26
ianwcmurphy: do you have a link to the failure?  but certainly we wouldn't want to set that on infra nodes.  it might be a red herring ... now you're getting a prebuilt wheel, as before, when it had pointers to trusty wheels, it was trying to build and failing ... so missing dependency?20:27
cmurphyianw: i noticed it on https://review.openstack.org/#/c/495629/20:27
ianwcmurphy: Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-ADYF1s/paho-mqtt/ ?20:29
clarkbcmurphy: ianw so basically we vendor in the spec helper in the old stuff? so the gem require => false there essentially means we don't install the actual gem helper?20:29
*** gouthamr has quit IRC20:29
ianwhard to tell without more logs, but very likely a missing build dep package20:29
*** claudiub has quit IRC20:30
openstackgerritDavid Moreau Simard proposed openstack-infra/devstack-gate master: Make bootstrap copying a playbook  https://review.openstack.org/49592820:30
openstackgerritDavid Moreau Simard proposed openstack-infra/devstack-gate master: Move logdir relocation to a playbook  https://review.openstack.org/49592920:30
pabelangerare we missing build dependencies? bindep.txt isn't in puppet-pip20:30
cmurphyianw: yeah, you can't tell from those logs but it's failing with an autoconf failure, "configure: error: C compiler cannot create executables" though gcc etc should all be there20:31
cmurphyclarkb: it doesn't mean don't install it it just means don't load it at install time, load it when 'require spec_helper_acceptance' is called20:31
*** jascott1 has quit IRC20:31
clarkbcmurphy: gotcha, and have we already moved that file into the spec_helper repo?20:32
clarkbI'm assuming we must've because tests passed20:32
*** jascott1 has joined #openstack-infra20:32
*** Douhet has quit IRC20:32
*** jascott1 has quit IRC20:32
*** Douhet has joined #openstack-infra20:32
cmurphyclarkb: yep we did that part already https://review.openstack.org/#/c/477228/20:32
*** jascott1 has joined #openstack-infra20:33
clarkbcmurphy: ianw makes sense to me I have +2'd that change. I need lunch but can swing around to help review the rest20:33
*** gixxer1k has joined #openstack-infra20:33
*** gixxer1k has quit IRC20:33
*** jascott1 has quit IRC20:33
cmurphyokay i will fix the rest20:34
*** psachin has quit IRC20:34
ianwok, well if we're at the point they're all the same i think it's mostly a formality, that was where i was hoping to get to :)20:34
*** jascott1 has joined #openstack-infra20:34
clarkbya I don't think we need to fret too much over the reviews if we are generally ok with the setup (and I am, I assume ianw is too)20:34
openstackgerritColleen Murphy proposed openstack-infra/puppet-zuul master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49565620:35
openstackgerritDavid Moreau Simard proposed openstack-infra/devstack-gate master: Centralize the Ansible configuration parameters in ansible.cfg  https://review.openstack.org/49638420:35
*** yamamoto has joined #openstack-infra20:35
openstackgerritMerged openstack-infra/project-config master: Publish artifacts to tarballs.o.o for zuulv3  https://review.openstack.org/49639420:35
ianwcmurphy: hmm, i think there's probably still something funky going on with dependencies; bindep has run and i can't see that gcc wouldn't be there.  but maybe leave well enough alone and debug when it becomes an issue20:35
*** MasterOfBugs has joined #openstack-infra20:36
openstackgerritAde Lee proposed openstack-infra/project-config master: Add novajoin repo for tempest tests  https://review.openstack.org/49640720:36
*** jascott1 has quit IRC20:36
openstackgerritMerged openstack-infra/zuul-jobs master: Add upload-pypi role  https://review.openstack.org/49597220:37
openstackgerritMerged openstack-infra/zuul-jobs master: Rename tox/tarball-post to python/tarball-post  https://review.openstack.org/49636420:37
openstackgerritMerged openstack-infra/zuul-jobs master: Add non-OpenStack python tarball creation job  https://review.openstack.org/49633220:37
openstackgerritMerged openstack-infra/zuul-jobs master: Add non-OpenStack PyPI upload job  https://review.openstack.org/49633320:38
openstackgerritMerged openstack-infra/zuul-jobs master: Remove tox-tarball job  https://review.openstack.org/49639520:38
openstackgerritDavid Moreau Simard proposed openstack-infra/devstack-gate master: Move DEVSTACK_GATE_SETTINGS into process-env  https://review.openstack.org/49593020:38
*** yamamoto has quit IRC20:38
*** yamamoto has joined #openstack-infra20:38
*** yamamoto has quit IRC20:39
openstackgerritColleen Murphy proposed openstack-infra/puppet-zuul master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49565620:40
openstackgerritColleen Murphy proposed openstack-infra/puppet-elasticsearch master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49558820:41
*** jamesmcarthur has quit IRC20:41
cmurphyreverted new changes so they're all staying the same ^20:41
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Consume upload-pypi role  https://review.openstack.org/49597320:42
Shrewsclarkb: left you a comment (2 remaining gearman-zk-shim references)20:42
*** slaweq has joined #openstack-infra20:43
*** mikal has quit IRC20:44
*** jamesmcarthur has joined #openstack-infra20:45
*** mikal has joined #openstack-infra20:45
openstackgerritMerged openstack-infra/zuul-jobs master: Split ensuring tox is installed into a role  https://review.openstack.org/49637520:47
*** Apoorva_ has joined #openstack-infra20:49
*** jamesmcarthur has quit IRC20:49
*** danieli has quit IRC20:49
*** rcernin has joined #openstack-infra20:50
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: move local.conf writing to a role  https://review.openstack.org/49639320:50
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add a simple devstack job  https://review.openstack.org/49633020:50
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add role to set up base dir  https://review.openstack.org/49641220:50
openstackgerritMonty Taylor proposed openstack-infra/openstack-zuul-jobs master: Add build-openstack-python-tarball job  https://review.openstack.org/49639020:50
openstackgerritJesse Keating proposed openstack-infra/zuul-jobs master: Role to copy the build ssh key to other users  https://review.openstack.org/49641320:51
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add role to set up base dir  https://review.openstack.org/49641220:51
*** Apoorva has quit IRC20:52
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Add publish-openstack-python-branch-tarball post job  https://review.openstack.org/49638020:52
*** gouthamr has joined #openstack-infra20:53
*** jamesmcarthur has joined #openstack-infra20:53
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add build-openstack-python-tarball to check and gate  https://review.openstack.org/49641620:53
*** jamesmcarthur has quit IRC20:54
*** jamesmcarthur has joined #openstack-infra20:54
*** flwang has quit IRC20:54
*** srobert has quit IRC20:55
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul-jobs master: Add known_hosts generation for multiple nodes  https://review.openstack.org/49470020:56
*** slaweq has quit IRC20:56
*** flwang has joined #openstack-infra20:57
*** slaweq has joined #openstack-infra20:58
*** dave-mccowan has quit IRC20:58
*** trown is now known as trown|outtypewww21:01
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add role to set up base dir  https://review.openstack.org/49641221:01
*** priteau has quit IRC21:01
*** eharney has quit IRC21:01
openstackgerritClark Boylan proposed openstack-infra/project-config master: Drastically simplify nodepool dsvm zuul layout  https://review.openstack.org/49639921:02
*** funzo has joined #openstack-infra21:02
clarkbShrews: ^ thanks21:02
*** dave-mccowan has joined #openstack-infra21:02
*** armax has joined #openstack-infra21:04
*** jcoufal has quit IRC21:04
clarkbianw: I see http://paste.openstack.org/show/619097/ around when dfw had the pip hash mismatch21:06
*** slaweq has quit IRC21:06
*** funzo has quit IRC21:07
clarkbianw: pabelanger and looking at syslog puppet ran around then and update the vhost config21:07
*** spligak has joined #openstack-infra21:07
clarkbI'm thinking this is just puppet not being very graceful to update apache21:08
*** tjones has joined #openstack-infra21:08
pabelangerclarkb: ya, apache2 changes are disruptive since service needs to be restarted21:08
clarkbya we can hack in reloads instead of restarts if we need to. Probably best to just keep that in mind for now (and hopefully we've made enough changes to stabilize things that we don't have to keep making changes)21:08
*** slaweq has joined #openstack-infra21:09
*** tjones has quit IRC21:09
*** yamamoto has joined #openstack-infra21:10
pabelangerya21:10
*** jascott1 has joined #openstack-infra21:10
*** ldnunes has quit IRC21:13
openstackgerritDavid Moreau Simard proposed openstack-infra/devstack-gate master: WIP Ansible network overlay  https://review.openstack.org/43593321:13
*** slaweq has quit IRC21:13
*** Goneri has joined #openstack-infra21:13
*** jmccrory has quit IRC21:13
*** kjackal has joined #openstack-infra21:14
*** jmccrory has joined #openstack-infra21:14
*** yamamoto has quit IRC21:15
*** mat128 has quit IRC21:15
*** makowals has joined #openstack-infra21:15
openstackgerritDavid Moreau Simard proposed openstack-infra/devstack-gate master: Move network overlay configuration to Ansible playbooks  https://review.openstack.org/43593321:16
*** mat128 has joined #openstack-infra21:16
dmsimardclarkb, jeblair: ^ rebased and comments addressed, let's see what it looks like.21:16
*** mat128 has quit IRC21:17
*** Goneri has quit IRC21:19
clarkbianw: cmurphy not sure I quite undersatnd the revert. on 495588. Was that just an optimization we don't need especially since we have a ton of changes ready to go on the older code?21:20
clarkbianw: cmurphy in any case are we ready to go through and start approving them all. eg you are happy with them?21:21
dhellmanndo we have any examples of jobs that need to install software not available in a system package and not written in python?21:21
*** thorst_a_ has quit IRC21:21
dhellmannI'm thinking of writing a test tool in golang just as a learning exercise, but it won't be that useful if I can't get it into a CI job.21:22
clarkbdhellmann: the gerrit jobs build gerrit using buck. Old jenkins things used maven. etcd is installed via tarballs.openstack.org21:23
dhellmannclarkb : so if I had a golang thing and made the binaries available for mirroring, that would be doable?21:23
clarkbetcd3 is probably the closest thing to your use case. I don't know that we have a great story there yet. Rough plan was to have a job update etcd3 on tarballs.o.o so that it isn't manually done21:24
*** thorst_afk has joined #openstack-infra21:24
dhellmannew, yeah, I wouldn't want anyone to have to grab new copies by hand21:24
clarkbdhellmann: ya probably you'd want a job that built it in infra and published it to tarballs. Doesn't necessarily have to be hosted by us as a project though (etcd3 isn't)21:24
dhellmanninitially I'd expect lots of updates until it hit feature completeness21:24
dhellmannok, that would work21:24
dhellmannmaybe a periodic job until zuul3 is up and running and can watch a github repo21:25
jeblairdhellmann: yeah, we've generally considered that a feature (development tools should be available in the operating systems we support).  you might also consider a ppa or similar.21:25
dhellmannthat's a fair point21:26
cmurphyclarkb: the revert puts back the require => false which is an optimization that is not changing with this change, and it also puts back the removal of the puppet-lint-empty_string-check which i unintentionally removed but (in my opinion) is not that important, and this way all the gemfiles are completely the same21:26
dhellmannwell, maybe I'll build it twice, since the only reason for using golang in the first place was because the project itself is simple enough that I thought it would be a good first app21:26
clarkbcmurphy: and you are ready for mass review/approvals at this point?21:27
cmurphyclarkb: yes i'm happy with it21:27
*** thorst_afk has quit IRC21:28
cmurphythough there are two modules that are currently broken for unrelated reasons but we can deal with that later21:28
clarkbya I see them scanning the list of topic query results21:29
*** Goneri has joined #openstack-infra21:29
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add role to set up base dir  https://review.openstack.org/49641221:31
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add roles related to log dirs  https://review.openstack.org/49642221:31
clarkbianw: ^ are you good with the changes at this point? you are my second +2 I think (even if not directly applying the vote)21:31
openstackgerritMerged openstack-infra/project-config master: Consume upload-pypi role  https://review.openstack.org/49597321:32
clarkbdhellmann: I think you are stumbling into (what I think is) the big pain point of languages like Go. Basiaclly how do you get your software out the door and keep it up to date. "containers" seems to be the answer for many but now you have two problems. How do I keep my golang binaries up to date and how do I keep my containers up to date :)21:33
ianwclarkb: yeah, i'm fine with it21:34
ianwclarkb: ok, a restart explains it too, that's good21:36
*** makowals has quit IRC21:38
clarkbpabelanger: ianw ya overall I think we are in good shape once we fix unbound on suse21:38
pabelanger++21:39
pabelangerpretty happy with the results21:39
clarkbianw: do you want to review cmurphy's changes too or should I just go through and approve as I go?21:39
clarkbianw: or would you prefer to approve them having done a bunch of the review work from what I can see?21:39
fungiclarkb: http://eavesdrop.openstack.org/meetings/infra/2017/infra.2017-07-18-19.03.log.html#l-65 is where i brought up the possibility for a project update session in sydney. it would be the first time we've done one, but there seemed to be a positive consensus in the meeting and pabelanger volunteered to help21:40
clarkbah ok was when I was mostly afk so that explains why its news to me :)21:41
fungialso, thanks for doing a great job with the meeting, new ptl! i'm reading the log now, looks like good discussion was had by all21:41
clarkbpabelanger: fungi it sounds like we can do a 10 or 20 or 40 minute update session. Do you think we need more than 20? (20 appears to be their preferred length)21:41
fungioriginally they said 20 and that seemed a reasonable balance to me21:42
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Fix Bug on calendar synch API  https://review.openstack.org/49642321:42
pabelangerclarkb: fungi: ya, 20 seems good21:42
fungibut really, it all depends on how much content you think we can come up with21:43
clarkbok, I'll respond to them asking for a 20 minute session21:43
clarkbwell I imagine jeblair could talk about zuulv3 all day :) but keeping it to a reasonable length for archival purposes seems like a good idea21:43
fungii was worried that the old-style 40min slots would be hard for us to fill which is part of why i didn't ask to do one in the past21:43
*** kjackal has quit IRC21:45
openstackgerritMerged openstack-infra/openstackid-resources master: Fix Bug on calendar synch API  https://review.openstack.org/49642321:47
*** xyang1 has quit IRC21:51
clarkbcmurphy: is there a cookiecutter repo that needs to be updated too?21:59
cmurphyclarkb: ummm yes, let me do that22:00
clarkbianw and other reviewers, I think my rough plan is to go through and +2 those after code review then when done (there are like 80 changes) swing back around and approve any that haven't been approved yet. That way others have a chance to review too if they like22:01
*** jamesmcarthur has quit IRC22:01
ianwclarkb: i'm happy for you to single approve them if you've got them all up, based on me having a look and them all being the same22:01
clarkbianw: ok so I should just approve as I am going then? I'll do that22:02
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add role to GPG sign artifacts in a directory  https://review.openstack.org/49642622:02
ianw++, thanks22:02
*** thorst_afk has joined #openstack-infra22:02
openstackgerritColleen Murphy proposed openstack-infra/puppet-infra-cookiecutter master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49642722:02
*** jamesmcarthur has joined #openstack-infra22:03
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Sign artifacts before we release them  https://review.openstack.org/49642822:04
mordredpabelanger: ^^ that does the signing -and also fixes the release job to use the right playbook22:05
pabelangermordred: ah, thanks!22:06
*** thorst_afk has quit IRC22:06
*** thorst_afk has joined #openstack-infra22:08
openstackgerritMerged openstack-infra/puppet-infra-cookiecutter master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49642722:08
openstackgerritMerged openstack-infra/puppet-featuretracker master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49559222:09
openstackgerritMerged openstack-infra/puppet-vcsrepo master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49565222:10
*** signed8b_ has joined #openstack-infra22:11
*** yamamoto_ has joined #openstack-infra22:11
openstackgerritMerged openstack-infra/puppet-kibana master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49560822:13
*** signed8bit has quit IRC22:13
openstackgerritMerged openstack-infra/puppet-github master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49559622:14
openstackgerritMerged openstack-infra/puppet-germqtt master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49559322:14
clarkbcmurphy: ianw ^ they are starting to merge now22:14
cmurphythanks clarkb and ianw22:14
*** wolverineav has quit IRC22:15
dhellmannclarkb : yeah, I suspect it's a lot easier to work with golang stuff where you just deploy locally :-/22:15
*** wolverineav has joined #openstack-infra22:16
*** wolverineav has quit IRC22:16
openstackgerritMerged openstack-infra/puppet-bup master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49558222:16
openstackgerritMerged openstack-infra/puppet-graphite master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49559822:16
openstackgerritMerged openstack-infra/puppet-infracloud master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49560222:17
*** yamamoto_ has quit IRC22:17
*** wolverineav has joined #openstack-infra22:17
*** thorst_afk has quit IRC22:18
openstackgerritMerged openstack-infra/puppet-jenkins master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49560622:18
openstackgerritMerged openstack-infra/puppet-log_processor master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49561022:18
openstackgerritMerged openstack-infra/puppet-ipsilon master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49560322:18
*** thorst_afk has joined #openstack-infra22:18
openstackgerritMerged openstack-infra/puppet-lodgeit master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49560922:18
openstackgerritMerged openstack-infra/puppet-meetbot master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49561622:19
openstackgerritMerged openstack-infra/puppet-gerritbot master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49559522:19
openstackgerritMerged openstack-infra/puppet-jeepyb master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49560522:19
openstackgerritMerged openstack-infra/puppet-diskimage_builder master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49558522:20
clarkbcmurphy: I've noticed at least one failed gating, you'll probably want to swing around and make sure those get debugged and merged22:20
dmsimardDo we need to rerun puppet on codesearch.o.o ? It seems like some newer repositories (such as openstack-infra/zuul-jobs) are missing.22:20
cmurphyclarkb: okay22:20
*** wolverineav has quit IRC22:21
cmurphyclarkb: curl: (6) Could not resolve host: bootstrap.pypa.io; Unknown error22:22
cmurphydns weirdness22:22
*** marst has quit IRC22:22
*** thorst_afk has quit IRC22:22
clarkbthat is a cname to c.global-ssl.fastly.net. and the A record for that name has a 30 second ttl, I wonder if that just fails to resolve sometimes22:24
cmurphyclarkb: also that one corrupt ssh key problem on centos, i guess we never figured that out http://logs.openstack.org/12/495612/1/gate/gate-infra-puppet-apply-3-centos-7/2173a3f/puppetapplytest29.final.out.FAILED22:24
openstackgerritMerged openstack-infra/puppet-haveged master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49559922:25
openstackgerritMerged openstack-infra/puppet-httpd master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49560122:25
openstackgerritMerged openstack-infra/puppet-hound master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49560022:25
clarkbcmurphy: no haven't been able to root cause that one yet. We can rpobably debug that by booting our centos 7 image in a loop and checking the authorized_keys file on the results22:25
*** signed8b_ is now known as signed8bit_Zzz22:25
*** pabelanger has quit IRC22:25
*** pabelanger has joined #openstack-infra22:25
openstackgerritMerged openstack-infra/puppet-vinz master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49565322:25
clarkbcmurphy: I think you can rechcek both22:26
cmurphyclarkb: yep done22:26
clarkbok I think that is everything approved in the modules except where check failed22:28
clarkbthe changes to spec helper will requier a bit more brain power so I'll put those off until this is done22:29
*** rcernin has quit IRC22:32
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Added Exponential Backoff on Outlook Api Delete Calendar .  https://review.openstack.org/49643122:34
openstackgerritMerged openstack-infra/openstackid-resources master: Added Exponential Backoff on Outlook Api Delete Calendar .  https://review.openstack.org/49643122:35
*** Goneri has quit IRC22:38
clarkblooks like top of gate for those changes may end up timing out and causign a reset but generally things are passing and should merge22:46
*** makowals has joined #openstack-infra22:46
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Create secrets dir in bwrap  https://review.openstack.org/49643222:46
*** jamesmcarthur has quit IRC22:47
*** gildub has joined #openstack-infra22:48
jeblairinfra-root: i'm going to force-merge that since a related bug has wedged zuulv3 ^22:50
jeblairor, rather, mordred is going to force merge it.  :)22:51
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Create secrets dir in bwrap  https://review.openstack.org/49643222:52
mordredjeblair: you on restarting ze01?22:52
jeblairmordred: yes i'll do that22:52
jeblairdone and rechecking a change22:54
*** makowals has quit IRC22:56
*** rbrndt has quit IRC22:57
*** rbrndt has joined #openstack-infra22:57
*** rbrndt has quit IRC22:57
clarkbwhen yall are done unwedging zuul, https://review.openstack.org/496399 will help sort out nodepool test jobs22:57
clarkbpabelanger: https://review.openstack.org/496310 is the dib fix for suse unbound too22:58
pabelangeroh right22:58
pabelanger+322:59
clarkbtyty23:00
*** thorst_afk has joined #openstack-infra23:00
*** priteau has joined #openstack-infra23:01
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add role to GPG sign artifacts in a directory  https://review.openstack.org/49642623:03
*** funzo has joined #openstack-infra23:03
*** aeng has quit IRC23:04
*** xarses has quit IRC23:05
*** priteau has quit IRC23:06
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Use item.path not item on results of find  https://review.openstack.org/49643623:07
*** funzo has quit IRC23:07
openstackgerritMerged openstack-infra/project-config master: Drastically simplify nodepool dsvm zuul layout  https://review.openstack.org/49639923:11
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Stop logging executor job args  https://review.openstack.org/49643723:12
*** hongbin has quit IRC23:13
*** yamamoto_ has joined #openstack-infra23:13
openstackgerritMerged openstack-infra/project-config master: Don't use dlv-anchor-file with unbound  https://review.openstack.org/49631023:13
*** gouthamr has quit IRC23:16
*** yamamoto_ has quit IRC23:18
*** mat128 has joined #openstack-infra23:19
openstackgerritMerged openstack-infra/zuul-jobs master: Use item.path not item on results of find  https://review.openstack.org/49643623:19
*** makowals has joined #openstack-infra23:20
*** aeng has joined #openstack-infra23:21
openstackgerritKendall Nelson proposed openstack-infra/storyboard master: [WIP] Adds Migration Documentation  https://review.openstack.org/49643923:22
*** mat128 has quit IRC23:24
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add role to GPG sign artifacts in a directory  https://review.openstack.org/49642623:24
*** esberglu has quit IRC23:24
*** esberglu has joined #openstack-infra23:25
*** tosky has quit IRC23:27
*** makowals has quit IRC23:27
openstackgerritMerged openstack-infra/puppet-grafyaml master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49559723:27
*** esberglu has quit IRC23:29
*** robled has quit IRC23:31
openstackgerritMerged openstack-infra/puppet-ciwatch master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49558423:31
openstackgerritMerged openstack-infra/puppet-etherpad_lite master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49559023:31
openstackgerritMerged openstack-infra/puppet-cgit master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49558323:32
openstackgerritMerged openstack-infra/puppet-drupal master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49558623:32
*** robled has joined #openstack-infra23:32
openstackgerritMerged openstack-infra/puppet-elastic_recheck master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49558723:32
openstackgerritMerged openstack-infra/puppet-exim master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49559123:33
openstackgerritMerged openstack-infra/puppet-bugdaystats master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49558123:33
openstackgerritJesse Keating proposed openstack-infra/zuul-jobs master: Role to copy the build ssh key to other users  https://review.openstack.org/49641323:33
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Delete keyring dir when we're done  https://review.openstack.org/49644023:34
*** pvaneck has quit IRC23:34
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add role to set up base dir  https://review.openstack.org/49641223:35
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add roles related to log dirs  https://review.openstack.org/49642223:35
*** Julien-zte has quit IRC23:35
openstackgerritMonty Taylor proposed openstack-infra/openstack-zuul-jobs master: Add build-openstack-python-tarball job  https://review.openstack.org/49639023:35
mordredjeblair, pabelanger: ^^ updated23:36
*** stakeda has joined #openstack-infra23:36
jeblair++23:36
openstackgerritMerged openstack-infra/puppet-apps_site master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49557723:37
openstackgerritMerged openstack-infra/zuul-jobs master: Add role to GPG sign artifacts in a directory  https://review.openstack.org/49642623:37
openstackgerritMerged openstack-infra/puppet-askbot master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49557823:37
openstackgerritMerged openstack-infra/puppet-apparmor master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49557623:37
openstackgerritMerged openstack-infra/puppet-openstackci master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/47722923:37
*** makowals has joined #openstack-infra23:38
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add role to set up base dir  https://review.openstack.org/49641223:38
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add roles related to log dirs  https://review.openstack.org/49642223:38
openstackgerritMerged openstack-infra/puppet-elasticsearch master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49558823:38
openstackgerritMerged openstack-infra/puppet-asterisk master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49557923:39
openstackgerritMerged openstack-infra/puppet-zuul master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49565623:39
openstackgerritMerged openstack-infra/puppet-zanata master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49565523:39
openstackgerritMerged openstack-infra/puppet-yum master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49565423:39
openstackgerritMerged openstack-infra/puppet-statusbot master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49564223:39
openstackgerritMerged openstack-infra/puppet-ssl_cert_check master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49564023:41
openstackgerritMerged openstack-infra/puppet-user master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49565123:41
openstackgerritMerged openstack-infra/puppet-ulimit master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49564823:41
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add test playbook  https://review.openstack.org/49644223:41
*** efried has quit IRC23:42
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Stop logging executor job args  https://review.openstack.org/49643723:44
openstackgerritMerged openstack-infra/puppet-tmpreaper master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49564623:46
openstackgerritMerged openstack-infra/puppet-unbound master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49565023:47
openstackgerritMerged openstack-infra/puppet-unattended_upgrades master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49564923:47
openstackgerritMerged openstack-infra/puppet-sudoers master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49564523:47
openstackgerritMerged openstack-infra/zuul-jobs master: Delete keyring dir when we're done  https://review.openstack.org/49644023:47
openstackgerritMerged openstack-infra/puppet-subunit2sql master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49564423:47
*** dave-mccowan has quit IRC23:48
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Add build-openstack-python-tarball job  https://review.openstack.org/49639023:49
openstackgerritMerged openstack-infra/puppet-storyboard master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49564323:50
ianwjeblair: if gertty is syncing from a previous subscription, is it expected that "s" on a new project doesn't do anything?23:52
openstackgerritMerged openstack-infra/puppet-ssh master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49563923:52
ianwclarkb: so was the conclusion that we're ok with a bindep release?23:53
clarkbianw: ya I think so23:54
*** efried has joined #openstack-infra23:56
openstackgerritMerged openstack-infra/puppet-snmpd master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49563823:56
openstackgerritMerged openstack-infra/puppet-packagekit master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49562623:56
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Sign artifacts before we release them  https://review.openstack.org/49642823:57
mordredjeblair: I went with door #1 ^^23:57
openstackgerritMerged openstack-infra/puppet-openstack_health master: Depend on helper gem for spec_helper_acceptance  https://review.openstack.org/49562323:57
jeblairianw: hrm, i don't think so, i think you should be able to keep subscribing to new projects while syncing in the background23:58
*** SpamapS has quit IRC23:59
*** SpamapS has joined #openstack-infra23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!