Wednesday, 2016-10-19

*** thorst_ has quit IRC00:00
*** kzaitsev_mb has quit IRC00:00
*** yamahata has joined #openstack-infra00:00
*** thorst_ has joined #openstack-infra00:01
*** ramishra has joined #openstack-infra00:01
anteayaclarkb: sorry was out for a walk, looks like ianw was able to review and approve00:05
*** thorst_ has quit IRC00:09
*** ramishra has quit IRC00:16
*** ramishra has joined #openstack-infra00:18
openstackgerritRabi Mishra proposed openstack-infra/project-config: Fix heat projects list  https://review.openstack.org/38826300:20
openstackgerritStephanie Miller proposed openstack-infra/zuul: Reenable test_layoutvalidator  https://review.openstack.org/38826600:28
*** ramishra has quit IRC00:30
*** ramishra has joined #openstack-infra00:32
*** adrian_otto has joined #openstack-infra00:37
*** adrian_otto has quit IRC00:42
*** pahuang has quit IRC00:42
*** adrian_otto has joined #openstack-infra00:46
*** cody-somerville has quit IRC00:47
*** ijw has joined #openstack-infra00:50
*** cody-somerville has joined #openstack-infra00:51
*** adrian_otto has quit IRC00:52
*** gouthamr has joined #openstack-infra00:52
*** jgriffith_ is now known as jgriffith00:53
openstackgerritStephanie Miller proposed openstack-infra/zuul: Add pillow dependency libjpeg-dev to bindep  https://review.openstack.org/38826800:58
*** thorst_ has joined #openstack-infra00:58
*** ramishra has quit IRC00:59
*** pahuang has joined #openstack-infra00:59
*** tqtran has quit IRC01:00
*** ramishra has joined #openstack-infra01:00
*** pahuang has quit IRC01:01
*** pahuang has joined #openstack-infra01:02
cloudnullclarkb: pabelanger: idk what's causing those ssh errors. I just built 720 (vms 3 per compute host) and all of them bootstrapped and we're ssh-able. We did have some nova api failures we're looking into however that resulted in error states.01:07
*** pvaneck has quit IRC01:08
*** maeker has joined #openstack-infra01:19
*** tuanluong has joined #openstack-infra01:21
*** maeker has quit IRC01:23
*** zhurong has joined #openstack-infra01:23
*** camunoz has joined #openstack-infra01:24
*** ramishra has quit IRC01:28
*** ramishra has joined #openstack-infra01:28
*** maeker has joined #openstack-infra01:28
*** yanyanhu has joined #openstack-infra01:34
*** Gorian has joined #openstack-infra01:39
*** adrian_otto has joined #openstack-infra01:40
*** markvoelker has joined #openstack-infra01:43
*** igormarnat has quit IRC01:45
*** markvoelker has quit IRC01:49
*** sdake has joined #openstack-infra01:54
*** igormarnat has joined #openstack-infra01:54
*** kaisers__ has joined #openstack-infra01:56
*** kaisers_ has quit IRC01:58
*** claudiub has quit IRC02:04
*** tkelsey has joined #openstack-infra02:07
*** thorst_ has quit IRC02:08
*** thorst_ has joined #openstack-infra02:09
*** tkelsey has quit IRC02:11
*** Apoorva_ has joined #openstack-infra02:15
*** chlong has joined #openstack-infra02:16
*** thorst_ has quit IRC02:18
*** Apoorva has quit IRC02:18
*** Apoorva_ has quit IRC02:19
*** yamahata has quit IRC02:20
*** ramishra has quit IRC02:21
*** Kevin_Zheng has joined #openstack-infra02:22
*** ramishra has joined #openstack-infra02:23
*** maeker has quit IRC02:24
*** sdake_ has joined #openstack-infra02:27
*** sdake has quit IRC02:28
*** dave-mccowan has quit IRC02:29
*** yamamoto_ has joined #openstack-infra02:37
*** zz_dimtruck is now known as dimtruck02:38
*** tlian has quit IRC02:46
*** yuanying has quit IRC02:51
*** yuanying has joined #openstack-infra02:54
*** nicolasbock has quit IRC02:56
*** armax has quit IRC02:58
*** sdake_ is now known as sdake03:15
*** thorst_ has joined #openstack-infra03:15
*** gildub_ has joined #openstack-infra03:18
*** gildub has quit IRC03:20
*** thorst_ has quit IRC03:23
*** vikrant has joined #openstack-infra03:23
*** maeker has joined #openstack-infra03:24
*** gildub_ has quit IRC03:27
*** gildub has joined #openstack-infra03:28
*** maeker has quit IRC03:29
*** ijw has quit IRC03:30
*** gildub_ has joined #openstack-infra03:36
*** gildub has quit IRC03:37
*** vikrant is now known as vikrant|brb03:42
*** tqtran has joined #openstack-infra03:45
openstackgerritDong Ma proposed openstack-infra/jenkins-job-builder: Update performance plugin  https://review.openstack.org/38830703:46
*** links has joined #openstack-infra03:46
*** gouthamr has quit IRC03:48
*** gildub has joined #openstack-infra03:48
*** gildub_ has quit IRC03:48
*** yuanying has quit IRC03:49
*** cshastri has joined #openstack-infra03:50
*** tqtran has quit IRC03:50
openstackgerritDong Ma proposed openstack-infra/jenkins-job-builder: Update mailer plugin  https://review.openstack.org/37314503:51
*** yamahata has joined #openstack-infra03:52
*** john-davidge has joined #openstack-infra03:57
*** john-davidge has quit IRC04:01
*** vikrant|brb is now known as vikrant04:05
*** tkelsey has joined #openstack-infra04:08
*** tkelsey has quit IRC04:13
*** armax has joined #openstack-infra04:14
*** mtanino has quit IRC04:14
*** adrian_otto1 has joined #openstack-infra04:14
*** adrian_otto has quit IRC04:17
*** thorst_ has joined #openstack-infra04:21
*** vikrant has quit IRC04:24
*** adriant has quit IRC04:25
*** thorst_ has quit IRC04:27
*** ssbarnea has joined #openstack-infra04:31
*** ssbarnea has quit IRC04:36
*** sree has joined #openstack-infra04:40
ramishraianw: hi! around?04:43
ianwramishra: yep04:43
ramishrahttps://review.openstack.org/#/c/345818 has broken all heat gate jobs.04:43
ramishraMost of the gate jobs for us use the devstack plugin.04:44
ramishraHowever, fixing the plugin does not help, as all grenade jobs fail, -1 release does not have the change.04:44
ramishraI would assume https://review.openstack.org/#/c/388263/ would fix that for us?04:45
*** coolsvap has joined #openstack-infra04:47
ramishraianw: ^^^04:47
ianwramishra: ummm ... i might just need to merge the devstack change down04:48
ramishraWe don't use the devstack code, rather devstack plugin.04:48
ramishrahowfar would be backport them for the grenade jobs04:49
ramishrahow far would we backport?04:49
ianwramishra: can you show me logs of a failiure04:49
ramishrahttp://logs.openstack.org/38/367638/5/check/gate-heat-dsvm-functional-orig-mysql-lbaasv2/205887e/logs/devstacklog.txt.gz#_2016-10-18_23_32_27_45504:50
ramishraplugin fixes https://review.openstack.org/#/c/388274/ https://review.openstack.org/#/c/388289/04:51
*** cshastri has quit IRC04:51
openstackgerritNate Johnston proposed openstack-infra/irc-meetings: Add Yushiro Furukawa as FWaaS meeting chair  https://review.openstack.org/38838304:52
*** reed_ has joined #openstack-infra04:52
ianwramishra: ahh, we want to remove dib-utils from the plugin04:53
*** reed_ has quit IRC04:53
ramishrait's removed in the above patches04:53
ramishraianw: the issue is grenade jobs installing older heat would need it. I tried backporting it to newton still it fails.04:54
ramishraianw: I would probably think the best possible way here is merge the project-config change and the fix it.04:55
ramishrahttp://logs.openstack.org/74/388274/2/check/gate-grenade-dsvm-heat/a9e187f/logs/grenade.sh.txt.gz#_2016-10-19_04_16_21_862, grenade failure04:56
ianwramishra: where's newton getting it from?04:56
*** amotoki has joined #openstack-infra04:57
ramishraianw: we've heat code both in devstack tree and the plugin, which is kind of a transition, till dependent projects move to use the plugin.04:57
ianwramishra: right, so i think merge the devstack change into newton?04:58
ramishraianw: then we would have issue in grenade job for newton, which would expect the change in mitaka, no?04:59
ramishraand I would assume stable/mitaka jobs would fail too.05:00
ianwwe can merge to both05:00
ramishraand to liberty?05:01
openstackgerritMerged openstack-infra/irc-meetings: Add Yushiro Furukawa as FWaaS meeting chair  https://review.openstack.org/38838305:01
ramishraCan we not merge the stop gap project-config change05:01
ramishra?05:01
*** hurgleburgler has quit IRC05:02
*** yuanying has joined #openstack-infra05:02
ianwramishra: i've proposed the backports05:04
ramishraHere is the mitaka grenade failure  http://logs.openstack.org/76/365976/2/check/gate-grenade-dsvm-heat/493596c/logs/grenade.sh.txt.gz05:04
ramishrawe've to also backport the plugin changes for all old releases. Do you think that the best option here?05:05
ianwramishra: why don't we just get rid of it now, since we're all looking at it05:06
ianwwe actually want to completely retire the dib-utils project05:06
ramishrawhat about the liberty grenade jobs that would probaly need the change in kilo?05:07
ramishraI understand stable/libery is phase 3 support, but there may be some security fixes for it in the future?05:08
*** bmjen has quit IRC05:08
*** Hunner has quit IRC05:08
*** raginbaj- has joined #openstack-infra05:11
ianwramishra: if we have to do a work-around for one branch, i'd prefer to see that.  it seems like just a couple of cherry-picks and we'll be there05:11
*** bmjen has joined #openstack-infra05:14
*** Hunner has joined #openstack-infra05:15
*** Hunner has quit IRC05:15
*** Hunner has joined #openstack-infra05:15
ramishraI don't know if that's the case.  we have moved to the devstack plugin from newton. So we don't have to backport them more.05:15
ramishraianw: I hope the stable grenade jobs work05:16
ianwramishra: i've got them going @ https://review.openstack.org/#/q/topic:dib-heat-backport ... i gotta run for a bit, but i'll check back soon05:16
ramishraianw: thanks!, I will see if they help fix the issue.05:17
*** csomerville has joined #openstack-infra05:18
*** cody-somerville has quit IRC05:18
*** jaosorior has joined #openstack-infra05:21
*** thorst_ has joined #openstack-infra05:25
*** maeker has joined #openstack-infra05:26
*** drifterza has joined #openstack-infra05:29
*** maeker has quit IRC05:31
*** adrian_otto1 has quit IRC05:32
*** thorst_ has quit IRC05:32
*** qwertyco has joined #openstack-infra05:34
*** igormarnat has quit IRC05:41
sc`i've been getting pretty consistent timeouts on my integration gates trying to connect to rubygems.org, causing inconsistent build failures. what might be going on here?05:41
sc`i know... perfect time of night to ask :D05:42
*** igormarnat has joined #openstack-infra05:45
*** sdake_ has joined #openstack-infra05:49
*** shu-mutou is now known as shu-mutou-AWAY05:51
*** sdake has quit IRC05:53
*** ssbarnea has joined #openstack-infra05:53
*** apetrich has quit IRC05:54
*** sdake has joined #openstack-infra05:56
*** nadya has joined #openstack-infra05:57
*** apetrich has joined #openstack-infra05:58
*** ssbarnea has quit IRC05:58
*** sdake_ has quit IRC06:00
*** sdake_ has joined #openstack-infra06:01
*** nadya has quit IRC06:01
*** sdake has quit IRC06:03
*** sandanar has joined #openstack-infra06:05
*** ssbarnea has joined #openstack-infra06:05
*** sandanar_ has joined #openstack-infra06:05
*** sandanar has quit IRC06:06
*** sdake_ has quit IRC06:07
*** sdake has joined #openstack-infra06:07
*** tkelsey has joined #openstack-infra06:10
*** rcernin has joined #openstack-infra06:11
*** clayton has quit IRC06:12
*** gongysh has joined #openstack-infra06:13
openstackgerritMerged openstack-infra/project-config: Upgrade check-uc to voting  https://review.openstack.org/38223206:14
*** markvoelker has joined #openstack-infra06:14
*** tkelsey has quit IRC06:14
*** sdake_ has joined #openstack-infra06:15
*** ssbarnea has quit IRC06:17
*** markvoelker has quit IRC06:19
*** vsaienko has joined #openstack-infra06:19
*** sdake has quit IRC06:19
openstackgerritMasayuki Igawa proposed openstack-infra/devstack-gate: Remove unused tempest runnings  https://review.openstack.org/37397106:20
openstackgerritMasayuki Igawa proposed openstack-infra/devstack-gate: SUPER WIP: Use new tempest run workflow  https://review.openstack.org/35566606:20
AJaegerramishra, ianw: CAn we abandon https://review.openstack.org/#/c/388263 now? Is the problem fixed?06:22
ramishraAJaeger: Not yet, I'm waiting for the devstack patches to land and then recheck heat fixes.06:22
*** chandankumar has joined #openstack-infra06:23
*** andreas_s has joined #openstack-infra06:25
AJaegerramishra: Understood, thanks06:25
*** nadya has joined #openstack-infra06:26
*** maeker has joined #openstack-infra06:27
*** isaacb has joined #openstack-infra06:27
*** sree has quit IRC06:27
AJaegersc`: are those jobs run all in the same cloud?06:28
*** rossella_s has quit IRC06:28
*** nherciu has joined #openstack-infra06:28
*** rossella_s has joined #openstack-infra06:28
sc`judging from the ipv6 addresses, yes?06:29
*** tkelsey has joined #openstack-infra06:29
*** vsaienko has quit IRC06:29
*** apetrich has quit IRC06:29
sc`i mean, the prefix all looks the same06:29
*** thorst_ has joined #openstack-infra06:31
openstackgerritMerged openstack-infra/project-config: Request for add new project nova-fusioncompute  https://review.openstack.org/38672706:31
AJaegersc`: the first line of a log file contains the host name - and that one includes the cloud06:31
AJaegerExample "Building remotely on ubuntu-trusty-osic-cloud1-disk-4995032" - that's in osic-cloud-disk06:32
AJaegerAnd it's the second line...06:32
*** apetrich has joined #openstack-infra06:32
*** maeker has quit IRC06:33
sc`ah. checking from an ipv6-capable host. the builds are rerunning and i didn't save the location to the previous run's logs06:33
*** markvoelker has joined #openstack-infra06:33
sc`current ones are both zl02, they haven't timed out... yet. it's really not a huge workload. a single vm with 2 cores and 8gb of ram06:35
sc`two. E_COFFEE06:35
sc`i should probably give in to sleep at this point and let the cloud be the cloud06:36
*** thorst_ has quit IRC06:37
openstackgerritMerged openstack-infra/project-config: Refactor run-tox-with-oslo-master.sh  https://review.openstack.org/38768106:37
*** isaacb has quit IRC06:38
*** markvoelker has quit IRC06:38
*** e0ne has joined #openstack-infra06:38
*** markvoelker has joined #openstack-infra06:38
*** nherciu has quit IRC06:40
sc`i'll check my build results in the manana and see where it fell down. random thought: maybe it's because rubygems.org isn't ipv6-ready06:40
cloudnullsc`: I'd be happy to poke things in the AM within the OSIC if needed.06:41
*** nherciu has joined #openstack-infra06:42
*** winggundamth has quit IRC06:42
*** csatari has joined #openstack-infra06:42
sc`i have no such visibility to see what might be causing the issue. it would be much appreciated, as i'm still trying to get a release out the door :D06:43
cloudnulljust a note the osic cloud for infra uses a dual stack so if rubygems doesn't have a AAAA then the traffic should be going out the 10/8 subnet but if that's being unhappy I can look at that on the infra side.06:43
openstackgerritMerged openstack-infra/project-config: Adds a functional test job for Octavia  https://review.openstack.org/38807806:43
openstackgerritMerged openstack-infra/project-config: networking-bgpvpn: add python35 and coverage jobs  https://review.openstack.org/38726706:44
sc`my team and i have made a meme out of recheck in one long-running change due to rubygems connectivity06:44
sc`the awesome thing is it's for a single gem06:45
cloudnullis this devstack + neutron by chance?06:45
sc`openstack + chef06:45
sc`(we still exist!)06:45
cloudnullI know there is/was an ongoing issue there where a competing 10. network was getting created which broke the GW06:45
*** winggundamth has joined #openstack-infra06:45
cloudnullsc`: awesome!06:45
cloudnullI used to do a lot of chef. good stuff06:46
*** gildub has quit IRC06:46
*** jaosorior has quit IRC06:47
sc`i'm being called away. i'll poke in here in the am when not so sleep deprived06:47
cloudnullok. ping me if its still being a bastard.06:47
*** tnovacik has joined #openstack-infra06:47
cloudnullima try sleeping myself.06:47
AJaegergood night, sc` and cloudnull !06:48
sc`o/06:48
cloudnullcheers. AJaeger06:48
openstackgerritIan Wienand proposed openstack/diskimage-builder: Revert "Fix grub installation for RHEL"  https://review.openstack.org/38846806:52
yamamoto_i want to make a job voting on a branch and non-voting on another.  is there any example for that kind of setup?06:55
*** clayton has joined #openstack-infra06:56
*** flepied1 has quit IRC06:56
AJaegeryamamoto_: not possible in general.06:56
AJaeger(at least not with current tools)06:57
AJaegeryamamoto_: which job would this be?06:57
*** claudiub has joined #openstack-infra06:59
*** armax has quit IRC07:00
*** ihrachys has joined #openstack-infra07:00
*** jaosorior has joined #openstack-infra07:00
*** claudiub|2 has joined #openstack-infra07:01
zhurongAJaeger Hi, please help us to check solum project: https://review.openstack.org/#/q/project:openstack/solum+status:open, all the need merge patches are in the "Submitted, Merge Pending" status07:03
*** Naeil has joined #openstack-infra07:04
*** claudiub has quit IRC07:04
*** Hal has joined #openstack-infra07:04
AJaegerzhurong: which is the oldest one of these?07:06
AJaegeropen it and check whether it has "Cannot merge"07:07
AJaegerIf that's the case, rebase this change...07:07
AJaeger(you need to do this manually)07:07
AJaegerthat should unstuck you07:07
zhurongAJaeger thx, I will have a try07:08
*** tesseract has joined #openstack-infra07:08
*** tesseract is now known as Guest9021107:09
openstackgerritMasayuki Igawa proposed openstack-infra/devstack-gate: SUPER WIP: Use new tempest run workflow  https://review.openstack.org/35566607:09
*** tosky has joined #openstack-infra07:10
*** qwertyco has quit IRC07:11
*** matrohon has joined #openstack-infra07:12
yamamoto_AJaeger: gate-tempest-dsvm-networking-midonet-ml2. i want to make it voting only on master.07:14
yamamoto_AJaeger: i need to create two variants for -nv and voting?07:16
*** oomichi has quit IRC07:16
AJaegeryamamoto_: that works - create a -nv variant.07:17
*** oomichi has joined #openstack-infra07:17
AJaegerWait, you could make it work - if you run the -nv variant only on one branch. But that's ugly.07:17
AJaegerneeds good comments ;)07:18
yamamoto_AJaeger: ok, let me try. thank you!07:18
AJaegerzhurong: let's see whether those merge once that change is in - if not, recheck them.07:19
zhurongAJaeger OK, I had rebase the oldest one, thx07:20
*** yaume has joined #openstack-infra07:21
openstackgerritPeter Szabo proposed openstack-infra/jenkins-job-builder: Add missing parameters for gitlab-notifier  https://review.openstack.org/37154707:22
*** martinkopec has joined #openstack-infra07:23
*** thorst_ has joined #openstack-infra07:25
*** nadya has quit IRC07:26
openstackgerritYAMAMOTO Takashi proposed openstack-infra/project-config: networking-midonet: Make ml2 job voting for newton and master  https://review.openstack.org/38849307:28
*** persia has quit IRC07:30
*** tmorin has joined #openstack-infra07:31
*** thorst_ has quit IRC07:32
*** persia has joined #openstack-infra07:33
therveAJaeger, Re https://review.openstack.org/#/c/388263/ it's used in our devstack plugin, to be used in tests.07:33
therveIt's not used currently, but all stable branches are broken, so it's easier to add it back for now07:33
*** esikachev has joined #openstack-infra07:34
*** camunoz_ has joined #openstack-infra07:34
*** tnovacik has quit IRC07:35
openstackgerritMasayuki Igawa proposed openstack-infra/devstack-gate: SUPER WIP: Use new tempest run workflow  https://review.openstack.org/35566607:40
*** gongysh has quit IRC07:40
*** vipuls has quit IRC07:40
*** vipuls has joined #openstack-infra07:40
*** clayton has quit IRC07:41
*** markvoelker has quit IRC07:41
*** icey has quit IRC07:42
*** tmorin has left #openstack-infra07:45
*** clayton has joined #openstack-infra07:45
*** e0ne has quit IRC07:46
*** icey has joined #openstack-infra07:46
AJaegertherve: I expect  that with https://review.openstack.org/#/q/topic:dib-heat-backport everything should be fixed (not sure whether those are all merged). If anything is still not working, please talk with ianw and give examples.07:46
therveOK07:47
therveWe also have to fix all our stable branches07:47
therveNot sure why this is more efficient that one change in config07:48
*** kzaitsev_mb has joined #openstack-infra07:48
*** tqtran has joined #openstack-infra07:49
AJaegertherve: I'm offline for the next few hours and can't help at the moment.07:49
*** jpich has joined #openstack-infra07:50
*** ssbarnea has joined #openstack-infra07:51
*** amoralej|off is now known as amoralej07:52
*** janonymous has joined #openstack-infra07:52
*** tqtran has quit IRC07:53
ianwtherve: i'm not sure it's more efficient, but if we can clear out an unneeded dependency with a a couple of backports it means we don't have to revist this later07:54
janonymousHi Team, I think this link is broken of [ 0.1.0 --> https://tarballs.openstack.org/kuryr/kuryr-0.1.0.tar.gz ]  in https://releases.openstack.org/teams/kuryr.html --> (should be) https://tarballs.openstack.org/kuryr/kuryr-lib-0.1.0.tar.gz07:55
janonymousCan someone check this please.07:55
*** dizquierdo has joined #openstack-infra07:56
ianwjanonymous: might want to ping in #openstack-release07:56
*** ssbarnea has quit IRC07:56
janonymousianw: Thanks07:56
*** claudiub|2 has quit IRC07:57
therveianw, It's a noble goal, but I don't think it's worth blocking heat's gate for it.07:57
*** markvoelker has joined #openstack-infra07:58
*** abregman|afk is now known as abregman07:59
*** zzzeek has quit IRC08:00
*** yanyanhu has quit IRC08:00
*** yanyanhu has joined #openstack-infra08:00
*** zzzeek has joined #openstack-infra08:01
tuanluonghi ironic team08:01
*** jpena|off is now known as jpena08:02
*** kzaitsev_mb has quit IRC08:02
*** dimtruck is now known as zz_dimtruck08:02
*** zz_dimtruck is now known as dimtruck08:03
*** ccamacho|out is now known as ccamacho08:04
*** tmorin has joined #openstack-infra08:07
*** janonymous has left #openstack-infra08:08
*** yanyanhu has quit IRC08:08
*** yanyanhu has joined #openstack-infra08:09
*** dizquierdo has quit IRC08:09
*** nadya has joined #openstack-infra08:11
*** flepied has joined #openstack-infra08:12
*** dimtruck is now known as zz_dimtruck08:12
*** dingyichen has quit IRC08:14
*** BobBall_AWOL is now known as BobBAll08:16
*** BobBAll is now known as BobBall08:16
*** rcernin has quit IRC08:16
*** rcernin has joined #openstack-infra08:16
*** rcernin has quit IRC08:18
*** rcernin has joined #openstack-infra08:19
*** rcernin has quit IRC08:19
*** rcernin has joined #openstack-infra08:19
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4  https://review.openstack.org/37120908:19
*** jaosorior is now known as jaosorior_lunch08:20
*** yanyanhu has quit IRC08:22
*** oomichi has quit IRC08:23
*** yanyanhu has joined #openstack-infra08:23
*** yanyanhu has quit IRC08:24
openstackgerritDougal Matthews proposed openstack-infra/tripleo-ci: Set TRIPLEO_ROOT before it is first used  https://review.openstack.org/38854208:25
*** oomichi has joined #openstack-infra08:25
openstackgerritMasayuki Igawa proposed openstack-infra/devstack-gate: SUPER WIP: Use new tempest run workflow  https://review.openstack.org/35566608:27
*** thorst_ has joined #openstack-infra08:30
*** ssbarnea has joined #openstack-infra08:34
openstackgerritDougal Matthews proposed openstack-infra/tripleo-ci: Set TRIPLEO_ROOT before it is first used  https://review.openstack.org/38854208:34
*** yanyanhu has joined #openstack-infra08:35
*** yanyanhu has quit IRC08:35
*** florianf has joined #openstack-infra08:36
*** andreykurilin has left #openstack-infra08:37
*** thorst_ has quit IRC08:37
*** andreykurilin has joined #openstack-infra08:37
*** derekh has joined #openstack-infra08:39
*** yanyanhu has joined #openstack-infra08:42
*** yanyanhu has quit IRC08:42
*** lVathan[m] has quit IRC08:45
*** M-docaedo_vector has quit IRC08:45
*** dtantsur|afk is now known as dtantsur|sick08:46
Kevin_ZhengHi, could anyone kindly  add 517341003@qq.com as PTL and core for nova-fusioncompute-core group?08:47
yolandagood morning08:47
yolandahi Kevin_Zheng , i can do it, is that email the same one that created the change for adding that project?08:48
Kevin_Zhengyes it is08:48
Kevin_ZhengThanks alot08:48
*** hexlibris has quit IRC08:48
*** hexlibris has joined #openstack-infra08:49
yolandadone08:49
*** yanyanhu has joined #openstack-infra08:50
*** yuanying_ has joined #openstack-infra08:50
*** yuanying has quit IRC08:52
andreykurilinHi folks! Does it possible to change an email for https://openstackid.org ?08:54
*** claudiub|2 has joined #openstack-infra08:55
Kevin_ZhengThanks08:55
*** lVathan[m] has joined #openstack-infra09:03
*** mfedosin has joined #openstack-infra09:04
*** abregman is now known as abregman|afk09:05
*** yuanying has joined #openstack-infra09:05
*** jaosorior_lunch is now known as jaosorior09:05
*** john-davidge has joined #openstack-infra09:07
*** ssbarnea has quit IRC09:07
*** ssbarnea has joined #openstack-infra09:07
*** e0ne has joined #openstack-infra09:08
*** chandankumar has quit IRC09:08
*** yuanying_ has quit IRC09:08
*** chandankumar has joined #openstack-infra09:08
*** links has quit IRC09:09
*** chandankumar has quit IRC09:09
openstackgerritMerged openstack-infra/project-config: Switch ironic-multitenancy job to xenial  https://review.openstack.org/38754509:09
*** chandankumar has joined #openstack-infra09:09
openstackgerritJiri Stransky proposed openstack/diskimage-builder: RH grub: don't fail if grub is already installed  https://review.openstack.org/38856709:09
openstackgerritMerged openstack-infra/project-config: [Manila] Temporary disable broken job  https://review.openstack.org/38789909:11
*** ralonsoh has joined #openstack-infra09:12
*** ralonsoh has quit IRC09:12
*** ralonsoh has joined #openstack-infra09:12
*** kzaitsev_mb has joined #openstack-infra09:13
*** sambetts|afk is now known as sambetts09:15
*** yanyanhu has quit IRC09:19
*** yanyanhu has joined #openstack-infra09:20
*** yanyanhu has quit IRC09:21
*** vikrant has joined #openstack-infra09:23
*** yanyanhu has joined #openstack-infra09:26
ianwramishra: if you get 388289 merged, then 388274 goes on top, and we're all good, right?09:29
*** alex_xu has quit IRC09:29
*** alex_xu has joined #openstack-infra09:31
openstackgerritJordan Pittier proposed openstack-infra/shade: Fix TypeError in list_router_interfaces  https://review.openstack.org/38857909:31
ramishraianw: yeah, I think we've to merge newton patch first.09:31
ramishramaster one is not working without that being merged. http://logs.openstack.org/74/388274/2/check/gate-grenade-dsvm-heat/4af8f58/logs/grenade.sh.txt.gz#_2016-10-19_09_24_26_96309:33
openstackgerritIan Wienand proposed openstack/diskimage-builder: [WIP] remove rh grub workaround stuff  https://review.openstack.org/38858009:34
*** ssbarnea has quit IRC09:34
*** claudiub|2 has quit IRC09:34
*** ssbarnea has joined #openstack-infra09:35
*** thorst_ has joined #openstack-infra09:35
*** markvoelker has quit IRC09:36
*** ssbarnea has quit IRC09:36
ianwramishra: ok, it's getting late here.  i believe merging the newton patch and then the other one will restore things, and have the benefit of removing all those extra clones.  i did +2 the other change as a fall-back if there are unforseen issues09:37
*** ssbarnea has joined #openstack-infra09:37
*** zhurong has quit IRC09:38
ramishraianw: OK, I assume we'll get to know in 1 hr. Our gate jobs run max ~30 mins.09:38
*** nadya has quit IRC09:42
*** yamahata has quit IRC09:42
*** thorst_ has quit IRC09:43
*** jaosorior has quit IRC09:43
*** jaosorior has joined #openstack-infra09:43
*** mestery has quit IRC09:44
openstackgerritabdul nizamuddin proposed openstack-dev/pbr: Update .coveragerc after the removal of openstack directory  https://review.openstack.org/38858609:46
*** jamespag` is now known as jamespage09:46
*** mestery has joined #openstack-infra09:50
szaherAJaeger: Can you please review this one https://review.openstack.org/#/c/388076/ ?09:51
openstackgerritMasayuki Igawa proposed openstack-infra/devstack-gate: SUPER WIP: Use new tempest run workflow  https://review.openstack.org/35566609:56
*** ssbarnea has quit IRC09:56
*** ijw has joined #openstack-infra09:57
*** ssbarnea has joined #openstack-infra09:58
*** ijw has quit IRC10:02
*** yanyanhu has quit IRC10:05
*** esikachev has quit IRC10:06
*** yuanying_ has joined #openstack-infra10:07
*** claudiub has joined #openstack-infra10:09
*** yuanying has quit IRC10:09
*** yee3796 has quit IRC10:14
*** yee379 has joined #openstack-infra10:14
*** kzaitsev_mb has quit IRC10:14
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Unbound variable when executing tripleo.sh  https://review.openstack.org/38859410:14
*** electrofelix has joined #openstack-infra10:20
*** ldnunes has joined #openstack-infra10:20
*** pblaho has joined #openstack-infra10:20
*** kzaitsev_mb has joined #openstack-infra10:23
*** nicolasbock has joined #openstack-infra10:27
*** ssbarnea has quit IRC10:28
*** ssbarnea has joined #openstack-infra10:29
*** vsaienko has joined #openstack-infra10:31
openstackgerritAlex Kavanagh proposed openstack-infra/project-config: Add charm-manila-generic-backend and interface  https://review.openstack.org/38791310:32
openstackgerritAlex Kavanagh proposed openstack-infra/project-config: Add charm-manila-generic and interface  https://review.openstack.org/38791310:33
*** yuanying has joined #openstack-infra10:34
*** yuanying_ has quit IRC10:36
*** tuanluong has quit IRC10:37
openstackgerritJordan Pittier proposed openstack-infra/shade: Remove useless mocking in tests/unit/test_shade.py  https://review.openstack.org/38860410:40
*** tnovacik has joined #openstack-infra10:41
*** thorst_ has joined #openstack-infra10:41
*** ssbarnea has quit IRC10:42
*** ssbarnea has joined #openstack-infra10:42
openstackgerritabdul nizamuddin proposed openstack-dev/pbr: Changed the home-page link  https://review.openstack.org/38860710:44
*** thorst_ has quit IRC10:47
*** abregman|afk is now known as abregman10:48
*** sdague has joined #openstack-infra10:48
*** mhickey has joined #openstack-infra10:53
*** sdake has joined #openstack-infra10:54
*** dguitarbite has quit IRC10:55
*** dguitarbite has joined #openstack-infra10:55
*** jkilpatr has quit IRC10:56
*** sdake_ has quit IRC10:57
*** yuanying has quit IRC10:58
*** yamamoto_ has quit IRC11:01
*** kzaitsev_mb has quit IRC11:08
*** edmondsw has joined #openstack-infra11:10
*** sree has joined #openstack-infra11:10
*** camunoz_ has quit IRC11:11
*** robcresswell has quit IRC11:12
*** dave-mccowan has joined #openstack-infra11:17
*** jkilpatr has joined #openstack-infra11:18
*** markvoelker has joined #openstack-infra11:21
vsaienk0ianw: I'm sorry for direct ping, ironic multinode stuck on 3 devstack-gate patches, they already have +2. could you please help to merge them: https://review.openstack.org/#/c/364830/11:25
*** adrian_otto has joined #openstack-infra11:26
*** jcoufal has joined #openstack-infra11:26
*** psilvad has joined #openstack-infra11:27
*** Hal has quit IRC11:31
*** robcresswell has joined #openstack-infra11:37
*** adrian_otto has quit IRC11:42
*** yamamoto has joined #openstack-infra11:46
openstackgerritMerged openstack-infra/storyboard: Update story.updated_at when tags are updated  https://review.openstack.org/38778311:46
*** lucas-afk is now known as lucas-sick11:47
*** yamamoto_ has joined #openstack-infra11:47
*** EricGonczer_ has joined #openstack-infra11:48
openstackgerritMerged openstack-infra/storyboard: Update story.updated_at when comments added  https://review.openstack.org/38778411:48
*** thorst_ has joined #openstack-infra11:49
*** mkoderer has joined #openstack-infra11:49
*** zhurong has joined #openstack-infra11:49
*** tqtran has joined #openstack-infra11:50
*** yamamoto has quit IRC11:51
*** adrian_otto has joined #openstack-infra11:51
*** kzaitsev_mb has joined #openstack-infra11:52
*** abregman is now known as abregman|afk11:52
jlvillalTrying to get patches merged so we can get Ironic multi-node testing working. This devstack-gate one is next in line:  https://review.openstack.org/#/c/364830  Currently has one +2. Help appreciated :)11:54
*** tqtran has quit IRC11:55
*** askb has quit IRC11:55
*** kzaitsev_mb has quit IRC11:56
*** adrian_otto has quit IRC11:57
*** makowals_ has joined #openstack-infra11:58
*** makowals has quit IRC11:59
*** ralonsoh_ has joined #openstack-infra12:01
*** ralonsoh has quit IRC12:02
*** kgiusti has joined #openstack-infra12:04
*** dprince has joined #openstack-infra12:06
*** kgiusti has quit IRC12:08
*** gouthamr has joined #openstack-infra12:09
*** kgiusti has joined #openstack-infra12:09
*** dizquierdo has joined #openstack-infra12:12
*** Naeil has quit IRC12:12
openstackgerritJohn L. Villalovos proposed openstack-infra/project-config: Add experimental ironic grenade multitenant job  https://review.openstack.org/38823912:13
*** kzaitsev_mb has joined #openstack-infra12:15
openstackgerritMerged openstack-infra/shade: Remove useless mocking in tests/unit/test_shade.py  https://review.openstack.org/38860412:16
*** raildo has joined #openstack-infra12:16
*** GheRivero has left #openstack-infra12:17
mordredrcarrillocruz: if you get a sec, could you review Ghe's patch: https://review.openstack.org/#/c/386551/ ?12:18
openstackgerritDirk Mueller proposed openstack-infra/irc-meetings: Adjust requirements team meeting  https://review.openstack.org/38866212:19
*** baoli has joined #openstack-infra12:19
*** rhallisey has joined #openstack-infra12:19
*** links has joined #openstack-infra12:20
*** baoli_ has joined #openstack-infra12:20
*** yamamoto_ has quit IRC12:21
*** dizquierdo has quit IRC12:21
*** yamamoto has joined #openstack-infra12:22
*** baoli has quit IRC12:24
*** wewe0901 has quit IRC12:25
*** mriedem has joined #openstack-infra12:26
*** trown|outtypewww is now known as trown12:26
*** ssbarnea has quit IRC12:28
*** ssbarnea has joined #openstack-infra12:28
*** yamamoto has quit IRC12:29
*** amotoki has quit IRC12:29
*** EricGonczer_ has quit IRC12:30
*** yamamoto has joined #openstack-infra12:30
*** Naeil has joined #openstack-infra12:30
rcarrillocruzmordred: bank holiday today, not around. I can look later12:31
*** yamamoto has quit IRC12:31
openstackgerritMerged openstack-infra/tripleo-ci: Set TRIPLEO_ROOT before it is first used  https://review.openstack.org/38854212:33
*** abregman|afk is now known as abregman12:33
openstackgerritDirk Mueller proposed openstack-infra/irc-meetings: Adjust requirements team meeting  https://review.openstack.org/38866212:34
*** tpsilva has joined #openstack-infra12:36
*** rlandy has joined #openstack-infra12:38
*** vikrant has quit IRC12:40
*** yamamoto has joined #openstack-infra12:40
*** mnaser has quit IRC12:40
*** bjolo_ has joined #openstack-infra12:40
*** afazekas has quit IRC12:41
*** afazekas has joined #openstack-infra12:42
openstackgerritMerged openstack-infra/irc-meetings: Adjust requirements team meeting  https://review.openstack.org/38866212:43
*** bjolo__ has quit IRC12:43
*** mnaser has joined #openstack-infra12:44
*** rakhmerov has quit IRC12:44
*** kzaitsev_ws has quit IRC12:44
*** jaosorior has quit IRC12:44
*** kzaitsev_ws has joined #openstack-infra12:44
*** mfedosin has quit IRC12:44
*** jaosorior has joined #openstack-infra12:44
*** mfedosin has joined #openstack-infra12:45
*** yamamoto has quit IRC12:45
*** woodster_ has joined #openstack-infra12:45
*** rakhmerov has joined #openstack-infra12:45
*** tlian has joined #openstack-infra12:46
*** jpena is now known as jpena|lunch12:48
*** ssbarnea has quit IRC12:50
*** ssbarnea has joined #openstack-infra12:50
*** jheroux has joined #openstack-infra12:51
*** maeker has joined #openstack-infra12:52
*** amoralej is now known as amoralej|lunch12:52
*** Goneri has joined #openstack-infra12:53
*** pilgrimstack has joined #openstack-infra12:56
*** hurgleburgler has joined #openstack-infra12:58
*** sdake_ has joined #openstack-infra12:58
*** sdake_ has quit IRC12:58
*** sdake_ has joined #openstack-infra12:58
mordredrcarrillocruz: enjoy the holiday!12:59
*** links has quit IRC12:59
*** Jeffrey4l has quit IRC12:59
openstackgerritMiguel Angel Ajo proposed openstack-infra/project-config: Move octavia multinode scenario to check queue  https://review.openstack.org/38868612:59
*** xyang1 has joined #openstack-infra12:59
*** sdake has quit IRC13:02
*** dizquierdo has joined #openstack-infra13:03
*** makowals_ has quit IRC13:03
openstackgerritMiguel Angel Ajo proposed openstack-infra/project-config: Move octavia multinode scenario to check queue  https://review.openstack.org/38868613:04
*** jordanP has joined #openstack-infra13:04
*** psilvad has quit IRC13:05
*** dtardivel has joined #openstack-infra13:06
*** drifterza has quit IRC13:07
*** makowals has joined #openstack-infra13:07
*** psilvad has joined #openstack-infra13:08
*** jcoufal_ has joined #openstack-infra13:09
*** StevenK has quit IRC13:09
*** dizquierdo has quit IRC13:09
*** gordc has joined #openstack-infra13:09
*** florianf has quit IRC13:10
*** yamamoto has joined #openstack-infra13:10
Zara(oh yeah, given that I was looking at rendering things in cgit yesterday, and then it came up coincidentally in the infra meeting, I figured my notes might be of interest to someone, though they're sketchy and may not be 100% accurate, just my understanding so far. http://paste.openstack.org/show/586377/ )13:11
*** ssbarnea has quit IRC13:11
*** ralonsoh_ has quit IRC13:11
*** ssbarnea has joined #openstack-infra13:11
*** ralonsoh has joined #openstack-infra13:11
*** jcoufal has quit IRC13:12
*** amitgandhinz has joined #openstack-infra13:14
*** StevenK has joined #openstack-infra13:15
*** ssbarnea has quit IRC13:15
*** ssbarnea has joined #openstack-infra13:16
*** mdrabe has joined #openstack-infra13:17
mordredinfra-root: landing the zuul remove async changes - will restart a launcher once they land13:17
*** mugsie has joined #openstack-infra13:17
*** jaosorior is now known as jaosorior_brb13:17
*** cardeois has joined #openstack-infra13:18
openstackgerritmatthew wagoner proposed openstack-infra/shade: Add test for os_keystone_domain Ansible module  https://review.openstack.org/38869713:20
*** dizquierdo has joined #openstack-infra13:22
*** amotoki has joined #openstack-infra13:22
*** florianf has joined #openstack-infra13:23
*** matt-borland has joined #openstack-infra13:23
*** yamamoto has quit IRC13:23
*** yamamoto has joined #openstack-infra13:24
openstackgerritMonty Taylor proposed openstack-infra/shade: Don't fail on trying to delete non-existant images  https://review.openstack.org/38870213:25
jeblairmordred: looks like we need https://review.openstack.org/388268 in the master branch13:26
cloudnullmornings13:26
*** spzala has joined #openstack-infra13:27
openstackgerritJames E. Blair proposed openstack-infra/zuul: Add pillow dependency libjpeg-dev to bindep  https://review.openstack.org/38870313:27
*** rlandy has quit IRC13:27
jeblairmordred: ^13:27
mordredjeblair: +213:27
openstackgerritMonty Taylor proposed openstack-infra/shade: Add abililty to find floating IP network by subnet  https://review.openstack.org/38870513:27
mordredjeblair: is the logic in the lock there ^^ a good example of what you were thinking in the other patch?13:28
*** rlandy has joined #openstack-infra13:28
rm_workwait didn't we run into the exact same pillow libjpeg issue like a year ago? lol13:28
*** rlandy has quit IRC13:29
*** rlandy has joined #openstack-infra13:29
mordredjeblair: shall I just rebase the async patches on top of that? or just wait for it to land?13:30
jeblairmordred: that will only ever run once; is that intended?13:30
mordredjeblair: yes13:30
mordredthat info changing in a FIP cloud would be highly strange13:30
jeblairmordred: i'd probably just wait for it to land, shouldn't take too long13:31
mordredjeblair: cool13:31
fungirm_work: yep, but we weren't using bindep to document zuul's non-python package dependencies back then13:31
rm_workah. doomed to repeat history due to lack of documentation? T_T13:31
jeblairmordred: it's not conceivable for new routers to show up or something?13:32
openstackgerritThierry Carrez proposed openstack-infra/irc-meetings: Remove old weekly ArchWG meeting duplicate  https://review.openstack.org/38870813:33
mordredin the scenario this is trapping for, not really. if you get to this code the cloud is HELLA strange and does not show you the external network. that means you can't create a router13:33
jeblairmordred: i think the locking logic works13:34
mordredhowever, even if you could, it's the external_network_id we're looking for - so even if you did, it would still be pointing to a new one13:34
mordredjeblair: awesome13:34
mordredjeblair: I am sad that the patch is needed13:34
mordredclarkb: btw - that patch (https://review.openstack.org/388705) should fix yesterday's problem13:37
jeblairmordred: it's not quite what i would do for the other patch, but that's a slightly different program flow13:37
*** mtanino has joined #openstack-infra13:37
openstackgerritMerged openstack-infra/zuul: Add pillow dependency libjpeg-dev to bindep  https://review.openstack.org/38870313:37
jeblairmordred: ^13:37
mordredjeblair: woot!13:38
openstackgerritMerged openstack-infra/zuul: Add pillow dependency libjpeg-dev to bindep  https://review.openstack.org/38826813:38
*** yamamoto has quit IRC13:39
*** sandanar_ has quit IRC13:41
*** ssbarnea has quit IRC13:42
*** ssbarnea has joined #openstack-infra13:42
jeblaircinerama: thanks for the change to re-enable the test and for that ^ it was ready just in time :)13:44
*** abregman is now known as abregman|afk13:44
*** larainema has quit IRC13:45
*** inc0 has joined #openstack-infra13:46
openstackgerritMonty Taylor proposed openstack-infra/shade: Fix string formatting error in error case  https://review.openstack.org/38871013:46
*** ijw has joined #openstack-infra13:48
*** shardy has quit IRC13:48
Shrewsmordred: why can't that fip by subnet change just check and return self._floating_network_by_subnet if it's not None?13:48
Shrewsmordred: outside the acquire13:49
jeblairShrews: it could but it would need a second check inside the acquire13:49
jeblair(maybe that's desired; depends on what code path you want to optimize)13:50
Shrewsjeblair: the way i read that, that code inside the lock will only ever run once. so i don't see the need for the check inside13:50
openstackgerritMonty Taylor proposed openstack-infra/shade: Potential fix for thundering herd  https://review.openstack.org/38871413:51
openstackgerritMerged openstack-infra/zuul: Rename zuul_runner to command  https://review.openstack.org/36960313:51
jeblairShrews: it will, unless you move the 'has run once' check outside the lock, then it will run up to the number of threads that manage to call it while the first run is holding the lock.13:51
*** hichihara has joined #openstack-infra13:52
mordredyah13:52
mordredthundering herd + run once and only once13:52
mordredjeblair: is that https://review.openstack.org/388714 a better application of the idea to jordan's issue?13:53
*** ijw has quit IRC13:53
*** vsaienko has quit IRC13:54
*** caowei has joined #openstack-infra13:54
fungiZara: great notes! that looks similar to what pleia2 was trying out a while back for rst/md rendering and syntax highlighting options13:54
openstackgerritMerged openstack-infra/zuul: Use command module instead of zuul_runner  https://review.openstack.org/36960413:54
openstackgerritMerged openstack-infra/zuul: Put script string in directly instead of in files  https://review.openstack.org/36960513:54
*** amitgandhinz has quit IRC13:54
openstackgerritMerged openstack-infra/zuul: Stop running commands with async  https://review.openstack.org/37173313:54
openstackgerritMerged openstack-infra/zuul: Split playbook into vars, pre-playbook and playbook  https://review.openstack.org/37173413:54
openstackgerritMerged openstack-infra/zuul: Enable pipelining for ansible-playbook  https://review.openstack.org/33149913:55
mordredwoot13:55
*** amitgandhinz has joined #openstack-infra13:55
jeblairmordred: i thought i solved this already?13:55
jeblairmordred: was there a problem with my proposed solution?13:55
*** ssbarnea has quit IRC13:56
*** dstanek has left #openstack-infra13:56
openstackgerritmatthew wagoner proposed openstack-infra/shade: Add test for os_keystone_domain Ansible module  https://review.openstack.org/38869713:56
*** kzaitsev_mb has quit IRC13:57
mordredjeblair: he had a question about implementing your proposed solution, I responded, he had a question about that, so I wrote a patch that I think implements your proposal, no?13:57
*** amoralej|lunch is now known as amoralej13:57
*** hongbin has joined #openstack-infra13:58
jeblairmordred: oh, i see.  my proposal did not include an instance variable.13:58
jeblairmordred: i will write the code for my proposal in comments on jordan's change.13:58
Zarafungi: yeah, I think it's very similar; syntax-hilighting uses the syntax-hilighting.py script in the top level of the filters directory there. (I'm currently looking at trying to integrate blockdiag, but so far everything is on fire. will post results if I get further with it, though).13:58
mordredjeblair: cool13:59
*** ralonsoh_ has joined #openstack-infra14:00
*** tnovacik has quit IRC14:00
fungiZara: good luck with fire fighting. curious to know what you end up doing with rendering, though where we got stuck is that there doesn't seem to be a good way to have both a rendered and source view of the same files in cgit14:00
*** vsaienko has joined #openstack-infra14:00
*** flepied has quit IRC14:00
*** ralonsoh has quit IRC14:01
*** ralonsoh_ is now known as ralonsoh14:01
*** flepied has joined #openstack-infra14:01
*** EricGonczer_ has joined #openstack-infra14:01
*** larainema has joined #openstack-infra14:01
*** ssbarnea has joined #openstack-infra14:01
openstackgerritJohn L. Villalovos proposed openstack-infra/project-config: Add experimental ironic grenade multitenant job  https://review.openstack.org/38823914:02
*** EricGonczer_ has quit IRC14:02
Zarafungi: yeah, I think short of adding another tab for a rendered view upstream, it's going to be a tradeoff. and I don't yet know whether upstream would consider that or how possible it would be to implement.14:02
*** jpena|lunch is now known as jpena14:02
mordredjeblair: k. I've added zl01.o.o to the emergency file and am going to update zuul there14:03
*** EricGonczer_ has joined #openstack-infra14:03
*** amotoki has quit IRC14:03
fungiZara: purely for a rendered readme, it seems like pumping something into the about tab content might be the way to go14:04
fungibut i haven't played around with that yet14:04
fungithough i do have an aging gitweb instance for some of my personal projects i'm eager to try swapping out for cgit, so may play with that a little if i get time14:04
jeblairmordred: updated https://review.openstack.org/387934 with code14:04
*** ssbarnea has quit IRC14:04
Shrewsjeblair: mordred: i tried to explain myself better in a comment on 38870514:05
*** EricGonczer_ has quit IRC14:05
Shrewsi may have failed14:05
jeblairmordred: it's going to be really hard to pull the code out of that because of all the other comments.  i could pastebin a clean copy if you want14:05
zulone question.....what generates this https://releases.openstack.org/ocata/index.html ?14:05
fungizul: a job for the release repo i think. looking now14:06
Zarafungi: yeah, ideally we wanted to try this for any file with an extension .md or similar... though at some point it makes more sense to use a dedicated docs tool, really. but I'm having fun seeing how much cgit can do.14:06
*** ssbarnea has joined #openstack-infra14:07
mordredjeblair: nope. makes sense to me14:07
fungiZara: fwiw, i've written some very simple cgis in the past that just wrap docutils calls to auto-render on request14:07
fungithere's not much to it14:07
Shrewsjeblair: mordred: Oh! I just answered my own question. I had to look more closely at the initial case.14:08
Shrewsso, nm14:08
mordredShrews: sweet14:09
*** ramishra has quit IRC14:10
jeblairShrews: yeah; i agree the non-initial case is suboptimtal (there is no need for the lock), but the lock is needed in the initial case.  if we wanted to optimize the non-initial case, then i would say put a check outside the lock, but we still need it inside the lock for the initial case.14:10
*** pilgrimstack has quit IRC14:10
Shrews*nod* I'm still pre-second-cup-of-coffee14:10
*** pilgrimstack has joined #openstack-infra14:10
fungizul: it's the static-releases-publish job running for changes merged to the openstack/releases repo. the job is built from this template http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/static-publish-jobs.yaml14:11
jeblairget that man a coffee, stat!14:11
mordredjeblair: so - for restarting the launcher and watching what's going on - do you recommend just restarting via init script and watching debug log? or running in the foreground?14:12
*** lykinsbd has joined #openstack-infra14:12
*** vsaienko has quit IRC14:12
jeblairmordred: init + debug log14:12
mordredawesome. I do that now14:12
fungizul: basically, it just does a `tox -e venv python setup.py build_sphinx` in openstack/releases and then publishes the resulting content from doc/build/html14:12
jeblairmordred: wait a sec14:12
mordredI wait14:12
*** sdake_ has quit IRC14:12
fungizul: does that answer your question?14:13
jeblairmordred: ok.  the init script will do a hard stop.  i think that's fine (jobs will be relaunched).  if that's what you want (i recommend it), carry on.14:13
Zarafungi: hm, may look into that, thanks for the tip :)14:13
*** lykinsbd_ has joined #openstack-infra14:14
*** burgerk has joined #openstack-infra14:14
jeblairmordred: (if you wanted to graceful stop, you would need to 'zuul-launcher graceful')14:14
*** xarses has quit IRC14:14
*** jordanP has quit IRC14:15
fungiZara: i've used it, for example, as an apache filter to generate rendered readme content for mod_autoindex, for example14:15
fungier, one too many for examples there14:15
Zara:)14:16
*** Julien-zte has joined #openstack-infra14:16
*** edtubill has joined #openstack-infra14:16
*** edtubill has quit IRC14:16
*** lykinsbd has quit IRC14:17
*** ramishra has joined #openstack-infra14:17
fungiZara: actual working page (creative use of apache filters and cgi to hackishly embed mod_autoindex browsing into a wordpress-based site): http://mudpy.org/res/src/14:17
*** ssbarnea has quit IRC14:17
*** EricGonczer_ has joined #openstack-infra14:17
mordredjeblair: cool. yeah - I think hard-stop is correct this morning14:17
*** edtubill has joined #openstack-infra14:17
*** ssbarnea has joined #openstack-infra14:17
*** EricGonczer_ has quit IRC14:18
*** pilgrimstack has quit IRC14:18
mordredjeblair: I have restarted14:19
Zarafungi: hahaha, I started searching your name to see if I could find the example, now I can feel less creepy14:19
Zarathanks14:19
jeblairfungi: that reminds me of poo14:19
*** ijw has joined #openstack-infra14:20
jeblairhttp://www.strout.net/info/coding/python/poo/14:20
mordredjeblair: it at least has not immediately fallen over14:21
mordredjeblair: I do not think the install took :(14:22
fungiZara: oh, here's a (rudimentary) example of rst rendered on the fly: http://fungi.yuggoth.org/weather/doc/14:22
mordredjeblair: I just looked in a random tmp dir and I'm still seeing playbooks with async and no pre-playbook14:23
fungiZara: clicking on any of those files in the autoindex calls an appache file handler for rst files14:23
*** burgerk_ has joined #openstack-infra14:23
*** rbrndt has joined #openstack-infra14:23
fungijeblair: hah. poo is an excellent name14:23
jeblairmordred: hrm. it looks like it should have been installed about 15 minutes before you restarted14:24
mordredyah. that's when I installed it14:24
mordredI has very confused14:24
timrcjeblair: I'm glad you quickly provided some context :)14:24
*** Swami_ has joined #openstack-infra14:24
*** Swami has joined #openstack-infra14:24
mordredjeblair: I'm going to stop the launcher again14:24
*** EricGonczer_ has joined #openstack-infra14:24
timrcThe first thing I see when I come to this window "that reminds me of poo"14:24
*** ijw has quit IRC14:24
*** Swami_ has quit IRC14:24
fungiZara: aha, here's the example i was looking for... autorendered readme in the mod_autoindex output http://fungi.yuggoth.org/weather/src/14:25
*** jaosorior_brb is now known as jaosorior14:25
*** burgerk has quit IRC14:26
mordredjeblair: ok. I have no clue what happened before, but I have now verified that after pip installing /opt/zuul the files in /usr/local have the expected content14:26
jeblairmordred: zuul-launcher --version jumped from dev12 to dev2414:27
mordredyah14:27
mordredwhich is what the pip install reported14:27
fungiZara: the cgi that does that is ~30 lines of python, but mostly it's just doing docutils.core.publish_string()14:27
mordredjeblair: I'm starting again14:27
*** rossella_s has quit IRC14:28
*** jtomasek_ has joined #openstack-infra14:28
*** jistr is now known as jistr|call14:28
*** rossella_s has joined #openstack-infra14:28
*** Swami has quit IRC14:29
openstackgerritThanh Ha proposed openstack-infra/jenkins-job-builder: Update mailer plugin  https://review.openstack.org/37314514:30
mordredjeblair: I saw what looked like ansible invocation errors in the log - I have stopped the launcher and am investigating14:31
*** esikachev has joined #openstack-infra14:31
jeblairmordred: k. lemme know if you want me to look14:31
zxiiroelectrofelix: are you going to be at openstack summit next week?14:31
Zarafungi: ah, cool, I need to learn more about apache file descriptors more generally but it looks like a neat trick to use. I get the impression that's best where you can safely say 'render everything as rst' or specify files, so it'd be less appropriate for something where you only want to render a subset of files a certain way, and you don't know in advance what they would be?14:31
hwoarangTheJulia: quick question. Is LOG.error("File does not appear to be JSON or YAML - %s" % e) on purpose in bifrost/inventory.py? I think ansible-playbook does not like this line being in the output as it can't parse the rest of the output? but i am not sure why I am seeing this now14:32
*** baoli_ has quit IRC14:32
hwoarangi think it should have been Log.debug instead14:32
*** markvoelker has quit IRC14:33
mordredjeblair: WELL - the multi-line output certainly didn't work14:33
mordredI will now attempt to answer why not14:34
mordredthe other stuff looks good14:34
fungiZara: pretty much. messy example of the apache config for one of those sites: http://paste.openstack.org/show/586401/14:34
timrcZara: The less you know about Apache, the happier you'll be in life.  That's my theory at least! :P JK14:34
fungiZara: ExtFilterDefine is where the magic happens14:35
timrcZara: But maybe because I recently spent a few days doing reverse proxy voodoo in Apache.14:35
timrcthat's because^14:35
openstackgerritMerged openstack-infra/shade: Add abililty to find floating IP network by subnet  https://review.openstack.org/38870514:35
*** burgerk_ has quit IRC14:35
jeblairmaybe not enough or too much escaping?  2016-10-19 14:30:38,544 DEBUG zuul.NodeWorker.centos-7-rax-ord-5007663: Ansible output:       \ \\\n    || true\n"14:36
mordredyah14:36
mordredthat's why I'm poking at right now14:36
jeblaircool14:36
*** ijw has joined #openstack-infra14:37
Zarafungi: ah, nice, thanks (heh, the cgit filter is also called rst2html; assuming it's a convention)14:37
Zaratimrc: haha, as I learn more I'll have to record happiness levels so I can be a human experiment.14:38
fungiZara: well, there's an "rst2html" utility provided as an example script with docutils, so could also be a reference to that14:39
*** Kevin_Zheng has quit IRC14:39
* Zara opens it up14:40
Zarastarts with 'exec rst2html.py'14:40
Zaralooks likely.14:40
*** john-davidge has quit IRC14:40
*** Kevin_Zheng has joined #openstack-infra14:41
fungithe script is basically just a wrapper for the docutils.core.publish_cmdline() entrypoint14:41
*** ijw has quit IRC14:41
*** andymaier has joined #openstack-infra14:42
*** hichihara has quit IRC14:42
*** psilvad has quit IRC14:42
timrcZara: there is a flask module that does rst->html on the fly https://flask-rstpages.readthedocs.io/en/latest/14:45
*** eharney has joined #openstack-infra14:45
*** eharney has quit IRC14:45
*** eharney has joined #openstack-infra14:46
TheJuliahwoarang: Yup, looking at it again, it should be LOG.debug.  I should have changed that when I added support for pulling the inventory via shade.  I guess your not defining an ipv4_address?14:47
*** sdake has joined #openstack-infra14:48
*** reed__ has joined #openstack-infra14:49
*** tnovacik has joined #openstack-infra14:49
*** yamahata has joined #openstack-infra14:49
sc`cloudnull: it seems there is a proposed change for creating a gem mirror, but it hasn't moved much14:50
cloudnullmornings sc`14:50
sc`morning :D14:50
*** jaosorior has quit IRC14:50
hwoarangTheJulia: i think i am getting this because the file is indeed a csv one and hence i hit the exception14:50
cloudnullinteresting. do we think the gem issues are mirror related?14:50
*** jtomasek_ has quit IRC14:50
hwoarangwhich is what i have been doing all along, but somehow now it triggers the problem. anyway i will send a patch to change it to log.debug14:51
TheJuliahwoarang: Oh, interesting.  There could likely be an issue in the CSV parsing. :(14:51
cloudnullI guess the connections wouldn't/shouldn't timeout if there was an OS gem mirror.14:51
cloudnulland we'd have a AAAA os OSIC would be generally happier.14:52
hwoarangTheJulia: if I am not mistaken, the code looks for yaml or json, if it can't find one, it goes into the exception, prints the error and tries csv as fallback14:52
sc`cloudnull: it seems that rubygems.org is _very_ flaky. i was enlightened to https://storyboard.openstack.org/#!/story/2000247 which spawned a change of https://review.openstack.org/#/c/253616/ way back in december of 201514:52
cloudnull's/os OSIC/so OSIC/'14:52
sc`cloudnull: yeah. rubygems also doesn't do ipv614:52
*** mkoderer has quit IRC14:52
hwoarangbut printing the error in stderr, makes ansible-playbook crazy because it's not a valid input for it14:52
TheJuliahwoarang: *goes and looks since it has been a very long time since I've looked at it*14:52
TheJuliahwoarang: yup, your right.  Weird...14:53
cloudnullso no v6 means all of that traffic is going over the v4 subnet through a router which is potentially slow.14:53
*** yamahata has quit IRC14:54
*** yamahata has joined #openstack-infra14:54
*** ijw has joined #openstack-infra14:55
fungicloudnull: and also getting port address translated on the way out, so potentially overrunning the available port range for connections from the overload address to that destination under load14:55
*** annegentle has joined #openstack-infra14:55
cloudnull^14:55
fungior overrunning a translation table or any number of other limited resources there14:55
sc`sounds like not good eats14:55
mordredjeblair: ok. I have a reproducible isolated test case that produces the same extra-quoted output14:56
mordredjeblair: I'm going to hack for a few minutes to see what's up with it14:56
jeblairmordred: cool.  i'm going to eat breakfast14:56
*** psilvad has joined #openstack-infra14:56
fungicloudnull: sc`: or could even be some manner of throttling/ddos mitigation at the far end freaking out because it sees too many connections or requests inbound from a single ip address14:57
*** caowei has quit IRC14:57
cloudnull^ also a good point.14:57
sc`yeah. hard to say what is going on on the other end14:57
fungiand that's just the tip of the iceberg for why i hate nat ;)14:57
cloudnullnat is a hack14:58
timrcReally glad my name is not Nat.14:58
openstackgerritMerged openstack-infra/jenkins-job-builder: Update mailer plugin  https://review.openstack.org/37314514:58
cloudnullhahaha.14:58
Zaratimrc: will look at that too, thanks14:58
* cloudnull quickly scans nics for "nat"14:58
hwoarangTheJulia: right. so i am guess i am seeing this because for whatever reason my stderr is redirected to stdout or something. anyway14:58
*** esikachev has quit IRC14:58
hwoarangwill fix it14:58
fungitimrc: you could just go by "nate" in that case. problem solved14:58
*** marst has joined #openstack-infra14:59
*** Julien-zte has quit IRC14:59
timrcfungi: Nate King Cole? Really????14:59
*** ijw has quit IRC14:59
fungisure. gotta roll with the times14:59
*** Julien-zte has joined #openstack-infra15:00
*** krtaylor has joined #openstack-infra15:00
*** Julien-zte has quit IRC15:00
*** ijw has joined #openstack-infra15:01
timrcsed -i "s/Natty Light/Natey Light" fridge15:01
*** Julien-zte has joined #openstack-infra15:01
cloudnullfungi: if you have thoughts/designs on making things happier I'd love to give them a go. cloud1 is only using the reference drivers so if there are things we can do to make general lives easier I'm all for that.15:01
*** Julien-zte has quit IRC15:01
*** Julien-zte has joined #openstack-infra15:01
*** Julien-zte has quit IRC15:02
fungicloudnull: well, the aforementioned gem mirror is probably a good bet for this particular issue anyway15:02
*** Julien-zte has joined #openstack-infra15:02
*** zhurong has quit IRC15:02
*** Julien-zte has quit IRC15:03
sc`the failures are pretty consistent. i can't even get a good integration run due to rubygems general flakiness15:03
*** armax has joined #openstack-infra15:03
*** Julien-zte has joined #openstack-infra15:03
mriedemlooks like pillow 3.4.2 released yesterday is breaking jobs15:03
fungicloudnull: more generally, would need to know if the router you have doing nat is struggling in some particular way (in which case there could be some configuration/tuning options)15:03
mriedemhttp://logs.openstack.org/34/388134/1/check/gate-openstack-ansible-os_ceilometer-ansible-func-ubuntu-xenial/117f9d3/console.html#_2016-10-19_14_51_20_86922515:03
*** Julien-zte has quit IRC15:03
*** sdake has quit IRC15:04
sc`bbl meetings15:04
*** sdake_ has joined #openstack-infra15:04
*** Julien-zte has joined #openstack-infra15:04
njohnstonSpeaking on behalf of all technically-minded people named Nathaniel, we would all like NAT to just die please.15:04
*** Julien-zte has quit IRC15:04
*** Julien-zte has joined #openstack-infra15:05
*** ijw has quit IRC15:05
*** Julien-zte has quit IRC15:05
cloudnullnjohnston: +1 and i'd like to subscribe to your newsletter :p15:05
mriedemu-c caps pillow at 3.4.1 https://git.openstack.org/cgit/openstack/requirements/tree/upper-constraints.txt#n1415:05
mriedembut 3.4.2 is slipping in15:06
*** xarses has joined #openstack-infra15:06
cloudnullfungi: while we have lots of traffic over that router, we're not seeing it "struggle" nor are we seeing resource exhaustion.15:06
cloudnullbut it's also 100% possible that i'm simply not looking at the right things .15:06
fungiyeah, then i'm betting the main gems site is just overloaded and performing poorly for everyone15:07
*** simondodsley has joined #openstack-infra15:07
cloudnullespecially since i've only had 1 cup of coffee this morning15:07
fungicloudnull: hrm, though rubygems.org is using a cdn (fastly), so maybe it's the fastly endpoints getting served up to osic which are having trouble15:08
fungimriedem: most likely it's "slipping" into jobs that don't use upper-constraints?15:09
fungii got the impression openstack-ansible is still looking into implementing constraints in their jobs15:09
mriedemmaybe, i was looking at openstack/ansible and it has u-c in tox https://github.com/openstack/openstack-ansible/blob/master/tox.ini#L1115:10
cloudnullodyssey4me: has been doing a bunch of u-c work.15:10
fungii think they had the boilerplate for it in their tox.ini but their job templates weren't setting up the file for it to use15:10
*** lin_yang has quit IRC15:11
mriedemas does this https://github.com/openstack/openstack-ansible-os_ceilometer/blob/master/tox.ini#L1015:11
odyssey4mefungi yeah, we've been using it for almost all jobs - only out functional jobs weren't able to15:11
mriedemah https://github.com/openstack/openstack-ansible-os_ceilometer/blob/master/tox.ini#L10615:11
odyssey4meyesterday AJaeger and pabelanger helped me find the missing job that sets down the u-c file15:12
*** pradk has quit IRC15:12
cloudnullwork in progress https://review.openstack.org/#/q/topic:use-upper-constraints+status:open15:12
*** jistr|call is now known as jistr15:12
odyssey4meso today I've been pushing up changes ot make sure that newton onwards uses u-c for everything15:12
mriedemok i'll remove the e-r query that started spiking again15:12
*** ihrachys has quit IRC15:12
fungigood deal15:12
odyssey4mewe also discovered a few kinks in our repeatable deployment system, which that topic is working on fixing up15:13
*** paul_ is now known as _15:13
*** Guest90211 has quit IRC15:13
*** itisha has joined #openstack-infra15:13
*** _ is now known as Guest6254115:14
*** Guest62541 has left #openstack-infra15:14
*** pcaruana has quit IRC15:14
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Remove query for pillow 3.0.0 bug 1501995  https://review.openstack.org/38875215:14
openstackbug 1501995 in OpenStack-Gate "Pillow 3.0.0 breaks the world" [Undecided,Fix released] https://launchpad.net/bugs/1501995 - Assigned to Anita Kuno (anteaya)15:14
*** srobert has joined #openstack-infra15:15
*** rcernin has quit IRC15:16
*** pradk has joined #openstack-infra15:17
*** chandanc has joined #openstack-infra15:18
*** tnovacik has quit IRC15:18
chandanchello dougwig15:20
*** mdrabe has quit IRC15:20
fungianybody happen to know who added the huawei/meghdwar/senlin topic and time to https://etherpad.openstack.org/p/infra-ocata-summit-planning ?15:21
pleia2I don't know15:21
fungii think someone has a misunderstanding about what the infra team is/does15:21
*** lin_yang has joined #openstack-infra15:22
openstackgerritMerged openstack-infra/elastic-recheck: Remove query for pillow 3.0.0 bug 1501995  https://review.openstack.org/38875215:22
openstackbug 1501995 in OpenStack-Gate "Pillow 3.0.0 breaks the world" [Undecided,Fix released] https://launchpad.net/bugs/1501995 - Assigned to Anita Kuno (anteaya)15:22
*** gbraad has quit IRC15:24
*** sdake_ has quit IRC15:27
*** baoli has joined #openstack-infra15:28
*** mdrabe has joined #openstack-infra15:29
*** _ari_ is now known as _ari_|ooo15:30
mordredjeblair: ok. I have isolated the problem15:32
openstackgerritMonty Taylor proposed openstack-infra/zuul: Revert "Put script string in directly instead of in files"  https://review.openstack.org/38876815:32
*** andreas_s has quit IRC15:33
mordredjeblair: it's in this ^^ - and more specifically, we have jenkins jobs that have here docs that write yaml to the filesystem15:33
mordredjeblair: the yaml in the here doc is triggering ansible's jinja processing to treat it as part of the yaml doc15:33
mordredbut, of course, it isn't15:33
mordredbut that produces the ansible yaml parse error15:34
mordred(so basically you have to have a shell task that here-docs a yaml file - which of course every single one of our tasks do for the clone map)15:34
mordredsince that's an artifact of jenkins job translation that I do not expect to exist when we're writing these in ansible in the first place, i think we should just revert that prat15:35
mordredpart15:35
mordredhowever, it's going to be a thing we're going to need to address in our jjb-to-ansible transition15:35
mordredthe most frequent instance of it can be handled easily since zuul-cloner macro will go away15:35
jeblairmordred: i think i generally follow and agree with everything you just said, except i don't think i understand why it's triggering the jinja parser... shouldn't all the heredoc stuff be inside of a proper yaml string block?15:37
jeblairmordred: oh because ansible does jinja parsing on strings15:37
mordredjeblair: jinja is processing things ... yah15:37
mordredthe colons are tricking it15:38
jeblairmordred: so it doesn't do "jinja(yaml.load(playbook))"15:38
mordredjeblair: it does not seem to do that, no15:38
jeblairmordred: it does "yaml.loads(jinja(playbook))"15:38
mordredyah15:39
*** e0ne has quit IRC15:39
jeblairneat.15:39
*** jistr is now known as jistr|biab15:39
mordredI do not think this will be a real problem for us when writing actual playbooks, because it's easy enough to parse them with ansible15:39
jeblairyeah15:40
*** rosmaita has joined #openstack-infra15:40
mordredalso - I wrote a patch I never pushed up. I';m going to push it up just for reference15:40
openstackgerritMonty Taylor proposed openstack-infra/zuul: Make script multi-line strings easier to read  https://review.openstack.org/38877215:40
mordredbut I do not think we need it15:40
mordred(I had to hunt through my local reflog to find it)15:40
mordredI will now abandon that15:40
clarkbmordred: jeblair but our heredocs shouldn't have anything in them that jinja will want to replace right?15:41
mordredclarkb: they have yaml in them15:41
clarkbright but yaml without the jinja directives?15:41
clarkbor is the jjb substitution sufficiently similar to jjb that we are colliding?15:42
jeblairmordred: zuul merge error on 38876815:42
clarkber jjb suffiicently similar to jinja15:42
jeblairclarkb: it sounds like there's some yaml-parsing happening at the templating stage (maybe this is also related to how ansible does it's friendly yaml error messages), and that pseudo-yaml parsing isn't quite right?15:44
mordredclarkb: there seem to be many things in the shell snippets that make ansible displeased15:44
*** sree has quit IRC15:44
mordredyah15:44
mordredoh! interesting15:44
mordredit's even worse, actually15:44
mordredthis comment in the script15:44
mordred      # REQS_DIR is not set for openstack/requirements and there's also15:44
mordredalso breaks things15:44
*** sree has joined #openstack-infra15:45
*** baoli has quit IRC15:45
mordredbut this all goes into the category of "generating playbooks from jjb snippets" which is not what we want to be in the business of doing long-term anyway15:46
mordredjeblair: looking15:46
*** links has joined #openstack-infra15:46
AJaegerteam, https://review.openstack.org/#/q/project:openstack/solum+status:open shows a lot of "Submitted, merge pending". I asked to rebase the one change with a merge conflict but the changes are still not merging. Could somebody help here, please?15:47
AJaegerzhurong was the one asking15:47
jlvillalIronic team is trying to get patches merged so we can get Ironic multi-node testing working. This devstack-gate one is next in line:  https://review.openstack.org/#/c/364830  Currently has one +2. Help appreciated :)15:47
mordredclarkb, jeblair: I take back most of my comments. the problem is the single quote in the comment15:48
timrcmordred: Maybe write shells snippets to roles/build_steps/files and then use script to remote execute? I guess that complicates things _but_ it gets bash out of yaml.15:49
mordredtimrc: that's what we were doing before this patch15:49
mordredtimrc: so yeah15:49
mordredtimrc: or, rather, emit the script to a script file, copy the script file over, and use ansible to execute the script file15:49
timrcmordred: Aye.15:50
clarkbmordred: that seems like maybe an ansible bug? like you should be able to have comments in shell scripts with single quotes15:50
openstackgerritvenkata anil proposed openstack-infra/project-config: Create experimental Neutron DVR+HA multinode job  https://review.openstack.org/38374215:51
*** Hal has joined #openstack-infra15:51
*** tqtran has joined #openstack-infra15:51
clarkbmordred: jlvillal and I guess if we continue to write to a file we can incorporate jlvillal's ordering of scripts change toO?15:52
*** panda is now known as panda|bbl15:52
mordredclarkb: yah. I tink that's the right thing to do at this point15:52
jeblairmaybe we can merge jlvillal's change on top of the revert before we restart?15:53
*** cody-somerville has joined #openstack-infra15:54
*** cody-somerville has joined #openstack-infra15:54
*** sree has quit IRC15:54
*** reed__ has quit IRC15:54
jeblairhttps://review.openstack.org/38559115:54
openstackgerritKarthik Prabhu Vinod proposed openstack-infra/project-config: Adding two other combinations of cinder multinode grenade job  https://review.openstack.org/38483615:55
openstackgerritMonty Taylor proposed openstack-infra/zuul: Generate shell scripts as a sequence  https://review.openstack.org/38559115:55
openstackgerritMonty Taylor proposed openstack-infra/zuul: Revert "Put script string in directly instead of in files"  https://review.openstack.org/38876815:55
mordredjeblair: I put jlvillal's on top of the revert there ^^15:55
*** sambetts is now known as sambetts|afk15:56
*** rwsu has quit IRC15:56
*** csomerville has quit IRC15:56
*** tqtran has quit IRC15:56
*** vhosakot has joined #openstack-infra15:56
openstackgerritMarkos Chandras proposed openstack/diskimage-builder: elements: growroot: Add SUSE package mappings  https://review.openstack.org/38878015:57
*** ccamacho is now known as ccamacho|afk15:57
*** Sukhdev has joined #openstack-infra15:57
*** tmorin has quit IRC15:58
*** berendt has joined #openstack-infra15:58
jeblair+215:58
jlvillalmordred: clarkb Thanks!15:58
*** yaume has quit IRC16:05
*** martinkopec has quit IRC16:05
*** jistr|biab is now known as jistr16:05
*** winggundamth_ has joined #openstack-infra16:05
jeblairerror in 385591; fixing16:08
*** marst has quit IRC16:08
*** cody-somerville has quit IRC16:08
openstackgerritJames E. Blair proposed openstack-infra/zuul: Generate shell scripts as a sequence  https://review.openstack.org/38559116:09
jeblairmordred: ^16:09
*** pilgrimstack has joined #openstack-infra16:09
mordredjeblair: thanks!16:09
*** Rockyg has joined #openstack-infra16:11
*** pots has quit IRC16:12
mordredjeblair: hrm. also, jordan tried both of our suggestions and apparently neither worked16:12
*** pots has joined #openstack-infra16:12
*** vhosakot has quit IRC16:12
mordredjeblair: however, there is a nice easy test case16:12
*** vhosakot has joined #openstack-infra16:13
*** mhickey has quit IRC16:13
openstackgerritMerged openstack-infra/zuul: Revert "Put script string in directly instead of in files"  https://review.openstack.org/38876816:14
*** vsaienko has joined #openstack-infra16:14
timrcjeblair: Hm at 'script_fn = '%02d.sh' % str(sequence)' why the str cast?16:14
timrcI get:16:15
timrcTypeError: %d format: a number is required, not str16:15
mordredtimrc: excellent catch16:15
jeblairyeah, that may have slipped in during one of the reworks... timrc you want to fix it? :)16:15
timrcjeblair: Yeah, that could pay for OpenStack summit boston lol.  I kid.  One moment16:16
mordredhaha16:16
*** marst has joined #openstack-infra16:17
openstackgerritTimothy R. Chavez proposed openstack-infra/zuul: Generate shell scripts as a sequence  https://review.openstack.org/38559116:18
*** cody-somerville has joined #openstack-infra16:18
mordred++16:18
timrcI didn't check to actually see whatever calls that is actually passing in int though.16:18
timrcMaybe I should explicit cast int()?16:18
*** matrohon has quit IRC16:19
*** csomerville has joined #openstack-infra16:20
openstackgerritFrederic Lepied proposed openstack-infra/tripleo-ci: Allow to use an RDO review to fix a packaging issue  https://review.openstack.org/38879116:20
*** cody-somerville has quit IRC16:23
*** shamail has joined #openstack-infra16:23
*** vsaienko has quit IRC16:23
*** tnovacik has joined #openstack-infra16:24
jeblairtimrc: it's an int, should be fine.  thanks.  +316:25
*** vhosakot has quit IRC16:25
*** vhosakot has joined #openstack-infra16:26
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Add reno jobs for neutron-lib  https://review.openstack.org/38879516:28
jlvillaltimrc: jeblair: That was my mistake on "%02d" % str(number) :(16:29
openstackgerritMerged openstack-infra/zuul: Generate shell scripts as a sequence  https://review.openstack.org/38559116:29
*** winggundamth_ has quit IRC16:31
*** links has quit IRC16:31
*** bhavik1 has joined #openstack-infra16:32
*** ssbarnea has quit IRC16:33
*** jpich has quit IRC16:34
amrithmordred, clarkb, AJaeger ... anyone else in infra ... is there some difference between the environment that is used for the experimental queue and the regular 'check' queue? I have a job listed in both experimental and check; it passes in check and fails in experimental. Is that normal?16:34
clarkbamrith: no they run on the same set of clouds on the same flavors on the same images16:34
mordredamrith: there should be absolutely no difference16:34
amrithhmm16:35
amrithplease see: https://review.openstack.org/#/c/387977/16:35
*** baoli has joined #openstack-infra16:35
*** vsaienko has joined #openstack-infra16:36
*** baoli has quit IRC16:37
amrithsorry mordred, clarkb16:37
amrithI was wrong16:37
mordredphew. I was worried16:37
amriththey are subtly different jobs16:37
amrithCRAP16:37
*** baoli has joined #openstack-infra16:37
amrithI need more coffee, again16:37
AJaegerinfra-root, https://review.openstack.org/#/q/project:openstack/solum+status:open shows a lot of "Submitted, merge pending". I asked to rebase the one change with a merge conflict but the changes are still not merging. Could somebody help here, please?16:39
* clarkb saw probuscis and wanted to run away so good16:39
*** vhosakot has quit IRC16:39
*** knangia has joined #openstack-infra16:39
*** vhosakot has joined #openstack-infra16:39
cardeoisHello there! I'm trying to do a release of project js-openstack-lib, I'm a core reviewer but I'm getting rejected by gerrit. I guess because I'm not part of js-openstack-lib-release (and nobody is). Does anyone know who I should poke for this issue?16:39
clarkbcardeois: if that is a release managed project then the release team should handle it for you. If it is not release managed we can add a small number of individuals to the release group so that they can push tags16:40
*** ssbarnea has joined #openstack-infra16:41
AJaegerhttps://review.openstack.org/#/admin/groups/1409,members - infra-root is only in release team16:41
AJaegerclarkb, cardeois : This is a repo that is part of OpenStack Infra  according to governance16:41
*** Apoorva has joined #openstack-infra16:41
cardeoisclarkb ok, I'm not sure if it's release managed or not, it should publish a npm package, I'll try to find our16:41
*** watanabe_isao has joined #openstack-infra16:42
mordredAJaeger: weird. I do not think it's an infra project16:42
clarkbAJaeger: interesting, in that case probably fungi is who needs to push releases or delegate it?16:42
AJaegermordred: according to governance: It is.16:42
cardeoisAJaeger mordred yeah right now we are under infra. Ok so I should poke fungi?16:42
AJaegerkrotscheck set it up this way initially AFAIR - somebody needs to check history...16:42
mordredcardeois: definitely fungi then16:43
cardeoisAJaeger mordred ok thanks you guys16:43
timrcjlvillal: Hey no prob! That's why we review :)16:43
jlvillal:)16:43
timrcI'm just glad IBM gave me security certification to do, so I could ignore it and come hang out here instead, today.16:44
mordredjeblair, clarkb: I'm going to start the launcher on zl01 with the new code16:44
krotscheckThere was some arguing about where it should live initially, as there wasn't an SDK program set up yet. Infra seemed to be the best place for it, instead of just going it alone.16:44
clarkbAJaeger: re solum the change number and commit sha1 for the most recent occurance do not show up in the gerrit error log16:44
clarkbAJaeger: and according to cgit none of them have actually merged so not a caching issue16:45
AJaegerclarkb: strange ;(16:45
sc`since there's already a pending review, what would need to occur to make a rubygems mirror a thing? just review/decide?16:46
clarkbsc`: iirc someone needed to figure out how large the mirror needs to be16:46
electrofelixzxiiro: unfortunately not, though I'll try and catch up with some reviews later this week and next, only just caught up with day job after being away16:48
zxiiroelectrofelix: ok sounds good. I'll be travelling so will be missing the next sprint as well. I've tried to stay on top of the etherpad list though16:48
clarkbAJaeger: ok changing my grep patterns has resulted in more useful datas in the lgos let me see if I can put together something16:48
zxiiroelectrofelix: I think we're very close to finishing so hopefully we can push through the final stretch. I'm excited for a new release.16:49
*** winggundamth_ has joined #openstack-infra16:49
clarkbAJaeger: http://paste.openstack.org/show/586437/ it looks like pretty normal merge resolution issues. We have plenty of disk so its not like we couldn't write the objects for that reason16:50
clarkbAJaeger: I do not know why it isn't reporting it as a merge failure in the UI though (that could possibly be a caching issue?)16:50
*** pcaruana has joined #openstack-infra16:51
sc`clarkb: from research (haven't poc'd yet) it seems to be in the low hundreds of gigabytes to do a mirror16:52
*** marst has quit IRC16:52
*** marst_ has joined #openstack-infra16:52
*** watanabe_isao has quit IRC16:52
amrithmonty, clarkb it turns out that they must be subtly different. projects that are cloned from the test framework are writeable but the project that is setup by devstack-gate framework is not writeable. and since I'm trying to get rid of trove-integration, I'm ending up in a readonly project... bugger.16:53
sc`my personal gear has well over that in storage capacity, so i'm tempted to fire up a gem mirror and see what comes out the other side16:53
*** ssbarnea has quit IRC16:53
*** flepied has quit IRC16:53
clarkbamrith: the expectation with devstack-gate is that you will instruct it on what you need then it will give you that and set it up properly for the zuul env. You then are not supposed to touch those repos16:53
*** amitgandhinz has quit IRC16:54
mordredjeblair: so far it does not seem to be falling over16:54
amrithclarkb, YUP!16:54
*** ssbarnea has joined #openstack-infra16:54
amrithbut as you know, trove-integration did weird things16:54
amrithand I'm learning them as we go along ...16:54
clarkbamrith: the reason for this is many many many projects have thought "we know better!" then ended up not actually testing the thing they thought they were testing16:54
openstackgerritDong Ma proposed openstack-infra/jenkins-job-builder: Update performance plugin  https://review.openstack.org/38830716:54
*** derekh has quit IRC16:54
*** watanabe_isao has joined #openstack-infra16:54
amrithoh yes, we know better. it's those other projects that shouldn't be doing things like that; they don't know better :)16:55
amrithunraveling it a bit at a time. this has been a learning experience.16:55
amrithtrove-integration had a reports directory16:55
amrithwhich was (as it turns out) created in the trove-integration source tree itself16:55
amrithwhich is fine on a developers environment16:55
*** bhavik1 has quit IRC16:55
amrithand fine in the old gate16:55
amrithbecause trove-integration was cloned outside of devstack gate16:56
mordredjeblair, clarkb: here is a job that has run with the new code: http://logs.openstack.org/54/377154/1/gate/gate-kolla-docs-ubuntu-xenial/e881978/16:56
amrithbut when I moved the stuff into trove, it because a problem16:56
amrithwhich I'm now fixing16:56
*** Guest41366 is now known as redrobot16:56
*** mugsie has quit IRC16:56
fungicardeois: i'm taking a look now. i'm going to guess from http://git.openstack.org/cgit/openstack/js-openstack-lib/tree/package.json#n3 that you need it tagged as "0.0.1" yes? or do javascript version tags expect a "v" prefix on the name?16:57
clarkbmordred: scripts/ is straight out of a sesame street episode now :)16:57
mordredclarkb: right?16:57
mordredclarkb: I will say - the playbook file is super easy to read now16:57
cardeoisfungi no 0.0.1 is perfect yes!16:57
*** ssbarnea has quit IRC16:57
*** Jeffrey4l has joined #openstack-infra16:58
*** mugsie has joined #openstack-infra16:58
jeblairclarkb, mordred: you're really going to like the patch to move 'scripts' to 'systemd-unit-files'16:58
*** ssbarnea has joined #openstack-infra16:58
mordredjeblair, clarkb: I'm not sure the dest path for scripts is correct- shouldn't it be going into a remote tmpdir we made some other way?16:58
mordredjeblair: or is that right?16:58
docaedoI have a question about merging stuff into a feature branch. Specifically I'll want to merge the stuff in https://review.openstack.org/#/q/status:open+project:openstack/app-catalog+branch:feature/glare-support+topic:bp/glare-work into that branch (not master)16:58
mordredjeblair: http://logs.openstack.org/54/377154/1/gate/gate-kolla-docs-ubuntu-xenial/e881978/_zuul_ansible/playbook16:58
jeblairmordred: oh!  that's probably something we didn't worry about because of uuids16:58
amrithclarkb, see: http://logs.openstack.org/77/387977/6/experimental/gate-trove-functional-dsvm-mysql-nv/02d9e2c/console.html#_2016-10-19_14_18_53_78624716:59
amrith:)16:59
docaedoIs that something I can do?  Or does someone need special powers for that?16:59
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Make bug name, type, and url explicit  https://review.openstack.org/37511316:59
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Add StoryBoard integration for graph commands  https://review.openstack.org/38511216:59
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Add Jira integration for graph commands  https://review.openstack.org/38521716:59
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Wait until the most recent index is available  https://review.openstack.org/38798616:59
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Refactor launchpad code into bug_tracker  https://review.openstack.org/38519916:59
*** gordc has quit IRC16:59
*** yamahata has quit IRC16:59
clarkbamrith: I awnt to say the dirs under /opt/stack are owned by the stack user. And your tox invocation is likely running as jenkins17:00
clarkbyou may be able to sudo/su your way around that17:00
jeblairmordred, clarkb, jlvillal: we should probably make the destination path for the scripts a tempdir, or change the remote filename to a uuid or tempfile.17:00
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: ensure version numbers are always strings  https://review.openstack.org/38881317:00
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: ensure all proposed versions include major.minor.patch values  https://review.openstack.org/38881417:00
clarkbjeblair: mordred jlvillal or maybe do $X_$UUID.sh ?17:01
jeblairclarkb: erm, like the original version of the patch before i told jlvillal to change it?17:02
jeblairoops17:02
*** spzala has quit IRC17:02
clarkboh is that what it did? if so then yes :)17:02
openstackgerritMike Fedosin proposed openstack-infra/project-config: Allow merging code in app-catalog feature branches  https://review.openstack.org/38881517:02
inc0hey guys, I was hoping if any of you could join us on kolla-CI work session, Thu 2:40pm - 3:20pm17:02
*** spzala has joined #openstack-infra17:02
*** e0ne has joined #openstack-infra17:03
jeblairfungi: ^ fyi from inc017:03
inc0aaand I think you have conflict there, I'll try to reschedule our session17:03
*** amoralej is now known as amoralej|off17:04
*** shamail has quit IRC17:04
fungiinc0: yep, that's our task tracking fishbowl timeslot17:04
*** zz_dimtruck is now known as dimtruck17:04
jlvillaljeblair: Sorry chairing a meeting at the moment...17:05
jeblairjlvillal: np.  i'm just going to put your patch back to the way it was before i send you down the wrong path :)17:05
jeblairjlvillal: sorry; i'll take care of it :)17:05
jlvillaljeblair: Thanks! :)17:06
*** spzala has quit IRC17:07
*** johndperkins has joined #openstack-infra17:07
inc0fungi, how about 3:30-4:10 slot?17:07
fungidocaedo: to answer your question, it looks like you just need to approve those changes. are you not seeing the usual code review +1 and workflow +1 options available on them?17:07
amrithclarkb, the dir where it is trying to write is the source tree with the change(s) being submitted. I'd rather not override permissions for this and instead put the reports someplace else.17:07
amrithmethinks a sudo would be easy (if it works) but potentially wrong17:07
fungiinc0: on thursday (the 27th)?17:08
amrithto your earlier point; not sure what exactly is being tested that way.17:08
inc0yes17:08
*** ralonsoh has quit IRC17:08
sc`maybe using gemirro over rubygems-mirror would be more lightweight than trying to mirror the whole of rubygems.org. in my use case, i only have a handful of gems17:08
*** cardeois_ has joined #openstack-infra17:09
*** aviau has quit IRC17:09
*** tqtran has joined #openstack-infra17:09
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: use sequence-uuid in shell scripts  https://review.openstack.org/38881617:09
clarkbamrith: so in the old system where you managed your own checkout chances are good based on historical evidence that it didn't handle the zuul env properly in all cases. That was what I was saying caused problems which is why we have been fairly forceful about trying to get people to let devstack-gate figure it out for them17:09
*** aviau has joined #openstack-infra17:09
clarkbamrith: writing the reports to another dir is prefectly fine too, you should bea ble to write them to $USER's $HOMEDIR17:09
jeblairclarkb, mordred, jlvillal, timrc: https://review.openstack.org/388816 is a cherry-pick of the old version of the patch (so it has jlvillal as author), with a fix for the formatting.17:10
inc0fungi, rescheduled, I guess I hope anyone better at gate-fu could join us there:)17:10
openstackgerritDong Ma proposed openstack-infra/jenkins-job-builder: Update performance plugin  https://review.openstack.org/38830717:10
fungiinc0: yeah, skimming i think we're likely to have no significant infra conflict in that slot17:10
amrithclarkb, there's a convenient environment variable to override this with so I'll use that (REPORT_DIRECTORY)17:10
jlvillaljeblair: I think you will need to import uuid17:10
fungii'm still digging into some of teh work session descriptions to see what they are17:10
jlvillaljeblair: I think that got removed before17:11
jeblairdrat17:11
amrithclarkb, and the code already handles that nicely17:11
inc0cool, I would really appreciate your input there guys17:11
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: use sequence-uuid in shell scripts  https://review.openstack.org/38881617:11
*** cardeois has quit IRC17:11
inc0many thanks17:11
* jlvillal was trying to add a basic skeleton of unit tests for that file.17:11
clarkbinc0: is there a proposed agenda for that session yet?17:11
jeblairjlvillal: don't worry about it17:12
inc0clarkb, what I would like to do is to figure out how to squeeze tests we would like to perform in single gate vm (unless we can do multi-vm)17:12
jeblairjlvillal: it's a development dead-end; the v3 version of that has tests.17:12
jlvillaljeblair: Ah17:12
inc0ideally I'd love to see stuff like full upgrade testing, but that's a stretch17:13
clarkbinc0: ok17:13
inc0and you guys could tell us what is possible, what isn't, what would have to be done to make stuff possible17:13
inc0I'll prepare talking points before sessio17:14
inc0n17:14
*** amitgandhinz has joined #openstack-infra17:14
*** xarses has quit IRC17:14
clarkbinc0: great info like that can help us if we have to split the party due to other conflicts. Seems like we all end up doing that during the summit17:14
fungiinc0: so far biggest infra-interest conflict for that slot is "Requirements: What does the future look like?" (fishbowl)17:15
*** amitgandhinz has quit IRC17:15
*** e0ne has quit IRC17:15
*** berendt has quit IRC17:16
*** asselin has quit IRC17:16
*** amitgandhinz has joined #openstack-infra17:16
*** e0ne has joined #openstack-infra17:16
inc0yeah I think it's impossible to make conflict-less schedules17:17
inc0openstack-summit-world problems17:17
*** jcoufal_ is now known as jcoufal17:18
*** edtubill has quit IRC17:18
fungicardeois_: no dice... http://logs.openstack.org/4b/4bffc80c819a4ca91e03230c07d9200e6a25913d/release/js-openstack-lib-nodejs4-npm-publish-tarball/5a87daa/console.html#_2016-10-19_17_09_39_63348017:19
fungicardeois_: looks like it built openstack-lib-0.0.1.tgz but was expecting js-openstack-lib-*.tgz17:20
cardeois_fungi ok cool thanks, will check that17:20
*** yamahata has joined #openstack-infra17:20
funginot sure if that's an incorrect assumption on the part of the publisher or incorrect package metadata in the repo17:21
*** rbrndt has quit IRC17:22
*** trown is now known as trown|lunch17:22
*** jkilpatr_ has joined #openstack-infra17:22
*** Sukhdev has quit IRC17:23
*** simondodsley has quit IRC17:24
*** jkilpatr has quit IRC17:24
*** watanabe_isao has quit IRC17:25
*** watanabe_isao has joined #openstack-infra17:25
fungicardeois_: if that's really how it's supposed to work, we may need to add some extra logic into http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/run-tarball.sh and http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/npm-tarball-upload.sh17:26
openstackgerritMerged openstack-infra/zuul: Ansible launcher: use sequence-uuid in shell scripts  https://review.openstack.org/38881617:27
openstackgerritMike Fedosin proposed openstack-infra/project-config: Allow merging code in app-catalog feature branches  https://review.openstack.org/38881517:28
*** spzala has joined #openstack-infra17:29
*** _ari_|ooo is now known as _ari_17:30
fungicardeois_: scratch that first url, the package name assumption is baked into http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/javascript.yaml#n12217:31
*** baoli has quit IRC17:32
*** ssbarnea has quit IRC17:33
*** baoli has joined #openstack-infra17:33
fungicardeois_: so either pack needs to be told to generate a tarball with the same name as the repo, or the jobs need some way to infer the correct tarball name17:33
*** ssbarnea has joined #openstack-infra17:33
*** tiswanso has joined #openstack-infra17:34
*** baoli_ has joined #openstack-infra17:34
jeblairmordred: 388816 merged; do you want to do one more restart on 01?17:35
mordredjeblair: I do!17:36
cardeois_ok sorry fungi I'm in the middle of something, will get back to you later17:36
*** xarses has joined #openstack-infra17:36
fungicardeois_: no problem. just trying to provide you with a good starting point there17:37
*** electrofelix has quit IRC17:37
*** baoli has quit IRC17:37
*** oanson has joined #openstack-infra17:38
*** annegentle has quit IRC17:38
*** winggundamth_ has quit IRC17:38
*** pblaho has quit IRC17:38
*** watanabe_isao has quit IRC17:39
docaedofungi: I am seeing usual code-review options :) I'm just afraid of hitting them and unintentionally merging something into master17:40
fungidocaedo: the "branch" mentioned in the interface there is the branch to which gerrit will merge them17:40
mordredjeblair: things seem to not be exploding17:40
jeblairmordred: cool, let's check the output when a job finishes, then maybe roll out globally?17:41
docaedofungi: gerrit is magical17:41
fungiand ever so clever17:42
*** spzala has quit IRC17:42
*** jpena is now known as jpena|off17:42
mordredjeblair: yah17:43
mordredjeblair: http://logs.openstack.org/22/388822/1/check/gate-python-tripleoclient-python35-nv/24d6245/17:43
mordredjeblair: btw - clicking on vars.yaml prompts to download - so we might want to add a mime-type to the apache config17:44
clarkbdocaedo: fungi and when you get to merging the feature branch back to master or master to feature branch it is even more fun17:46
docaedoclarkb: yes it's a thing I'm super excited about, haha17:46
*** maeker has quit IRC17:47
*** vsaienko has quit IRC17:48
jeblairmordred: yeah, i could get on board with that17:49
jeblairmordred: lgtm if you want to roll out when ready17:49
*** eharney has quit IRC17:50
*** chandankumar has quit IRC17:50
*** yamahata has quit IRC17:50
mordredjeblair: yah. I think we're ready. you have a playbook for this, yeah?17:51
*** vsaienko has joined #openstack-infra17:53
*** vsaienko has quit IRC17:54
*** maeker has joined #openstack-infra17:54
*** spzala has joined #openstack-infra17:54
jeblairmordred: https://review.openstack.org/37982317:55
mordredjeblair: neat17:55
*** vsaienko has joined #openstack-infra17:56
mordredjeblair: any need to send an announcement? or just roll with it?17:56
mordredjeblair: oh - we should likely wait until the commits have been pushed everywhere by puppet ...17:57
*** lykinsbd_ has quit IRC17:57
jeblairmordred: should be invisible unless there are release jobs running.  so i'd just check the status page for those, and if clear, go for it17:57
cloudnullclarkb: pabelanger: if you have time could we pull console logs from some of these error nodes in the OSIC? We've been trying to reproduce the issues and can not and we're looking for anything we can to try and understand what and why it's happening.17:57
cloudnullor anyone else for that matte.r17:58
*** dizquierdo has quit IRC17:58
*** spzala has quit IRC17:59
clarkbcloudnull: I'll have to figure out how pabelanger was doing that when there were glean issues in the past17:59
mordredjeblair: actually, there's a bunch of jobs backed up in the release pipeline17:59
*** maeker has quit IRC17:59
clarkbcloudnull: to workaround nodepool deleting them right away essentially17:59
cloudnullno worries. this can all wait till after summit too.18:00
cloudnulli know folks are busy18:00
cloudnullif someone has time, great. otherwise i can wait.18:01
clarkbok18:01
*** flepied has joined #openstack-infra18:01
openstackgerritMerged openstack-infra/system-config: Add infracloud-chocolate tree to Cacti  https://review.openstack.org/38801118:02
*** e0ne has quit IRC18:04
openstackgerritMichael Johnson proposed openstack-infra/project-config: Move experimental functional test to check queue  https://review.openstack.org/38883418:04
*** yamamoto has joined #openstack-infra18:04
openstackgerritSaad Zaher proposed openstack-infra/project-config: Freezer: Fixed tempest regex  https://review.openstack.org/38807618:07
*** florianf has quit IRC18:08
*** eharney has joined #openstack-infra18:08
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Removed old queries for fixed bugs  https://review.openstack.org/38883818:09
rcarrillocruzheya18:10
rcarrillocruzcan i get a review for https://review.openstack.org/#/c/388045/218:10
rcarrillocruzadding chocolate servers to cacti18:10
*** rbrndt has joined #openstack-infra18:10
*** admcleod- has quit IRC18:12
pleia2rcarrillocruz: this won't break cacti again, right? ;)18:13
rcarrillocruzlol18:13
rcarrillocruzwe can migrate to a new one again!18:13
rcarrillocruz:D18:13
pleia2lol18:13
rcarrillocruzone of the issues we had18:13
pleia2I guess we know how now18:13
rcarrillocruzis that we were pulling ALL the tap devices on all computes18:13
*** ssbarnea has quit IRC18:13
rcarrillocruzwhich was making cacti to crawl18:13
rcarrillocruzwe put a filter and we now only pull regular nics18:14
*** dimtruck is now known as zz_dimtruck18:14
openstackgerritMarkos Chandras proposed openstack/diskimage-builder: elements: source-repositories: Add git package mapping for SUSE  https://review.openstack.org/38884018:14
* pleia2 nods18:14
*** zz_dimtruck is now known as dimtruck18:14
*** ssbarnea has joined #openstack-infra18:14
openstackgerritMerged openstack-infra/elastic-recheck: Removed old queries for fixed bugs  https://review.openstack.org/38883818:16
*** rhallisey has quit IRC18:16
*** rhallisey has joined #openstack-infra18:17
openstackgerritSaad Zaher proposed openstack-infra/project-config: Freezer: Fixed tempest regex  https://review.openstack.org/38807618:17
*** aderyugin has quit IRC18:17
*** ijw has joined #openstack-infra18:18
*** itisha has quit IRC18:19
openstackgerritChuck Short proposed openstack-infra/project-config: nova-lxd: Update configuration  https://review.openstack.org/38884618:19
*** yamahata has joined #openstack-infra18:20
openstackgerritMarkos Chandras proposed openstack/diskimage-builder: elements: zypper: Drop not pull recommended packages  https://review.openstack.org/38884718:20
openstackgerritMarkos Chandras proposed openstack/diskimage-builder: elements: zypper: Do not pull recommended packages  https://review.openstack.org/38884718:21
*** gordc has joined #openstack-infra18:21
rcarrillocruzthx pleia218:21
*** pradk has quit IRC18:21
*** pradk has joined #openstack-infra18:23
*** ijw has quit IRC18:23
openstackgerritLouis Fourie proposed openstack-infra/project-config: Add neutron-lib-master periodic job for networking-sfc  https://review.openstack.org/38885218:24
*** aderyugin has joined #openstack-infra18:24
*** rajinir has joined #openstack-infra18:24
jeblairmordred: are they only wheel build jobs?18:25
jeblairmordred: the answer is yes18:26
jeblairmordred: you are all clear18:26
*** ociuhandu has joined #openstack-infra18:26
mordredjeblair: kk. cool18:26
jeblairmordred: the release pipeline runs a wheel mirror build job for every item.  it does not need to do that, but there isn't a better alternative in zuul v2.  as long as the actual *releases* have happened, it's okay to restart18:26
*** stream10 has joined #openstack-infra18:26
openstackgerritMerged openstack-infra/system-config: Add chocolate hosts to Cacti  https://review.openstack.org/38804518:27
*** ssbarnea has quit IRC18:27
jeblairmordred: i usually check the last item in the pipeline and see if its upload and announce jobs have run18:27
mordredjeblair: okie. here goes nothing18:27
*** rossella_s has quit IRC18:28
mgagnewhat's the best way to debug pkg_resources.VersionConflict ? So I got the error but I have no idea which package requires the mentioned version.18:28
*** rossella_s has joined #openstack-infra18:28
mordredmgagne: pastebin the traceback?18:28
mgagnehttp://paste.openstack.org/show/586456/18:29
mgagnelocal job, not upstream18:29
mgagnebecause "Requirement.parse('pbr<2.0,>=0.11')" did come from somewhere. Would be cool to know what introduced this range.18:29
*** ssbarnea has joined #openstack-infra18:29
*** jkilpatr_ has quit IRC18:30
openstackgerritMichael Johnson proposed openstack-infra/project-config: Consolidate neutron-lbaas API tests  https://review.openstack.org/38624518:31
mat128mgagne: got anything prior to this?18:32
openstackgerritgreghaynes proposed openstack-infra/nodepool: Supply ZK connection information to test configs  https://review.openstack.org/38396318:32
mgagneI'm thinking about enabling verbose mode. I found there is no output before installation confirmation.18:32
mat128mgagne: hmm18:32
openstackgerritgreghaynes proposed openstack-infra/nodepool: Add getMostRecentBuildImageUpload method to zk  https://review.openstack.org/38396418:32
openstackgerritgreghaynes proposed openstack-infra/nodepool: Assume diskimage and image names are the same  https://review.openstack.org/38396518:32
mat128mgagne: if you have access to the venv before running flake8, maybe you can run pip deptree?18:32
openstackgerritgreghaynes proposed openstack-infra/nodepool: Update waitForImage test method for ZK  https://review.openstack.org/38396618:33
mat128mgagne: obviously it needs to be installed, so yeah :S18:33
mgagnein venv right?18:33
openstackgerritgreghaynes proposed openstack-infra/nodepool: Re-enable test_dib_image_list  https://review.openstack.org/38396718:33
mordredmgagne: looking18:33
mat128mgagne: yes18:33
*** jheroux has quit IRC18:34
mgagnemordred: will enable more debug before disturbing the public place. I thought there was some clever trick I didn't know about18:34
mgagnedeptree looks promising18:34
mordredmgagne: yah - deptree is likely your best bet18:34
mat128mgagne: http://paste.openstack.org/show/586459/18:35
* mgagne learned a new trick today18:35
*** HeOS has quit IRC18:35
mat128mgagne: the same details are also present when installing packages, but thats too late if the install was done already18:35
mgagnemat128: with tox -v ? I don't see any output in Jenkins18:36
AJaegerclarkb: thanks for digging into this for solum.18:37
AJaegerzhurong, I rebased the change that clarkb pointed out - https://review.openstack.org/#/c/38420018:37
mat128mgagne: even without -v, simple "pip install" normally tells you requirements + what is being installed - http://paste.openstack.org/show/586460/18:37
mgagnemaybe tox detects you are in Jenkins and hides output...18:37
*** trown|lunch is now known as trown18:38
mat128mgagne: seems like the best idea in the world.. not18:38
AJaegerclarkb: looking at https://review.openstack.org/#/c/384200 I see in "Conflicts with " a "500 Internal Server error" - something seems wrong with solum18:38
mat128mgagne: must be the same guy that added passenv ;)18:38
*** chandanc has quit IRC18:38
*** abregman|afk has quit IRC18:39
*** edtubill has joined #openstack-infra18:41
AJaegerclarkb: could it be that the solum git repo on gerrit is somehow broken?18:41
clarkbAJaeger: maybe? or maybe its a new instance of that jgit bug from long ago where the gerrit jgit cache has become corrupt18:43
*** jkilpatr_ has joined #openstack-infra18:43
*** hashar has joined #openstack-infra18:43
AJaegerany idea how to check for that?18:44
clarkbAJaeger: probably have to dig more in hte gerrit error log18:44
AJaegerthanks, clarkb18:45
*** ssbarnea has quit IRC18:46
*** ssbarnea has joined #openstack-infra18:47
*** vhosakot has quit IRC18:48
*** jheroux has joined #openstack-infra18:48
mordredjeblair: according to ansible- all of the launchers should be updated18:49
timrc\o/18:49
jeblairmordred: neat oh!  time for lunch!  ;)18:50
*** jtomasek_ has joined #openstack-infra18:51
*** Sukhdev has joined #openstack-infra18:53
*** maeker has joined #openstack-infra18:55
*** vsaienko has quit IRC18:55
*** lykinsbd has joined #openstack-infra18:57
*** jheroux has quit IRC18:58
*** ijw has joined #openstack-infra19:01
*** knikolla has joined #openstack-infra19:01
*** baoli has joined #openstack-infra19:03
*** baoli_ has quit IRC19:04
zaroclarkb: fix change, https://gerrit-review.googlesource.com/Documentation/rest-api-changes.html#fix-change19:04
*** baoli has quit IRC19:04
*** baoli_ has joined #openstack-infra19:04
zaroor maybe use 'check' first.19:05
clarkbhttps://review.openstack.org/Documentation/rest-api-changes.html#fix-change looks like it is part of our gerrit19:05
clarkbhttps://review.openstack.org/Documentation/rest-api-changes.html#check-change is check19:06
clarkblet us see what check change says about these solum changes19:06
*** ijw has quit IRC19:06
*** baoli_ has quit IRC19:06
*** markvoelker has joined #openstack-infra19:08
*** charz has quit IRC19:08
*** abregman has joined #openstack-infra19:09
*** ijw has joined #openstack-infra19:09
clarkbapparently check hasto be run by owner or admin too19:10
*** jheroux has joined #openstack-infra19:11
*** gomarivera has joined #openstack-infra19:11
*** charz has joined #openstack-infra19:12
clarkbzaro "problems": [] so I guess it couldn't automatically find anything wroung with https://review.openstack.org/#/c/385955/ at least19:12
gomariveraquick question - I am following the instructions in (http://docs.openstack.org/infra/manual/creators.html) - however, it is not quite clear to me if the upstream tag becomes my permanent repo? - for example I have my code base in github such that it can be imported - but will my repo later on appear in openstack github community?19:13
*** timburke has quit IRC19:14
*** ijw has quit IRC19:14
mat128gomarivera: your upstream only serves for the initial import19:14
gomarivera@mat128: thank you19:15
*** oanson has quit IRC19:15
mat128gomarivera: yw :)19:15
*** charz has quit IRC19:17
clarkbit should be safe to git fsck the solum repo in review_site ya?19:19
clarkbinfra-root want to opine on ^19:19
clarkbif we can rule out problems with the git repo on disk then I Think that probably points back to problems with jgit caching in memory19:20
*** panda|bbl is now known as panda19:20
jeblairclarkb: i *think* but i would rsync it and fsck the copy19:20
clarkba local clone from gerrit itself fscks cleanly19:21
clarkbnot sure if that touches disk or only the cache or maybe both19:21
fungiyeah, i generally test that by doing a cp -ax of the on-disk repo and then git fsck that19:21
*** timburke has joined #openstack-infra19:22
*** jtomasek_ has quit IRC19:22
*** charz has joined #openstack-infra19:23
clarkbfungi: so cp -ax /home/gerrit2/review_site/git/openstack/solum.git /home/gerrit2/solum.git ?19:23
fungiyep19:23
clarkbthe -x is throwing me off, I guess not required and then dest doesn't matter19:23
*** Naeil has quit IRC19:23
fungioh, right -x is just habit, sorry19:23
clarkbthere are a lot of dangling blobs and commits but that is normal for gerrit right?19:25
openstackgerritMichael Johnson proposed openstack-infra/project-config: Move experimental functional test to check queue  https://review.openstack.org/38883419:25
clarkbotherwise its fine19:25
fungiyeah, that shouldn't prevent gerrit from merging to a branch (dangling objects are by definition not on a branch anyway)19:26
*** asselin has joined #openstack-infra19:26
*** baoli has joined #openstack-infra19:26
jlvillaljeblair: I like it :)  http://logs.openstack.org/64/387664/2/gate/gate-tempest-dsvm-ironic-lib-wholedisk-agent_ipmitool-ubuntu-xenial/e0d8b2e/_zuul_ansible/scripts/  Thanks for the help!19:27
fungii probably missed in scrollback, but did you manage to find a java backtrace from any of the merge failures gerrit was hitting19:27
fungi?19:27
fungiclarkb: ^19:27
clarkbfungi: I did, let me get a link to one of them in paste19:27
clarkbhttp://paste.openstack.org/show/586437/19:27
clarkbit looks like a normal merge conflict issue based on that, but apparently pushing up rebasese doesn't change things?19:28
*** ijw has joined #openstack-infra19:28
clarkbAJaeger: ^ that the case?19:28
*** gomarivera has quit IRC19:29
fungiin the past, i think some of these have corrected themselves after a gerrit service restart19:29
*** baoli has quit IRC19:31
*** baoli_ has joined #openstack-infra19:31
*** baoli_ has quit IRC19:36
*** baoli has joined #openstack-infra19:38
*** hashar has quit IRC19:41
*** baoli has quit IRC19:43
*** mfedosin has quit IRC19:44
*** rfolco has quit IRC19:45
*** baoli has joined #openstack-infra19:45
*** baoli_ has joined #openstack-infra19:47
*** pcaruana has quit IRC19:50
*** thingee_ has quit IRC19:50
*** baoli has quit IRC19:50
jlvillalDoes there already exist a utility to give a job name from project-config and it will output what that job will do? In particular the scripts19:51
*** thingee has quit IRC19:52
anteayajlvillal: like a job description?19:52
*** Sukhdev has quit IRC19:52
jlvillalanteaya: I think so.19:52
anteayajlvillal: if that is what you are looking for, then I don't believe we have such a feature19:53
*** tiswanso has quit IRC19:53
ianwclarkb: you see what you caused ;) https://bugzilla.redhat.com/show_bug.cgi?id=138605219:53
openstackbugzilla.redhat.com bug 1386052 in systemd "RFE: Ship rc.local template file and symlink" [Unspecified,New] - Assigned to systemd-maint19:53
jlvillalanteaya: Okay thanks19:53
anteayawelcome19:55
*** dprince has quit IRC19:55
clarkbianw: me? it was fricklers review :P19:57
*** moravec has joined #openstack-infra19:57
*** abregman has quit IRC19:57
clarkbor did I write the original rc.local?19:57
*** psilvad has quit IRC19:57
*** krtaylor has quit IRC19:57
*** mhickey has joined #openstack-infra19:58
*** cardeois_ has quit IRC19:59
fungijlvillal: currently at least, a reverse lookup like that isn't possible. instead you need to have jjb parse the entirety of our configuration, then filter the output for the job you're looking for (since job names themselves can be, and very often are, templated as well)20:00
ianwclarkb: oh, i dunno, doesn't matter.  i look forward to receiving further insightful emails messages from that bug20:00
jlvillalfungi: Thanks. Yeah I have run the jjb command and got the XML files. Now I need to figure out how to extract into more useful info :)20:00
clarkbianw: I apologize in advance for any pain it may cause you as a result :)20:01
*** maeker has quit IRC20:01
* jlvillal goes to read about import xml ....20:01
*** maeker has joined #openstack-infra20:01
*** thingee has joined #openstack-infra20:01
*** edtubill has quit IRC20:01
jlvillalfungi: Main goal is to extract those shell scripts so I can try to do a sanity check locally.20:01
jlvillalThanks20:01
ianwvsaienk0: will take a look20:02
ianwclarkb: np, hopefully that makes it into the builds today and centos & fedora should start working on osic20:03
*** vsaienko has joined #openstack-infra20:04
openstackgerritMonty Taylor proposed openstack-infra/shade: Document and be more explicit in normalization  https://review.openstack.org/38790520:04
openstackgerritMonty Taylor proposed openstack-infra/shade: Add strict mode for trimming out non-API data  https://review.openstack.org/38818420:04
*** nherciu has quit IRC20:05
AJaegerclarkb: yes, rebase didn't fix the problems ;(20:07
fungijlvillal: if what you want is a set of shell scripts, you might consider looking at what zuul-launcher does since it's relying on jjb as more of a parser library to create an in memory structure containing the scripts which it will run under ansible20:07
fungithe xml output isn't something we actually consume in our ci since zuul 2.520:07
*** yaume has joined #openstack-infra20:08
fungiit's what we would have crammed into the jenkins api back in the beforetime20:08
*** cardeois has joined #openstack-infra20:08
jlvillalfungi: Thanks. Yeah I want to dig in more to zuul/launchers/ansiblelaunchserver.py and see how it does it and figure out if I can yank that info out.20:08
jlvillalfungi: Hopefully that is what you were referring to.20:09
fungiyup20:09
hamzyso when I was following http://docs.openstack.org/infra/manual/creators.html I think that I configured https://launchpad.net/molteniron incorrectly since this new project is not yet under governance.  I want it to be more like https://launchpad.net/~third-party-ci-drivers with a small group of people who can checkin.  Can this be fixed here? I lost admin powers...20:09
*** kaisers__ has quit IRC20:10
*** kaisers_ has joined #openstack-infra20:10
fungihamzy: by checkin you mean approve proposed source code changes, or something else?20:11
hamzyyes, approve patches20:11
AJaegerhamzy: where do you think you set this up wrongly?20:11
AJaegerhamzy: https://review.openstack.org/#/c/388186/6/gerrit/acls/openstack/molteniron.config sets up a separate group that you can add reviewers to that can +2A20:12
hamzymaintainer being https://launchpad.net/~openstack-admins20:12
*** Apoorva has quit IRC20:12
fungihamzy: there's no connection between launchpad teams and gerrit permissions20:12
fungihamzy: ot'20:13
hamzyah okay then20:13
fungier20:13
fungiit's possible you missed reading http://docs.openstack.org/infra/manual/creators.html#update-the-gerrit-group-members20:13
*** ldnunes has quit IRC20:14
hamzyyeah, I was just looking at the differences between the two launchpads and was worrying about a potential problem20:14
*** kaisers_ has quit IRC20:15
fungithe community is really only relying on launchpad teams for bug and blueprint management at this point20:15
funginot at all for code control20:16
*** Apoorva has joined #openstack-infra20:16
*** coolsvap has quit IRC20:16
*** ijw has quit IRC20:16
hamzyah, thanks for that explanation20:17
*** sdake has joined #openstack-infra20:21
*** baoli has joined #openstack-infra20:23
*** baoli_ has quit IRC20:23
*** baoli has quit IRC20:24
*** baoli_ has joined #openstack-infra20:24
*** HeOS has joined #openstack-infra20:24
*** timello has quit IRC20:26
*** srobert has quit IRC20:27
*** baoli has joined #openstack-infra20:28
*** baoli_ has quit IRC20:28
*** stream10 has quit IRC20:31
*** timello has joined #openstack-infra20:31
*** Pramod has joined #openstack-infra20:31
wznoinskhi infra, creation of groups in gerrit is not via git/gerrit, right?20:34
*** baoli_ has joined #openstack-infra20:34
*** ssbarnea has quit IRC20:35
fungiwznoinsk: usually it is, yes. the groups are created as a reaction to mentioning them in gerrit acls, which are maintained in git (in the openstack-infra/project-config repo)20:35
*** baoli has quit IRC20:35
fungiwznoinsk: assuming you're talking about review.openstack.org specificallty20:35
fungispecifically20:35
*** ssbarnea has joined #openstack-infra20:35
wznoinskok, so will send one review there, thanks20:35
wznoinsks/review/patch20:36
*** Pramod has quit IRC20:36
*** ssbarnea has quit IRC20:36
*** baoli has joined #openstack-infra20:37
*** baoli_ has quit IRC20:37
*** jkilpatr_ has quit IRC20:37
*** ijw has joined #openstack-infra20:37
cardeoisfungi back to this js-openstack-lib release issue, thanks for your input. There is indeed an issue where we want the package to be pushed as `openstack-lib` I'll try to find a proper way to do that but I think the best would be to add specific config in ci_infra for js-openstack-lib when we use the template job 'nodejs4-publish-to-npm'.20:38
cardeoisI'll check that out20:38
*** baoli has quit IRC20:39
*** baoli has joined #openstack-infra20:39
openstackgerritYAMAMOTO Takashi proposed openstack-infra/project-config: networking-midonet: Make ml2 job voting for newton and master  https://review.openstack.org/38849320:40
openstackgerritYAMAMOTO Takashi proposed openstack-infra/project-config: networking-midonet: Add -{node} to dsvm job names  https://review.openstack.org/38889320:40
*** kgiusti has left #openstack-infra20:41
fungicardeois: so... the way we handle this for python packages is to add a routine that can identify the correct package name by parsing files that reside in the git repo20:41
*** baoli has quit IRC20:42
*** baoli has joined #openstack-infra20:42
openstackgerritYAMAMOTO Takashi proposed openstack-infra/project-config: networking-midonet: Add -{node} to dsvm job names  https://review.openstack.org/38889320:42
*** ijw has quit IRC20:42
fungi"package name is same as repo name" is a handy fallback behavior, and is correct for a lot of stuff, but when that doesn't work the best shared source of data we have between jobs is the content of the git repository20:42
cardeoisfungi: ok... I'm not sure I fully understand, do you have any python example I could dig for?20:43
*** baoli has quit IRC20:44
*** baoli has joined #openstack-infra20:44
*** dtardivel has quit IRC20:44
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Make bug name, type, and url explicit  https://review.openstack.org/37511320:44
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Add StoryBoard integration for graph commands  https://review.openstack.org/38511220:44
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Add Jira integration for graph commands  https://review.openstack.org/38521720:44
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Wait until the most recent index is available  https://review.openstack.org/38798620:44
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Refactor launchpad code into bug_tracker  https://review.openstack.org/38519920:44
*** nicolasbock has quit IRC20:44
openstackgerritMichael Johnson proposed openstack-infra/project-config: Consolidate neutron-lbaas API tests  https://review.openstack.org/38624520:44
openstackgerritWaldemar Znoinski proposed openstack-infra/project-config: gerrit: add intel-nfv-ci-tests-ci group  https://review.openstack.org/38889420:44
fungicardeois: yep, we have this handy script which extracts package names from setup.cfg files: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/pypi-extract-name.py20:45
fungicardeois: we could do something similar to parse the name parameter out of http://git.openstack.org/cgit/openstack/js-openstack-lib/tree/package.json20:45
mat128fungi: curl http://git.openstack.org/cgit/openstack/js-openstack-lib/plain/package.json | jq .name20:46
mat128cardeois: ^20:46
mat128;)20:46
cardeoisright20:46
fungithough in this case, rather than using curl, just use the already checked out copy of the repo in the job workspace20:46
mat128fungi: yup, or we can do the lookup in python if jq is not expected to be available20:47
mat128cardeois: https://github.com/openstack-infra/project-config/blob/a8124f45e1719332c4318e47897cde4faab308ad/jenkins/scripts/pypi-wheel-upload.sh#L2620:47
mat128usage20:47
cardeoisI think there is a npm command to directly to that, I'll check20:47
prometheanfiredoes @infra know of a way to reduce the context of merges to reduce the change of a merge conflict?  I ask because this is for updates to the upper-constraints file (in which the lines are unique)20:47
*** baoli has quit IRC20:47
prometheanfiredirk: ^20:48
openstackgerritWaldemar Znoinski proposed openstack-infra/project-config: gerrit: add intel-nfv-ci-tests-ci group  https://review.openstack.org/38889420:48
fungiright, prometheanfire no, i think it's hard-coded in gerrit or maybe even jgit20:48
mat128cardeois, fungi: the comment at https://github.com/openstack-infra/project-config/blob/master/jenkins/scripts/npm-tarball-upload.sh#L23 is currently wrong, but this is what you want20:48
fungier, i think i must have started out typing right, something else in response to somebody20:48
*** jcoufal has quit IRC20:48
prometheanfirefungi: k, it came up in coversation and it's nice to know20:49
cardeoisfungi: However "npm pack" we run already output the tarball name, so we could reuse this output. However I'm not sure it's possible to set a variable that tarball-upload can reuse20:49
prometheanfirefungi: right :P20:49
*** baoli has joined #openstack-infra20:49
jeblairprometheanfire: that might be a good question for #gerrit or repo-list20:49
fungicardeois: yeah, the npm tarball build job (not the upload job) is what failed since it assumes the tarball created by pack will start with the repo name20:49
mat128cardeois: so the npm-tarball-upload.sh script cannot fetch your file because the filename is wrong, is this right?20:49
openstackgerritYAMAMOTO Takashi proposed openstack-infra/project-config: networking-midonet: Add -{node} to dsvm job names  https://review.openstack.org/38889320:50
prometheanfirejeblair: which list specifically?20:50
jeblairprometheanfire: (of course, if we succeed in convincing gerrit to do that, we'll then have to figure out how to get zuul to do it.  but that's *probably* easier)20:50
fungimat128: cardeois: the issue is at http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/javascript.yaml#n13320:50
jeblairprometheanfire: sorry, repo-discuss@googlegroups.com20:51
prometheanfirethanks20:51
prometheanfireI asked in irc for now20:51
jeblairprometheanfire: https://groups.google.com/forum/#!forum/repo-discuss20:51
cardeoisfungi mat128 : right it's not the same name as the repo name. `js-openstack-lib` vs `openstack-lib` which is the name we want published to npm. But I can also rename the tarball when I do pack (I guess) or change the line you just sent20:51
cardeoisanyway I'll think about my options and will let you know20:51
mat128fungi, cardeois: so I guess that macro will have to use npm-extract-name instead of {name}, right?20:52
cardeoismat128 yeah something like that. Unless I can build the right tarball name directly20:52
mat128cardeois: by right you mean js-openstack-lib ?20:52
*** mfedosin has joined #openstack-infra20:53
mat128then it wont match whats inside the metadata.json20:53
wznoinskfungi, out of curiosity is there certain ppl responsible for gerrit changes or any 2infra cores can merge them?20:53
fungimat128: cardeois: odds are renaming the tarball is not what you want, but adjusting the cp command to use *.tgz or the name extraction function will be20:53
cardeoismat128 yep (package.json). But it will be uploaded anyway properly to npm with the right name in the package.json. I think20:53
anteayawznoinsk: you want a group named ci-tests-ci?20:53
mat128fungi: right20:54
*** baoli__ has joined #openstack-infra20:54
cardeoisright20:54
fungiwznoinsk: there is a separate (slightly larger) team of people who can approve changes to the project-config repo https://review.openstack.org/#/admin/groups/459,members (it includes the infra-core team though)20:54
wznoinskanteaya, to be consistent with the name of the repository this group is for, yes -   acl-config: /home/gerrit2/acls/openstack/openstack-manuals.config20:55
*** sree has joined #openstack-infra20:55
*** baoli has quit IRC20:55
wznoinskwrong link, sorry (clipboard doesn't work again)20:55
*** timello has quit IRC20:55
wznoinskanteaya, https://review.openstack.org/#/q/project:openstack/intel-nfv-ci-tests20:56
* mat128 is happy. Half of the time I look at messages here, they have been sent by coworkers 8)20:56
*** jkilpatr has joined #openstack-infra20:56
*** baoli__ has quit IRC20:57
*** baoli has joined #openstack-infra20:57
*** jheroux has quit IRC20:57
*** markvoelker_ has joined #openstack-infra20:57
*** baoli has quit IRC20:58
*** baoli has joined #openstack-infra20:58
*** amitgandhinz has quit IRC20:58
*** sree has quit IRC20:59
*** markvoelker has quit IRC21:00
*** moravec has quit IRC21:00
*** Goneri has quit IRC21:03
*** timello has joined #openstack-infra21:04
*** baoli_ has joined #openstack-infra21:05
*** baoli has quit IRC21:05
*** Sukhdev has joined #openstack-infra21:05
openstackgerritMonty Taylor proposed openstack-infra/shade: Fix string formatting error in error case  https://review.openstack.org/38871021:06
openstackgerritMonty Taylor proposed openstack-infra/shade: Don't fail image create on failure of cleanup  https://review.openstack.org/38889921:06
*** mountpoint has joined #openstack-infra21:06
*** sdake_ has joined #openstack-infra21:08
mgagne /join #openstack-internap21:09
*** sdake_ has quit IRC21:09
*** sdake_ has joined #openstack-infra21:10
*** yaume has quit IRC21:10
*** cardeois has quit IRC21:10
*** cardeois has joined #openstack-infra21:11
*** sdake has quit IRC21:11
*** r-daneel has joined #openstack-infra21:11
*** tkelsey has quit IRC21:12
funginow we all know where you have your secret cabal ;)21:13
mordredyay secret cabals!21:13
*** Sukhdev has quit IRC21:17
*** mriedem has quit IRC21:17
openstackgerritMonty Taylor proposed openstack/os-client-config: Update ECS image_api_version to 1  https://review.openstack.org/38890121:18
openstackgerritFrederic Lepied proposed openstack-infra/tripleo-ci: Allow to use an RDO review to fix a packaging issue  https://review.openstack.org/38879121:18
openstackgerritMonty Taylor proposed openstack/os-client-config: Update ECS image_api_version to 1  https://review.openstack.org/38890121:19
*** r-mibu has quit IRC21:19
*** mriedem has joined #openstack-infra21:19
*** r-mibu has joined #openstack-infra21:19
*** ijw has joined #openstack-infra21:19
*** tphummel has joined #openstack-infra21:19
*** rhallisey has quit IRC21:19
*** ijw has quit IRC21:20
*** ijw has joined #openstack-infra21:20
*** baoli_ has quit IRC21:23
*** baoli has joined #openstack-infra21:23
*** marst_ has quit IRC21:24
*** baoli has quit IRC21:24
*** tpsilva has quit IRC21:24
*** lykinsbd has quit IRC21:25
*** baoli has joined #openstack-infra21:25
*** mfedosin has quit IRC21:26
*** baoli has quit IRC21:27
*** baoli has joined #openstack-infra21:28
*** dizquierdo has joined #openstack-infra21:29
*** matt-borland has quit IRC21:31
*** ijw has quit IRC21:34
*** xyang1 has quit IRC21:34
*** ijw has joined #openstack-infra21:34
*** Jeffrey4l has quit IRC21:34
openstackgerritElizabeth K. Joseph proposed openstack-infra/project-config: Update entercloud to use custom Nodepool flavor  https://review.openstack.org/38890821:35
pleia2clarkb: ^21:35
*** baoli has quit IRC21:36
jlvillaljeblair: Is there any concern that jenkins_job_builder tip probably doesn't work with ansiblelaunchservers.py ?21:36
clarkbpleia2: approved21:36
*** baoli has joined #openstack-infra21:36
*** sdake_ has quit IRC21:37
openstackgerritCorentin Ardeois proposed openstack-infra/project-config: Properly find tarball for NPM packages we publish  https://review.openstack.org/38891121:37
fungijlvillal: i think we have it pinned in zuul's requirements21:37
jlvillaljeblair: I got pretty confused when I couldn't figure out where the code was that ALS (ansiblelaunchservers.py) was calling in jenkins_jobs. Finally figured out it had got deleted/moved21:37
cardeoisfungi mat128 https://review.openstack.org/#/c/388911/21:38
jlvillalfungi: Okay. Yeah I think if they do a release and try to use the new version it will likely fail.21:38
fungijlvillal: ahh, almost. we have it pinned in the puppet-zuul module http://git.openstack.org/cgit/openstack-infra/puppet-zuul/tree/manifests/launcher.pp#n5421:38
*** ijw has quit IRC21:39
fungijlvillal: but yeah, given the deep tentacles into bits of jjb that don't have an api stability guarantee, we figured zuul-launcher was locked to a specific jjb release21:39
*** ijw has joined #openstack-infra21:40
fungithis is a transition state on the way to zuul v3 where jjb won't be needed21:40
jlvillalfungi: Thanks for the info.21:40
*** tphummel has quit IRC21:40
*** pilgrimstack has quit IRC21:41
*** sdake has joined #openstack-infra21:41
openstackgerritClark Boylan proposed openstack-infra/system-config: Force entercloud to use glance v1  https://review.openstack.org/38891321:42
clarkbpleia2: mordred ^21:42
pleia2clarkb: working?21:42
*** lykinsbd has joined #openstack-infra21:42
clarkbya I got the upload to succeed with that21:42
clarkbhaven't booted the image but meh too excited that it worked :)21:42
pleia2cool (well, not, but yay success)21:42
*** krtaylor has joined #openstack-infra21:44
*** cardeois has quit IRC21:45
*** ijw has quit IRC21:47
*** baoli has quit IRC21:47
*** baoli_ has joined #openstack-infra21:47
*** Apoorva_ has joined #openstack-infra21:47
*** zzelle has joined #openstack-infra21:48
*** Apoorva_ has quit IRC21:48
*** ijw has joined #openstack-infra21:48
*** Apoorva has quit IRC21:48
*** zzelle has quit IRC21:48
*** Apoorva has joined #openstack-infra21:49
*** baoli has joined #openstack-infra21:49
*** baoli_ has quit IRC21:49
*** inc0 has quit IRC21:49
*** inc0 has joined #openstack-infra21:50
jeblairjlvillal, fungi: yeah, we didn't add it to zuul because it's not actually a requirement for any zuul v2 users except us21:51
*** marst_ has joined #openstack-infra21:52
jeblairs/it/it to requirements.txt/21:52
jlvillaljeblair:Okay21:52
*** baoli_ has joined #openstack-infra21:54
*** baoli_ has quit IRC21:55
*** baoli_ has joined #openstack-infra21:55
*** Pramod has joined #openstack-infra21:56
PramodHi All,21:56
*** baoli has quit IRC21:56
*** kaisers_ has joined #openstack-infra21:59
*** tphummel has joined #openstack-infra22:00
*** baoli has joined #openstack-infra22:00
*** baoli_ has quit IRC22:00
*** Goneri has joined #openstack-infra22:01
PramodI have a few gate tests failing in my project. I saw that there were similar failures in the other projects. the link for the failure is: https://review.openstack.org/#/c/364040/9 and this is the link to failed job http://logs.openstack.org/40/364040/9/check/gate-tempest-dsvm-networking-odl-carbon-snapshot/736a0b0/... Can anyone help me debug it?22:01
PramodBasically from the logs, the devstack wpould not come up22:02
mordredPramod: http://logs.openstack.org/40/364040/9/check/gate-tempest-dsvm-networking-odl-carbon-snapshot/736a0b0/console.html.gz#_2016-10-13_21_08_40_28818422:02
mordreddevstack came up, and tests were run against it22:02
mordredsome of them failed22:03
*** kaisers_ has quit IRC22:03
PramodHi Mordred,22:04
*** gildub has joined #openstack-infra22:04
Pramodthanks for your reply22:04
PramodI am sorry for the wrong link22:04
Pramodhttp://logs.openstack.org/40/364040/9/check/gate-tempest-dsvm-networking-odl-carbon-snapshot/736a0b0/22:04
Pramodthis is the link22:04
Pramodhttp://logs.openstack.org/40/364040/9/check/gate-rally-dsvm-networking-odl-carbon-snapshot-nv/093a44e/22:04
Pramodabove22:05
Pramodin rally tests22:05
*** mriedem is now known as mriedem_away22:05
mordredhttp://logs.openstack.org/40/364040/9/check/gate-rally-dsvm-networking-odl-carbon-snapshot-nv/093a44e/logs/devstacklog.txt.gz#_2016-10-13_19_39_46_05222:06
mordredinstalling tempest - command not found22:06
Pramodyes22:06
*** mdrabe has quit IRC22:07
mordredthat seems weird - but nothing jumps out at me at the moment, sorry22:07
PramodThat's cool! But i have one more thing Mordred. To debug this and reproduce in my local system should i clone the CI repo and run the tests?22:08
*** tkelsey has joined #openstack-infra22:08
clarkbPramod: in those log dirs should be a reproduce.sh script22:09
mordredPramod: http://logs.openstack.org/40/364040/9/check/gate-rally-dsvm-networking-odl-carbon-snapshot-nv/093a44e/logs/reproduce.sh22:09
mordredPramod: run that in a fresh trusty vm ... don't run it directly on your workstation :)22:10
PramodOk. that's after cloning the Ci repo right?22:11
*** baoli has quit IRC22:11
*** baoli_ has joined #openstack-infra22:11
PramodCool22:11
*** tkelsey has quit IRC22:13
*** baoli_ has quit IRC22:15
*** thorst_ has quit IRC22:15
*** baoli has joined #openstack-infra22:15
*** baoli has quit IRC22:17
*** baoli has joined #openstack-infra22:18
openstackgerritMerged openstack-infra/project-config: Update entercloud to use custom Nodepool flavor  https://review.openstack.org/38890822:19
*** maeker has quit IRC22:22
openstackgerritMerged openstack-infra/project-config: Properly find tarball for NPM packages we publish  https://review.openstack.org/38891122:22
*** baoli has quit IRC22:22
*** baoli_ has joined #openstack-infra22:22
*** Goneri has quit IRC22:22
*** maeker has joined #openstack-infra22:23
*** baoli_ has quit IRC22:24
*** baoli has joined #openstack-infra22:25
*** mhickey has quit IRC22:25
*** dimtruck is now known as zz_dimtruck22:26
*** EricGonczer_ has quit IRC22:27
openstackgerritMerged openstack-infra/system-config: Force entercloud to use glance v1  https://review.openstack.org/38891322:29
*** sdague has quit IRC22:29
*** amitgandhinz has joined #openstack-infra22:29
*** harlowja has quit IRC22:33
*** amitgandhinz has quit IRC22:34
*** marst_ has quit IRC22:34
*** baoli has quit IRC22:34
*** baoli_ has joined #openstack-infra22:34
*** krtaylor has quit IRC22:35
*** trown is now known as trown|outtypewww22:38
*** panda is now known as panda|Zz22:39
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Retire neutron-pd-driver  https://review.openstack.org/38891822:44
*** inc0 has quit IRC22:46
*** marst has joined #openstack-infra22:47
*** baoli_ has quit IRC22:48
*** baoli has joined #openstack-infra22:48
*** harlowja has joined #openstack-infra22:48
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Retire neutron-pd-driver  https://review.openstack.org/38891822:54
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Complete retirement for neutron-pd-driver  https://review.openstack.org/38892122:57
*** ijw has quit IRC22:57
*** gyee has joined #openstack-infra22:57
*** rbrndt has quit IRC22:58
*** lykinsbd has quit IRC22:58
*** Julien-zte has joined #openstack-infra22:58
openstackgerritRamy Asselin proposed openstack-infra/system-config: Add playbook to launch a new node  https://review.openstack.org/32046622:59
*** baoli has quit IRC22:59
*** vsaienko has quit IRC23:01
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Retire neutron-pd-driver  https://review.openstack.org/38891823:06
*** yamahata has quit IRC23:07
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Retire neutron-pd-driver  https://review.openstack.org/38891823:08
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Complete retirement for neutron-pd-driver  https://review.openstack.org/38892123:08
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Retire neutron-pd-driver  https://review.openstack.org/38891823:09
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Complete retirement for neutron-pd-driver  https://review.openstack.org/38892123:12
mwhahahaso i have a question, it seems that all of our puppet scenarios are broken but I can't figure out why the jobs are being marked as failed.  The task exit code was 023:12
mwhahahahttp://logs.openstack.org/89/388589/1/gate/gate-puppet-openstack-integration-4-scenario001-tempest-centos-7/fc2567b/console.html#_2016-10-19_22_44_33_78248823:12
*** armax has quit IRC23:13
*** gouthamr has quit IRC23:15
mwhahahahmm it seems that lsmod is no longer available23:16
*** andymaier has quit IRC23:16
*** hongbin has quit IRC23:17
*** gouthamr has joined #openstack-infra23:18
*** ijw has joined #openstack-infra23:18
*** rlandy has quit IRC23:19
*** dfflanders has joined #openstack-infra23:19
*** yamahata has joined #openstack-infra23:20
*** claudiub has quit IRC23:20
fungidid you switch to a different distro maybe?23:22
*** ijw has quit IRC23:23
jeblair2016-10-19 22:44:32,378 p=32718 u=zuul |  fatal: [node]: FAILED! => {"changed": false, "failed": true, "module_stderr": "", "module_stdout": "Traceback (most recent call last):\r\n  File \"/tmp/ansible_UmF8Ey/ansible_module_command.py\", line 465, in <module>\r\n    main()\r\n  File \"/tmp/ansible_UmF8Ey/ansible_module_command.py\", line 442, in main\r\n    rc, out, err = zuul_run_command(module, args, executable=executable, ...23:23
jeblair... use_unsafe_shell=shell, environ_update=environ)\r\n  File \"/tmp/ansible_UmF8Ey/ansible_module_command.py\", line 333, in zuul_run_command\r\n    e = get_exception()\r\nNameError: global name 'get_exception' is not defined\r\n", "msg": "MODULE FAILURE", "parsed": false}23:23
jeblairruh roh23:23
jeblairmordred: ^23:23
jeblairin http://logs.openstack.org/89/388589/1/gate/gate-puppet-openstack-integration-4-scenario001-tempest-centos-7/fc2567b/_zuul_ansible/ansible_log.txt23:23
jeblairthat may be the immediate cause of the failure, however, it may not be the underlying cause of the failure23:24
fungimat128: (cardeois seems to have dropped off) with that fix in place i reenqueued the 0.0.1 tag and teh tarball build job worked but it looks like the npm upload job needs some work to parse the package name out of the repo... http://logs.openstack.org/4b/4bffc80c819a4ca91e03230c07d9200e6a25913d/release/js-openstack-lib-npm-upload/5c639dc/console.html23:25
*** gordc has quit IRC23:25
fungithat script lives here, for the record: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/npm-tarball-upload.sh23:25
*** ijw has joined #openstack-infra23:27
*** ijw has quit IRC23:28
*** ijw has joined #openstack-infra23:29
jeblairmordred: get_exception is indeed not defined in the command module.23:30
*** amitgandhinz has joined #openstack-infra23:30
*** Jeffrey4l has joined #openstack-infra23:31
jeblairmwhahaha, mordred, fungi: looking at the lines in that traceback, it looks like it was trying to raise an exception involving either an oserror or ioerror.  it could involve a problem with the /tmp directory where the script was written, or it might involve a problem with the /home/jenkins/workspace/gate-puppet-openstack-integration-4-scenario001-tempest-centos-7 directory23:31
jeblair(or potentially other problems, those just seem like the most likely to cause a problem there)23:32
*** yuanying has joined #openstack-infra23:32
*** Pramod has quit IRC23:32
jeblairi'm open to the idea that the stdout/stderr hanging open on the prior process is somehow related, but at first glance, i don't see a way for it to be23:32
*** pahuang has quit IRC23:32
jeblairmwhahaha: if you can think of any reason files in /tmp might disappear or /home/jenkins/workspace/gate-puppet-openstack-integration-4-scenario001-tempest-centos-7 would disappear or the jenkins user would be unable to cd to that directory, that could shed a light on the underlying problem23:33
fungiindeed, i just checked out a fresh centos-7 node that hadn't started any job yet and can lsmod on it fine23:33
jeblairif lsmod has disappeared, perhaps something *very bad* happened to the entire filesystem?23:34
fungiso i agree it doesn't seem like lsmod is truly unavailable23:34
fungialso possible23:34
jeblairfungi: the zuul failure happened near the end of the job23:34
*** Julien-zte has quit IRC23:35
*** cardeois has joined #openstack-infra23:36
fungiwe do have a syslog retrieved from that job23:36
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: import get_exception in ansible command  https://review.openstack.org/38893623:37
cardeoisfungi: hello again, sorry I was out and I don't have the chat history (I really need a bouncer). Could you try when you have some time to re-release js-openstack-lib please? (no rush)23:37
jeblairmwhahaha, mordred, fungi: ^ i'm going to (attempt) to test that23:38
fungicardeois: with that fix in place i reenqueued the 0.0.1 tag and teh tarball build job worked but it looks like the npm upload job needs some work to parse the package name out of the repo... http://logs.openstack.org/4b/4bffc80c819a4ca91e03230c07d9200e6a25913d/release/js-openstack-lib-npm-upload/5c639dc/console.html23:38
fungithat script lives here, for the record: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/npm-tarball-upload.sh23:38
fungi(repeated from my input history from after you dropped off)23:38
jeblaircardeois: (and for future reference, we do archive this channel here: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/ )23:38
cardeoisok thanks ! I'll take a look right away23:39
*** dizquierdo has quit IRC23:39
cardeoisfungi: Oh I see it was released partly. So I will bump the version and will let you know tomorrow.23:41
cardeoisthanks for your help though23:41
fungicardeois: well, the npm upload script looks like it still assumes the tarball will start with the repo name, so it could stand to parse the correct package name out of the package.json file in the checked out copy of the js-openstack-lib repo in its workspace23:42
jeblairoh gah, i don't want to use get_exception!23:42
jeblairit causes this: An exception occurred during task execution. To see the full traceback, use -vvv. The error was: Exception: test23:43
fungijeblair: no dice on the syslog. it goes silent about 7 seconds prior to the failure to find lsmod23:43
jeblairi can't imagine a case where i would not want to know what the traceback was in the zuul command module23:43
jeblairand "turn on -vvv on the whole ci system in case it happens again" is not a debug strategy i want to repeat23:43
jeblairso i will write my own get_exception23:44
*** dingyichen has joined #openstack-infra23:44
cardeoisfungi: that's the expected behavior from my review https://review.openstack.org/#/c/388911/1/jenkins/jobs/javascript.yaml I copy the tarball to dist with the right name23:44
fungiyeah, that would result in some crazy verbosity23:44
cardeoisThe error is it's already published and I can't publish twice23:44
fungicardeois: it's published to npm?23:44
*** gildub has quit IRC23:45
cardeoisalmost https://www.npmjs.com/package/openstack-lib investigating what's in there23:45
*** pahuang has joined #openstack-infra23:45
jeblairoh, hrm, it's more complicated than that.  we do at least get the message, if not the traceback, so maybe we will be able to divine the problem from that.23:46
fungicardeois: oh, yep, i see it. i had it backwards in my head http://logs.openstack.org/4b/4bffc80c819a4ca91e03230c07d9200e6a25913d/release/js-openstack-lib-nodejs4-npm-publish-tarball/4ab6956/console.html#_2016-10-19_23_22_40_48164823:47
*** kaisers_ has joined #openstack-infra23:48
fungicardeois: so anyway, as long as you're okay with the tarball being named after the repo but the package name on npm being whatever is set in packaging.json, then i guess this is fine you just have things to figure out on the npm side23:48
fungimy guess is that krotscheck or someone may have "reserved" that name on npm with an initial version of 0.0.123:48
jeblairfungi, mordred: okay, i think https://review.openstack.org/388936 is what we want.  i did test the 'stdout is still open' code path, and it doesn't seem to be causing any problems.23:49
cardeoisfungi: well it seems like it was tagged 7hours ago, but anyway I'll do a 0.0.2 that we'll be easier than unpublish it 0.0.123:49
jeblairthat change will give us the error message, but not the full traceback.  if we need more, i guess we will have to enable verbose.  it's possible, just not pretty.23:49
jeblairinfra-root: i'd like to land https://review.openstack.org/388936 and restart launchers immediately23:50
*** cardeois_ has joined #openstack-infra23:50
fungisounds fine to me, and change looks good23:51
* pleia2 thumbs up23:51
jeblairfungi, pleia2: thanks.  i'm going to take a brief break while it lands and puppets, then i will restart them.23:51
*** spzala has joined #openstack-infra23:51
*** erlon has quit IRC23:52
*** kaisers_ has quit IRC23:52
*** thorst_ has joined #openstack-infra23:52
*** xarses has quit IRC23:53
openstackgerritMerged openstack-infra/zuul: Ansible launcher: import get_exception in ansible command  https://review.openstack.org/38893623:54
*** tphummel has quit IRC23:56
*** gouthamr has quit IRC23:56
*** cardeois has quit IRC23:56
*** cardeois_ has quit IRC23:56
*** spzala has quit IRC23:56
*** trash has quit IRC23:58
*** trash has joined #openstack-infra23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!