Tuesday, 2017-08-08

*** ecerquei_ has joined #tripleo00:03
*** itlinux has joined #tripleo00:09
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879300:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906600:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915200:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170916900:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)00:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)00:10
openstackLaunchpad bug 1709169 in tripleo "buildlogs.centos.org DDOS" [Critical,Triaged]00:10
*** jkilpatr has quit IRC00:13
*** pmannidi has joined #tripleo00:15
openstackgerritMerged openstack/diskimage-builder master: Bump fedora/fedora-minimal DIB_RELEASE 26  https://review.openstack.org/48257000:26
EmilienMwhy do we rely on https://buildlogs.centos.org again? we switched to mirrors :/00:29
EmilienMpabelanger: ^ I'm confused00:31
pabelangerEmilienM: we still rely on buildlogs.centos.org, as we are just setup as a proxy. So, if that server is down, our reverse proxy cache is likely down.  If we have the file cache, we should serve it up, if not expoired00:32
pabelangerEmilienM: the better approach for builds logs, is to rsync the data to AFS, but they don't support rsync right now00:32
EmilienMah so files expired in cache00:32
pabelangergoing to have a talk with them in 2 weeks time to see if they could enable it00:32
EmilienMdamn00:33
pabelangerEmilienM: ya, we only have 50GB of storage, and expire it every 24 hours00:33
EmilienMcan't we increase the ttl?00:33
EmilienMour whole CI seems red now00:33
pabelangerwe could, but we don't have enough storage on mirrors right now00:33
EmilienMI see00:33
pabelangerya, buildlogs was under DDOS, so that didn't help00:34
EmilienMI'm boarding to my last flight now00:34
EmilienMbbl00:34
EmilienMlet me know if we can do something00:34
EmilienMI'll read back00:34
pabelangerack00:34
*** limao has joined #tripleo00:41
*** mdnadeem has joined #tripleo00:49
*** mdnadeem has quit IRC00:57
*** catintheroof has joined #tripleo01:02
*** ipsecguy_ has joined #tripleo01:04
*** dmacpher has joined #tripleo01:06
*** ipsecguy has quit IRC01:07
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879301:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906601:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915201:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170916901:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)01:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)01:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)01:10
openstackLaunchpad bug 1709169 in tripleo "buildlogs.centos.org DDOS" [Critical,Triaged]01:10
*** catintheroof has quit IRC01:11
*** maeca has quit IRC01:12
*** rwsu has quit IRC01:32
*** gkadam has joined #tripleo01:35
*** gkadam has quit IRC01:43
*** rwsu has joined #tripleo01:44
*** bfournie has joined #tripleo01:52
*** bfournie has quit IRC01:54
openstackgerritMerged openstack/tripleo-common master: Add health checks during kolla build  https://review.openstack.org/48841901:59
*** ramishra has quit IRC02:03
openstackgerritMerged openstack/tripleo-image-elements master: Create symlink for dib-run-parts  https://review.openstack.org/49050002:06
*** yamahata has quit IRC02:07
*** bkopilov has quit IRC02:07
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879302:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906602:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915202:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170916902:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)02:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)02:10
openstackLaunchpad bug 1709169 in tripleo "buildlogs.centos.org DDOS" [Critical,Triaged]02:10
*** zshi_laptop has joined #tripleo02:13
*** dhill_ has quit IRC02:15
*** dhill_ has joined #tripleo02:15
*** dtrainor has quit IRC02:18
*** lifeless has quit IRC02:18
*** rodrigods has quit IRC02:19
*** lifeless has joined #tripleo02:19
*** rodrigods has joined #tripleo02:23
*** dtrainor has joined #tripleo02:26
openstackgerritzenghui.shi proposed openstack/os-net-config master: Add NIC Mapping Reporting Feature  https://review.openstack.org/38351602:29
*** tzumainn has quit IRC02:32
*** ramishra has joined #tripleo02:34
openstackgerritjimmygc proposed openstack/diskimage-builder master: Fix ubuntu minimal build failure  https://review.openstack.org/49165302:55
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879303:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906603:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915203:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170916903:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)03:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)03:10
openstackLaunchpad bug 1709169 in tripleo "buildlogs.centos.org DDOS" [Critical,Triaged]03:10
*** mdnadeem has joined #tripleo03:27
*** gkadam has joined #tripleo03:36
*** dixiaoli has joined #tripleo03:39
itlinuxhello all.. has anyone found a workaround on ceilometer upgrade issue when running with SSL deployment.. If I run without SSL I do not see this issue.. TY03:44
*** udesale has joined #tripleo03:45
*** bkopilov has joined #tripleo03:46
*** jmelvin has quit IRC03:49
*** links has joined #tripleo03:53
*** nyechiel has joined #tripleo03:53
*** ykarel has joined #tripleo04:02
*** limao has quit IRC04:03
*** nyechiel has quit IRC04:10
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879304:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906604:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915204:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170916904:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)04:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)04:10
openstackLaunchpad bug 1709169 in tripleo "buildlogs.centos.org DDOS" [Critical,Triaged]04:10
*** shreshtha has joined #tripleo04:13
*** garyk has joined #tripleo04:24
*** limao has joined #tripleo04:38
*** dsariel has joined #tripleo04:51
*** ratailor has joined #tripleo04:52
jaosorioritlinux: what issue?04:59
itlinuxthe issue is that the ceilometer stop the installation here is the log let me get them for you jaosolor:05:00
itlinuxhttp://paste.openstack.org/show/617568/05:00
itlinuxhttp://paste.openstack.org/show/617566/05:00
itlinuxthanks for helping out.. ]  jaosorior:i05:01
jaosorioritlinux: what are you using? OSP or upstream tripleo?05:01
jaosoriorand what version?05:01
itlinuxupstream05:01
itlinuxlatest RDO build for Ocata (Trunlk)05:01
itlinuxTrunk05:01
itlinuxbaseurl=https://trunk.rdoproject.org/centos7-ocata/16/85/16852f9048db3563e17d75913b5da72218448b8f_c3ad0e1b05:02
jaosorioritlinux: oh, that was fixed on master IIRC05:02
itlinuxahh which one do I need to pull down then?05:02
itlinuxocata right?05:03
jaosorioruhm05:03
jaosoriorthis was the rebase for ocata https://review.openstack.org/#/c/482712/05:03
*** janki has joined #tripleo05:03
*** skramaja has joined #tripleo05:03
itlinuxok..05:03
jaosorioritlinux: did you get ahold of pradk? he rebased it.05:03
itlinuxI was not able to get him yet..05:04
jaosorioritlinux: ok05:04
itlinuxwhere can I get the repos so I can pull them down..05:04
jaosoriorit might also be that the ocata images don't include that fix yet.05:04
*** chem has quit IRC05:05
jaosorioralthough, the package from that repo you sent must include it. It has puppet-tripleo from July 31st05:05
jaosorioruhm...05:06
itlinuxok so what will be the appropriate way to get this solved? Ty..05:06
itlinuxuh openstack undercloud upgrade did not work ..05:06
jaosoriorright, this is not an undercloud issue. It's on the overcloud05:06
itlinuxso should I pull down new images then?05:07
itlinuxI guess I could apply this patch https://review.openstack.org/#/c/482712/3/manifests/profile/base/ceilometer/collector.pp05:07
jaosorioritlinux: right, that or disable telemetry while we sort this issue out :/05:09
itlinuxwell my boss does want ceilomter working.. so I guess I just patch it..05:09
itlinuxthanks ]  jaosorior:05:10
itlinuxI will give it a try.05:10
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879305:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906605:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915205:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170916905:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)05:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)05:10
openstackLaunchpad bug 1709169 in tripleo "buildlogs.centos.org DDOS" [Critical,Triaged]05:10
itlinuxwell looking at the pp it does have the patch so I wonder why it still fails..05:12
itlinux jaosorior: strange..05:12
jaosorioritlinux: where are you looking? overcloud or undercloud?05:12
itlinuxundercloud..05:12
jaosorioritlinux: gotta look at the overcloud05:12
jaosorioritlinux: the undercloud might have different manifests05:12
itlinuxahh ok.. where do you think the pp manist is..05:12
itlinuxok..05:12
jaosorioritlinux: openstack server list05:13
itlinuxso I should update the images then..05:13
itlinuxwell I have it down now.. I will have to rebuild it..05:13
jaosorioritlinux: even if it was a failed deployment, it'll give you the ip addresses and you can ssh into the node05:13
jaosorioritlinux: if that's the case05:13
jaosorioritlinux: mount the overcloud image05:13
itlinuxyes I know..05:13
*** dbecker has joined #tripleo05:13
itlinuxok which one specifically.. should I ?05:13
itlinuxok let me download the new images and see.. or I can mount them let me checkk05:14
jaosorioritlinux: overcloud-full.qcow205:14
itlinuxok05:14
itlinuxone sec let me check..05:14
jaosorioritlinux: you could use   guestfish -a overcloud-full.qcow2     and browse the filesystem that way05:15
itlinuxchecking if I hve the guestfish..05:16
jaosorioritlinux: it's part of the libguestfs-tools package05:16
itlinuxok05:16
itlinuxinstalling now05:17
itlinuxwhich location should I look?05:17
*** limao has quit IRC05:18
jaosorior/etc/puppet/modules/tripleo/manifests/profile/base/ceilometer/collector.pp05:18
itlinuxsorry never used the guestfish any tips on how to get this checked.. thanks..05:18
jaosorioritlinux: ok, so05:19
jaosoriorguestfish -a overcloud-full.qcow205:19
itlinuxdone that..05:19
jaosoriorthen, once you're in the command line prompt05:19
jaosoriortype05:19
itlinuxgood to go..05:19
jaosoriorrun05:19
jaosoriormount /dev/sda /05:19
*** limao has joined #tripleo05:19
jaosoriorthen05:19
jaosoriorless /etc/puppet/modules/tripleo/manifests/profile/base/ceilometer/collector.pp05:19
itlinuxgetting there..05:20
itlinuxyea I see it does not have the patch05:21
itlinuxaccually I see the same patch05:22
itlinuxtry_sleep05:22
itlinuxhttp://paste.openstack.org/show/617738/05:23
jaosoriordamn05:23
jaosorioritlinux: well, in that case, unfortunately the best person to ask is pradk :/05:24
itlinuxok sounds good do you know when he will be around? TY05:24
jaosoriorI think he's in the US. So it's gonna take several hours :/05:25
itlinuxok I am in the US too :)05:25
jaosoriormust be late there05:25
itlinuxThanks good to learn a few more tricks :)05:25
itlinuxdo you have the yaml for the ssl by chance.. I follow this steps for the ssl gen..05:28
openstackgerritzenghui.shi proposed openstack/os-net-config master: Add NIC Mapping Reporting Feature  https://review.openstack.org/38351605:30
itlinuxam I missing something .. http://paste.openstack.org/show/617739/05:30
itlinuxjust to make sure but I do not think that's the problem jasorior:05:30
*** psachin has joined #tripleo05:34
itlinuxdo you know if that was fixed in Pike? TY05:37
*** yamahata has joined #tripleo05:40
*** yprokule has joined #tripleo05:44
*** stendulker has joined #tripleo05:45
*** marios has joined #tripleo05:52
*** cshastri has joined #tripleo05:53
*** dbecker has quit IRC05:57
*** udesale__ has joined #tripleo06:02
*** udesale has quit IRC06:03
*** nyechiel has joined #tripleo06:06
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879306:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906606:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915206:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170916906:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)06:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)06:10
openstackLaunchpad bug 1709169 in tripleo "buildlogs.centos.org DDOS" [Critical,Triaged]06:10
*** agurenko has joined #tripleo06:10
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: Add script to create tripleo-admin on deployed servers  https://review.openstack.org/49045806:14
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud  https://review.openstack.org/47175906:14
*** pgadiya has joined #tripleo06:18
*** rcernin has joined #tripleo06:21
*** jfrancoa has joined #tripleo06:25
*** gcerami|zZ has quit IRC06:36
*** dixiaoli has left #tripleo06:38
*** ffiore has joined #tripleo06:44
*** jaganathan has joined #tripleo06:45
*** shreshtha has quit IRC06:45
*** shreshtha has joined #tripleo06:46
*** dmacpher has quit IRC06:48
*** jprovazn has joined #tripleo06:49
*** stevebaker has quit IRC06:54
*** gfidente has joined #tripleo06:55
openstackgerritHonza Pokorny proposed openstack/tripleo-common master: Add GUI logging workflows  https://review.openstack.org/46919606:56
*** lmiccini has joined #tripleo07:00
*** pcaruana has joined #tripleo07:00
*** stevebaker has joined #tripleo07:02
*** ebarrera has joined #tripleo07:02
*** jlinkes has joined #tripleo07:02
*** anshul has joined #tripleo07:08
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879307:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906607:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915207:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170916907:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)07:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)07:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)07:10
openstackLaunchpad bug 1709169 in tripleo "buildlogs.centos.org DDOS" [Critical,Triaged]07:10
*** bogdando has joined #tripleo07:11
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Download logs interface  https://review.openstack.org/47393307:14
*** florianf has joined #tripleo07:15
*** tesseract has joined #tripleo07:21
*** udesale has joined #tripleo07:23
*** ecerquei_ has quit IRC07:23
*** udesale__ has quit IRC07:24
*** shreshtha has quit IRC07:25
*** shreshtha has joined #tripleo07:25
*** udesale__ has joined #tripleo07:26
*** udesale has quit IRC07:29
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Download logs interface  https://review.openstack.org/47393307:31
*** oidgar has joined #tripleo07:31
bogdandojistr: hi. replied https://review.openstack.org/#/c/490048/507:33
*** dciabrin has quit IRC07:33
*** dciabrin has joined #tripleo07:34
*** iranzo has joined #tripleo07:36
*** iranzo has joined #tripleo07:36
*** amoralej|off is now known as amoralej07:36
*** pmannidi has quit IRC07:37
*** ccamacho has joined #tripleo07:38
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Containarise Barbican API  https://review.openstack.org/48145107:38
*** ffiore has quit IRC07:39
*** cylopez has joined #tripleo07:39
*** ratailor is now known as ratailor|Lunch07:45
*** ffiore has joined #tripleo07:46
*** mcornea has joined #tripleo07:47
*** dsariel has quit IRC07:47
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP The ha init_bundles need to be able to run docker commands  https://review.openstack.org/49170507:48
*** dsariel has joined #tripleo07:49
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP Tag the pcmk using images with pcmk_latest  https://review.openstack.org/49170607:49
*** dsariel has quit IRC07:50
*** dsariel has joined #tripleo07:51
*** dsariel has quit IRC07:52
*** dsariel has joined #tripleo07:53
*** jprovazn has quit IRC07:58
*** ckyriakidou has joined #tripleo07:58
*** shardy has joined #tripleo08:06
*** hewbrocca_afk is now known as hewbrocca08:08
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879308:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906608:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915208:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170916908:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)08:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)08:10
openstackLaunchpad bug 1709169 in tripleo "buildlogs.centos.org DDOS" [Critical,Triaged]08:10
*** itlinux has quit IRC08:11
*** jprovazn has joined #tripleo08:13
jaosoriorshardy: could you check this out https://review.openstack.org/#/c/491446/ ?08:13
*** oidgar has quit IRC08:14
*** oidgar has joined #tripleo08:14
shardyjaosorior: ack, looking08:14
*** oidgar has quit IRC08:15
*** ratailor|Lunch is now known as ratailor08:16
*** garyk1 has joined #tripleo08:16
*** garyk has quit IRC08:17
gfidentejaosorior I think the 'null' value is passed as string to the puppet module there?08:17
shardyconfig/nodes/2ctlr.yml: No such file or directory08:18
shardyhrm, where did that go I wonder, I don't see it in openstack/tripleo-quickstart/config08:18
* shardy suspects it's related to switching 3nodes job to oooq08:19
shardytrown|outtypewww: ^^08:19
shardyhttp://logs.openstack.org/46/491446/3/check/gate-tripleo-ci-centos-7-3nodes-multinode-nv/ac58c02/console.html#_2017-08-08_05_05_38_62935308:19
*** derekh has joined #tripleo08:20
jaosoriorgfidente: is it? I thought it got there as a null08:20
jaosoriorI mean, an undef08:20
gfidentejaosorior I hit this before, I think the ~ represent null in yaml08:21
gfidentebut you can only use it as value, not as key08:22
gfidentenot sure how it behaves with list items08:22
shardyAha https://review.openstack.org/#/c/485689/ adds it08:23
jaosoriorgfidente: but, if it wouldn't have worked, it would have tried to give an invalid value for the certificate. And if it had an invalid value it would have failed entirely for the non-ssl cases08:23
gfidentejaosorior yeah I commented that in the submission08:24
gfidenteso what is it set to in hieradata?08:25
*** lucas-afk is now known as lucasagomes08:26
gfidente"tripleo::haproxy::service_certificate": null,08:27
gfidenteworks as is then08:27
shardyyeah I made a suggestion of another way to do it08:28
shardyso we only set that key when tls is enabled08:28
shardynot blocking if this works though08:28
*** paramite has joined #tripleo08:28
*** karthiks has joined #tripleo08:30
jaosoriorshardy commented08:32
shardyjaosorior: we're not passing an empty dict to puppet, it's passed to the map_merge08:33
shardyperhaps I got the order reversed08:33
shardybut it means you can only set the service_certificate key if public_tls_enabled is true08:33
shardyNo the order is ok08:34
shardyif public_tls_enabled, set ...::service_certificate else merge nothing08:34
shardycheck the nova-api link where we do similar for workers08:34
*** limao has quit IRC08:35
jaosoriorshardy: oooh, now I get it08:36
jaosorioractually I like that option more08:36
*** limao has joined #tripleo08:36
shardyOk cool - I guess they will work the same, but it means we don't have to care about the default in teh case where ssl is disabled08:36
jaosorioryeah08:36
jaosoriorI dig that08:36
gfidenteshardy unrelated but I think I am finally at the point where I need the node ip as ansible host var08:37
gfidentehave you explored ways of doing that already?08:37
shardygfidente: Is the list of ctlplane ips we already collect enough?08:39
shardyhttps://github.com/openstack/tripleo-validations/commit/60f9257683baff89f6a737addfa894b9c1c5186908:39
*** snecklifter has joined #tripleo08:40
shardygfidente: the only related things I've done are adding groups for each node name to resolve to the IP we already add to the inventory08:40
shardywhich makes it easy to run a playbook against either a node name, or it's IP as exposed via nova list08:40
shardywe can pass the same data into the workflow perhaps?08:40
*** limao has quit IRC08:41
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Move HAProxy's public TLS logic from controller to service template  https://review.openstack.org/49144608:41
gfidenteshardy adding groups for each node name is good for me08:45
gfidentebut then in there I need to set an ansible var to a different value for each host08:46
*** garyk1 has quit IRC08:50
shardygfidente: yup, you can specify different vars for each node in the inventory right?08:51
shardyI'm not sure how it works via the workflow, but in the dynamic-inventory I did that08:51
shardyhttps://github.com/openstack/tripleo-validations/commit/064a61c1a332c1e4163c1dea80d23b41d72e2e2508:51
*** garyk has joined #tripleo08:51
jaosoriorgfidente: are there plans to call ansible directly instead of doing the heat -> mistral -> ansible flow? Would be kinda cool to just call ansible from heat :)08:51
shardye,g we set deploy_server_id per server,08:52
shardyjaosorior: we're already doing that, and it's possible to run ansible directly on the CLI using heat stack outputs to provide the playbook08:52
jaosoriorright08:52
jaosoriorthat's nice08:52
shardythe issue is we can't run ceph-ansible that way because it needs to run on the groups of nodes08:52
shardyso I think we'll eventually want to just run mistral->ansible08:53
shardye.g without heat->mistral08:53
jaosoriorwould be cool to have a heat resource for for ansible though, and to be able to pass OS::Nova::Server's as the inventory08:53
shardyjaosorior: yeah, I see what you mean, but we'd need a sandboxed place to run ansible vs just on one node08:54
shardyin the heat community we decided to avoid running the config management tools server side, but clearly mistral has taken a different approach08:54
gfidenteshardy yeah that last sentence is the key factor :D08:55
jaosoriorshardy: weeell, another option would be to run ansible on the top, and then run heat stacks or workflows (hopefully those existing in shade already)08:55
gfidenteshardy jaosorior also calling mistral means you can use ansible, if you need to, but also any other workflow08:55
jaosoriorgfidente: right, and I have done mistral calling ansible for the key rotation (which doesn't work in containers)08:56
*** jprovazn has quit IRC08:56
jaosoriorgfidente: but it's a pain to debug, no usability, and I honestly thing it adds too much unnecessary complexity08:56
* jaosorior not a fan08:56
gfidentejaosorior yeah and for that calling the config tool server side, like shardy said, would probably help08:56
shardyjaosorior: yeah I think we're moving towards more ansible and less layers of indirection, but it's taking time because of backwards compatibility08:57
d0ugalshardy: well, technically, mistral hasn't taken an opinion, it is all done in a custom action :)08:57
jaosoriord0ugal: aah right.08:57
shardyd0ugal: ah, I thought the ansible action had landed as part of the standard mistral actions?08:57
shardymy mistake08:57
jaosoriorit's all actions that we maintain. So it's not even mistral enabling it08:57
d0ugalshardy: nope, it is in tripleo-common. It will likely be added to mistral in time tho - we just need to figure out the details, so some of this will be discussed.08:58
shardyd0ugal: ack, understood, thanks for clarifying08:58
d0ugalnp08:58
shardylike, we could have a heat plugin that does the same, create a manifest from a group of nodes or whatever08:58
gfidenteshardy sorry back to the per-host vars, where is it that you set those?08:58
jaosoriorshardy: right08:59
shardybut it's not something we wanted to do by default in heat due to scalabilty concerns08:59
jaosorioroh08:59
jaosoriorI think figuring out how to use straight mistral and keep the backwards compatilibity will just make everybody happier in the long run08:59
jaosorior* straight ansible08:59
jaosoriornot mistral08:59
shardygfidente: you can set vars in the inventory per group, e.g global for the "overcloud" group, per role in the "Controller" group, or per node in the "overcloud-controller-0" group08:59
*** atheurer_ has quit IRC09:00
gfidentejaosorior I think there are different opinions, one is to not use heat and consume the output from a workflow which is calling ansible09:00
shardyjaosorior: yeah "and keep backwards compatibility" is the hard part09:00
shardy;)09:00
jaosoriorshardy: right, but that effort could be done instead of the effort of trying to come up with all sorts of funky workarounds to make the current solution sorta work09:00
shardyalso just straight ansible isn't an option for the UI, as there's no API09:00
gfidenteshardy sorry I mean, where in the code are some node-vars set?09:01
gfidenteare there examples?09:01
shardyhttps://github.com/openstack/tripleo-validations/commit/064a61c1a332c1e4163c1dea80d23b41d72e2e2509:01
shardythat's one example I linked earlier gfidente ^^09:01
gfidenteah fine I missed it, though it's happening in inventory.py not in the templates09:02
shardygfidente: yeah, but the data is from overcloud stack outputs09:02
shardyso you should be able to create the same inventory in the workflow or heat inputs to the workflow09:03
gfidenteyeah09:03
shardyjaosorior: well, we've done a bunch of work this cycle to enable drving ansible directly, but it's just a step towards the approach you describe09:04
shardythe next step might be an ansible module that can do the heat translation to generate the playbooks, but I've not tried that yet09:04
shardye.g we still depend on the heat stack outputs at this point09:04
shardybecause all the user inputs are tied to the heat model09:04
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Download logs interface  https://review.openstack.org/47393309:05
gfidenteshardy ok thanks, looking into that09:05
*** salmankhan has joined #tripleo09:07
*** ykarel is now known as ykarel|lunch09:08
*** salmankhan1 has joined #tripleo09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879309:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906609:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915209:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170916909:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)09:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)09:10
openstackLaunchpad bug 1709169 in tripleo "buildlogs.centos.org DDOS" [Critical,Triaged]09:10
*** jprovazn has joined #tripleo09:10
*** salmankhan has quit IRC09:11
*** salmankhan1 is now known as salmankhan09:11
jaosoriordciabrin: anything in mergeable state?09:14
dciabrinjaosorior, I'm passing the ruby lint check locally, then I think galera and rabbit are09:15
jaosoriorfuck yeah09:16
*** garyk1 has joined #tripleo09:17
*** garyk has quit IRC09:17
*** cmyster has quit IRC09:21
*** lmiccini has quit IRC09:22
*** pgadiya has quit IRC09:26
*** ffiore has quit IRC09:27
*** ffiore_ has joined #tripleo09:28
*** pgadiya has joined #tripleo09:29
*** tosky has joined #tripleo09:29
jaosoriorflaper87: you around?09:29
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Make container varaibles defined for upgrades  https://review.openstack.org/49146309:34
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Add insecure registry param to overcloud upgrade  https://review.openstack.org/49173609:34
openstackgerritzenghui.shi proposed openstack/os-net-config master: Add NIC Mapping Reporting Feature  https://review.openstack.org/38351609:34
jaosoriorccamacho, marios, bandini: Could you check this out https://review.openstack.org/#/c/491390/ ?09:37
ccamachosure jaororior09:41
*** shardy has quit IRC09:43
jaosoriorccamacho: thanks09:46
bandinijaosorior: on a call. will do later09:47
*** pmannidi has joined #tripleo09:48
*** udesale__ has quit IRC09:49
mariosjaosorior: ack09:49
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Enable TLS in the internal network for horizon  https://review.openstack.org/48959309:50
*** marios has quit IRC09:52
*** marios has joined #tripleo09:52
*** cylopez has quit IRC09:53
*** shardy has joined #tripleo09:56
*** aufi has joined #tripleo09:58
openstackgerritNuman Siddique proposed openstack/tripleo-common master: Add OVN images to the overcloud containers  https://review.openstack.org/48987510:02
*** pkovar has joined #tripleo10:04
*** pgadiya has quit IRC10:07
openstackgerritNuman Siddique proposed openstack/tripleo-quickstart master: Add fset030 for OVN with containerized oc  https://review.openstack.org/49062410:09
*** dtantsur|afk is now known as dtantsur10:09
*** dr_gogeta86 has quit IRC10:09
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879310:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906610:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915210:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170916910:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)10:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)10:10
openstackLaunchpad bug 1709169 in tripleo "buildlogs.centos.org DDOS" [Critical,Triaged]10:10
*** dsariel has quit IRC10:11
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Add logrotate with crond service  https://review.openstack.org/49005010:11
*** dsariel has joined #tripleo10:11
bogdandofolks, PTAL containers logrotate https://review.openstack.org/#/q/topic:bug/170091210:11
*** dr_gogeta86 has joined #tripleo10:12
*** dr_gogeta86 has joined #tripleo10:12
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Drop mongo from UC deploy  https://review.openstack.org/48006310:17
bogdandorebased https://review.openstack.org/#/c/480063/, it was all +1/+2, please refresh votes :)10:17
*** agurenko has quit IRC10:17
*** agurenko has joined #tripleo10:18
*** pgadiya has joined #tripleo10:19
*** sri_ has quit IRC10:19
*** colonwq has quit IRC10:19
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Persist containerized services httpd logs  https://review.openstack.org/48995510:20
*** colonwq has joined #tripleo10:20
bogdandoditto ^^, it was WF+1, but merge conflicted10:20
*** fultonj has joined #tripleo10:22
*** ecerquei has joined #tripleo10:25
*** pkovar has quit IRC10:27
*** akrivoka has joined #tripleo10:28
*** pgadiya has quit IRC10:28
*** cmyster has joined #tripleo10:30
*** cmyster has quit IRC10:30
*** cmyster has joined #tripleo10:30
*** ecerquei has quit IRC10:32
*** katkapilatova has joined #tripleo10:36
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Adds when in upgrade_tasks playbook written by config download  https://review.openstack.org/49174910:37
*** pgadiya has joined #tripleo10:41
*** ykarel|lunch is now known as ykarel10:41
*** iranzo has quit IRC10:42
*** fultonj has quit IRC10:43
openstackgerritSaravanan KR proposed openstack/tripleo-common master: Provide a list of unused user env parameters in plan  https://review.openstack.org/49175310:51
openstackgerritzenghui.shi proposed openstack/tripleo-heat-templates master: Add PTP composable service  https://review.openstack.org/49131710:51
*** udesale has joined #tripleo10:53
*** mdnadeem has quit IRC10:53
*** bkopilov has quit IRC10:55
*** jkilpatr has joined #tripleo10:58
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Make container varaibles defined for upgrades  https://review.openstack.org/49146311:01
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Make container varaibles defined for upgrades  https://review.openstack.org/49146311:01
*** chem has joined #tripleo11:03
*** gcerami has joined #tripleo11:05
*** pkovar has joined #tripleo11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879311:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906611:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915211:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170916911:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)11:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)11:10
openstackLaunchpad bug 1709169 in tripleo "buildlogs.centos.org DDOS" [Critical,Triaged]11:10
*** dbecker has joined #tripleo11:11
*** fultonj has joined #tripleo11:12
jaosoriorshardy: mind revisiting this https://review.openstack.org/#/c/491446/ ?11:12
*** fultonj has quit IRC11:12
*** fultonj has joined #tripleo11:13
*** ffiore has joined #tripleo11:13
*** ffiore_ has quit IRC11:13
shardyjaosorior: done, thanks!11:13
*** akrivoka has quit IRC11:14
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Create separate resource for HAProxy horizon endpoint  https://review.openstack.org/49143711:16
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Enable TLS in the internal network for horizon  https://review.openstack.org/48959311:17
*** cylopez has joined #tripleo11:20
*** dbecker has quit IRC11:21
*** amoralej is now known as amoralej|lunch11:22
*** stendulker has quit IRC11:23
*** akrivoka has joined #tripleo11:26
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Fix parsing of DockerCephDaemonImage parameter  https://review.openstack.org/49175911:30
openstackgerritMichael  Henkel proposed openstack/os-net-config master: Make onboot parameter for ifcfg configuration configurable  https://review.openstack.org/48513211:30
*** akrivoka has quit IRC11:37
*** akrivoka has joined #tripleo11:37
*** aufi has quit IRC11:42
*** bfournie has joined #tripleo11:42
*** lucasagomes is now known as lucas-hungry11:46
gfidenteany yaql fan for https://review.openstack.org/491759 ?11:46
openstackgerritJan Provaznik proposed openstack/puppet-tripleo master: Do not create fs and server side key from manila  https://review.openstack.org/48250111:47
*** atoth has joined #tripleo11:48
*** shreshtha is now known as shreshtha|off11:48
jaosoriorgfidente: what could the value of DockerCephDaemonImage be?11:50
jaosoriorgfidente: also, you could use an OS::Heat::Value resource, and set the location there, then just get that value, so we would only call the yaql once.11:50
gfidentejaosorior any valid docker url for example11:51
*** abishop has joined #tripleo11:51
gfidentehostname:port/groupname/imagename:tagname11:51
gfidenteor also11:51
gfidentegroupname/imagename:tagname11:51
jaosorioroooh, right11:51
jaosoriorgfidente: that makes sense now.11:51
gfidentethe rightsplit yeah :(11:52
jaosoriorgfidente: anyway, I recommend using OS::Heat::Value11:52
gfidenteI tried using it11:52
gfidentebut it's not really saving much because11:52
gfidenteI need different parts in different values11:53
jaosorioroh11:53
jaosoriorok11:53
gfidenteit is fine, I can use it with the intent of isolating the mangling code11:53
gfidentebut it's not really making it smaller11:53
gfidentemoving in one place the parsing though, yes11:54
gfidenteI'll try that in an update11:54
gfidentethanks for checking it :D11:54
*** shreshtha|off is now known as shreshtha11:56
*** psachin has quit IRC11:58
*** jrist has joined #tripleo11:58
*** mdnadeem has joined #tripleo11:59
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Keep dynamic network creation backward compatible.  https://review.openstack.org/49151011:59
jaosoriorgfidente: no worries dude. you're right, it doesn't bring that much value to use the Value resource. I +2ed your patch11:59
gfidentejaosorior well it makes it easy to read the code and keep the parsing in a single place, still good idea to me12:00
gfidentethanks!12:00
jaosoriorgfidente: ok, let me know if you change it then, so I can revisit your patch. no problem12:00
*** pchavva has joined #tripleo12:01
*** psachin has joined #tripleo12:01
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Keep dynamic network creation backward compatible.  https://review.openstack.org/49151012:01
EmilienMhi12:02
openstackgerritzenghui.shi proposed openstack/tripleo-heat-templates master: Add PTP composable service  https://review.openstack.org/49131712:03
EmilienMcan someone get https://review.openstack.org/#/c/491522/ please? it should help to stabilize a little bit the CI12:03
*** jpena|off is now known as jpena12:03
jaosoriorEmilienM: yessir12:05
*** trown|outtypewww is now known as trown12:05
EmilienMjaosorior: thx!12:05
*** rlandy has joined #tripleo12:06
cylopezjaosorior++ :-)12:06
trownshardy: ya 3nodes job is broken because we decided to merge stuff that merge conflicted all the patches for it while I was on PTO (rather than merge the 3nodes patches) ... I think slage was going to revert the project config patch to fix it while I get the other patches working again12:06
slaglei put up a project-config patch for that12:08
*** shreshtha has quit IRC12:09
*** bfournie has quit IRC12:09
*** bfournie has joined #tripleo12:10
trownshardy: slagle: ya I am fine with merging the revert... I would also be ok reverting the multinode-containers patches that caused this in the first place12:10
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879312:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906612:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915212:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170916912:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)12:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)12:10
openstackLaunchpad bug 1709169 in tripleo "buildlogs.centos.org DDOS" [Critical,Triaged]12:10
trownEmilienM: why was the multinode-containers job added immediately as voting gate job? seems not very stable12:10
slagletrown: which ones are those?12:10
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Also write an upgrade_(batch)_tasks playbook  https://review.openstack.org/49084812:12
EmilienMtrown: multinode-containers was supposed to be stable12:12
*** ffiore has quit IRC12:13
trownEmilienM: well merging the patches for that broke 3nodes which was high priority 3 weeks ago12:13
trownEmilienM: and all patches were ready to merge for 3nodes when I left for PTO12:13
*** bfournie has quit IRC12:14
EmilienMtrown: sorry12:14
pabelangertrown: EmilienM: http://logs.openstack.org/83/489083/5/gate/gate-tripleo-ci-centos-7-containers-multinode/d71b1ec/console.html#_2017-08-08_11_02_29_447001 that seems odd12:14
trownEmilienM: now they are in various states of disrepair, and then we had the fun buildlogs ddos yesterday preventing me to make any progress in fixing them12:14
*** ratailor has quit IRC12:15
EmilienMtrown: bth, we've had a bunch of issues in the meantime12:15
EmilienMtbh*12:15
trownEmilienM: ya... that time of the cycle12:15
EmilienMtrown: anyway, I'm happy to help and get the 3nodes ready again12:16
EmilienMpabelanger: I'm in meetings all week - I can't really help during the day12:16
trownEmilienM: ya I think in the short term we should just merge slagle's revert to get the job back green12:16
trownEmilienM: probably needs your +1... slagle can you link it here?12:16
EmilienMtrown: unless we can make it right this week?12:16
slaglei think he already did12:16
trownah ok12:17
EmilienMtrown: https://review.openstack.org/#/c/491477/ ?12:17
slaglehttps://review.openstack.org/#/c/491477/12:17
EmilienMif you think we can make it working this week, we can avoid the revert, maybe?12:17
trownEmilienM: it is really cheap to just revert12:17
trownEmilienM: I will put back up the DNM patches to get results12:17
EmilienMtrown: but how are we going to tes it?12:17
EmilienMthe dummy patch in tripleo-ci ?12:17
trownit is actually 2... because we dont run that job on tripleo-ci patches currently... but ya12:18
*** sbrzozow has joined #tripleo12:18
trowna patch on tht and a patch on tripleo-ci ... I can just un-abandon the ones I used before12:18
EmilienMI need to go offline now, ttyl12:19
EmilienMand sorry again - last weeks were terrible in ci (tm)12:20
pabelangerEmilienM: okay, that warning is expected. but going to try and fix it12:20
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/48739812:24
*** skramaja has quit IRC12:24
*** jcoufal has joined #tripleo12:25
*** Goneri has joined #tripleo12:26
*** rwsu has quit IRC12:28
*** rwsu has joined #tripleo12:29
jristreviews plz https://review.openstack.org/#/c/482979/112:29
*** jaganathan has quit IRC12:30
*** nyechiel has quit IRC12:34
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Docker/TLS everywhere: Add telemetry and neutron services to environment  https://review.openstack.org/49178212:35
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Fix parsing of DockerCephDaemonImage parameter  https://review.openstack.org/49175912:37
gfidentejaosorior ^^ ?12:37
*** dparkes has joined #tripleo12:37
*** ffiore has joined #tripleo12:38
openstackgerritzenghui.shi proposed openstack/os-net-config master: Add NIC Mapping Reporting Feature  https://review.openstack.org/38351612:38
*** iranzo has joined #tripleo12:39
*** iranzo has joined #tripleo12:39
*** mmethot has joined #tripleo12:40
*** gcerami1 has joined #tripleo12:40
*** aufi has joined #tripleo12:41
*** rhallisey has joined #tripleo12:42
*** bfournie has joined #tripleo12:43
*** gcerami has quit IRC12:43
*** gkadam has quit IRC12:45
*** dprince has joined #tripleo12:45
*** leitan has joined #tripleo12:45
*** lucas-hungry is now known as lucasagomes12:45
*** jpena is now known as jpena|mtg12:46
*** tvignaud has quit IRC12:47
*** akrivoka has quit IRC12:47
*** cmyster has quit IRC12:48
*** amoralej|lunch is now known as amoralej12:49
*** Goneri has quit IRC12:50
*** jmelvin has joined #tripleo12:50
*** ecerquei has joined #tripleo12:50
*** mandre_away is now known as mandre_mtg12:51
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: Don't doube kill heat_all  https://review.openstack.org/49178712:53
*** athomas has joined #tripleo12:53
*** pradk has joined #tripleo12:54
*** aufi has quit IRC12:56
*** jpena|mtg is now known as jpena|off12:56
*** bfournie1 has joined #tripleo12:57
*** tvignaud has joined #tripleo12:58
*** tvignaud has quit IRC12:58
*** tvignaud has joined #tripleo12:58
*** atheurer has joined #tripleo12:59
*** bfournie has quit IRC12:59
*** ansmith has joined #tripleo12:59
*** catintheroof has joined #tripleo13:00
*** jrist has quit IRC13:02
*** akrivoka has joined #tripleo13:03
*** garyk1 has quit IRC13:03
*** maeca has joined #tripleo13:04
*** pradk has quit IRC13:06
*** nyechiel has joined #tripleo13:06
*** athomas has quit IRC13:06
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Add release notes for TripleO-Validations patch.  https://review.openstack.org/48774413:08
*** rlandy has quit IRC13:08
openstackgerritGael Chamoulaud proposed openstack-infra/tripleo-ci master: Enable tripleo-validations tests  https://review.openstack.org/48108013:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879313:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906613:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915213:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170916913:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)13:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)13:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)13:10
openstackLaunchpad bug 1709169 in tripleo "buildlogs.centos.org DDOS" [Critical,Triaged]13:10
jaosoriorabishop: you wanted to talk about barbican keys13:10
*** links has quit IRC13:11
*** pgadiya has quit IRC13:13
abishopjaosorior: yes, but I have mtgs coming up. I'll be in touch soon13:13
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Adding scenarios tests in default regex  https://review.openstack.org/49179413:14
jaosoriorok13:15
*** ffiore_ has joined #tripleo13:16
*** ffiore has quit IRC13:17
*** bkopilov has joined #tripleo13:17
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Make cinder-manage db sync run on only one controller during upgrade  https://review.openstack.org/49179913:19
*** lblanchard has joined #tripleo13:21
*** lblanchard has quit IRC13:21
*** sshnaidm|afk is now known as sshnaidm13:21
*** lblanchard has joined #tripleo13:22
*** katkapilatova has left #tripleo13:22
*** marrusl has joined #tripleo13:24
*** ecerquei_ has joined #tripleo13:26
*** iranzo has quit IRC13:26
*** agopi|away has joined #tripleo13:27
*** ecerquei_ has quit IRC13:28
*** ecerquei_ has joined #tripleo13:28
*** ecerquei has quit IRC13:28
*** agopi|away has quit IRC13:30
*** agopi|away has joined #tripleo13:31
*** zshi_laptop has quit IRC13:32
bandinijaosorior: if you have some time https://review.openstack.org/#/c/489277/ ?13:32
*** cshastri has quit IRC13:33
mwhahahajust a reminder if anyone has anything to discuss during todays meeting, please add it to the etherpad https://etherpad.openstack.org/p/tripleo-meeting-items13:34
*** akrivoka has quit IRC13:35
*** akrivoka has joined #tripleo13:36
*** cshastri has joined #tripleo13:36
*** limao has joined #tripleo13:36
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo master: Enable TLS configuration for containerized RabbitMQ  https://review.openstack.org/49160013:39
*** bfournie1 has quit IRC13:40
*** nyechiel has quit IRC13:45
sshnaidmdid anyone mention very long overcloud deployment in multinode jobs?13:45
sshnaidmpabelanger, is it related to infra proxies? ^^13:45
*** jtomasek has joined #tripleo13:46
*** mdnadeem has quit IRC13:46
*** nyechiel has joined #tripleo13:50
slaglebogdando: we can still fix bugs in pike, fwiw13:53
openstackgerritNuman Siddique proposed openstack/tripleo-heat-templates master: Support deploying OVN as container services  https://review.openstack.org/46886013:53
bogdandoslagle: I'm not sure13:53
numansbeagles, bogdando can you please have a look at this patch again - https://review.openstack.org/46886013:53
bogdandoEmilienM: could you please comment? https://review.openstack.org/#/c/491787/13:53
slaglebogdando: not sure about if we can still fix bugs in pike?13:53
beaglesnumans: ack13:53
*** jlabarre has joined #tripleo13:54
bogdandoslagle: yeah, should be only high/crit from now until the stable/pike, AFAIK13:54
chandankumararxcruz: Regarding this review https://review.openstack.org/#/c/491189/13:54
slaglebogdando: a bit subjective i guess, but i don't mind waiting13:55
bogdandonumans: does it has FFE?13:55
slaglebogdando: the undercloud containers job is our least stable job and it is voting and in the gate, which is quite problematic13:55
chandankumararxcruz: i donot wanted to use pretty or --subunit/ norpretty as subunit generation is done at other part13:55
bogdandoslagle: we could make it high bug then?13:55
chandankumararxcruz: i wanted to find the tempest status13:55
openstackgerritAthlan-Guyot sofer proposed openstack/instack-undercloud master: Remove nova cell leftover of undercloud upgrade from N->O.  https://review.openstack.org/47921313:55
chandankumararxcruz: for that i have used testr failing --list13:56
*** oidgar has joined #tripleo13:56
bogdandonumans: feature freeze exception for pike I mean13:56
numansbogdando, I haven't requested for it, but I can send an email to the ML and ask if it is possible13:56
pabelangerslagle: no, likely a result of losing OSIC-cloud1. Jobs are now running on slower clouds13:57
bogdandonumans: yes please do. We can not merge features related patches otherwise13:57
chandankumararxcruz: and pretty is generally used with subunit-trace which we are not using during ostestr run13:57
slaglepabelanger: "no" to what?13:57
slaglepabelanger: i don't think this has a lot to do with running on slower clouds13:57
numansbogdando, thanks, would do13:57
gfidenteEmilienM are you running the meetin gtoday?13:58
*** jprovazn has quit IRC13:58
mwhahahagfidente: no i am13:58
slaglepabelanger: i don't think we can say the job is stable, as long as it runs on certain clouds. isn't that the definition of unstable? :)13:58
mwhahahahe's off doing meetings13:58
gfidentemwhahaha ack thanks13:59
bnemecslagle: I think maybe pabelanger meant to respond to sshnaidm?13:59
slagleOH. well then that makes more sense13:59
sshnaidmpabelanger, ok14:00
*** jlabarre has left #tripleo14:00
*** jlabarre has quit IRC14:00
mwhahahameeting time14:00
mwhahaha#startmeeting tripleo14:00
openstackMeeting started Tue Aug  8 14:00:58 2017 UTC and is due to finish in 60 minutes.  The chair is mwhahaha. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
*** jlabarre has joined #tripleo14:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
*** nyechiel_ has joined #tripleo14:01
*** openstack changes topic to " (Meeting topic: tripleo)"14:01
openstackThe meeting name has been set to 'tripleo'14:01
mwhahaha#topic agenda14:01
*** openstack changes topic to "agenda (Meeting topic: tripleo)"14:01
mwhahaha* review past action items14:01
mwhahaha* one off agenda items14:01
mwhahaha* bugs14:01
mwhahaha* Projects releases or stable backports14:01
mwhahaha* CI14:01
mwhahaha* Specs14:01
mwhahaha* open discussion14:01
mwhahahaSo who's here today?14:01
beagleso/14:01
marioso/14:01
jaosorioro/14:02
sshnaidmo/14:02
ccamachoo/14:02
owalsho/14:02
oidgaro/14:03
*** jaganathan has joined #tripleo14:03
mwhahahai like how everyone disappeared :D14:03
jankio/14:03
mwhahahawell then let's get going14:03
bogdandoo/14:04
mwhahaha#topic review past action items14:04
*** openstack changes topic to "review past action items (Meeting topic: tripleo)"14:04
mwhahahaEmilienM to switch master to run new upgrade jobs and not old ones anymore14:04
*** nyechiel has quit IRC14:04
mwhahahanot sure if that's been done yet given the CI issues as of late so we'll pospone that14:04
mwhahahajaosorior and abishop to talk together about plans for queens relating to barbican backends (prepare ptg session if needed + discuss about migration tool)14:04
mwhahahajaosorior, abishop -^ any update?14:04
abishopmwhahaha: sorry, none from my end (I've been away), but will make it a priority now that I'm back14:06
mwhahahak14:06
mwhahaha jkilpatr brings up perf testing discussion again when tripleo promotion workflow moved to RDO14:06
mwhahahajkilpatr: -^ any update?14:06
*** liverpooler has joined #tripleo14:06
mwhahaha#action EmilienM to switch master to run new upgrade jobs and not old ones anymore (postponed)14:07
mwhahaha#action jaosorior and abishop to talk together about plans for queens relating to barbican backends (prepare ptg session if needed + discuss about migration tool) (postponed)14:07
jkilpatrmwhahaha, I'm not really sure about the status of the RDO/tripleo promotion stuff14:07
jkilpatrI keep hearing about a dlrn api I can use to vote, but I've never seen any docs for it, where should I be looking?14:07
mwhahahajkilpatr: not sure we'll follow up off line about that, probably want to check in #rdo around some of that14:08
jkilpatrmwhahaha, sounds good.14:08
mwhahahateam to review PTP support spec https://review.openstack.org/#/c/483227/14:08
mwhahahai've noticed some patches around PTP support so please make sure to checkout the spec14:09
mwhahahamoving on14:09
mwhahaha#topic one off agenda items14:09
*** openstack changes topic to "one off agenda items (Meeting topic: tripleo)"14:09
mwhahaha#link https://etherpad.openstack.org/p/tripleo-meeting-items14:09
mwhahahathe items list is empty for today, does anyone have anything pressing they would like to talk about?14:09
gfidentecan I add a topic on the fly?14:09
mwhahahasure14:09
gfidentewas thinking to move rgw testing from scenario4 to scenario114:10
gfidentehttps://review.openstack.org/#/c/491566/14:10
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879314:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906614:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915214:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)14:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)14:10
gfidentethis to facilitate testing of fixes for rgw and mds independently14:10
gfidentebecause currently scenario4 uses both mds and rgw, while scenario1 uses ceph but doesn't enable any of the two14:10
mwhahahasounds reasonable to me14:10
gfidenteanything against the reshuffle?14:10
gfidentecan you guys point me to the code which matches scenario jobs with file changes?14:11
gfidenteI can't find that anymore14:11
slaglegfidente: that's in project-config14:11
gfidenteslagle++ ah thanks! :D14:11
mwhahahagfidente: i think it's in layout.yaml14:11
gfidentethanks guys14:12
mwhahahagfidente: might be a good idea to send a note to the ML about the switch14:12
gfidentemwhahaha will do14:12
mwhahaha#action gfidente to send an ML note about moving ceph rgw from scenario004 to 00114:12
mwhahahaany other topics?14:12
mwhahahasounds like no14:13
mwhahahamoving on14:13
mwhahaha#topic bugs14:13
*** openstack changes topic to "bugs (Meeting topic: tripleo)"14:13
mwhahaha#link https://launchpad.net/tripleo/+milestone/pike-rc114:13
mwhahahawe've got a bunch of high/critical bugs14:13
mwhahahaplease take a look at the list as we need to start addressing some of these for RC114:14
*** pmannidi has quit IRC14:14
mwhahahaalso see EmilienM's note about the RC schedule on the ml14:14
mwhahaha#link http://lists.openstack.org/pipermail/openstack-dev/2017-August/120806.html14:14
mwhahahaany one have any specific bugs they want to point out? or have issues with?14:15
*** jtomasek has quit IRC14:15
beaglescan we remove the milestone from ones marked invalid/incomplete?14:15
*** dtrainor has quit IRC14:16
*** dtrainor has joined #tripleo14:16
mwhahahais there a better way to track when the bug was reported?14:16
mwhahahaor are we moving the invalid bugs incorrectly14:16
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo master: Enable TLS configuration for containerized HAProxy  https://review.openstack.org/49159914:17
*** agurenko has quit IRC14:17
*** fandrieu has joined #tripleo14:17
mwhahahawe don't really have too many of them but maybe we can think of a different thing to do with those so they don't show up on the list14:18
mwhahahaanyway14:18
mwhahaha#topic projects releases or stable backports14:18
*** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)"14:18
beaglesack14:18
mwhahahaany one have any stable backports they need reviews on?14:18
mwhahahaalso note that there is a bug around the docs job for tripleo-common being broken on stable/ocata. https://bugs.launchpad.net/bugs/170915214:19
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)14:19
mwhahahai need to see if we have a solution for that today14:20
slaglei have a patch that removes the svg's, which makes the job pass14:20
slaglei don't really know why it's suddenly broken though14:20
mwhahahathat's probably not right since everyone else has those14:20
mwhahahabut if no one has another solution we might just pull them14:21
*** bfournie has joined #tripleo14:21
mwhahahamoving on14:21
mwhahaha#topic CI14:21
*** openstack changes topic to "CI (Meeting topic: tripleo)"14:21
*** adarazs is now known as adarazs_mtg14:21
mwhahahaI think the buildlogs ddos is over, ci seemed to be doing better today.14:22
mwhahahapabelanger do you have any update you want to share with the elastic stuff?14:22
sshnaidmfyi https://bugs.launchpad.net/tripleo/+bug/170932714:23
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]14:23
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Enable TLS configuration for containerized HAProxy  https://review.openstack.org/49160214:23
mwhahahak sounds like we have some perf issues without osic14:24
openstackgerritMichele Baldessari proposed openstack/instack-undercloud master: Remove docker --iptables=false on the undercloud  https://review.openstack.org/49182414:24
mwhahahaIf we find perf fixes we may also want to look into backporting some of those for the scenario upgrade jobs in ocata as they are timing out still14:24
mwhahahaany other CI issues?14:25
*** jpena|off is now known as jpena14:25
sshnaidmit ran on centos-7-2-node-infracloud-vanilla-10319460, not sure it's osic.. but seems like infra issue anyway14:25
sshnaidmwe promoted today14:25
mwhahahayay promotion14:25
sshnaidmand that's all good news about CI14:25
mwhahahak moving on14:26
mwhahaha#topic specs14:26
mwhahaha#link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open14:26
*** openstack changes topic to "specs (Meeting topic: tripleo)"14:26
mwhahahathe usual, take some time to review specs. the ptp was mentioned eariler and we have some patches for it. So it would be a good idea to make sure it's in a good spot before we merge the code14:26
mwhahahaanyone have any specific specs they want to talk about?14:27
openstackgerritMarios Andreou proposed openstack/tripleo-common master: Download and run upgrade/deploy_steps_playbooks for upgrade  https://review.openstack.org/49084714:27
mwhahahamoving on14:27
mwhahaha#topic open discussion14:27
*** openstack changes topic to "open discussion (Meeting topic: tripleo)"14:27
mwhahahalast call for things to talk about14:27
mwhahahaif nothing, i'll close the meeting in 2 minutes and we can get back to work14:28
*** itlinux has joined #tripleo14:29
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Correct gnocchi-upgrade command quotes  https://review.openstack.org/49182614:29
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: WIP show how to create per node service IPs map  https://review.openstack.org/49182814:29
*** anshul has quit IRC14:29
shardygfidente: ^^ incomplete but that shows the approach we discussed14:29
shardyhttp://paste.openstack.org/show/617793/14:30
mwhahahaok thanks everyone14:30
mwhahaha#endmeeting14:30
*** openstack changes topic to ""you can't land a Cessna with workarounds, so don't try in Quickstart" - TripleO : http://tripleo.org/ | https://wiki.openstack.org/wiki/TripleO | Meetings On Tuesdays at 14:00 UTC here."14:30
openstackMeeting ended Tue Aug  8 14:30:21 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:30
openstackMinutes:        http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-08-08-14.00.html14:30
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-08-08-14.00.txt14:30
openstackLog:            http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-08-08-14.00.log.html14:30
shardythanks for running the meeting today mwhahaha14:30
sshnaidmdoes anybody know why it happens? 404 Client Error: Not Found ("no such id: docker.io/tripleoupstream/centos-binary-barbican-api:latest")14:31
mwhahahamissing container image?14:32
shardyyeah either it's missing from the registry (or cache of the registry in CI?) or network issues?14:33
*** gbarros has joined #tripleo14:33
sshnaidmmwhahaha, shardy where does it download from? dockerhub or undercloud?14:34
mwhahahathat looked like dockerhub14:34
*** jaganathan has quit IRC14:34
shardyyeah the error says dockerhub but which is used depends on your configuration from overcloud container image prepare14:35
sshnaidm404 means it doesn't exist, not even network failure, but https://hub.docker.com/r/tripleoupstream/centos-binary-barbican-api/14:35
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Enable TLS configuration for containerized RabbitMQ  https://review.openstack.org/49160414:35
sshnaidmhttp://logs.openstack.org/16/442716/20/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container/ec816a8/logs/undercloud/home/jenkins/overcloud_prep_containers.log.txt.gz#_2017-08-08_09_22_0914:36
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Correct gnocchi-upgrade command quotes  https://review.openstack.org/49182614:37
shardysshnaidm: yeah but is the 404 coming from dockerhub directly or do we have a proxy en-route to there in CI?14:37
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Use stdout_lines instead of stdout for subnode inventory  https://review.openstack.org/48339614:38
gfidenteshardy that is great, so you'd keep it separate from ctlplane_service_ips14:38
*** jpena is now known as jpena|off14:38
gfidentenot have a single structure with both?14:38
sshnaidmshardy, not sure how it works today.. pabelanger ?14:38
shardygfidente: yeah I guess we could combine them14:39
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Add featureset for 3nodes multinode job  https://review.openstack.org/48615514:39
shardygfidente: then we'd have some extra logic in overcloud.j2.yaml to create the map based on whatever per node key (name/ip/id) you need14:39
shardygfidente: feel free to take over that review or just copy from it and I'll abandon14:39
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Add node config variables to support deployed server  https://review.openstack.org/48568914:40
*** florianf has quit IRC14:40
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Move common multinode role setup from tripleo-ci  https://review.openstack.org/48740814:40
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: HAProxy: Set listen options for internal services too  https://review.openstack.org/49183214:41
flaper87jaosorio here14:43
gfidenteshardy wait that output is per role though right?14:43
*** shreshtha has joined #tripleo14:44
shardygfidente: No it's per node, we get a list per node from e.g get_attr: [{{role.name}}, service_ips] in overcloud.j214:44
*** dtantsur is now known as dtantsur|brb14:44
shardywhich we can then use to create a per-node map, e.g via yaql or repeat14:45
shardygfidente: I can add the second part to the WIP patch but may not get to it until tomorrow14:45
*** gcerami1 is now known as gcerami|backin1014:46
*** links has joined #tripleo14:48
*** links has quit IRC14:49
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Containarise Barbican API  https://review.openstack.org/48145114:49
*** cshastri has quit IRC14:50
rcerninping tripleo, shardy: hi, guys can we use the SoftwareConfig or what shall we use to pass multiple scripts to the PostDeployment via multiple ExtraConfigs, like one for ControllerExtraConfig, NovaComputeExtraConfig and ExtraConfig ?14:51
*** florianf has joined #tripleo14:53
*** dmarlin has joined #tripleo14:54
*** gcerami|backin10 is now known as gcerami14:54
*** snecklifter has quit IRC14:55
shardyrcernin: there are two different ExtraConfig interfaces14:55
shardyhttps://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/node_config.html14:55
shardyhttps://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/extra_config.html14:55
shardyrcernin: the ones you mention are for passing hieradata overrides to puppet (e.g the *ExtraConfig parameters)14:56
shardythe second ones can be used to apply SoftwareConfig resources to either specific roles, or all roles14:56
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.j2.yaml#L6014:57
shardyrcernin: looks like the docs are missing one OS::TripleO::NodeExtraConfigPost14:58
*** jaganathan has joined #tripleo14:58
shardywhich is probably the one you want if you want to run multiple scripts on all nodes, or certain roles, after the TripleO config has happened14:58
*** eck` is now known as eck`gone14:59
*** eck`gone is now known as eck`15:00
*** dmsimard is now known as dmsimard|afk15:00
*** gbarros has quit IRC15:01
*** psachin has quit IRC15:01
*** yprokule has quit IRC15:03
*** gbarros has joined #tripleo15:04
marioschem: o/ thanks for checking https://review.openstack.org/#/c/491749/1/tripleoclient/v1/overcloud_config.py i added some comments when you get a chance again much appreciated15:05
*** jrist has joined #tripleo15:05
*** pradk has joined #tripleo15:05
openstackgerritMerged openstack/tripleo-quickstart master: Create configurations for pike jobs in ci.centos.org  https://review.openstack.org/49096015:06
*** pradk has quit IRC15:07
chemmarios: looking15:07
*** anshul has joined #tripleo15:08
marioschem: updated plan at https://bugs.launchpad.net/tripleo/+bug/1708115 comment #8 fwiw as well  shardy appreciate your comments on the approach in that comment too when you get a chance (will bring for discussion tomorrow too just fyi)15:08
openstackLaunchpad bug 1708115 in tripleo "Ensure non-controller are usable after upgrade and before converge." [Critical,Triaged]15:08
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879315:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906615:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915215:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932715:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170933915:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)15:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)15:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]15:10
openstackLaunchpad bug 1709339 in tripleo "CI: duplicate /etc directories in logs for containers" [Critical,Triaged]15:10
sshnaidmmwhahaha, did we have a patch in puppet to fix such issue? https://bugs.launchpad.net/tripleo/+bug/1709339  I'm not sure if it was your or jaosorior that submitted it..15:10
mwhahahasshnaidm: not that i'm aware of15:10
jaosoriorsshnaidm: not me15:10
sshnaidmsorry, amnesia15:11
chemmarios: replyed, do you need a physical run of this ?15:13
*** jaganathan has quit IRC15:14
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Containarise Barbican API  https://review.openstack.org/48145115:17
*** fandrieu has quit IRC15:17
rcerninshardy: OS::TripleO::NodeExtraConfigPost can we use it per Controller,NovaCompute,All?15:17
marioschem: yeah for sure this is next, currently there are a lot of reviews in the top of that tht one so i need to try with all of those applied and see what else is missing15:17
*** fandrieu has joined #tripleo15:17
*** gvrangan_odl has joined #tripleo15:19
shardyrcernin: it runs on all roles but you could have logic in the script that is run which exits early on roles, e.g based on knowledge of the hostname pattern or some other condition15:19
chemmarios: ack, I'll try to test it15:19
rcerninshardy: I see, now how an I add more scripts to SoftwareConfig, is it just adding another ExtraConfig: under resources?15:20
openstackgerritOr Idgar proposed openstack/tripleo-common master: WIP Add Octavia post deployment steps to tripleo workflows  https://review.openstack.org/48745015:21
shardyrcernin: yes you can just add more SoftwareConfig/SoftwareDeploymentGroup pairs in your template15:21
rcerninshardy: http://paste.openstack.org/show/617800/15:21
*** mcornea has quit IRC15:22
shardyrcernin: that won't work because the yaml will ignore the first two ExtraConfig duplicates15:22
shardyrcernin: you need e.g ExtraConfig1 paired with ExtraDeployments115:22
*** jlinkes has quit IRC15:22
shardyetc15:22
shardyrcernin: you can then use depends_on (on the Deployment resources) to achieve the desired ordering, if that matters15:23
*** jmelvin has quit IRC15:23
rcerninshardy++ :) Thank you15:24
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Containarise Barbican API  https://review.openstack.org/48145115:27
*** dtantsur|brb is now known as dtantsur15:30
*** limao has quit IRC15:33
*** limao has joined #tripleo15:34
*** rhallisey has quit IRC15:37
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Correct gnocchi-upgrade command quotes  https://review.openstack.org/49182615:37
pabelangersshnaidm: shardy: you need to setup docker to use our reverse proxy. I sent a post to ML a few months ago how to do it15:37
*** ccamacho has quit IRC15:38
*** ccamacho has joined #tripleo15:38
*** ebarrera has quit IRC15:38
*** limao has quit IRC15:38
pabelangersee http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/scripts/configure_mirror.sh#n99 for reverse proxy URL15:38
*** marios has quit IRC15:39
*** tosky has quit IRC15:40
*** tosky has joined #tripleo15:40
*** jprovazn has joined #tripleo15:41
*** ebarrera has joined #tripleo15:42
sshnaidmpabelanger, I think we use it https://github.com/openstack/tripleo-quickstart/blob/18cf8f48e70a68063232a5c4c13e03c1bd5d3ab8/config/general_config/featureset022.yml#L715:44
pabelangersshnaidm: do you source /etc/ci/mirror-info.sh?15:47
*** Vineet has joined #tripleo15:48
pabelangersshnaidm: http://logs.openstack.org/48/490748/3/gate/gate-tripleo-ci-centos-7-undercloud-containers/e51e50f/logs/etc/docker/daemon.json.txt.gz is empty15:48
*** janki has quit IRC15:48
pabelangersshnaidm: so chances are you are not using the reverse proxy15:48
sshnaidmpabelanger, hmm.. maybe not in this job15:49
pabelangersshnaidm: see commit message for more details: http://git.openstack.org/cgit/openstack-infra/system-config/commit/?id=836cddb2f2242872822a5429f465cb6965c0df6915:49
mwhahahapython-networking-bagpipe stikes again :/15:51
mwhahahahttp://logs.openstack.org/88/474788/8/gate/gate-tripleo-ci-centos-7-nonha-multinode-oooq/b363c4f/console.html#_2017-08-08_15_31_22_45909915:51
mwhahahawe really need to make the package builds for ZUUL_CHANGES throw warnings if they fail to build15:51
pabelangerHmm, elastic-recheck should have commented on that15:53
mwhahahathere's some others where elastic-recheck commented15:54
*** gvrangan_odl has quit IRC15:54
*** hamzy has quit IRC15:55
*** dparkes has quit IRC15:55
*** jmelvin has joined #tripleo15:56
*** ebarrera has quit IRC15:58
mwhahahapabelanger: soooo i got a puppet-tripleo unit job logs published to my puppet-mistral lint results15:58
mwhahahapabelanger: http://logs.openstack.org/52/491352/1/gate/gate-puppet-mistral-puppet-lint/9b68f25/console.html#_2016-12-16_09_27_21_57327815:58
*** agurenko has joined #tripleo15:59
*** ffiore_ has quit IRC15:59
*** jfrancoa has quit IRC16:00
*** hewbrocca is now known as hewbrocca_afk16:01
pabelangermwhahaha: wow, look at the date timestamp on that16:02
mwhahahapabelanger: yea i just noticed that16:02
pabelangersomething really weird going on there16:02
mwhahahasomething weird happened16:02
*** nyechiel_ has quit IRC16:02
pabelangerk16:02
pabelangerwill move this to openstack-infra an look16:03
flaper87bogdando: does kubespray require the ssh user to have access to docker?16:05
flaper87bogdando: http://logs.openstack.org/59/471759/54/experimental/gate-tripleo-ci-centos-7-scenario006-multinode-oooq-nv/0a9490e/logs/undercloud/var/log/mistral/executor.log.txt.gz16:05
*** cylopez has quit IRC16:05
flaper87bogdando: I suspect docker is actually running but the tripleo-admin user doesn't have permissions on the socket16:05
bogdandoflaper87: I'm used to add the ssh user to the docker group as a provision requirement for k8s clusters by kargo. Never tested otherwise16:06
bogdandoflaper87: this can be also checked by the CI jobs at gitlab16:06
flaper87bogdando: ok, that might actually answer my question16:07
flaper87bogdando: thanks16:07
d0ugalflaper87: How do you read that :)16:08
flaper87d0ugal: dude, I've no idea. We seriously need to fix logging from that ansible action16:08
d0ugalflaper87: Yeah, any ideas? Can we have ansible output JSON or something we can parse?16:08
d0ugalI need to run, but I might look into this tomorrow - should be fairly simple to get some easy wins.16:10
flaper87d0ugal: I thought about it the other day and I think we'll have to parse the ansible output AND also do some changes to mistral. AFAICT, it seems that mistral is not encoding the output before spitting it in the logs16:10
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879316:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906616:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915216:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932716:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170933916:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)16:10
flaper87d0ugal: ditto16:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)16:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]16:10
openstackLaunchpad bug 1709339 in tripleo "CI: duplicate /etc directories in logs for containers" [Critical,Triaged]16:10
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Add missing module documentation  https://review.openstack.org/49184516:10
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: Add validation task in docker services [cinder]  https://review.openstack.org/48994016:10
d0ugalflaper87: well, the action gives mistral a dict - so that isn't really something you can just encode :)16:10
d0ugalso AFAICT, it is just an action issue16:11
d0ugalbut I'll see what I can learn16:11
* d0ugal leaves16:11
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574716:11
flaper87d0ugal: but mistral doesn't "print" the dict, does it ?16:12
flaper87d0ugal: I just don't want to encode things before we really need to encode them16:12
flaper87d0ugal: let's talk tomorrow16:12
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates stable/newton: [NEWTON-ONLY] Ignore Ceph healt warning states by default  https://review.openstack.org/49184716:16
*** nyechiel_ has joined #tripleo16:22
*** ykarel has quit IRC16:22
*** agopi|away has quit IRC16:24
*** ccamacho has quit IRC16:24
*** lucasagomes is now known as lucas-afk16:24
*** ggillies_ has quit IRC16:27
*** pcaruana has quit IRC16:27
*** ggillies has joined #tripleo16:30
*** rcernin has quit IRC16:31
*** slagle has quit IRC16:31
*** tesseract has quit IRC16:31
*** akrivoka has quit IRC16:37
*** akrivoka has joined #tripleo16:38
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP The ha init_bundles need to be able to run docker commands  https://review.openstack.org/49170516:41
*** dmsimard|afk is now known as dmsimard16:43
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Convert controller-role.yaml to role.role.j2.yaml  https://review.openstack.org/48027216:44
*** agurenko has quit IRC16:45
*** paramite has quit IRC16:45
*** shardy has quit IRC16:46
*** rhallisey has joined #tripleo16:50
*** agopi|away has joined #tripleo16:50
*** derekh has quit IRC16:52
*** rhallisey has quit IRC16:52
*** yamahata has quit IRC16:52
*** rhallisey has joined #tripleo16:52
*** trown is now known as trown|lunch16:54
*** artom_ is now known as artom17:01
chembandini: yaql and all, man that's quite a review :)  I will try to test this17:02
bandinichem: yeah :/ am testing it right now. don't really like the approach tbh, but there are not many other race-free ways unfortunately17:03
bandinichem: plus the yaql will need quite some love to get all the corner cases right17:03
chembandini: it looks to me that we cover all currently known image name17:04
*** tosky has quit IRC17:04
*** rwsu has quit IRC17:04
bandinichem: dunno, I think I'll have to write down all the possible image urls and make sure the function does not break17:05
*** ckyriakidou has quit IRC17:06
bandinichem: on the positive side, with this new approach only a tht change is needed17:07
*** udesale has quit IRC17:07
chembandini: yes, simpler to test17:07
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879317:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906617:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915217:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932717:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,Fix committed] - Assigned to Arx Cruz (arxcruz)17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170933917:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)17:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)17:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]17:10
openstackLaunchpad bug 1709339 in tripleo "CI: duplicate /etc directories in logs for containers" [Critical,Triaged]17:10
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila Share for HA  https://review.openstack.org/48268017:11
*** pkovar has quit IRC17:11
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila Share for HA  https://review.openstack.org/48268017:13
*** bogdando has quit IRC17:14
*** dtantsur is now known as dtantsur|afk17:17
bandinichem: gasp it actually works ->  Docker container set: rabbitmq-bundle [192.168.24.1:8787/tripleoupstream/centos-binary-rabbitmq:pcmklatest]17:20
bandinidciabrin: ^17:20
mwhahaha[overcloud.BlockStorageServiceChain.ServiceChain]: CREATE_FAILED  resources.ServiceChain: Property error: resources[8].properties: Property DockerIscsidImage not assigned17:23
*** hamzy has joined #tripleo17:24
mwhahahaanyone seen that one before? i'm running an absolute basic deploy -e environment/docker.yaml basically17:24
bandininope not here :/17:24
* mwhahaha sighs17:25
chembandini: easy peasy17:25
mwhahahawhat are we even testing in ci if the baked in defaults don't work17:25
dciabrinbandini, w00t17:29
chembandini: hum... when you have time tomorrow if you could push this https://review.openstack.org/#/c/490422/ into the stable/newton oblivion17:30
chemdciabrin: bandini he's the one17:30
bandinilol17:31
bandinichem: looking at it now17:31
bandinichem: that way I have a perfect excuse to avoid doing sports17:31
dciabrinlol17:31
bandini"chem called, can't come, sorry"17:31
chembandini: haha, hum it's will be a problem only if you're doing a 2 min workout17:32
bandinichem: wait a sec, there are longer workouts? ;)17:32
chembandini: yeah, right....17:32
*** yamahata has joined #tripleo17:34
chembandini: I guess it depends on the workout -> https://www.youtube.com/watch?v=oyJx-Ja00wo&t=0m09s17:35
chembandini: 2 min should be more than enough17:35
bandiniholy guacamole!17:36
*** florianf has quit IRC17:36
chembandini: good training, but I had to change of keyboard more often since that.17:38
bandiniahahah17:38
bandiniI genuinely don't think I can do a single normal pushup17:38
bandiniI'd probably injure myself just by trying17:38
bandinianyways, let's expand this tht pcmklatest review17:38
*** oidgar has quit IRC17:39
mwhahahaah ha i figured it out, it helps if you provide environments/docker-centos-tripleoupstream.yaml17:39
mwhahahathe docs are a bit lacking about this17:40
bandinioh wow17:40
bandiniso is there somewhere a specification for the exact format of an image name? i.e. the various tripleoupstream/image-name or 192.168.24.1:8787/tripleoupstream/image-name etc?17:41
bandiniI need to construct a function that gives me the image name *without* the tag and I want to be sure I cover all cases17:42
mwhahahawouldn't it just be the last bit?17:43
mwhahahaso after last / before last :17:43
bandiniI *think* so yes, I just wanted to be sure of it17:43
mwhahahatripleoupstream/centos-binary-aodh-api:latest -> centos-binary-aodh-api?17:43
* mwhahaha is unsure of this format17:43
bandiniwell we do want tripleoupstream/centos-binary-aodh-api, but yeah the idea is the same17:43
mwhahahaso we need the namespace + image17:44
bandiniyeah17:44
pabelangermwhahaha: looks like https://review.openstack.org/#/c/490466/ just hit DLRN failure on python-networking-bagpipe again too. Sounds like this has happened before?17:44
*** slagle has joined #tripleo17:45
mwhahahapabelanger: so if python-networking-bagpipe ends up in the ZUUL_CHANGES it tries to get build and breaks17:45
mwhahahapabelanger: because we can't know the dependent patches, the problem is when it gets in the gate there's a bunch of other projects that get passed in with ZUUL_CHANGES17:45
bnemecWhy is that project in our gate queue?17:46
mwhahahapabelanger: i have a feeling the python-networking-bagpipe is just broken in rdo but everytime a patch for that gets into the gate with tripleo stuff it'll fail all the tripleo patches17:46
pabelangermwhahaha: right, because it is enqueue into the gate pipeline, the shared changeset17:46
pabelanger491776,1 right now17:46
pabelangeron status.o.o/zuul17:46
pabelangerbnemec: shared jobs17:46
pabelangerso it gets enqueued into the same change queue17:47
pabelangerlet me see what job it is17:47
bnemecI wonder if the failure is related to our discussion the other day about the project clone list.17:47
bnemecI bet that project isn't in the list, so it probably doesn't get cloned.17:48
mwhahahathe dlrn stuff needs some attention17:48
*** salmankhan1 has joined #tripleo17:48
mwhahahawe keep getting hit with these build problems in ci17:48
mwhahahabecause we just assume everything builds ok17:48
*** pradk has joined #tripleo17:48
pabelangertripleo-scenario-jobs-scenario00417:49
pabelangeropenstack/networking-bgpvpn has that job17:49
mwhahahabut that's only in check right?17:49
pabelangerno, gate too17:49
*** salmankhan has quit IRC17:49
*** salmankhan1 is now known as salmankhan17:49
pabelangerso, DLRN will need to be update not to build it17:50
pabelangeror move it back to -nv in networking-bgpvpn17:50
bnemecThe job must work on the repo itself though, right?17:50
bnemecI feel like someone would have complained if we were blocking all their patches. :-)17:50
*** aufi has joined #tripleo17:51
pabelangernot sure17:51
pabelangerbut scenario003 is failing17:51
pabelangerwhich is not tested17:51
mwhahahawrong change17:51
pabelangerlet me look at their jobs17:51
mwhahaha482931 was the change that failed the job17:52
mwhahahait's networking-bagpipe not bgpvpn17:52
pabelangerI'm looking at 490466 ATM, which is failing17:52
pabelangerOh ya17:52
mwhahahaok: [undercloud] => {"ansible_facts": {"artg_change_list": [], "gerrit_host": "", "zuul_changes": "openstack/networking-bagpipe:master:refs/changes/31/482931/3^openstack/mistral:master:refs/changes/12/491712/1^openstack/mistral:master:refs/changes/66/490466/5"}, "changed": false}17:52
*** pradk has quit IRC17:52
mwhahahahttp://logs.openstack.org/66/490466/5/gate/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/bd96e47/console.html#_2017-08-08_16_55_27_36020417:52
pabelangerYa, that is what I am looking at17:53
pabelangerokay, 1 sec, let me look at zuul again17:53
mwhahahahttp://logs.openstack.org/66/490466/5/gate/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/bd96e47/logs/delorean_logs/71/4d/714ded7b8f2e092c39253b05832f71cc2f4f7259_dev/build.log.txt.gz17:53
mwhahahathe bagpipe-bgp package needs some love17:53
*** florianf has joined #tripleo17:53
mwhahahawe need some smarter logic around the packages being built and when/why we fail17:53
pabelangerYa, how does RDO learn of these failures? I know there was a 3rdparty CI job setup a while back, wonder if that is still working17:55
mwhahahawe complain :D17:55
pabelangerYa, doesn't really scale too well17:55
mwhahahawe added some logic to fix for missing distgits17:56
mwhahahathat solved some of the problem17:56
mwhahahabut this one is just that the package is no good anymore so i think there is a blacklist we can update17:56
*** salmankhan has quit IRC17:56
pabelangerYa, https://github.com/rdo-packages/networking-bagpipe-distgit/ hasn't been touched in 6 months17:56
mwhahahai'd kinda rather see just a giant warning but its hard to tell if it was a failure due to the change being tested or not17:57
*** aufi has quit IRC17:57
bnemecThere is the report page that tells you what is failing to build: https://trunk.rdoproject.org/centos7-master-head/report.html17:57
*** jrist has quit IRC17:57
pabelangerha, python-networking-bagpipe FAILED17:57
pabelangerhttps://trunk.rdoproject.org/centos7-master-head/c5/c6/c5c69472cc26c46d735e67ffb2b35211ba9d843c_07259ace/rpmbuild.log17:58
pabelangersame errors17:58
*** amoralej is now known as amoralej|off18:00
pabelangermwhahaha: updated review, looks like https://review.rdoproject.org/r/#/c/5839/ will be the fix18:04
*** itlinux has quit IRC18:04
mwhahahasince march 15th18:04
pabelangeryup18:04
mwhahahaso basically any approved change for networking-bagpipe since march 15th has broken our ci every time18:05
* mwhahaha applies desk directly to his forehead18:05
pabelangerand likley only merge code when no other tripleo patch is in play18:06
mwhahahai don't even know if we ci that package18:06
mwhahahalike i don't think we have a scenario with it enabled but let me see18:07
mwhahahawe have neutron-bgpvpn in scenario004 but i'm not sure that depends on python-networking-bagpipe18:08
honzahey, is ci doing ok?  i'm getting some mysterious errors in tripleo-ui18:08
*** gfidente is now known as gfidente|afk18:08
mwhahahahonza: such as?18:08
honzamwhahaha: http://logs.openstack.org/33/473933/13/check/gate-tripleo-ui-nodejs6-npm-run-test/0dd8dbe/console.html#_2017-08-08_15_31_02_59140018:09
honzamwhahaha: for some reason, it's testing a compiled file; same code passes locally18:09
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879318:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906618:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915218:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932718:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,Fix committed] - Assigned to Arx Cruz (arxcruz)18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170933918:10
*** ooolpbot has quit IRC18:10
mwhahahahonza: same versions of everything?18:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)18:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)18:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]18:10
openstackLaunchpad bug 1709339 in tripleo "CI: duplicate /etc directories in logs for containers" [Critical,Triaged]18:10
honzamwhahaha: node and npm, yes18:10
mwhahahahttp://logs.openstack.org/33/473933/13/check/gate-tripleo-ui-nodejs6-npm-run-test/0dd8dbe/console.html#_2017-08-08_15_31_02_58727418:10
mwhahahanot sure what's at that position in PlansAction.js (f i'm reading the stack correctly)18:11
honzamwhahaha: that's just it; the location is nonsense, the file mangled18:12
pabelangermwhahaha: I think networking-bagpipe is getting pulled into your change queue because it and networking-bgpvpn share gate-tempest-dsvm-networking-bgpvpn-bagpipe-ubuntu-xenial and networking-bgpvpn shares tripleo-scenario-jobs-scenario00418:12
pabelangergoing to confirm in zuul logs18:13
mwhahahapabelanger: that's annoying18:13
honzamwhahaha: it's kind of intermittent, too --- see the last three rechecks on this patch https://review.openstack.org/#/c/473933/18:13
honzamwhahaha: 1st one has a failing lint, but test is fine, the other two have passing lint but failing test (no code change)18:14
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Exclude python-networking-bagpipe from dlrn  https://review.openstack.org/49187818:14
honzamwhahaha: also, the git sha for the patch at the top of the log file looks bogus, too18:14
mwhahahahonza: other than diffing component versions I don't even know how to debug that. it's not related to any other ci issues so not sure18:15
honzamwhahaha: ok, cool, thanks18:15
mwhahahahonza: do those tests have some concurrency in how they get run? like is one stomping on another18:16
honzamwhahaha: not sure18:16
* mwhahaha knows nothing about npm18:17
honzanpm itself is sequential so i guess the answer is no18:17
honzamwhahaha: is there a command like recheck that's more like "kill-it-with-fire-and-start-over-recheck"?18:21
mwhahahaYea recheck ;D18:22
pabelangermwhahaha: so, likely since July 17, is when failures started happening for DLRN and networking-bagpipe: EmilienM added new jobs to gate pipeline https://review.openstack.org/#/c/480641/18:26
pabelangermight be worth considering revert on bgpvpn until RDO package is fixed18:27
*** ebarrera has joined #tripleo18:27
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Use tasks for rhel registration  https://review.openstack.org/49188118:28
*** trown|lunch is now known as trown18:30
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Use tasks for rhel registration  https://review.openstack.org/49188118:36
*** dprince has quit IRC18:36
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Use tasks for rhel registration  https://review.openstack.org/49188118:38
*** nyechiel_ has quit IRC18:39
*** florianf has quit IRC18:39
*** gcerami1 has joined #tripleo18:40
*** gcerami has quit IRC18:44
fultonjDuring deployment step1, the run of `python /var/lib/docker-puppet/docker-puppet.py` on my controller returned 'ERROR: 60501 -- ERROR configuring haproxy'.18:45
fultonjhas anyone seen this? ^18:45
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: fix random broken pipe on du command  https://review.openstack.org/49188418:54
*** florianf has joined #tripleo18:54
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Fix cidr get_attr in custom networks  https://review.openstack.org/49188619:03
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: fix random broken pipe on du command  https://review.openstack.org/49188419:03
*** oidgar has joined #tripleo19:08
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879319:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,Fix committed] - Assigned to Arx Cruz (arxcruz)19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906619:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915219:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932719:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170933919:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)19:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)19:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]19:10
openstackLaunchpad bug 1709339 in tripleo "CI: duplicate /etc directories in logs for containers" [Critical,Triaged]19:10
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: fix FreeIPA dns server issue  https://review.openstack.org/49188819:11
openstackgerritAndy Smith proposed openstack/tripleo-heat-templates master: WIP OpenStack containerized qpid-dispatch-router service  https://review.openstack.org/47904919:11
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP Tag the ha containers with 'pcmklatest' at deploy time  https://review.openstack.org/49170519:12
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Make HA container bundle work on remote nodes  https://review.openstack.org/48607619:17
openstackgerritAndy Smith proposed openstack/tripleo-common master: Add Qdrouterd to the overcloud containers  https://review.openstack.org/49188919:20
*** itlinux has joined #tripleo19:25
mwhahahapabelanger: hmm ok, well we can also just exclude it via https://review.openstack.org/#/c/491878/19:26
*** pchavva has quit IRC19:27
*** oidgar has quit IRC19:28
pabelangermwhahaha: cool, left comment / question19:28
*** gfidente|afk is now known as gfidente19:28
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Exclude python-networking-bagpipe from dlrn  https://review.openstack.org/49187819:29
pabelanger+119:30
*** gcerami1 has quit IRC19:32
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Make HA container bundle work on remote nodes  https://review.openstack.org/48607619:35
*** ebarrera has quit IRC19:36
*** gcerami1 has joined #tripleo19:43
mwhahahahrm what's the trick to having the deploy actually use the local registry? i tried setting DockerInsecureRegistryAddress but it still seems to be trying to pull from the internets19:43
bandinimwhahaha: I set each image to point to 192.168.24.1:8787/... where I upload all the containers19:44
mwhahahaso for all the *Image: declarations?19:44
mwhahahahttps://github.com/openstack/tripleo-heat-templates/blob/9f1fbcb40a030d40b3241b6684fd554e12732dd1/environments/docker-centos-tripleoupstream.yaml in this thingy?19:44
bandinimwhahaha: yep19:45
mwhahahahmm ok19:45
* mwhahaha goes back to the docs19:45
mwhahahaah i see you need to rerun the image prepare command to get those generated correctly19:45
mwhahahathe formating of this doesn't make that obvious, i thought that was only needed if you use kolla-build19:45
mwhahahahttps://www.irccloud.com/pastebin/sZetQ9L4/19:46
mwhahahathat's what does it19:46
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Make HA container bundle work on remote nodes  https://review.openstack.org/48607619:47
bandinimwhahaha: ah see learned something. I had not used the container image prepare command yet and did everything manually19:48
openstackgerritJames Slagle proposed openstack/instack-undercloud master: Fix invalid /etc/hosts edit  https://review.openstack.org/49190119:53
*** jprovazn has quit IRC20:02
*** sbrzozow has quit IRC20:02
*** liverpooler has quit IRC20:03
mwhahahahttp://logs.openstack.org/91/490791/4/gate/gate-tripleo-ci-centos-7-undercloud-containers/051799e/console.html#_2017-08-08_17_14_04_74219620:04
mwhahahapabelanger: what's your thoughts on that one, /home/jenkins/workspace/gate-tripleo-ci-centos-7-undercloud-containers/devstack-gate/functions.sh: line 180: declare: gate_hook: not found20:04
pabelangermwhahaha: I think that is a red herring. I've noticed that on tripleo jobs this morning, still looking into it. But it happens on successful jobs too20:05
mwhahahawould be really nice if we had a line in the logs when it transitions between each builder20:06
mwhahahaalways hard to tell where the infra setup stops and the testing stuff begins20:06
pabelangerYa, zuulv3 should be nicer for that. Our logging getting a little make over20:07
*** anshul has quit IRC20:08
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Exclude networking-bagpipe from dlrn  https://review.openstack.org/49187820:09
pabelangermwhahaha: http://logs.openstack.org/91/490791/4/gate/gate-tripleo-ci-centos-7-undercloud-containers/051799e/logs/devstack-gate-setup-host.txt20:09
pabelangermwhahaha: seen that yesterday too, on a job20:09
pabelangerbest guess was maybe a bad hypervisor20:09
pabelangergoing to search logstash and see if we get any more hits20:09
mwhahahayea seems host related20:09
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879320:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,Fix committed] - Assigned to Arx Cruz (arxcruz)20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906620:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915220:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932720:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170933920:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)20:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)20:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]20:10
openstackLaunchpad bug 1709339 in tripleo "CI: duplicate /etc directories in logs for containers" [Critical,Triaged]20:10
*** Vineet has quit IRC20:14
*** jkilpatr has quit IRC20:16
sshnaidmmandre_mtg, jistr can you please check in your time? https://bugs.launchpad.net/tripleo/+bug/170933920:24
openstackLaunchpad bug 1709339 in tripleo "CI: duplicate /etc directories in logs for containers" [Critical,Triaged]20:25
*** jcoufal has quit IRC20:27
*** ansmith has quit IRC20:28
*** jkilpatr has joined #tripleo20:37
mandre_mtgsshnaidm: hey, I think I already have a fix posted for https://bugs.launchpad.net/tripleo/+bug/1709339 -> https://review.openstack.org/#/c/481233/20:38
openstackLaunchpad bug 1709339 in tripleo "CI: duplicate /etc directories in logs for containers" [Critical,Triaged]20:39
vkmchey guys, is there a way to check why a container haven't started?20:41
fultonjvkmc: did you try any of these tricks ? http://tripleo.org/install/containers_deployment/tips_tricks.html#debugging-container-failures20:41
vkmcprecisely, in my deploy I'm seeing all services being containerized except of some of them... which are running as regular services20:42
vkmcfultonj, let me check20:42
vkmcyeah, that is in the case that a container has started and failed for some reason20:42
vkmcin this case I specify the environment files I want and for some reason the containers don't start20:42
fultonjvkmc: which service?20:43
vkmcfultonj, manila20:43
sshnaidmmandre_mtg, great, thanks!20:43
vkmcfultonj, this started happening now that I'm specifying a backend environment file20:43
vkmcwhen I was using the generic driver, containers will start as expected20:44
fultonjhttps://jistr.github.io/tripleo-deep-dive-containers-june-2017/#/1420:45
fultonjvkmc: is docker-puppet.py not starting your container?20:47
vkmcfultonj, how can I check that?20:47
vkmcI'm seeing all other services running in containers20:47
gcerami1can someone check here if the conotainers images were really downloaded from rdo registry ? https://logs.rdoproject.org/47/475747/90/openstack-experimental/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016/Z800253dbc71342feaa586039ae522370/undercloud/home/jenkins/overcloud_prep_containers.log.txt.gz20:48
vkmcmanila-* are the only ones that are not20:48
vkmchttp://paste.openstack.org/show/617833/20:49
vkmchttp://paste.openstack.org/show/617834/20:49
vkmchttp://paste.openstack.org/show/617835/20:50
vkmchttp://paste.openstack.org/show/617836/20:50
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Make HA container bundle work on remote nodes  https://review.openstack.org/48607620:50
gcerami1mandre_mtg: ^ any idea how to check for sure ?20:51
fultonjvkmc: you could try running docker-puppet.py and see if it fails trying to start those containers and see the error message that it throws20:52
vkmcfultonj, from where?20:52
fultonji will show you an example20:52
vkmcin the controller node?20:52
fultonjthe node on which it won't start20:52
fultonjyeah, probably the controller in your case20:52
vkmck20:53
fultonjhttp://paste.openstack.org/show/617838/20:53
fultonjin the example above, i wanted to know why my haproxy container wouldn't start20:53
fultonjso i was able to see that the .json file it's reading was probably out of sync with it's puppet20:54
fultonjand missing https://github.com/openstack/puppet-tripleo/commit/50f160a148b6a973891ffc6d0882f4c0d597336e20:54
gcerami1stevebaker: ping20:54
stevebakergcerami1: hi20:54
fultonjvkmc: so maybe you will see an error when docker-puppet.py tries to start your container20:54
fultonjvkmc: i bet mandre_mtg or stevebaker know better though than me though if that doesn't work20:55
vkmcfultonj, nice, I'm trying that20:55
*** dprince has joined #tripleo20:55
vkmcthanks20:56
fultonjvkmc: hope it helps20:56
gcerami1stevebaker: I think my deployment was able to take images from rdo registry to test, with a specific tag, but here https://logs.rdoproject.org/47/475747/90/openstack-experimental/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016/Z800253dbc71342feaa586039ae522370/undercloud/home/jenkins/failed_deployments.log.txt.gz seems the deployment is looking for :latest tag anyway20:57
gcerami1stevebaker: how do I tell it to use the same tag from undercloud registry ?20:57
stevebakervkmc: are you running RDO or OSP?20:58
gcerami1stevebaker: also, if this is the case, then I don't understand why https://logs.rdoproject.org/47/475747/90/openstack-experimental/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016/Z800253dbc71342feaa586039ae522370/undercloud/home/jenkins/overcloud_prep_containers.log.txt.gz is telling hat underclou dimages have the "latest" tag.20:58
vkmcstevebaker, RDO20:59
abishopvkmc, fultonj: do you mind if I butt in?20:59
abishopI think the problem is environments/manila-netapp-config.yaml is slamming you back onto puppet services for Manila (overriding the docker services)20:59
fultonjabishop: not at all20:59
vkmcabishop, please do; how is that?20:59
gcerami1stevebaker: maybe I should pass --tag to the second prepare command here ? https://logs.rdoproject.org/47/475747/90/openstack-experimental/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016/Z800253dbc71342feaa586039ae522370/undercloud/home/jenkins/overcloud-prep-containers.sh21:00
stevebakergcerami1: run the prepare command again, with --tag <tag> --namespace 192.168.24.1:8787/tripleo --env-file ...21:01
*** ecerquei_ has quit IRC21:01
abishopvkmc: the resource_registry entries at the top of the file are overriding things21:01
stevebakergcerami1: yes :)21:01
vkmchttps://github.com/openstack/tripleo-heat-templates/blob/master/environments/manila-netapp-config.yaml#L2-L7 <- this puppet manifests?21:02
vkmcabishop, ^21:02
gcerami1stevebaker: ok thanks!21:02
abishopvkmc: yes21:02
vkmcabishop, I checked them but I didn't spot anything... I'm double checking them now21:03
fultonjif they had a container version it would look more like ../docker/services/... not ../puppet/services21:03
*** trown is now known as trown|outtypewww21:03
fultonjin that tht21:03
abishopvkmc, fultonj: right. I think this file needs a container version21:04
stevebakergcerami1, dprince: btw I'm wondering if we could improve the reliability of CI if we used trunk.registry.rdoproject.org instead of docker.io for our manually built images? I have noticed that trunk.registry.rdoproject.org has been down on a Sunday more than once21:04
vkmcabishop, all right, I'll try that21:04
*** dprince has quit IRC21:05
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras master: prep containers: use same tag for both prepare command  https://review.openstack.org/49192221:05
vkmcfultonj++21:05
vkmcabishop++21:05
vkmcthanks21:05
fultonje.g. lines 10,11,12 of https://review.openstack.org/#/c/479288/28/ci/environments/scenario001-multinode-containers.yaml21:05
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: WIP: test undercloud docker proxy  https://review.openstack.org/49192321:05
gcerami1stevebaker: ^21:05
*** lblanchard has quit IRC21:06
gcerami1stevebaker: about using rdo registry, I'm not sure, we are using an enhanced api to interact with rdo registry21:07
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574721:08
stevebakergcerami1: the proxy would help, it would still be nice to be using the same registry for manual and automatic builds though21:09
*** maeca has quit IRC21:10
stevebakergcerami1: there would be less surprises when we switched to automatic by default21:10
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879321:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,Fix committed] - Assigned to Arx Cruz (arxcruz)21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906621:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915221:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932721:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)21:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)21:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]21:10
fultonjremember deploy artirfifacts? (http://hardysteven.blogspot.com/2016/08/tripleo-deploy-artifacts-and-puppet.html)21:10
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Begin adding environments with all params for a service  https://review.openstack.org/47592421:11
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Add ability to generate an environment index  https://review.openstack.org/49192521:11
fultonjnow that we're in containers, would i need to build new container images with an update to puppet to get the same effect?21:11
mandre_mtggcerami1: it says pull_source trunk.registry.rdoproject.org, that looks good... you can check the docker logs to make sure21:11
mandre_mtg81263821:11
*** nyechiel_ has joined #tripleo21:11
fultonji guess i'd then need to put it in my own registry to test my puppet changes21:12
fultonjis ^ the general idea?21:12
abishopfultonj: ouch, good question!21:12
fultonjabishop: thanks21:12
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Pass monitor_address_block to ceph-ansible for mon_host  https://review.openstack.org/49192921:22
*** dparkes has joined #tripleo21:22
*** abishop has quit IRC21:25
*** ffiore has joined #tripleo21:27
*** akrivoka has quit IRC21:31
*** dtrainor has quit IRC21:35
*** gcerami1 has quit IRC21:37
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Add ability to generate an environment index  https://review.openstack.org/49192521:39
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Begin adding environments with all params for a service  https://review.openstack.org/47592421:39
openstackgerritAlex Schultz proposed openstack/instack-undercloud master: Validate local_interface exists  https://review.openstack.org/49160121:44
*** ffiore has quit IRC21:45
*** dtrainor has joined #tripleo21:49
*** nyechiel_ has quit IRC21:49
openstackgerritMerged openstack/tripleo-heat-templates master: MariaDB: create clustercheck user at container bootstrap  https://review.openstack.org/48927721:53
*** florianf has quit IRC21:59
*** dprince has joined #tripleo21:59
*** jmelvin has quit IRC22:06
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879322:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,Fix committed] - Assigned to Arx Cruz (arxcruz)22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906622:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915222:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932722:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)22:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)22:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]22:10
*** dprince has quit IRC22:31
*** ecerquei_ has joined #tripleo22:33
*** leitan has quit IRC22:40
openstackgerritSwaminathan Vasudevan proposed openstack/diskimage-builder master: Failed to open parameter YAML error while trying to unmount imagedir  https://review.openstack.org/49063722:45
*** shreshtha_ has joined #tripleo22:45
*** maeca has joined #tripleo22:46
*** shreshtha has quit IRC22:48
mwhahahaif any cores are still around, https://review.openstack.org/#/c/49188622:49
*** rhallisey has quit IRC23:06
*** dmarlin has quit IRC23:07
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879323:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906623:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915223:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932723:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,Fix committed] - Assigned to Arx Cruz (arxcruz)23:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)23:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)23:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]23:10
*** rhallisey has joined #tripleo23:20
*** ecerquei_ has quit IRC23:21
*** catintheroof has quit IRC23:29
*** gfidente is now known as gfidente|afk23:39
*** fandrieu has quit IRC23:39
*** agopi|away has quit IRC23:50
*** slagle has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!