Monday, 2018-04-23

*** fragatin_ has quit IRC00:03
*** agopi has joined #tripleo00:06
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176597500:10
openstackLaunchpad bug 1765975 in tripleo "ssh timeout in tempest basic ops scen007 gate jobs" [Critical,In progress] - Assigned to yatin (yatinkarel)00:10
*** ooolpbot has quit IRC00:10
*** fragatina has joined #tripleo00:11
*** fragatina has quit IRC00:21
openstackgerritMerged openstack/diskimage-builder master: Stop using slave_scripts/install-distro-packages.sh  https://review.openstack.org/56326400:21
*** lblanchard has joined #tripleo00:38
*** lblanchard has quit IRC00:51
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176597501:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1765975 in tripleo "ssh timeout in tempest basic ops scen007 gate jobs" [Critical,In progress] - Assigned to yatin (yatinkarel)01:10
openstackgerritzhubingbing proposed openstack/puppet-tripleo master: Trivial: fix a comment typo  https://review.openstack.org/56078201:29
*** bkopilov has quit IRC01:37
openstackgerritMerged openstack/diskimage-builder master: pip-and-virtualenv: fix install-pip when centos-release-openstack is enabled  https://review.openstack.org/56293602:07
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176597502:10
openstackLaunchpad bug 1765975 in tripleo "ssh timeout in tempest basic ops scen007 gate jobs" [Critical,In progress] - Assigned to yatin (yatinkarel)02:10
*** ooolpbot has quit IRC02:10
*** derekjhyang has joined #tripleo02:16
*** moshele has joined #tripleo02:27
*** psachin has joined #tripleo02:44
*** bkopilov has joined #tripleo02:49
*** ramishra has joined #tripleo02:55
*** mdnadeem has joined #tripleo03:00
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176597503:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1765975 in tripleo "ssh timeout in tempest basic ops scen007 gate jobs" [Critical,In progress] - Assigned to yatin (yatinkarel)03:10
*** ykarel_ has joined #tripleo03:24
*** rcernin has quit IRC03:31
*** rcernin has joined #tripleo03:35
*** psachin has quit IRC03:39
*** adrianreza has joined #tripleo03:40
*** dxiri has joined #tripleo03:48
*** mdnadeem has quit IRC03:53
*** ykarel_ is now known as ykarel03:55
openstackgerritMerged openstack/python-tripleoclient master: add lower-constraints job  https://review.openstack.org/55619504:06
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates master: Fix openstack-nova-consoleauth service upgrade check  https://review.openstack.org/56343204:08
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176597504:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1765975 in tripleo "ssh timeout in tempest basic ops scen007 gate jobs" [Critical,In progress] - Assigned to yatin (yatinkarel)04:10
*** skramaja has joined #tripleo04:16
*** pgadiya has joined #tripleo04:23
*** pgadiya has joined #tripleo04:26
*** anilvenkata has joined #tripleo04:29
openstackgerritAndreas Florath proposed openstack/diskimage-builder master: WIP: Docker matrix build  https://review.openstack.org/41434704:39
Tenguhello there04:40
*** pdeore has joined #tripleo04:51
*** moshele has quit IRC04:55
openstackgerritPranali Deore proposed openstack/tripleo-heat-templates master: Disable interoperable default image import method in THT  https://review.openstack.org/56293004:55
*** aufi has joined #tripleo05:00
*** psachin has joined #tripleo05:00
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176597505:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1765975 in tripleo "ssh timeout in tempest basic ops scen007 gate jobs" [Critical,In progress] - Assigned to yatin (yatinkarel)05:10
*** yprokule has joined #tripleo05:12
*** dxiri has quit IRC05:12
*** jtomasek has joined #tripleo05:13
*** dxiri has joined #tripleo05:13
*** dxiri has quit IRC05:18
*** shreshtha has joined #tripleo05:21
*** shreshtha has quit IRC05:23
*** shreshtha has joined #tripleo05:23
*** numans has quit IRC05:29
*** numans has joined #tripleo05:30
*** anilvenkata has quit IRC05:31
*** ratailor has joined #tripleo05:35
*** pmannidi has quit IRC05:37
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Added tempest skip list for undercloud for stable branches  https://review.openstack.org/56037405:39
*** tzumainn has quit IRC05:41
*** anilvenkata has joined #tripleo05:43
*** dhill__ has quit IRC05:43
*** aufi has quit IRC05:45
*** jfrancoa has joined #tripleo05:46
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Pass environment files to upgrade converge step.  https://review.openstack.org/56349405:47
*** agurenko has joined #tripleo05:49
*** avivgt has joined #tripleo05:49
*** moshele has joined #tripleo05:50
*** marios has joined #tripleo05:52
*** florianf has joined #tripleo05:58
*** quiquell|off is now known as quiquell|ruck06:08
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176597506:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1765975 in tripleo "ssh timeout in tempest basic ops scen007 gate jobs" [Critical,In progress] - Assigned to yatin (yatinkarel)06:10
*** kopecmartin has joined #tripleo06:10
*** links has joined #tripleo06:13
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: Correct branch used in tripleo-upgrade installation.  https://review.openstack.org/56308106:23
*** jaganathan has joined #tripleo06:24
*** jaganathan has quit IRC06:25
*** quiquell|ruck is now known as quiquell|ruck|af06:25
*** quiquell|ruck|af is now known as quique|ruck|afk06:25
*** jaganathan has joined #tripleo06:25
*** masco has joined #tripleo06:32
openstackgerritAndreas Florath proposed openstack/diskimage-builder master: WIP: Docker matrix build  https://review.openstack.org/41434706:38
*** dciabrin_ has quit IRC06:39
*** dparkes has joined #tripleo06:39
*** ffiore has joined #tripleo06:43
*** athomas has quit IRC06:45
*** apetrich has joined #tripleo06:46
*** apetrich has quit IRC06:46
openstackgerritHarald Jensås proposed openstack/instack-undercloud master: Masqurading, do not persist ephemeral firewall rules  https://review.openstack.org/56346706:48
*** dciabrin has joined #tripleo06:50
*** jbadiapa has joined #tripleo06:51
openstackgerritAndreas Florath proposed openstack/diskimage-builder master: IP: Docker matrix build  https://review.openstack.org/41434706:53
*** dsariel has quit IRC06:54
openstackgerritHarald Jensås proposed openstack/puppet-tripleo master: Firewall: NOT persist ephemetal ironic-inspector rules  https://review.openstack.org/56346106:54
*** dsariel has joined #tripleo06:54
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Removing the deprecated environment files for hw offloading in containers  https://review.openstack.org/55972306:56
*** ccamacho has joined #tripleo06:56
*** ffiore has quit IRC06:59
*** ffiore has joined #tripleo07:00
*** quique|ruck|afk is now known as quiquell|ruck07:01
*** apetrich has joined #tripleo07:02
openstackgerritAndreas Florath proposed openstack/diskimage-builder master: IP: Docker matrix build  https://review.openstack.org/41434707:03
*** tesseract has joined #tripleo07:04
*** ffiore_ has joined #tripleo07:08
*** ffiore has quit IRC07:08
openstackgerritCarlos Goncalves proposed openstack/tripleo-heat-templates master: Define Octavia SSH key name and file path  https://review.openstack.org/56087907:09
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176597507:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1765975 in tripleo "ssh timeout in tempest basic ops scen007 gate jobs" [Critical,In progress] - Assigned to yatin (yatinkarel)07:10
*** jpena|off is now known as jpena07:10
*** aufi has joined #tripleo07:12
*** janki has joined #tripleo07:15
*** suuuper has joined #tripleo07:15
*** slaweq has joined #tripleo07:16
Tenguanyone for a small issue with containerized Pike? my horizon dashboard has some issues for authentication, it crashes with a "unable to open database file" - apparently it searches for some sqlite3 DB file.07:18
*** b00tcat has joined #tripleo07:19
*** rcernin has quit IRC07:19
*** jchhatbar has joined #tripleo07:21
*** janki has quit IRC07:23
*** bogdando has joined #tripleo07:24
*** pcaruana has joined #tripleo07:25
openstackgerritAndreas Florath proposed openstack/diskimage-builder master: IP: Docker matrix build  https://review.openstack.org/41434707:26
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart-extras master: Pass stable_release into nodepool_setup for reproducer_oooq.  https://review.openstack.org/56350207:27
*** tosky has joined #tripleo07:28
paramiteguys, in the recent master branch adding -e /usr/share/openstack-heat-templates/environments/services/collectd.yaml did not deployed collectd containers. Does the way to enable additional service for overcloud deploy changed recently?07:28
ykarelbogdando, can you please check: https://review.openstack.org/#/c/563443/07:30
bogdandoPTAL https://review.openstack.org/#/c/556516/07:31
bogdandoykarel: ok07:32
*** leanderthal has joined #tripleo07:33
leanderthalo/07:34
openstackgerritvenkata anil proposed openstack/tripleo-heat-templates master: Add OVNCMSOptions in dvr environment files  https://review.openstack.org/56350307:35
*** dsariel has quit IRC07:35
openstackgerritMehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: Telemetry services needs to access to Storage  https://review.openstack.org/56350407:35
openstackgerritMehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: Telemetry services need to access to Storage  https://review.openstack.org/56350407:36
*** markmc`` is now known as markmc07:41
*** amoralej|off is now known as amoralej07:42
*** markmc is now known as markmc``07:42
*** gfidente has joined #tripleo07:43
*** gfidente has quit IRC07:43
*** gfidente has joined #tripleo07:43
ykarelparamite, is non container version for collect deployed?07:47
bogdandoykarel: it would be nice to have CI coverage for the described cases07:47
bogdandowrt reverted things07:48
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart-extras master: Include extra_params option in reproducer-quickstart.sh.  https://review.openstack.org/54693207:48
ykarelbogdando, u mean scenario007 jobs should run?07:48
bogdandoykarel: somthing to detect the breakage07:49
*** ukalifon has joined #tripleo07:49
bogdandohttps://review.openstack.org/#/c/562966/ was all grean...07:49
ykarelhmm scenario007 didn't ran their so didn't detected07:49
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Use auto-evaluated http boot path for Ironic  https://review.openstack.org/55652207:50
ykarelbogdando, infact it was detected in your patch but missed somehow:- http://logs.openstack.org/59/560559/6/check/tripleo-ci-centos-7-scenario007-multinode-oooq-container/8142e14/logs/undercloud/home/zuul/tempest/tempest.html.gz07:51
paramiteykarel, nope, containerized07:54
Tengumarios: heya! update: the migration to containers is DONE on the production. Although I had several issues I didn't hit on the lab -.-. And there are still two issues that need to be addressed.07:54
*** nguyenhai has joined #tripleo07:54
ykarelparamite, are you deploying default roles or have customized services07:55
Tenguanyone in here knowing a bit about horizon in containers? having an issue following a migration, horizon seems to want some sqlite3 DB and crashes once login is done.07:55
*** ykarel is now known as ykarel|lunch07:56
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Switch remaining env files to containers defaults  https://review.openstack.org/56055907:58
*** jpich has joined #tripleo07:58
paramiteykarel|lunch, default roles and I just need to add collectd service to deploy07:59
openstackgerritJiri Tomasek proposed openstack/tripleo-common master: Optionally run config download at the end of stack create/update  https://review.openstack.org/55422408:00
openstackgerritJiri Tomasek proposed openstack/tripleo-common master: Send a message every time we get the stack  https://review.openstack.org/56093308:00
openstackgerritJiri Tomasek proposed openstack/tripleo-common master: Add type and plan_name to message sent from ansible-playbook action  https://review.openstack.org/56163908:00
jtomasekd0ugal: ^08:00
*** pblaho has joined #tripleo08:02
openstackgerritJiri Stransky proposed openstack/tripleo-common stable/queens: Only update plan on upgrade converge  https://review.openstack.org/56351008:03
*** shardy has joined #tripleo08:05
*** agopi has quit IRC08:05
d0ugaljtomasek: thanks!08:06
*** ffiore_ has quit IRC08:06
openstackgerritPranali Deore proposed openstack/tripleo-heat-templates master: Disable interoperable default image import method in THT  https://review.openstack.org/56293008:09
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176597508:10
openstackLaunchpad bug 1765975 in tripleo "ssh timeout in tempest basic ops scen007 gate jobs" [Critical,In progress] - Assigned to yatin (yatinkarel)08:10
*** ooolpbot has quit IRC08:10
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Added tempest skip list for undercloud for stable branches  https://review.openstack.org/56037408:10
openstackgerritCarlos Goncalves proposed openstack/tripleo-heat-templates master: Octavia amphora image handling updates  https://review.openstack.org/56208608:12
*** mdnadeem has joined #tripleo08:13
*** aufi has quit IRC08:13
*** jaosorior has joined #tripleo08:15
*** lucas-afk is now known as lucasagomes08:15
jaosoriorGreetings from Brno folks!08:16
*** threestrands has quit IRC08:17
Tenguhello jaosorior !08:17
jaosoriorTengu: sup dude08:17
Tengujaosorior: production is running on containers \o/08:17
Tengujaosorior: after over 30 hours of battle.08:18
jaosoriorbandini: could you check this out https://review.openstack.org/#/c/563136/ ?08:18
jaosoriorTengu: holy crap!08:18
Tengujust ONE error: horizon.08:18
Tenguoh and a missing CA bundle in keystone.08:18
jaosoriorTengu: which CA bundle?08:18
jaosoriorTengu: OpenSSL's CA bundle should be loaded, aside some other ones :/ if you identify a missing one, can you report a bug?08:19
Tengujaosorior: 2s08:20
*** dbecker has joined #tripleo08:20
Tengujaosorior: https://bugs.launchpad.net/tripleo/+bug/176617808:20
openstackLaunchpad bug 1766178 in tripleo "Keystone in container: missing trusted CA" [Undecided,New]08:20
Tenguhave already filled an issue :).08:20
jaosoriorTengu: excellent!08:21
jaosoriorTengu: thanks!08:21
Tengunp :)08:21
jaosoriorTengu: gonna submit a bug for it? I'm a bit busy this week with other stuff, so won't be able to jump on it immediately08:22
Tengujaosorior: is it to be pushed somewhere else?08:24
*** morazi has joined #tripleo08:24
jaosoriorTengu: s/bug/patch/08:24
jaosoriorTengu: ENEEDMORECOFFEE08:25
Tengujaosorior: ah. XD maybe, not sure how to do that for now, absolutely no experience with it. I'll see if I can find some time this week.08:25
TenguElse it will either wait you, or my start at Redhat.08:25
jaosoriorTengu: haha alright08:26
jaosoriorTengu: I might only be able to jump on that one in a couple of weeks08:26
Tenguuhu08:26
jaosoriorTengu: if you want, after that we can both go through it, so I can explain to you how those bits work08:26
*** ssbarnea_ has joined #tripleo08:26
TenguI'll check that on my own - I won't do much more in my current job anyway :)08:27
TenguI guess git grep will provide some help, and it's related to kolla at some point.08:27
*** derekh has joined #tripleo08:27
jaosoriorTengu: ... ish08:28
jaosoriorTengu: so yes, kolla is involved, but it merely provides the images and the scripts to build them08:28
jaosoriorTengu: this is more related to how we do the bind-mounts in tripleo08:28
Tenguah, ok.08:28
jaosoriorand there are two places you might need to touch, depending on the usage of that file08:28
Tenguso in heat templates ?08:28
jaosorioryeah08:28
Tenguok, so git grep.08:29
Tenguoh, ok. I think I stumbled on something while looking for my horizon issue.08:29
Tengushouldn't be hard. Might be able to provide a patch today :D08:30
*** ubijtsa has joined #tripleo08:30
jaosoriornice!08:30
jaosoriorwhat was the horizon issue again?08:30
Tengujaosorior: https://bugs.launchpad.net/tripleo/+bug/176618408:30
openstackLaunchpad bug 1766184 in tripleo "Containerized Horizon: unable to connect" [Undecided,New]08:30
openstackgerritHamdy Khader proposed openstack/puppet-tripleo master: Add NVMeOF support to configure cinder backend  https://review.openstack.org/55900808:30
Tengu(yep, I do issues ;))08:30
*** ykarel|lunch is now known as ykarel08:31
jaosoriorTengu: and that's very much appreciated :D08:31
Tenguso tripleo-heat-templates and banzai.08:31
Tengujaosorior: np ;). digging in the keystone thingy.08:31
jaosoriorbrb08:32
*** jaosorior has quit IRC08:32
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates stable/queens: Improve nova-ironic cellv2 discovery  https://review.openstack.org/56352208:32
*** chem has joined #tripleo08:36
openstackgerritMerged openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/56339708:40
*** sshnaidm|off is now known as sshnaidm08:41
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: Added missing pki volume for keystone.  https://review.openstack.org/56352508:42
*** aufi has joined #tripleo08:42
openstackgerritwes hayutin proposed openstack/tripleo-common master: add tripleo update job as non-voting  https://review.openstack.org/56352608:43
mariosTengu: congratulations!08:43
Tengumarios: thank you :)08:43
Tengumarios: I had some issues with pacemaker, it didn't configure any service, only the "bundle"… but I could take the config from the lab and inject it. Once pacemaker was up and happy, it was a breeze.08:44
Tenguwell, almost.08:44
mariosTengu: so wrt the horizon issue might be worth filing a bug for that too please ... at least save you the effort to re-explain stuff to folks08:44
quiquell|ruckHi guys, anyone here has any clue on this ?08:45
quiquell|ruckhttps://bugs.launchpad.net/tripleo/+bug/176619508:45
openstackLaunchpad bug 1766195 in tripleo "Error installing fluent-plugin-kubernetes_metadata_filter at pike" [Critical,New] - Assigned to Gabriele Cerami (gcerami)08:45
Tengumarios: already done: https://bugs.launchpad.net/tripleo/+bug/176618408:45
openstackLaunchpad bug 1766184 in tripleo "Containerized Horizon: unable to connect" [High,Confirmed]08:45
mariosTengu: hmmm ack with the pacemaker issues too... i mean probably bug worthy ... but having said all of that, the point still remains that doing baremetal pike to containerized queens isn't a priority so the caveat is that someone will have to pick those up and work on them ..08:45
Tengumarios: yep. that's why I didn't want to talk about that in any issue.08:47
Tengumarios: also, I didn't had this issue on the lab.08:47
Tengubogdando: hello! care to help me a bit with my review regarding the missing PKI path in keystone container? :)08:50
Tengubogdando: I'm brand new to the container infra on tripleo…08:50
bogdandoTengu: we have multiple config (on-time) containers running for misc config steps08:50
bogdandoone-time*08:50
Tenguhmm ok08:50
bogdandoif you need that mount for all steps, add it for each of the defined steps08:51
bogdandoor for the "main" step only08:51
openstackgerritHamdy Khader proposed openstack/tripleo-heat-templates master: Fix few issues with deploying with baremetal-services.yaml  https://review.openstack.org/56026108:51
openstackgerritHamdy Khader proposed openstack/tripleo-heat-templates master: Add support for NVMeOF cinder backend  https://review.openstack.org/55957208:51
Tengubogdando: hhmm ok. I need it for the "running" state, i.e. final step I guess. Previous steps aren't needed, as it's only for the user authentication08:51
bogdandohttps://review.openstack.org/#/c/563525/1/docker/services/keystone.yaml@16208:52
bogdandothat one08:52
Tengudarn08:52
Tengudidn't see it X(08:52
Tenguhmmm.08:52
Tenguwhere are this *keystone_volumes set now.08:52
* Tengu arms git grep08:52
bogdando:)08:54
Tengubogdando: hmmm. in fact…08:54
TenguI think I was right.08:54
bogdandoyeah, there is a common settings08:54
bogdandodocker/services/containers-common.yaml08:54
TenguI think *keystone_volumes refers to the &keystone_volumes ?08:54
Tenguah.08:54
bogdandoprolly you should only put it there08:54
bogdandofor all...08:54
Tenguhmmm right. would be better.08:55
bogdandoand keystone_volumes seem only logs config specific, docker/services/logging/files/keystone.yaml08:55
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Use --roles in overcloud upgrade run.  https://review.openstack.org/56353308:56
*** dsariel has joined #tripleo08:56
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: Added missing pki volume for custom CA.  https://review.openstack.org/56352508:56
Tengubogdando: yup. updated :)08:56
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/newton: Add version check for ovs >= 2.8 before applying perm changes  https://review.openstack.org/56353408:57
Tengubogdando: thank you :)08:58
Tengufirst patch in this container context \o/.08:58
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/newton: Add version check for ovs >= 2.8 before applying perm changes  https://review.openstack.org/56353408:59
*** akrivoka has joined #tripleo08:59
bogdandoTengu: urw ! welcome :)08:59
*** sri_ has quit IRC09:02
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo stable/newton: [Newton only] Do not overwrite current {neutron,nova}::host value.  https://review.openstack.org/56254209:02
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo stable/newton: [Newton only] Do not overwrite current {neutron,nova}::host value.  https://review.openstack.org/56254209:03
openstackgerritvenkata anil proposed openstack/tripleo-heat-templates master: Add OVNCMSOptions in dvr environment files  https://review.openstack.org/56350309:07
*** jaosorior has joined #tripleo09:07
*** moguimar has quit IRC09:08
jaosoriorTengu: there's another place missing though.09:08
jaosoriorthat'll work for when the container is running09:09
jaosoriorbut if the configuration (puppet) need the CA file for some reason09:09
jaosoriorit won't be there09:09
Tengujaosorior: hmmmm puppet doesn't need it I think09:09
jaosoriorthat's because the puppet configuration gets ran in another pass inside another container09:09
jaosorioryou sure?09:09
jaosoriorif not, that's fine09:09
*** brault has joined #tripleo09:10
Tengujaosorior: at least not for the keystone thinggy. As long as the host has the CA and it's mounted in the container at the right location, we're good09:10
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176597509:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1765975 in tripleo "ssh timeout in tempest basic ops scen007 gate jobs" [Critical,In progress] - Assigned to yatin (yatinkarel)09:10
*** moguimar has joined #tripleo09:10
Tengujaosorior: my quick-fix on the prod was to create a symlink in the container, and restart (docker restart keystone)09:10
Tengujaosorior: so I'm pretty positive puppet won't need it :)09:10
jaosoriorTengu: alright, sounds good to me then09:15
Tengu:)09:15
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/pike: Change ovs user and fix permissions on ovs upgrade  https://review.openstack.org/56161009:18
Tenguah, another thing: apparently, even with ntpd service running, ceph is complaining about time drift on the monitors. Anything to do in order to avoid that?09:20
*** sri_ has joined #tripleo09:20
TenguI know there's something new with systemd, with the "timedate" command. Apparently, time sync isn't using ntp, according to the output: NTP enabled: no09:21
Tengualthough NTP synchronized: yes09:21
Tenguapparently, this configuration is managed at some level in tripleo.09:21
Tengu(we manually set the "ntp-enable" to "yes", and it was back to no after a tripleo deploy run)09:22
jaosoriorTengu: not sure about that one to be honest09:24
Tenguhttps://bugs.launchpad.net/tripleo/+bug/1766199  :] issue opened in the meanwhile so that "we" can discuss this matter.09:27
openstackLaunchpad bug 1766199 in tripleo "Link timedatectl to ntp" [Undecided,New]09:27
Tenguand now, lunch time. because hungry.09:27
*** bkopilov has quit IRC09:27
Tenguuh? openstack-tripleo-heat-templates/docker/services/ceph-ansible/ceph-base.yaml:          ntp_service_enabled: false09:28
Tenguseriously ?09:28
Tengubrb.09:29
*** stendulker has joined #tripleo09:30
bogdandojaosorior: hi. PTAL https://review.openstack.org/#/c/562589/09:32
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/pike: Change ovs user and fix permissions on ovs upgrade  https://review.openstack.org/56161009:33
*** zoli is now known as zoli|lunch09:33
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/pike: Change ovs user and fix permissions on ovs upgrade  https://review.openstack.org/56161009:39
openstackgerritMichele Baldessari proposed openstack/tripleo-common master: Allow fencing config generation before deployment.  https://review.openstack.org/51142309:42
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Generate undercloud_parameters in output_dir  https://review.openstack.org/56256609:45
shardyjaosorior: Hey, I need to make a host (e.g my laptop) trust an undercloud via SSL with self-signed certs09:46
shardyjaosorior: I followed the steps you added in https://review.openstack.org/#/c/553219/3/doc/source/install/advanced_deployment/ssl.rst09:46
shardybut the browser still complains about missing Subject Alternate Names in the cert09:47
shardyany ideas how I can fix that?09:47
jaosoriorshardy: how was the cert generated?09:47
jaosoriordid you generate that yourself? or was it autogenerated?09:47
shardyjaosorior: autogenerated I think09:47
shardyit's just a pretty default undercloud install09:47
shardybut it's for a demo where it'd be good to make the browser connection appear secure09:47
jaosoriorright09:48
jaosoriorshardy: so, was the cert generated with generate_service_certificate = true ?09:48
jaosoriorshardy: cause the browser complaining about SubjectAltNames is not a trust issue, but an issue with the cert itself09:48
shardyjaosorior: yes generate_service_certificate = true and enable_ui = true were set in the config09:49
jaosoriorshardy: what's the exact error message the browswer is showing?09:49
jaosoriorshardy: was it this error SEC_ERROR_EXTENSION_VALUE_INVALID ?09:50
shardyjaosorior: yes in firefox I see that, in chrome I see a message about SubjectAltNames header missing09:51
shardysec trying to get the exact error09:51
shardyhttp://paste.openstack.org/show/719725/09:52
shardyjaosorior: ^^09:52
shardythat's from chrome09:52
jaosoriorshardy: https://bugzilla.redhat.com/show_bug.cgi?id=1551635 :( soo... yeah, that ended up being a certmonger error.09:52
openstackbugzilla.redhat.com bug 1551635 in certmonger "Can't log in to the director UI with Firefox" [Urgent,On_qa] - Assigned to rcritten09:52
shardyjaosorior: ack thanks, checking what certmonger version we have09:54
jaosoriorshardy: can you pass the output of openssl x509 -in /etc/pki/tls/certs/undercloud-front.crt -noout -text     ?09:55
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates stable/queens: Add the service_config_settings from nova-compute base  https://review.openstack.org/56355409:55
*** markmc`` is now known as markmc09:55
shardyjaosorior: ack just sent it to you via email09:57
jaosoriorthakns09:57
shardyjaosorior: our certmonger version is too old - is it enough to update it or will the cert need to be regenerated?09:58
jaosoriorshardy: yeah, I think it's the certmonger issue; you will need to get the cert regenerated09:58
jaosoriorshardy: cause certmonger was setting up a wrong value in the cert...09:58
shardyjaosorior: Ok, do we have steps to do that manually documented anywhere?09:58
openstackgerritRaoul Scarazzini proposed openstack/python-tripleoclient master: Make ipmi lanplus the default in auto fencing  https://review.openstack.org/56310409:59
jaosoriorshardy: not documented, but you can delete /etc/pki/tls/certs/undercloud-front.crt and run the undercloud install again09:59
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates stable/queens: Add the service_config_settings from {{service-name}} base  https://review.openstack.org/56355609:59
shardyjaosorior: Ok thanks will try that10:00
jaosoriorshardy: (I should document that, let me write myself a TODO)10:01
jaosoriorshardy: I'll add a bunch of missing stuff for the SSL docs in the near future (specially with the TLS by default work, it's needed)10:01
jaosoriorbrb, lunch10:01
shardyjaosorior: ack, thanks for the help!10:01
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/ocata: Change ovs user and fix permissions on ovs upgrade  https://review.openstack.org/55947410:07
*** adarazs is now known as adarazs_lunch10:09
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176597510:10
openstackLaunchpad bug 1765975 in tripleo "ssh timeout in tempest basic ops scen007 gate jobs" [Critical,In progress] - Assigned to yatin (yatinkarel)10:10
*** ooolpbot has quit IRC10:10
*** sshnaidm has quit IRC10:10
*** dtantsur|pto is now known as dtantsur10:16
gfidentedo you guys know if I can retrigger rdo ci jobs only?10:17
gfidenterdo-recheck ?10:17
dtantsurgfidente: last time it was check-rdo10:17
gfidentedtantsur an nice, thanks10:18
Tengugfidente: heya! just a small follow-up regarding my migration: it's done. I have a pike in containers with ceph-ansible \o/. Thanks for your help regarding the ceph issues I had :910:22
gfidenteTengu sorry I couldn't be of more help10:23
gfidentebut good to hear you got there10:23
Tengugfidente: well, you helped :). That's the important part ;)10:23
gfidentenot sure if you're going to blog something about it?10:23
Tengunot sure either.10:23
gfidentejust to understand if/how much it deviated from the normal process10:23
Tengumost of the issues were due to the order I included env files in the end.10:23
Tengugfidente: well, no real deviation. Just run the "upgrade" protocol instead of a simple "update" so that it triggers the "ocat->pike" part, and move the "puppet-ceph -> ceph-ansible" to the third step of the upgrade.10:24
Tengugfidente: ah, had a "small" surprise with a "chcon -R" running on the ceph data… with over 1To, it took "some" time, and I hit the tripleo 4-hours-timeout.10:25
rookshardy: do you happen to have a split-stack example?10:26
*** pcaruana has quit IRC10:26
rookI have never deployed split stack, and didn't know the nodes themselves didn't get added to ironic nor nova.10:26
*** panda is now known as panda|rover10:27
Tenguo_O oook… that's… kind of convenient? censored output on the CI :( http://logs.openstack.org/25/563525/2/check/tripleo-ci-centos-7-undercloud-oooq/8cfab48/job-output.txt.gz#_2018-04-23_09_19_10_76888210:27
florianfdtantsur: Hi! I have a quick ironic question when you have some time...10:28
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Manage UC hostname and hosts file in client  https://review.openstack.org/56356210:28
shardyrook: that feature is "deployed server", which I think we have documented, sec10:28
shardyrook: https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/deployed_server.html10:29
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: [WIP] Set nova/ceilometer/neutron host param to controlled value.  https://review.openstack.org/56251710:30
rookshardy: does the undercloud retain a record of the information of the deployment -- ie openstack overcloud server list (obviously this doesn't work for deployed server, but is there anything that will?)10:30
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Manage UC hostname and hosts file in client  https://review.openstack.org/56356210:30
shardyrook: the heat part of it is still persisted, it's just the servers in nova and ironic which aren't10:30
shardye.g most of the heat outputs should work the same as normal10:31
shardyIIRC10:31
rookshardy: so with splitstack/deployed server, there isn't a way to really query to see the role:hostname key:value ?10:32
*** pcaruana has joined #tripleo10:33
shardyrook: outputs like RoleNetIpMap should still work I think, but they'll be based on the static IP assignments you pass in e.g via DeployedServerPortMap10:34
shardythe thing you can't do is openstack server list to get the ctlplane IP10:34
shardybut because you set DeployedServerPortMap, you should know those already :)10:34
quiquell|ruckSomeone knows how to force un-attach a volume ?10:36
quiquell|ruckI have one without an instance running10:36
Tenguhmm, is the RDO third party CI voting?10:37
*** cshastri has joined #tripleo10:38
quiquell|ruckTengu: It should10:39
quiquell|ruckIt's not ?10:39
Tenguhmm.10:39
Tenguno real idea.10:39
Tenguas it failed my check, I just wondered if I had to really check it :)10:39
Tengulong time I didn't push a review ;)10:39
quiquell|ruckFor the +1 from RDO Third Party CI10:40
Tenguyup10:40
quiquell|ruckCheck this for example10:40
quiquell|ruckhttps://review.openstack.org/#/c/561484/10:40
Tengugot a -1 although I'm not sure the issue is really for my code.10:40
quiquell|ruckGive it to me10:40
Tenguhttps://review.openstack.org/#/c/563525/10:40
Tenguwith error log https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/11722/consoleFull (two jobs, that's the first)10:40
TenguI'd say the issue is with some package install, but not sure. I'm not that used to the CI outputs for now.10:41
Tenguthat's a thing I'll need to learn about shortly anyway :)10:41
rookshardy nope, i don't know... I didn't deploy this cloud :)10:41
rookshardy I am looking into how to patch browbeat to work with a splitstack cloud, since we build our ansible inventory based on nova/heat information...10:42
quiquell|ruckTengu: You have more info here10:42
quiquell|ruck/home/jenkins/install_packages.sh.log10:42
quiquell|ruckEnsure that it's not really related10:42
Tenguquiquell|ruck: hmm, where may I find it? not used to that UI10:43
shardyrook: I think the best approach is to build the inventory based on the heat stack outputs - that's what we do for the tripleo-ansible-inventory10:43
* quiquell|ruck retrieving it10:43
shardyrook: or even better, just use the existing dynamic inventory?10:43
quiquell|ruckTengu: If you go to the button of consoleFull10:44
quiquell|ruckYou find this: 200~https://logs.rdoproject.org/25/563525/2/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z64dee21c42e5474d9895690241b7064610:44
Tenguaah10:44
quiquell|ruckThis contains all the logs files10:44
Tengudirectly in the log. OK10:44
quiquell|ruckYep10:44
quiquell|ruckYou have /home/jenkins/install_packages.sh.log there10:44
quiquell|ruckÂLike zuul10:44
Tenguah, un "undercloud"* directory.10:44
Tenguok10:45
Tenguyep, can confirm: unrelated to my change :)10:45
quiquell|ruckTengu: Yep sorry under undercloud directory10:45
TenguI'm not adding any package, only adding a new volume in the containers :)10:45
quiquell|ruckjeje ok10:45
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Standardise Workflow messaging and optionally persist messages  https://review.openstack.org/42506010:45
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Optionally run config download at the end of stack create/update  https://review.openstack.org/55422410:45
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Send a message every time we get the stack  https://review.openstack.org/56093310:45
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Add type and plan_name to message sent from ansible-playbook action  https://review.openstack.org/56163910:45
Tenguquiquell|ruck: I suspect it's the same issue with zuul tripleo-ci-centos-7-undercloud-oooq check in fact.10:46
Tengualso red.10:46
Tenguhttp://logs.openstack.org/25/563525/2/check/tripleo-ci-centos-7-undercloud-oooq/8cfab48/logs/undercloud/home/zuul/repo_setup.log.txt.gz#_2018-04-23_09_19_10  bingo10:46
rookshardy10:46
rookwhoops, sorry for the naked ping10:46
rookill look into it... I looked into it previously, and I don't think we break out the roles by definition in that script10:47
Tenguquiquell|ruck: thanks for the tip regarding the log location on the 3rd party CI :).10:47
*** jcoufal has joined #tripleo10:47
rookie [controller][compute][ceph-nodes][hci] etc...10:47
quiquell|ruckTengu: You are more thank welcome10:47
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: No-op Mistral workflow resources for update/upgrade/ffwd  https://review.openstack.org/56166610:48
rookbut it has been a while since I have looked shardy -- so it could have been updated...10:48
shardyrook: in recent versions there should be a group per role, and for every service10:48
shardyso probably worth taking a look10:48
Tenguquiquell|ruck: so I suppose I'll be good for a recheck once zuul is over.10:49
quiquell|ruckTengu: Going to check this thing at zuul first10:49
Tenguquiquell|ruck: thanks :)10:49
shardyrook: try /usr/bin/tripleo-ansible-inventory --static-yaml-inventory foo.yaml --plan overcloud10:50
shardyrook: don't use the old ini format --static-inventory though, it's deprecated and may not work10:51
quiquell|ruckTengu: but zuul is still running at your change ?10:51
ykarelamoralej, is this related to deps change ^^ what Tengu mentioned: 2018-04-23 09:19:10 | http://mirror.gra1.ovh.openstack.org:8080/rdo/centos7-master/deps/latest/repodata/0838d41c4715855fa499cbb897028f7209816e763d09a02becc92bf30bc80d2a-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found10:51
Tenguquiquell|ruck: yep, there are still two checks running. one (voting) has failed already.10:52
quiquell|ruckOk found it10:52
amoralejlet me check10:52
Tenguykarel: ah :). good10:52
Tenguquiquell|ruck: apparently amoralej and ykarel are on the package issue :).10:52
amoralejit's probably bad cache10:52
ykarelhmm, this will be fixed automatically?10:52
amoralejwhere is the log?10:53
ykarelamoralej, http://logs.openstack.org/25/563525/2/check/tripleo-ci-centos-7-undercloud-oooq/8cfab48/logs/undercloud/home/zuul/repo_setup.log.txt.gz#_2018-04-23_09_19_1010:53
amoralejmmm10:53
amoralejwe can do a trick10:53
rookshardy that script isn't on this UC10:53
rookshardy i already dug around...10:53
rookI guess it is missing the validations10:53
amoralejyeah, we moved repodata under their feet10:54
shardyrook: it's been installed by default for a while now, what version is this?10:54
*** zoli|lunch is now known as zoli10:54
shardyrook: it's not only used for validations now, we're in the process of switching to ansible deployed "config download" which won't work without that inventory10:54
quiquell|ruckTengu: Today yours and other are the only one failing at this job at zuul10:54
quiquell|ruckAnd the error is different10:54
shardyrook: but yeah, it's installed via the tripleo-validations RPM atm10:54
quiquell|ruckhttps://review.openstack.org/55652210:55
amoralejykarel, yes, that mirror is already in synk10:55
amoralejsync10:55
amoraleji just checked10:55
amoralejare other jobs failing?10:56
amoralejin fact10:56
amoralejupstream mirrors should help to mitigate this10:56
quiquell|ruckamoralej: From RDO I think, let me check10:56
amoralejbut that specific mirror probably expired cache10:56
Tenguquiquell|ruck: hmm both are involving the undercloud. although I guess others are also wanting some undercloud. I git-pulled master from the tripleo-heat-templates, sooo… maybe it's only "latest" pulls?10:56
*** dprince has joined #tripleo10:57
ykarelamoralej, ok checking if any current job is failing on this10:57
amoralejrefreshing the repomd.xml of the mirrors normally refreshes cache10:58
openstackgerritMerged openstack/tripleo-heat-templates master: Revert "Fix neutron-plugin-ml2.yaml puppet base ref"  https://review.openstack.org/56344311:01
ykarelamoralej, saw some failures but in those undercloud/home/zuul directory doesn't exist, so it may be transient and have fixed for now11:03
jaosoriorback11:03
amoralejykarel, ok11:03
*** sshnaidm has joined #tripleo11:03
ykarelTengu, recheck your job once current run finishes to see if the issue is fixed11:03
quiquell|ruckykarel: Cool, I don't find much jobs with issues there11:03
Tenguykarel: amoralej so you think a simple "recheck" today should be OK with my failed ?11:03
Tenguok :D11:03
amoralejTengu, yes11:03
amoralejit should11:03
Tenguwill do that either today or tomorrow. thanky ykarel amoralej11:03
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: [WIP] Set nova/ceilometer/neutron host param to controlled value.  https://review.openstack.org/56251711:04
*** lucasagomes is now known as lucas-hungry11:06
openstackgerritDougal Matthews proposed openstack/python-tripleoclient master: Don't exit on a RUNNING message for deploy workflow  https://review.openstack.org/55735611:07
*** mfedosin has quit IRC11:08
*** dsariel has quit IRC11:09
*** moguimar has quit IRC11:13
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Disallow SSLv2, SSLv3 and TLS1.0 in httpd for FedRAMP compliance.  https://review.openstack.org/56313611:13
*** dpeacock has quit IRC11:14
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo master: Make host param for nova/neutron/ceilometer immutable during upgrade  https://review.openstack.org/55573211:15
*** thrash|g0ne is now known as thrash11:15
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo stable/queens: Make host param for nova/neutron/ceilometer immutable during upgrade  https://review.openstack.org/56357211:16
*** shreshtha has quit IRC11:16
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/queens: WIP: in docker-puppet.py copy in existing config data before puppet apply  https://review.openstack.org/56357311:16
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: Reduce reproducer redudancy  https://review.openstack.org/55836911:18
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: Lint directory instead of files and match exclude from oooq-extra.  https://review.openstack.org/56357411:18
*** dpeacock has joined #tripleo11:19
*** cshastri has quit IRC11:20
*** masco has quit IRC11:21
*** shreshtha has joined #tripleo11:21
*** shreshtha has quit IRC11:22
*** pdeore has quit IRC11:22
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP: in docker-puppet.py copy in existing config data before puppet apply  https://review.openstack.org/56287611:22
*** shreshtha has joined #tripleo11:22
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: [DNM] Testing upgrade patches.  https://review.openstack.org/56357711:24
*** ansmith has quit IRC11:28
*** dbecker has quit IRC11:29
*** stendulker_ has joined #tripleo11:29
*** dsariel has joined #tripleo11:29
chandankumarEmilienM: hello11:29
chandankumarEmilienM: do we need more work on this one https://trello.com/c/wwpJfjRA/695-tempest-run-should-take-less-than-5-min-in-tripleo-undercloud-jobs ?11:30
*** dbecker has joined #tripleo11:31
*** stendulker has quit IRC11:32
*** jpena is now known as jpena|lunch11:33
*** stendulker_ has quit IRC11:34
openstackgerritHarald Jensås proposed openstack/puppet-tripleo stable/queens: Firewall: NOT persist ephemetal ironic-inspector rules  https://review.openstack.org/56358011:35
Tenguykarel amoralej : recheck started.11:35
Tenguwill follow :).11:36
openstackgerritHarald Jensås proposed openstack/instack-undercloud stable/queens: Masqurading, do not persist ephemeral firewall rules  https://review.openstack.org/56358111:36
openstackgerritNoam Angel proposed openstack/tripleo-heat-templates master: Fix few issues with deploying with baremetal-services.yaml  https://review.openstack.org/56026111:36
amoralejok Tengu let me know how it goes11:36
ykarelack11:36
*** zshi has quit IRC11:36
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/ocata: Change ovs user and fix permissions on ovs upgrade  https://review.openstack.org/55947411:36
*** amoralej is now known as amoralej|lunch11:36
Tenguhmmm.11:37
Tenguwill rebase.11:37
*** zshi has joined #tripleo11:37
*** mfedosin has joined #tripleo11:37
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: Added missing pki volume for custom CA.  https://review.openstack.org/56352511:37
Tengubetter.11:37
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/ocata: Add version check for ovs >= 2.8 before applying perm changes  https://review.openstack.org/56358311:37
beaglesif we can get some eyes on these https://review.openstack.org/#/q/topic:bug/1749209+(status:open+OR+status:merged)11:40
*** panda|rover is now known as panda|rover|lunc11:41
beaglesfwiw, much of containerized neutron's functionality has been effectively broken (particularly with respect to HA) so these are pretty important11:42
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Make pcs resource bundle image name update tolerant of rerun  https://review.openstack.org/56307311:42
chandankumarsshnaidm: please have a look at this review https://review.openstack.org/#/c/551271/11:43
*** shreshtha_ has joined #tripleo11:43
*** shreshtha has quit IRC11:44
chandankumarsshnaidm: this one also https://review.openstack.org/#/c/560006/11:46
*** adarazs_lunch is now known as adarazs11:47
chandankumarsshnaidm: thanks :-)11:47
Tengumarios: one question: now that containers are deployed, I guess the infra is "easily" updatable and upgradable, right?11:47
*** quiquell|ruck is now known as quique|ruck|food11:47
dtantsurflorianf: hi, sure11:48
*** abishop has joined #tripleo11:49
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/pike: Change ovs user and fix permissions on ovs upgrade  https://review.openstack.org/56161011:50
florianfdtantsur: cool. Is there a cheap way for ironic(-instructor) to contact a node just to see if it can reach it? (cheap as in: not starting introspection)11:51
dtantsurflorianf: for what definition of "reach"? talk to its BMC? has network connectivity to one/all of its NICs?11:53
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Fix ansible config download dir  https://review.openstack.org/56331711:53
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Save temporary working data  https://review.openstack.org/56057811:53
florianfdtantsur: Networt connectivity11:53
dtantsurflorianf: to NICs, not BMC? I don't see how it's possible without booting the node..11:54
*** aufi has quit IRC11:54
*** pcaruana has quit IRC11:54
*** rfolco|off is now known as rfolco11:55
* beagles really wonders how well sidecars are going to play on the undercloud - shouldn't be a prob, but...11:55
florianfBut talking to the BMC would be possible? I'm mainly thinking about detecting hardware issues (cable unplugged) here, so maybe the NICs arent's that important11:55
florianf*aren't11:55
florianf:-)11:56
*** atoth has joined #tripleo11:56
Tenguamoralej|lunch: ykarel still failing : https://logs.rdoproject.org/25/563525/3/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Zb8a4f84b5a5343b1a688117446f7d06d/undercloud/home/jenkins/install_packages.sh.log.txt.gz#_2018-04-23_11_52_2611:58
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/queens: Make pcs resource bundle image name update tolerant of rerun  https://review.openstack.org/56358812:00
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Fix services docker tht path for tempest container  https://review.openstack.org/56358912:00
florianfdtantsur: ^^12:01
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: [DNM] Testing upgrade patches.  https://review.openstack.org/56357712:01
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Move remnants of environments/services-docker  https://review.openstack.org/56298312:01
beaglesskramaja: if you have a minute can I get your eyes on https://review.openstack.org/#/q/topic:bug/1749209+(status:open), I want to get some insights on how this might affect NFV related cases12:01
dtantsurflorianf: we have no way to detect wrong cabling of NICs without introspection. you can easily check if the BMC is connected properly. actually, our workflows will fail in such case :)12:01
dtantsurI mean, enrolling workflows12:01
beaglestrozet: ^ same12:01
*** khyr0n has quit IRC12:02
skramajaack beagles, will take a look.12:02
beaglesskramaja: thanks12:02
derekjhyangHello. Has anyone used the ManageIQ with TripleO ? Where could I know manageIQ which supports OpenStack version ?12:03
florianfdtantsur: by workflows you mean the mistral workflows, right?12:03
dtantsurflorianf: yep12:03
dtantsurflorianf: the transition enroll -> manageable validates the power credentials12:04
florianfdtantsur: and if I don't want to make those changes and just check if the bmc can be connected to?12:05
dtantsurflorianf: what's the use case? BMC suddenly going down?12:05
*** lucas-hungry is now known as lucasagomes12:06
florianfdtantsur: the use case would be a validation that you can run pre-deployment to check connectivity. Like unplugged cables or similar.12:08
sshnaidmchandankumar, commented12:08
florianfdtantsur: although I'm not sure how useful this is if we can't check the nics.12:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176619512:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1766195 in tripleo "Error installing fluent-plugin-kubernetes_metadata_filter at pike" [Critical,New] - Assigned to Gabriele Cerami (gcerami)12:10
*** pcaruana has joined #tripleo12:10
openstackgerritJose Luis Franco proposed openstack/tripleo-common stable/queens: Remove version section in overcloud_keystone_url.  https://review.openstack.org/56359812:12
*** trown|outtypewww is now known as trown12:12
*** liverpooler has joined #tripleo12:16
*** avivgt has quit IRC12:17
*** avivgt has joined #tripleo12:17
*** raildo has joined #tripleo12:17
openstackgerritDmitry Tantsur proposed openstack/tripleo-heat-templates master: Add support to ironic "direct" deploy interface  https://review.openstack.org/52934212:17
*** fultonj has joined #tripleo12:19
*** dsariel has quit IRC12:19
*** rlandy has joined #tripleo12:19
*** pchavva has joined #tripleo12:19
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Rename test_regex to test_white_regex with deprecation  https://review.openstack.org/56000612:20
*** fultonj has quit IRC12:20
*** fultonj has joined #tripleo12:20
dtantsurflorianf: right, the connectivity to the BMC is checked when enrolling. everything else - during introspection.12:21
openstackgerritHamdy Khader proposed openstack/tripleo-heat-templates master: Add support for NVMeOF cinder backend  https://review.openstack.org/55957212:23
*** aufi has joined #tripleo12:24
*** amoralej|lunch is now known as amoralej12:25
amoralejTengu, that's a different one12:25
amoralejlet me fix it12:25
Tenguamoralej: :) thanks12:25
amoralejmmmm12:26
Tengudid I break anything? ;)12:27
*** cdearborn has joined #tripleo12:27
*** jpena|lunch is now known as jpena12:27
ykarelamoralej, ahh, so we missed some packages12:28
amoralejactually, not12:28
amoralejthe package is in the ceph repo12:28
amoralejmmm12:28
amoralejbut it shouldn't be in the metadata12:28
ykarelOk, so is this changed recently12:28
ykarelas i can see that package in https://trunk.rdoproject.org/centos7-queens/deps/latest/x86_64/12:29
amoralejbut anyway, i think it's good to push it to the deps repo12:29
amoralejas las release in RDO is higher that the one in the ceph repo12:30
amoralejso, it's still related to using old metadata12:30
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Rename test_regex to test_white_regex  https://review.openstack.org/55928112:30
ykarelamoralej, Ok12:30
*** zshi has quit IRC12:30
beaglesdprince, mandre: if I can get your eyes on these patches https://review.openstack.org/#/q/topic:bug/1749209+(status:open) as well - there is some stuff where I had to update docker to do something different for neutron sidecar containers and I think it warrants some heightened scrutiny on that front12:31
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Add neutron-plugin-ml2 to the scenario007  https://review.openstack.org/56360412:31
amoralejTengu, but that job is running in rdo-cloud12:31
amoralejright?12:31
beaglesmwhahaha, EmilienM ^ same12:31
Tenguamoralej: third party CI yep12:31
beaglesbasically mounting docker.sock in a container can lead to badness if docker is restarted12:32
florianfdtantsur: and can connectivity be checked without changing state? something like a bmc ping? :-)12:32
beaglesso I added the option to have it create additional bind sockets12:32
*** trozet has quit IRC12:32
dprincebeagles: ack12:32
Tenguamoralej: for now I don't have feedback from zuul12:32
amoralejwe Tengu did it passed the repos-setup role?12:33
amoralejthe ones in zuul12:33
*** dsariel has joined #tripleo12:34
amoraleji could do a quick fix if needed until all mirrors are in sync12:34
Tenguamoralej: hmmmm it's installing the undercloud for the one that failed last time12:34
dtantsurflorianf: well, we have a (mis)feature in our API: the call to get the current boot device accesses the BMC in a synchronous fashion12:34
Tenguamoralej: http://zuul.openstack.org/stream.html?uuid=06a85cc1b03e48108bd206a84aedbc8b&logfile=console.log12:34
*** zshi has joined #tripleo12:34
amoralejok, that sounds good12:34
Tenguamoralej: failure occures later I think.12:34
amoralejno, i guess it's before12:34
amoralejin repo-setup iirc12:35
Tenguwe'll see :)12:35
Tenguanyway, this review isn't that urgent (unless jaosorior has some better view [the keystone/CA issue] of course)12:35
florianfdtantsur: sounds good! why the "mis"? :)12:36
dtantsurflorianf: because of the way openstack projects are designed, synchronous actions that can lock up for several minutes are not desired12:37
dtantsursuch a thing will occupy an RPC thread12:37
jchhatbarjaosorior, hey12:37
*** rmascena has joined #tripleo12:37
*** jchhatbar is now known as janki12:37
*** tcw has joined #tripleo12:39
*** raildo has quit IRC12:40
florianfdtantsur: oh right. so gettingt the current boot device will probably take a while?12:40
*** tcw has joined #tripleo12:40
openstackgerritAlex Schultz proposed openstack/tripleo-puppet-elements master: Remove Openstack and Ceph packages attempt 2  https://review.openstack.org/56360812:43
*** trozet has joined #tripleo12:44
*** faceman- is now known as faceman12:44
openstackgerritDmitry Tantsur proposed openstack/python-tripleoclient master: Add XClarity in the list of supported hw types  https://review.openstack.org/54157012:44
dtantsurflorianf: not if the BMC is functioning well12:46
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Generate undercloud_parameters in output_dir  https://review.openstack.org/56256612:46
jpichhonza: Hi! What have you been running the undercloud container on? Just on your laptop directly?12:46
*** zshi has quit IRC12:48
openstackgerritAlex Schultz proposed openstack/tripleo-puppet-elements master: Remove Openstack and Ceph packages attempt 2  https://review.openstack.org/56360812:48
*** rbowen has joined #tripleo12:50
*** zshi has joined #tripleo12:50
*** dmsimard|off is now known as dmsimard12:51
florianfdtantsur: cool. thanks for all the input!12:51
dtantsurnp12:52
openstackgerritPranali Deore proposed openstack/tripleo-heat-templates master: Disable interoperable default image import method in THT  https://review.openstack.org/56293012:52
*** dsariel has quit IRC12:52
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Wire-in net_config_override  https://review.openstack.org/56361012:53
*** adarazs is now known as adarazs_brb12:56
dtantsurthe CI does not look GREEN, it seems like we have some mirror problems currently12:57
*** ansmith has joined #tripleo12:57
* dtantsur looks at https://review.openstack.org/#/c/529342/12:57
*** quique|ruck|food is now known as quiquell|ruck12:57
honzajpich: i use a vm in rdo cloud12:58
*** tzumainn has joined #tripleo12:58
honzajpich: and then this https://gist.github.com/EmilienM/2968a53e6ca03de8a0eed6a9a1cc9f7312:58
honzajpich: btw, i never had to do the eth1 stuff12:59
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: [WIP] Set nova/ceilometer/neutron host param to controlled value.  https://review.openstack.org/56251712:59
jpichhonza: Oh, really? I'm having all sorts of issues with network interfaces so it looks like exactly what I need. Thanks for the pointers!12:59
*** dhill_ has joined #tripleo13:01
honzajpich: i tried using the openstack commands to boot a nova instance, and couldn't figure out how to do it for 2h (networking stuff, floating ip, etc), so now i just use oooq and ctrl+c once the vm is up and it has keys and a floating ip13:03
*** Goneri has joined #tripleo13:04
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Removing the deprecated environment files for hw offloading in containers  https://review.openstack.org/55972313:05
fultonjany reason we haven't +w'd https://review.openstack.org/#/c/563040 ?13:09
fultonjgfidente: ^ ?13:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176619513:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1766195 in tripleo "Error installing fluent-plugin-kubernetes_metadata_filter at pike" [Critical,Confirmed] - Assigned to Gabriele Cerami (gcerami)13:10
*** mcornea has joined #tripleo13:10
*** ramishra_ has joined #tripleo13:12
gfidentefultonj yeah it's not tested in CI13:12
*** ramishra has quit IRC13:13
gfidentethis one should be testing it https://review.openstack.org/#/c/563047/13:13
gfidenteI was I think we can merge both, but the above is failing in rdo and I wanted to make sure it's unrelated13:14
chandankumarmwhahaha: please have a look at this one https://review.openstack.org/#/c/551271/13:14
fultonjgfidente: ok, thanks13:15
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/queens: DNM: Test pike->queens upgrades.  https://review.openstack.org/56361613:15
*** moshele has quit IRC13:16
*** psachin has quit IRC13:17
openstackgerritDerek Higgins proposed openstack/tripleo-heat-templates master: Download IPA kernel and ramdisk  https://review.openstack.org/56307213:18
*** ratailor has quit IRC13:21
openstackgerritRyan Brady proposed openstack/tripleo-common master: Adds Create Container Workflow  https://review.openstack.org/56361913:26
*** moguimar has joined #tripleo13:26
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: Correct branch used in tripleo-upgrade installation.  https://review.openstack.org/56308113:29
*** ohochman has joined #tripleo13:29
*** jpich has quit IRC13:30
*** lvdombrkr has joined #tripleo13:30
*** adarazs_brb is now known as adarazs13:30
*** cshastri has joined #tripleo13:31
apetrichthrash, I"m late13:32
thrashapetrich: ack13:32
weshaymwhahaha, EmilienM packaging team are syncing new content for rocky atm, looks like it's impacting some gate jobs fyi13:32
*** cshastri has quit IRC13:33
weshayhttp://logs.openstack.org/63/507963/54/gate/tripleo-ci-centos-7-undercloud-oooq/54add67/logs/undercloud/home/zuul/repo_setup.log.txt.gz#_2018-04-23_13_06_2013:33
*** weshay changes topic to "Welcome to Rocky. CI status Yellow/Red, rdo packaging updating yum repos for rocky | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest"13:35
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Default collectd to overcloud gnocchi  https://review.openstack.org/56237213:35
pabelangermwhahaha: could you please review and merge https://review.openstack.org/563244/ and https://review.openstack.org/563245/ will help openstack-infra team13:36
openstackgerritJason E. Rist proposed openstack/tripleo-ui master: Mask Passwords and allow Copy to Clipboard  https://review.openstack.org/56203913:36
*** jpich has joined #tripleo13:38
florianfjrist: I see you've just updated https://review.openstack.org/#/c/562039/ Would you mind updating the shrinkwrap file as well while you're at it?13:44
jristoh sure!13:45
jristthanks florianf13:45
jristoh no13:45
jristthis is what Liz was talking about13:46
jristflorianf: http://paste.openstack.org/show/719745/13:46
mwhahahapabelanger: need to actually find a jobt that's running the build-images bits. i'll try to do that today13:47
pabelangerthanks13:47
pabelangermwhahaha: oh, I think it is DIB that runs it13:48
mwhahahapabelanger: there's other ones. we should actually be doing it on ovb jobs but that appears to have gone missing at some point13:48
openstackgerritAlex Schultz proposed openstack/tripleo-puppet-elements master: DNM ci test  https://review.openstack.org/56362713:49
mwhahahai think that'll trigger it13:49
florianfjrist: let me have a look13:50
*** dxiri has joined #tripleo13:51
*** panda|rover|lunc is now known as panda|ruck13:51
EmilienMhi13:51
florianfhonza: which version of npm are we using for packaging?13:51
*** quiquell|ruck is now known as quiquell|rover13:51
honzaflorianf: 5.6.013:51
EmilienMbeagles: ack13:51
beaglesEmilienM: thx!13:51
EmilienMchandankumar: I'll look today and reply in the trello card13:52
chemowalsh: hi, so you should we un-abandon https://review.openstack.org/#/q/I7ed52727d1515ee7f191a82b0b1d645a9d597cd3 and make https://review.openstack.org/#/c/562517/ a proper backport ?13:52
EmilienMweshay: I can't look *now*13:52
florianfhonza: thanks!13:52
*** owalsh has left #tripleo13:52
jristflorianf, jtomasek - this guy does a bump https://github.com/nandastone/react-password-mask13:52
*** owalsh has joined #tripleo13:53
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: WIP: do not pass ceph_release to ceph-ansible  https://review.openstack.org/56363213:54
dtantsurfolks, could you please check this backport: https://review.openstack.org/#/c/559314/13:54
openstackgerritAlex Schultz proposed openstack/tripleo-puppet-elements master: DNM ci test  https://review.openstack.org/56362713:54
owalshchem: sure13:54
*** rh-jelabarre has quit IRC13:55
*** trown is now known as trown|brb13:56
weshayEmilienM, no need.. just fyi13:57
florianfjrist: meaning?13:58
Tengufultonj: heya! thanks to your help on the few ceph issues I had, I could migrate last weekend :). It was painful, but in the end I have my containerized overcloud with ceph-ansible and the like :). so, yep, thank you!13:58
openstackgerritMerged openstack/tripleo-heat-templates master: Enable management network in network_data  https://review.openstack.org/56286713:59
jristflorianf: meaning it works with React 1614:00
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Align UC net/env-files override with instack  https://review.openstack.org/56363614:00
*** trown|brb is now known as trown14:01
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates stable/queens: Enable management network in network_data  https://review.openstack.org/56363714:02
fultonjTengu: that's great!14:02
*** rh-jelabarre has joined #tripleo14:03
Tengufultonj: indeed :)14:07
owalshchem: so roll https://review.openstack.org/555278 back to PS2 and unabandon the backports yea?14:07
fultonjTengu: is there anytyhing worth documenting as a result of your experience?14:07
fultonje.g. if you upgraded without containers it's possible to migrate to containers by doing x,y,z14:08
chemowalsh: yeap, and adding https://review.openstack.org/#/c/562517/ to the "backport" list14:08
fultonjmaybe just a blog entry ?14:08
chemowalsh: that will fix deployment14:08
Tengufultonj: hmm, well, order DOES matter for environment inclusion, especially when you want ceph instead of the default swift. More than that, I think the three steps are pretty well documented, as it's an *upgrade* we have to do, even if we stay in Pike.14:09
chemowalsh: I'm trying to capture all that in there https://etherpad.openstack.org/p/mitaka-newton-fip-loss14:09
Tengufultonj: and the fact I had to do the puppet-ceph -> ceph-ansible + ceph in containers at the third step14:09
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176619514:10
openstackLaunchpad bug 1766195 in tripleo "Error installing fluent-plugin-kubernetes_metadata_filter at pike" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)14:10
*** ooolpbot has quit IRC14:10
owalshchem: ok, I'll push the patches now14:10
Tengufultonj: sooo… don't know. regarding blog post, I don't know - my current job doesn't have a technical blog, my own one is in French only… maybe in some "advanced post-deploy" page on some rdo/tripleo/openstack wiki?14:11
*** lblanchard has joined #tripleo14:11
*** matbu has quit IRC14:12
*** lblanchard has quit IRC14:12
abishopdtantsur: I'm sure you're swamped after being away, but hoping you can take a second look at https://review.openstack.org/55831314:12
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Removing the deprecated environment files for hw offloading in containers  https://review.openstack.org/55972314:13
fultonjTengu: ok14:14
*** moguimar has quit IRC14:14
openstackgerritMerged openstack/tripleo-docs master: Doc config-download with deployed-server  https://review.openstack.org/55432514:14
fultonjwe have https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ceph_config.html and  https://docs.openstack.org/tripleo-docs/latest/install/post_deployment/upgrade.html14:14
*** matbu has joined #tripleo14:14
Tengufultonj: yup. maybe a dedicated page in the post_deployment?14:15
fultonji was wondering if they needed an update to include your experiences14:15
TenguI'd rather put a dedicated page, as it's a really specific thing.14:16
fultonjTengu: awesome14:16
*** skramaja has quit IRC14:16
Tengufultonj: repository is tripleo-docs I guess?14:16
fultonjTengu: if you put something up please add me to the review14:16
fultonjTengu: yeah14:16
Tenguyup, no problem14:16
fultonjTengu: e.g. https://review.openstack.org/#/c/562378/14:17
Tenguyep14:17
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Explicitly set nova/neutron/ceilometer host to expected fqdn  https://review.openstack.org/55527814:18
EmilienMccamacho, mwhahaha : do we have functional testing for https://review.openstack.org/#/c/559024 ? do we have a job that deploys an undercloud and tries to run a backup?14:18
mwhahahanope14:18
TenguI create the "blank" page and the review, and will complete it tomorrow. For now I'm a bit tired, slept less than 12 hours this weekend due to the migration :D. I had some side issues… and I'm just plain dead now.14:18
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Move the tests around so pcmk_resource_has_changed? does not get triggered  https://review.openstack.org/56364414:21
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates stable/queens: Explicitly set nova/neutron/ceilometer host to expected fqdn  https://review.openstack.org/55531314:21
dtantsurabishop: kinda swamped indeed, will put on my queue14:22
abishopdtantsur: thx!14:23
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates stable/pike: Explicitly set nova/neutron/ceilometer host to expected fqdn  https://review.openstack.org/55531714:23
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates stable/ocata: Explicitly set nova/neutron/ceilometer host to expected fqdn  https://review.openstack.org/55531914:25
openstackgerritCarlos Goncalves proposed openstack/tripleo-common master: Create keypair for SSH access to Octavia amphorae  https://review.openstack.org/56088014:26
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates stable/ocata: Explicitly set nova/neutron/ceilometer host to expected fqdn  https://review.openstack.org/55531914:27
openstackgerritMerged openstack/tripleo-docs master: Doc adding HostsEntry to /etc/hosts  https://review.openstack.org/55859614:27
florianfjrist: which is what we have, isn't it?14:28
jristflorianf: aye14:28
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates stable/ocata: Explicitly set nova/neutron/ceilometer host to expected fqdn  https://review.openstack.org/55531914:28
*** hjensas is now known as hjensas|afk14:29
*** links has quit IRC14:30
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Exclude nodes deployed with another deployment plan  https://review.openstack.org/56364614:30
openstackgerritToure Dunnon proposed openstack/tripleo-quickstart master: Update quickstart base centos image.  https://review.openstack.org/51939114:31
*** lvdombrkr89 has joined #tripleo14:37
*** bkopilov has joined #tripleo14:38
*** paramite has quit IRC14:39
*** lvdombrkr has quit IRC14:40
bogdandoPTAL https://review.openstack.org/#/c/556522/ https://review.openstack.org/#/c/562983/14:40
ccamachoEmilienM we don't have functional tests for the UC backup, that's why I reused the same interface for pushing tarballs to swift14:40
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates stable/newton: Explicitly set nova/neutron/ceilometer host to expected fqdn  https://review.openstack.org/56365014:41
ccamachoim just changing the swift client per service and adding the corresponfing headers14:41
*** pblaho has quit IRC14:45
jristhonza, florianf, akrivoka, jtomasek - how are you guys handling NPM versions14:45
jtomasekjrist: nvm14:45
jristk14:46
honzajrist: nvm (fish implementation)14:46
jtomasekjrist: is what I use14:46
jristhonza: FISH?!14:46
honzajrist: https://github.com/fisherman/nvm14:46
* jrist dives in14:46
*** lblanchard has joined #tripleo14:46
florianfjrist: nvm14:46
honzajrist: sorry, this one https://github.com/fisherman/fnm14:47
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates stable/newton: Explicitly set nova/neutron/ceilometer host to expected fqdn  https://review.openstack.org/56365014:47
*** lvdombrkr89 has quit IRC14:47
honzajrist: y u no fish?14:47
jristhonza: is this recommended14:47
jristI know not of fish14:47
honzajrist: fish is the best shell ever14:47
honza<314:47
jristlul14:47
jristhonza: you are my favorite corner case14:48
honzajrist: bahahaha14:48
openstackgerritCarlos Camacho proposed openstack/tripleo-common master: Allow uploading big files to swift (5GB)  https://review.openstack.org/55902414:48
honzajrist: fish isn't *that* unusual14:48
*** agopi has joined #tripleo14:48
honzajrist: the best thing about fish is that it knows what you want to do, and makes suggestions as you type your command; you then just hit ctrl+f to accept it14:49
*** rpioso|afk is now known as rpioso14:49
*** ykarel is now known as ykarel|away14:50
ccamachoso EmilienM, for the functional tests, if the export_plan works it should work for the backup as is the same method14:52
*** stendulker has joined #tripleo14:53
owalshchem: patches are all updated, and have a newton backport in https://review.openstack.org/56365014:53
*** artom has joined #tripleo14:54
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Enable cleanup by default for undercloud install  https://review.openstack.org/56203214:54
owalshchem: can't turn https://review.openstack.org/562517 into a backport AFAIK, as we would need to alter the change-id, which will create a new review14:55
*** quiquell|rover is now known as quiquell|off14:56
chemowalsh: I was about to abandoning it, yours is better anyway :)14:56
*** jcoufal_ has joined #tripleo14:56
*** jcoufal has quit IRC15:00
*** gfidente is now known as gfidente|afk15:00
*** orange_julius has quit IRC15:01
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Add external DNS server to the /etc/resolv.conf  https://review.openstack.org/56282515:02
*** skramaja has joined #tripleo15:04
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Remove DNS servers that are no longer used  https://review.openstack.org/56365815:06
*** skramaja has quit IRC15:07
openstackgerritCarlos Goncalves proposed openstack/puppet-tripleo stable/queens: Split up neutron-lbaas service plugin and agent  https://review.openstack.org/56321415:08
*** rajinir has joined #tripleo15:08
*** stendulker_ has joined #tripleo15:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176619515:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1766195 in tripleo "Error installing fluent-plugin-kubernetes_metadata_filter at pike" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)15:10
*** stendulker has quit IRC15:11
*** anilvenkata has quit IRC15:14
*** janki has quit IRC15:17
*** ramishra_ has quit IRC15:18
*** pcaruana has quit IRC15:19
chandankumarEmilienM: sshnaidm How to add a new featerset?15:21
openstackgerritMerged openstack/tripleo-common stable/queens: Add docker packages to dhcp and l3 agent containers  https://review.openstack.org/56165015:21
openstackgerritMerged openstack/tripleo-heat-templates master: Fix openstack-nova-consoleauth service upgrade check  https://review.openstack.org/56343215:21
sshnaidmchandankumar, create a patch with featureset file in tripleo-quickstart15:21
sshnaidmchandankumar, but be aware of numbers: https://etherpad.openstack.org/p/quickstart-featuresets15:22
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Wire-in roles_file for undercloud heat installer  https://review.openstack.org/56366615:22
EmilienMweshay: how could we test https://review.openstack.org/#/c/563608/ with an OVB job that actually rebuild the image?15:22
mwhahahaso i thought all ovb jobs were supposed to rebuild15:24
mwhahahaor do we want to just pick fs35 or fs00115:24
EmilienMmwhahaha: how long takes image rebuild?15:25
EmilienMmwhahaha: imho we should only trigger the rebuild on certains projects15:25
EmilienMrebuilding the image is useful in tripleo-puppet-elements, and some other projects but not everytime15:25
* mwhahaha shrugs15:25
mwhahahajust saying it used to be like that15:26
mwhahahaand we've lost this over time15:26
EmilienMweshay and others^ any idea why?15:26
*** pblaho has joined #tripleo15:28
chemowalsh: do you have bz for https://bugs.launchpad.net/tripleo/+bug/1758034 ?15:28
openstackLaunchpad bug 1758034 in tripleo "live migration fails if domain name is incorrect" [High,In progress] - Assigned to Oliver Walsh (owalsh)15:28
chemowalsh: if not I create them all to piggy-back all the review that need to be in all version in the table there https://etherpad.openstack.org/p/mitaka-newton-fip-loss15:30
openstackgerritDmitry Tantsur proposed openstack/python-tripleoclient master: Add XClarity in the list of supported hw types  https://review.openstack.org/54157015:30
owalshchem: https://bugzilla.redhat.com/show_bug.cgi?id=155936615:30
openstackbugzilla.redhat.com bug 1559366 in openstack-tripleo-heat-templates "[Deployment] Live migrations failing when domain is incorrect" [High,On_dev] - Assigned to owalsh15:30
chemowalsh: thanks15:30
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates stable/queens: Fix openstack-nova-consoleauth service upgrade check  https://review.openstack.org/56366915:32
owalshchem: although https://review.openstack.org/562818 pretty much resolves the live-migration issue15:33
owalshas it switches to using IPs15:34
chemowalsh: yeah ... make sense to associte it with that bugzilla ... just need cloning and a lot of tag and pm ack to make sure it's merged from master to newton15:34
owalshactually, no, not ips, is uses the network specific fqdn15:34
*** stendulker has joined #tripleo15:35
chemowalsh: right15:35
*** chandankumar has quit IRC15:35
owalshchem: so I may need to backport all of the fqdn_* hieradata to newton15:36
*** stendulker_ has quit IRC15:36
owalshchem: or switch to IPs... only need the fqdn for TLS15:37
*** moshele has joined #tripleo15:38
chemowalsh: oh ... and this is ssh, so no need for name really ... backport fqdn_$network may prove more chanlenging than ip15:39
*** fragatina has joined #tripleo15:39
*** b00tcat_ has joined #tripleo15:40
owalshchem: yea, newton is ssh only IIRC15:40
*** b00tcat has quit IRC15:40
*** moshele has quit IRC15:40
chemowalsh: for the other patch/backport I'll use clone of for every release https://bugzilla.redhat.com/show_bug.cgi?id=149920115:40
openstackbugzilla.redhat.com bug 1499201 in rhosp-director "OSP9 -> OSP10: workloads created before upgrade are not reachable anymore after rebooting controller nodes" [Urgent,On_dev] - Assigned to sathlang15:40
owalshchem: sure15:41
*** suuuper has quit IRC15:41
*** fragatin_ has joined #tripleo15:41
*** sshnaidm is now known as sshnaidm|afk15:41
*** chandankumar has joined #tripleo15:42
*** jpena is now known as jpena|brb15:43
*** fragatina has quit IRC15:45
*** dparkes has quit IRC15:45
*** sshnaidm|afk has quit IRC15:46
*** sshnaidm has joined #tripleo15:48
*** sshnaidm has quit IRC15:49
*** ykarel|away has quit IRC15:49
*** moguimar has joined #tripleo15:50
*** ukalifon has quit IRC15:50
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: [DNM] Testing upgrade patches.  https://review.openstack.org/56368015:50
*** panda|ruck is now known as panda|bbl15:51
*** gfidente|afk has quit IRC15:56
*** stendulker_ has joined #tripleo15:56
*** agurenko has quit IRC15:56
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - heat: align config with instack-undercloud  https://review.openstack.org/55835415:57
*** stendulker has quit IRC15:58
*** owalsh is now known as owalsh_afk15:58
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO  https://review.openstack.org/56045216:00
*** bogdando has quit IRC16:01
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Exclude nodes deployed with another deployment plan  https://review.openstack.org/56364616:02
*** yprokule has quit IRC16:04
*** leanderthal has quit IRC16:04
*** ccamacho has quit IRC16:04
*** stendulker_ has quit IRC16:05
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176619516:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1766195 in tripleo "Error installing fluent-plugin-kubernetes_metadata_filter at pike" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)16:10
*** marios has quit IRC16:11
*** ccamacho has joined #tripleo16:11
openstackgerritHarald Jensås proposed openstack/instack-undercloud master: Masqeurading: NOT persist ephemeral firewall rules  https://review.openstack.org/56346716:13
*** pcaruana has joined #tripleo16:13
*** zoli is now known as zoli|gone16:14
*** zoli|gone is now known as zoli16:14
*** hjensas|afk is now known as hjensas16:18
openstackgerritMerged openstack/tripleo-quickstart master: Add opstools repo roles to path  https://review.openstack.org/56007816:19
*** jpena|brb is now known as jpena16:22
*** aufi has quit IRC16:23
*** lucasagomes is now known as lucas-afk16:29
*** jpich has quit IRC16:30
*** pblaho has quit IRC16:31
openstackgerritMerged openstack/tripleo-validations master: Add validation for checking baremetal boot images  https://review.openstack.org/55532516:38
*** leitan has joined #tripleo16:41
openstackgerritMerged openstack/tripleo-docs master: Ceph backfill and recovery options require config overrides  https://review.openstack.org/56237816:44
openstackgerritMerged openstack/puppet-pacemaker master: Fix missing pass-through of cluster_auth_enabled parameter  https://review.openstack.org/56226316:45
mwhahahaEmilienM: so to answer your question, it looks like it takes ~15 mins to build the images w/ my reduced package install16:47
mwhahahahttp://logs.openstack.org/08/563608/2/check/tripleo-buildimage-overcloud-full-centos-7/875f428/job-output.txt.gz#_2018-04-23_13_13_21_91487816:47
*** jpena is now known as jpena|off16:50
EmilienMmwhahaha: it's not long but still some time, we probably want some logic to run the build only on some projects, like t-p-e and probably more16:50
mwhahahayea16:50
mwhahahai'll look into that16:50
mwhahahaweshay, seeing a bunch of failures that look to be infra redlated http://logs.openstack.org/17/563317/5/check/tripleo-ci-centos-7-3nodes-multinode/738fffb/job-output.txt.gz#_2018-04-23_15_48_40_84664016:51
EmilienMmwhahaha: I think weshay isn't here today, probably traveling16:51
mwhahahawell i don't see a ruck/rover16:51
mwhahahaso16:51
mwhahahafiddlesticks16:51
EmilienMtrown, rlandy ^ please16:51
mwhahahaarg16:53
mwhahahaheat-agents 1.6.0 is nto available16:53
* mwhahaha blames EmilienM 16:53
mwhahahahttp://logs.openstack.org/17/563317/5/check/tripleo-ci-centos-7-3nodes-multinode/738fffb/logs/undercloud/home/zuul/install_built_repo.log.txt.gz16:53
EmilienMis it because we don't pull it from current16:53
EmilienM?16:54
mwhahahamost likely16:54
trownya same thing just started happening with my deploys16:54
EmilienMgrr16:54
EmilienMwait but we released heat-agents on Friday16:54
mwhahahapromotion?16:54
EmilienMI can revert my patch16:55
mwhahahayes plz16:55
trownEmilienM: mwhahaha... or we take heat-agents from current...16:55
EmilienMhttps://review.rdoproject.org/r/#/c/13484/16:55
EmilienMtrown: they don't run tripleo jobs, I would rather not do it16:55
EmilienMand use regular promotion workflow16:55
trownk16:55
*** rbowen has quit IRC16:58
*** trown is now known as trown|lunch17:00
*** sshnaidm has joined #tripleo17:00
*** moguimar has quit IRC17:02
*** sshnaidm is now known as sshnaidm|off17:02
*** jaosorior has quit IRC17:05
EmilienMbeagles: can you please review https://review.openstack.org/#/c/562932/ ?17:08
beaglesEmilienM: ack17:08
*** derekh has quit IRC17:08
openstackgerritMike Fedosin proposed openstack/tripleo-common master: Send a zaqar message with 'list_validations' result  https://review.openstack.org/56370117:08
*** ooolpbot has joined #tripleo17:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176619517:11
openstackLaunchpad bug 1766195 in tripleo "Error installing fluent-plugin-kubernetes_metadata_filter at pike" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)17:11
*** ooolpbot has quit IRC17:11
*** morazi has quit IRC17:11
openstackgerritMerged openstack/tripleo-heat-templates master: Add environment file for Mellanox SDN  https://review.openstack.org/55050717:11
openstackgerritMerged openstack/puppet-tripleo stable/queens: Changing opendaylight loadbalancing alogirthm  https://review.openstack.org/56346317:11
openstackgerritMerged openstack/tripleo-common master: Use ansible_queue_name only for upgrade/update  https://review.openstack.org/56299517:11
*** kopecmartin has quit IRC17:12
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates stable/pike: Reduce verbosity during mysql bootstrap  https://review.openstack.org/56297917:15
openstackgerritBrent Eagles proposed openstack/puppet-tripleo master: Adding wrapper scripts for neutron agent subprocesses  https://review.openstack.org/55022417:15
openstackgerritCarlos Camacho proposed openstack/tripleo-common stable/queens: Use ansible_queue_name only for upgrade/update  https://review.openstack.org/56370317:16
*** mdnadeem has quit IRC17:17
openstackgerritMerged openstack-infra/tripleo-ci master: add an update non-voting job to mimimal check  https://review.openstack.org/56234717:18
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: CI test - never merge  https://review.openstack.org/56370617:21
*** waleedm has joined #tripleo17:21
*** waleedm has quit IRC17:22
*** ledo_ has joined #tripleo17:22
*** ledo_ has quit IRC17:22
*** waleedm has joined #tripleo17:22
*** tesseract has quit IRC17:23
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Removing the deprecated environment files for hw offloading in containers  https://review.openstack.org/55972317:24
*** khyr0n has joined #tripleo17:25
*** khyr0n has quit IRC17:27
*** khyr0n has joined #tripleo17:27
*** khyr0n has quit IRC17:31
*** khyr0n has joined #tripleo17:31
Tenguhmm. fultonj are you still here? where are supposed to be the ceph-osd-* logs?17:32
*** dtantsur is now known as dtantsur|afk17:33
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - heat: align config with instack-undercloud  https://review.openstack.org/55835417:33
*** khyr0n_ has joined #tripleo17:33
fultonjsudo journalctl CONTAINER_NAME=ceph-mon-overcloud-controller-017:34
fultonjTengu: ^ and similar on relevant node17:34
Tengufultonj: oh, ok. so not in the /var/log/container directory.17:35
fultonjno17:35
Tenguwill need to debug a bit, apparently the object store isn't working properly, and returns 401 "error" code. will do that tomorrow.17:35
*** khyr0n has quit IRC17:36
dtrainorfultonj, great troubleshooting command, thanks.17:37
fultonjdtrainor: oh good, glad it helps17:37
Tengu:)17:38
fultonjTengu: you might want to make sure you have adequate resources on your containers17:39
fultonjhttps://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ceph_config.html#configure-container-settings-with-ceph-ansible17:39
fultonj^ the above allocates 3g + 1cpu per OSD container17:39
fultonj3g+1cpu per OSD should be default but you might want to check if things are starving17:40
Tengufultonj: hmm, how can I do that?17:40
jristhonza, jtomasek, florianf I Was able to shrinkwrap with newer npm17:40
fultonjTengu: how to check if they're starving?17:40
openstackgerritJason E. Rist proposed openstack/tripleo-ui master: Mask Passwords and allow Copy to Clipboard  https://review.openstack.org/56203917:40
fultonjTengu: if you look at the logs for the container with `journalctl CONTAINER_NAME` and see it dying and reporting it's out of memory for example...17:41
Tengufultonj: note: we have 2 ceph nodes. I have therefore set CephPoolDefaultSize: 2, CephStorageCount: 2, CephPoolDefaultPgNum: 25617:41
Tengufultonj: ah, ok.17:41
openstackgerritMerged openstack/tripleo-upgrade stable/queens: Pass environment files to upgrade converge step.  https://review.openstack.org/56349417:42
openstackgerritMerged openstack/tripleo-upgrade master: Add overcloud update converge tasks.  https://review.openstack.org/56224417:42
openstackgerritMerged openstack/tripleo-upgrade master: Use --roles in overcloud upgrade run.  https://review.openstack.org/56353317:42
*** agopi is now known as agopi|lunch17:42
Tengufultonj: hmmm. apparently resources are OK17:42
fultonjTengu: cool17:42
fultonjTengu: so all your ceph containers are running i take it17:43
Tenguif rados returns 401, I'd rather go for the ceph-rgw-controller-* containers I guess?17:43
Tengufultonj: yup. ceph health is happy17:43
fultonjthat's good17:43
Tengu:)17:43
openstackgerritMehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates stable/queens: Telemetry services need to access to Storage  https://review.openstack.org/56371517:44
openstackgerritMehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates stable/pike: Telemetry services need to access to Storage  https://review.openstack.org/56371617:44
openstackgerritJason E. Rist proposed openstack/tripleo-ui master: Mask Passwords and allow Copy to Clipboard  https://review.openstack.org/56203917:44
Tengurados seems to return only 200.17:44
*** anilvenkata has joined #tripleo17:45
Tenguanyway. will do that debug tomorrow with the colleagues. they have to learn :). as I'm to quit my current job next week.17:45
*** shreshtha_ has quit IRC17:45
jristew17:45
jristI may have made things worse.17:45
Tenguah ! civetweb: 0x7f48d80103a0: 10.27.102.9 - - [23/Apr/2018:17:45:18 +0000] "HEAD /swift/v1/atomic-registry HTTP/1.1" 401 0 - distribution/v2.6.2+unknown17:45
fultonjhttps://www.sebastien-han.fr/blog/2017/03/27/Debug-Ceph-Docker-containers/17:45
fultonjTengu: ^17:45
Tengufultonj: thanks !17:45
Tengujust got a 401 in my logs.17:46
fultonjsounds like you're on it's trail now17:46
honzajrist: shrinkwrap is all kinds of ewww so don't worry17:47
jristhonza: ok17:47
Tengufultonj: yup. have to find the root cause.17:47
jristhonza: it's like 20k changes17:47
jristlooks better tho17:47
*** jaosorior has joined #tripleo17:49
*** yamahata has quit IRC17:50
beaglesEmilienM: re: https://review.openstack.org/#/c/562932/ is this important enough to merge now and do a followup patch for a release note?17:53
EmilienMbeagles: afik it's a promotion blocker17:53
EmilienMykarel can confirm17:53
beaglesah I see17:53
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci master: Stop using slave_scripts/install-distro-packages.sh  https://review.openstack.org/56324417:56
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci master: Add bindep.txt file  https://review.openstack.org/56324517:56
*** jjung has joined #tripleo17:57
*** dprince has quit IRC18:00
*** khyr0n_ has quit IRC18:01
*** khyr0n_ has joined #tripleo18:02
*** trown|lunch is now known as trown18:05
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176619518:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1766195 in tripleo "Error installing fluent-plugin-kubernetes_metadata_filter at pike" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)18:10
beagleshave we run into a python-tripleoclient-heat-installer-10.0.1-0.20180423155011.465ce03.el7.centos.noarch  dependency issue on openstack-heat-agents or do I get to call "first!"?18:12
* beagles scrolls18:13
EmilienMbeagles: do recheck18:13
EmilienMbeagles: it's my bad18:13
beaglesEmilienM: k thks18:13
mwhahahatrown: what's the cmd line for quickstart.sh to just run the teardown bits?18:24
*** dprince has joined #tripleo18:25
*** noam__ has joined #tripleo18:26
*** paramite has joined #tripleo18:27
EmilienMmwhahaha: have you tried "--teardown all" ?18:27
mwhahahayea18:28
mwhahahadidn't work18:28
mwhahahacause that'd be too obvious18:28
EmilienMsshnaidm|off: ^ probably know18:28
mwhahahai recall there being another special option to just run the teardown bits and not restart a deploy18:28
EmilienMor myoung18:28
EmilienM--no-clone ?18:29
trownmwhahaha: you can --skip-tags all18:29
mwhahahathat's the one18:29
mwhahaha--skip-tags18:29
hjensasbeagles: I see it as well: http://logs.openstack.org/67/563467/5/check/tripleo-ci-centos-7-undercloud-oooq/3d7b3f0/logs/undercloud/home/zuul/install_packages.sh.log.txt.gz18:29
mwhahahaactually that didn't work either18:30
mwhahahathat just does nothing18:30
*** rbrady has joined #tripleo18:30
*** rbrady has quit IRC18:30
*** rbrady has joined #tripleo18:30
beagleshjensas: I think rechecking will do the trick18:30
hjensasbeagles: I did one already. :(18:32
beagleshjensas: I'm stalking zuul I'll let you know once one of the jobs that failed previously goes green18:33
trownmwhahaha: have to do that with --teardown all18:34
mwhahahatrown: i did18:34
trownhmm...18:34
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/diskimage-builder master: Move common ubuntu environment setting to ubuntu-common element  https://review.openstack.org/56373118:34
mwhahahatrown: http://paste.openstack.org/show/719764/18:34
*** rbrady has quit IRC18:35
*** waleedm has quit IRC18:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/diskimage-builder master: Move common ubuntu environment setting to ubuntu-common element  https://review.openstack.org/56373118:36
trownmwhahaha: hmm i wonder if that behavior changed in ansible... I thought before any tags that you specifically ask for on the cli will get run even with skip-tags=all18:37
trownmwhahaha: in any case... there is a playbook you could use instead one sec18:37
mwhahahai think i can just --tags teardown-all18:38
* mwhahaha is trying it out18:38
trownhttps://github.com/openstack/tripleo-quickstart/blob/master/playbooks/teardown.yml would also probably work18:38
mwhahahatrown: ./quickstart.sh --tags teardown-all 192.168.0.7918:41
mwhahahathat seemed to work18:41
trownoh right... nice18:41
mwhahahai'll file a bug tho18:42
mwhahahashould probably at least document it :D18:42
trownsure... I really want to dump quickstart.sh all together18:43
mwhahahawhich is fine, just need to document how to run it18:43
beaglesdammit auto-correct: I *do* mean "respin", not "resin" - although maybe it knows something I don't18:47
*** Lokesh_Jain___ has quit IRC18:50
*** leitan has quit IRC18:52
*** leitan has joined #tripleo18:53
*** jaosorior has quit IRC18:55
*** Goneri has quit IRC18:56
*** rbrady has joined #tripleo18:56
*** rbrady has quit IRC18:56
*** rbrady has joined #tripleo18:56
*** rbrady has quit IRC19:01
*** rbrady has joined #tripleo19:01
*** rbrady has joined #tripleo19:01
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add libvirt option to reproducer script  https://review.openstack.org/56331919:02
*** fragatin_ has quit IRC19:02
*** leitan has quit IRC19:04
*** rbrady has quit IRC19:04
*** amoralej is now known as amoralej|off19:06
*** agopi|lunch is now known as agopi19:07
*** rajinir has quit IRC19:08
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176619519:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1766195 in tripleo "Error installing fluent-plugin-kubernetes_metadata_filter at pike" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)19:10
*** rbrady_ has joined #tripleo19:12
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/diskimage-builder master: Remove redundant sources change/update  https://review.openstack.org/56373919:12
pabelangermwhahaha: EmilienM: https://review.openstack.org/563244/ updated to fix buildimage jobs19:15
mwhahahapabelanger: yea i rechecked my test patch, i'll review when that one comes back19:15
pabelangermwhahaha: http://logs.openstack.org/27/563627/2/check/tripleo-buildimage-overcloud-full-centos-7/f6345b2/ is the results :)19:16
pabelangerthanks for looking19:16
mwhahahak19:16
*** atoth has quit IRC19:20
myoungmwhahaha: re: teardown, are you unstuck?  was afk19:26
mwhahahayea i got it with the --tags teardown-all19:26
mwhahahai filed a bug for it19:26
mwhahahahttps://bugs.launchpad.net/tripleo/+bug/176632619:26
openstackLaunchpad bug 1766326 in tripleo "quickstart is missing how to just run the teardown actions" [Medium,Triaged]19:26
myoungmwhahaha: ack and thx19:26
*** jfrancoa has quit IRC19:29
beagleshjensas: a couple of tests went green so far - try rechecking again19:29
*** rbrady_ has quit IRC19:30
*** akrivoka has quit IRC19:31
hjensasbeagles: thanks, will do.19:32
*** yamahata has joined #tripleo19:36
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Add external DNS server to the /etc/resolv.conf  https://review.openstack.org/56282519:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/diskimage-builder master: Add ubuntu-systemd-container operating-system element  https://review.openstack.org/56374819:40
*** ssbarnea_ has quit IRC19:42
*** jfrancoa has joined #tripleo19:42
trozetmwhahaha: ping?19:44
* mwhahaha hides19:44
mwhahahatrozet: whatcha breaking today?19:44
trozetmwhahaha: haha, i think we have a problem :)19:44
mwhahahaso business as usual?19:44
mwhahahak19:44
trozetmwhahaha: rgr19:44
trozetmwhahaha: is it intended for neutron-server to be started with paste wsgi or httpd?19:44
mwhahahahttpd19:45
* mwhahaha thinks19:45
trozetmwhahaha: nova is started with httpd, i thought all services moved to that19:45
mwhahahait's supposed to19:45
trozetmwhahaha: however in this container deployment, neutron is started with paste :/19:45
mwhahahanice19:45
mwhahahaEmilienM: images are supposed to be built on t-p-e https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/to-build-or-not-to-build.yml#L919:46
trozetmwhahaha: haha so now the question is, how19:46
mwhahahatrown, myoung -^ i don't think to-build-or-not-tobuild is working naymore19:46
mwhahahatrozet: ok let me go look19:46
mwhahahatrozet: now i do remember that neutron server was really slow in the migration to httpd19:47
mwhahahatrozet: so it may be possible that it was never actually run under httpd19:48
trozetmwhahaha: is that your final answer?19:48
mwhahahatrozet: yes it's not run under httpd https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/neutron/server.pp#L14219:50
mwhahahahttps://github.com/openstack/puppet-neutron/blob/master/manifests/server.pp#L23319:50
trozetmwhahaha: congratulations, youve won a new bug :)19:51
mwhahahano, beagles has won a new bug19:51
mwhahahahttps://github.com/openstack/puppet-neutron/blob/master/manifests/params.pp#L1419:51
trozetmwhahaha: why is this then httpd??? https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/neutron-api.yaml#L12519:51
mwhahahalet me see if we override it somewhere19:51
mwhahahaso with the switch to kolla, it's controlling the service declaration19:52
mwhahahaso containers may behttpd19:52
mwhahahaand non-containers would be paste19:52
trozetmwhahaha: i dont think so because the kolla command is neutron-server: https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/neutron-api.yaml#L11319:53
trozetmwhahaha, beagles: so i guess the first question is: should neutron be using httpd?19:53
* mwhahaha shrugs19:53
mwhahahaso it looks like tls is just a proxy19:54
mwhahahaso it's not actually running it behind httpd but rather using httpd for tls proxy19:54
trozetmwhahaha: right19:55
mwhahahai thought everything was supposed wsgi after last cycle19:55
mwhahahabut that's really up to beagles & co to implement that19:55
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Increase ssh timeout after reboot in nodepool setup  https://review.openstack.org/56310219:58
* beagles reads backlog19:58
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Add post upgrade Nova operation check  https://review.openstack.org/56273820:02
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Add post upgrade Nova operation check  https://review.openstack.org/56273820:03
mwhahahatrown, myoung: do we still run the ovb-setup playbook in CI?20:05
*** liverpooler has quit IRC20:05
beagleshrmm mwhahaha, trozet, I remember conversations on that. Unfortunately I cannot recall what the deal was... I thought we backed off that because the neutron-server is also the RPC endpoint for the agents, but not sure20:08
beaglesremember -> vaguely recall20:08
mwhahahait'20:08
mwhahahait's all vaguely recall these days :D20:08
*** owalsh_afk is now known as owalsh20:08
mwhahahaIf i vaguely recall we had run into issues in ocata i thought or there wasn't actually any wsgi script20:09
trozetbeagles: would anyone else know? owalsh modified that part of the file last20:09
mwhahahabut it was a community goal20:09
beaglesright, the wsgi support is there now (has been since late 2016 I think)20:09
beaglestrozet: no idea20:09
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176619520:10
openstackLaunchpad bug 1766195 in tripleo "Error installing fluent-plugin-kubernetes_metadata_filter at pike" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)20:10
*** ooolpbot has quit IRC20:10
trozetbeagles: i thought the switch to httpd was for performance improvement right?20:10
beaglesI was thinking maybe jaosorior would remember20:10
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Add post upgrade Nova operation check  https://review.openstack.org/56273820:11
beaglestrozet: something like that ...20:11
beaglestrozet: or simply consistency with those types of APIs20:13
trozetbeagles: so I put a needinfo on Juan20:13
trozetbeagles: I guess let's see what he says20:13
* beagles reflects this is exactly one of those times a comment in a file would be a good thing20:15
*** avivgt has quit IRC20:15
beaglestrozet: what's kind of funny is that the move to containers means we now run all of those extra instances of httpd20:20
mwhahahaSHHHHH STOP POINTING OUT HOW TERRIBLE CONTAINERS ARE20:20
beagleslol20:21
slagleyea containers are great. we don't have to worry about package deps anymore20:21
mwhahahayea i found the extra instances of httpd the other week20:21
trozetbeagles: lol i know, such isolation20:21
trozetbeagles: much surprise20:22
beagles"so we found this critical bug in apache..."20:22
beagles"you must patch all running instances immediately..."20:22
* mwhahaha gives beagles a heartbleed20:22
beagleslol20:22
*** leitan has joined #tripleo20:24
trozetlets run the container with no cgroups, privelege mode, and networking attached to host20:24
*** leitan has quit IRC20:24
trozetbut its so isolated...20:24
trozetsorry i'll stop20:24
beagleshehe20:25
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Set CephAnsibleVerbosity during upgrade  https://review.openstack.org/56375520:30
*** dprince has quit IRC20:32
*** paramite has quit IRC20:33
pabelangerEmilienM: mwhahaha: https://review.openstack.org/563245/ and https://review.openstack.org/563244/ are now great, if you don't mind a +320:37
*** dougbtv_ has joined #tripleo20:37
*** dougbtv has quit IRC20:40
mwhahahaso pushy20:41
openstackgerritJose Luis Franco proposed openstack/tripleo-common stable/queens: Remove version section in overcloud_keystone_url.  https://review.openstack.org/56359820:41
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Expose params to enable panko expirer cron  https://review.openstack.org/56321220:41
mwhahahawe'll want to wait for rdo cloud to report20:41
mwhahahait's running now, should be ok in a bit20:41
*** jfrancoa has quit IRC20:42
*** ansmith has quit IRC20:43
*** jtomasek has quit IRC20:43
*** rajinir has joined #tripleo20:45
openstackgerritMerged openstack/tripleo-heat-templates master: Telemetry services need to access to Storage  https://review.openstack.org/56350420:48
openstackgerritMerged openstack/puppet-tripleo master: Firewall: NOT persist ephemetal ironic-inspector rules  https://review.openstack.org/56346120:48
openstackgerritMerged openstack/tripleo-heat-templates master: Add neutron-plugin-ml2 to the scenario007  https://review.openstack.org/56360420:48
*** sai_p has joined #tripleo20:49
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Fix changes regex  https://review.openstack.org/56376020:57
mwhahahaEmilienM, slagle, trown: I found why we only built sometimes for things like tripleo-puppet-elements -^20:57
bandinimwhahaha: https://review.openstack.org/#/c/563644/ if you have a sec, please ;)20:57
mwhahahak20:58
*** Goneri has joined #tripleo21:00
*** dougbtv__ has joined #tripleo21:01
*** trown is now known as trown|outtypewww21:02
*** avivgt has joined #tripleo21:03
*** dougbtv_ has quit IRC21:03
*** lblanchard has quit IRC21:06
*** pchavva has quit IRC21:06
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: WIP: Disable cloud-init  https://review.openstack.org/56376321:07
*** artom has quit IRC21:08
*** leitan has joined #tripleo21:09
*** fragatina has joined #tripleo21:09
*** fragatina has quit IRC21:10
*** fragatina has joined #tripleo21:11
*** ooolpbot has joined #tripleo21:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176619521:11
openstackLaunchpad bug 1766195 in tripleo "Error installing fluent-plugin-kubernetes_metadata_filter at pike" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)21:11
*** ooolpbot has quit IRC21:11
*** dbecker has quit IRC21:12
openstackgerritMerged openstack/puppet-pacemaker master: Move the tests around so pcmk_resource_has_changed? does not get triggered  https://review.openstack.org/56364421:15
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - heat: align config with instack-undercloud  https://review.openstack.org/55835421:15
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Revert "Revert "Deploy container-multinode (fs010) with a containerized undercloud""  https://review.openstack.org/56026421:16
openstackgerritAlex Schultz proposed openstack-infra/tripleo-ci master: Update undercloud install directories  https://review.openstack.org/56376921:21
openstackgerritAlex Schultz proposed openstack-infra/tripleo-ci master: Remove old directories  https://review.openstack.org/56377021:21
*** abishop has quit IRC21:21
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Save temporary working data  https://review.openstack.org/56057821:21
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Enable cleanup by default for undercloud install  https://review.openstack.org/56203221:21
openstackgerritEmilien Macchi proposed openstack/tripleo-upgrade master: undercloud: workaround for containers  https://review.openstack.org/56377221:23
*** avivgt has quit IRC21:24
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Introduce tripleo-ci-centos-7-containerized-undercloud-upgrades  https://review.openstack.org/55363321:24
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Introduce tripleo-ci-centos-7-containerized-undercloud-upgrades  https://review.openstack.org/55363321:24
*** paramite has joined #tripleo21:27
*** dparkes has joined #tripleo21:33
*** cdearborn has quit IRC21:34
*** ansmith has joined #tripleo21:35
*** rmascena__ has joined #tripleo21:38
*** rmascena has quit IRC21:40
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates stable/queens: Telemetry services need to access to Storage  https://review.openstack.org/56371521:41
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Removing the deprecated environment files for hw offloading in containers  https://review.openstack.org/55972321:41
openstackgerritAlex Schultz proposed openstack-infra/tripleo-ci master: Don't cleanup undercloud  https://review.openstack.org/56377721:42
*** slaweq has quit IRC21:45
*** slaweq has joined #tripleo21:46
*** slaweq has quit IRC21:52
*** mcornea has quit IRC21:52
*** b00tcat_ has quit IRC21:53
*** noam__ has quit IRC21:53
*** florianf has quit IRC21:55
*** anilvenkata has quit IRC21:56
*** paramite has quit IRC21:59
*** vpickard is now known as vpickard_22:00
*** Goneri has quit IRC22:07
*** leitan has quit IRC22:08
*** jrist has quit IRC22:08
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176619522:10
openstackLaunchpad bug 1766195 in tripleo "Error installing fluent-plugin-kubernetes_metadata_filter at pike" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)22:10
*** ooolpbot has quit IRC22:10
*** jrist has joined #tripleo22:12
*** jrist has joined #tripleo22:12
*** dhill_ has quit IRC22:14
*** ipsecguy_ has joined #tripleo22:14
*** dhill_ has joined #tripleo22:16
*** ipsecguy has quit IRC22:17
*** leitan has joined #tripleo22:23
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Enable cleanup by default for undercloud install  https://review.openstack.org/56203222:28
*** rcernin has joined #tripleo22:31
*** dhill_ has quit IRC22:34
*** khyr0n_ has quit IRC22:34
*** rpioso is now known as rpioso|afk22:38
*** threestrands has joined #tripleo22:41
*** threestrands has quit IRC22:41
*** threestrands has joined #tripleo22:41
*** dhill_ has joined #tripleo22:43
owalshtrozet: don't blame me, I just fixed the borked logging :-)22:44
*** zshi has quit IRC22:53
*** dhill_ has quit IRC22:54
*** rh-jelabarre has quit IRC22:57
*** dhill_ has joined #tripleo23:00
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates stable/newton: Explicitly set nova/neutron/ceilometer host to expected fqdn  https://review.openstack.org/56365023:00
*** lblanchard has joined #tripleo23:03
*** zshi has joined #tripleo23:07
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176619523:10
openstackLaunchpad bug 1766195 in tripleo "Error installing fluent-plugin-kubernetes_metadata_filter at pike" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)23:10
*** ooolpbot has quit IRC23:10
*** thrash is now known as thrash|g0ne23:13
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Fix nova-placement healthcheck  https://review.openstack.org/56379123:25
*** dhill_ has quit IRC23:38
*** leitan has quit IRC23:41
openstackgerritMerged openstack/tripleo-common stable/queens: Only update plan on upgrade converge  https://review.openstack.org/56351023:42
hjensasEmilienM: mwhahaha: if can look at https://review.openstack.org/563467 for https://bugs.launchpad.net/tripleo/+bug/176570023:43
openstackLaunchpad bug 1765700 in tripleo "Undercloud: pike -> queens upgrade break introspection" [High,In progress] - Assigned to Harald Jensås (harald-jensas)23:43
*** zshi has quit IRC23:45
*** dhill_ has joined #tripleo23:45
openstackgerritHarald Jensås proposed openstack/puppet-tripleo stable/queens: Firewall: NOT persist ephemetal ironic-inspector rules  https://review.openstack.org/56358023:45
EmilienMhjensas: sure thing23:46
openstackgerritHarald Jensås proposed openstack/instack-undercloud stable/queens: Masquerading, do not persist ephemeral firewall rules  https://review.openstack.org/56358123:48
hjensasEmilienM: thanks. - Hope I got the commit id correct on the cherry picks.23:49
*** dhill_ has quit IRC23:53
*** artom has joined #tripleo23:53
*** tosky has quit IRC23:54
EmilienMhjensas: if you used -x option, it's all good23:57
*** zshi has joined #tripleo23:58
*** leitan has joined #tripleo23:59
openstackgerritGabriele Cerami proposed openstack/tripleo-upgrade master: Add timestamps to all log files  https://review.openstack.org/56191123:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!