Friday, 2018-04-27

*** slaweq has joined #tripleo00:01
*** florianf has joined #tripleo00:01
*** slaweq has quit IRC00:06
*** florianf has quit IRC00:08
*** rlandy has quit IRC00:08
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176688400:10
openstackLaunchpad bug 1766884 in tripleo "Gate jobs are failing in different ways related to network issues" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176704900:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1767049 in tripleo "Error during test discovery : 'must specify exactly one of host or intercept'" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)00:10
*** liverpooler has joined #tripleo00:11
*** khyr0n has quit IRC00:24
*** dhill_ has quit IRC00:29
*** dhill_ has joined #tripleo00:36
*** masco has joined #tripleo00:43
*** thrash is now known as thrash|g0ne00:43
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: DNM - clone ansible-role-container-registry  https://review.openstack.org/56209000:52
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: DNM - clone ansible-role-container-registry  https://review.openstack.org/56209000:52
*** tzumainn has quit IRC00:57
*** wolverineav has joined #tripleo01:02
*** psachin has joined #tripleo01:02
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176688401:10
openstackLaunchpad bug 1766884 in tripleo "Gate jobs are failing in different ways related to network issues" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176704901:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1767049 in tripleo "Error during test discovery : 'must specify exactly one of host or intercept'" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)01:10
*** wolverineav has quit IRC01:10
*** michchap has quit IRC01:15
openstackgerritMerged openstack/puppet-tripleo stable/newton: firewall: add IPv6 support  https://review.openstack.org/56425001:16
*** agopi|zzz has joined #tripleo01:19
*** michchap has joined #tripleo01:28
*** pmannidi has quit IRC01:29
*** liverpooler has quit IRC01:30
*** pmannidi has joined #tripleo01:30
*** moshele has joined #tripleo01:34
*** jcoufal has quit IRC01:51
*** hamzy has joined #tripleo02:00
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Deploy Docker via Ansible and not Puppet  https://review.openstack.org/56137702:00
*** slaweq has joined #tripleo02:02
*** slaweq has quit IRC02:06
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Add volumes list of docker-puppet container when merging config volumes  https://review.openstack.org/56438402:08
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Modify libvirt port range for live-migration  https://review.openstack.org/56417102:09
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Modify libvirt port range for live-migration  https://review.openstack.org/56417202:09
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Modify libvirt port range for live-migration  https://review.openstack.org/56417502:09
openstackgerritMerged openstack/tripleo-upgrade stable/queens: Adhere to ANSIBLE0011 All tasks should be named.  https://review.openstack.org/56443802:09
openstackgerritMerged openstack/tripleo-upgrade master: Add post upgrade Nova operation check  https://review.openstack.org/56273802:09
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176688402:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176704902:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1766884 in tripleo "Gate jobs are failing in different ways related to network issues" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)02:10
openstackLaunchpad bug 1767049 in tripleo "Error during test discovery : 'must specify exactly one of host or intercept'" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)02:10
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade stable/queens: Add post upgrade Nova operation check  https://review.openstack.org/56466002:17
*** moshele has quit IRC02:18
*** hamzy has quit IRC02:29
*** karthiks has quit IRC02:30
*** tzumainn has joined #tripleo02:35
*** hamzy has joined #tripleo02:36
*** karthiks has joined #tripleo02:43
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Save temporary working data  https://review.openstack.org/56057802:48
*** gkadam has joined #tripleo02:51
openstackgerritzenghui.shi proposed openstack/os-net-config stable/queens: ifcfg: don't restart ovs if --no-activate is specified  https://review.openstack.org/56466102:57
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Enable cleanup by default for undercloud install  https://review.openstack.org/56203202:57
*** gkadam has quit IRC02:58
openstackgerritzenghui.shi proposed openstack/os-net-config stable/pike: ifcfg: don't restart ovs if --no-activate is specified  https://review.openstack.org/56466202:58
openstackgerritzenghui.shi proposed openstack/os-net-config stable/ocata: ifcfg: don't restart ovs if --no-activate is specified  https://review.openstack.org/56466302:59
*** gkadam has joined #tripleo03:01
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176688403:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176704903:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1766884 in tripleo "Gate jobs are failing in different ways related to network issues" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)03:10
openstackLaunchpad bug 1767049 in tripleo "Error during test discovery : 'must specify exactly one of host or intercept'" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)03:10
*** dhill_ has quit IRC03:13
*** rajinir has quit IRC03:21
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Save temporary working data  https://review.openstack.org/56057803:28
*** dhill_ has joined #tripleo03:33
*** ykarel|away has joined #tripleo03:38
*** ramishra has joined #tripleo03:42
*** ykarel|away has quit IRC03:57
*** slaweq has joined #tripleo04:03
*** fragatina has quit IRC04:04
*** fragatina has joined #tripleo04:04
*** dhill_ has quit IRC04:06
*** slaweq has quit IRC04:08
*** fragatina has quit IRC04:08
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176688404:10
openstackLaunchpad bug 1766884 in tripleo "Gate jobs are failing in different ways related to network issues" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176704904:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1767049 in tripleo "Error during test discovery : 'must specify exactly one of host or intercept'" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)04:10
*** shreshtha_ has joined #tripleo04:15
*** holser__ has joined #tripleo04:17
*** tzumainn has quit IRC04:18
*** dhill_ has joined #tripleo04:20
*** holser__ has quit IRC04:22
*** fragatina has joined #tripleo04:29
*** mpjetta has quit IRC04:29
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Create generic deployment action  https://review.openstack.org/56467104:31
*** gvrangan has joined #tripleo04:35
*** skramaja has joined #tripleo04:36
*** jaganathan has joined #tripleo04:39
*** jaganathan has quit IRC04:40
*** jaganathan has joined #tripleo04:40
*** janki has joined #tripleo04:43
*** marios has joined #tripleo04:44
*** janki has quit IRC04:44
*** janki has joined #tripleo04:45
*** janki has quit IRC04:45
*** janki has joined #tripleo04:46
*** ykarel|away has joined #tripleo04:47
*** ykarel|away is now known as ykarel04:48
*** dhill_ has quit IRC04:51
*** gvrangan has quit IRC04:54
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Remove unused undercloud_public_net_name var  https://review.openstack.org/56467504:56
*** ohochman has quit IRC04:59
openstackgerritSagi Shnaidman proposed openstack/tripleo-upgrade master: Fix linters in role and make them fit oooq rules  https://review.openstack.org/56457405:01
*** links has joined #tripleo05:04
*** hanish has joined #tripleo05:04
*** dhill_ has joined #tripleo05:07
*** links has quit IRC05:08
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176688405:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176704905:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1766884 in tripleo "Gate jobs are failing in different ways related to network issues" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)05:10
openstackLaunchpad bug 1767049 in tripleo "Error during test discovery : 'must specify exactly one of host or intercept'" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)05:10
*** mpjetta has joined #tripleo05:10
*** pdeore has joined #tripleo05:10
*** jchhatbar has joined #tripleo05:11
*** janki has quit IRC05:13
*** links has joined #tripleo05:13
openstackgerritPranali Deore proposed openstack/tripleo-heat-templates stable/pike: Add support of netapp configuration for glance in THT  https://review.openstack.org/56398905:14
*** karthiks has quit IRC05:16
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: [WIP] Added validate-tempest vars descriptions  https://review.openstack.org/56467705:20
*** fragatina has quit IRC05:21
*** gvrangan has joined #tripleo05:23
*** pgadiya has joined #tripleo05:26
*** karthiks has joined #tripleo05:28
*** ratailor has joined #tripleo05:28
*** quiquell|off is now known as quiquell|rover05:31
*** gvrangan has quit IRC05:33
*** dhill_ has quit IRC05:37
*** dhill_ has joined #tripleo05:43
*** agopi|zzz has quit IRC05:44
*** udesale_ has joined #tripleo05:44
*** udesale_ has quit IRC05:44
*** jfrancoa has joined #tripleo05:48
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Keep plan-environment only on upgrade  https://review.openstack.org/56450805:49
*** jfrancoa has quit IRC05:50
*** zshi has quit IRC05:57
*** masco has quit IRC06:00
*** jfrancoa has joined #tripleo06:01
*** matbu has quit IRC06:03
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176688406:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176704906:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1766884 in tripleo "Gate jobs are failing in different ways related to network issues" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)06:10
openstackLaunchpad bug 1767049 in tripleo "Error during test discovery : 'must specify exactly one of host or intercept'" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)06:10
*** marios has quit IRC06:16
*** marios has joined #tripleo06:17
*** saneax-_-|AFK is now known as saneax06:21
*** dciabrin has quit IRC06:21
*** moshele has joined #tripleo06:21
*** pcaruana has joined #tripleo06:33
*** dparkes has joined #tripleo06:34
*** dciabrin has joined #tripleo06:34
*** moshele has quit IRC06:36
*** holser__ has joined #tripleo06:37
*** kmy has joined #tripleo06:37
*** holser__ has quit IRC06:39
pdeorecould someone review https://review.openstack.org/#/c/562930/ please?06:39
*** holser__ has joined #tripleo06:40
*** holser__ has quit IRC06:41
weshayykarel, quiquell|rover https://review.rdoproject.org/r/#/c/13571/06:42
*** nmathew has joined #tripleo06:42
ykarelweshay, +106:43
weshayquiquell|rover, ok.. clear to run the promote for master06:43
*** nmathew has quit IRC06:43
*** kmy has quit IRC06:43
quiquell|roverweshay: ack06:44
*** fpan has quit IRC06:45
*** fpan has joined #tripleo06:45
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Improved validate-tempest role README documentation  https://review.openstack.org/56467706:48
*** quiquell|rover is now known as quique|rover|afk06:49
*** masco has joined #tripleo06:50
*** pcaruana has quit IRC06:50
*** slaweq has joined #tripleo06:52
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Ensure config-download mappings are unset on ceph-upgrade  https://review.openstack.org/56468606:54
*** yolanda__ is now known as yolanda06:59
*** pcaruana has joined #tripleo07:06
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176688407:10
openstackLaunchpad bug 1766884 in tripleo "Gate jobs are failing in different ways related to network issues" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176704907:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1767049 in tripleo "Error during test discovery : 'must specify exactly one of host or intercept'" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)07:10
*** pmannidi has quit IRC07:10
*** ffiore has joined #tripleo07:11
*** zshi has joined #tripleo07:15
*** jtomasek has joined #tripleo07:15
*** ccamacho has quit IRC07:17
*** rcernin has quit IRC07:17
*** ccamacho has joined #tripleo07:18
*** kopecmartin has joined #tripleo07:21
*** jaosorior has joined #tripleo07:21
*** tesseract has joined #tripleo07:27
*** saneax is now known as saneax-_-|AFK07:31
*** yprokule has joined #tripleo07:31
*** quique|rover|afk is now known as quiquell|rover07:40
*** holser__ has joined #tripleo07:40
*** moshele has joined #tripleo07:41
*** kopecmartin has quit IRC07:43
*** gkadam has quit IRC07:43
*** holser__ has quit IRC07:44
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: DNM: Setting the kernel override option to false  https://review.openstack.org/56011207:45
*** holser__ has joined #tripleo07:45
*** hanish has quit IRC07:45
*** ssbarnea_ has joined #tripleo07:45
*** bogdando has joined #tripleo07:47
*** ykarel is now known as ykarel|away07:47
openstackgerritJaganathan Palanisamy proposed openstack/python-tripleoclient stable/queens: Composable role and service fails workflow  https://review.openstack.org/56469207:49
*** jpena|off is now known as jpena07:52
*** amoralej|off is now known as amoralej07:52
*** tesseract has quit IRC07:53
*** chem has joined #tripleo07:55
*** tesseract has joined #tripleo07:56
*** lucas-afk is now known as lucasagomes07:58
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/ocata: GATE CHECK for TripleO  https://review.openstack.org/56429108:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO  https://review.openstack.org/56428508:00
openstackgerritMerged openstack/python-tripleoclient master: Remove commented cidr nat rules code  https://review.openstack.org/56452108:04
*** gkadam has joined #tripleo08:07
openstackgerritQuique Llorente proposed openstack/tripleo-common master: DNM: Put IPA images as selinux-permissive  https://review.openstack.org/56469708:07
jaosoriorjistr: if you have some time, could you check these out https://review.openstack.org/#/q/topic:public-tls-default+status:open ?08:09
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176688408:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176704908:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1766884 in tripleo "Gate jobs are failing in different ways related to network issues" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)08:10
openstackLaunchpad bug 1767049 in tripleo "Error during test discovery : 'must specify exactly one of host or intercept'" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)08:10
*** tosky has joined #tripleo08:10
jaosoriorthe next one would be this one https://review.openstack.org/#/c/559926/ then https://review.openstack.org/#/c/564518/ ... and for the rest the order is not that relevant08:10
openstackgerritwaleed mousa proposed openstack/puppet-tripleo master: Adding support for VF LAG in SR-IOV  https://review.openstack.org/55841108:11
*** moshele has quit IRC08:11
bogdandoo/ PTAL https://review.openstack.org/#/c/563589 folks08:12
openstackgerritMerged openstack/tripleo-heat-templates master: Switch to config-download by default  https://review.openstack.org/55892708:14
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Explicitly set nova/neutron/ceilometer host to expected fqdn  https://review.openstack.org/55531708:14
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Fix Cinder's default db purge cron settings  https://review.openstack.org/56402908:14
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates stable/queens: Removing the deprecated environment files for hw offloading in queens  https://review.openstack.org/56442608:15
openstackgerritCarlos Camacho proposed openstack/tripleo-validations stable/pike: Validate that there should not be XFS volumes with ftype=0  https://review.openstack.org/56469808:19
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Exclude nodes deployed with another deployment plan  https://review.openstack.org/56364608:19
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Add sanitizeMessage function  https://review.openstack.org/56450208:19
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Add deployment status tracking infrastructure  https://review.openstack.org/55902108:19
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Enable config-download deployment tracking  https://review.openstack.org/55902208:19
*** artom has quit IRC08:20
*** artom has joined #tripleo08:20
*** artom has quit IRC08:20
*** artom has joined #tripleo08:21
openstackgerritMerged openstack/tripleo-puppet-elements master: Add keepalived back  https://review.openstack.org/56453108:21
bogdandoPTAL https://review.openstack.org/#/c/562299/08:25
bogdandoneeded for https://review.openstack.org/#/c/561192/308:26
*** srini has joined #tripleo08:26
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Add CephMgr service to custom roles_data file.  https://review.openstack.org/56470108:29
bogdandojaosorior: hi, please also https://review.openstack.org/#/c/562299/ :)08:31
*** saneax-_-|AFK is now known as saneax08:35
*** mandre is now known as mandre_afk08:39
*** derekh has joined #tripleo08:40
*** shardy has joined #tripleo08:41
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Add CephMgr service to custom roles_data file.  https://review.openstack.org/56470108:42
*** shardy has quit IRC08:42
*** shardy has joined #tripleo08:42
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Store UC hosts/portmaps heat params in output_dir  https://review.openstack.org/56413508:45
openstackgerritMichele Baldessari proposed openstack/paunch master: WIP enable tty by default  https://review.openstack.org/56470308:48
*** kopecmartin has joined #tripleo08:48
*** dparkes has quit IRC08:51
openstackgerritMerged openstack/tripleo-docs master: Docs: Enrich integration with ironic networking features  https://review.openstack.org/56086808:53
*** dtantsur|afk is now known as dtantsur08:55
*** pcaruana has quit IRC08:56
*** dparkes has joined #tripleo08:57
*** florianf has joined #tripleo08:57
dtantsurhi folks, looking for the final +A on https://review.openstack.org/#/c/529342/09:02
dtantsurbogdando or jaosorior maybe ^^^09:02
*** shardy has quit IRC09:07
*** pcaruana has joined #tripleo09:07
openstackgerritDerek Higgins proposed openstack/tripleo-heat-templates master: Download IPA kernel and ramdisk  https://review.openstack.org/56307209:08
dtantsurbogdando: fwiw this code was mostly copied from another place. also could you please show me example of post deploy tasks doing something like that?09:09
bogdandodtantsur: http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/extraconfig/post_deploy/undercloud_post.sh09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176688409:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1766884 in tripleo "Gate jobs are failing in different ways related to network issues" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)09:10
dtantsurbogdando: doing it there was shot down by slagle and mwhahaha. next idea?09:10
dtantsurbogdando: also not sure why you say it won't work, while it does work in the containerized undercloud CI09:10
owalshjaosorior: re TLS by default... I guess this means that DNS records are now required09:11
dtantsurbogdando: also undercloud_post is for the undercloud, what about overcloud?09:13
therveEmilienM: Well yeah resource exhaustion09:13
*** leanderthal has joined #tripleo09:15
*** paramite has joined #tripleo09:18
bogdandodtantsur: updated https://etherpad.openstack.org/p/tripleo-inspector-containers with an algorithm09:21
bogdandothere is no undercloud/overcloud semantics, but only consumer/distributor09:21
*** florianf has quit IRC09:21
*** panda|ruck|off is now known as panda|ruck09:21
dtantsurbogdando: let's not play with words, we have a very specific problem at hand: you're talking about fetching something from swift without having any swift installed09:25
bogdandofor that case, you're distributor and have to upload things09:25
bogdandoand if nothing to upload - no dirs/files, fail the task09:26
dtantsurme = who? upload = where? at which stage?09:26
bogdandoplease read the steps in the etherpad09:26
dtantsurI did09:26
pdeoreGuys, can someone review https://review.openstack.org/#/c/562930/ please? it's a blocker for queens :/09:26
dtantsurplease remove all "ifs", we have two very specific situations: OC and UC09:27
bogdandothat's that I prospose09:27
dtantsuralso with all this consumer/distributor split, you're facing the same argument as with solution #1: different code paths for UC and OC09:27
bogdandoI do not have an option for uc vs oc logic09:27
dtantsurthen why not just use solution #1?09:28
bogdandoyeah, this is to be figured out09:28
bogdandoprolly, fetching attempts should be done as you proposed, the deploy time09:28
bogdandoin init steps for containers09:28
bogdandoand only distribution - as post deploy09:28
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart master: Tag "Add the virthost to the inventory" as teardown-  https://review.openstack.org/56471209:28
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart master: Tag "Add the virthost to the inventory" as teardown-  https://review.openstack.org/56471209:29
*** zoli is now known as zoli|lunch09:29
*** colonwq has quit IRC09:30
dtantsurbogdando: also please answer questions above re direct deploy09:30
bogdandodtantsur: that's a very high level yet :)09:31
bogdandodtantsur: hm, I think you're right and I described the case 1, but added a post deploy task to distribute09:33
*** anilvenkata has joined #tripleo09:33
*** dmacpher has joined #tripleo09:34
*** leanderthal has quit IRC09:36
*** leanderthal has joined #tripleo09:38
bogdandodtantsur: please do rework my proposal, we'll have hard time transform it inline09:38
bogdandoyou can take the #1 and add a post deploy task for distribution09:39
dtantsurbogdando: I think if I rework the proposal, I'll end up with solution #1 :)09:39
bogdandoindeed09:39
bogdandothat's that I ask for :)09:39
dtantsurI cannot get why we need this distribution, maybe I'm missing something?09:39
bogdandojust add a post deploy task09:39
bogdandoundercloud post deploy should distribute it09:39
dtantsurokay, maybe I get it09:40
bogdandoovercloud deploy tasks to fetch it via given creds and endpoints09:40
bogdandoso as there is yet overcloud endpoints the undercloud post step, we'' have to pass UC creds and endpoints for overcloud steps heat data09:40
dtantsurbogdando: so, I've updated solution #1, what am I missing there?09:41
bogdandofor undercloud only case, let's just duplicate fetching logic in post deploy as well09:41
bogdandoand make it optional, based on passed heat params09:41
dtantsurso, you're telling me "how" to do something in post deploy, I cannot get "why"09:41
bogdandoI'm not sure how to explain it better :)09:41
dtantsurbogdando: let's do the other way around: I claim the solution #1 covers all cases. which case am I missing?09:42
*** gfidente has joined #tripleo09:42
*** gfidente has quit IRC09:42
*** gfidente has joined #tripleo09:42
*** colonwq has joined #tripleo09:42
bogdandodtantsur: let's just make a prototype09:43
bogdandoand see how it works09:43
dtantsurbogdando: I can help with that, as soon as somebody helps me resolve the situation around https://review.openstack.org/52934209:43
anilvenkataskramaja, dalvarez lucasagomes pep8 failure http://logs.openstack.org/25/564425/2/check/openstack-tox-pep8/7cb1416/job-output.txt.gz#_2018-04-26_10_54_14_70479509:43
dtantsurwhich has been around for half a year and rewritten already twice from scratch09:43
* lucasagomes looks09:43
anilvenkataskramaja, dalvarez lucasagomes it is not allowing that definition09:44
dtantsurwow, a wild lucasagomes!09:44
dalvarezhey09:44
lucasagomesdtantsur, lol hey man09:44
anilvenkataskramaja, dalvarez lucasagomes let me hard code geneve type i.e go back to previous patchset :)09:44
dtantsurlucasagomes: how's going? what are you doing in this channel, poor soul? :D09:44
dalvarezanilvenkata: ohhhhh ok :( haha i liked the approach09:44
anilvenkatadalvarez, thanks09:45
lucasagomesdtantsur, haha all is well, how it's going there ? Man, blame it on anilvenkata he has summered me here09:45
skramajaanilvenkata: PARAMETER_DEFINITION_EXCLUSIONS in https://github.com/openstack/tripleo-heat-templates/blob/master/tools/yaml-validate.py#L7109:45
anilvenkatalucasagomes, :)09:45
* dtantsur blames anilvenkata09:45
dtantsurlucasagomes: as you see, integrating stuff in tripleo, close to flipping tables and leaving :D09:45
dalvarezanilvenkata: can't we use skramaja's approach there?09:46
skramajaanilvenkata:  this is a temprovary workaround till ovn gets it fixed, we add it to the exclusing with comment reference to bz.09:46
dalvarezah yeah ok09:46
lucasagomesdtantsur, I've been eating some popcorn while watching that ML thread about enabling cleaning by default btw09:46
anilvenkataskramaja, dalvarez so I will hard code for time being09:46
dtantsurlucasagomes: oh man.. I still have to answer something about instance deletion being non-destructive09:47
skramajaanilvenkata: i would suggeste you to try the PARAMETER_DEFINITION_EXCLUSIONS approach first. if does not work, then we can hardcode it. the only problem with hardcoding is user will never come to know even thought he parameter exisits, it will not be used.09:48
*** akrivoka has joined #tripleo09:48
anilvenkataskramaja, thanks, I will try then09:48
*** ansiwen[q] has quit IRC09:48
anilvenkataanilvenkata, pep8 succesful in local environment with your suggestion09:53
anilvenkataskramaja, ^09:53
anilvenkataskramaja, I will push new patchset09:53
anilvenkataskramaja, thanks Saravanan09:53
dalvarezyeah +1 to skramaja's suggestion!09:54
skramajaanilvenkata: add a comment that it is temprovary and to be removed, probably associated bug or bz.09:54
anilvenkataskramaja, sure09:55
skramajathanks09:55
dalvarezskramaja: another question on my side :) We'd like to disable dvr api extension for tempest... [network-feature-enabled] api_extensions = dvr09:55
dalvarezskramaja: anilvenkata ajo where do we do this in TripleO?09:55
dalvarezi would like to remove that one from the api_extensions09:55
anilvenkatadalvarez, did u check with numans ?09:56
jaosoriorowalsh: yes09:56
dalvarezanilvenkata: no, numans ^ :? :)09:56
anilvenkatadalvarez, he is our ovn tripleo local expert :) if not then we will go to skramaja :)09:57
anilvenkatadalvarez, numans ^09:57
dalvarezanilvenkata: heh true :) i see it's exposed here http://git.openstack.org/cgit/openstack/puppet-tempest/tree/manifests/init.pp09:57
anilvenkatadalvarez, u also became our ovn tripleo expert now :)09:57
anilvenkatadalvarez++09:57
dalvarezhaha well... :D09:57
dalvarezbut thanks09:58
jaosoriorbogdando: saw your message too late09:58
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Ensure config-download mappings are unset on ceph-upgrade  https://review.openstack.org/56468609:58
jaosoriorowalsh: regarding the CloudDomain thing... well... folks can actually work with using localdomain, and we can issue self-signed certs for that10:01
owalshjaosorior: but putting DNS records in a localdomain zone?10:01
jaosoriorowalsh: so, by default we do rely on /etc/hosts ... so no real DNS...10:02
owalshjaosorior: yea, but for the public endpoint?10:03
jaosoriorowalsh: yeah, I know it sucks10:03
jaosoriorowalsh: ... but yeah, one option is to remove the default, and force folks to specify a domain for their clouds10:04
owalshjaosorior: yup, stops people shooting themselves in the foot, without at least pausing to consider it :-)10:04
jaosoriorowalsh: I just wanted to make it easier for everyone, and if they weren't already setting their DNS, nor TLS... well, at least this would have gotten them one step in the right direction10:04
jaosoriorowalsh: OK, lets give it a try10:05
dtantsurbogdando: wdyt about derekh's patch https://review.openstack.org/#/c/563072/ btw? it's another approach10:05
owalshjaosorior: I think oooq always set it, so CI will be happy I expcet10:05
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: Add vxlan port to the multinodes security group  https://review.openstack.org/56447510:05
*** shardy has joined #tripleo10:06
*** shardy has quit IRC10:06
derekhdtantsur: bogdando it works for the overcloud, we could use it as is on the undercloud or add something to turn it into a noop10:06
owalshjaosorior: but in general I think we need to figure out a process for changing domains on an existing deployment, however horrible that may be10:07
numansanilvenkata, dalvarez yo10:07
bogdandonice10:07
skramajadalvarez: anilvenkata i am not ware of the tempset configuration in tht. maybe chandankumar can help with tempest.10:07
anilvenkatanumans, skramaja dalvarez daniel himself figured out10:07
jaosoriorowalsh: note that folks can still use deployments with IPs and no TLS10:07
skramajanice!10:07
*** shardy has joined #tripleo10:08
numansdalvarez, probably here - https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset030.yml#L3910:08
dalvareznumans: yeah but that's for oooq10:08
dalvareznumans: for example in packstack it's done here: http://git.openstack.org/cgit/openstack/packstack/tree/packstack/puppet/modules/packstack/manifests/provision/tempest.pp#n10110:08
numansdalvarez, ok. i thought you want to disable for fset03010:09
owalshjaosorior: ack10:09
dalvareznumans: yeah maybe that too10:09
dalvareznumans: for some reason i think those are skipped .. :?10:10
openstackgerritvenkata anil proposed openstack/tripleo-heat-templates master: Restrict tenant network to geneve  https://review.openstack.org/56442510:10
dalvarezcause otherwise they'd fail10:10
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Switch public endpoints to use FQDNs by default  https://review.openstack.org/55992610:10
*** ooolpbot has joined #tripleo10:10
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add EnablePublicTLS flag  https://review.openstack.org/56451810:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176688410:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1766884 in tripleo "Gate jobs are failing in different ways related to network issues" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)10:10
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Change default endpoint map entries to use TLS  https://review.openstack.org/55842410:10
owalshjaosorior: guess we'll need a disable-tls environment10:10
jaosoriorowalsh: done ^^10:10
jaosoriorowalsh: it exists10:10
jaosoriorowalsh: check https://review.openstack.org/#/c/564518/10:10
numansdalvarez, for fset030 ovn job, we only run one test - https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset030.yml#L4410:10
owalshjaosorior: ah, haven't gotten that far yet :-)10:10
dalvareztrue10:11
jchhatbarHi. Can I get some reviews for this plz https://review.openstack.org/#/c/563819/10:11
jaosoriorowalsh: thanks for going through them10:11
jaosoriorowalsh: also for not letting me be too lenient. Your suggestion is taking us in the right direction. And we shouldn't have let folks use localdomain in their public endpoints in the first place.10:12
quiquell|roverIn case someone finds vxlan ping timeouts at overcloud deploy10:12
quiquell|roverhttps://review.openstack.org/#/c/564475/10:12
quiquell|roverWe found at a promoter, it needs a +210:12
openstackgerritvenkata anil proposed openstack/tripleo-heat-templates stable/queens: Add OVNCMSOptions in dvr environment files  https://review.openstack.org/56472010:13
owalshjaosorior: yea, been trying to unravel some host/fqdn issues with chem recently :-)10:13
*** dtantsur is now known as dtantsur|brb10:13
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add health check script for Sahara API  https://review.openstack.org/56472110:13
owalshjaosorior: CloudDomain also set in puppet/role.role.j2.yaml10:14
*** l4yerffej has quit IRC10:15
owalshjaosorior: wonder if we could use a different domain for the public & internal endpoints...10:16
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Add health check script for Sahara API  https://review.openstack.org/56472110:17
*** l4yerffej has joined #tripleo10:17
*** assassin has quit IRC10:18
*** apetrich has quit IRC10:19
openstackgerritMartin Mágr proposed openstack/tripleo-common master: [WIP] Activate remaining set of healthchecks  https://review.openstack.org/56387410:19
*** ubijtsa has joined #tripleo10:20
*** ubijtsa is now known as assassin10:20
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Enable Sahara API health check  https://review.openstack.org/56472310:22
jaosoriorowalsh: I think we can10:24
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Switch public endpoints to use FQDNs by default  https://review.openstack.org/55992610:24
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add EnablePublicTLS flag  https://review.openstack.org/56451810:24
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Change default endpoint map entries to use TLS  https://review.openstack.org/55842410:24
jaosoriorowalsh: done ^^10:24
jaosoriorowalsh: so, the initial proposal of the endpoints was to use CloudDomain for the domain of all public and internal endpoints... That was rejected with the use case of folks wanting to use different ones (though I don't think someone actually does that)10:27
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-common master: TLS by default for the overcloud  https://review.openstack.org/55492610:27
owalshjaosorior: you mean use the fqdn instead of IPs?10:38
owalshjaosorior: or do you mean that's why we use <network>.CloudDomain10:39
owalshjaosorior: hang on... for the public endpoints it's CloudName yea? does it matter what CloudDomain is set to?10:42
*** b00tcat has joined #tripleo10:43
*** yamahata has quit IRC10:45
*** mandre_afk is now known as mandre10:48
owalshjaosorior: I was assuming CloudName took the domain from CloudDomain, but it doesn't, just defaults to 'overcloud.localdomain'10:49
owalshand removing the CloudDomain default will have no effect in this case10:50
*** zoli|lunch is now known as zoli10:52
jaosoriorowalsh: right, which is why I removed CloudName as well11:02
owalshjaosorior: is it easy to change CloudName on a stack update?11:03
jaosoriorowalsh: Great question :D we would need to try it out11:03
jaosoriorowalsh: got a deployment?11:03
owalshjaosorior: not with TLS11:03
jaosoriorowalsh: well, it depends11:04
jaosoriorowalsh: uhm...11:05
jaosoriorwait no, nevermind11:05
jaosorioryeah, it'll be problematic, yeah11:05
jaosoriorowalsh: not impossible, but it would require some manual steps11:05
panda|ruckhas anyone seen this before ? http://logs.openstack.org/61/560261/9/gate/tripleo-ci-centos-7-containers-multinode/2884516/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz#_2018-04-27_09_33_58 ?11:06
jaosoriorowalsh: so, if automatic public TLS would be used, it would be a matter of calling certmonger, removing the certificate (stop-tracking), deleting the cert file, and then it would be possible to re-deploy11:06
panda|ruck2018-04-27 09:33:58 | container_linux.go:247: starting container process caused "process_linux.go:258: applying cgroup configuration for process caused \"open /sys/fs/cgroup/cpuset/system.slice/cpuset.cpus: no such file or directory\""11:06
*** dtantsur|brb is now known as dtantsur11:06
panda|ruckit's failing one of the gates11:06
panda|ruckthe current queue will be reset11:06
owalshjaosorior: ack, so removing the CloudName default seems right11:07
*** raildo has joined #tripleo11:07
owalshjaosorior: but CloudDomain default can remain?11:07
jaosoriorowalsh: probably, yeah11:07
* jaosorior reviewing the code11:08
jaosoriorowalsh: yep, you're right11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176688411:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1766884 in tripleo "Gate jobs are failing in different ways related to network issues" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)11:10
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Switch public endpoints to use FQDNs by default  https://review.openstack.org/55992611:11
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add EnablePublicTLS flag  https://review.openstack.org/56451811:11
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Change default endpoint map entries to use TLS  https://review.openstack.org/55842411:11
owalshjaosorior: yea, CloudName<network> doens't matter I think, as we continue using IPs for all other endpoints11:11
jaosoriorowalsh: correct. It only matters for TLS everywhere11:11
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Chain ansible messages in deployment progress  https://review.openstack.org/56473311:12
jtomasekmandre: ^11:12
panda|ruckbogdando: any idea what's happening there ? ^11:12
owalshjaosorior: handle enabling that be default in the next release ;-)11:12
jtomasekmandre: I've added additional patch which makes the UI display all messages as they come and automatically scrolls to the bottom to mimic terminal behavior11:13
openstackgerritMerged openstack/python-tripleoclient master: Remove adding config-download-environment.yaml  https://review.openstack.org/55893111:13
jaosoriorowalsh: haha I'm sure trying (had some talks with the FreeIPA folks this week). There's other issues to handle first though.11:13
*** adarazs has quit IRC11:13
owalshjaosorior: LGTM, I'll try to take a look at the other patches after lunch11:15
*** ykarel|away is now known as ykarel11:22
openstackgerritMerged openstack/tripleo-heat-templates master: Switch remaining env files to containers defaults  https://review.openstack.org/56055911:22
*** shreshtha_ has quit IRC11:25
dtantsurd0ugal: hi, around for a short question re concurrency in mistral tasks?11:26
dtantsurlargely, I'd like to check my understanding: if a task runs several workflows via with_items, will they run in parallel?11:27
d0ugaldtantsur: yes :)11:29
d0ugaldtantsur: you can limit the parallel executions with the concurrency attribute11:30
d0ugalhttps://github.com/openstack/tripleo-common/blob/5422ea0962c91f05b8328267d31f8419a711b4c2/workbooks/support.yaml#L23211:30
d0ugaldtantsur: ^ we also use that for introspection11:30
d0ugalhttps://github.com/openstack/tripleo-common/blob/5422ea0962c91f05b8328267d31f8419a711b4c2/workbooks/baremetal.yaml#L50811:30
d0ugaland line 54011:30
dtantsurd0ugal: I don't want to limit it, quite the opposite :) I have some long running things to launch11:30
dtantsurthanks, I think it answers my question!11:31
d0ugaldtantsur: if you put multiple tasks in on-success (or error or complete) then they will also run in parallel11:31
d0ugalMistral workflows are really designed to be very parallel, we just don't take advantage of it often11:32
d0ugaldtantsur: how long is long running?11:32
*** jcoufal has joined #tripleo11:32
dtantsurd0ugal: one case is several minutes (similar to introspection in all regards), the other - several hours (but this is not going to be a popular case :)11:34
d0ugaldtantsur: https://bugs.launchpad.net/mistral/+bug/159508411:34
openstackLaunchpad bug 1595084 in Mistral "Workflow execution lifespan is limited by auth token expire time" [High,Triaged] - Assigned to Brad P. Crochet (brad-9)11:34
d0ugaldtantsur: You should be aware of that - token timeout in tripleo is 4 hours. We really need to get it fixed. thrash|g0ne is going to try.11:35
dtantsurthanks for heads up11:36
d0ugalnp, I hope we can fix it in Rocky, but no promises :)11:36
d0ugalbbiab11:36
dtantsurit's fine, the several hours case is going to be really rare.. I even think of not including it at all :)11:37
*** lblanchard has joined #tripleo11:37
d0ugalI was kinda hoping this would give us more motivation to fix it sooner :)11:37
dtantsurheh11:37
*** nyechiel has quit IRC11:38
* dtantsur throws away a huuuuuge patch which he realizes is not relevant11:38
*** lucasagomes is now known as lucas-hungry11:38
*** thrash|g0ne is now known as thrash11:39
*** quiquell|rover is now known as quique|rover|lch11:40
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: main script: remove legacy JOB_NAME setting  https://review.openstack.org/56473711:41
jistrgfidente: wdyt? +2 as well and we get a 3rd +2 before merging? https://review.openstack.org/#/c/56468611:41
*** abishop has joined #tripleo11:45
*** itlinux has joined #tripleo11:45
*** iranzo1 has joined #tripleo11:46
openstackgerritDmitry Tantsur proposed openstack/tripleo-common master: Workflows for wiping overcloud nodes  https://review.openstack.org/56454511:47
akrivokagchamoul: this is the output of tripleo-ansible-inventory https://paste.fedoraproject.org/paste/P2bCDy~gpEDYxbprM8rwDg11:48
gchamoulakrivoka: thx!11:48
akrivokagchamoul: let me know if you want access to that machine11:49
*** pkovar has joined #tripleo11:50
*** tvignaud has quit IRC11:52
openstackgerritCarlos Camacho proposed openstack/tripleo-validations stable/ocata: Validate that there should not be XFS volumes with ftype=0  https://review.openstack.org/56473811:52
openstackgerritCarlos Camacho proposed openstack/tripleo-validations stable/newton: Validate that there should not be XFS volumes with ftype=0  https://review.openstack.org/56473911:52
gchamoulakrivoka: I am comparing the the output with the one from my env (which is working)11:53
pdeore Guys, can someone review https://review.openstack.org/#/c/562930/ please? it's a blocker for queens :/11:55
dtantsurfolks, can you point me at someone to talk about the OVB CI, more specifically about an upcoming breakage of it?11:55
*** jpena is now known as jpena|lunch11:56
pdeorejaosorior, jistr, gfidente, EmilienM , mandre ^11:56
jaosoriorpdeore: LGTM, but can you add a release note?11:57
dtantsurweshay: around?11:57
pdeorejaosorior, ohh yeah sure :)11:58
*** pkovar has quit IRC11:58
*** ramishra has quit IRC11:58
chandankumarEmilienM: mwhahaha there are couple of patches which needs your acks: https://review.openstack.org/560374 -> https://review.openstack.org/55452212:00
chandankumarEmilienM: mwhahaha https://review.openstack.org/560006 -> https://review.openstack.org/55928112:00
dtantsurarxcruz: hey, around? do you know our OVB jobs well?12:00
*** dprince has joined #tripleo12:01
chandankumarhttps://review.openstack.org/563879 https://review.openstack.org/564156 https://review.openstack.org/564391 https://review.openstack.org/564675 https://review.openstack.org/56467712:01
*** jtomasek has quit IRC12:01
arxcruzdtantsur: which job ?12:01
*** pkovar has joined #tripleo12:01
dtantsurarxcruz: any :) like these fs001 that are running on any patch12:01
arxcruzdtantsur: a little bit, what do you want to know ?12:02
*** jtomasek has joined #tripleo12:02
dtantsurthey are using the deprecated pxe_ipmitool driver. we plan on removing it by Rocky-2. I don't understand where it's coming from in the CI, so I cannot fix it.12:02
arxcruzdtantsur: can you show me a log ?12:02
jaosoriorchandankumar: you've been busy :O12:02
*** dparkes has quit IRC12:03
*** lblanchard has quit IRC12:03
chandankumarjaosorior: no, just came from movie12:03
dtantsurarxcruz: there's no really logs (yet), I just cannot understand where pxe_ipmitool is coming from in https://logs.rdoproject.org/57/564457/2/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Zed7c3eff9afb442d8a16afc049d3313f/undercloud/home/jenkins/instackenv.json.txt.gz12:03
dtantsurI fixed all places I could think of....12:03
arxcruzdtantsur: checking12:04
dtantsurthanks!12:04
jaosoriorchandankumar: lol, nice; which?12:05
chandankumarjaosorior: Avengers, Infinity wars12:05
dtantsurchandankumar: worth it?12:05
* dtantsur might wait for it to show up on amazon though12:05
chandankumardtantsur: yup, go for it12:05
*** ssbarnea_ has quit IRC12:06
dtantsur:)12:06
*** ssbarnea_ has joined #tripleo12:07
chandankumardtantsur: you will love it :-)12:08
*** panda|ruck is now known as panda|ruck|lunch12:08
*** ssbarnea_ has quit IRC12:09
arxcruzdtantsur: found https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/ovb-manage-stack/defaults/main.yml#L92 and https://github.com/openstack/tripleo-quickstart/blob/master/roles/libvirt/setup/overcloud/templates/instackenv.json.j2#L2312:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176688412:10
openstackLaunchpad bug 1766884 in tripleo "Gate jobs are failing in different ways related to network issues" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)12:10
*** ooolpbot has quit IRC12:10
dtantsurarxcruz: nope, that's not it. see, there are conditions to change it to 'ipmi' for newer releases? still, pxe_ipmitool is used on master12:10
dtantsuractually, the latter (for BM, not OVB) works12:11
arxcruzdtantsur: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/ovb-manage-stack/tasks/ovb-create-stack.yml#L17812:11
dtantsurmaybe the former is wrong for some reason - dunno12:11
dtantsurI expected --driver {{ baremetal_driver }} to do the trick, maybe it does not..12:12
arxcruzdtantsur: found it i think, let me confirm12:13
*** ssbarnea_ has joined #tripleo12:13
arxcruzdtantsur: https://github.com/cybertron/openstack-virtual-baremetal/blob/master/openstack_virtual_baremetal/build_nodes_json.py#L6312:14
arxcruz;)12:14
*** jpich has joined #tripleo12:14
dtantsurarxcruz: right, but it does not explain this problem12:14
arxcruzdtantsur: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/ovb-manage-stack/tasks/ovb-create-stack.yml#L178-L18412:14
dtantsurarxcruz: this task does pass --driver, but if you check https://logs.rdoproject.org/57/564457/2/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Zed7c3eff9afb442d8a16afc049d3313f/quickstart_install.txt.gz it seems to be skipped anyway12:15
arxcruzthis is being called parsing the baremetal_driver12:15
arxcruzthat is default to pxe_impitool12:15
arxcruzhttps://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/ovb-manage-stack/defaults/main.yml#L9212:15
openstackgerritMerged openstack/tripleo-heat-templates master: Add defaults into name property for config-download.  https://review.openstack.org/56425312:16
arxcruzdtantsur: oh, just a sec, it's being skipped12:16
dtantsuryep12:16
dtantsurI know, I wrote these bits around --driver :)12:16
arxcruzhehehe12:17
arxcruzdtantsur: sorry, let me continue digging into it12:17
dtantsurno problem, thanks for helping12:17
dtantsurit's confusing indeed, I followed the same path initially12:17
*** ssbarnea_ has quit IRC12:19
*** liverpooler has joined #tripleo12:20
*** ssbarnea_ has joined #tripleo12:21
*** quique|rover|lch is now known as quiquell|rover12:22
*** trown|outtypewww is now known as trown12:23
jaosoriorslagle: what do you mean out of order?12:25
jaosoriorslagle: there is a way to restore the old default. see https://review.openstack.org/#/c/564518/12:25
jaosoriorslagle: that's why I pointed to the whole chain yesterday12:25
slaglejaosorior: why isn't that the first patch in the chain (or at least part of it)?12:26
jaosoriorwhat do you mean part of it?12:26
slaglejaosorior: as it is now, the first patch merges, and then there's no way to restore the old default12:26
jaosoriorit's part of it12:26
jaosoriorthat's a very strange expectation, given that we would end up merging the whole thing12:27
slaglejaosorior: one has to wait for the 2nd patch to merge12:27
slaglejaosorior: there's nothing preventing the first patch in the chain from merging12:27
slagleon its own12:27
jaosoriorso?12:27
slaglejaosorior: the expectation is to not push breaking changes into the templates. that's not strange12:27
jaosoriorit wouldn't be a breaking change given it's part of a chain12:27
slaglejaosorior: the chain does not all merge at once12:28
jaosoriorsure man, alright, I'll change it12:28
slaglethe first patch can merge on its own.12:28
slaglethat's the first patch i reviewed, i see it causes a breakage in the templates, that's why I -1.12:28
slagleif it was backwards compatible or at least gave people a way to restore the old behavior, then i'm fine with it12:29
arxcruzdtantsur: i think i have an idea where this is comming from12:29
jaosoriorslagle: Right, but the expectation is to go forward with the rest of the chain. Which I did point to12:29
*** atoth has quit IRC12:29
*** atoth has joined #tripleo12:29
slaglejaosorior: i know, but the first patch could merge, and then CI is down for a week. it happens12:29
dtantsurarxcruz: cool! I'll have a quick lunch and get back to you12:29
slaglejaosorior: the way we manage this is to not push breaking changes that we expect to fix later12:30
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-common master: TLS by default for the overcloud  https://review.openstack.org/55492612:30
openstackgerritPranali Deore proposed openstack/tripleo-heat-templates master: Disable interoperable default image import method in THT  https://review.openstack.org/56293012:30
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add EnablePublicTLS flag  https://review.openstack.org/56451812:30
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Switch public endpoints to use FQDNs by default  https://review.openstack.org/55992612:30
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Change default endpoint map entries to use TLS  https://review.openstack.org/55842412:30
slaglejaosorior: we keep things working for our users as we go12:30
jaosorioralright, re-organized the dependencies12:30
slaglejaosorior: otherwise it is very disruptive, especially to developers who are deploying from latest templates12:30
jaosoriorslagle: I see your point. I just expected the whole thing to merge more or less at the same time. But yeah, it's better to be the least disruptive as possible.12:32
honzaccamacho: hey, are you planning on backporting this patch to queens?  https://review.openstack.org/#/c/559024/12:33
honzaccamacho: i'm trying to backport another patch, and i'm getting a merge conflict on queens because your big files patch isn't there (yet)12:33
*** eck` is now known as eck`gone12:34
*** eck`gone is now known as eck`12:35
*** zshi has quit IRC12:35
*** liverpooler has quit IRC12:36
*** liverpooler has joined #tripleo12:37
*** liverpooler has quit IRC12:37
*** iranzo1 has quit IRC12:38
*** liverpooler has joined #tripleo12:38
*** lucas-hungry is now known as lucasagomes12:38
*** rlandy has joined #tripleo12:39
ccamachohey honza, yes12:39
ccamachoit is here https://review.openstack.org/#/c/563977/12:39
ccamachobut we are still gating12:40
honzaccamacho: thanks, i guess i didn't look hard enough!12:40
ccamachonp let12:40
ccamachosee if if got merge soon12:40
*** rbowen has joined #tripleo12:41
*** psachin has quit IRC12:41
openstackgerritMerged openstack/tripleo-common stable/queens: Add healthcheck script for nova-metadata service  https://review.openstack.org/56382812:43
*** saneax is now known as saneax-_-|AFK12:47
dtantsurarxcruz: back12:47
arxcruzdtantsur: found something, still checking12:48
*** ratailor has quit IRC12:50
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Remove DNS servers that are no longer used  https://review.openstack.org/56365812:50
*** skramaja has quit IRC12:52
openstackgerritMerged openstack/tripleo-quickstart-extras master: Fix services docker tht path for tempest container  https://review.openstack.org/56358912:54
openstackgerritMerged openstack/tripleo-heat-templates master: Add dry-run mode for process templates  https://review.openstack.org/56229912:54
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Add neutron "segments" plugin to the default list  https://review.openstack.org/56437812:54
openstackgerritMerged openstack/tripleo-upgrade stable/queens: Fix release var in undercloud upgrade script  https://review.openstack.org/56463512:54
openstackgerritMerged openstack/tripleo-quickstart master: Disable cloud-init for VMs in libvirt-fake-nodepool  https://review.openstack.org/56376312:54
*** jpena|lunch is now known as jpena12:54
arxcruzdtantsur: okay, my best shot12:55
arxcruzdtantsur: and i'm 80% confident12:55
arxcruzso we have the te-broker server, that run the heat stack create to create the stack to run ovb job, and return that instackenv.json file12:55
*** srini has quit IRC12:55
openstackgerritDmitry Tantsur proposed openstack/python-tripleoclient master: Add 'overcloud node clean' command to run metadata cleaning on nodes  https://review.openstack.org/56474712:55
arxcruzthe code at the end of te-broker server calls is this https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/te-broker/create-env#L12412:55
dtantsurugh.. good catch12:56
dtantsurany idea how to fix it to pass --driver ?12:56
arxcruzthat calls the build-nodes-json without --driver12:56
*** iranzo1 has joined #tripleo12:56
*** vpickard_ is now known as vpickard12:57
arxcruzdtantsur: not sure if in the extra args is being passed12:57
arxcruzdtantsur: submit a git review ?12:57
arxcruz:)12:57
dtantsurarxcruz: how do I know the current release?12:58
arxcruzdtantsur: no idea, need to check, afaik it's not being passed as argument12:59
arxcruzdtantsur: the new driver will only work from rocky-2 and forward ?12:59
dtantsurarxcruz: it's in since Pike13:00
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: Do not rely on defaults for DockerCephDaemonImage in CI.  https://review.openstack.org/56474913:00
*** wolverineav has joined #tripleo13:00
arxcruzdtantsur: the easiest, dirty fix is do a check in toci and replace pxe_ipmitool after instackenv.json is generated13:01
dtantsurarxcruz: "in toci" - where? sorry, please don't assume any reasonable knowledge of tripleo CI here :)13:02
*** quiquell|rover is now known as quiquell|roger13:02
*** quiquell|roger is now known as quiquell|rover13:02
arxcruzdtantsur: toci is the script that we call to run the job13:02
*** panda|ruck|lunch is now known as panda|ruck13:03
*** athomas has joined #tripleo13:03
*** tzumainn has joined #tripleo13:03
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/queens: DNM: Test pike->queens upgrades.  https://review.openstack.org/56361613:04
arxcruzdtantsur: https://github.com/openstack-infra/tripleo-ci/blob/master/toci_gate_test-oooq.sh#L25713:04
arxcruzthis is the line that returns the instackenv.json13:04
dtantsurhmm, may work13:04
arxcruzdtantsur: https://github.com/openstack-infra/tripleo-ci/blob/master/testenv-client#L76-L87 is where the instackenv.json is generated13:07
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176688413:10
openstackLaunchpad bug 1766884 in tripleo "Gate jobs are failing in different ways related to network issues" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)13:10
*** ooolpbot has quit IRC13:10
arxcruzdtantsur: https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/prepare-slave.yml#L2513:12
arxcruzthis is where you want to change with some sed magic13:12
dtantsurarxcruz: thanks!13:13
arxcruzdtantsur: https://logs.rdoproject.org/57/564457/2/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Zed7c3eff9afb442d8a16afc049d3313f/ara_oooq/result/174740af-15df-4e48-99c6-94eef62b1e4e/13:14
arxcruzdtantsur: something like {% if release not in ['neutron', 'ocata'] %} magic sed command in the TE_DATAFILE13:16
dtantsuryep13:17
*** yprokule has quit IRC13:19
openstackgerritJames Slagle proposed openstack/tripleo-common master: Enable ControlMaster for ansible ssh  https://review.openstack.org/56475813:20
*** yprokule has joined #tripleo13:23
openstackgerritJames Slagle proposed openstack/tripleo-common master: Enable ControlMaster for ansible ssh  https://review.openstack.org/56475813:23
*** trown is now known as trown|brb13:26
*** Goneri has joined #tripleo13:29
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart master: Tag "Add the virthost to the inventory" as teardown-  https://review.openstack.org/56471213:30
*** pkovar has quit IRC13:30
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart master: Tag "Add the virthost to the inventory" as teardown-  https://review.openstack.org/56471213:31
*** pdeore has quit IRC13:33
*** pkovar has joined #tripleo13:34
*** dansmith is now known as superdan13:34
*** bnemec has quit IRC13:35
dpeacockg'morning slagle, EmilienM, mwhahaha :-)  Can I chase +2s on https://review.openstack.org/#/c/560973/ & https://review.openstack.org/#/c/564370/ please?13:35
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart master: Tag "Add the virthost to the inventory" as teardown-  https://review.openstack.org/56471213:37
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart master: Tag "Add the virthost to the inventory" as teardown-  https://review.openstack.org/56471213:37
mwhahahabogdando: can you rview https://review.openstack.org/#/c/564094/ plz13:38
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates stable/ocata: Fix Cinder's default db purge cron settings  https://review.openstack.org/56476013:39
openstackgerritDmitry Tantsur proposed openstack/python-tripleoclient master: Add 'overcloud node clean' command to run metadata cleaning on nodes  https://review.openstack.org/56474713:41
*** bnemec has joined #tripleo13:42
quiquell|roverDid you found this problem ?13:45
quiquell|rover2018-04-27 13:02:28.511 4988 INFO urllib3.poolmanager [-] Redirecting http://192.168.24.11:8004/v1/acee2ddc7945462b8e8beb5e89632bcb/stacks/integration_test -> http://192.168.24.11:8004/v1/acee2ddc7945462b8e8beb5e89632bcb/stacks/integration_test/d2e19298-cad8-48d0-b67a-213ea3fcdc9913:45
quiquell|roverIt's an infinte loop executing tempest13:46
mwhahahayay infinite loops13:46
*** oneswig has joined #tripleo13:47
openstackgerrityatin proposed openstack/tripleo-quickstart-extras master: Revert "Add test_segment_with_timestamp to skip list"  https://review.openstack.org/56476213:48
*** mcornea has joined #tripleo13:48
*** morazi has joined #tripleo13:50
openstackgerritDmitry Tantsur proposed openstack/tripleo-quickstart-extras master: Update OVB jobs to use the 'ipmi' driver before Queens  https://review.openstack.org/56476513:51
dtantsurarxcruz: something like ^^^?13:51
dtantsurmwhahaha: let us know if we're crazy ^^^13:51
dpeacockmwhahaha: jaosorior: thank you13:51
quiquell|rovermwhahaha: friday's infinite loop, feels bad13:52
*** jchhatbar has quit IRC13:52
mwhahahadtantsur: that's because of the ovb generator isn't it?13:52
mwhahahaor is it te-broker13:52
* mwhahaha can't remember where that file comes from13:52
dtantsurmwhahaha: because of te-broker13:52
dtantsurwhich does not seem to be release-aware :(13:52
mwhahahadtantsur: we switched it to be the "correct" version going forward right? so this is a updating it to the old value?13:53
dtantsurmwhahaha: no, we need s/pxe_ipmitool/ipmi/ starting with Queens13:54
dtantsurunless I'm too tired to think :)13:54
mwhahahadtantsur: then we should flip it so te-broker spits out the Queens value and we use sed to update it back for the legacy versions13:54
mwhahahaor is the thought that we hope to elimitate te-broker some day (probably never)13:54
*** saneax-_-|AFK is now known as saneax13:55
dtantsurmwhahaha: just a practical thought, s/pxe_ipmitool/ipmi/ is safer than s/ipmi/pxe_ipmitool/, since the former is idempotent :)13:56
* mwhahaha facepalms and moves on13:56
mwhahahait's friday13:56
derekhdtantsur: mwhahaha why not just pass the release into te-worker and have it pass in the appropriate driver to OVB/build_nodes_json.py ? https://github.com/cybertron/openstack-virtual-baremetal/blob/master/openstack_virtual_baremetal/build_nodes_json.py#L6413:56
*** trown|brb is now known as trown13:56
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud master: novajoin: Add higher default timeout for nova vendordata plugins  https://review.openstack.org/56476613:56
dtantsurderekh: it's an option, just a longer one13:57
* dtantsur does not want to spend a week working on it13:57
openstackgerritJulie Pichon proposed openstack/tripleo-docs master: Add note to update THT when upgrading undercloud  https://review.openstack.org/56476713:58
*** oneswig has left #tripleo13:59
*** apetrich has joined #tripleo14:00
*** masco has quit IRC14:00
*** yamahata has joined #tripleo14:01
*** ratailor has joined #tripleo14:03
EmilienMjaosorior: please port https://review.openstack.org/#/c/564766/ to THT for the containerized undercloud14:03
EmilienMakrivoka: please close https://bugs.launchpad.net/tripleo/+bug/1767339 and open it in storyboard, reminder: validations moved to storyboard14:04
openstackLaunchpad bug 1767339 in tripleo "Validations are broken due to a recent change in tripleo-ansible-inventory" [Critical,Triaged]14:04
jaosoriorEmilienM: will do; was just fixing the original bug to backport it14:04
EmilienMjaosorior: sounds good14:04
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: WIP - Add --stack to upgrades and ffu  https://review.openstack.org/56477214:05
akrivokaEmilienM: ah that's right, I totally forgot, sorry about that14:05
arxcruzdtantsur: i'm not a sed specialist, but yup, pretty much14:05
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates stable/queens: Add defaults into name property for config-download.  https://review.openstack.org/56477314:05
EmilienMakrivoka: no worries, thanks for moving14:06
*** dtantsur is now known as dtantsur|brb14:07
*** yprokule has quit IRC14:07
*** shreshtha has joined #tripleo14:08
*** holser__ has quit IRC14:09
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/176688414:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1766884 in tripleo "Gate jobs are failing in different ways related to network issues" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)14:10
*** raildo has quit IRC14:10
*** dmacpher has quit IRC14:11
*** raildo has joined #tripleo14:16
*** michchap has quit IRC14:16
*** eck` is now known as eck`gone14:16
*** eck`gone is now known as eck`14:18
slaglesdoran: hey, any idea why ansible requires different formats for static vs dynamic inventory?14:18
slaglesdoran: see https://bugs.launchpad.net/tripleo/+bug/176733914:18
openstackLaunchpad bug 1767339 in tripleo "Validations are broken due to a recent change in tripleo-ansible-inventory" [Critical,Triaged]14:18
openstackgerritEmilien Macchi proposed openstack/ansible-role-container-registry master: Fix role path in setup.cfg  https://review.openstack.org/56478014:18
slaglesdoran: in the static yaml inventory, "hosts" is a dict of hostnames to host vars. but in the dynamic inv, hosts must be just a list of hostnames14:19
openstackgerritEmilien Macchi proposed openstack/ansible-role-container-registry master: Fix role path in setup.cfg  https://review.openstack.org/56478014:19
*** itlinux has quit IRC14:19
*** alee has joined #tripleo14:19
*** quiquell|rover is now known as quiquell|off14:19
aleemcornea, ping14:21
mcorneaalee: hi14:21
aleemcornea, hey - I didn't see a reply to the last email on the thread ..14:22
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: Add exclude-path to undercloud backups  https://review.openstack.org/56478414:22
aleemcornea, should I go ahead and start throwing something together --- or did Alex want to start something?  and where?14:22
*** agopi|zzz has joined #tripleo14:23
*** agopi|zzz is now known as agopi14:23
dmsimardEmilienM, mwhahaha, quiquell|off: BTW flask shipped a broken release on pypi and it's breaking new installations of ARA: https://github.com/pallets/flask/issues/2728, they're pushing a new fixed version momentarily14:24
openstackgerritDerek Higgins proposed openstack/tripleo-heat-templates master: Download IPA kernel and ramdisk  https://review.openstack.org/56307214:25
mwhahahai spotted that yesterday14:25
mwhahahawas wondering what it was14:25
EmilienMdmsimard: thanks for the heads-up14:26
*** paramite has quit IRC14:27
EmilienMdmsimard: btw, do you have any progress on running ara for our overcloud / undercloud deployements since they're all ansible driven now?14:27
mcorneaalee: so that's what we need to figure out, where to place the code and then I think you can start it. Probably Alex would migrate the existing tests later into that. Perhaps EmilienM can help us with that.14:28
*** michchap has joined #tripleo14:28
EmilienMmcornea: of course. Can you link the code again please?14:28
mcorneaEmilienM: for some context we would like to have some tests which validate post deployment configuration changes and we were thinking about having a common repo for them14:28
EmilienMmcornea: don't we already have post deployment validations with tripleo-validations?14:29
mcorneaEmilienM: https://github.com/agurenko/rhosp-ci-tests for instance14:29
mcorneaEmilienM: I'm not sure if they can be considered validations, it's more of a test like change a config value, re-run deploy and then validate that it was applied14:30
aleeEmilienM, a first application of this would be a job where we test changing passwords for various services and ensuring that all the services start up and work correctly afterwards14:31
EmilienMmcornea: it's ansible driven and you should talk with the validation team: gchamoul, akrivoka, florian, etc14:31
*** ratailor has quit IRC14:31
aleewould that be considered a tripleo-validation?14:32
EmilienMmaybe?14:32
mcorneaEmilienM: alee I think the validation part could eventually only cover the part for validating that the config changes were applied but we still need some code for generating the config parameters and apply them14:33
openstackgerritEmilien Macchi proposed openstack/ansible-role-container-registry master: Fix role path in setup.cfg  https://review.openstack.org/56478014:33
EmilienMmcornea: I would really avoid creating a new repo for something that we might already have14:33
dmsimardEmilienM: I haven't made any progress on that, no14:34
bogdandopanda|ruck: nope, I have no idea. Let's report a bug for docker folks14:35
EmilienMdmsimard: it would be really helpful.14:35
bogdandomoby and downstream bz prolly14:35
panda|ruckbogdando: I have a bug14:35
panda|ruckbogdando: https://bugs.launchpad.net/tripleo/+bug/176734314:35
openstackLaunchpad bug 1767343 in tripleo "gate tripleo-ci-centos-7-containers-multinode fails to update packages in cron container" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)14:35
bogdandoyeah, but that's a tripleo bug, we barely can investigate or fix14:35
panda|ruckbut no other gates failed in the same way14:35
*** atoth has quit IRC14:36
panda|ruckbogdando: ok, some project I can assign it to , or it' would be outside of lp ?14:37
bogdandopanda|ruck: do we have more gates using container-check ?14:37
aleeEmilienM, mcornea looking a tripleo-validations now -- I dont see anywhere we do actually do a redeploy -- I see lots of scripts that confirm that the environment is actually up and working ..14:37
bogdandopanda|ruck: I think it should be a moby issue, and something in bz14:37
bogdandoEmilienM: any ideas for traiging it? ^^14:38
bogdandotriaging14:38
mcorneaEmilienM: me too but I don't see how to add the steps for generating the config changes and apply them post deployment in tripleo-validations. tripleo-upgrade is the closes that I am aware where we do this kind of actions14:38
mcorneaalee: ^14:38
aleemcornea, right - which is why I was originally thinking of adding to there :)14:40
bogdandopanda|ruck: may be related, though the message looks a little bit different https://github.com/openshift/origin/issues/1624614:41
panda|ruckbogdando: container-check is run by default now14:41
panda|ruckbogdando: so every container gate is running it, but only taht job seemed to fail14:41
bogdandowell, if that's a reace with systemd, it's expected races to be higly intermittent )14:42
bogdandorace*14:42
mcorneaalee: yeah, thinking more about it I think we could benefit from some checks that we already have in tripleo-upgrade for verifying the dataplane that could apply to configuration changes, for instance if you change a neutron configuration make sure that the network connectivity doesn't break during the stack update14:42
*** dxiri has quit IRC14:42
bogdandopanda|ruck: we have also https://bugzilla.redhat.com/show_bug.cgi?id=152304314:43
openstackbugzilla.redhat.com bug 1523043 in openstack-containers "OC deployment fails with oci runtime error applying cgroup configuration" [Medium,Closed: currentrelease] - Assigned to dprince14:43
*** itlinux has joined #tripleo14:43
*** pdeore has joined #tripleo14:43
panda|ruckbogdando: ooooh very interesting14:44
panda|ruckbogdando: linking to the bug as reference14:44
aleemcornea, yup - writing the bit that does the redeploy is the easy part, its the validations afterwards that will take a bit of weaving together14:44
bogdandopanda|ruck: long story short, we need a new docker version https://bugzilla.redhat.com/show_bug.cgi?id=154357514:45
openstackbugzilla.redhat.com bug 1543575 in docker "Container deployment fails with oci runtime error applying cgroup configuration" [Medium,Closed: errata] - Assigned to dwalsh14:45
openstackgerritMerged openstack/ansible-role-container-registry master: Fix role path in setup.cfg  https://review.openstack.org/56478014:46
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: WIP - Add --stack to upgrades and ffu  https://review.openstack.org/56477214:47
*** melwitt is now known as jgwentworth14:47
panda|ruckbogdando: ok, thanks, keeping the bug open14:48
aleemcornea, maybe the best is for me to throw a straw man together and add to tripleo-upgrade.  we can always yank it out and put it somewhere else if that makes sense.14:48
aleemcornea, but getting some initial working code can move this along14:48
chandankumarmwhahaha: https://review.openstack.org/#/c/560374/1214:50
chandankumarmwhahaha: can i fix it in a new patchset?14:50
* mwhahaha shrugs14:50
mwhahahai was just wondering14:50
mwhahahaif it still works i guess?14:50
mcorneaalee: ok, yeah, let's see how the steps in your role would look like in tripleo-upgrade, can you send a review and start the discussion over there?14:50
pdeorejaosorior, added release note to https://review.openstack.org/#/c/562930/14:51
chandankumarmwhahaha: http://logs.openstack.org/51/560351/4/check/tripleo-ci-centos-7-undercloud-oooq/e5d421f/logs/undercloud/home/zuul/tempest_output.log.txt.gz#_2018-04-19_07_07_4414:51
*** atoth has joined #tripleo14:51
aleemcornea, sure - makes sense14:51
chandankumarthe condition is correct let me edit the patch14:51
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Added tempest skip list for undercloud for stable branches  https://review.openstack.org/56037414:52
chandankumarmwhahaha: done14:53
mwhahahak14:53
*** itlinux has quit IRC14:53
*** rdopiera has quit IRC14:53
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Introduce tripleo-ci-centos-7-containerized-undercloud-upgrades  https://review.openstack.org/55363314:54
mwhahahachandankumar: oh if it was just a comment adjustment yea you could have fixed it in a follow up. i thought the if clause needed to be fixed14:54
pdeoreshardy, EmilienM , slagle , jistr could you please have a look at https://review.openstack.org/#/c/562930/, it's blocking glance image import feature :/14:55
openstackgerritEmilien Macchi proposed openstack/tripleo-upgrade master: Revert "undercloud: workaround for containers"  https://review.openstack.org/56479114:55
EmilienMpdeore: we're using /tmp ???14:55
*** itlinux has joined #tripleo14:56
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Introduce tripleo-ci-centos-7-containerized-undercloud-upgrades  https://review.openstack.org/55363314:56
pdeoreyes, it is the default staging location set in glance.conf14:56
*** dtantsur|brb is now known as dtantsur14:56
mwhahahayea let's not use /tmp for that14:56
mwhahahaespecially if it can be an nfs mount too?14:56
jistr(sorry i don't have enough bandwidth to look today but will try to do so later in case it's still needed)14:58
EmilienMmcornea, alee : I'm not sure tbh. This discussion could/should? happen on the mailing list and collect feedback from our group14:58
pdeoreEmilienM, https://github.com/openstack/glance/blob/acafa76a78578f93629de1dfc47e6de0616f496a/glance/common/config.py#L67914:58
* jistr will be back Wednesday14:58
EmilienMwell it's not because glance uses /tmp by default that we have to follow that14:59
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Inject the generated hash password on the node  https://review.openstack.org/56479614:59
aleeEmilienM, mcornea that sounds like a good idea15:00
mcorneaEmilienM: ok, agree. alee would you mind starting the thread and I'll reply with my thoughts15:00
aleemcornea, will do15:00
pdeoreEmilienM, yeah that's true, but here we'll have to add separate patch for setting new stating uri to node_stating_uri in glance.conf15:01
EmilienMI would not do a separated patch for that - again we're introducing potential security problems here15:02
openstackgerritJames Slagle proposed openstack/tripleo-common master: Fix dynamic inventory  https://review.openstack.org/56479715:02
slagleakrivoka: fyi^. roughly tested :)15:03
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates master: Add DeployIdentifier to Swift set_swift_secret container  https://review.openstack.org/56479815:03
EmilienMjaosorior: is it ok to use /tmp in https://review.openstack.org/#/c/562930/ ?15:03
akrivokaslagle: oh nice, thanks! I'll test it15:03
* EmilienM asking security experts :P15:03
EmilienMhttps://bugs.launchpad.net/tripleo/+bug/1767339 - this is why we need validations to be actually failing in our CI otherwise we don't catch regressions... cc gchamoul akrivoka15:05
openstackLaunchpad bug 1767339 in tripleo "Validations are broken due to a recent change in tripleo-ansible-inventory" [Critical,In progress] - Assigned to James Slagle (james-slagle)15:05
jaosoriorpdeore, EmilienM: ah, thought it was the pre-defined dir that they needed to use. If we REALLY can choose. Then no, lets not use tmp. would be nicer to have something in /var/run or something of the sort. while you can protect directories inside /tmp, it's prone to issues.15:05
*** rajinir has joined #tripleo15:06
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Switch public endpoints to use FQDNs by default  https://review.openstack.org/55992615:10
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Change default endpoint map entries to use TLS  https://review.openstack.org/55842415:10
leanderthalhrmm....  anyone want to take a stab at helping me with the tripleo quickstart, please?15:10
leanderthalfollowing the instructions https://docs.openstack.org/tripleo-quickstart/latest/getting-started.html15:11
leanderthali ran this command:15:11
*** pcaruana has quit IRC15:11
leanderthalbash quickstart.sh -R master --no-clone --tags all \15:11
leanderthal    --nodes config/nodes/1ctlr_1comp.yml -p quickstart.yml $VIRTHOST15:11
leanderthaland it just returns the --help output which tells me i'm doing something wrong, but i don't see it.15:11
leanderthali *just* want to install the undercloud ...15:12
leanderthalso maybe i'm overthinking this.15:12
jaosoriorleanderthal: this is what I use: ./quickstart.sh --no-clone --teardown all --clean -p quickstart-extras.yml -N config/nodes/1ctlr_1comp.yml   -c config/general_config/pacemaker.yml  -R master -w ~/local_quickstart15:12
*** iranzo1 has quit IRC15:15
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Deploy Docker via Ansible and not Puppet  https://review.openstack.org/56137715:15
leanderthalit's starting, jaosorior but that it runs into some error messages; is there somewhere that it logs errors?15:15
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Make novajoin vendordata timeout configurable  https://review.openstack.org/56480315:15
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Revert "Revert "Deploy container-multinode (fs010) with a containerized undercloud""  https://review.openstack.org/56026415:16
jaosoriorleanderthal: should be visible in the output15:16
*** shardy has quit IRC15:17
EmilienMleanderthal: if you just need an undercloud, that's like 3 commands to run15:17
EmilienMleanderthal: are you planning to deploy an overcloud?15:17
leanderthalEmilienM, eventually, yes, but i just want those three commands15:17
* leanderthal remembers three commands15:17
leanderthalfirst time doing this in... a year?15:18
EmilienMleanderthal: I have a gist that I run on fresh centos7: https://gist.github.com/EmilienM/2968a53e6ca03de8a0eed6a9a1cc9f7315:18
EmilienMleanderthal: it's doing what the doc is saying: https://docs.openstack.org/tripleo-docs/latest/install/installation/installation.html#installing-the-undercloud15:18
openstackgerritJose Luis Franco proposed openstack/instack-undercloud master: Add sudo into instack's semanage call.  https://review.openstack.org/56480415:19
leanderthalyessssss; thx EmilienM - that's the page i was looking for....15:20
*** pdeore has quit IRC15:22
*** saneax is now known as saneax-_-|AFK15:23
*** jfrancoa has quit IRC15:25
*** dxiri has joined #tripleo15:25
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Save temporary working data  https://review.openstack.org/56057815:27
*** michchap has quit IRC15:27
EmilienMtherve, zaneb: not sure you saw my ping yesterday but trying to do https://review.openstack.org/#/c/558354/ and bumping HeatMaxNestedStackDepth from 6 to 7 causes serious damage to the heat containers (infra can't even get the logs from the VM)15:27
therveEmilienM: Yeah I saw15:27
EmilienMtherve, zaneb : any thoughts on that? and the fact it worked in a non containeirzed undercloud15:27
EmilienMhttps://github.com/openstack/instack-undercloud/blob/8c421446d566c0a66cdae5f7752466e2012e1515/elements/puppet-stack-config/puppet-stack-config.yaml.template#L15415:28
EmilienMit's the default in instack-undercloud (non containerized undercloud) but when I port it to THT, it fails like bad15:28
therveEmilienM: Oh, your patch switches to convergence15:29
EmilienMtherve: yeah, like instack-undercloud15:29
therveThat seems more relevant15:29
EmilienMhttps://github.com/openstack/instack-undercloud/blob/8c421446d566c0a66cdae5f7752466e2012e1515/elements/puppet-stack-config/puppet-stack-config.yaml.template#L15215:29
zanebmy first thought is why does anybody need a nested stack 7 levels deep ;)15:29
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Inject the generated hash password on the node  https://review.openstack.org/56479615:29
therveYeah I know instack does15:29
EmilienMtherve: well, when I put again on 6, it works fine, with convergence to True15:29
therveHum, ok15:30
EmilienMzaneb: I'm just bringing config parity15:30
EmilienMI can git blame to find why we did that, one sec15:30
EmilienMhttps://github.com/openstack/instack-undercloud/commit/be7f564da11cd32103e10c97b082741f242850ac15:30
EmilienMtrozet did it ^15:30
*** kopecmartin has quit IRC15:31
sdoranslagle: Static files are meant to be written by hand. The dynamic format is more verbose and harder for humans to type, so a simplified format was created for static YAML files to make it easier to write by hand.15:31
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Enable cleanup by default for undercloud install  https://review.openstack.org/56203215:31
therveEmilienM: Where is the successful build with 6?15:32
*** myoung is now known as myoung|email-unl15:32
zanebEmilienM: assuming exactly the same templates, it's very surprising that it could make any difference at all whether the value is set to 6 or 715:32
*** myoung|email-unl is now known as myoung|emailplz15:32
zaneb(presumably this test isn't actually using 7, otherwise it would fail when set to 6)15:33
EmilienMtherve: http://logs.openstack.org/54/558354/28/check/tripleo-ci-centos-7-undercloud-containers/45a2a45/15:33
*** agopi is now known as agopi|brb15:34
EmilienMtherve: http://logs.openstack.org/54/558354/28/check/tripleo-ci-centos-7-undercloud-containers/45a2a45/logs/undercloud/var/log/config-data/heat/etc/heat/heat.conf.txt.gz15:34
EmilienMmax_nested_stack_depth=6 and convergence_engine=True15:34
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Generate undercloud_parameters in output_dir  https://review.openstack.org/56256615:35
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates stable/ocata: Don't unregister on system/resource delete  https://review.openstack.org/56481315:35
jaosoriorI'm off, have a good weekend everyone!15:35
*** jaosorior has quit IRC15:35
therveEmilienM: AFAIK it should fail if the limit is hit. Increasing the limit doesn't increase the complexity15:36
therveSo maybe there is something else in play, like another error we don't see15:36
*** michchap has joined #tripleo15:36
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates stable/newton: Don't unregister on system/resource delete  https://review.openstack.org/56481415:37
*** agopi|brb is now known as agopi15:38
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Create generic deployment action  https://review.openstack.org/56467115:38
therveEmilienM: Do you have another failure?15:38
zanebEmilienM: so in patch set 28 you are hard-coding '6' I wonder what happens if you set it to 6 in undercloud.yaml?15:40
zanebi.e. could it be a problem with passing the parameter (and it ends up as 0 or None or something) rather than a problem with the value 7 vs. 6?15:41
therveYeah15:41
EmilienMtherve: no and it doesn't capture the logs, everytime the instance goes south15:41
*** michchap has quit IRC15:41
EmilienMtherve: I could reproduce in my local env15:41
therveEmilienM: There is some issue with error reporting15:41
therveThe patch series was broken for a while because it said "get_para"15:41
EmilienMok15:41
EmilienMlet me see that15:41
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - heat: align config with instack-undercloud  https://review.openstack.org/55835415:42
*** dparkes has joined #tripleo15:43
therveEmilienM: Which scenario deploys heat in the overcloud?15:43
EmilienMtherve: scenario00115:44
EmilienMtherve: http://logs.openstack.org/86/564686/2/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/224e378/logs/subnode-2/var/log/config-data/heat/etc/heat/heat.conf.txt.gz15:44
EmilienMtherve: with limit of 6 for nested stacks15:45
therveEmilienM: That's another patch though15:45
EmilienMtherve: oh correct but we just change the config for the undercloud15:46
*** pdeore has joined #tripleo15:46
EmilienMtherve: except for heat::engine::reauthentication_auth_method: 'trusts' nothing else change on the overcloud15:47
therveEmilienM: Right but the get_param is used in the overcloud too now, right?15:47
therveOn patch 29 scenario001 fails too, if you can find why15:47
EmilienMtherve: correct15:47
EmilienMlet me see15:47
EmilienMtherve: it's https://bugs.launchpad.net/tripleo/+bug/1767252 I believe15:48
openstackLaunchpad bug 1767252 in tripleo "scenario001 timeout: ceph-ansible + config-download takes more time than before" [High,Triaged]15:48
sdoranslagle: There are multiple inventory plugins in Ansible: script, ini, YAML, etc. When the script inventory plugin is run, it expects data in a certain format. When ini/YAML are run, they expect the data in a different format based on what's the easiest for a human to type.15:48
therveHum ok15:48
*** marios has quit IRC15:48
sdoranIf the goal is take the JSON output form a script and convert it to YAML, `ansible-inventory tripleo-ansible-inventory --list --yaml` will do the trick.15:49
sdoranOr we could write a custom inventory plugin that accepts that same data format as the script plugin.15:49
sdoranBut I think that'd be overkill.15:49
aleemcornea, sent15:50
mcorneaalee: thanks15:50
*** kopecmartin has joined #tripleo15:52
*** anilvenkata has quit IRC15:55
*** kopecmartin has quit IRC15:56
*** anilvenkata has joined #tripleo15:57
*** lucasagomes is now known as lucas-afk15:58
*** anilvenkata has quit IRC15:58
*** anilvenkata has joined #tripleo15:58
openstackgerritRedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/56044516:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO  https://review.openstack.org/56428516:00
sdoranThe best path forward would be to eliminate the static file altogether. Generating a static file from a dynamic source is digging a hole and filling it back in.16:00
sdoranWith caching and `--list --yaml`, you can "see" your inventory anytime without having to have a static file on disk.16:01
*** bnemec is now known as beekneemech16:02
EmilienMsdoran: isn't it --list-hosts ?16:03
EmilienMsdoran: nevermind, that's the playbook command16:04
*** dparkes has quit IRC16:04
EmilienMansible-inventory --list --yaml is indeed fine16:04
beaglesEmilienM: mwhahaha: can you take a look at https://review.openstack.org/#/c/564425/? I'm not sure I would've gone this way (prob would've put a check in puppet-tripleo instead) but I guess the thinking is to catch a misconfig early?16:05
mwhahahayea we'd rather catch that in THT than puppet16:07
mwhahahaway faster fail16:07
beaglesk cool16:07
EmilienMwell16:07
EmilienMwhy not doing: neutron::plugins::ml2::tenant_network_types: geneve16:07
EmilienMfor now16:07
EmilienMbut yeah it works too16:07
mwhahahabogdando: replied to https://review.openstack.org/#/c/564094/3, the problem is that OSC has an annoying default logging configuration that basically suppresses <=INFO16:14
mwhahahabogdando: --verbose and --debug both just basically enable everything16:14
mwhahahaso we can only really use .error and .warning to output things to an end user16:14
*** dparkes has joined #tripleo16:15
*** dtantsur is now known as dtantsur|afk16:15
*** itlinux has quit IRC16:15
* fultonj submitting a WIP for LP 176725216:19
openstackLaunchpad bug 1767252 in tripleo "scenario001 timeout: ceph-ansible + config-download takes more time than before" [High,Triaged] https://launchpad.net/bugs/176725216:19
openstackgerritBrent Eagles proposed openstack/puppet-tripleo master: Adding wrapper scripts for neutron agent subprocesses  https://review.openstack.org/55022416:20
*** jpich has quit IRC16:24
trozetEmilienM, zaneb: everythign OK with the heat stack depth?16:25
*** dxiri has quit IRC16:27
*** sai_p has joined #tripleo16:27
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Execute ceph-ansible with its own ansible.cfg  https://review.openstack.org/56483316:28
sai_pHi, can someone give workflow for this cherrypick https://review.openstack.org/#/c/559886/ ?16:29
sai_pThank you16:29
sai_pAlso review these cherrypicks?16:30
sai_phttps://review.openstack.org/#/c/564361/16:30
sai_phttps://review.openstack.org/#/c/564366/16:30
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Create generic deployment action  https://review.openstack.org/56467116:30
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Fix hieradata overrides for UC instack/heat install  https://review.openstack.org/56483516:30
*** mcornea has quit IRC16:30
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Create generic deployment action  https://review.openstack.org/56467116:32
*** lblanchard has joined #tripleo16:33
bogdandomwhahaha: well, I still think we should not issue warnings...16:33
mwhahahabogdando: that's fine, but can we argue about what we print out to the user later?16:34
bogdandook16:34
mwhahahabogdando: the python logging levels don't affect functionality of the deploy. The point of switching those to warnings was to actually output those to the user16:34
mwhahahabogdando: if we don't wish to see those with a default install, then we can switch them to info. but those are progress indidicators16:34
*** derekh has quit IRC16:35
mwhahahai'd rather us focus on suppressing the heat output than argue about progress messages :D16:35
bogdandoI think users never read warnings so it would be equal to supressing those via INFO level haha16:35
*** ccamacho has quit IRC16:35
*** dprince has quit IRC16:35
*** zoli is now known as zoli|gone16:36
mwhahahabogdando: in the deploy, it's just text base so they don't even know they are warnings16:36
bogdandoright16:36
mwhahahabogdando: go check the output of undercloud install16:36
bogdandook you've convinced me, let's think of a proper fix later16:36
mwhahahai agree it's not ideal :)916:36
bogdandolike adding oslo log levels to config or something16:37
bogdandoif that helps16:37
bogdandohttps://gist.github.com/ewindisch/4488269#file-log-py-L7716:38
bogdandosomething like that16:38
bogdandomwhahaha: WDYT?16:38
mwhahahabogdando: so it's configured by openstack client16:38
mwhahahabogdando: i'm not sure we can actually override them16:38
bogdandoI think we could try16:38
mwhahahabut yea it would be nice16:38
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Introduce tripleo-ci-centos-7-containerized-undercloud-upgrades  https://review.openstack.org/55363316:39
*** mcornea has joined #tripleo16:39
*** trown is now known as trown|lunch16:40
*** raildo has quit IRC16:42
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Update the fast forward workflow to use CLI commands  https://review.openstack.org/56483616:44
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Update the fast forward workflow to use CLI commands  https://review.openstack.org/56483616:44
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo master: Disallow SSLv2, SSLv3 and TLS1.0 in mysql for FedRAMP compliance  https://review.openstack.org/56483716:45
*** b00tcat_ has joined #tripleo16:46
*** raildo has joined #tripleo16:46
*** b00tcat has quit IRC16:47
*** ffiore has quit IRC16:49
*** bogdando has quit IRC16:55
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Update undercloud install to use tripleo deploy  https://review.openstack.org/56484216:56
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Update the fast forward workflow to use CLI commands  https://review.openstack.org/56483617:07
*** jpena is now known as jpena|off17:07
*** gkadam has quit IRC17:08
*** tesseract has quit IRC17:09
*** yamahata has quit IRC17:09
*** itlinux has joined #tripleo17:09
*** dprince has joined #tripleo17:17
*** pdeore has quit IRC17:24
*** pdeore has joined #tripleo17:24
*** raildo has quit IRC17:26
*** ohochman has joined #tripleo17:29
*** brault has quit IRC17:30
*** dxiri has joined #tripleo17:33
*** khyr0n has joined #tripleo17:35
*** raildo has joined #tripleo17:37
*** amoralej is now known as amoralej|off17:41
*** hanish has joined #tripleo17:44
*** dhill_ has quit IRC17:44
*** yamahata has joined #tripleo17:45
*** rmascena has joined #tripleo17:46
*** raildo has quit IRC17:46
*** ykarel is now known as ykarel|away17:49
*** trown|lunch is now known as trown17:50
*** dhill_ has joined #tripleo17:50
*** gfidente has quit IRC17:52
hanishtrozet: hi17:54
trozethanish: hi17:54
*** ykarel|away has quit IRC17:54
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Revert "Fixes ceph-external docker service name"  https://review.openstack.org/56319317:55
*** fragatina has joined #tripleo17:56
*** fragatin_ has joined #tripleo17:57
hanishtrozet: i am deploying opendaylight openstack using tripleo, my overcloud creation is fine, but opendaylight_api container does not listenon 665317:58
hanishtrozet: it listens on 6633, but iptables rules and switches are configured to connect to 665317:59
trozethanish: 6633 is legacy17:59
trozethanish: which version of opendaylight did you use? can you go into the container and do rpm -q opendaylight?18:00
*** pkovar has quit IRC18:00
*** fragatina has quit IRC18:01
hanishtrozet: ok18:01
*** jaganathan has quit IRC18:02
hanishtrozet: opendaylight-8.1.0-0.1.20180423snap226.el7.noarch looks like oxygen18:02
trozethanish: yeah oxygen SR1.  There was a bug that was just fixed yesterday where openflow plugin is not starting correctly due a missing default: https://git.opendaylight.org/gerrit/#/c/70814/18:03
trozethanish: on the controller can you do docker logs opendaylight_api and see if you have some exceptions with openflow plugin?18:04
trozethanish: I can give you a workaround as well for hte problem18:04
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Update the fast forward workflow to use CLI commands  https://review.openstack.org/56483618:05
hanishtrozet: thanks, what would be the workaround18:06
*** panda|ruck is now known as panda|ruck|off18:07
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Update the fast forward workflow to use CLI commands  https://review.openstack.org/56483618:07
trozethanish: so if you want to redeploy you would need to go on the undercloud, and do scp heat-admin@<controller ip>:/etc/puppet/modules/opendaylight/templates/default-openflow-connection-config.xml.erb .18:08
trozethanish: then modify that file to include this <channel-outbound-queue-size>1024</channel-outbound-queue-size>18:09
trozethanish: put that jsut under the line with <port>6653</port>18:09
trozethanish: then LIBGUESTFS_BACKEND=direct virt-customize --upload default-openflow-connection-config.xml.erb:/etc/puppet/modules/opendaylight/templates/ -a overcloud-full.qcow218:09
trozethanish: openstack overcloud image upload --update18:10
trozethanish: then redeploy18:10
hanishtrozet: got it, thanks18:10
trozethanish: np18:10
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Create generic deployment action  https://review.openstack.org/56467118:11
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Update undercloud install to use tripleo deploy  https://review.openstack.org/56484218:11
*** holser__ has joined #tripleo18:22
*** ykarel|away has joined #tripleo18:23
*** ayoung has joined #tripleo18:24
ayoungWhat if I want to run Tripleo, complete with hardward managed undercloud, but the server machines I am using don't have remote power management?  Is it still worth trying to do that?18:25
*** dprince has quit IRC18:30
*** itlinux has quit IRC18:32
*** vpickard is now known as vpickard_18:33
*** vpickard_ is now known as vpickard18:33
*** vpickard is now known as vpickard_18:34
*** shreshtha has quit IRC18:43
*** mcornea has quit IRC18:47
*** holser__ has quit IRC18:53
*** mcornea has joined #tripleo18:57
*** spsurya has quit IRC19:01
openstackgerritMerged openstack/tripleo-common master: Bump Ceph container image from 3.0.1 to 3.0.3  https://review.openstack.org/56301219:05
openstackgerritMerged openstack/python-tripleoclient stable/queens: Composable role and service fails workflow  https://review.openstack.org/56469219:05
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: WIP: Move libvirt-fake-nodepool vars to roles  https://review.openstack.org/56486519:06
leanderthalayoung, it depends on what you're using the environment for? one of the major features of the undercloud is management which needs remote power management19:10
leanderthali wouldn't recommend sans remote power management in a production environment.19:13
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Update the fast forward workflow to use CLI commands  https://review.openstack.org/56483619:14
*** fragatin_ has quit IRC19:15
EmilienMmcornea: I'm debugging tripleo-ci-centos-7-undercloud-upgrades19:18
*** myoung|emailplz is now known as myoung19:18
EmilienMmcornea: but I'm not sure we actually deploy Queens first and then upgrade19:18
EmilienMsee http://logs.openstack.org/12/563012/1/check/tripleo-ci-centos-7-undercloud-upgrades/ac5a74c/logs/undercloud/var/log/yum.log.txt.gz for example19:18
EmilienMrpms are installed (looks like rocky rpms)19:18
EmilienMand never updated19:18
mcorneaEmilienM: looking19:19
EmilienMmcornea: see http://logs.openstack.org/12/563012/1/check/tripleo-ci-centos-7-undercloud-upgrades/ac5a74c/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz#_2018-04-26_08_42_22_85819:21
EmilienMit's clearly not queens that was deployed19:21
mcorneaEmilienM: yeah, look so, do you know where this job is defined?19:24
EmilienMmcornea: I think it's a featureset, let me check19:24
EmilienMhttps://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset047.yml19:24
mwhahahai don't think we ever converted the old undercloud upgrade to oooq did we19:25
EmilienMwe did19:25
mwhahahapretty sure it's not19:26
EmilienMjfrancoa did19:26
mwhahahaoh guess i'm wrong19:26
mwhahahawe still use tripleo.sh for the node bootstrap19:26
EmilienMhttps://review.openstack.org/#/c/548974/19:26
mwhahahahttp://logs.openstack.org/42/529342/5/check/tripleo-ci-centos-7-undercloud-upgrades/2815bfe/job-output.txt.gz#_2018-04-27_13_35_39_20218619:26
mwhahahaah recently19:27
mwhahahathats why19:27
*** pdeore has quit IRC19:32
*** slaweq has quit IRC19:35
*** orange_julius has joined #tripleo19:36
orange_juliusHaving an interesting problem with a queens deployment.. The deployment timedout and we think the issue is that the openstack-nova-conductor service was never started on the controller nodes. I manually ran os-refresh-config on a node, waited for it to hang, then started openstack-nova-conductor. os-refresh-config then started up all the containers normally.19:37
orange_juliusWhy would openstack-nova-conductor not be starting on these nodes? It didn't fail to start, it just was never asked to start19:37
orange_juliusThis was in step 4 of the deployment. openstack-nova-compute was timing out on rabbitmq messages saying that openstack-nova-conductor wasn't started19:40
mcorneaEmilienM: so it's using --extra-vars @/home/zuul/workspace/.quickstart/config/release/tripleo-ci/master.yml for intial deployment , trying to figure out that gets set from, it should be queens.yml19:41
openstackgerritJames Slagle proposed openstack/tripleo-common master: Fix dynamic inventory  https://review.openstack.org/56479719:44
mcorneaEmilienM: I guess it's coming from --extra-vars @$LOCAL_WORKING_DIR/config/release/tripleo-ci/${UPGRADE_RELEASE:-$QUICKSTART_RELEASE}.yml19:47
mcorneaand I see we do export UPGRADE_RELEASE=master earlier in +(/opt/stack/new/tripleo-ci/toci_gate_test.sh:141): export UPGRADE_RELEASE=master19:47
openstackgerritJames Slagle proposed openstack/tripleo-common master: Fix dynamic inventory  https://review.openstack.org/56479719:47
EmilienMmcornea: ouch :/19:48
leanderthalI'm running into [quickstart.sh: line 495: /root/.quickstart/tripleo-quickstart/ansible_ssh_env.sh: no such file or directory] when i run any quickstart.sh command; i.e. bash quickstart.sh $VIRTHOST19:50
* leanderthal thinking this is an i.d.10.t bug....19:50
mcorneaEmilienM: so it's set here https://github.com/openstack-infra/tripleo-ci/blob/master/toci_gate_test-oooq.sh#L14119:54
mcorneaEmilienM: next_release_from queens returns master -> https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/oooq_common_functions.sh#L98-L9919:54
EmilienMleanderthal: are you trying to just deploy an undercloud?19:57
EmilienMleanderthal: because really it takes less than 3 commands I think19:57
*** paramite has joined #tripleo19:57
EmilienMmcornea: right, my patch is on master so we should deploy an undercloud on queens first, no?19:58
EmilienMorange_julius: did you check if the container tried to start before and maybe failed?19:58
leanderthalEmilienM, you'd think that would be easy, right?!?19:58
mcorneaEmilienM: right19:59
trownleanderthal: oh... you shouldnt run as root I think19:59
trownleanderthal: sorry I missed your earlier ping19:59
leanderthalthat is so solid.19:59
leanderthalokay, trying NOT as root cause i'm made of awesomeness19:59
*** ansmith has quit IRC20:00
*** dciabrin has quit IRC20:00
*** dciabrin has joined #tripleo20:01
leanderthaland we're goooooooooooooooooooooooooooooooooooooooooooooooood20:02
leanderthalthx trown++20:02
*** ansmith has joined #tripleo20:02
* trown feels bad... glad it worked out though20:02
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: WIP: Move libvirt-fake-nodepool vars to roles  https://review.openstack.org/56486520:10
*** b00tcat_ has quit IRC20:11
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Move libvirt-fake-nodepool vars to roles  https://review.openstack.org/56486520:12
*** b00tcat_ has joined #tripleo20:12
*** b00tcat_ has quit IRC20:12
*** rmascena has quit IRC20:13
*** khyr0n has quit IRC20:13
orange_juliusEmilienM: There were no container failures. There was a hung ansible script which eventually was trying to start openstack-nova-compute on our controller nodes. This service was "Starting" for 21 hours waiting for openstack-nova-conductor to come up20:15
orange_juliusIt seemed like these services were all on the host and not in docker containers20:15
*** raildo has joined #tripleo20:18
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Update the fast forward workflow to use CLI commands  https://review.openstack.org/56483620:22
openstackgerritBrent Eagles proposed openstack/puppet-tripleo master: Adding wrapper scripts for neutron agent subprocesses  https://review.openstack.org/55022420:23
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add EnablePublicTLS flag  https://review.openstack.org/56451820:24
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Generate and mount wrappers for neutron agent processes  https://review.openstack.org/55082320:25
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add compute node L3 agent container for DVR  https://review.openstack.org/53793120:25
*** rbowen has quit IRC20:35
*** leanderthal has quit IRC20:40
*** ssbarnea_ has quit IRC20:43
beaglesif anybody wants some light reading there are these patches https://review.openstack.org/#/q/topic:bug/1749209+(status:open), they've had a bunch of tweaks over the last week or so and I think I'm just about out of things to ad-hoc test and fix20:43
*** wolverineav has quit IRC20:43
beaglessadly the t-h-t patch won't pass CI until there is a promotion on the neutron-l3-agent container20:43
*** wolverineav has joined #tripleo20:44
* beagles goes for a walk to clear head20:45
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Move tests to tripleo deploy  https://review.openstack.org/56488120:47
*** wolverineav has quit IRC20:48
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Create generic deployment action  https://review.openstack.org/56467120:49
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Update undercloud install to use tripleo deploy  https://review.openstack.org/56484220:49
*** itlinux has joined #tripleo20:49
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Move tests to tripleo deploy  https://review.openstack.org/56488120:49
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: Introduce docker_insecure_registries parameter  https://review.openstack.org/56488520:59
EmilienMmwhahaha: ^21:00
*** trown is now known as trown|outtypewww21:01
*** jtomasek has quit IRC21:02
*** jcoufal has quit IRC21:06
orange_juliusand now I am seeing File "/usr/lib/python2.7/site-packages/trove_dashboard/content/database_configurations/tables.py", line 184, in <module>     class UpdateCell(tables.UpdateAction): AttributeError: 'module' object has no attribute 'UpdateAction' after a fresh Queens deployment. Not too sure what would have caused this....21:09
*** rfolco is now known as rfolco|off21:11
*** abishop has quit IRC21:12
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Update OVB jobs to use the 'ipmi' driver before Queens  https://review.openstack.org/56476521:14
*** ykarel|away has quit IRC21:15
orange_juliusThere seems to be a bug in the trove_dashboard python scripts. UpdateAction definitely doesn't exist anywhere in /usr/lib/python2.7/site-packages/trove_dashboard21:15
orange_juliusexcept for the one place its being called21:16
orange_juliusapologies, tables.UpdateAction doesn't appear anywhere in horizon as far as I can tell21:16
*** rakhmerov has quit IRC21:25
*** paramite has quit IRC21:26
mwhahahathat's a question for the trove folks21:28
mwhahahai don't even think we support trove in tripleo21:28
*** rakhmerov has joined #tripleo21:30
orange_juliusIts installed by default in the queens release21:30
*** hanish has quit IRC21:31
orange_juliusWe have done 0 extra configuration apart from bonded vlans and are getting an error 500 after deployment when attempting to go to the dashboard21:31
mwhahahadefault as part of horizon?21:31
orange_juliusLooks like a python package version issue somewhere21:31
orange_juliusThe trove_dashboard python package is in the horizon container. Its the python2-troveclient rpm21:32
orange_juliusRemoving the package fixes the issue21:33
mwhahahaoh must be coming from kolla21:33
mwhahahabecause we don't support it in tripleo21:33
orange_juliusMaybe. Whatever it is results in a broken tripleo deployment by default in Queens21:34
mwhahahahttps://github.com/openstack/kolla/blob/887ed5310e801d7a3f7bc455663123fa1817be1f/docker/horizon/Dockerfile.j2#L1221:34
mwhahahayea there it is21:34
mwhahahaorange_julius: plz file a bug21:34
mwhahahajrist: -^ looks like horizon is bad in queens21:34
*** raildo has quit IRC21:38
orange_juliusAlrighty21:39
*** dparkes_ has joined #tripleo21:40
*** dparkes has quit IRC21:41
*** thrash is now known as thrash|g0ne21:42
*** abishop has joined #tripleo21:43
jrist:(21:46
jristpass the bug along when you got it orange_julius21:46
*** fragatina has joined #tripleo21:49
*** fragatina has quit IRC21:50
*** fragatina has joined #tripleo21:52
orange_juliusjrist mwhahaha do you need my environment files and the rest of the overcloud configuration in the bug report?21:58
jristwouldn't hurt.21:58
mwhahahaif you can that's fine. if not reporting the error message and any debugging you did would be beneficial21:59
*** rlandy has quit IRC22:04
orange_juliushttps://bugs.launchpad.net/tripleo/+bug/1767520 is what I got right now. If you need more information let me know22:04
openstackLaunchpad bug 1767520 in tripleo "Python-TroveClient causes Horizon to throw error 500" [Undecided,New]22:04
*** itlinux has quit IRC22:05
*** mcornea has quit IRC22:09
*** itlinux has joined #tripleo22:09
*** holser__ has joined #tripleo22:14
*** agopi is now known as agopi|out22:20
*** Goneri has quit IRC22:35
*** agopi|out has quit IRC22:44
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Update the fast forward workflow to use CLI commands  https://review.openstack.org/56483622:45
*** liverpooler has quit IRC22:48
*** zshi has joined #tripleo22:49
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Update the fast forward workflow to use CLI commands  https://review.openstack.org/56483622:51
*** dhill_ has quit IRC22:51
*** ohochman has quit IRC22:56
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Update the fast forward workflow to use CLI commands  https://review.openstack.org/56483622:56
*** itlinux has quit IRC23:01
*** holser__ has quit IRC23:03
openstackgerritMatt Young proposed openstack/tripleo-quickstart master: Add editor dirs to .gitignore  https://review.openstack.org/56438023:03
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Update the fast forward workflow to use CLI commands  https://review.openstack.org/56483623:04
openstackgerritMatt Young proposed openstack/tripleo-quickstart master: Misc improvements to libvirt nodepool reproducer  https://review.openstack.org/56438223:05
openstackgerritMatt Young proposed openstack/tripleo-quickstart master: Misc improvements to libvirt nodepool reproducer  https://review.openstack.org/56438223:13
orange_juliusIt appears that attempting to add the ironic service to the overcloud after a successful overcloud deployment won't work. There is an error running ironic-dbsync because the ironic user isn't created23:17
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade stable/queens: FFU: We need to be root to install ansible-pacemaker package.  https://review.openstack.org/56494723:21
*** adrianreza has quit IRC23:28
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Revert Ceph bridge names to previous values  https://review.openstack.org/56494923:41
*** liverpooler has joined #tripleo23:46
*** tosky has quit IRC23:47
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates stable/queens: Revert Ceph bridge names to previous values  https://review.openstack.org/56495123:50
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Update the fast forward workflow to use CLI commands  https://review.openstack.org/56483623:53
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Update the fast forward workflow to use CLI commands  https://review.openstack.org/56483623:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!