| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
|---|---|---|
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 00:10 |
| *** trozet has quit IRC | 00:20 | |
| *** liverpooler has joined #tripleo | 00:22 | |
| *** pchavva has joined #tripleo | 00:36 | |
| *** yamahata has joined #tripleo | 00:38 | |
| openstackgerrit | Merged openstack/diskimage-builder master: install sudo in the devuser element https://review.openstack.org/555149 | 00:58 |
| *** chandankumar has joined #tripleo | 01:03 | |
| *** chkumar246 has quit IRC | 01:04 | |
| *** chandankumar has quit IRC | 01:08 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 01:10 |
| *** artom has joined #tripleo | 01:17 | |
| *** chandankumar has joined #tripleo | 01:21 | |
| *** ykarel_ has joined #tripleo | 01:47 | |
| *** ayoung has quit IRC | 01:51 | |
| *** lblanchard has quit IRC | 02:02 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 02:10 |
| openstackgerrit | binhong.hua proposed openstack/tripleo-heat-templates master: remove OS::TripleO::Services::CephClient from CephAll https://review.openstack.org/553416 | 02:35 |
| *** moshele has joined #tripleo | 02:36 | |
| *** moshele has quit IRC | 02:42 | |
| openstackgerrit | Yong Huang proposed openstack/tripleo-heat-templates master: [DellEMC]Update Manila Unity driver https://review.openstack.org/543200 | 02:44 |
| *** pchavva has quit IRC | 02:47 | |
| *** ramishra has joined #tripleo | 02:50 | |
| openstackgerrit | Yong Huang proposed openstack/tripleo-heat-templates master: [DellEMC]Update Manila VNX driver https://review.openstack.org/538147 | 02:59 |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 03:10 |
| *** ykarel_ has quit IRC | 03:17 | |
| *** kmy has quit IRC | 03:20 | |
| *** kmy has joined #tripleo | 03:21 | |
| *** trown has joined #tripleo | 03:32 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers https://review.openstack.org/551441 | 03:45 |
| *** psahoo has joined #tripleo | 03:54 | |
| *** rcernin has quit IRC | 03:55 | |
| *** rcernin has joined #tripleo | 03:55 | |
| *** ratailor has joined #tripleo | 04:01 | |
| *** shreshtha has joined #tripleo | 04:07 | |
| *** pdeore has joined #tripleo | 04:07 | |
| openstackgerrit | Merged openstack/tripleo-common master: Add UUID to directory where Heat configs are stored https://review.openstack.org/550258 | 04:09 |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 04:10 |
| *** agopi|out has quit IRC | 04:13 | |
| *** masco_ has joined #tripleo | 04:16 | |
| *** karthiks has quit IRC | 04:17 | |
| *** psachin has joined #tripleo | 04:28 | |
| *** udesale has joined #tripleo | 04:35 | |
| *** tdasilva has quit IRC | 04:36 | |
| Tengu | hello there | 04:44 |
| *** gyankum has joined #tripleo | 04:49 | |
| *** ykarel_ has joined #tripleo | 04:49 | |
| *** dsariel has quit IRC | 04:50 | |
| *** dpawar has joined #tripleo | 05:08 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 05:10 |
| *** moshele has joined #tripleo | 05:14 | |
| *** moshele has quit IRC | 05:16 | |
| *** jfrancoa has joined #tripleo | 05:17 | |
| *** anilvenkata has joined #tripleo | 05:18 | |
| *** jfrancoa has quit IRC | 05:19 | |
| *** jfrancoa has joined #tripleo | 05:26 | |
| *** jfrancoa has joined #tripleo | 05:27 | |
| *** jfrancoa has joined #tripleo | 05:27 | |
| *** ykarel__ has joined #tripleo | 05:30 | |
| *** ykarel_ has quit IRC | 05:33 | |
| *** marios has joined #tripleo | 05:45 | |
| *** agurenko has joined #tripleo | 05:45 | |
| *** karthiks has joined #tripleo | 05:46 | |
| *** pgadiya has joined #tripleo | 05:53 | |
| *** jaosorior has joined #tripleo | 05:59 | |
| *** dpawar has quit IRC | 05:59 | |
| openstackgerrit | yatin proposed openstack/tripleo-heat-templates master: Correctly set NeutronMl2PluginBase for OVN scenario https://review.openstack.org/556350 | 06:02 |
| *** skramaja has joined #tripleo | 06:02 | |
| *** tdasilva has joined #tripleo | 06:07 | |
| *** moshele has joined #tripleo | 06:09 | |
| *** skramaja_ has joined #tripleo | 06:10 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 06:10 |
| *** skramaja has quit IRC | 06:10 | |
| *** jaosorior has quit IRC | 06:14 | |
| *** links has joined #tripleo | 06:19 | |
| *** jaosorior has joined #tripleo | 06:21 | |
| *** skramaja_ is now known as skramaja | 06:22 | |
| *** dbecker has quit IRC | 06:30 | |
| *** dpawar has joined #tripleo | 06:31 | |
| *** aufi has joined #tripleo | 06:34 | |
| *** moshele has quit IRC | 06:35 | |
| *** jaosorior has quit IRC | 06:41 | |
| *** moshele has joined #tripleo | 06:42 | |
| *** jtomasek has joined #tripleo | 06:43 | |
| *** jtomasek has quit IRC | 06:45 | |
| *** dbecker has joined #tripleo | 06:45 | |
| *** jtomasek has joined #tripleo | 06:46 | |
| *** jaosorior has joined #tripleo | 06:50 | |
| *** fragatina has quit IRC | 07:03 | |
| *** fragatina has joined #tripleo | 07:03 | |
| *** holser__ has joined #tripleo | 07:03 | |
| *** pcaruana has joined #tripleo | 07:08 | |
| *** rcernin has quit IRC | 07:10 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 07:10 |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Update network_data.yaml file in swift for updata/upgrade https://review.openstack.org/556364 | 07:12 |
| *** ebarrera has joined #tripleo | 07:13 | |
| *** jaganathan has joined #tripleo | 07:16 | |
| openstackgerrit | Harald Jensås proposed openstack/instack-undercloud master: Fix help string for subnets option https://review.openstack.org/554895 | 07:22 |
| *** tesseract has joined #tripleo | 07:23 | |
| *** moshele has quit IRC | 07:25 | |
| *** moshele has joined #tripleo | 07:26 | |
| *** ykarel__ is now known as ykarel|lunch | 07:37 | |
| jaosorior | What Redis version are we using? | 07:39 |
| bandini | sec | 07:41 |
| bandini | jaosorior: downstream it is redis-3.2.8-2.el7ost.x86_64 (in upcoming osp13) | 07:42 |
| bandini | so I presume the same is in upstream rdo repos | 07:42 |
| jaosorior | cool cool | 07:42 |
| *** ukalifon has joined #tripleo | 07:44 | |
| jaosorior | thanks | 07:44 |
| *** tosky has joined #tripleo | 07:46 | |
| *** dpawar has quit IRC | 07:48 | |
| *** dpawar has joined #tripleo | 07:48 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add Ironic Networking Baremetal Templates https://review.openstack.org/547318 | 07:49 |
| *** dsariel has joined #tripleo | 07:50 | |
| *** mdnadeem has joined #tripleo | 07:52 | |
| *** fragatina has quit IRC | 07:53 | |
| *** shardy has joined #tripleo | 07:55 | |
| *** suuuper has joined #tripleo | 07:57 | |
| *** lucas-afk is now known as lucasagomes | 07:58 | |
| *** jpich has joined #tripleo | 07:58 | |
| *** pkovar has joined #tripleo | 07:59 | |
| openstackgerrit | Julie Pichon proposed openstack/instack-undercloud stable/queens: Add configuration for the Nova proxy endpoint https://review.openstack.org/556396 | 08:03 |
| openstackgerrit | Julie Pichon proposed openstack/instack-undercloud stable/queens: Add Nova UI endpoints to the endpoint list https://review.openstack.org/556398 | 08:03 |
| openstackgerrit | Julie Pichon proposed openstack/puppet-tripleo stable/queens: Add configuration for the Nova proxy endpoint https://review.openstack.org/556399 | 08:03 |
| *** kopecmartin has joined #tripleo | 08:04 | |
| *** cylopez has joined #tripleo | 08:06 | |
| *** moshele has quit IRC | 08:08 | |
| *** egallen has joined #tripleo | 08:08 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 08:10 |
| *** moshele has joined #tripleo | 08:12 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Re-use undercloud upgrades tasks. https://review.openstack.org/552303 | 08:12 |
| *** radeks has joined #tripleo | 08:13 | |
| *** panda|off is now known as panda | 08:16 | |
| *** ykarel|lunch is now known as ykarel | 08:19 | |
| *** ktibi has joined #tripleo | 08:20 | |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Update network_data.yaml file in swift for update/upgrade https://review.openstack.org/556364 | 08:20 |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart master: Fix checking if the overcloud group is empty https://review.openstack.org/556423 | 08:21 |
| *** derekh has joined #tripleo | 08:23 | |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Update network_data.yaml file in swift for update/upgrade https://review.openstack.org/556364 | 08:25 |
| *** athomas has joined #tripleo | 08:27 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/555687 | 08:29 |
| *** akrivoka has joined #tripleo | 08:36 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade stable/queens: Add roles-data into overcloud upgrade prepare. https://review.openstack.org/555389 | 08:41 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade stable/queens: DNM: Testing P->Q from queens branch. https://review.openstack.org/552080 | 08:41 |
| *** cylopez has left #tripleo | 08:43 | |
| *** pblaho has joined #tripleo | 08:51 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates stable/queens: Consume ceph-container project's new style of tags https://review.openstack.org/556446 | 08:54 |
| *** moguimar has quit IRC | 08:57 | |
| *** dciabrin_ has joined #tripleo | 08:57 | |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Update network_data.yaml file in swift for update/upgrade https://review.openstack.org/556364 | 08:58 |
| *** pgadiya has quit IRC | 08:59 | |
| *** dciabrin has quit IRC | 09:00 | |
| *** ccamacho has joined #tripleo | 09:02 | |
| *** pgadiya has joined #tripleo | 09:02 | |
| *** ccamacho is now known as ccamacho|PTO | 09:03 | |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Update network_data.yaml file in swift for update/upgrade https://review.openstack.org/556364 | 09:04 |
| *** avivgt has joined #tripleo | 09:04 | |
| *** bogdando has joined #tripleo | 09:05 | |
| *** gfidente has joined #tripleo | 09:06 | |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 09:10 |
| *** udesale_ has joined #tripleo | 09:10 | |
| *** udesale has quit IRC | 09:10 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Fix validate-template-override. https://review.openstack.org/539519 | 09:12 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates stable/queens: Add pre_upgrade_rolling_tasks https://review.openstack.org/556454 | 09:12 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Add support in nodepool-setup for branched tripleo-upgrade. https://review.openstack.org/553779 | 09:13 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: Ensure ansible-pacemaker is present on the undercloud. https://review.openstack.org/554236 | 09:14 |
| *** udesale_ has quit IRC | 09:15 | |
| *** sshnaidm|off has quit IRC | 09:15 | |
| *** udesale has joined #tripleo | 09:16 | |
| *** egallen has quit IRC | 09:18 | |
| *** yurii has joined #tripleo | 09:20 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations stable/pike: Fix the nova config file location https://review.openstack.org/556457 | 09:21 |
| *** salmankhan has joined #tripleo | 09:21 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-docs master: Refactor backup and restore docs https://review.openstack.org/544975 | 09:23 |
| *** moguimar has joined #tripleo | 09:24 | |
| bogdando | o/ let's merge a backport please https://review.openstack.org/#/c/554993/ | 09:30 |
| bogdando | PTAL https://review.openstack.org/#/c/555338/ | 09:31 |
| *** srini_ has joined #tripleo | 09:34 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Fix checking if the overcloud group is empty https://review.openstack.org/556463 | 09:38 |
| social | therve: any idea what should FFU do with https://review.openstack.org/#/c/555312/ ? as we don't use the tripleo-client yet | 09:41 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Make HA containers log to /var/log/containers after upgrade https://review.openstack.org/556294 | 09:41 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Conventional log directories for pacemaker bundles https://review.openstack.org/519419 | 09:41 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Implement MasqueradeNetworks services https://review.openstack.org/553427 | 09:42 |
| therve | social, Yeah I mentioned it on the review :) | 09:44 |
| therve | I don't know what you mean about tripleo client though | 09:44 |
| *** karthiks has quit IRC | 09:46 | |
| social | therve: well the tripleo-common patch would mean need to use client for FFU wouldn't it? | 09:46 |
| social | therve: or it would be modifying the deploy | 09:46 |
| *** paramite_ has joined #tripleo | 09:46 | |
| therve | social, It changes heat install | 09:46 |
| therve | So no I don't think it means using the client | 09:47 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Upgrade data on disk on mariadb major upgrade https://review.openstack.org/546666 | 09:47 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-docs master: Refactor backup and restore docs https://review.openstack.org/544975 | 09:48 |
| social | therve: I don't fully understand how would heat know that now we want to add the noop and now we want to remove it? | 09:49 |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Update network_data.yaml file in swift for update/upgrade https://review.openstack.org/556364 | 09:50 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Remove adjust-interface-mtus script https://review.openstack.org/546216 | 09:56 |
| *** salmankhan has quit IRC | 09:57 | |
| *** salmankhan has joined #tripleo | 09:57 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: undercloud: add missing TLS environments when preparing containers https://review.openstack.org/545444 | 09:58 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Remove adjust-interface-mtus script https://review.openstack.org/546216 | 10:01 |
| *** gyankum has quit IRC | 10:01 | |
| openstackgerrit | Damien Ciabrini proposed openstack/puppet-tripleo stable/queens: Conventional log directories for pacemaker bundles https://review.openstack.org/556470 | 10:02 |
| openstackgerrit | Damien Ciabrini proposed openstack/tripleo-heat-templates stable/queens: Upgrade data on disk on mariadb major upgrade https://review.openstack.org/556471 | 10:02 |
| *** jpich has quit IRC | 10:03 | |
| *** jpich has joined #tripleo | 10:08 | |
| *** jpich has quit IRC | 10:08 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757474 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1757474 in tripleo "periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset027-master fails with undefined groups.overcloud" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 10:10 |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 10:10 |
| *** jpich has joined #tripleo | 10:10 | |
| *** jpich has quit IRC | 10:11 | |
| *** jpich has joined #tripleo | 10:15 | |
| *** jpich has quit IRC | 10:16 | |
| *** jpich has joined #tripleo | 10:17 | |
| *** jpich has quit IRC | 10:21 | |
| *** jpich has joined #tripleo | 10:21 | |
| *** egallen has joined #tripleo | 10:22 | |
| *** jpich has quit IRC | 10:22 | |
| shardy | Morning all, is anyone else having issues with the docker.io/tripleomaster images today? | 10:25 |
| shardy | http://paste.openstack.org/show/713879/ | 10:25 |
| shardy | mandre: ^^ perhaps you've seen something? I'm testing overcloud deploy on a new quickstart setup | 10:25 |
| *** jpich has joined #tripleo | 10:30 | |
| *** jpich has quit IRC | 10:31 | |
| *** sshnaidm has joined #tripleo | 10:34 | |
| *** egallen has quit IRC | 10:38 | |
| ykarel | shardy, hmm not working for me as well | 10:43 |
| *** egallen has joined #tripleo | 10:46 | |
| shardy | Hmm I think my env is trying to pull the wrong names due to an old tripleo-common actually | 10:47 |
| shardy | https://hub.docker.com/r/tripleomaster/centos-binary-swift-proxy-server/ but my env is trying to pull openstack-swift-proxy-server | 10:48 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Parametrize overcloud-prep-containers script name. https://review.openstack.org/548472 | 10:48 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add support to mixed upgrade for overcloud-prep-container role. https://review.openstack.org/540473 | 10:48 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Use rhos-release role pin puddle option https://review.openstack.org/555976 | 10:48 |
| openstackgerrit | Merged openstack/python-tripleoclient stable/queens: Wire up a --skip-tags parameter for overcloud upgrade run cli https://review.openstack.org/553372 | 10:48 |
| ykarel | shardy, hmm just checked you have wrong image being pulled | 10:49 |
| shardy | ykarel: yeah | 10:49 |
| *** salmankhan has quit IRC | 10:50 | |
| shardy | something messed up in my environment I think | 10:50 |
| *** jpich has joined #tripleo | 10:51 | |
| *** egallen has quit IRC | 10:53 | |
| *** egallen has joined #tripleo | 10:59 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: Work around faulty package in iptables. https://review.openstack.org/554647 | 10:59 |
| *** jaosorior has quit IRC | 11:01 | |
| openstackgerrit | Derek Higgins proposed openstack/puppet-tripleo master: Wrap bind IP for docker registry if IPv6 https://review.openstack.org/554608 | 11:02 |
| *** holser___ has joined #tripleo | 11:02 | |
| *** bogdando_ has joined #tripleo | 11:03 | |
| *** bogdando has quit IRC | 11:03 | |
| *** bogdando_ is now known as bogdando | 11:03 | |
| *** holser__ has quit IRC | 11:04 | |
| *** marios has quit IRC | 11:05 | |
| *** marios has joined #tripleo | 11:06 | |
| *** egallen has quit IRC | 11:08 | |
| *** salmankhan has joined #tripleo | 11:08 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: Work around packaging issue in iptables-services. https://review.openstack.org/554647 | 11:09 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757474 | 11:10 |
| openstack | Launchpad bug 1757474 in tripleo "periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset027-master fails with undefined groups.overcloud" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 11:10 |
| *** jpich has quit IRC | 11:11 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Ensure ansible-pacemaker installation for updates/upgrades. https://review.openstack.org/556487 | 11:12 |
| *** egallen has joined #tripleo | 11:12 | |
| therve | social, Sorry back | 11:13 |
| therve | social, So the idea is to have a tripleo specific subclass, and to revert to that | 11:13 |
| therve | I should probably do it | 11:14 |
| *** jpich has joined #tripleo | 11:19 | |
| *** karthiks has joined #tripleo | 11:20 | |
| *** shreshtha has quit IRC | 11:20 | |
| *** egallen has quit IRC | 11:20 | |
| *** shreshtha has joined #tripleo | 11:21 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-common master: Enrich integration with ironic networking features https://review.openstack.org/556490 | 11:22 |
| *** quiquell is now known as quiquell|lunch | 11:22 | |
| *** jlabarre has joined #tripleo | 11:22 | |
| *** pradk has joined #tripleo | 11:23 | |
| openstackgerrit | Thomas Herve proposed openstack/tripleo-common master: Add custom subclass to revert mapping https://review.openstack.org/556491 | 11:23 |
| *** egallen has joined #tripleo | 11:24 | |
| *** egallen has quit IRC | 11:24 | |
| openstackgerrit | Thomas Herve proposed openstack/tripleo-heat-templates master: Revert config-download mappings in upgrade converge step https://review.openstack.org/555312 | 11:24 |
| therve | social, gfidente ^^^ | 11:24 |
| *** liverpooler has quit IRC | 11:25 | |
| *** jpich has quit IRC | 11:25 | |
| jtomasek | shardy: I am starting to feel that determining deployment status based on saved messages is not enough as it is. problem is that if the workflow did not finish (yet), the status is not updated. | 11:26 |
| *** jpich has joined #tripleo | 11:26 | |
| *** egallen has joined #tripleo | 11:27 | |
| *** ansmith has quit IRC | 11:27 | |
| *** jpich has quit IRC | 11:28 | |
| jtomasek | shardy: using workflow execution for this is quite ideal as it is created right when workflow is started and wraps whole deployment process, so by looking at the execution we would be able to very easily determine the status. Also on undeploy, we could remove the execution, so a deployment is considered not deployed, when there is no tripleo.v1.deploy_plan execution (with the input: {<currentPlan>}) | 11:28 |
| *** jpich has joined #tripleo | 11:29 | |
| jtomasek | shardy: only problem is the persistence of the execution. if we could persist only some of the executions with mistral, that would be ideal | 11:29 |
| *** jpich has quit IRC | 11:29 | |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: Add multinode-overcloud-update playbook to run list https://review.openstack.org/547058 | 11:29 |
| *** jpich has joined #tripleo | 11:30 | |
| *** jpich has quit IRC | 11:30 | |
| *** shardy has quit IRC | 11:30 | |
| *** slagle has joined #tripleo | 11:30 | |
| *** pdeore has quit IRC | 11:30 | |
| *** adarazs is now known as adarazs_lunch | 11:31 | |
| *** fultonj has joined #tripleo | 11:32 | |
| *** egallen has quit IRC | 11:33 | |
| therve | jtomasek, Why, there are too many executions for the same workflow? | 11:35 |
| *** shardy has joined #tripleo | 11:36 | |
| *** dtantsur|afk is now known as dtantsur | 11:37 | |
| jtomasek | therve: yes, currently the executions are not persisted forever. d0ugal said executions are not designed to be persisted. | 11:38 |
| jtomasek | shardy: did you see my messages ^^^? | 11:38 |
| therve | Hum, really | 11:38 |
| *** shreshtha has quit IRC | 11:40 | |
| *** salmankhan has quit IRC | 11:40 | |
| *** jaosorior has joined #tripleo | 11:40 | |
| *** egallen has joined #tripleo | 11:41 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: Add support for Designate https://review.openstack.org/518983 | 11:44 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Fix image_cache_expire_days https://review.openstack.org/554627 | 11:44 |
| jaosorior | if I have a change that adds a script to tripleo-common, what do I need to do to get that included in the package? This https://review.openstack.org/#/c/554926/ is failing because of the package creation it seems | 11:45 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: add lower-constraints job https://review.openstack.org/556266 | 11:46 |
| *** jpich has joined #tripleo | 11:46 | |
| *** jpich has quit IRC | 11:47 | |
| *** egallen has quit IRC | 11:47 | |
| *** yurii has quit IRC | 11:48 | |
| *** yurii has joined #tripleo | 11:48 | |
| *** salmankhan has joined #tripleo | 11:48 | |
| *** tcw has joined #tripleo | 11:48 | |
| *** jpich has joined #tripleo | 11:49 | |
| hjensas | jaosorior: Possibly an update to the rpm spec file in: https://review.rdoproject.org/r/#/admin/projects/openstack/tripleo-common-distgit | 11:49 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: DNM, test ovs-2.9 https://review.openstack.org/555873 | 11:50 |
| *** jpich has quit IRC | 11:50 | |
| *** jpich has joined #tripleo | 11:52 | |
| *** lucasagomes is now known as lucas-hungry | 11:52 | |
| *** pgadiya has quit IRC | 11:52 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: DNM, test ovs-2.9 https://review.openstack.org/555873 | 11:54 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-common master: TLS by default for the overcloud if no certificate provided https://review.openstack.org/554926 | 11:55 |
| *** egallen has joined #tripleo | 11:56 | |
| honza | jpich: thanks for all the backports | 11:57 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: A keystone only controller deployment https://review.openstack.org/553048 | 11:57 |
| *** anande has joined #tripleo | 11:57 | |
| jpich | honza: Np! | 11:57 |
| *** mcornea has joined #tripleo | 11:58 | |
| *** avivgt has quit IRC | 11:58 | |
| *** atoth has joined #tripleo | 11:59 | |
| *** rfolco|off is now known as rfolco|ruck | 11:59 | |
| *** abishop has joined #tripleo | 12:00 | |
| weshay | need reviews on https://review.openstack.org/#/c/556350/ please | 12:02 |
| *** morazi has joined #tripleo | 12:02 | |
| *** dprince has joined #tripleo | 12:03 | |
| *** leanderthal has joined #tripleo | 12:03 | |
| *** jpich has quit IRC | 12:03 | |
| *** raildo has joined #tripleo | 12:04 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/paunch master: Allow to limit cgroup cpu shares https://review.openstack.org/554539 | 12:04 |
| *** egallen has quit IRC | 12:04 | |
| *** suuuper has quit IRC | 12:06 | |
| *** thrash|g0ne is now known as thrash | 12:07 | |
| *** egallen has joined #tripleo | 12:07 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757474 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1757474 in tripleo "periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset027-master fails with undefined groups.overcloud" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 12:10 |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 12:10 |
| *** panda is now known as panda|lunch | 12:11 | |
| *** quiquell|lunch is now known as quiquell | 12:13 | |
| *** fragatina has joined #tripleo | 12:16 | |
| *** jpich has joined #tripleo | 12:18 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Change default output-dir to be $HOME https://review.openstack.org/554997 | 12:20 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Add validation-errors-nonfatal and debug into updates job. https://review.openstack.org/554891 | 12:20 |
| *** egallen has quit IRC | 12:21 | |
| *** cylopez has joined #tripleo | 12:22 | |
| *** pradk has quit IRC | 12:22 | |
| *** lucas-hungry is now known as lucasagomes | 12:25 | |
| *** ratailor has quit IRC | 12:26 | |
| *** ratailor has joined #tripleo | 12:26 | |
| *** adarazs_lunch is now known as adarazs | 12:26 | |
| *** psahoo has quit IRC | 12:28 | |
| *** jcoufal has joined #tripleo | 12:29 | |
| *** ratailor has quit IRC | 12:30 | |
| *** chem has joined #tripleo | 12:35 | |
| *** egallen has joined #tripleo | 12:35 | |
| *** cylopez has left #tripleo | 12:36 | |
| openstackgerrit | Thomas Herve proposed openstack/tripleo-common master: Add custom subclass to revert mapping https://review.openstack.org/556491 | 12:37 |
| shardy | jtomasek: Hi sorry been at lunch, I missed your messages but reading the logs now | 12:37 |
| openstackgerrit | Thomas Herve proposed openstack/tripleo-heat-templates master: Revert config-download mappings in upgrade converge step https://review.openstack.org/555312 | 12:37 |
| shardy | jtomasek: Could we have a workflow/action that checks for executions, and falls back to the swift message if they have expired? | 12:37 |
| *** liverpooler has joined #tripleo | 12:38 | |
| *** rlandy has joined #tripleo | 12:38 | |
| shardy | jtomasek: I don't believe it's possible to conditionally disable expiration of workflow executions, but I guess we could look into it | 12:38 |
| shardy | jtomasek: the other option is to send an IN_PROGRESS message at the start of the workflow? | 12:38 |
| shardy | jtomasek: I was expecting us to potentially add some more verbose messages like that | 12:39 |
| jtomasek | shardy: I've started to look into doing option 1 in GUI directly (as we already fetch executions, but having it in mistral makes sense | 12:39 |
| shardy | jtomasek: I'm thinking the best from a performance point of view would be to write the in progress message? | 12:40 |
| shardy | then you only have to poll one place? | 12:40 |
| bandini | can anyone take a look at these two simple cherry-picks ? https://review.openstack.org/#/c/556210/ and https://review.openstack.org/#/c/556211/ | 12:41 |
| jtomasek | shardy: yeah, that could work | 12:41 |
| shardy | jtomasek: Ok should I push a patch which does that or would you like to do it? | 12:42 |
| jtomasek | shardy: it would be cool if you could add the patch | 12:42 |
| jtomasek | shardy: if you have time of course | 12:43 |
| shardy | jtomasek: sure I've got some meetings but will try to push it this afternoon | 12:43 |
| jtomasek | shardy: ok | 12:43 |
| *** Goneri has joined #tripleo | 12:44 | |
| *** egallen has quit IRC | 12:44 | |
| shardy | bandini: Added one question to the action patch, I assume nowhere actually passes fence_action in the workbooks? | 12:45 |
| bandini | shardy: so it was always a big no no to use those and we removed them fully from tripleoclient as well | 12:46 |
| shardy | grep says no so I guess we're OK provided nobody wrote any custom workflows | 12:46 |
| therve | weshay, I have a few pending patches in quickstart-extras, do you know who can have a look? https://review.openstack.org/#/q/owner:therve%2540redhat.com+status:open+project:openstack/tripleo-quickstart-extras | 12:46 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: undercloud: workaround for masquerading network in CI/OVB https://review.openstack.org/553620 | 12:46 |
| openstackgerrit | Merged openstack/tripleo-common master: Check if plan_env has resource_registry key https://review.openstack.org/554237 | 12:46 |
| bandini | ack | 12:47 |
| *** dtantsur is now known as dtantsur|brb | 12:49 | |
| *** pchavva has joined #tripleo | 12:50 | |
| *** fragatina has quit IRC | 12:51 | |
| *** ansmith has joined #tripleo | 12:52 | |
| *** psachin has quit IRC | 12:53 | |
| *** egallen has joined #tripleo | 12:54 | |
| *** mcornea_ has joined #tripleo | 12:54 | |
| *** aputtur_ has joined #tripleo | 12:56 | |
| *** mcornea has quit IRC | 12:57 | |
| *** toure|gone is now known as toure | 12:57 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Always hard link http boot contents for Ironic https://review.openstack.org/556516 | 12:58 |
| *** jmelvin has joined #tripleo | 13:00 | |
| *** egallen has quit IRC | 13:01 | |
| *** panda|lunch is now known as panda | 13:03 | |
| *** nyechiel_ has joined #tripleo | 13:04 | |
| *** skramaja has quit IRC | 13:04 | |
| *** eck`gone is now known as eck` | 13:05 | |
| *** masco_ has quit IRC | 13:07 | |
| *** egallen has joined #tripleo | 13:07 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Always hard link http boot contents for Ironic https://review.openstack.org/556516 | 13:08 |
| *** dsariel has quit IRC | 13:08 | |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757474 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1757474 in tripleo "periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset027-master fails with undefined groups.overcloud" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 13:10 |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 13:10 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Use auto-evaluated http boot path for Ironic https://review.openstack.org/556522 | 13:10 |
| slagle | dprince: mandre : what actually restarts a container if the config changes? | 13:14 |
| *** yurii has left #tripleo | 13:14 | |
| slagle | dprince: mandre : i see in docker-puppet.py where we write out TRIPLEO_CONFIG_HASH to the startup-config, but what actually consumes this? | 13:14 |
| slagle | i suspected paunch, but I don't see any special handling restart logic there | 13:14 |
| mandre | slagle: it's being taken care of by paunch | 13:14 |
| shardy | slagle: paunch sees the container environment changed, so it restarts it | 13:14 |
| *** yurii has joined #tripleo | 13:15 | |
| shardy | slagle: IIRC it just restarts the container if anything in the definition changed? | 13:15 |
| dprince | slagle: paunch | 13:15 |
| *** tzumainn has joined #tripleo | 13:15 | |
| *** egallen has quit IRC | 13:16 | |
| slagle | so paunch consumes TRIPLEO_CONFIG_HASH? | 13:16 |
| slagle | how come my grep returns nothing | 13:16 |
| shardy | slagle: No it's just a salt to change the json config paunch consumes | 13:17 |
| shardy | it's not explicitly handled | 13:17 |
| shardy | slagle: it could be a key with any name, the point is something changed | 13:17 |
| mandre | slagle: let me look at the code again | 13:17 |
| mandre | slagle: the TRIPLEO_CONFIG_HASH ends up being passed to paunch as the --config-id opt for each container | 13:19 |
| *** egallen has joined #tripleo | 13:20 | |
| *** leseb has quit IRC | 13:23 | |
| mandre | slagle: sorry my bad, rather it's passed as env variable to each container and paunch notices when a new value is passed | 13:23 |
| shardy | yeah it's just an ignored environment variable IIRC | 13:23 |
| *** leseb has joined #tripleo | 13:24 | |
| mandre | correct | 13:26 |
| slagle | hmm, i'm just not seeing how this is handled anywhere | 13:26 |
| *** egallen has quit IRC | 13:27 | |
| slagle | i'll keep looking. but i don't see any restart logic. i assume it's obvious somewhere and i must be looking in the wrong place | 13:27 |
| mandre | slagle: see for example how the variable is written down in json files such as /var/lib/tripleo-config/hashed-docker-container-startup-config-step_3.json | 13:27 |
| slagle | sure, i understand how it's supposed to work. just looking for the code that does it | 13:28 |
| *** nyechiel_ has quit IRC | 13:28 | |
| slagle | am trying to triage this bug fwiw: https://bugzilla.redhat.com/show_bug.cgi?id=1559105 | 13:28 |
| openstack | bugzilla.redhat.com bug 1559105 in openstack-tripleo "OC update does not set additional RBD Cinder backend on stack update" [High,New] - Assigned to jslagle | 13:28 |
| *** lblanchard has joined #tripleo | 13:29 | |
| *** tosky__ has joined #tripleo | 13:29 | |
| *** tosky has quit IRC | 13:31 | |
| shardy | https://github.com/openstack/paunch/blob/master/paunch/builder/compose1.py#L109 | 13:33 |
| shardy | slagle: I think it's ^^ which does it? It deletes any changed containers, then starts them again? | 13:33 |
| shardy | vs actually doing a docker restart | 13:33 |
| *** egallen has joined #tripleo | 13:34 | |
| *** anande has quit IRC | 13:34 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: Support custom stack names during FFU https://review.openstack.org/555975 | 13:34 |
| slagle | shardy: must be. thanks | 13:36 |
| mandre | slagle: sooo... in docker-puppet.py we only add the TRIPLEO_CONFIG_HASH variable to the environment if the container mounts a config_volume | 13:37 |
| mandre | and the cinder-volume container doesn't mount anything, so it's not restarted when the config in /var/lib/config-data/cinder is updated | 13:38 |
| shardy | aha | 13:38 |
| *** trown is now known as trown|brb | 13:40 | |
| mandre | slagle: in the case the container mounts files from more than one config_volume, the TRIPLEO_CONFIG_HASH ends up being a concatenation of the config_volumes's hashes | 13:40 |
| *** egallen has quit IRC | 13:40 | |
| openstackgerrit | Doug Hellmann proposed openstack/diskimage-builder master: add lower-constraints job https://review.openstack.org/555412 | 13:42 |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-quickstart-extras master: FOR TESTING ONLY.. TESTING OVS 2.9 upgrade https://review.openstack.org/506888 | 13:45 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates master: Upgrades: Refactor httpd_enabled variable https://review.openstack.org/555781 | 13:46 |
| *** aufi has quit IRC | 13:47 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: undercloud: add missing TLS environments when preparing containers https://review.openstack.org/545444 | 13:48 |
| *** trown|brb is now known as trown | 13:48 | |
| *** aufi has joined #tripleo | 13:48 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Always hard link http boot contents for Ironic https://review.openstack.org/556516 | 13:50 |
| *** cylopez has joined #tripleo | 13:51 | |
| *** egallen has joined #tripleo | 13:52 | |
| *** cylopez has left #tripleo | 13:53 | |
| *** udesale has quit IRC | 13:53 | |
| *** dsariel has joined #tripleo | 13:54 | |
| slagle | mandre: where does cinder-volume get it's config from? the host? | 13:54 |
| *** udesale has joined #tripleo | 13:55 | |
| *** jaosorior has quit IRC | 13:58 | |
| *** egallen has quit IRC | 13:59 | |
| *** elgxl has joined #tripleo | 14:00 | |
| *** aufi has quit IRC | 14:00 | |
| slagle | it seems the issue is that pacemaker bundles are oblivious to config changes | 14:01 |
| *** jistr is now known as jistr|mtg | 14:02 | |
| *** aufi has joined #tripleo | 14:02 | |
| *** beekneemech is now known as bnemec | 14:03 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Remove the os-net-config element config.json template https://review.openstack.org/556533 | 14:04 |
| *** mcornea_ is now known as mcornea | 14:04 | |
| *** brault has joined #tripleo | 14:07 | |
| *** moshele has quit IRC | 14:09 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757474 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1757474 in tripleo "periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset027-master fails with undefined groups.overcloud" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 14:10 |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 14:10 |
| *** etingof has quit IRC | 14:11 | |
| *** chem has quit IRC | 14:11 | |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Remove the noop deploystep for upgrade converge step https://review.openstack.org/554880 | 14:12 |
| *** yurii1 has joined #tripleo | 14:13 | |
| *** yurii has quit IRC | 14:14 | |
| *** yurii1 is now known as yurii | 14:14 | |
| *** avivgt has joined #tripleo | 14:14 | |
| *** dtantsur|brb is now known as dtantsur | 14:15 | |
| openstackgerrit | Bob Fournier proposed openstack/tripleo-heat-templates master: Remove config.json for old style nic config files when using new style https://review.openstack.org/556539 | 14:17 |
| *** nyechiel_ has joined #tripleo | 14:20 | |
| *** salmankhan has quit IRC | 14:21 | |
| *** ihrachys has quit IRC | 14:25 | |
| *** chem has joined #tripleo | 14:25 | |
| *** ihrachys has joined #tripleo | 14:25 | |
| *** avivgta has joined #tripleo | 14:26 | |
| *** avivgt has quit IRC | 14:27 | |
| *** jistr|mtg is now known as jistr | 14:27 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates stable/queens: Add access to /var/run/openvswitch from collectd https://review.openstack.org/556547 | 14:30 |
| *** nyechiel_ has quit IRC | 14:30 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-common master: Add healthcheck script for Horizon https://review.openstack.org/550118 | 14:31 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-common master: Add healthcheck script for neutron-sriov-agent https://review.openstack.org/555262 | 14:31 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-common master: Add healthcheck script for libvirtd https://review.openstack.org/550492 | 14:32 |
| *** links has quit IRC | 14:32 | |
| *** salmankhan has joined #tripleo | 14:37 | |
| *** jobewan has joined #tripleo | 14:37 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: HAProxy: fix bind mount to expose stats socket https://review.openstack.org/555928 | 14:40 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Replace perl with awk https://review.openstack.org/554993 | 14:40 |
| openstackgerrit | Merged openstack/tripleo-common master: Raise an error if deployment_name cannot be determined https://review.openstack.org/554614 | 14:40 |
| *** hjensas has quit IRC | 14:40 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Remove the os-net-config element config.json template https://review.openstack.org/556533 | 14:42 |
| mandre | slagle: if it's pacemaker, the cinder-volume volumes come from https://github.com/openstack/puppet-tripleo/blob/729bac126e73cb0ff4235c848edd070994d11696/manifests/profile/pacemaker/cinder/volume_bundle.pp#L87 | 14:42 |
| *** holser__ has joined #tripleo | 14:42 | |
| slagle | mandre: yea, i found that. then from the paunch side though, nothing re-runs cinder_volume_init_bundle | 14:42 |
| slagle | so i wonder if we should just do that every time? | 14:43 |
| slagle | then hopefully the puppet will trigger pacemaker restarting the container | 14:43 |
| bogdando | PTAL folks https://review.openstack.org/#/c/555338/ | 14:43 |
| *** holser___ has quit IRC | 14:43 | |
| mandre | slagle: IIUC paunch is out of the equation for all pacemaker managed containers, dciabrin_ or bandini can confirm | 14:44 |
| bandini | slagle, mandre: correct, paunch is not involved. so puppet-pacemaker won't restart an existing resource. in the BM days we had this https://review.openstack.org/#/c/358510/ to restart pacemaker-managed resources when config changed | 14:45 |
| slagle | mandre: paunch runs the containers that execute the puppet to configure the bundles in pacemaker | 14:45 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Always hard link http boot contents for Ironic https://review.openstack.org/556516 | 14:45 |
| slagle | mandre: bandini : that's the puppet we need to rerun on stack update so that pacemaker will restart the bundle containers | 14:45 |
| bandini | slagle: right, I don't think that code is working since we containerized | 14:46 |
| slagle | correct. we can't update config for mysql, cinder-volume, rabbitmq | 14:46 |
| bandini | slagle, mandre: FWIW a minor update workflow will restart the pacemaker resources (one node at the time). it's the redeploy against existing overcloud which seems to be problematic | 14:46 |
| bandini | I'll need to think about this a bit more | 14:47 |
| shardy | slagle: is it enough to just mount the config volume to a dummy mountpoint in the relevant docker_config step? | 14:49 |
| *** yamahata has quit IRC | 14:49 | |
| *** ramishra has quit IRC | 14:50 | |
| slagle | shardy: depends. do we want to run the puppet code for the pacemaker bundles on config change or every stack update? | 14:51 |
| slagle | shardy: depends on the delineation of responsibility | 14:51 |
| slagle | to we have to run the puppet every time to answer "has anything changed?" | 14:52 |
| slagle | if so, we probably need to rerun the puppet on every stack update | 14:52 |
| slagle | like we do for host tasks and we used to do for everything on baremetal | 14:53 |
| shardy | slagle: ack, I guess we could pass in DeployIdentifier in that case then? | 14:53 |
| shardy | or maybe a new flag for paunch I guess | 14:53 |
| slagle | or a new option to paunch | 14:54 |
| slagle | yea | 14:54 |
| *** mdnadeem has quit IRC | 14:54 | |
| slagle | bandini: can i assign this bug to you to figure out what the "right" thing to do is? then we can figure out where and how to fix it | 14:55 |
| bandini | slagle: sure | 14:56 |
| openstackgerrit | Rajini Karthik proposed openstack/tripleo-heat-templates stable/queens: Add support for Dell EMC XtremIO Cinder ISCSI Backend https://review.openstack.org/554331 | 14:56 |
| *** jpich has quit IRC | 14:58 | |
| slagle | bandini: fyi, https://bugzilla.redhat.com/show_bug.cgi?id=1559105 | 15:01 |
| openstack | bugzilla.redhat.com bug 1559105 in openstack-tripleo "OC update does not set additional RBD Cinder backend on stack update" [Unspecified,New] - Assigned to michele | 15:01 |
| bandini | slagle: yeah I had already CCed myself ;) | 15:02 |
| bandini | am discussing it with damien | 15:02 |
| *** leifmadsen has quit IRC | 15:02 | |
| *** leifmadsen has joined #tripleo | 15:04 | |
| *** ykarel_ has joined #tripleo | 15:05 | |
| *** chkumar246 has joined #tripleo | 15:05 | |
| *** ykarel has quit IRC | 15:05 | |
| *** dmsimard is now known as dmsimard|cave | 15:05 | |
| *** dpawar has quit IRC | 15:05 | |
| *** chandankumar has quit IRC | 15:06 | |
| *** ykarel__ has joined #tripleo | 15:06 | |
| *** tosky__ is now known as tosky | 15:07 | |
| *** jpich has joined #tripleo | 15:08 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Add pre_upgrade_rolling_tasks https://review.openstack.org/556454 | 15:09 |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Remove fence_action parameter from GenerateFencingParametersAction https://review.openstack.org/556210 | 15:09 |
| openstackgerrit | Merged openstack/python-tripleoclient stable/queens: Deprecate the action parameter for fencing generation. https://review.openstack.org/556211 | 15:09 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Correctly set NeutronMl2PluginBase for OVN scenario https://review.openstack.org/556350 | 15:09 |
| *** ykarel_ has quit IRC | 15:09 | |
| *** chkumar246 has quit IRC | 15:09 | |
| openstackgerrit | Brad P. Crochet proposed openstack/python-tripleoclient master: Change generate fencing parameters to call workflow https://review.openstack.org/548284 | 15:10 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757474 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1757474 in tripleo "periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset027-master fails with undefined groups.overcloud" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 15:10 |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 15:10 |
| *** jpich has quit IRC | 15:12 | |
| *** jpich has joined #tripleo | 15:13 | |
| *** moshele has joined #tripleo | 15:13 | |
| *** shreshtha has joined #tripleo | 15:13 | |
| *** jpich has quit IRC | 15:14 | |
| *** jpich has joined #tripleo | 15:15 | |
| *** jpich has quit IRC | 15:15 | |
| *** ykarel__ is now known as ykarel | 15:16 | |
| *** jpich has joined #tripleo | 15:16 | |
| *** jpich has quit IRC | 15:17 | |
| *** pcaruana has quit IRC | 15:18 | |
| *** jpich has joined #tripleo | 15:19 | |
| *** derekh has quit IRC | 15:19 | |
| *** jpich has quit IRC | 15:19 | |
| *** ykarel is now known as ykarel|afk | 15:19 | |
| *** yurii has quit IRC | 15:20 | |
| *** bogdando has quit IRC | 15:21 | |
| *** hjensas has joined #tripleo | 15:22 | |
| *** hjensas has quit IRC | 15:22 | |
| *** hjensas has joined #tripleo | 15:22 | |
| *** chkumar246 has joined #tripleo | 15:23 | |
| *** ykarel_ has joined #tripleo | 15:23 | |
| *** agurenko has quit IRC | 15:23 | |
| *** mdnadeem has joined #tripleo | 15:24 | |
| openstackgerrit | Clark Boylan proposed openstack/diskimage-builder master: Fix element-provides in debian element https://review.openstack.org/556556 | 15:24 |
| *** ykarel|afk has quit IRC | 15:24 | |
| *** chlong has quit IRC | 15:24 | |
| *** jpich has joined #tripleo | 15:25 | |
| *** hjensas has quit IRC | 15:26 | |
| *** ykarel_ has quit IRC | 15:28 | |
| *** leanderthal has quit IRC | 15:33 | |
| sshnaidm | jfrancoa, do you still use my patch for undercloud upgrade job? https://review.openstack.org/#/c/554882/ | 15:34 |
| jfrancoa | sshnaidm: sure, it does, otherwise mine wouldn't work | 15:34 |
| sshnaidm | jfrancoa, in which patch do you link it? I don't find.. | 15:35 |
| jfrancoa | sshnaidm:https://review.openstack.org/#/c/553850/6 | 15:35 |
| jfrancoa | sshnaidm: in fact, it can't land until your won't be pushed (didn't realize about it till now) | 15:35 |
| sshnaidm | jfrancoa, thanks | 15:36 |
| jfrancoa | sshnaidm: I took also your patch, as it's changing all release files and added the check for yum update using repo_setup_run_update | 15:37 |
| *** jpich has quit IRC | 15:38 | |
| *** jobewan has quit IRC | 15:40 | |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud stable/ocata: Remove hardcoded eth0 MASQUERADE rule https://review.openstack.org/556563 | 15:40 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud stable/newton: Remove hardcoded eth0 MASQUERADE rule https://review.openstack.org/556564 | 15:40 |
| *** elgxl has quit IRC | 15:42 | |
| openstackgerrit | Marios Andreou proposed openstack/python-tripleoclient master: Add --templates by defaut in overcloud upgrade prepare/converge https://review.openstack.org/556566 | 15:43 |
| *** jobewan has joined #tripleo | 15:44 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart master: Add tripleo-upgrade specific parameters. https://review.openstack.org/556567 | 15:46 |
| *** jmelvin has quit IRC | 15:47 | |
| *** mburned is now known as mburned_out | 15:47 | |
| *** abishop_ has joined #tripleo | 15:47 | |
| *** abishop has quit IRC | 15:47 | |
| *** jmelvin has joined #tripleo | 15:47 | |
| *** mburned_out is now known as mburned | 15:47 | |
| *** jcoufal_ has joined #tripleo | 15:48 | |
| *** jpich has joined #tripleo | 15:48 | |
| *** jpich has quit IRC | 15:48 | |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: Add multinode-overcloud-update playbook to run list https://review.openstack.org/547058 | 15:48 |
| *** fragatina has joined #tripleo | 15:49 | |
| *** pradk has joined #tripleo | 15:49 | |
| *** jcoufal has quit IRC | 15:49 | |
| *** jpich has joined #tripleo | 15:50 | |
| *** jpich has quit IRC | 15:50 | |
| *** etingof has joined #tripleo | 15:51 | |
| *** jpich has joined #tripleo | 15:51 | |
| *** jpich has quit IRC | 15:52 | |
| *** jpich has joined #tripleo | 15:52 | |
| *** ykarel_ has joined #tripleo | 15:52 | |
| *** jcoufal_ has quit IRC | 15:53 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade stable/queens: Include connectivity check prepare scripts during FFU https://review.openstack.org/556573 | 15:53 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade stable/queens: Support custom stack names during FFU https://review.openstack.org/556574 | 15:53 |
| *** yamahata has joined #tripleo | 15:53 | |
| *** jcoufal has joined #tripleo | 15:54 | |
| fultonj | kschinck abishop are you guys working on Monday April 2nd? | 15:54 |
| *** pblaho has quit IRC | 15:55 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 15:55 |
| *** rnoriega has quit IRC | 15:56 | |
| *** ebarrera has quit IRC | 15:56 | |
| *** jaosorior has joined #tripleo | 15:56 | |
| * fultonj wrong channel | 15:56 | |
| *** rnoriega has joined #tripleo | 15:57 | |
| *** thrash has quit IRC | 15:57 | |
| *** pchavva has quit IRC | 15:57 | |
| *** ansmith has quit IRC | 15:57 | |
| *** vkhanna has quit IRC | 15:57 | |
| *** dmanchad has quit IRC | 15:57 | |
| *** weshay has quit IRC | 15:57 | |
| *** hewbrocca_afk has quit IRC | 15:57 | |
| *** faceman has quit IRC | 15:57 | |
| *** marios has quit IRC | 16:01 | |
| *** hewbrocca_afk has joined #tripleo | 16:01 | |
| *** thrash has joined #tripleo | 16:01 | |
| *** thrash has joined #tripleo | 16:01 | |
| *** dmanchad has joined #tripleo | 16:01 | |
| *** vkhanna has joined #tripleo | 16:02 | |
| *** weshay has joined #tripleo | 16:02 | |
| *** ansmith has joined #tripleo | 16:02 | |
| *** liverpooler has quit IRC | 16:02 | |
| *** pchavva has joined #tripleo | 16:02 | |
| *** faceman has joined #tripleo | 16:03 | |
| *** salmankhan has quit IRC | 16:03 | |
| *** aufi has quit IRC | 16:04 | |
| *** hjensas has joined #tripleo | 16:04 | |
| *** hjensas has quit IRC | 16:04 | |
| *** hjensas has joined #tripleo | 16:04 | |
| *** salmankhan has joined #tripleo | 16:07 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757474 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1757474 in tripleo "periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset027-master fails with undefined groups.overcloud" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 16:10 |
| *** ansmith has quit IRC | 16:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 16:10 |
| EmilienM | sdoran: hey! I saw you closed https://github.com/ansible/ansible/issues/32503 I guess it's fixed in v2.5.0 ? (first question) | 16:11 |
| EmilienM | sdoran: (second question) what are our plans to upgrade Ansible? | 16:12 |
| *** salmankhan has quit IRC | 16:12 | |
| *** ansmith has joined #tripleo | 16:13 | |
| *** yamahata has quit IRC | 16:14 | |
| *** sshnaidm has quit IRC | 16:14 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Remove adjust-interface-mtus script https://review.openstack.org/546216 | 16:14 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Remove adjust-interface-mtus script https://review.openstack.org/546216 | 16:14 |
| sdoran | EmilienM: It's fixed in 2.5 for `include_role`. | 16:16 |
| EmilienM | sdoran: good to know | 16:16 |
| sdoran | It won't work for `import_role`. I'm not sure if it's backported to 2.4. Will have to check. | 16:16 |
| EmilienM | now, when can we have 2.5 in RDO/TripleO :) | 16:17 |
| *** udesale has quit IRC | 16:17 | |
| sdoran | That I don't know. I'd have to go track down what's doing the Ansible install, which is not something I've looked at yet. | 16:17 |
| *** udesale has joined #tripleo | 16:17 | |
| *** tosky has quit IRC | 16:19 | |
| *** bugzy has quit IRC | 16:21 | |
| *** sai-intrw is now known as sai-ons | 16:22 | |
| *** ktibi has quit IRC | 16:24 | |
| *** moshele has quit IRC | 16:26 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade master: Add debug during stack output creation. https://review.openstack.org/549269 | 16:28 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade master: Add validation-errors-nonfatal when in using deployed-server. https://review.openstack.org/556583 | 16:28 |
| *** bugzy has joined #tripleo | 16:29 | |
| *** bugzy has quit IRC | 16:29 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade stable/queens: Add roles-data into overcloud upgrade prepare. https://review.openstack.org/555389 | 16:29 |
| *** tosky has joined #tripleo | 16:29 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade stable/queens: DNM: Testing P->Q from queens branch. https://review.openstack.org/552080 | 16:29 |
| *** jfrancoa has quit IRC | 16:30 | |
| *** salmankhan has joined #tripleo | 16:31 | |
| *** jpich has quit IRC | 16:32 | |
| *** dsariel has quit IRC | 16:32 | |
| *** shreshtha has quit IRC | 16:33 | |
| *** shreshtha has joined #tripleo | 16:33 | |
| *** agopi|out has joined #tripleo | 16:34 | |
| *** udesale has quit IRC | 16:35 | |
| *** lucasagomes is now known as lucas-afk | 16:37 | |
| *** srini_ has quit IRC | 16:38 | |
| *** elgxl has joined #tripleo | 16:39 | |
| *** radeks has quit IRC | 16:41 | |
| honza | jtomasek: i see you already fixed my patches! | 16:41 |
| rook | dsneddon: hey - is there a tool to convert existing nic-configs from pike -> queens? | 16:41 |
| honza | jtomasek: thanks :) | 16:41 |
| *** trozet has joined #tripleo | 16:42 | |
| jtomasek | honza: np! | 16:42 |
| *** srini_ has joined #tripleo | 16:43 | |
| *** elgxl has quit IRC | 16:43 | |
| *** pcaruana has joined #tripleo | 16:44 | |
| bfournie | rook: https://github.com/openstack/tripleo-heat-templates/blob/master/tools/yaml-nic-config-2-script.py, pick up the latest as there were changes a few days ago | 16:44 |
| bfournie | rook: note this converts the old style to new style. The old style still worked in pike but not in queens | 16:45 |
| *** sshnaidm has joined #tripleo | 16:48 | |
| *** etingof has quit IRC | 16:48 | |
| *** salmankhan has quit IRC | 16:51 | |
| *** zoli is now known as zoli|gone | 16:54 | |
| *** dpawar has joined #tripleo | 16:54 | |
| *** zoli|gone is now known as zoli | 16:54 | |
| *** pblaho has joined #tripleo | 16:55 | |
| *** trown is now known as trown|lunch | 16:56 | |
| *** mdnadeem has quit IRC | 17:00 | |
| *** agopi|out has quit IRC | 17:01 | |
| *** agopi|out has joined #tripleo | 17:01 | |
| mwhahaha | rfolco|ruck, arxcruz|rover, weshay: so where are we at in troubleshooting some of these ssh failures. is there a specific FS we're focusing on? | 17:03 |
| *** agopi|out has quit IRC | 17:05 | |
| weshay | mwhahaha, I need to try something other than 3node, because the deployment failed again | 17:05 |
| rfolco|ruck | mwhahaha, I am still checking if fs017 timeouts are related to fs030 ones. | 17:06 |
| weshay | also working on the test for ovs 29 | 17:06 |
| mwhahaha | k | 17:06 |
| mwhahaha | i guess i can try and spin up a fs30 reproducer and poke at it | 17:06 |
| *** liverpooler has joined #tripleo | 17:09 | |
| rook | bfournie++ | 17:09 |
| rook | thanks! | 17:09 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757474 | 17:10 |
| openstack | Launchpad bug 1757474 in tripleo "periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset027-master fails with undefined groups.overcloud" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 17:10 |
| *** dsariel has joined #tripleo | 17:10 | |
| *** dpawar has quit IRC | 17:12 | |
| *** moshele has joined #tripleo | 17:12 | |
| *** panda is now known as panda|off | 17:14 | |
| *** dtantsur is now known as dtantsur|afk | 17:15 | |
| *** salmankhan has joined #tripleo | 17:16 | |
| rook | bfournie: do we have something for the roles_data? | 17:17 |
| rook | to convert for version to version? | 17:17 |
| *** kopecmartin has quit IRC | 17:18 | |
| *** dpawar has joined #tripleo | 17:18 | |
| *** salmankhan has quit IRC | 17:20 | |
| EmilienM | weshay, mwhahaha : what does it take to upgrade ansible in RDO (and everywhere else...?) | 17:21 |
| mwhahaha | EmilienM: NO. | 17:22 |
| EmilienM | :-o | 17:22 |
| mwhahaha | you cannot haz new ansible | 17:22 |
| EmilienM | but but | 17:22 |
| EmilienM | whiiii? | 17:22 |
| *** moshele has quit IRC | 17:23 | |
| EmilienM | we have ansible-2.4.2.0-2.el7.noarch now | 17:23 |
| weshay | EmilienM, what do you mean everywhere else? | 17:23 |
| EmilienM | weshay: osp etc | 17:23 |
| weshay | EmilienM, that is a question for #rel-del | 17:24 |
| EmilienM | sdoran: I think that's the pr for 2.4 https://github.com/ansible/ansible/pull/32565 | 17:25 |
| *** agopi|out has joined #tripleo | 17:26 | |
| *** akrivoka has quit IRC | 17:26 | |
| *** ykarel_ is now known as ykarel|away | 17:27 | |
| *** srini_ has quit IRC | 17:27 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates master: Enable ironic rescue mode by default https://review.openstack.org/555336 | 17:29 |
| mwhahaha | EmilienM: i don't think we're pulling in anything special. What version has that PR? 2.4.3.0? | 17:30 |
| EmilienM | mwhahaha: i don't know yet | 17:31 |
| EmilienM | github makes it very hard to find where patches are in which tag etc | 17:31 |
| *** dpawar has quit IRC | 17:31 | |
| mwhahaha | also i don't think we lock to a specific ansible version for anything so we'd need to test regressions in older versions | 17:31 |
| *** dsariel has quit IRC | 17:31 | |
| EmilienM | fungi: hey, could you please give a status on the storyboard migration for tripleo-ui bugs? | 17:32 |
| *** cylopez has joined #tripleo | 17:32 | |
| EmilienM | I don't see much bugs on https://storyboard.openstack.org/#!/project/964 | 17:32 |
| mwhahaha | EmilienM: this github PR is a train wreck | 17:33 |
| EmilienM | it is | 17:33 |
| mwhahaha | EmilienM: it's not merged yet | 17:33 |
| fungi | EmilienM: yes, since the last test migration of tripleo bugs wit the ui tag, one has been added that initially included a 4-byte codepoint in its bug description. we haven't yet gotten utf8mb4 conversion implemented (we knew that was holding us back from importing some other projects already so it's a priority i've been working on since last week-ish) | 17:34 |
| *** bugzy has joined #tripleo | 17:34 | |
| fungi | it's involved me learning a lot more than i wanted to about mysql's varchar indices | 17:34 |
| EmilienM | fungi: ok, thanks for the update. So for now we keep using launchpad until migration is complete | 17:34 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: DNM turning off container update https://review.openstack.org/556599 | 17:34 |
| fungi | yep, i'm hoping i'll have the initial database migration i flubbed fixed up to include some shortened indices so the table character set conversions actually work in production | 17:35 |
| fungi | in the next day or two | 17:35 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: DNM, test ovs-2.9 https://review.openstack.org/555873 | 17:35 |
| fungi | right now we're using the default mysql "utf8" encoding which only supports up to 3-byte codepoints. switching to utf8mb4 so we can support 4-byte codepoints also means we need to shorten any varchar columns which are used as indices to no more than 191 characters so they don't exceed mysql 2.6's max index width for innodb | 17:37 |
| EmilienM | fungi: thanks for your help | 17:38 |
| fungi | but storyboard has lots of tables, so i'm just now at the stage of hunting down which columns need a migration to shorten them | 17:38 |
| fungi | EmilienM: you're welcome, and apologies it didn't go as planned over the weekend | 17:38 |
| EmilienM | dprince: when you have time this week to review (again) https://review.openstack.org/#/c/550608/ - thanks | 17:38 |
| EmilienM | fungi: no worries, no pressure here | 17:38 |
| *** ebarrera has joined #tripleo | 17:40 | |
| *** thrash is now known as thrash|biab | 17:43 | |
| bfournie | rook: what would you want to convert with the roles_data file? | 17:43 |
| rook | bfournie: I have custom roles... | 17:43 |
| rook | I guess the tool would not know... | 17:43 |
| rook | I have a role for every different type of compute node. | 17:43 |
| bfournie | rook: I don't think we have anything that will convert that, the script above is just for the nic config files since they went to a new format | 17:44 |
| rook | right | 17:44 |
| rook | the roles_data changes too | 17:44 |
| rook | from version to version | 17:44 |
| bfournie | rook: can you give me diffs? I haven't been that involved in roles_data, shardy would know more | 17:45 |
| rook | bfournie: https://github.com/redhat-performance/openstack-templates/blob/master/RDU-Scale/Pike/full-scale-lab-Feb2018/roles_data.yaml#L149-L197 | 17:47 |
| rook | We create a different role for every machine type in the scale lab. | 17:47 |
| rook | Since we have a mix bag of machines in there. | 17:47 |
| rook | Each with different nic layouts. | 17:48 |
| bfournie | rook: do you mean that additional services need to be added to the custom roles in queens? | 17:49 |
| rook | bfournie: If I remember correctly, some services are removed. | 17:49 |
| rook | and some validation catches it | 17:49 |
| rook | and barfs. | 17:49 |
| *** cylopez has quit IRC | 17:50 | |
| bfournie | rook: k, there is a ls | 17:50 |
| rook | eh? | 17:50 |
| bfournie | roles-data-generate script in that same directory | 17:50 |
| rook | ahh | 17:51 |
| bfournie | rook: I haven't used it though… | 17:51 |
| rook | MMV :D | 17:51 |
| *** wolverineav has joined #tripleo | 17:51 | |
| *** wolverineav has quit IRC | 17:52 | |
| *** wolverin_ has joined #tripleo | 17:52 | |
| bfournie | slagle, shardy: have you used tools/roles-data-generate.py? rook would like to convert roles_data.yaml from pike to queens | 17:52 |
| slagle | bfournie: there are proper osc commands for that ... "openstack overcloud role..." | 17:54 |
| slagle | all it does is concatenat the roles files together under roles/ into one file | 17:54 |
| dprince | EmilienM: +2 on the docs. nice job | 17:55 |
| EmilienM | thanks :) nice team work | 17:55 |
| *** owalsh_ is now known as owalsh | 17:56 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Remove adjust-interface-mtus script https://review.openstack.org/546216 | 17:56 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: DO NOT REVIEW - Workarounds for containerized undercloud https://review.openstack.org/545628 | 17:56 |
| bfournie | slagle: I think what rook is hitting is he needs to adjust the services required between pike and queens, roles-data-validation.sh is probably failing, not sure if that must be done manually or there is a script that can do it | 17:57 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Run ovb-ha (fs001) with a containerized undercloud https://review.openstack.org/542556 | 17:57 |
| slagle | bfournie: there's nothing to do that automatically | 17:58 |
| rook | I think it might be hard to feed into the script what I want... | 17:58 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: DNM - Deploy container-multinode (fs010) with a containerized undercloud https://review.openstack.org/542906 | 17:58 |
| openstackgerrit | Clark Boylan proposed openstack/diskimage-builder master: Fix element-provides in debian element https://review.openstack.org/556556 | 17:58 |
| rook | Since there isn't like a defined _role_ it is pretty free form... | 17:58 |
| rook | For instance bfournie I know that 6018rCompute is a compute node, but the script wouldn't | 17:59 |
| rook | unless it just regex'ed the name :) | 17:59 |
| rook | Then you get into weird stuff with HCI/etc... | 17:59 |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: Manage upgrades to a containerized undercloud https://review.openstack.org/549624 | 18:00 |
| *** holser__ has quit IRC | 18:00 | |
| bfournie | rook: yeah true | 18:00 |
| rook | Only if it could just know what I wanted.... | 18:00 |
| *** trown|lunch is now known as trown | 18:03 | |
| *** cylopez has joined #tripleo | 18:08 | |
| *** agopi|out has quit IRC | 18:09 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757474 | 18:10 |
| openstack | Launchpad bug 1757474 in tripleo "periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset027-master fails with undefined groups.overcloud" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 18:10 |
| *** tesseract has quit IRC | 18:10 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Use auto-evaluated http boot path for Ironic https://review.openstack.org/556522 | 18:11 |
| *** ebarrera has quit IRC | 18:11 | |
| *** yamahata has joined #tripleo | 18:16 | |
| *** wolverin_ has quit IRC | 18:19 | |
| *** haleyb has quit IRC | 18:20 | |
| *** cylopez has quit IRC | 18:23 | |
| *** sai_p has joined #tripleo | 18:24 | |
| sai_p | Hello, can someone review this https://review.openstack.org/#/c/546476/2 . Thank you | 18:24 |
| openstackgerrit | Bob Fournier proposed openstack/tripleo-heat-templates master: Remove config.json for old style nic config files when using new style https://review.openstack.org/556539 | 18:27 |
| openstackgerrit | Merged openstack/tripleo-docs master: containers: document kernel for 3rd party https://review.openstack.org/550608 | 18:29 |
| openstackgerrit | Thomas Herve proposed openstack/tripleo-heat-templates master: Revert config-download mappings in upgrade converge step https://review.openstack.org/555312 | 18:30 |
| therve | mcornea ^^^ | 18:30 |
| mcornea | therve: thanks, I'll try it once the stack update finishes | 18:30 |
| therve | I hope it will :) | 18:31 |
| *** SlickNik has quit IRC | 18:31 | |
| mcornea | therve: hm, but this won't work if the environment already has OS::TripleO::StructuredDeployment: ../config-download-structured.yaml set right? I need to start before that for the patch to work if I understand it correctly? | 18:32 |
| therve | Hum, right | 18:33 |
| therve | mcornea, I'll change the names then | 18:33 |
| mcornea | ok | 18:33 |
| openstackgerrit | Thomas Herve proposed openstack/tripleo-common master: Add custom subclass to revert mapping https://review.openstack.org/556491 | 18:34 |
| openstackgerrit | Thomas Herve proposed openstack/tripleo-heat-templates master: Revert config-download mappings in upgrade converge step https://review.openstack.org/555312 | 18:36 |
| therve | mcornea, OK this time hopefully | 18:36 |
| mcornea | therve: thanks, trying | 18:37 |
| *** yamahata has quit IRC | 18:39 | |
| *** jcoufal has quit IRC | 18:40 | |
| *** jobewan has quit IRC | 18:42 | |
| *** fragatina has quit IRC | 18:45 | |
| *** jobewan has joined #tripleo | 18:45 | |
| *** fragatina has joined #tripleo | 18:45 | |
| *** pcaruana has quit IRC | 18:46 | |
| *** thrash|biab is now known as thrash | 18:48 | |
| *** fragatina has quit IRC | 18:57 | |
| *** Goneri has quit IRC | 18:58 | |
| *** haleyb has joined #tripleo | 18:58 | |
| *** atoth has quit IRC | 19:00 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/queens: Conventional log directories for pacemaker bundles https://review.openstack.org/556470 | 19:06 |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Ensure ansible-pacemaker installation for updates/upgrades. https://review.openstack.org/556487 | 19:06 |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Include connectivity check prepare scripts during FFU https://review.openstack.org/554914 | 19:06 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing. https://review.openstack.org/525686 | 19:06 |
| *** moshele has joined #tripleo | 19:10 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757474 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1757474 in tripleo "periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset027-master fails with undefined groups.overcloud" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 19:10 |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 19:10 |
| *** trozet has quit IRC | 19:11 | |
| mcornea | therve: gfidente \o/ I think we have progress, I can see the hieradata and ceph-mgr firewall rules applied | 19:11 |
| mcornea | gfidente: ceph cluster is health_warn too many PGs per OSD (224 > max 200) but at least it now reports the disk usage | 19:12 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Use tripleo-upgrade role for p->q job. https://review.openstack.org/540072 | 19:13 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Upgrade data on disk on mariadb major upgrade https://review.openstack.org/556471 | 19:13 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Ensure ansible-pacemaker is present on the undercloud. https://review.openstack.org/554236 | 19:13 |
| *** shreshtha has quit IRC | 19:13 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-upgrade master: DNM: Add a temp change to spin tripleo-upgrades-check tests https://review.openstack.org/556621 | 19:15 |
| *** moshele has quit IRC | 19:15 | |
| *** agopi|out has joined #tripleo | 19:19 | |
| *** ccamacho|PTO has quit IRC | 19:21 | |
| gfidente | mcornea great and the warning seems valid to me | 19:23 |
| gfidente | mcornea depends on PGs/OSDs/pool ration | 19:23 |
| mcornea | gfidente: I have 3 osds with CephPoolDefaultPgNum: 32 | 19:24 |
| gfidente | mcornea interesting, can you try 'ceph osd pool get metrics size' | 19:24 |
| gfidente | and see what it gives? | 19:24 |
| mcornea | gfidente: size: 3 | 19:25 |
| gfidente | mcornea 'ceph osd lspools' ? | 19:25 |
| mcornea | gfidente: 0 rbd,1 metrics,2 images,3 backups,4 volumes,5 vms, | 19:25 |
| *** aputtur_ has quit IRC | 19:26 | |
| gfidente | mcornea interesting, can you try 'ceph osd pool get metrics pg_num' | 19:26 |
| gfidente | ? | 19:26 |
| mcornea | gfidente: pg_num: 32 | 19:26 |
| gfidente | but 32 * 4 (the custom pools) + 64 (the rbd pool) is 192 not 224 | 19:27 |
| gfidente | ah but there are 5 custom pools | 19:27 |
| gfidente | so it makes sense yes | 19:27 |
| mcornea | gfidente: so I need to lower pg_num? | 19:28 |
| gfidente | you're above the 200 pg per osd which luminous checks for | 19:28 |
| gfidente | mcornea you can't lower pg_num of existing pools | 19:28 |
| gfidente | you can delete rbd | 19:28 |
| gfidente | or add osds | 19:28 |
| gfidente | (or disks per node) | 19:28 |
| gfidente | though if upgrade worked it's already great for me | 19:29 |
| mcornea | gfidente: ok, so in case I had more than 3 osds I wouldn't see this right? I mean we're not expecting to see this in production? | 19:29 |
| gfidente | mcornea yeah this is pretty much a factor of osds num and pg num | 19:30 |
| gfidente | which should be customized in production and set appropriately | 19:30 |
| *** elgxl has joined #tripleo | 19:30 | |
| mcornea | gfidente: perhpas we can document it just in case someone hits this, it's clearly a change in requirement between versions | 19:31 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-upgrade stable/queens: DNM: Add a temp change to spin tripleo-upgrades-check tests https://review.openstack.org/556627 | 19:31 |
| gfidente | mcornea you can also increase the max pg_num per osd to remove the warning | 19:31 |
| gfidente | mcornea so the change came with luminous, it always had that check for the pg num vs pg_per_osd | 19:31 |
| gfidente | except before 12.2.2 it wouldn't set the cluster in _WARN state, only print a messag | 19:31 |
| gfidente | now it does | 19:31 |
| mcornea | gfidente: is there a parmater for max pg_num per osd? | 19:32 |
| gfidente | in theory, if set appropriately on the initial deployment, it shouldn't be an issue with luminous even though the check is enforced | 19:32 |
| gfidente | mcornea yeah sec | 19:32 |
| *** holser__ has joined #tripleo | 19:32 | |
| *** fragatina has joined #tripleo | 19:32 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-upgrade stable/pike: DNM: Add a temp change to spin tripleo-upgrades-check tests https://review.openstack.org/556629 | 19:32 |
| gfidente | mon_pg_warn_max_per_osd | 19:33 |
| *** holser__ has quit IRC | 19:34 | |
| gfidente | try: ceph tell mon.* injectargs "--mon_pg_warn_max_per_osd 300" | 19:34 |
| gfidente | to inject at runtime | 19:34 |
| *** holser__ has joined #tripleo | 19:34 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: [DNM] Testing keystone-only featureset000 https://review.openstack.org/556630 | 19:35 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade stable/queens: Include connectivity check prepare scripts during FFU https://review.openstack.org/556573 | 19:36 |
| *** jtomasek has quit IRC | 19:39 | |
| *** fragatina has quit IRC | 19:41 | |
| *** aputtur_ has joined #tripleo | 19:42 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: DNM turning off container update https://review.openstack.org/556599 | 19:42 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: DNM, test ovs-2.9 https://review.openstack.org/555873 | 19:42 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade stable/queens: Include connectivity check prepare scripts during FFU https://review.openstack.org/556573 | 19:44 |
| *** raildo has quit IRC | 19:47 | |
| chkumar246 | EmilienM: weshay sshnaidm arxcruz|rover please have a look at this step https://review.openstack.org/#/c/551441/10/roles/validate-tempest/templates/configure-tempest.sh.j2@189 | 19:48 |
| chkumar246 | in stackrc file os_auth_url is contains https:<ip address> only and nothing else | 19:49 |
| chkumar246 | i need to cancate the version | 19:49 |
| chkumar246 | and also please have a look what tests we want to run on undercloud https://review.openstack.org/554522 | 19:50 |
| arxcruz|rover | bogdando: ping, chkumar246 done | 19:52 |
| arxcruz|rover | ops | 19:52 |
| arxcruz|rover | chkumar246: done | 19:52 |
| openstackgerrit | Merged openstack/instack-undercloud master: Use the new dnsmasq PXE filter in ironic-inspector https://review.openstack.org/523944 | 19:56 |
| *** moshele has joined #tripleo | 19:56 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade stable/queens: Include connectivity check prepare scripts during FFU https://review.openstack.org/556573 | 19:56 |
| *** EmilienM has quit IRC | 19:57 | |
| *** EmilienM has joined #tripleo | 19:57 | |
| *** EmilienM has joined #tripleo | 19:57 | |
| *** ChanServ sets mode: +v EmilienM | 19:57 | |
| *** ebarrera has joined #tripleo | 19:57 | |
| openstackgerrit | Matt Young proposed openstack/tripleo-upgrade master: Add log artifacts for upgrade steps https://review.openstack.org/544696 | 19:59 |
| *** aputtur_ has quit IRC | 20:01 | |
| rajinir | I'm seeing this bug with OSP12, overcloud containerized redeployment. https://bugs.launchpad.net/tripleo/+bug/1752467 | 20:06 |
| openstack | Launchpad bug 1752467 in tripleo "Request limit exceeded: JSON body size (2299844 bytes) exceeds maximum allowed size (2097152 bytes)." [Medium,Fix released] - Assigned to Radoslaw Smigielski (radoslaw-smigielski) | 20:06 |
| *** dprince has quit IRC | 20:06 | |
| rajinir | It is not clear to me where to apply the fix and what services need to be restarted. Any help ? EmilienM | 20:06 |
| openstackgerrit | Matt Young proposed openstack/tripleo-upgrade master: Add log artifacts for upgrade steps https://review.openstack.org/544696 | 20:08 |
| *** liverpooler has quit IRC | 20:08 | |
| *** rlandy is now known as rlandy|brb | 20:09 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757474 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1757474 in tripleo "periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset027-master fails with undefined groups.overcloud" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 20:10 |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 20:10 |
| *** aputtur_ has joined #tripleo | 20:11 | |
| *** jobewan has quit IRC | 20:11 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Assign Cinder's backend_host when deploying for HA https://review.openstack.org/550112 | 20:11 |
| rajinir | need help with this BUG I'm seeing this bug with OSP12, overcloud containerized redeployment. https://bugs.launchpad.net/tripleo/+bug/1752467 | 20:14 |
| openstack | Launchpad bug 1752467 in tripleo "Request limit exceeded: JSON body size (2299844 bytes) exceeds maximum allowed size (2097152 bytes)." [Medium,Fix released] - Assigned to Radoslaw Smigielski (radoslaw-smigielski) | 20:14 |
| weshay | mwhahaha, EmilienM preference on promotion criteria... in https://review.rdoproject.org/r/#/c/13072 | 20:15 |
| *** trozet has joined #tripleo | 20:15 | |
| mwhahaha | weshay: so there was talk of needing 4 hours for that, what are we running in tempest? | 20:15 |
| weshay | mwhahaha, https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset020.yml#L34 | 20:16 |
| *** aputtur_ has quit IRC | 20:16 | |
| mwhahaha | weshay: wait we're running everything? | 20:16 |
| openstackgerrit | Alan Bishop proposed openstack/puppet-tripleo stable/queens: Update default Cinder RBD backend_host value https://review.openstack.org/556637 | 20:16 |
| mwhahaha | when did that change | 20:16 |
| weshay | mwhahaha, it's been like that for about a year | 20:17 |
| *** lblanchard has quit IRC | 20:17 | |
| *** aputtur_ has joined #tripleo | 20:17 | |
| weshay | 11 months | 20:17 |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates stable/queens: Assign Cinder's backend_host when deploying for HA https://review.openstack.org/556638 | 20:17 |
| mwhahaha | these fs/scenarios/whatever are clear as mud as to what we're actually doing | 20:17 |
| mwhahaha | so that's the one we need to figure out where the load is coming from on containers vs baremetal | 20:18 |
| *** aputtur_ has quit IRC | 20:18 | |
| mwhahaha | weshay: so can we compare the list of tempest tests from 11 months ago to what it is now? | 20:18 |
| mwhahaha | weshay: i assume they've added new tests over the last 11 months which is the porblem | 20:19 |
| mwhahaha | weshay: this is another case where we need a valid whitelist not a blacklist | 20:19 |
| weshay | mwhahaha, not sure what to say.. others have different requirements, we're using the promotions for two purposes atm which is part of the disconnect | 20:20 |
| weshay | this all worked fine 1.5 weeks ago | 20:21 |
| mwhahaha | weshay: so what's the difference in tests from 1.5 weeks ago | 20:21 |
| weshay | mwhahaha, why would you assume the tests have changed? | 20:21 |
| mwhahaha | weshay: well i like to work backwards | 20:21 |
| weshay | ya | 20:22 |
| mwhahaha | so let's see if the tests have change then figure out what in the services have changed | 20:22 |
| mwhahaha | since it's .* | 20:22 |
| mwhahaha | we cannot say for certain that we're doing the same thing from 1.5 weeks ago | 20:22 |
| mwhahaha | where we didn't add new services into the system | 20:22 |
| weshay | mwhahaha, master passed on 3/24 | 20:23 |
| weshay | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/0e974b0/tempest.html.gz | 20:23 |
| mwhahaha | and we don't capture anything on timeout | 20:24 |
| mwhahaha | blaaaah | 20:24 |
| *** toure is now known as toure|biab | 20:25 | |
| weshay | I suspect that has is pretty good.. | 20:25 |
| *** fragatina has joined #tripleo | 20:25 | |
| weshay | only two other jobs failed.. and it was also on a timeout building the overcloud images https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload/48c19de/console.txt.gz#_2018-03-25_00_11_21_753 | 20:25 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Add NFS backend for cinder-backup service https://review.openstack.org/553640 | 20:26 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Add access to /var/run/openvswitch from collectd https://review.openstack.org/556547 | 20:26 |
| mwhahaha | i mean we were running 1706 tests | 20:26 |
| mwhahaha | that does seem a bit much | 20:26 |
| weshay | mwhahaha, depends who you ask but I get your point for sure | 20:26 |
| mwhahaha | well this goes back to phase1 vs phase2 | 20:27 |
| mwhahaha | i personally would be ok with just teh tempest.scenario.* for the promotion | 20:27 |
| weshay | meh.. we're probably having the wrong conversation atm | 20:27 |
| weshay | this could time out w/ 10 tests | 20:27 |
| weshay | atm | 20:27 |
| stevebaker | morning | 20:27 |
| weshay | we just don't know atm | 20:27 |
| weshay | hey Steve | 20:27 |
| sdoran | EmilienM: Variables for `tasks_from` with `include_role` is on the list for things to include in 2.4.4. Not currently merged to the `stable-2.4` branch, though. | 20:27 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: undercloud: add missing TLS environments when preparing containers https://review.openstack.org/545444 | 20:28 |
| *** ykarel|away has quit IRC | 20:28 | |
| *** fragatin_ has joined #tripleo | 20:29 | |
| weshay | mwhahaha, for all we know it could be infra again | 20:30 |
| weshay | my recreate just went down | 20:31 |
| mwhahaha | HEH | 20:31 |
| weshay | amiright? | 20:31 |
| mwhahaha | so do we have any outstanding tasks to collect logs from rdo in case of a timeout? | 20:32 |
| mwhahaha | cause that' | 20:32 |
| mwhahaha | cause that's kinda a problem | 20:32 |
| *** fragatina has quit IRC | 20:33 | |
| weshay | yes, yes it is | 20:33 |
| *** moshele has quit IRC | 20:33 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-docs master: Provide an example of how to Customize OpenStack Ceph Pools https://review.openstack.org/556641 | 20:34 |
| * mwhahaha starts an fs020 reproducer | 20:36 | |
| weshay | https://bugs.launchpad.net/tripleo/+bug/1758932 | 20:37 |
| openstack | Launchpad bug 1758932 in tripleo "ovb-1ctlr_1comp-featureset020-master job timing out" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 20:37 |
| mwhahaha | weshay: is this the only one we run .* on or do we it do it on other FS? | 20:40 |
| weshay | mwhahaha, fs20 should be a very basic deployment w/ full tempest | 20:41 |
| *** dprince has joined #tripleo | 20:41 | |
| *** rlandy|brb is now known as rlandy | 20:41 | |
| weshay | it's the only fs where full tempest is executed | 20:42 |
| mwhahaha | k | 20:42 |
| weshay | mwhahaha, it works w/ libvirt as well | 20:42 |
| weshay | I have fs20 up on my libvirt env | 20:42 |
| *** SlickNik has joined #tripleo | 20:42 | |
| weshay | but I got the same errors we were trying to fix w/ the openvswitch element | 20:42 |
| *** dougbtv__ is now known as dougbtv | 20:42 | |
| trozet | mwhahaha: hey im facing a bug where certs are mounted into a container. The cert is generated on the host with its UID/GID set as neutron's id on the host. However when it is mounted into the container, the UID of neutron is different there and neutron cannot read it | 20:43 |
| trozet | mwhahaha: 1) how dyou solve that for other services? 2) is there a way to mount the certs with different permisisons in the container | 20:44 |
| weshay | mwhahaha, since that is not run upstream.. we could remove fs20 from tripleo promotion criteria if we need to feed upstream | 20:44 |
| weshay | and everything else is working | 20:44 |
| mwhahaha | trozet: because containers solve everything. and by solve everything mean we have to resolve everything we already solved in the last 30 years | 20:44 |
| * trozet waits for more wisdom :) | 20:44 | |
| trozet | mwhahaha: i could change the permissions of the private key to readable by all on the host, but that seems pretty bad | 20:46 |
| mwhahaha | weshay: so i'm partial to not having a full tempest run for tripleo, but it would be beneficial to have one run w/ failures reported elsewhere | 20:46 |
| *** Goneri has joined #tripleo | 20:46 | |
| mwhahaha | trozet: can you fix the perms for the mount? not sure why the neutron uid would be different. i thought we had a consistent ID from packaging | 20:46 |
| trozet | mwhahaha: good point...why are the uids different | 20:47 |
| *** SlickNik has quit IRC | 20:49 | |
| mwhahaha | weshay: so if fs020 is our only blocker, i woudl be partial to either removing it or reducing the amount of tempest stuff we run | 20:50 |
| openstackgerrit | Merged openstack/tripleo-common master: Add healthcheck script for Horizon https://review.openstack.org/550118 | 20:50 |
| openstackgerrit | Merged openstack/instack-undercloud stable/ocata: Remove hardcoded eth0 MASQUERADE rule https://review.openstack.org/556563 | 20:50 |
| mwhahaha | weshay: i would still like a full run, but it would be nice to have as a daily periodic with bugs filed for failures than the promotion process | 20:51 |
| *** SlickNik has joined #tripleo | 20:51 | |
| *** yamahata has joined #tripleo | 20:52 | |
| weshay | mwhahaha, if that ends up being our only issue for promotion I'll send it through w/o the job as criteria | 20:52 |
| mwhahaha | weshay: k i'll see if this fs020 recreate shows anything | 20:53 |
| *** aputtur_ has joined #tripleo | 20:54 | |
| *** ansmith has quit IRC | 20:55 | |
| trozet | mwhahaha: im not seeing how they would be the same between the host and hte container. In the neutron distgit it just creates the neutron user with no specific ID it looks like | 20:55 |
| mwhahaha | trozet: ugh so yea maybe they switched away from being static. | 20:56 |
| trozet | mwhahaha: actually i see in nova distgit they use a specific UID | 20:57 |
| trozet | mwhahaha: maybe its a bug in neutron distgit? | 20:57 |
| mwhahaha | not likely | 20:57 |
| *** SlickNik has quit IRC | 20:58 | |
| mwhahaha | trozet: so an alternative is to copy it into the container config at deploy | 20:59 |
| trozet | mwhahaha: so I guess im wondering where I go from here. Should I propose a patch to make it static? | 20:59 |
| trozet | mwhahaha: hmm, like in the ansible tasks? | 20:59 |
| mwhahaha | trozet: not ideal but that's about the only thing i can thinks of. might want to check with jaosorior to see if he has any other idea | 20:59 |
| *** trown is now known as trown|outtypewww | 21:00 | |
| trozet | mwhahaha: what would be the reason that neutron is not using a specific ID? | 21:00 |
| * mwhahaha shrugs | 21:00 | |
| mwhahaha | that's an RDO packaging question | 21:00 |
| mwhahaha | i don't know which is the correct pattern | 21:00 |
| *** pblaho has quit IRC | 21:00 | |
| trozet | i see ihrachys is the last one that modified that line | 21:00 |
| mwhahaha | yea but this is a packaging thing not necessarily a openstack service things | 21:00 |
| trozet | mwhahaha: yeah, but i think it would be more consistent to use the same packaging method for each service, and static uid makes things more predictable anyway | 21:02 |
| trozet | mwhahaha: so nova and neutron should do things the same way | 21:02 |
| *** dprince has quit IRC | 21:02 | |
| mwhahaha | trozet: i agree, but consistency is not our forte :D | 21:02 |
| openstackgerrit | Jill Rouleau proposed openstack/tripleo-common master: config download support for a fixed directory https://review.openstack.org/550577 | 21:02 |
| trozet | ihrachys: do you have anything against statically assigning UID for neutron linux user in neutron-distgit? | 21:02 |
| *** pchavva has quit IRC | 21:03 | |
| ihrachys | trozet, fedora packaging guidelines that we stick to say we shouldn't enforce a particular uid | 21:03 |
| ihrachys | trozet, some packages got it allocated before it was enforced | 21:03 |
| openstackgerrit | Jill Rouleau proposed openstack/tripleo-common master: Check mode support for Server Deployments https://review.openstack.org/549066 | 21:03 |
| *** SlickNik has joined #tripleo | 21:04 | |
| EmilienM | sdoran: ok, thanks. Any idea when i'll happen? | 21:04 |
| ihrachys | trozet, this is the process to get a uid allocated: https://fedoraproject.org/wiki/Packaging:UsersAndGroups#Soft_static_allocation | 21:04 |
| ihrachys | but we were told we don't have a reason to have it | 21:04 |
| sdoran | Think they're looking at it this week. | 21:04 |
| hjensas | att: container folks, How/where do I add kolla images to the tripleo registry? This merged in kolla: https://review.openstack.org/546173 | 21:04 |
| trozet | ihrachys: we kind of need it for container deployments, unless we use a workaround. We generate SSL key and certificate (recall that patch I pushed ot neutron for this support) and that is set as neutron owner (some UID on host) then mounted into neutorn container, but neutron UID in container is a different value | 21:06 |
| *** jmelvin has quit IRC | 21:08 | |
| mwhahaha | trozet: the only other thing i could think of is trying to override the uuid in the container. | 21:09 |
| ihrachys | trozet, can it be fixed by mounting /etc/passwd and /etc/group into the container and make it switch to the neutron user? | 21:09 |
| mwhahaha | trozet: would have to check kolla to see if that's a thing. i'm really not sure the best way to handle this | 21:09 |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757474 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1757474 in tripleo "periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset027-master fails with undefined groups.overcloud" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 21:10 |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 21:10 |
| trozet | ihrachys: hmm I wonder if that would work | 21:10 |
| ihrachys | mwhahaha, I was looking for a way to provide a map of uids a month ago, couldn't figure it out | 21:10 |
| ihrachys | in scope of ovs containerization | 21:10 |
| mwhahaha | :/ | 21:10 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Fix checking if the overcloud group is empty https://review.openstack.org/556463 | 21:10 |
| trozet | mwhahaha: what about ihrachys notion of mounting passwd and group | 21:10 |
| *** elgxl has quit IRC | 21:10 | |
| ihrachys | and what I came up with is run process as root and make it switch to uid passed as argument | 21:10 |
| mwhahaha | i guess this is one of those things where the containerized vs host really need to be seperated cleanly | 21:11 |
| mwhahaha | the problem with passwd/group is that the uid in the container might already be bad | 21:11 |
| ihrachys | then the process inside container would switch to the right uid because /etc/passwd provides those from host | 21:11 |
| mwhahaha | so i don't think that's a solution | 21:11 |
| *** dprince has joined #tripleo | 21:11 | |
| ihrachys | mwhahaha, right. so you start as root and then switch to the right uid | 21:11 |
| ihrachys | not saying it's a great solution ofc | 21:11 |
| ihrachys | mwhahaha, the lack of support for the mapping is very frustrating. I didn't expect the space still misses it after so many years. | 21:12 |
| ihrachys | (or maybe I don't need it and just don't know I don't need it) | 21:12 |
| trozet | mwhahaha: ok so maybe copying the file for now is best workaround? | 21:13 |
| mwhahaha | trozet: yea the only problem with that is cert updates. i would go down that route first and check with jaosorior | 21:13 |
| trozet | mwhahaha: so how are you thinking to copy this? Do you have an example? | 21:15 |
| mwhahaha | trozet: I don't think i have an example. if the cert was coming from THT it's just part of the config. but if it's being gnerated on the host not sure | 21:17 |
| mwhahaha | trozet: so octavia does some ansible stuff with the mounts i think. or at least some config updates, so you might see something in there | 21:19 |
| trozet | mwhahaha: its a a file created by puppet and we have the path in THT hardcoded to where it will be generated | 21:19 |
| trozet | mwhahaha: but puppet runs on the host to generate the cert | 21:20 |
| mwhahaha | trozet: yea you'd need to copy it into the config container after the step that handles the cert generation | 21:20 |
| *** dprince has quit IRC | 21:21 | |
| trozet | mwhahaha: ok I'll check out octavia | 21:21 |
| mwhahaha | trozet: something like https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/octavia-api.yaml#L102 maybe | 21:21 |
| trozet | mwhahaha: ah | 21:22 |
| mwhahaha | trozet: you could actually use that | 21:22 |
| mwhahaha | trozet: before the neutron service starts to chmod the certs | 21:23 |
| *** abishop_ has quit IRC | 21:24 | |
| *** elgxl has joined #tripleo | 21:24 | |
| *** elgxl has quit IRC | 21:24 | |
| *** aputtur_ has quit IRC | 21:25 | |
| *** dsariel has joined #tripleo | 21:29 | |
| trozet | mwhahaha: ah you know what | 21:29 |
| *** SlickNik has quit IRC | 21:29 | |
| trozet | mwhahaha: we can mount them as RW, then do chown in the container, and it would change it to the container's neutron UID | 21:29 |
| trozet | right? | 21:29 |
| mwhahaha | yea | 21:29 |
| trozet | mwhahaha: ok that seems like an OK workaround for now, I'll add you to the reivew. thanks! | 21:30 |
| *** gfidente has quit IRC | 21:33 | |
| *** yamahata has quit IRC | 21:33 | |
| *** SlickNik has joined #tripleo | 21:39 | |
| *** mcornea has quit IRC | 21:45 | |
| *** ebarrera has quit IRC | 21:46 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Use sensu-client healthcheck parameter https://review.openstack.org/545280 | 21:53 |
| *** Goneri has quit IRC | 21:55 | |
| *** rfolco|ruck is now known as rfolco|off | 21:55 | |
| *** ebarrera has joined #tripleo | 21:57 | |
| *** ansmith has joined #tripleo | 21:57 | |
| *** dsariel has quit IRC | 21:57 | |
| *** dprince has joined #tripleo | 22:04 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Fix validate-template-override. https://review.openstack.org/539519 | 22:07 |
| openstackgerrit | Merged openstack/instack-undercloud stable/newton: Remove hardcoded eth0 MASQUERADE rule https://review.openstack.org/556564 | 22:07 |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 22:10 |
| *** pradk has quit IRC | 22:10 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Do not override NeutronServicePlugins in CI https://review.openstack.org/555950 | 22:19 |
| openstackgerrit | Merged openstack/instack-undercloud master: Fix next_hop for metadata service host route on local_subnet https://review.openstack.org/554908 | 22:19 |
| *** rcernin has joined #tripleo | 22:20 | |
| openstackgerrit | Matt Young proposed openstack/tripleo-upgrade master: Add log artifacts for upgrade steps https://review.openstack.org/544696 | 22:25 |
| *** lblanchard has joined #tripleo | 22:27 | |
| weshay | Sl0w, ping | 22:30 |
| weshay | Sl0w, wonder if I can yum update a container w/ a local yum repo | 22:30 |
| weshay | it seems the container can't access the yum repo that is built on the system | 22:31 |
| weshay | w/ maybe an extra --volume arg to docker run | 22:31 |
| *** holser__ has quit IRC | 22:31 | |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates master: Fixes Neutron certificate and key permissions https://review.openstack.org/556673 | 22:32 |
| *** jlabarre has quit IRC | 22:34 | |
| openstackgerrit | Harald Jensås proposed openstack/instack-undercloud stable/queens: Fix next_hop for metadata service host route on local_subnet https://review.openstack.org/556675 | 22:39 |
| weshay | Sl0w, nvrmind I just need to build it /opt | 22:43 |
| weshay | :)) | 22:43 |
| Sl0w | weshay: yeah all doable :) | 22:44 |
| weshay | Sl0w, you da man | 22:44 |
| *** dprince has quit IRC | 22:49 | |
| openstackgerrit | Harald Jensås proposed openstack/instack-undercloud stable/queens: Use the new dnsmasq PXE filter in ironic-inspector https://review.openstack.org/556677 | 22:50 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: DNM, test ovs-2.9 https://review.openstack.org/555873 | 22:51 |
| *** pkovar has quit IRC | 22:53 | |
| *** chandankumar has joined #tripleo | 22:57 | |
| *** chkumar246 has quit IRC | 22:57 | |
| weshay | mwhahaha, EmilienM if we make scen007 non-voting we could promote master it looks like | 23:00 |
| weshay | I'm testing the ovn update now | 23:00 |
| weshay | https://review.rdoproject.org/zuul/ | 23:01 |
| *** chandankumar has quit IRC | 23:02 | |
| *** tosky has quit IRC | 23:08 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 23:10 |
| mwhahaha | weshay: k. Did we get a specific cause for the failures with ovn | 23:11 |
| *** chandankumar has joined #tripleo | 23:14 | |
| *** gvrangan has joined #tripleo | 23:18 | |
| *** ebarrera has quit IRC | 23:27 | |
| EmilienM | weshay: ok works for me | 23:34 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Run ovb-ha (fs001) with a containerized undercloud https://review.openstack.org/542556 | 23:37 |
| *** sai_p has quit IRC | 23:42 | |
| *** chkumar246 has joined #tripleo | 23:53 | |
| *** chandankumar has quit IRC | 23:53 | |
| *** SlickNik has quit IRC | 23:55 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 23:55 |
| *** chkumar246 has quit IRC | 23:57 | |
| weshay | mwhahaha, there were two issues.. one the ci environment params were missing the net-iso config in tht/ci/env | 23:59 |
| weshay | yatin patched that | 23:59 |
| weshay | the other is the ovn update that we can't gate someone | 23:59 |
| mwhahaha | Can't gate somewhere you mean? | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!