| *** pmannidi has joined #tripleo | 00:03 | |
| *** sai_p has quit IRC | 00:03 | |
| *** dmacpher has quit IRC | 00:04 | |
| *** dmacpher has joined #tripleo | 00:07 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
|---|---|---|
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 00:10 |
| *** jbadiapa_ has joined #tripleo | 00:10 | |
| *** jbadiapa has quit IRC | 00:12 | |
| *** tosky has quit IRC | 00:23 | |
| *** lblanchard has joined #tripleo | 00:31 | |
| *** itlinux has quit IRC | 00:51 | |
| *** atoth has quit IRC | 00:53 | |
| openstackgerrit | Merged openstack/diskimage-builder master: delete unused module https://review.openstack.org/558167 | 01:04 |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 01:10 |
| *** gyan__ has joined #tripleo | 01:13 | |
| *** dougbtv_ has joined #tripleo | 01:13 | |
| *** dougbtv has quit IRC | 01:15 | |
| *** fragatina has quit IRC | 01:16 | |
| *** noslzzp has joined #tripleo | 01:17 | |
| *** cshastri has joined #tripleo | 01:20 | |
| *** lblanchard has quit IRC | 01:34 | |
| openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo stable/queens: Removes neutron ownership of certs https://review.openstack.org/558664 | 01:54 |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 02:10 |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates stable/queens: Fixes Neutron certificate and key permissions https://review.openstack.org/558667 | 02:11 |
| *** moshele has joined #tripleo | 02:12 | |
| *** ykarel|afk has joined #tripleo | 02:16 | |
| openstackgerrit | Merged openstack/tripleo-common master: zuul: run ceph scenarios when touching actions/ansible.py https://review.openstack.org/558568 | 02:20 |
| openstackgerrit | wangqi proposed openstack/tripleo-common master: Replace LOG.warn with LOG.warning https://review.openstack.org/558672 | 02:22 |
| *** ykarel|afk has quit IRC | 02:29 | |
| *** rfolco|away is now known as rfolco|ruck | 02:31 | |
| *** noslzzp has quit IRC | 02:35 | |
| openstackgerrit | Merged openstack/tripleo-common master: Revert "Pass connection info via ansible config file" https://review.openstack.org/558567 | 02:39 |
| *** moshele has quit IRC | 02:39 | |
| *** mburned_out is now known as mburned | 02:41 | |
| *** psachin has joined #tripleo | 02:45 | |
| *** threestrands has quit IRC | 02:47 | |
| *** threestrands has joined #tripleo | 02:47 | |
| *** threestrands has quit IRC | 02:48 | |
| *** threestrands has joined #tripleo | 02:49 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 03:10 |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Remove /etc/os-net-config/config.json in os-apply-config https://review.openstack.org/556997 | 03:18 |
| EmilienM | jaosorior: hey, need your help on something, ping me when you around | 03:26 |
| EmilienM | I'm investigating this trace: https://logs.rdoproject.org/56/542556/100/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z64d11a27268e46db803351bb52f7cc25/undercloud/var/log/containers/mistral/executor.log.txt.gz#_2018-04-04_01_56_12_631 | 03:27 |
| EmilienM | which is also visible in the zaqar logs: | 03:27 |
| EmilienM | https://logs.rdoproject.org/56/542556/100/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z64d11a27268e46db803351bb52f7cc25/undercloud/var/log/containers/zaqar/zaqar.log.txt.gz#_2018-04-04_01_56_10_669 | 03:27 |
| EmilienM | and in keystone: https://logs.rdoproject.org/56/542556/100/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z64d11a27268e46db803351bb52f7cc25/undercloud/var/log/containers/keystone/keystone.log.txt.gz#_2018-04-04_01_56_10_548 | 03:27 |
| EmilienM | I wonder if it's related to key rotations | 03:27 |
| *** ramishra has joined #tripleo | 03:33 | |
| *** rfolco|ruck is now known as rfolco|off | 03:39 | |
| *** liverpooler has quit IRC | 03:42 | |
| EmilienM | but there is no key rotation enabled by default, afik | 03:42 |
| EmilienM | it's all manual via a mistral workflow | 03:43 |
| *** shreshtha_ has joined #tripleo | 03:48 | |
| *** shreshtha_ has quit IRC | 03:48 | |
| *** fragatina has joined #tripleo | 03:48 | |
| *** shreshtha has joined #tripleo | 03:48 | |
| *** fragatina has quit IRC | 03:48 | |
| *** fragatina has joined #tripleo | 03:49 | |
| *** fragatina has quit IRC | 03:50 | |
| *** fragatina has joined #tripleo | 03:50 | |
| *** psahoo has joined #tripleo | 03:54 | |
| *** ohochman has quit IRC | 03:57 | |
| *** udesale has joined #tripleo | 04:07 | |
| *** ykarel|afk has joined #tripleo | 04:09 | |
| *** ykarel|afk is now known as ykarel | 04:10 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 04:10 |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| *** moshele has joined #tripleo | 04:12 | |
| *** moshele has quit IRC | 04:14 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Implement tripleo::masquerade_networks https://review.openstack.org/558235 | 04:23 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: masquerade: stop using YAQL for iptables data https://review.openstack.org/558236 | 04:23 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs001: enable masquerading via THT https://review.openstack.org/557972 | 04:24 |
| *** pcaruana has joined #tripleo | 04:27 | |
| *** pcaruana has quit IRC | 04:30 | |
| *** pgadiya has joined #tripleo | 04:37 | |
| *** threestrands has quit IRC | 04:38 | |
| *** links has joined #tripleo | 04:39 | |
| *** links has quit IRC | 04:40 | |
| EmilienM | jaosorior: I filed https://bugs.launchpad.net/tripleo/+bug/1761050 | 04:44 |
| openstack | Launchpad bug 1761050 in tripleo "Failures to get tokens when undercloud is containerized" [High,Triaged] | 04:44 |
| *** tonyb has quit IRC | 04:45 | |
| *** links has joined #tripleo | 04:46 | |
| Tengu | hello there | 04:48 |
| *** marios has joined #tripleo | 04:53 | |
| *** anilvenkata has joined #tripleo | 04:59 | |
| *** khyr0n has joined #tripleo | 05:02 | |
| jaosorior | EmilienM: it's not a key rotation/token issue | 05:04 |
| EmilienM | jaosorior: the keystone logs don't tell much about the issue, just the warning about that a token failed to be given | 05:04 |
| jaosorior | EmilienM: key rotation IS a manual step (in a clustered environment), and is not necessary for tokens to work, it's a security measure | 05:04 |
| jaosorior | EmilienM: I don't think it's a keystone issue | 05:05 |
| EmilienM | yeah | 05:05 |
| EmilienM | ok | 05:05 |
| EmilienM | jaosorior: I'm heading to sleep now, if you see anything please let me know (here or in the bug report) - thank you! | 05:05 |
| jaosorior | sure | 05:05 |
| EmilienM | jaosorior: fyi, I reproduce it consistentely | 05:05 |
| EmilienM | and it blocks the containerized undercloud on OVB job | 05:06 |
| * EmilienM off | 05:06 | |
| Tengu | gn EmilienM :) | 05:07 |
| *** ratailor has joined #tripleo | 05:07 | |
| *** ratailor_ has joined #tripleo | 05:10 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 05:10 |
| *** ratailor has quit IRC | 05:12 | |
| *** pdeore has joined #tripleo | 05:13 | |
| *** moshele has joined #tripleo | 05:16 | |
| *** anande has joined #tripleo | 05:17 | |
| *** anande has quit IRC | 05:18 | |
| *** anande has joined #tripleo | 05:19 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Formalise saving of /etc/resolv.conf https://review.openstack.org/558362 | 05:19 |
| *** yprokule has joined #tripleo | 05:29 | |
| *** jfrancoa has joined #tripleo | 05:30 | |
| *** jtomasek has joined #tripleo | 05:39 | |
| *** PagliaccisCloud has quit IRC | 05:40 | |
| *** aufi has joined #tripleo | 05:44 | |
| chandankumar | dtantsur|afk: nope, not added | 05:45 |
| *** PagliaccisCloud has joined #tripleo | 05:45 | |
| *** waleedm has joined #tripleo | 05:46 | |
| *** pmannidi has quit IRC | 05:49 | |
| *** agurenko has joined #tripleo | 05:50 | |
| *** khrystop_ has joined #tripleo | 05:52 | |
| *** moshele has quit IRC | 05:53 | |
| *** khrystoph has quit IRC | 05:53 | |
| *** SulaimanRadwan has joined #tripleo | 05:55 | |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: Import gated tripleo-upgrade role. https://review.openstack.org/558210 | 06:04 |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: Use tripleo-upgrade role in undercloud upgrades job. https://review.openstack.org/548974 | 06:04 |
| *** janki has joined #tripleo | 06:06 | |
| *** agopi has quit IRC | 06:07 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 06:10 |
| openstackgerrit | Merged openstack/diskimage-builder master: Restore tracing on exit points of block_device_create_config_file https://review.openstack.org/558358 | 06:13 |
| *** anande has quit IRC | 06:16 | |
| *** anande has joined #tripleo | 06:16 | |
| *** hamdyk has joined #tripleo | 06:17 | |
| *** dsariel has joined #tripleo | 06:19 | |
| *** jaosorior has quit IRC | 06:25 | |
| *** dparkes has joined #tripleo | 06:26 | |
| *** kopecmartin has joined #tripleo | 06:31 | |
| *** holser__ has joined #tripleo | 06:35 | |
| *** shardy has quit IRC | 06:36 | |
| *** shardy has joined #tripleo | 06:36 | |
| *** mpjetta has quit IRC | 06:39 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers https://review.openstack.org/551441 | 06:39 |
| *** dsariel has quit IRC | 06:41 | |
| openstackgerrit | Yong Huang proposed openstack/tripleo-heat-templates master: [DellEMC]Update Manila VNX driver https://review.openstack.org/538147 | 06:47 |
| *** tzumainn has quit IRC | 06:50 | |
| *** mpjetta has joined #tripleo | 06:51 | |
| *** jaosorior has joined #tripleo | 06:58 | |
| openstackgerrit | Yong Huang proposed openstack/tripleo-heat-templates master: [DellEMC]Update Manila Unity driver https://review.openstack.org/543200 | 06:59 |
| *** masco_ has joined #tripleo | 06:59 | |
| *** fragatina has quit IRC | 07:00 | |
| *** pcaruana has joined #tripleo | 07:01 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: DNM: Set token expiration to 5400 https://review.openstack.org/558716 | 07:07 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart master: Run ovb-ha (fs001) with a containerized undercloud https://review.openstack.org/542556 | 07:07 |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 07:10 |
| *** florianf has joined #tripleo | 07:14 | |
| *** florianf has quit IRC | 07:14 | |
| *** florianf_ has joined #tripleo | 07:14 | |
| *** akrivoka has joined #tripleo | 07:17 | |
| *** skramaja has joined #tripleo | 07:22 | |
| *** rcernin has quit IRC | 07:23 | |
| *** tesseract has joined #tripleo | 07:26 | |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-heat-templates stable/newton: Change ovs user and fix permissions on ovs upgrade https://review.openstack.org/558471 | 07:29 |
| *** ccamacho has joined #tripleo | 07:32 | |
| *** amoralej|off is now known as amoralej | 07:34 | |
| *** moshele has joined #tripleo | 07:35 | |
| *** fragatina has joined #tripleo | 07:35 | |
| *** khyr0n has quit IRC | 07:36 | |
| *** khyr0n has joined #tripleo | 07:37 | |
| Tengu | hello there! small question with containerized overcloud: is there still an HTTPD outside of containers? | 07:39 |
| *** khyr0n has quit IRC | 07:41 | |
| jaosorior | Tengu: nothing I remember that's running on it, no | 07:42 |
| Tengu | ok… well. | 07:42 |
| Tengu | guess what. | 07:42 |
| Tengu | tripleo, while migrating from BM to containers, wants to restart httpd. and it just failed on one controller. | 07:43 |
| Tengu | although the service IS running, but there are a bunch of error in its log, I suspect this returned a bad exit status. | 07:43 |
| Tengu | oh. better: "Unit httpd.service cannot be reloaded because it is inactive." | 07:44 |
| Tengu | for once it wasn't ceph the issue. had to be something else, of course :'( | 07:44 |
| *** shardy has quit IRC | 07:45 | |
| *** shardy has joined #tripleo | 07:45 | |
| *** jpena|off is now known as jpena | 07:46 | |
| *** d0ugal_ has quit IRC | 07:46 | |
| Tengu | "Loaded: loaded (/usr/lib/systemd/system/httpd.service; disabled; vendor preset: disabled)" ok. well. guess there are some issue in there. | 07:46 |
| *** d0ugal has joined #tripleo | 07:47 | |
| *** d0ugal has quit IRC | 07:47 | |
| *** d0ugal has joined #tripleo | 07:47 | |
| *** tosky has joined #tripleo | 07:48 | |
| *** gkadam has joined #tripleo | 07:49 | |
| d0ugal | Anyone finding the reproducer scripts just exit and don't do anything? I get http://paste.openstack.org/show/718352/ | 07:56 |
| d0ugal | oh, removing autorun seems to help - maybe a bug there. | 07:56 |
| Tengu | hmm, how do we use the "--limit @/var/lib/heat-config/heat-config-ansible/9f20c34a-5dab-4239-b519-2de1629b5c26_playbook.retry" shown at the end of `openstack stack failures list --long overcloud' ? | 07:58 |
| *** jpich has joined #tripleo | 08:02 | |
| *** bcafarel has joined #tripleo | 08:02 | |
| *** masco_ is now known as masco | 08:03 | |
| *** fragatina has quit IRC | 08:07 | |
| *** dsariel has joined #tripleo | 08:08 | |
| *** agurenko has quit IRC | 08:09 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 08:10 |
| jaosorior | d0ugal: any idea what version of mistral is being used in CI right now? | 08:12 |
| *** masco has quit IRC | 08:12 | |
| jaosorior | d0ugal: I think there might be an issue in either mistral or zaqarclient https://bugs.launchpad.net/tripleo/+bug/1761050 | 08:12 |
| openstack | Launchpad bug 1761050 in tripleo "Failures to get tokens when undercloud is containerized" [High,Triaged] | 08:12 |
| *** agurenko has joined #tripleo | 08:12 | |
| d0ugal | jaosorior: I guess it'll just be the latest promoted? I forget where you check that... | 08:13 |
| d0ugal | jaosorior: brb, 5 mins, then I'll take a look at that bug. | 08:13 |
| *** masco has joined #tripleo | 08:14 | |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Allow providing --ssh-user for update/upgrade run commands https://review.openstack.org/557747 | 08:16 |
| *** lucas-afk is now known as lucasagomes | 08:17 | |
| *** mdnadeem has joined #tripleo | 08:21 | |
| d0ugal | jaosorior: Any idea why would this be different in containers vs not? | 08:26 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Adjust tripleo-ansible-inventory parameters. https://review.openstack.org/558744 | 08:28 |
| *** psahoo has quit IRC | 08:31 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Add featureset051 to test keystone-only upgrades https://review.openstack.org/556630 | 08:37 |
| paramite | Hey guys, can we get this merged please: https://review.openstack.org/#/c/555262/ ? | 08:38 |
| *** gfidente has joined #tripleo | 08:42 | |
| *** gfidente has quit IRC | 08:42 | |
| *** gfidente has joined #tripleo | 08:42 | |
| *** psahoo has joined #tripleo | 08:43 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: WIP Drop ubuntu 14.04 from spec tests https://review.openstack.org/558750 | 08:46 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Migrate to the new Mistral context class https://review.openstack.org/506186 | 08:47 |
| dr_gogeta86 | anybody knows how to enable cadf audit via tripleo on every services | 08:49 |
| dr_gogeta86 | ? | 08:50 |
| *** links has quit IRC | 08:53 | |
| *** shreshtha_ has joined #tripleo | 08:54 | |
| *** shreshtha_ has quit IRC | 08:54 | |
| *** links has joined #tripleo | 08:57 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Change container registry file to the default paremters https://review.openstack.org/558760 | 09:07 |
| *** pblaho has joined #tripleo | 09:07 | |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Adjust tripleo-ansible-inventory parameters. https://review.openstack.org/558744 | 09:08 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-common master: Update converge workflow to remove no-ops https://review.openstack.org/558535 | 09:09 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 09:10 |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Update converge CLI to remove no-ops https://review.openstack.org/558536 | 09:11 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Adjust tripleo-ansible-inventory parameters. https://review.openstack.org/558744 | 09:12 |
| *** ykarel_ has joined #tripleo | 09:14 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade stable/queens: DNM: Testing P->Q from queens branch. https://review.openstack.org/552080 | 09:14 |
| sri_ | Tengu: hi quick question is it possible to scale my baremetal overcloud with deployed server ? | 09:16 |
| *** ykarel has quit IRC | 09:17 | |
| Tengu | sri_: hmm "deployed server" means "they already have a CentOS on it, you don't want to pxe-boot them from ironic for std deploy" ? | 09:18 |
| sri_ | yes | 09:18 |
| Tengu | sri_: was the previous deploy done like that? | 09:18 |
| sri_ | Tengu: no it's was bare-meal deployment | 09:19 |
| Tengu | sri_: not sure you can mix :/. but I'm no expert on that field, you might want a second advice. | 09:19 |
| Tengu | I didn't use the deployed server thing | 09:20 |
| jaosorior | d0ugal: no idea really | 09:22 |
| sri_ | Tengu: hhmmm, Yes we cant mix baremetal with deployed server, i thought thats only apply when I am using baremetal with deployed same time | 09:22 |
| jaosorior | d0ugal: but without containers it doesn't fail because the deployment takes less than an hour | 09:22 |
| d0ugal | jaosorior: I thought token expiry was 4 hours? | 09:22 |
| jaosorior | d0ugal: nope, it's 1 | 09:22 |
| d0ugal | jaosorior: was it ever 4? or am I just confused :) | 09:23 |
| jaosorior | confused :) | 09:23 |
| d0ugal | hah | 09:23 |
| d0ugal | jaosorior: Okay, then that is probably the issue - I don't believe Mistral will refresh (if that is the correct term) tokens | 09:23 |
| Tengu | sri_: well, I can't ensure you you won't break anything ;). My current knowledge is still "beginner", even if on some precise things I might be considered as "not so beginner" ;). | 09:24 |
| Tengu | sri_: you might want to check if shardy is available for that, or, maybe some others from the deploy team. | 09:25 |
| jaosorior | d0ugal: that's not something mistral should do | 09:25 |
| jaosorior | d0ugal: that's the whole reason why the keystone team recommends folks to use keystone session objects | 09:25 |
| *** pmannidi has joined #tripleo | 09:25 | |
| jaosorior | the refresh should be done automatically there | 09:25 |
| d0ugal | jaosorior: okay, then... | 09:26 |
| d0ugal | ¯\_(ツ)_/¯ | 09:26 |
| *** panda|bbl is now known as panda | 09:26 | |
| jaosorior | d0ugal: so there must be some subtle issue somewhere. and I'm kind of more suspicious of the zaqarclient code | 09:27 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: DNM DNR CI Test https://review.openstack.org/558763 | 09:27 |
| jaosorior | but I haven't pointed out where the actual issue is. | 09:27 |
| d0ugal | I'll do some testing and see if I can spot anything | 09:27 |
| *** salmankhan has joined #tripleo | 09:28 | |
| jaosorior | Could I get a review for this t-h-t backport https://review.openstack.org/#/c/558547/ ? | 09:30 |
| sri_ | Tengu: understood, ;) | 09:30 |
| *** wathoom has joined #tripleo | 09:30 | |
| *** ykarel__ has joined #tripleo | 09:39 | |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: Run playbooks with custom args https://review.openstack.org/553474 | 09:40 |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: Import gated tripleo-upgrade role. https://review.openstack.org/558210 | 09:40 |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: Use tripleo-upgrade role in undercloud upgrades job. https://review.openstack.org/548974 | 09:40 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates stable/queens: Do not create NetworkVlanID is the value is not defined https://review.openstack.org/558766 | 09:43 |
| *** ykarel_ has quit IRC | 09:43 | |
| *** yamahata has quit IRC | 09:44 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud master: Always include certmonger_user https://review.openstack.org/558768 | 09:46 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Change default endpoint map entries to use TLS https://review.openstack.org/558424 | 09:46 |
| *** bogdando has joined #tripleo | 09:48 | |
| openstackgerrit | Merged openstack/tripleo-docs master: [Backup/Restore] Fix nits in docs and clarification note. https://review.openstack.org/558429 | 09:53 |
| *** dtantsur|afk is now known as dtantsur | 09:54 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: Drop ubuntu 14.04 from spec tests https://review.openstack.org/558750 | 09:58 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: DNM DNR CI Test https://review.openstack.org/558763 | 09:58 |
| openstackgerrit | Bernard Cafarelli proposed openstack/tripleo-common master: Fix healthcheck script for neutron-api service https://review.openstack.org/558775 | 10:03 |
| *** cshastri has quit IRC | 10:04 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: Validate upgrade-non-controller.sh to run in Controller nodes https://review.openstack.org/541404 | 10:05 |
| *** jaganathan has quit IRC | 10:05 | |
| *** artom_ has joined #tripleo | 10:06 | |
| *** dciabrin_ has joined #tripleo | 10:06 | |
| *** jtomasek_ has joined #tripleo | 10:06 | |
| *** tcw1 has joined #tripleo | 10:06 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-common master: Validate upgrade-non-controller.sh to run in Controller nodes https://review.openstack.org/541404 | 10:07 |
| *** dobson` has joined #tripleo | 10:09 | |
| *** bugzy_ has joined #tripleo | 10:09 | |
| *** beekneemech has joined #tripleo | 10:10 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 10:10 |
| *** thegodfather has joined #tripleo | 10:11 | |
| *** tbonds_ has joined #tripleo | 10:11 | |
| *** wathoom_ has joined #tripleo | 10:11 | |
| *** cgoncalv1s has joined #tripleo | 10:11 | |
| *** lifeless_ has joined #tripleo | 10:11 | |
| *** pcaruana|afk| has joined #tripleo | 10:12 | |
| *** pgadiya_ has joined #tripleo | 10:13 | |
| *** adarazs_ has joined #tripleo | 10:13 | |
| *** mburned` has joined #tripleo | 10:13 | |
| *** gfidente^2nd has joined #tripleo | 10:14 | |
| *** rodrigod` has joined #tripleo | 10:14 | |
| *** hewbrocc` has joined #tripleo | 10:14 | |
| *** weshay_ has joined #tripleo | 10:14 | |
| *** olivierb- has joined #tripleo | 10:14 | |
| *** markmc` has joined #tripleo | 10:14 | |
| *** eck`` has joined #tripleo | 10:14 | |
| *** raildo has joined #tripleo | 10:14 | |
| *** hachi-ju has joined #tripleo | 10:15 | |
| *** haleyb_ has joined #tripleo | 10:15 | |
| *** safchain_ has joined #tripleo | 10:15 | |
| *** saneax__ is now known as saneax | 10:15 | |
| *** gfidente has quit IRC | 10:15 | |
| *** jtomasek has quit IRC | 10:15 | |
| *** ansmith has quit IRC | 10:15 | |
| *** etingof has quit IRC | 10:15 | |
| *** artom has quit IRC | 10:15 | |
| *** tcw has quit IRC | 10:15 | |
| *** dciabrin has quit IRC | 10:15 | |
| *** owalsh has quit IRC | 10:15 | |
| *** bandini has quit IRC | 10:15 | |
| *** markmc has quit IRC | 10:15 | |
| *** bnemec has quit IRC | 10:15 | |
| *** lifeless has quit IRC | 10:15 | |
| *** cgoncalves has quit IRC | 10:15 | |
| *** number80 has quit IRC | 10:15 | |
| *** rodrigods has quit IRC | 10:15 | |
| *** eck` has quit IRC | 10:15 | |
| *** fabbione has quit IRC | 10:15 | |
| *** adarazs has quit IRC | 10:15 | |
| *** mdnadeem has quit IRC | 10:15 | |
| *** tosky has quit IRC | 10:15 | |
| *** pcaruana has quit IRC | 10:15 | |
| *** pgadiya has quit IRC | 10:15 | |
| *** tbonds has quit IRC | 10:15 | |
| *** olivierbourdon38 has quit IRC | 10:15 | |
| *** safchain has quit IRC | 10:15 | |
| *** paramite has quit IRC | 10:15 | |
| *** zshi has quit IRC | 10:15 | |
| *** jrist has quit IRC | 10:15 | |
| *** weshay has quit IRC | 10:15 | |
| *** haleyb has quit IRC | 10:15 | |
| *** bugzy has quit IRC | 10:15 | |
| *** hewbrocca_afk has quit IRC | 10:15 | |
| *** mburned has quit IRC | 10:15 | |
| *** dobson has quit IRC | 10:15 | |
| *** dmsimard has quit IRC | 10:15 | |
| *** lucasagomes has quit IRC | 10:15 | |
| *** wathoom has quit IRC | 10:15 | |
| *** safchain_ is now known as safchain | 10:16 | |
| *** adarazs_ is now known as adarazs | 10:16 | |
| *** tosky has joined #tripleo | 10:16 | |
| *** yprokule has quit IRC | 10:16 | |
| *** yprokule has joined #tripleo | 10:17 | |
| *** owalsh has joined #tripleo | 10:17 | |
| *** mdnadeem has joined #tripleo | 10:17 | |
| *** ansmith has joined #tripleo | 10:17 | |
| *** zshi has joined #tripleo | 10:17 | |
| *** paramite has joined #tripleo | 10:17 | |
| *** dmsimard has joined #tripleo | 10:18 | |
| *** etingof has joined #tripleo | 10:18 | |
| *** lucasagomes has joined #tripleo | 10:19 | |
| *** jrist has joined #tripleo | 10:19 | |
| *** jrist has joined #tripleo | 10:19 | |
| *** udesale has quit IRC | 10:23 | |
| *** cgoncalv1s is now known as cgoncalves | 10:23 | |
| jaosorior | marios: What happens to heat deployments on updates? do they get ran at some point? | 10:24 |
| *** udesale has joined #tripleo | 10:24 | |
| *** bandini has joined #tripleo | 10:26 | |
| *** salmankhan has quit IRC | 10:28 | |
| *** pcaruana|afk| has quit IRC | 10:28 | |
| *** pcaruana|afk| has joined #tripleo | 10:28 | |
| *** adarazs has quit IRC | 10:28 | |
| *** adarazs has joined #tripleo | 10:28 | |
| *** mburned` has quit IRC | 10:28 | |
| *** mburned` has joined #tripleo | 10:28 | |
| *** hewbrocc` has quit IRC | 10:28 | |
| *** hewbrocc` has joined #tripleo | 10:28 | |
| *** weshay_ has quit IRC | 10:28 | |
| *** weshay_ has joined #tripleo | 10:28 | |
| *** markmc` has quit IRC | 10:28 | |
| *** markmc` has joined #tripleo | 10:28 | |
| *** eck`` has quit IRC | 10:28 | |
| *** eck`` has joined #tripleo | 10:28 | |
| *** haleyb_ has quit IRC | 10:28 | |
| *** haleyb_ has joined #tripleo | 10:28 | |
| *** yprokule has quit IRC | 10:28 | |
| *** yprokule has joined #tripleo | 10:28 | |
| *** lucasagomes has quit IRC | 10:28 | |
| *** lucasagomes has joined #tripleo | 10:28 | |
| jaosorior | dciabrin_: hey around? | 10:30 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Mount the public TLS certificate for HAProxy on up(date|grade) on pacemaker https://review.openstack.org/557653 | 10:30 |
| dciabrin_ | jaosorior, yep | 10:30 |
| *** zoli is now known as zoli|lunch | 10:31 | |
| *** salmankhan has joined #tripleo | 10:32 | |
| honza | my undercloud is telling me that random proxy endpoints in haproxy have no server available: what does this mean? how can i debug/fix? | 10:32 |
| *** yurii has joined #tripleo | 10:34 | |
| *** yurii has quit IRC | 10:35 | |
| *** yurii has joined #tripleo | 10:35 | |
| *** bandini has quit IRC | 10:38 | |
| jaosorior | marios: seems that the update run scenario doesn't regenearte overcloudrc. Is that excepted or should I raise a bug? | 10:40 |
| *** pmannidi has quit IRC | 10:40 | |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-heat-templates stable/newton: Change ovs user and fix permissions on ovs upgrade https://review.openstack.org/558471 | 10:43 |
| *** rcernin has joined #tripleo | 10:45 | |
| jpich | honza: Usually for me it means the service is down, you might try to check if they're up? | 10:45 |
| *** bandini has joined #tripleo | 10:45 | |
| *** tbonds_ has quit IRC | 10:47 | |
| marios | jaosorior: for minor update in p/q there is only one stack update at the start when we generate the playbooks. heat deployments don't get applied there | 10:56 |
| marios | jaosorior: no we don't re-generate overcloudrc | 10:56 |
| marios | jaosorior: you can raise a bug if you think it should? | 10:56 |
| * marios coffee run brb | 10:56 | |
| *** panda is now known as panda|lunch | 10:58 | |
| *** anande has quit IRC | 10:58 | |
| *** yurii has quit IRC | 10:58 | |
| *** moshele has quit IRC | 11:02 | |
| *** moshele has joined #tripleo | 11:03 | |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 11:10 |
| *** gfidente^2nd has quit IRC | 11:11 | |
| *** pradk has joined #tripleo | 11:14 | |
| *** jfrancoa is now known as jfrancoa|lunch | 11:17 | |
| *** lucasagomes is now known as lucas-hungry | 11:19 | |
| *** gfidente has joined #tripleo | 11:22 | |
| *** gfidente has quit IRC | 11:22 | |
| *** gfidente has joined #tripleo | 11:22 | |
| *** etingof has quit IRC | 11:23 | |
| jaosorior | marios: will raise a bug | 11:24 |
| *** pdeore has quit IRC | 11:24 | |
| *** hachi-ju has quit IRC | 11:25 | |
| *** pradk has quit IRC | 11:26 | |
| *** number80 has joined #tripleo | 11:26 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Don't log set_fact tasks for role_data https://review.openstack.org/558636 | 11:30 |
| *** zoli|lunch is now known as zoli | 11:30 | |
| Tengu | marios: hello :). would you be able to check the new issue I stubmled on today for the infamous migration? https://bugs.launchpad.net/tripleo/+bug/1761093 | 11:31 |
| openstack | Launchpad bug 1761093 in tripleo "Upgrade "Pike BM" -> "Pike Containers": httpd issue" [Undecided,New] | 11:31 |
| *** quiquell is now known as quiquell|lunch | 11:32 | |
| *** holser__ has quit IRC | 11:34 | |
| *** holser__ has joined #tripleo | 11:35 | |
| *** gyan__ has quit IRC | 11:38 | |
| *** leanderthal has joined #tripleo | 11:39 | |
| d0ugal | jaosorior: https://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/puppet-stack-config.yaml.template#L212 | 11:40 |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-quickstart-extras master: Fix parameter call for reproducer https://review.openstack.org/558785 | 11:42 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Install additional roles for quickstart https://review.openstack.org/558786 | 11:42 |
| *** ykarel__ has quit IRC | 11:43 | |
| *** rfolco|off is now known as rfolco|ruck | 11:43 | |
| bogdando | EmilienM, slagle: hi. https://review.openstack.org/#/c/550060/6 needs https://review.openstack.org/#/c/550081/3 to go first please | 11:43 |
| *** pradk has joined #tripleo | 11:44 | |
| bogdando | PTAL https://review.openstack.org/#/c/556516/ folks | 11:45 |
| *** cshastri has joined #tripleo | 11:47 | |
| *** ykarel has joined #tripleo | 11:50 | |
| *** abishop_ has joined #tripleo | 11:52 | |
| *** jpena is now known as jpena|lunch | 11:53 | |
| *** jfrancoa|lunch is now known as jfrancoa | 11:55 | |
| *** dprince has joined #tripleo | 11:55 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test ci2 https://review.openstack.org/558189 | 11:58 |
| *** hamdyk has quit IRC | 11:59 | |
| lhinds | ping jaosorior | 11:59 |
| jaosorior | lhinds: pong | 12:00 |
| *** jlabarre has joined #tripleo | 12:00 | |
| jaosorior | gonna wait a bit for more folks to show up | 12:00 |
| jaosorior | lhinds: how's it going? | 12:00 |
| lhinds | good thanks, was away last week..how did it go? | 12:00 |
| owalsh | o/ | 12:00 |
| jaosorior | lhinds: it went alright :) | 12:00 |
| lhinds | jaosorior: good | 12:01 |
| lhinds | hey owalsh | 12:01 |
| raildo | o/ | 12:01 |
| jaosorior | and it's going alright, a little bit stuck on the TLS by default work, but I'll give an update in some minutes | 12:01 |
| *** shreshtha has quit IRC | 12:01 | |
| lhinds | I am still a bit behind on stuff as well, but its not fallen off my table. | 12:01 |
| jaosorior | just gonna wait a couple more minutes just so folks can join (if someone else joins, who knows) | 12:01 |
| *** hamdyk has joined #tripleo | 12:02 | |
| jaosorior | alright | 12:03 |
| jaosorior | #startmeeting TripleO Security Squad | 12:03 |
| openstack | Meeting started Wed Apr 4 12:03:15 2018 UTC and is due to finish in 60 minutes. The chair is jaosorior. Information about MeetBot at http://wiki.debian.org/MeetBot. | 12:03 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 12:03 |
| *** openstack changes topic to " (Meeting topic: TripleO Security Squad)" | 12:03 | |
| openstack | The meeting name has been set to 'tripleo_security_squad' | 12:03 |
| *** jcoufal has joined #tripleo | 12:03 | |
| jaosorior | #topic Work progress update | 12:03 |
| *** openstack changes topic to "Work progress update (Meeting topic: TripleO Security Squad)" | 12:03 | |
| jaosorior | Hi folks! | 12:03 |
| lhinds | hey jaosorior | 12:04 |
| jaosorior | So, thanks for joining the Security Squad meeting. First, I would like to give a small update on how things are going | 12:04 |
| jaosorior | I've been mostly doing work on getting TripleO to use TLS by default on the public interfaces | 12:04 |
| jaosorior | The undercloud patches have merged, as well as the patches to get it as a default in the containerized undercloud | 12:05 |
| *** quiquell|lunch is now known as quiquell | 12:05 | |
| jaosorior | so: classic and containerized | 12:05 |
| jaosorior | I've been a little stuck on the overcloud though | 12:05 |
| *** noslzzp has joined #tripleo | 12:05 | |
| *** vpickard_ is now known as vpickard | 12:05 | |
| jaosorior | The main problem being that the current code that I have https://review.openstack.org/#/c/554926/ relies on the undercloud having the CA file generated, and that way it detects if we can use the same CA, and get the certs from there. | 12:06 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test ci roles https://review.openstack.org/558790 | 12:06 |
| jaosorior | If no TLS is enabled in the undercloud, then we don't request the certs for the overcloud... BUT this kinda complicates things on what defaults should we use for the endpoints and such | 12:06 |
| jaosorior | and it makes it hard to detect if the deployer overwrote those endpoints at some point | 12:06 |
| jaosorior | so I need to come up with a solution for that | 12:06 |
| jaosorior | one idea I had is to always deploy the local CA certificate in the undercloud: https://review.openstack.org/#/c/558768/ which is failing for some reason (need to investigate it) | 12:07 |
| jaosorior | that way we would always have the CA available, and we could just change the defaults for the overcloud to use https | 12:07 |
| jaosorior | hope I didn't go too deep into details | 12:07 |
| jaosorior | but again, if anybody is interested in joining that effort, reach out | 12:08 |
| jaosorior | and also I really appreciate reviews and ideas | 12:08 |
| jaosorior | any questions/feedback? | 12:08 |
| lhinds | do you have the patches you staged jaosorior ? | 12:08 |
| lhinds | or topic | 12:09 |
| lhinds | sorry, i see them now :-/ | 12:09 |
| jaosorior | lhinds: I've been adding most of the patches to the etherpad https://etherpad.openstack.org/p/tripleo-security-squad but also I'm using a topic for them | 12:09 |
| jaosorior | https://review.openstack.org/#/q/topic:public-tls-default+(status:open+OR+status:merged) | 12:09 |
| lhinds | ack, got it jaosorior - me being slow | 12:10 |
| jaosorior | public-tls-default is the topic | 12:10 |
| trozet | jaosorior: do you mind approving https://review.openstack.org/#/c/558664/ ? | 12:10 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 12:10 |
| *** alee has joined #tripleo | 12:10 | |
| *** jbadiapa_ is now known as jbadiapa | 12:10 | |
| jaosorior | trozet: done. | 12:10 |
| trozet | jaosorior: ty | 12:11 |
| jaosorior | #topic Any other business | 12:11 |
| *** openstack changes topic to "Any other business (Meeting topic: TripleO Security Squad)" | 12:11 | |
| jaosorior | that was all from my side (on the progress update bit) | 12:11 |
| jaosorior | does anybody else have anything you would like to bring up to the meeting? | 12:11 |
| *** lucas-hungry is now known as lucasagomes | 12:11 | |
| lhinds | I can provide a small update (not much as I was away last week) | 12:11 |
| jaosorior | Sure | 12:12 |
| *** thegodfather is now known as fabbione | 12:12 | |
| jaosorior | lhinds: should I add a topic so it's easier to follow in the logs? | 12:12 |
| lhinds | #topic Limit TripleO users | 12:12 |
| jaosorior | #topic Limit TripleO users | 12:12 |
| *** openstack changes topic to "Limit TripleO users (Meeting topic: TripleO Security Squad)" | 12:12 | |
| lhinds | thx ! | 12:12 |
| jaosorior | lhinds: I don't recall the command to make you admin too | 12:13 |
| lhinds | #chair donaldduck | 12:13 |
| lhinds | > #chair donaldduck | 12:13 |
| jaosorior | lol ok | 12:13 |
| *** atoth has joined #tripleo | 12:13 | |
| lhinds | So I am yet to make a start on this, but have been thinking about my approach. I will start sketching it out in the following this week I hope: | 12:13 |
| lhinds | https://etherpad.openstack.org/p/tripleo-audit-limit-track | 12:13 |
| lhinds | can you hash topic Security Hardening pls jaosorior | 12:14 |
| jaosorior | #topic Security Hardening | 12:14 |
| *** openstack changes topic to "Security Hardening (Meeting topic: TripleO Security Squad)" | 12:14 | |
| lhinds | I need to look at the following patch and get this in a better state, its pretty horrible at the moment. | 12:15 |
| lhinds | #link https://review.openstack.org/#/c/444804/6 | 12:15 |
| lhinds | this will expose more values in tht for puppet-auditd | 12:15 |
| jaosorior | nice | 12:15 |
| lhinds | I also need to do some patches in DIB to allow a grub2.conf entry to start auditd early in system boot. | 12:16 |
| lhinds | the idea being audit starts early on in the boot cycle, before the services it tracks. | 12:16 |
| lhinds | That's it for me. | 12:16 |
| lhinds | thx jaosorior | 12:16 |
| jaosorior | lhinds: if you do patches, or have ideas you would like help on, feel free to put it in the etherpad so it's easier for people to track | 12:17 |
| jaosorior | at least that way I could review them easier :) | 12:17 |
| lhinds | jaosorior: just did that, added the auditd patch. | 12:17 |
| jaosorior | awesome | 12:17 |
| jaosorior | thansk | 12:17 |
| lhinds | great minds think alike :) | 12:17 |
| jaosorior | #topic Any other business (again) | 12:17 |
| *** openstack changes topic to "Any other business (again) (Meeting topic: TripleO Security Squad)" | 12:17 | |
| *** psahoo has quit IRC | 12:17 | |
| jaosorior | Just in case someone else has something to bring up | 12:18 |
| lhinds | nothing from me. | 12:18 |
| jaosorior | alee, raildo, owalsh ? | 12:18 |
| raildo | nothing from my side | 12:19 |
| owalsh | nothing from me | 12:19 |
| jaosorior | alrighty | 12:19 |
| jaosorior | Thanks for joining folks! | 12:19 |
| jaosorior | #endmeeting | 12:19 |
| *** openstack changes topic to "Welcome to Rocky. CI status - Promotions: RED; check/gate: GREEN; RDO CI jobs: Questionable | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/" | 12:19 | |
| openstack | Meeting ended Wed Apr 4 12:19:29 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 12:19 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo_security_squad/2018/tripleo_security_squad.2018-04-04-12.03.html | 12:19 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo_security_squad/2018/tripleo_security_squad.2018-04-04-12.03.txt | 12:19 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo_security_squad/2018/tripleo_security_squad.2018-04-04-12.03.log.html | 12:19 |
| lhinds | thx jaosorior ! | 12:19 |
| *** lblanchard has joined #tripleo | 12:20 | |
| owalsh | jaosorior: I'll try to review the TLS patches later, after a strong coffee maybe :-) | 12:20 |
| jaosorior | owalsh: haha sure :D it would be appreciated | 12:20 |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: [DNM] Checking performance after disabling security https://review.openstack.org/558412 | 12:22 |
| *** abishop_ is now known as abishop | 12:24 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers https://review.openstack.org/551441 | 12:26 |
| chandankumar | arxcruz|rover: weshay_ ^^ fixed subunit generation issue | 12:26 |
| weshay_ | nice | 12:27 |
| arxcruz|rover | chandankumar: great, i wasn't able to look in to subunit on containerized yet :) | 12:27 |
| arxcruz|rover | chandankumar++ | 12:27 |
| chandankumar | arxcruz|rover: I think we can better subunit generation part in run tempest later | 12:28 |
| *** mburned` is now known as mburned_out | 12:29 | |
| *** amoralej is now known as amoralej|lunch | 12:29 | |
| *** pchavva has joined #tripleo | 12:30 | |
| *** psahoo has joined #tripleo | 12:30 | |
| *** panda|lunch is now known as panda | 12:31 | |
| *** cshastri has quit IRC | 12:31 | |
| *** jlabarre is now known as rh-jelabarre | 12:33 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Expand jinja variables in one place only https://review.openstack.org/558369 | 12:34 |
| *** hamdyk has quit IRC | 12:36 | |
| *** adrianreza has quit IRC | 12:37 | |
| *** rh-jelabarre is now known as rh-jlabarre | 12:38 | |
| *** ratailor_ has quit IRC | 12:38 | |
| *** rh-jlabarre is now known as rh-jelabarre | 12:40 | |
| *** bfournie has joined #tripleo | 12:43 | |
| *** trown|outtypewww is now known as trown | 12:43 | |
| openstackgerrit | Thomas Herve proposed openstack/tripleo-heat-templates master: Revert config-download mappings in upgrade converge step https://review.openstack.org/555312 | 12:43 |
| *** colonwq has quit IRC | 12:44 | |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates master: Replace LOG.warn with LOG.warning https://review.openstack.org/558804 | 12:46 |
| mandre | shardy: I'm seeing a software config that is successful on the node, but the object in swift is empty and my action times out... Do you have any idea what could cause this? | 12:53 |
| *** jpena|lunch is now known as jpena | 12:53 | |
| mandre | shardy: I would expect it to hold the content of /var/lib/heat-config/deployed/whatever.notify.json from the deployed node... | 12:54 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Implement skipping of networks https://review.openstack.org/558805 | 12:55 |
| dtantsur | hey folks! I see check/gate GREEN, but nearly all jobs fail. Does this ring any bells? http://logs.openstack.org/36/555336/5/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/5f87f73/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-04-04_12_25_34 | 12:56 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Implement skipping of networks https://review.openstack.org/558805 | 12:56 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Run tempest on fs027 using containerized tempest https://review.openstack.org/551442 | 12:56 |
| chandankumar | arxcruz|rover: ^^ there | 12:56 |
| shardy | mandre: I think we poll for the deployments from swift, but the heat-config-notify is just posting to the heat-api? | 12:57 |
| shardy | mandre: the most likely reason is broken networking on the node I expect | 12:57 |
| shardy | e.g it can't reach the undercloud, are there any clues in the occ logs on the node? | 12:58 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Implement skipping of networks https://review.openstack.org/558805 | 12:58 |
| *** shardy is now known as shardy_mtg | 12:58 | |
| *** hamdyk has joined #tripleo | 12:58 | |
| shardy_mtg | https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.j2.yaml#L355 | 12:58 |
| shardy_mtg | mandre: ^^ | 12:58 |
| trown | dtantsur: saw that in a env I was working on this morning, and quiquell has too ... looking into it | 12:59 |
| *** mburned_out is now known as mburned | 12:59 | |
| dtantsur | cool, thanks | 12:59 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Implement skipping of networks https://review.openstack.org/558805 | 12:59 |
| trown | dtantsur: seems like some new bug... arxcruz|rover ^ | 12:59 |
| trown | arxcruz|rover: http://logs.openstack.org/36/555336/5/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/5f87f73/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-04-04_12_25_34 | 12:59 |
| mandre | shardy: that's it! SSL error | 13:00 |
| *** moshele has quit IRC | 13:00 | |
| therve | gfidente, So why do we need https://review.openstack.org/555312 backported? | 13:00 |
| arxcruz|rover | rfolco|ruck: ^ can you open the bug ? | 13:00 |
| therve | I thought the config download happened after the undercloud upgrade | 13:01 |
| mandre | shardy_mtg: thanks a lot, I had no idea where to look at | 13:01 |
| rfolco|ruck | arxcruz|rover, context please | 13:01 |
| arxcruz|rover | rfolco|ruck: http://logs.openstack.org/36/555336/5/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/5f87f73/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-04-04_12_25_34 | 13:01 |
| d0ugal | thrash: hmm https://logs.rdoproject.org/26/558526/2/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/Zd783e142fca14e4ba6a5ff5801a9def0/undercloud/var/log/mistral/executor.log.txt.gz#_2018-04-03_21_49_23_174 | 13:02 |
| rfolco|ruck | arxcruz|rover, sure. Thanks for letting me know. | 13:02 |
| *** pchavva has quit IRC | 13:03 | |
| thrash | d0ugal: there's no 'log_exceptions=False' on that call | 13:03 |
| d0ugal | oh :) | 13:03 |
| gfidente | therve I meant backported into queens | 13:03 |
| gfidente | not before | 13:03 |
| therve | Oh yeah sure | 13:04 |
| therve | It needs to land first :D | 13:04 |
| *** psachin has quit IRC | 13:04 | |
| *** psahoo has quit IRC | 13:05 | |
| therve | gfidente, Was that tested successfully? | 13:05 |
| *** Goneri has joined #tripleo | 13:05 | |
| *** weshay_ is now known as weshay | 13:06 | |
| rfolco|ruck | arxcruz|rover, is this recurrent ? I ask coz its check pipeline | 13:08 |
| arxcruz|rover | rfolco|ruck: according dtantsur and trown is happening often | 13:08 |
| thrash | d0ugal: https://logs.rdoproject.org/26/558526/2/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Zd783e142fca14e4ba6a5ff5801a9def0/undercloud/var/log/mistral/engine.log.txt.gz#_2018-04-03_21_45_34_206 | 13:09 |
| rfolco|ruck | arxcruz|rover, ok cool. Thanks. | 13:09 |
| trown | arxcruz|rover: rfolco|ruck, ya I think master is boosted | 13:09 |
| trown | rfolco|ruck: I reproduced on unrelated change this morning, as did quiquell | 13:09 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 13:10 |
| thrash | d0ugal: but it looks like it's still written to executor log :/ | 13:10 |
| rfolco|ruck | arxcruz|rover, trown here is the bug: https://bugs.launchpad.net/tripleo/+bug/1761171 | 13:11 |
| openstack | Launchpad bug 1761171 in tripleo "scn0001 multinode container: mistralclient api authorization failed" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 13:11 |
| thrash | d0ugal: actually... It looks like the swiftclient is writing that... | 13:11 |
| thrash | :( | 13:11 |
| d0ugal | thrash: I don't think the traceback was ever written to the engine, was it? | 13:12 |
| d0ugal | thrash: d'oh | 13:12 |
| *** morazi has joined #tripleo | 13:12 | |
| thrash | d0ugal: no, it was not written to engine.log... But the swiftclient did to executor | 13:12 |
| thrash | d0ugal: https://logs.rdoproject.org/26/558526/2/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Zd783e142fca14e4ba6a5ff5801a9def0/undercloud/var/log/mistral/executor.log.txt.gz#_2018-04-03_21_45_34_189 | 13:12 |
| *** tbonds has joined #tripleo | 13:14 | |
| d0ugal | thrash: How do you know it is swiftclient? | 13:14 |
| thrash | d0ugal: the stacktrace looks like it originated there... | 13:14 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/instack-undercloud master: Replace LOG.warn with LOG.warning https://review.openstack.org/558815 | 13:14 |
| d0ugal | thrash: sure, but the logger is mistral logger iiuc | 13:14 |
| thrash | d0ugal: yeah... | 13:14 |
| thrash | d0ugal: Hmmm | 13:14 |
| d0ugal | mistral.actions.openstack.base and mistral.executors.default_executor | 13:15 |
| thrash | d0ugal: I'm confused. lol | 13:15 |
| d0ugal | thrash: welcome to the club | 13:15 |
| *** salmankhan has quit IRC | 13:15 | |
| *** jmelvin has joined #tripleo | 13:17 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart master: Adding featureset051 https://review.openstack.org/558816 | 13:17 |
| jrist | EmilienM, fungi thanks | 13:18 |
| *** tzumainn has joined #tripleo | 13:18 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Remove role_data from inventory https://review.openstack.org/558322 | 13:19 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Use hostnames in inventory https://review.openstack.org/558550 | 13:19 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Configurable host network for inventory https://review.openstack.org/558630 | 13:19 |
| *** cshastri has joined #tripleo | 13:20 | |
| *** pradk has quit IRC | 13:20 | |
| *** udesale has quit IRC | 13:20 | |
| jrist | EmilienM, fungi - still getting familiar with Storyboard - but I don't see a tripleo ui board... | 13:20 |
| jrist | ah it's a project group | 13:21 |
| *** ykarel has quit IRC | 13:21 | |
| *** amoralej|lunch is now known as amoralej | 13:21 | |
| *** cshastri has quit IRC | 13:22 | |
| *** artom_ is now known as artom | 13:22 | |
| *** yolanda_ has joined #tripleo | 13:22 | |
| *** colonwq has joined #tripleo | 13:23 | |
| *** liverpooler has joined #tripleo | 13:23 | |
| *** yolanda has quit IRC | 13:24 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-common master: Update converge workflow to remove no-ops https://review.openstack.org/558535 | 13:26 |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Update converge CLI to remove no-ops https://review.openstack.org/558536 | 13:26 |
| *** pradk has joined #tripleo | 13:30 | |
| fungi | jrist: the project group is "tripleo" and the project (git repository) is "openstack/tripleo-ui | 13:33 |
| *** links has quit IRC | 13:35 | |
| *** mugsie_ is now known as mugsie | 13:35 | |
| *** mugsie has quit IRC | 13:36 | |
| *** mugsie has joined #tripleo | 13:36 | |
| *** salmankhan has joined #tripleo | 13:37 | |
| skramaja | slagle: around? | 13:37 |
| slagle | skramaja: yes | 13:38 |
| jaosorior | slagle: answered here https://review.openstack.org/#/c/556817/ | 13:38 |
| skramaja | slagle: in the config-download approach for nfv deployments (dpdk and sriov), there is an problem, for which need your opinion. for nfv deployments, we need to set the kernel args and reboot the compute nodes. it is done via PreNetworkConfig. in ansible when we reboot, the deployment stops. we need speciifc handling to ensure that the it waits for the node to come back.. | 13:40 |
| *** pradk has quit IRC | 13:40 | |
| skramaja | this restart could be avoided if we plan to use ansible deploy driver in ironic. but for now a reboot is required. | 13:40 |
| skramaja | slagle: https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/pre_network/host_config_and_reboot.yaml#L247 | 13:41 |
| skramaja | slagle: it is rebooted here. ^ | 13:41 |
| slagle | skramaja: does the reboot need to happen before NetworkDeployment is applied? | 13:42 |
| skramaja | yes slagle | 13:43 |
| EmilienM | hello | 13:43 |
| mandre | jaosorior: o/ how do I tell my node to accept the certs? http://paste.openstack.org/show/718378/ | 13:43 |
| skramaja | skramaja: in case of dpdk, without enabling hugepage kernel args, the dpdk port addition will fail (in os-net-config) | 13:44 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-heat-templates stable/newton: Change ovs user and fix permissions on ovs upgrade https://review.openstack.org/558471 | 13:44 |
| mandre | jaosorior: I tried to add the OS::TripleO::Services::CACerts and OS::TripleO::Services::CertmongerUser services to my openshift profile with no luck :-/ | 13:44 |
| *** pgadiya_ has quit IRC | 13:44 | |
| jaosorior | mandre: so yes, you need the CACerts one, and this http://tripleo.org/install/advanced_deployment/ssl.html#getting-the-overcloud-to-trust-cas | 13:44 |
| slagle | skramaja: we may need to add a new interface to run arbitrary Ansible before applying any of the deployments such as NetworkDeployment | 13:45 |
| mandre | jaosorior: is CertmongerUser needed? | 13:45 |
| jaosorior | mandre: not in your case | 13:45 |
| slagle | skramaja: and then from there you could add a reboot task, and use the wait_for module for the servers to finish rebooting | 13:45 |
| mandre | jaosorior: ok thanks, let me try it | 13:46 |
| jaosorior | mandre: but yeah, CACerts should be a service there, and you gotta add the CA certificate to the CAMap parameter. | 13:46 |
| skramaja | ok slagle i will give a try, and keep you posted.. | 13:46 |
| owalsh | skramaja, slagle: this occurred to me today too. Maybe we can reuse the ansible tasks, although the ironic ansible stuff has do all of the interesting things in a chroot | 13:46 |
| openstackgerrit | Raildo Mascena proposed openstack/tripleo-ipsec master: Update to openstack-tox-linters job https://review.openstack.org/558822 | 13:47 |
| jaosorior | raildo: thanks ^^ | 13:48 |
| skramaja | owalsh: with irnoic ansible, we could avoid this reboot, which will also reduce the deployment time for nfv. | 13:48 |
| raildo | jaosorior, np :) | 13:48 |
| slagle | skramaja: i'm thinking something like a "pre_deployment_tasks" that work like external_deploy_tasks, but we run them right before "Server deployments" from here: https://github.com/openstack/tripleo-heat-templates/blob/master/common/deploy-steps.j2#L414 | 13:48 |
| *** links has joined #tripleo | 13:48 | |
| owalsh | skramaja, slagle: do we need to support deployed servers too? | 13:48 |
| jaosorior | slagle: what about adding a step -1 to external_deploy_tasks? :D | 13:49 |
| owalsh | skramaja: if we do then we'll need to reboot either way | 13:49 |
| slagle | skramaja: owalsh : i assume you do | 13:49 |
| *** ykarel has joined #tripleo | 13:49 | |
| slagle | jaosorior: actually, that's not a bad idea...we could have a external_deploy_tasks step 0 | 13:50 |
| *** mcornea has joined #tripleo | 13:50 | |
| slagle | and run only step 0 before "Server deployments" | 13:50 |
| skramaja | slagle: ok. i will start with it. | 13:51 |
| *** rpioso|afk is now known as rpioso | 13:51 | |
| jaosorior | slagle: yeah, it's not too bad; same interface as we already have, and the step -1 or 0 do note that it's before what folks know as the usual steps. | 13:51 |
| owalsh | slagle, jaosorior: why not name the steps? | 13:51 |
| jaosorior | owalsh: ?? | 13:52 |
| skramaja | slagle: another thing just for your info is we are working on containerizing openvswich which should be installed before NetworkDeployment. so probbably, multiple pre_network configurations are required. | 13:52 |
| owalsh | jaosorior: do they have to be numbers? | 13:52 |
| jaosorior | owalsh: well, that's how it always has been | 13:53 |
| jaosorior | owalsh: at some point we could actually give those numbers aliases, that would probably be more descriptive | 13:53 |
| slagle | actually external_deploy_tasks only run against the underclod, so that probably wouldn't work | 13:53 |
| jaosorior | slagle: deploy_tasks runs against the overcloud though | 13:53 |
| jaosorior | if that's what you need | 13:53 |
| owalsh | jaosorior: don't think the numbers really matter though. Would make inserting a new step a hell of a lot less painful :-) | 13:54 |
| owalsh | jaosorior: matters to puppet since we have conditionals all over puppet-tripleo, but I don't think steps are significant in t-h-t, jinja just needs to iterate over the steps in the right order IIRC | 13:55 |
| slagle | jaosorior: yes, it'd have to be deploy_steps_tasks | 13:55 |
| openstackgerrit | Merged openstack/tripleo-ipsec master: Update to openstack-tox-linters job https://review.openstack.org/558822 | 13:57 |
| jaosorior | raildo: :D ^^ | 13:58 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Implement skipping of networks https://review.openstack.org/558805 | 13:58 |
| raildo | jaosorior, well, it was quickly :D | 13:58 |
| *** moshele has joined #tripleo | 13:58 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Support deploy_steps_tasks step 0 https://review.openstack.org/558829 | 13:58 |
| slagle | jaosorior: owalsh skramaja : something like that ^^ | 13:58 |
| jaosorior | slagle: looks about right | 13:59 |
| jaosorior | slagle: do we have somewhere where we document the steps? | 14:00 |
| owalsh | jaosorior: in the README IIRC | 14:00 |
| slagle | yaml is self documenting | 14:00 |
| jaosorior | lol | 14:00 |
| skramaja | ok slagle | 14:00 |
| slagle | jaosorior: :). yea the out of date README probably | 14:00 |
| *** moshele has quit IRC | 14:01 | |
| *** tbonds has quit IRC | 14:03 | |
| *** agopi has joined #tripleo | 14:03 | |
| owalsh | jaosorior: [puppet|docker]/services/README.rst | 14:03 |
| *** noslzzp has quit IRC | 14:04 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Update deprecated auth_uri option. https://review.openstack.org/558831 | 14:05 |
| jaosorior | jfrancoa: thanks for the commit! commented. | 14:06 |
| jfrancoa | jaosorior: np, it took me a while realizing where the problem was...thanks for the comment, I'll rework it | 14:08 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 14:10 |
| mcornea | marios: hey o/ got a question re https://review.openstack.org/#/c/557937/ - does openstack overcloud ffwd-upgrade accept options for passing custom roles data (-r) or enviroment files(-e) that would override the current ones? | 14:12 |
| *** ramishra has quit IRC | 14:13 | |
| marios | mcornea: yeah the ffwd-upgrade prepare inherits from the Deploy class ( https://review.openstack.org/#/c/557937/4/tripleoclient/v1/overcloud_ffwd_upgrade.py@26 ) which means we get all its params (like https://github.com/openstack/python-tripleoclient/blob/a5a56b8a9c43551e672703ca67d732b55881c0d3/tripleoclient/v1/overcloud_deploy.py#L618 ) | 14:15 |
| marios | mcornea: (discuss some morein the call in bit) | 14:16 |
| mcornea | marios: cool, tnx | 14:16 |
| arxcruz|rover | jfrancoa: thanks for your comments on https://bugs.launchpad.net/tripleo/+bug/1761171 | 14:16 |
| openstack | Launchpad bug 1761171 in tripleo "scn0001 multinode container: mistralclient api authorization failed" [Critical,In progress] - Assigned to Jose Luis Franco (jfrancoa) | 14:16 |
| arxcruz|rover | jfrancoa: so, mistral guys need to update puppet-mistral to change auth_uri to www_authenticate_uri | 14:16 |
| arxcruz|rover | right ? | 14:16 |
| arxcruz|rover | jfrancoa: oh, nevermind, it's in tripleo-heat-template | 14:17 |
| jfrancoa | arxcruz|rover: I'm now updating the option in instack_undercloud, and waiting for ci results. It seems so, the parameter has been changed recently to www_authenticate_uri | 14:17 |
| arxcruz|rover | jfrancoa: thanks anyway :) | 14:17 |
| arxcruz|rover | rfolco|ruck: trown dtantsur ^ | 14:18 |
| jfrancoa | arxcruz|rover: welcome | 14:18 |
| dtantsur | thanks | 14:18 |
| *** fpan has quit IRC | 14:19 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart master: Adding featureset048 https://review.openstack.org/558816 | 14:19 |
| jfrancoa | jaosorior: one doubt, if I understand your comment correctly. are you suggesting to keep both options? auth_uri and the new www_authenticate_uri? | 14:20 |
| jaosorior | jfrancoa: yes | 14:20 |
| jfrancoa | jaosorior: ok, thanks! just to have it clear. I'll change it then | 14:21 |
| *** weshay changes topic to "Welcome to Rocky. CI status - Promotions: GREEN; check/gate: RED; RDO CI jobs: Questionable | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/" | 14:23 | |
| *** mcornea has quit IRC | 14:23 | |
| weshay | mwhahaha, fyi.. added alert to https://bugs.launchpad.net/tripleo/+bug/1761171 | 14:23 |
| openstack | Launchpad bug 1761171 in tripleo "scn0001 multinode container: mistralclient api authorization failed" [Critical,In progress] - Assigned to Jose Luis Franco (jfrancoa) | 14:23 |
| jfrancoa | jaosorior: by the way, the same can apply for the case of instack_undercloud? should we keep both too? | 14:23 |
| mwhahaha | weshay: k | 14:24 |
| jaosorior | jfrancoa: yep | 14:25 |
| *** mcornea has joined #tripleo | 14:25 | |
| mwhahaha | oh fiddle sticks | 14:25 |
| jfrancoa | jaosorior: great, thanks! | 14:26 |
| chandankumar | weshay: undercloud install is failing is it a known issue currently? | 14:26 |
| mwhahaha | yea | 14:26 |
| mwhahaha | i'm fixing the puppet | 14:26 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates master: DNM: Test uncontainerizing neutron services https://review.openstack.org/557424 | 14:26 |
| *** jcoufal_ has joined #tripleo | 14:27 | |
| weshay | chandankumar, ya.. just added it the alerts | 14:27 |
| chandankumar | weshay: thanks :-) | 14:27 |
| weshay | rfolco|ruck, arxcruz|rover if check or gate jobs are failing due to an issue.. that's a tag = "alert" | 14:28 |
| *** pradk has joined #tripleo | 14:28 | |
| arxcruz|rover | weshay: ack | 14:28 |
| rfolco|ruck | weshay, oops, forgot it, sorry. | 14:29 |
| *** jcoufal has quit IRC | 14:30 | |
| openstackgerrit | Jose Luis Franco proposed openstack/instack-undercloud master: Replace deprecated auth_uri by www_authenticate_uri. https://review.openstack.org/558837 | 14:31 |
| jistr | marios, matbu: just some FYI 1) update converge is tested & ready for review 2) we should probably think whether we want the stack update on upgrade converge or not then... I thought we'd have it but FFU patch only does plan update right now. (I think FFU and upgrade converge should behave the same.) | 14:31 |
| *** waleedm has quit IRC | 14:32 | |
| *** rcernin has quit IRC | 14:32 | |
| jistr | re 2) i'm not zealously advocating for either side... just think that e.g. when i finished my upgrade, i would like a "sanity run" of Heat stack-update before i start doing things like scale-down and scale-up etc. OTOH an argument in favor of not doing the stack update is "it's much faster and if everything works as intended, the stack update shouldn't make a real difference" | 14:33 |
| jistr | trying to imagine myself as an operator, i'd probably go for the stack-update sanity check... | 14:34 |
| jistr | marios, matbu: though i could still do it manually via `overcloud deploy` after i've finished with `overcloud upgrade/ffwd converge`... | 14:35 |
| marios | jistr: on call right now will catchup later | 14:36 |
| jistr | ack | 14:36 |
| *** dparkes has quit IRC | 14:37 | |
| *** noslzzp has joined #tripleo | 14:37 | |
| *** SulaimanRadwan has quit IRC | 14:39 | |
| *** d0ugal has quit IRC | 14:39 | |
| *** d0ugal has joined #tripleo | 14:41 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add www_authenticate_uri option to replace auth_uri. https://review.openstack.org/558831 | 14:41 |
| jfrancoa | jaosorior: updated ^, have a look at it when you have some time please | 14:42 |
| jaosorior | jfrancoa: thanks! | 14:43 |
| dtantsur | an easy queens backport to approve, CI is green: https://review.openstack.org/#/c/554585/ | 14:43 |
| *** dsariel has quit IRC | 14:45 | |
| mandre | jaosorior: so IIUC the CACerts is for when I'm deploying an overcloud with SSL... this is not exactly what I want, I have an SSL undercloud and I want my nodes to trust the undercloud certs | 14:45 |
| mandre | jaosorior: I can see my overcloud nodes have a /etc/pki/ca-trust/source/anchors/undercloud-ca.pem file, but not my openshift nodes and I don't know what creates this file | 14:46 |
| openstackgerrit | Jose Luis Franco proposed openstack/instack-undercloud master: Replace deprecated auth_uri by www_authenticate_uri. https://review.openstack.org/558837 | 14:47 |
| d0ugal | rbrady,d0ugal,apetrich,thrash,toure,jtomasek: Workflow Squad Meeting in ~12 mins. https://etherpad.openstack.org/p/tripleo-workflows-squad-status | 14:48 |
| jaosorior | mandre: CACerts is when you need your overcloud to trust a certain CA certificate. | 14:48 |
| jaosorior | mandre: that gets created by the CACerts profile/role or whatever (dunno how to call it) | 14:49 |
| jaosorior | mandre: wanna open a tmate session? | 14:49 |
| *** khrystop_ has quit IRC | 14:50 | |
| toure | d0ugal ack | 14:50 |
| *** khrystoph has joined #tripleo | 14:50 | |
| *** jcoufal_ has quit IRC | 14:50 | |
| mandre | jaosorior: that would be awesome, I'll send you the url | 14:50 |
| *** jcoufal has joined #tripleo | 14:51 | |
| *** lblanchard has quit IRC | 14:51 | |
| *** haleyb_ is now known as haleyb | 14:52 | |
| *** morazi has quit IRC | 14:55 | |
| EmilienM | just a reminder everyone: PLEASE DO NOT RECHECK :-) the gate is red right now, Alex has a patch: https://review.openstack.org/#/c/558827 | 14:55 |
| *** suuuper has joined #tripleo | 14:57 | |
| *** adarazs is now known as adarazs_afk | 14:57 | |
| *** pchavva has joined #tripleo | 14:58 | |
| *** dsariel has joined #tripleo | 14:58 | |
| *** links has quit IRC | 15:00 | |
| *** pradk has quit IRC | 15:02 | |
| *** mwhahaha changes topic to "Welcome to Rocky. CI status -RED. ಠ_ಠ Do not recheck | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/" | 15:02 | |
| *** pradk has joined #tripleo | 15:06 | |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-common stable/queens: Defaults to parent_resource name correctly https://review.openstack.org/558845 | 15:06 |
| jaosorior | EmilienM: jfrancoa has some patches as well :D | 15:06 |
| jaosorior | EmilienM: https://review.openstack.org/558837 https://review.openstack.org/558831 | 15:06 |
| mwhahaha | jaosorior: yea but the puppet stuff is way broken | 15:07 |
| mwhahaha | it needs to get fixed in puppet | 15:07 |
| mwhahaha | not anywhere else | 15:07 |
| mwhahaha | those will be follow ups once we actually untangle the puppet fiasco | 15:07 |
| EmilienM | but the patches are good, thanks jaosorior / jfrancoa | 15:07 |
| mwhahaha | happy wednesday | 15:07 |
| *** hamdyk has quit IRC | 15:08 | |
| *** ukalifon has quit IRC | 15:09 | |
| EmilienM | jaosorior, jfrancoa: I dropped a comment, about why do we keep the old param? | 15:09 |
| mwhahaha | EmilienM: not all the patches have landed in puppet so it depends on how we want to do this | 15:09 |
| jfrancoa | EmilienM: np, let's focus on merging Alex' one and we can change tht and instack-undercloud later | 15:09 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1761171 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 15:10 |
| openstack | Launchpad bug 1761171 in tripleo "scn0001 multinode container: mistralclient api authorization failed" [Critical,In progress] - Assigned to Jose Luis Franco (jfrancoa) | 15:10 |
| mwhahaha | also i'm assuming we'll need a promotion to actually get the new param | 15:10 |
| EmilienM | jfrancoa: thanks for the patches anyway, it helps to move forward with new config!! | 15:10 |
| *** morazi_onsite has joined #tripleo | 15:10 | |
| jaosorior | EmilienM: haha I commented on jfrancoa's patch asking him to keep both; so we could wait for all the pupet-* patches to merge. And aftwards we could have a poatch removing the old parameter. | 15:10 |
| *** morazi_onsite is now known as morazi | 15:11 | |
| *** marios has quit IRC | 15:11 | |
| jaosorior | jfrancoa: sorry man, made you do some extra work | 15:11 |
| jfrancoa | jaosorior: no problem, it might be useful at some point, and if not, at least it was good to have some fun :-D | 15:12 |
| *** marios has joined #tripleo | 15:12 | |
| *** etingof has joined #tripleo | 15:13 | |
| *** janki has quit IRC | 15:14 | |
| *** fpan has joined #tripleo | 15:18 | |
| *** salmankhan has quit IRC | 15:25 | |
| *** salmankhan has joined #tripleo | 15:25 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-upgrade master: Support --ssh-user argument to upgrade/update run command https://review.openstack.org/558850 | 15:30 |
| *** yamahata has joined #tripleo | 15:30 | |
| *** leanderthal has quit IRC | 15:31 | |
| EmilienM | jaosorior: thanks a lot for your reviews on my THT changes for config alignment, I'm glad you catch them | 15:33 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common master: Fix error handling in set_provision_state/set_power_state workflows https://review.openstack.org/552554 | 15:34 |
| *** jaganathan has joined #tripleo | 15:35 | |
| *** toure is now known as toure|biab | 15:38 | |
| *** tesseract has quit IRC | 15:38 | |
| *** dtantsur is now known as dtantsur|brb | 15:38 | |
| *** agopi has quit IRC | 15:40 | |
| *** tcw1 is now known as tcw | 15:40 | |
| *** jcoufal_ has joined #tripleo | 15:40 | |
| *** agopi has joined #tripleo | 15:40 | |
| *** tesseract has joined #tripleo | 15:41 | |
| *** bugzy_ is now known as bugzy | 15:41 | |
| *** links has joined #tripleo | 15:43 | |
| *** thrash is now known as thrash|biab | 15:43 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-upgrade master: Support --ssh-user argument to upgrade/update run command https://review.openstack.org/558850 | 15:43 |
| *** jcoufal has quit IRC | 15:43 | |
| *** agurenko has quit IRC | 15:44 | |
| *** pcaruana|afk| has quit IRC | 15:45 | |
| *** chlong has joined #tripleo | 15:46 | |
| mwhahaha | owalsh: do you know if your comment on https://review.openstack.org/#/c/521172/1/elements/overcloud-compute/install.d/package-installs-overcloud-compute is still valid? | 15:46 |
| mwhahaha | owalsh: do we still need nova_migration_package for Rocky? | 15:46 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart master: Make sure we keep using tripleo-admin as ssh user in CI https://review.openstack.org/558855 | 15:47 |
| *** panda is now known as panda|training | 15:47 | |
| owalsh | mwhahaha: should be ok if we don't need a baremetal to containers upgrade path | 15:48 |
| mwhahaha | shouldn't for rocky | 15:48 |
| * mwhahaha is updating the patch to shrink the overcloud images | 15:48 | |
| *** skramaja has quit IRC | 15:50 | |
| * owalsh bets we have some implicit dependencies that this will break :-) | 15:50 | |
| mwhahaha | about to find out :D | 15:54 |
| owalsh | assume this will speed up CI a bit, possibly a lot if there is an image build | 15:56 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-puppet-elements master: Remove Openstack and Ceph packages https://review.openstack.org/521172 | 15:56 |
| mwhahaha | yea | 15:56 |
| mwhahaha | it's time | 15:56 |
| * mwhahaha purges all the things | 15:56 | |
| *** salmankhan has quit IRC | 15:56 | |
| mwhahaha | we can probably get ride of the mongo/mysql stuff too | 15:57 |
| *** dsariel has quit IRC | 15:57 | |
| mwhahaha | bandini, dciabrin_, Ng: we aren't leveraging any pacemaker/fencing stuff from the host anymore are we? | 15:58 |
| mwhahaha | bandini, dciabrin_, Ng: those also fully containerized right? | 15:58 |
| openstackgerrit | Merged openstack/tripleo-ui master: Make running workflows more robust https://review.openstack.org/549751 | 15:59 |
| dciabrin_ | mwhahaha, we do actually. VIP resources are run on the host, and fencing actions are triggered from the host | 15:59 |
| mwhahaha | dciabrin_: so we still need those packages | 15:59 |
| dciabrin_ | running services with unix process all run in containers | 16:00 |
| dciabrin_ | mwhahaha, correct | 16:00 |
| mwhahaha | k thanks | 16:00 |
| *** atoth has quit IRC | 16:00 | |
| *** jfrancoa has quit IRC | 16:01 | |
| mwhahaha | pradk: we've officially dropped mongodb support right? wasn't that in queens where we wouldn't be shipping the package anymore? | 16:02 |
| pradk | mwhahaha, correct, I think it was starting pike | 16:02 |
| mwhahaha | pradk: is there any efforts to purge it from the configuration? i see it's still in a bunch of palces | 16:03 |
| mwhahaha | zaqar appears to be using it | 16:03 |
| mwhahaha | or referencing it | 16:03 |
| *** salmankhan has joined #tripleo | 16:03 | |
| openstackgerrit | Merged openstack/tripleo-ui master: Make Validation actions use startWorkflow https://review.openstack.org/550086 | 16:03 |
| openstackgerrit | Merged openstack/tripleo-ui master: Make Nodes workflow actions use startWorkflow https://review.openstack.org/550232 | 16:03 |
| openstackgerrit | Merged openstack/tripleo-ui master: Refactor RolesActions to use startWorkflow https://review.openstack.org/552532 | 16:03 |
| pradk | mwhahaha, thought Samar moved to redis ? | 16:03 |
| mwhahaha | therve: do we support mongodb with zaqar? | 16:03 |
| pradk | zaqar* | 16:03 |
| mwhahaha | not in the defaults | 16:03 |
| mwhahaha | https://github.com/openstack/tripleo-heat-templates/blob/4e3cd0df30e8f53743808b65f17b7a96f6e974ba/docker/services/zaqar.yaml#L16 | 16:04 |
| mwhahaha | so much for purging that from the overcloud image | 16:04 |
| pradk | mwhahaha, guess no ones using zaqar then :) | 16:05 |
| therve | mwhahaha, Depends who's we | 16:05 |
| mwhahaha | :o | 16:05 |
| therve | mwhahaha, I don't think we do in tripleo | 16:05 |
| mwhahaha | therve: k so what's the correct default that we (tripleo) should be using for zaqar then? | 16:05 |
| mwhahaha | since it's still set to mongodb | 16:05 |
| therve | redis probably | 16:05 |
| *** links has quit IRC | 16:05 | |
| *** mcornea has quit IRC | 16:06 | |
| *** waleedm has joined #tripleo | 16:07 | |
| * mwhahaha would like to really drop mongo support | 16:07 | |
| *** mcornea has joined #tripleo | 16:07 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates stable/newton: Include database in the default event dispatchers https://review.openstack.org/558864 | 16:09 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1761171 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 16:10 |
| openstack | Launchpad bug 1761171 in tripleo "scn0001 multinode container: mistralclient api authorization failed" [Critical,In progress] - Assigned to Jose Luis Franco (jfrancoa) | 16:10 |
| *** jaganathan has quit IRC | 16:10 | |
| *** dparkes has joined #tripleo | 16:12 | |
| *** trown is now known as trown|lunch | 16:14 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Revert "Run containerized mistral-api eventlet" https://review.openstack.org/558557 | 16:14 |
| *** atoth has joined #tripleo | 16:15 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Enforce env_variables values to string before run https://review.openstack.org/558865 | 16:17 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: zaqar: fix hieradata to enable Debug https://review.openstack.org/558651 | 16:19 |
| openstackgerrit | Marios Andreou proposed openstack/python-tripleoclient master: WIP Add converge env into the upgrade converge https://review.openstack.org/558866 | 16:19 |
| *** links has joined #tripleo | 16:19 | |
| *** fpan has quit IRC | 16:21 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: mistral: align parameters with undercloud https://review.openstack.org/558654 | 16:21 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: mistral: align parameters with undercloud https://review.openstack.org/558654 | 16:21 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: masquerade: stop using YAQL for iptables data https://review.openstack.org/558236 | 16:21 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: heat: align config with instack-undercloud https://review.openstack.org/558354 | 16:22 |
| *** marios has quit IRC | 16:25 | |
| *** dparkes has quit IRC | 16:25 | |
| *** udesale has joined #tripleo | 16:26 | |
| mwhahaha | therve: what backend should we switch the default to for zaqar? i'd like to purge mongodb. should i just switch it to redis? | 16:28 |
| therve | mwhahaha, Yes | 16:28 |
| mwhahaha | EmilienM: what backend do we use for zaqar on the undercloud? swift? and how do we set that | 16:28 |
| mwhahaha | k | 16:28 |
| *** florianf_ has quit IRC | 16:28 | |
| *** mcornea has quit IRC | 16:28 | |
| EmilienM | mwhahaha: swift | 16:29 |
| EmilienM | mwhahaha: containerized or not? | 16:30 |
| mwhahaha | EmilienM: both? | 16:30 |
| EmilienM | I checked, both use swift | 16:30 |
| *** mcornea has joined #tripleo | 16:30 | |
| EmilienM | zaqar::message_store: swift | 16:30 |
| mwhahaha | k | 16:30 |
| EmilienM | zaqar::messaging::swift::uri: URL | 16:30 |
| EmilienM | that's the magic | 16:30 |
| mwhahaha | *magic* | 16:31 |
| sshnaidm | EmilienM, where would I install dstat if I made a composable role for it? In which part of tripleo we do it usually? | 16:34 |
| *** toure|biab is now known as toure | 16:36 | |
| *** bogdando has quit IRC | 16:36 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Switch Zaqar to use Redis https://review.openstack.org/558874 | 16:37 |
| mwhahaha | sshnaidm: addition of new roles usually consist of THT/puppet-tripleo changes | 16:37 |
| sshnaidm | mwhahaha, maybe I mean service(?). like here: https://review.openstack.org/#/c/557476/ | 16:38 |
| EmilienM | mwhahaha: so redis is a good default | 16:38 |
| EmilienM | ah I just saw therve's comment on redis | 16:39 |
| EmilienM | I guess redis is better than swift for default, since we don't deploy swift by default? | 16:39 |
| mwhahaha | sshnaidm: a more complex, but quality example would be beekneemech's designate support https://review.openstack.org/#/c/518983/ https://review.openstack.org/#/c/518998/ | 16:39 |
| mwhahaha | sshnaidm: right that role stuff has to be created in THT/puppet-tripleo | 16:39 |
| *** yprokule has quit IRC | 16:39 | |
| mwhahaha | EmilienM: yea i would think redis would make more sense as a backend for zaqar anyway | 16:40 |
| mwhahaha | but that's for someone else to argue :D | 16:40 |
| sshnaidm | mwhahaha, but where actually to install package, which part of tht/puppet-tripleo? | 16:41 |
| *** Tengu has quit IRC | 16:41 | |
| mwhahaha | sshnaidm: it's a lot more complex than that | 16:41 |
| mwhahaha | sshnaidm: short answer, tripleo-puppet-elements & puppet-tripleo | 16:42 |
| mwhahaha | this is why it would be better to actually invest in reusing the collectd we already have provided | 16:42 |
| EmilienM | sshnaidm: you can run pure ansible tasks in THT | 16:42 |
| EmilienM | didn't we have this discussion already about dstat? | 16:42 |
| EmilienM | I thought it was resolved | 16:42 |
| *** Tengu has joined #tripleo | 16:42 | |
| *** beekneemech is now known as bnemec | 16:42 | |
| sshnaidm | I'm asking for self-learning more, if I have this service already.. | 16:43 |
| EmilienM | did we agree to deploy dstat as a service? The last time I check we had some pushback, isn't? | 16:43 |
| mwhahaha | https://docs.openstack.org/tripleo-docs/latest/install/developer/tht_walkthrough/tht_walkthrough.html | 16:43 |
| mwhahaha | that's how to add a service | 16:44 |
| EmilienM | in any case, if it's dstat, it's a matter of installer a package and running one command right? | 16:44 |
| mwhahaha | should porbably revisit that doc to make sure it's up to date with container stuff | 16:44 |
| EmilienM | if so, we can use external_deploy_tasks | 16:44 |
| mwhahaha | do we have docs on how to hook into external_deploy_tasks? | 16:45 |
| * mwhahaha hasn't looked in a while | 16:45 | |
| *** lucasagomes is now known as lucas-afk | 16:45 | |
| EmilienM | I know we have intree doc | 16:45 |
| mwhahaha | intree docs are like "go read the comments" | 16:45 |
| EmilienM | here: https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ansible_config_download.html | 16:46 |
| *** udesale has quit IRC | 16:46 | |
| mwhahaha | but we don't use config download everywhere yet | 16:46 |
| EmilienM | https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ansible_config_download.html#tags | 16:46 |
| EmilienM | we don't *yet* | 16:47 |
| mwhahaha | also not really a viable solution for previous releases | 16:47 |
| *** fpan has joined #tripleo | 16:47 | |
| EmilienM | it depends, are we going to backport that? | 16:48 |
| mwhahaha | it's for CI | 16:48 |
| mwhahaha | so at least partially | 16:48 |
| *** suuuper has quit IRC | 16:48 | |
| sshnaidm | I found only: * external_deploy_tasks: Ansible tasks to be run each step on the undercloud where a variable "step" is provided to enable conditionally running tasks at a given step | 16:49 |
| EmilienM | sshnaidm: before pushing for services, we need to investigate how we can use what we have now | 16:49 |
| EmilienM | sshnaidm: we already deploy collectd for a while, it would be great to see if we can use it | 16:50 |
| sshnaidm | EmilienM, I ask for learning, not for pushing it to CI, just a general question | 16:50 |
| *** suuuper has joined #tripleo | 16:50 | |
| mwhahaha | yea if you want to learn more about the composable services checkout the doc i posted | 16:50 |
| mwhahaha | it's the same pattern for all the services | 16:50 |
| sshnaidm | it's good to debug your own service... | 16:51 |
| sshnaidm | mwhahaha, yeah, looking into it.. | 16:51 |
| *** mcornea has quit IRC | 16:52 | |
| *** mcornea has joined #tripleo | 16:53 | |
| *** eck`` is now known as eck` | 16:53 | |
| dpeacock | EmilienM: Following https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/undercloud.html; the "Configuring the Undercloud" section is confusing me a little. It's reading as optional and unrelated; is this section skipable? | 16:54 |
| openstackgerrit | Mike Fedosin proposed openstack/tripleo-ui master: Use workflows instead of actions https://review.openstack.org/558880 | 16:54 |
| EmilienM | dpeacock: yes | 16:55 |
| EmilienM | dpeacock: right now what you need to do is the container image prepare and install --use-heat things | 16:56 |
| dpeacock | cool - thanks | 16:56 |
| EmilienM | dpeacock: we need to update the doc | 16:57 |
| dpeacock | ack | 16:57 |
| EmilienM | dpeacock: I added a task on https://trello.com/c/BQ1606lD/6-documentation | 16:58 |
| EmilienM | "Update "undercloud install" doc for containers, and mark undercloud_deploy doc as experimental and not used for production." | 16:58 |
| *** fragatina has joined #tripleo | 16:58 | |
| *** dprince has quit IRC | 16:59 | |
| *** bfournie has quit IRC | 16:59 | |
| *** bfournie has joined #tripleo | 17:00 | |
| dpeacock | EmilienM: I can take care of doc updates later once I've run through this and picked your brain more | 17:00 |
| *** holser__ has quit IRC | 17:03 | |
| *** bfournie has quit IRC | 17:04 | |
| *** shreshtha has joined #tripleo | 17:04 | |
| *** bfournie has joined #tripleo | 17:05 | |
| *** fragatina has quit IRC | 17:06 | |
| *** fragatina has joined #tripleo | 17:06 | |
| EmilienM | dpeacock: in a meeting now, but happy to pair on it together later in the day | 17:07 |
| *** sanjayu has joined #tripleo | 17:08 | |
| *** links has quit IRC | 17:08 | |
| *** kopecmartin has quit IRC | 17:08 | |
| dpeacock | EmilienM: Thanks - I'll ping you in a bit | 17:09 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1761171 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 17:10 |
| openstack | Launchpad bug 1761171 in tripleo "scn0001 multinode container: mistralclient api authorization failed" [Critical,In progress] - Assigned to Jose Luis Franco (jfrancoa) | 17:10 |
| *** jpich has quit IRC | 17:11 | |
| *** fragatina has quit IRC | 17:11 | |
| *** salmankhan has quit IRC | 17:13 | |
| sdoran | Anyone know who I should talk to from Ceph about their Ansible performance issues? | 17:18 |
| *** jpena is now known as jpena|off | 17:19 | |
| openstackgerrit | Mike Fedosin proposed openstack/tripleo-common master: Create get_flattened_parameters workflow https://review.openstack.org/558883 | 17:20 |
| EmilienM | sdoran: gfidente / fultonj | 17:20 |
| sdoran | 👍 | 17:20 |
| gfidente | sdoran hey | 17:20 |
| gfidente | I actually think rook is the best guy to ask | 17:21 |
| gfidente | he can provide you with some actual fata | 17:21 |
| gfidente | *data | 17:21 |
| sdoran | Ok, sounds good. | 17:21 |
| gfidente | though I guess going to 2.4.4 is good as well | 17:21 |
| sdoran | We've been doing a bunch of work with the OpenShift team of late and I'm wondering if you are hitting similar issues or something different. | 17:21 |
| sdoran | Hopefully. Depends on the exact issue. | 17:22 |
| sdoran | If it's related to dynamic includes, then yes, 2.4.4 will help. | 17:22 |
| sdoran | But if it's something else, I want to get the bottom of it and get it fixed. | 17:23 |
| *** dparkes has joined #tripleo | 17:24 | |
| *** trown|lunch is now known as trown | 17:26 | |
| *** dprince has joined #tripleo | 17:26 | |
| gfidente | sdoran I am not sure about the internals but I think we get this task in ceph-ansible | 17:26 |
| gfidente | https://github.com/ceph/ceph-ansible/blob/master/roles/ceph-docker-common/tasks/fetch_image.yml#L179 | 17:26 |
| gfidente | to consume half rss memory size | 17:27 |
| gfidente | just by moving to 2.4.2 to 2.4.3 | 17:27 |
| *** fpan has quit IRC | 17:27 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: turn on container updates for upstream multinode https://review.openstack.org/558885 | 17:27 |
| sdoran | That's good news. | 17:27 |
| *** fpan has joined #tripleo | 17:27 | |
| gfidente | sdake btw, the correct link is https://github.com/ceph/ceph-ansible/blob/stable-3.0/roles/ceph-docker-common/tasks/fetch_image.yml#L179 | 17:28 |
| gfidente | same task, but from stable branch | 17:29 |
| gfidente | just to make sure | 17:29 |
| sdoran | Interesting that a single retry task was consuming tons of memory. I don't believe that's a scenario we've investigated specifically. | 17:29 |
| *** fragatina has joined #tripleo | 17:30 | |
| gfidente | sdoran and btw, thanks for reaching out | 17:31 |
| gfidente | ++ | 17:31 |
| gfidente | :D | 17:31 |
| sdoran | No problem. | 17:32 |
| *** mdnadeem has quit IRC | 17:32 | |
| *** dparkes has quit IRC | 17:37 | |
| *** agurenko has joined #tripleo | 17:40 | |
| *** anilvenkata has quit IRC | 17:40 | |
| *** gfidente is now known as gfidente|afk | 17:42 | |
| *** d0ugal has quit IRC | 17:42 | |
| *** sai_p has joined #tripleo | 17:44 | |
| *** zshi has quit IRC | 17:45 | |
| *** dparkes has joined #tripleo | 17:45 | |
| *** shreshtha has quit IRC | 17:45 | |
| *** zshi has joined #tripleo | 17:45 | |
| *** suuuper has quit IRC | 17:55 | |
| *** fragatina has quit IRC | 17:55 | |
| *** fragatina has joined #tripleo | 17:56 | |
| *** atoth has quit IRC | 17:56 | |
| *** akrivoka has quit IRC | 17:56 | |
| *** waleedm has quit IRC | 17:57 | |
| EmilienM | dprince: what's your preference regarding https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/undercloud.html - should we keep this document? or amend the classic undercloud deployment setup? | 17:57 |
| EmilienM | dprince: I think it was intended for development when it was "experimental" but now it becomes more stable and integrated in tripleo, I think we should maybe revisit the doc | 17:58 |
| mwhahaha | that doc needs to get revisited | 17:59 |
| mwhahaha | i think we might want to split that one off into an updated how to use the advanced deploy command or soemthing | 17:59 |
| EmilienM | yeah | 18:01 |
| *** shardy_mtg has quit IRC | 18:06 | |
| *** atoth has joined #tripleo | 18:10 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1761171 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 18:10 |
| openstack | Launchpad bug 1761171 in tripleo "scn0001 multinode container: mistralclient api authorization failed" [Critical,In progress] - Assigned to Jose Luis Franco (jfrancoa) | 18:10 |
| *** d0ugal has joined #tripleo | 18:12 | |
| *** tesseract has quit IRC | 18:14 | |
| openstackgerrit | Matt Young proposed openstack/tripleo-quickstart-extras master: DNM: Change mtu to 1500 for nodepool setup https://review.openstack.org/558889 | 18:22 |
| *** ihrachys has joined #tripleo | 18:23 | |
| *** dtantsur|brb is now known as dtantsur | 18:29 | |
| *** dparkes has quit IRC | 18:36 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-docs master: Upgrade the content for containerized undercloud https://review.openstack.org/558893 | 18:37 |
| EmilienM | dprince, dpeacock, mwhahaha ^ when you have time for review. This is really a draft, I'm happy to improve | 18:37 |
| EmilienM | weshay, mwhahaha : re the issue with fs001 and containerized undercloud, jaosorior found one of the root causes, see https://review.openstack.org/#/c/558716/ | 18:41 |
| EmilienM | with that patch, it works fine | 18:41 |
| EmilienM | we need to investigate why zaqar fails to get a token after a while | 18:42 |
| *** paramite has quit IRC | 18:45 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Allow exit code of 2 only for puppet deployments https://review.openstack.org/558896 | 18:46 |
| EmilienM | thrash|biab, d0ugal: when you have time, I need your feedback on https://review.openstack.org/#/c/558654 please. Do we need to make them changeable or these defaults are safe ? (I took them from instack-undercloud) | 18:48 |
| *** amoralej is now known as amoralej|off | 18:51 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: masquerade: stop using YAQL for iptables data https://review.openstack.org/558236 | 18:51 |
| *** sshnaidm is now known as sshnaidm|afk | 18:51 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs001: enable masquerading via THT https://review.openstack.org/557972 | 18:51 |
| *** dtantsur is now known as dtantsur|afk | 18:52 | |
| d0ugal | EmilienM: seem safe to me | 18:53 |
| EmilienM | d0ugal: thank you | 18:56 |
| *** gfidente|afk has quit IRC | 18:56 | |
| *** gkadam has quit IRC | 19:00 | |
| *** pradk has quit IRC | 19:00 | |
| *** pradk has joined #tripleo | 19:01 | |
| EmilienM | jaosorior: re: https://bugs.launchpad.net/tripleo/+bug/1761050 - the weird thing is that it works "fine" when the undercloud isn't containerized, which is why I compared the configs | 19:02 |
| openstack | Launchpad bug 1761050 in tripleo "Failures to get tokens when undercloud is containerized" [High,Triaged] | 19:02 |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1761171 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 19:10 |
| openstack | Launchpad bug 1761171 in tripleo "scn0001 multinode container: mistralclient api authorization failed" [Critical,In progress] - Assigned to Jose Luis Franco (jfrancoa) | 19:10 |
| *** agurenko has quit IRC | 19:11 | |
| *** atoth has quit IRC | 19:16 | |
| *** pkovar has quit IRC | 19:18 | |
| EmilienM | jaosorior: I think this isn't not just the contenerized undercloud but all underclouds | 19:18 |
| EmilienM | jaosorior: if overcloud takes more than 3600s to deploy, zaqar fails to get token when mistral workflow is done | 19:19 |
| EmilienM | bogdan is right we should add a sleep to confirm this bug | 19:19 |
| mwhahaha | no that bug would have shown up long ago | 19:20 |
| mwhahaha | or is it master only? | 19:20 |
| EmilienM | yeah master only | 19:21 |
| EmilienM | at least I've never seen that before | 19:21 |
| mwhahaha | ah ok | 19:21 |
| EmilienM | I'm doing to find in our logs if we had an overcloud taking more than 1h to be deployed | 19:21 |
| * EmilienM wish we have that in our logging :) | 19:21 | |
| mwhahaha | though doesn't our deploy take >60 mins anyway? | 19:21 |
| mwhahaha | in CI | 19:21 |
| EmilienM | mwhahaha: the problem here is with a mistral workflow for overcloud | 19:22 |
| EmilienM | the deployment workflow | 19:22 |
| mwhahaha | ah | 19:22 |
| mwhahaha | so just a single workflow exeuction > 1 hour | 19:22 |
| mwhahaha | or token expire time rather | 19:22 |
| mwhahaha | isn't the token expire time usually like 4 hours? | 19:23 |
| EmilienM | yeah | 19:23 |
| mwhahaha | which may be why people haven't spotted this | 19:23 |
| EmilienM | it's 3600s in puppet-keystone default | 19:23 |
| *** fpan has quit IRC | 19:27 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: rhel-registration: update template version https://review.openstack.org/558541 | 19:28 |
| EmilienM | mwhahaha: I checked 10 OVB jobs and they all take ~56 minutes lol | 19:28 |
| EmilienM | so I guess we were super lucky until now | 19:28 |
| mwhahaha | :o | 19:29 |
| EmilienM | I continue to look though | 19:29 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Collectd needs access to /var/run/ceph to load the ceph plugin https://review.openstack.org/558563 | 19:29 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/queens: Removes neutron ownership of certs https://review.openstack.org/558664 | 19:31 |
| mwhahaha | puppet-keystone fix is merged | 19:35 |
| *** ykarel is now known as ykarel|away | 19:35 | |
| mwhahaha | so we can probably test a recheck | 19:35 |
| *** Tengu has quit IRC | 19:35 | |
| jaosorior | EmilienM: might be a regression either in mistral or zaqarclient. Still unsure where.... or who knows, maybe it never really worked. | 19:35 |
| mwhahaha | oh wait didn't we switch to zaqarclient in master | 19:35 |
| mwhahaha | maybe that's why we never saw it before | 19:35 |
| mwhahaha | we used to use a different method for polling | 19:36 |
| *** tosky has quit IRC | 19:36 | |
| *** tosky has joined #tripleo | 19:37 | |
| mwhahaha | https://review.openstack.org/#/c/550024/ | 19:40 |
| mwhahaha | it's in queens tho | 19:40 |
| mwhahaha | oh no that's just for updates | 19:41 |
| *** gkadam has joined #tripleo | 19:42 | |
| *** raildo has quit IRC | 19:42 | |
| *** Tengu has joined #tripleo | 19:42 | |
| *** noslzzp has quit IRC | 19:43 | |
| *** alee has quit IRC | 19:51 | |
| bnemec | As a data point, I've done successful deployments with the Rocky bits that took 4291 seconds (71-ish minutes). | 19:53 |
| bnemec | Not in the past couple of weeks though, so something could have changed. | 19:53 |
| openstackgerrit | Alex Schultz proposed openstack/puppet-pacemaker master: Wrap the cib file deletion commands in a function https://review.openstack.org/558033 | 19:53 |
| openstackgerrit | Alex Schultz proposed openstack/puppet-pacemaker master: Wrap pcs command generation into their own functions https://review.openstack.org/558038 | 19:53 |
| openstackgerrit | Rafael Folco proposed openstack/tripleo-quickstart-extras master: Fix dstat time penalty for failed runs https://review.openstack.org/558908 | 19:54 |
| *** noslzzp has joined #tripleo | 20:01 | |
| EmilienM | bnemec: with config download? | 20:03 |
| EmilienM | it's not realted in fact, nevermind | 20:04 |
| EmilienM | it's another workflow | 20:04 |
| bnemec | EmilienM: Probably not, unless that default has changed. | 20:04 |
| EmilienM | the defaults haven't changed, yet | 20:04 |
| EmilienM | it's a goal for Rocky though. | 20:04 |
| mwhahaha | that "yet" always seems like a threat | 20:04 |
| *** ihrachys has quit IRC | 20:04 | |
| mwhahaha | WE HAVEN'T FIRED YOU, yet... | 20:04 |
| *** colonwq has quit IRC | 20:05 | |
| *** ihrachys has joined #tripleo | 20:05 | |
| EmilienM | :-O | 20:05 |
| * bnemec quits first | 20:06 | |
| bnemec | Ha! I showed them! Wait... | 20:06 |
| *** aufi has quit IRC | 20:06 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Fixes Neutron certificate and key permissions https://review.openstack.org/558667 | 20:07 |
| EmilienM | jaosorior, mwhahaha : it should be easily reproducable if we created a workflow that would run a sleep and post the message when done | 20:08 |
| mwhahaha | sleep driven debugging | 20:08 |
| *** alee has joined #tripleo | 20:08 | |
| EmilienM | lol | 20:08 |
| mwhahaha | or as i call it, mornings | 20:08 |
| bnemec | mwhahaha: Isn't that sleep-deprived debugging? | 20:09 |
| mwhahaha | yes, that would be this morning | 20:10 |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1761171 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 20:10 |
| openstack | Launchpad bug 1761171 in tripleo "scn0001 multinode container: mistralclient api authorization failed" [Critical,In progress] - Assigned to Jose Luis Franco (jfrancoa) | 20:10 |
| *** myoung is now known as myoung|mtg | 20:10 | |
| * bnemec has a nova-compute log full of tracebacks | 20:10 | |
| mwhahaha | so a normal log? | 20:10 |
| * bnemec applies the take off and nuke it from orbit approach | 20:10 | |
| mwhahaha | man it's not even friday yet | 20:11 |
| bnemec | These are some fun new ones. | 20:11 |
| mwhahaha | let me guess, messaging timeouts? | 20:11 |
| EmilienM | actually there is a super simple way to test the bug | 20:11 |
| bnemec | InventoryInUse: Inventory for ''CUSTOM_BAREMETAL'' on resource provider '651a690f-cee0-4da8-b58a-97534a3c4a80' in use. | 20:12 |
| bnemec | BuildAbortException: Build of instance 7b86ee95-dcd1-4af3-b0a6-d800eee04396 aborted: Failure prepping block device. | 20:12 |
| bnemec | VirtualInterfacePlugException: Cannot attach VIF b00ffd81-44cd-4b0a-b659-4a5176ff9a72 to the node a8a5ad84-4d9e-420a-bcd0-253 | 20:12 |
| bnemec | 020d65d0d due to error: Unable to attach VIF b00ffd81-44cd-4b0a-b659-4a5176ff9a72, not enough free physical ports. | 20:12 |
| mwhahaha | oo that's new | 20:12 |
| bnemec | This is probably what happens when you keep a development undercloud around for months at a time. | 20:12 |
| *** ffiore has joined #tripleo | 20:12 | |
| mwhahaha | so like an actual cloud? | 20:13 |
| mwhahaha | :D | 20:13 |
| * mwhahaha thinks he needs a nap | 20:13 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: DNM: keystone token are valid for 17 minutes https://review.openstack.org/558914 | 20:14 |
| EmilienM | mwhahaha: ^ let's see how that works | 20:14 |
| EmilienM | damn | 20:14 |
| EmilienM | I need to do that in instcak-(undercloud | 20:14 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud master: DNM: keystone token are valid for 17 minutes https://review.openstack.org/558915 | 20:15 |
| EmilienM | so we can test both non containeirzed & containerized keystone | 20:16 |
| EmilienM | mwhahaha: d0ugal just mentioned to me that he reproduced the issue with a workflow: https://github.com/d0ugal/tripleo-util/blob/master/scripts/workbooks/testing.yaml | 20:17 |
| *** liverpooler has quit IRC | 20:19 | |
| EmilienM | mwhahaha: apparently stevebaker changed it 3 years ago for instack-undercloud: https://github.com/openstack/instack-undercloud/commit/43e792c6844d4a7081b718d7f89b0c40f5cfb708 | 20:19 |
| mwhahaha | that's what i thought | 20:19 |
| EmilienM | bug 1235908 | 20:20 |
| EmilienM | I like the "Possibly Closes-Bug: #1235908" | 20:20 |
| *** colonwq has joined #tripleo | 20:20 | |
| EmilienM | that was https://bugzilla.redhat.com/show_bug.cgi?id=1235908 | 20:22 |
| openstack | bugzilla.redhat.com bug 1235908 in rhosp-director "Heat error when deploying with network isolation enabled" [Unspecified,Closed: errata] - Assigned to rybrown | 20:22 |
| EmilienM | stevebaker: do you have more context on that bug? we're hitting the same problem with a containerized undercloud https://bugs.launchpad.net/tripleo/+bug/1761050 | 20:22 |
| mwhahaha | customers i'm sure | 20:22 |
| mwhahaha | any actual deployment that exceeded 1 hour was probably failing | 20:22 |
| EmilienM | stevebaker: and wonder why mistral/zaqar clients don't try to get a new token | 20:22 |
| bnemec | I think that was causing Heat errors back in the day. | 20:22 |
| openstack | Launchpad bug 1761050 in tripleo "Failures to get tokens when undercloud is containerized" [High,Triaged] | 20:22 |
| bnemec | openstack is a bit slow on the draw today. | 20:23 |
| *** ykarel|away has quit IRC | 20:25 | |
| bnemec | Oh man, there's a toldyouso emoji. | 20:25 |
| bnemec | ☜(꒡⌓꒡) | 20:25 |
| * bnemec saves for future use | 20:25 | |
| therve | EmilienM, Sessions are supposed to solve that issue maybe? | 20:25 |
| mwhahaha | they are | 20:26 |
| therve | Now, whether mistral uses them correctly or not... | 20:26 |
| EmilienM | therve: isn't it zaqar? | 20:27 |
| therve | EmilienM, No, zaqar gets an expired token | 20:28 |
| EmilienM | mistral complains because zaqar failed to post the message, afiu | 20:28 |
| therve | AFAIU | 20:28 |
| EmilienM | ok | 20:28 |
| therve | Now it can be zaqar client | 20:28 |
| *** colonwq has quit IRC | 20:35 | |
| stevebaker | EmilienM: it should be possible to use tokens in a way which refreshes them when they are close to expiry. I'm pretty sure heat does this right, shardy did a lot here | 20:38 |
| EmilienM | thrash|biab, therve, d0ugal: I moved the bug to zaqar/mistral https://bugs.launchpad.net/mistral/+bug/1761050 in the meantime | 20:39 |
| openstack | Launchpad bug 1761050 in tripleo "Mistral or Zaqar fail to maintain a keystone session while deploying an overcloud" [High,Triaged] | 20:39 |
| * therve catches the hot potato | 20:40 | |
| *** panda|training is now known as panda|off | 20:42 | |
| EmilienM | therve: lol no, really I'm trying to reproduce in my env now and keep debugging | 20:43 |
| EmilienM | therve: I just think we need more eyes on it | 20:43 |
| mwhahaha | and it's potatoe | 20:43 |
| mwhahaha | the e is for EmilienM | 20:43 |
| bnemec | That logic seems sound. | 20:44 |
| *** jtomasek_ has quit IRC | 20:44 | |
| *** fpan has joined #tripleo | 20:44 | |
| EmilienM | :-O | 20:45 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: undercloud: increase token expiration time https://review.openstack.org/558922 | 20:46 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Run ovb-ha (fs001) with a containerized undercloud https://review.openstack.org/542556 | 20:47 |
| mwhahaha | ah crap | 20:48 |
| mwhahaha | puppet-keystone change hasn't built in rdo | 20:48 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: masquerade: stop using YAQL for iptables data https://review.openstack.org/558236 | 20:48 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs001: enable masquerading via THT https://review.openstack.org/557972 | 20:49 |
| mwhahaha | weshay: is there anyone up now that we can poke to see why a new puppet-keystone hasn't built yet? | 20:49 |
| mwhahaha | rfolco|ruck, arxcruz|rover -^ | 20:49 |
| weshay | hrm.. apparently packaging building is unamerican | 20:49 |
| mwhahaha | i'm looking at https://trunk.rdoproject.org/centos7-master/report.html | 20:49 |
| bnemec | RDO cloud was down yesterday, it's possible dlrn is just behind. | 20:49 |
| EmilienM | mwhahaha: let me check that | 20:49 |
| weshay | mwhahaha, oh ya | 20:49 |
| weshay | there is a card blocking packaing | 20:50 |
| * weshay gets | 20:50 | |
| * mwhahaha flips tables | 20:50 | |
| weshay | https://trello.com/c/5ghFsnra/532-cixftbfsneutron-vpnaasfails-to-build-on-master | 20:50 |
| EmilienM | damn | 20:50 |
| weshay | https://review.openstack.org/#/c/558839/ | 20:50 |
| EmilienM | and it failed to land :D | 20:51 |
| mwhahaha | figures | 20:51 |
| weshay | mwhahaha, seems like apevec is watching it | 20:51 |
| weshay | but not in this channel | 20:51 |
| mwhahaha | all my rechecks are for naught then | 20:51 |
| * mwhahaha gives up on upstream and goes and does other things | 20:51 | |
| * weshay checks the freshness of my puddle | 20:52 | |
| *** rfolco|ruck is now known as rfolco|off | 20:52 | |
| mwhahaha | pretty sure you'll get food poisoning | 20:53 |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Switch to config-download by default https://review.openstack.org/558925 | 20:54 |
| *** florianf has joined #tripleo | 20:56 | |
| *** iranzo has joined #tripleo | 20:57 | |
| *** iranzo has quit IRC | 20:57 | |
| *** iranzo has joined #tripleo | 20:57 | |
| EmilienM | mwhahaha, slagle : just a heads-up before I leave for lunch : https://review.openstack.org/#/c/542556/ will be ready to land this week, once we land the Keystone token thing (in depends-on). So good progress so far, as we wanted to have OVB job running a containerized undercloud. Feel free to vote in Gerrit. Thanks. | 20:58 |
| mwhahaha | so -2, got it | 20:58 |
| EmilienM | weshay: ^ fyi as well | 20:58 |
| weshay | lol | 20:59 |
| *** dsavineau has quit IRC | 20:59 | |
| *** rcernin has joined #tripleo | 21:00 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Switch to config-download by default https://review.openstack.org/558927 | 21:01 |
| *** paramite has joined #tripleo | 21:02 | |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Switch to config-download by default https://review.openstack.org/558925 | 21:03 |
| *** myoung|mtg is now known as myoung | 21:03 | |
| *** Goneri has quit IRC | 21:05 | |
| *** iranzo has quit IRC | 21:05 | |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Remove adding config-download-environment.yaml https://review.openstack.org/558931 | 21:05 |
| *** bfournie has quit IRC | 21:09 | |
| weshay | AssertionError: False is not true | 21:10 |
| *** bfournie has joined #tripleo | 21:10 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1761171 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 21:10 |
| openstack | Launchpad bug 1761171 in tripleo "scn0001 multinode container: mistralclient api authorization failed" [Critical,In progress] - Assigned to Jose Luis Franco (jfrancoa) | 21:10 |
| *** pchavva has quit IRC | 21:10 | |
| *** bfournie has quit IRC | 21:14 | |
| *** yamahata has quit IRC | 21:19 | |
| *** ffiore has quit IRC | 21:19 | |
| *** abishop has quit IRC | 21:19 | |
| *** d0ugal has quit IRC | 21:21 | |
| *** rcernin has quit IRC | 21:29 | |
| *** gkadam has quit IRC | 21:36 | |
| *** chlong has quit IRC | 21:42 | |
| *** colonwq has joined #tripleo | 21:44 | |
| *** jmelvin has quit IRC | 21:46 | |
| *** waleedm has joined #tripleo | 21:48 | |
| *** yamahata has joined #tripleo | 21:49 | |
| *** alee has quit IRC | 21:50 | |
| *** mcornea has quit IRC | 21:51 | |
| *** d0ugal has joined #tripleo | 21:51 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates stable/newton: Include database in the default event dispatchers https://review.openstack.org/558864 | 21:57 |
| *** florianf has quit IRC | 21:59 | |
| *** morazi has quit IRC | 22:02 | |
| *** mburned is now known as mburned_out | 22:07 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1761171 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 22:10 |
| openstack | Launchpad bug 1761171 in tripleo "scn0001 multinode container: mistralclient api authorization failed" [Critical,In progress] - Assigned to Jose Luis Franco (jfrancoa) | 22:10 |
| *** rpioso is now known as rpioso|afk | 22:14 | |
| *** paramite has quit IRC | 22:20 | |
| *** pradk has quit IRC | 22:21 | |
| *** alee has joined #tripleo | 22:24 | |
| EmilienM | http://zuul.openstack.org/builds.html?job_name=neutron-vpnaas-dsvm-tempest the job looks unstable | 22:31 |
| EmilienM | which causes https://review.openstack.org/#/c/558839/ to not land | 22:31 |
| EmilienM | I did recheck, but we have to wait 45m again | 22:31 |
| rook | shadower: ping | 22:31 |
| EmilienM | actually 1h30, since job is in check now | 22:31 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Refresh keystone after deployment https://review.openstack.org/558548 | 22:42 |
| *** rcernin has joined #tripleo | 22:45 | |
| *** rh-jelabarre has quit IRC | 22:49 | |
| *** d0ugal has quit IRC | 23:03 | |
| *** ledo_ has joined #tripleo | 23:05 | |
| *** waleedm has quit IRC | 23:08 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1757556 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1761171 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged] | 23:10 |
| openstack | Launchpad bug 1761171 in tripleo "scn0001 multinode container: mistralclient api authorization failed" [Critical,In progress] - Assigned to Jose Luis Franco (jfrancoa) | 23:10 |
| *** tosky has quit IRC | 23:25 | |
| *** Guest98296 has joined #tripleo | 23:31 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: WIP: config-download for scenario's 001 and 004 https://review.openstack.org/548306 | 23:40 |
| EmilienM | https://review.openstack.org/#/c/558839/ landed | 23:41 |
| EmilienM | once it's build in RDO current we can run recheck | 23:41 |
| *** yamahata has quit IRC | 23:42 | |
| *** colonwq has quit IRC | 23:47 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: Convert remaining multinode jobs to config-download https://review.openstack.org/558965 | 23:52 |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: Convert ceph multinode jobs to config-download https://review.openstack.org/548306 | 23:53 |
| *** thrash|biab is now known as thrash|g0ne | 23:54 | |
| *** thrash|g0ne is now known as thrash | 23:54 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!