openstackgerrit | Harald Jensås proposed openstack/instack-undercloud master: Tripleo routed networks ironic inspector, and Undercloud https://review.openstack.org/437544 | 00:01 |
---|---|---|
mwhahaha | is scenario002 unblocked with the barbican containers now? | 00:03 |
*** yamahata has quit IRC | 00:20 | |
*** threestrands has quit IRC | 00:25 | |
*** nyechiel has quit IRC | 00:28 | |
*** tosky has quit IRC | 00:33 | |
*** tongl has quit IRC | 00:36 | |
*** tongl has joined #tripleo | 00:36 | |
*** tongl has quit IRC | 00:40 | |
*** itlinux has quit IRC | 01:00 | |
*** zshi has joined #tripleo | 01:05 | |
*** bandini has quit IRC | 01:07 | |
*** tristanC has quit IRC | 01:08 | |
*** tristanC has joined #tripleo | 01:09 | |
*** bandini has joined #tripleo | 01:09 | |
*** tzumainn has quit IRC | 01:10 | |
*** s_b_34343 has quit IRC | 01:14 | |
*** s_b_34343 has joined #tripleo | 01:15 | |
EmilienM | slagle: ok thx | 01:19 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Introduce tripleo-bootstrap Ansible role https://review.openstack.org/525285 | 01:20 |
EmilienM | slagle: your patch conflicts with mine, but ok https://review.openstack.org/#/c/525291/ | 01:21 |
EmilienM | slagle: I'm happy to abandon mine | 01:21 |
*** s_b_34343 has quit IRC | 01:22 | |
*** Vijayendra has quit IRC | 01:24 | |
*** s_b_34343 has joined #tripleo | 01:24 | |
*** yamahata has joined #tripleo | 01:25 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Remove jq package install https://review.openstack.org/525781 | 01:28 |
*** cshastri has joined #tripleo | 01:29 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: zuul: update OVB jobs https://review.openstack.org/525747 | 01:30 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Fix loop in config-download.yaml.j2 template https://review.openstack.org/523155 | 01:30 |
*** psachin has joined #tripleo | 01:30 | |
*** dmacpher has joined #tripleo | 01:32 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs https://review.openstack.org/525743 | 01:32 |
EmilienM | mwhahaha: a bunch of OVB timeouts :( | 01:40 |
EmilienM | i'm trying to see | 01:41 |
mwhahaha | Oh noes | 01:41 |
EmilienM | 12 minutes to prepare containers | 01:43 |
EmilienM | http://logs.openstack.org/76/525776/2/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/7ff6cef/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz | 01:44 |
EmilienM | stevebaker: hey good morning - any way we can accelerate this task in CI? ^ | 01:44 |
EmilienM | also, some tasks run twice | 01:45 |
EmilienM | yeah that's a bug I guess | 01:46 |
EmilienM | a bunch of tasks run two times | 01:47 |
stevebaker | EmilienM: by reviewing my changes :) https://review.openstack.org/#/c/522055/ | 01:49 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Update the Docker registry defaults to rdoproject https://review.openstack.org/520201 | 01:50 |
*** rlandy has quit IRC | 01:50 | |
EmilienM | weshay: need eyes on https://bugs.launchpad.net/tripleo/+bug/1736634 | 01:51 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times" [Critical,Triaged] | 01:51 |
openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Implement post-upload cleanup of docker images https://review.openstack.org/519201 | 01:58 |
EmilienM | stevebaker: ok, doing it now | 01:58 |
EmilienM | in your patch, it takes 5 min http://logs.openstack.org/55/522055/4/check/tripleo-ci-centos-7-containers-multinode/f2f749e/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz | 01:59 |
EmilienM | otheriwe it takes 9 minutes | 01:59 |
EmilienM | (random patch) http://logs.openstack.org/94/525594/6/check/tripleo-ci-centos-7-containers-multinode/222ae13/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz | 01:59 |
openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Revert "Allow deleting all of docker cache" https://review.openstack.org/525849 | 01:59 |
EmilienM | stevebaker: +2 | 02:00 |
stevebaker | EmilienM: yeah, my limited sampling showed 5min vs ~8min | 02:00 |
EmilienM | yep | 02:00 |
EmilienM | stevebaker: thanks, nice improvement imho | 02:01 |
EmilienM | now we need to figure https://bugs.launchpad.net/tripleo/+bug/1736634 so we don't have timeouts anymore on ovb jobs | 02:02 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] | 02:02 |
*** bfournie has joined #tripleo | 02:05 | |
*** bfournie has quit IRC | 02:06 | |
openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Revert "Allow deleting all of docker cache" https://review.openstack.org/525849 | 02:07 |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] | 02:10 |
*** oanson has quit IRC | 02:12 | |
*** oanson has joined #tripleo | 02:12 | |
*** rfolco has quit IRC | 02:16 | |
*** s_b_34343 has quit IRC | 02:20 | |
*** s_b_34343 has joined #tripleo | 02:21 | |
*** fragatin_ has quit IRC | 02:27 | |
openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo master: Enable Octavia LBaaS integration config in neutron https://review.openstack.org/525854 | 02:32 |
weshay | EmilienM, /me looks | 02:37 |
*** fpan has joined #tripleo | 02:42 | |
*** tongl has joined #tripleo | 02:42 | |
*** s_b_34343 has quit IRC | 02:44 | |
*** itlinux has joined #tripleo | 02:45 | |
openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates master: Add a StorageNFS network for use by Manila/Ganesha https://review.openstack.org/512239 | 02:45 |
openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates master: Add support for ceph-nfs manila backend https://review.openstack.org/471245 | 02:45 |
weshay | EmilienM, it's actually called three times | 02:47 |
*** thrash is now known as thrash|g0ne | 02:50 | |
weshay | EmilienM, /me looks at the job to try and help w/ the timeout | 02:50 |
openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Remove default for --overcloud-ssh-key https://review.openstack.org/525779 | 02:51 |
*** itlinux has quit IRC | 02:53 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia integration parameters to neutron https://review.openstack.org/525860 | 03:01 |
*** moshele has joined #tripleo | 03:01 | |
*** tongl has quit IRC | 03:02 | |
*** hjensas has quit IRC | 03:07 | |
*** hjensas has joined #tripleo | 03:24 | |
*** hjensas has quit IRC | 03:24 | |
*** hjensas has joined #tripleo | 03:24 | |
*** s_b_34343 has joined #tripleo | 03:27 | |
*** zshi has quit IRC | 03:27 | |
*** s_b_34343 has quit IRC | 03:32 | |
*** Vijayendra has joined #tripleo | 03:37 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-specs master: introduce a ci team structure policy https://review.openstack.org/509280 | 03:41 |
*** psahoo has joined #tripleo | 03:49 | |
*** haint has joined #tripleo | 03:52 | |
*** nguyentrihai has quit IRC | 03:55 | |
*** ramishra has joined #tripleo | 03:55 | |
*** kristaps_ has joined #tripleo | 03:57 | |
*** links has joined #tripleo | 03:58 | |
*** lvdombrkr has quit IRC | 03:58 | |
*** tbarron has quit IRC | 03:59 | |
weshay | sshnaidm|off, please start looking at this bug as your first top priority in your morning and I'll sync with you at 8:30am est w/ rfolco and myoung | 04:00 |
weshay | https://bugs.launchpad.net/tripleo/+bug/1736634 | 04:00 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 04:00 |
*** tbarron has joined #tripleo | 04:00 | |
*** dparkes has quit IRC | 04:00 | |
*** links has quit IRC | 04:01 | |
*** links has joined #tripleo | 04:01 | |
*** dparkes has joined #tripleo | 04:03 | |
*** fpan has quit IRC | 04:04 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Make Kubespray install work without --private-key too https://review.openstack.org/525524 | 04:07 |
*** mgkwill has quit IRC | 04:07 | |
*** mgkwill_ has joined #tripleo | 04:07 | |
*** tzumainn has joined #tripleo | 04:11 | |
*** masco has joined #tripleo | 04:12 | |
*** ykarel__ has joined #tripleo | 04:19 | |
*** moshele has quit IRC | 04:28 | |
*** dpawar has joined #tripleo | 04:29 | |
*** gbarros_ has joined #tripleo | 04:29 | |
*** gbarros has quit IRC | 04:30 | |
*** janki has joined #tripleo | 04:33 | |
*** hamzy has joined #tripleo | 04:40 | |
*** daidv has quit IRC | 04:41 | |
*** daidv has joined #tripleo | 04:42 | |
*** udesale has joined #tripleo | 04:46 | |
*** janki has quit IRC | 04:54 | |
*** gbarros_ has quit IRC | 04:55 | |
*** s_b_34343 has joined #tripleo | 04:56 | |
*** ratailor has joined #tripleo | 04:58 | |
*** janki has joined #tripleo | 05:01 | |
Tengu | hello there | 05:02 |
*** ykarel__ is now known as ykarel | 05:04 | |
*** ratailor has quit IRC | 05:05 | |
*** gvrangan has joined #tripleo | 05:07 | |
*** ratailor has joined #tripleo | 05:08 | |
*** threestrands has joined #tripleo | 05:09 | |
*** threestrands has quit IRC | 05:09 | |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736383 | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
openstack | Launchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] | 05:10 |
*** tongl has joined #tripleo | 05:14 | |
*** skramaja has joined #tripleo | 05:14 | |
*** tzumainn has quit IRC | 05:15 | |
*** gvrangan has quit IRC | 05:15 | |
*** jaganathan has joined #tripleo | 05:16 | |
*** shreshtha has joined #tripleo | 05:18 | |
*** shreshtha has quit IRC | 05:19 | |
*** shreshtha has joined #tripleo | 05:19 | |
*** liverpooler has quit IRC | 05:27 | |
*** pgadiya has joined #tripleo | 05:34 | |
openstackgerrit | Merged openstack/diskimage-builder master: zypper: fix package removal https://review.openstack.org/517658 | 05:42 |
*** mdnadeem has joined #tripleo | 05:43 | |
*** janki has quit IRC | 05:44 | |
*** karthiks has quit IRC | 05:48 | |
*** fragatina has joined #tripleo | 05:53 | |
*** janki has joined #tripleo | 05:56 | |
*** tongl has quit IRC | 05:56 | |
*** zshi has joined #tripleo | 06:07 | |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736383 | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
openstack | Launchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] | 06:10 |
*** udesale__ has joined #tripleo | 06:10 | |
*** marios has joined #tripleo | 06:11 | |
*** udesale has quit IRC | 06:12 | |
*** karthiks has joined #tripleo | 06:14 | |
*** dsariel has joined #tripleo | 06:14 | |
*** ykarel_ has joined #tripleo | 06:16 | |
*** rwsu has quit IRC | 06:17 | |
*** ykarel has quit IRC | 06:19 | |
*** salmankhan has joined #tripleo | 06:20 | |
*** nmathew has joined #tripleo | 06:21 | |
*** radeks has joined #tripleo | 06:23 | |
*** salmankhan has quit IRC | 06:24 | |
*** pdeore has joined #tripleo | 06:26 | |
*** rwsu has joined #tripleo | 06:30 | |
s_b_34343 | ; | 06:31 |
*** moshele has joined #tripleo | 06:32 | |
moshele | skramaja: hi | 06:32 |
*** bkopilov has quit IRC | 06:35 | |
*** janki has quit IRC | 06:36 | |
moshele | skramaja: we are trying to test all the merge patches with the latest quick start and tripleo, the finished successfully all the configuration look good. The problem is that we want to access the overcloud we get error in keystone see http://paste.openstack.org/show/628240/ do you have pointers how to debug this? | 06:36 |
*** janki has joined #tripleo | 06:38 | |
*** ykarel_ has quit IRC | 06:47 | |
*** ykarel_ has joined #tripleo | 06:47 | |
*** pgadiya has quit IRC | 06:51 | |
*** gkadam has joined #tripleo | 06:54 | |
*** abregman has joined #tripleo | 06:55 | |
*** iranzo has joined #tripleo | 06:57 | |
*** udesale has joined #tripleo | 06:58 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/instack-undercloud master: Fix wrong path in ssh selinux issue detection. https://review.openstack.org/525911 | 06:59 |
*** udesale__ has quit IRC | 07:00 | |
*** rcernin has quit IRC | 07:02 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/instack-undercloud stable/pike: Make sure selinux permissions are correct on ~/.ssh. https://review.openstack.org/525194 | 07:06 |
*** ykarel_ is now known as ykarel | 07:10 | |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736383 | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
openstack | Launchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] | 07:10 |
*** shreshtha has quit IRC | 07:10 | |
*** nyechiel has joined #tripleo | 07:10 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/instack-undercloud master: Fix wrong path in ssh selinux issue detection. https://review.openstack.org/525911 | 07:10 |
*** jtomasek has joined #tripleo | 07:11 | |
*** abregman has quit IRC | 07:14 | |
*** Vijayendra has quit IRC | 07:16 | |
*** Vijayendra has joined #tripleo | 07:16 | |
*** morazi has quit IRC | 07:20 | |
*** tongl has joined #tripleo | 07:21 | |
*** karthiks has quit IRC | 07:26 | |
*** shreshtha has joined #tripleo | 07:27 | |
*** aditya_r has joined #tripleo | 07:29 | |
*** dsariel has quit IRC | 07:36 | |
*** karthiks has joined #tripleo | 07:39 | |
*** rcernin has joined #tripleo | 07:39 | |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Get message from websocket instead from zaqarclient directly https://review.openstack.org/525924 | 07:40 |
*** yprokule has joined #tripleo | 07:45 | |
openstackgerrit | mathieu bultel proposed openstack/tripleo-common master: Update the noop environment files with start_args https://review.openstack.org/525929 | 07:48 |
*** agurenko has joined #tripleo | 07:49 | |
*** athomas has joined #tripleo | 07:51 | |
*** cylopez has joined #tripleo | 07:55 | |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Get message from websocket instead from zaqarclient directly https://review.openstack.org/525924 | 07:55 |
*** morazi has joined #tripleo | 07:59 | |
*** oidgar has joined #tripleo | 08:00 | |
*** tongl has quit IRC | 08:06 | |
*** dbecker has joined #tripleo | 08:07 | |
*** yamahata has quit IRC | 08:07 | |
*** mnaser has quit IRC | 08:08 | |
*** shardy has joined #tripleo | 08:08 | |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736383 | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
openstack | Launchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] | 08:10 |
*** mnaser has joined #tripleo | 08:11 | |
*** florianf|afk is now known as florianf | 08:12 | |
*** Vijayendra has quit IRC | 08:12 | |
*** holser has joined #tripleo | 08:13 | |
*** bogdando has joined #tripleo | 08:14 | |
*** Vijayendra has joined #tripleo | 08:16 | |
*** tesseract has joined #tripleo | 08:19 | |
*** ykarel is now known as ykarel|lunch | 08:20 | |
*** sshnaidm|off is now known as sshnaidm|rover | 08:20 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Remove workaround for periodic jobs https://review.openstack.org/525541 | 08:21 |
*** ukalifon has joined #tripleo | 08:22 | |
*** ukalifon has left #tripleo | 08:22 | |
*** dbellant has joined #tripleo | 08:25 | |
*** abregman has joined #tripleo | 08:31 | |
*** dbellant has quit IRC | 08:33 | |
openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras master: Do not create roles unless keystone was deployed https://review.openstack.org/525648 | 08:35 |
*** ffiore has joined #tripleo | 08:37 | |
*** stendulker has joined #tripleo | 08:39 | |
*** shreshtha has quit IRC | 08:40 | |
*** shreshtha has joined #tripleo | 08:41 | |
openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-heat-templates master: Update default value for derive params workflow inputs https://review.openstack.org/525986 | 08:41 |
*** udesale has quit IRC | 08:42 | |
*** dbellant has joined #tripleo | 08:44 | |
*** ramishra has quit IRC | 08:45 | |
*** jtomasek has quit IRC | 08:45 | |
*** mrch has joined #tripleo | 08:46 | |
*** dsariel has joined #tripleo | 08:47 | |
openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-common master: DPDK derive params inputs default value update https://review.openstack.org/525990 | 08:48 |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 08:49 |
*** dbellant has quit IRC | 08:50 | |
*** dbellant has joined #tripleo | 08:53 | |
*** ramishra has joined #tripleo | 08:57 | |
*** gfidente has joined #tripleo | 08:57 | |
*** aufi has joined #tripleo | 09:02 | |
*** jpich has joined #tripleo | 09:03 | |
*** gfidente has quit IRC | 09:09 | |
*** ooolpbot has joined #tripleo | 09:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736383 | 09:10 |
*** ooolpbot has quit IRC | 09:10 | |
openstack | Launchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] | 09:10 |
*** gfidente has joined #tripleo | 09:10 | |
*** gfidente has quit IRC | 09:10 | |
*** gfidente has joined #tripleo | 09:10 | |
*** ykarel_ has joined #tripleo | 09:10 | |
*** ykarel|lunch has quit IRC | 09:11 | |
*** hewbrocca_afk is now known as hewbrocca | 09:11 | |
*** gfidente has quit IRC | 09:15 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack-infra/tripleo-ci master: [WIP] Add support function for fast forward upgrade testing. https://review.openstack.org/526000 | 09:15 |
*** suuuper has joined #tripleo | 09:15 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack-infra/tripleo-ci master: [WIP] Add support function for fast forward upgrade testing. https://review.openstack.org/526000 | 09:16 |
*** gfidente has joined #tripleo | 09:17 | |
*** tvignaud has quit IRC | 09:18 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack-infra/tripleo-ci master: [WIP] Add support function for fast forward upgrade testing. https://review.openstack.org/526000 | 09:18 |
*** mrunge_ has joined #tripleo | 09:19 | |
*** mrunge has quit IRC | 09:21 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: [WIP] New featureset for fast forward upgrade testing. https://review.openstack.org/525686 | 09:21 |
openstackgerrit | Moshe Levi proposed openstack/tripleo-heat-templates master: SR-IOV agent: allow to configure agent extensions https://review.openstack.org/524956 | 09:23 |
holser | chem... So what's the status of upgrade job on CI? | 09:24 |
chem | holser: hehe | 09:24 |
holser | O>P or O>master | 09:24 |
holser | is still failing? | 09:24 |
chem | holser: so, O>P has has a super strange error last time I checked | 09:25 |
chem | holser: give me a sec | 09:25 |
skramaja | moshele: i am not sure of this keystone error. can you ensure if all the services are up and running? | 09:25 |
chem | holser: so this one https://bugs.launchpad.net/tripleo/+bug/1735697 | 09:26 |
openstack | Launchpad bug 1735697 in tripleo "O->P fails during AllNodesPostUpgradeSteps.ControllerDeployment_Step1 on haproxy docker." [Critical,Triaged] | 09:26 |
holser | okey I will have a look | 09:27 |
moshele | skramaja: I try to deploy everything I will check when it done | 09:27 |
holser | thanks a lot chem | 09:27 |
chem | holser: and this one https://bugs.launchpad.net/tripleo/+bug/1735702 | 09:29 |
openstack | Launchpad bug 1735702 in tripleo "O->P fails during docker upgrade on docker/services/pacemaker/mysql." [High,Triaged] | 09:29 |
*** mcornea has joined #tripleo | 09:29 | |
holser | k, thanks | 09:29 |
chem | holser: those come from the same logs, they start appearing when we get past the other errors. | 09:29 |
*** mrunge_ is now known as mrunge | 09:30 | |
chem | holser: I asked around to ha-expert and it looks like they never seen that before. | 09:30 |
holser | interesting, okey. I will assigne these bugs to myself | 09:30 |
chem | holser: maybe dciabrin (if he has time) could gives you pointers | 09:30 |
* holser is starting working on those bugs | 09:31 | |
*** gfidente has quit IRC | 09:31 | |
chem | holser: you can use https://review.openstack.org/#/c/523408/ to test those bugs | 09:31 |
*** lucas-afk is now known as lucasagomes | 09:31 | |
holser | once I have fixes I will rebase 523408 on top of them | 09:32 |
*** cylopez has left #tripleo | 09:32 | |
chem | holser: or you can use depends-on ... as you see fit. | 09:32 |
*** gfidente has joined #tripleo | 09:33 | |
*** gfidente has quit IRC | 09:33 | |
*** gfidente has joined #tripleo | 09:33 | |
holser | that's it :) you've got my point | 09:33 |
chem | holser: I would trigger a new job, i think for rdo cloud you need "recheck experimental" | 09:33 |
dciabrin | holser, a long time ago I suspected the HA upgrade job to be misconfigured but I could never prove it with logs. if you have an HA upgrade job failing and you manage to get access to the env, I'd be happy to help you investigate | 09:33 |
chem | holser: last one is 4 days old which is like pre-historic time :) | 09:34 |
holser | wow - really old :) | 09:34 |
chem | dciabrin: holser no live env ... but it's really looks like misconfiguration as downstream doesn't have this issue | 09:34 |
*** tvignaud has joined #tripleo | 09:35 | |
*** d0ugal has quit IRC | 09:37 | |
skramaja | ok moshele. i assume you are using continer base deployments, ensure the containers are running, when you face the error again. | 09:38 |
*** derekh has joined #tripleo | 09:39 | |
moshele | skramaja: I run the default overcloud-deploy.sh as I remember it is not containerized environment, unless the default as changed | 09:39 |
chem | holser: dciabrin I'm going to (try to) spin up a live env for the O->P, will let you know if it works | 09:40 |
skramaja | ok. oooq default is not containerized. got it. | 09:40 |
holser | chem, I am spinning it up :) | 09:40 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart-extras master: WIP: wire up queens upgrade workflow https://review.openstack.org/526006 | 09:40 |
holser | also | 09:40 |
chem | holser: ah, cool, so I won't. | 09:41 |
holser | give me a bit of time | 09:41 |
*** d0ugal has joined #tripleo | 09:42 | |
dciabrin | chem ack excellent | 09:42 |
openstackgerrit | Moshe Levi proposed openstack/tripleo-heat-templates master: SR-IOV agent: allow to configure agent extensions https://review.openstack.org/524956 | 09:42 |
moshele | skramaja: change it to be with default "" ^ | 09:44 |
*** aditya_r has quit IRC | 09:46 | |
chem | holser: maybe have a look at the marios' review https://review.openstack.org/#/c/526006/1. maybe there's something to grab in this stuff. | 09:50 |
skramaja | thanks moshele | 09:50 |
chem | marios: ^ | 09:50 |
holser | looking... thanks for a tip chem | 09:50 |
marios | o/ | 09:51 |
chem | marios: just saw your review and the current upgrade is not using the proper queen upgrade doc it seems, right ? | 09:51 |
chem | marios: holser is looking into the upgrade jobs. | 09:51 |
marios | chem: well it is running the composable upgrades steps and we are removing that (I am going to post something to tht as starter) since we have now the noop stack update to generate playbooks etc etc as you know | 09:52 |
marios | chem: so even if it works for P->master/Q then it isn't the one we are working towards anyway | 09:52 |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Fix stackviz data https://review.openstack.org/525603 | 09:54 |
chem | marios: right. | 09:55 |
shardy | marios: I don't think we can remove the upgrade_tasks for p-q as we've not formally deprecated the baremetal support | 09:56 |
marios | shardy: ah ack thanks that makes sense.... i'm in the middle of a rip out session :) | 09:56 |
shardy | so even if we reduce/remove test coverage of baremetal->containers we probably need to leave the tasks for stopping baremetal services, until we communicate support for bm deployments ending | 09:57 |
*** gfidente has quit IRC | 09:57 | |
shardy | marios: ack, yeah will be good to remove eventually, but I think we need to leave the baremetal bits for a while longer | 09:57 |
marios | shardy: but for baremetal support, can't we still generate ansible playbooks from the upgrade tasks and execute them? | 09:58 |
marios | shardy: i mean do we need to have the heat driven upgrade steps (common/major_upgrade_steps.j2.yaml is the one i'm looking at) | 09:58 |
marios | shardy: i think a review will be easier to discuss let me do that instead | 09:59 |
shardy | marios: ah, perhaps I misunderstood your comment, yea we need to leave the upgrade_tasks, but we could remove the associated deployment resources provided we have an upgrade workflow via config download etc | 09:59 |
marios | shardy: ack | 09:59 |
marios | shardy: yeah depends-on https://review.openstack.org/#/c/463728/46 | 09:59 |
shardy | marios: I was hoping we'd be able to remove _all_ deployment resources and switch to config download by default, but discussion with slagle indicates that's not likely for Queens | 10:00 |
shardy | 46 revisions, wow | 10:01 |
shardy | but yeah, will be good to move to that instead of the heat resources | 10:01 |
*** gfidente has joined #tripleo | 10:01 | |
*** gfidente has quit IRC | 10:01 | |
*** gfidente has joined #tripleo | 10:01 | |
*** gfidente has quit IRC | 10:03 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: WIP: remove the heat upgrade steps for Q upgrade workflow https://review.openstack.org/526017 | 10:08 |
*** ooolpbot has joined #tripleo | 10:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736383 | 10:10 |
*** ooolpbot has quit IRC | 10:10 | |
openstack | Launchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] | 10:10 |
*** salmankhan has joined #tripleo | 10:10 | |
*** ccamacho has joined #tripleo | 10:11 | |
*** gfidente has joined #tripleo | 10:13 | |
*** gfidente has quit IRC | 10:13 | |
*** gfidente has joined #tripleo | 10:13 | |
moshele | skramaja: all the service are up and it without containers | 10:25 |
shardy | jistr, bogdando, flaper87: Hey trying to figure out the ClusterIP stuff mentioned by abeekhof | 10:25 |
shardy | afaics that IP is a floating IP for the pods, not for external access? | 10:25 |
shardy | http://paste.openstack.org/show/628259/ | 10:25 |
jistr | shardy: yes, i think i wrote about that in an earlier e-mail | 10:25 |
shardy | e.g we do need the external LB/VIP for a single access IP to the user-facing API | 10:26 |
moshele | skramaja: I just run the overcloud-deploy.sh and took https://raw.githubusercontent.com/openstack-infra/tripleo-ci/master/test-environments/enable-tls.yaml and https://raw.githubusercontent.com/openstack-infra/tripleo-ci/master/test-environments/inject-trust-anchor.yaml + created simple network-environment.yaml | 10:26 |
moshele | skramaja: is there a better way to run it? | 10:26 |
jistr | shardy: yea. the IP that abeekhof mentioned is handled via statistic NAT in iptables | 10:27 |
flaper87 | shardy: right | 10:27 |
bogdando | shardy: yes, that's for an internal cluster consumption. It's not a real IP, just an iptables magic | 10:27 |
shardy | jistr: ack OK I'll carry on with the haproxy stuff then - atm it's failing because the SSL certs don't consider the VIP ip, so either we need to add it when they're generated or nat the traffic from iptables | 10:27 |
shardy | Ok thanks guys, I was doubting myself for a moment based on the email feedback ;) | 10:27 |
flaper87 | ^^ | 10:28 |
shardy | bogdando: I pasted the latest error to https://review.openstack.org/#/c/516894/ - do you know how to get the x509 certificate to be valid for traffic from the VIP? | 10:29 |
shardy | I couldn't figure it out from grepping kubespray but I assume we're missing setting some variable | 10:29 |
*** skramaja_ has joined #tripleo | 10:33 | |
*** skramaja has quit IRC | 10:33 | |
*** tosky has joined #tripleo | 10:37 | |
*** skramaja has joined #tripleo | 10:37 | |
*** skramaja_ has quit IRC | 10:38 | |
*** d0ugal has quit IRC | 10:39 | |
*** jtomasek has joined #tripleo | 10:40 | |
gfidente | flaper87 you around? | 10:40 |
flaper87 | gfidente: kinda, sorta | 10:40 |
flaper87 | gfidente: sup? | 10:40 |
gfidente | flaper87 I am trying to consume some data back into mistral after executing ansible-playbook | 10:40 |
gfidente | have you tried anything similar and have a recipe? | 10:41 |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Do not send email when logs are not available https://review.openstack.org/526024 | 10:41 |
gfidente | basically I want to capture the output from a command executed on all nodes | 10:41 |
gfidente | and consume it in the workflow | 10:41 |
flaper87 | gfidente: mmh, haven't done/needed that :/ | 10:42 |
flaper87 | I guess you can parse the output of the playbook execution? | 10:42 |
gfidente | yeah I can append into the output the content of a register | 10:46 |
*** ffiore has quit IRC | 10:47 | |
gfidente | but the problem seems to be parsing it | 10:47 |
gfidente | indeed | 10:47 |
flaper87 | gfidente: can you have the role/task/whatever-it-is write a file somewhere with the data you need? | 10:49 |
openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: Instance HA support https://review.openstack.org/506922 | 10:49 |
flaper87 | you can then red that file from mistral | 10:49 |
openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud master: [PROTOTYPE] Enable generating SSH key for the ansible deploy https://review.openstack.org/526026 | 10:50 |
*** cshastri has quit IRC | 10:50 | |
gfidente | flaper87 probably | 10:50 |
*** abregman is now known as abregman|afk | 10:50 | |
gfidente | I'll try messing with the output callback plugins first | 10:50 |
gfidente | thanks | 10:50 |
flaper87 | gfidente: it's better if you can avoid parsing things (especially ansible-playbook output) | 10:50 |
flaper87 | parsing always leads to weird scenarios :D | 10:51 |
gfidente | but has json output | 10:51 |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations stable/pike: Add ansible-lint script https://review.openstack.org/526027 | 10:52 |
*** adarazs is now known as adarazs_afk | 10:52 | |
*** udesale has joined #tripleo | 10:55 | |
*** dparkes has quit IRC | 10:56 | |
*** d0ugal has joined #tripleo | 11:02 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: [WIP] Consume NodeDataLookup in ceph-ansible https://review.openstack.org/526030 | 11:02 |
*** ffiore has joined #tripleo | 11:02 | |
openstackgerrit | Merged openstack/tripleo-common master: Add --ansible-opts for upgrade-non-controller.sh O->P upgrade https://review.openstack.org/524183 | 11:03 |
*** tosky_ has joined #tripleo | 11:03 | |
*** tosky has quit IRC | 11:03 | |
*** tosky_ is now known as tosky | 11:03 | |
*** ykarel_ has quit IRC | 11:06 | |
*** ykarel_ has joined #tripleo | 11:06 | |
*** lostRhino has joined #tripleo | 11:08 | |
*** ooolpbot has joined #tripleo | 11:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736383 | 11:10 |
*** ooolpbot has quit IRC | 11:10 | |
openstack | Launchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] | 11:10 |
*** stendulker has quit IRC | 11:15 | |
*** rfolco has joined #tripleo | 11:16 | |
*** tosky has quit IRC | 11:16 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia integration parameters to neutron https://review.openstack.org/525860 | 11:17 |
*** masco has quit IRC | 11:18 | |
*** Vijayendra has quit IRC | 11:19 | |
*** Vijayendra has joined #tripleo | 11:20 | |
*** udesale has quit IRC | 11:20 | |
*** ykarel_ is now known as ykarel | 11:25 | |
*** ykarel has quit IRC | 11:29 | |
*** ykarel has joined #tripleo | 11:29 | |
ramishra | shardy, others: please can I get some reviews for this pike backport? https://review.openstack.org/#/c/522558/ | 11:32 |
*** ykarel_ has joined #tripleo | 11:34 | |
skramaja | moshele: so you are deploying with tls and facing the keystone endpoint issue? | 11:34 |
moshele | skramaja: yes | 11:34 |
*** links has quit IRC | 11:34 | |
moshele | skramaja: should I remove it? | 11:34 |
shardy | ramishra: Hi, sure looking | 11:35 |
ramishra | shardy: thanks! | 11:35 |
skramaja | moshele: can you remove and deploy to confirm, but jasorior is the person, who could helo with tls if it is specific to tls | 11:36 |
moshele | skramaja: I wil check | 11:36 |
*** ykarel has quit IRC | 11:37 | |
openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient master: Add workflows-based role listing commands https://review.openstack.org/526038 | 11:37 |
*** rcernin has quit IRC | 11:39 | |
bogdando | shardy: access_ip maybe. IIRC, it is added to certs' dns ip alts | 11:41 |
bogdando | shardy: so 192.168.24.13 should be access_ip | 11:42 |
shardy | bogdando: Ah, thanks, I think I previously tried setting access_ip but the current version only sets ip, kube_apiserver_bind_address and loadbalancer_apiserver | 11:43 |
shardy | I had assumed loadbalancer_apiserver was enought to adjust the cluster access IP | 11:43 |
shardy | bogdando: thanks will try that, otherwise may have to terminate the ssl at haproxy | 11:43 |
moshele | skramaja: should I just remove the enable-tls.yaml ? | 11:44 |
*** abregman|afk is now known as abregman | 11:44 | |
*** BryanS68 has joined #tripleo | 11:44 | |
skramaja | moshele: i think inject-trust-anchor.yaml too.. | 11:45 |
*** BryanS68 has quit IRC | 11:46 | |
moshele | skramaja: and what about this /usr/share/openstack-tripleo-heat-templates/environments/tls-endpoints-public-ip.yaml? | 11:47 |
*** links has joined #tripleo | 11:47 | |
*** ratailor has quit IRC | 11:47 | |
skramaja | moshele: sorry, i dont have much idea on tls part - https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ssl.html could give some insight. | 11:47 |
*** pdeore has quit IRC | 11:48 | |
openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-heat-templates master: Update default value for derive params workflow inputs https://review.openstack.org/525986 | 11:48 |
*** raildo has joined #tripleo | 11:48 | |
*** BryanS68 has joined #tripleo | 11:49 | |
*** janki has quit IRC | 11:52 | |
*** dtantsur|afk is now known as dtantsur | 11:53 | |
*** nmathew has quit IRC | 11:54 | |
dtantsur | morning folks, can someone check https://review.openstack.org/#/c/522568/ please? it's a small patch enabling a very cool feature. | 11:55 |
dtantsur | the same change for containerized undercloud is https://review.openstack.org/#/c/523094/ (also a one-liner), if you're interested | 11:57 |
*** jkilpatr has joined #tripleo | 11:59 | |
*** pdeore has joined #tripleo | 12:01 | |
*** openstackgerrit has quit IRC | 12:03 | |
*** akrivoka has joined #tripleo | 12:04 | |
*** pkovar has joined #tripleo | 12:05 | |
*** openstackgerrit has joined #tripleo | 12:06 | |
openstackgerrit | Merged openstack/paunch stable/pike: Explicitly pull images before docker run https://review.openstack.org/525322 | 12:06 |
*** links has quit IRC | 12:08 | |
*** ooolpbot has joined #tripleo | 12:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736383 | 12:10 |
openstack | Launchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] | 12:10 |
*** ooolpbot has quit IRC | 12:10 | |
bogdando | shardy: https://github.com/kubernetes-incubator/kubespray/blob/fe036cbe7705d6dc5aed5ddccb32a4723c31c9cd/roles/kubernetes/secrets/templates/openssl.conf.j2#L23 here is access_ip makes into certs. And via its FQDN at the line 20 | 12:10 |
*** links has joined #tripleo | 12:13 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-common stable/pike: Add --ansible-opts for upgrade-non-controller.sh O->P upgrade https://review.openstack.org/526047 | 12:14 |
openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Add a tag to all the role specific parameters https://review.openstack.org/517231 | 12:20 |
*** ansmith has quit IRC | 12:21 | |
*** adarazs_afk is now known as adarazs | 12:27 | |
*** tosky has joined #tripleo | 12:28 | |
chandankumar | EmilienM: sshnaidm|rover weshay mwhahaha feel free to add feedback to it https://etherpad.openstack.org/p/tempestconfigtool_refactoring | 12:29 |
*** pchavva has joined #tripleo | 12:32 | |
*** psahoo has quit IRC | 12:32 | |
*** panda is now known as panda|lnch | 12:34 | |
*** Goneri has quit IRC | 12:37 | |
*** lucasagomes is now known as lucas-hungry | 12:44 | |
*** abishop has joined #tripleo | 12:45 | |
*** paramite has joined #tripleo | 12:45 | |
*** janki has joined #tripleo | 12:46 | |
*** thrash|g0ne is now known as thrash | 12:46 | |
*** iranzo has quit IRC | 12:48 | |
*** salmankhan has quit IRC | 12:49 | |
*** salmankhan has joined #tripleo | 12:51 | |
*** tesseract has quit IRC | 12:53 | |
openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 12:54 |
*** nmathew has joined #tripleo | 12:55 | |
openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates master: Pass storage nfs VIP to ceph-ansible https://review.openstack.org/512240 | 12:56 |
*** tesseract has joined #tripleo | 12:57 | |
*** nyechiel has quit IRC | 12:58 | |
*** bfournie has joined #tripleo | 12:59 | |
*** bfournie has quit IRC | 12:59 | |
*** nyechiel has joined #tripleo | 12:59 | |
*** skramaja has quit IRC | 13:01 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 13:07 |
*** suuuper has quit IRC | 13:09 | |
*** ooolpbot has joined #tripleo | 13:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736383 | 13:10 |
*** ooolpbot has quit IRC | 13:10 | |
openstack | Launchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] | 13:10 |
chem | lyarwood: hey, I would need the release https://review.openstack.org/#/c/519195/2 in tripleo-ci, would you mind if I made the change ? | 13:12 |
*** verdurin has quit IRC | 13:12 | |
chem | lyarwood: in tripleo-ci directory | 13:12 |
openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo master: Enable Octavia service_auth configuration https://review.openstack.org/526060 | 13:12 |
dtantsur | mwhahaha: hey! I'm sorry, its seems that I've forgotten to ask for approval of https://blueprints.launchpad.net/tripleo/+spec/ovirt-driver. It's a high-priority for Red Hat, low impact code-wise and disabled by default. 2 of the patches are merged, 2 have 1x +2. | 13:12 |
lyarwood | chem: not at all, go for it :) | 13:12 |
mwhahaha | dtantsur: are all patches posted? or is there more work needed? | 13:13 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data https://review.openstack.org/508567 | 13:13 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow https://review.openstack.org/509419 | 13:13 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow https://review.openstack.org/513463 | 13:13 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Adds Workflow to List Available Roles https://review.openstack.org/509832 | 13:13 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Adds UpdateRoles Workflow https://review.openstack.org/515045 | 13:13 |
dtantsur | mwhahaha: double-checking | 13:13 |
*** dprince has joined #tripleo | 13:14 | |
mwhahaha | dtantsur: thanks, if it's all good as is i have no problems approving it as it looks like we can land it today | 13:14 |
EmilienM | beagles: in a mtg now, will join asap | 13:14 |
dtantsur | mwhahaha: all patches seem to be up for it | 13:15 |
mwhahaha | dtantsur: ok thanks | 13:15 |
beagles | EmilienM, ack | 13:15 |
dtantsur | mwhahaha: while we are here, status update on https://blueprints.launchpad.net/tripleo/+spec/ansible-deploy. all essential patches are up. the docs are missing, and the SSH craziness I've been working asking you about is nice-to-have, but not critical. | 13:16 |
*** jkilpatr has quit IRC | 13:16 | |
mwhahaha | dtantsur: ok i'll review that one as well | 13:17 |
dtantsur | mwhahaha: this is approved already, just updating you on the status | 13:17 |
mwhahaha | dtantsur: yea i meant the patches :D | 13:17 |
dtantsur | that's even better, thanks :) | 13:17 |
*** dtantsur is now known as dtantsur|lunch | 13:18 | |
*** nyechiel has quit IRC | 13:18 | |
*** mburned is now known as mburned_out | 13:20 | |
chem | lyarwood: cool | 13:20 |
*** rhallisey has joined #tripleo | 13:20 | |
*** sshnaidm|rover is now known as sshnaidm|afk | 13:20 | |
*** ffiore has quit IRC | 13:21 | |
*** trown|outtypewww is now known as trown | 13:22 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: config: Provide a Master UC and Newton OC release config https://review.openstack.org/519195 | 13:23 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add support for Octavia service-to-service credentials https://review.openstack.org/526062 | 13:23 |
*** links has quit IRC | 13:23 | |
*** verdurin has joined #tripleo | 13:25 | |
*** rlandy has joined #tripleo | 13:28 | |
*** ykarel_ has quit IRC | 13:28 | |
*** rfolco is now known as rfolco|afk | 13:29 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia integration parameters to neutron https://review.openstack.org/525860 | 13:29 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add support for Octavia service-to-service credentials https://review.openstack.org/526062 | 13:29 |
*** mburned_out is now known as mburned | 13:29 | |
flaper87 | jistr: might have found a workaround for the nm thing, will report back after testing | 13:29 |
*** ykarel_ has joined #tripleo | 13:30 | |
*** Goneri has joined #tripleo | 13:30 | |
openstackgerrit | Martin Mágr proposed openstack/puppet-tripleo master: Enable collectd to send metrics to Gnocchi https://review.openstack.org/526067 | 13:33 |
*** rfolco|afk is now known as real_jesus | 13:34 | |
*** real_jesus is now known as rfolco | 13:34 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: deploy-steps.j2: use ansible to bootstrap environment https://review.openstack.org/525291 | 13:38 |
*** dtantsur|lunch is now known as dtantsur | 13:40 | |
EmilienM | weshay: do we have a bug for OVB timeout now? | 13:40 |
EmilienM | weshay: if yes, I would put it in alert | 13:40 |
weshay | EmilienM, we | 13:40 |
weshay | 're | 13:40 |
EmilienM | folks need to know to be careful when reviewing patches | 13:40 |
weshay | using your bug :) | 13:40 |
* weshay gets | 13:41 | |
weshay | EmilienM, would be great if you updated the title | 13:41 |
EmilienM | sure | 13:41 |
*** nmathew- has joined #tripleo | 13:42 | |
EmilienM | https://bugs.launchpad.net/tripleo/+bug/1736634 | 13:42 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 13:42 |
*** jkilpatr has joined #tripleo | 13:42 | |
EmilienM | what should I change? | 13:42 |
EmilienM | we have this one otherwise: https://bugs.launchpad.net/tripleo/+bug/1722864 | 13:43 |
openstack | Launchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged] | 13:43 |
EmilienM | which looks more accurate to the situation | 13:43 |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Do not send email when logs are not available https://review.openstack.org/526024 | 13:43 |
*** ffiore has joined #tripleo | 13:43 | |
openstackgerrit | James Slagle proposed openstack/tripleo-common master: Remove jq package install https://review.openstack.org/525781 | 13:43 |
*** nmathew has quit IRC | 13:45 | |
*** psachin has quit IRC | 13:45 | |
jistr | flaper87: that would be great :) | 13:45 |
dtantsur | mwhahaha: could you please create rocky milestones in LP? I'd like to retarget https://blueprints.launchpad.net/tripleo/+spec/ironic-direct-deploy but we don't have rocky-1 | 13:46 |
*** gbarros has joined #tripleo | 13:46 | |
mwhahaha | dtantsur: yea i'm going to do it today | 13:47 |
dtantsur | ack | 13:47 |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Handle error in the deploy_on_server workflow https://review.openstack.org/523332 | 13:47 |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Remove the name from task() functions that refer to themselves https://review.openstack.org/524250 | 13:47 |
openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-common master: DPDK derive params inputs default value update https://review.openstack.org/525990 | 13:48 |
*** eck`gone is now known as eck` | 13:48 | |
*** lucas-hungry is now known as lucasagomes | 13:49 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: [WIP] Consume NodeDataLookup in ceph-ansible https://review.openstack.org/526030 | 13:50 |
*** ansmith has joined #tripleo | 13:51 | |
*** ykarel_ is now known as ykarel|afk | 13:53 | |
*** ansmith has quit IRC | 13:56 | |
openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud master: Set default_resource_class to baremetal https://review.openstack.org/526072 | 13:57 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Passes NodeDataLookup to ceph-ansible workflow https://review.openstack.org/526073 | 13:57 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Passes NodeDataLookup to ceph-ansible workflow https://review.openstack.org/526073 | 13:58 |
openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Undercloud deploy: pass undercloud.yaml after docker.yaml https://review.openstack.org/526076 | 13:59 |
*** ansmith has joined #tripleo | 13:59 | |
*** jaganathan has quit IRC | 13:59 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-heat-templates stable/pike: Update capabilities-map.yaml to include latest storage environments https://review.openstack.org/526077 | 14:00 |
*** nmathew- has quit IRC | 14:01 | |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Get rid of Undercloud* specific service entries in resource registry https://review.openstack.org/524644 | 14:01 |
*** liverpooler has joined #tripleo | 14:01 | |
jistr | dprince, mandre: i think this is why we had the separate Undercloud* resource entries: https://review.openstack.org/#/c/526076 | 14:02 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: config: Provide a Master UC and Newton OC release config https://review.openstack.org/519195 | 14:02 |
jistr | passing the env file again is not optimal, but IMO it's still significantly better than maintaining two sets of resource registry names | 14:02 |
*** hamzy has quit IRC | 14:02 | |
*** sshnaidm|afk is now known as sshnaidm|rover | 14:02 | |
dprince | jistr: ah right, that could be it | 14:03 |
dprince | jistr: I don't want to always containerize it | 14:03 |
jistr | ack. Then passing the undercloud.yaml after docker.yaml should do the trick. | 14:04 |
dprince | jistr: actually, we specifically might use this for keeping some of our baremetal testing intact. We spoke of this at the PTG. Like we could keep 1 (small) single node job to test baremeteal with the undercloud | 14:04 |
dprince | jistr: yes, but we'll need to roll our own validation mechanism for this ordering I think | 14:05 |
jistr | yea i see, now i seem recall that from ML / irc meeting discussion as well | 14:05 |
jistr | re baremetal testing i mean ^ | 14:05 |
dprince | jistr: okay | 14:06 |
dprince | jistr: so regarding undercloud.yaml being last. I would say a validation would be nice on this | 14:07 |
dprince | maybe not required though | 14:07 |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates master: [WIP] undercloud: set default_resource_class to 'baremetal' https://review.openstack.org/526078 | 14:07 |
dprince | jistr: also, I think we already have some ordering issues with other environment files too. But it may be best to avoid them... even if it costs us some duplication | 14:08 |
*** tzumainn has joined #tripleo | 14:08 | |
*** dsariel has quit IRC | 14:08 | |
*** lostRhino_ has joined #tripleo | 14:08 | |
dtantsur | mwhahaha: sorry for the noise, another highlight: currently the undercloud-containers job does not install ironic-inspector. https://review.openstack.org/#/c/524163/ corrects it, and seems to work. | 14:09 |
*** mdnadeem has quit IRC | 14:09 | |
*** lostRhino has quit IRC | 14:10 | |
*** lostRhino_ is now known as lostRhino | 14:10 | |
jistr | dprince: what you see as the desired outcome, re preferring duplication over ordering issues? Would you like to keep Undercloud* resource registry? | 14:10 |
*** ooolpbot has joined #tripleo | 14:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736383 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 14:10 |
*** ooolpbot has quit IRC | 14:10 | |
openstack | Launchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] | 14:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 14:10 |
fultonj | my oooq install is failing because undercloud-install.sh is not on the undercloud. Does anyone know how it's supposed to get there? | 14:10 |
*** iranzo has joined #tripleo | 14:10 | |
dprince | jistr: I dunno. Maybe. | 14:11 |
jistr | dprince: i could try implementing the validation for docker.yaml vs. undercloud.yaml, but i don't know what other ordering issues you had in mind | 14:11 |
*** ramishra has quit IRC | 14:11 | |
*** udesale has joined #tripleo | 14:12 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Enable ironic staging drivers in the undercloud https://review.openstack.org/523084 | 14:14 |
*** salmankhan has quit IRC | 14:14 | |
jistr | dprince: there's another possible duplication path. We could have docker-undercloud.yaml that would duplicate docker.yaml, but exclude the services disabled by default. Still duplication, but at least it would be limited to t-h-t. The current solution duplicates in tripleo-common as well, and makes for quite confusing naming (some services in resource registry are Undercloud<Service>, others are just | 14:15 |
jistr | <Service>). | 14:15 |
jistr | the duplication in tripleo-common is because of `container image prepare` detection of which images to pull | 14:16 |
jistr | dprince: anyway maybe this could use a ML thread? | 14:16 |
dprince | jistr: right, but again. That violates the "anything can be an undercloud" idea | 14:16 |
openstackgerrit | Thomas Herve proposed openstack/tripleo-common master: Make some tweaks to swift logging https://review.openstack.org/498930 | 14:16 |
*** ffiore has quit IRC | 14:17 | |
*** dbellant has quit IRC | 14:17 | |
openstackgerrit | Or Idgar proposed openstack/tripleo-heat-templates master: Add missing parameters to octavia worker https://review.openstack.org/526080 | 14:17 |
dprince | jistr: there are several goals of this framework. One is dev/testing. Another is replacing instack-undercloud with a containerized product | 14:17 |
*** bfournie has joined #tripleo | 14:17 | |
dprince | jistr: for me having the Heat environment behave as much as possible like they do on the Overcloud is the overriding ideal | 14:17 |
*** gkadam has quit IRC | 14:18 | |
dprince | jistr: and if there is some duplication in the process. So be it. Perhaps put a tools/yaml-validate.py test on it like we do for many things | 14:18 |
*** jmelvin has joined #tripleo | 14:20 | |
jistr | dprince: re violating "anything can be an undercloud". You mean that we'd have to pass `docker-undercloud.yaml` instead of `docker.yaml` to undercloud deploy? | 14:20 |
openstackgerrit | Or Idgar proposed openstack/tripleo-heat-templates master: Add missing parameters to octavia worker https://review.openstack.org/526080 | 14:21 |
dprince | jistr: right. if there is a static list it means we can't leverage the environments/services-docker to layer in custom services | 14:23 |
openstackgerrit | Or Idgar proposed openstack/tripleo-heat-templates master: Add missing parameters to octavia worker https://review.openstack.org/526080 | 14:23 |
jistr | dprince: well it wouldn't be list, it would still be just resource registry mappings. So the services-docker layering would still work. | 14:23 |
*** salmankhan has joined #tripleo | 14:27 | |
dprince | jistr: yeah. good point. I think it could be okay then | 14:27 |
*** ykarel_ has joined #tripleo | 14:28 | |
jistr | dprince: ok i'll change the patches in this way and we'll see what folks think. It's still duplication but it's limited to a single place, so hopefully it would be an improvement. | 14:29 |
jistr | dprince: thanks for the feedback :) | 14:30 |
*** ykarel|afk has quit IRC | 14:31 | |
openstackgerrit | Or Idgar proposed openstack/tripleo-heat-templates master: Add support for Octavia service-to-service credentials https://review.openstack.org/526062 | 14:33 |
*** hjensas has quit IRC | 14:34 | |
*** lblanchard has joined #tripleo | 14:34 | |
openstackgerrit | Or Idgar proposed openstack/tripleo-heat-templates master: Add missing parameters to octavia worker https://review.openstack.org/526080 | 14:35 |
*** eck` is now known as eck`gone | 14:36 | |
*** tesseract has quit IRC | 14:37 | |
*** eck`gone is now known as eck` | 14:40 | |
*** hamzy has joined #tripleo | 14:42 | |
*** tesseract has joined #tripleo | 14:44 | |
*** s_b_34343 has quit IRC | 14:44 | |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations stable/pike: Validate library files for documentation string https://review.openstack.org/526085 | 14:46 |
EmilienM | slagle: in https://review.openstack.org/#/c/525291/ - I'm not sure how the playbook is executed if we don't call the tag, right? | 14:46 |
EmilienM | gchamoul: could you please follow up on https://review.openstack.org/#/c/525637/ ? | 14:47 |
shardy | EmilienM: by default we run config dowload playbooks with no tags | 14:48 |
EmilienM | shardy: ok so we run all playboosk I guess | 14:48 |
slagle | EmilienM: right, if you pass no tags, they all get run | 14:48 |
EmilienM | ack | 14:49 |
slagle | which is what we do by default | 14:49 |
EmilienM | ok, thx | 14:49 |
EmilienM | shardy: if you have time to review https://review.openstack.org/#/c/525291/ | 14:49 |
shardy | EmilienM: sure looking | 14:49 |
EmilienM | and https://review.openstack.org/#/c/525285/ | 14:49 |
openstackgerrit | Or Idgar proposed openstack/tripleo-heat-templates master: Add support for Octavia service-to-service credentials https://review.openstack.org/526062 | 14:49 |
d0ugal | rbrady,d0ugal,apetrich,thrash,toure,jpich,jtomasek - Workflow squad meeting in ~9mins. https://etherpad.openstack.org/p/tripleo-workflows-squad-status | 14:51 |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations stable/pike: Add ansible-lint script https://review.openstack.org/526027 | 14:51 |
openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo master: Enable octavia certificate configuration https://review.openstack.org/526087 | 14:51 |
jtomasek | d0ugal: sorry, not able to join today | 14:51 |
d0ugal | jtomasek: np | 14:52 |
openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Undercloud deploy: use docker-uc.yaml https://review.openstack.org/526076 | 14:52 |
*** lblanchard has quit IRC | 14:52 | |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Get rid of Undercloud* specific service entries in resource registry https://review.openstack.org/524644 | 14:52 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Disable services in undercloud.yaml and add docker-uc.yaml https://review.openstack.org/526088 | 14:52 |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 14:52 |
*** alee has joined #tripleo | 14:52 | |
*** cylopez has joined #tripleo | 14:52 | |
*** hamzy has quit IRC | 14:53 | |
toure | d0ugal ack | 14:54 |
*** hamzy has joined #tripleo | 14:55 | |
EmilienM | shardy: thanks :-) | 14:55 |
slagle | EmilienM: now can you +2 https://review.openstack.org/#/c/525781/ ? | 14:56 |
openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Undercloud deploy: use docker-uc.yaml https://review.openstack.org/526076 | 14:56 |
EmilienM | slagle: I could :P | 14:56 |
*** hamzy has quit IRC | 14:58 | |
openstackgerrit | Or Idgar proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters https://review.openstack.org/526090 | 14:59 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Remove Octavia LBaaS service plugin from neutron config https://review.openstack.org/526093 | 14:59 |
*** hamzy has joined #tripleo | 15:00 | |
*** rbowen has joined #tripleo | 15:01 | |
*** ykarel_ is now known as ykarel | 15:01 | |
*** marios has quit IRC | 15:02 | |
*** owalsh_ has joined #tripleo | 15:03 | |
*** owalsh has quit IRC | 15:05 | |
*** hamzy has quit IRC | 15:06 | |
*** ramishra has joined #tripleo | 15:07 | |
*** s_b_34343 has joined #tripleo | 15:10 | |
*** ooolpbot has joined #tripleo | 15:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736383 | 15:10 |
openstack | Launchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 15:10 |
*** ooolpbot has quit IRC | 15:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 15:10 |
sshnaidm|rover | dprince, do you know maybe: in tripleoclient output we have "tacker" container, but in kolla we build tacker-base, tacker-conductor, tacker-server, there is no "tacker" container | 15:11 |
*** dsariel has joined #tripleo | 15:11 | |
dprince | sshnaidm|rover: sounds like they got split out perhaps? | 15:11 |
sshnaidm|rover | dprince, perhaps.. no idea, who can know? | 15:12 |
sshnaidm|rover | dprince, and how to fix? to add to tripleoclient all those? | 15:12 |
dprince | sshnaidm|rover: just did a 'git log' in the kolla/docker/tacker directory | 15:12 |
dprince | sshnaidm|rover: it see this Kolla commit : 7b2dea5506375cb868d6acb6a99b0aca916fad6c | 15:12 |
dprince | sshnaidm|rover: Implement tacker-conductor image, rework all tacker | 15:12 |
dprince | sshnaidm|rover: I think this is your answer | 15:12 |
sshnaidm|rover | dprince, so, we need to fix it where? tripleo-common, tripleoclient? | 15:13 |
*** panda|lnch is now known as panda | 15:13 | |
*** hamzy has joined #tripleo | 15:13 | |
dprince | sshnaidm|rover: someone needs to push patches to pull the new tacker containers, yes. Probably some work in tripleo-common and maybe tripleoclient too | 15:14 |
*** hamzy has quit IRC | 15:14 | |
sshnaidm|rover | dprince, do you have suggestions who could be this hero? :) | 15:15 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Do not create roles unless keystone was deployed https://review.openstack.org/525648 | 15:17 |
*** janki has quit IRC | 15:17 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Remove workaround for periodic jobs https://review.openstack.org/525541 | 15:17 |
*** hamzy has joined #tripleo | 15:17 | |
*** agurenko has quit IRC | 15:17 | |
sshnaidm|rover | gfidente, hi, do you know why ceph container is not in tripleoupstream? https://github.com/openstack/tripleo-common/blob/aaf46be238f554148b40748dbd4eafec759038ed/container-images/overcloud_containers.yaml#L96 | 15:17 |
*** hamzy has quit IRC | 15:18 | |
dtantsur | folks, we do configure swift temporary URLs in the undercloud, don't we? | 15:18 |
*** dsariel has quit IRC | 15:18 | |
dtantsur | shardy: I guess you know ^^^ | 15:18 |
dprince | sshnaidm|rover: I think pradk might have implemented that. radez you helped a bit w/ Congress right? | 15:18 |
mandre | sshnaidm|rover: the kolla tacker container was recently split into base and conductor and tripleo has not yet caught up with the change | 15:18 |
shardy | dtantsur: yes we do | 15:18 |
beagles | shardy, couple of questions - with external_deploy_tasks is the correct pattern to construct an inventory or is there an "implicit" inventory that is meant to be used? | 15:18 |
dprince | sshnaidm|rover: probably somebody else on the containers DFG can help with this too | 15:18 |
dtantsur | shardy: where can I access the key for them, do you know? | 15:19 |
gfidente | sshnaidm|rover because we use images built by ceph | 15:19 |
gfidente | not by tripleo | 15:19 |
sshnaidm|rover | gfidente, ack | 15:19 |
*** ffiore has joined #tripleo | 15:19 | |
sshnaidm|rover | dprince, it raises again the question about updated containers list.. | 15:19 |
mandre | sshnaidm|rover: I think you can safely ignore tacker until we get someone in tripleo to rework the implementation | 15:20 |
shardy | dtantsur: it depends where they were created, there's a couple of scripts in tripleo common, and heat can also create a tempurl for metadata/signalling | 15:20 |
sshnaidm|rover | mandre, yes, but I wanted to have containers list generated automatically, and seems like it's not updated if it contains "tacker" container | 15:20 |
shardy | dtantsur: e.g https://github.com/openstack/tripleo-common/blob/master/scripts/upload-swift-artifacts#L109 | 15:20 |
openstackgerrit | Or Idgar proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters https://review.openstack.org/526090 | 15:21 |
shardy | dtantsur: the upload* scripts aren't used by default, but the heat transport is, sec I'll find the code | 15:21 |
mwhahaha | dtantsur: what are you needing it for? we do leverage them in mistral | 15:21 |
dtantsur | mwhahaha: ironic ansible deploy interface uses it to provide access to overcloud-full image of the target node | 15:22 |
shardy | Oh yeah, for swift ring distribution also | 15:22 |
mandre | sshnaidm|rover: agreed, let's drop it from tripleo-common's list until it's fixed | 15:22 |
*** dpawar has quit IRC | 15:23 | |
*** dpawar has joined #tripleo | 15:23 | |
mwhahaha | dtantsur: i don't think you'd generate a key via the swift command | 15:23 |
shardy | dtantsur: Yeah I think you generate the key at the point of creating the tempurl | 15:23 |
mwhahaha | dtantsur: of course the openstack command doesnt' support temp url generation so i had to hack something into the upload swift script | 15:23 |
EmilienM | need review https://review.openstack.org/#/c/525341/ | 15:23 |
shardy | vs having a predictable/shared key | 15:24 |
dtantsur | shardy: for some reason, I don't remember exactly, ironic accepts a pre-generated key | 15:24 |
mwhahaha | dtantsur: probably because you generate it in swift first | 15:25 |
*** dpawar has quit IRC | 15:25 | |
mwhahaha | dtantsur: https://github.com/openstack/tripleo-common/blob/master/scripts/upload-swift-artifacts#L106-L113 that block does it | 15:25 |
weshay | sshnaidm|rover, FYI https://bugs.launchpad.net/tripleo/+bug/1736475 was not escalated because the milestone was not filled out | 15:25 |
openstack | Launchpad bug 1736475 in tripleo "Telemetry tempest tests fail in pike promotion job periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-pike" [Critical,Triaged] | 15:25 |
*** ffiore has quit IRC | 15:25 | |
weshay | sshnaidm|rover, fixed and escalated | 15:25 |
EmilienM | weshay: ping pradk eventually | 15:25 |
dtantsur | mwhahaha: thanks, yeah, looking at it now. should not be hard to do for the glance container.. | 15:25 |
shardy | https://github.com/openstack/heat/blob/master/heat/engine/clients/os/swift.py#L99 | 15:26 |
shardy | dtantsur: FWIW that's how we do it in heat, randomly generated unless there's a header for the account | 15:26 |
dtantsur | nice, I'll file a bug against ironic | 15:27 |
dtantsur | maybe we don't do it do avoid stepping on operator's shoes, if they need to access these containers from other tools? | 15:28 |
sshnaidm|rover | weshay, ack | 15:28 |
*** aditya_r has joined #tripleo | 15:29 | |
openstackgerrit | Or Idgar proposed openstack/tripleo-heat-templates master: Run Octavia configuration on the overcloud https://review.openstack.org/508195 | 15:29 |
openstackgerrit | Or Idgar proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters https://review.openstack.org/526090 | 15:31 |
*** cylopez has quit IRC | 15:31 | |
*** lostRhino has quit IRC | 15:31 | |
*** owalsh_ is now known as owalsh | 15:32 | |
openstackgerrit | Martin André proposed openstack/tripleo-common master: Comment out tacker image until service is ready https://review.openstack.org/526099 | 15:34 |
mandre | sshnaidm|rover: ^^ what about this? | 15:34 |
*** lostRhino has joined #tripleo | 15:35 | |
*** gbarros has quit IRC | 15:35 | |
*** moshele has quit IRC | 15:35 | |
openstackgerrit | Merged openstack/tripleo-common master: Support enrolling nodes with staging-ovirt hardware type https://review.openstack.org/522815 | 15:35 |
openstackgerrit | Merged openstack/instack-undercloud master: Add support for oVirt via the staging-ovirt hardware type https://review.openstack.org/522807 | 15:35 |
sshnaidm|rover | mandre, great, exactly what we need | 15:35 |
*** udesale has quit IRC | 15:36 | |
sshnaidm|rover | mandre, when tripleoclient generates list of containers, does it take the list from tripleo-common files? | 15:37 |
mandre | sshnaidm|rover: yes, that's our source for container images | 15:39 |
sshnaidm|rover | mandre, ack | 15:40 |
*** trown is now known as trown|brb | 15:42 | |
*** lostRhino has left #tripleo | 15:45 | |
*** ykarel is now known as ykarel|afk | 15:45 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: WIP: (very) Execute Octavia post deploy tasks https://review.openstack.org/526103 | 15:46 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: add nova and neutron tempest plugins to default config https://review.openstack.org/525657 | 15:49 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: remove tempest plugin install from convert image https://review.openstack.org/525659 | 15:49 |
*** abregman is now known as abregman|mtg | 15:50 | |
*** trown|brb is now known as trown | 15:50 | |
adarazs | EmilienM: please re-review this when you have some time, I want to move forward with it, other tasks depend on it in our sprint: https://review.openstack.org/525237 | 15:52 |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Implement Upgrade workflow via the tripleo cli https://review.openstack.org/463728 | 15:52 |
*** tongl has joined #tripleo | 15:52 | |
dtantsur | folks, I may be insane.. but I have 5 images in Glance and no Swift containers for the glance user | 15:53 |
trown | rlandy: you could use your +2 powers on https://review.openstack.org/#/c/518748/ ;) | 15:53 |
rlandy | trown: sure - I owe you that! | 15:54 |
EmilienM | adarazs: sure thing, I'll review it today | 15:54 |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Get message from websocket instead from zaqarclient directly https://review.openstack.org/525924 | 15:54 |
adarazs | rlandy: woo, congrats for the +2! :) | 15:55 |
beagles | shardy, forgot my second question - just confirming that we would still be calling the playbook from the external_post_deploy_tasks, not move all of the tasks into the heat template | 15:55 |
rlandy | weshay: ^^ first +2 - do I get to make a shehecheyanu? | 15:56 |
weshay | rlandy, ah NICE.. I've never said the shehecheyanu over bluejeans | 15:56 |
weshay | rlandy++ | 15:56 |
shardy | beagles: Hey, so the tasks are called on the undercloud with -i /usr/bin/tripleo-ansible-inventory, so if the tasks can run on the undercloud no additional inventory is required | 15:57 |
weshay | very nice news | 15:57 |
trown | ive also never said the shehecheyanu over bluejeans | 15:57 |
adarazs | looking at how complicated even just that word is, I don't think I will say it either. :) | 15:57 |
shardy | beagles: however in the case where you want to run tasks on the overcloud nodes, such as in the case of kubespray, you may need to generate a nested inventory in a similar way | 15:57 |
weshay | who is ejuaoso | 15:57 |
shardy | beagles: where the tasks live is up to you, but I was thinking you may want to move them into the service template | 15:58 |
beagles | shardy, there are a lot of em ;) | 15:58 |
shardy | beagles: ack, yeah then I guess it could remain a role in tripleo-common and you just include it | 15:59 |
openstackgerrit | Toure Dunnon proposed openstack/tripleo-common master: Migrate the ansible actions from tripleo-common to mistral-extra. https://review.openstack.org/523540 | 15:59 |
*** s_b_34343 has quit IRC | 15:59 | |
beagles | shardy, oohhhh include | 15:59 |
beagles | beagles does a facepalm | 15:59 |
shardy | beagles: the disadvantage of that approach is the update of the role has to be aligned with any update to the template | 16:00 |
beagles | shardy, yeah, that's a good point | 16:00 |
shardy | whereas it's kinda easier when everything is in t-h-t | 16:00 |
shardy | that said we already have that problem with kubespray, openshift-ansible and ceph-ansible | 16:00 |
beagles | shardy, there is something special that needs to be done to get access to the overcloud credentials correct? | 16:01 |
beagles | shardy, ie. be able to call openstack client calls from the task? | 16:01 |
shardy | beagles: I had been wondering if there's a case for a tht/ansible/roles structure, e.g somewhere config download could download roles from vs having a static packaged role to keep in sync | 16:01 |
beagles | shardy, that would actually be pretty sweet | 16:02 |
shardy | beagles: you'd just need to pass the credentials in via heat parameters I think, assuming the admin credentials | 16:02 |
*** morazi has quit IRC | 16:02 | |
beagles | shardy, ack | 16:02 |
*** ykarel|afk has quit IRC | 16:02 | |
shardy | beagles: we could even consider reworking how we write the overcloudrc I guess, that could use external_post_deploy_tasks instead of a tripleo-common workflow | 16:03 |
shardy | beagles: but for now I think you can just reference e.g AdminPassword and the keystone endpoint from the EndpointMap | 16:05 |
shardy | and pass those to the ansible tasks (e.g via str_replace) | 16:05 |
shardy | we do a similar thing here: | 16:05 |
shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/services/kubernetes-master.yaml#L147 | 16:06 |
*** ooolpbot has joined #tripleo | 16:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736383 | 16:10 |
openstack | Launchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 16:10 |
*** ooolpbot has quit IRC | 16:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 16:10 |
*** andreaf_ has joined #tripleo | 16:10 | |
*** gbarros has joined #tripleo | 16:12 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: add keystone and neutron tempest plugins to default config https://review.openstack.org/525657 | 16:15 |
openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: Deploy OpenShift using OOO on the overcloud https://review.openstack.org/494470 | 16:15 |
*** andreaf has quit IRC | 16:17 | |
*** andreaf_ is now known as andreaf | 16:17 | |
*** s_b_34343 has joined #tripleo | 16:18 | |
weshay | dprince, Slower are all the patches in for the insecure registry, ready for retest? | 16:22 |
*** s_b_34343 has quit IRC | 16:23 | |
*** hewbrocca is now known as hewbrocca_afk | 16:23 | |
jpich | jtomasek, honza: So https://blueprints.launchpad.net/tripleo/+spec/tripleo-ui-basic-ci-check was added a couple of cycles ago to the undercloud CI job, and the UI can break this test which is why the job was also added to it at the time | 16:24 |
*** s_b_34343 has joined #tripleo | 16:24 | |
jpich | jtomasek, honza: I'm not totally sure if it was lost along the way during the migration to quickstart for CI, but if it's still there I think the job should be reenabled... | 16:24 |
*** shreshtha has quit IRC | 16:25 | |
jtomasek | jpich: +1 | 16:26 |
dprince | weshay: I still have a patch to push | 16:30 |
dprince | weshay: hit a snag w/ the Endpointmapping stuff in t-h-t with regards to the new docker-registry service we need | 16:30 |
jpich | jtomasek: Do you know if it was deliberately removed (I assumed so from your comment?) or did it get lost along the way, during the zuul migration? | 16:31 |
jtomasek | jpich: I have no idea tbh, I don't think it was removed on purpose | 16:32 |
jtomasek | jpich: is that job used anywhere else? | 16:32 |
jpich | jtomasek: It should be used on puppet-tripleo and a couple other places *looks* | 16:32 |
*** aditya_r has quit IRC | 16:34 | |
*** ffiore has joined #tripleo | 16:35 | |
*** dbecker has quit IRC | 16:35 | |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Enable collectd to send metrics to Gnocchi https://review.openstack.org/526122 | 16:36 |
jpich | jtomasek: yes it looks like there is still undercloud only jobs running there... though they have oooq in the name so I don't know if they use the tripleo.sh script. Looking at https://review.openstack.org/#/c/514795/ though there are UI sanity checks there too so we probably want to figure out which jobs this validation is running on and get the shortest running one to run on the UI too | 16:37 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: Reduce the calls to heat when downloading config https://review.openstack.org/525236 | 16:38 |
sshnaidm|rover | alee, just to confirm here - we don't need barbican-worker and keystone-listener containers for pike, so I exclude them | 16:38 |
openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 16:38 |
shardy | slagle: ^^ hey that's the fix I mentioned yesterday for config download, would appreciate your review when you get a moment, as I'm not 100% certain my use of outputs is equivalent to your previous resource list logic | 16:38 |
shardy | slagle: it makes config download take ~12 seconds vs over a minute though | 16:39 |
alee | sshnaidm|rover, yup | 16:39 |
jtomasek | jpich: sounds good | 16:39 |
*** nmathew- has joined #tripleo | 16:39 | |
slagle | shardy: i'll take a look | 16:39 |
*** abregman|mtg has quit IRC | 16:40 | |
*** gbarros has quit IRC | 16:40 | |
*** nmathew has joined #tripleo | 16:41 | |
openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 16:41 |
*** shreshtha has joined #tripleo | 16:44 | |
*** nmathew- has quit IRC | 16:44 | |
*** nmathew- has joined #tripleo | 16:44 | |
*** nmathew- has quit IRC | 16:45 | |
openstackgerrit | Martin Mágr proposed openstack/puppet-tripleo master: Enable collectd to send metrics to Gnocchi https://review.openstack.org/526067 | 16:46 |
*** nmathew has quit IRC | 16:48 | |
*** jangutter has quit IRC | 16:48 | |
*** nyechiel has joined #tripleo | 16:50 | |
dtantsur | folks, am I using this syntax incorrectly? https://review.openstack.org/#/c/526078/1/puppet/services/ironic-base.yaml | 16:52 |
*** pdeore has quit IRC | 16:53 | |
*** hamzy has joined #tripleo | 16:53 | |
*** fragatina has quit IRC | 16:55 | |
dtantsur | "if" ends up in the final hieradata: http://logs.openstack.org/78/526078/1/check/tripleo-ci-centos-7-undercloud-containers/c41d84d/logs/undercloud/etc/puppet/hieradata/service_configs.json.txt.gz | 16:56 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data https://review.openstack.org/508567 | 16:59 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow https://review.openstack.org/509419 | 16:59 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow https://review.openstack.org/513463 | 16:59 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Adds Workflow to List Available Roles https://review.openstack.org/509832 | 16:59 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Adds UpdateRoles Workflow https://review.openstack.org/515045 | 16:59 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs https://review.openstack.org/525743 | 16:59 |
thrash | sorry... | 17:00 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data https://review.openstack.org/508567 | 17:00 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow https://review.openstack.org/509419 | 17:00 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow https://review.openstack.org/513463 | 17:00 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Adds Workflow to List Available Roles https://review.openstack.org/509832 | 17:00 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Adds UpdateRoles Workflow https://review.openstack.org/515045 | 17:00 |
thrash | when you forget a Depends-On in the first patch in a series... :( | 17:00 |
*** mrch has quit IRC | 17:00 | |
*** dprince has quit IRC | 17:01 | |
*** athomas has quit IRC | 17:04 | |
*** trown is now known as trown|lunch | 17:04 | |
jtomasek | thrash: :) Adds Workflow to List Available Roles is to get consistent with networks and replace the current action? | 17:07 |
thrash | jtomasek: yes. :D | 17:07 |
*** itlinux has joined #tripleo | 17:08 | |
*** hamzy has quit IRC | 17:08 | |
jtomasek | thrash: I'll check those out tomorrow | 17:09 |
thrash | jtomasek: see comment on https://review.openstack.org/#/c/520634/2 | 17:09 |
*** hamzy has joined #tripleo | 17:09 | |
jtomasek | thrash: I think I confused list roles and list available roles -> 2 different things | 17:09 |
*** hjensas has joined #tripleo | 17:09 | |
*** hjensas has quit IRC | 17:09 | |
*** hjensas has joined #tripleo | 17:09 | |
thrash | jtomasek: perhaps | 17:09 |
*** cylopez has joined #tripleo | 17:10 | |
*** ooolpbot has joined #tripleo | 17:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736383 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 17:10 |
*** ooolpbot has quit IRC | 17:10 | |
openstack | Launchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] | 17:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 17:10 |
*** iranzo has quit IRC | 17:11 | |
*** hamzy has quit IRC | 17:12 | |
*** hamzy has joined #tripleo | 17:12 | |
*** fragatina has joined #tripleo | 17:14 | |
*** lucasagomes is now known as lucas-afk | 17:15 | |
*** thrash is now known as thrash|biab | 17:16 | |
EmilienM | slagle: http://logs.openstack.org/91/525291/2/check/tripleo-ci-centos-7-containers-multinode/0c1b6d5/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-12-06_15_26_29 | 17:18 |
EmilienM | it worked \o/ | 17:18 |
Tengu | hello! | 17:18 |
slagle | EmilienM: i always knew you could sling yaml like a pro | 17:19 |
*** nyechiel has quit IRC | 17:19 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-heat-templates master: [WIP] Add networks directory https://review.openstack.org/520634 | 17:19 |
jtomasek | thrash|biab: ^ | 17:19 |
Tengu | small question: I'm trying to add a unit test in puppet-tripleo, but it apparently fails. When I test on my laptop, it fails as well, and apparently it's due to the syntax in hiera. | 17:20 |
Tengu | the unit test is here: https://review.openstack.org/#/c/525492/3/spec/defines/tripleo_haproxy_service_endpoints_spec.rb and the puppet code: https://review.openstack.org/#/c/525492/3/manifests/haproxy/service_endpoints.pp | 17:21 |
*** rfolco is now known as rfolco_brb | 17:21 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Remove jq package install https://review.openstack.org/525781 | 17:21 |
Tengu | apparently, the notation "tripleo.foo.blah" is already used in the "firewall" part of the same module, but..... apparently, there isn't any unit test on that one as well. So I'm a bit stuck. | 17:21 |
EmilienM | slagle: ^ rebased correctly on top of 525285 to have the playbook | 17:21 |
slagle | EmilienM: thanks, yea i noticed you can't have a depends-on for a patch from the same repo | 17:22 |
*** jtomasek has quit IRC | 17:22 | |
slagle | which is why the ci had failed | 17:22 |
*** holser has quit IRC | 17:23 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 17:26 |
*** yprokule has quit IRC | 17:26 | |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Implement Upgrade workflow via the tripleo cli https://review.openstack.org/463728 | 17:28 |
*** florianf has quit IRC | 17:29 | |
*** aufi has quit IRC | 17:30 | |
*** dhill_ has quit IRC | 17:30 | |
*** hamzy has quit IRC | 17:32 | |
*** dtantsur is now known as dtantsur|afk | 17:33 | |
tbarron | naive (likely dumb) question: are THT unit tests supposed to work when run locally? | 17:33 |
*** paramite has quit IRC | 17:34 | |
tbarron | I get errors due to missing 'output_path' positional argument: https://paste.fedoraproject.org/paste/skEBkRzsGZ436Iqsc5dEjg | 17:34 |
tbarron | that's with no changes on master | 17:34 |
tbarron | probably some set-up-your-env doc tells me what I'm missing but I'm not seeing the doc | 17:36 |
*** bogdando has quit IRC | 17:36 | |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: DO NOT MERGE - test https://review.openstack.org/526131 | 17:37 |
openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: DO NOT MERGE: test ovb-ha with config-download https://review.openstack.org/525331 | 17:37 |
EmilienM | weshay: I haven't followed everything but are you aware about any progress on OVB jobs timeouts? | 17:38 |
weshay | EmilienM, I'm looking at it now, but first thought has already been done.. where I was going to turn off tripleo-validations | 17:39 |
weshay | EmilienM, I confirmed w/ trown|lunch and sshnaidm|rover re your concern about the modify-image | 17:40 |
weshay | being called multiple times.. it's just a utility role | 17:40 |
weshay | called several times for the right reasons | 17:40 |
weshay | still looking at options | 17:40 |
*** ramishra has quit IRC | 17:40 | |
*** ffiore has quit IRC | 17:41 | |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add docker-registry service https://review.openstack.org/526132 | 17:41 |
EmilienM | weshay: ovb-ha doesn't run validations. | 17:42 |
weshay | ya | 17:42 |
weshay | correct | 17:42 |
*** jpich has quit IRC | 17:43 | |
weshay | it did at one point | 17:43 |
EmilienM | I'm wondering if it's just time to switch off rh1 and only have RDO CI jobs (just on master) | 17:43 |
EmilienM | RDO CI jobs would just run ovb-ha and ovb-ha-ipv6, like we want rh1 to do now (with check-tripleo) | 17:44 |
EmilienM | does it make sense? | 17:44 |
*** ffiore has joined #tripleo | 17:45 | |
openstackgerrit | Matt Young proposed openstack/tripleo-quickstart master: remove tempest plugin install from convert image https://review.openstack.org/525659 | 17:46 |
EmilienM | weshay: the RDO CI jobs run much faster | 17:47 |
weshay | yes | 17:47 |
weshay | EmilienM, /me looks at your fs024 review | 17:47 |
weshay | reducing load will help | 17:47 |
*** salmankhan has quit IRC | 17:47 | |
*** mcornea has quit IRC | 17:48 | |
*** ffiore has quit IRC | 17:48 | |
EmilienM | weshay: in a call, brb | 17:48 |
*** salmankhan has joined #tripleo | 17:49 | |
weshay | EmilienM, /me wonders if a good first step would be to simply nuke fs024 and push through the review vs. https://review.openstack.org/#/c/525747/2/zuul.d/layout.yaml | 17:51 |
*** rfolco_brb is now known as rfolco | 17:52 | |
*** dsariel has joined #tripleo | 17:54 | |
*** shardy has quit IRC | 17:54 | |
EmilienM | weshay: let me finish the thing I'm doing and we can chat | 17:58 |
*** rhallisey has quit IRC | 18:01 | |
*** derekh has quit IRC | 18:01 | |
*** rhallisey has joined #tripleo | 18:02 | |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add DockerRegistryMirror parameter https://review.openstack.org/525764 | 18:03 |
*** haint has quit IRC | 18:04 | |
*** moshele has joined #tripleo | 18:04 | |
*** tesseract has quit IRC | 18:07 | |
*** tosky has quit IRC | 18:09 | |
*** mcornea has joined #tripleo | 18:09 | |
*** radeks has quit IRC | 18:10 | |
*** ooolpbot has joined #tripleo | 18:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736383 | 18:10 |
openstack | Launchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 18:10 |
*** ooolpbot has quit IRC | 18:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 18:10 |
*** shreshtha has quit IRC | 18:11 | |
*** nguyentrihai has joined #tripleo | 18:14 | |
*** s_b_34343 has quit IRC | 18:14 | |
chandankumar | weshay: EmilienM free free to add thoughts to the tempestconf work etherpad https://etherpad.openstack.org/p/tempestconfigtool_refactoring | 18:15 |
chandankumar | in future we are going to get rid of tempest deployer input conf file | 18:15 |
*** BryanS68 has quit IRC | 18:15 | |
*** thrash|biab is now known as thrash | 18:16 | |
*** BryanS68 has joined #tripleo | 18:16 | |
*** dhill_ has joined #tripleo | 18:16 | |
*** salmankhan has quit IRC | 18:17 | |
*** dhill_ has quit IRC | 18:22 | |
*** dhill_ has joined #tripleo | 18:23 | |
*** dhill_ is now known as dhill|food | 18:26 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: dump out all the variables used https://review.openstack.org/526138 | 18:27 |
*** radeks has joined #tripleo | 18:28 | |
*** trown|lunch is now known as trown | 18:32 | |
*** gkadam has joined #tripleo | 18:32 | |
*** dprince has joined #tripleo | 18:36 | |
*** gbarros has joined #tripleo | 18:38 | |
*** radeks has quit IRC | 18:40 | |
*** hamzy has joined #tripleo | 18:45 | |
*** moshele has quit IRC | 18:45 | |
*** hamzy has quit IRC | 18:46 | |
*** hamzy has joined #tripleo | 18:46 | |
*** hjensas has quit IRC | 18:47 | |
*** nyechiel has joined #tripleo | 18:49 | |
*** mcornea has quit IRC | 18:54 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs https://review.openstack.org/525743 | 18:54 |
*** hjensas has joined #tripleo | 18:56 | |
*** cylopez has quit IRC | 18:58 | |
openstackgerrit | Dan Prince proposed openstack/python-tripleoclient master: Configure undercloud docker registry/mirror https://review.openstack.org/526147 | 19:02 |
*** sshnaidm|rover is now known as sshnaidm|afk | 19:02 | |
*** oidgar has quit IRC | 19:04 | |
*** gbarros has quit IRC | 19:05 | |
*** nyechiel has quit IRC | 19:06 | |
Slower | EmilienM: so dan says he wrote those parameters and we can just add them to tripleo-common | 19:09 |
EmilienM | Slower: in tripleoclient you mean? | 19:09 |
Slower | EmilienM: dan says we should use 'danny' instead of 'janky' now.. :) | 19:09 |
EmilienM | and generate them beside NovaPassword, etc? | 19:09 |
Slower | EmilienM: in tripleo-common constants | 19:10 |
openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Add parameters for Barbican keystone listener https://review.openstack.org/525741 | 19:10 |
openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Add parameters for Barbican worker image https://review.openstack.org/525742 | 19:10 |
EmilienM | yeah ok | 19:10 |
EmilienM | Slower: I'll do it | 19:10 |
*** ooolpbot has joined #tripleo | 19:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736383 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 19:10 |
*** ooolpbot has quit IRC | 19:10 | |
openstack | Launchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] | 19:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 19:10 |
EmilienM | thanks danny | 19:10 |
Slower | good thing I didn't say dprince so as to alert dan.. | 19:10 |
*** hjensas has quit IRC | 19:13 | |
*** leitan has joined #tripleo | 19:14 | |
trozet | does anyone know what step certmonger runs to generate certificates/keys for each service? | 19:16 |
*** pkovar has quit IRC | 19:19 | |
EmilienM | Slower, dprince : please review this bug report and comment if I said something wrong https://bugs.launchpad.net/tripleo/+bug/1736779 | 19:20 |
openstack | Launchpad bug 1736779 in tripleo "undercloud-container: deployment isn't idempotent because of passwords" [High,Triaged] | 19:20 |
alee | EmilienM, I think I have glance image signing working -- https://review.openstack.org/524064 -- trying to see where in the logs it shows that the image signing test has run .. | 19:21 |
EmilienM | alee: http://logs.openstack.org/64/524064/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/c30a3af/logs/tempest.html.gz | 19:21 |
EmilienM | I don't see it | 19:21 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow https://review.openstack.org/513463 | 19:23 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Adds Workflow to List Available Roles https://review.openstack.org/509832 | 19:23 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Adds UpdateRoles Workflow https://review.openstack.org/515045 | 19:23 |
*** rhallisey has quit IRC | 19:24 | |
*** rhallisey has joined #tripleo | 19:25 | |
openstackgerrit | Dan Prince proposed openstack/python-tripleoclient master: Configure undercloud docker registry/mirror https://review.openstack.org/526147 | 19:28 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Manage MysqlRootPassword in constants https://review.openstack.org/526151 | 19:28 |
*** gbarros has joined #tripleo | 19:30 | |
openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: constants: remove SERVICE_LIST (unused) https://review.openstack.org/526152 | 19:31 |
alee | EmilienM, interesting - am I setting the test to run in the wrong place? | 19:31 |
EmilienM | alee: it should be the right place | 19:31 |
EmilienM | alee: I'll dig a bit into it in a bit | 19:31 |
EmilienM | Slower: can you put https://bugs.launchpad.net/tripleo/+bug/1736779 in the TODO when you write your code? thanks | 19:32 |
openstack | Launchpad bug 1736779 in tripleo "undercloud-container: deployment isn't idempotent because of passwords" [High,Triaged] | 19:32 |
EmilienM | alee: I'm wondering if the plugin is well deployed etc | 19:32 |
EmilienM | alee: I would ask help from chandankumar / arxcruz, our tempest gurus | 19:33 |
alee | EmilienM, thanks - whats interesting is that I see that the telemetry test is run even though it is commented out | 19:33 |
alee | chandankumar, arxcruz ^^ | 19:33 |
weshay | alee, where? | 19:35 |
*** moshele has joined #tripleo | 19:35 | |
alee | weshay, https://review.openstack.org/524064 | 19:35 |
weshay | https://review.openstack.org/#/c/524064/ | 19:35 |
alee | weshay, here is the report -- http://logs.openstack.org/64/524064/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/c30a3af/logs/tempest.html.gz | 19:36 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Remove MysqlRootPassword from overcloud.yaml https://review.openstack.org/526155 | 19:36 |
EmilienM | Slower: see https://review.openstack.org/#/q/topic:bug/1736779 - I'm not sure upgrades will work though, I'll ask for some help | 19:36 |
EmilienM | alee: have you check tempest logs? | 19:37 |
openstackgerrit | Ian Main proposed openstack/tripleo-common master: Generate MysqlRootPassword and RabbitCookie https://review.openstack.org/526156 | 19:37 |
EmilienM | http://logs.openstack.org/64/524064/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/c30a3af/logs/undercloud/home/zuul/tempest_output.log.txt.gz#_2017-12-06_18_37_23 | 19:37 |
EmilienM | alee: see http://logs.openstack.org/64/524064/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/c30a3af/logs/undercloud/home/zuul/tempest_output.log.txt.gz#_2017-12-06_18_37_27 | 19:38 |
EmilienM | the plugin is loaded | 19:39 |
EmilienM | 2017-12-06 18:37:23 | barbican_tempest_plugin.tests.scenario.test_volume_encryption.VolumeEncryptionTest.test_encrypted_cinder_volumes_cryptsetup[compute,id-cbc752ed-b716-4727-910f-956ccf965723,image,volume] | 19:39 |
EmilienM | the test is found but not executed, ignored | 19:39 |
EmilienM | it's a whitelist issue | 19:39 |
EmilienM | oh, see http://logs.openstack.org/64/524064/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/c30a3af/logs/undercloud/home/zuul/tempest/etc/tempest.conf.txt.gz | 19:39 |
EmilienM | barbican isn't enabled | 19:39 |
EmilienM | that's probably why | 19:39 |
*** lblanchard has joined #tripleo | 19:39 | |
Slower | EmilienM: doh, I just did the same fix :) | 19:39 |
Slower | EmilienM: where's RabbitCookie in the first patch? | 19:39 |
Slower | EmilienM: also I don't think we need to touch tripleo-heat-templates | 19:40 |
Slower | EmilienM: we may be making updates harder? | 19:40 |
EmilienM | Slower: ah, sorry I thought I said I would do the work | 19:40 |
EmilienM | Slower: please abandon yours, mine updates tests as well and I'm just doing mysql now | 19:40 |
EmilienM | Slower: I'll take care of it, do your workaround for now it's fine | 19:40 |
Slower | EmilienM: ok | 19:40 |
EmilienM | Slower: if we don't, I'm afraid there is a parameter collision | 19:41 |
EmilienM | Slower: we need to stop using the Randomstring thing in THT | 19:41 |
Slower | EmilienM: mmm, I could use your patch directly if you added teh rabbitcookie.. | 19:42 |
Slower | because.. COOKIES!! mmmm | 19:42 |
EmilienM | Slower: there is more than rabbit | 19:42 |
EmilienM | lol | 19:42 |
EmilienM | Slower: rabbit is fine, you can regenerate a cookie, there is no HA | 19:42 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add support for Octavia service-to-service credentials https://review.openstack.org/526062 | 19:42 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters https://review.openstack.org/526090 | 19:42 |
EmilienM | Slower: on the undercloud | 19:42 |
Slower | EmilienM: well there may be soon | 19:42 |
EmilienM | Slower: so for now, mysql is only required | 19:42 |
Slower | that's next on the list :) | 19:43 |
Slower | for tls support | 19:43 |
EmilienM | Slower: I just want to see if this password transition can work | 19:43 |
EmilienM | Slower: if that work I'll do rabbit | 19:43 |
EmilienM | Slower: also for rabbit, there are some password constraint | 19:43 |
EmilienM | it's a cookie, not a password, there is a format etc | 19:43 |
Slower | yeah | 19:44 |
Slower | that's not too hard really tho | 19:44 |
EmilienM | (lenght is 20) | 19:44 |
EmilienM | indeed, easy | 19:44 |
alee | EmilienM, cool - where do I set that? | 19:44 |
dprince | EmilienM: I think removing the Mysql heat randomstring resource could break upgrades? | 19:44 |
EmilienM | alee: probably in python-tempestconf | 19:45 |
EmilienM | dprince: yeah that's what I said | 19:45 |
EmilienM | dprince: but I don't know if we have the choice | 19:45 |
dprince | EmilienM: it needs to be exactly the same string. otherwise resouces would get bounced | 19:45 |
EmilienM | dprince: the other alternative is to create a new parameter | 19:45 |
dprince | EmilienM: I left it in a long time ago for this reason. The choice is leave it along | 19:45 |
dprince | EmilienM: another parameter? There is already a way to override | 19:45 |
EmilienM | dprince: but if we don't patch THT, we'll have 2 same parameters, right? | 19:46 |
EmilienM | oh ok I see now | 19:46 |
dprince | EmilienM: there have been 2 parameters for some time. | 19:46 |
EmilienM | so you mean we can abandon my patch in THT and just override in constants | 19:46 |
EmilienM | in tripleo-common | 19:46 |
EmilienM | ? | 19:46 |
dprince | EmilienM: one is automatically generated, and the second is to allow the end user to set it | 19:46 |
dprince | EmilienM: Ian's patch to tripleo-common should be all we need I think | 19:46 |
dprince | EmilienM: or your patch. either way | 19:47 |
EmilienM | dprince: yah, I have the same patch | 19:47 |
EmilienM | yeah | 19:47 |
EmilienM | ok | 19:47 |
EmilienM | gotcha, i'll abandon the THT | 19:47 |
EmilienM | done | 19:47 |
EmilienM | in that case, let me do them all in one shot | 19:47 |
EmilienM | Slower: ^ | 19:47 |
EmilienM | alee: I'll look at your bug in a few but please take a look at tempestconf tool | 19:48 |
EmilienM | it's somewhere in there | 19:48 |
alee | EmilienM, thanks. I'll looking at that repo now -- looking to see where its invoked | 19:48 |
dprince | EmilienM: one big blocker for the containerized Undercloud is the lack of the docker-registry | 19:50 |
mwhahaha | dtantsur|afk: fyi i created the rocky milestones | 19:50 |
dprince | EmilienM: https://review.openstack.org/#/c/526147/ and aslo that has 3 depends-on patches too :/ | 19:50 |
dprince | EmilienM: I'm hitting an issue locally... but getting close | 19:50 |
alee | weshay, do you know where its invoked? | 19:50 |
EmilienM | dprince: I'll help in review. Let me know if there is anything more I can help with. | 19:50 |
*** rwsu has quit IRC | 19:51 | |
dprince | EmilienM mwhahaha: actually both of your take on this matter would be helpful https://review.openstack.org/#/c/525761/ | 19:51 |
dprince | we've done some very sloppy puppet work around docker stuff in the past | 19:52 |
dprince | I could just create a new docker_registry_new.pp. But other than that I don't think there is a good way to deprecate what I need to remove there | 19:52 |
mwhahaha | i thought with puppet-tripleo we didn't really have to deprecate it | 19:52 |
mwhahaha | because it was matching with THT | 19:52 |
Slower | EmilienM: ok cool | 19:53 |
Slower | EmilienM: you're right that we should do a 20 char string for rabbitcookie | 19:53 |
EmilienM | yeah i'm doing it no worries | 19:53 |
dprince | mwhahaha: I was happy to just remove it :). But did mention the lack of a good deprecation option in the commit message | 19:53 |
Slower | EmilienM: I realize my hack in python-tripleoclient won't work | 19:53 |
Slower | EmilienM: oh no it would | 19:53 |
Slower | nm :) | 19:54 |
EmilienM | Slower: -_-^? | 19:54 |
EmilienM | my face ^ | 19:54 |
mwhahaha | dprince: yea i don't know if we need a deprecation specifically because in the past we've assumed matching THT and puppet-tripleo. but that's gotten us in a bad spot | 19:54 |
Slower | haha | 19:54 |
*** Sandy619 has joined #tripleo | 19:56 | |
sshnaidm|afk | mwhahaha, how should we revisit admins for tripeo-ci-admins? If everybody agree, maybe not worth to revert this patch? | 19:58 |
dprince | mwhahaha: okay. sounds like you agree w/ me. Maybe I'll just try to talk Bogdon down from his -1 tomorrow then | 19:59 |
mwhahaha | dprince: yea unless we plan on backporting it | 19:59 |
*** leitan has quit IRC | 19:59 | |
mwhahaha | sshnaidm|afk: it's a process thing, it got bypassed so lets turn around and do it right | 19:59 |
*** leitan has joined #tripleo | 19:59 | |
mwhahaha | sshnaidm|afk: if it's not an issue with everyone, it should be no big deal to do it right | 19:59 |
*** dhill|food has quit IRC | 20:01 | |
*** dhill_ has joined #tripleo | 20:02 | |
openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Concurrent upload container images https://review.openstack.org/522055 | 20:02 |
*** leitan has quit IRC | 20:04 | |
alee | EmilienM, found it with help from weshay -- I typoed the test name | 20:04 |
alee | EmilienM, resubmitting .. | 20:04 |
EmilienM | alee: haha! | 20:07 |
EmilienM | alee: I like IPA beers btw. | 20:07 |
alee | EmilienM, absolutely - ditto for weshay :) | 20:07 |
sshnaidm|afk | mandre, why could I miss images from containers.yaml? | 20:08 |
*** ooolpbot has joined #tripleo | 20:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736383 | 20:10 |
openstack | Launchpad bug 1736383 in tripleo "tripleo container push fails for a few containers" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 20:10 |
*** ooolpbot has quit IRC | 20:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 20:10 |
*** abregman has joined #tripleo | 20:12 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Manage legacy OS::TripleO::RandomString resources in constants https://review.openstack.org/526151 | 20:12 |
EmilienM | Slower: ready for review ^ | 20:12 |
*** gkadam has quit IRC | 20:14 | |
openstackgerrit | Ade Lee proposed openstack/tripleo-quickstart master: Add image signing tests with barbican https://review.openstack.org/524064 | 20:18 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters https://review.openstack.org/526090 | 20:19 |
*** dprince has quit IRC | 20:21 | |
*** safchain has quit IRC | 20:24 | |
*** safchain has joined #tripleo | 20:26 | |
*** salmankhan has joined #tripleo | 20:29 | |
*** radeks has joined #tripleo | 20:29 | |
*** pchavva has quit IRC | 20:31 | |
*** dtantsur|afk has quit IRC | 20:31 | |
*** brault has quit IRC | 20:31 | |
*** fultonj has quit IRC | 20:31 | |
*** mhenkel has quit IRC | 20:31 | |
*** cinerama` has quit IRC | 20:31 | |
*** Lokesh_Jain__ has quit IRC | 20:31 | |
*** Tyrantelf_ has quit IRC | 20:31 | |
*** moshele has quit IRC | 20:31 | |
*** rbrady has quit IRC | 20:31 | |
*** arxcruz has quit IRC | 20:31 | |
*** salmankhan has quit IRC | 20:33 | |
*** rbowen has quit IRC | 20:37 | |
*** rbowen has joined #tripleo | 20:37 | |
*** itlinux has quit IRC | 20:40 | |
alee | tdasilva, looking through your patches/email now .. will respond shortly | 20:43 |
tdasilva | alee: thanks! | 20:43 |
openstackgerrit | Andy Smith proposed openstack/tripleo-heat-templates master: Support separate oslo.messaging services for RPC and Notification https://review.openstack.org/507963 | 20:45 |
*** pchavva has joined #tripleo | 20:47 | |
*** dtantsur|afk has joined #tripleo | 20:47 | |
*** brault has joined #tripleo | 20:47 | |
*** fultonj has joined #tripleo | 20:47 | |
*** mhenkel has joined #tripleo | 20:47 | |
*** cinerama` has joined #tripleo | 20:47 | |
*** Lokesh_Jain__ has joined #tripleo | 20:47 | |
*** Tyrantelf_ has joined #tripleo | 20:47 | |
*** moshele has joined #tripleo | 20:47 | |
*** rbrady has joined #tripleo | 20:47 | |
*** arxcruz has joined #tripleo | 20:47 | |
*** moshele has quit IRC | 20:51 | |
*** jmelvin has quit IRC | 20:52 | |
*** itlinux has joined #tripleo | 20:53 | |
*** jkilpatr has quit IRC | 20:54 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Install SSH keys of admnins on RH clouds https://review.openstack.org/526187 | 20:55 |
*** nyechiel has joined #tripleo | 20:56 | |
*** tongl has quit IRC | 20:56 | |
*** gvrangan has joined #tripleo | 20:57 | |
*** liverpooler has quit IRC | 21:02 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-upgrade master: Setup tox https://review.openstack.org/525676 | 21:02 |
alee | tdasilva, so -- just as a clarification - the root key that you are trying to store -- this is something that is not tenant specific , right? | 21:02 |
tdasilva | alee: correct | 21:02 |
alee | tdasilva, that is -- there is some initialization code in swift that reads it using the username/password of the swift user? | 21:03 |
alee | tdasilva, are there encryption keys that are generated from this root key that are tenant specific? | 21:04 |
tdasilva | alee: IIRC, from the root key, swift generates a container key and an object key | 21:05 |
*** tongl has joined #tripleo | 21:05 | |
alee | tdasilva, and these keys are stored somewhere -- or just regenerated every time? | 21:06 |
alee | (based on a container/object id) | 21:06 |
tdasilva | alee: they are generated everytime | 21:06 |
tdasilva | alee: correct | 21:06 |
tdasilva | https://docs.openstack.org/swift/latest/overview_encryption.html#key-management | 21:06 |
alee | tdasilva, ok - and in all cases, you are using castellan to get the root key? | 21:08 |
tdasilva | alee: yes, correct | 21:08 |
alee | tdasilva, ok - I'll respond to the email .. | 21:08 |
tdasilva | alee: thanks, i hope this makes sense... :) | 21:09 |
alee | tdasilva, it does definitely | 21:09 |
*** kambiz has quit IRC | 21:09 | |
*** yamahata has joined #tripleo | 21:10 | |
*** ooolpbot has joined #tripleo | 21:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 21:10 |
*** ooolpbot has quit IRC | 21:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 21:10 |
tdasilva | swift took a phased approach to enabling encryption in swift...we started with a root_key and derived objects keys from the root_key. The plan is that in the future we would have per tenant or per container keys | 21:10 |
tdasilva | or even a BYOK/per object key | 21:10 |
tdasilva | alee: ^ | 21:10 |
*** dparkes has joined #tripleo | 21:11 | |
alee | tdasilva, sure that makes sense | 21:11 |
alee | tdasilva, so that means that eventually the root key will no longer be used? | 21:12 |
*** kambiz has joined #tripleo | 21:12 | |
*** itlinux has quit IRC | 21:13 | |
tdasilva | alee: that seems like a good assumption, but honestly, i don't know, I think that's an implementation detail of how we would migrate from a root_key to tenant/container key | 21:13 |
alee | tdasilva, yeah | 21:14 |
*** nyechiel has quit IRC | 21:15 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Save oooq generated files https://review.openstack.org/517136 | 21:15 |
*** rhallisey has quit IRC | 21:15 | |
tbarron | dsneddon: need some advice on how to make progress on StorageNFS network when you have a chance (I'm picking up this work from jprovazn) | 21:15 |
tdasilva | alee: honestly, i think the real challenge is how we would go about re-keying possibly billions/trillions of objects | 21:15 |
alee | tdasilva, you might be able to do it in a background job or on demand perhaps | 21:16 |
alee | tdasilva, but I understand that swift is sensitive to performance impacts | 21:17 |
tdasilva | alee: yeah, i imagine it would have to be as a background job directly on storage nodes in a distributed as possible way :) | 21:17 |
tdasilva | alee: but i'm just guessing at this point | 21:18 |
dsneddon | tbarron, Sure, how can I help? | 21:18 |
alee | tdasilva, yup | 21:18 |
tbarron | dsneddon: thanks | 21:18 |
tbarron | dsneddon: Our remaining ceph-nfs patches depend on https://review.openstack.org/#/c/512239 | 21:18 |
tbarron | dsneddon: Starting at PS4 with that review overclod deploy fails with: Unknown Property StorageNFSIpSubnet | 21:18 |
tbarron | dsneddon: Backing off to PS3, the overcloud deploy succeeds, but presumably there were good reasons we | 21:18 |
tbarron | dsneddon: didn't just merge PS3. | 21:18 |
tbarron | dsneddon: Would appreciate your help figuring how to make progress. | 21:18 |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Render NIC config templates with jinja2 https://review.openstack.org/523638 | 21:18 |
tbarron | dsneddon: you can advise in the review rather than real-time atm if you prefer | 21:19 |
dsneddon | tbarron, I think you need this patch: https://review.openstack.org/523638 | 21:19 |
dsneddon | tbarron, I'm going to wrap that up within the hour, and you can try adding a depends-on | 21:19 |
tbarron | dsneddon: awesome, that sounds like a plan! | 21:20 |
*** dparkes has quit IRC | 21:20 | |
*** hjensas has joined #tripleo | 21:21 | |
*** hjensas has quit IRC | 21:21 | |
*** hjensas has joined #tripleo | 21:21 | |
* tbarron enjoys getting a 3000+ line depends-on unexpectedly | 21:21 | |
mwhahaha | depends-on: teh world | 21:21 |
tbarron | mwhahaha: well, it's kinda M2 still :D | 21:22 |
mwhahaha | :D | 21:22 |
mwhahaha | i figured the m2 window is probably going to bleed into next week | 21:22 |
*** radeks has quit IRC | 21:26 | |
*** itlinux has joined #tripleo | 21:26 | |
*** yamahata has quit IRC | 21:27 | |
*** pchavva has quit IRC | 21:30 | |
*** raildo has quit IRC | 21:31 | |
slagle | EmilienM: doing some testing with vanilla centos cloud images. looking pretty good when using the tripleo-bootstrap role :) | 21:33 |
*** ansmith has quit IRC | 21:35 | |
*** holser has joined #tripleo | 21:38 | |
*** lblanchard has quit IRC | 21:38 | |
*** openstackgerrit has quit IRC | 21:38 | |
*** sai has quit IRC | 21:38 | |
*** sshnaidm|afk has quit IRC | 21:38 | |
*** sri_ has quit IRC | 21:38 | |
*** lyarwood has quit IRC | 21:38 | |
*** mburned has quit IRC | 21:38 | |
*** timothyb89 has quit IRC | 21:38 | |
*** mandre has quit IRC | 21:38 | |
*** lifeless has quit IRC | 21:38 | |
*** leifmadsen has quit IRC | 21:38 | |
*** afazekas has quit IRC | 21:38 | |
*** sc has quit IRC | 21:38 | |
beagles | EmilienM, mwhahaha: https://review.openstack.org/#/c/526062/ and https://review.openstack.org/#/c/526060/ seem to be doing their job in testing | 21:39 |
beagles | as is https://review.openstack.org/#/c/526087/ | 21:39 |
mwhahaha | ok i'll take a look | 21:39 |
*** iranzo|AFK is now known as iranzo | 21:40 | |
*** iranzo has quit IRC | 21:41 | |
*** liverpooler has joined #tripleo | 21:44 | |
EmilienM | beagles: ack | 21:44 |
mwhahaha | beagles: is it supposed to be the admin project? | 21:44 |
mwhahaha | beagles: i thought we put all of our users in the service project | 21:44 |
*** hjensas has quit IRC | 21:45 | |
EmilienM | mwhahaha: I'm wondering if we should increase the timeout value for ovb jobs (now we have control on it with zuul v3) | 21:47 |
EmilienM | put it to 3h maybe | 21:47 |
mwhahaha | EmilienM: sneaky | 21:47 |
EmilienM | wait it's 3h already | 21:48 |
EmilienM | damn | 21:48 |
mwhahaha | no i thought it was 2:30 | 21:48 |
EmilienM | 10800 seconds | 21:48 |
mwhahaha | the task itself is 3hours | 21:48 |
*** jmelvin has joined #tripleo | 21:48 | |
mwhahaha | ah | 21:48 |
EmilienM | I think the timeout comes from the promotion | 21:48 |
mwhahaha | but in our code we limit it i thought | 21:48 |
EmilienM | we haven't changed anything except running tempest | 21:49 |
EmilienM | but I checked it doesn't change much | 21:49 |
beagles | mwhahaha, we do, but this has something to do with service-to-service comms | 21:49 |
mwhahaha | beagles: commented on https://review.openstack.org/#/c/526062/ because i'm not sure if that's the right auth info | 21:49 |
EmilienM | ah in our code, right | 21:49 |
mwhahaha | beagles: shouldn't service-to-service use the service user 'octavia'? | 21:49 |
beagles | mwhahaha, that's cool. I'll bring it up with nmagnezi in the mornig | 21:49 |
mwhahaha | EmilienM: we do that because collect-logging is not a seperate playbook | 21:50 |
mwhahaha | EmilienM: which it could be if we could stop using devstack stuff | 21:50 |
EmilienM | yeah | 21:51 |
EmilienM | if we would run collect-logs role outside of "run" but in "post" | 21:52 |
EmilienM | thing that Sagi and I were working ont | 21:52 |
EmilienM | this: https://review.openstack.org/#/c/522554/ | 21:53 |
mwhahaha | yea that thing | 21:55 |
beagles | mwhahaha, the devstack plugin (just sets to admin and is questionable reference anyways) and documentation is of little guidance so seeking confirmation in #openstack-lbaas | 21:56 |
mwhahaha | beagles: yea it's likely that doesn't match what tripleo uses as we setup accounts for each service with different creds | 21:57 |
mwhahaha | beagles: so most likely this needs to match the octavia service creds which we create via octavia::keystone::auth | 21:57 |
*** gfidente has quit IRC | 21:57 | |
*** itlinux has quit IRC | 21:59 | |
*** leitan has joined #tripleo | 22:00 | |
beagles | mwhahaha, k will update | 22:01 |
*** openstackgerrit has joined #tripleo | 22:01 | |
*** sai has joined #tripleo | 22:01 | |
*** sshnaidm|afk has joined #tripleo | 22:01 | |
*** sri_ has joined #tripleo | 22:01 | |
*** lyarwood has joined #tripleo | 22:01 | |
*** mburned has joined #tripleo | 22:01 | |
*** timothyb89 has joined #tripleo | 22:01 | |
*** mandre has joined #tripleo | 22:01 | |
*** lifeless has joined #tripleo | 22:01 | |
*** leifmadsen has joined #tripleo | 22:01 | |
*** afazekas has joined #tripleo | 22:01 | |
*** sc has joined #tripleo | 22:01 | |
*** rcernin has joined #tripleo | 22:01 | |
beagles | mwhahaha, got some agreement from the lbaas crowd as well, if the octavia creds don't work then we probably need to have done something different with that user | 22:02 |
mwhahaha | beagles: i mean you could in theory create a seperate user and use that too so it's more about what exactly this is for :) in the past we traditionally use the service accounts for these types of setup | 22:03 |
beagles | mwhahaha, it's for talking to neutron and nova | 22:03 |
beagles | IIUC | 22:03 |
openstackgerrit | Michael Turek proposed openstack/diskimage-builder master: Remove architecture rules on lshw dependency in ironic-agent https://review.openstack.org/526212 | 22:03 |
*** rcernin has quit IRC | 22:03 | |
*** rcernin has joined #tripleo | 22:03 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: add dry-run or list-tasks to quickstart.sh https://review.openstack.org/526208 | 22:03 |
mwhahaha | right so the octavia user should work | 22:03 |
beagles | ack | 22:04 |
mwhahaha | kinda like for keystone auth for all the services | 22:04 |
*** leitan has quit IRC | 22:05 | |
*** gvrangan has quit IRC | 22:06 | |
dsneddon | tbarron, You should be able to add the depends-on now. Fingers crossed. | 22:07 |
dsneddon | tbarron, One thing to note is that this change will be breaking in the sense that if someone upgrades and uses old NIC config templates, they will either need to add the StorageNFSIpSubnet, or remove the StorageNFS network from the network_data.yaml | 22:08 |
dsneddon | tbarron, So I wonder if you will have a cascading effect where CI starts failing as the patch moves downstream, and CI environments need to be modified? | 22:09 |
tbarron | dsneddon: thanks. | 22:09 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add support for Octavia service-to-service credentials https://review.openstack.org/526062 | 22:10 |
*** ooolpbot has joined #tripleo | 22:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 22:10 |
*** ooolpbot has quit IRC | 22:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 22:10 |
*** moshele has joined #tripleo | 22:10 | |
tbarron | dsneddon: are you saying this would affect only folks who have already deloyed StorageNFS net by one means or another, or also people running traditional isolated networks w/o any StorageNFS network defined? | 22:10 |
tbarron | dsneddon: If the former, I'm not concerned since we don't have that in production. | 22:10 |
tbarron | dsneddon: some devs will need to adjust, that's all. | 22:11 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters https://review.openstack.org/526090 | 22:11 |
dsneddon | tbarron, Actually, since the network is disabled by default, I think it'll be fine. | 22:12 |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: WIP -- Add major update implementation https://review.openstack.org/526213 | 22:12 |
tbarron | dsneddon: ack | 22:12 |
*** shadower has quit IRC | 22:12 | |
openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates master: Add a StorageNFS network for use by Manila/Ganesha https://review.openstack.org/512239 | 22:13 |
*** shadower has joined #tripleo | 22:13 | |
openstackgerrit | mathieu bultel proposed openstack/tripleo-common master: WIP -- Add extra environment files for the update https://review.openstack.org/526214 | 22:13 |
openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates master: Add support for ceph-nfs manila backend https://review.openstack.org/471245 | 22:14 |
openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates master: Pass storage nfs VIP to ceph-ansible https://review.openstack.org/512240 | 22:14 |
dsneddon | tbarron, It does make me realize that I'm going to have to change my patch to check whether the network is enabled, however. | 22:17 |
*** jlabarre has quit IRC | 22:19 | |
*** tosky has joined #tripleo | 22:19 | |
tbarron | dsneddon: ack | 22:20 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Update the Docker registry defaults to rdoproject https://review.openstack.org/520201 | 22:20 |
openstackgerrit | Merged openstack/tripleo-common master: Introduce tripleo-bootstrap Ansible role https://review.openstack.org/525285 | 22:20 |
openstackgerrit | Merged openstack/tripleo-common master: Implement post-upload cleanup of docker images https://review.openstack.org/519201 | 22:20 |
*** jkilpatr has joined #tripleo | 22:20 | |
*** dparkes has joined #tripleo | 22:20 | |
tbarron | dsneddon: is StorageNFS net the first post-child composable network? | 22:20 |
dsneddon | tbarron, Yes | 22:21 |
*** vpickard is now known as vpickard_ | 22:21 | |
dsneddon | tbarron, Sorry for making you the guinea pig | 22:21 |
tbarron | dsneddon: well, we'll embrace the opportunity then | 22:22 |
*** abishop has quit IRC | 22:24 | |
mwhahaha | s/opportunity/pain and suffering | 22:24 |
*** BryanS68 has quit IRC | 22:24 | |
tbarron | mwhahaha: well, the first love is the hardest | 22:26 |
mwhahaha | :D | 22:26 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-upgrade master: Update .gitreview. https://review.openstack.org/524142 | 22:28 |
*** holser has quit IRC | 22:28 | |
*** ebarrera has joined #tripleo | 22:28 | |
mwhahaha | speaking of entertainment | 22:29 |
tbarron | what seemed like a straightforward feature has ended up depending on a) ceph ansible (with patches still not in 3.0, b) ceph luminous, c) ganesha stuff still in master, and d) composable networks. It was allegedly a Storage feature. | 22:29 |
tbarron | ? | 22:29 |
mwhahaha | i'm enjoying the integrated ci queue is 12 hours behind | 22:29 |
mwhahaha | nothing is straight forward these days | 22:29 |
openstackgerrit | mathieu bultel proposed openstack/tripleo-common master: WIP -- Add extra environment files for the update https://review.openstack.org/526214 | 22:30 |
mwhahaha | slagle: looks like we got a failure in the gate around the config-download bits http://logs.openstack.org/91/525291/2/gate/tripleo-ci-centos-7-containers-multinode/7507f49/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-12-06_21_37_12 | 22:31 |
*** zshi has quit IRC | 22:31 | |
mwhahaha | EmilienM: -^ | 22:31 |
*** ansmith has joined #tripleo | 22:31 | |
mwhahaha | also scenario004 looks unhappy in the gate myoung|ruck, weshay | 22:32 |
* mwhahaha is looking for logs | 22:32 | |
* weshay looks | 22:32 | |
weshay | thanks | 22:32 |
mwhahaha | got two fails http://logs.openstack.org/55/523155/3/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/3fc4e8f/ and http://logs.openstack.org/57/525657/4/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/0e0b220/ | 22:33 |
* myoung|ruck is also looking | 22:33 | |
mwhahaha | github.com resolution failure | 22:34 |
mwhahaha | http://logs.openstack.org/57/525657/4/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/0e0b220/job-output.txt.gz#_2017-12-06_22_15_48_636186 | 22:34 |
mwhahaha | dmsimard: -^ | 22:34 |
dmsimard | mwhahaha: looking | 22:34 |
mwhahaha | and vxlan setup failure http://logs.openstack.org/55/523155/3/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/3fc4e8f/job-output.txt.gz#_2017-12-06_19_58_46_553324 | 22:34 |
mwhahaha | dmsimard, pabelanger -^ | 22:35 |
dmsimard | no clue what's that vxlan thing though | 22:35 |
dmsimard | hm, github's not in the cache http://logs.openstack.org/55/523155/3/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/3fc4e8f/logs/dns_cache.txt.gz | 22:37 |
dmsimard | mwhahaha: which node is that happening on ? | 22:38 |
mwhahaha | dmsimard: primary | 22:38 |
mwhahaha | dmsimard: that's in the undercloud setup | 22:38 |
dmsimard | mwhahaha: there's something wrong because we set up the cache TTL configuration here: http://logs.openstack.org/57/525657/4/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/0e0b220/ara/result/46777a55-55d9-47e8-bb6c-441369fe0076/ | 22:40 |
dmsimard | yet there's nothing there: | 22:41 |
dmsimard | http://logs.openstack.org/55/523155/3/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/3fc4e8f/logs/subnode-2/etc/unbound/conf.d/ | 22:41 |
dmsimard | http://logs.openstack.org/57/525657/4/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/0e0b220/logs/undercloud/etc/unbound/conf.d/ | 22:41 |
dmsimard | have to step away for a bit | 22:42 |
*** Goneri has quit IRC | 22:43 | |
mwhahaha | dmsimard: ssure just fyi | 22:43 |
weshay | mwhahaha, an infra mirror had a hiccup http://logs.openstack.org/55/523155/3/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/3fc4e8f/logs/undercloud/home/zuul/vxlan_networking.sh.log.txt.gz#_2017-12-06_19_58_43 | 22:44 |
mwhahaha | interesting | 22:45 |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: WIP -- Add major update implementation https://review.openstack.org/526213 | 22:45 |
weshay | hrm.. this is a bug I started working on last week http://logs.openstack.org/57/525657/4/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/0e0b220/job-output.txt.gz#_2017-12-06_22_15_45_986170 | 22:48 |
myoung|ruck | I realize there's probably a lot of backstory here, but do we have doc'd anywhere I can RTFM how proxy / squid / ____ is set up in nodepool to hit github/other? | 22:49 |
mwhahaha | it's magic | 22:50 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add ironic-inspector to containerized undercloud https://review.openstack.org/524163 | 22:50 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: undercloud: enable ansible deploy method by default https://review.openstack.org/523094 | 22:50 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: SR-IOV agent: allow to configure agent extensions https://review.openstack.org/524956 | 22:50 |
mwhahaha | myoung|ruck: https://docs.openstack.org/infra/system-config/afs.html some history on it | 22:51 |
mwhahaha | myoung|ruck: so we've got specific mirrors setup for like rdo and such so we have to config them to be used in oooq | 22:52 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Add IPSEC composable service https://review.openstack.org/521863 | 22:53 |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Allow running toci_gate_test on pre-provisioned ovb env https://review.openstack.org/518748 | 22:53 |
openstackgerrit | Merged openstack/instack-undercloud master: Fix wrong path in ssh selinux issue detection. https://review.openstack.org/525911 | 22:53 |
openstackgerrit | Merged openstack/python-tripleoclient master: Remove default for --overcloud-ssh-key https://review.openstack.org/525779 | 22:53 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Do not send email when logs are not available https://review.openstack.org/526024 | 22:53 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add log to validate ipmi role https://review.openstack.org/492117 | 22:53 |
*** pmannidi has joined #tripleo | 22:53 | |
mwhahaha | myoung|ruck: and we do the mirror configs in the repo setup https://github.com/openstack/tripleo-quickstart/blob/143d08315868aedacb11cc905fdd2ffdd4388e2e/config/release/tripleo-ci/master.yml#L24 | 22:55 |
mwhahaha | as well as in https://github.com/openstack-infra/tripleo-ci/blob/f649369a329a282f4b6ce2abf065116964e79d99/toci_gate_test-oooq.sh#L19 | 22:55 |
weshay | myoung|ruck, can you please add this info to the ruck doc | 22:56 |
mwhahaha | in infra folks probably have more specifics on the mirror stuff if you have further questions | 22:57 |
*** ebarrera has quit IRC | 22:58 | |
*** fpan has joined #tripleo | 22:59 | |
*** ebarrera has joined #tripleo | 22:59 | |
myoung|ruck | mwhahaha: thx, reading. weshay: yerp...already on it | 22:59 |
weshay | https://review.openstack.org/#/c/498766/ | 22:59 |
weshay | https://review.openstack.org/#/c/517776/ | 22:59 |
*** akrivoka has quit IRC | 23:00 | |
*** jmelvin has quit IRC | 23:00 | |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 23:04 |
weshay | pabelanger, can we get one of the two elastic-recheck queries reviewed when you have a sec please ^ | 23:06 |
mwhahaha | first is abandoned | 23:06 |
weshay | ah it is | 23:07 |
weshay | mwhahaha, I'll pick this back up in a bit, have to take my kid to $activity | 23:07 |
mwhahaha | pesky $activity | 23:08 |
weshay | the activities are fine... pesky kids! | 23:08 |
mwhahaha | also this | 23:08 |
mwhahaha | it's cold outside, don't forget to wear a hat :D | 23:08 |
myoung|ruck | LOL | 23:08 |
weshay | :) | 23:08 |
myoung|ruck | i need to go as well. the little urchins want...i dunno...food and stuff | 23:09 |
* myoung|ruck rolls his eyes and smirks | 23:09 | |
mwhahaha | they do like being fed | 23:09 |
myoung|ruck | they've threatened to eat us if we don't toe the line and do $foodPrep | 23:09 |
mwhahaha | "i'm hungry" ... "and?" | 23:09 |
mwhahaha | sudo make me a sandwich | 23:10 |
*** ooolpbot has joined #tripleo | 23:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 23:10 |
*** ooolpbot has quit IRC | 23:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 23:10 |
openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Concurrent upload container images https://review.openstack.org/522055 | 23:13 |
openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Concurrent upload container images https://review.openstack.org/522055 | 23:14 |
*** ebarrera has quit IRC | 23:17 | |
*** ebarrera has joined #tripleo | 23:21 | |
*** Sandy619 has quit IRC | 23:25 | |
*** openstack has joined #tripleo | 23:28 | |
*** ChanServ sets mode: +o openstack | 23:28 | |
openstackgerrit | Moshe Levi proposed openstack/tripleo-heat-templates stable/pike: SR-IOV agent: allow to configure agent extensions https://review.openstack.org/526222 | 23:35 |
*** moshele has quit IRC | 23:36 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!