| *** itlinux has joined #tripleo | 00:04 | |
| *** tosky has quit IRC | 00:11 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Update consistent repo files for periodic jobs https://review.openstack.org/525016 | 00:22 |
|---|---|---|
| EmilienM | sshnaidm: update what in rdo config? I'm just curiuous | 00:25 |
| sshnaidm | EmilienM, what do you mean..? | 00:25 |
| EmilienM | sshnaidm: you said: "sshnaidm | [13:05:17] EmilienM, reviewed, I think we're good. I'll update rdo cloud config when we are merging this" | 00:25 |
| sshnaidm | EmilienM, oh, right, it's for OVB jobs on RDO cloud | 00:26 |
| EmilienM | sshnaidm: yeah, we can talk about it during the week | 00:26 |
| EmilienM | sshnaidm: for now, let's see how it works once it's merged | 00:26 |
| EmilienM | sshnaidm: then maybe we'll add the new job to promotion pipeline | 00:26 |
| sshnaidm | EmilienM, I'm talking firstly about patch jobs, not promotion ones | 00:27 |
| sshnaidm | EmilienM, we run them in parallel with RH1, so.. | 00:27 |
| EmilienM | sshnaidm: oh, I see ok yeah | 00:27 |
| EmilienM | sshnaidm: thanks! | 00:27 |
| sshnaidm | EmilienM, it's just a fs file change, nothing serious | 00:27 |
| EmilienM | sounds good | 00:27 |
| EmilienM | good night | 00:27 |
| sshnaidm | good night! | 00:27 |
| sshnaidm | arxcruz, chandankumar when you're around, take a look please: https://bugs.launchpad.net/tripleo/+bug/1736026 seems like it's just a tempest config issue, it's master promotion blocker | 00:29 |
| openstack | Launchpad bug 1736026 in tripleo "Tempest tests fail because don't find 'etc/cirros-0.3.1-x86_64-vmlinuz'" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 00:29 |
| *** sshnaidm is now known as sshnaidm|off | 00:30 | |
| sshnaidm|off | matbu, jistr please take a look in your time: https://bugs.launchpad.net/tripleo/+bug/1736040 | 00:37 |
| openstack | Launchpad bug 1736040 in tripleo "Overcloud is not operational after upgrade in containers-multinode-upgrades job" [Critical,Triaged] | 00:37 |
| *** dmacpher-afk has quit IRC | 00:43 | |
| *** ramishra has joined #tripleo | 00:51 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix yum command for TLS job https://review.openstack.org/525018 | 00:52 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-heat-templates master: DONT REVIEW: this is dependency patch https://review.openstack.org/446592 | 00:55 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-common master: DONT REVIEW: used for testing only https://review.openstack.org/447276 | 00:55 |
| openstackgerrit | Sagi Shnaidman proposed openstack/puppet-tripleo master: DONT REVIEW: test failure https://review.openstack.org/442415 | 00:55 |
| *** zaneb has quit IRC | 00:56 | |
| *** psachin has joined #tripleo | 01:00 | |
| *** dhill_ has quit IRC | 01:11 | |
| openstackgerrit | Steve Baker proposed openstack/paunch master: Explicitly pull images before docker run https://review.openstack.org/522665 | 01:13 |
| *** cshastri has joined #tripleo | 01:17 | |
| *** cshastri has quit IRC | 01:22 | |
| *** ebarrera has quit IRC | 01:24 | |
| *** yamahata has quit IRC | 01:28 | |
| *** dmacpher has joined #tripleo | 01:36 | |
| *** mburned_out is now known as mburned | 01:52 | |
| *** sai_ has joined #tripleo | 01:58 | |
| *** gbarros has quit IRC | 02:23 | |
| *** daidv has joined #tripleo | 02:28 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Move scenario001 and scenario003 back to the gate https://review.openstack.org/524760 | 02:49 |
| *** cshastri has joined #tripleo | 02:49 | |
| *** anilvenkata has joined #tripleo | 02:50 | |
| *** noslzzp has quit IRC | 03:20 | |
| *** itlinux has quit IRC | 03:32 | |
| *** psahoo has joined #tripleo | 03:52 | |
| *** ykarel has joined #tripleo | 04:02 | |
| *** links has joined #tripleo | 04:13 | |
| *** shreshtha has joined #tripleo | 04:16 | |
| *** yamahata has joined #tripleo | 04:21 | |
| *** udesale has joined #tripleo | 04:25 | |
| *** udesale has quit IRC | 04:25 | |
| *** udesale has joined #tripleo | 04:25 | |
| *** itlinux has joined #tripleo | 04:39 | |
| *** tzumainn has quit IRC | 04:51 | |
| *** skramaja has joined #tripleo | 05:04 | |
| *** janki has joined #tripleo | 05:05 | |
| *** masco has joined #tripleo | 05:16 | |
| *** jaosorior has joined #tripleo | 05:16 | |
| *** jaganathan has joined #tripleo | 05:18 | |
| *** fragatina has quit IRC | 05:21 | |
| *** fragatina has joined #tripleo | 05:21 | |
| *** itlinux has quit IRC | 05:28 | |
| *** dpawar has joined #tripleo | 05:29 | |
| *** fragatina has quit IRC | 05:30 | |
| *** dsariel has quit IRC | 05:33 | |
| *** pgadiya has joined #tripleo | 05:40 | |
| *** ratailor has joined #tripleo | 05:46 | |
| *** honza has quit IRC | 05:48 | |
| *** honza has joined #tripleo | 05:48 | |
| *** honza is now known as Guest46858 | 05:48 | |
| *** jfrancoa has joined #tripleo | 05:51 | |
| *** moshele has joined #tripleo | 05:51 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Add gitreview file https://review.openstack.org/525058 | 05:51 |
| moshele | skramaja: hi | 05:53 |
| Tengu | hello there :) | 05:53 |
| jaosorior | hello folks! | 05:54 |
| moshele | skramaja: do you know why the qos extension is not enable in SR-IOV agent? also there is no way to configure it. I did this change https://review.openstack.org/#/c/524956/ | 05:54 |
| EmilienM | jaosorior: hey, can you please review https://review.openstack.org/#/q/topic:fs035+status:open ? | 05:55 |
| EmilienM | I'm off to bed now, ttyl | 05:55 |
| EmilienM | we need https://review.openstack.org/#/c/524766/ to merge everything as well | 05:56 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Add gitreview file https://review.openstack.org/525058 | 05:56 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Fix role name in test playbook https://review.openstack.org/525059 | 05:56 |
| jaosorior | EmilienM: ack | 05:57 |
| moshele | skramaja: also this https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/neutron-ovs-agent.yaml#L51 is missleading as the agent extenstion should be configure per agent a better name will be NeutronOVSExtension | 05:57 |
| *** sai_ has quit IRC | 06:00 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Remove unused task file https://review.openstack.org/525060 | 06:00 |
| *** jtomasek has joined #tripleo | 06:08 | |
| *** abregman has quit IRC | 06:10 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Add zuul.d directory with openstack-ansible-linter jobs https://review.openstack.org/525064 | 06:12 |
| *** dpawar has quit IRC | 06:16 | |
| *** suuuper has joined #tripleo | 06:21 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: WORKAROUND: Set rolename to what legacy lint job expects https://review.openstack.org/525059 | 06:25 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Add gitreview file https://review.openstack.org/525058 | 06:25 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Remove unused task file https://review.openstack.org/525060 | 06:25 |
| *** yamahata has quit IRC | 06:31 | |
| *** morazi has quit IRC | 06:33 | |
| *** jbadiapa has joined #tripleo | 06:33 | |
| *** marios has joined #tripleo | 06:35 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: WORKAROUND: Use include_tasks instead of calling role https://review.openstack.org/525059 | 06:37 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Add gitreview file https://review.openstack.org/525058 | 06:37 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Remove unused task file https://review.openstack.org/525060 | 06:37 |
| bandini | jaosorior: anything you need me to review? (I'd have https://review.openstack.org/#/c/506350/ and https://review.openstack.org/#/c/506922/22 if you have time) | 06:37 |
| jaosorior | bandini: not at the moment, thanks! | 06:38 |
| bandini | ack | 06:39 |
| *** jaganathan has quit IRC | 06:39 | |
| *** jaganathan_ has joined #tripleo | 06:39 | |
| *** gkadam_ has quit IRC | 06:47 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: WORKAROUND: Use include_tasks instead of calling role https://review.openstack.org/525059 | 06:47 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Add gitreview file https://review.openstack.org/525058 | 06:47 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Remove unused task file https://review.openstack.org/525060 | 06:47 |
| Tengu | bandini: hello! small question: I stubmled on your blog post where you explained how to deploy openstack on Intel NUC boards. Did the AMT ironic driver allowed you to (pxe-)boot and reboot the boards properly? | 06:50 |
| *** dparkes has joined #tripleo | 06:51 | |
| bandini | Tengu: heya. yeah it used to work back then, but since the amt ironic driver became more or less unmaintained I faced a number of issues | 06:52 |
| bandini | Tengu: so these days I just use split-stack with my NUCs | 06:52 |
| Tengu | bandini: argh… ok. I saw it was dropped from the tree indeed | 06:52 |
| Tengu | split-stack? | 06:52 |
| bandini | basically you pre-provision your nodes and then deploy tripleo without using nova/ironic | 06:53 |
| bandini | I should probably blog about it | 06:53 |
| bandini | Tengu: https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/split_stack.html | 06:53 |
| Tengu | ah, ok. was considering that - I saw an option somwhere in the deploy enabling deploying on already-installed nodes, with some basic OS. | 06:53 |
| Tengu | oh. that's deeper. oook. thanks for the link! I think there's a way to do a nice thing with at least Pike deploy. | 06:54 |
| Tengu | bandini: there's the following env file that can do a nice thing: deployed-server-bootstrap-environment-centos.yaml | 06:55 |
| bandini | yeah that is what I use in my env | 06:55 |
| Tengu | cool :). | 06:55 |
| Tengu | wasn't far from getting a working thing then | 06:56 |
| Tengu | bandini: I have 4 NUC board, I think I'll deploy a 1-controller 3-compute setup, with the undercloud in a VM on my laptop (or desktop). I'll have some time to play with that in Christmas holidays :] | 06:57 |
| bandini | :) | 06:57 |
| *** nyechiel has joined #tripleo | 06:57 | |
| Tengu | 4 boards with 16G RAM, 128G msata, and i3 cpus. should be nice, and allow me to play a bit. I'll probably configure some PXE on a pi3 in order to be able to re-install it seemlessly. | 07:00 |
| openstackgerrit | Merged openstack/tripleo-ipsec master: WORKAROUND: Use include_tasks instead of calling role https://review.openstack.org/525059 | 07:03 |
| openstackgerrit | Merged openstack/tripleo-ipsec master: Add gitreview file https://review.openstack.org/525058 | 07:05 |
| openstackgerrit | Merged openstack/tripleo-ipsec master: Remove unused task file https://review.openstack.org/525060 | 07:05 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Move scenario001 and scenario003 back to the gate https://review.openstack.org/524760 | 07:06 |
| Tengu | bandini: is the split-task mandatory in an setup where all nodes are deployed with the deployed-server-bootstrap-environment-centos.yaml env file? I don't really see why it should be, but maybe I overlooked something | 07:07 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Add zuul.d directory with openstack-ansible-linter jobs https://review.openstack.org/525064 | 07:07 |
| Tengu | *split-stack | 07:07 |
| *** dmacpher has quit IRC | 07:09 | |
| bandini | not sure tbh | 07:14 |
| Tengu | will try it without split-stack then. | 07:15 |
| *** aufi has joined #tripleo | 07:23 | |
| *** cylopez has joined #tripleo | 07:26 | |
| *** fragatina has joined #tripleo | 07:27 | |
| *** athomas has joined #tripleo | 07:31 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Configure scenario image for tempest https://review.openstack.org/525084 | 07:33 |
| *** iranzo has joined #tripleo | 07:38 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Remove file rule on tripleo-ci-centos-7-ovb-ha-oooq https://review.openstack.org/524878 | 07:38 |
| *** stendulker has joined #tripleo | 07:40 | |
| *** morazi has joined #tripleo | 07:41 | |
| *** karthiks has joined #tripleo | 07:44 | |
| *** shardy has joined #tripleo | 07:48 | |
| *** rcernin has quit IRC | 07:49 | |
| *** pmannidi has quit IRC | 07:50 | |
| *** dbecker has joined #tripleo | 07:50 | |
| *** dmacpher has joined #tripleo | 07:50 | |
| *** florianf has joined #tripleo | 07:50 | |
| *** ccamacho has joined #tripleo | 07:55 | |
| *** bogdando has joined #tripleo | 07:56 | |
| *** dpawar has joined #tripleo | 08:03 | |
| *** dmellado has quit IRC | 08:06 | |
| *** dmellado has joined #tripleo | 08:08 | |
| *** jtomasek has quit IRC | 08:11 | |
| *** jtomasek has joined #tripleo | 08:11 | |
| *** tesseract has joined #tripleo | 08:13 | |
| *** abregman_ has joined #tripleo | 08:14 | |
| *** gkadam_ has joined #tripleo | 08:15 | |
| *** ukalifon has joined #tripleo | 08:15 | |
| *** agurenko has joined #tripleo | 08:17 | |
| *** dmellado has quit IRC | 08:18 | |
| *** dmellado has joined #tripleo | 08:18 | |
| *** yprokule has joined #tripleo | 08:18 | |
| openstackgerrit | Saravanan KR proposed openstack/puppet-tripleo master: Allow vhost socket directory user/group as configurable from template https://review.openstack.org/524575 | 08:23 |
| *** pcaruana has joined #tripleo | 08:24 | |
| *** jfrancoa has quit IRC | 08:24 | |
| skramaja | moshele: sorry, dont have much idea about qos on sriov, may be beagles could help us. | 08:27 |
| skramaja | is it possible run validations on a node with a service? i want to add some validations only on the compute nodes where dpdk is enabled. has this been addressed already? shardy ?? | 08:30 |
| bandini | jaosorior: did I address your concerns a bit? | 08:31 |
| jaosorior | bandini: you did. I'll get back to the patches in a bit. | 08:33 |
| bandini | jaosorior: ack, do ping if you have questions/concerns. thanks again | 08:34 |
| *** rcernin has joined #tripleo | 08:35 | |
| arxcruz | sshnaidm|off: I checked, and both you and chandankumar already have a solution :) | 08:40 |
| sshnaidm|off | arxcruz, me too :D | 08:40 |
| *** sshnaidm|off is now known as sshnaidm|rover | 08:40 | |
| arxcruz | sshnaidm|off: yup, already +1 hehehe :D | 08:40 |
| sshnaidm|rover | arxcruz, chandankumar take a look please https://review.openstack.org/#/c/525084 | 08:41 |
| arxcruz | sshnaidm|rover: already did it :) | 08:41 |
| *** ffiore has joined #tripleo | 08:41 | |
| sshnaidm|rover | arxcruz, great, thanks | 08:41 |
| *** jfrancoa has joined #tripleo | 08:42 | |
| skramaja | could someone check this out - https://review.openstack.org/#/c/520342/ ? | 08:43 |
| *** apetrich has quit IRC | 08:47 | |
| *** jpena|off is now known as jpena | 08:48 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Custom overcloud user/key for deployed server prepare https://review.openstack.org/522776 | 08:49 |
| *** abregman_ has quit IRC | 08:50 | |
| *** abregman has joined #tripleo | 08:50 | |
| flaper87 | bogdando: jistr tempest passes on the ansible-role-k8s-keystone CI :rock: | 08:51 |
| bogdando | flaper87: \o/ | 08:51 |
| *** ykarel is now known as ykarel|lunch | 08:52 | |
| *** jpich has joined #tripleo | 08:53 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix yum command for TLS job https://review.openstack.org/525018 | 08:57 |
| openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 08:58 |
| *** masco has quit IRC | 09:02 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: WIP: Convert tags to when statements for Q major upgrade workflow https://review.openstack.org/510902 | 09:04 |
| *** pblaho has joined #tripleo | 09:05 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Only do force listen on pacemaker nodes https://review.openstack.org/525103 | 09:12 |
| *** iranzo has quit IRC | 09:13 | |
| *** gfidente has joined #tripleo | 09:13 | |
| jistr | flaper87: great!!! | 09:13 |
| jistr | nice work | 09:14 |
| *** aditya_r has joined #tripleo | 09:17 | |
| *** masco has joined #tripleo | 09:19 | |
| *** mcornea has joined #tripleo | 09:21 | |
| *** aditya_r has quit IRC | 09:24 | |
| openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 09:28 |
| openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Octavia post deployment mistral wrapper https://review.openstack.org/515402 | 09:29 |
| *** lucas-afk is now known as lucasagomes | 09:31 | |
| *** dsariel has joined #tripleo | 09:31 | |
| *** rodolof has joined #tripleo | 09:32 | |
| *** dpawar has quit IRC | 09:36 | |
| *** paramite has joined #tripleo | 09:37 | |
| openstackgerrit | Merged openstack/tripleo-ipsec master: Only do force listen on pacemaker nodes https://review.openstack.org/525103 | 09:38 |
| *** hewbrocca_afk is now known as hewbrocca | 09:38 | |
| *** derekh has joined #tripleo | 09:38 | |
| *** masco has quit IRC | 09:40 | |
| *** moshele has quit IRC | 09:42 | |
| jistr | jaosorior: hi, can you please re-review https://review.openstack.org/523087 when you have some time? | 09:43 |
| jistr | jaosorior: thanks | 09:46 |
| flaper87 | jistr: the openshift patch is... almost done | 09:46 |
| flaper87 | I'm hitting an issue where one of the openshift services won't start because of a missing file that should be generated by one of the NetworkManager's dispatch scripts | 09:47 |
| flaper87 | you can see where I'm going with this | 09:47 |
| flaper87 | :P | 09:47 |
| jistr | flaper87: yea :D i just looked at the diff between 28 and 29 | 09:48 |
| flaper87 | it seems the dispatch script is not running with the right configs | 09:48 |
| flaper87 | and I think that's happening because of the bridge device in the vm | 09:48 |
| flaper87 | anyway, I'm trying other things | 09:49 |
| flaper87 | and see if I can get it to work | 09:49 |
| flaper87 | this nm thing is annoying | 09:49 |
| jistr | flaper87: because of br-ex? | 09:49 |
| flaper87 | yeah | 09:49 |
| flaper87 | since we are not managing those devices with nm | 09:49 |
| flaper87 | anyway, I'll hit my head on this a bit longer | 09:50 |
| flaper87 | shardy: ^ FYI | 09:50 |
| flaper87 | if you guys want to give it a spin, do it :) | 09:50 |
| flaper87 | it should run just fine until it doesn't | 09:50 |
| flaper87 | :P | 09:50 |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for OVN Metadata Agent https://review.openstack.org/502943 | 09:52 |
| jistr | flaper87: ack, destroying my overcloud and trying the opensift patch | 09:54 |
| *** apetrich has joined #tripleo | 09:55 | |
| *** masco has joined #tripleo | 09:56 | |
| *** jaganathan_ has quit IRC | 09:56 | |
| flaper87 | jistr: awesome, let me know how far you get | 09:57 |
| shardy | flaper87: 'morning, ack thanks will check it out | 09:57 |
| openstackgerrit | Luke Hinds proposed openstack/puppet-tripleo master: Implements AIDE Intrusion Detection System https://review.openstack.org/483025 | 09:57 |
| *** ykarel|lunch is now known as ykarel | 09:59 | |
| *** Guest46858 is now known as honza | 10:00 | |
| *** milan_ has joined #tripleo | 10:01 | |
| *** salmankhan has joined #tripleo | 10:09 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Send logs size to grahite site https://review.openstack.org/481159 | 10:10 |
| *** salmankhan has quit IRC | 10:12 | |
| *** salmankhan has joined #tripleo | 10:12 | |
| *** tosky has joined #tripleo | 10:14 | |
| openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates master: Create /var/log/containers on Swift storage-only nodes https://review.openstack.org/525124 | 10:14 |
| *** zshi has quit IRC | 10:17 | |
| *** etingof has quit IRC | 10:17 | |
| *** Vijayendra has joined #tripleo | 10:19 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Send graphite stats from ARA https://review.openstack.org/480121 | 10:28 |
| sshnaidm|rover | jistr, jfrancoa hi, can you or somebody from upgrades take a look at container upgrades job? It fails on pingtest: https://bugs.launchpad.net/tripleo/+bug/1736040 | 10:30 |
| openstack | Launchpad bug 1736040 in tripleo "Overcloud is not operational after upgrade in containers-multinode-upgrades job" [Critical,Triaged] | 10:30 |
| jfrancoa | sshnaidm|rover: sure, I'll have a look at it | 10:30 |
| sshnaidm|rover | jfrancoa, thanks | 10:30 |
| *** zshi has joined #tripleo | 10:30 | |
| jistr | thanks jfrancoa | 10:30 |
| jfrancoa | jistr: sshnaidm|rover: you're welcome | 10:31 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-docs master: Fill in upgrades CI developer doc https://review.openstack.org/520636 | 10:32 |
| *** cshastri has quit IRC | 10:38 | |
| *** akrivoka has joined #tripleo | 10:43 | |
| shardy | matbu: Hi! I was wondering if you'd noticed a large increase in config download time, e.g since https://review.openstack.org/#/c/487488/ | 10:44 |
| shardy | matbu: I've not debugged it yet but just noticed that config download is taking much more time now (like 10x the time it was before) | 10:45 |
| *** rodolof has quit IRC | 10:45 | |
| *** Sorvin has joined #tripleo | 10:51 | |
| *** anilvenkata has quit IRC | 10:51 | |
| *** etingof has joined #tripleo | 10:52 | |
| *** rfolco has joined #tripleo | 10:54 | |
| *** jaganathan has joined #tripleo | 10:56 | |
| *** dmacpher has quit IRC | 10:56 | |
| *** etingof has quit IRC | 10:59 | |
| *** ebarrera has joined #tripleo | 11:01 | |
| *** Sorvin has quit IRC | 11:04 | |
| *** pdeore has joined #tripleo | 11:05 | |
| jistr | flaper87: how do you get the openshift-ansible? From centos repos or from source? | 11:05 |
| *** ebarrera has quit IRC | 11:08 | |
| *** ffiore has quit IRC | 11:09 | |
| *** etingof has joined #tripleo | 11:12 | |
| *** iranzo has joined #tripleo | 11:14 | |
| openstackgerrit | Numan Siddique proposed openstack/puppet-tripleo master: OVN: Remove container-attribute-target=host from the ovn_dbs_bundle https://review.openstack.org/525157 | 11:15 |
| *** ffiore has joined #tripleo | 11:17 | |
| jistr | flaper87: hm the centos ones don't have byo playbook so i'll try from openshift-ansible master for now | 11:17 |
| *** chem has joined #tripleo | 11:17 | |
| numans | bandini, Hi, can you please have a look at this when ever you get some time - https://review.openstack.org/#/c/525157/ | 11:19 |
| *** abregman is now known as abregman|afk | 11:20 | |
| jistr | or the release-3.6 branch rather | 11:20 |
| *** dpawar has joined #tripleo | 11:21 | |
| matbu | shardy: hi nop i didn't notice | 11:22 |
| matbu | shardy: 10x its really huge | 11:22 |
| matbu | shardy: on master ? or pike or both ? | 11:22 |
| shardy | matbu: ack OK I'll dig into it later and see if I can spot where the time is taken | 11:22 |
| shardy | matbu: I've only tested master so far | 11:22 |
| shardy | matbu: if you have a pike env I'd be interested to know the time for time openstack overcloud config download | 11:23 |
| *** akrivoka has quit IRC | 11:24 | |
| matbu | shardy: i'll take a look as well if i see something | 11:24 |
| matbu | shardy: im working on refactoring minor update a bit for Queens | 11:25 |
| openstackgerrit | Merged openstack/tripleo-validations master: Add ansible-lint script https://review.openstack.org/516332 | 11:25 |
| *** brault has joined #tripleo | 11:25 | |
| lhinds | hi all, is it possible just to recheck 'RDO Third Party CI'? | 11:26 |
| lhinds | or perhaps just FAILURES | 11:27 |
| Tengu | jaosorior: heya! do you think a pull request adding basic auth capability to your dynamic haproxy endpoint would be accepted? | 11:27 |
| *** akrivoka has joined #tripleo | 11:27 | |
| Tengu | jaosorior: I have a nice usecase for that, I can create an issue on launchpad if needed. and I know more or less what needs to be added, and where to do that :). | 11:28 |
| jaosorior | Tengu: please create a launchpad bug; it would help :) | 11:28 |
| Tengu | jaosorior: fine :). | 11:29 |
| Tengu | hmmmm wait. maybe I can already do what I need in fact. | 11:30 |
| Tengu | there's the listen_options :D | 11:30 |
| Tengu | should be sufficient. | 11:30 |
| *** dtantsur|afk is now known as dtantsur | 11:30 | |
| *** akrivoka has quit IRC | 11:31 | |
| shardy | matbu: I think the problem is we do a nested resource list, twice | 11:31 |
| shardy | matbu: instead we should just read whatever data is needed from the overcloud stack outputs | 11:31 |
| shardy | which is how it worked before, and that was quite fast | 11:32 |
| shardy | matbu: I guess we'll need to chat with slagle about it later | 11:32 |
| *** akrivoka has joined #tripleo | 11:33 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates stable/pike: Add validation task in docker services [cinder] https://review.openstack.org/525158 | 11:35 |
| Tengu | jaosorior: btw, I think this issue can be closed: https://bugs.launchpad.net/tripleo/+bug/1721832 (I opened it some times ago - since you have merged your dynamic endpoint code in master) | 11:36 |
| openstack | Launchpad bug 1721832 in tripleo "Allow to add custom backends in HAProxy" [Medium,Triaged] | 11:36 |
| jaosorior | Tengu: done, thanks | 11:36 |
| Tengu | :) | 11:36 |
| *** shreshtha has quit IRC | 11:38 | |
| matbu | shardy: ack | 11:39 |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for OVN Metadata Agent https://review.openstack.org/502943 | 11:39 |
| *** moshele has joined #tripleo | 11:40 | |
| sshnaidm|rover | arxcruz, do you know what could be a problem? overcloud not installed properly? http://logs.openstack.org/36/523436/1/gate/tripleo-ci-centos-7-containers-multinode/391a217/logs/undercloud/home/zuul/tempest_output.log.txt.gz#_2017-11-30_23_08_58 | 11:41 |
| openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient stable/pike: Add mock to avoid writing missing files to disk https://review.openstack.org/525163 | 11:41 |
| arxcruz | sshnaidm|rover: checking | 11:41 |
| arxcruz | sshnaidm|rover: this is in https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/validate-tempest/templates/configure-tempest.sh.j2#L29-L51 did neutron change something? Also, the /v3 comes from overcloudrc.v3 file | 11:43 |
| Tengu | jaosorior: https://bugs.launchpad.net/tripleo/+bug/1736132 | 11:43 |
| openstack | Launchpad bug 1736132 in tripleo "Allow to add Basic Authentication on HAProxy endpoint" [Undecided,New] | 11:43 |
| Tengu | jaosorior: if you have comments - I should be able to implement that during this week. | 11:44 |
| sshnaidm|rover | arxcruz, I suspect it could happen when overcloud didn't install.. | 11:44 |
| *** shardy has quit IRC | 11:44 | |
| arxcruz | sshnaidm|rover: http://logs.openstack.org/36/523436/1/gate/tripleo-ci-centos-7-containers-multinode/391a217/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz shows no failures | 11:45 |
| *** shardy has joined #tripleo | 11:45 | |
| jaosorior | Tengu: it looks reasonable; and I guess it would be disabled by default, right? | 11:45 |
| Tengu | jaosorior: empty list/hash yep | 11:46 |
| Tengu | I'll probably call the create_resource() function in order to do that properly. | 11:46 |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-validations master: Enhance repo validation to check for unwanted enabled repos https://review.openstack.org/515412 | 11:47 |
| Tengu | and, of course, empty set won't add anything ;). Pormetheus is our usecase, probably others will have some other needs :). Generic way to fill the gaps. | 11:47 |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for containerized OVN Metadata Agent https://review.openstack.org/525164 | 11:47 |
| *** dpawar has quit IRC | 11:47 | |
| *** raildo has joined #tripleo | 11:51 | |
| *** jkilpatr has joined #tripleo | 11:52 | |
| *** ratailor has quit IRC | 11:52 | |
| jaosorior | Tengu: sounds good to me | 11:52 |
| Tengu | jaosorior: great. I have to do some other things for my "real" job, I'll try to get a hit on that request either tomorrow or, at least, before the weekend. | 11:53 |
| sshnaidm|rover | arxcruz, yeah.. well, need to reproduce | 11:53 |
| arxcruz | sshnaidm|rover: working on that :) | 11:56 |
| *** jpena is now known as jpena|lunch | 11:57 | |
| *** jkilpatr has quit IRC | 11:57 | |
| *** marrusl has quit IRC | 11:57 | |
| sshnaidm|rover | FYI, https://bugs.launchpad.net/tripleo/+bug/1736137 | 11:59 |
| openstack | Launchpad bug 1736137 in tripleo "CI: containers multinode gate job fails on tempest configuration" [Critical,Triaged] | 11:59 |
| openstackgerrit | Lee Yarwood proposed openstack/puppet-tripleo master: rabbitmq: Avoid calls to rabbitmqctl during fast-forward upgrades https://review.openstack.org/522550 | 12:07 |
| *** stendulker has quit IRC | 12:07 | |
| *** lennyb__ has quit IRC | 12:07 | |
| *** pkovar has joined #tripleo | 12:08 | |
| openstackgerrit | Lee Yarwood proposed openstack/puppet-tripleo master: rabbitmq: Avoid calls to rabbitmqctl during fast-forward upgrades https://review.openstack.org/522550 | 12:10 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736137 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1736137 in tripleo "CI: containers multinode gate job fails on tempest configuration" [Critical,Triaged] | 12:10 |
| *** jkilpatr has joined #tripleo | 12:10 | |
| *** lucasagomes is now known as lucas-hungry | 12:10 | |
| *** apetrich has quit IRC | 12:10 | |
| *** oidgar has joined #tripleo | 12:14 | |
| *** thrash|g0ne is now known as thrash | 12:19 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Set DNS on ctlplane network https://review.openstack.org/523087 | 12:22 |
| *** dpawar has joined #tripleo | 12:22 | |
| *** paramite has quit IRC | 12:23 | |
| *** paramite has joined #tripleo | 12:24 | |
| *** ffiore has quit IRC | 12:24 | |
| *** BryanS68 has joined #tripleo | 12:24 | |
| *** pdeore has quit IRC | 12:25 | |
| *** bfournie has quit IRC | 12:28 | |
| *** bfournie has joined #tripleo | 12:28 | |
| *** oidgar has quit IRC | 12:28 | |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-validations master: Change HAProxy validation queue timeout to match the default https://review.openstack.org/525173 | 12:29 |
| *** psahoo has quit IRC | 12:29 | |
| *** anilvenkata has joined #tripleo | 12:30 | |
| *** pkovar has quit IRC | 12:31 | |
| *** rcernin has quit IRC | 12:31 | |
| *** ansmith has quit IRC | 12:31 | |
| *** bfournie has quit IRC | 12:32 | |
| *** derekh has quit IRC | 12:36 | |
| *** ffiore has joined #tripleo | 12:37 | |
| *** oidgar has joined #tripleo | 12:42 | |
| *** skramaja has quit IRC | 12:42 | |
| *** rhallisey has joined #tripleo | 12:43 | |
| *** mhenkel has quit IRC | 12:47 | |
| *** pblaho has quit IRC | 12:49 | |
| *** ffiore has quit IRC | 12:53 | |
| *** links has quit IRC | 12:54 | |
| *** masco has quit IRC | 12:55 | |
| *** mhenkel has joined #tripleo | 12:55 | |
| *** gfidente has quit IRC | 12:57 | |
| *** cylopez has quit IRC | 13:00 | |
| *** gfidente has joined #tripleo | 13:00 | |
| *** dprince has joined #tripleo | 13:02 | |
| *** cylopez has joined #tripleo | 13:03 | |
| *** jlabarre has joined #tripleo | 13:03 | |
| *** dtantsur is now known as dtantsur|lunch | 13:03 | |
| *** bfournie has joined #tripleo | 13:04 | |
| *** stendulker has joined #tripleo | 13:04 | |
| *** jpena|lunch is now known as jpena | 13:04 | |
| *** gfidente has quit IRC | 13:05 | |
| openstackgerrit | Merged openstack/tripleo-ui master: Refactor Register nodes dialog to use redux-form https://review.openstack.org/504903 | 13:05 |
| *** stendulker has quit IRC | 13:05 | |
| *** stendulker has joined #tripleo | 13:06 | |
| *** abishop has joined #tripleo | 13:06 | |
| *** trown|outtypewww has quit IRC | 13:06 | |
| *** trown has joined #tripleo | 13:07 | |
| jtomasek | honza: hi, when you're here, could you please check https://review.openstack.org/#/c/508536/1 It has been there for quite a while now, getting burdened in the patches list | 13:07 |
| *** gfidente has joined #tripleo | 13:07 | |
| *** gfidente has quit IRC | 13:07 | |
| *** gfidente has joined #tripleo | 13:07 | |
| *** lucas-hungry is now known as lucasagomes | 13:08 | |
| *** stendulker has quit IRC | 13:08 | |
| *** stendulker has joined #tripleo | 13:08 | |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736137 | 13:10 |
| openstack | Launchpad bug 1736137 in tripleo "CI: containers multinode gate job fails on tempest configuration" [Critical,Triaged] | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| *** stendulker has left #tripleo | 13:11 | |
| *** pkovar has joined #tripleo | 13:12 | |
| *** oidgar has quit IRC | 13:12 | |
| *** jaganathan has quit IRC | 13:14 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add deploy_steps_tasks interface https://review.openstack.org/522344 | 13:15 |
| shardy | jaosorior: Hey ^^ updated FYI | 13:16 |
| *** ffiore has joined #tripleo | 13:17 | |
| jaosorior | shardy: nice!!! :D | 13:19 |
| sshnaidm|rover | arxcruz, I couldn't reproduce the failure of container-multinode, it passed. Seems like it started to pass in gates too. Will try now with delorean hashes from failed jobs.. | 13:22 |
| *** ramishra has quit IRC | 13:22 | |
| arxcruz | sshnaidm|rover: ok | 13:22 |
| *** vpickard_ is now known as vpickard | 13:23 | |
| arxcruz | sshnaidm|rover: rdo cloud seems to be hanging, my provision is failing :/ | 13:23 |
| *** colonwq has quit IRC | 13:23 | |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-validations master: Change controller ulimit to match the default https://review.openstack.org/525179 | 13:24 |
| sshnaidm|rover | arxcruz, yeah, it happens ( | 13:24 |
| *** ykarel_ has joined #tripleo | 13:24 | |
| *** tzumainn has joined #tripleo | 13:26 | |
| *** ykarel has quit IRC | 13:26 | |
| sshnaidm|rover | cores, please review promotion blocker fix: https://review.openstack.org/#/c/525084/ | 13:30 |
| *** ykarel__ has joined #tripleo | 13:30 | |
| *** links has joined #tripleo | 13:31 | |
| weshay | mwhahaha, I don't think scen001 containers is good enough to gate yet | 13:31 |
| mwhahaha | weshay: what are we at | 13:31 |
| mwhahaha | also what are we failign on | 13:31 |
| *** rlandy has joined #tripleo | 13:32 | |
| *** ykarel_ has quit IRC | 13:32 | |
| weshay | mwhahaha, myoung|ruck it's at 50% pass in check.. w/ a few failures in the overcloud deployment, couple dlrn fails and some other random | 13:33 |
| *** janki has quit IRC | 13:33 | |
| *** jcoufal has joined #tripleo | 13:33 | |
| weshay | mwhahaha, scen003 is 83% in check | 13:33 |
| mwhahaha | weshay: k i'll look later | 13:33 |
| *** yamahata has joined #tripleo | 13:34 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Add noop's for docker pacemaker for rabbitmq https://review.openstack.org/524751 | 13:34 |
| *** dougbtv has quit IRC | 13:34 | |
| *** myoung|ruck has quit IRC | 13:35 | |
| *** oanson has quit IRC | 13:35 | |
| *** sai has quit IRC | 13:35 | |
| *** sai has joined #tripleo | 13:36 | |
| slagle | dprince: my attempt at just including from the docker template for pacemaker rabbitmq didn't work. however just adding the noop's does: https://review.openstack.org/#/c/524751/ | 13:36 |
| *** noslzzp has joined #tripleo | 13:37 | |
| *** ykarel_ has joined #tripleo | 13:37 | |
| *** oanson has joined #tripleo | 13:37 | |
| *** dtantsur|lunch is now known as dtantsur | 13:38 | |
| *** myoung has joined #tripleo | 13:39 | |
| dprince | slagle: The solutions should have both given the same puppet manifest. I wonder why "extending" the base rabbit service didn't work | 13:39 |
| *** ykarel__ has quit IRC | 13:40 | |
| slagle | dprince: i'm not sure. honestly, it was very hard to debug...the error must be buried somewhere | 13:40 |
| *** Goneri has joined #tripleo | 13:40 | |
| slagle | dprince: it failed in CI the same way on PS1 where I had tried the extending method, so maybe there's something there | 13:40 |
| dprince | slagle: there is a DockerPuppetDebug heat param that might help | 13:41 |
| dprince | slagle: probably fine to go with what you've got too. Just curious now that I look at it again | 13:41 |
| sshnaidm|rover | arxcruz, so what was root cause for 001 and 003 tempest failures? | 13:41 |
| slagle | dprince: there are significant differences between docker and docker/pacemaker for rabbitmq fwiw. may need to pull in more folks to help reconcile them | 13:42 |
| slagle | dprince: i was going to send a note to the list about the pattern here, and see if anyone can look at it who is more familiar with the pacemaker side | 13:42 |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-common master: Add OVN Metadata Agent to containerized environments https://review.openstack.org/525182 | 13:43 |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for containerized OVN Metadata Agent https://review.openstack.org/525164 | 13:43 |
| mwhahaha | weshay: well it looks like EmilienM aproved the voting change yesterday. so we'll have to keep an eye on the stats | 13:45 |
| weshay | that guy | 13:46 |
| weshay | ya.. I saw one run in the gate, was wondering about that | 13:46 |
| trown | arxcruz: sshnaidm|rover: is that scenario.img option supported in all the versions of tempestconf? https://review.openstack.org/#/c/525084/1/roles/validate-tempest/templates/configure-tempest.sh.j2 | 13:46 |
| mwhahaha | if we're getting new failures then we'll just need to open new bugs | 13:46 |
| dprince | slagle: oh, right. I thought I mentioned if there were differences we'd have no option but to do it in pacemaker | 13:47 |
| dprince | slagle: I think what you've got looks great | 13:47 |
| sshnaidm|rover | trown, you mean tempest.conf file? | 13:47 |
| weshay | mwhahaha, aye.. myoung fyi.. we'll have to keep an open eye on http://cistatus.tripleo.org:8000/ and tripleo-ci-centos-7-scenario001-multinode-oooq-container | 13:47 |
| weshay | myoung, it was just moved back to voting | 13:47 |
| gfidente | bandini about https://bugzilla.redhat.com/show_bug.cgi?id=1507888 | 13:47 |
| openstack | bugzilla.redhat.com bug 1507888 in instack-undercloud "Deployment with ceph and TLS everywhere fails with: "WorkflowTasks_Step2_Execution: ERROR "cannot stat '/var/run/ceph/ceph-mon.overcloud-controller-2.asok': No such file or directory""" [High,Post] - Assigned to gfidente | 13:47 |
| weshay | myoung, renick as myoung|ruck :) | 13:47 |
| myoung | weshay, mwhahaha< ack | 13:48 |
| *** myoung is now known as myoung|ruck | 13:48 | |
| weshay | thanks | 13:48 |
| trown | sshnaidm|rover: i mean by the tool which generates tempest.conf | 13:48 |
| gfidente | bandini so maybe we should default that to '' instead of removing it then? | 13:48 |
| trown | sshnaidm|rover: https://git.openstack.org/openstack/python-tempestconf | 13:49 |
| sshnaidm|rover | trown, I thought it just dumps what we add to config, but arxcruz and chandankumar may know better | 13:49 |
| *** apetrich has joined #tripleo | 13:50 | |
| *** pblaho has joined #tripleo | 13:50 | |
| sshnaidm|rover | trown, and why is it important? does it have branches? | 13:50 |
| *** tvignaud has quit IRC | 13:50 | |
| *** itlinux has joined #tripleo | 13:50 | |
| arxcruz | sshnaidm|rover: yes, when you pass the arg, it will just create in the [scenario] an option img | 13:50 |
| arxcruz | trown: ^ | 13:50 |
| trown | sshnaidm|rover: it is packaged, so if that doesnt work on an older version it will break something somewhere | 13:51 |
| trown | but seems fine | 13:51 |
| *** ykarel_ has quit IRC | 13:51 | |
| *** ykarel has joined #tripleo | 13:51 | |
| arxcruz | sshnaidm|rover: dalvarez was THE MAN who solve it, but tl-dr ovsdbapp 0.8 wasn't handling a race condition properly, but 0.9 is, also, a bug in neutron | 13:52 |
| arxcruz | sshnaidm|rover: https://trello.com/c/oyRiPSLG has all the info | 13:52 |
| dalvarez | arxcruz, :) yeah we still need to fix it in neutron but we fixed the main cause of that error by bumping ovsdbapp | 13:53 |
| *** jkilpatr has quit IRC | 13:53 | |
| openstackgerrit | Giulio Fidente proposed openstack/instack-undercloud master: Set nova dhcp_domain to empty string https://review.openstack.org/525193 | 13:54 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/instack-undercloud stable/pike: Make sure selinux permissions are correct on ~/.ssh. https://review.openstack.org/525194 | 13:54 |
| chandankumar | trown: proper fix will be added soon in tempestconf | 13:55 |
| dmsimard | mwhahaha: FYI I'm still seeing DNS failures for TripleO after the cache change, however, they are all failing at the same place -- on looking up an openstack mirror during devstack gate cleanup | 13:56 |
| mwhahaha | dmsimard: so i wonder if changes we make during tripleo breaks it | 13:57 |
| dmsimard | I wonder if there's anything else going on during that cleanup | 13:57 |
| mwhahaha | dmsimard: might want to check with the ci guys to make sure we're not breaking unbound | 13:57 |
| bandini | gfidente: I think that changing anything at that layer will need a lot of thinking and testing because stuff just breaks in so many ways | 13:57 |
| bandini | I would need to do a proper riteup on how we even set the hostname in all cases in order to grasp the full extent of the issue | 13:58 |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras master: Do not assume default values for undercloud.conf https://review.openstack.org/525196 | 13:58 |
| honza | jtomasek: on it | 13:58 |
| *** yamahata has quit IRC | 13:59 | |
| openstackgerrit | Merged openstack/tripleo-docs master: Update the driver documentation for the undercloud https://review.openstack.org/524674 | 14:00 |
| openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient master: Support more hardware types and deprecate enabled_drivers https://review.openstack.org/524577 | 14:00 |
| dtantsur | dprince: hey, I could use some reviews on ^^^ | 14:00 |
| dtantsur | to avoid rebasing it all the time :) | 14:01 |
| dprince | dtantsur: ack, will do | 14:01 |
| *** liverpooler has joined #tripleo | 14:02 | |
| *** ansmith has joined #tripleo | 14:02 | |
| dtantsur | also, can someone please move forward with a 2nd +2 two patches that modify 11 lines together :) https://review.openstack.org/#/c/523082/ and https://review.openstack.org/#/c/523085/ | 14:03 |
| gfidente | bandini though empty string is in line with the overcloud config and is better than .novalocal | 14:03 |
| dmsimard | sshnaidm|rover, weshay: I've created a bug for recurring DNS failures during devstack-gate-cleanup, can we check if it's something we're doing on our end ? https://bugs.launchpad.net/tripleo/+bug/1736157 | 14:03 |
| openstack | Launchpad bug 1736157 in tripleo "Recurring DNS lookup failures during devstack-gate-cleanup" [Undecided,New] | 14:03 |
| bandini | gfidente: try one run and then we can check CI results and see if we get the right stuff happening on hostnames? | 14:03 |
| dmsimard | sshnaidm|rover, weshay: At first glance I'm not seeing this error in other projects | 14:03 |
| gfidente | bandini yeah I added you on the review | 14:04 |
| gfidente | thanks | 14:04 |
| bandini | ack | 14:04 |
| *** abregman|afk is now known as abregman | 14:06 | |
| dprince | mandre: hi, re the IPv6 healthchecks. Would you buy this using this https://review.openstack.org/#/c/524876/ for a quick (safe) fix to be backported. And then we can change the common.sh functions in master to be more robust as you suggest? | 14:06 |
| honza | florianf: I gave you a +2, let me know if you feel like making some of the suggested changes, if not, I'll +1 on workflow https://review.openstack.org/#/c/508536/1 | 14:08 |
| *** tvignaud has joined #tripleo | 14:08 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/puppet-tripleo master: ironic-inspector: enable support for dnsmasq PXE filter https://review.openstack.org/525203 | 14:08 |
| mandre | hey dprince, no problem for me, you see I haven't downvoted your patch | 14:08 |
| sshnaidm|rover | dmsimard, does it run on "localhost"? | 14:09 |
| dprince | mandre: I see that. I also see you've not upvoted it :) | 14:09 |
| dprince | mandre: anyways, I can work on the common fix in parallel I suppose | 14:09 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736137 | 14:10 |
| openstack | Launchpad bug 1736137 in tripleo "CI: containers multinode gate job fails on tempest configuration" [Critical,Triaged] | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| mandre | dprince: yeah, I wanted to check with you how you wanted to handle it first. Now it's clear :) | 14:10 |
| *** fultonj has joined #tripleo | 14:11 | |
| dmsimard | sshnaidm|rover: I'm not sure what you mean | 14:11 |
| sshnaidm|rover | dmsimard, this is an ansible task, right? | 14:11 |
| dprince | mandre: ack, thanks | 14:11 |
| *** pchavva has joined #tripleo | 14:11 | |
| sshnaidm|rover | dmsimard, the "devstack-gate-cleanup" | 14:12 |
| dmsimard | sshnaidm|rover: I linked the logs where the DNS lookup failure occurs, I'm not sure what the context of that task is (haven't had time to look yet) | 14:12 |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Add/Update modal-related dependencies https://review.openstack.org/516363 | 14:12 |
| *** karthiks has quit IRC | 14:12 | |
| sshnaidm|rover | dmsimard, I just want to find out where this tasks runs, if it runs on nodepool/zuul instance, not on "primary" image, then it's not our scope, we can't touch anything there | 14:16 |
| chandankumar | weshay: arxcruz sshnaidm|rover EmilienM https://review.openstack.org/#/c/525130/ https://review.openstack.org/#/c/525072/ if you see any breakage in telemetry side let me know | 14:17 |
| *** jmelvin has joined #tripleo | 14:17 | |
| dmsimard | sshnaidm|rover: in a meeting, can you go up the logs directory tree to see where it runs and how it runs ? | 14:17 |
| florianf | honza: thanks! Since it's two nits now I guess it'll make sense for me to integrate them first. | 14:19 |
| honza | florianf: sorry and thank you :) | 14:19 |
| sshnaidm|rover | dmsimard, on a meeting too :) I see first line in this log: localhost | SUCCESS | rc=0, so this host is out of our control | 14:20 |
| florianf | honza: thank you! | 14:20 |
| *** fpan has quit IRC | 14:20 | |
| dmsimard | sshnaidm|rover: localhost refers to the node itself more than likely | 14:21 |
| dmsimard | sshnaidm|rover: devstack-gate doesn't run on the executor | 14:21 |
| *** apetrich has quit IRC | 14:21 | |
| dmsimard | you basically can't run anything on the executor | 14:21 |
| *** aputtur_ has joined #tripleo | 14:22 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Make CephPools override properties of other pools https://review.openstack.org/525213 | 14:22 |
| *** apetrich has joined #tripleo | 14:22 | |
| sshnaidm|rover | dmsimard, need to find this playbook.. | 14:23 |
| *** jkilpatr has joined #tripleo | 14:23 | |
| dtantsur | ./quickstart.sh: line 493: ansible-playbook: command not found | 14:23 |
| dtantsur | WUT? | 14:23 |
| *** lblanchard has joined #tripleo | 14:23 | |
| *** gbarros has joined #tripleo | 14:24 | |
| dtantsur | should I recheck or..? | 14:24 |
| *** lblanchard has quit IRC | 14:25 | |
| *** dhill_ has joined #tripleo | 14:25 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud master: Remove usage of ironic::drivers::ipmi::retry_timeout https://review.openstack.org/525214 | 14:27 |
| sshnaidm|rover | dmsimard, hmm.. I just checked a few links and it starts to fail in dns resolving in the job itself, this is only last symptom | 14:28 |
| weshay | sshnaidm|rover, FYI.. I synced w/ myoung and we'll have 4 incoming bugs 2 are quickstart tempest related | 14:29 |
| sshnaidm|rover | weshay, I think I need more details | 14:29 |
| weshay | sshnaidm|rover, ya.. the bugs will come in | 14:30 |
| *** ebarrera has joined #tripleo | 14:31 | |
| sshnaidm|rover | weshay, where from..? | 14:31 |
| weshay | lp | 14:31 |
| sshnaidm|rover | weshay, ok, let's talk after a mtg | 14:31 |
| *** dtrainor has joined #tripleo | 14:33 | |
| openstackgerrit | Merged openstack/tripleo-ui master: Add/Update modal-related dependencies https://review.openstack.org/516363 | 14:34 |
| d0ugal | thrash: https://review.openstack.org/#/c/518506/ https://review.openstack.org/#/c/520061/ - can we land these two? just errors I made in the original package layout/setup | 14:35 |
| *** jkilpatr has quit IRC | 14:35 | |
| dmsimard | sshnaidm|rover: ok, off meeting | 14:35 |
| weshay | sshnaidm|rover, I don't see https://bugs.launchpad.net/tripleo/+bug/1736137 in http://cistatus.tripleo.org:8000/ | 14:35 |
| openstack | Launchpad bug 1736137 in tripleo "CI: containers multinode gate job fails on tempest configuration" [Critical,Triaged] | 14:35 |
| thrash | d0ugal: done | 14:36 |
| d0ugal | thrash: thanks. | 14:36 |
| sshnaidm|rover | weshay, it's there | 14:36 |
| weshay | sshnaidm|rover, k.. /me looks again | 14:38 |
| *** ykarel is now known as ykarel|away | 14:38 | |
| *** dhill_ has quit IRC | 14:38 | |
| sshnaidm|rover | weshay, last jobs passed though | 14:39 |
| *** ramishra has joined #tripleo | 14:39 | |
| *** dhill_ has joined #tripleo | 14:40 | |
| *** nguyentrihai has quit IRC | 14:40 | |
| *** nguyentrihai has joined #tripleo | 14:40 | |
| *** ykarel|away has quit IRC | 14:43 | |
| openstackgerrit | Merged openstack/tripleo-common-tempest-plugin master: Update the .gitignore https://review.openstack.org/518506 | 14:44 |
| openstackgerrit | Merged openstack/tripleo-common-tempest-plugin master: Correct the package name in the setup.cfg https://review.openstack.org/520061 | 14:44 |
| *** jkilpatr has joined #tripleo | 14:46 | |
| *** BryanS68 has quit IRC | 14:47 | |
| *** BryanS68 has joined #tripleo | 14:47 | |
| openstackgerrit | Justin Kilpatrick proposed openstack/tripleo-quickstart-extras master: WIP: Add disruption detector for Overcloud endpoint monitoring https://review.openstack.org/520126 | 14:47 |
| dmsimard | sshnaidm|rover: There's definitely something going on, because DNS resolution works (we install things from pip) and then always start failing at the same place, I added some comments in https://bugs.launchpad.net/tripleo/+bug/1736157 | 14:50 |
| openstack | Launchpad bug 1736157 in tripleo "Recurring DNS lookup failures during devstack-gate-cleanup" [Undecided,New] | 14:51 |
| dmsimard | mwhahaha: ^ this sounds like the same behavior we noticed last week. There's something's up because it is fairly reliably reproducing at the same time | 14:51 |
| bandini | gfidente: http://logs.openstack.org/93/525193/1/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/6cf9720/job-output.txt.gz#_2017-12-04_14_11_19_237787 seems something else is wrong atm | 14:52 |
| sshnaidm|rover | dmsimard, I see.. it there a chance to collect unbound log with devstack? Because our code doesn't reach this step.. | 14:52 |
| dmsimard | sshnaidm|rover: devstack doesn't exhibit that issue | 14:52 |
| dmsimard | sshnaidm|rover: looking through logstash, tripleo is the only project hitting this | 14:53 |
| *** psachin has quit IRC | 14:53 | |
| sshnaidm|rover | dmsimard, I mean we don't have unbound log with debug that we enabled.. | 14:53 |
| dmsimard | You are restarting unbound here: http://logs.openstack.org/07/472607/145/check/tripleo-ci-centos-7-containers-multinode/ae132c1/job-output.txt.gz#_2017-12-02_23_21_33_419832 | 14:53 |
| dmsimard | That's like 95% the fault of that restart | 14:53 |
| dmsimard | Likely unbound doesn't have time to settle | 14:53 |
| dmsimard | the DNS lookup error shows up ~5 seconds after the restart | 14:54 |
| sshnaidm|rover | dmsimard, yeah, we can remove this since we have debug enabled already in infra | 14:54 |
| dmsimard | so either it really is slow to restart, or unbound doesn't restart properly in the first place | 14:54 |
| *** dpawar has quit IRC | 14:55 | |
| sshnaidm|rover | dmsimard, 5 seconds not enough?? I doubt, but let's remove this anyway | 14:55 |
| dhill_ | dmsimard, hey ! how are you ? | 14:55 |
| dhill_ | dmsimard, do you know why we turned on ipa-inspection-dhcp-all-interfaces=1 ? | 14:55 |
| dmsimard | dhill_: I have absolutely no idea, I'm not the right person to ask for that kind of question :) | 14:56 |
| dhill_ | ah | 14:56 |
| dhill_ | gfidente, and you? | 14:56 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Remove debug config of unbound since it's enabled https://review.openstack.org/525228 | 14:58 |
| sshnaidm|rover | dmsimard, ^^ | 14:59 |
| dtantsur | dhill_: because we want to collect as many valid IP addresses as possible | 14:59 |
| EmilienM | hello | 14:59 |
| EmilienM | chandankumar: ack | 15:00 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 15:00 |
| dmsimard | sshnaidm|rover: +1, added a comment though | 15:00 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Remove debug config of unbound since it's enabled https://review.openstack.org/525228 | 15:01 |
| *** aputtur_ has quit IRC | 15:01 | |
| sshnaidm|rover | core, need another +2 on fixed TLS job: https://review.openstack.org/#/c/525018/ | 15:02 |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for OVN Metadata Agent https://review.openstack.org/502943 | 15:06 |
| *** alee has quit IRC | 15:07 | |
| openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Octavia post deployment mistral wrapper https://review.openstack.org/515402 | 15:07 |
| *** jkilpatr has quit IRC | 15:07 | |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736137 | 15:10 |
| openstack | Launchpad bug 1736137 in tripleo "CI: containers multinode gate job fails on tempest configuration" [Critical,Triaged] | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| *** anilvenkata has quit IRC | 15:10 | |
| *** links has quit IRC | 15:10 | |
| *** florianf is now known as florianf|afk | 15:14 | |
| *** zaneb has joined #tripleo | 15:14 | |
| *** shreshtha has joined #tripleo | 15:15 | |
| *** agurenko has quit IRC | 15:23 | |
| *** oidgar has joined #tripleo | 15:25 | |
| slagle | mwhahaha: i found this one: https://bugs.launchpad.net/tripleo/+bug/1735168. which i just switched to fix committed. but don't see any others for config-download | 15:26 |
| openstack | Launchpad bug 1735168 in tripleo "overcloud deploy --config-download returns 0 even when Ansible fails" [Critical,Fix committed] - Assigned to James Slagle (james-slagle) | 15:26 |
| *** itlinux has quit IRC | 15:26 | |
| slagle | let me know if i missed anything else | 15:26 |
| *** gbarros has quit IRC | 15:27 | |
| shardy | slagle: hey FYI I just raised one re config-download, about to push a WIP patch | 15:28 |
| dtantsur | folks, am I the only one seeing ovb-ha job failing after 15-18 minutes of running? | 15:28 |
| shardy | slagle: in my environment it's taking quite a long time to run, due to the multiple nested resource list calls | 15:28 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: Reduce the calls to heat when downloading config https://review.openstack.org/525236 | 15:29 |
| dmsimard | ansible-playbook command not found | 15:30 |
| dmsimard | Is there anyone working on this ? | 15:30 |
| dmsimard | Causing apparently all jobs to fail | 15:30 |
| dmsimard | sshnaidm|rover, EmilienM, mwhahaha ^ | 15:30 |
| dtantsur | aha, so it's not only me | 15:31 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: Reduce the calls to heat when downloading config https://review.openstack.org/525236 | 15:31 |
| sshnaidm|rover | dmsimard, where? | 15:31 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add support for OVN Metadata Agent https://review.openstack.org/502943 | 15:31 |
| *** dmacpher has joined #tripleo | 15:32 | |
| dmsimard | sshnaidm|rover: http://logs.openstack.org/28/525228/2/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/d356eb7/job-output.txt.gz#_2017-12-04_15_19_14_167228 | 15:32 |
| dmsimard | sshnaidm|rover: all the jobs in our unbound patch failed: https://review.openstack.org/#/c/525228/ | 15:32 |
| sshnaidm|rover | dmsimard, omg.. will look after a mtg | 15:33 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 15:33 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 15:33 |
| EmilienM | dmsimard: | 15:33 |
| EmilienM | dmsimard: no I didn't see it | 15:33 |
| dmsimard | weshay, trown ^ ? | 15:33 |
| EmilienM | but I just started my day tbh | 15:33 |
| *** moshele has quit IRC | 15:33 | |
| sshnaidm|rover | http://logs.openstack.org/28/525228/2/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/d356eb7/job-output.txt.gz#_2017-12-04_15_19_14_058496 | 15:34 |
| sshnaidm|rover | No matching distribution found for python-cinderclient>=3.0.0 (from python-openstackclient->-r requirements.txt (line 10)) | 15:34 |
| *** gbarros has joined #tripleo | 15:35 | |
| EmilienM | jfrancoa: do we already have a bug for upgrade job failing in stable/pike? I created https://bugs.launchpad.net/tripleo/+bug/1714105 a few months ago, maybe I can close it | 15:36 |
| openstack | Launchpad bug 1714105 in tripleo "Upgrade jobs don't work on stable/pike" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 15:36 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Run Octavia configuration on the overcloud https://review.openstack.org/508195 | 15:36 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia to scenario002 (containers only) https://review.openstack.org/518331 | 15:36 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart master: WIP: use cachable facts to allow multiple runs https://review.openstack.org/525237 | 15:36 |
| EmilienM | chandankumar: do you have any progress on https://storyboard.openstack.org/#!/story/2001253 ? https://bugs.launchpad.net/tripleo/+bug/1725311 ? | 15:37 |
| openstack | Launchpad bug 1725311 in tripleo "Tempest Swift tests run on scenario004 (with Ceph RGW, not Swift)" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 15:37 |
| jfrancoa | EmilienM: yes, chem created one last week and we have been focusing our efforts in stabilize the job again (it's one issue after another) https://bugs.launchpad.net/tripleo/+bug/1734353 | 15:37 |
| openstack | Launchpad bug 1734353 in tripleo "[pike] [ci] containers-multinode-upgrades-pike job is broken due to missing puppet class." [High,In progress] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 15:37 |
| *** ramishra has quit IRC | 15:38 | |
| EmilienM | jfrancoa: cool, thx | 15:38 |
| EmilienM | jfrancoa: I'll close mine? | 15:38 |
| EmilienM | s/?/./ | 15:38 |
| mwhahaha | slagle: that was one of them, i think there was another but i'll keep a look out | 15:38 |
| slagle | shardy: k, i'll have a look | 15:38 |
| jfrancoa | EmilienM: np, yes you can. We are tracking the issue | 15:38 |
| *** adarazs is now known as adarazs_afk | 15:39 | |
| *** sai_ has joined #tripleo | 15:40 | |
| *** apetrich has quit IRC | 15:40 | |
| *** colonwq has joined #tripleo | 15:43 | |
| *** jkilpatr has joined #tripleo | 15:43 | |
| *** aputtur_ has joined #tripleo | 15:44 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: Reduce the calls to heat when downloading config https://review.openstack.org/525236 | 15:44 |
| dmsimard | sshnaidm|rover: I don't see https://github.com/openstack/tripleo-quickstart/blob/master/quickstart.sh#L160 being used anywhere ? It looks like the virtualenv is not sourced.. | 15:45 |
| dmsimard | oh it's before the set -ex so we're not seeing it in verbose.. | 15:46 |
| sshnaidm|rover | dmsimard, we didn't change anything related to it, maybe mirror failure? | 15:46 |
| sshnaidm|rover | dmsimard, locally I install: | 15:47 |
| sshnaidm|rover | Collecting python-cinderclient>=3.0.0 (from python-openstackclient->-r requirements.txt (line 10)) | 15:47 |
| sshnaidm|rover | Downloading python_cinderclient-3.2.0-py2.py3-none-any.whl (317kB) | 15:47 |
| sshnaidm|rover | 100% |################################| 327kB 17.6MB/s | 15:47 |
| openstackgerrit | David Moreau Simard proposed openstack/tripleo-quickstart master: Move set -ex to occur before activate_venv https://review.openstack.org/525241 | 15:47 |
| sshnaidm|rover | dmsimard, pabelanger can you please check if it's problem with pypi mirror in infra? | 15:48 |
| dmsimard | sshnaidm|rover: oh, you're right: http://logs.openstack.org/28/525228/2/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/d356eb7/job-output.txt.gz#_2017-12-04_15_19_13_434493 | 15:48 |
| sshnaidm|rover | dmsimard, pabelanger it doesn't find python_cinderclient-3.2.0 | 15:48 |
| dmsimard | sshnaidm|rover: I don't think it'd be an issue with mirrors but let me check | 15:48 |
| sshnaidm|rover | dmsimard, I can install it locally, so it presents on pypi | 15:49 |
| *** mmethot is now known as mmethot|away | 15:50 | |
| *** cylopez has quit IRC | 15:55 | |
| *** trown is now known as trown|brb | 15:58 | |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-common master: Add OVN Metadata Agent to containerized environments https://review.openstack.org/525182 | 15:58 |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-common master: Add OVN Metadata Agent to containerized environments https://review.openstack.org/525182 | 16:02 |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for containerized OVN Metadata Agent https://review.openstack.org/525164 | 16:02 |
| dmsimard | We found the issue for the ansible-playbook commands failing, it's infrastructure related | 16:03 |
| EmilienM | sweet | 16:04 |
| *** cylopez has joined #tripleo | 16:05 | |
| sshnaidm|rover | dmsimard, so no disk space for python-cinderclient? | 16:06 |
| dmsimard | yes | 16:06 |
| dmsimard | they'll fix the disk space issue then we'll need to re-sync the mirror | 16:06 |
| dmsimard | might take a while | 16:06 |
| *** jkilpatr has quit IRC | 16:07 | |
| *** trown|brb is now known as trown | 16:07 | |
| *** jkilpatr has joined #tripleo | 16:07 | |
| *** morazi has quit IRC | 16:08 | |
| EmilienM | flaper87: https://review.openstack.org/#/c/494470/ - I don't want to block you but if you can do it in the same patch it's good otherwise later but please don't miss it | 16:08 |
| *** abregman is now known as abregman|afk | 16:09 | |
| *** ramishra has joined #tripleo | 16:09 | |
| *** dbecker has quit IRC | 16:09 | |
| * flaper87 clicks and reads | 16:09 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736137 | 16:10 |
| openstack | Launchpad bug 1736137 in tripleo "CI: containers multinode gate job fails on tempest configuration" [Critical,Triaged] | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736184 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1736184 in tripleo "CI: TripleO jobs fail because not finding pytjon-cinderclient in PyPi mirror" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 16:10 |
| flaper87 | EmilienM: the job still doesn't work, fwiw. I'd rather do that when it is working and passing | 16:10 |
| flaper87 | EmilienM: if you agree | 16:10 |
| flaper87 | lemme comment on gerrit | 16:10 |
| EmilienM | flaper87: ok I'll approve it | 16:10 |
| EmilienM | flaper87: that's fine | 16:10 |
| flaper87 | coolio | 16:11 |
| flaper87 | thanks | 16:11 |
| EmilienM | flaper87: now we have the bits merged, maybe we can stabilize the ci job? | 16:11 |
| flaper87 | that's been my focus since last week | 16:11 |
| *** dparkes has quit IRC | 16:11 | |
| flaper87 | cleaning the patch to stabilize the CI job | 16:11 |
| EmilienM | nice | 16:12 |
| *** suuuper has quit IRC | 16:14 | |
| dmsimard | EmilienM: do we really need all those projects in required-projects btw https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/base.yaml#L13 ? It's causing the job preparation to take over 5 minutes: https://i.imgur.com/upYA0O1.png | 16:15 |
| EmilienM | dmsimard: you know what | 16:15 |
| EmilienM | it's an excellent question, I wanted to try removing them and see what happens | 16:16 |
| dmsimard | EmilienM: required-projects prepares the repositories in the workspace so that they can be used by the job -- if you use depends-on it is automatically prepared without needing to add it in required-projects | 16:16 |
| EmilienM | I never understood why we have that, is it for zuul-cloner? | 16:16 |
| *** nyechiel has quit IRC | 16:16 | |
| dmsimard | EmilienM: ah, if you still use legacy zuul-cloner, then it might be required yes | 16:16 |
| dmsimard | hmm, so basically you need to put the whole world in required-projects on the offchance that you might need to zuul-clone one of them ? | 16:17 |
| EmilienM | dmsimard: do we? | 16:17 |
| EmilienM | dmsimard: I can send a patch that remove these things | 16:17 |
| dmsimard | EmilienM: if you still use zuul-cloner, it needs to be in required-projects | 16:17 |
| dmsimard | but this also means there's an edge case that was missed in the current zuul deisng | 16:18 |
| dmsimard | design* | 16:18 |
| dmsimard | I'll bring it up in #zuul | 16:18 |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for OVN Metadata Agent https://review.openstack.org/502943 | 16:18 |
| EmilienM | dmsimard: I don't get it, tbh | 16:18 |
| dmsimard | zuul-cloner no longer exists in v3 | 16:18 |
| dmsimard | it's merely a shim that retrieves what zuul v3 prepared (by means of required-projects) | 16:19 |
| *** dpawar has joined #tripleo | 16:20 | |
| *** dpawar has quit IRC | 16:21 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Update .gitreview. https://review.openstack.org/524142 | 16:21 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Update .gitreview. https://review.openstack.org/524142 | 16:22 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Configure scenario image for tempest https://review.openstack.org/525084 | 16:23 |
| openstackgerrit | Merged openstack/puppet-tripleo master: ironic: support enabling staging drivers https://review.openstack.org/523082 | 16:23 |
| openstackgerrit | Merged openstack/puppet-tripleo master: ironic: add support for the ansible deploy method https://review.openstack.org/523085 | 16:23 |
| openstackgerrit | Merged openstack/tripleo-common master: IPv6 healthcheck fixes for Glance/Swift https://review.openstack.org/524876 | 16:23 |
| *** dpawar has joined #tripleo | 16:28 | |
| trozet | flaper87, EmilienM: can you refresh my memory on executing puppet for containers. Is that done on the overcloud and and then the generated config files are saved on the overcloud to be mounted again when the service is started in deployment? | 16:28 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Specify docker.io defaults for upstream config release files. https://review.openstack.org/520639 | 16:28 |
| flaper87 | trozet: it's all done in the overcloud node | 16:28 |
| trozet | flaper87: ok thanks | 16:29 |
| *** abregman|afk is now known as abregman | 16:29 | |
| *** itlinux has joined #tripleo | 16:31 | |
| *** artom_ has quit IRC | 16:32 | |
| *** artom has joined #tripleo | 16:32 | |
| *** ramishra has quit IRC | 16:33 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates stable/pike: Run rabbitmq_policy,rabbitmq_user with pacemaker https://review.openstack.org/524871 | 16:33 |
| *** athomas has quit IRC | 16:35 | |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Add OVN metadata agent service to scenario007 job https://review.openstack.org/522813 | 16:35 |
| dmsimard | EmilienM: examples: http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/playbooks/tripleo-buildimage/run.yaml#n24 && http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/playbooks/tripleo-ci/run.yaml#n22 | 16:40 |
| dmsimard | EmilienM: these zuul-cloner commands will fail if the projects there aren't in the required-projects list | 16:40 |
| *** trozet has quit IRC | 16:41 | |
| *** thrash is now known as thrash|biab | 16:42 | |
| *** ffiore has quit IRC | 16:42 | |
| *** myoung|ruck is now known as myoung|ruck|bbl | 16:42 | |
| bugzy | dsneddon: made some minor modifications to the docs at https://etherpad.openstack.org/p/composable-networking-docs but I am not sure that I made the modifications according to the style of standard that you may be looking for. Also, I think a point that I included as a note should be its own section. | 16:43 |
| bugzy | style or standard* | 16:43 |
| *** jpena is now known as jpena|brb | 16:43 | |
| *** jeblair has joined #tripleo | 16:43 | |
| *** stendulker has joined #tripleo | 16:44 | |
| *** itlinux has quit IRC | 16:46 | |
| EmilienM | dmsimard: so what we do? | 16:46 |
| *** bogdando has quit IRC | 16:46 | |
| openstackgerrit | Merged openstack/tripleo-common master: Add support for ceph_rbdmirror_ansible_vars from tht https://review.openstack.org/520658 | 16:47 |
| shardy | bugzy, dsneddon: FYI I also have some composable networks docs in progress at https://review.openstack.org/#/c/521493/ | 16:49 |
| shardy | would be good to combine these efforts when you're ready | 16:50 |
| *** itlinux has joined #tripleo | 16:50 | |
| *** aputtur_ has quit IRC | 16:51 | |
| *** marios has quit IRC | 16:52 | |
| weshay | arxcruz, FYI.. stackwiz is broken again afaict | 16:53 |
| *** adarazs_afk is now known as adarazs | 16:53 | |
| *** shreshtha has quit IRC | 16:54 | |
| *** ffiore has joined #tripleo | 16:54 | |
| *** jfrancoa has quit IRC | 16:56 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] split playbooks https://review.openstack.org/525252 | 16:56 |
| *** nyechiel has joined #tripleo | 16:57 | |
| *** jkilpatr has quit IRC | 17:00 | |
| *** nyechiel has quit IRC | 17:03 | |
| *** ukalifon has quit IRC | 17:05 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Make CephPools override properties of other pools https://review.openstack.org/525213 | 17:05 |
| gfidente | bandini but that seems unrelated no? | 17:09 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-docs master: Add composable networks documentation https://review.openstack.org/521493 | 17:09 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736184 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1736184 in tripleo "CI: TripleO OVB jobs fail because not finding pytjon-cinderclient in PyPi mirror" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 17:10 |
| bandini | gfidente: yep is unrelated | 17:11 |
| bugzy | mwhahaha: I have encountered a bug on Pike that is related to https://bugs.launchpad.net/tripleo/+bug/1697722; I am not sure whether the bug should be reopened or whether to file a new report. | 17:11 |
| openstack | Launchpad bug 1697722 in tripleo "Using external network for MysqlNetwork results in deployment failure" [Medium,Fix released] - Assigned to Alex Schultz (alex-schultz) | 17:11 |
| bugzy | mwhahaha: essentially, while dsneddon was helping me out with composable networks, I discovered that whenever the MysqlNetwork is mapped to any name other than an expected network | 17:11 |
| bugzy | name (or set of names, perhaps internal_api, storage, storage_mgmt, tenant, management, and ctrlplane) the deployment failed with [ERROR] /usr/libexec/mysqld: option '--bind-address' requires an argument" | 17:11 |
| gfidente | bandini basically I think empty string is less broken than .novalocal | 17:11 |
| gfidente | bandini but you probably prefer revert it entirely? | 17:12 |
| *** ffiore has quit IRC | 17:12 | |
| bandini | gfidente: tbh I am not sure :/ | 17:12 |
| mwhahaha | bugzy: file a new bug, as it's a regression | 17:12 |
| gfidente | bandini also empty string matches overcloud so ... | 17:12 |
| bandini | gfidente: I am not too familiar with the whole thing | 17:12 |
| gfidente | ... at least they behave similarily | 17:12 |
| bandini | gfidente: let's try empty and then we will see | 17:12 |
| *** pkovar has quit IRC | 17:14 | |
| EmilienM | mwhahaha: I'm a bit worried about https://review.openstack.org/#/c/487450/ | 17:15 |
| *** ebarrera has quit IRC | 17:15 | |
| EmilienM | since when we configure services that way | 17:15 |
| mwhahaha | EmilienM: ditto | 17:15 |
| mwhahaha | EmilienM: since we allowed ceph-ansible shenanigans | 17:15 |
| mwhahaha | EmilienM: i think the reasoning for that was they needed to do it after the steps because it's dependenant on vswitch or something | 17:16 |
| mwhahaha | EmilienM: but since we moved that to step4, i'm not sure how valid that is anymore | 17:16 |
| shardy | EmilienM, mwhahaha, oidgar: Can that be done via external_post_deploy_tasks instead? | 17:16 |
| *** oidgar has quit IRC | 17:16 | |
| shardy | I added that interface for exactly this reason | 17:16 |
| shardy | https://review.openstack.org/#/c/522312/ | 17:16 |
| EmilienM | yeah | 17:17 |
| EmilienM | shardy: can you comment the patch eventually? I'm not in favor of its current design | 17:17 |
| *** nyechiel has joined #tripleo | 17:17 | |
| shardy | it'd probably be easier to understand (and debug) if the implementation was reworked to do that | 17:17 |
| shardy | EmilienM: sure | 17:17 |
| *** udesale has quit IRC | 17:17 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-common master: Always load rsyslog-base container https://review.openstack.org/521529 | 17:18 |
| EmilienM | beagles: ^ fyi | 17:18 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Add incoming storage driver param https://review.openstack.org/524248 | 17:19 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-common master: Include barbican worker and listener images if API is enabled https://review.openstack.org/522220 | 17:19 |
| EmilienM | shardy: also I don't like the templating of octavia config tbh | 17:19 |
| mwhahaha | we shouldn't need to template the ocatavia bits | 17:20 |
| openstackgerrit | Pradeep Kilambi proposed openstack/puppet-tripleo master: Add incoming storage driver param https://review.openstack.org/524240 | 17:20 |
| shardy | EmilienM: yeah it seems pretty risky | 17:20 |
| *** tesseract has quit IRC | 17:20 | |
| beagles | EmilienM, yup we were aware of the external_post_deploy_tasks - we were nailing down the functionality of the work in progress (which it seems to be at this point) | 17:21 |
| shardy | beagles: ack np - I recall we discussed this just wasn't clear on the intended direction | 17:21 |
| beagles | EmilienM, shardy, mwhahaha: not sure what you mean by the above though | 17:21 |
| beagles | by templating of octavia, etc | 17:22 |
| shardy | beagles: where do the templated ifcfg files end up? | 17:22 |
| mwhahaha | beagles: https://review.openstack.org/#/c/487450/57/playbooks/roles/octavia-controller-config/templates/octavia-post-deploy.conf.j2 | 17:22 |
| mwhahaha | beagles: that's a templated conf file | 17:23 |
| mwhahaha | https://review.openstack.org/#/c/487450/57/playbooks/roles/octavia-controller-config/templates/worker-post-deploy.conf.j2 | 17:23 |
| mwhahaha | same | 17:23 |
| beagles | mwhahaha, oic these files end up on the node that's running octavia health manager and controller worker | 17:23 |
| mwhahaha | beagles: right so that should exist in puppet usually | 17:23 |
| mwhahaha | i haven't dived in to see the whole thing but this seems more of an after the fact hack rather than a proper integration | 17:24 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Introduce fs035, ovb-ha-ipv6 https://review.openstack.org/522615 | 17:24 |
| openstackgerrit | Merged openstack/os-apply-config master: Remove -U from pip install https://review.openstack.org/524891 | 17:24 |
| openstackgerrit | Merged openstack/os-collect-config master: Remove -U from pip install https://review.openstack.org/524889 | 17:24 |
| openstackgerrit | Merged openstack/os-refresh-config master: Remove -U from pip install https://review.openstack.org/524886 | 17:24 |
| mwhahaha | my concern about these ansible playbook integrations is understaneding who/what opens the service and it's config | 17:24 |
| beagles | mwhahaha, that may be possible.. it's tricky because we need to do things like create neutron ports in the overcloud to get that data | 17:25 |
| mwhahaha | beagles: which should be easier with the docker_config interfaces | 17:25 |
| shardy | Yeah I was just looking at how that's done in the tasks | 17:25 |
| *** jpena|brb is now known as jpena | 17:25 | |
| mwhahaha | beagles: i have a feeling most of this needs to get put into the docker_config | 17:26 |
| mwhahaha | and not a seperate set of playbooks | 17:26 |
| *** rlandy is now known as rlandy|brb | 17:26 | |
| mwhahaha | like the creation of ssh keys | 17:27 |
| mwhahaha | that should be done via tripleoclient and just be metadata | 17:27 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Move step 1 preparation to deploy-steps-tasks.yaml https://review.openstack.org/525260 | 17:27 |
| mwhahaha | the way we do tls | 17:27 |
| beagles | mwhahaha, might be more doable now than it used to be - what we require is access the overcloud credentials | 17:27 |
| beagles | mwhahaha, because this is an aaS type of deal, the keys are created against the overcloud's nova ,etc | 17:28 |
| EmilienM | dmsimard: so back on zuul-cloner/required-projects - what's the plan now? | 17:28 |
| beagles | mwhahaha, same as with the neutron port, the amphora image etc | 17:28 |
| mwhahaha | beagles: the creation of the ca/ssh keys? | 17:28 |
| beagles | mwhahaha, the ssh keys yep | 17:29 |
| beagles | mwhahaha, the CA keys are a different sort of deal | 17:30 |
| dmsimard | EmilienM: the projects that aren't zuul-cloned can be removed | 17:30 |
| mwhahaha | beagles: i'm not sure about that as we do have interfaces to generate those as part of the deployment. anyway i'm going to take a look at that review today | 17:31 |
| beagles | mwhahaha, cool thanks | 17:31 |
| dsneddon | bugzy, Looking at that bug, it looks to me like it was fixed only for the case of moving the DB to the External newtork. Were you trying to move it there, or to a custom network? | 17:31 |
| EmilienM | dmsimard: how do we know which ones aren't zuul-cloned? | 17:32 |
| dmsimard | EmilienM: however we need to take into account that zuul-cloner prepares the projects in $HOME/workspace/<namespace>/<project> i.e, $HOME/workspace/openstack/nova while required-projects prepares them in $HOME/src/git.openstack.org/<namespace>/<project>. | 17:32 |
| EmilienM | dmsimard: the ones we don't deploy with delorean? | 17:32 |
| *** dsariel has quit IRC | 17:32 | |
| dmsimard | EmilienM: http://codesearch.openstack.org/?q=zuul-cloner&i=nope&files=&repos= ? | 17:33 |
| bugzy | dsneddon: yes to a custom network | 17:33 |
| *** dbecker has joined #tripleo | 17:34 | |
| EmilienM | dmsimard: you're very smart | 17:34 |
| dmsimard | :/ | 17:35 |
| EmilienM | dmsimard: so iiuc. We need to keep the list just for the projects that we actually zuul-clone ourselves in our scripts and drop the rest (Depends-On thing is automagically handled and Delorean will work) | 17:37 |
| EmilienM | is that correct? | 17:37 |
| bugzy | /away/ | 17:37 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Move step 1 preparation to deploy-steps-tasks.yaml https://review.openstack.org/525260 | 17:37 |
| dsneddon | bugzy, I think we probably need a similar fix for custom networks, right now I'm not even sure if they get a FQDN. | 17:37 |
| mwhahaha | beagles: so why the new image in the undercloud for octavia? i guess i'm missing what exactly is the deployment process for octavia, is there documentation that I can refer to? | 17:37 |
| dmsimard | EmilienM: so I looked and the dlrn build part doesn't actually use zuul-cloner anymore | 17:38 |
| beagles | mwhahaha, the image is actually in the overcloud | 17:38 |
| dmsimard | EmilienM: it parses things and ends up doing a git clone and git checkout of the refspec | 17:38 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Add S3 storage driver as an option and its config https://review.openstack.org/521093 | 17:38 |
| mwhahaha | beagles: so why can't we just use the glance_image provider? | 17:38 |
| mwhahaha | beagles: the playbook is misleading because that runs on the undercloud | 17:38 |
| *** gkadam_ has quit IRC | 17:38 | |
| dmsimard | EmilienM: if there are things that we still zuul-clone, we need to understand why and potentially remove them altogether (because it's handled by required-projects) BUT like I said, the paths do change so there might be things to handle there | 17:39 |
| *** thrash|biab is now known as thrash | 17:39 | |
| EmilienM | dmsimard: maybe we can just drop the list and see how CI works | 17:39 |
| EmilienM | and iterate | 17:39 |
| *** dpawar has quit IRC | 17:40 | |
| beagles | mwhahaha, I see the point.. the amphora would be obtained somehow (like installed as part of an rpm) then uploaded into the overcloud .. the undercloud being a singleton in this case seemed okay for that | 17:40 |
| *** rlandy|brb is now known as rlandy | 17:40 | |
| dmsimard | EmilienM, mwhahaha, sshnaidm|rover: the "ansible-playbook command not found" issue should be fixed, the PyPi mirror should be okay now | 17:40 |
| mwhahaha | beagles: right but that seems like something that should occur on the controller. generally in later steps we do have access to the cloud. Now I know historically there is a problem with using puppet to get some of the data points of dynamic things | 17:41 |
| beagles | mwhahaha, the amphora is sort of a load balancing appliance vm | 17:41 |
| mwhahaha | beagles: but that doesn't mean we should do all the things externally as I think some of this can just be done normally | 17:41 |
| mwhahaha | beagles: so i'm trying ot understand the actual deployment steps and their requirements to ensure they get dropped in the right spots | 17:42 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP - zuul/tripleo-ci-dsvm: remove required-projects https://review.openstack.org/525265 | 17:42 |
| beagles | mwhahaha, sure | 17:42 |
| EmilienM | dmsimard: testing ^ | 17:42 |
| *** noslzzp has quit IRC | 17:43 | |
| *** yprokule has quit IRC | 17:45 | |
| *** iranzo has quit IRC | 17:45 | |
| dmsimard | EmilienM: why does tripleo still use devstack-gate btw ? | 17:46 |
| EmilienM | dmsimard: AFIK we use(+d?) some functions from there. | 17:46 |
| EmilienM | but i think we've get rid of it | 17:46 |
| EmilienM | tbh I'm not sure | 17:47 |
| dmsimard | the ovs bridges part | 17:47 |
| dmsimard | but the functions were copied over | 17:47 |
| dmsimard | devstack-gate is deprecated at this point, I think even devstack no longer uses it | 17:47 |
| dmsimard | The stuff that devstack-gate did are mostly covered by zuul-v3 base jobs | 17:47 |
| EmilienM | yeah I know | 17:48 |
| EmilienM | I think we don't use it anymore | 17:48 |
| dmsimard | well you use it, yes | 17:48 |
| dmsimard | but whether you need to use it, I don't know | 17:48 |
| dmsimard | it would be great to get rid of it if you can tbh | 17:48 |
| *** lucasagomes is now known as lucas-afk | 17:49 | |
| dmsimard | who would know why we want to run devstack-gate ? | 17:49 |
| chandankumar | EmilienM: not yet started, we will get it done soon | 17:50 |
| EmilienM | chandankumar: ack | 17:50 |
| EmilienM | dmsimard: we can see in tripleo-ci, where we use it | 17:50 |
| *** jkilpatr has joined #tripleo | 17:50 | |
| EmilienM | yeah we run: source $TRIPLEO_ROOT/devstack-gate/functions.sh | 17:51 |
| dmsimard | https://github.com/openstack-infra/tripleo-ci/blob/master/playbooks/tripleo-ci/run.yaml#L13-L100 | 17:51 |
| EmilienM | in multinode_setup | 17:51 |
| EmilienM | but AFIK it was for networking | 17:51 |
| dmsimard | there's a role for that in v3 | 17:52 |
| EmilienM | and pabelanger imported the function in tripleo-ci | 17:52 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Updated from global requirements https://review.openstack.org/525010 | 17:52 |
| EmilienM | dmsimard: maybe, but we'll need help to use it | 17:52 |
| EmilienM | there are probably shiny things that we don't know | 17:52 |
| EmilienM | it's very hard to catch-up for us, it's moving super fast and not a lot of folks worked on that zuulv3 transition on our side | 17:52 |
| dmsimard | https://github.com/openstack-infra/zuul-jobs/tree/master/roles/multi-node-bridge is the equivalent of what devstack-gate did with the ovs roles here https://github.com/openstack-infra/devstack-gate/tree/master/playbooks/roles | 17:53 |
| dmsimard | I can try to take a stab at it | 17:53 |
| *** nyechiel has quit IRC | 17:53 | |
| EmilienM | go4it | 17:54 |
| dmsimard | EmilienM: it's very likely an insane rabbit hole but w/e | 17:55 |
| *** ffiore has joined #tripleo | 17:55 | |
| *** moshele has joined #tripleo | 17:57 | |
| *** gfidente has quit IRC | 17:57 | |
| weshay | myoung|ruck|bbl, ping me when you are back pleased | 17:57 |
| *** dpawar has joined #tripleo | 17:58 | |
| *** trozet has joined #tripleo | 17:58 | |
| *** gfidente has joined #tripleo | 17:59 | |
| *** gfidente has quit IRC | 17:59 | |
| *** gfidente has joined #tripleo | 17:59 | |
| *** trown is now known as trown|lunch | 18:00 | |
| *** moshele has quit IRC | 18:03 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Prepend errors file with prefix for logstash index https://review.openstack.org/525268 | 18:06 |
| *** dtantsur is now known as dtantsur|afk | 18:08 | |
| *** nyechiel has joined #tripleo | 18:09 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Layout components updates https://review.openstack.org/516361 | 18:10 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Modals with react-bootstrap https://review.openstack.org/516362 | 18:10 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Rework ModalPanel to be based on react-overlays https://review.openstack.org/516364 | 18:10 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: ModalPanel vs Validations sidebar positioning https://review.openstack.org/516365 | 18:10 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add modal closing components https://review.openstack.org/520366 | 18:10 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add release notes for Modals and Validations sidebar changes https://review.openstack.org/524101 | 18:10 |
| *** apetrich has joined #tripleo | 18:14 | |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for OVN Metadata Agent https://review.openstack.org/502943 | 18:17 |
| *** abregman has quit IRC | 18:19 | |
| *** jpena is now known as jpena|away | 18:20 | |
| *** hewbrocca is now known as hewbrocca_afk | 18:20 | |
| *** ffiore has quit IRC | 18:21 | |
| *** ffiore has joined #tripleo | 18:22 | |
| openstackgerrit | Merged openstack/tripleo-ipsec master: Add zuul.d directory with openstack-ansible-linter jobs https://review.openstack.org/525064 | 18:22 |
| *** aufi has quit IRC | 18:22 | |
| openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Add OVN metadata agent service to scenario007 job https://review.openstack.org/522813 | 18:23 |
| *** sshnaidm|rover is now known as sshnaidm|off | 18:23 | |
| *** dpawar has quit IRC | 18:24 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Add ui_validate_simple to the logs collected https://review.openstack.org/523461 | 18:25 |
| *** tosky has quit IRC | 18:28 | |
| *** trozet has quit IRC | 18:28 | |
| *** iranzo has joined #tripleo | 18:34 | |
| *** fultonj has quit IRC | 18:35 | |
| *** fultonj has joined #tripleo | 18:37 | |
| *** moshele has joined #tripleo | 18:40 | |
| *** ffiore has quit IRC | 18:42 | |
| *** moshele has quit IRC | 18:42 | |
| *** gkadam_ has joined #tripleo | 18:47 | |
| *** jpena|away is now known as jpena|off | 18:48 | |
| *** jpich has quit IRC | 18:48 | |
| *** salmankhan has quit IRC | 18:50 | |
| dmsimard | EmilienM: looking at the devstack-gate stuff | 18:53 |
| dmsimard | there's so many tangled up assumptions everywhere I don't know where to look :( | 18:53 |
| *** fragatina has quit IRC | 18:53 | |
| dmsimard | I'd seriously end up just re-writing the entire thing which I don't have bandwidth for right now | 18:54 |
| *** milan_ has quit IRC | 18:56 | |
| *** tosky has joined #tripleo | 19:04 | |
| *** etingof has quit IRC | 19:06 | |
| *** fultonj has quit IRC | 19:06 | |
| openstackgerrit | Liz Blanchard proposed openstack/tripleo-ui master: Remove trash icon from delete node modal https://review.openstack.org/525281 | 19:07 |
| *** paramite has quit IRC | 19:07 | |
| *** fultonj has joined #tripleo | 19:14 | |
| *** stendulker has quit IRC | 19:17 | |
| *** trown|lunch is now known as trown | 19:18 | |
| openstackgerrit | Toure Dunnon proposed openstack/tripleo-common master: Migrate the ansible actions from tripleo-common to mistral-extra. https://review.openstack.org/523540 | 19:20 |
| *** myoung|ruck|bbl is now known as myoung|ruck | 19:21 | |
| openstackgerrit | Ian Main proposed openstack/tripleo-quickstart-extras master: DNM: Update quickstart extras with undercloud install for containers https://review.openstack.org/517444 | 19:25 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Introduce tripleo-bootstrap Ansible role https://review.openstack.org/525285 | 19:28 |
| EmilienM | slagle: ^ | 19:28 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Introduce tripleo-bootstrap Ansible role https://review.openstack.org/525285 | 19:29 |
| slagle | EmilienM: ok cool. | 19:29 |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Disable /etc/hosts checks until we determine requirements. https://review.openstack.org/525286 | 19:29 |
| EmilienM | dmsimard: nobody has this time | 19:29 |
| *** rwsu has quit IRC | 19:29 | |
| EmilienM | dmsimard: have you looked into tripleo-ci repo? | 19:30 |
| dmsimard | EmilienM: yeah we'd need to be.. like.. an entire team in an office for a week | 19:30 |
| dmsimard | EmilienM: I have | 19:30 |
| EmilienM | dmsimard: maybe we can send a patch to see what happens if we stop cloning devstack-gate | 19:30 |
| dmsimard | EmilienM: I already traced down a few rabbits, it's a tangled mess | 19:30 |
| EmilienM | slagle: if we go that path, I would patch the tripleo-common distgit right now, so we can start playing with it in CI | 19:31 |
| slagle | EmilienM: so the next step would be to include the role somewhere, probably in tht in deploy-steps.j2 | 19:31 |
| slagle | right after the gather facts | 19:31 |
| dmsimard | EmilienM: There's assumptions like running from /opt/stack/new (which is set up by devstack-gate), or working from within a directory called workspace, etc. I went deep enough and came back out before I was too deep. | 19:32 |
| dmsimard | https://github.com/openstack-infra/tripleo-ci/blob/master/toci_gate_test-oooq.sh is not really friendly either | 19:32 |
| *** mcornea has quit IRC | 19:33 | |
| dmsimard | sorry for giving up so soon, I have other priorities in the short term | 19:33 |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Generate undercloud-passwords.conf and fix output dir. https://review.openstack.org/523511 | 19:33 |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Disable /etc/hosts checks until we determine requirements. https://review.openstack.org/525286 | 19:33 |
| EmilienM | slagle: I sent https://review.rdoproject.org/r/10809 - but I'm unsure this is the right path for Ansible roles | 19:34 |
| openstackgerrit | Merged openstack/python-tripleoclient stable/pike: Add mock to avoid writing missing files to disk https://review.openstack.org/525163 | 19:34 |
| *** jkilpatr has quit IRC | 19:34 | |
| openstackgerrit | Ian Main proposed openstack/tripleo-quickstart master: DNM: Update undercloud install options for containers https://review.openstack.org/517445 | 19:35 |
| EmilienM | sdoran: could you please review https://review.rdoproject.org/r/#/c/10809 and https://review.openstack.org/#/c/525285 ? | 19:36 |
| sdoran | Sure thing! | 19:36 |
| *** fragatina has joined #tripleo | 19:37 | |
| EmilienM | slagle: ok, i'm looking at deploy-steps.j2 now | 19:40 |
| EmilienM | slagle: could you confirm we want to execute this role for all hosts, right? | 19:42 |
| EmilienM | (not just the undercloud) | 19:42 |
| slagle | EmilienM: yea, all hosts | 19:44 |
| *** artom has quit IRC | 19:47 | |
| *** artom has joined #tripleo | 19:48 | |
| *** trozet has joined #tripleo | 19:51 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: deploy-steps.j2: use ansible to bootstrap environment https://review.openstack.org/525291 | 19:51 |
| EmilienM | slagle: ^ feedback welcome | 19:51 |
| *** florianf|afk is now known as florianf | 19:55 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP - zuul/tripleo-ci-dsvm: remove required-projects https://review.openstack.org/525265 | 19:57 |
| EmilienM | dmsimard: trying to keep devstack-gate repo ^ | 19:57 |
| *** itlinux has quit IRC | 20:01 | |
| *** nyechiel has quit IRC | 20:03 | |
| EmilienM | mwhahaha: I'm about to prepare tripleo-queens-m2 | 20:04 |
| shardy | EmilienM, slagle: commented, I've been looking at reworking things such as the common/deploy-steps-tasks to make them easier to reuse via include_role, but I wonder if we need something more pluggable? | 20:04 |
| shardy | e.g it seems like a way to include arbitrary roles would be useful, I'm wondering if include_role via deploy_steps_tasks is enough - I'm not sure if you can nest includes like that though | 20:05 |
| EmilienM | shardy: like a new composable service? | 20:05 |
| EmilienM | using deploy_steps_tasks ? | 20:06 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Use ansible-playbook in place of quickstart.sh https://review.openstack.org/525294 | 20:06 |
| shardy | EmilienM: yes that's what I was thinking | 20:06 |
| EmilienM | shardy: but from what I understand you need to bootstrap something before being able to deploy any composable service, right? | 20:06 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Create /var/log/containers on Swift storage-only nodes https://review.openstack.org/525124 | 20:06 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove -U from pip install https://review.openstack.org/524883 | 20:06 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: Addition of Nuage bridge MTU parameter https://review.openstack.org/520163 | 20:06 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Addition of Nuage bridge MTU parameter https://review.openstack.org/519457 | 20:06 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Addition of Nuage bridge MTU parameter https://review.openstack.org/519455 | 20:06 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Fix networking settings for ObjectStorage role https://review.openstack.org/516019 | 20:06 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: scenario002: enable panko and ceilo-compute-agent https://review.openstack.org/524959 | 20:06 |
| shardy | EmilienM: Not when we switch to --config-download by default, then we just run ansible | 20:07 |
| shardy | AFAIK that's planned pretty soon but not sure of the latest status | 20:07 |
| EmilienM | ok | 20:07 |
| shardy | EmilienM: not blocking, just thinking about what a more generic approach would look like | 20:08 |
| EmilienM | I'm fine either way, let's see what slagle says | 20:08 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Introduce tripleo-bootstrap Ansible role https://review.openstack.org/525285 | 20:09 |
| EmilienM | sdoran: thanks for your first review | 20:09 |
| *** salmankhan has joined #tripleo | 20:09 | |
| *** athomas has joined #tripleo | 20:10 | |
| shardy | EmilienM: actually, with the group_vars stuff ansible does need the heat-config hooks | 20:10 |
| * EmilienM lunch | 20:13 | |
| *** salmankhan has quit IRC | 20:14 | |
| sdoran | EmilienM: Hope I did it right. Still getting used to the tool. | 20:16 |
| EmilienM | sdoran: you did perfectly, have you started to look at Gerrty? it's awesome as well | 20:17 |
| *** dhill_ has quit IRC | 20:18 | |
| openstackgerrit | Merged openstack/paunch master: Explicitly pull images before docker run https://review.openstack.org/522665 | 20:19 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Enable autoscaling tests in scenario002 https://review.openstack.org/504149 | 20:19 |
| *** matbu has quit IRC | 20:20 | |
| *** matbu_ has joined #tripleo | 20:22 | |
| EmilienM | tripleo queens m2 release proposed: https://review.openstack.org/#/c/525298/ | 20:22 |
| *** matbu has joined #tripleo | 20:22 | |
| flaper87 | slagle: replied here: https://review.openstack.org/#/c/494470/ | 20:22 |
| flaper87 | slagle: is your concern NetworkManager in general or just the nm bits in that patch? | 20:22 |
| *** matbu_ has quit IRC | 20:23 | |
| *** dhill_ has joined #tripleo | 20:23 | |
| dhill_ | EmilienM, ping | 20:24 |
| sdoran | EmilienM: Yup, got `gertty` setup and still getting used to it. | 20:24 |
| dhill_ | EmilienM, if a customer would like to change all the undercloud / overcloud IPs... it's not possible atm right ? | 20:25 |
| *** rwsu has joined #tripleo | 20:25 | |
| flaper87 | sdoran: gertty ++ | 20:27 |
| sdoran | I'm learning. ;) | 20:31 |
| *** moshele has joined #tripleo | 20:31 | |
| shardy | dhill_: No you can't change the provisioning IP on the undercloud, we explicitly disallow it because it breaks swift | 20:36 |
| shardy | https://github.com/openstack/instack-undercloud/blob/master/instack_undercloud/undercloud.py#L719 | 20:37 |
| shardy | dhill_: changing some overcloud IPs might work but it's not tested/supported AFAIK | 20:37 |
| dhill_ | shardy, should I create a RFE? | 20:37 |
| dhill_ | shardy, I mean, if customers want to move an undercloud / overcloud to a new range, the should be a way to do this wihtout redeploying everything ... | 20:37 |
| mwhahaha | dhill_: it's unlikely to be addressed anytime soon | 20:38 |
| mwhahaha | dhill_: it's a limitation more in neutron | 20:38 |
| shardy | dhill_: sure you can, I suspect given the previous issues around swift I don't think it's that likely | 20:38 |
| tdasilva | shardy, dhill_: changing overcloud IPs you might run into the same issues with swift on the overcloud | 20:38 |
| shardy | tdasilva: Yeah exactly - we don't have any way to deal with that atm | 20:39 |
| dhill_ | mwhahaha, we can't destroy a network and recreate a new one with different IPs ? I mean, the ports would be a problem maybe ? I'm just trying to understand why I know it's not supported and won't work and translate it to some ascii characters to ship it to the customer :) | 20:39 |
| shardy | I'd guess there's a bunch of fun corner cases in addition to the swift rings too | 20:39 |
| dhill_ | shardy, is that why sometimes the swift ring builds are rebuilt every deployment? :S | 20:39 |
| mwhahaha | dhill_: so doing it after the fact is an update, so it's a limitation around being able to update existing networks and configurations | 20:39 |
| mwhahaha | dhill_: reiping the entire environment is a massive change that we will most likely not support anytime soon | 20:40 |
| mwhahaha | dhill_: i mean you could file the rfe but it's not going to be accepted anytime in the near future | 20:40 |
| *** etingof has joined #tripleo | 20:40 | |
| dhill_ | mwhahaha, I know... but from a support perspective, it's better than nothing :) | 20:40 |
| dhill_ | mwhahaha, or we do it manually for the customer | 20:40 |
| shardy | dhill_: The reasons are (1) network configuration doesn't run by default on update, as doing it risks bouncing nics and fencing nodes (2) some services such as swift have internal state related to the networks/ips which would get broken due to the network ranges changing, (3) it's not tested so we can't really say with any certainty what will break, or how to fix it | 20:41 |
| shardy | dhill_: I appreciate it's not necessarily the answer you were looking for, but what you're asking for is a pretty risky operation IMO | 20:42 |
| shardy | unless it's only, say, the management network or something | 20:42 |
| dhill_ | shardy, no it's exactly what I expected ... just forgot about the swift rings | 20:42 |
| mwhahaha | customer needs to invest in some hefty network gear to do nats :D | 20:43 |
| dhill_ | lol | 20:43 |
| mwhahaha | that's a much less risky approach | 20:43 |
| dhill_ | mwhahaha, I thought openstack was supposed to run on cheap hardware and treat vms as cattles and not pets | 20:43 |
| mwhahaha | dhill_: sure, but you're talking networking not openstack :D | 20:43 |
| mwhahaha | ToR switches for openstack have always been not cheap hardware :D | 20:44 |
| dhill_ | mwhahaha, I thought dlink switches were fine for openstack :) | 20:44 |
| therve | If you care about ip ranges you're not doing cattle :) | 20:44 |
| mwhahaha | you and our customers | 20:44 |
| dhill_ | therve, I know ... it's not my cloud ;) | 20:44 |
| mwhahaha | 10baseT 4 life | 20:44 |
| dhill_ | meh serial connection is better | 20:44 |
| mwhahaha | 10base2 for life then | 20:45 |
| dhill_ | thank you guys for those answers | 20:45 |
| dhill_ | the only problem I have now | 20:45 |
| dhill_ | is if a customer have 100 computes | 20:45 |
| dhill_ | and wants to change a VLAN ... it's not supported | 20:45 |
| dhill_ | and that might be annoying in the context of a network administrator point of view | 20:46 |
| dhill_ | or can we change VLANs and not IPs ? | 20:46 |
| mwhahaha | you generally don't change vnlans at that scale | 20:46 |
| shardy | dhill_: changing a vlan isn't the same as changing the IP ranges? | 20:46 |
| dhill_ | shardy, well you could change a VLAN ID but keep the IP range ? | 20:46 |
| mwhahaha | and that can be a mapping at the ToR/Core | 20:46 |
| dhill_ | so basically, we have to tear everything down to build everything back up with new ips ... | 20:47 |
| mwhahaha | there's nothing that says the openstack vlan can't remain the same but outside of teh openstack env it's a different vlan | 20:47 |
| dhill_ | mwhahaha, that always depends | 20:47 |
| dhill_ | mwhahaha, I'm not a networking expert but if you really want to change a VLAN ID, you can't | 20:47 |
| dhill_ | mwhahaha, or a range | 20:47 |
| mwhahaha | at this point we're well outside director and that's how a custoemer deployed their hardware | 20:47 |
| mwhahaha | changing a vlan is usually a massive change | 20:47 |
| dhill_ | mwhahaha, sure | 20:48 |
| mwhahaha | cause it's going to have an outage | 20:48 |
| dhill_ | mwhahaha, yep | 20:48 |
| dhill_ | mwhahaha, exactly | 20:48 |
| mwhahaha | You could add a new one, migrate and cleanup the old one | 20:48 |
| mwhahaha | but it requires advanced knowledge | 20:48 |
| shardy | yeah, that *might* work if you enable os-net-config on update via NetworkDeploymentActions and take steps to ensure the nodes don't get fenced | 20:48 |
| dhill_ | mwhahaha, I don't mind about outages at this point because it's as you said, a major change... but we can't even have that outage hehe | 20:48 |
| dhill_ | shardy, you can disable fencing actually | 20:48 |
| mwhahaha | changing vlans could be done from a config standpoint, but i'm not sure the imact on neutron/nova | 20:49 |
| *** tzumainn_ has joined #tripleo | 20:51 | |
| *** jaosorior has quit IRC | 20:51 | |
| *** gkadam_ has quit IRC | 20:51 | |
| *** tzumainn has quit IRC | 20:52 | |
| *** artom has quit IRC | 20:53 | |
| *** artom has joined #tripleo | 20:54 | |
| *** pchavva has quit IRC | 20:55 | |
| *** tzumainn_ is now known as tzumainn | 20:55 | |
| *** almondjoy has joined #tripleo | 21:03 | |
| *** shardy has quit IRC | 21:05 | |
| *** itlinux has joined #tripleo | 21:05 | |
| bugzy | mwhahaha, dsneddon: the bug report is now filed -- https://bugs.launchpad.net/tripleo/+bug/1736254 | 21:06 |
| openstack | Launchpad bug 1736254 in tripleo "Using composable network or custom named network for MysqlNetwork results in deployment failure" [Undecided,New] | 21:06 |
| *** itlinux has quit IRC | 21:06 | |
| EmilienM | dmsimard: can you tell why it fails here? http://logs.openstack.org/65/525265/2/check/tripleo-ci-centos-7-containers-multinode/1a8d966/job-output.txt.gz#_2017-12-04_20_10_04_736094 | 21:06 |
| dsneddon | bugzy, Thanks, perfect. | 21:07 |
| EmilienM | dmsimard: http://logs.openstack.org/65/525265/2/check/tripleo-ci-centos-7-containers-multinode/1a8d966/logs/devstack-gate-setup-workspace-new.txt here it seems | 21:07 |
| dmsimard | EmilienM: missing zuul cloner reference ? http://logs.openstack.org/65/525265/2/check/tripleo-ci-centos-7-containers-multinode/1a8d966/logs/devstack-gate-setup-workspace-new.txt | 21:07 |
| dmsimard | EmilienM: er, nevermind, devstack gate seems to copy required-projects elsewhere | 21:07 |
| dsneddon | bugzy, I'll have to look into it, but if we add fqdn's for custom networks, I think that will make Galera happy. | 21:08 |
| dsneddon | bugzy, For a quick workaround, you can add the custom network IP to /etc/hosts on all hosts, that might allow the cluster to boot. You'd need to have a script or puppet do it in a fresh deployment, but you could probably log into each host or use Ansible and do it when the system first comes up with SSH access. | 21:09 |
| EmilienM | sdoran: I have a question on https://review.rdoproject.org/r/#/c/10809/1/openstack-tripleo-common.spec | 21:09 |
| dsneddon | bugzy, During the deployment, I mean. | 21:09 |
| sdoran | EmilienM: Go. | 21:09 |
| bugzy | dsneddon: Got it . Thanks | 21:11 |
| bugzy | dsneddon: Thanks for the "hand holding" through all of this. | 21:11 |
| dsneddon | bugzy, Thanks for the testing. | 21:12 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common stable/pike: Tolerate ports in tag discover https://review.openstack.org/525314 | 21:14 |
| weshay | myoung|ruck, FYI https://bugs.launchpad.net/tripleo/+bug/1736258 | 21:15 |
| openstack | Launchpad bug 1736258 in tripleo "master/pike network prep fails with ipv6, iptables v1.4.21: invalid mask `64' specified" [Critical,Triaged] | 21:15 |
| weshay | EmilienM, ping.. any ipv6 changes to fs024? | 21:18 |
| weshay | I don't see anything | 21:18 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Add multiple secret store backends for barbican https://review.openstack.org/523539 | 21:19 |
| *** liverpooler has quit IRC | 21:19 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Prepend errors file with prefix for logstash index https://review.openstack.org/525268 | 21:21 |
| EmilienM | weshay: no, we'll stop to run fs024 in queens (upstream at least) | 21:21 |
| EmilienM | ovb-ha and ovb-ha-ipv6 are enough imho | 21:22 |
| weshay | I wish he spoke english | 21:22 |
| weshay | k | 21:22 |
| EmilienM | fs024 is ipv6 + ceph | 21:22 |
| EmilienM | but ipv6 is now coverered by ovb-ha-ipv6 and ceph is covered by 2 scenarios | 21:22 |
| *** abregman has joined #tripleo | 21:22 | |
| EmilienM | no point of wasting ovb for that | 21:22 |
| openstackgerrit | Ian Main proposed openstack/tripleo-quickstart-extras master: DNM: Update quickstart extras with undercloud install for containers https://review.openstack.org/517444 | 21:23 |
| openstackgerrit | Steve Baker proposed openstack/paunch stable/pike: Explicitly pull images before docker run https://review.openstack.org/525322 | 21:25 |
| *** yamahata has joined #tripleo | 21:25 | |
| weshay | EmilienM++ | 21:26 |
| weshay | he doesn't need english | 21:26 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Add ipv6 support to overcloud-prep-network https://review.openstack.org/523997 | 21:26 |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates master: CI: Test multi-rbd backend for cinder in scenario001 https://review.openstack.org/519749 | 21:26 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Add ipv6 support to overcloud-prep-network https://review.openstack.org/523997 | 21:26 |
| EmilienM | weshay: ^ | 21:26 |
| weshay | thank you sir | 21:26 |
| EmilienM | weshay: call me when you speak a second language :P | 21:27 |
| EmilienM | (and YAML doesn't count) | 21:27 |
| weshay | EmilienM, I speak pig latin bro | 21:27 |
| openstackgerrit | Thiago da Silva proposed openstack/puppet-tripleo master: Include barbican modules to swift proxy https://review.openstack.org/525323 | 21:28 |
| EmilienM | lol | 21:28 |
| weshay | :) | 21:28 |
| EmilienM | weshay: so smartay | 21:28 |
| *** rwsu has quit IRC | 21:29 | |
| EmilienM | weshay: i'm not sure why rdo ci has the failure now | 21:29 |
| weshay | EmilienM, I was looking for recent changes, didn't find anything relate | 21:30 |
| weshay | related | 21:30 |
| openstackgerrit | Thiago da Silva proposed openstack/tripleo-heat-templates master: WIP: Add new encryption middleware to swift proxy https://review.openstack.org/525324 | 21:31 |
| openstackgerrit | Thiago da Silva proposed openstack/tripleo-heat-templates master: WIP: Add new encryption middleware to swift proxy https://review.openstack.org/525324 | 21:32 |
| EmilienM | weshay: give me logs here I'll take a look in 20 min, brb | 21:32 |
| weshay | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-master/9561210/undercloud/home/jenkins/overcloud_prep_network.log.txt.gz#_2017-12-04_20_20_23 | 21:32 |
| *** yamahata has quit IRC | 21:32 | |
| *** jkilpatr has joined #tripleo | 21:33 | |
| openstackgerrit | Ade Lee proposed openstack/puppet-tripleo master: Add multiple backends for barbican https://review.openstack.org/523538 | 21:35 |
| *** cylopez has quit IRC | 21:37 | |
| *** pcaruana has quit IRC | 21:39 | |
| *** ansmith has quit IRC | 21:40 | |
| *** moshele has quit IRC | 21:40 | |
| *** dbecker has quit IRC | 21:42 | |
| *** ebarrera has joined #tripleo | 21:42 | |
| *** rhallisey has quit IRC | 21:43 | |
| *** dprince has quit IRC | 21:44 | |
| *** jtomasek has quit IRC | 21:45 | |
| *** etingof has quit IRC | 21:46 | |
| *** raildo has quit IRC | 21:47 | |
| *** ccamacho has quit IRC | 21:49 | |
| *** abregman is now known as abregman|afk | 21:50 | |
| *** trown is now known as trown|outtypewww | 21:54 | |
| weshay | EmilienM, just sayin.. I think it's time we start giving Slower a hard time | 22:03 |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: DO NOT MERGE: test ovb-ha with config-download https://review.openstack.org/525331 | 22:05 |
| slagle | EmilienM: i guess that may test ovb ha with config-download ^. i dunno | 22:05 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add lookup plugin for ironic nodes https://review.openstack.org/514308 | 22:06 |
| *** rcernin has joined #tripleo | 22:07 | |
| *** jcoufal has quit IRC | 22:07 | |
| *** myoung|ruck is now known as myoung|ruck|bbl | 22:11 | |
| *** myoung|ruck|bbl is now known as myoung|ruck | 22:11 | |
| slagle | are multinode-upgrades jobs from RDO 3rd party supposed to be passing? | 22:17 |
| slagle | weshay: ^^? | 22:18 |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-validations master: Enhance repo validation to check for unwanted enabled repos https://review.openstack.org/515412 | 22:18 |
| *** akrivoka has quit IRC | 22:19 | |
| *** abishop has quit IRC | 22:20 | |
| weshay | slagle, not afaict.. matbu FYI | 22:20 |
| weshay | those should be marked non-voting at this point.. they've been failing for too long | 22:21 |
| slagle | weshay: because it *doesn't* say non-voting. but i see a lot of failures | 22:21 |
| weshay | exactly | 22:22 |
| slagle | weshay: where can one check the history? it's not either of the status pages | 22:22 |
| slagle | just jenkins i guess works fine :) | 22:22 |
| weshay | slagle, http://cistatus.tripleo.org/ --> TripleO CI promotion jobs | 22:22 |
| weshay | slagle, then you will find them | 22:22 |
| weshay | sshnaidm|off, it's not clear where to find the upgrade jobs in sova | 22:23 |
| * weshay adds a link | 22:23 | |
| slagle | weshay: thanks. i had not noticed there were new links up there :) | 22:23 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-common master: Added ability to generate kek for barbican simple crypto backend https://review.openstack.org/525337 | 22:25 |
| *** rwsu has joined #tripleo | 22:27 | |
| *** iranzo has quit IRC | 22:27 | |
| *** BryanS68 has quit IRC | 22:30 | |
| *** fpan has joined #tripleo | 22:31 | |
| *** dparkes has joined #tripleo | 22:33 | |
| *** vpickard is now known as vpickard_ | 22:41 | |
| *** pmannidi has joined #tripleo | 22:43 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Update consistent repo files for periodic jobs https://review.openstack.org/525016 | 22:44 |
| openstackgerrit | Merged openstack/tripleo-common master: Memoize docker uploader https://review.openstack.org/519200 | 22:44 |
| *** ansmith has joined #tripleo | 22:47 | |
| openstackgerrit | Alex Schultz proposed openstack/instack-undercloud master: Fix path in selinux fix for /root/.ssh https://review.openstack.org/525341 | 22:50 |
| EmilienM | weshay: why are you saying that ? | 22:52 |
| EmilienM | slagle: nice, indeed, that should do the work | 22:52 |
| *** dmacpher has quit IRC | 22:56 | |
| *** jmelvin has quit IRC | 22:57 | |
| dsneddon | EmilienM, I have a backport question. This bug affects only Ocata and before, but doesn't affect master or Pike. Ordinarily I would fix in master and backport, but do I need to do anything special to fix direcly to stable/ocata that isn't a backport? | 22:57 |
| dsneddon | https://bugzilla.redhat.com/show_bug.cgi?id=1393641 | 22:57 |
| openstack | bugzilla.redhat.com bug 1393641 in openstack-tripleo-heat-templates "setting ControlPlaneDefaultRoute and not ManagementInterfaceDefaultRoute fails" [Unspecified,New] - Assigned to jstransk | 22:57 |
| dsneddon | EmilienM, I'm going to open a Launchpad bug, of course. | 22:58 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 23:00 |
| EmilienM | dsneddon: if it only affect ocata and before, don't patch master or pike | 23:00 |
| EmilienM | go straight to stable/ocata | 23:00 |
| EmilienM | and note it in the commit message for reviewers | 23:00 |
| EmilienM | thanks for asking a bunch of people got it wrong sometimes | 23:00 |
| *** bfournie has quit IRC | 23:01 | |
| *** almondjoy has quit IRC | 23:01 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Add name property where missing https://review.openstack.org/521992 | 23:02 |
| weshay | Slower, you still around? | 23:02 |
| weshay | Slower, maybe we can update EmilienM | 23:02 |
| dsneddon | EmilienM, Got it, thanks. | 23:02 |
| *** etingof has joined #tripleo | 23:03 | |
| EmilienM | weshay: looking at rdo ci logs now | 23:04 |
| EmilienM | I don't understand how you have this one | 23:04 |
| EmilienM | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-master/9561210/undercloud/home/jenkins/overcloud_prep_network.log.txt.gz#_2017-12-04_20_20_23 | 23:04 |
| EmilienM | but I know how to fix it :D | 23:04 |
| EmilienM | https://review.openstack.org/#/c/523997/ should help | 23:05 |
| weshay | EmilienM, ya.. I don't see what ended up changing the behavior | 23:05 |
| EmilienM | weshay: rlandy's comment is good, I'll update my patch | 23:05 |
| EmilienM | wait | 23:06 |
| *** hjensas has quit IRC | 23:06 | |
| EmilienM | dsneddon: need your help | 23:06 |
| dsneddon | EmilienM, Sure | 23:06 |
| EmilienM | dsneddon: when deploying tripleo on ipv6 network, do we need NAT iptables rules for external network? | 23:07 |
| EmilienM | second question (I think the answer is yes but not sure): do we need ip6table rules for fancing? | 23:07 |
| dsneddon | EmilienM, What do you mean "deploying tripleo on ipv6 network"? We don't support deploying on an IPv6 control plane yet. | 23:07 |
| EmilienM | dsneddon: the context is https://review.openstack.org/#/c/523997/5/roles/overcloud-prep-network/templates/overcloud-prep-network.sh.j2 | 23:08 |
| mwhahaha | speaking of ipv6, weshay https://bugs.launchpad.net/tripleo/+bug/1736264 dpeacock hit this today using devmode | 23:08 |
| openstack | Launchpad bug 1736264 in tripleo "On host systems with IPv6 enabled, install fails at overcloud_prep_network step due to ipv6 dns server being used for ipv4 neutron network" [Medium,Triaged] | 23:08 |
| weshay | mwhahaha, thanks | 23:09 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Fix SSL certs creation for ipv6 https://review.openstack.org/523477 | 23:09 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Allow support for subunit2junitxml < 1.2 https://review.openstack.org/521650 | 23:09 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Reintroduce TripleoPackages in the default Controller service. https://review.openstack.org/524258 | 23:09 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Run rabbitmq_policy,rabbitmq_user with pacemaker https://review.openstack.org/524871 | 23:09 |
| openstackgerrit | Merged openstack/tripleo-common master: Include barbican worker and listener images if API is enabled https://review.openstack.org/522220 | 23:09 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add EndpointMapOverride parameter https://review.openstack.org/521929 | 23:09 |
| *** dmacpher has joined #tripleo | 23:09 | |
| EmilienM | weshay: https://review.openstack.org/523477 merged | 23:11 |
| EmilienM | weshay: it should fix your issue | 23:11 |
| EmilienM | dsneddon: nevermind, I think we fixed our problem with https://review.openstack.org/523477 | 23:11 |
| EmilienM | dsneddon: we were running iptables rules when deploying an ipv6 overcloud | 23:12 |
| dsneddon | EmilienM, OK, I believe that boolean results in IPv6 isolated networks on an IPv4 control plane. | 23:12 |
| EmilienM | dsneddon: yes, sorry for bad wording | 23:13 |
| dsneddon | EmilienM, yeah, I think that patch will fix this issue. Note that if quickstart deploys with IPv6, all the isolated networks, including External, will be IPv6, so no NAT for the External network. | 23:13 |
| dsneddon | EmilienM, But when IPv6 External network is used, the Controllers use Control Plane for external connectivity, so NAT happens there. | 23:14 |
| openstackgerrit | Alex Schultz proposed openstack/instack-undercloud master: Fix path in selinux fix for /root/.ssh https://review.openstack.org/525341 | 23:14 |
| *** florianf has quit IRC | 23:14 | |
| EmilienM | dsneddon: ok, thanks for clarifying | 23:15 |
| EmilienM | weshay: please let me know if there is any new failure in the periodic jobs, but we should be clear now | 23:15 |
| weshay | myoung|ruck, FYI ^ | 23:15 |
| EmilienM | arxcruz: have you seen that stackviz doesn't work ? | 23:29 |
| EmilienM | arxcruz: http://logs.openstack.org/85/525285/3/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/e3b2613/logs/stackviz/#/stdin | 23:29 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Add multiple secret store backends for barbican https://review.openstack.org/523539 | 23:30 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-common master: Added ability to generate kek for barbican simple crypto backend https://review.openstack.org/525337 | 23:41 |
| mwhahaha | for my own amusement: scenario001 is the only currently green containers job on cistatus :D | 23:45 |
| *** mwhahaha changes topic to "CI status: GREEEEEEEEN! see alerts and read ML. | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/" | 23:45 | |
| weshay | wha? | 23:46 |
| mwhahaha | http://cistatus.tripleo.org/ | 23:46 |
| EmilienM | 001 is best | 23:46 |
| mwhahaha | 001 rock solid | 23:46 |
| weshay | yup | 23:46 |
| EmilienM | mwhahaha: https://review.openstack.org/#/c/502943/ | 23:47 |
| EmilienM | scenarios passed well 2h ago | 23:47 |
| mwhahaha | yea i think some of the reports are thrown off by the infra issues with the pypi mirrors | 23:47 |
| weshay | still better to look at http://cistatus.tripleo.org:8000/ | 23:47 |
| mwhahaha | i just found it amusing | 23:47 |
| weshay | mwhahaha, EmilienM this is really good for the last 7 days http://status.openstack.org/openstack-health/#/ | 23:48 |
| weshay | everything at 100% not sure if that is accurate | 23:48 |
| EmilienM | lol | 23:48 |
| EmilienM | probably not | 23:48 |
| weshay | ya | 23:48 |
| mwhahaha | return true | 23:48 |
| EmilienM | I never saw 100% of success in our CI | 23:48 |
| EmilienM | but let me see | 23:48 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: WIP - zuul/tripleo-ci-dsvm: remove required-projects https://review.openstack.org/525265 | 23:53 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
