| *** achadha has quit IRC | 00:01 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Multinode provision role https://review.openstack.org/516795 | 00:01 |
|---|---|---|
| openstackgerrit | Merged openstack/puppet-tripleo stable/newton: Prepare puppet-tripleo 5.6.5 https://review.openstack.org/515132 | 00:01 |
| *** moshele has quit IRC | 00:05 | |
| *** etingof has quit IRC | 00:13 | |
| *** achadha has joined #tripleo | 00:17 | |
| *** links has joined #tripleo | 00:20 | |
| *** dmacpher has joined #tripleo | 00:24 | |
| *** ansiwen[q] has joined #tripleo | 00:33 | |
| *** ansiwen[q] is now known as ansiwen_q | 00:34 | |
| *** ansiwen_q is now known as ansiwen[q] | 00:35 | |
| *** ansiwen[q] has quit IRC | 00:40 | |
| *** psahoo has joined #tripleo | 00:42 | |
| *** etingof has joined #tripleo | 00:51 | |
| *** liverpooler has quit IRC | 00:56 | |
| openstackgerrit | Merged openstack/instack-undercloud stable/newton: heat-dbsync: increase timeout to 15 minutes https://review.openstack.org/516683 | 00:59 |
| *** achadha has quit IRC | 01:00 | |
| *** achadha has joined #tripleo | 01:05 | |
| *** achadha has quit IRC | 01:09 | |
| *** ecerquei has quit IRC | 01:11 | |
| *** bobh has joined #tripleo | 01:11 | |
| *** fragatina has quit IRC | 01:14 | |
| *** leitan has quit IRC | 01:24 | |
| *** bobh has quit IRC | 01:31 | |
| *** bobh has joined #tripleo | 01:32 | |
| *** bobh has quit IRC | 01:33 | |
| *** psachin has joined #tripleo | 01:43 | |
| *** leitan has joined #tripleo | 01:46 | |
| *** yamahata has quit IRC | 01:56 | |
| openstackgerrit | Merged openstack/instack-undercloud stable/ocata: heat-dbsync: increase timeout to 15 minutes https://review.openstack.org/516682 | 01:56 |
| *** achadha has joined #tripleo | 01:57 | |
| *** achadha has quit IRC | 02:02 | |
| *** chlong has joined #tripleo | 02:04 | |
| *** zshi has joined #tripleo | 02:14 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add --detailed-exitcodes when running puppet via ansible https://review.openstack.org/511509 | 02:17 |
| *** moshele has joined #tripleo | 02:27 | |
| *** itlinux has joined #tripleo | 02:33 | |
| *** adarazs|rover has quit IRC | 02:40 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: Make python changes more reliable https://review.openstack.org/516819 | 02:44 |
| *** itlinux has quit IRC | 02:52 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: Make preinstall.d more deterministic https://review.openstack.org/516821 | 02:53 |
| *** yamahata has joined #tripleo | 02:55 | |
| *** etingof has quit IRC | 02:57 | |
| *** dtantsur|afk has quit IRC | 03:01 | |
| *** bobh has joined #tripleo | 03:01 | |
| *** moshele has quit IRC | 03:05 | |
| *** moshele has joined #tripleo | 03:07 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: Enable support for Gentoo overlays https://review.openstack.org/516823 | 03:07 |
| *** etingof has joined #tripleo | 03:10 | |
| *** bobh has quit IRC | 03:13 | |
| *** leitan has quit IRC | 03:20 | |
| *** fragatina has joined #tripleo | 03:26 | |
| *** brault_ has quit IRC | 03:26 | |
| *** brault has joined #tripleo | 03:27 | |
| *** fragatina has quit IRC | 03:28 | |
| *** fragatina has joined #tripleo | 03:28 | |
| *** etingof has quit IRC | 03:31 | |
| *** fragatina has quit IRC | 03:33 | |
| *** atoth has quit IRC | 03:36 | |
| *** etingof has joined #tripleo | 03:43 | |
| *** etingof has quit IRC | 03:48 | |
| openstackgerrit | Feng Pan proposed openstack/os-net-config master: Add support for VPP Bond https://review.openstack.org/513972 | 03:48 |
| *** moshele has quit IRC | 03:52 | |
| *** gkadam has joined #tripleo | 03:57 | |
| *** etingof has joined #tripleo | 04:01 | |
| *** pdeore has joined #tripleo | 04:02 | |
| *** dmacpher has quit IRC | 04:04 | |
| *** dmacpher has joined #tripleo | 04:21 | |
| *** ykarel has joined #tripleo | 04:26 | |
| *** etingof has quit IRC | 04:30 | |
| *** newmember has joined #tripleo | 04:32 | |
| *** janki has joined #tripleo | 04:33 | |
| *** ramishra has joined #tripleo | 04:37 | |
| *** udesale has joined #tripleo | 04:39 | |
| *** etingof has joined #tripleo | 04:44 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs010: use --config-download from tripleoclient https://review.openstack.org/514736 | 04:45 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: config-download: use workflow supported in Queens https://review.openstack.org/514745 | 04:46 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: config-download: use workflow supported in Queens https://review.openstack.org/514745 | 04:46 |
| *** bswartz has quit IRC | 04:48 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: config-download: use workflow supported in Queens https://review.openstack.org/516841 | 04:48 |
| *** shreshtha has joined #tripleo | 04:49 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs010: use --config-download from tripleoclient https://review.openstack.org/514736 | 04:49 |
| openstackgerrit | Merged openstack/puppet-pacemaker master: Switch to Zuul v3 testing https://review.openstack.org/515234 | 04:53 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Make memcached logs verbosity configurable https://review.openstack.org/516205 | 04:58 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Force memcached container log to file https://review.openstack.org/516206 | 04:58 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Fix permissions for dockerized horizon https://review.openstack.org/511425 | 04:58 |
| *** achadha has joined #tripleo | 04:59 | |
| *** achadha_ has joined #tripleo | 05:00 | |
| *** dmacpher has quit IRC | 05:00 | |
| *** achadha has quit IRC | 05:03 | |
| *** eck` is now known as eck`gone | 05:07 | |
| *** dmacpher has joined #tripleo | 05:12 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 05:13 |
| *** dsariel__ has joined #tripleo | 05:16 | |
| *** pdeore has quit IRC | 05:17 | |
| *** moshele has joined #tripleo | 05:23 | |
| *** pdeore has joined #tripleo | 05:24 | |
| *** janki has quit IRC | 05:30 | |
| moshele | skramaja: hi | 05:38 |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: Enable support for Gentoo overlays https://review.openstack.org/516823 | 05:43 |
| *** janki has joined #tripleo | 05:48 | |
| *** ratailor has joined #tripleo | 05:48 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: Add the groundwork for musl profile support https://review.openstack.org/516844 | 05:50 |
| *** cshastri has joined #tripleo | 05:50 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: Enable support for Gentoo overlays https://review.openstack.org/516823 | 05:53 |
| Tengu | hello there :) | 05:55 |
| *** shreshtha has quit IRC | 05:57 | |
| *** shreshtha has joined #tripleo | 05:58 | |
| *** marios has joined #tripleo | 05:58 | |
| Tengu | erf… ok. no recheck… apparently there are some issues. | 06:02 |
| *** jprovazn has joined #tripleo | 06:03 | |
| *** udesale__ has joined #tripleo | 06:12 | |
| *** udesale has quit IRC | 06:15 | |
| *** udesale__ has quit IRC | 06:18 | |
| *** udesale__ has joined #tripleo | 06:19 | |
| *** udesale has joined #tripleo | 06:21 | |
| *** threestrands has quit IRC | 06:22 | |
| *** abregman has joined #tripleo | 06:23 | |
| *** udesale__ has quit IRC | 06:23 | |
| *** tzumainn has quit IRC | 06:37 | |
| *** d0ugal_ has quit IRC | 06:45 | |
| ratailor | owalsh, Hi | 06:49 |
| *** links has quit IRC | 06:53 | |
| *** d0ugal_ has joined #tripleo | 06:56 | |
| *** jtomasek has joined #tripleo | 06:56 | |
| *** yprokule has joined #tripleo | 07:00 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui stable/pike: Imported Translations from Zanata https://review.openstack.org/515990 | 07:00 |
| *** adac has joined #tripleo | 07:02 | |
| *** brault has quit IRC | 07:05 | |
| *** pgadiya has joined #tripleo | 07:07 | |
| *** adac has quit IRC | 07:09 | |
| *** achadha_ has quit IRC | 07:11 | |
| *** spectr-RH has joined #tripleo | 07:12 | |
| *** spectr has quit IRC | 07:13 | |
| *** agurenko has joined #tripleo | 07:13 | |
| moshele | beagles: hi can you review https://review.openstack.org/#/c/507100/ ? | 07:14 |
| *** achadha has joined #tripleo | 07:16 | |
| *** paramite has joined #tripleo | 07:17 | |
| *** aufi has joined #tripleo | 07:19 | |
| *** links has joined #tripleo | 07:20 | |
| *** achadha has quit IRC | 07:20 | |
| *** anshul has joined #tripleo | 07:21 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Update proliant-tools to support Gen10 Proliant servers https://review.openstack.org/509359 | 07:22 |
| *** Dinesh_Bhor has joined #tripleo | 07:23 | |
| openstackgerrit | Merged openstack/instack-undercloud stable/pike: heat-dbsync: increase timeout to 15 minutes https://review.openstack.org/516680 | 07:24 |
| *** lvdombrkr has quit IRC | 07:25 | |
| *** lvdombrkr has joined #tripleo | 07:29 | |
| *** jaosorior has joined #tripleo | 07:42 | |
| *** rcernin has quit IRC | 07:42 | |
| *** masco has joined #tripleo | 07:43 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates stable/pike: Make memcached logs verbosity configurable https://review.openstack.org/516875 | 07:44 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates stable/pike: Force memcached container log to file https://review.openstack.org/516876 | 07:44 |
| *** dmacpher has quit IRC | 07:47 | |
| *** shardy_afk is now known as shardy | 07:47 | |
| *** tesseract has joined #tripleo | 07:48 | |
| *** sri_ has quit IRC | 07:53 | |
| *** ukalifon has joined #tripleo | 07:58 | |
| ratailor | jaosorior, you around ? | 08:01 |
| jaosorior | ratailor: yeah, what's up? | 08:01 |
| *** jbadiapa has quit IRC | 08:02 | |
| *** pdeore has quit IRC | 08:08 | |
| *** abregman has quit IRC | 08:15 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Multinode provision role https://review.openstack.org/516795 | 08:15 |
| *** abregman has joined #tripleo | 08:15 | |
| *** pcaruana has joined #tripleo | 08:17 | |
| *** pdeore has joined #tripleo | 08:17 | |
| *** Goneri has joined #tripleo | 08:18 | |
| *** chlong has quit IRC | 08:18 | |
| *** dtantsur has joined #tripleo | 08:23 | |
| *** agurenko has quit IRC | 08:31 | |
| *** spectr-RH has quit IRC | 08:32 | |
| *** spectr has joined #tripleo | 08:33 | |
| *** agurenko has joined #tripleo | 08:34 | |
| *** zshi has quit IRC | 08:39 | |
| *** zshi has joined #tripleo | 08:39 | |
| Tengu | thank you jaosorior for the workflow+1 :) | 08:40 |
| *** achadha has joined #tripleo | 08:40 | |
| jaosorior | Tengu: no biggie | 08:41 |
| *** d0ugal_ has quit IRC | 08:42 | |
| *** rcernin has joined #tripleo | 08:43 | |
| Tengu | jaosorior: ah, re: certodia: I think I should be able to get a working form by next week. Doing it on my free time isn't easy, as free time is an expensive resource ;). | 08:44 |
| *** d0ugal has joined #tripleo | 08:44 | |
| *** d0ugal has joined #tripleo | 08:44 | |
| Tengu | jaosorior: but I'm pretty confident it will work as expected. I've already the HAProxy thingy allowing to manage its configuration through the socket, and that was probably one of the hardest part (not to mention IPA Vault - that one will come later) | 08:45 |
| *** achadha has quit IRC | 08:45 | |
| *** gkadam_ has joined #tripleo | 08:46 | |
| *** gkadam has quit IRC | 08:48 | |
| Tengu | hmm, anyone can tell me who I should poke when the RDO CI is failing like that? https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-containers-multinode-upgrades-master/642/console | 08:48 |
| Tengu | it's a bit annoying, as you may expect. | 08:48 |
| jaosorior | Tengu: sshnaidm|afk perhaps? or you could ask in #rdo | 08:52 |
| * Tengu launch a might /join #rdo | 08:53 | |
| * Tengu will be hated by all CI guys | 08:54 | |
| Tengu | :) | 08:54 |
| openstackgerrit | Jan Provaznik proposed openstack/tripleo-heat-templates master: Add support for ceph-nfs manila backend https://review.openstack.org/471245 | 08:58 |
| *** ccamacho has quit IRC | 09:00 | |
| *** jpich has joined #tripleo | 09:02 | |
| *** brault has joined #tripleo | 09:06 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-docs master: Document using UEFI mode with overcloud nodes https://review.openstack.org/516893 | 09:06 |
| *** jistr_ is now known as jistr | 09:07 | |
| *** panda|ruck is now known as panda|ruck|bbl | 09:08 | |
| jistr | shardy: thanks for your review re multi node kubernetes. Did you get a chance to look into haproxy config yesterday or should i? | 09:09 |
| shardy | jistr: I started it but it's not yet working, sec I'll push what I have | 09:10 |
| *** brault has quit IRC | 09:10 | |
| jistr | shardy: sounds good, thanks | 09:10 |
| * jistr will try a multi-master multi-worker cluster and tune the open ports | 09:12 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Allow installing multiple-node Kubernetes https://review.openstack.org/514730 | 09:12 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Enable loadbalancer for kubernetes masters https://review.openstack.org/516894 | 09:12 |
| shardy | jistr: ^^ I'll mark the LB one WIP as it's definitely not working properly yet | 09:13 |
| Tengu | darn… I hoped that issue wouldn't come back X( http://logs.openstack.org/74/513274/11/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/e4a5a97/logs/undercloud/home/zuul/vxlan_networking.sh.log.txt.gz#_2017-11-01_06_34_12 | 09:13 |
| Tengu | Failed to get unit file state for neutron-openvswitch-agent.service: No such file or directory | 09:14 |
| shardy | jistr: one problem is we need the bind IP for access_ip, which won't be replaced like for config_settings when it references the ServiceNetMap | 09:14 |
| shardy | I guess we could have ansible read the hiera keys from https://review.openstack.org/#/c/514707/ but that doesn't seem super-clean | 09:15 |
| shardy | jistr: FYI I tested 3 masters and one worker and it seems OK with the firewall disabled | 09:15 |
| shardy | not really done much with the cluster but the nodes all register | 09:16 |
| jistr | cool thanks, that's good. Yea trying to get the firewall rules right is what i'm after now, then the multi-node patch should be ready to merge (it should work without loadbalancer too, only one master node will be the endpoint though) | 09:18 |
| *** derekh has joined #tripleo | 09:18 | |
| shardy | jistr: actually could you pls review https://review.openstack.org/#/c/514707/ if you have a moment, I think it's good to land and it's useful for some spine/leaf testing that's ongoing | 09:18 |
| jistr | sure | 09:18 |
| *** brault has joined #tripleo | 09:30 | |
| *** adarazs_ has joined #tripleo | 09:30 | |
| *** lucas-afk is now known as lucasagomes | 09:31 | |
| *** adarazs_ is now known as adarazs | 09:31 | |
| *** mcornea has joined #tripleo | 09:31 | |
| *** lifeless has quit IRC | 09:32 | |
| *** etingof has quit IRC | 09:37 | |
| *** ccamacho has joined #tripleo | 09:37 | |
| *** psahoo has quit IRC | 09:38 | |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Adds --overcloud-user option to upgrade-non-controller.sh https://review.openstack.org/514950 | 09:39 |
| *** yamahata has quit IRC | 09:45 | |
| Tengu | oh. what an unexpected surprise. I got some timeout on the CI :) | 09:47 |
| *** newmember has quit IRC | 09:48 | |
| mcornea | shardy: hi, good morning o/ this is the OS::TripleO::Network::Management could not be found issue I was mentioning yesterday - https://bugs.launchpad.net/tripleo/+bug/1729039 I attached the environment files used for deployment to the bug | 09:49 |
| openstack | Launchpad bug 1729039 in tripleo "Ocata -> Pike overcloud upgrade: major-upgrade-composable-steps-docker fails with The Resource Type (OS::TripleO::Network::Management) could not be found." [Critical,Triaged] | 09:49 |
| owalsh | ratailor: hey | 09:50 |
| *** etingof has joined #tripleo | 09:55 | |
| *** jkilpatr has joined #tripleo | 09:56 | |
| *** links has quit IRC | 09:57 | |
| Tengu | oh, ah. this might explain the issue with my current review: http://logs.openstack.org/74/513274/11/check/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container/4d603a9/logs/undercloud/home/zuul/tempest_output.log.txt.gz#_2017-11-01_07_54_17 | 09:57 |
| Tengu | is it a known issue? | 09:58 |
| jaosorior | mandre: could you check these two backports https://review.openstack.org/#/c/516876/ https://review.openstack.org/#/c/516875/ ? | 09:58 |
| jaosorior | Tengu: I'm seeing that as well | 09:58 |
| jaosorior | seems like a new issue now :/ | 09:58 |
| Tengu | jaosorior: ook. may I open an issue on launchpad? | 09:59 |
| Tengu | I've also opened another one with the neutron-openvswitch-agent.service: https://bugs.launchpad.net/tripleo/+bug/1729252 | 09:59 |
| openstack | Launchpad bug 1729252 in tripleo "CI issue: Failed to get unit file state for neutron-openvswitch-agent.service: No such file or directory" [Undecided,New] | 09:59 |
| Tengu | I'm not 100% sure this issue makes the whole thing collapse, but it would be good to correct it so that we won't stress on that next time we see a failed run :). | 10:00 |
| jaosorior | Tengu: yeah, I think it's appropriate to open an issue | 10:00 |
| Tengu | jaosorior: OK, I create it. | 10:00 |
| Tengu | jaosorior: https://bugs.launchpad.net/tripleo/+bug/1729253 care to add your own remarks if necessary ? ;) | 10:03 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container fails with volume" [Undecided,New] | 10:03 |
| *** ykarel is now known as ykarel|lunch | 10:04 | |
| *** janki has left #tripleo | 10:08 | |
| *** janki has joined #tripleo | 10:08 | |
| *** salmankhan has joined #tripleo | 10:09 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 10:10 |
| shardy | mcornea: Hi! Thanks for raising the bug, looking now | 10:10 |
| *** jkilpatr has quit IRC | 10:11 | |
| *** achadha has joined #tripleo | 10:11 | |
| *** pgadiya has quit IRC | 10:12 | |
| shardy | mcornea: do you still have the environment to get any more debug info? | 10:15 |
| *** pdeore has quit IRC | 10:16 | |
| *** achadha has quit IRC | 10:16 | |
| mcornea | shardy: let me check, it's an env used by the nfv qe | 10:17 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Fix passing props for ToolbarFiltersForm https://review.openstack.org/508472 | 10:17 |
| *** rbowen has joined #tripleo | 10:19 | |
| *** ebarrera_ has joined #tripleo | 10:21 | |
| mcornea | shardy: looks like it was reprovisioned, what debug info should I gather? I'll try to reproduce the issue | 10:21 |
| *** sri_ has joined #tripleo | 10:24 | |
| *** pgadiya has joined #tripleo | 10:25 | |
| shardy | mcornea: I'll add a note to the bug, basically I'd like to see the rendered templates and the environment from heat | 10:27 |
| *** pdeore has joined #tripleo | 10:27 | |
| *** morazi has quit IRC | 10:28 | |
| mcornea | shardy: ok, initially I thought that it could be related to the fact that the $THT/environments/network-isolation.yaml wasn't used in this deployment. We use that in all the base architecture tests and I thought that's why we haven't caught this issue before. | 10:30 |
| ratailor | owalsh, Hey | 10:30 |
| ratailor | owalsh, me and jaosorior has tmate session and he helped in debug the issue and in successfully deploying TLS enabled ec2api setup. | 10:31 |
| owalsh | ratailor: was it "ec2_api_metadata_network is not set in the hieradata" | 10:32 |
| jtomasek | d0ugal: the last line here https://review.openstack.org/#/c/509832/7/workbooks/plan_management.yaml means 'fail the workflow if status is FAILED'? | 10:33 |
| ratailor | owalsh, it was related to eku parameter missing from certmonger. | 10:33 |
| ratailor | owalsh, he had already requested package update for the same .https://review.rdoproject.org/r/#/c/10372/ | 10:33 |
| d0ugal | jtomasek: yes, exactly. The idea is that the workflow state should reflect the last message sent. | 10:34 |
| jaosorior | owalsh: we didn't test the metadata one, just ec2_api | 10:34 |
| jtomasek | d0ugal: ok, yes, makes sense | 10:34 |
| owalsh | ratailor: ok... still have an issue with the metadata one | 10:34 |
| owalsh | ratailor: I'll comment on the review | 10:34 |
| d0ugal | jtomasek: (it is mostly important/useful for sub-workflows, so any workflow calling that one knows it failed) | 10:34 |
| ratailor | owalsh, I tried only with ec2api, will try with metadata one as well. | 10:34 |
| ratailor | owalsh, sure, | 10:34 |
| d0ugal | jtomasek: and that is why my comment on L927 is important :) | 10:35 |
| shardy | mcornea: yeah the hard-coded net-iso environment isn't the way we normally test but I can't see why that specific resource type isn't found, as it appears to be in the resource_registry | 10:35 |
| jtomasek | d0ugal: I see | 10:35 |
| shardy | mcornea: if you are able to reproduce we could perhaps debug together, currently I'm not quite sure what's causing this | 10:36 |
| *** sri_ has quit IRC | 10:36 | |
| *** abregman is now known as abregman|afk | 10:36 | |
| jtomasek | d0ugal: I've added on-complete and tested it and I am not getting the message, so I am trying to figure out why... will try to update Failed to FAILED too... | 10:36 |
| *** pgadiya has quit IRC | 10:36 | |
| mcornea | shardy: cool, I'll let you know once I get a reproducing environment. thanks! | 10:36 |
| d0ugal | jtomasek: can I access the env or can you show me "mistral task-list $EXECUTION_ID"? | 10:38 |
| *** Goneri has quit IRC | 10:38 | |
| jtomasek | d0ugal: one sec | 10:40 |
| jtomasek | d0ugal: http://paste.openstack.org/show/625194/ | 10:42 |
| *** ebarrera_ has quit IRC | 10:42 | |
| d0ugal | jtomasek: oh! | 10:43 |
| *** cylopez has joined #tripleo | 10:43 | |
| d0ugal | jtomasek: you are missing a Mistral patch | 10:43 |
| jtomasek | d0ugal: I see, my setup is relatively old... | 10:44 |
| jtomasek | I guess it is time to reinstall then :) | 10:44 |
| d0ugal | jtomasek: wait | 10:45 |
| jtomasek | ok | 10:45 |
| d0ugal | jtomasek: because it isn't promoted, reinstalling wont help | 10:45 |
| d0ugal | iirc | 10:45 |
| d0ugal | actually, I might just be confused. | 10:45 |
| d0ugal | jtomasek: https://review.openstack.org/#/c/511616/ | 10:45 |
| d0ugal | that is what you need | 10:45 |
| *** pdeore_ has joined #tripleo | 10:46 | |
| jtomasek | d0ugal: thanks! | 10:46 |
| d0ugal | jtomasek: okay, sorry, a reinstall should be fine. It only needs to be promoted for CI which is why that patch can't land yet | 10:46 |
| d0ugal | jtomasek: rbrady's patch is based on thrash's patch which has a depends-on to the mistral patch. | 10:47 |
| *** pdeore has quit IRC | 10:47 | |
| *** pgadiya has joined #tripleo | 10:48 | |
| thrash | d0ugal: you are correct... it hasn't been promoted yet. | 10:50 |
| *** udesale has quit IRC | 10:50 | |
| thrash | jtomasek: if you use master-consistent you'll get it. | 10:50 |
| jtomasek | thrash: ok, thanks | 10:51 |
| thrash | jtomasek: actually... looks like master-tripleoci has had a promotion | 10:51 |
| *** jfrancoa has joined #tripleo | 10:51 | |
| thrash | I was out yesterday | 10:52 |
| *** Goneri has joined #tripleo | 10:53 | |
| *** rfolco_ has joined #tripleo | 10:53 | |
| *** etingof has quit IRC | 10:54 | |
| *** pdeore_ is now known as pdeore | 10:57 | |
| *** rcernin has quit IRC | 10:57 | |
| *** salmankhan has quit IRC | 11:00 | |
| *** lifeless has joined #tripleo | 11:02 | |
| *** salmankhan has joined #tripleo | 11:04 | |
| *** abishop has quit IRC | 11:04 | |
| *** etingof has joined #tripleo | 11:07 | |
| *** newmember has joined #tripleo | 11:09 | |
| *** sshnaidm|afk is now known as sshnaidm | 11:10 | |
| *** gfidente has joined #tripleo | 11:11 | |
| *** gfidente has quit IRC | 11:11 | |
| *** gfidente has joined #tripleo | 11:11 | |
| *** gfidente is now known as gfidente|pto | 11:12 | |
| *** gfidente|pto has quit IRC | 11:12 | |
| *** newmember has quit IRC | 11:13 | |
| *** newmember has joined #tripleo | 11:14 | |
| *** brault has quit IRC | 11:19 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart-extras master: Set --ntp-server without having to edit extra_args https://review.openstack.org/516958 | 11:23 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data https://review.openstack.org/508567 | 11:25 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow https://review.openstack.org/509419 | 11:25 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow https://review.openstack.org/513463 | 11:25 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-docs master: Update upgrade documentation with the Ceph related steps https://review.openstack.org/511635 | 11:26 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart-extras master: Set --ntp-server without having to edit extra_args https://review.openstack.org/516958 | 11:26 |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-common master: Validate parameters before updating https://review.openstack.org/511249 | 11:28 |
| *** bfournie has quit IRC | 11:28 | |
| *** bfournie has joined #tripleo | 11:28 | |
| *** gkadam_ has quit IRC | 11:31 | |
| *** morazi has joined #tripleo | 11:31 | |
| *** brian83 has joined #tripleo | 11:32 | |
| *** bfournie has quit IRC | 11:32 | |
| *** jpich has quit IRC | 11:34 | |
| *** jpich has joined #tripleo | 11:35 | |
| *** abregman|afk is now known as abregman | 11:35 | |
| *** atoth has joined #tripleo | 11:37 | |
| *** jfrancoa has quit IRC | 11:37 | |
| jistr | sshnaidm: thanks for the review on the network_args patch. I posted one more for a thing that has been itching me for a long time -- setting --ntp-server via quickstart https://review.openstack.org/516958 | 11:38 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 11:38 |
| *** abregman has quit IRC | 11:40 | |
| *** abregman has joined #tripleo | 11:41 | |
| *** ebarrera_ has joined #tripleo | 11:45 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Make keystone notification topics configurable https://review.openstack.org/516969 | 11:46 |
| *** ccamacho has quit IRC | 11:46 | |
| *** jcoufal has joined #tripleo | 11:47 | |
| *** ykarel|lunch is now known as ykarel | 11:47 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 11:47 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-common master: Octavia post deployment mistral wrapper https://review.openstack.org/515402 | 11:47 |
| *** dtantsur is now known as dtantsur|bbl | 11:48 | |
| *** jcoufal_ has joined #tripleo | 11:50 | |
| *** dprince has joined #tripleo | 11:52 | |
| *** rbrady has joined #tripleo | 11:52 | |
| *** rbrady has quit IRC | 11:52 | |
| *** rbrady has joined #tripleo | 11:52 | |
| *** ansmith has quit IRC | 11:52 | |
| *** rbrady-afk has quit IRC | 11:53 | |
| *** jcoufal has quit IRC | 11:54 | |
| *** chlong has joined #tripleo | 11:54 | |
| *** jlabarre has joined #tripleo | 11:54 | |
| *** pkovar has joined #tripleo | 11:59 | |
| *** rhallisey has joined #tripleo | 11:59 | |
| *** rhallisey has quit IRC | 11:59 | |
| *** rhallisey has joined #tripleo | 12:01 | |
| *** abregman has quit IRC | 12:01 | |
| *** abregman has joined #tripleo | 12:01 | |
| *** abishop has joined #tripleo | 12:02 | |
| *** ecerquei has joined #tripleo | 12:02 | |
| *** bfournie has joined #tripleo | 12:04 | |
| *** lucasagomes is now known as lucas-hungry | 12:04 | |
| *** abregman has quit IRC | 12:05 | |
| *** abregman has joined #tripleo | 12:05 | |
| *** raildo has joined #tripleo | 12:07 | |
| *** eck`gone is now known as eck` | 12:09 | |
| *** weshay|PTO is now known as weshay | 12:09 | |
| *** abregman has quit IRC | 12:11 | |
| *** abregman has joined #tripleo | 12:11 | |
| *** akane has joined #tripleo | 12:12 | |
| *** bobh has joined #tripleo | 12:13 | |
| *** pgadiya has quit IRC | 12:14 | |
| *** abregman has quit IRC | 12:15 | |
| *** abregman has joined #tripleo | 12:15 | |
| *** udesale has joined #tripleo | 12:18 | |
| *** leitan has joined #tripleo | 12:19 | |
| *** jcoufal_ has quit IRC | 12:21 | |
| *** panda|ruck|bbl is now known as panda|ruck | 12:22 | |
| *** jcoufal has joined #tripleo | 12:23 | |
| akane | shardy: Hi. This is regarding "roles_data.yaml equivalent in containers" email I had sent on the mailing list https://openstack.nimeyo.com/121895/openstack-tripleo-roles_data-yaml-equivalent-containers | 12:24 |
| *** trown|outtypewww is now known as trown | 12:25 | |
| akane | shardy: I though to use this approach http://paste.openstack.org/show/625203/ | 12:26 |
| akane | since I just want to call the hooks of service_config_settings, I copied the veritas-hyperscale-controller.yaml file from puppet/service to docker/services as is, and called it via a new environment file in services-docker | 12:27 |
| *** shreshtha has quit IRC | 12:27 | |
| *** pradk has joined #tripleo | 12:27 | |
| akane | but the service_config_settings hooks are not executed | 12:28 |
| *** catintheroof has joined #tripleo | 12:28 | |
| akane | and I also see that +service_name"_enabled flag is not set in hieradata | 12:28 |
| *** tzumainn has joined #tripleo | 12:28 | |
| akane | Do I need to call the puppet servic efrom docker/service as shown at https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/sahara-api.yaml#L53 | 12:29 |
| d0ugal | thrash: commented on https://review.openstack.org/#/c/513463/ - sorry for the confusion. | 12:31 |
| *** pdeore has quit IRC | 12:32 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 12:33 |
| *** rlandy has joined #tripleo | 12:33 | |
| *** achadha has joined #tripleo | 12:36 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Set keystone notification topics if ceilometer is enabled https://review.openstack.org/516979 | 12:36 |
| openstackgerrit | Alfredo Moralejo proposed openstack/tripleo-puppet-elements master: Install yum-plugin-priorities in pre-install phase https://review.openstack.org/516765 | 12:39 |
| *** lblanchard has quit IRC | 12:39 | |
| *** liverpooler has joined #tripleo | 12:39 | |
| Tengu | jaosorior: small question: I think we talked a bit about "json-ification of the python stacktraces" at oslo.log level, right? I think I should open some issue on their launchpad in order to have a track, don't you? | 12:40 |
| *** achadha has quit IRC | 12:40 | |
| Tengu | jaosorior: or do you have any cons or an already-implemented solution, as you're apparently working hard on the container logging part :) | 12:40 |
| jaosorior | Tengu: you talked briefly about it | 12:41 |
| jaosorior | and that oslo.messaging already had an implementation of that | 12:41 |
| jaosorior | right? | 12:41 |
| Tengu | oslo.log has some JSON implementation yes | 12:41 |
| jaosorior | lol, log, right | 12:41 |
| jaosorior | I'm doing some messaging stuff right now, that's why it came to my mind | 12:42 |
| jaosorior | anyway | 12:42 |
| jaosorior | no cons | 12:42 |
| Tengu | I'll open an issue in order to have some feedback from the oslo team about that specific part. | 12:42 |
| jaosorior | just haven't experimented with it right now | 12:42 |
| Tengu | perfect. | 12:42 |
| Tengu | :) | 12:42 |
| Tengu | neither did I | 12:42 |
| Tengu | but having the capability to output a correct JSON for any log messages, even stack traces, is a really good feature. | 12:42 |
| Tengu | … just have to find that lib name again -.-' | 12:43 |
| *** brault has joined #tripleo | 12:43 | |
| Tengu | python-json-logger tadaaa | 12:43 |
| *** sri_ has joined #tripleo | 12:45 | |
| jaosorior | Tengu: that would actually make my life easier. As we wouldn't need to reconstruct stack-traces anymore. | 12:46 |
| *** bobh has quit IRC | 12:46 | |
| moshele | skramaja: hi | 12:46 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Keystone: Enable notification topics to be configured https://review.openstack.org/516982 | 12:47 |
| apetrich | shardy, heya! I'm looking at https://review.openstack.org/#/c/448209 how much more do you think it is missing or needs to be done? | 12:47 |
| Tengu | jaosorior: well, that would make an easier life for a lot of people ;) | 12:47 |
| Tengu | jaosorior: https://bugs.launchpad.net/oslo.log/+bug/1729331 | 12:47 |
| openstack | Launchpad bug 1729331 in oslo.log "JSON format for stack trace" [Undecided,New] | 12:47 |
| *** pkovar has quit IRC | 12:47 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Set notification_bind on zaqar websocket https://review.openstack.org/516983 | 12:50 |
| Tengu | bnemec: are you available for a small logging chat? | 12:50 |
| *** salmankhan has quit IRC | 12:52 | |
| *** salmankhan has joined #tripleo | 12:52 | |
| *** ecerquei_ has joined #tripleo | 12:53 | |
| mwhahaha | looks like multinode-containers job is broken http://logs.openstack.org/18/516418/1/gate/legacy-tripleo-ci-centos-7-containers-multinode/bd8a18e/job-output.txt.gz#_2017-11-01_12_46_32_573210 | 12:55 |
| *** jmelvin has joined #tripleo | 12:55 | |
| *** ecerquei has quit IRC | 12:55 | |
| Tengu | btw jaosorior, what shall we do in order to be able to activate json outputs in oslo? I think if we do that, all messages using oslo.log will be formated - the only exception being the (in)famous stack traces. | 12:59 |
| mwhahaha | cschwede, abishop, mandre: https://bugs.launchpad.net/tripleo/+bug/1729339 FYI this is failing in the gate so we're going to have a bad time today trying ot get things merged | 13:00 |
| openstack | Launchpad bug 1729339 in tripleo "containers-multinode fails because cinder has no valid backends configured" [Critical,Triaged] | 13:00 |
| openstackgerrit | Rajesh Tailor proposed openstack/puppet-tripleo master: Add TLS for ec2api service https://review.openstack.org/509392 | 13:00 |
| Tengu | jaosorior: I think it would almost be good if the json could be the default, especially since, currently, the logs are processed by a fluentd… | 13:00 |
| Tengu | mwhahaha: hello! the bug you linked is apparently the same I created a bit earlier today, sorry :/ | 13:00 |
| *** brault has quit IRC | 13:01 | |
| Tengu | mwhahaha: the issue being: https://bugs.launchpad.net/tripleo/+bug/1729253 | 13:01 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container fails with volume" [Undecided,New] | 13:01 |
| mwhahaha | Tengu: thanks | 13:01 |
| Tengu | didn't know how to call it in order to avoid dups, sorry | 13:01 |
| abishop | mwhahaha: thx for heads-up | 13:01 |
| jaosorior | Tengu: Lets do this. Lets ask in the mailing list for input on what the default should be. If folks are fine with it, we can switch it to be json formatted. Else, we can make it configurable. | 13:02 |
| Tengu | jaosorior: one or the other would be lovely, as long as we can have json :). | 13:02 |
| Tengu | I think I should apply to the ML :D | 13:02 |
| jaosorior | openstack-dev | 13:02 |
| Tengu | jaosorior: which one, in fact ? | 13:02 |
| Tengu | ok | 13:02 |
| jaosorior | mwhahaha: I had seen that issue before :/ what I had seen was iscsid not starting properly | 13:03 |
| mwhahaha | jaosorior: :( well it's new as of this morning so something broke it | 13:03 |
| *** myoung|remote has joined #tripleo | 13:03 | |
| *** toure_biab is now known as toure | 13:03 | |
| *** abregman has quit IRC | 13:05 | |
| Tengu | jaosorior: I think it would be more… suitable if you're the one asking for the output format, as I'm an externe, and "new" to tripleo :) | 13:05 |
| jaosorior | Tengu: haha well, at this point I think you have more info about the json formatter, that why I was thinking you should do it. But however you want. I can do a bit of research and send the mail if you're more comfortable with that. | 13:07 |
| Tengu | jaosorior: I think it might get some more impact ;) | 13:07 |
| *** lucas-hungry is now known as lucasagomes | 13:08 | |
| sshnaidm | shardy, bnemec can you please take a look at patch from heat perspective? https://review.openstack.org/#/c/516795/ I think it could be more optimized with parameters | 13:08 |
| jaosorior | mwhahaha: I don't think it's the same issue :/ the logs I was expecting are not there. | 13:08 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 13:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container fails with volume" [Critical,Triaged] | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Confirmed] - Assigned to Gabriele Cerami (gcerami) | 13:10 |
| *** pkovar has joined #tripleo | 13:14 | |
| *** ratailor has quit IRC | 13:16 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud master: Only enable keystone notifications if telemetry is enabled https://review.openstack.org/516989 | 13:16 |
| *** ramishra has quit IRC | 13:18 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Increase the Mistral RPC timeout https://review.openstack.org/516990 | 13:18 |
| *** ansmith has joined #tripleo | 13:19 | |
| *** abregman has joined #tripleo | 13:20 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Refactor cellv2 host discovery logic to avoid races https://review.openstack.org/513867 | 13:23 |
| EmilienM | hi | 13:23 |
| *** bobh has joined #tripleo | 13:25 | |
| Tengu | hello EmilienM :) | 13:26 |
| *** bswartz has joined #tripleo | 13:27 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: DNM - Run tempest after an upgrade Ocata to Pike https://review.openstack.org/500440 | 13:27 |
| weshay | panda|ruck, looking at http://status.openstack.org/elastic-recheck/ | 13:27 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Upgrade CI test on stable/pike https://review.openstack.org/500625 | 13:28 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Upgrade CI test on stable/pike https://review.openstack.org/500625 | 13:28 |
| EmilienM | it looks like promotion was done | 13:29 |
| EmilienM | I checked multinode non container jobs, let's see containers | 13:29 |
| Tengu | :) | 13:29 |
| weshay | panda|ruck, legacy-tripleo-ci-centos-7-containers-multinode | 13:29 |
| openstackgerrit | Pradeep Kilambi proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf https://review.openstack.org/511350 | 13:31 |
| *** lblanchard has joined #tripleo | 13:31 | |
| EmilienM | how can we know the version of the rpm in the container in the CI jobs | 13:31 |
| EmilienM | I see container ids, http://logs.openstack.org/62/510562/21/check/legacy-tripleo-ci-centos-7-containers-multinode/47efa99/logs/subnode-2/var/log/extra/docker/docker_allinfo.log.txt.gz | 13:31 |
| Tengu | jaosorior: in the end I can write the proposal on the ML, and you might want to back it up. as you want. I think I have a pretty clear idea now. | 13:31 |
| Tengu | but the changes will be huge, I'm pretty sure every puppet module will need a new param. | 13:32 |
| jaosorior | Tengu: lets do that. I'm still investigating another bug :/ so it'll take me some time to write that mail. | 13:32 |
| Tengu | (in order to set the logging handler) | 13:32 |
| Tengu | ok, I write it then :) | 13:32 |
| jaosorior | Tengu: wouldn't be the first time we need something like that | 13:32 |
| jaosorior | Tengu: aaand we could automate the commits :P | 13:32 |
| Tengu | :) | 13:32 |
| Tengu | provided the CI don't fall appart | 13:32 |
| * Tengu runs away | 13:32 | |
| jpich | jtomasek: Hi!! Wondering if you might have some thoughts about https://review.openstack.org/#/c/511249/ as well - I think it's an improvement (I remember when saving bad parameters would mess up loading environment details from the UI) but it does add some time to parameter updates, not sure about the UI impact | 13:33 |
| jpich | just as a FYI | 13:33 |
| jtomasek | jpich: oh nice! | 13:34 |
| EmilienM | panda|ruck, weshay: I'm not sure our gate is now deploying latest containers | 13:34 |
| EmilienM | see http://logs.openstack.org/62/510562/21/check/legacy-tripleo-ci-centos-7-containers-multinode/47efa99/logs/subnode-2/var/log/extra/docker/containers/cinder_api/docker_info.log.txt.gz | 13:34 |
| EmilienM | "build-date": "20170913", | 13:34 |
| jpich | jtomasek: yeah, go apetrich :) :) | 13:34 |
| weshay | EmilienM, ya.. we need a promotion :) | 13:34 |
| jtomasek | jpich: only concern is how long the validation takes. in any case it deffinitely is a fix for long missing feature | 13:34 |
| jpich | jtomasek: It definitely takes longer here, maybe about 10 seconds? to run through the whole validation. Do we update parameters individually or, a full "page" at a time? | 13:35 |
| EmilienM | weshay: baremetal jobs had one, fyi | 13:36 |
| jtomasek | jpich: afaik, it processes templates, merges environment and sends that all to heat | 13:36 |
| *** zshi has quit IRC | 13:37 | |
| jtomasek | jpich: - same what we're doing to fetch parameters | 13:37 |
| jtomasek | which takes long, but there is probably not much we can do about it | 13:37 |
| jpich | jtomasek: Yeah, I mean I'm not sure how many calls to parameters_set the UI makes - but it sounds like it'll work out about similar then, thanks | 13:37 |
| weshay | EmilienM, they all passed I think you are saying ya? ATM the critieria for a promotion is https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config/master.ini#L14-L25 | 13:37 |
| jtomasek | problem is that we do this operation (updating params) very often which makes the experience slow | 13:37 |
| EmilienM | slagle: https://review.openstack.org/#/c/508307/ failed in the gate, http://logs.openstack.org/07/508307/31/check/legacy-tripleo-ci-centos-7-containers-multinode/f221787/logs/undercloud/home/zuul/ansible_steps.log.txt.gz#_2017-11-01_06_33_11 - I'm looking now, but I like the output better | 13:38 |
| EmilienM | weshay: yeah, all jobs passed | 13:38 |
| apetrich | jpich, that was my worry. remember that not only I have to do a validation as I do have to do a template process. it should take as long as the getparameteraction without the cache | 13:38 |
| EmilienM | weshay: but it sounds like tripleo-ci pulls old containers | 13:38 |
| apetrich | jtomasek, ^ | 13:38 |
| *** amodi has joined #tripleo | 13:38 | |
| EmilienM | mwhahaha: have you seen that error sometimes? http://logs.openstack.org/07/508307/31/check/legacy-tripleo-ci-centos-7-containers-multinode/f221787/logs/undercloud/home/zuul/ansible_steps.log.txt.gz#_2017-11-01_06_33_11 | 13:39 |
| weshay | EmilienM, look at the email I just forwarded to you | 13:39 |
| *** ykarel is now known as ykarel|afk | 13:40 | |
| EmilienM | weshay: seen | 13:41 |
| EmilienM | weshay: I was there, i know what happenned | 13:41 |
| EmilienM | weshay: but I don't understand why it happens | 13:42 |
| weshay | you can't have two periodic queues running at the same time | 13:42 |
| weshay | per release that is | 13:42 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Only mount selinux sysfs in nova_libvirt container https://review.openstack.org/515966 | 13:44 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Workflow to get Horizon URL endpoint https://review.openstack.org/516991 | 13:44 |
| *** dpeacock has quit IRC | 13:45 | |
| *** aputtur_ has joined #tripleo | 13:48 | |
| *** ykarel|afk has quit IRC | 13:50 | |
| *** Goneri has quit IRC | 13:51 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add router for IPv6 ctlplane subnet https://review.openstack.org/516992 | 13:52 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Undercloud: Add router for IPv6 ctlplane subnet https://review.openstack.org/516992 | 13:53 |
| *** Goneri has joined #tripleo | 13:53 | |
| Tengu | jaosorior: mail sent. Hope I didn't mess it :D (first impression, blahblah and so on ;)) | 13:54 |
| jaosorior | excellent | 13:55 |
| jaosorior | thanks dude | 13:55 |
| Tengu | well, thank you for the pointers on openstack-oslo ;) | 13:55 |
| *** moshele has quit IRC | 13:55 | |
| *** colonwq has quit IRC | 13:56 | |
| EmilienM | mwhahaha: ok I found the cron issue, it's a bug | 13:58 |
| EmilienM | mwhahaha: you'll see the fix, I have no idea how it worked before tbh | 13:59 |
| *** lblanchard has quit IRC | 13:59 | |
| openstackgerrit | Merged openstack/tripleo-ui master: Make validation groups labels clickable https://review.openstack.org/494513 | 14:00 |
| mwhahaha | EmilienM: cause the --detailed-exitcodes patch landed didn't it | 14:01 |
| mwhahaha | EmilienM: but I would have thought it to have failed on that patch | 14:01 |
| EmilienM | mwhahaha: ahaahah | 14:02 |
| *** abregman is now known as abregman|brb | 14:02 | |
| EmilienM | mwhahaha: https://bugs.launchpad.net/tripleo/+bug/1729352 | 14:02 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,Triaged] | 14:02 |
| *** abregman|brb is now known as abregman|mtg | 14:03 | |
| *** dpeacock has joined #tripleo | 14:04 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: cinder: switch CinderCronDbPurgeUser to 'cinder' https://review.openstack.org/516994 | 14:04 |
| EmilienM | bandini: ^ another puppet error ixed | 14:04 |
| EmilienM | fixed* | 14:04 |
| mwhahaha | copy-paste fail probably | 14:05 |
| EmilienM | need quick review on that one ^ | 14:05 |
| *** tesseract has quit IRC | 14:06 | |
| *** anshul has quit IRC | 14:07 | |
| *** ecerquei__ has joined #tripleo | 14:07 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 14:08 |
| *** salmankhan has quit IRC | 14:09 | |
| *** mwhahaha changes topic to "CI status: RED - containers-multinode broken. DO NOT APPROVE PATCHES - promotion 51 days | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/" | 14:09 | |
| *** ecerquei_ has quit IRC | 14:10 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-container fails with volume" [Critical,Triaged] | 14:10 |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Confirmed] - Assigned to Gabriele Cerami (gcerami) | 14:10 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add ability to specify KEK for simple crypto plugin https://review.openstack.org/516732 | 14:10 |
| Tengu | btw mwhahaha and/or EmilienM small question regarding the CI: I have reported another issue, if you could have a look? https://bugs.launchpad.net/tripleo/+bug/1729252 | 14:13 |
| openstack | Launchpad bug 1729252 in tripleo "CI issue: Failed to get unit file state for neutron-openvswitch-agent.service: No such file or directory" [Undecided,New] | 14:13 |
| *** janki has quit IRC | 14:13 | |
| *** janki has joined #tripleo | 14:13 | |
| EmilienM | it sounds like the OVS 2.8 again | 14:13 |
| Tengu | I love the "again". | 14:14 |
| EmilienM | mwhahaha: I'm confused about the new alert and http://logs.openstack.org/18/516418/1/gate/legacy-tripleo-ci-centos-7-containers-multinode/bd8a18e/logs/subnode-2/var/log/containers/cinder/cinder-scheduler.log.txt.gz#_2017-11-01_12_45_44_266 | 14:14 |
| EmilienM | mwhahaha: I thought containers weren't promoted | 14:14 |
| EmilienM | mwhahaha: so they were and latest cinder broke us? | 14:15 |
| *** salmankhan has joined #tripleo | 14:15 | |
| * mwhahaha shrugs | 14:15 | |
| EmilienM | adarazs, panda|ruck: also about ^ how could it pass in periodic jobs, since we run the same scenarios with tempest, etc? | 14:16 |
| weshay | panda|ruck, ok.. the containers push failed again https://review.rdoproject.org/jenkins/job/periodic-tripleo-centos-7-master-containers-build/251/console | 14:17 |
| weshay | we're sure that is local? no need to engage david simard? | 14:18 |
| *** amodi has quit IRC | 14:19 | |
| *** ykarel|afk has joined #tripleo | 14:19 | |
| panda|ruck | EmilienM: is this for master ? there were no containers uploaded after the broken promotion | 14:19 |
| adarazs | weshay: even if it's local, it might be the problem with the very low IO performance of RDO Cloud | 14:19 |
| *** adarazs is now known as adarazs|rover | 14:19 | |
| panda|ruck | weshay: yes, the logs show clearly hostname="localhost", but it it's a performance issue, we can have some chanche increasing the timeouts in docker | 14:19 |
| EmilienM | panda|ruck: master | 14:19 |
| *** anshul has joined #tripleo | 14:19 | |
| weshay | adarazs|rover, panda|ruck ok.. thank you both | 14:20 |
| panda|ruck | EmilienM: the containers for master are still from 13 Sept | 14:20 |
| panda|ruck | EmilienM: I just addedd some tags in the past week to make them work with the latest modifications in the release files | 14:20 |
| adarazs|rover | weshay: found a docker issue where people are having the same problem as us. | 14:21 |
| panda|ruck | se they could work using current-tripleo and the direct hash | 14:21 |
| *** myoung|remote has quit IRC | 14:21 | |
| adarazs|rover | weshay: see my comment on the bug: https://bugs.launchpad.net/tripleo/+bug/1729328 | 14:21 |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 14:21 |
| *** iranzo has joined #tripleo | 14:21 | |
| *** iranzo has quit IRC | 14:21 | |
| *** iranzo has joined #tripleo | 14:21 | |
| EmilienM | panda|ruck: that's weird, tempest failed | 14:21 |
| EmilienM | maybe https://bugs.launchpad.net/tripleo/+bug/1729253 is random | 14:21 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,Triaged] | 14:21 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Get DLRN hash before setting up repos and images https://review.openstack.org/512855 | 14:21 |
| EmilienM | let me look at openstackhealth | 14:21 |
| EmilienM | panda|ruck, adarazs|rover, weshay: another question, why do we still run periodic jobs in openstack-infra? http://status.openstack.org/openstack-health/#/g/build_name/periodic-tripleo-ci-centos-7-scenario001-multinode-oooq | 14:23 |
| adarazs|rover | EmilienM: probably for reference. sshnaidm: do you think we can disable the openstack-infra periodics? | 14:25 |
| EmilienM | it sounds like a waste of resources | 14:25 |
| adarazs|rover | probably. | 14:25 |
| *** akane has quit IRC | 14:25 | |
| sshnaidm | EmilienM, adarazs|rover do we run them at all? | 14:26 |
| weshay | dang.. I thought that change merged | 14:26 |
| EmilienM | why would we run them at all | 14:26 |
| sshnaidm | after zuulv3 I didn't see them running | 14:26 |
| weshay | sshnaidm, no | 14:26 |
| EmilienM | since we use RDO CI ... | 14:26 |
| EmilienM | they are running | 14:26 |
| *** salmankhan has quit IRC | 14:26 | |
| weshay | http://logs.openstack.org/periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-scenario001-multinode-oooq/ | 14:26 |
| openstackgerrit | yatin proposed openstack/tripleo-quickstart-extras master: Use shell instead of command module as using &> operator https://review.openstack.org/509084 | 14:26 |
| weshay | ya.. they are still running | 14:26 |
| sshnaidm | EmilienM, then need to disable | 14:26 |
| EmilienM | yup | 14:26 |
| *** ebarrera_ has quit IRC | 14:26 | |
| *** rfolco has quit IRC | 14:27 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Make keystone notification topics configurable https://review.openstack.org/516969 | 14:27 |
| *** iranzo has quit IRC | 14:27 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Set keystone notification topics if ceilometer is enabled https://review.openstack.org/516979 | 14:28 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Keystone: Enable notification topics to be configured https://review.openstack.org/516982 | 14:28 |
| jaosorior | mwhahaha: this is what I was referring to ^^ | 14:28 |
| *** salmankhan has joined #tripleo | 14:28 | |
| EmilienM | sshnaidm: can someone from CI team look at it? | 14:28 |
| *** ykarel|afk is now known as ykarel | 14:31 | |
| *** liverpooler has quit IRC | 14:31 | |
| *** udesale has quit IRC | 14:31 | |
| *** liverpooler has joined #tripleo | 14:32 | |
| sshnaidm | EmilienM, I'll disable them | 14:32 |
| EmilienM | thanks | 14:32 |
| weshay | sshnaidm, add me to that review please | 14:33 |
| *** amodi has joined #tripleo | 14:34 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DO NOT MERGE - Testing specific DLRN hash tag Also testing dlrn_hash_tag_newest set to specific hash. https://review.openstack.org/516624 | 14:35 |
| EmilienM | abishop: I looked at logstash and it seems like the tempest issue we have in tripleo gate is also in cinder gate since 2 days | 14:36 |
| EmilienM | http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22%20%20%20%20tempest.exceptions.VolumeResourceBuildErrorException%3A%20volume%5C%22 | 14:37 |
| *** liverpooler has quit IRC | 14:40 | |
| EmilienM | mwhahaha: looking at logstash, it looks like a random issue, recently introduced | 14:40 |
| mwhahaha | EmilienM: wonder if it's a configuration race | 14:40 |
| EmilienM | mwhahaha: i'm trying to look at devstack jobs if they fail the same way | 14:41 |
| abishop | gfidente[m]: ^^ I recall hearing discussion about proposed changed to storage-environment.yaml, could this be related? | 14:41 |
| *** cshastri has quit IRC | 14:43 | |
| *** tesseract has joined #tripleo | 14:43 | |
| *** liverpooler has joined #tripleo | 14:43 | |
| EmilienM | mwhahaha, abishop: I confirm we have the same issue as cinder gate | 14:43 |
| EmilienM | I found the same failure in cinder gate, in devstack job | 14:44 |
| EmilienM | http://logs.openstack.org/52/514952/6/check/legacy-tempest-dsvm-full-sheepdog/ed1e451/logs/screen-c-sch.txt.gz?level=ERROR | 14:44 |
| *** abregman|mtg is now known as abregman | 14:45 | |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-common master: Use ansible python api for ansible action https://review.openstack.org/511254 | 14:45 |
| EmilienM | abishop: any idea what's happenning? | 14:47 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-common master: Add zaqarclient to TripleOAction https://review.openstack.org/516347 | 14:48 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-common master: Use ansible python api for ansible action https://review.openstack.org/511254 | 14:48 |
| *** psachin has quit IRC | 14:48 | |
| *** colonwq has joined #tripleo | 14:48 | |
| abishop | EmilienM: not yet, investigating | 14:48 |
| EmilienM | I wonder if that could be https://review.openstack.org/#/c/514802/ | 14:48 |
| *** ecerquei__ has quit IRC | 14:50 | |
| EmilienM | or maybe https://review.openstack.org/#/c/514853/ | 14:50 |
| *** moshele has joined #tripleo | 14:50 | |
| panda|ruck | EmilienM: please recheck any job now, current-tripleo was pointing again to the broken hash images | 14:54 |
| *** anshul has quit IRC | 14:55 | |
| panda|ruck | EmilienM: not sure what happened, I checked yestrday if current-tripleo was pointing to the old images | 14:55 |
| EmilienM | panda|ruck: please do not recheck anything | 14:55 |
| *** ecerquei has joined #tripleo | 14:55 | |
| EmilienM | panda|ruck: we have 2 valid alerts | 14:55 |
| EmilienM | panda|ruck: cinder is failing at a high rate | 14:56 |
| panda|ruck | EmilienM: I'm not rechecking, joust pointing out that the current-tripleo link for images was pointing at the wrong images | 14:56 |
| *** fragatina has joined #tripleo | 14:56 | |
| *** fragatina has quit IRC | 14:57 | |
| *** fragatina has joined #tripleo | 14:57 | |
| *** anshul has joined #tripleo | 14:58 | |
| EmilienM | panda|ruck: ok, thx | 14:59 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Allow installing multiple-node Kubernetes https://review.openstack.org/514730 | 15:01 |
| jistr | shardy: ^^ i was able to deploy a 3+3 kubernetes cluster with firewall on, and starting pods worked too | 15:04 |
| *** fragatina has quit IRC | 15:04 | |
| dmsimard | panda|ruck: if you have a cron running that keeps updating the hash to the thing it last promoted, that's not cool | 15:05 |
| dmsimard | panda|ruck: it seemed like something was fighting against me on images.rdo | 15:06 |
| panda|ruck | dmsimard: it takes tha latest tripleo-ci-testing | 15:06 |
| panda|ruck | dmsimard: it didn't change since my revert, so it promoted things back again | 15:06 |
| dmsimard | panda|ruck: can you just disable whatever tries to promote things for now | 15:06 |
| dmsimard | panda|ruck: the promotion pipeline is fine, just disable the dlrnapi and image parts | 15:07 |
| *** gbarros has joined #tripleo | 15:07 | |
| shardy | jistr: nice! :shipit: :) | 15:07 |
| panda|ruck | dmsimard: disabled the crontab | 15:08 |
| shardy | jistr: I've made some progress on the haproxy patch, will push an update shortly but still testing atm | 15:08 |
| jtomasek | d0ugal: one of the behaviors I am seeing with mistral is that if there are multiple mistral actions/workflows started, they seem to be executed sequentially, could this be the case? | 15:09 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,Triaged] - Assigned to Alan Bishop (alan-bishop) | 15:10 |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 15:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 15:10 |
| jistr | shardy: nice :) btw pod networking might still be an issue to solve. I got the pods running fine but i'm testing pod network connectivity and kube services now, and that doesn't seem to work right... | 15:10 |
| jistr | "kube services" == the service resources in kube, built-in LBs | 15:11 |
| *** moshele has quit IRC | 15:11 | |
| *** fzdarsky has joined #tripleo | 15:11 | |
| *** masco has quit IRC | 15:12 | |
| *** dmacpher has joined #tripleo | 15:13 | |
| *** moshele has joined #tripleo | 15:15 | |
| *** moshele has quit IRC | 15:18 | |
| *** masco has joined #tripleo | 15:19 | |
| *** catintheroof has quit IRC | 15:21 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 15:22 |
| *** fzdarsky has quit IRC | 15:23 | |
| *** ebarrera_ has joined #tripleo | 15:24 | |
| panda|ruck | dmsimard: is the promotion still getting in your way ? because now tripleo-ci-testing is set to another hash, at least for master, so it should try anymore to revert our reverts | 15:25 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud master: Only enable keystone notifications if telemetry is enabled https://review.openstack.org/516989 | 15:28 |
| dmsimard | panda|ruck: I'm working on fixing the symlink for trunk.rdoproject.org | 15:30 |
| panda|ruck | dmsimard: ok ping me when ytou're don, I'll restart the cron jobs | 15:32 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Multinode provision role https://review.openstack.org/516795 | 15:36 |
| *** spectr has quit IRC | 15:37 | |
| *** amodi has quit IRC | 15:38 | |
| *** ykarel is now known as ykarel|afk | 15:38 | |
| *** anshul has quit IRC | 15:39 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test ci https://review.openstack.org/517016 | 15:42 |
| sshnaidm | rlandy, ^^ | 15:42 |
| *** itlinux has joined #tripleo | 15:43 | |
| *** dprince has quit IRC | 15:43 | |
| rlandy | sshnaidm: +1 - let's see what it says TE_DATAFILE actually is at that point | 15:43 |
| *** ykarel|afk has quit IRC | 15:44 | |
| *** newmember has quit IRC | 15:44 | |
| *** dtantsur|bbl is now known as dtantsur | 15:47 | |
| *** jlibosva has joined #tripleo | 15:49 | |
| jlibosva | hi - can anybody help me getting an information where does this job take rpms from? http://logs.openstack.org/60/513460/8/check-tripleo/legacy-tripleo-ci-centos-7-ovb-ha-oooq/3695e81/ | 15:50 |
| dmsimard | panda|ruck: can you send me what the promotion command that you use look like ? | 15:50 |
| *** amodi has joined #tripleo | 15:50 | |
| *** anshul has joined #tripleo | 15:51 | |
| panda|ruck | dmsimard: we use the python api | 15:51 |
| sshnaidm | rlandy, TE_DATAFILE is /tmp/tmprUOkGz | 15:53 |
| sshnaidm | rlandy, was easy to guess | 15:54 |
| *** yamahata has joined #tripleo | 15:54 | |
| rlandy | lovely | 15:54 |
| *** ansiwen[q] has joined #tripleo | 15:54 | |
| sshnaidm | obvious name | 15:54 |
| sshnaidm | rlandy, seems like it's created with mktemp | 15:54 |
| *** ansiwen[q] is now known as ansiwen_q | 15:54 | |
| *** gbarros_ has joined #tripleo | 15:55 | |
| *** ansiwen_q is now known as ansiwen[q] | 15:55 | |
| *** ansiwen[q] is now known as ansiwen_q | 15:56 | |
| *** janki has quit IRC | 15:56 | |
| abishop | EmilienM, mwhahaha: root issue is likely http://logs.openstack.org/18/516418/1/gate/legacy-tripleo-ci-centos-7-containers-multinode/bd8a18e/logs/subnode-2/var/log/cinder/volume.log.txt.gz#_2017-11-01_12_42_49_271 | 15:56 |
| abishop | maybe triggered by https://review.openstack.org/510201 | 15:57 |
| mwhahaha | abishop: is this the race issue with db sync? | 15:57 |
| mwhahaha | abishop: because it works sometimes | 15:57 |
| *** gbarros has quit IRC | 15:57 | |
| abishop | mwhahaha: possibly, yes | 15:57 |
| abishop | not sure why, but cinder-volume isn't containerized whereas rest of cinder services are | 15:57 |
| abishop | https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/multinode-containers.yaml#L12 | 15:58 |
| dmsimard | panda|ruck: you use the API directly ? not the client ? | 15:58 |
| mwhahaha | abishop: ask mandre https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/multinode-containers.yaml#L10 | 15:59 |
| *** ansiwen_q is now known as ansiwen[q] | 15:59 | |
| dmsimard | EmilienM, panda|ruck: fyi trunk.rdo current-tripleo is still pointing on the wrong hash, was reading backlog | 15:59 |
| *** amodi has quit IRC | 15:59 | |
| dmsimard | what I fixed earlier was images.rdo, trunk.rdo is a bit harder to fix due to the API involved... | 15:59 |
| panda|ruck | dmsimard: can I promote the link again with the DLRN CLI ? | 16:00 |
| panda|ruck | dmsimard: can I try to* | 16:00 |
| panda|ruck | yesterday night it seemed to work | 16:00 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add --detailed-exitcodes when running puppet via ansible https://review.openstack.org/517022 | 16:00 |
| dmsimard | panda|ruck: yes, but something rolled it back to the wrong hash | 16:01 |
| dmsimard | panda|ruck: see http://paste.openstack.org/raw/625228/ | 16:01 |
| dmsimard | 31388 is the september hash | 16:01 |
| dmsimard | 35331 is the wrong one (from yesterday I guess) | 16:01 |
| EmilienM | abishop: you can ask mandre (but likely on bank holiday today) | 16:01 |
| EmilienM | abishop: you could send a patch to THT to containerized it and see if Gerrit found a similar patch already, maybe we missed it | 16:02 |
| EmilienM | bandini: FYI https://review.openstack.org/#/c/517022/ | 16:02 |
| abishop | EmilienM, mwhahaha; sure, I'll propose patch to update ci env files to containerize cinder-volume | 16:03 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Certmonger: Only notify haproxy class if it's defined https://review.openstack.org/517023 | 16:03 |
| panda|ruck | dmsimard: yes, the promoter script | 16:03 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Fetch stacks only when current plan changes https://review.openstack.org/517024 | 16:03 |
| jtomasek | honza, florianf^ | 16:03 |
| panda|ruck | dmsimard: after the revert, the promoter script saw again a new hash, and it promoted it | 16:03 |
| panda|ruck | but it was the broken hash | 16:03 |
| dmsimard | panda|ruck: so can you please run it manually or something to set it back to f442a3aa35981c3d6d7e312599dde2a1b1d202c9_0468cca4 | 16:04 |
| panda|ruck | dmsimard: going with the same commend as yesterday | 16:04 |
| dmsimard | via the CLI would work | 16:04 |
| panda|ruck | dmsimard: done | 16:04 |
| panda|ruck | can you check if everything is OK again ? | 16:04 |
| panda|ruck | dmsimard: the hash has changed so the pormoter script should not interfere again | 16:05 |
| *** ansiwen[q] is now known as ansiwen_q | 16:05 | |
| panda|ruck | dmsimard: the hash for tripleo-ci-testing that is | 16:05 |
| dmsimard | panda|ruck: that's back to 2017-09-09 | 16:05 |
| dmsimard | is that correct ? | 16:05 |
| panda|ruck | yes | 16:05 |
| dmsimard | ok | 16:05 |
| panda|ruck | reenabling cron in promoter | 16:05 |
| dmsimard | panda|ruck: don't re-enable anything yet please | 16:05 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Certmonger: Only notify haproxy class if it's defined https://review.openstack.org/517023 | 16:05 |
| dmsimard | panda|ruck: do we know what was the result of the last promotion run ? | 16:06 |
| panda|ruck | dmsimard: for master, failed, for the container push error | 16:06 |
| dmsimard | panda|ruck: ok, push timeout ? | 16:06 |
| panda|ruck | dmsimard: no wait that was the one before, this failed for slave problems | 16:07 |
| *** catintheroof has joined #tripleo | 16:07 | |
| dmsimard | panda|ruck: you are positive that if you re-enable the cron it's not going to go and re-promote old stuff again ? | 16:08 |
| *** dtrainor has joined #tripleo | 16:08 | |
| panda|ruck | dmsimard: yes, because tripleo-ci-testing points to a different hash now, and it will not try to promote anything else | 16:08 |
| dmsimard | panda|ruck: ok, up to you if you want to re-enable it | 16:09 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-heat-templates master: Update ansible before the ansible upgrade tasks https://review.openstack.org/517025 | 16:09 |
| panda|ruck | dmsimard: ok | 16:09 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Move instackenv.json copy and inventory to ovb-create-stack task. https://review.openstack.org/517026 | 16:09 |
| *** trown is now known as trown|lunch | 16:10 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 16:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,Triaged] - Assigned to Alan Bishop (alan-bishop) | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 16:10 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add --detailed-exitcodes when running puppet via ansible https://review.openstack.org/517022 | 16:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 16:10 |
| panda|ruck | dmsimard: ok reenabled | 16:10 |
| panda|ruck | dmsimard: also, if yu can take a lokk at https://review.rdoproject.org/jenkins/job/periodic-tripleo-centos-7-master-containers-build/250/console ? if happened on the run at 9AM UTC | 16:11 |
| EmilienM | can I get another core review on https://review.openstack.org/#/c/516994/ please | 16:11 |
| panda|ruck | not sure if I should open a bug | 16:11 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-heat-templates master: Test.Do not merge. Update ansible before the ansible upgrade tasks https://review.openstack.org/517025 | 16:12 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: mysql: Only set certificate specs if TLS everywhere is enabled https://review.openstack.org/517029 | 16:13 |
| *** aufi has quit IRC | 16:14 | |
| *** anshul has quit IRC | 16:14 | |
| *** anshul has joined #tripleo | 16:14 | |
| dmsimard | need a +3 from tripleo-ci core on https://review.openstack.org/#/c/516785/ | 16:17 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: mysql: Only set certificate specs if TLS everywhere is enabled https://review.openstack.org/517029 | 16:17 |
| dmsimard | panda|ruck: "10:36:48 Slave went offline during the build" | 16:17 |
| dmsimard | panda|ruck: if it reproduces often it might be bug worthy but that seems like a momentary network problem | 16:18 |
| panda|ruck | dmsimard: ok, I'll monitor | 16:18 |
| *** jmelvin has quit IRC | 16:18 | |
| panda|ruck | dmsimard: zuulv3 has +3 now ? | 16:18 |
| panda|ruck | dmsimard: zuulv4 will have +4 ? | 16:19 |
| dmsimard | panda|ruck: +3 means it's missing a +2 and +W :) | 16:20 |
| dmsimard | (but it already has a +2) | 16:20 |
| *** jschlueter|znc is now known as jschlueter | 16:21 | |
| *** newmember has joined #tripleo | 16:23 | |
| *** achadha_ has joined #tripleo | 16:26 | |
| *** amodi has joined #tripleo | 16:26 | |
| *** achadha has joined #tripleo | 16:26 | |
| *** masco has quit IRC | 16:27 | |
| *** achadha_ has quit IRC | 16:30 | |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates master: Containerize cinder services under pacemaker in CI https://review.openstack.org/517038 | 16:33 |
| *** gvrangan has joined #tripleo | 16:34 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: certmonger/HAProxy: don't use principal if CA is local https://review.openstack.org/517039 | 16:34 |
| openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Don't rewrite resource_registry values that aren't paths https://review.openstack.org/517040 | 16:36 |
| shardy | mcornea: ^^ aims to fix the issue we've been discussing | 16:36 |
| mcornea | shardy: thanks, will try it | 16:37 |
| openstackgerrit | Andy Smith proposed openstack/tripleo-heat-templates master: WIP Separate rpc and notify messaging backends https://review.openstack.org/507963 | 16:42 |
| *** dmarlin has joined #tripleo | 16:43 | |
| *** yprokule has quit IRC | 16:43 | |
| *** dsariel__ has quit IRC | 16:44 | |
| *** catintheroof has quit IRC | 16:45 | |
| *** abregman has quit IRC | 16:46 | |
| *** ykarel|afk has joined #tripleo | 16:46 | |
| *** gbarros_ has quit IRC | 16:46 | |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates master: Containerize cinder services under pacemaker in CI https://review.openstack.org/517038 | 16:47 |
| *** jlibosva has quit IRC | 16:49 | |
| honza | jtomasek: +1 | 16:50 |
| *** catintheroof has joined #tripleo | 16:52 | |
| *** pcaruana has quit IRC | 16:52 | |
| *** marios has quit IRC | 16:54 | |
| *** ffiore has joined #tripleo | 16:54 | |
| openstackgerrit | Gonéri Le Bouder proposed openstack/tripleo-quickstart-extras master: tempest: conditional --provider:physical_network https://review.openstack.org/514313 | 16:54 |
| *** amodi has quit IRC | 16:56 | |
| *** salmankhan has quit IRC | 16:57 | |
| *** panda|ruck is now known as panda|ruck|bbl | 16:58 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-validations master: Add per-network bind ips to inventory https://review.openstack.org/517051 | 17:00 |
| *** amodi has joined #tripleo | 17:01 | |
| *** brault has joined #tripleo | 17:02 | |
| *** salmankhan has joined #tripleo | 17:02 | |
| *** openstackgerrit has quit IRC | 17:03 | |
| *** amodi has quit IRC | 17:06 | |
| *** ukalifon has quit IRC | 17:06 | |
| *** brault has quit IRC | 17:06 | |
| *** jcoufal has quit IRC | 17:07 | |
| *** jcoufal has joined #tripleo | 17:08 | |
| *** gbarros has joined #tripleo | 17:09 | |
| *** itlinux has quit IRC | 17:09 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 17:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 17:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 17:10 |
| *** ansiwen has quit IRC | 17:10 | |
| *** ansiwen has joined #tripleo | 17:11 | |
| *** anshul has quit IRC | 17:13 | |
| *** lucasagomes is now known as lucas-afk | 17:13 | |
| *** ebarrera_ has quit IRC | 17:14 | |
| *** fragatina has joined #tripleo | 17:16 | |
| *** openstackgerrit has joined #tripleo | 17:16 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Enable loadbalancer for kubernetes masters https://review.openstack.org/516894 | 17:16 |
| *** agurenko has quit IRC | 17:17 | |
| *** moshele has joined #tripleo | 17:20 | |
| *** mcornea has quit IRC | 17:20 | |
| *** jmelvin has joined #tripleo | 17:20 | |
| *** jcoufal has quit IRC | 17:21 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test image build https://review.openstack.org/517059 | 17:21 |
| *** myoung|afk is now known as myoung | 17:22 | |
| *** jcoufal has joined #tripleo | 17:22 | |
| *** jpich has quit IRC | 17:22 | |
| sshnaidm | EmilienM, mwhahaha weshay - https://review.openstack.org/#/c/517019/ removing periodic | 17:24 |
| EmilienM | sshnaidm: thx | 17:25 |
| weshay | we had a card on that I'm sure of it.. :( | 17:25 |
| *** myoung is now known as myoung|workshop | 17:28 | |
| *** trown|lunch is now known as trown | 17:34 | |
| d0ugal | jtomasek: the number processed concurrently depends how mistral is deployed - I think you need multiple engines/executors for more concurrency. | 17:34 |
| d0ugal | jtomasek: sorry for the delayed response | 17:34 |
| jtomasek | d0ugal: ok, I wonder how it is in undercloud | 17:35 |
| *** ansiwen has quit IRC | 17:36 | |
| *** itlinux has joined #tripleo | 17:37 | |
| *** ansiwen has joined #tripleo | 17:37 | |
| *** ecerquei has quit IRC | 17:38 | |
| *** gvrangan has quit IRC | 17:39 | |
| *** ykarel|afk has quit IRC | 17:40 | |
| d0ugal | jtomasek: I'm not totally sure. Is it causing a problem? | 17:40 |
| *** gvrangan has joined #tripleo | 17:40 | |
| jtomasek | d0ugal: we're hitting some performance problems for example in case when parameters are fetched or validations are being loaded (both take quite long). any subsequent call to mistral gets resolved after the previous one is done | 17:42 |
| jtomasek | d0ugal: I'd have to do more proper observation to clearly identify the problem. so I was generally asking how things work | 17:43 |
| d0ugal | jtomasek: right, sounds like we should look into it. | 17:43 |
| *** ecerquei has joined #tripleo | 17:45 | |
| jtomasek | d0ugal: mistral.conf has api_workers=4 am I looking at the right thing? | 17:48 |
| d0ugal | jtomasek: no :) | 17:48 |
| jtomasek | haha | 17:48 |
| d0ugal | jtomasek: I found that too, it is just for the HTTP api. | 17:48 |
| d0ugal | jtomasek: I did know it before but I can't find it now. I can look tomorrow if you don't have any luck | 17:50 |
| *** sshnaidm is now known as sshnaidm|afk | 17:50 | |
| jtomasek | thanks, no rush | 17:50 |
| *** itlinux has quit IRC | 17:58 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow https://review.openstack.org/513463 | 17:59 |
| EmilienM | panda|ruck|bbl: can we unpromote everything, the gate is broken now, cinder is failing all the times in tempest | 18:00 |
| EmilienM | weshay: why don't we have tempest html results on http://logs.openstack.org/94/516994/1/check/legacy-tripleo-ci-centos-7-containers-multinode/63b9368/logs/ ? | 18:01 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: Add ability to specify KEK for simple crypto plugin https://review.openstack.org/516732 | 18:01 |
| EmilienM | weshay: tempest ran and failed http://logs.openstack.org/94/516994/1/check/legacy-tripleo-ci-centos-7-containers-multinode/63b9368/logs/undercloud/home/zuul/tempest_output.log.txt.gz | 18:01 |
| EmilienM | weshay: but no html results like we used to have | 18:01 |
| *** vpickard is now known as vpickard_ | 18:01 | |
| *** itlinux has joined #tripleo | 18:01 | |
| weshay | EmilienM, yes I know we talked about this already | 18:01 |
| EmilienM | weshay: http://logs.openstack.org/94/516994/1/check/legacy-tripleo-ci-centos-7-containers-multinode/63b9368/logs/ara_oooq/result/a8edbb2b-569d-409d-8608-fb47b476337e/ | 18:01 |
| EmilienM | weshay: and? | 18:02 |
| *** panda|ruck|bbl is now known as panda|ruck | 18:04 | |
| panda|ruck | EmilienM: what do you want me to unpromote ? | 18:04 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Move instackenv.json copy to ovb-create-stack task https://review.openstack.org/517026 | 18:04 |
| EmilienM | panda|ruck: everything | 18:04 |
| EmilienM | panda|ruck: something broke in cinder, abishop is on it | 18:05 |
| EmilienM | panda|ruck: but we don't want latest cinder for sure | 18:05 |
| EmilienM | it's broken | 18:05 |
| *** moshele has quit IRC | 18:05 | |
| panda|ruck | EmilienM: master ? pike ? ocata ? | 18:05 |
| EmilienM | panda|ruck: master | 18:05 |
| panda|ruck | EmilienM: ok, master should be back to september hash | 18:06 |
| EmilienM | ok | 18:06 |
| EmilienM | panda|ruck: same for containers, right? | 18:06 |
| panda|ruck | EmilienM: yes | 18:06 |
| EmilienM | weshay: i'm filling a bug for tempest/html | 18:06 |
| EmilienM | panda|ruck: k thx | 18:06 |
| *** moshele has joined #tripleo | 18:07 | |
| EmilienM | weshay: https://bugs.launchpad.net/tripleo/+bug/1729403 | 18:08 |
| openstack | Launchpad bug 1729403 in tripleo "subunit2html fails to run in TripleO CI" [Medium,Triaged] | 18:08 |
| *** myoung|workshop is now known as myoung|afk | 18:09 | |
| *** myoung|afk is now known as myoung | 18:09 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 18:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 18:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 18:10 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Only mount selinux sysfs in nova_libvirt container https://review.openstack.org/515966 | 18:14 |
| *** moshele has quit IRC | 18:16 | |
| *** ansiwen_q is now known as ansiwen[q] | 18:17 | |
| *** ecerquei_ has joined #tripleo | 18:19 | |
| *** moshele has joined #tripleo | 18:19 | |
| *** ecerquei has quit IRC | 18:22 | |
| itlinux | hi guys can PIKE deploy barbican? | 18:22 |
| itlinux | does barbican work well in PIKE I heard that there was some issues with Ocata.. Thanks | 18:24 |
| *** ecerquei_ has quit IRC | 18:25 | |
| *** dprince has joined #tripleo | 18:25 | |
| *** ecerquei has joined #tripleo | 18:25 | |
| *** yamahata has quit IRC | 18:26 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Refactor cellv2 host discovery logic to avoid races https://review.openstack.org/513867 | 18:26 |
| *** moshele has quit IRC | 18:26 | |
| *** lblanchard has joined #tripleo | 18:28 | |
| *** tesseract has quit IRC | 18:28 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Refactor cellv2 host discovery logic to avoid races https://review.openstack.org/513867 | 18:30 |
| *** ansiwen[q] has quit IRC | 18:30 | |
| *** bnemec has quit IRC | 18:35 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add DockerDebug https://review.openstack.org/517075 | 18:35 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-common master: Add Barbican worker and keystone notifier images https://review.openstack.org/517076 | 18:35 |
| *** adac has joined #tripleo | 18:41 | |
| *** ecerquei_ has joined #tripleo | 18:41 | |
| *** rwsu has quit IRC | 18:42 | |
| *** ecerquei has quit IRC | 18:44 | |
| *** ecerquei_ has quit IRC | 18:45 | |
| owalsh | dprince: hi, if you have time would you mind reviewing https://review.openstack.org/513867 | 18:45 |
| *** ecerquei has joined #tripleo | 18:45 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Add tls roles for undercloud https://review.openstack.org/517079 | 18:45 |
| *** ecerquei has joined #tripleo | 18:45 | |
| dprince | owalsh: looking now | 18:47 |
| owalsh | thanks | 18:48 |
| *** paramite has quit IRC | 18:51 | |
| *** dtantsur is now known as dtantsur|afk | 18:53 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Use playbook from tripleo-quickstart-extras for OVB https://review.openstack.org/513508 | 18:53 |
| dmsimard | mwhahaha, EmilienM, weshay, adarazs|rover, panda|ruck: could I just get a quick ack before I approve https://review.openstack.org/#/c/517002/ | 18:58 |
| weshay | +1 from me | 18:59 |
| dmsimard | +W'd, thanks | 18:59 |
| EmilienM | great +1 | 19:00 |
| *** abregman has joined #tripleo | 19:02 | |
| *** rlandy is now known as rlandy|brb | 19:03 | |
| *** openstackgerrit has quit IRC | 19:03 | |
| *** bnemec has joined #tripleo | 19:03 | |
| *** abregman has quit IRC | 19:03 | |
| *** openstackgerrit has joined #tripleo | 19:04 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates stable/pike: Add tags to baremetal cron removal tasks https://review.openstack.org/517082 | 19:04 |
| *** yamahata has joined #tripleo | 19:06 | |
| *** jlibosva has joined #tripleo | 19:06 | |
| *** jlibosva has quit IRC | 19:06 | |
| *** salmankhan has quit IRC | 19:07 | |
| *** raildo has quit IRC | 19:07 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 19:10 |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 19:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 19:10 |
| *** mwhahaha changes topic to "CI status: RED - see alerts, do not recheck/approve patches until the alerts are cleared as the gate is very, very far behind and full - promotion 51 days | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/" | 19:11 | |
| *** itlinux has quit IRC | 19:13 | |
| bnemec | 56 patches in the gate queue. That might be a new record. | 19:13 |
| *** noslzzp has quit IRC | 19:13 | |
| mwhahaha | 56 patches in the gate queue. 56 patches in the gate queue. One fails, they all reset. 55 patches in the gate queueeeeeeeee | 19:14 |
| *** catintheroof has quit IRC | 19:16 | |
| *** owalsh is now known as owalsh_biab | 19:18 | |
| *** catintheroof has joined #tripleo | 19:18 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf https://review.openstack.org/511350 | 19:18 |
| *** adac has quit IRC | 19:18 | |
| *** rlandy|brb is now known as rlandy | 19:21 | |
| *** raildo has joined #tripleo | 19:21 | |
| *** etingof has quit IRC | 19:24 | |
| dprince | owalsh_biab: hi, commented on your patch. let me know your thoughts... | 19:25 |
| *** Goneri has quit IRC | 19:25 | |
| *** Goneri has joined #tripleo | 19:26 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Don't append DockerInsecureRegistryAddress https://review.openstack.org/514477 | 19:27 |
| *** jcoufal_ has joined #tripleo | 19:27 | |
| openstackgerrit | Merged openstack/tripleo-common master: Allow running mistral-api service via wsgi in container https://review.openstack.org/513323 | 19:27 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: RHSM: when using proxy, test its connectivity first https://review.openstack.org/513530 | 19:27 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: added level of indirection causes incorrect hiera config https://review.openstack.org/508369 | 19:27 |
| *** itlinux has joined #tripleo | 19:28 | |
| *** jcoufal has quit IRC | 19:30 | |
| *** jcoufal has joined #tripleo | 19:31 | |
| owalsh_biab | dprince: yea, what I did initially but needed a plan B after I waited ~30days for the promotion | 19:32 |
| *** jcoufal_ has quit IRC | 19:33 | |
| owalsh_biab | dprince: also found this really useful for development, but yes, probably will move it to tripleo-common in a follow-up patch | 19:34 |
| dprince | owalsh_biab: agree this is much more hackable. Not opposed to the idea of it. Just that writing more to the host is something we want to stop doing soon I think. Like all the puppet stuff needs a lot of fixes in this regard as well | 19:36 |
| *** bobh has quit IRC | 19:38 | |
| owalsh_biab | dprince: oh, another issue I needed this for was jinga2 | 19:40 |
| *** gvrangan has quit IRC | 19:41 | |
| *** gvrangan has joined #tripleo | 19:42 | |
| owalsh_biab | dprince: https://github.com/ansible/ansible/issues/16968 | 19:43 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Fix delorean_hash for newton and ocata promotion https://review.openstack.org/516567 | 19:43 |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Refactor undercloud deploy to use Ansible. https://review.openstack.org/515967 | 19:44 |
| mwhahaha | hey look stuff is finally merging after 16 hours | 19:45 |
| *** bnemec has quit IRC | 19:53 | |
| openstackgerrit | Eric Harney proposed openstack/tripleo-heat-templates master: Set ipc=host for services attaching encrypted volumes https://review.openstack.org/517096 | 19:53 |
| *** pkovar has quit IRC | 19:55 | |
| *** anshul has joined #tripleo | 19:56 | |
| *** rwsu has joined #tripleo | 19:56 | |
| abishop | EmilienM, mwhahaha: re cinder backend CI blocker, I have cinder-volume in a container under pacemaker, but it's hosed | 20:04 |
| abishop | http://logs.openstack.org/38/517038/2/check/legacy-tripleo-ci-centos-7-containers-multinode/5aff66b/logs/subnode-2/var/log/containers/cinder/cinder-volume.log.txt.gz | 20:04 |
| abishop | I think docker/services/pacemaker/cinder-volume.yaml was never kept up with non-pacemaker version | 20:05 |
| mwhahaha | abishop: it's poaable | 20:05 |
| mwhahaha | abishop: for what it's worth I haven't seen that job fail again for that reason since the package promotion repo stuff was fixed | 20:06 |
| mwhahaha | so maybe it was bad images as to why we were seeing | 20:06 |
| abishop | mwhahaha: that would ease the urgency | 20:06 |
| mwhahaha | yea stuff's merging at the moment | 20:06 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data https://review.openstack.org/508567 | 20:06 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow https://review.openstack.org/509419 | 20:06 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow https://review.openstack.org/513463 | 20:06 |
| mwhahaha | i'm keeping an eye on it to see if pops up again | 20:06 |
| mwhahaha | abishop: it might be a blocker for promotion but at least it doesn't seem to be failing in the gate anymore | 20:07 |
| abishop | mwhahaha: can we get a container expert to help recraft the pacemaker/cinder-XXX.yaml files? | 20:07 |
| * mwhahaha points to mandre, dprince for such help | 20:07 | |
| *** liverpooler has quit IRC | 20:08 | |
| abishop | mwhahaha: I'll write a lp for it | 20:08 |
| *** gbarros has quit IRC | 20:09 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 20:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 20:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 20:10 |
| *** Goneri has quit IRC | 20:14 | |
| *** jcoufal_ has joined #tripleo | 20:18 | |
| mwhahaha | meh timeout in gate | 20:18 |
| dprince | abishop: last I checked cinder-volume.yaml was functional for me | 20:18 |
| dprince | abishop: non-pacemaker | 20:18 |
| dprince | abishop: what are you noticing with it/ | 20:19 |
| dprince | ? | 20:19 |
| *** jcoufal__ has joined #tripleo | 20:20 | |
| *** anshul has quit IRC | 20:20 | |
| *** jcoufal has quit IRC | 20:20 | |
| abishop | dprince: details in https://bugs.launchpad.net/tripleo/+bug/1729430 | 20:21 |
| openstack | Launchpad bug 1729430 in tripleo "Cinder containers used with pacemaker not configured correctly" [Critical,New] | 20:21 |
| abishop | dprince: issue is w/ pacemaker | 20:21 |
| dprince | abishop: oh, i see. Pacemaker is behind perhaps | 20:21 |
| abishop | yep | 20:22 |
| abishop | dprince: I could flail at updating it, but I would be flailing | 20:22 |
| *** jcoufal_ has quit IRC | 20:22 | |
| dprince | abishop: so for that we can help, but you might also keep dciabrin, and bandini in your arsenal | 20:22 |
| abishop | dprince: good to know | 20:23 |
| *** rwsu has quit IRC | 20:23 | |
| abishop | dprince, dciabrin, bandini: note that https://review.openstack.org/517096 will be updating cinder-volume's non-pacemaker config | 20:24 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates stable/pike: Add tags to baremetal cron removal tasks https://review.openstack.org/517082 | 20:25 |
| *** dprince has quit IRC | 20:26 | |
| *** jcoufal__ has quit IRC | 20:27 | |
| *** morazi has quit IRC | 20:28 | |
| *** ffiore has quit IRC | 20:29 | |
| *** ffiore_ has joined #tripleo | 20:29 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow https://review.openstack.org/513463 | 20:29 |
| *** Goneri has joined #tripleo | 20:30 | |
| openstackgerrit | Aditya Vaja proposed openstack/tripleo-heat-templates stable/ocata: added level of indirection causes incorrect hiera config https://review.openstack.org/517104 | 20:32 |
| *** ffiore_ has quit IRC | 20:34 | |
| *** aputtur_ has quit IRC | 20:35 | |
| *** bnemec has joined #tripleo | 20:35 | |
| *** ecerquei has quit IRC | 20:36 | |
| *** rwsu has joined #tripleo | 20:42 | |
| *** rfolco_ has quit IRC | 20:43 | |
| *** ansmith has quit IRC | 20:45 | |
| *** threestrands has joined #tripleo | 20:48 | |
| *** toure is now known as toure_biab | 20:52 | |
| *** achadha has quit IRC | 20:54 | |
| *** lblanchard has quit IRC | 20:55 | |
| *** achadha has joined #tripleo | 20:55 | |
| *** adac has joined #tripleo | 20:59 | |
| *** derekh has quit IRC | 20:59 | |
| *** achadha has quit IRC | 21:00 | |
| *** jprovazn has quit IRC | 21:02 | |
| *** gvrangan has quit IRC | 21:05 | |
| *** moshele has joined #tripleo | 21:08 | |
| *** trown is now known as trown|outtypewww | 21:08 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 21:10 |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 21:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 21:10 |
| *** morazi has joined #tripleo | 21:11 | |
| *** bfournie has quit IRC | 21:13 | |
| *** catintheroof has quit IRC | 21:16 | |
| *** leitan has quit IRC | 21:21 | |
| *** abishop has quit IRC | 21:24 | |
| openstackgerrit | Aditya Vaja proposed openstack/tripleo-heat-templates stable/pike: added level of indirection causes incorrect hiera config https://review.openstack.org/517113 | 21:37 |
| *** brian83 has quit IRC | 21:39 | |
| *** raildo has quit IRC | 21:40 | |
| *** itlinux has quit IRC | 21:42 | |
| *** rcernin has joined #tripleo | 21:42 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add workflow for deployment via config-download https://review.openstack.org/512876 | 21:44 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Log Ansible actions to ansible.log https://review.openstack.org/514783 | 21:44 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add work_dir for some actions https://review.openstack.org/514784 | 21:44 |
| *** achadha has joined #tripleo | 21:45 | |
| *** achadha_ has joined #tripleo | 21:46 | |
| *** achadha has quit IRC | 21:50 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Move defaults out of overcloud_containers.yaml.j2 https://review.openstack.org/516136 | 21:52 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Finish deprecation of pull_source https://review.openstack.org/516138 | 21:52 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: WIP Implement a skopeo based image uploader https://review.openstack.org/515252 | 21:52 |
| *** etingof has joined #tripleo | 21:55 | |
| *** rwsu has quit IRC | 21:57 | |
| *** bobh has joined #tripleo | 21:59 | |
| *** etingof has quit IRC | 22:00 | |
| *** jmelvin has quit IRC | 22:01 | |
| *** shardy has quit IRC | 22:01 | |
| *** adac has quit IRC | 22:02 | |
| *** bobh has quit IRC | 22:03 | |
| *** florianf has quit IRC | 22:04 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 22:10 |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 22:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 22:10 |
| *** moshele has quit IRC | 22:13 | |
| *** etingof has joined #tripleo | 22:13 | |
| *** panda|ruck is now known as panda|ruck|off | 22:13 | |
| *** jlabarre has quit IRC | 22:15 | |
| openstackgerrit | Aditya Vaja proposed openstack/tripleo-heat-templates stable/pike: added level of indirection causes incorrect hiera config https://review.openstack.org/517113 | 22:15 |
| *** rlandy is now known as rlandy|afk | 22:17 | |
| openstackgerrit | Aditya Vaja proposed openstack/tripleo-heat-templates stable/ocata: added level of indirection causes incorrect hiera config https://review.openstack.org/517104 | 22:18 |
| *** ffiore_ has joined #tripleo | 22:18 | |
| *** owalsh_biab is now known as owalsh | 22:26 | |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Refactor undercloud deploy to use Ansible. https://review.openstack.org/515967 | 22:28 |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Mount a tmpfs filesystem for heat tmpfiles https://review.openstack.org/508558 | 22:31 |
| *** brault has joined #tripleo | 22:38 | |
| *** brault has quit IRC | 22:43 | |
| openstackgerrit | Ian Main proposed openstack/python-tripleoclient master: Refactor undercloud deploy to use Ansible. https://review.openstack.org/515967 | 22:43 |
| *** owalsh is now known as owalsh_pto | 22:46 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates stable/pike: Only mount selinux sysfs in nova_libvirt container https://review.openstack.org/517125 | 22:48 |
| *** artom has quit IRC | 22:48 | |
| *** ffiore_ has quit IRC | 22:54 | |
| *** dmarlin has quit IRC | 22:54 | |
| *** bfournie has joined #tripleo | 22:55 | |
| tonyb | I'm pretty sure I've done somethign wrong with my overcloud deploy (wrt templates and environment files) I have a 3 system (1 ctrl, 2 compute) overcloud and when I do the deploy neutron fiales to start because the IP (neutron::db::mysql::host) has an IP that doesn't match any of the systems. | 22:57 |
| *** ffiore_ has joined #tripleo | 22:57 | |
| tonyb | I know it's a pretty wide question but any idea what I may have missed? | 22:57 |
| tonyb | Would I be better to create a plan to validate that I have everythign right? | 22:58 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 23:00 |
| *** ffiore_ has quit IRC | 23:02 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test repositories https://review.openstack.org/517130 | 23:03 |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 23:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Alan Bishop (alan-bishop) | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729328 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729352 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1729328 in tripleo "Container images build in RDOcloud are randomly failing to be pushed to localhost" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 23:10 |
| openstack | Launchpad bug 1729352 in tripleo "CinderCronDbPurgeUser is set to 'keystone' by default" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 23:10 |
| *** bfournie has quit IRC | 23:11 | |
| *** newmember has quit IRC | 23:12 | |
| *** dmacpher has quit IRC | 23:14 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: [Newton only] Fix double sed backup during upgrade. https://review.openstack.org/516676 | 23:23 |
| *** achadha_ has quit IRC | 23:25 | |
| *** dansmith has left #tripleo | 23:26 | |
| *** moshele has joined #tripleo | 23:31 | |
| moshele | beagles: hi | 23:32 |
| *** moshele has quit IRC | 23:38 | |
| *** achadha has joined #tripleo | 23:42 | |
| *** bfournie has joined #tripleo | 23:43 | |
| Slower | slagle: any thoughts on this failure? http://logs.openstack.org/67/515967/8/check/legacy-tripleo-ci-centos-7-undercloud-containers/69f8a34/logs/var/log/undercloud_install.txt.gz | 23:46 |
| Slower | I've never seen those deprication warnings either | 23:46 |
| *** achadha has quit IRC | 23:46 | |
| tonyb | well looking at the generated plan certainly gives more more yaml to look at. | 23:48 |
| tonyb | Still not really sure how/why it picked the IP it did. | 23:48 |
| tonyb | but I'm more convinced that the defult networking isn't going to work for me | 23:49 |
| * tonyb goes back to re-read the planning networks section | 23:49 | |
| Slower | it's clear we need to log the ansible playbooks too | 23:50 |
| *** abishop has joined #tripleo | 23:53 | |
| *** links has joined #tripleo | 23:56 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!