| *** nyechiel has quit IRC | 00:09 | |
| EmilienM | stevebaker: hey oh hi! | 00:12 |
|---|---|---|
| EmilienM | stevebaker: https://review.openstack.org/#/c/568375/1 approved - but where do we deploy the rpm now? | 00:12 |
| stevebaker | EmilienM: helooo | 00:12 |
| EmilienM | second question: https://review.openstack.org/#/c/566769/2/puppet/services/mistral-base.yaml | 00:14 |
| stevebaker | EmilienM: for local dev which requires full kolla builds, just install openstack-kolla. For build pipelines they will need to install openstack-kolla in their provision script. But is there anywhere which installs a full undercloud so they can build images? | 00:15 |
| EmilienM | stevebaker: not that I'm aware of | 00:15 |
| EmilienM | stevebaker: I think your patch is good and we shouldn't deploy the rpm by default | 00:16 |
| stevebaker | EmilienM: https://review.openstack.org/#/c/566769/2 | 00:17 |
| EmilienM | stevebaker: the namespace is wrong | 00:20 |
| EmilienM | you used mistral::executor::docker_group | 00:20 |
| EmilienM | it should be tripleo::profile::base::mistral::executor::docker_group | 00:20 |
| openstackgerrit | Merged openstack/ansible-role-container-registry master: Don't install kolla https://review.openstack.org/568375 | 00:21 |
| stevebaker | EmilienM: ok, I'll fix it up. thank | 00:21 |
| stevebaker | s | 00:21 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Expose parameter MistralDockerGroup https://review.openstack.org/566769 | 00:22 |
| EmilienM | stevebaker: ^ | 00:22 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Expose parameter MistralDockerGroup https://review.openstack.org/566769 | 00:22 |
| EmilienM | stevebaker: we *could* handle the kolla rpm in the THT service | 00:24 |
| EmilienM | stevebaker: like in the docker-registry service, with a parameter, and use deploy_step_tasks to deploy the rpm | 00:24 |
| *** bfournie has quit IRC | 00:25 | |
| *** bfournie has joined #tripleo | 00:26 | |
| *** artom has quit IRC | 00:27 | |
| stevebaker | EmilienM: there is a good argument for not though, we want to encourage folk consuming tested RDO images | 00:27 |
| EmilienM | stevebaker: fine by me | 00:29 |
| weshay | mwhahaha, ya.. we got 99 problems https://bugs.launchpad.net/tripleo/+bug/1771233 | 00:29 |
| openstack | Launchpad bug 1771233 in tripleo "te-broker errors in tripleo 3rd party jobs" [Critical,Triaged] | 00:29 |
| EmilienM | stevebaker: in that case I would remove enable_container_images_build in tripleoclient ok? | 00:29 |
| EmilienM | since we're switching to ansible and stop using puppet-tripleo for deploying docker | 00:29 |
| *** bfournie has quit IRC | 00:30 | |
| EmilienM | stevebaker: https://git.openstack.org/cgit/openstack/python-tripleoclient/tree/tripleoclient/config/undercloud.py#n245 becomes useless, right? | 00:31 |
| stevebaker | EmilienM: way ahead of you, and it turns out it was never wired in to do anything! https://review.openstack.org/#/c/568384/ | 00:31 |
| EmilienM | the parameter is even not used | 00:31 |
| EmilienM | yeah | 00:31 |
| EmilienM | stevebaker: lol ahead of me | 00:31 |
| mwhahaha | weshay: meh | 00:31 |
| EmilienM | stevebaker: -1 is ahead of you :P | 00:32 |
| stevebaker | EmilienM: also I change the default for this https://review.openstack.org/#/c/568376/ | 00:32 |
| EmilienM | stevebaker: +2 | 00:32 |
| EmilienM | stevebaker: nice progress on the image prepare stuff :) | 00:32 |
| *** weshay changes topic to "Welcome to Rocky. CI status: YELLOW (OVB failing) | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest" | 00:33 | |
| EmilienM | stevebaker: are we moving https://github.com/steveb/ansible-role-tripleo-modify-image to OpenStack ? | 00:33 |
| stevebaker | EmilienM: yes, just need to take the first step. I think it is ready | 00:36 |
| *** slaweq has quit IRC | 00:46 | |
| *** bfournie has joined #tripleo | 00:47 | |
| *** psahoo has joined #tripleo | 00:53 | |
| *** slaweq has joined #tripleo | 00:53 | |
| *** threestrands has quit IRC | 01:00 | |
| *** ramishra has joined #tripleo | 01:01 | |
| *** dmacpher has quit IRC | 01:06 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1771233 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1771233 in tripleo "te-broker errors in tripleo 3rd party jobs" [Critical,Triaged] | 01:10 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Run "overcloud container image prepare" only once https://review.openstack.org/528621 | 01:25 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Move BUILD_ID setting logic out of template https://review.openstack.org/568396 | 01:25 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: WIP Use "openstack tripleo container image prepare" https://review.openstack.org/568403 | 01:25 |
| *** ramishra has quit IRC | 01:25 | |
| openstackgerrit | Merged openstack/tripleo-common master: Use Designate Worker container for config https://review.openstack.org/564049 | 01:27 |
| *** ramishra has joined #tripleo | 01:27 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: WIP Use "openstack tripleo container image prepare" https://review.openstack.org/568403 | 01:31 |
| openstackgerrit | Shuo Liu proposed openstack/tripleo-heat-templates master: fix spelling misktake https://review.openstack.org/568405 | 01:39 |
| EmilienM | stevebaker: ok, let me know if you need any help | 01:56 |
| stevebaker | EmilienM: ok thanks | 01:57 |
| *** ramishra has quit IRC | 02:05 | |
| *** ramishra has joined #tripleo | 02:09 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1771233 | 02:10 |
| openstack | Launchpad bug 1771233 in tripleo "te-broker errors in tripleo 3rd party jobs" [Critical,Triaged] | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| *** abishop has quit IRC | 02:12 | |
| *** tzumainn has quit IRC | 02:16 | |
| *** ramishra has quit IRC | 02:17 | |
| *** ramishra has joined #tripleo | 02:18 | |
| *** adrianreza has joined #tripleo | 02:21 | |
| *** ramishra has quit IRC | 02:26 | |
| *** dciabrin has quit IRC | 02:30 | |
| *** dciabrin has joined #tripleo | 02:30 | |
| *** bfournie has quit IRC | 02:33 | |
| *** bfournie has joined #tripleo | 02:34 | |
| *** bfournie has quit IRC | 02:38 | |
| *** rcernin has quit IRC | 02:46 | |
| *** dbecker has quit IRC | 02:47 | |
| *** rcernin has joined #tripleo | 02:50 | |
| *** dougbtv_ has quit IRC | 02:56 | |
| *** anilvenkata has quit IRC | 02:58 | |
| *** dbecker has joined #tripleo | 02:59 | |
| *** itlinux has joined #tripleo | 03:03 | |
| *** psachin has joined #tripleo | 03:03 | |
| *** ramishra has joined #tripleo | 03:03 | |
| *** itlinux has quit IRC | 03:03 | |
| *** fragatina has quit IRC | 03:06 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1771233 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1771233 in tripleo "te-broker errors in tripleo 3rd party jobs" [Critical,Triaged] | 03:10 |
| *** udesale has joined #tripleo | 03:10 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Enable default polling interval override https://review.openstack.org/568241 | 03:13 |
| *** ramishra has quit IRC | 03:18 | |
| *** udesale has quit IRC | 03:19 | |
| *** dmacpher has joined #tripleo | 03:26 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Include docker and undercloud environments first https://review.openstack.org/567053 | 03:30 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Add s3api support https://review.openstack.org/498564 | 03:30 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Trivial: fix a comment typo https://review.openstack.org/560782 | 03:30 |
| *** udesale has joined #tripleo | 03:31 | |
| *** ramishra has joined #tripleo | 03:32 | |
| *** links has joined #tripleo | 03:37 | |
| *** pdeore has joined #tripleo | 03:52 | |
| *** gyankum has joined #tripleo | 03:59 | |
| Tengu | hello there | 04:05 |
| *** fragatina has joined #tripleo | 04:05 | |
| *** fragatina has quit IRC | 04:06 | |
| *** fragatina has joined #tripleo | 04:06 | |
| *** fragatin_ has joined #tripleo | 04:07 | |
| jillr | morning Tengu | 04:09 |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1771233 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1771233 in tripleo "te-broker errors in tripleo 3rd party jobs" [Critical,Triaged] | 04:10 |
| Tengu | jillr: good evening :) | 04:10 |
| Tengu | or afternoon? | 04:10 |
| *** fragatina has quit IRC | 04:10 | |
| jillr | evening indeed :) | 04:11 |
| *** fragatin_ has quit IRC | 04:13 | |
| *** janki has joined #tripleo | 04:16 | |
| *** cshastri has joined #tripleo | 04:16 | |
| *** udesale has quit IRC | 04:28 | |
| *** anilvenkata has joined #tripleo | 04:29 | |
| *** pcaruana has joined #tripleo | 04:31 | |
| *** linhnm has joined #tripleo | 04:38 | |
| *** udesale has joined #tripleo | 04:39 | |
| jaosorior | good morning folks! | 04:40 |
| jaosorior | Tengu: dammit! I thought I was logging in early | 04:40 |
| Tengu | :) | 04:40 |
| Tengu | jaosorior: I still wake up at 5:30 - but now I just need a shower, and starting up the laptop :) | 04:41 |
| *** fragatina has joined #tripleo | 04:41 | |
| jaosorior | EmilienM, bandini: If you're around, I need a review here https://review.openstack.org/#/c/554926/ | 04:41 |
| jaosorior | wow | 04:41 |
| jaosorior | Tengu: I wake up at 6:30, then coffee :P | 04:42 |
| jaosorior | priorities | 04:42 |
| Tengu | jaosorior: uhu | 04:42 |
| linhnm | 11:45pm in Vietnam | 04:43 |
| linhnm | 11:45am :D | 04:43 |
| jaosorior | linhnm: that's not too bad :D | 04:44 |
| jaosorior | it's 7:44 here in Helsinki | 04:44 |
| linhnm | anyone use diskimage-builder to create CentOS 6 | 04:45 |
| jaosorior | linhnm: I don't think so. At least not that I know of. | 04:45 |
| EmilienM | jaosorior: looking | 04:47 |
| *** udesale has quit IRC | 04:49 | |
| *** udesale has joined #tripleo | 04:50 | |
| jaosorior | EmilienM: thanks | 04:51 |
| EmilienM | jaosorior: anytime | 04:52 |
| EmilienM | jaosorior: not sure why update jobs fail | 04:55 |
| EmilienM | jaosorior: consistently | 04:56 |
| EmilienM | http://logs.openstack.org/40/568340/2/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/65fa484/logs/undercloud/home/zuul/overcloud_update_run_Controllertripleorolename.log.txt.gz | 04:56 |
| EmilienM | I think I know why | 04:57 |
| EmilienM | the log file name is wrong I wonder why (looking at it now) | 04:57 |
| jaosorior | whaa | 04:58 |
| jaosorior | Controllertripleorolename | 04:58 |
| *** fragatina has quit IRC | 04:58 | |
| EmilienM | https://git.openstack.org/cgit/openstack/tripleo-upgrade/tree/tasks/update/overcloud_update_run.yml#n7 | 04:59 |
| jaosorior | I don't see the issue there :/ | 05:00 |
| jaosorior | oc_roles | 05:01 |
| jaosorior | lets see where that comes from | 05:01 |
| EmilienM | https://git.openstack.org/cgit/openstack/tripleo-upgrade/tree/tasks/update/create-update-scripts.yaml#n43 | 05:02 |
| EmilienM | pfiou | 05:02 |
| EmilienM | that's... improvable :D | 05:03 |
| jaosorior | EmilienM: cmoes from this tripleo-ansible-inventory --plan {{ overcloud_stack_name }} {% if overcloud_ssh_user != '' %} --ansible_ssh_user {{ overcloud_ssh_user }} {% endif %} --static-yaml-inventory /tmp/fake-oc-hosts.yaml ; | 05:03 |
| jaosorior | awk -F':' '/role_name/ {gsub("[[:space:][:punct:]]", "", $2); print $2}' /tmp/fake-oc-hosts.yaml | 05:03 |
| jaosorior | oh | 05:03 |
| jaosorior | lol | 05:03 |
| jaosorior | you got it too | 05:03 |
| jaosorior | EmilienM: interesting that tripleo-upgrades doesn't use the dynamic inventory from the start | 05:04 |
| *** linhnm has quit IRC | 05:04 | |
| *** marios has joined #tripleo | 05:08 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-upgrade master: Use tripleo_role_name instead of role_name https://review.openstack.org/568443 | 05:08 |
| jaosorior | EmilienM: seems to me that the patch won't work | 05:09 |
| jaosorior | since at that point we don't have tripleo_role_name yet | 05:09 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Include 'tripleo_role_name' in the inventory https://review.openstack.org/568340 | 05:09 |
| *** fragatina has joined #tripleo | 05:09 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Include 'tripleo_role_name' in the inventory https://review.openstack.org/568340 | 05:09 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: deploy-steps: switch to tripleo_role_name https://review.openstack.org/568343 | 05:09 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: (cleanup) remove usage of role_name https://review.openstack.org/568347 | 05:09 |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1771233 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1771233 in tripleo "te-broker errors in tripleo 3rd party jobs" [Critical,Triaged] | 05:10 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Deploy Docker via Ansible and not Puppet https://review.openstack.org/561377 | 05:10 |
| EmilienM | jaosorior: https://review.openstack.org/568443 that should do it | 05:10 |
| EmilienM | but in long term we really need to clean that code | 05:10 |
| *** saneax-_-|AFK is now known as saneax | 05:10 | |
| *** ykarel has joined #tripleo | 05:10 | |
| EmilienM | jaosorior: also https://review.openstack.org/568340 | 05:11 |
| EmilienM | they need to land together | 05:11 |
| * EmilienM out | 05:13 | |
| EmilienM | jaosorior: thx | 05:14 |
| *** agurenko has joined #tripleo | 05:19 | |
| *** fragatina has quit IRC | 05:20 | |
| *** fragatina has joined #tripleo | 05:26 | |
| *** linhnm has joined #tripleo | 05:26 | |
| *** yprokule has joined #tripleo | 05:26 | |
| *** zshi has quit IRC | 05:27 | |
| *** zshi has joined #tripleo | 05:27 | |
| *** agurenko has quit IRC | 05:30 | |
| *** fragatina has quit IRC | 05:31 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: NFV: Support for config-download to deploy node with kernel args https://review.openstack.org/560767 | 05:31 |
| *** agurenko has joined #tripleo | 05:32 | |
| *** pgadiya has joined #tripleo | 05:34 | |
| *** paramite has joined #tripleo | 05:35 | |
| *** paramite has quit IRC | 05:35 | |
| *** udesale_ has joined #tripleo | 05:36 | |
| *** udesale has quit IRC | 05:39 | |
| *** udesale_ has quit IRC | 05:40 | |
| *** udesale has joined #tripleo | 05:40 | |
| *** elgxl has quit IRC | 05:41 | |
| *** elgxl has joined #tripleo | 05:41 | |
| *** linhnm has quit IRC | 05:56 | |
| *** fragatina has joined #tripleo | 05:58 | |
| *** jbadiapa has quit IRC | 06:00 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1771233 | 06:10 |
| openstack | Launchpad bug 1771233 in tripleo "te-broker errors in tripleo 3rd party jobs" [Critical,Triaged] | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| *** radeks has joined #tripleo | 06:12 | |
| *** radeks_ has joined #tripleo | 06:20 | |
| *** radeks has quit IRC | 06:20 | |
| *** radeks has joined #tripleo | 06:21 | |
| *** linhnm has joined #tripleo | 06:22 | |
| ykarel | chandankumar, u were correct ^^ | 06:22 |
| ykarel | reported 5hours back | 06:23 |
| *** radeks__ has joined #tripleo | 06:34 | |
| *** masco has joined #tripleo | 06:36 | |
| *** radeks has quit IRC | 06:37 | |
| *** udesale has quit IRC | 06:38 | |
| *** bogdando has joined #tripleo | 06:40 | |
| *** udesale has joined #tripleo | 06:40 | |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: [WIP] Fix validation for A/P services https://review.openstack.org/568301 | 06:49 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Pass overcloud stack name to upgrade run. https://review.openstack.org/568468 | 06:51 |
| *** ubijtsa has joined #tripleo | 06:54 | |
| *** ubijtsa is now known as assassin | 06:54 | |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Call L3 checks before/after Role upgrade. https://review.openstack.org/566249 | 06:58 |
| *** brault has quit IRC | 07:01 | |
| *** mburned is now known as mburned_out | 07:02 | |
| *** fragatina has quit IRC | 07:03 | |
| *** brault has joined #tripleo | 07:06 | |
| *** sshnaidm has joined #tripleo | 07:09 | |
| *** ffiore has joined #tripleo | 07:09 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1771233 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1771233 in tripleo "te-broker errors in tripleo 3rd party jobs" [Critical,Triaged] | 07:10 |
| *** rcernin has quit IRC | 07:13 | |
| *** tesseract has joined #tripleo | 07:13 | |
| *** wolverineav has joined #tripleo | 07:14 | |
| *** pcaruana has quit IRC | 07:17 | |
| *** pcaruana has joined #tripleo | 07:17 | |
| *** paramite has joined #tripleo | 07:18 | |
| *** pcaruana has quit IRC | 07:18 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-common stable/queens: Add special 'all' for deploy_on_servers server name to match all https://review.openstack.org/567538 | 07:18 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-heat-templates master: Enable logging for tempest container https://review.openstack.org/566364 | 07:18 |
| *** florianf has joined #tripleo | 07:18 | |
| *** afazekas|pto is now known as afazekas | 07:18 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Enable tempest.log in /var/log/tempest for container https://review.openstack.org/566526 | 07:19 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Enable undercloud_enable_tempest to true https://review.openstack.org/566332 | 07:19 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Enable undercloud_enable_tempest to true https://review.openstack.org/566332 | 07:19 |
| *** holser__ has joined #tripleo | 07:20 | |
| chandankumar | sshnaidm: Hello | 07:20 |
| chandankumar | sshnaidm: please have a look at this https://review.openstack.org/#/c/566686/ | 07:21 |
| *** sshnaidm is now known as sshnaidm|rover | 07:21 | |
| *** pmannidi has quit IRC | 07:22 | |
| sshnaidm|rover | chandankumar, +w | 07:23 |
| *** pcaruana has joined #tripleo | 07:23 | |
| chandankumar | sshnaidm|rover: thanks :-) | 07:23 |
| *** skramaja has joined #tripleo | 07:23 | |
| *** kopecmartin has joined #tripleo | 07:24 | |
| *** lvdombrkr has joined #tripleo | 07:27 | |
| *** aufi has joined #tripleo | 07:29 | |
| *** akrivoka has joined #tripleo | 07:32 | |
| *** linhnm has quit IRC | 07:36 | |
| *** cylopez has joined #tripleo | 07:37 | |
| *** ramishra has quit IRC | 07:39 | |
| *** ramishra has joined #tripleo | 07:40 | |
| bogdando | o/ PTAL https://review.openstack.org/#/c/565233/ | 07:42 |
| bogdando | jaosorior: ^^ please | 07:42 |
| openstackgerrit | Martin André proposed openstack/tripleo-common master: Stop assuming all containers are plans https://review.openstack.org/566345 | 07:43 |
| bogdando | one more https://review.openstack.org/#/c/566333/ | 07:43 |
| *** dmacpher has quit IRC | 07:43 | |
| *** tosky has joined #tripleo | 07:49 | |
| dciabrin | jaosorior, hey o/ | 07:56 |
| *** olap has joined #tripleo | 07:58 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 08:00 |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Add ability to pre-assign IPs by role on ctlplane https://review.openstack.org/568505 | 08:03 |
| *** lucas-afk is now known as lucasagomes | 08:04 | |
| *** dbecker has quit IRC | 08:05 | |
| *** dbecker has joined #tripleo | 08:05 | |
| openstackgerrit | Martin André proposed openstack/tripleo-common stable/queens: Run yum clean to reduce size of docker image layer https://review.openstack.org/568508 | 08:06 |
| openstackgerrit | Martin André proposed openstack/tripleo-common stable/pike: Run yum clean to reduce size of docker image layer https://review.openstack.org/568510 | 08:07 |
| openstackgerrit | Michael Chapman proposed openstack/tripleo-quickstart-extras master: Add opendaylight to collect-logs https://review.openstack.org/494043 | 08:09 |
| *** shardy has joined #tripleo | 08:09 | |
| *** pdeore has quit IRC | 08:10 | |
| *** gfidente has joined #tripleo | 08:10 | |
| *** gfidente has quit IRC | 08:10 | |
| *** gfidente has joined #tripleo | 08:10 | |
| *** nyechiel has joined #tripleo | 08:12 | |
| *** mdnadeem has joined #tripleo | 08:12 | |
| *** holser__ has quit IRC | 08:13 | |
| *** athomas has joined #tripleo | 08:13 | |
| *** holser__ has joined #tripleo | 08:13 | |
| *** psachin has quit IRC | 08:14 | |
| *** ykarel is now known as ykarel|lunch | 08:15 | |
| *** dhill_ has quit IRC | 08:15 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common master: Convert classic drivers to hardware types on enrollment https://review.openstack.org/567900 | 08:15 |
| *** mdnadeem has quit IRC | 08:16 | |
| *** salmankhan has joined #tripleo | 08:23 | |
| *** nyechiel_ has joined #tripleo | 08:23 | |
| *** nyechiel has quit IRC | 08:23 | |
| akrivoka | hey d0ugal do you think we could merge this? https://review.openstack.org/#/c/393775/ | 08:25 |
| d0ugal | akrivoka: I think so, but I forget what the rules are for merging specs... | 08:25 |
| bogdando | folks, PTAL https://review.openstack.org/#/c/566333/ and https://review.openstack.org/#/c/565233/ | 08:26 |
| akrivoka | oh I didn't know they were different than for normal patches | 08:26 |
| d0ugal | akrivoka: could check in the meeting today | 08:28 |
| akrivoka | d0ugal: there's this https://specs.openstack.org/openstack/tripleo-specs/specs/policy/spec-review.html | 08:28 |
| d0ugal | akrivoka: but I believe you can start working on it anyway, there is enough agreement for that. | 08:28 |
| d0ugal | akrivoka: yeah, I looked at that too. I don't see anything specific to specs there (I think there should be) | 08:28 |
| d0ugal | oh | 08:28 |
| d0ugal | sorry, I can't realy | 08:28 |
| *** mdnadeem has joined #tripleo | 08:28 | |
| d0ugal | read | 08:28 |
| d0ugal | (I may be juggling a baby) | 08:28 |
| akrivoka | :) | 08:29 |
| akrivoka | that's a really good excuse :) | 08:29 |
| *** psachin has joined #tripleo | 08:29 | |
| *** pdeore has joined #tripleo | 08:30 | |
| d0ugal | akrivoka: so it seems there isn't a hard rule, but maybe worth getting somebody else to review? maybe shardy since he looked at it previously | 08:31 |
| d0ugal | Really not sure. Or we could check in the meeting today | 08:31 |
| akrivoka | d0ugal: sure | 08:31 |
| akrivoka | d0ugal: sounds good | 08:31 |
| akrivoka | thanks! | 08:32 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: FFU Add cinder-backup missing fast_forward_upgrade_tasks https://review.openstack.org/568520 | 08:32 |
| akrivoka | florianf: could you also review https://review.openstack.org/#/c/393775/ please? not much has changed since the last iterations | 08:32 |
| *** ssbarnea_ has joined #tripleo | 08:34 | |
| florianf | akrivoka: yep | 08:34 |
| jaosorior | dciabrin: sup | 08:37 |
| dciabrin | jaosorior, i'm having trouble to deploy a tls env with master rocky, any chance you can have a quick look at my config later today? | 08:37 |
| jaosorior | sure | 08:37 |
| jaosorior | I can check it out now | 08:37 |
| dciabrin | cool thx | 08:38 |
| *** florianf has quit IRC | 08:40 | |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates master: fix spelling misktake https://review.openstack.org/568405 | 08:43 |
| *** florianf has joined #tripleo | 08:44 | |
| *** derekh has joined #tripleo | 08:45 | |
| openstackgerrit | Nir Magnezi proposed openstack/tripleo-common master: Make lb-mgmt-subnet a class B subnet https://review.openstack.org/568089 | 08:51 |
| *** gkadam has joined #tripleo | 08:51 | |
| *** ykarel|lunch is now known as ykarel | 08:51 | |
| *** trown|outtypewww has quit IRC | 08:52 | |
| Tengu | shardy: hello! do you have a spare minute for a small question regarding heat? | 08:52 |
| openstackgerrit | Nir Magnezi proposed openstack/tripleo-heat-templates master: Make lb-mgmt-subnet a class B subnet https://review.openstack.org/568138 | 08:52 |
| *** cylopez has left #tripleo | 08:52 | |
| *** trown has joined #tripleo | 08:53 | |
| jaosorior | Tengu: you can also ask ramishra and therve about heat | 08:55 |
| Tengu | jaosorior: oh, great, thank you :). | 08:55 |
| Tengu | sooo ramishra or therve - does one of you have a spare minute? It's related to https://review.openstack.org/#/c/566228/ - I'd like to know if a Parameter could call another Parameter value for its default :). | 08:56 |
| Tengu | in order to avoid ugly code duplication -.-. the current test is apparently working, but.... not really happy with the fact we have to duplicated some values in multiple files. | 08:57 |
| therve | Tengu: A paramater, as in something in the parameters section? | 08:57 |
| Tengu | therve: wait, picking up links from github to illustrate. | 08:58 |
| shardy | Tengu: No a parameter can't reference another parameter | 08:58 |
| jaosorior | Tengu: you can't do that in a parameter declaration, but you can when passing a parameter in the resources section. | 08:58 |
| shardy | yeah you could perhaps use a conditional or something, an example would help advise further :) | 08:59 |
| Tengu | shardy: fuuu :(. | 08:59 |
| *** salmankhan has quit IRC | 08:59 | |
| Tengu | shardy: therve for example: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/nova-api.yaml#L66-L70 you see the default value | 08:59 |
| therve | Yes | 08:59 |
| Tengu | I need to override it when we use Docker, because log path is different. | 08:59 |
| Tengu | in order to do so, I've pushed this (WIP) patch: https://review.openstack.org/#/c/566228/4/docker/services/nova-api.yaml | 09:00 |
| Tengu | but it duplicates code, and if for some reason we're to change the tag for example, or logfile name, we'll need to ensure we do that change in at least two files instead of only one. | 09:00 |
| therve | So, just redefine NovaApiLoggingSource in the docker file? | 09:00 |
| Tengu | I was thinking about split the "path" in "dirname" and "logfile" or something | 09:01 |
| jaosorior | shardy: did we come to any agreement on still supporting the baremetal templates? Would sure be nice to start merging them | 09:01 |
| Tengu | therve: in the service in docker, yep | 09:01 |
| Tengu | so that it will generate correctly the hiera content for fluentd | 09:01 |
| shardy | jaosorior: No, I proposed merging them but dprince was against it, due to the possibility of supporting baremetal all-in-one deployments | 09:01 |
| jaosorior | :( | 09:01 |
| openstackgerrit | Carlos Goncalves proposed openstack/tripleo-common master: Increase services project quotas when deploying Octavia https://review.openstack.org/567641 | 09:01 |
| shardy | Tengu: that approach will work, but you're hard-coding the parameter that's supposed to be user configurable | 09:02 |
| shardy | will comment on the patch | 09:02 |
| Tengu | shardy: thank you. I confess, I'm not happy wth that proposal, that's why I only edited one file :) | 09:02 |
| therve | Hum I don't get it | 09:02 |
| therve | Tengu: Why not define NovaApiLoggingSource in docker.yaml.? | 09:02 |
| jaosorior | therve: I think that'll cause an error in the pep8 gate. | 09:03 |
| therve | I don't get why you want to get the default from the other parameter, as you want another default | 09:03 |
| jaosorior | therve: we check that the parameter declarations are the same | 09:03 |
| jaosorior | of course, that's not a blocker; just mentioning that needs to be fixed :) | 09:03 |
| therve | jaosorior: You can't have a parameter with different value? | 09:04 |
| therve | Or because you use parameter_defaults all of the place... | 09:04 |
| jaosorior | therve: I think it's the parameter_defaults thing | 09:04 |
| shardy | Yeah I agree with therve, you should just copy the parameter declaration to the docker template and change the default | 09:05 |
| Tengu | therve: thought about it as well, but wasn't sure how to do that. I'm not that used to heat things. Hence the question :) | 09:05 |
| shardy | and yeah we'd need to work out the pep8 check thing | 09:05 |
| * therve checks | 09:05 | |
| Tengu | shardy: thank you for your comment, now I see a bit more. | 09:06 |
| *** salmankhan has joined #tripleo | 09:06 | |
| Tengu | I'll update the patch with in order to ensure I'm correct, and will do the others once it's valid. | 09:06 |
| shardy | Another possibly cleaner approach might be to move the definition of tripleo_fluentd_sources_nova_api so it's set in docker/services/nova-api.yaml | 09:06 |
| openstackgerrit | Bogdan Dobrelya proposed openstack-infra/tripleo-ci master: Optimize CI triggers for some of OC deploy jobs https://review.openstack.org/568536 | 09:06 |
| shardy | e.g don't pass the value via the nova-base template at all | 09:06 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/nova-api.yaml#L185 | 09:06 |
| Tengu | shardy: hm. that's.. well, way out of reach for me now I guess :( | 09:06 |
| shardy | Tengu: why? | 09:07 |
| therve | OK it does indeed fail | 09:07 |
| Tengu | shardy: hmm, maybe I don't understand your cleaner solution in fact | 09:07 |
| *** nyechiel_ has quit IRC | 09:08 | |
| *** nyechiel_ has joined #tripleo | 09:08 | |
| shardy | Tengu: Ok sec let me push a patch to illustrate | 09:08 |
| Tengu | thank you. | 09:08 |
| openstackgerrit | Bogdan Dobrelya proposed openstack-infra/tripleo-ci master: Optimize CI triggers for UC containers upgrades https://review.openstack.org/568275 | 09:09 |
| openstackgerrit | Bogdan Dobrelya proposed openstack-infra/tripleo-ci master: Optimize CI triggers for some of OC deploy jobs https://review.openstack.org/568326 | 09:09 |
| openstackgerrit | Nir Magnezi proposed openstack/tripleo-heat-templates master: Make lb-mgmt-subnet a class B subnet https://review.openstack.org/568138 | 09:11 |
| openstackgerrit | Nir Magnezi proposed openstack/tripleo-common master: Make lb-mgmt-subnet a class B subnet https://review.openstack.org/568089 | 09:11 |
| *** linhnm has joined #tripleo | 09:11 | |
| therve | There is PARAMETER_DEFINITION_EXCLUSIONS which can work around the pep8 thing | 09:12 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: WIP Correct log location in container environment for Fluentd https://review.openstack.org/568540 | 09:12 |
| shardy | yeah that's definitely solvable | 09:13 |
| Tengu | therve: care to show me that pep8 thing? so that I can learn a bit more (new at redhat, started yesterday) | 09:13 |
| shardy | Tengu: ^^ that was what I was thinking | 09:13 |
| shardy | there's a little bit of duplication but it's fairly clear | 09:13 |
| therve | Tengu: http://paste.openstack.org/show/720982/ | 09:13 |
| therve | shardy: Your patch will fail pep8 right | 09:14 |
| shardy | therve: yeah I'll have to add your fix | 09:14 |
| shardy | if we're going with that approach | 09:14 |
| * shardy adds it | 09:14 | |
| *** jbadiapa has joined #tripleo | 09:15 | |
| Tengu | shardy: hmm so yep, confirm: out of reach for now :). Not that used to heat and its ways. That will come. | 09:15 |
| Tengu | therve: hm, ok. Can't really see what is impacted in fact. will dig in the code and its validation. | 09:16 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Correct log location in container environment for Fluentd https://review.openstack.org/568540 | 09:16 |
| openstackgerrit | Bogdan Dobrelya proposed openstack-infra/tripleo-ci master: Add CI triggers for OC deploy jobs to depend on UC https://review.openstack.org/568536 | 09:16 |
| openstackgerrit | Bogdan Dobrelya proposed openstack-infra/tripleo-ci master: Optimize CI triggers for UC containers upgrades https://review.openstack.org/568275 | 09:16 |
| openstackgerrit | Bogdan Dobrelya proposed openstack-infra/tripleo-ci master: Optimize CI triggers for some of OC deploy jobs https://review.openstack.org/568326 | 09:16 |
| shardy | Tengu: we run tools/yaml-validate.py in the gate, which has some checks that ensure parameters are consistently defined | 09:16 |
| Tengu | shardy: therve so I guess I'll need to update in the same way all the services yaml file right? | 09:17 |
| shardy | as therve points out, there's a way to escape that check when you intentionally diverge the parameter definitions | 09:17 |
| Tengu | shardy: ok | 09:17 |
| shardy | Tengu: yes if the log path is wrong in all of them I guess so | 09:17 |
| Tengu | well, it actually is -.-' | 09:17 |
| therve | Tengu: is it always the same schema? | 09:17 |
| Tengu | as logs have been moved from /var/log/<service> to /var/log/containers/<service> | 09:18 |
| shardy | sed ftw! ;) | 09:18 |
| shardy | Tengu: aren't they all symlinked tho? | 09:18 |
| Tengu | and http logs are in /var/log/containers/httpd/<service> | 09:18 |
| Tengu | shardy: nope | 09:18 |
| therve | Yeah the problem is if it was user defined | 09:18 |
| shardy | hrm | 09:18 |
| Tengu | there's a nice readme in the old location | 09:18 |
| Tengu | showing the new location | 09:18 |
| *** shreshtha_ has quit IRC | 09:18 | |
| shardy | Ok, well we could create a symlink for each service in host_prep_tasks, or change the path like in my patch for all services which require it | 09:19 |
| Tengu | symlink might cause issues with logrotate or might override the old logs. | 09:19 |
| cgoncalves | shardy, bogdando: hi. could you please review https://review.openstack.org/#/c/566913/ ? | 09:20 |
| shardy | Tengu: ack, probably best to update the config then I guess | 09:20 |
| Tengu | shardy: think so. Already thought about symlink, but due to the state possible issues... | 09:20 |
| Tengu | shardy: may I take back your patch in my own review and work on it, or is it better I push updates to yours instead? | 09:21 |
| shardy | Tengu: you're welcome to take it and update your review | 09:21 |
| shardy | then I'll abandon my review | 09:21 |
| Tengu | shardy: thank you :). | 09:21 |
| shardy | np! :) | 09:21 |
| shardy | cgoncalves: ack, one question added | 09:22 |
| Tengu | shardy: cherry-picked it in my own branch. I'll continue the patches then. | 09:23 |
| *** leanderthal has joined #tripleo | 09:23 | |
| openstackgerrit | Sergii Golovatiuk proposed openstack/python-tripleoclient master: Replace logging with oslo_log for upgrade classes https://review.openstack.org/567819 | 09:23 |
| bogdando | shardy: heh, telepathy in action | 09:24 |
| bogdando | https://review.openstack.org/#/c/566913/4/playbooks/roles/octavia-undercloud/tasks/main.yml | 09:24 |
| bogdando | shardy: could you please take a look https://review.openstack.org/#/c/566333/ ? | 09:25 |
| shardy | bogdando: ack, done! | 09:28 |
| cgoncalves | shardy, bogdando: replied. thanks for your reviews! | 09:30 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/python-tripleoclient master: Make standalone role name configurable https://review.openstack.org/568378 | 09:31 |
| openstackgerrit | Bogdan Dobrelya proposed openstack-infra/tripleo-ci master: Delay deployment jobs until the pep8/unit passes https://review.openstack.org/568543 | 09:32 |
| *** udesale_ has joined #tripleo | 09:33 | |
| *** udesale has quit IRC | 09:34 | |
| openstackgerrit | Sergii Golovatiuk proposed openstack-infra/tripleo-ci master: Fix deprecation warnings for te-broker https://review.openstack.org/547045 | 09:34 |
| *** shreshtha has joined #tripleo | 09:41 | |
| *** linhnm has quit IRC | 09:42 | |
| *** shreshtha_ has joined #tripleo | 09:43 | |
| *** shreshtha_ has quit IRC | 09:44 | |
| *** shreshtha_ has joined #tripleo | 09:45 | |
| *** shreshtha has quit IRC | 09:45 | |
| Tengu | hmmm. apparently "designate" service isn't known by fluentd. At least, nothing seems to export its log directory for fluentd in the various heat templates. | 09:55 |
| Tengu | that's the DNSaaS right? | 09:55 |
| *** jaosorior has quit IRC | 10:00 | |
| *** paramite has quit IRC | 10:00 | |
| *** jaosorior has joined #tripleo | 10:01 | |
| *** udesale_ has quit IRC | 10:01 | |
| *** udesale has joined #tripleo | 10:03 | |
| *** zoli is now known as zoli|lunch | 10:05 | |
| *** shreshtha_ has quit IRC | 10:05 | |
| *** wolverineav has quit IRC | 10:09 | |
| *** wolverineav has joined #tripleo | 10:10 | |
| *** tosky has quit IRC | 10:11 | |
| *** tosky has joined #tripleo | 10:12 | |
| *** paramite has joined #tripleo | 10:12 | |
| *** wolverineav has quit IRC | 10:15 | |
| *** paramite_ has joined #tripleo | 10:16 | |
| *** shreshtha has joined #tripleo | 10:17 | |
| *** rh-jelabarre has joined #tripleo | 10:17 | |
| *** paramite has quit IRC | 10:20 | |
| *** psahoo has quit IRC | 10:21 | |
| sshnaidm|rover | bogdando, for rechecking only OVB you need "check-rdo" | 10:21 |
| Tengu | hmmm. does anyone has a containerized overcloud? Care to check if neutron logs are in /var/log/containers/neutron? apparently, that service isn't using this location, but I'm unable to check that on a live system -.-'. Not enough power on my laptop, and no access to rdocloud ) | 10:21 |
| sshnaidm|rover | bogdando, "recheck ..." will recheck everything | 10:21 |
| *** zoli|lunch is now known as zoli | 10:24 | |
| *** pkovar has joined #tripleo | 10:28 | |
| *** pdeore has quit IRC | 10:40 | |
| *** tesseract is now known as info | 10:41 | |
| *** info is now known as tesseract | 10:41 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/newton: Ensure the CephX Manila keyring permissions are only set when needed https://review.openstack.org/567854 | 10:42 |
| *** mburned_out is now known as mburned | 10:44 | |
| *** nyechiel has joined #tripleo | 10:47 | |
| *** nyechiel_ has quit IRC | 10:47 | |
| shardy | Tengu: yes looks like it ref http://paste.openstack.org/show/720985/ | 10:49 |
| shardy | Tengu: https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/neutron-api.yaml#L117 is confusing though | 10:50 |
| shardy | maybe that is wrong | 10:50 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-tripleo stable/newton: [Newton Only] Fix getting live value of nova/neutron during update. https://review.openstack.org/568552 | 10:59 |
| *** nyechiel_ has joined #tripleo | 10:59 | |
| *** nyechiel has quit IRC | 11:00 | |
| *** vpickard_ is now known as vpickard | 11:05 | |
| Tengu | shardy: guess this is used by kolla inside the container in fact | 11:11 |
| Tengu | shardy: I've asked a former colleague to check on my former lab, and apparently the logs are in the containers subdir. So it's OK. I was confused because I didn't see the volume | 11:12 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-tripleo stable/newton: [Newton Only] Fix getting live value of nova/neutron during update. https://review.openstack.org/568552 | 11:12 |
| *** zoli is now known as zoli|afk-tpb | 11:13 | |
| *** dtantsur|afk is now known as dtantsur | 11:14 | |
| Tengu | duh.. ok. should rebase master in fact. apparently there was a file name change. | 11:16 |
| *** atoth has joined #tripleo | 11:20 | |
| *** wolverineav has joined #tripleo | 11:26 | |
| *** jcoufal has joined #tripleo | 11:26 | |
| *** ansmith has quit IRC | 11:26 | |
| *** nyechiel_ has quit IRC | 11:27 | |
| *** vpickard has quit IRC | 11:28 | |
| *** ffiore has quit IRC | 11:29 | |
| *** vpickard has joined #tripleo | 11:30 | |
| *** holser__ has quit IRC | 11:32 | |
| *** holser___ has joined #tripleo | 11:32 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: Correct log location in container environment for Fluentd https://review.openstack.org/568540 | 11:37 |
| Tengu | argh | 11:37 |
| Tengu | the cherry-pick wasn't a good idea -.-. | 11:38 |
| Tengu | shardy: well, I guess I'll continue working on your own change in fact. | 11:38 |
| Tengu | or.. hmm. | 11:38 |
| * Tengu twisting git | 11:41 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: [WIP] Correct log location in container environment for Fluentd https://review.openstack.org/566228 | 11:41 |
| *** abishop has joined #tripleo | 11:41 | |
| Tengu | shardy: you can abandon your change, sorry for the noise. I didn't take the right ID in my amend -.-'. | 11:42 |
| *** rodolof has joined #tripleo | 11:42 | |
| *** mdnadeem has quit IRC | 11:44 | |
| *** mdnadeem has joined #tripleo | 11:45 | |
| *** pchavva has joined #tripleo | 11:46 | |
| *** agopi has quit IRC | 11:46 | |
| *** dprince has joined #tripleo | 11:49 | |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates stable/queens: Add ability to control Glance's enabled_import_methods https://review.openstack.org/567833 | 11:57 |
| Tengu | jaosorior: I think you kind of broke pep8 on t-h-t :]. Not sure though. But as it talks about endpoints and TLS... :) | 11:59 |
| *** zoli|afk-tpb is now known as zoli | 11:59 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Enable config-download deployment tracking https://review.openstack.org/559022 | 12:00 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Chain ansible messages in deployment progress https://review.openstack.org/564733 | 12:00 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Run undeploy_plan workflow to delete deployment https://review.openstack.org/566366 | 12:00 |
| Tengu | jaosorior: http://paste.openstack.org/show/720989/ care to have a look ? | 12:00 |
| *** skramaja has quit IRC | 12:01 | |
| *** skramaja_ has joined #tripleo | 12:01 | |
| *** raildo has joined #tripleo | 12:01 | |
| Tengu | unless I don't know how to invoke the tool in fact. | 12:01 |
| Tengu | ok. have to pass the correct directory apparently. my bad :) | 12:02 |
| jaosorior | no biggie | 12:03 |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: [WIP] Correct log location in container environment for Fluentd https://review.openstack.org/566228 | 12:04 |
| Tengu | hmm. still.. the script is complaining :) | 12:04 |
| Tengu | but not anymore with my stupide typos :) | 12:04 |
| *** liverpooler has joined #tripleo | 12:06 | |
| jaosorior | how is it complaining? | 12:06 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Expose parameter MistralDockerGroup https://review.openstack.org/566769 | 12:07 |
| Tengu | jaosorior: same message as in my previous paste :/ | 12:07 |
| Tengu | don't know if zuul launches the test with some specific options, I don't think it does seeing its log. | 12:08 |
| *** nyechiel_ has joined #tripleo | 12:09 | |
| Tengu | anyway. going back to work on that patch - I've done only the half of the files I think -.-'. | 12:09 |
| jaosorior | Tengu: | 12:09 |
| jaosorior | josorior@pickle ~/d/o/tripleo-heat-templates> pwd | 12:09 |
| jaosorior | /home/josorior/development/openstack/tripleo-heat-templates | 12:09 |
| jaosorior | josorior@pickle ~/d/o/tripleo-heat-templates> ./tools/yaml-validate.py | 12:09 |
| jaosorior | I launch it from the t-h-t base dir | 12:09 |
| Tengu | jaosorior: hmm. ok. | 12:09 |
| Tengu | ok, now I see other errors. And those are related to my patch. Thanks for the head up :) | 12:11 |
| openstackgerrit | Merged openstack/python-tripleoclient master: deploy/upgrade: include tripleo_role_name https://review.openstack.org/568342 | 12:11 |
| openstackgerrit | Merged openstack/tripleo-common master: TLS by default for the overcloud https://review.openstack.org/554926 | 12:11 |
| *** tiswanso has quit IRC | 12:12 | |
| *** udesale_ has joined #tripleo | 12:18 | |
| openstackgerrit | Marios Andreou proposed openstack/python-tripleoclient master: Add .deployment.v1.deploy_on_servers to ffwd-upgrade prepare https://review.openstack.org/566336 | 12:18 |
| *** udesale has quit IRC | 12:19 | |
| dtantsur | folks, is this a known problem? http://logs.openstack.org/86/567886/1/check/tripleo-ci-centos-7-containers-multinode/d523823/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz#_2018-05-15_09_35_32 | 12:20 |
| *** bfournie has joined #tripleo | 12:20 | |
| *** gyankum has quit IRC | 12:25 | |
| chandankumar | EmilienM: jaosorior mwhahaha I need some help on this review https://review.openstack.org/#/q/topic:tempest_log+(status:open+OR+status:merged) | 12:26 |
| cgoncalves | beagles, shardy: want to discuss https://review.openstack.org/566913 now? | 12:27 |
| chandankumar | tempest container logging is not happening | 12:27 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-common master: Add new undeploy_plan workflow https://review.openstack.org/566246 | 12:27 |
| chandankumar | I am not sure where I am doing wrong | 12:27 |
| beagles | cgoncalves: on a call a the moment | 12:28 |
| beagles | cgoncalves: I'll be free in 30 minutes | 12:28 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Change default endpoint map entries to use TLS https://review.openstack.org/558424 | 12:28 |
| openstackgerrit | Merged openstack/tripleo-common master: Add special 'all' for deploy_on_servers server name to match all https://review.openstack.org/566576 | 12:28 |
| *** tzumainn has joined #tripleo | 12:28 | |
| cgoncalves | beagles, ack. I've a call in 30 minutes. let's chat in 1 hour if you're available | 12:28 |
| *** numans has quit IRC | 12:31 | |
| *** dougbtv_ has joined #tripleo | 12:32 | |
| *** artom has joined #tripleo | 12:32 | |
| *** rlandy has joined #tripleo | 12:33 | |
| *** numans has joined #tripleo | 12:35 | |
| mandre | dtantsur: I suspect it has something to do new promoted hash being used before container images are all uploaded to the dockerhub, I've seen the same thing happening in https://review.openstack.org/#/c/566246/ | 12:38 |
| beagles | k | 12:38 |
| dtantsur | sigh | 12:38 |
| beagles | cgoncalves: well, if shardy is available ;) | 12:38 |
| shardy | beagles, cgoncalves: Hey yes I'm around, I just wanted to understand when we expect yum to fail, to ensure we're not just confusing the operator by hiding an actual error then doing nothing | 12:39 |
| shardy | like, if I messed up my repo config I'd probably rather know about it than have something just not happen without any warning? | 12:40 |
| shardy | Or perhaps there's something I'm missing :) | 12:40 |
| *** dougbtv_ has quit IRC | 12:40 | |
| *** tiswanso has joined #tripleo | 12:41 | |
| *** tiswanso has quit IRC | 12:41 | |
| cgoncalves | shardy, well if one messes up the repo config we can't help much there :) | 12:42 |
| *** tiswanso has joined #tripleo | 12:42 | |
| shardy | cgoncalves: well, we can tell them yum failed and not ignore the resulting errors... | 12:42 |
| shardy | maybe there was a temporary network outage, or a mirror was down, then boom you get no warning and stuff just gets skipped | 12:43 |
| cgoncalves | shardy, in case yum fails the user can still easily install the rpm and upload the image to glance | 12:43 |
| shardy | cgoncalves: yes but how do they know they need to do it? | 12:43 |
| shardy | what about if we test this in CI and a mirror goes down? | 12:43 |
| cgoncalves | shardy, I'd argue that, in case of network outage, it would be better to ignore error and finish deployment than having to redeploy again | 12:43 |
| beagles | shardy: I'll try to boil down my reasons to be as concise as possible: 1. afaik we don't normally install anything on install so introducing a dependency like this is new and we havent' the time to sort out all of the implications 2. the deploy completes fine without the package, the user will need to upload the amphora image afterwards and 3. the failure would happen really late and that sucks | 12:44 |
| shardy | cgoncalves: well you could say that about any error I suppose, but in this case I just worry that there's no warning, so the operator thinks everything is fine | 12:44 |
| shardy | only, sometimes, it's not | 12:44 |
| shardy | ugh | 12:44 |
| beagles | "install anything on deploy" not "install" ;) | 12:44 |
| beagles | shardy: yeah, that's right | 12:44 |
| shardy | beagles: if it's a temporary thing while we let repos catch up or something then I get it | 12:45 |
| cgoncalves | shardy, we could add a 'debug' with msg task but the user would hardly see it in the (long) log | 12:45 |
| shardy | cgoncalves: yeah, or we could just say, hey we couldn't install and tell them there was an error | 12:45 |
| shardy | then they can re-run it manually and work out why | 12:45 |
| shardy | beagles: I'm not blocking on it, it just seems like an obscure bug report waiting to happen ;) | 12:46 |
| beagles | shardy: :) that's true - mmmm | 12:46 |
| beagles | shardy: I'm vascillating :) | 12:46 |
| cgoncalves | I'm sort of okay with either approach :) | 12:46 |
| beagles | shardy: I'm weighing the alternatives - | 12:47 |
| beagles | "a wtf" issue from a customer - why wasn't there an error | 12:47 |
| beagles | or "a wtf" what do you mean I have to redeploy | 12:47 |
| cgoncalves | +1 :) | 12:48 |
| shardy | well they have to run the command again, or you could print something in the error which says "maybe you got unlucky, try running this manually" I guess | 12:48 |
| shardy | but, like, if yum install fails, something is probably broken right? | 12:48 |
| shardy | As an operator I think I'd rather know | 12:48 |
| shardy | anyway, I'll remove my vote and we can get some other opinions on it | 12:49 |
| beagles | shardy: cgoncalves: okay here's my proposal - let it fail late (remove ignore_errors) and document that where network connectivity to repos on the undercloud is limited for whatever reason that the rpm should be installed before hand | 12:50 |
| shardy | beagles: that sounds reasonable - the other approach would be to add it to the undercloud install by default? | 12:50 |
| shardy | how big is the image? | 12:50 |
| *** ansmith has joined #tripleo | 12:50 | |
| beagles | shardy: good question - not sure atm. That would actually be the ideal thing. We avoided this u/s but maybe that's an option elsewhere | 12:51 |
| cgoncalves | shardy, 649MB RPM | 12:51 |
| shardy | cgoncalves: ouch | 12:51 |
| *** rh-jelabarre has quit IRC | 12:52 | |
| *** nmagnezi has joined #tripleo | 12:52 | |
| beagles | cgoncalves: in any case give assaf a heads up and let's remove the ignore_errors , sound k? | 12:53 |
| cgoncalves | beagles, ack. I'll be meeting with him in 7 minutes :) | 12:53 |
| shardy | with such a large package it's probably even more important to not ignore errors, e.g it may fail due to filling up the disk | 12:53 |
| *** rh-jelabarre has joined #tripleo | 12:54 | |
| *** mcornea has joined #tripleo | 12:55 | |
| beagles | mmm.. it's going to fail anyways if that breaks the bank ;) | 12:55 |
| beagles | but that's a good point :) | 12:55 |
| beagles | shardy: Seems like we can move this up in steps with external steps in rocky yeah? | 12:56 |
| beagles | external_workflow_tasks I mean | 12:57 |
| beagles | (sorry I'm multitasking meetings) | 12:57 |
| beagles | shardy: we could do it now but we want to backport this revision | 12:57 |
| shardy | beagles: yup it should move to external_deploy_tasks for rocky as we've switched to config-download by default | 12:59 |
| shardy | which I think will mean the old workflow tasks don't work anymore | 12:59 |
| beagles | shardy: yes, that's right.. I was just mentioning that we probably want to look at moving some of these things up some steps to allow for failing earlier | 13:00 |
| myoung|ruck | hrm...whichever route is chosen on this one I would like to ensure that in CI we're looking for. we see issues around mirrors and/or infra connectivity quite a bit. If there's a summary of what was problematic in a know parsable place, 1we can add bits to look for it (and then fail the CI job in an informative fashion). Anything we can do to reduce the time to diagnose issues is a \o/ | 13:00 |
| beagles | shardy: e.g. certs stuff and yum install can be done pretty early | 13:00 |
| beagles | (it'll means massaging ansible though I guess) | 13:00 |
| shardy | beagles: ack - I guess another approach would be to install the image on the first controller and do the bootstrapping there | 13:00 |
| *** elgxl_ has joined #tripleo | 13:01 | |
| beagles | shardy: I toyed with idea - but it forces development environments to configure masquerading or similar to get access to the outside. I don't do it myself unnecessarily... | 13:02 |
| beagles | shardy: which actually has been handy for some issues | 13:02 |
| beagles | shardy: but meh | 13:02 |
| shardy | beagles: Hmm, I thought we configured a route with masquerading via the undercloud by default anyway | 13:02 |
| beagles | shardy: I think you need to tell it to | 13:03 |
| shardy | yeah, not a big deal, I just got burned very recently corruping a VM based undercloud due to running out of disk space ;) | 13:03 |
| beagles | shardy: lol | 13:03 |
| beagles | shardy: I've been there *a lot* | 13:03 |
| shardy | beagles: :D | 13:03 |
| beagles | (my undercloud vms are pretty long lived) | 13:04 |
| *** elgxl has quit IRC | 13:04 | |
| beagles | sometimes I think I test undercloud updates more than anyone | 13:04 |
| beagles | well actually not so much because I now pretty much nuke the previous one | 13:04 |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: Correct log location in container environment for Fluentd https://review.openstack.org/566228 | 13:05 |
| Tengu | pfiou. that's the bigest patch I've ever pushed until now :). | 13:05 |
| Tengu | pretty sure it won't merge easily -.-. | 13:06 |
| *** Goneri has joined #tripleo | 13:06 | |
| *** elgxl_ has quit IRC | 13:07 | |
| *** elgxl has joined #tripleo | 13:08 | |
| *** eck` is now known as eck`gone | 13:08 | |
| gfidente | mwhahaha it wasn't obvious to me why we had to abandon/restore some submissions last week to resolve the CI issue but, can you tell if https://review.openstack.org/#/c/567275/ one of those affected or should I just recheck? | 13:11 |
| *** eck`gone is now known as eck` | 13:11 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: Correct log location in container environment for Fluentd https://review.openstack.org/566228 | 13:12 |
| mwhahaha | gfidente: we had to clear the gate, that was not one of them. since those ci results are from this morning looks like fresh problems | 13:12 |
| gfidente | mwhahaha ack recheck then :D | 13:14 |
| mwhahaha | might not be helpful but sure | 13:14 |
| mwhahaha | looks like pacemaker problems across the board | 13:14 |
| mwhahaha | dciabrin, bandini -^ | 13:14 |
| mwhahaha | http://logs.openstack.org/75/567275/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/b27465d/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-05-15_11_20_38 | 13:14 |
| tosky | arxcruz: "Send tempest results by mail" failed again (Connection refused) | 13:14 |
| mwhahaha | tosky: i don't think that bit has worked in a long time (i've seen errors for weeks) | 13:14 |
| mwhahaha | tosky: we should probably turn it off | 13:14 |
| tosky | mwhahaha: I'd say fix it | 13:15 |
| arxcruz | tosky: yes, i had to turn off yesterday because dns was taking too long to resolve | 13:15 |
| arxcruz | and weshay needed a job to pass | 13:15 |
| tosky | mwhahaha: we are slowly trying to have it working, shutting it down permanently would not make things better | 13:15 |
| tosky | tbarron, vkmc: ^^ | 13:15 |
| mwhahaha | considering it's been failing for weeks | 13:15 |
| mwhahaha | it's not something that should be on | 13:15 |
| mwhahaha | sure fix it | 13:16 |
| mwhahaha | but if no one is looking, don't leave it on | 13:16 |
| arxcruz | mwhahaha: i'm looking into it :) | 13:16 |
| *** dhill_ has joined #tripleo | 13:16 | |
| Tengu | \o/ pep8 is happy now :). thank you shardy and therve for the hints/examples :). | 13:17 |
| Tengu | now is time for the next checks. | 13:17 |
| tbarron | tosky: ty | 13:18 |
| tbarron | mwhahaha: I think no one looks at the broadly targeted something failed somewhere and we thought you should know emails but tosky is developing a quite targeted notifier | 13:19 |
| arxcruz | tosky: fyi i turn the server on, fix the dns problem, let's see how it behaves now | 13:19 |
| arxcruz | mwhahaha: tbarron ^ | 13:20 |
| tbarron | arxcruz: ack | 13:20 |
| tosky | arxcruz: thanks, let me recheck; let's see in 3 hours | 13:20 |
| arxcruz | tosky: k, let's keep talking :) | 13:20 |
| arxcruz | well, we are talking constantly on tempestconf so ;) | 13:20 |
| *** elgxl has quit IRC | 13:25 | |
| *** elgxl has joined #tripleo | 13:26 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add linter jobs for releases file script https://review.openstack.org/568287 | 13:26 |
| *** gyankum has joined #tripleo | 13:28 | |
| *** dougbtv_ has joined #tripleo | 13:28 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-common master: Add new undeploy_plan workflow https://review.openstack.org/566246 | 13:33 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates stable/queens: FFU Add cinder-backup missing fast_forward_upgrade_tasks https://review.openstack.org/568584 | 13:33 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Add python script to dynamically compose releases https://review.openstack.org/567521 | 13:34 |
| *** lblanchard has joined #tripleo | 13:37 | |
| Tengu | hmm, might a patch close multiple LP issues? | 13:39 |
| Tengu | or refer at least ? | 13:39 |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: Correct log location in container environment for Fluentd https://review.openstack.org/566228 | 13:41 |
| *** elgxl has quit IRC | 13:44 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Help generate playbook commnands https://review.openstack.org/565740 | 13:44 |
| *** elgxl has joined #tripleo | 13:45 | |
| *** cdearborn has joined #tripleo | 13:45 | |
| Tengu | PTAL ? :) https://review.openstack.org/#/c/566276/ | 13:45 |
| Tengu | missing one CR+2 and WF+1 :) | 13:46 |
| *** fragatina has joined #tripleo | 13:46 | |
| *** rh-jelabarre has quit IRC | 13:46 | |
| *** bkopilov has quit IRC | 13:47 | |
| *** colonwq has quit IRC | 13:47 | |
| *** colonwq has joined #tripleo | 13:49 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Help generate playbook commnands https://review.openstack.org/565740 | 13:49 |
| *** rh-jelabarre has joined #tripleo | 13:49 | |
| abishop | marios, gfidente: https://review.openstack.org/567667 is happy now, please +W | 13:49 |
| *** elgxl has quit IRC | 13:50 | |
| Tengu | bogdando: thank you :) | 13:52 |
| *** agopi has joined #tripleo | 13:54 | |
| *** elgxl has joined #tripleo | 13:55 | |
| *** pblaho has joined #tripleo | 13:56 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Include 'tripleo_role_name' in the inventory https://review.openstack.org/568340 | 13:58 |
| *** elgxl has quit IRC | 13:59 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: deploy-steps: switch to tripleo_role_name https://review.openstack.org/568343 | 13:59 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Deploy Docker via Ansible and not Puppet https://review.openstack.org/561377 | 13:59 |
| mwhahaha | #startmeeting tripleo | 14:00 |
| mwhahaha | #topic agenda | 14:00 |
| mwhahaha | * Review past action items | 14:00 |
| mwhahaha | * One off agenda items | 14:00 |
| mwhahaha | * Squad status | 14:00 |
| mwhahaha | * Bugs & Blueprints | 14:00 |
| openstack | Meeting started Tue May 15 14:00:11 2018 UTC and is due to finish in 60 minutes. The chair is mwhahaha. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| mwhahaha | * Projects releases or stable backports | 14:00 |
| mwhahaha | * Specs | 14:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| mwhahaha | * open discussion | 14:00 |
| mwhahaha | Anyone can use the #link, #action and #info commands, not just the moderatorǃ | 14:00 |
| mwhahaha | Hi everyone! who is around today? | 14:00 |
| *** openstack changes topic to " (Meeting topic: tripleo)" | 14:00 | |
| openstack | The meeting name has been set to 'tripleo' | 14:00 |
| *** openstack changes topic to "agenda (Meeting topic: tripleo)" | 14:00 | |
| EmilienM | o/ | 14:00 |
| dpeacock | o7 | 14:00 |
| florianf | o/ | 14:00 |
| mwhahaha | happy tuesday | 14:00 |
| marios | o/ | 14:00 |
| dpeacock | Happy Tuesday :-) | 14:00 |
| beagles | o/ | 14:00 |
| chem | o/ | 14:00 |
| jrist | o/ | 14:01 |
| myoung|ruck | o/ | 14:01 |
| matbu | o/ | 14:01 |
| *** skramaja_ is now known as skramaja | 14:02 | |
| skramaja | hello | 14:02 |
| holser___ | o/ | 14:02 |
| mwhahaha | alright let's go | 14:02 |
| mwhahaha | #topic review past action items | 14:02 |
| *** openstack changes topic to "review past action items (Meeting topic: tripleo)" | 14:02 | |
| mwhahaha | mwhahaha to send a note about just cutting all of tripleo over to storyboard - DONE | 14:02 |
| mwhahaha | #link http://lists.openstack.org/pipermail/openstack-dev/2018-May/130333.html | 14:02 |
| mwhahaha | not a whole lot of feedback on that one | 14:02 |
| mwhahaha | if there are no objections i'm going to start working with infra to do the migration of bugs to stories | 14:03 |
| EmilienM | so we stop doing squad by squad? | 14:03 |
| mwhahaha | but we'll need the other action item first | 14:03 |
| mwhahaha | yea | 14:03 |
| EmilienM | hmm ok | 14:03 |
| mwhahaha | it's not beneficial to do it that way because it doubles work | 14:04 |
| *** rbrady has joined #tripleo | 14:04 | |
| mwhahaha | and it a pain trying to figure out how to wedge the squad bugs into storyboard | 14:04 |
| openstackgerrit | Carlos Goncalves proposed openstack/tripleo-common master: Install Octavia amphora image if Red Hat https://review.openstack.org/566913 | 14:04 |
| *** rbrady is now known as Guest15334 | 14:04 | |
| *** elgxl has joined #tripleo | 14:04 | |
| EmilienM | so we'll have "one" project in SB, 'tripleo' for all repos? | 14:04 |
| *** Guest15334 is now known as rbrady_ | 14:04 | |
| *** rbrady_ has joined #tripleo | 14:04 | |
| mwhahaha | it's likely that we'll use either THT or tripleo-common | 14:05 |
| mwhahaha | but yea | 14:05 |
| cgoncalves | beagles, shardy, bogdando: https://review.openstack.org/#/c/566913/ | 14:05 |
| mwhahaha | we'll need to figure that out with the infra folks | 14:05 |
| mwhahaha | anyway the other action item which is along those lines | 14:06 |
| mwhahaha | weshay & co to ensure tooling is storyboard friendly | 14:06 |
| weshay | 0/ | 14:06 |
| mwhahaha | weshay, myoung|ruck: i know ci is/was on fire, did you get a chance to look at using storyboard as the source for the CIX scripts and bots? | 14:06 |
| weshay | I wish | 14:06 |
| EmilienM | before the tooling we need to get humans familiar with it :D | 14:06 |
| myoung|ruck | mwhahaha: what weshay said | 14:06 |
| EmilienM | I'm not sure 5% of us know the syntax in commit message to close a bug (or a task/story) | 14:06 |
| mwhahaha | it's been mailed out, but we can send a note | 14:07 |
| Tengu | would be great for new comers :). | 14:07 |
| mwhahaha | it's not that complex | 14:07 |
| Tengu | either send a note, or point a wiki link | 14:07 |
| mwhahaha | Story: or Task: instead of Closes-Bug: | 14:07 |
| myoung|ruck | Has a quickstart / show-n-tell already been recorded? | 14:07 |
| jtomasek | o/ | 14:07 |
| myoung|ruck | (for sb) | 14:08 |
| mwhahaha | either way that's on folks need to take it upon themselves to look | 14:08 |
| owalsh | o/ | 14:08 |
| mwhahaha | we can't force people to read | 14:08 |
| *** elgxl has quit IRC | 14:08 | |
| Tengu | just don't forget to update https://docs.openstack.org/infra/manual/developers.html#development-workflow - I always refer to it in case of doubt :) | 14:08 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-specs master: blueprint tripleo-routed-networks-templates https://review.openstack.org/451584 | 14:08 |
| Tengu | and it's already updated. so all's good | 14:09 |
| *** elgxl has joined #tripleo | 14:09 | |
| mwhahaha | weshay: ok any chance on getting some eyes on the storyboard bits this week? | 14:09 |
| mwhahaha | trying to nail down some dates so we can push a bit on this | 14:10 |
| weshay | will try | 14:10 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-specs master: blueprint tripleo-routed-networks-templates https://review.openstack.org/451584 | 14:10 |
| mwhahaha | k | 14:10 |
| mwhahaha | moving on | 14:11 |
| mwhahaha | #topic one off agenda items | 14:11 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-meeting-items | 14:11 |
| *** openstack changes topic to "one off agenda items (Meeting topic: tripleo)" | 14:11 | |
| mwhahaha | FYI open for discussion, debate other ideas regarding preflighting CentOS updates to our CI jobs | 14:11 |
| mwhahaha | not sure who added that topic | 14:11 |
| mwhahaha | weshay: was that you? | 14:12 |
| weshay | yes | 14:12 |
| weshay | so to describe this a bit | 14:12 |
| *** elgxl has quit IRC | 14:12 | |
| *** bkopilov has joined #tripleo | 14:12 | |
| *** elgxl has joined #tripleo | 14:12 | |
| *** gkadam has quit IRC | 14:12 | |
| weshay | I think we can have a periodic job that runs once or twice a week.. w/ the cr centos repo continuous delivery rpms that move to base | 14:13 |
| bogdando | sounds like a perfect plan | 14:13 |
| weshay | two jobs or so that consume that repo w/o image and container rebuild.. and a couple jobs that run after the image and containers have been rebuilt w/ the cr repo | 14:13 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Run undeploy_plan workflow to delete deployment https://review.openstack.org/566366 | 14:13 |
| weshay | so .. I think we'd get the before and after promotion picture w/ regards to base updates | 14:13 |
| EmilienM | that + humans actually watching and pro-active on this job, which means we need a process of regular surveillance for this job | 14:14 |
| weshay | ya | 14:14 |
| *** gkadam has joined #tripleo | 14:14 | |
| myoung|ruck | it's a (good) canary, but doesn't stop the train...so ya active monitoring | 14:14 |
| EmilienM | something we check every week in our weekly meeting or in CI call or anything regular really | 14:14 |
| EmilienM | stupid question: so there is a centos repo that offers cd rpms? | 14:15 |
| dprince | EmilienM: testing? | 14:16 |
| dprince | EmilienM: if we enabled the testing repos it might get some coverage there... | 14:16 |
| weshay | EmilienM, yes.. I think I pasted into the agenda | 14:16 |
| weshay | https://wiki.centos.org/AdditionalResources/Repositories/CR | 14:16 |
| EmilienM | ah cool, til | 14:17 |
| EmilienM | so yeah, maybe a periodic multinode + a periodic ovb might do the job | 14:17 |
| mwhahaha | ok sounds like there isn't any general objection | 14:19 |
| mwhahaha | weshay: is this going on the backlog for the CI squad? | 14:19 |
| bogdando | even a single node undercloud deploy could prolly show if any update issues | 14:19 |
| bogdando | why waste CI resources for more nodes? | 14:20 |
| *** rajinir has joined #tripleo | 14:20 | |
| mwhahaha | if it's a periodic it's beneficial to get see the ovb problems | 14:20 |
| bogdando | ok makes sense | 14:20 |
| mwhahaha | since that's a more complete test | 14:20 |
| *** rpioso|afk is now known as rpioso | 14:20 | |
| EmilienM | the good news is we're not in hurry before next centos major upgrade | 14:21 |
| mwhahaha | alright anything else on this topic? | 14:21 |
| myoung|ruck | mwhahaha: bogdando: will capture this as a backlog item. Will design / discuss / prioritize / crush with PM/UA/TC per process | 14:21 |
| mwhahaha | plz make sure to also circulate plans on the ML so we can get infra input as well | 14:22 |
| myoung|ruck | mwhahaha: ack and indeed. | 14:22 |
| mwhahaha | cool moving on | 14:22 |
| mwhahaha | Deep dive about containerized undercloud! WANTED | 14:22 |
| mwhahaha | not sure who added that one either | 14:22 |
| mwhahaha | put your name on things people :D | 14:22 |
| bogdando | some one who wants to run it? | 14:22 |
| EmilienM | yes, we should make it I agree | 14:22 |
| EmilienM | when I get my voice back I can run it | 14:22 |
| dprince | mwhahaha: when is the deep dive? | 14:23 |
| EmilienM | there is no deep dive | 14:23 |
| EmilienM | but it seems people are asking for it | 14:23 |
| *** itlinux has joined #tripleo | 14:23 | |
| dprince | I can help run it | 14:23 |
| dprince | if it helps | 14:23 |
| EmilienM | awesome, yeah | 14:23 |
| mwhahaha | #action dprince, EmilienM plan a containerized undercloud deep dive | 14:23 |
| *** elgxl has quit IRC | 14:23 | |
| mwhahaha | tag your it | 14:23 |
| dprince | mwhahaha: perhaps lets wait a week or so after summit though | 14:24 |
| mwhahaha | indeed | 14:24 |
| EmilienM | yes ^ | 14:24 |
| mwhahaha | the action item is just a plan :D so if the plan doesn't start for 3 weeks, that's fine | 14:24 |
| mwhahaha | alright we'll get that going in the next few weeks | 14:25 |
| mwhahaha | any other questions/issues around this? | 14:25 |
| mwhahaha | ok moving on | 14:27 |
| mwhahaha | CI Community Meeting starts immediately upon this meeting closing. All are welcome, Add to agenda (or just join), https://bluejeans.com/7050859455, https://etherpad.openstack.org/p/tripleo-ci-squad-meeting @L28 | 14:27 |
| mwhahaha | yes, ci meeting after this one. feel free to join and discuss issues | 14:27 |
| mwhahaha | any questions? | 14:27 |
| myoung|ruck | we don't bite | 14:27 |
| *** itlinux has quit IRC | 14:27 | |
| mwhahaha | a likely story | 14:28 |
| *** elgxl has joined #tripleo | 14:29 | |
| mwhahaha | ok moving on | 14:29 |
| *** elgxl has quit IRC | 14:29 | |
| mwhahaha | #topic Squad status | 14:29 |
| mwhahaha | ci | 14:29 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 14:29 |
| mwhahaha | upgrade | 14:29 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status | 14:29 |
| *** openstack changes topic to "Squad status (Meeting topic: tripleo)" | 14:29 | |
| mwhahaha | containers | 14:29 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-containers-squad-status | 14:29 |
| mwhahaha | config-download | 14:29 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-config-download-squad-status | 14:29 |
| mwhahaha | integration | 14:29 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-integration-squad-status | 14:29 |
| mwhahaha | ui/cli | 14:29 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status | 14:29 |
| mwhahaha | validations | 14:29 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-validations-squad-status | 14:29 |
| mwhahaha | networking | 14:29 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-networking-squad-status | 14:29 |
| mwhahaha | workflows | 14:29 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-workflows-squad-status | 14:29 |
| mwhahaha | security | 14:29 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-security-squad | 14:29 |
| *** lvdombrkr89 has joined #tripleo | 14:30 | |
| jrist | will update ours shortly | 14:30 |
| *** elgxl has joined #tripleo | 14:30 | |
| mwhahaha | any status related items for discussion? | 14:31 |
| EmilienM | ditto | 14:31 |
| mwhahaha | looks like most are up to date | 14:31 |
| *** lvdombrkr has quit IRC | 14:32 | |
| openstackgerrit | Doug Szumski proposed openstack/diskimage-builder master: Remove duplicate GRUB command line entry https://review.openstack.org/568600 | 14:32 |
| Tengu | hmm. I think I have some sound issue with bluejeans -.- | 14:33 |
| mwhahaha | ok moving on | 14:34 |
| Tengu | ahh | 14:34 |
| mwhahaha | #topic bugs & blueprints | 14:34 |
| mwhahaha | #link https://launchpad.net/tripleo/+milestone/rocky-2 | 14:34 |
| mwhahaha | For Rocky we currently have 55 (+1) blueprints and about 705 (+20) open Launchpad bugs. 694 rocky-2, 11 rocky-3. 101 (+0) open Storyboard bugs. | 14:34 |
| mwhahaha | #link https://storyboard.openstack.org/#!/project_group/76 | 14:34 |
| *** openstack changes topic to "bugs & blueprints (Meeting topic: tripleo)" | 14:34 | |
| mwhahaha | so we've had two large increases in the bug count for the last two weeks +17 and +20 | 14:34 |
| EmilienM | I wanted to rise https://bugs.launchpad.net/tripleo/+bug/1771171 | 14:34 |
| openstack | Launchpad bug 1771171 in tripleo "ansible 2.5 takes internal role_name var seriously" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 14:34 |
| EmilienM | I'm working on it: https://review.openstack.org/#/q/topic:bug/1771171 | 14:34 |
| EmilienM | not sure if it's just my patches but multinode jobs are quite unstable | 14:35 |
| *** dxiri_ has quit IRC | 14:35 | |
| mwhahaha | i don't think it's just your job, i think we have issues with pacemaker with the 7.5 bits | 14:35 |
| *** dxiri has joined #tripleo | 14:35 | |
| *** apetrich has quit IRC | 14:36 | |
| *** cshastri has quit IRC | 14:37 | |
| *** trown is now known as trown|brb | 14:37 | |
| mwhahaha | also looked like some container download issues | 14:37 |
| mwhahaha | any other bugs? | 14:37 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: (cleanup) remove usage of role_name https://review.openstack.org/568347 | 14:37 |
| EmilienM | just a note | 14:38 |
| EmilienM | if we merge https://review.openstack.org/568443 we really need to land https://review.openstack.org/568340 at the same time | 14:38 |
| *** gbarros has joined #tripleo | 14:38 | |
| EmilienM | or gate will break | 14:38 |
| mwhahaha | sounds like we need to line those up carefully | 14:39 |
| EmilienM | yeah, I'll sync the merges | 14:40 |
| *** tosky has quit IRC | 14:40 | |
| mwhahaha | alright anything else? | 14:40 |
| *** trown|brb is now known as trown | 14:41 | |
| mwhahaha | #topic projects releases or stable backports | 14:41 |
| *** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)" | 14:41 | |
| mwhahaha | EmilienM: so it was mentioned last week that we should do a tripleoclient release at some point | 14:42 |
| mwhahaha | should we do it after the role name stuff lands or can we just do it now | 14:42 |
| *** tosky has joined #tripleo | 14:44 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates stable/queens: Add compute node L3 agent container for DVR https://review.openstack.org/568602 | 14:44 |
| *** rbrady__ has joined #tripleo | 14:44 | |
| EmilienM | mwhahaha: yes I planned to do it after this role_name thing | 14:44 |
| mwhahaha | k | 14:44 |
| EmilienM | #action EmilienM to release tripleoclient after role_name bug is fixed | 14:45 |
| mwhahaha | also as a reminder M2 is in ~3 weeks | 14:45 |
| mwhahaha | moving on | 14:45 |
| mwhahaha | #topic specs | 14:45 |
| mwhahaha | #link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open | 14:45 |
| *** openstack changes topic to "specs (Meeting topic: tripleo)" | 14:45 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Decouple OpenShiftGlusterDisks from openshift-master.yaml https://review.openstack.org/568603 | 14:45 |
| mwhahaha | we've got a handful of open specs | 14:46 |
| mwhahaha | please take some time to review them | 14:46 |
| mwhahaha | i'll be merging any with appropriate +2s at the end of the week if there are no objections | 14:46 |
| mwhahaha | #topic open discussion | 14:46 |
| *** openstack changes topic to "open discussion (Meeting topic: tripleo)" | 14:46 | |
| mwhahaha | anything else? | 14:46 |
| *** rbrady_ has quit IRC | 14:47 | |
| *** apetrich has joined #tripleo | 14:48 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Consume deployed t-h-t from the working output dir https://review.openstack.org/565233 | 14:49 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Use predictable name for generated hiera overrides https://review.openstack.org/566333 | 14:49 |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Call L3 checks before/after Role upgrade. https://review.openstack.org/566249 | 14:49 |
| openstackgerrit | Merged openstack/tripleo-validations master: Add documentation links to README https://review.openstack.org/568226 | 14:49 |
| openstackgerrit | Marios Andreou proposed openstack/python-tripleoclient stable/queens: Add .deployment.v1.deploy_on_servers to ffwd-upgrade prepare https://review.openstack.org/568604 | 14:49 |
| mwhahaha | sounds like nope | 14:49 |
| *** lvdombrkr89 has quit IRC | 14:49 | |
| mwhahaha | thanks everyone | 14:49 |
| mwhahaha | #endmeeting | 14:49 |
| *** openstack changes topic to "Welcome to Rocky. CI status: YELLOW (OVB failing) | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest" | 14:49 | |
| openstack | Meeting ended Tue May 15 14:49:43 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:49 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-05-15-14.00.html | 14:49 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-05-15-14.00.txt | 14:49 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-05-15-14.00.log.html | 14:49 |
| *** masco has quit IRC | 14:50 | |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Call L3 checks before/after Role upgrade. https://review.openstack.org/568606 | 14:51 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Store UC hosts/portmaps heat params in output_dir https://review.openstack.org/564135 | 14:52 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file https://review.openstack.org/568608 | 14:53 |
| chandankumar | EmilienM: please have a look at this patch https://review.openstack.org/#/q/topic:tempest_log+(status:open+OR+status:merged) It is related to enable logging in tempest container, But my changes is not working, I am not sure where I can doing wrong, please have a look | 14:59 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-validations stable/ocata: Validate that there should not be XFS volumes with ftype=0 https://review.openstack.org/564738 | 14:59 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Persist generated undercloud parameters t-h-t https://review.openstack.org/565764 | 15:00 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file https://review.openstack.org/568608 | 15:00 |
| chem | marios: matbu, hey I introduced a last minute bug in my osp9/10 upgrade and ill tested it, so if you could have a look at https://review.openstack.org/#/c/568552/ | 15:00 |
| EmilienM | chandankumar: I can't now but will do asap | 15:00 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Drop default inclusion of undercloud.yaml https://review.openstack.org/568386 | 15:01 |
| chem | marios: matbu, this was the last patchset that introduced the tempfile and my test env didn't take it into account | 15:01 |
| *** ykarel is now known as ykarel|afk | 15:02 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file https://review.openstack.org/568608 | 15:03 |
| *** apetrich has quit IRC | 15:06 | |
| *** bdodd has joined #tripleo | 15:06 | |
| mwhahaha | myoung|ruck, sshnaidm|rover, weshay: did we ever build pike containers? it looks like they are failing on pacemaker still | 15:14 |
| mwhahaha | http://logs.openstack.org/98/564698/2/check/tripleo-ci-centos-7-containers-multinode/50e7e2d/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-05-15_09_27_29 | 15:14 |
| weshay | mwhahaha, my understanding is that queens and pike are still down due to no promotion.. pike was close | 15:15 |
| * weshay looks | 15:15 | |
| mwhahaha | k | 15:15 |
| mwhahaha | plz let me know if we need reviews/fixes | 15:15 |
| *** apetrich has joined #tripleo | 15:15 | |
| weshay | mwhahaha, pike status on last attempt | 15:15 |
| weshay | https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-pike-upload/179/ | 15:16 |
| weshay | the image upload job timed out I think | 15:16 |
| weshay | hopefully getting a queens promotion in a few hours | 15:16 |
| mwhahaha | 2018-05-15 04:07:03,339 - testenv-client - INFO - Received job : Couldn't retrieve env | 15:16 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file https://review.openstack.org/568608 | 15:16 |
| * mwhahaha shakes fist at tebroker and rdocloud | 15:16 | |
| sshnaidm|rover | mwhahaha, it was problem at morning, not it's solved | 15:17 |
| sshnaidm|rover | s/not/now | 15:17 |
| weshay | sshnaidm|rover, is da man | 15:17 |
| sshnaidm|rover | mwhahaha, pike is running once a day, so tonight we'll see | 15:17 |
| mwhahaha | k | 15:17 |
| *** skramaja has quit IRC | 15:18 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file https://review.openstack.org/568608 | 15:18 |
| *** eck` is now known as eck`gone | 15:20 | |
| *** eck`gone is now known as eck` | 15:20 | |
| *** links has quit IRC | 15:21 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file https://review.openstack.org/568608 | 15:22 |
| chem | mwhahaha: hey, I forgot to port some changes from my test env to the review, hence https://review.openstack.org/#/c/568552/ ... it's a short one .. and sorry about that. | 15:24 |
| *** udesale_ has quit IRC | 15:25 | |
| mwhahaha | chem: k | 15:25 |
| chem | mwhahaha: thanks | 15:25 |
| *** aufi has quit IRC | 15:25 | |
| *** elgxl_ has joined #tripleo | 15:26 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file https://review.openstack.org/568608 | 15:26 |
| *** yprokule has quit IRC | 15:29 | |
| *** elgxl has quit IRC | 15:30 | |
| *** sshnaidm|rover is now known as sshnaidm|bbl | 15:31 | |
| *** elgxl_ has quit IRC | 15:31 | |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Make standalone role name configurable https://review.openstack.org/568378 | 15:31 |
| *** elgxl has joined #tripleo | 15:32 | |
| *** saneax is now known as saneax-_-|AFK | 15:33 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Add ability to use a different release per playbook https://review.openstack.org/566565 | 15:36 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file https://review.openstack.org/568608 | 15:36 |
| *** ykarel|afk is now known as ykarel|away | 15:39 | |
| *** ykarel|away has quit IRC | 15:44 | |
| *** agurenko has quit IRC | 15:44 | |
| tosky | arxcruz: this time the notification email worked! | 15:45 |
| arxcruz | tosky: ;) | 15:46 |
| *** tiswanso_ has joined #tripleo | 15:49 | |
| *** olap has quit IRC | 15:50 | |
| *** tiswanso has quit IRC | 15:52 | |
| *** tiswanso_ has quit IRC | 15:57 | |
| abishop | myoung|ruck: I think my tht stable/queens patch is hitting https://bugs.launchpad.net/tripleo/+bug/1770692, should I hold off rechecking? | 15:57 |
| openstack | Launchpad bug 1770692 in tripleo "potential for pacemaker version mismatch (BM vs.container) is a risk for OC deploy failures in gates" [Critical,Triaged] | 15:57 |
| *** tiswanso has joined #tripleo | 15:58 | |
| *** sanjay__u has quit IRC | 15:59 | |
| myoung|ruck | abishop: https://review.openstack.org/#/c/567833 ? | 16:01 |
| *** dprince has quit IRC | 16:01 | |
| * myoung|ruck looks | 16:01 | |
| EmilienM | mcornea: need your help if you have 5 min | 16:01 |
| *** salmankhan has quit IRC | 16:01 | |
| mcornea | EmilienM: sure, what's up? | 16:01 |
| EmilienM | mcornea: https://review.openstack.org/#/c/568340/ (looking at zuul), still failing in the update job: 2018-05-15 15:59:40.246637 | primary | failed: [undercloud] (item={'_ansible_parsed': True, 'stderr_lines': [], u'cmd': u'bash /home/zuul/overcloud_update_run-Controllertripleorolename.sh &> /home/zuul/overcloud_update_run_Controllertripleorolename.log', u'end': u'2018-05-15 15:59:39.815935', | 16:01 |
| EmilienM | '_ansible_no_log': False, u'stdout': u'', '_ansible_item_result': True, u'changed': True, u'start': u'2018-05-15 15:59:21.700823', u'failed': True, u'delta': u'0:00:18.115112', 'item': u'Controllertripleorolename', u'rc': 1, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'_raw_params': u'bash /home/zuul/overcloud_update_run-Controllertripleorolename.sh &> | 16:01 |
| EmilienM | /home/zuul/overcloud_update_run_Controllertripleorolename.log', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [], u'stderr': u'', u'msg': u'non-zero return code'}) => {"changed": false, "failed": true, "item": {"changed": true, "cmd": "bash /home/zuul/overcloud_update_run-Controllertripleorolename.sh &> /home/zuul/overcloud_update_run_Controllertripleorolename.log", | 16:01 |
| EmilienM | "delta": "0:00:18.115112", "end": "2018-05-15 15:59:39.815935", "failed": true, "invocation": {"module_args": {"_raw_params": "bash /home/zuul/overcloud_update_run-Controllertripleorolename.sh &> /home/zuul/overcloud_update_run_Controllertripleorolename.log", "_uses_shell": true, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": | 16:01 |
| EmilienM | "Controllertripleorolename", "msg": "non-zero return code", "rc": 1, "start": "2018-05-15 15:59:21.700823", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}, "msg": "Overcloud minor update execution step failed..."} | 16:01 |
| EmilienM | oops sorry for that | 16:02 |
| EmilienM | I really though it would be short :O | 16:02 |
| EmilienM | anyway, do you know if depends-on tripleo-upgrades repo is supposed to work? | 16:02 |
| EmilienM | mcornea: see https://review.openstack.org/#/c/568443/ | 16:02 |
| abishop | myoung|ruck: yup, that one | 16:02 |
| *** bogdando has quit IRC | 16:03 | |
| abishop | myoung|ruck: got 2 timeouts, and 3 overcloud deployment errors w/ same failure | 16:03 |
| mcornea | EmilienM: overcloud_update_run-Controllertripleorolename.sh doesn't look good to me, I think it should be overcloud_update_run-Controller.sh | 16:04 |
| EmilienM | yeah right | 16:04 |
| EmilienM | mcornea: which is what I'm supposed to fix in https://review.openstack.org/#/c/568443/ | 16:05 |
| EmilienM | (I thought) | 16:05 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file https://review.openstack.org/568608 | 16:06 |
| *** bcafarel|pto is now known as bcafarel | 16:06 | |
| mcornea | EmilienM: what's the link to the job for https://review.openstack.org/#/c/568340/ ? | 16:06 |
| EmilienM | mcornea: http://zuul.openstack.org/stream.html?uuid=2808950efa6c43338738645c4c2147f0&logfile=console.log | 16:07 |
| myoung|ruck | dciabrin, trozet, looks like abishop is also hitting https://bugs.launchpad.net/tripleo/+bug/1770692 in https://review.openstack.org/#/c/568443/ | 16:07 |
| openstack | Launchpad bug 1770692 in tripleo "potential for pacemaker version mismatch (BM vs.container) is a risk for OC deploy failures in gates" [Critical,Triaged] | 16:07 |
| EmilienM | mcornea: logs are being updated | 16:07 |
| *** anilvenkata has quit IRC | 16:07 | |
| EmilienM | mcornea: first thing I want to check is if we checked out my tripleo-upgrade patch | 16:07 |
| *** trown is now known as trown|lunch | 16:08 | |
| myoung|ruck | abishop: I need to dash for a lunch meeting, back in a bit. I would recheck for the data points...load isn't intense in the queues atm | 16:08 |
| abishop | myoung|ruck: ack, will recheck and see | 16:09 |
| *** lucasagomes is now known as lucas-afk | 16:09 | |
| mcornea | EmilienM: yeah, /tmp/fake-oc-hosts.yaml would also be useful, or can you run tripleo-ansible-inventory with this change applied locally? we can then run the awk command against the resulting inventory file to make sure it's doing the right thing | 16:09 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Update HostnameMap generation https://review.openstack.org/567951 | 16:09 |
| EmilienM | mcornea: logs are here http://logs.openstack.org/40/568340/5/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/2808950/ | 16:11 |
| EmilienM | mcornea: why we do this thing really? | 16:12 |
| EmilienM | mcornea: this code is terrible, imho | 16:13 |
| EmilienM | mcornea: we should use the tripleo inventory no? | 16:13 |
| mcornea | EmilienM: it's mostly to discover what roles are being deployed since we need to run different commands per role | 16:14 |
| EmilienM | awk -F':' '/tripleo_role_name/ {gsub("[[:space:][:punct:]]", "", $2); print $2}' /tmp/fake-oc-hosts.yaml | 16:15 |
| EmilienM | really? :-) | 16:15 |
| mcornea | EmilienM: /tmp/fake-oc-hosts.yaml is generated by tripleo inventory though :) | 16:17 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Add ability to use a different release per playbook https://review.openstack.org/566565 | 16:17 |
| EmilienM | mcornea: do you see in logs if we use https://review.openstack.org/#/c/568443/ ? | 16:17 |
| EmilienM | I'm not even sure | 16:17 |
| mcornea | EmilienM: ZUUL_CHANGES=openstack/tripleo-upgrade:master:refs/changes/43/568443/1^openstack/tripleo-common:master:refs/changes/40/568340/5 | 16:18 |
| EmilienM | yeah but it doesn't tell you if we checkout it at the place where the role is used | 16:18 |
| mcornea | EmilienM: can you show me how the inventory looks like with https://review.openstack.org/#/c/568340/ applied? | 16:19 |
| mcornea | to run the awk against it | 16:19 |
| EmilienM | mcornea: I don't have an env right now | 16:20 |
| *** ramishra has quit IRC | 16:20 | |
| *** tesseract has quit IRC | 16:21 | |
| mcornea | EmilienM: give me a minute to if I can apply it on one of my envs | 16:21 |
| EmilienM | weshay: we shouldn't use Wiki, it's deprecated and will be removed one day AFIK, we should keep our doc at the same place: https://wiki.openstack.org/wiki/Tripleo-upgrades-fs-variables | 16:21 |
| EmilienM | weshay: please remove that page | 16:21 |
| EmilienM | mcornea: thx | 16:21 |
| weshay | EmilienM, aye.. that is a fine plan | 16:21 |
| EmilienM | weshay: like always ;-) please just don't use it | 16:22 |
| weshay | use it | 16:22 |
| weshay | ? | 16:22 |
| EmilienM | the wiki is deprecated and will be removed one day | 16:22 |
| EmilienM | all our doc has been done in tripleo-docs | 16:23 |
| EmilienM | we should really be consistent at some point | 16:23 |
| weshay | aye aye | 16:23 |
| weshay | roger that | 16:23 |
| *** rodolof has quit IRC | 16:23 | |
| weshay | 10-4 | 16:23 |
| *** rodolof has joined #tripleo | 16:23 | |
| *** zoli is now known as zoli|gone | 16:26 | |
| *** zoli|gone is now known as zoli | 16:26 | |
| *** panda is now known as panda|bbl | 16:29 | |
| EmilienM | mcornea: I'll use a random inventory http://logs.openstack.org/33/566333/3/gate/tripleo-ci-centos-7-containers-multinode/298dde4/logs/undercloud/var/lib/mistral/b1b0226f-b8c1-4b66-bff0-c9af481baf29/tripleo-ansible-inventory.yaml.txt.gz | 16:30 |
| *** jaosorior has quit IRC | 16:31 | |
| EmilienM | mcornea: I could reproduce | 16:31 |
| EmilienM | mcornea: we shouldn't parse YAML from bash, really... | 16:32 |
| *** dtantsur is now known as dtantsur|afk | 16:33 | |
| mcornea | EmilienM: how? on my env it appears to work correctly http://paste.openstack.org/show/721025/ | 16:33 |
| *** pcaruana has quit IRC | 16:33 | |
| EmilienM | mcornea: you didn't change the inventory | 16:33 |
| EmilienM | mcornea: role_name: Controller, tripleo_role_name: Controller} | 16:33 |
| EmilienM | change the line ^ | 16:33 |
| EmilienM | I found the problem, fixingf | 16:34 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-upgrade master: Use tripleo_role_name instead of role_name https://review.openstack.org/568443 | 16:36 |
| EmilienM | mcornea: ^ see ($3 instead of $2) | 16:37 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-upgrade master: Use tripleo_role_name instead of role_name https://review.openstack.org/568443 | 16:37 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Include 'tripleo_role_name' in the inventory https://review.openstack.org/568340 | 16:38 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: deploy-steps: switch to tripleo_role_name https://review.openstack.org/568343 | 16:38 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Deploy Docker via Ansible and not Puppet https://review.openstack.org/561377 | 16:38 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: (cleanup) remove usage of role_name https://review.openstack.org/568347 | 16:38 |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: (cleanup) remove usage of vars when calling ansible https://review.openstack.org/568346 | 16:38 |
| mcornea | EmilienM: what better option do we have for discovering the roles from an existing deloyment? | 16:38 |
| EmilienM | mcornea: everything except parsing YAML/JSON from bash | 16:39 |
| EmilienM | this is super sensible | 16:39 |
| *** mdnadeem has quit IRC | 16:40 | |
| *** marios has quit IRC | 16:41 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Add basics for standalone node https://review.openstack.org/566419 | 16:41 |
| *** suuuper has joined #tripleo | 16:41 | |
| trozet | myoung|ruck: yeah I did this workaround that I'm testing now: https://gerrit.opnfv.org/gerrit/#/c/56981/26/lib/ansible/playbooks/prepare_overcloud_containers.yml | 16:42 |
| *** gfidente has quit IRC | 16:45 | |
| *** mdnadeem has joined #tripleo | 16:54 | |
| *** dprince has joined #tripleo | 16:56 | |
| *** derekh has quit IRC | 17:00 | |
| *** tiswanso_ has joined #tripleo | 17:02 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file https://review.openstack.org/568608 | 17:05 |
| *** tiswanso has quit IRC | 17:05 | |
| *** gkadam has quit IRC | 17:07 | |
| *** thrash is now known as thrash|biab | 17:08 | |
| *** yolanda_ has quit IRC | 17:09 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: Ensure the CephX Manila keyring permissions are only set when needed https://review.openstack.org/567642 | 17:10 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Pass overcloud stack name to upgrade run. https://review.openstack.org/568468 | 17:10 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file https://review.openstack.org/568608 | 17:10 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-upgrade master: Add config_change role https://review.openstack.org/567300 | 17:12 |
| sai_ | dsneddon: hey, i have a typical situation. Although I set use_dhcp: fals eto all other interfaces except provisioning in my tempaltes, I see hte other itnerfaces also picking up dhcp addresses instead of the values fro mthe nic-configs. I verfified the interface config files and they are all set to bootproto=none. Not sure how they are dhcping. Anything from the template/tripleo side i can do to avoid this | 17:12 |
| *** shardy has quit IRC | 17:12 | |
| EmilienM | mcornea: if we had to treat this kind of data, we should use Python or Ansible native features, not bash, imho. | 17:12 |
| EmilienM | mcornea: we really need to come up with best practices in tripleo-upgrades repo | 17:13 |
| mcornea | EmilienM: yeah, I'm looking into how to do that, I agree that bash is not ideal but for now it did the job | 17:13 |
| sai_ | dsneddon: sorry, i still see bootproto-dhcp inspite of using use_dhcp: fals ein templates | 17:14 |
| *** janki has quit IRC | 17:14 | |
| *** mdnadeem has quit IRC | 17:15 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file https://review.openstack.org/568608 | 17:16 |
| *** kopecmartin has quit IRC | 17:17 | |
| *** rodolof has quit IRC | 17:17 | |
| dsneddon | sai_, Why are you even including those interfaces in the template if you don't want to use them? | 17:17 |
| dsneddon | sai_, Or are they supposed to be used, but not get DHCP? Are they supposed to get a static IP? | 17:18 |
| sai_ | dsneddon: they are dhcping into the control plane pool. Im using them for other networks like tenhant/internalapi etc. So setting them to use_dhcp: false | 17:18 |
| sai_ | dsneddon: correct | 17:18 |
| dsneddon | sai_, Can you show me your nic config templates? | 17:19 |
| sai_ | dsneddon: one sec. | 17:19 |
| *** yolanda_ has joined #tripleo | 17:20 | |
| dsneddon | sai_, If you are getting the control plane IP on other interfaces, that isn't because of DHCP, it | 17:20 |
| dsneddon | sai_, It's because you forgot to instantiate the ports for the other networks, so they fallback to the control plane IP. Did you include network-isolation.yaml? | 17:21 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add releases script pytest tests to tox.ini https://review.openstack.org/567649 | 17:21 |
| *** tiswanso_ has quit IRC | 17:22 | |
| *** tiswanso has joined #tripleo | 17:22 | |
| sai_ | dsneddon: yes, including the isolation file in deploy command | 17:22 |
| sai_ | dsneddon: http://elk.browbeatproject.org:9090/~smalleni/osp13-full-lab/nic-configs/r630-controller.yaml | 17:22 |
| *** trown|lunch is now known as trown | 17:22 | |
| openstackgerrit | Ade Lee proposed openstack/tripleo-quickstart master: Add job to test password changes https://review.openstack.org/567888 | 17:24 |
| *** psachin has quit IRC | 17:24 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add releases script pytest tests to tox.ini https://review.openstack.org/567649 | 17:25 |
| sai_ | dsneddon: also, a bit of background, since we have nodes with varying number of nics and we want to use as many nics as available on each system, we use qinq where the service provider vlan is same for all ports, however we use the custoemr vlan for network isolation | 17:25 |
| sai_ | SamYaple: that is why the other nics are able to dhcp...however i would expect them not to dhcp when setting use_dhcp: false | 17:26 |
| openstackgerrit | Ade Lee proposed openstack-infra/tripleo-ci master: Add password change job https://review.openstack.org/567897 | 17:26 |
| dsneddon | sai_, Can you grab the bridge ifcfg files from /etc/sysconfig/network-scripts/ifcfg-br-* and tell me if they have the correct IP in them? | 17:27 |
| sai_ | dsneddon: : that is why the other nics are able to dhcp...however i would expect them not to dhcp when setting use_dhcp: false | 17:27 |
| sai_ | dsneddon: ok one sec | 17:27 |
| sai_ | dsneddon: bridge interface config files havent even been created | 17:28 |
| sai_ | dsneddon: by the time deploy fails | 17:28 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add releases script pytest tests to tox.ini https://review.openstack.org/567649 | 17:28 |
| dsneddon | sai_, That's your problem. os-net-config is failing, probably because of a problem with your NIC config, so a fallback service dhcp-all-interfaces runs. This causes DHCP on all interfaces, so you can log in and find out what went wrong. Can you pastebin /etc/os-net-config/config.json? | 17:29 |
| sai_ | dsneddon: https://imgur.com/3Rq4L6g | 17:30 |
| sai_ | dsneddon: sorry couldnt copy from the management console, hence screenshot | 17:31 |
| *** elgxl_ has joined #tripleo | 17:31 | |
| *** masco has joined #tripleo | 17:32 | |
| *** tosky has quit IRC | 17:33 | |
| *** elgxl has quit IRC | 17:34 | |
| dsneddon | sai_, OK, the screenshot doesn't let me validate the JSON. Can you maybe run "sudo os-net-config --debug -c /etc/os-net-config/config.json" and tell me what the error is? | 17:34 |
| EmilienM | mcornea: is https://review.openstack.org/#/c/568443/ ok for you? | 17:35 |
| EmilienM | mcornea: I'll clean that up when the old var is removed | 17:35 |
| *** elgxl_ has quit IRC | 17:36 | |
| *** agurenko has joined #tripleo | 17:36 | |
| sai_ | dsneddon: that command returned successfully..shocking :) | 17:36 |
| *** masco has quit IRC | 17:37 | |
| mcornea | EmilienM: yes, looks good to me | 17:37 |
| dsneddon | sai_, Do you now have ifcfg-br-* files in /etc/sysconfig/network-scripts? | 17:37 |
| sai_ | dsneddon: everythign is *fixed* now in the sense the vlan interfaces are created | 17:37 |
| sai_ | dsneddon: yes | 17:37 |
| dsneddon | sai_, OK, I don't know what happened, then. Hard to say. | 17:37 |
| *** tosky has joined #tripleo | 17:38 | |
| dsneddon | sai_, You might check the /var/log/messages file for os-net-config and see if there was an error before. | 17:38 |
| sai_ | dsneddon: in case my tempaltes were wrong etc, runing os-net-config should have shown an error right? | 17:40 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add linter jobs for releases file script https://review.openstack.org/568287 | 17:42 |
| dsneddon | sai_, Yes, I would expect so. | 17:42 |
| sai_ | dsneddon: this is a 290 node deployment, not a great way to start :-) | 17:43 |
| dsneddon | sai_, The only thing I can think is that maybe the switch was acting weird when it first ran, or it was a fluke, etc. | 17:43 |
| dsneddon | sai_, BTW, you only need bridges on the interfaces where you are hosting Neutron tenant or provider VLANs. | 17:43 |
| dsneddon | sai_, You don't need a bridge on the Storage Management or Storage networks | 17:44 |
| dsneddon | sai_, What we usually do is just have an interface and a VLAN, and the VLAN has "device: <interface>" to indicate which interface the VLAN goes on. | 17:44 |
| sai_ | dsneddon: ack, will keep in mind | 17:45 |
| sai_ | dsneddon: i see error running /var/lib/heat-config/heat-config-script/32e7213e-4bc3-4e27-b336-b1f50 | 17:46 |
| sai_ | 0b0999b | 17:46 |
| sai_ | and looking athe filke | 17:46 |
| sai_ | it seems to be doing the ent-config | 17:46 |
| dsneddon | sai_, Like this: http://paste.openstack.org/show/721036/ | 17:47 |
| dsneddon | sai_, That will be the run-os-net-config.sh script running | 17:48 |
| sai_ | dsneddon: can i run that manually and see what the error is? maybe theres abug here? | 17:49 |
| dsneddon | sai_, What that script does is write /etc/os-net-config/config.json and runs os-net-config. | 17:51 |
| *** holser__ has joined #tripleo | 17:51 | |
| sai_ | hmm this is weird now, unsure how to proceed, deployment failed three times at same step | 17:51 |
| *** holser___ has quit IRC | 17:51 | |
| *** thrash|biab is now known as thrash | 17:52 | |
| dsneddon | sai_, Clearly the first part is happening (writing to os-net-config). | 17:52 |
| dsneddon | sai_, Wait a minute, you have the addresses: under the VLAN, those should be under the bridge | 17:53 |
| *** elgxl has joined #tripleo | 17:53 | |
| dsneddon | sai_, Or do I misunderstand your setup? All the networks are delivered over VLANs, but on different NICs? | 17:53 |
| *** gyankum has quit IRC | 17:55 | |
| dsneddon | sai_, No, you said they were Q-in-Q, so I guess that's intentional | 17:55 |
| *** holser__ has quit IRC | 17:56 | |
| sai_ | dsneddon: yeh, this might not even be a switch issue right? doesnt even get to the point of pinging? | 17:56 |
| EmilienM | weshay: do we have someone looking at https://bugs.launchpad.net/tripleo/+bug/1768997 during this sprint? | 17:56 |
| openstack | Launchpad bug 1768997 in tripleo "containerized-undercloud-upgrades: dlrn tasks don't run" [Critical,Triaged] | 17:56 |
| weshay | EmilienM, yes.. that is one of the use cases they are solving | 17:57 |
| sai_ | dsneddon: all ports are in same serviceporivider vlan, just using customer vlan to isolate networks..maybe that is the issue? what if i have the other interfaces totally isolated from the provisioning interface, so they cant even dhcp? | 17:57 |
| dsneddon | sai_, You have the right idea (use_dhcp: false on the bridge), but I don't know why it's failing when it runs the script. | 17:58 |
| *** elgxl has quit IRC | 17:58 | |
| dsneddon | sai_, Try grepping recursively for os-net-config in /var/log | 17:59 |
| dsneddon | sai_, Or in the journalctl output | 17:59 |
| *** tiswanso_ has joined #tripleo | 18:00 | |
| *** links has joined #tripleo | 18:00 | |
| dsneddon | sai_, You can always modify run-os-net-config.sh script in tripleo-heat-templates/network/script if it turns out you need a sleep delay for the switch or something. | 18:00 |
| sai_ | dsneddon: also, i have use_dhcp: fasle at bridge elvel and interface level..do i need it at both places (i gues si do right) | 18:01 |
| *** salmankhan has joined #tripleo | 18:02 | |
| dsneddon | sai_, Honestly it's just to make it clear what's happening. Unless you have use_dhcp: true, it defaults to false. | 18:02 |
| sai_ | dsneddon: no errors :/ https://gist.githubusercontent.com/smalleni/72597bd0f2e2a4afa66a7bcfc22605d5/raw/0df657aacd970ade04abe8ee9749ac72a26ffc43/gistfile1.txt | 18:03 |
| sai_ | dsneddon: ah ok | 18:03 |
| *** tiswanso has quit IRC | 18:04 | |
| sai_ | dsneddon: (heat-config) [ERROR] Error running /var/lib/heat-config/heat-config-script/32e7213e-4bc3-4e27-b336-b1f500b0999b doesnt say what the error was :/ | 18:06 |
| dsneddon | sai_, To be clear, this node has em1, em2, em3, em4, p2p1, p2p2, p2p3, and p2p4, but only em1-em4 are supposed to be used, correct? | 18:10 |
| sai_ | dsneddon: yes | 18:11 |
| sai_ | other nics arent wired | 18:11 |
| *** dougbtv_ has quit IRC | 18:11 | |
| *** ykarel|away has joined #tripleo | 18:12 | |
| *** florianf has quit IRC | 18:16 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add fast_forward_upgrade_tasks in ironic services. https://review.openstack.org/567849 | 18:17 |
| dsneddon | sai_, It looks like the initial run of os-net-config failed to make 192.168.0.1 pingable: "echo '192.168.0.1 is not pingable." | 18:19 |
| dsneddon | sai_, So because of that, it ran this a few minutes later: os-net-config -c /etc/os-net-config/dhcp_all_interfaces.yaml -v --detailed-exit-codes --cleanup | 18:19 |
| sai_ | dsneddon: so it tries to ping only once? | 18:20 |
| sai_ | dsneddon: maybe when i reran the os-net-config command it succceded as ping was successful then | 18:21 |
| *** ykarel|away has quit IRC | 18:22 | |
| dsneddon | sai_, No, it tried and failed 10 times | 18:23 |
| dsneddon | sai_, I don't think that just running os-net-config will run the ping test, so it's possible that when you ran os-net-config by hand that 192.168.0.1 still isn't pingable | 18:24 |
| *** holser__ has joined #tripleo | 18:28 | |
| *** dprince has quit IRC | 18:30 | |
| *** dprince has joined #tripleo | 18:30 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add dry run option to toci_quickstart https://review.openstack.org/567060 | 18:32 |
| *** holser__ has quit IRC | 18:32 | |
| dsneddon | sai_, Can you check to see if 192.168.0.1 is pingable now that you ran os-net-config by hand? | 18:37 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: DNM: Stop openstack services before undercloud upgrade https://review.openstack.org/568667 | 18:39 |
| sai_ | dsneddon: blew awa ythe env, will check on redeployment | 18:40 |
| *** agopi has quit IRC | 18:41 | |
| dsneddon | sai_, Do these nodes boot off of em2? I noticed that is where you are placing the control plane IP | 18:46 |
| sai_ | dsneddon: yes, they pxe off em2 | 18:51 |
| *** tiswanso_ has quit IRC | 18:52 | |
| *** tiswanso has joined #tripleo | 18:54 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Add python script to dynamically compose releases https://review.openstack.org/567521 | 18:57 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Add method for getting dlrn_hash from release and hash_name https://review.openstack.org/567320 | 18:57 |
| *** suuuper has quit IRC | 18:57 | |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: overcloud plan deployment failures https://review.openstack.org/568673 | 18:57 |
| *** tiswanso has quit IRC | 18:58 | |
| *** dmsimard|off is now known as dmsimard | 18:58 | |
| *** ansmith has quit IRC | 18:59 | |
| *** pkovar has quit IRC | 18:59 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Ansible json error callback plugin https://review.openstack.org/566938 | 19:00 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Workflow and action for deployment failures https://review.openstack.org/567318 | 19:00 |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: overcloud plan deployment status https://review.openstack.org/564341 | 19:00 |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: overcloud plan deployment failures https://review.openstack.org/568673 | 19:00 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Ansible json error callback plugin https://review.openstack.org/566938 | 19:03 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Workflow and action for deployment failures https://review.openstack.org/567318 | 19:03 |
| myoung|ruck | weshay, mwhahaha: (queens) 2018-05-15 19:06:07,912 28001 INFO promoter Promoting the container images for dlrn hash a7fbaca2a97adda856c3ba5d5166fb1665f02bc0 on queens to current-tripleo | 19:08 |
| weshay | nice | 19:08 |
| myoung|ruck | ^^ if you have the blood of a chicken or a vial of unicorn tears to offer to the infra gods...now isn't a terrible time... | 19:09 |
| myoung|ruck | /me grins | 19:10 |
| *** agopi has joined #tripleo | 19:10 | |
| *** holser__ has joined #tripleo | 19:11 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add dry run option to toci_quickstart https://review.openstack.org/567060 | 19:15 |
| *** holser__ has quit IRC | 19:16 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Set deployment_status from config_download_deploy https://review.openstack.org/566953 | 19:16 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add workflow for plan deployment status https://review.openstack.org/564315 | 19:16 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Ansible json error callback plugin https://review.openstack.org/566938 | 19:16 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Workflow and action for deployment failures https://review.openstack.org/567318 | 19:16 |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: overcloud plan deployment status https://review.openstack.org/564341 | 19:16 |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: overcloud plan deployment failures https://review.openstack.org/568673 | 19:16 |
| slagle | i'm gettin good at git | 19:18 |
| *** radeks__ has quit IRC | 19:19 | |
| *** radeks_ has quit IRC | 19:20 | |
| *** links has quit IRC | 19:20 | |
| *** tiswanso has joined #tripleo | 19:20 | |
| *** jaosorior has joined #tripleo | 19:21 | |
| *** tiswanso has quit IRC | 19:21 | |
| *** tiswanso has joined #tripleo | 19:21 | |
| *** agurenko has quit IRC | 19:25 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/queens: Enable default polling interval override https://review.openstack.org/568677 | 19:26 |
| bnemec | Hmm, undercloud install is failing on certmonger today: http://paste.openstack.org/show/721042/ | 19:27 |
| *** alee is now known as alee_afk | 19:27 | |
| *** cylopez has joined #tripleo | 19:29 | |
| EmilienM | mwhahaha: can we approve https://review.openstack.org/#/c/568443/ and https://review.openstack.org/#/c/568340/ in the same time please? | 19:29 |
| mwhahaha | k | 19:30 |
| * mwhahaha rolls the dice with the CI gods | 19:30 | |
| EmilienM | lol | 19:30 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: WIP: Load roles list from yaml instead of awk parsing https://review.openstack.org/568679 | 19:31 |
| *** cylopez has quit IRC | 19:31 | |
| EmilienM | mwhahaha: and https://review.openstack.org/#/c/568343/ | 19:31 |
| EmilienM | am I alone to have tempest failures today? http://logs.openstack.org/77/561377/78/check/tripleo-ci-centos-7-containers-multinode/3715d6c/logs/tempest.html.gz | 19:32 |
| EmilienM | myoung|ruck ^ is there an ongoing issue? | 19:32 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-upgrade master: Cleanup on oc_roles var https://review.openstack.org/568680 | 19:37 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: (cleanup) remove usage of role_name https://review.openstack.org/568347 | 19:38 |
| *** salmankhan has quit IRC | 19:39 | |
| myoung|ruck | EmilienM: we've been working on a number of issues, i'm not certain about that specific tempest failure. although last night we had a missing container that caused a gates failures so you might be tip of the spear...not sure yet | 19:42 |
| *** shreshtha has quit IRC | 19:42 | |
| abishop | myoung|ruck: same failures after recheck http://logs.openstack.org/33/567833/2/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/f54dafa/logs/subnode-2/var/log/journal.txt.gz#_May_15_18_10_54 | 19:44 |
| EmilienM | myoung|ruck: ack I'll keep an eye | 19:44 |
| *** shreshtha has joined #tripleo | 19:44 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add dry run option to toci_quickstart https://review.openstack.org/567060 | 19:45 |
| mcornea | EmilienM: fyi I started https://review.openstack.org/#/c/568679/ to replace the awk, I need to test it and replace all the occurences | 19:47 |
| EmilienM | woot | 19:48 |
| EmilienM | mcornea: thanks :) | 19:48 |
| EmilienM | mcornea: really better | 19:48 |
| EmilienM | thanks | 19:48 |
| weshay | EmilienM, looks like neutron timed out creating the virt interface | 19:49 |
| *** jtomasek has quit IRC | 19:51 | |
| weshay | EmilienM, myoung|ruck ya.. so I would not expect queens to work until this promotion is done https://review.openstack.org/#/c/567833/ | 19:52 |
| weshay | re: this review | 19:52 |
| weshay | EmilienM, queens and pike are DOWN | 19:53 |
| weshay | abishop, ^ | 19:53 |
| abishop | weshay: I think https://review.openstack.org/568550 was the critical one | 19:53 |
| weshay | abishop, ok.. well that can be cherry picked in | 19:54 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Add basics for standalone node https://review.openstack.org/566419 | 19:54 |
| myoung|ruck | weshay, abishop, EmilienM: re queens promotion it's chugging along with container push now...it's pulled from rdoproject and has started to push containers --> docker.io | 19:55 |
| abishop | weshay: It was merged to queens, and the issue it fixed was never on pike | 19:55 |
| weshay | abishop, aye.. that's fine.. it's a puppet change no longer checked by tripleo until promotion jobs anyhooo | 19:55 |
| weshay | abishop, so when I say queens is down, I'm referring to the tripleo repos only | 19:56 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add dry run option to toci_quickstart https://review.openstack.org/567060 | 20:01 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Revert "Revert "Deploy container-multinode (fs010) with a containerized undercloud"" https://review.openstack.org/560264 | 20:11 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Make standalone role name configurable https://review.openstack.org/568378 | 20:13 |
| *** lblanchard has quit IRC | 20:16 | |
| EmilienM | weshay: yeah: http://logs.openstack.org/77/561377/78/check/tripleo-ci-centos-7-containers-multinode/3715d6c/logs/subnode-2/var/log/containers/nova/nova-compute.log.txt.gz#_2018-05-15_19_05_13_682 | 20:18 |
| *** fragatina has quit IRC | 20:20 | |
| *** fragatina has joined #tripleo | 20:20 | |
| weshay | EmilienM, yup | 20:20 |
| weshay | but queens is fubar'd until we get new containers up | 20:20 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add dry run option to toci_quickstart https://review.openstack.org/567060 | 20:23 |
| *** agopi has quit IRC | 20:25 | |
| *** holser__ has joined #tripleo | 20:27 | |
| *** pchavva has quit IRC | 20:31 | |
| *** rbowen has quit IRC | 20:34 | |
| *** sshnaidm|bbl is now known as sshnaidm|rover | 20:42 | |
| *** gbarros has quit IRC | 20:46 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add dry run option to toci_quickstart https://review.openstack.org/567060 | 20:48 |
| *** oneswig has joined #tripleo | 20:52 | |
| *** leanderthal has quit IRC | 20:53 | |
| *** raildo has quit IRC | 20:59 | |
| *** trown is now known as trown|outtypewww | 21:05 | |
| weshay | dam.. all of metrics and monitoring is in europe | 21:10 |
| weshay | minus prad | 21:10 |
| *** paramite_ has quit IRC | 21:10 | |
| weshay | mwhahaha, can we skip list autoscale? http://logs.openstack.org/45/560445/29/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/6c9f8c0/logs/stackviz/#/stdin | 21:10 |
| weshay | scen01/02 are failing | 21:10 |
| mwhahaha | you mean the only test that actually tests something | 21:10 |
| mwhahaha | sure | 21:10 |
| mwhahaha | let's just return 0 | 21:10 |
| weshay | lolz | 21:11 |
| weshay | ok.. just asking | 21:11 |
| mwhahaha | urllib3.exceptions.SSLError: [SSL: UNKNOWN_PROTOCOL] unknown protocol (_ssl.c:579) | 21:11 |
| weshay | mwhahaha, you don't have to get Alex Schultz on me ;P | 21:11 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: WIP: Load roles list from yaml instead of awk parsing https://review.openstack.org/568696 | 21:12 |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Add ability to pre-assign IPs by role on ctlplane https://review.openstack.org/568505 | 21:12 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: WIP: Load roles list from yaml instead of awk parsing https://review.openstack.org/568696 | 21:13 |
| mwhahaha | weshay: i'd prefer we turned of ssl over disabling the test | 21:15 |
| mwhahaha | then we can throw things at juan tomorrow | 21:15 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: WIP: Load roles list from yaml instead of awk parsing https://review.openstack.org/568696 | 21:15 |
| mwhahaha | weshay: it's likely something is supposed to be ssl enabeld but isn't. though this is happening in the gate right? or promotion | 21:16 |
| weshay | check and gate | 21:16 |
| weshay | afaict | 21:16 |
| mwhahaha | so what did we merge | 21:17 |
| mwhahaha | when did it start | 21:17 |
| weshay | myoung|ruck, fyi ^ | 21:17 |
| * weshay traces it back | 21:17 | |
| openstackgerrit | Roman Gorshunov proposed openstack/diskimage-builder master: Allow to rebuild arbitrary images https://review.openstack.org/568697 | 21:17 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: WIP: Load roles list from yaml instead of awk parsing https://review.openstack.org/568696 | 21:18 |
| weshay | this may help https://review.openstack.org/#/c/567667/2 | 21:19 |
| weshay | worked in check, failed in gate | 21:19 |
| mwhahaha | so something that merged today | 21:20 |
| mwhahaha | so nothing | 21:21 |
| mwhahaha | because nothing merged between then | 21:21 |
| *** holser__ has quit IRC | 21:21 | |
| mwhahaha | what the hell | 21:21 |
| *** abishop has quit IRC | 21:21 | |
| mwhahaha | https://review.openstack.org/#/c/558424/ | 21:21 |
| mwhahaha | i bet it was that | 21:21 |
| weshay | mwhahaha, I'm checking on if containers changed at that time too | 21:22 |
| mwhahaha | no it's probably that default endpoint map | 21:22 |
| mwhahaha | gimme a bug so i can revert it | 21:22 |
| weshay | myoung|ruck, ^ | 21:22 |
| weshay | so that is tht | 21:22 |
| weshay | k.. may I update the files: config in zuul there? | 21:23 |
| mwhahaha | yes | 21:23 |
| weshay | word up | 21:23 |
| mwhahaha | network/endpoints/ should get everything | 21:23 |
| * myoung|ruck surfaces from logs and reads scrollback | 21:24 | |
| mwhahaha | i'll create a bug | 21:25 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Revert "Change default endpoint map entries to use TLS" https://review.openstack.org/568699 | 21:27 |
| mwhahaha | weshay, myoung|ruck -^ | 21:27 |
| weshay | myoung|ruck, the number is important, the details can come in a follow up | 21:29 |
| myoung|ruck | weshay: i might just be fuzzy because it's approaching dinner but I'm trying to parse that | 21:30 |
| myoung|ruck | you mean a LP #? | 21:30 |
| weshay | ya | 21:30 |
| myoung|ruck | k | 21:30 |
| mwhahaha | i filed one | 21:32 |
| mwhahaha | https://bugs.launchpad.net/tripleo/+bug/1771435 | 21:32 |
| openstack | Launchpad bug 1771435 in tripleo "scenario001/002 failing on autoscaling with urllib3.exceptions.SSLError: [SSL: UNKNOWN_PROTOCOL] unknown protocol (_ssl.c:579)" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 21:32 |
| weshay | mwhahaha, thanks | 21:32 |
| mwhahaha | already tagged that change with it as well | 21:33 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates master: update tht jobs to include network/endpoints https://review.openstack.org/568700 | 21:33 |
| * mwhahaha throws things at jaosorior | 21:33 | |
| weshay | mwhahaha, check my math on that | 21:33 |
| myoung|ruck | 1771437 | 21:33 |
| weshay | myoung|ruck, alex opened one | 21:33 |
| * myoung|ruck gives up and picks up his kid | 21:33 | |
| myoung|ruck | I'll be back in an hour | 21:33 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Run "overcloud container image prepare" only once https://review.openstack.org/528621 | 21:36 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Move BUILD_ID setting logic out of template https://review.openstack.org/568396 | 21:36 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: WIP Use "openstack tripleo container image prepare" https://review.openstack.org/568403 | 21:36 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Disable repo centos-qemu-ev https://review.openstack.org/568701 | 21:36 |
| *** ssbarnea_ has quit IRC | 21:36 | |
| stevebaker | weshay: hey, are you aware of this issue with the repo file for centos-qemu-ev? ^^ | 21:37 |
| *** ansmith has joined #tripleo | 21:37 | |
| weshay | stevebaker, yes me checks on that | 21:38 |
| weshay | there is a lp | 21:38 |
| weshay | stevebaker, think this is it https://bugs.launchpad.net/tripleo/+bug/1771090 | 21:39 |
| openstack | Launchpad bug 1771090 in tripleo "Kolla fails to build containers for tripleo in Ci build-container job" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 21:39 |
| *** akrivoka has quit IRC | 21:39 | |
| myoung|ruck | weshay, stevebaker, yes https://bugs.launchpad.net/tripleo/+bug/1771090 is the qemu-ev issue | 21:42 |
| openstack | Launchpad bug 1771090 in tripleo "Kolla fails to build containers for tripleo in Ci build-container job" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 21:42 |
| weshay | stevebaker would it be better to stat.. /etc/yum.re/CentOS-QEMU-EV.repo and if present disable? vs.. when: inventory_hostname == "subnode-0 | 21:42 |
| stevebaker | weshay: or maybe lets just populate /etc/yum/vars/contentdir | 21:43 |
| *** dmsimard is now known as dmsimard|off | 21:43 | |
| weshay | hrm.. not sure what you mean | 21:43 |
| *** jcoufal has quit IRC | 21:44 | |
| stevebaker | weshay: the problem is that $contentdir doesn't resolve to "centos" in that repo file, so maybe we can just write out "centos" to /etc/yum/vars/contentdir if that file is missing | 21:45 |
| weshay | k sec just educating myself | 21:46 |
| *** tvignaud has quit IRC | 21:46 | |
| weshay | it takes the cost of a cup of coffee you know | 21:46 |
| *** tvignaud has joined #tripleo | 21:47 | |
| stevebaker | only too well | 21:47 |
| weshay | ah k | 21:48 |
| weshay | similiar to what I'm seeing... arch, basearch, infra etc | 21:48 |
| weshay | in http://logs.openstack.org/24/558424/30/check/tripleo-ci-centos-7-containers-multinode/9ab75d0/logs/undercloud/etc/yum/vars/ | 21:48 |
| stevebaker | weshay: also, maybe this would go away if there was a centos 7.5 image tagged as latest in the RDO glance? | 21:50 |
| weshay | stevebaker, let me check if they released a qcow2 image | 21:50 |
| weshay | I don't think they did a few days ago.. that was part of our beef | 21:50 |
| weshay | don't see one here http://cloud.centos.org/centos/7/images/ | 21:52 |
| weshay | re: contentdir https://lists.centos.org/pipermail/centos-devel/2018-March/016542.html | 21:52 |
| *** myoung|ruck is now known as myoung|ruck|afk | 21:53 | |
| *** Goneri has quit IRC | 21:53 | |
| weshay | stevebaker, not sure if we know enough to populate the var atm w/o potentially breaking the ppc work coming up.. wdyt? Seems like stage 1 safest is to disable the repo if detected | 21:54 |
| *** dprince has quit IRC | 21:55 | |
| weshay | bbl have to roll | 21:55 |
| stevebaker | weshay: yep ok, I'll give it a go | 21:56 |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Actually print the error during deployment fail https://review.openstack.org/568707 | 21:58 |
| *** rcernin has joined #tripleo | 22:00 | |
| *** oneswig has quit IRC | 22:04 | |
| *** dhill_ has quit IRC | 22:10 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1771435 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1771435 in tripleo "scenario001/002 failing on autoscaling with urllib3.exceptions.SSLError: [SSL: UNKNOWN_PROTOCOL] unknown protocol (_ssl.c:579)" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 22:10 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Disable repo centos-qemu-ev https://review.openstack.org/568701 | 22:10 |
| *** cdearborn has quit IRC | 22:16 | |
| *** pchavva has joined #tripleo | 22:20 | |
| *** wolverineav has quit IRC | 22:20 | |
| *** wolverineav has joined #tripleo | 22:21 | |
| mwhahaha | why do we have to disable the qemu repo in like 12 places | 22:22 |
| * mwhahaha sighs | 22:22 | |
| *** slaweq has quit IRC | 22:23 | |
| *** slaweq has joined #tripleo | 22:23 | |
| *** wolverineav has quit IRC | 22:25 | |
| stevebaker | mwhahaha: ugh, my workaround doesn't work because the task that fails is the one which installs that file | 22:27 |
| mwhahaha | ha | 22:27 |
| stevebaker | mwhahaha: lets just implement the proper contentdir logic https://review.openstack.org/#/c/568239/2/docker/base/Dockerfile.j2 | 22:28 |
| *** rpioso is now known as rpioso|afk | 22:28 | |
| * mwhahaha would like to wash his hands of yum repos | 22:29 | |
| mwhahaha | and containers, and yaml and a lot of things really | 22:29 |
| mwhahaha | stevebaker: aren't we getting that via infra? isn't there some DIB thing we need to update | 22:30 |
| *** pchavva has quit IRC | 22:30 | |
| sai_ | dsneddon: hey i retrried and see this https://gist.githubusercontent.com/smalleni/98047cd80bc2373be244120f46e3c2a7/raw/765c134e9ac3c50ba44aa7f3fd3a004d68b31cf5/gistfile1.txt | 22:32 |
| sai_ | same error right? | 22:32 |
| sai_ | i can login to node and ping..hmm | 22:33 |
| stevebaker | mwhahaha: hmm, I thought these jobs were starting with a vanilla centos-7 image. The image is whatever is labelled 'latest' in rdocloud | 22:33 |
| mwhahaha | stevebaker: which jobs? multinode come from upstream infra and we've always inherited some repo cruft | 22:34 |
| *** pchavva has joined #tripleo | 22:34 | |
| stevebaker | mwhahaha: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master | 22:34 |
| mwhahaha | stevebaker: ah so yes that's rdo cloud | 22:34 |
| mwhahaha | but i think the images are the same | 22:34 |
| stevebaker | mwhahaha: specifically, me running a reproducer-quickstart.sh from ^^ | 22:35 |
| mwhahaha | yes so that's likely not to be the same | 22:35 |
| dsneddon | sai_, OK, great, now you can run "sudo os-net-config --debug -c /etc/os-net-config/config.json" and then see if you can ping 192.168.0.1 | 22:35 |
| dsneddon | sai_, That way we can narrow it down to whether the underlay network is not working, or whether the NICs just took a while to come up, or something else. | 22:35 |
| sai_ | dsneddon: i logged in thru the control plaane ip and ran it so lost access :-) | 22:36 |
| mwhahaha | stevebaker: but any of those centos mirrors should be disabled via https://github.com/openstack/tripleo-quickstart/blob/master/roles/repo-setup/templates/repo_setup.sh.j2#L98 | 22:36 |
| mwhahaha | stevebaker: we overlay our own urls from the job config | 22:36 |
| stevebaker | mwhahaha: its too late by then. The task which installs the broken repo file is the task which fails | 22:36 |
| dsneddon | sai_, I see two issues, one is that I see routes to 192.168.0.1, but I don't see any interfaces configured with 192.168.0.X addresses. | 22:37 |
| *** bfournie has quit IRC | 22:37 | |
| mwhahaha | stevebaker: it's only the reproducer right? | 22:37 |
| dsneddon | sai_, The other problem I see is that I think I see two different default routes with 192.168.0.1 as the next hop, on different interfaces. | 22:37 |
| stevebaker | mwhahaha: maybe its only in the reproducer, or RDO CI is failing earlier for other reasons so hasn't hit this yet | 22:39 |
| *** pmannidi has joined #tripleo | 22:40 | |
| dsneddon | sai_, Actually, there is only one default route, the network_config is just repeated twice. | 22:41 |
| sai_ | dsneddon: yeh my control plane dhcp is 192.168.0.0/16 | 22:41 |
| sai_ | and UC ip is 192.168.0.1 | 22:41 |
| dsneddon | sai_, But I still don't see how 192.168.10.15 is supposed to get to 192.168.0.1. Did you have an incorrect entry for ControlPlaneDefaultRoute? Is that supposed to be 192.168.10.1? | 22:42 |
| dsneddon | sai_, Same problem with EC2MetadataIp | 22:42 |
| sai_ | dsneddon: /16 right, im using 192.168.0.0/16 for control plane range | 22:43 |
| * sai_ is worried if he missed something obvious | 22:43 | |
| openstackgerrit | Emilien Macchi proposed openstack/ansible-role-container-registry master: Handle Docker rpm updates https://review.openstack.org/568714 | 22:44 |
| stevebaker | EmilienM: has that role been RPM packaged? ^^ | 22:45 |
| openstackgerrit | Emilien Macchi proposed openstack/ansible-role-container-registry master: Handle Docker rpm updates https://review.openstack.org/568714 | 22:45 |
| dsneddon | sai_, Nope, you need to set ControlPlaneSubnetCidr: '16' for that to work. Your control plane IP is getting configured as a /24 | 22:45 |
| EmilienM | stevebaker: yep | 22:46 |
| sai_ | dsneddon: crap!!!! i changed the dhcp range in undercloud.conf and expected that to take of stuff | 22:46 |
| EmilienM | stevebaker: you can deploy it with "yum install ansible-role-container-registry" | 22:46 |
| stevebaker | EmilienM: sweet. It installs to /etc/ansible/roles? | 22:47 |
| sai_ | dsneddon: thanks a ton! maybe that was it | 22:47 |
| EmilienM | stevebaker: /usr/share/ansible/roles | 22:47 |
| stevebaker | ok | 22:47 |
| EmilienM | stevebaker: https://github.com/openstack/ansible-role-container-registry/blob/master/setup.cfg#L22 | 22:47 |
| EmilienM | stevebaker: I had to create a BZ to import in RDO etc | 22:48 |
| EmilienM | stevebaker: they have a process that works pretty well | 22:48 |
| EmilienM | but before you need the repo in openstack, one sec | 22:48 |
| *** tiswanso_ has joined #tripleo | 22:49 | |
| EmilienM | stevebaker: https://review.openstack.org/#/q/ansible-role-container-registry and https://review.rdoproject.org/r/#/q/ansible-role-container-registry should help you | 22:49 |
| stevebaker | EmilienM: thanks | 22:49 |
| EmilienM | cool np | 22:49 |
| EmilienM | stevebaker: now I have a question for you :D | 22:50 |
| EmilienM | stevebaker: see https://review.openstack.org/#/c/561377/78/puppet/services/docker.yaml | 22:50 |
| EmilienM | I want to update update_tasks to use the exact same tasks from deploy_steps_tasks | 22:50 |
| EmilienM | I wanted to use get_attr, does it make sense? | 22:50 |
| sai_ | dsneddon: aha, makes since why ping works after failed deploy on logging in manually | 22:51 |
| *** tiswanso has quit IRC | 22:51 | |
| stevebaker | EmilienM: in the same file? | 22:51 |
| sai_ | dsneddon: because of dhcp range on undercloud | 22:51 |
| EmilienM | stevebaker: yes | 22:51 |
| stevebaker | EmilienM: that sounds like you want to use that yaml reference/anchor thing | 22:52 |
| EmilienM | uh what is that | 22:52 |
| EmilienM | otherwise I could have had a docker-base | 22:53 |
| EmilienM | but it's really overkill | 22:53 |
| EmilienM | stevebaker: any example? | 22:53 |
| stevebaker | EmilienM: Look for & and * in docker/services/glance-api.yaml | 22:55 |
| EmilienM | ohhh that | 22:55 |
| EmilienM | now I remember, ok thanks | 22:55 |
| EmilienM | is it documented somewhere? | 22:55 |
| EmilienM | but yeah, & is to set and * is to get | 22:56 |
| EmilienM | iiuc | 22:56 |
| *** pchavva has quit IRC | 22:56 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: docker: cleanup update tasks https://review.openstack.org/568715 | 22:58 |
| *** colonwq has quit IRC | 23:01 | |
| *** saneax-_-|AFK is now known as saneax | 23:01 | |
| EmilienM | bnemec: where is designate actually tested? http://logs.openstack.org/07/555007/7/gate/tripleo-ci-centos-7-scenario003-multinode-oooq-container/e04283a/logs/tempest.html.gz | 23:01 |
| EmilienM | bnemec: you'll need to patch the featureset and add at least one designate test | 23:02 |
| *** SamYaple has quit IRC | 23:02 | |
| *** wolverineav has joined #tripleo | 23:06 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1771435 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1771435 in tripleo "scenario001/002 failing on autoscaling with urllib3.exceptions.SSLError: [SSL: UNKNOWN_PROTOCOL] unknown protocol (_ssl.c:579)" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 23:10 |
| *** mcornea has quit IRC | 23:10 | |
| *** colonwq has joined #tripleo | 23:13 | |
| *** dxiri_ has joined #tripleo | 23:17 | |
| *** dxiri has quit IRC | 23:21 | |
| sai_ | dsneddon: setting the controlplanecidr to 16 fixed it, thanks! | 23:22 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Populate /etc/yum/vars/contentdir https://review.openstack.org/568701 | 23:23 |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: overcloud plan deployment failures https://review.openstack.org/568673 | 23:23 |
| *** wolverineav has quit IRC | 23:25 | |
| *** wolverineav has joined #tripleo | 23:25 | |
| *** tosky has quit IRC | 23:26 | |
| EmilienM | stevebaker: can you please review https://review.openstack.org/#/c/567384/ ? | 23:28 |
| *** ssbarnea_ has joined #tripleo | 23:28 | |
| stevebaker | EmilienM: I can! | 23:29 |
| openstackgerrit | Merged openstack/tripleo-common master: Implement image customization during upload https://review.openstack.org/566207 | 23:29 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Cleanup dead code, build_service_filter mocking https://review.openstack.org/567413 | 23:29 |
| openstackgerrit | Merged openstack/tripleo-common master: Persist package update ansible logs https://review.openstack.org/566018 | 23:29 |
| *** wolverineav has quit IRC | 23:30 | |
| *** dxiri_ has quit IRC | 23:31 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-common master: Add recover_deployment workflow https://review.openstack.org/566699 | 23:31 |
| *** dxiri has joined #tripleo | 23:32 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-common master: Add recover_deployment workflow https://review.openstack.org/566699 | 23:33 |
| *** rh-jelabarre has quit IRC | 23:33 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Populate /etc/yum/vars/contentdir https://review.openstack.org/568701 | 23:36 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Prepare call, add --modify-role and --modify-vars https://review.openstack.org/566209 | 23:37 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/queens: Call L3 checks before/after Role upgrade. https://review.openstack.org/568606 | 23:37 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/newton: [Newton Only] Fix getting live value of nova/neutron during update. https://review.openstack.org/568552 | 23:37 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Populate /etc/yum/vars/contentdir https://review.openstack.org/568701 | 23:38 |
| *** liverpooler has quit IRC | 23:39 | |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: undercloud upgrade: include UndercloudUpgrade service https://review.openstack.org/568716 | 23:40 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Populate /etc/yum/vars/contentdir https://review.openstack.org/568701 | 23:43 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing integration of releases script in toci https://review.openstack.org/568717 | 23:44 |
| openstackgerrit | Merged openstack/instack-undercloud master: Remove ironic_host_manager usage https://review.openstack.org/565824 | 23:46 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Populate /etc/yum/vars/contentdir https://review.openstack.org/568701 | 23:50 |
| *** elgxl has joined #tripleo | 23:52 | |
| *** elgxl has quit IRC | 23:57 | |
| *** bfournie has joined #tripleo | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!