| *** artom has quit IRC | 00:02 | |
| *** funzo has joined #tripleo | 00:07 | |
| *** funzo has quit IRC | 00:07 | |
| *** funzo has joined #tripleo | 00:07 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Fix the DLRN API URL for non-master branches https://review.openstack.org/497184 | 00:10 |
|---|---|---|
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712621 | 00:10 |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge) | 00:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 00:10 |
| *** ecerquei__ has joined #tripleo | 00:10 | |
| *** funzo has quit IRC | 00:11 | |
| *** rlandy is now known as rlandy|bbl | 00:12 | |
| *** dsneddon_away is now known as dsneddon | 00:13 | |
| *** ecerquei_ has quit IRC | 00:13 | |
| *** abishop has quit IRC | 00:16 | |
| *** abishop has joined #tripleo | 00:17 | |
| *** ffiore has quit IRC | 00:18 | |
| *** tzumainn has quit IRC | 00:40 | |
| *** limao has joined #tripleo | 00:45 | |
| *** achadha has joined #tripleo | 00:49 | |
| *** tzumainn has joined #tripleo | 00:50 | |
| *** achadha__ has quit IRC | 00:52 | |
| *** achadha has quit IRC | 00:53 | |
| *** itlinux has joined #tripleo | 00:57 | |
| *** dixiaoli has joined #tripleo | 00:57 | |
| *** itlinux has quit IRC | 01:02 | |
| *** fzdarsky_ has joined #tripleo | 01:03 | |
| *** itlinux has joined #tripleo | 01:03 | |
| *** achadha has joined #tripleo | 01:06 | |
| *** fzdarsky has quit IRC | 01:06 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 01:10 |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712621 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge) | 01:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 01:10 |
| pabelanger | stevebaker: weshay: I just rechecked 496950 now that container-scenario is running against tripleo-quickstart-extras | 01:15 |
| stevebaker | pabelanger: oh thanks, I'll check when it finishes | 01:16 |
| pabelanger | stevebaker: ya, am curious what will happen | 01:17 |
| *** yamahata has quit IRC | 01:21 | |
| *** hamzy has joined #tripleo | 01:23 | |
| *** achadha_ has joined #tripleo | 01:26 | |
| *** achadha has quit IRC | 01:29 | |
| *** achadha_ has quit IRC | 01:30 | |
| *** rlandy|bbl is now known as rlandy | 01:31 | |
| *** achadha has joined #tripleo | 01:31 | |
| *** achadha has quit IRC | 01:35 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: WIP container ovs-agent, ensure br-ex exists https://review.openstack.org/493695 | 01:44 |
| *** achadha has joined #tripleo | 01:58 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Revert "Enable opstools-testing repo" https://review.openstack.org/497102 | 01:59 |
| *** achadha has quit IRC | 01:59 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: Fix panko port to match tht https://review.openstack.org/496694 | 02:00 |
| *** achadha has joined #tripleo | 02:00 | |
| *** achadha has quit IRC | 02:03 | |
| *** achadha_ has joined #tripleo | 02:03 | |
| *** ecerquei__ has quit IRC | 02:04 | |
| *** achadha_ has quit IRC | 02:04 | |
| *** achadha has joined #tripleo | 02:05 | |
| *** links has joined #tripleo | 02:06 | |
| *** links has quit IRC | 02:06 | |
| *** funzo has joined #tripleo | 02:07 | |
| *** achadha has quit IRC | 02:10 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712621 | 02:10 |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge) | 02:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 02:10 |
| *** funzo has quit IRC | 02:12 | |
| *** dmacpher has joined #tripleo | 02:19 | |
| *** sdake has quit IRC | 02:22 | |
| *** achadha has joined #tripleo | 02:23 | |
| *** vkmc has quit IRC | 02:24 | |
| *** achadha has quit IRC | 02:27 | |
| *** sdake has joined #tripleo | 02:29 | |
| *** sdake is now known as Guest20192 | 02:29 | |
| *** vkmc has joined #tripleo | 02:29 | |
| *** achadha has joined #tripleo | 02:43 | |
| *** achadha has quit IRC | 02:43 | |
| *** achadha has joined #tripleo | 02:44 | |
| *** fpan has joined #tripleo | 02:48 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Updated from global requirements https://review.openstack.org/494800 | 02:59 |
| *** ykarel has joined #tripleo | 02:59 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 03:10 |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712621 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge) | 03:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 03:10 |
| *** achadha has quit IRC | 03:11 | |
| *** achadha has joined #tripleo | 03:11 | |
| *** ykarel has quit IRC | 03:12 | |
| *** achadha has quit IRC | 03:15 | |
| *** limao has quit IRC | 03:21 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: container ovs-agent, ensure br-ex exists https://review.openstack.org/493695 | 03:23 |
| *** psahoo has joined #tripleo | 03:25 | |
| *** garyk has quit IRC | 03:25 | |
| openstackgerrit | Steve Baker proposed openstack-infra/tripleo-ci master: Don't use docker-network.yaml env https://review.openstack.org/497720 | 03:27 |
| *** garyk has joined #tripleo | 03:28 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart master: Don't use docker-network.yaml env https://review.openstack.org/497722 | 03:29 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Don't use docker-network.yaml env https://review.openstack.org/497723 | 03:32 |
| *** mdnadeem has joined #tripleo | 03:51 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Filter image list by deployed services https://review.openstack.org/496950 | 04:02 |
| *** tzumainn has quit IRC | 04:04 | |
| *** funzo has joined #tripleo | 04:05 | |
| *** funzo has quit IRC | 04:10 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 04:10 |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712621 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge) | 04:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 04:10 |
| *** limao has joined #tripleo | 04:22 | |
| *** limao has quit IRC | 04:27 | |
| *** dsariel has joined #tripleo | 04:33 | |
| *** dsariel has quit IRC | 04:38 | |
| *** mdnadeem has quit IRC | 04:44 | |
| *** dsariel has joined #tripleo | 04:50 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo stable/pike: Add /bin to PATH for CRL cronjob https://review.openstack.org/497730 | 04:56 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo stable/pike: Fix panko port to match tht https://review.openstack.org/497731 | 04:57 |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 05:10 |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712621 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge) | 05:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 05:10 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Add missing CentOS repos to promote releases https://review.openstack.org/497545 | 05:10 |
| *** links has joined #tripleo | 05:12 | |
| *** gbarros has quit IRC | 05:12 | |
| *** psahoo has quit IRC | 05:14 | |
| openstackgerrit | Michael Chapman proposed openstack/tripleo-quickstart-extras master: Add opendaylight to collect-logs https://review.openstack.org/494043 | 05:14 |
| *** udesale has joined #tripleo | 05:16 | |
| *** psahoo has joined #tripleo | 05:17 | |
| *** yprokule has joined #tripleo | 05:19 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo stable/ocata: Use resource collector for the fencing -> stonith ordering https://review.openstack.org/497732 | 05:25 |
| *** jfrancoa has joined #tripleo | 05:27 | |
| *** limao has joined #tripleo | 05:29 | |
| *** jbadiapa has joined #tripleo | 05:31 | |
| *** trozet has quit IRC | 05:34 | |
| *** mdnadeem has joined #tripleo | 05:39 | |
| *** jprovazn has joined #tripleo | 05:48 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use latest Fedora .qcow URL https://review.openstack.org/497734 | 05:48 |
| *** udesale has quit IRC | 05:50 | |
| *** dsariel has quit IRC | 05:50 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Fix cylical systemd config for dhcp-all-interfaces https://review.openstack.org/490962 | 05:51 |
| jaosorior | bandini: when you get some time could you check these out https://review.openstack.org/#/c/496501/ https://review.openstack.org/#/c/496572/ https://review.openstack.org/#/c/496564/ | 05:51 |
| Tengu | hello ! | 05:56 |
| Tengu | my ocata -> pike upgrade has failed yesterday in the end... | 05:56 |
| matbu | Tengu: impossible ! :) | 05:59 |
| matbu | Tengu: what happen ? | 05:59 |
| *** iranzo has joined #tripleo | 06:00 | |
| Tengu | apparently a 500 error :( | 06:03 |
| Tengu | I've filled a bug: https://bugs.launchpad.net/tripleo/+bug/1712974 in case someone has some ideas | 06:04 |
| openstack | Launchpad bug 1712974 in tripleo "Ocata -> Pike: overcloud upgrade fails due to keystone/fernet" [Undecided,New] | 06:04 |
| *** dsariel has joined #tripleo | 06:05 | |
| matbu | Tengu: ack thx | 06:08 |
| matbu | we will take a look | 06:09 |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 06:10 |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712621 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge) | 06:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 06:10 |
| bandini | jaosorior: morning, on it | 06:10 |
| lvdombrkr | morning guys | 06:11 |
| Tengu | matbu: thanks! As said, I'm not sure the keystone/fernet is the main reason for that error :/. I'm trying to tackle it down, and finding some logs. | 06:12 |
| jaosorior | morning folks! | 06:12 |
| Tengu | jaosorior: heya! | 06:13 |
| jaosorior | Tengu: hey | 06:13 |
| *** rcernin has joined #tripleo | 06:14 | |
| Tengu | matbu: might be a race condition between keystone being not in a good state (like, mariadb restart or else) and the fact the openstack overcloud deploy wants to show the keystone endpoint. Might be more something lke that. | 06:14 |
| lvdombrkr | i have question about HA, in my test lab i deploy undercloud + overcloud (controller_+ compute in one node) now i want add second node in onderclound. so if i will deploy second controller is than any options to configure HA between both controllers? | 06:15 |
| jaosorior | Tengu: I don't think fernet is the issue there. It will still work | 06:15 |
| Tengu | updating the issue and title, 2s | 06:16 |
| *** rlandy has quit IRC | 06:16 | |
| jaosorior | bandini: oooh, and this one https://review.openstack.org/#/c/497602/ :D | 06:18 |
| bandini | jaosorior: ouch, stunnel ;) | 06:19 |
| *** aufi has joined #tripleo | 06:21 | |
| *** dparkes has joined #tripleo | 06:24 | |
| *** psachin has joined #tripleo | 06:27 | |
| *** dsariel has quit IRC | 06:28 | |
| tonyb | Is there anything special about the name 'OS::TripleO::Services::NovaCompute' ?? I want to create Roles for containerized and baremetal compute so could I setup a roll to use 'OS::TripleO::BM-Services::*' with matching resource-registries? | 06:31 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-common master: Add clustercheck healthcheck https://review.openstack.org/497468 | 06:31 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Use TLS proxy for Redis' internal TLS https://review.openstack.org/496616 | 06:33 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add manifests to install and configure stunnel https://review.openstack.org/497240 | 06:33 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Use TLS proxy for Redis' internal TLS https://review.openstack.org/496616 | 06:33 |
| *** florianf has joined #tripleo | 06:33 | |
| jaosorior | bandini: yeah :/ mod_proxy is no good for redis | 06:35 |
| *** hjensas has quit IRC | 06:36 | |
| *** pcaruana has joined #tripleo | 06:40 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Use TLS proxy for Redis' internal TLS https://review.openstack.org/496616 | 06:43 |
| openstackgerrit | afazekas proposed openstack/python-tripleoclient stable/pike: Add --set argument to prepare command https://review.openstack.org/497745 | 06:43 |
| *** achadha has joined #tripleo | 06:44 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Use TLS proxy for Redis' internal TLS https://review.openstack.org/496616 | 06:49 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add manifests to install and configure stunnel https://review.openstack.org/497240 | 06:49 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-common master: Add clustercheck healthcheck https://review.openstack.org/497468 | 06:53 |
| Tengu | hmm. weird. many files were apparently removed from the openstack-tripleo-heat-templates, and as we still link them from our custom environment file, it should fail when we apply the update - but it doesn't fail at all..... | 06:53 |
| *** tesseract has joined #tripleo | 06:53 | |
| *** jlinkes has joined #tripleo | 06:54 | |
| *** bogdando has joined #tripleo | 06:58 | |
| jaosorior | bandini: could we merge this backport https://review.openstack.org/#/c/497730/ ? | 07:01 |
| bandini | jaosorior: sure | 07:01 |
| bandini | jaosorior: just +A it once CI is done? | 07:02 |
| *** ffiore has joined #tripleo | 07:02 | |
| jaosorior | uok | 07:03 |
| openstackgerrit | afazekas proposed openstack/python-tripleoclient stable/pike: Add --set argument to prepare command https://review.openstack.org/497745 | 07:04 |
| *** ebarrera has joined #tripleo | 07:07 | |
| *** psachin has quit IRC | 07:07 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712621 | 07:10 |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1712621 in tripleo "ovb overcloud image build broken due to rubygem-fluent-plugin-secure-forward" [Critical,Triaged] - Assigned to Matthias Runge (mrunge) | 07:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 07:10 |
| *** jpena|off is now known as jpena | 07:13 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy OpenShift using OOO on the overcloud https://review.openstack.org/494470 | 07:14 |
| *** jtomasek has joined #tripleo | 07:15 | |
| *** jpich has joined #tripleo | 07:16 | |
| *** suuuper has joined #tripleo | 07:17 | |
| *** cschwede_ has joined #tripleo | 07:17 | |
| *** bogdando has quit IRC | 07:17 | |
| *** psahoo has quit IRC | 07:20 | |
| jpich | jtomasek: Looks like we branched earlier than expected, need to remember to do backports now | 07:21 |
| *** bogdando has joined #tripleo | 07:22 | |
| jtomasek | jpich: I see, I forgot to git fetch all yesterday... | 07:23 |
| jtomasek | jpich: good to know, thanks:) | 07:23 |
| jpich | jtomasek: No problems. I wish that email thread you found had been updated in advance :) | 07:24 |
| *** ffiore has quit IRC | 07:27 | |
| *** psachin has joined #tripleo | 07:30 | |
| *** psachin has joined #tripleo | 07:30 | |
| *** psahoo has joined #tripleo | 07:33 | |
| *** egonzalez has joined #tripleo | 07:35 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates master: Enhance completion message when upgrading non controller nodes https://review.openstack.org/482868 | 07:39 |
| openstackgerrit | Merged openstack/diskimage-builder master: Fix cylical systemd config for dhcp-all-interfaces https://review.openstack.org/490962 | 07:43 |
| openstackgerrit | Bogdan Dobrelya proposed openstack-infra/tripleo-ci master: Rework the getthelogs helper script for wget recursive https://review.openstack.org/492178 | 07:44 |
| *** ffiore has joined #tripleo | 07:45 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Use TLS proxy for Redis' internal TLS https://review.openstack.org/496616 | 07:45 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add manifests to install and configure stunnel https://review.openstack.org/497240 | 07:45 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: TLS proxy for redis https://review.openstack.org/496520 | 07:46 |
| *** psachin has quit IRC | 07:46 | |
| jaosorior | mandre: made some changes to enable stunnel to run in the foreground, and added the stunnel command for the tls proxy container ^^ | 07:46 |
| *** psachin has joined #tripleo | 07:48 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use latest Fedora .qcow URL https://review.openstack.org/497734 | 07:49 |
| *** egonzalez has quit IRC | 07:50 | |
| *** egonzalez has joined #tripleo | 07:50 | |
| lvdombrkr | guys how can i add external network to my overcloud? | 07:52 |
| mandre | jaosorior: ack, I was wondering why I didn't have a stunnel.conf file :) | 07:54 |
| jaosorior | mandre: haha right, that too, needed to add the ::tripleo::stunnel resource | 07:57 |
| jaosorior | mandre: redeploying now | 08:02 |
| jaosorior | lets see how it goes :O | 08:02 |
| *** dtantsur|afk is now known as dtantsur | 08:04 | |
| *** funzo has joined #tripleo | 08:07 | |
| daidv | Hi everyone, I have tried to run TripleO quickstart. Everything look good except proxy problem after undercloud VM start. | 08:09 |
| daidv | Did we have some points to configure our proxy ENV before deployment? | 08:09 |
| jaosorior | adarazs: ^^ | 08:10 |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 08:10 |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 08:10 |
| *** funzo has quit IRC | 08:11 | |
| *** mcornea has joined #tripleo | 08:14 | |
| *** achadha has quit IRC | 08:15 | |
| *** derekh has joined #tripleo | 08:16 | |
| *** lucas-afk is now known as lucasagomes | 08:24 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP DNR Set meta container-attribute-target=host attribute https://review.openstack.org/497766 | 08:24 |
| *** achadha has joined #tripleo | 08:26 | |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: WIP fix missing data on 100-openstack-sources.conf https://review.openstack.org/497768 | 08:28 |
| *** dsariel has joined #tripleo | 08:34 | |
| *** dsariel has quit IRC | 08:38 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: TLS proxy for redis https://review.openstack.org/496520 | 08:42 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Use TLS proxy for Redis' internal TLS https://review.openstack.org/496616 | 08:46 |
| *** achadha has quit IRC | 08:48 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Use TLS proxy for Redis' internal TLS https://review.openstack.org/496616 | 08:49 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add manifests to install and configure stunnel https://review.openstack.org/497240 | 08:49 |
| *** dtantsur is now known as dtantsur|sick | 08:50 | |
| adarazs | daidv: we don't have anything in place for a system wide proxy configuration I'm afraid. | 08:53 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Containarise Barbican API https://review.openstack.org/481451 | 08:54 |
| jaosorior | mandre: how's it looking over there? | 08:55 |
| mandre | jaosorior: the redis tls proxy is restarting | 08:58 |
| *** apetrich has quit IRC | 08:58 | |
| mandre | jaosorior: http://paste.openstack.org/show/619404/ | 08:59 |
| jaosorior | mandre: is that good? :P | 08:59 |
| jaosorior | mandre: oh, so it didn't find /etc/stunnel/stunnel.conf | 09:00 |
| jaosorior | wait | 09:00 |
| jaosorior | it did find it | 09:00 |
| jaosorior | mandre: maybe it's not bind mounted to the container? | 09:00 |
| mandre | jaosorior: the cert line of the config file is empty | 09:00 |
| mandre | not sure if that's expected | 09:00 |
| jaosorior | whaa | 09:00 |
| jaosorior | that's not right | 09:00 |
| jaosorior | what happened to the cert and key :/... | 09:01 |
| mandre | jaosorior: I don't have redis_certificate_specs in my hieradata :/ | 09:02 |
| jaosorior | mandre: shit, I know why | 09:02 |
| jaosorior | mandre: exactly | 09:02 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: TLS proxy for redis https://review.openstack.org/496520 | 09:05 |
| jaosorior | mandre: ^^ | 09:05 |
| mandre | jaosorior: same player shoot again | 09:06 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 09:10 |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 09:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged] | 09:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 09:10 |
| rcernin | mandre: you got a minute on ooo-validations? | 09:15 |
| rcernin | mandre: ansible-playbook -vvvv -i /usr/bin/tripleo-ansible-inventory validations/network-environment.yaml --extra-vars "network_environment_path=network-environment.yaml" got any good example for this one? | 09:16 |
| daidv | adarazs, thanks. :( | 09:19 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use latest Fedora .qcow URL https://review.openstack.org/497734 | 09:19 |
| openstackgerrit | Merged openstack/tripleo-puppet-elements master: Add stunnel https://review.openstack.org/497602 | 09:19 |
| adarazs | daidv: I can't promise we can add it too fast. option one is to open a bug against tripleo, adding the "quickstart" tag explaining what you need (proxy support for undercloud) https://bugs.launchpad.net/tripleo/+filebug | 09:20 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-puppet-elements stable/pike: Add stunnel https://review.openstack.org/497788 | 09:20 |
| adarazs | daidv: or if you can make a fix, please do and I can review it: https://docs.openstack.org/developer/tripleo-quickstart/contributing.html#code | 09:21 |
| *** jistr is now known as jistr|trng | 09:21 | |
| adarazs | daidv: option number three is to break your deployment into 2 parts: 1 for deploying the VMs, then you log in and fix the undercloud for the proxy, and then continue deployment. | 09:24 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-common master: Fix port health check false negatives https://review.openstack.org/497792 | 09:24 |
| daidv | adarazs, I have tried the last one | 09:25 |
| daidv | but I saw that my undercloud VM is destroyed and re-created IIUC. | 09:25 |
| jaosorior | mandre: fuck, it's still missing :/ | 09:25 |
| adarazs | daidv: when you rerun quickstart.sh it does that. the default is to tear down existing stuff because quickstart is supposed to be a one-shot solution. you can prevent that to happen: https://docs.openstack.org/developer/tripleo-quickstart/configuration.html#explicit-teardown | 09:26 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy OpenShift using OOO on the overcloud https://review.openstack.org/494470 | 09:27 |
| adarazs | daidv: you will also need to add "--retain-inventory" | 09:27 |
| daidv | adarazs, nice, thank you very much. Let me try it again. | 09:27 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: TLS proxy for redis https://review.openstack.org/496520 | 09:27 |
| adarazs | but you could just use the shell scripts that quickstart creates if it's a one-off installation that you don't try to automate. | 09:28 |
| adarazs | daidv: can you paste me the quickstart.sh line that you used to deploy the first time? | 09:28 |
| jaosorior | mandre: oh right, the fqdn for the cert was wrong so the CA rejected it. Fixed it above ^^ | 09:29 |
| daidv | adarazs, bash quickstart.sh 127.0.0.2 | 09:30 |
| adarazs | daidv: and to be sure: the problem is that the undercloud can't access stuff without the proxy, right? | 09:30 |
| *** ipsecguy has quit IRC | 09:31 | |
| *** ipsecguy has joined #tripleo | 09:32 | |
| adarazs | daidv: so yeah, that only prepares the env, won't do a full installation. login to the undercloud, fix the proxy config and execute the shell scripts that quickstart creates. they should work, I think. | 09:32 |
| daidv | adarazs, yep. it is the first problem that I saw. After I connect to undercloud (after I faced the problem) | 09:32 |
| daidv | I have added proxy ENV stuffs and it can install openstack packages. | 09:33 |
| *** ipsecguy has quit IRC | 09:33 | |
| daidv | adarazs, Ok, let me try. | 09:33 |
| *** ipsecguy has joined #tripleo | 09:33 | |
| *** ipsecguy has quit IRC | 09:33 | |
| *** ipsecguy has joined #tripleo | 09:34 | |
| mandre | jaosorior: ack, retrying... we're getting closer each time :) | 09:34 |
| mandre | what's up rcernin? | 09:34 |
| *** ipsecguy has quit IRC | 09:34 | |
| *** ipsecguy has joined #tripleo | 09:35 | |
| *** ffiore has quit IRC | 09:35 | |
| mandre | rcernin: jeez, I haven't tried the network-environment validation in ages... isn't it working as expected? | 09:37 |
| rcernin | mandre: actually not sure how it is expected to work. since never saw it working. | 09:39 |
| rcernin | mandre: thought you will know. or shadower ? | 09:39 |
| mandre | rcernin: these days it's mostly florianf who's taking care of the validations | 09:41 |
| rcernin | good | 09:42 |
| mandre | rcernin: fzdarsky_ may be able to help too since he was the last one to touch this validation | 09:44 |
| mandre | last one to touch means he owns it, right? :P | 09:44 |
| rcernin | if you got a minute guys would you have an example of network-environment.yaml check using tripleo-validations? | 09:44 |
| rcernin | i tried this one the environment should be setup: ansible-playbook -vvvv -i /usr/bin/tripleo-ansible-inventory validations/network-environment.yaml --extra-vars "network_environment_path=network-environment.yaml" | 09:45 |
| *** tosky has joined #tripleo | 09:46 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Use TLS proxy for Redis' internal TLS https://review.openstack.org/496616 | 09:48 |
| jaosorior | mandre: ok, found another issue | 09:49 |
| jaosorior | I think this is it though | 09:49 |
| florianf | rcernin: it's maybe worth noting that the default path for the netenv file is "environment/network-environment.yaml" | 09:49 |
| rcernin | yea I noticed, can you just override it with extra-vars? | 09:50 |
| florianf | rcernin: also, it will not work on local file, but will try to find the file path in the swift container for the current plan | 09:50 |
| florianf | rcernin: sure, you can override it, if the file has a different path in the swift container for your plan. | 09:50 |
| rcernin | interesting, but did you check the environment/network-environment.yaml in swift after the deployment? | 09:51 |
| rcernin | i m no 100% sure, i would need to check it, but i wonder if its the one that you specify in CLI, talking about the netwon. Or whether it contains the default networks 172... | 09:51 |
| rcernin | i m checking that, the swift environment/network-environment.yaml vs the network-environment.yaml after the --update-plan-only. | 09:52 |
| *** ffiore has joined #tripleo | 09:53 | |
| *** gfidente has joined #tripleo | 09:54 | |
| lvdombrkr | hi guys, does selilinux in overcloud should be perrmessive? or i can enable it? | 09:54 |
| *** dixiaoli has quit IRC | 09:57 | |
| *** dixiaoli has joined #tripleo | 09:58 | |
| *** jschlueter|znc is now known as jschlueter | 09:59 | |
| *** dixiaoli has quit IRC | 10:00 | |
| lvdombrkr | hi guys, does selilinux in overcloud should be perrmessive? or i can enable it? | 10:01 |
| rcernin | florianf: http://paste.openstack.org/show/619418/ | 10:01 |
| rcernin | lvdombrkr: i use enforcing and it's fine. | 10:02 |
| *** openstackgerrit has quit IRC | 10:02 | |
| lvdombrkr | rcernin: its a test env or prod? | 10:03 |
| florianf | rcernin: oh right, got it. well, currently the validation only works with templates stored in swift. | 10:03 |
| rcernin | lvdombrkr: mine is test, sure if you are using permissive you are logging right, check the sealert if you have any issues before enabling it. | 10:03 |
| rcernin | florianf: so what are we actually validating, is it just me that see the default overcloud network-environment.yaml ? | 10:04 |
| *** openstackgerrit has joined #tripleo | 10:05 | |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-common master: Run fluentd container https://review.openstack.org/487038 | 10:05 |
| lvdombrkr | rcernin: thanks! | 10:05 |
| rcernin | florianf: in the swift environments, network-environment.yaml | 10:05 |
| florianf | rcernin: so what you'd have to do is to upload your env file to your plan in swift and the re-run the validations | 10:05 |
| lvdombrkr | does anybode else use overcloud with selilinux enforcing? | 10:06 |
| florianf | *validation | 10:06 |
| rcernin | florianf: line #55-#56 | 10:07 |
| *** funzo has joined #tripleo | 10:07 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 10:10 |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 10:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 10:10 |
| rcernin | florianf: maybe pebkac | 10:10 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Use TLS proxy for Redis' internal TLS https://review.openstack.org/496616 | 10:11 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add manifests to install and configure stunnel https://review.openstack.org/497240 | 10:11 |
| *** funzo has quit IRC | 10:12 | |
| *** apetrich has joined #tripleo | 10:12 | |
| *** limao has quit IRC | 10:14 | |
| jaosorior | mandre: woooo!! redis is listening behind a tls proxy and it can respond. Now it seems that what's missing is to fix the haproxy configuration | 10:15 |
| *** ebarrera has quit IRC | 10:15 | |
| *** ebarrera has joined #tripleo | 10:16 | |
| florianf | rcernin: can you paste the result of swift list overcloud somewhere? | 10:17 |
| rcernin | florianf: http://paste.openstack.org/show/619419/ | 10:17 |
| florianf | rcernin: ok, so your customized netenv file wasn't added to the plan when you ran "deploy --update-plan-only". I think for that to work you'd have to add the file to the templates directory | 10:20 |
| florianf | rcernin: before you update the plan | 10:20 |
| rcernin | where? | 10:20 |
| rcernin | /home/stack/templates? | 10:20 |
| *** milan has joined #tripleo | 10:20 | |
| florianf | rcernin: In line 34 you are using /usr/share/openstack-tripleo-heat-templates, so you could add it there. although I'd probably rather make a copy of that folder in your home dir, make your adjustments there and then update the plan | 10:22 |
| rcernin | florianf: got it. its relevant path to the one specified in --templates | 10:24 |
| florianf | rcernin: yes, you'd have to specify the path where you made the customizations | 10:25 |
| derekh | Slower: are you involved in the container health checks? spotted this problem a while back causing some of them to fail https://review.openstack.org/#/c/490832/ | 10:30 |
| rcernin | florianf: btw if --templates by default takes the /usr/share/openstack-tripleo-heat-templates, then https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/10/html-single/upgrading_red_hat_openstack_platform/#sect-Updating_the_Overcloud is broken | 10:32 |
| *** iranzo has quit IRC | 10:32 | |
| *** akrivoka has joined #tripleo | 10:33 | |
| *** rcernin is now known as rcernin|lunch | 10:34 | |
| *** iranzo has joined #tripleo | 10:39 | |
| *** iranzo has quit IRC | 10:39 | |
| *** iranzo has joined #tripleo | 10:39 | |
| florianf | rcernin|lunch: Hm. I guess I should try that myself... | 10:41 |
| *** limao has joined #tripleo | 10:45 | |
| *** apetrich has quit IRC | 10:45 | |
| *** limao_ has joined #tripleo | 10:48 | |
| *** limao has quit IRC | 10:50 | |
| *** garyk has quit IRC | 10:51 | |
| *** limao_ has quit IRC | 10:56 | |
| *** limao has joined #tripleo | 10:57 | |
| *** mdbooth has quit IRC | 10:58 | |
| *** daidv has quit IRC | 11:00 | |
| *** iranzo has quit IRC | 11:01 | |
| openstackgerrit | Ana Krivokapic proposed openstack/instack-undercloud master: Protect against plan migration failing https://review.openstack.org/497834 | 11:05 |
| akrivoka | jpich: ^ | 11:05 |
| jpich | Nice, thanks! | 11:06 |
| jpich | akrivoka: I think we might need to catch another exception as well, Mistral switched to using keystoneauth during the cycle and that caused a different exception type to be raised in some cases * tries to find the reference again * | 11:07 |
| jpich | akrivoka: e.g. here line 312-313 that were removed https://review.openstack.org/#/c/473804/3/tripleoclient/v1/overcloud_deploy.py | 11:08 |
| jpich | It did my head in when it happened mid-cycle, probably safer to catch both still... (not sure if there's been any changes since) | 11:09 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 11:10 |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 11:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged] | 11:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 11:10 |
| openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates master: Add Swift dispersion profile https://review.openstack.org/476255 | 11:12 |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-heat-templates master: Enable ceilometer compute agent https://review.openstack.org/497835 | 11:15 |
| *** abishop has quit IRC | 11:17 | |
| *** limao has quit IRC | 11:17 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Use TLS proxy for Redis' internal TLS https://review.openstack.org/496616 | 11:20 |
| jaosorior | arxcruz: you should probably file a BZ for https://review.openstack.org/497835 if you're planning to put it in stable/pike | 11:20 |
| *** cylopez has joined #tripleo | 11:21 | |
| jfrancoa | Hi folks, does anybody know what is the purpose of disabling heat_api_cfn and hea_api_cloudwatch in this environment file https://github.com/openstack-infra/tripleo-ci/blob/master/test-environments/worker-config.yaml#L5-L6 ? | 11:21 |
| jaosorior | jfrancoa: IIRC it's cause they were not used. | 11:22 |
| jaosorior | jfrancoa: so the purpose was to make the deployment lighter | 11:22 |
| jfrancoa | jaosorior: is it ment so heat_api_cfn and heat_api_cloudwatch are started as httpd services? or to ensure they are not started | 11:22 |
| jfrancoa | jaosorior: I see, so the second option... | 11:23 |
| arxcruz | jaosorior: bz or lp ? | 11:23 |
| jaosorior | arxcruz: lp, sorry | 11:23 |
| arxcruz | :) | 11:23 |
| jaosorior | jfrancoa: to ensure they're not started I think | 11:23 |
| jfrancoa | jaosorior: thanks! | 11:23 |
| jfrancoa | jaosorior++ | 11:23 |
| jaosorior | jfrancoa: not sure if that's working though. Why did you ask? | 11:23 |
| akrivoka | jpich: ah thanks, good catch! let me fix that real quick | 11:27 |
| jfrancoa | jaosorior: it is working when deploying on ocata, at least heat_api_cfn service is disabled. heat_api_cloudwatch is not, because its template sets service_name to 'httpd' (https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/heat-api-cloudwatch.yaml#L96) and so it is started as an apache service. But when upgrading to pike using the same environment file they appear both up, so I was wondering what was the pur | 11:28 |
| jfrancoa | pose then | 11:28 |
| *** pkovar has joined #tripleo | 11:28 | |
| openstackgerrit | Ana Krivokapic proposed openstack/instack-undercloud master: Protect against plan migration failing https://review.openstack.org/497834 | 11:30 |
| *** pkovar has quit IRC | 11:30 | |
| akrivoka | jpich: ^ | 11:30 |
| *** dsavineau has quit IRC | 11:41 | |
| *** dmanchad has quit IRC | 11:41 | |
| *** andreaf has quit IRC | 11:41 | |
| *** lucasagomes has quit IRC | 11:41 | |
| *** markmc has quit IRC | 11:41 | |
| *** arxcruz has quit IRC | 11:41 | |
| *** zoli has quit IRC | 11:41 | |
| *** amoralej has quit IRC | 11:41 | |
| *** mmedvede has quit IRC | 11:41 | |
| *** number80 has quit IRC | 11:41 | |
| *** dansmith has quit IRC | 11:41 | |
| *** eck` has quit IRC | 11:41 | |
| *** pliu has quit IRC | 11:41 | |
| *** EmilienM has quit IRC | 11:41 | |
| *** jrist has quit IRC | 11:41 | |
| *** mjblack has quit IRC | 11:41 | |
| *** timothyb89 has quit IRC | 11:41 | |
| *** zul has quit IRC | 11:41 | |
| *** Lokesh_Jain__ has quit IRC | 11:41 | |
| *** d0ugal has quit IRC | 11:41 | |
| *** patrickeast has quit IRC | 11:41 | |
| *** mgkwill has quit IRC | 11:41 | |
| *** hrybacki has quit IRC | 11:41 | |
| *** v1k0d3n has quit IRC | 11:41 | |
| *** mgagne has quit IRC | 11:41 | |
| *** fungi has quit IRC | 11:41 | |
| *** NobodyCam has quit IRC | 11:41 | |
| *** akrivoka has quit IRC | 11:41 | |
| *** milan has quit IRC | 11:41 | |
| *** psahoo has quit IRC | 11:41 | |
| *** tesseract has quit IRC | 11:41 | |
| *** pcaruana has quit IRC | 11:41 | |
| *** jprovazn has quit IRC | 11:41 | |
| *** yprokule has quit IRC | 11:41 | |
| *** links has quit IRC | 11:41 | |
| *** hamzy has quit IRC | 11:41 | |
| *** athomas has quit IRC | 11:41 | |
| *** social has quit IRC | 11:41 | |
| *** sdoran has quit IRC | 11:41 | |
| *** ChanServ has quit IRC | 11:41 | |
| *** gfidente has quit IRC | 11:41 | |
| *** ffiore has quit IRC | 11:41 | |
| *** derekh has quit IRC | 11:41 | |
| *** bogdando has quit IRC | 11:41 | |
| *** dmacpher has quit IRC | 11:41 | |
| *** pblaho has quit IRC | 11:41 | |
| *** rook has quit IRC | 11:41 | |
| *** jpena has quit IRC | 11:41 | |
| *** panda has quit IRC | 11:41 | |
| *** axisys has quit IRC | 11:41 | |
| *** jaosorior has quit IRC | 11:41 | |
| *** yolanda has quit IRC | 11:41 | |
| *** michapma has quit IRC | 11:41 | |
| *** homeski has quit IRC | 11:41 | |
| *** dhill_ has quit IRC | 11:41 | |
| *** lyarwood has quit IRC | 11:41 | |
| *** zzzeek has quit IRC | 11:41 | |
| *** dobson has quit IRC | 11:41 | |
| *** honza has quit IRC | 11:41 | |
| *** dmsimard has quit IRC | 11:41 | |
| *** pabelanger has quit IRC | 11:41 | |
| *** jlinkes has quit IRC | 11:41 | |
| *** lvdombrkr has quit IRC | 11:41 | |
| *** leifmadsen has quit IRC | 11:41 | |
| *** kambiz has quit IRC | 11:41 | |
| *** StevenK has quit IRC | 11:41 | |
| *** saneax has quit IRC | 11:41 | |
| *** faceman has quit IRC | 11:41 | |
| *** dtantsur|sick has quit IRC | 11:41 | |
| *** assassin has quit IRC | 11:41 | |
| *** dparkes has quit IRC | 11:41 | |
| *** hexo has quit IRC | 11:41 | |
| *** stevebaker has quit IRC | 11:41 | |
| *** toure_biab has quit IRC | 11:41 | |
| *** Slower has quit IRC | 11:41 | |
| *** bswartz has quit IRC | 11:41 | |
| *** flaper87 has quit IRC | 11:41 | |
| *** ansiwen has quit IRC | 11:41 | |
| *** ipsecguy has quit IRC | 11:41 | |
| *** cschwede_ has quit IRC | 11:41 | |
| *** itlinux has quit IRC | 11:41 | |
| *** marrusl has quit IRC | 11:41 | |
| *** dsneddon has quit IRC | 11:41 | |
| *** rbrady-afk has quit IRC | 11:41 | |
| *** afazekas has quit IRC | 11:41 | |
| *** Hazelesque has quit IRC | 11:41 | |
| *** dr_gogeta86 has quit IRC | 11:41 | |
| *** Tyrantelf has quit IRC | 11:41 | |
| *** tosky has quit IRC | 11:41 | |
| *** mcornea has quit IRC | 11:41 | |
| *** ansmith has quit IRC | 11:41 | |
| *** oanson has quit IRC | 11:41 | |
| *** owalsh has quit IRC | 11:41 | |
| *** fabbione has quit IRC | 11:41 | |
| *** bandini has quit IRC | 11:41 | |
| *** fzdarsky_ has quit IRC | 11:41 | |
| *** atoth has quit IRC | 11:41 | |
| *** Vijayendra has quit IRC | 11:41 | |
| *** tvignaud has quit IRC | 11:41 | |
| *** dougbtv has quit IRC | 11:41 | |
| *** lifeless has quit IRC | 11:41 | |
| *** jtomasek has quit IRC | 11:41 | |
| *** aufi has quit IRC | 11:41 | |
| *** rcernin|lunch has quit IRC | 11:41 | |
| *** sshnaidm|off has quit IRC | 11:41 | |
| *** larsks has quit IRC | 11:41 | |
| *** PhilSliderS has quit IRC | 11:41 | |
| *** shadower has quit IRC | 11:41 | |
| *** akrzos has quit IRC | 11:41 | |
| *** vpickard has quit IRC | 11:41 | |
| *** lhinds has quit IRC | 11:41 | |
| *** hewbrocca_afk has quit IRC | 11:41 | |
| *** myoung has quit IRC | 11:41 | |
| *** beagles has quit IRC | 11:41 | |
| *** rnoriega has quit IRC | 11:41 | |
| *** chandankumar has quit IRC | 11:41 | |
| *** percevalbot has quit IRC | 11:41 | |
| *** jidar has quit IRC | 11:41 | |
| *** ianw has quit IRC | 11:41 | |
| *** rasca has quit IRC | 11:41 | |
| *** mandre has quit IRC | 11:41 | |
| *** sai has quit IRC | 11:41 | |
| *** mhenkel has quit IRC | 11:41 | |
| *** therve_ has quit IRC | 11:41 | |
| *** openstackgerrit has quit IRC | 11:41 | |
| *** egonzalez has quit IRC | 11:41 | |
| *** psachin has quit IRC | 11:41 | |
| *** vkmc has quit IRC | 11:41 | |
| *** Guest20192 has quit IRC | 11:41 | |
| *** jkilpatr has quit IRC | 11:41 | |
| *** stee_3 has quit IRC | 11:41 | |
| *** bcafarel has quit IRC | 11:41 | |
| *** fultonj has quit IRC | 11:41 | |
| *** portdirect has quit IRC | 11:41 | |
| *** jwb has quit IRC | 11:41 | |
| *** zaneb has quit IRC | 11:41 | |
| *** alanmeadows has quit IRC | 11:41 | |
| *** suuuper has quit IRC | 11:41 | |
| *** spredzy has quit IRC | 11:41 | |
| *** Tengu has quit IRC | 11:41 | |
| *** tdasilva has quit IRC | 11:41 | |
| *** mwhahaha has quit IRC | 11:41 | |
| *** japestinho has quit IRC | 11:41 | |
| *** tbarron has quit IRC | 11:41 | |
| *** melwitt has quit IRC | 11:41 | |
| *** rajinir has quit IRC | 11:41 | |
| *** Ng has quit IRC | 11:41 | |
| *** ebarrera has quit IRC | 11:41 | |
| *** florianf has quit IRC | 11:41 | |
| *** kbyrne has quit IRC | 11:41 | |
| *** trown|outtypewww has quit IRC | 11:41 | |
| *** leseb has quit IRC | 11:41 | |
| *** dciabrin has quit IRC | 11:41 | |
| *** thrash|g0ne has quit IRC | 11:41 | |
| *** zshi has quit IRC | 11:41 | |
| *** tristanC has quit IRC | 11:41 | |
| *** dalvarez has quit IRC | 11:41 | |
| *** cinerama has quit IRC | 11:41 | |
| *** migi has quit IRC | 11:41 | |
| *** jistr|trng has quit IRC | 11:41 | |
| *** gchamoul has quit IRC | 11:41 | |
| *** weshay has quit IRC | 11:41 | |
| *** jpich has quit IRC | 11:41 | |
| *** mdnadeem has quit IRC | 11:41 | |
| *** fpan has quit IRC | 11:41 | |
| *** paramite has quit IRC | 11:41 | |
| *** numans has quit IRC | 11:41 | |
| *** bkopilov has quit IRC | 11:41 | |
| *** bnemec has quit IRC | 11:41 | |
| *** pradk has quit IRC | 11:41 | |
| *** jschlueter has quit IRC | 11:41 | |
| *** mburned has quit IRC | 11:41 | |
| *** adarazs has quit IRC | 11:41 | |
| *** remix_tj has quit IRC | 11:41 | |
| *** rodrigods has quit IRC | 11:41 | |
| *** mrunge has quit IRC | 11:41 | |
| *** jbadiapa has quit IRC | 11:41 | |
| *** jfrancoa has quit IRC | 11:41 | |
| *** bfournie has quit IRC | 11:41 | |
| *** rbowen has quit IRC | 11:41 | |
| *** colonwq has quit IRC | 11:41 | |
| *** jokke_ has quit IRC | 11:41 | |
| *** rwsu has quit IRC | 11:41 | |
| *** dtrainor has quit IRC | 11:41 | |
| *** radez has quit IRC | 11:41 | |
| *** bugzy has quit IRC | 11:41 | |
| *** SlickNik has quit IRC | 11:41 | |
| *** tonyb has quit IRC | 11:41 | |
| *** matbu has quit IRC | 11:41 | |
| *** openstack has joined #tripleo | 12:57 | |
| florianf | :-) | 12:57 |
| *** jmelvin has joined #tripleo | 12:57 | |
| owalsh | bogdando: ping, would you happen to know if we log stdout/stderr from the nova_api_discover_hosts container from docker/services/nova-api.yaml | 12:58 |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: Fix missing data on 100-openstack-sources.conf https://review.openstack.org/497768 | 12:59 |
| *** openstackstatus has joined #tripleo | 12:59 | |
| *** ChanServ sets mode: +v openstackstatus | 12:59 | |
| bogdando | owalsh: AFAIK, it gets to docker daemon logging facilities and follows to OS host journald | 12:59 |
| *** bfournie has joined #tripleo | 12:59 | |
| owalsh | bogdando: thanks, I'll take a look | 13:00 |
| rcernin | lvdombrkr: to me it seems no link on both cards. | 13:00 |
| bogdando | owalsh: so if docker logs shows something, it should be in the journald | 13:00 |
| bogdando | as well | 13:00 |
| rcernin | lvdombrkr: "No carrier information for interface ethN" | 13:00 |
| *** sbrzozow has quit IRC | 13:01 | |
| *** rbrady-afk is now known as rbrady | 13:08 | |
| *** jlabarre has joined #tripleo | 13:08 | |
| *** dparkes has quit IRC | 13:08 | |
| lvdombrkr | rcernin: myhm, if there no link how it can boot wihout it? | 13:10 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 13:10 |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713045 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 13:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged] | 13:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 13:10 |
| openstack | Launchpad bug 1713045 in tripleo "dlrn_api calls fail to set delorean hash in tripleo promotion jobs" [Critical,Triaged] - Assigned to Attila Darazs (adarazs) | 13:10 |
| *** tzumainn has quit IRC | 13:11 | |
| *** tzumainn has joined #tripleo | 13:11 | |
| *** pchavva has joined #tripleo | 13:11 | |
| adarazs | trown: I merged that config change for removing the hack. can you retrigger those jobs to see if it worked? | 13:12 |
| *** sbrzozow has joined #tripleo | 13:14 | |
| *** apetrich has joined #tripleo | 13:14 | |
| trown | adarazs: I think it is better to just wait for next periodic run... it would trigger in the middle of a manual run and cancel it | 13:14 |
| adarazs | trown: okay | 13:14 |
| trown | adarazs: also the manual runs do not seem to do the same thing as periodic (which is a pretty big problem) | 13:15 |
| trown | we should probably just get rid of manual and try to get the periodic down to 4hr | 13:15 |
| adarazs | trown: okay | 13:16 |
| adarazs | we can probably do that. | 13:16 |
| adarazs | trown: why are you saying "try"? Isn't it just a matter of changing the definition in the config? or we would use too many resources? | 13:16 |
| *** akrivoka has joined #tripleo | 13:17 | |
| trown | adarazs: well it is more that the job wont complete in 4hrs now (I think) ... so it would cancel itself over and over | 13:17 |
| trown | adarazs: we could do 6hr though... give us an extra run per day | 13:18 |
| adarazs | trown: hmm, can't we tell zuul not to cancel the already running jobs? :) | 13:18 |
| * adarazs checks out how this works | 13:18 | |
| trown | adarazs: we could, but we use a tripleo-testing tag to tell the child container jobs what containers to test | 13:18 |
| trown | adarazs: so we actually want to make sure there is only one job running at a time or we could be testing different stuff than we think | 13:19 |
| trown | one set of jobs anyways | 13:19 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Drop step_config as top level docker requirement https://review.openstack.org/442716 | 13:20 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: docker: Add unit tests on service_name https://review.openstack.org/442755 | 13:20 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add docker templates to configure Ironic inspector https://review.openstack.org/457822 | 13:20 |
| adarazs | trown: hmm, right. | 13:20 |
| *** jcoufal has joined #tripleo | 13:21 | |
| adarazs | trown: the obvious hack is to have two set of 8 hour jobs using a separate promotion... but it's quite hacky. | 13:21 |
| trown | adarazs: ya, gl convincing folks to allow 2x 8hr pipelines :P | 13:22 |
| adarazs | "business necessity" :) | 13:22 |
| *** leitan has joined #tripleo | 13:23 | |
| *** leitan has quit IRC | 13:23 | |
| *** leitan has joined #tripleo | 13:23 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add tags to baremetal cron removal tasks https://review.openstack.org/497936 | 13:23 |
| lvdombrkr | guys any ideas about this error on node which i introspect https://pasteboard.co/GHhNmpD.jpg | 13:24 |
| lvdombrkr | ? | 13:24 |
| lvdombrkr | * | 13:24 |
| *** dsariel has joined #tripleo | 13:25 | |
| dprince | matbu: https://review.openstack.org/#/c/497936/ | 13:27 |
| dprince | matbu: and by 'we' I really mean 'me' :) | 13:27 |
| *** artom has joined #tripleo | 13:27 | |
| owalsh | dprince: any idea what's up with this? https://bugzilla.redhat.com/show_bug.cgi?id=1480326#c15 | 13:31 |
| openstack | bugzilla.redhat.com bug 1480326 in openstack-nova "openstack-nova: failed to launch instance on OC: "Host 'overcloud-compute-1.localdomain' is not mapped to any cell", "code": 400, "created": "2017-08-10T13:16:11Z"}" [Unspecified,New] - Assigned to eglynn | 13:31 |
| owalsh | dprince: I'd expect this to break all bootstrap_host containers | 13:31 |
| dprince | owalsh: looking | 13:31 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Add docker service to all roles https://review.openstack.org/497937 | 13:32 |
| owalsh | dprince: FWIW bootstrap_host works if I mount /etc/puppet read/write | 13:32 |
| matbu | dprince: hehe no pb :) thanks for the quick review | 13:33 |
| EmilienM | hello | 13:36 |
| *** dsariel has quit IRC | 13:36 | |
| *** dsariel has joined #tripleo | 13:36 | |
| *** links has quit IRC | 13:37 | |
| *** funzo has joined #tripleo | 13:37 | |
| openstackgerrit | Francois Deppierraz proposed openstack/tripleo-docs master: Typo: removed backslash which ended up in the generated HTML version https://review.openstack.org/497939 | 13:41 |
| owalsh | dprince: ah, paunch runs something else | 13:42 |
| owalsh | dprince: I was using the commands from https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/tips_tricks.html#debugging-container-failures | 13:42 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add yaml validation in docker upgrade_tasks. https://review.openstack.org/497940 | 13:43 |
| *** gbarros has joined #tripleo | 13:43 | |
| dprince | /query bandini | 13:45 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy OpenShift using OOO on the overcloud https://review.openstack.org/494470 | 13:45 |
| openstackgerrit | Lukas Bezdicka proposed openstack/python-tripleoclient master: Add minor-update-init option to get heat stack outputs https://review.openstack.org/495658 | 13:46 |
| *** ffiore has joined #tripleo | 13:47 | |
| *** ebarrera has quit IRC | 13:47 | |
| *** d0ugal has quit IRC | 13:49 | |
| *** ebarrera has joined #tripleo | 13:49 | |
| *** dsariel has quit IRC | 13:50 | |
| *** limao has joined #tripleo | 13:51 | |
| owalsh | dprince: so it works if I run the cmd line that paunch reports but only if I escape the quotes... so I'm guessing it's ok or we wouldn't have any db syncs etc...? | 13:53 |
| lvdombrkr | guys any ideas about this error on node which i introspect https://pasteboard.co/GHhNmpD.jpg | 13:53 |
| dprince | owalsh: sounds plausable. So is this BZ perhaps resolved then? | 13:56 |
| dprince | owalsh: sorry, I've been slow. Lots of pings at once :) | 13:56 |
| *** snecklifter has joined #tripleo | 13:57 | |
| owalsh | dprince: np... well, if discover hosts is running then we have a race condition :-( but we have no logs to confirm, best I can do is add --verbose to get some output | 13:58 |
| *** limao_ has joined #tripleo | 14:02 | |
| *** limao has quit IRC | 14:02 | |
| *** Goneri has joined #tripleo | 14:02 | |
| openstackgerrit | Rajini Karthik proposed openstack/puppet-tripleo master: Support for Dell EMC VNX Manila Driver https://review.openstack.org/490642 | 14:04 |
| EmilienM | jrist: it sounds like https://blueprints.launchpad.net/tripleo/+spec/node-discovery-by-range isn't completed yet, any chance to have it this week you think? | 14:06 |
| jrist | EmilienM: for the UI? it is bumped to queens | 14:06 |
| jrist | afaik | 14:06 |
| EmilienM | jrist: blueprint is targeted for Pike. Should I update it? | 14:07 |
| jrist | probably best to ask Dmitry | 14:07 |
| EmilienM | jrist: same question for https://blueprints.launchpad.net/tripleo/+spec/websocket-logging | 14:07 |
| jrist | who is out today | 14:07 |
| jrist | EmilienM: for the latter, we're mostly just fighting https://review.openstack.org/469608 and need +A on https://review.openstack.org/489134 | 14:08 |
| jrist | EmilienM: otherwise it's ready | 14:08 |
| tbarron | EmilienM: good morning, welcome back, etc. When you get a minute, pls. ping me regarding https://bugs.launchpad.net/tripleo/+bug/1712842 | 14:10 |
| openstack | Launchpad bug 1712842 in tripleo "manila: need to override default setting for 'host'" [Undecided,In progress] - Assigned to Tom Barron (tpb) | 14:10 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 14:10 |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713045 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 14:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged] | 14:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 14:10 |
| openstack | Launchpad bug 1713045 in tripleo "dlrn_api calls fail to set delorean hash in tripleo promotion jobs" [Critical,In progress] - Assigned to Attila Darazs (adarazs) | 14:10 |
| rajinir | EmilienM>: https://review.openstack.org/#/c/490581/ is not moving to merge, and I have several patches waiting on it. Need help | 14:11 |
| *** limao_ has quit IRC | 14:12 | |
| *** limao has joined #tripleo | 14:13 | |
| rook | fultonj: hey - if I want to update a puppet script on the overcloud image, what is your workflow for that? | 14:14 |
| rook | i want to update haproxy.pp :/ | 14:14 |
| EmilienM | rajinir: I just come back from some days off, please let me some time to catch-up. I'll look into your work probably today | 14:14 |
| *** jlinkes has quit IRC | 14:14 | |
| fultonj | rook: i was using shardy's deploy artifacts http://hardysteven.blogspot.com/2016/08/tripleo-deploy-artifacts-and-puppet.html , but i don't think that will work now with the contianer deployment | 14:15 |
| fultonj | rook: you could edit the image | 14:16 |
| rook | oh | 14:16 |
| rook | bummer. | 14:16 |
| fultonj | rook: or use a preboot script to pull in the updated puppet before docker-puppet.py runs | 14:16 |
| fultonj | so you have 2 other methods | 14:16 |
| rook | fultonj it doesn't sound well tested... I don't feel like burning cycles :/ | 14:17 |
| rook | alright | 14:17 |
| rook | ill press on | 14:17 |
| fultonj | "it doesn't sound well tested" --> modifying the image or using a preboot script is known | 14:17 |
| rook | fultonj this modifies the container? | 14:18 |
| rook | well | 14:18 |
| rook | i suppose it doesn't need to modify the container | 14:18 |
| rook | since the container just reads from the configuration file from the host. | 14:18 |
| fultonj | dprince do you expect http://hardysteven.blogspot.com/2016/08/tripleo-deploy-artifacts-and-puppet.html to work with docker-puppet.py to update the puppet before the configs are genereated? | 14:19 |
| fultonj | rook: ^ | 14:19 |
| rajinir | EmilienM>: Thank you | 14:19 |
| tbarron | EmilienM: to preview, I'm wondering if bug 1712842 can be targeted for rc2 - I can't triage it myself but have fix posted. | 14:20 |
| openstack | bug 1712842 in tripleo "manila: need to override default setting for 'host'" [Undecided,In progress] https://launchpad.net/bugs/1712842 - Assigned to Tom Barron (tpb) | 14:20 |
| mandre | fultonj: I do it all the time, upload-puppet-modules -d puppet-modules | 14:20 |
| dprince | fultonj: yes | 14:20 |
| fultonj | awesome, thanks guys! | 14:21 |
| fultonj | rook: ^ | 14:21 |
| dprince | fultonj: I think there is an explicit depends_on so that the artifacts deployment runs fur | 14:21 |
| dprince | first | 14:21 |
| *** limao_ has joined #tripleo | 14:24 | |
| fultonj | rook: sounds like all 3 methods work | 14:25 |
| rook | fultonj: roger. | 14:26 |
| fultonj | rook: you could try my script to set up deploy artifacts https://github.com/fultonj/oooq/blob/master/setup-deploy-artifacts.sh | 14:26 |
| rook | i like scripts | 14:26 |
| rook | :D | 14:26 |
| fultonj | that's what i did in the scale lab a while back | 14:26 |
| rook | thanks fultonj | 14:26 |
| fultonj | just add the opesntack/ha-proxy to repos and try it out | 14:26 |
| *** aditya_r has joined #tripleo | 14:27 | |
| *** limao has quit IRC | 14:28 | |
| openstackgerrit | Merged openstack/puppet-pacemaker master: Update reno>=2.5.0 https://review.openstack.org/495708 | 14:29 |
| openstackgerrit | Joe Talerico proposed openstack/puppet-tripleo master: HAProxy logging https://review.openstack.org/497524 | 14:31 |
| jrist | apetrich: are we just hitting a random gate-tripleo-ci-centos-7-undercloud-oooq bug on this one? https://review.openstack.org/#/c/469608/ | 14:33 |
| jrist | apetrich: would like to get that merged. should we try another recheck ? | 14:33 |
| apetrich | jrist, I can't call it random. It is pretty consistent | 14:34 |
| jrist | just wait for 497596 ? | 14:34 |
| jrist | it's +A | 14:34 |
| apetrich | jrist, aye. that log shows what is happening and then we can call it ok or not | 14:34 |
| apetrich | jrist, I feel that is going to be some weird thing and not the trigger but ... | 14:35 |
| *** limao has joined #tripleo | 14:35 | |
| jrist | yeah | 14:36 |
| jrist | apetrich: ok, how much longer are you around today? | 14:36 |
| EmilienM | trown: have you seen https://bugs.launchpad.net/tripleo/+bug/1712436 ? | 14:36 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged] | 14:36 |
| EmilienM | trown: it looks like it comes from https://github.com/openstack/tripleo-quickstart-extras/commit/619bbe8bdc433a8c170ec910a61144b30a4ab3c8 | 14:36 |
| lvdombrkr | guys any ideas about this error on node which i introspect https://pasteboard.co/GHhNmpD.jpg | 14:36 |
| apetrich | jrist, at least more one hour and half but I will pop up on and off later | 14:36 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Persist containerized services httpd logs https://review.openstack.org/489955 | 14:36 |
| EmilienM | trown: any chance to look at it today? | 14:37 |
| rook | bogdando: hey - curious did my reply make sense to the haproxy.pp change>? | 14:37 |
| apetrich | jrist, feel free to ping me if you need anything | 14:37 |
| jrist | thanks apetrich | 14:37 |
| apetrich | no worries | 14:37 |
| bogdando | rook yes, thanks | 14:37 |
| rook | bogdando: ok cool... hoping my change to the spec makes jenkins happy now :) | 14:37 |
| rook | fultonj: since I had your attention, I wanted to add some logging to haproxy : https://review.openstack.org/#/c/497524/ | 14:38 |
| *** limao_ has quit IRC | 14:39 | |
| *** hewbrocca_afk is now known as hewbrocca | 14:40 | |
| fultonj | rook: nice | 14:40 |
| trown | EmilienM: ya looking | 14:41 |
| EmilienM | trown: thank you | 14:41 |
| *** jistr|trng is now known as jistr | 14:42 | |
| openstackgerrit | Justin Kilpatrick proposed openstack/tripleo-quickstart-extras master: WIP: Disruption detection and some stack update roles https://review.openstack.org/497950 | 14:46 |
| *** limao has quit IRC | 14:46 | |
| *** limao has joined #tripleo | 14:47 | |
| homeski | quick question: | 14:47 |
| homeski | if we included an environment file during overcloud deployment | 14:47 |
| homeski | and it had an empty section for resource_registry | 14:47 |
| homeski | would that funkiness? | 14:47 |
| homeski | e.g. | 14:47 |
| homeski | resource_registry: | 14:47 |
| homeski | parameter_defaults: | 14:47 |
| openstackgerrit | Justin Kilpatrick proposed openstack/tripleo-quickstart-extras master: WIP: Disruption detection and some stack update roles https://review.openstack.org/497950 | 14:49 |
| lvdombrkr | does anybode else use overcloud with selilinux enforcing? | 14:50 |
| *** limao has quit IRC | 14:57 | |
| *** limao has joined #tripleo | 14:58 | |
| *** rcernin has quit IRC | 14:59 | |
| *** jpich has quit IRC | 15:00 | |
| *** amoralej is now known as amoralej|off | 15:03 | |
| *** aditya_r has quit IRC | 15:03 | |
| *** psachin has quit IRC | 15:04 | |
| *** amoralej|off has quit IRC | 15:06 | |
| *** pcaruana has quit IRC | 15:06 | |
| *** psachin has joined #tripleo | 15:07 | |
| *** yprokule has quit IRC | 15:08 | |
| itlinux | geguileo: are you around? | 15:08 |
| *** limao has quit IRC | 15:08 | |
| *** d0ugal has joined #tripleo | 15:09 | |
| *** limao has joined #tripleo | 15:09 | |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 15:10 |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713045 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713079 | 15:10 |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,Triaged] | 15:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 15:10 |
| openstack | Launchpad bug 1713045 in tripleo "dlrn_api calls fail to set delorean hash in tripleo promotion jobs" [Critical,In progress] - Assigned to Attila Darazs (adarazs) | 15:10 |
| openstack | Launchpad bug 1713079 in tripleo "modify-image failing on IPA image" [Critical,Triaged] | 15:10 |
| *** dprince has quit IRC | 15:11 | |
| *** egonzalez has quit IRC | 15:12 | |
| *** catintheroof has joined #tripleo | 15:14 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Add verbose output to containerized cell_v2 host discovery https://review.openstack.org/497955 | 15:14 |
| *** garyk has quit IRC | 15:15 | |
| EmilienM | owalsh: hey, do we need https://review.openstack.org/#/c/496848/ in pike? | 15:17 |
| owalsh | EmilienM: I think mwhahaha is going to set it on the undercloud | 15:18 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-puppet-elements stable/pike: Add stunnel https://review.openstack.org/497788 | 15:18 |
| EmilienM | owalsh: ok so we need a backport, right? | 15:20 |
| *** limao has quit IRC | 15:20 | |
| EmilienM | owalsh: I'm not in favor of using nova_config provider directly in instack-undercloud | 15:20 |
| *** limao has joined #tripleo | 15:20 | |
| owalsh | EmilienM: yea, needs a backport | 15:22 |
| EmilienM | will do | 15:23 |
| *** psachin has quit IRC | 15:24 | |
| owalsh | EmilienM: ah, you already did. LGTM | 15:24 |
| *** iranzo has quit IRC | 15:25 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Make deployed_server_prepare.sh compatible with newton https://review.openstack.org/497958 | 15:26 |
| trown | EmilienM: weshay I think ^ should fix newton | 15:26 |
| *** jprovazn has quit IRC | 15:27 | |
| weshay | trown, thank you!! | 15:27 |
| trown | do we need to make a dummy tripleo-ci patch to test it? | 15:27 |
| *** limao has quit IRC | 15:28 | |
| EmilienM | trown: please | 15:28 |
| EmilienM | trown: thanks for the fix as well! | 15:28 |
| openstackgerrit | Michael Chapman proposed openstack/tripleo-quickstart-extras master: Add opendaylight to collect-logs https://review.openstack.org/494043 | 15:29 |
| *** mdnadeem has quit IRC | 15:30 | |
| trown | EmilienM: hmm that job doesnt run on tripleo-ci by default... maybe need to make dummy commit to tht stable/newton | 15:30 |
| openstackgerrit | Michael Chapman proposed openstack/tripleo-quickstart-extras master: Add opendaylight to collect-logs https://review.openstack.org/494043 | 15:30 |
| EmilienM | trown: yeah, in THT | 15:31 |
| *** itlinux has quit IRC | 15:31 | |
| *** bogdando has quit IRC | 15:32 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Switch scenario007 to run Tempest https://review.openstack.org/494293 | 15:33 |
| rlandy | jistr: hi - question about https://github.com/openstack/tripleo-quickstart-extras/blame/master/roles/overcloud-deploy/tasks/pre-deploy.yml#L184 | 15:33 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates stable/newton: DNM TESTING 497958 https://review.openstack.org/497960 | 15:33 |
| rlandy | jistr: just wanted to know what that would not be used with network isolation | 15:34 |
| rlandy | we don't have any containers jobs work with net-iso - so looking into that | 15:34 |
| EmilienM | pabelanger: could you please re-consider https://review.openstack.org/#/c/495409/ ? | 15:34 |
| jistr | rlandy: yea that wouldn't be used with network isolation, as any sort of network isolation should provide its own NIC config files for the compute node | 15:35 |
| *** psachin has joined #tripleo | 15:35 | |
| jistr | rlandy: the file just sets a compute NIC config to make sure that br-ex is created https://github.com/openstack/tripleo-heat-templates/blob/master/environments/docker-network.yaml | 15:35 |
| jistr | rlandy: actually i think we're now looking into it as a bug. For Puppet deployments, br-ex is created by Puppet. In container deployments that doesn't happen so that docker-network.yaml is a workaround for it. It's probable that the docker-network.yaml file will be entirely removed before Pike is released. | 15:37 |
| pabelanger | EmilienM: done | 15:38 |
| EmilienM | pabelanger: thank you sir | 15:39 |
| rlandy | jistr: for an external settings issue, that condition is not resolving so I am just investigating it | 15:39 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Upgrade CI test - never merge https://review.openstack.org/461000 | 15:41 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Upgrade CI test - never merge https://review.openstack.org/461000 | 15:42 |
| *** suuuper has quit IRC | 15:44 | |
| *** aufi has quit IRC | 15:44 | |
| jistr | rlandy: i'm probably missing a bit of context on what the issue is. You're deploying with network isolation but something doesn't work? br-ex missing? | 15:45 |
| *** milan has quit IRC | 15:45 | |
| *** akrivoka has quit IRC | 15:45 | |
| rlandy | jistr: it's not a problem from the bridge side - it's a settings issue which is hard to detect so I was just trying to see how/when that needed to be used so we could workaround it. The problem is on the CI side only | 15:47 |
| jistr | rlandy: ok, please let me know if you want more eyes on something, i'd be happy to help (or try to at least :) ) | 15:50 |
| *** aditya_r has joined #tripleo | 15:51 | |
| rlandy | jistr: to give you some context, we are trying to get the containers jobs working on rdocloud - and it's been more complex than I thought | 15:52 |
| *** d0ugal has quit IRC | 15:52 | |
| jistr | ack, and currently we think the issue is in network config maybe? | 15:52 |
| *** psachin has quit IRC | 15:56 | |
| *** ffiore has quit IRC | 15:56 | |
| *** derekh has quit IRC | 15:57 | |
| *** ebarrera has quit IRC | 15:59 | |
| *** catintheroof has quit IRC | 15:59 | |
| *** psachin has joined #tripleo | 16:01 | |
| *** lucasagomes is now known as lucas-afk | 16:06 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1689556 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 16:10 |
| openstack | Launchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,Triaged] | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713045 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713079 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 16:10 |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 16:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,In progress] - Assigned to John Trowbridge (trown) | 16:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 16:10 |
| openstack | Launchpad bug 1713045 in tripleo "dlrn_api calls fail to set delorean hash in tripleo promotion jobs" [Critical,In progress] - Assigned to Attila Darazs (adarazs) | 16:10 |
| openstack | Launchpad bug 1713079 in tripleo "modify-image failing on IPA image" [Critical,Triaged] | 16:10 |
| *** dansmith is now known as superdan | 16:12 | |
| jistr | rlandy: after doing some digging, IIUC the OVB setup uses this NIC config https://github.com/cybertron/openstack-virtual-baremetal/blob/master/network-templates/nic-configs/compute.yaml | 16:18 |
| *** dprince has joined #tripleo | 16:19 | |
| *** cschwede_ has quit IRC | 16:20 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Do not try to inject repo into IPA image if we dont fetch it https://review.openstack.org/497973 | 16:21 |
| jistr | rlandy: it looks like it's missing some form of br-ex creation to get the same "workaround" that is provided by docker-network.yaml in the non-OVB non-net-iso case | 16:21 |
| jistr | e.g. for non-OVB net-iso case, one could use the single-nic-vlans, which, IIUC, would take care of creating br-ex here | 16:22 |
| jistr | https://github.com/openstack/tripleo-heat-templates/blob/master/network/config/single-nic-vlans/compute.yaml#L87-L88 | 16:22 |
| *** snecklifter has quit IRC | 16:22 | |
| openstackgerrit | John Trowbridge proposed openstack/instack-undercloud master: DNM TESTING 497973 https://review.openstack.org/497974 | 16:23 |
| rlandy | jistr: we have to run ovb w/o net-iso due to https://bugs.launchpad.net/tripleo/+bug/1689556 | 16:23 |
| openstack | Launchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,Triaged] | 16:23 |
| *** aditya_r has quit IRC | 16:23 | |
| rlandy | jistr: your work is fine - I just need to figure out why the ci is missing the condition to include it | 16:24 |
| bnemec | We really badly need a fix for the missing bridge problem with containers. | 16:25 |
| bnemec | This isn't just a ci problem, it's something users are going to run into as well. | 16:25 |
| jistr | rlandy: right, that's what i meant -- what i described above is likely the root cause of bug 1689556 | 16:25 |
| openstack | bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,Triaged] https://launchpad.net/bugs/1689556 | 16:25 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates stable/newton: DNM TESTING 497958 https://review.openstack.org/497960 | 16:25 |
| jistr | bnemec: yea i think Slower and stevebaker were discussing the possiblities there recently | 16:26 |
| openstackgerrit | John Trowbridge proposed openstack/instack-undercloud master: DNM TESTING 497973 https://review.openstack.org/497974 | 16:27 |
| trown | bnemec: weshay https://review.openstack.org/#/q/topic:bug/1713079 will hopefully resolve the ovb CI issue | 16:27 |
| trown | bnemec: thanks for filing bug | 16:27 |
| weshay | oh man that playbook is ugly | 16:28 |
| *** trown is now known as trown|lunch | 16:30 | |
| openstackgerrit | Martin André proposed openstack/puppet-tripleo master: Use TLS proxy for Redis' internal TLS https://review.openstack.org/496616 | 16:30 |
| *** marrusl has quit IRC | 16:34 | |
| *** marrusl has joined #tripleo | 16:34 | |
| *** marrusl has quit IRC | 16:35 | |
| *** marrusl has joined #tripleo | 16:35 | |
| *** pblaho has quit IRC | 16:38 | |
| EmilienM | tbarron: could you have a look at https://bugs.launchpad.net/tripleo/+bug/1712976 please? | 16:41 |
| openstack | Launchpad bug 1712976 in tripleo "Ocata -> Pike: 500 error upon horizon login" [High,Triaged] | 16:41 |
| tbarron | EmilienM: yessir | 16:41 |
| EmilienM | thx | 16:42 |
| Slower | derekh: Yes, thanks! Martin Magr is too | 16:44 |
| *** achadha has joined #tripleo | 16:45 | |
| *** thrash is now known as thrash|biab | 16:47 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Removing duplicated tasks https://review.openstack.org/486958 | 16:48 |
| *** achadha has quit IRC | 16:49 | |
| EmilienM | pradk: have you seen https://bugs.launchpad.net/tripleo/+bug/1713038 ? | 16:49 |
| openstack | Launchpad bug 1713038 in tripleo "Enable ceilometer compute agent in scenario001" [Medium,In progress] - Assigned to Arx Cruz (arxcruz) | 16:49 |
| *** achadha has joined #tripleo | 16:49 | |
| pradk | EmilienM, already +2'ed the patch | 16:50 |
| EmilienM | pradk: nevermind, I saw https://review.openstack.org/#/c/497835/ | 16:50 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Change Delorean repo link to consistent for single job pipelines https://review.openstack.org/497982 | 16:50 |
| EmilienM | it was not linked into the bug | 16:50 |
| EmilienM | pradk: my bad | 16:50 |
| pradk | np | 16:50 |
| *** achadha has quit IRC | 16:51 | |
| *** achadha has joined #tripleo | 16:51 | |
| *** catintheroof has joined #tripleo | 16:52 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart master: Switch containers multinode CI to deploy HA https://review.openstack.org/471724 | 16:52 |
| *** achadha_ has joined #tripleo | 16:53 | |
| EmilienM | adarazs: can we close https://bugs.launchpad.net/tripleo/+bug/1713045 ? | 16:54 |
| openstack | Launchpad bug 1713045 in tripleo "dlrn_api calls fail to set delorean hash in tripleo promotion jobs" [Critical,In progress] - Assigned to Attila Darazs (adarazs) | 16:54 |
| *** jpena is now known as jpena|off | 16:54 | |
| *** achadha_ has quit IRC | 16:54 | |
| *** achadha_ has joined #tripleo | 16:54 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Change Delorean repo link to consistent for single job pipelines https://review.openstack.org/497982 | 16:54 |
| *** achadha has quit IRC | 16:55 | |
| EmilienM | fultonj, gfidente : do we want the fix for https://bugs.launchpad.net/tripleo/+bug/1712912 in stable/pike? | 16:55 |
| openstack | Launchpad bug 1712912 in tripleo "composed role for hci fails ceph-ansible deploy on step 2" [Medium,Triaged] - Assigned to Giulio Fidente (gfidente) | 16:55 |
| EmilienM | if yes, we need to set it to High probably. | 16:55 |
| gfidente | EmilienM yes totally | 16:56 |
| gfidente | was looking into that earlier | 16:56 |
| EmilienM | gfidente: please set to High then | 16:56 |
| gfidente | done | 16:57 |
| EmilienM | thx! | 16:57 |
| EmilienM | mcornea: can you look at https://review.openstack.org/#/c/496223/ when possible please? | 16:58 |
| EmilienM | jistr: ^ as well | 16:58 |
| mcornea | EmilienM: looking | 16:58 |
| EmilienM | trown|lunch, adarazs, weshay : closing https://bugs.launchpad.net/tripleo/+bug/1713045 as https://review.rdoproject.org/r/8916 fixed it - feel free to re-open if it's still here | 16:59 |
| openstack | Launchpad bug 1713045 in tripleo "dlrn_api calls fail to set delorean hash in tripleo promotion jobs" [Critical,Fix released] - Assigned to Attila Darazs (adarazs) | 16:59 |
| *** achadha_ has quit IRC | 17:00 | |
| *** jtomasek has quit IRC | 17:00 | |
| *** achadha has joined #tripleo | 17:00 | |
| *** tesseract has quit IRC | 17:07 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: mv wait_for to wait_for.sh to be collected by logs https://review.openstack.org/497984 | 17:07 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Reintroduce containerized Cinder https://review.openstack.org/479001 | 17:07 |
| EmilienM | jistr, mcornea : thanks guys ;-) | 17:07 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1689556 | 17:10 |
| openstack | Launchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,Triaged] | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712910 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713079 | 17:10 |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 17:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,In progress] - Assigned to John Trowbridge (trown) | 17:10 |
| openstack | Launchpad bug 1712910 in tripleo "oooq virt-customize repo setup logs are not saved " [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 17:10 |
| openstack | Launchpad bug 1713079 in tripleo "modify-image failing on IPA image" [Critical,Triaged] - Assigned to John Trowbridge (trown) | 17:10 |
| *** psachin has quit IRC | 17:10 | |
| *** tosky has quit IRC | 17:11 | |
| *** catintheroof has quit IRC | 17:11 | |
| *** itlinux has joined #tripleo | 17:12 | |
| *** trown|lunch is now known as trown | 17:18 | |
| *** akrivoka has joined #tripleo | 17:22 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Containarise Barbican API https://review.openstack.org/497987 | 17:24 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP DNR Add some local stanzas to haproxy https://review.openstack.org/497989 | 17:26 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: the pike-testing-hash release config needs release set to pike and not master https://review.openstack.org/497993 | 17:29 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: the pike-testing-hash release config should be pike https://review.openstack.org/497993 | 17:31 |
| EmilienM | trown: can we close https://bugs.launchpad.net/tripleo/+bug/1712785 you think? | 17:33 |
| openstack | Launchpad bug 1712785 in tripleo "tripleo quickstart fails with "Failed to parse dlrn hash"" [High,Triaged] | 17:33 |
| trown | EmilienM: ya related fix should have been closes | 17:34 |
| EmilienM | trown: k | 17:34 |
| *** tosky has joined #tripleo | 17:36 | |
| *** gfidente has quit IRC | 17:37 | |
| *** gbarros has quit IRC | 17:40 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Add /bin to PATH for CRL cronjob https://review.openstack.org/497730 | 17:42 |
| openstackgerrit | Merged openstack/os-net-config stable/pike: Delete controller for standalone OVS bridges https://review.openstack.org/496707 | 17:42 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: add logs for virt-customize https://review.openstack.org/497596 | 17:43 |
| trown | EmilienM: mind an easy review? https://review.openstack.org/497993 ... no ci runs on that file, so it would be good to just get in the gate queue in hopes of making the next periodic run in 2 hours | 17:43 |
| EmilienM | trown: +A | 17:44 |
| trown | EmilienM: thanks | 17:44 |
| EmilienM | yw | 17:44 |
| *** florianf has quit IRC | 17:46 | |
| EmilienM | weshay: does it affect our current CI jobs? https://bugs.launchpad.net/tripleo/+bug/1689556 | 17:46 |
| openstack | Launchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,Triaged] | 17:46 |
| EmilienM | or is it rdo jobs? | 17:46 |
| weshay | EmilienM, so all the ovb container jobs are running w/o net-iso | 17:47 |
| weshay | upstream | 17:47 |
| EmilienM | weshay: ok so we can remove alert, no? | 17:47 |
| *** florianf has joined #tripleo | 17:47 | |
| weshay | EmilienM, well.. you are the boss man. Are we risking anything by not deploying w/ net-iso? | 17:48 |
| EmilienM | I hope I'm not the boss | 17:50 |
| bnemec | EmilienM: You are until Pike is out the door. :-P | 17:51 |
| *** bnemec is now known as beekneemech | 17:51 | |
| openstackgerrit | Justin Kilpatrick proposed openstack/tripleo-quickstart-extras master: WIP: Disruption detection and some stack update roles https://review.openstack.org/497950 | 17:52 |
| *** achadha_ has joined #tripleo | 17:52 | |
| EmilienM | beekneemech: damn it | 17:54 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: WIP create default settings for environment types https://review.openstack.org/495407 | 17:55 |
| *** achadha has quit IRC | 17:55 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Change devmode to deploy containerized services by default https://review.openstack.org/472412 | 17:56 |
| *** catintheroof has joined #tripleo | 17:56 | |
| *** achadha has joined #tripleo | 17:56 | |
| *** achadha_ has quit IRC | 17:56 | |
| *** garyk has joined #tripleo | 17:58 | |
| *** pkovar has quit IRC | 17:59 | |
| EmilienM | trown, weshay: have you seen that before? http://logs.openstack.org/30/497730/1/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/c7cb0d8/console.html#_2017-08-25_10_09_29_338151 | 18:03 |
| *** thrash|biab is now known as thrash | 18:04 | |
| atoth | abishop, thanks for the help you didn't even know you gave me :-) | 18:04 |
| weshay | looking | 18:04 |
| abishop | atoth: um, sure? | 18:04 |
| atoth | abishop, just had a "Only 0 nodes are exposed to Nova" issue and one of your past replies to rook helped :-) | 18:05 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Change devmode to deploy containerized services by default https://review.openstack.org/472412 | 18:05 |
| abishop | atoth: ah, yes! | 18:05 |
| * atoth loves posted irc logs | 18:05 | |
| abishop | true dat | 18:05 |
| rook | atoth :D | 18:06 |
| atoth | :-) | 18:06 |
| *** pchavva has quit IRC | 18:07 | |
| EmilienM | weshay: it's only on stable/pike | 18:08 |
| EmilienM | weshay: we probably need something in oooq | 18:08 |
| weshay | EmilienM, I can't find that file in src | 18:09 |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1689556 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 18:10 |
| openstack | Launchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,Triaged] | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713079 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 18:10 |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 18:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,In progress] - Assigned to John Trowbridge (trown) | 18:10 |
| openstack | Launchpad bug 1713079 in tripleo "modify-image failing on IPA image" [Critical,Triaged] - Assigned to John Trowbridge (trown) | 18:10 |
| rook | pabelanger: ping, learning opportunity for me... why did this build fail : http://logs.openstack.org/24/497524/6/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq/0b63e4b/console.html | 18:11 |
| rook | pabelanger: i see 2017-08-25 16:23:50.592659 | ERROR: the main setup script run by this job failed - exit code: 2 | 18:11 |
| fultonj | abishop: do you havea patch in the works for https://bugs.launchpad.net/tripleo/+bug/1711462 ? | 18:11 |
| openstack | Launchpad bug 1711462 in tripleo "HCI derived parameters workflow not using NovaVcpuPinSet" [High,In progress] - Assigned to Alan Bishop (alan-bishop) | 18:11 |
| pabelanger | rook: http://logs.openstack.org/24/497524/6/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq/0b63e4b/console.html#_2017-08-25_16_19_18_101920 is the task failure | 18:12 |
| abishop | fultonj: https://review.openstack.org/489239 | 18:12 |
| abishop | fultonj: which, I just noticed, just needs W+ | 18:12 |
| pabelanger | rook: which would take you to: http://logs.openstack.org/24/497524/6/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq/0b63e4b/logs/undercloud/home/jenkins/failed_deployment_list.log.txt.gz | 18:13 |
| rook | pabelanger: is the trick to search for fatal from the top? | 18:13 |
| *** mcornea has quit IRC | 18:13 | |
| abishop | fultonj: and https://review.openstack.org/#/c/480587/ (dependency) also needs W+ | 18:13 |
| pabelanger | rook: I just grep for "fatal:" usually | 18:13 |
| rook | ok | 18:14 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Change devmode to deploy containerized services by default https://review.openstack.org/472412 | 18:14 |
| weshay | EmilienM, I suspect the name of that file is generated from vars, and it's never been checked in | 18:14 |
| fultonj | abishop: ack, thanks. | 18:14 |
| pabelanger | rook: ARA would be another way too | 18:14 |
| rook | pabelanger: i don't get the sense my patch did this... | 18:15 |
| * rook attempts a recheck | 18:15 | |
| rook | seems to be a issue with clustercheck? | 18:15 |
| pabelanger | rook: ya, I've not see that before. EmilienM ^ ideas? | 18:15 |
| pabelanger | rook: ya, it would be good to check logstash.o.o and see if this has happened before | 18:16 |
| pabelanger | rook: if so, we need to create an elastic-recheck query and get somebody to fix it | 18:16 |
| rook | where is the kibana to dig through? | 18:16 |
| fultonj | can someone with the power, please +workflow these two patches which have the +2s and ci+1 that they need? https://review.openstack.org/#/c/480587 https://review.openstack.org/#/c/489239 | 18:17 |
| pabelanger | rook: logsstach.o.o | 18:17 |
| weshay | EmilienM, https://github.com/openstack-infra/tripleo-ci/blob/master/toci_gate_test-oooq.sh#L199 | 18:17 |
| rook | pabelanger: excuse me for being dense, but o.o ? | 18:18 |
| pabelanger | rook: Oh, logstash.openstack.org | 18:18 |
| rook | oh | 18:18 |
| rook | well | 18:18 |
| EmilienM | pabelanger: not afik | 18:18 |
| rook | thank god it is friday | 18:18 |
| EmilienM | weshay: yeah that's problematic | 18:19 |
| pabelanger | rook: EmilienM: okay, I am getting hits on that in logstash | 18:19 |
| pabelanger | so, we need to create a bug and elastic-recheck query | 18:19 |
| pabelanger | message:"Failed to call refresh: /usr/bin/clustercheck" AND tags:"console" | 18:19 |
| EmilienM | weshay: we need to fix that asap, since we just branched stable/pike | 18:20 |
| pabelanger | 16 hits over 10 days | 18:20 |
| *** psachin has joined #tripleo | 18:20 | |
| rook | yeah, looking at the last 6 hours I see two hits. | 18:20 |
| rook | yeah, I just searched message: "Failed to call refresh: /user/bin/clustercheck" | 18:20 |
| pabelanger | same | 18:21 |
| pabelanger | rook: do you mind creating a bug? | 18:21 |
| pabelanger | rook: then we can add it to elastic-recheck to track | 18:22 |
| rook | pabelanger: just a launchpad - against? | 18:22 |
| rook | ok | 18:22 |
| pabelanger | rook: ya, maybe confirm with EmilienM where | 18:22 |
| EmilienM | all bugs are under launchpad/tripleo, as usual... | 18:22 |
| rook | ok - since this was tripleo-infra i didn't know if this was different. | 18:24 |
| weshay | EmilienM, looking at it | 18:25 |
| pabelanger | rook: EmilienM: This is exciting! We found an issue in check, before hitting gate. And now we'll have elastic-recheck start collecting stats on it. :) | 18:26 |
| *** dixiaoli has joined #tripleo | 18:29 | |
| EmilienM | rook: no, there is one launchpad to use: https://launchpad.net/tripleo | 18:29 |
| EmilienM | pabelanger: that's great indeed | 18:30 |
| rook | https://bugs.launchpad.net/tripleo/+bug/1713127 pabelanger | 18:30 |
| openstack | Launchpad bug 1713127 in tripleo "tripleo fails to deploy in ci : Failed to call refresh: /usr/bin/clustercheck" [Medium,Triaged] | 18:30 |
| EmilienM | rook: thanks | 18:30 |
| pabelanger | rook: cool, now we need to update openstack-infra/elastic-recheck | 18:30 |
| weshay | EmilienM, the ipa image should be from pike? and the overcloud from ocata? | 18:31 |
| weshay | ya | 18:31 |
| EmilienM | weshay: you're talking about a different bug here? | 18:32 |
| weshay | EmilienM, nevermind | 18:32 |
| EmilienM | ok | 18:32 |
| weshay | No.. the release file | 18:32 |
| EmilienM | weshay: so we have config/release/tripleo-ci/master-undercloud-ocata-overcloud.yml in oooq | 18:32 |
| rook | pabelanger: just add it to https://github.com/openstack-infra/elastic-recheck/tree/master/queries (it being the query) | 18:32 |
| weshay | yes.. I'm using that as my template | 18:32 |
| rook | with the bugid | 18:32 |
| EmilienM | but since we've cut stable/pike, now tripleo-ci script tries to find config/release/tripleo-ci/pike-undercloud-ocata-overcloud.yml | 18:32 |
| EmilienM | weshay: I guess we need to create it ^ ? | 18:32 |
| pabelanger | rook: exactly, you can 1449136 as an example | 18:33 |
| EmilienM | and transform config/release/tripleo-ci/master-undercloud-ocata-overcloud.yml to config/release/tripleo-ci/master-undercloud-pike-overcloud.yml | 18:33 |
| EmilienM | no? | 18:33 |
| *** dixiaoli has quit IRC | 18:33 | |
| EmilienM | weshay: ^ | 18:35 |
| pabelanger | rook: you can then use elastic-recheck-query on the yaml file to see the hits | 18:35 |
| weshay | EmilienM, doing so now | 18:35 |
| rook | so there is no need for time scale | 18:37 |
| pabelanger | rook: no, we default that to 10days | 18:38 |
| pabelanger | all the storage we have | 18:38 |
| rook | ah ok | 18:38 |
| pabelanger | weshay: EmilienM: do you remember who was going to update quickstack not to clone DLRN from github.com but pip install it? | 18:40 |
| pabelanger | EmilienM: weshay: http://logs.openstack.org/88/495288/1/gate/gate-tripleo-ci-centos-7-nonha-multinode-oooq/b8dd8be/console.html#_2017-08-21_13_10_58_555887 is the reason why | 18:40 |
| pabelanger | if we pip install, it will use our mirrors | 18:40 |
| pabelanger | that failure was in the gate too | 18:41 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: add upgrade release file for pike/ocata deployment https://review.openstack.org/498057 | 18:41 |
| weshay | pabelanger, adarazs can own that | 18:41 |
| EmilienM | weshay: commented ^ | 18:43 |
| weshay | EmilienM, oh maybe I went the wrong way.. do you master undercloud pike overcloud? | 18:44 |
| weshay | or pike undercloud ocata overcloud | 18:45 |
| weshay | works both ways | 18:45 |
| pabelanger | weshay: adarazs thanks: https://bugs.launchpad.net/tripleo/+bug/1713130 | 18:45 |
| openstack | Launchpad bug 1713130 in tripleo "pip install DLRN don't git clone from github.com" [Undecided,New] | 18:45 |
| pabelanger | weshay: do you mind tagging that with your CI gate failure things | 18:45 |
| weshay | pabelanger, do you want an alert? | 18:46 |
| EmilienM | weshay: why do we have this? | 18:47 |
| EmilienM | weshay: what are we testing? are we deploying an n-1 undercloud with n-1 overcloud and then upgrade overcloud to n? | 18:47 |
| pabelanger | weshay: what is the criteria for that? because we did have a job fail in gate today because of it. Which leads to gate resets, and delays patches merging | 18:47 |
| weshay | I believe there was a request from the boss to have mixed version deployments | 18:48 |
| weshay | I can trace down the history if that is required | 18:48 |
| weshay | EmilienM, I just need to know which mix | 18:48 |
| weshay | I suspect master undercloud w/ pike overcloud | 18:48 |
| weshay | which is not what I submitted | 18:48 |
| pabelanger | weshay: that was back on the 21st, 2 hits. So, not breaking gate, but should be priority to fix to avoid gate failures | 18:49 |
| EmilienM | "from the boss" - what does it mean? | 18:49 |
| weshay | understood | 18:49 |
| weshay | oh man.. time to joke around or not... /me thinks | 18:49 |
| EmilienM | I'm a bit confused what are we trying to deploy and test | 18:50 |
| weshay | EmilienM, https://github.com/openstack/tripleo-quickstart/commit/5c4aaf3d6f1b92077a84ee335c87e7ff612a4b69 | 18:51 |
| weshay | EmilienM, ah I think I see | 18:51 |
| EmilienM | weshay: if only people would take time to write commit messages | 18:51 |
| weshay | this sets up the overcloud at n-1 so that upgrades can take care of it | 18:52 |
| EmilienM | and explain each change | 18:52 |
| weshay | if only everyone gave more hugs | 18:52 |
| weshay | EmilienM, ok.. taking care of it man | 18:52 |
| EmilienM | hugs are targeted for queens-1 | 18:52 |
| EmilienM | not we are in pike-rc2, no hug. | 18:53 |
| EmilienM | now* | 18:53 |
| weshay | pabelanger, I do have questions about your kids dress that has been hanging on your door for about a year :) | 18:53 |
| weshay | I expect answers at the ptg | 18:53 |
| EmilienM | lol | 18:53 |
| pabelanger | weshay: they use them everyday | 18:53 |
| pabelanger | :) | 18:53 |
| weshay | give me a hot sec.. and I'll take care of it | 18:53 |
| weshay | :) | 18:53 |
| EmilienM | weshay: ok thx | 18:53 |
| rook | lol weshay... saying what everyone wants to say | 18:56 |
| rook | weshay: I just figured pabelanger throws that on every now and then :P | 18:56 |
| EmilienM | weshay: I think we're timeouting when running pingtest after overcloud upgrade (container) | 18:56 |
| EmilienM | weshay: but pingtest works: http://logs.openstack.org/00/461000/49/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/be64888/logs/undercloud/home/jenkins/overcloud_validate.log.txt.gz#_2017-08-25_18_29_55 | 18:56 |
| weshay | ah wait | 18:56 |
| weshay | the error is this | 18:57 |
| weshay | pike-undercloud-ocata-overcloud.yml is missing | 18:57 |
| weshay | so I was right | 18:57 |
| EmilienM | yes you were right | 18:57 |
| EmilienM | I told you already | 18:57 |
| EmilienM | but we need to change the previous file as well | 18:57 |
| EmilienM | to do it with queens (we can do it later probably) | 18:57 |
| weshay | rook, HA.. | 18:57 |
| weshay | EmilienM, well.. you can tell me I'm right all day long, but it won't change anything until you remove that -1 :) | 18:58 |
| EmilienM | weshay: ok | 18:58 |
| EmilienM | weshay: how many coffees did you take today? | 18:59 |
| weshay | EmilienM, :) | 18:59 |
| weshay | I drank tiger blood | 18:59 |
| weshay | it's legal here | 18:59 |
| eck` | weshay: the correct term is recreational tiger blood | 18:59 |
| weshay | eck`, is here! | 19:00 |
| weshay | hey eck` | 19:00 |
| eck` | i am always lurking ;) | 19:00 |
| * rook looks up if it is legal to drink tiger blood... | 19:00 | |
| EmilienM | pabelanger: we're having a long standing issue in tripleo ci where upgrade jobs randomly timeout and I feel like we miss 15 min | 19:00 |
| *** abishop has quit IRC | 19:01 | |
| rook | maybe over in Apex/Cary land only | 19:01 |
| EmilienM | pabelanger: would it be possible to go up to 3h for these jobs? | 19:01 |
| EmilienM | instead of 2h45 | 19:01 |
| pabelanger | EmilienM: which job is timing out? | 19:01 |
| EmilienM | pabelanger: gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv | 19:01 |
| EmilienM | and | 19:02 |
| EmilienM | gate-tripleo-ci-centos-7-scenario00X-multinode-oooq-container-upgrades-nv | 19:02 |
| EmilienM | at least | 19:02 |
| EmilienM | we also have upgrade jobs on stable/ocata | 19:02 |
| pabelanger | EmilienM: k, I haven't profiled them. I don't think bumping them up 15mins is the right fix, haven't these jobs been slowly growing it time as you keep bumping them? | 19:02 |
| EmilienM | yeah it's not the right fix | 19:03 |
| pabelanger | let me look at logstash.o.o and see what it says | 19:03 |
| EmilienM | another example of timeout: http://logs.openstack.org/00/461000/49/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container-upgrades-nv/a4b8a8d/console.html#_2017-08-25_18_30_49_250920 | 19:03 |
| *** achadha has quit IRC | 19:04 | |
| openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo master: Repair immediate VF configuration for PCI SR-IOV https://review.openstack.org/497664 | 19:04 |
| *** achadha has joined #tripleo | 19:05 | |
| openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo master: Repair immediate VF configuration for PCI SR-IOV https://review.openstack.org/497664 | 19:05 |
| *** achadha has quit IRC | 19:06 | |
| *** achadha has joined #tripleo | 19:07 | |
| beagles | is there something weird going on with the stable/pike branch of puppet-tripleo | 19:10 |
| *** achadha has quit IRC | 19:10 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1689556 | 19:10 |
| openstack | Launchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,Triaged] | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 19:10 |
| *** achadha_ has joined #tripleo | 19:10 | |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713079 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 19:10 |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 19:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,In progress] - Assigned to John Trowbridge (trown) | 19:10 |
| openstack | Launchpad bug 1713079 in tripleo "modify-image failing on IPA image" [Critical,Triaged] - Assigned to John Trowbridge (trown) | 19:10 |
| beagles | ne'er mind .. must be imagining things | 19:11 |
| *** dhill_ has quit IRC | 19:14 | |
| *** achadha_ has quit IRC | 19:14 | |
| *** dhill_ has joined #tripleo | 19:15 | |
| *** pradk has quit IRC | 19:16 | |
| pabelanger | EmilienM: where is the logs for overcloud-upgrade process: http://logs.openstack.org/00/461000/49/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container-upgrades-nv/a4b8a8d/ | 19:20 |
| EmilienM | pabelanger: http://logs.openstack.org/00/461000/49/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container-upgrades-nv/a4b8a8d/logs/undercloud/home/jenkins/overcloud_upgrade_console.log.txt.gz | 19:21 |
| *** itlinux has quit IRC | 19:21 | |
| EmilienM | pabelanger: and the very deep details are in ansible tasks, in http://logs.openstack.org/00/461000/49/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container-upgrades-nv/a4b8a8d/logs/subnode-2/var/log/messages.txt.gz | 19:22 |
| *** itlinux has joined #tripleo | 19:22 | |
| openstackgerrit | Dan Sneddon proposed openstack/os-net-config master: Add NIC Mapping Reporting Feature https://review.openstack.org/383516 | 19:23 |
| pabelanger | EmilienM: so, looks like you're spending ~16mins pushing containers to the registry | 19:23 |
| dsneddon | EmilienM, beagles, bandini, trown: I would love to get a review on this os-net-config patch which has been lingering: https://review.openstack.org/#/c/383516/ | 19:24 |
| beagles | dsneddon, ack | 19:25 |
| dsneddon | EmilienM, I also wanted your opinion on whether this can be merged in time for Pike. It'd be nice for validation/troubleshooting. | 19:25 |
| pabelanger | EmilienM: don't know, 3 hours jobs on every patch seems like a lot. Why not make these periodic jobs? | 19:26 |
| EmilienM | dsneddon: it would require a bug report in launchpad to be backported | 19:28 |
| EmilienM | pabelanger: yeah I know it's long, it's not new | 19:28 |
| EmilienM | pabelanger: periodic would maybe be great as well | 19:28 |
| dsneddon | EmilienM, I created one, post facto: https://bugs.launchpad.net/os-net-config/+bug/1713137 | 19:29 |
| openstack | Launchpad bug 1713137 in os-net-config "os-net-config should validate and report NIC mappings" [Medium,In progress] - Assigned to Dan Sneddon (dsneddon) | 19:29 |
| EmilienM | pabelanger: but it's problematic when you're patching THT upgrade tasks | 19:29 |
| EmilienM | pabelanger: how would you test the patch? | 19:29 |
| EmilienM | dsneddon: update commit message please and I think we're good | 19:29 |
| dsneddon | EmilienM, It has a Closes-bug: 1723137, it's in the commit message after the Change-Id. Thanks! | 19:30 |
| *** achadha has joined #tripleo | 19:30 | |
| dsneddon | EmilienM, Annoyingly, when I updated the commit message it seems to have removed the existing +1s and +2. | 19:31 |
| dsneddon | And the successful tests. Argh! | 19:31 |
| EmilienM | dsneddon: I'm fine doing it again | 19:31 |
| dsneddon | EmilienM, beagles: Thanks again. | 19:32 |
| *** athomas has quit IRC | 19:33 | |
| *** Goneri has quit IRC | 19:34 | |
| *** achadha has quit IRC | 19:35 | |
| *** itlinux has quit IRC | 19:37 | |
| tbarron | anything special about upgrading ocata to pike other than following http://tripleo.org/post_deployment/upgrade.html and substituting release names? | 19:38 |
| tbarron | 'openstack undercloud upgrade' -> "__init__() got an unexpected keyword argument 'url'" | 19:39 |
| * tbarron is trying to repro an issue reported in launchpad but this isn't it | 19:39 | |
| EmilienM | tbarron: yes, a sec | 19:40 |
| tbarron | EmilienM: thx | 19:40 |
| EmilienM | tbarron: doc is WIP https://review.openstack.org/#/c/496223/ | 19:40 |
| EmilienM | but should help | 19:40 |
| tbarron | EmilienM: excellent | 19:40 |
| EmilienM | hth | 19:40 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Fix missing data for fluentd (100-openstack-sources.conf) https://review.openstack.org/497768 | 19:41 |
| *** itlinux has joined #tripleo | 19:41 | |
| *** lblanchard has joined #tripleo | 19:43 | |
| bandini | dsneddon: looking | 19:44 |
| *** cylopez has joined #tripleo | 19:47 | |
| *** eck` is now known as eck`gone | 19:48 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Update reno>=2.5.0 https://review.openstack.org/495715 | 19:49 |
| *** cylopez has quit IRC | 19:49 | |
| *** eck`gone is now known as eck` | 19:49 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: WIP use pip to install delorean https://review.openstack.org/498074 | 19:52 |
| *** psachin has quit IRC | 19:54 | |
| openstackgerrit | Merged openstack/tripleo-docs master: Remove another outdated note https://review.openstack.org/497688 | 19:55 |
| pabelanger | weshay: EmilienM: so, I have another option you can do for upgrading testing but it would need to be done in 3rd party CI. Basically, today you have to build the undercloud / overcloud in the gate, even before testing can start, that is upwards of 1h20mins. In RDO, you could have nodepool (zuulv3) start launching new images which have already setup the first cloud, then any jobs that runs on it, would just | 19:55 |
| pabelanger | start the upgrade process right away. You'd split up the testing, which is find be you are already gating on the first cloud being setup | 19:55 |
| weshay | pabelanger, exactly | 19:56 |
| weshay | is that possible? | 19:56 |
| weshay | w/ nodepool? | 19:56 |
| weshay | oh.. just in rdo | 19:56 |
| pabelanger | weshay: 3rd party CI nodepool, ya | 19:56 |
| pabelanger | not upstream | 19:56 |
| weshay | matbu, ^ | 19:56 |
| weshay | pabelanger, that is the best way afaict | 19:57 |
| weshay | not fun to keep those images updated | 19:57 |
| weshay | but ya | 19:57 |
| weshay | pabelanger, we were doing something similiar internally for a while | 19:57 |
| pabelanger | weshay: ya, we can talk more about it at PTG, but it wouldn't take much to actually do that in RDO | 19:57 |
| weshay | pabelanger, those rdo infra guys are pretty strict though.. :) | 19:58 |
| pabelanger | weshay: then, you'd need to 3rd party the 3rd party :) | 19:58 |
| weshay | lolz | 19:58 |
| pabelanger | turtles | 19:59 |
| pabelanger | all | 19:59 |
| pabelanger | the | 19:59 |
| pabelanger | way | 19:59 |
| pabelanger | down! | 19:59 |
| EmilienM | hehe | 19:59 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: WIP use pip to install delorean https://review.openstack.org/498074 | 20:02 |
| beekneemech | beagles: puppet-tripleo is probably not configured to git review to the proper branch yet: https://review.openstack.org/#/c/497622/ | 20:02 |
| beagles | beekneemech, hah | 20:03 |
| *** dougbtv_laptop has quit IRC | 20:03 | |
| beagles | beekneemech, thanks for pointing that out | 20:03 |
| *** rcernin has joined #tripleo | 20:04 | |
| *** abishop has joined #tripleo | 20:09 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1689556 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 20:10 |
| openstack | Launchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,Triaged] | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713079 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 20:10 |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 20:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,In progress] - Assigned to John Trowbridge (trown) | 20:10 |
| openstack | Launchpad bug 1713079 in tripleo "modify-image failing on IPA image" [Critical,Triaged] - Assigned to John Trowbridge (trown) | 20:10 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: WIP use pip to install delorean https://review.openstack.org/498074 | 20:13 |
| openstackgerrit | Martin André proposed openstack/puppet-tripleo master: Use TLS proxy for Redis' internal TLS https://review.openstack.org/496616 | 20:14 |
| *** Goneri has joined #tripleo | 20:25 | |
| *** achadha has joined #tripleo | 20:26 | |
| *** jcoufal has quit IRC | 20:27 | |
| *** pradk has joined #tripleo | 20:29 | |
| openstackgerrit | Rajini Karthik proposed openstack/tripleo-heat-templates master: Add support for Dell EMC VMAX ISCSI Backend https://review.openstack.org/489393 | 20:29 |
| *** sbrzozow has quit IRC | 20:31 | |
| *** garyk has quit IRC | 20:31 | |
| weshay | pabelanger, centos.ci keeps failing on installing dlrn via pip :( | 20:32 |
| weshay | we have too much infra | 20:32 |
| pabelanger | weshay: no pypi mirror? | 20:34 |
| weshay | nope | 20:34 |
| weshay | afaik | 20:34 |
| *** achadha has quit IRC | 20:35 | |
| pabelanger | weshay: okay, maybe make it default to pip then override to github.com? At our scale, github.com isn't realiable | 20:35 |
| weshay | this is the BIG leagues | 20:35 |
| weshay | ya.. something like that | 20:35 |
| *** lblanchard has quit IRC | 20:36 | |
| *** rbowen has quit IRC | 20:37 | |
| *** ebarrera has joined #tripleo | 20:39 | |
| *** abishop has quit IRC | 20:40 | |
| *** abishop has joined #tripleo | 20:41 | |
| *** pradk has quit IRC | 20:42 | |
| *** ebarrera has quit IRC | 20:45 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Configure the set of tests to execute in scenario001 https://review.openstack.org/490376 | 20:46 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Configure the set of tests to execute in scenario001 https://review.openstack.org/490376 | 20:46 |
| *** akrivoka has quit IRC | 20:46 | |
| EmilienM | beekneemech: can you look https://review.openstack.org/#/c/496800 when you have time? thx | 20:47 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: WIP use pip to install delorean https://review.openstack.org/498074 | 20:48 |
| *** hewbrocca is now known as hewbrocca_afk | 20:48 | |
| *** hewbrocca_afk is now known as hewbrocca | 20:48 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Make archive policy configurable https://review.openstack.org/496796 | 20:49 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Telemetry specific config for scenario001 https://review.openstack.org/496800 | 20:49 |
| beagles | crap, beekneemech, EmilienM that patch is still messed up I think. it overwrote the patch on the master branch but it's parent is on the pike branch | 20:49 |
| *** garyk has joined #tripleo | 20:49 | |
| *** trown is now known as trown|outtypewww | 20:49 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Configure the set of tests to execute in scenario001 https://review.openstack.org/490376 | 20:49 |
| beagles | I'm going to have to resubmit again | 20:49 |
| EmilienM | weshay: ^ with Depends-on, so we can actually test it | 20:49 |
| EmilienM | weshay: not sure why it wasn't done before | 20:50 |
| EmilienM | beagles: ok | 20:50 |
| openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo master: Repair immediate VF configuration for PCI SR-IOV https://review.openstack.org/497664 | 20:50 |
| *** catintheroof has quit IRC | 20:55 | |
| *** catintheroof has joined #tripleo | 20:56 | |
| *** pradk has joined #tripleo | 21:01 | |
| *** japestinho has quit IRC | 21:01 | |
| pabelanger | EmilienM: weshay: how can I see the logs for virt-customize? http://logs.openstack.org/32/497732/1/gate/gate-tripleo-ci-centos-7-undercloud-oooq/1e89600/console.html#_2017-08-25_20_18_12_066881 | 21:05 |
| pabelanger | I've not see that error before and not sure where they are located | 21:05 |
| *** garyk has quit IRC | 21:07 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1689556 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 21:10 |
| openstack | Launchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,Triaged] | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713079 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 21:10 |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 21:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,In progress] - Assigned to John Trowbridge (trown) | 21:10 |
| openstack | Launchpad bug 1713079 in tripleo "modify-image failing on IPA image" [Critical,Triaged] - Assigned to John Trowbridge (trown) | 21:10 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: WIP use pip to install delorean https://review.openstack.org/498074 | 21:12 |
| apetrich | weshay, I don't think https://review.openstack.org/#/c/497596/ is working. I don't see undercloud/var/lib on the failed run | 21:17 |
| *** itlinux has quit IRC | 21:18 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: WIP create default settings for environment types https://review.openstack.org/495407 | 21:18 |
| *** achadha has joined #tripleo | 21:18 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: WIP use pip to install delorean https://review.openstack.org/498074 | 21:19 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Change devmode to deploy containerized services by default https://review.openstack.org/472412 | 21:20 |
| *** achadha has quit IRC | 21:23 | |
| *** fultonj has quit IRC | 21:24 | |
| *** Goneri has quit IRC | 21:27 | |
| *** dprince has quit IRC | 21:33 | |
| *** leitan has quit IRC | 21:35 | |
| *** tongl has joined #tripleo | 21:37 | |
| *** yamahata has joined #tripleo | 21:38 | |
| *** jmelvin has quit IRC | 21:45 | |
| *** jmelvin has joined #tripleo | 21:47 | |
| *** jfrancoa has quit IRC | 21:51 | |
| *** gbarros has joined #tripleo | 21:57 | |
| *** morazi has quit IRC | 22:00 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 22:00 |
| *** hewbrocca is now known as hewbrocca_afk | 22:01 | |
| *** jmelvin has quit IRC | 22:01 | |
| *** gbarros has quit IRC | 22:08 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1689556 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 22:10 |
| openstack | Launchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,Triaged] | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713079 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 22:10 |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 22:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,In progress] - Assigned to John Trowbridge (trown) | 22:10 |
| openstack | Launchpad bug 1713079 in tripleo "modify-image failing on IPA image" [Critical,Triaged] - Assigned to John Trowbridge (trown) | 22:10 |
| *** ebarrera has joined #tripleo | 22:12 | |
| *** tzumainn has quit IRC | 22:15 | |
| *** ebarrera has quit IRC | 22:18 | |
| *** florianf has quit IRC | 22:20 | |
| *** achadha has joined #tripleo | 22:23 | |
| pabelanger | weshay: EmilienM: There is a regression in the gate: http://logs.openstack.org/92/496292/1/gate/gate-tripleo-ci-centos-7-undercloud-oooq/efaddb7/console.html#_2017-08-25_22_05_55_447445 | 22:24 |
| pabelanger | EmilienM: weshay: something changed in the last 24-36 hours, because 2017-08-23T15:16:54.206-04:00 is the first hit on failure in logstash.o.o | 22:25 |
| pabelanger | I also cannot find log files for that | 22:26 |
| *** achadha has quit IRC | 22:26 | |
| *** achadha has joined #tripleo | 22:26 | |
| *** achadha has quit IRC | 22:26 | |
| *** achadha has joined #tripleo | 22:27 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Update .gitreview for stable/pike https://review.openstack.org/497622 | 22:30 |
| EmilienM | pabelanger: let me look | 22:31 |
| *** deadnull has joined #tripleo | 22:34 | |
| pabelanger | EmilienM: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22***%20Image%20Build%20Error%20***%5C%22%20AND%20tags%3A%5C%22console%5C%22 is the logstash query | 22:36 |
| *** achadha_ has joined #tripleo | 22:50 | |
| *** achadha has quit IRC | 22:51 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Update UPPER_CONSTRAINTS_FILE for stable/pike https://review.openstack.org/497623 | 23:05 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Update reno for stable/pike https://review.openstack.org/497624 | 23:05 |
| openstackgerrit | Merged openstack/os-collect-config master: Updated from global requirements https://review.openstack.org/497062 | 23:06 |
| pabelanger | http://logs.openstack.org/00/496300/1/gate/gate-tripleo-ci-centos-7-undercloud-oooq/520847d/console.html | 23:07 |
| pabelanger | 3 failure in a row | 23:08 |
| pabelanger | starting to back up the gate, we are hitting almost 9 hours now | 23:08 |
| *** ebarrera has joined #tripleo | 23:10 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1689556 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1691403 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1702955 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1712436 | 23:10 |
| openstack | Launchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [Critical,Triaged] | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1713079 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1691403 in tripleo "containerized overcloud - neutron-openvswitchagent fails to start" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker) | 23:10 |
| openstack | Launchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 23:10 |
| openstack | Launchpad bug 1712436 in tripleo "stable/newton gate-tripleo-ci-centos-7-nonha-multinode-oooq is broken due to Controller create timeout" [Critical,In progress] - Assigned to John Trowbridge (trown) | 23:10 |
| openstack | Launchpad bug 1713079 in tripleo "modify-image failing on IPA image" [Critical,Triaged] - Assigned to John Trowbridge (trown) | 23:10 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add panko publisher in the event pipeline https://review.openstack.org/496723 | 23:13 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Enable ceilometer compute agent https://review.openstack.org/497835 | 23:14 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Move multinode overcloud user to multinode settings https://review.openstack.org/496675 | 23:14 |
| *** rlandy has quit IRC | 23:15 | |
| *** ebarrera has quit IRC | 23:15 | |
| *** catintheroof has quit IRC | 23:17 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add panko publisher in the event pipeline https://review.openstack.org/498118 | 23:19 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Enable ceilometer compute agent https://review.openstack.org/498119 | 23:20 |
| pabelanger | EmilienM: mwhahaha: weshay: so, http://status.openstack.org/elastic-recheck/data/others.html in fact was the first job to see the error, back on Aug. 23. However, it appears people have just ignored the failure but issues rechecks. Maybe on monday we can all get into a bluejeans and discuss a plan for stopping blind 'recheck' and leveraging elastic-recheck more. I know it is still early in the usage of | 23:20 |
| pabelanger | elastic-recheck, and possible not everybody knows how to use it / it works. | 23:20 |
| EmilienM | pabelanger: yes | 23:21 |
| pabelanger | sorry: https://review.openstack.org//469608 was the first patch | 23:21 |
| *** rcernin has quit IRC | 23:23 | |
| *** yamahata has quit IRC | 23:24 | |
| pabelanger | bug 1713167 | 23:24 |
| openstack | bug 1713167 in tripleo "build-images : Throw error msg if image build is failing *** Image Build Error ***" [Undecided,New] https://launchpad.net/bugs/1713167 | 23:24 |
| pabelanger | creating elastic-recheck query now | 23:24 |
| *** ebarrera has joined #tripleo | 23:45 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Override STABLE_RELEASE when testing puppet-ceph stable/jewel https://review.openstack.org/498123 | 23:46 |
| *** ebarrera has quit IRC | 23:51 | |
| *** tosky has quit IRC | 23:54 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
