| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO https://review.openstack.org/602248 | 00:00 |
|---|---|---|
| *** Chaserjim has joined #tripleo | 00:04 | |
| *** Chaserjim has quit IRC | 00:08 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 00:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 00:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 00:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 00:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 00:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 00:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 00:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 00:10 |
| *** Chaserjim has joined #tripleo | 00:16 | |
| *** mcornea has quit IRC | 00:22 | |
| openstackgerrit | caoyuan proposed openstack/puppet-pacemaker master: Update overriden to overridden https://review.openstack.org/571415 | 00:24 |
| openstackgerrit | caoyuan proposed openstack/puppet-pacemaker master: Remove the duplicated "the" https://review.openstack.org/576347 | 00:24 |
| *** tzumainn has quit IRC | 00:42 | |
| *** dxiri has joined #tripleo | 00:43 | |
| *** rh-jelabarre has quit IRC | 00:59 | |
| *** Chaserjim has quit IRC | 01:03 | |
| *** jaganathan has quit IRC | 01:03 | |
| *** Chaserjim has joined #tripleo | 01:03 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 01:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 01:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 01:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 01:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 01:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 01:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 01:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 01:10 |
| *** Chaserjim has quit IRC | 01:15 | |
| *** Chaserjim has joined #tripleo | 01:16 | |
| *** Chaserjim has quit IRC | 01:24 | |
| *** bfournie has joined #tripleo | 01:26 | |
| *** Chaserjim has joined #tripleo | 01:29 | |
| *** Chaserjim has quit IRC | 01:34 | |
| *** mrsoul has quit IRC | 01:35 | |
| *** mschuppert has quit IRC | 01:37 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 02:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 02:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 02:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 02:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 02:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 02:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 02:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 02:10 |
| *** slaweq has joined #tripleo | 02:11 | |
| *** slaweq has quit IRC | 02:16 | |
| *** ramishra has joined #tripleo | 02:18 | |
| *** rlandy|bbl is now known as rlandy | 02:23 | |
| *** pvc has joined #tripleo | 02:24 | |
| *** dxiri has quit IRC | 02:32 | |
| *** saneax has joined #tripleo | 02:43 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: use a more stable centos repo for k8s and container rpms https://review.openstack.org/603273 | 02:43 |
| weshay | stevebaker, double check that ^ to see if will be ok for you guys and PODMAN | 02:52 |
| *** apetrich has quit IRC | 02:52 | |
| *** ykarel|away has joined #tripleo | 03:01 | |
| *** ykarel|away has quit IRC | 03:07 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 03:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 03:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 03:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 03:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 03:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 03:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 03:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 03:10 |
| *** pvc has quit IRC | 03:21 | |
| *** Chaserjim has joined #tripleo | 03:33 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO https://review.openstack.org/603275 | 03:35 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: automatically build a test package when only CI is changed https://review.openstack.org/603277 | 03:38 |
| *** rlandy has quit IRC | 03:42 | |
| *** Chaserjim has quit IRC | 03:42 | |
| *** Chaserjim has joined #tripleo | 03:43 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: automatically build a test package when only CI is changed https://review.openstack.org/603277 | 03:46 |
| *** rlandy has joined #tripleo | 03:50 | |
| *** rlandy has quit IRC | 03:53 | |
| *** udesale has joined #tripleo | 03:53 | |
| *** sri_ has quit IRC | 03:54 | |
| *** sri_ has joined #tripleo | 03:55 | |
| *** ykarel|away has joined #tripleo | 04:08 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 04:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 04:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 04:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 04:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 04:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 04:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 04:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 04:10 |
| *** slaweq has joined #tripleo | 04:11 | |
| *** slaweq has quit IRC | 04:16 | |
| *** Petersingh has joined #tripleo | 04:25 | |
| *** Chaserjim has quit IRC | 04:34 | |
| *** ykarel|away has quit IRC | 04:34 | |
| *** Petersingh is now known as Petersingh|afk | 04:35 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Switch containerized undercloud job to nv https://review.openstack.org/603187 | 04:36 |
| *** Chaserjim has joined #tripleo | 04:42 | |
| *** ykarel|away has joined #tripleo | 04:53 | |
| *** jaosorior has joined #tripleo | 04:54 | |
| *** skramaja has joined #tripleo | 04:55 | |
| *** ykarel|away is now known as ykarel | 04:55 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Create interface to create mysql resources via hieradata https://review.openstack.org/600000 | 04:57 |
| *** Chaserjim has quit IRC | 04:59 | |
| cgoncalves | jaosorior++ :) | 05:02 |
| jaosorior | cgoncalves: keeping track of your patches | 05:02 |
| cgoncalves | jaosorior, I appreciate a lot! | 05:02 |
| *** shyamb has joined #tripleo | 05:02 | |
| *** Chaserjim has joined #tripleo | 05:03 | |
| cgoncalves | btw the PermissionError from Ceph to Glance is fixed: https://review.openstack.org/#/c/592938/8..9/ci/environments/scenario010-multinode-containers.yaml | 05:03 |
| jaosorior | nice! | 05:04 |
| *** Petersingh|afk is now known as Petersingh | 05:06 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/python-tripleoclient master: Add some client libraries as requirements https://review.openstack.org/603162 | 05:07 |
| *** Chaserjim has quit IRC | 05:07 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 05:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 05:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 05:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 05:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 05:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 05:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 05:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 05:10 |
| *** yprokule has joined #tripleo | 05:10 | |
| *** Chaserjim has joined #tripleo | 05:12 | |
| *** shyamb has quit IRC | 05:14 | |
| *** Chaserjim has quit IRC | 05:16 | |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Enhance undercloud reboot procedure for baremetal https://review.openstack.org/603155 | 05:17 |
| *** jaganathan_ has joined #tripleo | 05:17 | |
| *** shyamb has joined #tripleo | 05:20 | |
| *** Chaserjim has joined #tripleo | 05:20 | |
| *** ratailor has joined #tripleo | 05:23 | |
| jaosorior | mandre: around? | 05:24 |
| chkumar|ruck | ykarel: seen this one http://logs.openstack.org/45/560445/143/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/2f42063/logs/undercloud/var/lib/mistral/overcloud/ansible.log.txt.gz#_2018-09-17_18_57_25_921 | 05:25 |
| chkumar|ruck | it appears issue with tripleo-container-image-prepare | 05:25 |
| *** pvc has joined #tripleo | 05:27 | |
| pvc | hi guys | 05:27 |
| pvc | ykarel? | 05:28 |
| *** quique|rover|off is now known as quiquell|rover | 05:31 | |
| *** jtomasek has joined #tripleo | 05:35 | |
| quiquell|rover | Good morning | 05:36 |
| *** shyamb has quit IRC | 05:36 | |
| chkumar|ruck | quiquell|rover: Good morning :-) | 05:37 |
| *** shyamb has joined #tripleo | 05:38 | |
| pvc | quiquell hi | 05:41 |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates stable/queens: Add NeutronSriovHostConfig mapping to neutron-sriov.yaml file https://review.openstack.org/597985 | 05:43 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Add BlacklistedHostnames stack output https://review.openstack.org/599067 | 05:45 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Add BlacklistedIpAddresses stack output https://review.openstack.org/599068 | 05:45 |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Support deployment blacklist with --limit https://review.openstack.org/599069 | 05:45 |
| *** holser_ has joined #tripleo | 05:45 | |
| ykarel | chkumar|ruck, that also mirror issue: http://logs.openstack.org/45/560445/143/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/2f42063/logs/undercloud/var/lib/mistral/overcloud/tripleo-container-image-prepare.log.txt.gz | 05:47 |
| quiquell|rover | chkumar|ruck: upgrade on ceph-ansible did not fix fs019 in master :-( | 05:48 |
| pvc | ykarel can i ask please ;( | 05:49 |
| ykarel | pvc, hi | 05:49 |
| jaosorior | jbadiapa: any suggestion on how to get this to work in centos https://review.openstack.org/#/c/599574/1 ? it's breaking in fedora :/ | 05:50 |
| pvc | hi ykarel. im on the part of overcloud and it seems that the introspection is failing on my baremetal nodes. It just saying power on and manageable state | 05:50 |
| chkumar|ruck | quiquell|rover: we are still seeing ironic ovb jobs failure as we seen yesterday | 05:50 |
| quiquell|rover | chkumar|ruck: At least now we have logs at te-broker | 05:51 |
| quiquell|rover | chkumar|ruck: Going to dig into the fs019 issue :-( | 05:51 |
| ykarel | pvc, what command u ran which failed | 05:51 |
| ykarel | pvc, share ur instackenv.json, and output of: openstack baremetal node show <node name> | 05:52 |
| pvc | here ykarel openstack overcloud node import --introspect --provide instackenv.json | 05:53 |
| *** Chaserjim has quit IRC | 05:55 | |
| pvc | the ipmi connection is fine | 05:55 |
| ykarel | pvc, share: openstack baremetal node show <node name> and ironic-inspector logs | 05:58 |
| pvc | noted ykarel wait | 05:58 |
| *** ksambor has joined #tripleo | 06:00 | |
| chkumar|ruck | quiquell|rover: https://logs.rdoproject.org/24/567224/108/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens/eb39d51/logs/undercloud/var/log/ironic-inspector/ironic-inspector.log.txt.gz#_2018-09-18_00_58_25_777 it also appears to be ovb ironic node issue | 06:03 |
| *** psachin has joined #tripleo | 06:06 | |
| *** jfrancoa has joined #tripleo | 06:06 | |
| *** shyamb has quit IRC | 06:07 | |
| quiquell|rover | chkumar|ruck: ack, add it to the lp | 06:07 |
| *** janki has joined #tripleo | 06:08 | |
| *** jtomasek has quit IRC | 06:09 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 06:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 06:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 06:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 06:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 06:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 06:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 06:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 06:10 |
| *** mschuppert has joined #tripleo | 06:11 | |
| chkumar|ruck | quiquell|rover: I think we can move http://zuul.openstack.org/builds.html?job_name=tripleo-ci-centos-7-containerized-undercloud-upgrades this job to non-voting as last night wes was saying | 06:13 |
| chkumar|ruck | failure rate is too high | 06:13 |
| *** jtomasek has joined #tripleo | 06:14 | |
| quiquell|rover | chkumar|ruck: The reviews to fix it and go non-voting are in the gates I think | 06:14 |
| chkumar|ruck | quiquell|rover: what you say??? | 06:14 |
| *** phuongnh has joined #tripleo | 06:14 | |
| quiquell|rover | chkumar|ruck: https://trello.com/c/eAdupJ8I/745-cixlp1792892tripleociproa-undercloud-upgrades-fails-at-error-invalid-callback-for-stdout-specified-yaml | 06:14 |
| quiquell|rover | weshay: added stuff there | 06:14 |
| chkumar|ruck | quiquell|rover: https://review.openstack.org/#/c/603187/ | 06:14 |
| quiquell|rover | weshay: with a lot of reverts | 06:14 |
| quiquell|rover | chkumar|ruck: So it's already non voting | 06:15 |
| chkumar|ruck | https://review.openstack.org/#/c/601522/4 manila tempest issue get fixed then we will have a pike promotion also i think | 06:16 |
| quiquell|rover | chkumar|ruck: Looks like if this https://review.openstack.org/#/c/603181/ and this https://review.openstack.org/#/c/602751/ get merged | 06:16 |
| quiquell|rover | chkumar|ruck: uc containerized upgrades will work | 06:16 |
| quiquell|rover | chkumar|ruck: Let's remove it from promotion criteria ? | 06:17 |
| mandre | jaosorior: around now, what's up? | 06:18 |
| chkumar|ruck | quiquell|rover: Let's see if recheck passes or if not then we can remove | 06:18 |
| quiquell|rover | chkumar|ruck: ack | 06:19 |
| *** slaweq has joined #tripleo | 06:19 | |
| jaosorior | mandre: hey! just got back to work :D I was remember your patch https://review.openstack.org/#/c/602063/2/manifests/haproxy.pp where you couldn't use the t-h-t hook. I was wondering what error you had, to see if we could fix it up so it's usable from t-h-t instead. | 06:20 |
| *** rdopiera has joined #tripleo | 06:21 | |
| mandre | jaosorior: hehe, my issue was that I was trying to add two endpoints in the same template file, and because of that I couldn't use the service name to fill the ip addresses and server names | 06:22 |
| mandre | since the endpoint needs to match exactly the service name for that to happen | 06:22 |
| jaosorior | mandre: right, and passing the hiera call yourself didn't work either, what was that error? | 06:23 |
| *** cylopez has joined #tripleo | 06:24 | |
| mandre | jaosorior: nope, that doesn't work because ip addresses and server names are arrays, and are thus interpolated with escaped square brackets in hiera | 06:24 |
| jaosorior | mandre: so, does it end up as a string? | 06:25 |
| mandre | yeah | 06:25 |
| jaosorior | uhm, maybe calling any2array would help there | 06:25 |
| mandre | nope, that wouldn't, because it's not a top level value, but is part of a bigger string value | 06:26 |
| ykarel | chkumar|ruck, that ironic logs doesn't seems to related to ovb, those related to rootwrap filters | 06:26 |
| mandre | there is no way to get it to work with hiera, the only way would be to pass the values directly in the template (so get it from heat) | 06:26 |
| ykarel | chkumar|ruck, so seems a real issue | 06:27 |
| jaosorior | mandre: I didn't get that part, what do you mean it's not a top level value? | 06:27 |
| mandre | jaosorior: pulling out an example | 06:27 |
| mandre | jaosorior: at some point I had something like https://review.openstack.org/#/c/601241/2/extraconfig/services/openshift-infra.yaml@61 | 06:29 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: TEST: filter ip_addresses and server_names through any2array https://review.openstack.org/603291 | 06:29 |
| jaosorior | mandre: so this wouldn't work? ^^ | 06:29 |
| *** phuongnh has quit IRC | 06:29 | |
| mandre | jaosorior: hmm I didn't try ^^, I tried any2array in the template directly | 06:31 |
| jaosorior | mandre: yeah, I guess the issue is that the function calls you can do from hiera are quite limited | 06:31 |
| jaosorior | but it might work if we bake it directly into the puppet manifest | 06:31 |
| mandre | this could work, yeah -- I'll give it a try | 06:32 |
| jaosorior | mandre: let me know if that works; if it works, I can write a proper commit message, tests, and maybe even merge it closing a proper launchpad bug. | 06:33 |
| pvc | ykarel another question is cyborg supported in tripleo? | 06:34 |
| ykarel | pvc, no idea | 06:35 |
| pvc | i see wait for the logs | 06:35 |
| pvc | i reinstall all | 06:35 |
| pvc | im in the part of undercloud | 06:35 |
| *** jtomasek has quit IRC | 06:35 | |
| *** quiquell|rover is now known as quique|rover|brb | 06:36 | |
| ykarel | chkumar|ruck, that ironic issue needs one more queens promotion | 06:37 |
| *** jhebden has quit IRC | 06:38 | |
| ykarel | pvc, ack | 06:38 |
| *** shyamb has joined #tripleo | 06:38 | |
| pvc | ack | 06:38 |
| *** jhebden has joined #tripleo | 06:42 | |
| *** akrivoka has joined #tripleo | 06:45 | |
| *** jtomasek has joined #tripleo | 06:46 | |
| chkumar|ruck | ykarel: you means queens fs01 issue? | 06:48 |
| chkumar|ruck | dtantsur|afk: Hello | 06:48 |
| chkumar|ruck | dtantsur|afk: please have a look at this issue https://logs.rdoproject.org/24/567224/108/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens/eb39d51/logs/undercloud/var/log/ironic-inspector/ironic-inspector.log.txt.gz#_2018-09-18_00_58_25_777 | 06:49 |
| jaosorior | pvc: it's not supported AFAIK | 06:50 |
| ykarel | chkumar|ruck, yes as per the logs, but still not sure how it passed in promotion job | 06:52 |
| chkumar|ruck | ykarel: it is appearing today I have 3 jobs failure related to same | 06:54 |
| chkumar|ruck | ykarel: filing a new bug | 06:55 |
| ykarel | chkumar|ruck, https://review.openstack.org/#/c/598229/ should have caused it that, and it explains why it passed in promotion job | 06:55 |
| ykarel | so if u can compare instack-undercloud version in all three failures to confirm that it's related | 06:56 |
| chkumar|ruck | ack checking | 06:56 |
| ykarel | chkumar|ruck, anyway looks like with next promotion it will be fixed with next promotion as it will get ironic-inspector commit: https://review.openstack.org/#/c/598433/ | 06:57 |
| chkumar|ruck | ack | 06:58 |
| *** assassin has joined #tripleo | 06:59 | |
| ykarel | still bug for it is good and right people from ironic on it to confirm the issue and monitor | 06:59 |
| chkumar|ruck | ykarel: https://github.com/openstack/instack-undercloud/commit/40ede6260cd56ed74a6d61cfac0a6a7c03fb5dc8 -> the jobs are failing | 07:01 |
| chkumar|ruck | above review confirms that | 07:01 |
| ykarel | chkumar|ruck, okk cool | 07:01 |
| *** jtomasek has quit IRC | 07:01 | |
| *** quique|rover|brb is now known as quiquell|rover | 07:02 | |
| *** rcernin has quit IRC | 07:03 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 07:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 07:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 07:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 07:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to Mehdi Abaakouk (sileht) | 07:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 07:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 07:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 07:10 |
| chkumar|ruck | dtantsur|afk: I have added the bug here https://bugs.launchpad.net/tripleo/+bug/1793073 please have a look | 07:11 |
| openstack | Launchpad bug 1793073 in tripleo "[queens] fs01 periodic job failed with Stderr: u'/usr/bin/ironic-inspector-rootwrap: Unauthorized command: systemctl start openstack-ironic-inspector-dnsmasq.service (no filter matched)" [Critical,Triaged] | 07:11 |
| chkumar|ruck | quiquell|rover: ^^ queens promotion blocker | 07:11 |
| ykarel | mmm how this is blocking can't get that | 07:13 |
| *** saneax has quit IRC | 07:13 | |
| ykarel | if im correct about the need for a new promotion then it's not a blocker | 07:14 |
| quiquell|rover | chkumar|ruck: ack, assign it to me, I am still digging fs019 master | 07:14 |
| *** cylopez has left #tripleo | 07:15 | |
| chkumar|ruck | fyi fs020 master is also affected with telemetry issue | 07:17 |
| *** shyamb has quit IRC | 07:22 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Revert "Add ability to have dlrn build all the packages at once" https://review.openstack.org/602751 | 07:24 |
| chkumar|ruck | slaweq: Hello | 07:26 |
| chkumar|ruck | slagle: on Fs020 master two neutron tests are failing | 07:26 |
| chkumar|ruck | sorry | 07:26 |
| chkumar|ruck | slaweq: on Fs020 master two neutron tests are failing | 07:27 |
| slaweq | chkumar|ruck: hi | 07:27 |
| chkumar|ruck | slaweq: https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/ff12cd1/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-09-18_05_06_27 | 07:27 |
| chkumar|ruck | slaweq: https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/ff12cd1/logs/overcloud-controller-0/var/log/containers/neutron/l3-agent.log.txt.gz#_2018-09-18_05_20_47_520 | 07:27 |
| slaweq | chkumar|ruck: I can check that but later today | 07:28 |
| slaweq | I need to check something else now | 07:28 |
| slaweq | is it fine for You? | 07:28 |
| chkumar|ruck | slaweq: ok, will open a bug, I will try to add more info there | 07:29 |
| chkumar|ruck | slaweq: thanks :-) | 07:29 |
| slaweq | chkumar|ruck: thx | 07:29 |
| *** ykarel is now known as ykarel|lunch | 07:31 | |
| *** Petersingh is now known as Petersingh|lunch | 07:35 | |
| *** aufi has joined #tripleo | 07:36 | |
| *** pvc has quit IRC | 07:38 | |
| *** gkadam has joined #tripleo | 07:39 | |
| *** jpich has joined #tripleo | 07:40 | |
| *** paramite|clone has joined #tripleo | 07:47 | |
| *** jpena|off is now known as jpena | 07:50 | |
| *** bogdando has joined #tripleo | 07:50 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Do not enforce libguestfs emulation mode https://review.openstack.org/595566 | 07:51 |
| *** agopi has quit IRC | 07:54 | |
| *** amoralej|off is now known as amoralej | 07:57 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 08:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 08:00 |
| *** kopecmartin has joined #tripleo | 08:00 | |
| chkumar|ruck | quiquell|rover: please have a look at this one https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-rocky/4c5589f/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-09-18_03_53_16 | 08:05 |
| chkumar|ruck | I am not sure why connection closed | 08:05 |
| quiquell|rover | chkumar|ruck: no clue, I am still with the fs019 | 08:08 |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 08:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 08:10 |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 08:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 08:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix committed] - Assigned to Mehdi Abaakouk (sileht) | 08:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 08:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 08:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 08:10 |
| openstackgerrit | Merged openstack/tripleo-common master: Fix formatting options https://review.openstack.org/597723 | 08:12 |
| quiquell|rover | bandini: ceph-ansible 3.1.3 does not fix https://bugs.launchpad.net/tripleo/+bug/1792296 | 08:12 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 08:12 |
| quiquell|rover | bandini: Maybe we have to update ceph container image ? | 08:13 |
| quiquell|rover | bandini: I have found this https://github.com/ceph/ceph-container/commit/24bd34a6ed748d390c889bf07acc8b02c931f37d | 08:13 |
| quiquell|rover | bandini: It's about using ceph.conf for some of the parameters in the docker image, but I don't know what have we change | 08:13 |
| *** tosky has joined #tripleo | 08:16 | |
| *** psachin has quit IRC | 08:22 | |
| *** ykarel|lunch is now known as ykarel | 08:25 | |
| *** saneax has joined #tripleo | 08:27 | |
| *** hamdyk has joined #tripleo | 08:28 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-common master: Upgrade ceph docker image https://review.openstack.org/603322 | 08:28 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Upgrade ceph docker image https://review.openstack.org/603323 | 08:29 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-common master: Upgrade ceph docker image https://review.openstack.org/603322 | 08:30 |
| quiquell|rover | chkumar|ruck: Now that I think of, scenario004 is passing upstream... | 08:36 |
| quiquell|rover | chkumar|ruck: It only fails at RDO ? | 08:36 |
| quiquell|rover | chkumar|ruck: How do I enforce to run legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master | 08:37 |
| quiquell|rover | Ahh ok new components version maybe... ? | 08:38 |
| *** Petersingh|lunch is now known as Petersingh | 08:38 | |
| bandini | quiquell|rover: we need to check with gfidente once he gets online then | 08:40 |
| bandini | I am totally unclued about ceph | 08:40 |
| quiquell|rover | bandini: ack, I am testing new docker version... but don't know why promotion jobs are failing but upstream is good | 08:40 |
| quiquell|rover | bandini: Maybe we have one of the dlrn rpms updated tha breaks scenario004 ? | 08:41 |
| *** chem has joined #tripleo | 08:41 | |
| bandini | maybe, yes. I hope gfidente can clue us in | 08:41 |
| quiquell|rover | bandini: going to check RPMs version between working and non working | 08:41 |
| bandini | I don't see him on PTO in the calendar so he should show up sometime today | 08:41 |
| bandini | ack | 08:42 |
| *** shyamb has joined #tripleo | 08:45 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: TEST: Introduce alternative to get ip_addresses and server_names https://review.openstack.org/603291 | 08:46 |
| jaosorior | mandre: what about this? ^^ | 08:46 |
| *** derekh has joined #tripleo | 08:49 | |
| *** saneax has quit IRC | 08:50 | |
| *** saneax has joined #tripleo | 08:52 | |
| quiquell|rover | chkumar|ruck, ykarel: Can I add a Depends-On here https://review.rdoproject.org/r/#/c/13943 to test a job against some changes ? | 08:54 |
| chkumar|ruck | quiquell|rover: yes | 08:54 |
| quiquell|rover | chkumar|ruck: ok | 08:54 |
| ykarel | it depends on the change though, but can try | 08:55 |
| quiquell|rover | ykarel: upstream change on tripleo-common and tqe | 08:55 |
| quiquell|rover | ykarel: https://review.openstack.org/#/c/603323/ | 08:56 |
| ykarel | quiquell|rover, tqe should be fine, for tripleo-common i think i had a patch | 08:56 |
| ykarel | let me check if that's merged | 08:56 |
| mandre | jaosorior: yay that works \o/ | 08:57 |
| mandre | and it makes the interface much nicer too | 08:57 |
| quiquell|rover | ykarel: Di you update ceph image ? | 08:57 |
| ykarel | quiquell|rover, nope | 08:57 |
| ykarel | quiquell|rover, i am talking about what needs to test depends-on | 08:57 |
| ykarel | also add https://review.openstack.org/#/c/596618/ as a depend-on on testproject while u test tripleo-common change | 08:58 |
| quiquell|rover | ykarel: ok, build-test-package have to be call, to re-construct tripleo-common I think | 08:58 |
| ykarel | atleast that was required for tripleo-heat-templates c | 08:58 |
| quiquell|rover | ykarel: will try thanks | 08:59 |
| *** pvc has joined #tripleo | 09:01 | |
| pvc | is there a chance that the cyborg will be implement in tripleo? | 09:02 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Introduce alternative to get ip_addresses and server_names https://review.openstack.org/603291 | 09:03 |
| jaosorior | mandre: updated the commit message ^^ not entirely sure how to test the hiera call though, any ideas? | 09:03 |
| jaosorior | I mean, test it in our spec tests. | 09:03 |
| jaosorior | Tengu: ^^ | 09:04 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: bump ansible to 2.6.3 https://review.openstack.org/596282 | 09:05 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: bump ansible to 2.6.4 https://review.openstack.org/596282 | 09:06 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Configure haproxy for openshift infra https://review.openstack.org/601241 | 09:08 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 09:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 09:10 |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 09:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 09:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix committed] - Assigned to Mehdi Abaakouk (sileht) | 09:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 09:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 09:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 09:10 |
| mandre | jaosorior: you've picked the wrong guy to ask puppet questions :-/ | 09:15 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Introduce alternative to get ip_addresses and server_names https://review.openstack.org/603291 | 09:16 |
| jaosorior | mandre: thanks for the feedback, updated the patch ^^ | 09:16 |
| *** kopecmartin has quit IRC | 09:26 | |
| openstackgerrit | Martin Schuppert proposed openstack/puppet-tripleo master: WIP - add support for native TLS encryption on NBD for disk migration https://review.openstack.org/603341 | 09:28 |
| *** ksambor has quit IRC | 09:28 | |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: WIP - add support for native TLS encryption on NBD for disk migration https://review.openstack.org/603343 | 09:31 |
| *** ksambor has joined #tripleo | 09:33 | |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: WIP - add support for native TLS encryption on NBD for disk migration https://review.openstack.org/603343 | 09:33 |
| *** shardy has joined #tripleo | 09:34 | |
| *** dtantsur|afk is now known as dtantsur | 09:36 | |
| dtantsur | chkumar|ruck: I'll redirect https://bugs.launchpad.net/tripleo/+bug/1793073 to hjensas, he was the last to touch that code | 09:37 |
| openstack | Launchpad bug 1793073 in tripleo "[queens] fs01 periodic job failed with Stderr: u'/usr/bin/ironic-inspector-rootwrap: Unauthorized command: systemctl start openstack-ironic-inspector-dnsmasq.service (no filter matched)" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 09:37 |
| chkumar|ruck | dtantsur: thanks :-) | 09:38 |
| dtantsur | chkumar|ruck: it must be related to https://github.com/openstack/ironic-inspector/commit/04dc40d4c84ac2d7bf2c0747a247c1749299133d | 09:39 |
| *** saneax has quit IRC | 09:39 | |
| dtantsur | I wonder if RDO ships the new file | 09:39 |
| *** saneax has joined #tripleo | 09:39 | |
| *** saneax has quit IRC | 09:40 | |
| *** saneax has joined #tripleo | 09:41 | |
| jaosorior | mandre: thanks for the patience on that patch. | 09:44 |
| *** shardy has quit IRC | 09:46 | |
| *** shyamb has quit IRC | 09:46 | |
| *** shyamb has joined #tripleo | 09:47 | |
| *** iranzo has joined #tripleo | 09:49 | |
| ykarel | dtantsur, in RDO consistent that file is there, but in current-tripleo it's not there | 09:49 |
| ykarel | so as soon as next promotion happens, those jobs should pass | 09:50 |
| *** ykarel is now known as ykarel|away | 09:50 | |
| *** ykarel|away is now known as ykarel|afk | 09:51 | |
| jaosorior | iranzo: saw you added me to the citellus patch; mind adding more details such as docs to the patch itself? I did find some demo made by you https://asciinema.org/a/169814 | 09:56 |
| jaosorior | but it would be nice to have more details than that :) | 09:56 |
| iranzo | hi, I will ping weshay as he added it as PoC | 09:56 |
| jaosorior | sure | 09:56 |
| iranzo | jaosorior: woudl you like me to update the commit update with the information | 09:56 |
| iranzo | ? | 09:56 |
| iranzo | would that be ok? | 09:56 |
| jaosorior | sure | 09:56 |
| iranzo | thanks a lot! | 09:56 |
| iranzo | doing it... | 09:56 |
| jaosorior | iranzo: also, if you want to bring it up to today's meeting, feel free to do that, might bring more visibility to that work | 09:56 |
| iranzo | the operators one? | 09:57 |
| jaosorior | nah, the tripleo one (which is today); just in case you want more tripleo folks to be aware of that work. | 09:57 |
| iranzo | I'll try to find the details fo rit | 09:58 |
| jaosorior | iranzo: https://wiki.openstack.org/wiki/Meetings/TripleO | 09:58 |
| iranzo | added to my calendar, thanks jaosorior++ | 09:59 |
| *** mhenkel_ has joined #tripleo | 10:00 | |
| jaosorior | iranzo: feel free to add items here https://etherpad.openstack.org/p/tripleo-meeting-items | 10:00 |
| mhenkel_ | Hi All, any tips on how to troubleshoot a stuck stack update? I tried to scale compute nodes and the stack is in UPDATE_IN_PROGRESS for resources overcloud-AllNodesDeploySteps-224azt3wfzqe and overcloud for an hour now | 10:01 |
| *** kopecmartin has joined #tripleo | 10:02 | |
| *** gkadam has quit IRC | 10:02 | |
| jaosorior | mhenkel_: I think your best bet is to figure out which node is stuck, ssh to it, and try to track down which operation is problematic through the logs (journald) | 10:02 |
| *** gkadam has joined #tripleo | 10:04 | |
| openstackgerrit | Pablo Iranzo Gómez proposed openstack/tripleo-quickstart-extras master: POC, citellus support https://review.openstack.org/553571 | 10:06 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Configure undercloud for containerized upgrade. https://review.openstack.org/603151 | 10:07 |
| mhenkel_ | jaosorior: any good way on how to figure out the node from AllNodesDeploySteps > | 10:08 |
| *** quiquell|rover has quit IRC | 10:08 | |
| mhenkel_ | I have ~20 nodes in the stack | 10:08 |
| jaosorior | mhenkel_: what release is it? | 10:08 |
| mhenkel_ | queens | 10:08 |
| *** quiquell has joined #tripleo | 10:09 | |
| jaosorior | you could do, openstack stack resource list -n 5 | grep PROG, to figure out which resources are still in progress; from the resource index you can derive which node is the problematic one, IIRC | 10:09 |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 10:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 10:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 10:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 10:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix committed] - Assigned to Mehdi Abaakouk (sileht) | 10:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 10:10 |
| mhenkel_ | I did openstack stack resource list overcloud -n 5 > list | 10:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 10:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 10:10 |
| mhenkel_ | jaosorior: and grep -v COMPLETE list gives me only: AllNodesDeploySteps | 10:11 |
| jaosorior | beagles: if you have some time; I do have a tripleo deployment with the nova-metadata issue we talked about in Denver. | 10:11 |
| jaosorior | mhenkel_: is that it? | 10:11 |
| mhenkel_ | yes | 10:11 |
| mhenkel_ | AllNodesDeploySteps | bd7af8ab-608d-4ffa-a11e-1bcc5193aaf4 | OS::TripleO::PostDeploySteps | 10:12 |
| mhenkel_ | | UPDATE_IN_PROGRESS | 2018-09-18T08:56:49Z | overcloud | 10:12 |
| rook | EmilienM: mwhahaha does Rocky not have a timeout for deployment? | 10:18 |
| jaosorior | mhenkel_ uhm... that resource should be ran by all the nodes, and it's where the configurations get executed. I would have expected some sub-resource whithin that to still be running; but if that stack is the one that's stuck, it sounds to me like it might be a Heat issue. I'm unsure how to debug that further unfortunately. | 10:19 |
| *** gkadam has quit IRC | 10:21 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Configure haproxy for openshift infra https://review.openstack.org/601241 | 10:21 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Use openshift-ansible container instead of RPMs https://review.openstack.org/583868 | 10:21 |
| therve | mhenkel_: What does "openstack software deployment list" give you? | 10:23 |
| *** shyamb has quit IRC | 10:26 | |
| mhenkel_ | therve: a very long list ;) | 10:26 |
| mhenkel_ | just checking it | 10:26 |
| pvc | 2018-09-18 05:28:04,025 INFO: /tmp/tmpeeuy9l/pre-install.d/05-rpm-epel-release: line 9: DISTRO_NAME: unbound variable | 10:28 |
| pvc | ykarel 2018-09-18 05:28:04,025 INFO: /tmp/tmpeeuy9l/pre-install.d/05-rpm-epel-release: line 9: DISTRO_NAME: unbound variable | 10:28 |
| mhenkel_ | there are some failed software deployments but all from previous failed updates | 10:30 |
| mhenkel_ | for the current run all software deployments are CREATE_COMPLETE | 10:30 |
| pvc | thats for me? | 10:30 |
| *** kopecmartin has quit IRC | 10:31 | |
| *** mschuppert is now known as mschuppert|brb | 10:38 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Dump zuul variables to file https://review.openstack.org/602673 | 10:40 |
| ssbarnea | panda: simple review https://review.openstack.org/595265 | 10:44 |
| pvc | ykarel | 10:45 |
| pvc | hi | 10:45 |
| panda | no review is simple. Not anymore <drama intensifies> | 10:45 |
| *** udesale has quit IRC | 10:47 | |
| *** mschuppert|brb is now known as mschuppert|lunch | 10:50 | |
| *** dprince has joined #tripleo | 10:50 | |
| *** boazel has joined #tripleo | 10:53 | |
| pvc | hi | 10:53 |
| pvc | anyone | 10:53 |
| pvc | ? | 10:53 |
| *** shyamb has joined #tripleo | 10:56 | |
| *** gkadam has joined #tripleo | 10:57 | |
| *** ykarel|afk is now known as ykarel | 11:00 | |
| fultonj | tosky: i reproduced 1789680 . i will keep the system up and running for you. ping me when you get online and I can get you a tmate | 11:06 |
| fultonj | toure: ^ | 11:07 |
| fultonj | tosky: please disregard | 11:07 |
| *** amoralej is now known as amoralej|lunch | 11:08 | |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 11:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 11:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 11:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 11:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix committed] - Assigned to Mehdi Abaakouk (sileht) | 11:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 11:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 11:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 11:10 |
| panda | holy Copy on Write. | 11:10 |
| panda | ssbarnea: i don't understand the use case https://review.openstack.org/595265 | 11:11 |
| *** kopecmartin has joined #tripleo | 11:14 | |
| quiquell | panda: :-) | 11:14 |
| ssbarnea | panda: i think that chown may fail i fnot run as root. | 11:14 |
| tosky | fultonj: np :) | 11:14 |
| *** artom has joined #tripleo | 11:15 | |
| *** gfidente has joined #tripleo | 11:18 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Inject undercloud user into the cloud image https://review.openstack.org/603069 | 11:20 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Fix environment vars not working with commands https://review.openstack.org/603360 | 11:20 |
| *** abishop has quit IRC | 11:24 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Fix environment vars not working with commands https://review.openstack.org/603362 | 11:25 |
| openstackgerrit | Yurii Prokulevych proposed openstack/python-tripleoclient master: Fix typo in upgrade playbook's name. https://review.openstack.org/603363 | 11:25 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Fix environment vars not working with commands https://review.openstack.org/603360 | 11:27 |
| ssbarnea | panda: this is safe to review but not a pleasure due to its repetitive nature: https://review.openstack.org/#/c/598599/ - but it should cut the console logs to ~50%. | 11:28 |
| jaosorior | panda: could you check this out https://review.openstack.org/#/c/570841/5 ? | 11:28 |
| jaosorior | ssbarnea: nice | 11:29 |
| fultonj | any tripleo-common cores care to review https://review.openstack.org/#/c/597221 for rocky? | 11:29 |
| pvc | hi anyone | 11:30 |
| fultonj | already have a +1 from original author and a +2 | 11:30 |
| pvc | quiquell :( | 11:30 |
| pvc | can you help me | 11:30 |
| quiquell | pvc: what's up ? | 11:30 |
| pvc | quiquell 2018-09-18 06:30:50,791 INFO: /tmp/tmpj1ZzzU/pre-install.d/05-rpm-epel-release: line 9: DISTRO_NAME: unbound variable | 11:31 |
| pvc | im using ocata versio | 11:32 |
| *** ratailor has quit IRC | 11:34 | |
| *** ratailor has joined #tripleo | 11:34 | |
| *** ratailor has quit IRC | 11:34 | |
| *** leanderthal has joined #tripleo | 11:35 | |
| *** mschuppert|lunch is now known as mschuppert | 11:35 | |
| *** jpena is now known as jpena|lunch | 11:38 | |
| openstackgerrit | Alan Pevec proposed openstack/tripleo-quickstart master: use a more stable centos repo for k8s and container rpms https://review.openstack.org/603273 | 11:38 |
| *** gkadam has quit IRC | 11:39 | |
| *** gkadam has joined #tripleo | 11:40 | |
| openstackgerrit | Alan Pevec proposed openstack/tripleo-quickstart master: use a more stable centos repo for k8s and container rpms https://review.openstack.org/603273 | 11:40 |
| chkumar|ruck | panda: please have a look at this job https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-rocky/4c5589f/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-09-18_03_53_16 | 11:41 |
| chkumar|ruck | panda: I am not getting what went wrong | 11:41 |
| panda | chkumar|ruck: looks like everything passed | 11:44 |
| chkumar|ruck | panda: but from the logs, deployment failed, https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-rocky/4c5589f/job-output.txt.gz#_2018-09-18_03_53_28_391544 | 11:45 |
| quiquell | chkumar|ruck: fs019 fixed updating ceph docker :-) | 11:45 |
| chkumar|ruck | quiquell: it is fixed for master | 11:46 |
| chkumar|ruck | quiquell: awesome | 11:46 |
| chkumar|ruck | quiquell: for rocky promotion, fs019 and fs020 is blocking, let me trigger both fs020 and fs019 for rocky | 11:46 |
| quiquell | chkumar|ruck: confirmed it did update the container | 11:49 |
| quiquell | Hello wee ned some review for master promotion blocker fix https://review.openstack.org/#/c/603323/ and https://review.openstack.org/#/c/603322/ | 11:50 |
| quiquell | panda: Can you help on merging this ^ ? | 11:50 |
| quiquell | marios: ^ | 11:50 |
| pvc | 2018-09-18 06:51:34,064 INFO: /tmp/tmpFoVrS8/pre-install.d/05-rpm-epel-release: line 9: DISTRO_NAME: unbound variab | 11:51 |
| pvc | quiquell any thoughts? 2018-09-18 06:51:34,064 INFO: /tmp/tmpFoVrS8/pre-install.d/05-rpm-epel-release: line 9: DISTRO_NAME: unbound variab | 11:51 |
| marios | quiquell: checking gfidente around? (it has 'ceph' on it) @ https://review.openstack.org/#/c/603323/ https://review.openstack.org/#/c/603322/ | 11:52 |
| quiquell | gfidente: Ahh you are back | 11:52 |
| jaosorior | pvc: I think adding a bit more info about the issue would be more useful for folks to help you out. Like, what command where you trying out, and perhaps giving more log lines (in a pastebin for instance). | 11:52 |
| quiquell | gfidente: Looks like we need ceph-ansible new version and also ceph-docker new version | 11:52 |
| pvc | im using openstack undercloud install | 11:52 |
| *** leanderthal has quit IRC | 11:53 | |
| jaosorior | pvc: what release? | 11:53 |
| pvc | im using ocata | 11:53 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: fix nova placement errors for ovb recreate https://review.openstack.org/596610 | 11:53 |
| panda | gfidente: is this (and dependency) correct ? https://review.openstack.org/603323 | 11:53 |
| jaosorior | pvc: ocata is that an update or an upgrade? or is it a new deployment? | 11:53 |
| pvc | new deployment | 11:54 |
| quiquell | panda, gfidente: I did a replace, maybe some are not needed | 11:54 |
| marios | quiquell: fwiw i did a grep and it looks like you replaced all of them :) | 11:54 |
| *** thrash|g0ne is now known as thrash | 11:54 | |
| beagles | jaosorior: quick sanity check - tls proxy support requires httpd and mod_ssl to be installed in the container image, correct? | 11:55 |
| jaosorior | beagles: yes | 11:55 |
| *** saneax has quit IRC | 11:56 | |
| beagles | jaosorior: that's what I thought, cool thanks | 11:56 |
| *** saneax has joined #tripleo | 11:56 | |
| pvc | jaosorior im using ocata | 11:56 |
| *** dprince has quit IRC | 11:57 | |
| *** agopi has joined #tripleo | 11:57 | |
| EmilienM | rook: yes we do have a timeout, why? | 11:57 |
| panda | chkumar|ruck: looks like we are not testing the right exit condition | 12:02 |
| panda | chkumar|ruck: we are greppping for a string that does not exist openstack | 12:02 |
| panda | chkumar|ruck: https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-rocky/4c5589f/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-09-18_03_53_23 | 12:02 |
| panda | chkumar|ruck: looks like a false negative | 12:03 |
| jaosorior | pvc: can you give the full logs? | 12:04 |
| openstackgerrit | Martin Schuppert proposed openstack/puppet-tripleo master: WIP - add support for native TLS encryption on NBD for disk migration https://review.openstack.org/603341 | 12:04 |
| jaosorior | pvc: also, what distro are you using? | 12:05 |
| *** gkadam has quit IRC | 12:06 | |
| *** shyamb has quit IRC | 12:06 | |
| jaosorior | EmilienM: could you check this out https://review.openstack.org/#/c/600000/ ? | 12:06 |
| *** shyamb has joined #tripleo | 12:07 | |
| EmilienM | jaosorior: in mtg | 12:07 |
| *** abishop has joined #tripleo | 12:07 | |
| ykarel | jaosorior, looks like pvc is hitting https://bugs.launchpad.net/tripleo/+bug/1765123 | 12:07 |
| openstack | Launchpad bug 1765123 in tripleo "dib-run-parts fails with /tmp/tmpkGJoNl/pre-install.d/05-rpm-epel-release: line 9: DISTRO_NAME: unbound variable" [Critical,Fix released] - Assigned to Gabriele Cerami (gcerami) | 12:07 |
| ykarel | pvc, can u try that change to see if it helps | 12:07 |
| gfidente | marios quiquell for the docker image I had https://review.openstack.org/#/c/601597/ already | 12:08 |
| gfidente | fultonj ^^ you should vote on that as well :D | 12:08 |
| marios | gfidente: i think you quiquell need to fight to the death i see no other way around it | 12:08 |
| quiquell | gfidente: the tqe change is not needed ? | 12:09 |
| panda | agreed | 12:09 |
| gfidente | marios didn't know we had references to the container image in oooq as well, any clue why that is necessary? | 12:09 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 12:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 12:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 12:10 |
| fultonj | so are we ignoring rdo's -1 ? | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 12:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 12:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix committed] - Assigned to Mehdi Abaakouk (sileht) | 12:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 12:10 |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Enhance undercloud reboot procedure for baremetal https://review.openstack.org/603155 | 12:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 12:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 12:10 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Tag step plays https://review.openstack.org/599072 | 12:10 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Remove "when failed" from debug task names https://review.openstack.org/598221 | 12:10 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Tag tasks in in common tasks https://review.openstack.org/603250 | 12:10 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Convert with_dict tasks to use loop and be less chatty https://review.openstack.org/603251 | 12:10 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: check mode: puppet host https://review.openstack.org/603252 | 12:10 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: check mode: docker_puppet https://review.openstack.org/603253 | 12:10 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: check mode: docker_puppet_tasks https://review.openstack.org/603254 | 12:10 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: check mode: paunch configs https://review.openstack.org/603255 | 12:10 |
| fultonj | gfidente: https://review.openstack.org/#/c/603322 is already locked into the dep for https://review.openstack.org/#/c/603323/ | 12:11 |
| gfidente | quiquell marios the oooq-extras is still needed | 12:11 |
| fultonj | might as well promote +2 603322 so you don't have to fight to the death | 12:11 |
| gfidente | quiquell marios but I wonder why we need to specify a container image in oooq-extras as well and not rely on the defaults? | 12:11 |
| gfidente | quiquell marios fultonj yeah it's fine I can abandon mine as well | 12:11 |
| gfidente | panda but still, the oooq-extras seems problematic, why is it needed? | 12:13 |
| panda | gfidente: for the prep container role | 12:13 |
| fultonj | quiquell: https://review.openstack.org/#/c/603323 + https://review.openstack.org/#/c/603322 have +2's | 12:13 |
| fultonj | can they be +W'd even with RDO's -1 ? | 12:14 |
| gfidente | panda yeah but why can't it rely on the defaults in tripleo? | 12:14 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-specs master: Improve upgrades_tasks CI coverage with standalone for Stein https://review.openstack.org/579854 | 12:14 |
| panda | gfidente: which runs openstack overcloud container image prepare ---set "ceph_namespace={{ docker_ceph_namespace }}" | 12:14 |
| marios | jistr: chem weshay updated spec ^ | 12:14 |
| fultonj | panda: why can't it use the one we pass it, why hard code it in another place? | 12:14 |
| jistr | marios: thanks, will take a look | 12:15 |
| marios | https://review.openstack.org/579854 jistr & chem I added you as co-author ping me if you are offended by this association :) | 12:15 |
| jistr | marios: i'm flattered | 12:15 |
| marios | ;) | 12:15 |
| * jistr blushes | 12:15 | |
| * marios bows | 12:15 | |
| * marios bows backwards towards kitchen needs moar coffee | 12:15 | |
| * jistr turns head 360 degrees around | 12:15 | |
| marios | lol | 12:15 |
| weshay | GOALLLL | 12:16 |
| *** jtomasek has joined #tripleo | 12:16 | |
| *** mcornea has joined #tripleo | 12:16 | |
| ykarel | gfidente, quiquell do that ceph new image needed for queens as well? | 12:16 |
| ykarel | if not release files for queens need to be adjusted | 12:16 |
| gfidente | ykarel and rocky yes | 12:16 |
| gfidente | it will probably in master | 12:16 |
| gfidente | 3.x is for queens and rocky | 12:17 |
| ykarel | gfidente, 3.0 was already there, 3.1 ok for queens | 12:17 |
| ykarel | ? | 12:17 |
| gfidente | ykarel 3.x | 12:17 |
| gfidente | for both, not sticking to 3.0 or 3.1 | 12:17 |
| panda | gfidente: fultonj how do we get all the namespace imagename and tag information from tripleo-common ? | 12:17 |
| gfidente | panda isn't it created with the defaults from https://review.openstack.org/#/c/603322/2/tripleo_common/image/kolla_builder.py ? | 12:18 |
| gfidente | (when you run image prepare) | 12:19 |
| ykarel | gfidente, v3.1.0-stable-3.1-luminous-centos-7-x86_64 image builds with ceph 3.x | 12:19 |
| gfidente | ykarel yep | 12:19 |
| gfidente | well that is 3.1 specifically | 12:19 |
| ykarel | gfidente, ack then fine | 12:19 |
| gfidente | but I mean, there can be further updats in the future | 12:19 |
| panda | gfidente: fultonj it's probably one of thos instances in ehich we modified the CI instead of the product directly | 12:19 |
| panda | gfidente: fultonj we don't keep and pass the informations generated by the kolla build for the other jobs | 12:20 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-specs master: Improve upgrades_tasks CI coverage with standalone for Stein https://review.openstack.org/579854 | 12:21 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/rocky: Enhance undercloud reboot procedure for baremetal https://review.openstack.org/603365 | 12:22 |
| *** kopecmartin has quit IRC | 12:22 | |
| quiquell | gfidente: So do I have to backport the change to rocky and queens at tripleo-common ? | 12:23 |
| gfidente | quiquell yes :D | 12:23 |
| quiquell | gfidente: Deosn't look like they are affected | 12:23 |
| gfidente | quiquell but we want to update the image anyway, to test the image which will be out with 3.1 | 12:23 |
| gfidente | panda quiquell and I am not sure to which branches applies the change for oooq-extras | 12:24 |
| quiquell | gfidente: btw, working periodic https://logs.rdoproject.org/43/13943/32/check/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/27d65fd/logs/undercloud/home/zuul/containers-prepare-parameter.yaml.txt.gz | 12:24 |
| gfidente | quiquell promotion? | 12:25 |
| quiquell | gfidente: forced a run on it | 12:25 |
| gfidente | great | 12:25 |
| *** trown|outtypewww is now known as trown | 12:26 | |
| *** raildo has joined #tripleo | 12:26 | |
| quiquell | gfidente: why I don't know what causes the fs019 issue, in the first place, maybe some new DLRN stuff ? upstream was working fine | 12:27 |
| gfidente | quiquell why what? | 12:28 |
| quiquell | gfidente: I mean fs019 was failing at master, that's how we discover it, but onlÃy on promotion jobs (they take new stuff from DLRN to promote) | 12:29 |
| quiquell | gfidente: So don't know what changes at openstack projects to cause the issue | 12:29 |
| EmilienM | jaosorior: looking now | 12:30 |
| trown | shadower: mandre I think I found the issue with the latest 3.10 releases, but I am a bit stuck on getting to the root cause. It looks like openvswitch is not called to set up all of the openshift networks: http://logs.openstack.org/74/602074/5/check/tripleo-ci-centos-7-scenario009-multinode-oooq/c151cd0/logs/subnode-2/var/log/journal.txt.gz#_Sep_17_15_12_19 (cni error) ... http://logs.openstack.org/74/602074/5/check/tripleo- | 12:31 |
| trown | ci-centos-7-scenario009-multinode-oooq/c151cd0/logs/subnode-2/var/log/host_info.txt.gz (grep ovs-vsctl) | 12:31 |
| panda | gfidente: unless you restrict it, will apply to all branches | 12:31 |
| gfidente | panda ok for pike we need the 2.x image though | 12:31 |
| gfidente | sorry, 3.0 | 12:31 |
| gfidente | :D | 12:31 |
| fultonj | gfidente: pike is jewel | 12:31 |
| *** chkumar|ruck is now known as chkumar|off | 12:32 | |
| fultonj | has always been jewel i should say | 12:32 |
| gfidente | fultonj yeah but the container version is 3.0 | 12:32 |
| trown | anyone able to review https://review.openstack.org/600438 ? openshift job is broken without it | 12:32 |
| gfidente | so it's that weird v3.x-stable-3.0-jewel naming | 12:32 |
| gfidente | basically the jewel image compatible with ceph-ansible 3.x | 12:32 |
| gfidente | 3.0 | 12:32 |
| fultonj | gfidente: ah yes, my head jumped from 3 > lumionus, but it's actually 3-jewel | 12:33 |
| panda | hold on while I try to make my head explode like a lemming. | 12:33 |
| gfidente | panda yeah | 12:33 |
| fultonj | sorry | 12:33 |
| fultonj | https://getyarn.io/yarn-clip/5aff4233-3aa1-407c-8ebb-4e84bb69db23 | 12:34 |
| quiquell | panda: are you updateing the image to rocky and queens ? | 12:34 |
| panda | quiquell: no | 12:34 |
| gfidente | panda so wait a sec, are you saying that we deploy the image in main.yml for the pike jobs as well? | 12:35 |
| chem | marios: replied in the review, thanks for the co-authorship | 12:35 |
| mandre | trown: have you tried with a recent checkout of 3.10 branch? I'm facing a different issue with a newer openshift ansible, https://github.com/openshift/openshift-ansible/issues/9894 | 12:35 |
| gfidente | panda that's not possible it'd fail | 12:35 |
| gfidente | panda in quickstart/release/tripleo-ci I see a bunch of files explicitly pointing to jewel | 12:36 |
| gfidente | HOW MANY TIMES DO WE NEED TO REFERENCE THIS CONTAINER IMAGE? | 12:36 |
| gfidente | I LOVE QUICKSTART BUT | 12:36 |
| gfidente | :D | 12:36 |
| gfidente | are the .yml in tripleo-quicksart overriding the stuff in extras? | 12:37 |
| panda | gfidente: those are the repoitories | 12:37 |
| gfidente | panda no there is docker_ceph_tag | 12:38 |
| quiquell | gfidente: pike is using v3.0.3-stable-3.0-jewel-centos-7-x86_64 | 12:38 |
| quiquell | gfidente: https://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-pike/6d8446b/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz | 12:38 |
| gfidente | quiquell yeah exactly so are the vars in tripleo-quickstart overriding the default set in extras? | 12:38 |
| *** jpena|lunch is now known as jpena | 12:38 | |
| quiquell | gfidente: what vars ? | 12:39 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common master: Workflow for provisioning bare metals without Nova https://review.openstack.org/576856 | 12:39 |
| panda | gfidente: yeah, it's all in the release files | 12:39 |
| panda | gfidente: so the release files override the defaults | 12:39 |
| gfidente | panda ack got it, thanks :D | 12:39 |
| quiquell | ahh ok | 12:39 |
| panda | gfidente: so in the pike release file we are specifying jewel | 12:39 |
| trown | mandre: the error in that bug looks similar to how the install eventually fails: http://logs.openstack.org/74/602074/5/check/tripleo-ci-centos-7-scenario009-multinode-oooq/c151cd0/logs/undercloud/var/lib/mistral/overcloud/openshift/playbook.log.txt.gz ... but the reason it is failing that way in the scenario009 case is that the ovs networking never gets setup | 12:39 |
| quiquell | yep | 12:39 |
| gfidente | panda quiquell understood, makes sense, thanks | 12:39 |
| *** dtantsur is now known as dtantsur|brb | 12:40 | |
| quiquell | gfidente, panda: So just updating rocky and queens is missing at tripleo-common ? | 12:40 |
| gfidente | quiquell yes sounds like to me | 12:40 |
| trown | mandre: so it is just looping looking for a cni config... in a working job the cni error stops eventually and we see the ovs interfaces show up: http://logs.openstack.org/67/600067/14/check/tripleo-ci-centos-7-scenario009-multinode-oooq/cf898dc/logs/subnode-2/var/log/host_info.txt.gz (grep ovs-vsctl) | 12:41 |
| trown | mandre: I tried looking through changes on that branch, but no luck finding anything that looked related | 12:42 |
| *** rlandy has joined #tripleo | 12:42 | |
| quiquell | gfidente: fs019 rocky is the same not the case for queens... but I will try to update | 12:43 |
| quiquell | gfidente: I mean the failure | 12:43 |
| mandre | trown: hmm, if you check the failing task, it tries to check for pods named master-controllers-192.168.24.3 | 12:43 |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-common master: Add workflow that wraps register, introspect and provide https://review.openstack.org/498936 | 12:43 |
| mandre | trown: I bet the pod is there, but with a hostname and not the IP address | 12:44 |
| mandre | trown: yeah... http://logs.openstack.org/74/602074/5/check/tripleo-ci-centos-7-scenario009-multinode-oooq/c151cd0/logs/subnode-2/var/log/containers/ | 12:44 |
| *** shyamb has quit IRC | 12:45 | |
| *** shyamb has joined #tripleo | 12:45 | |
| trown | mandre: ah ok... so I guess the networking happens after that check... that seems like the root issue then | 12:46 |
| *** ansmith has joined #tripleo | 12:46 | |
| mandre | trown: they've just merged https://github.com/openshift/openshift-ansible/commit/43d7e126923a8d1bbade7ee2ae0ffebe1e22c74c that is supposed to fix it | 12:46 |
| marios | thanks chem will check | 12:47 |
| *** shyamb has quit IRC | 12:50 | |
| trown | mandre: hmm so we need to wait for it to be packaged in a release I guess... I can try to manually make that change in an env with the latest package and confirm it fixes our issue though | 12:51 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-common stable/rocky: Upgrade ceph docker image https://review.openstack.org/603367 | 12:52 |
| *** tzumainn has joined #tripleo | 12:52 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Add new nova-event-callback validation https://review.openstack.org/513333 | 12:53 |
| mandre | trown: the origin-ansible container image already contains the fix, if you want to give https://review.openstack.org/#/c/583868/ a try :) | 12:54 |
| *** kopecmartin has joined #tripleo | 12:54 | |
| trown | mandre: did you figure out the issue with being able to actually run the container from mistral? | 12:55 |
| mandre | trown: nope - I rebooted my undercloud and now I don't get the permission denied error anymore | 12:56 |
| mandre | could be selinux like Emilien said | 12:57 |
| trown | weird | 12:57 |
| mandre | it's also weird that the containerized undercloud doesn't have the same issue in CI | 12:57 |
| mandre | trown: can I get reviews on https://review.openstack.org/#/c/565182/? | 12:58 |
| trown | mandre: where do we use that openshift-cns service? | 13:00 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-common stable/queens: pgrade ceph docker image https://review.openstack.org/603369 | 13:00 |
| mandre | trown: it's not exercised in CI, I'm using it locally though | 13:00 |
| trown | mandre: ok | 13:01 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Upgrade ceph docker image https://review.openstack.org/603323 | 13:03 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Validation for no PMD cores on a NUMA node https://review.openstack.org/559168 | 13:03 |
| quiquell | gfidente: doen for rocky and queens | 13:03 |
| quiquell | gfidente: don't know if the Depends-On at tqe is needed any of them | 13:03 |
| quiquell | gfidente: looks like tqe is overriding | 13:04 |
| *** saneax has quit IRC | 13:04 | |
| *** saneax has joined #tripleo | 13:04 | |
| mandre | trown: 1 down, 10 more to go :) Thanks | 13:06 |
| quiquell | To unblock master, rocky and queens promotions https://review.openstack.org/#/c/603323 thanks | 13:06 |
| quiquell | Also the Depends-On | 13:07 |
| quiquell | panda: something else missing ? | 13:07 |
| *** jtomasek has quit IRC | 13:08 | |
| ykarel | can't get why depends-on needed on all the tripleo-common patches | 13:09 |
| ykarel | they can go parallel to fix issue sooner | 13:09 |
| quiquell | ykarel: what do you mean ? | 13:10 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 13:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 13:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| weshay | EmilienM, mwhahaha https://review.openstack.org/#/c/603323 | 13:10 |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 13:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 13:10 |
| *** salmankhan has joined #tripleo | 13:10 | |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix committed] - Assigned to Mehdi Abaakouk (sileht) | 13:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 13:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 13:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 13:10 |
| ykarel | quiquell, so tripleo-common patch changes the default, tqe overriding those defaults, | 13:10 |
| *** jtomasek has joined #tripleo | 13:11 | |
| ykarel | so even if tripleo-common patch merges, and tqe don't merge, old ceph image would be used in ci | 13:11 |
| quiquell | ykarel: ok, I have my brains so fry now, so Depends-On are not needed but would be good to have all of them merged | 13:11 |
| ykarel | yes | 13:11 |
| quiquell | ykarel: so better remove the Depends-On so we have tqe ASAP | 13:12 |
| *** boazel has quit IRC | 13:12 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Upgrade ceph docker image https://review.openstack.org/603323 | 13:13 |
| ykarel | quiquell, yes, u can keep master tripleo-common one if u want that in git history, if both tqe and tripleo-common referring some lp bug then that even should not be needed | 13:13 |
| quiquell | ykarel: ok tqe updated | 13:13 |
| quiquell | ykarel: let's get it merged | 13:13 |
| *** quiquell is now known as quique|rover|lch | 13:14 | |
| *** fultonj is now known as fultonj|afk | 13:14 | |
| ykarel | yes | 13:15 |
| *** mjturek has joined #tripleo | 13:15 | |
| EmilienM | weshay: is it too much asking for having commit messages? | 13:16 |
| weshay | quique|rover|lch, ^ | 13:16 |
| weshay | EmilienM, there is a bug associated.. but yes there should also be a message | 13:16 |
| weshay | in a bottle | 13:16 |
| weshay | ya ya | 13:16 |
| rook | EmilienM: I asked because I had a deployment stuck for 8 hours (overnight) | 13:17 |
| EmilienM | weshay: we shouldn't encourage people to not write commit messages because there is a bug associated | 13:17 |
| EmilienM | rook: rocky? | 13:17 |
| rook | yup | 13:17 |
| weshay | quique|rover|lch, https://wiki.openstack.org/wiki/GitCommitMessages | 13:17 |
| EmilienM | rook: yeah one sec | 13:18 |
| rook | EmilienM: the issue was/is something with the undercloud installation set my hostname to "localhost" so nova-conductor was spitting out messages about no hosts available. | 13:18 |
| EmilienM | rook: I remember of a bug that slagle fixed | 13:18 |
| rook | ack | 13:18 |
| EmilienM | gimme one sec | 13:18 |
| rook | no problem if there was already a bug / fix ill stfu :) | 13:18 |
| EmilienM | https://review.openstack.org/#/c/586358/ | 13:18 |
| EmilienM | rook: ^ | 13:18 |
| EmilienM | https://launchpad.net/bugs/1783893 | 13:18 |
| openstack | Launchpad bug 1783893 in tripleo "config-download doesnt honor timeout" [Medium,In progress] - Assigned to James Slagle (james-slagle) | 13:18 |
| EmilienM | so yeah it's WIP | 13:18 |
| rook | ack EmilienM | 13:19 |
| rook | thanks EmilienM | 13:19 |
| openstackgerrit | Sam Betts proposed openstack/python-tripleoclient master: Ensure that the --template-file option is passed to the kolla builder https://review.openstack.org/600393 | 13:19 |
| *** ade_lee has quit IRC | 13:20 | |
| slagle | EmilienM: it's not WIP. it's just awaiting your review :) | 13:23 |
| EmilienM | slagle: I'm actuallyl ooking at it now | 13:23 |
| *** agopi has quit IRC | 13:24 | |
| EmilienM | slagle: small nit on https://review.openstack.org/#/c/586358/5/tripleoclient/v1/overcloud_deploy.py | 13:25 |
| EmilienM | I'm happy to push over and +2 | 13:26 |
| slagle | EmilienM: i can fix it. bad line wrapping | 13:26 |
| EmilienM | otherwise lgtm | 13:26 |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Honor timeout with config-download https://review.openstack.org/586358 | 13:27 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Use ansible_host variable in wait_for task. https://review.openstack.org/603382 | 13:27 |
| *** zul has joined #tripleo | 13:28 | |
| *** rh-jelabarre has joined #tripleo | 13:28 | |
| *** amoralej|lunch is now known as amoralej | 13:30 | |
| *** vinaykns has joined #tripleo | 13:30 | |
| openstackgerrit | Sam Betts proposed openstack/tripleo-heat-templates master: Remove incorrect mapped_data key from cisco ml2 hieradata https://review.openstack.org/600396 | 13:32 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: automatically build a test package when only CI is changed https://review.openstack.org/603277 | 13:34 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/rocky: Add reflection of RpcPort to health checks https://review.openstack.org/603387 | 13:36 |
| *** skramaja has quit IRC | 13:37 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Upgrade docker ceph container https://review.openstack.org/603323 | 13:38 |
| quique|rover|lch | weshay, EmilienM: ^ | 13:39 |
| *** quique|rover|lch is now known as quiquell|rover | 13:40 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Only set ca_bundle for HAProxy if internal TLS enabled https://review.openstack.org/603390 | 13:40 |
| jaosorior | EmilienM: done ^^ | 13:40 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates stable/queens: Add reflection of RpcPort to health checks https://review.openstack.org/603391 | 13:40 |
| EmilienM | jaosorior: thanks | 13:42 |
| EmilienM | jaosorior: I'll test it today - and let you know | 13:42 |
| EmilienM | slagle: thx +2 | 13:43 |
| EmilienM | jaosorior: wait | 13:43 |
| EmilienM | jaosorior: nvrmind | 13:43 |
| quiquell|rover | EmilienM, gfidente, rlandy: Need +2 again after changing comment https://review.openstack.org/#/c/603323/ | 13:45 |
| *** agopi has joined #tripleo | 13:46 | |
| EmilienM | quiquell|rover: thanks. | 13:47 |
| quiquell|rover | EmilienM: Didn't have anough brain cycles at comment creation | 13:48 |
| *** apetrich has joined #tripleo | 13:48 | |
| *** vinaykns has quit IRC | 13:49 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-common stable/queens: Upgrade docker ceph container https://review.openstack.org/603369 | 13:50 |
| janki | EmilienM, Hi. Can you please review https://review.openstack.org/#/c/597007 and https://review.openstack.org/#/c/602196/. thanks | 13:50 |
| EmilienM | janki: I will, asap when I can | 13:50 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-common stable/rocky: Upgrade docker ceph container https://review.openstack.org/603367 | 13:51 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-common master: Upgrade docker ceph container https://review.openstack.org/603322 | 13:51 |
| *** vinaykns has joined #tripleo | 13:52 | |
| openstackgerrit | Merged openstack/tripleo-common stable/rocky: Add validations pkg to mistral-executor image https://review.openstack.org/603002 | 13:54 |
| *** ade_lee has joined #tripleo | 13:55 | |
| *** mjturek has quit IRC | 13:57 | |
| *** radeks_ has joined #tripleo | 13:58 | |
| janki | EmilienM, thanks for the reviews :) | 14:00 |
| EmilienM | cool | 14:00 |
| *** florianf is now known as florianf|biab | 14:01 | |
| jaosorior | #startmeeting tripleo | 14:01 |
| openstack | Meeting started Tue Sep 18 14:01:17 2018 UTC and is due to finish in 60 minutes. The chair is jaosorior. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:01 |
| *** openstack changes topic to " (Meeting topic: tripleo)" | 14:01 | |
| openstack | The meeting name has been set to 'tripleo' | 14:01 |
| jaosorior | #topic agenda | 14:01 |
| *** openstack changes topic to "agenda (Meeting topic: tripleo)" | 14:01 | |
| jaosorior | * Review past action items | 14:01 |
| jaosorior | * One off agenda items | 14:01 |
| jaosorior | * Squad status | 14:01 |
| holser_ | o/ | 14:01 |
| jaosorior | * Bugs & Blueprints | 14:01 |
| jaosorior | * Projects releases or stable backports | 14:01 |
| jaosorior | * Specs | 14:01 |
| jaosorior | * open discussion | 14:01 |
| jfrancoa | o/ | 14:01 |
| jaosorior | Anyone can use the #link, #action and #info commands, not just the moderatorǃ | 14:01 |
| *** fhubik has joined #tripleo | 14:01 | |
| jaosorior | Hey folks! who's around? | 14:01 |
| fultonj|afk | o/ | 14:01 |
| marios | o/ hello | 14:01 |
| rascasoft | o/ | 14:01 |
| iranzo | hi | 14:01 |
| *** fultonj|afk is now known as fultonj | 14:01 | |
| weshay | 0/ | 14:01 |
| ksambor | \o | 14:01 |
| chem | o/ | 14:01 |
| gfidente | o/ | 14:01 |
| slagle | hi | 14:02 |
| mwhahaha | hi2u | 14:02 |
| fhubik | hey | 14:02 |
| rlandy | o/ | 14:02 |
| beagles | o/ | 14:02 |
| rfolco | o/ | 14:02 |
| jrist | o/ | 14:02 |
| dpeacock | o7 | 14:02 |
| rdopiera | hi, I'm trying oooquickstart with rhos-14 and I'm getting an import error for zmq. I'm being told that zmq shouldn't be used in osp14, is it something I'm doing wrong? I'm using all the defaults | 14:02 |
| holser_ | o/ | 14:03 |
| EmilienM | hi (half here) | 14:03 |
| jrist | haha o7, is that like a salute? | 14:03 |
| rdopiera | uh, sorry, it seems there is a meeting | 14:03 |
| rdopiera | I will come later | 14:03 |
| dpeacock | jrist: yeah I saw tengu do it once and figured it looked a little cool | 14:03 |
| owalsh | o/ | 14:03 |
| panda | o/ | 14:03 |
| mschuppert | o/ | 14:04 |
| mwhahaha | yea it's a salute | 14:04 |
| jrist | dpeacock+1 | 14:04 |
| jaosorior | #topic review past action items | 14:04 |
| *** openstack changes topic to "review past action items (Meeting topic: tripleo)" | 14:04 | |
| jaosorior | None. | 14:04 |
| *** shyamb has joined #tripleo | 14:04 | |
| jaosorior | #topic one off agenda items | 14:04 |
| *** openstack changes topic to "one off agenda items (Meeting topic: tripleo)" | 14:04 | |
| jaosorior | #link https://etherpad.openstack.org/p/tripleo-meeting-items | 14:04 |
| redrobot | o/ | 14:05 |
| *** dciabrin has joined #tripleo | 14:05 | |
| jaosorior | #topic Stein forum topic proposals | 14:06 |
| *** openstack changes topic to "Stein forum topic proposals (Meeting topic: tripleo)" | 14:06 | |
| *** mjturek has joined #tripleo | 14:06 | |
| jaosorior | So... we have until the 26th of September to propose topics for the Stein Summit | 14:06 |
| jrist | jaosorior: are we past one off agenda items? | 14:06 |
| jaosorior | Here's the etherpad: | 14:06 |
| abishop | o/ | 14:06 |
| jaosorior | #link https://etherpad.openstack.org/p/tripleo-forum-stein | 14:06 |
| jaosorior | jrist: no, this is one of the "one off agenda items" | 14:06 |
| jrist | oh ok :) | 14:07 |
| jrist | thanks | 14:07 |
| jaosorior | So, if you have a topic to bring up to the Summit, which is coming soon, please add it to the etherpad. | 14:07 |
| jaosorior | #topic citellus POC | 14:07 |
| *** openstack changes topic to "citellus POC (Meeting topic: tripleo)" | 14:07 | |
| jaosorior | iranzo: ^^ | 14:07 |
| iranzo | jaosorior: yup :) | 14:07 |
| iranzo | weshay++ some months ago worked on a review at https://review.openstack.org/#/c/553571/4 ) | 14:08 |
| iranzo | that used a set of scripts that are used by support folks | 14:08 |
| iranzo | to detect known issues on osp deployments | 14:08 |
| iranzo | from either live systems or sosreports | 14:08 |
| iranzo | unlike others, goal was to enable operators, and sysadmins in general to run them and of course write new ones | 14:09 |
| iranzo | by using bash or other languages of choice | 14:09 |
| iranzo | and some common agreements (return codes and stderr for messages) | 14:09 |
| iranzo | it can drop a json that can be parsed later by other tools to get overall status | 14:09 |
| *** dtantsur|brb is now known as dtantsur | 14:09 | |
| iranzo | so... thoughts? | 14:10 |
| iranzo | review was 'rechecked' as it passed some time ago, but to get updated results | 14:10 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 14:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 14:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 14:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 14:10 |
| jaosorior | iranzo: I see the POC patch is for CI; how would that be used? | 14:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix committed] - Assigned to Mehdi Abaakouk (sileht) | 14:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 14:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 14:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 14:10 |
| jrist | ah that bot is well timed | 14:10 |
| weshay | capturing errors and making it easy to find the associated data is awesome.. | 14:10 |
| iranzo | jaosorior: ^ | 14:10 |
| weshay | citellus looked pretty awesome | 14:10 |
| weshay | iranzo++ | 14:11 |
| iranzo | weshay++ | 14:11 |
| jaosorior | weshay, iranzo: It sounded really nice; that's why I asked iranzo to bring it up here :D | 14:11 |
| mwhahaha | we need to find a better way to package/deploy that | 14:11 |
| mwhahaha | right now i'd be -2 on that review | 14:11 |
| iranzo | it is delivered as pip package if needed | 14:11 |
| jaosorior | just asking for more details cause I'm interested. | 14:11 |
| iranzo | that is build automatically | 14:11 |
| weshay | ya.. that was not ready for merge | 14:11 |
| jrist | that website isn't working | 14:11 |
| iranzo | or a container | 14:11 |
| chem | weshay: iranzo do we have a exemple of the kind of check it will be used for ? | 14:11 |
| jrist | can someone summarize? is it just about associated data? | 14:11 |
| weshay | mwhahaha, jaosorior so we need to think about not adding to CI | 14:11 |
| iranzo | chem: yes, one sec | 14:11 |
| weshay | mwhahaha, jaosorior we need to think about adding it to the project | 14:11 |
| jrist | oh nevermind, it had an extra ) | 14:11 |
| iranzo | chem: https://asciinema.org/a/169814 | 14:12 |
| mwhahaha | i don't know if w ewant to add it to the project | 14:12 |
| iranzo | asciicinema of operation | 14:12 |
| iranzo | and as example of checks: non configured token expirations, wrong ntp sync setup | 14:12 |
| mwhahaha | distributing it as a container might be interesting | 14:12 |
| iranzo | like when people used chronyc instead of ntpd | 14:12 |
| weshay | mwhahaha, iranzo getting consensus on the tool to use for error detection is difficult at best | 14:12 |
| iranzo | missing support in system for virtualization, etc | 14:12 |
| slagle | what is citellus-master.tgz? is that a tarball of the citellus git repo? | 14:12 |
| iranzo | slagle: yes, its an old tarball of the repo | 14:13 |
| slagle | iranzo: can we do that a different way? just use git clone or something | 14:13 |
| mwhahaha | i would rather see it added as a new service rather than added to quickstart or integrated into tripleo itself | 14:13 |
| mwhahaha | it might make sense to have it on the undercloud itself | 14:13 |
| iranzo | slagle: yes or even add it to the requirements.txt | 14:13 |
| weshay | +1 | 14:13 |
| chem | iranzo: hum so static report of sosreport, nice. Plugged into the ci it would only check logs then, no triggering another process | 14:13 |
| iranzo | from undercloud, you can pass an ansible-host-file that uploads executes and brings back data from the hosts | 14:14 |
| *** radeks_ has quit IRC | 14:14 | |
| chem | iranzo: (afraid of timeout in ci) | 14:14 |
| iranzo | chem: yes, and the json can be easily parsed for the errors | 14:14 |
| iranzo | let me show you one example of the json | 14:14 |
| weshay | if I recall it was all very fast.. a number of seconds | 14:14 |
| iranzo | web UI: https://htmlpreview.github.io/?https://github.com/citellusorg/citellus/blob/master/doc/sampleweb/citellus.html | 14:14 |
| iranzo | https://github.com/citellusorg/citellus/blob/master/doc/sampleweb/citellus.json | 14:15 |
| iranzo | json generated | 14:15 |
| iranzo | yes, it runs usually under 10 seconds | 14:15 |
| iranzo | (for the sosreport check) | 14:15 |
| mwhahaha | it seems like something that should be integrated with the UI itself | 14:15 |
| iranzo | for live it can take a bit more because of system logs parsed, etc | 14:15 |
| iranzo | but it's not like a century | 14:15 |
| iranzo | goal was always to make it damn fast and easy to get new things there | 14:15 |
| iranzo | to highlight what could go wrong | 14:15 |
| *** ykarel is now known as ykarel|away | 14:16 | |
| iranzo | even you can define sizing data based on number of cpus, etc and report if a setting is not 'suited' to host setup | 14:16 |
| iranzo | if you want to give hints there | 14:16 |
| jaosorior | weshay, iranzo: so, is that a service that would constantly be running on the nodes? or is it a one-off script you run and pulls down a bunch of info? | 14:16 |
| iranzo | I would say a one-off executed as part of the tests could be ok | 14:16 |
| iranzo | in support we used it to check what customers had wrongly setup | 14:16 |
| iranzo | based on our past experience | 14:16 |
| iranzo | and test 'id's' are unique so you can define which ones should be reported or not | 14:17 |
| iranzo | based on regexps to the full path | 14:17 |
| *** jfrancoa has quit IRC | 14:17 | |
| iranzo | like "all for openstack", or all for "clock" | 14:17 |
| chem | mwhahaha: if it's in the product then maybe that could be used for the 2 days validation framework currently WIP by Tengu | 14:17 |
| iranzo | or report openstack issues but not bugzillas | 14:17 |
| *** quiquell|rover is now known as quique|rover|off | 14:17 | |
| mwhahaha | chem: yea that was my thought as it makes sense to have available on the undercloud for subsequent runs | 14:17 |
| mwhahaha | but it's a delivery thing into tripleo | 14:17 |
| mwhahaha | ie rpm or containers or whatever | 14:17 |
| iranzo | when it checks several hosts, it also aggregates data and shows a combined status, also reporting things that could be problematic | 14:18 |
| iranzo | think of different OS releases | 14:18 |
| iranzo | on the same environment | 14:18 |
| iranzo | or sharing same iscsi initiatior name | 14:18 |
| mwhahaha | it's likely that we'd want it wrapped up in a container so it could be pulled in on the undercloud and executed via the UI/CLI | 14:18 |
| iranzo | among different hosts | 14:18 |
| jaosorior | iranzo, weshay: does the POC patch have an output already from the deployment? | 14:19 |
| mwhahaha | so i think it's a good idea to have, but we need to figure out the best way to integrate the execution/results | 14:19 |
| iranzo | mwhahaha: I've made some attempts to use an Super privileged container, but still require work, as the actual 'tests' are written for either checking the path in sosreport or the path in a live system | 14:19 |
| chem | mwhahaha: that would be cool | 14:19 |
| weshay | jaosorior, it's so old | 14:19 |
| weshay | I'll refresh it at some point | 14:19 |
| jaosorior | sure | 14:19 |
| iranzo | so trying to run 'live' against a folder might give some strange output for some commands | 14:19 |
| chem | iranzo: seems like all feature are there :) | 14:19 |
| chem | citellus++ :) | 14:19 |
| iranzo | think of 'rpm -qa' inside the container instead of the actal 'host' folder | 14:19 |
| * weshay notes.. it would be very cool to have the same tool used to diagnose errors up and down stream | 14:20 | |
| iranzo | yes! | 14:20 |
| mwhahaha | so it sounds like there's more work on the citellus front to figure out distribution | 14:20 |
| weshay | which is why I would hope we can avoid making this a ci project | 14:20 |
| *** jfrancoa has joined #tripleo | 14:20 | |
| jaosorior | weshay, iranzo: So, the tool does sound quite cool. But yeah, like mwhahaha said, it would be best if we could have it packaged and integrated properly. | 14:21 |
| *** Petersingh has quit IRC | 14:21 | |
| iranzo | the list of plugins in the tarball is at this commit: https://github.com/citellusorg/citellus/tree/1ee1c6a36f51e8a7c809d5162004fb57ee99b168 | 14:21 |
| iranzo | jaosorior: what kind of packaging do you mean? | 14:21 |
| iranzo | project has automatic creationg via dockerhub of container and pypi package upload | 14:21 |
| weshay | iranzo, jaosorior ok.. the ci team will help get it packaged | 14:21 |
| iranzo | ok | 14:21 |
| mwhahaha | so we need it rpm'd to be properly integrated | 14:22 |
| jaosorior | mwhahaha: well, the patch does say POC in the title. I assumed weshay and iranzo meant to show how it works. | 14:22 |
| weshay | +1 | 14:22 |
| mwhahaha | then we'd like to have it work from in a container | 14:22 |
| mwhahaha | cause that's what we have | 14:22 |
| weshay | sure | 14:22 |
| geneliu | Hello everyone, a quick question: Is containerized undercloud installation available on Queens? (I know it's the default of Rocky) | 14:22 |
| mwhahaha | geneliu: no | 14:22 |
| iranzo | jaosorior: I can show it :) what do you use? bjns? asciinema? | 14:22 |
| *** Chaserjim has joined #tripleo | 14:22 | |
| jaosorior | iranzo: asciinema is fine :) | 14:22 |
| weshay | flash cards | 14:22 |
| jaosorior | lol | 14:22 |
| mwhahaha | poster board diorama | 14:23 |
| mwhahaha | must include at least 2 historical figures | 14:23 |
| mwhahaha | weshay may be used as 1 of the figures | 14:23 |
| iranzo | jaosorior: then https://asciinema.org/a/169814 should work | 14:23 |
| iranzo | for later processing I would just run and get the json or report to console the 'failed' tests | 14:23 |
| iranzo | internally it uses 'priority' which is the likelyhood of a test failing being bringing down your environment | 14:24 |
| iranzo | and can be also be filtered based on it | 14:24 |
| jaosorior | weshay: so, the CI team would help with the packaging/containerization of citellus? | 14:24 |
| iranzo | and tests are 'info', 'skipped' 'ok' or 'failed' | 14:24 |
| weshay | so first steps would be to package and containerize? | 14:25 |
| iranzo | and this is for the old-group processing https://asciinema.org/a/170429 | 14:25 |
| iranzo | (now just outputs a json to make it more easily consumible basd on the information generated) | 14:25 |
| geneliu | thanks for the answer, mwhahaha! | 14:25 |
| jaosorior | weshay: yeah. | 14:25 |
| rook | Trying to deploy rocky with OVN, and getting : resources.ServiceChain: Property error: resources[43].properties: Property DockerOvnMetadataImage not assigned | 14:26 |
| mwhahaha | rook: you're missing the ovn metadata container from the prepare (also we're in a meeting) | 14:27 |
| rook | Where must this get defined -- and why isn't it defined in the environment file passed ? | 14:27 |
| rook | erm | 14:27 |
| rook | looking | 14:27 |
| *** jfrancoa has quit IRC | 14:27 | |
| *** sri_ has quit IRC | 14:27 | |
| iranzo | any other question about the tool? something I missed? | 14:28 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Revert "Revert "Add ability to have dlrn build all the packages at once"" https://review.openstack.org/603406 | 14:28 |
| jaosorior | iranzo: not from my side. I like it though | 14:28 |
| iranzo | there's a recording from devconf.cz in youtube | 14:28 |
| iranzo | let me find uri | 14:28 |
| iranzo | https://www.youtube.com/watch?v=SDzzqrUdn5A&t=1257s&index=1&list=LLyqRUm2tl7NOBlSL4Gz0e_Q | 14:29 |
| jaosorior | #link https://www.youtube.com/watch?v=SDzzqrUdn5A&t=1257s&index=1&list=LLyqRUm2tl7NOBlSL4Gz0e_Q | 14:29 |
| iranzo | and project uri | 14:29 |
| iranzo | #link https://citellus.org | 14:29 |
| iranzo | #link https://github.com/citellusorg/citellus | 14:29 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Revert "Revert "Add ability to have dlrn build all the packages at once"" https://review.openstack.org/603406 | 14:29 |
| jaosorior | iranzo: thanks | 14:29 |
| iranzo | jaosorior++ to you | 14:30 |
| weshay | iranzo, is this tool mostly used w/ tirpleo? | 14:30 |
| weshay | tripleo | 14:30 |
| iranzo | weshay: no, it can be used even outside triple-O | 14:30 |
| weshay | I'll catch up later | 14:30 |
| weshay | thanks iranzo++ | 14:30 |
| iranzo | and has little dependencies so if properly written, the bash scripts for tests, coudl be run on any platfrom | 14:30 |
| iranzo | we do use them even for openshift (reduced number of plugins) | 14:30 |
| iranzo | general systems with services like firewall, containers, clock sync, etc | 14:30 |
| iranzo | it's pretty generic as the project itself runs the plugins | 14:31 |
| iranzo | and each plugin 'decides' if have or not to run based on the requirements | 14:31 |
| iranzo | think for example of something checking galera db status, if the package/process is not there, the plugins skips itself | 14:31 |
| iranzo | so can be used for testing the deployed status or even infra for other projects | 14:32 |
| iranzo | weshay++ | 14:32 |
| jaosorior | lets move to the next topic in the agenda | 14:32 |
| jaosorior | #topic Workflow for wrapping register, introspect and provide | 14:32 |
| *** openstack changes topic to "Workflow for wrapping register, introspect and provide (Meeting topic: tripleo)" | 14:32 | |
| jaosorior | jrist: ^^ | 14:32 |
| jaosorior | akrivoka: ^^ | 14:33 |
| jrist | yeah so | 14:34 |
| jrist | this was proposed last year | 14:34 |
| jrist | this time. ;) | 14:34 |
| jrist | it was recently abandoned due to age | 14:35 |
| jrist | we're just wondering if this has priority or what | 14:35 |
| jrist | because it really didn't get many reviews or attention, despite asking | 14:35 |
| jrist | maybe akrivoka can chime in | 14:35 |
| *** Chaserjim has quit IRC | 14:35 | |
| *** ykarel|away has quit IRC | 14:36 | |
| jrist | and maybe someone like dtantsur or bfournie | 14:36 |
| jaosorior | jrist: sure, feedback from them, and if we can get d0ugal to look at it again for the mistral side of things, it would be good. | 14:37 |
| *** mhenkel_ has quit IRC | 14:37 | |
| jrist | ok so I am bringing it up here because it has been difficult getting feedback from everyone | 14:38 |
| jaosorior | jrist: this would be shared by the CLI and the UI, right? | 14:38 |
| jrist | that is definitely the purpose | 14:38 |
| jaosorior | Added myself as a reviewer; I'll give it a check, but would sure hope that dtantsur and d0ugal would look at it as well. | 14:39 |
| jaosorior | jrist: thanks for bringing it up | 14:40 |
| *** Chaserjim has joined #tripleo | 14:40 | |
| *** dxiri has joined #tripleo | 14:40 | |
| jaosorior | #topic Squad status | 14:40 |
| *** openstack changes topic to "Squad status (Meeting topic: tripleo)" | 14:40 | |
| jaosorior | ci | 14:40 |
| jaosorior | #link https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 14:40 |
| jaosorior | upgrade | 14:40 |
| jaosorior | #link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status | 14:40 |
| jaosorior | containers | 14:40 |
| jaosorior | #link https://etherpad.openstack.org/p/tripleo-containers-squad-status | 14:40 |
| jaosorior | integration | 14:40 |
| jaosorior | #link https://etherpad.openstack.org/p/tripleo-integration-squad-status | 14:40 |
| jaosorior | ui/cli | 14:40 |
| jaosorior | #link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status | 14:40 |
| jaosorior | validations | 14:40 |
| jaosorior | #link https://etherpad.openstack.org/p/tripleo-validations-squad-status | 14:40 |
| jaosorior | networking | 14:40 |
| jaosorior | #link https://etherpad.openstack.org/p/tripleo-networking-squad-status | 14:40 |
| jaosorior | workflows | 14:41 |
| jaosorior | #link https://etherpad.openstack.org/p/tripleo-workflows-squad-status | 14:41 |
| jaosorior | security | 14:41 |
| jaosorior | #link https://etherpad.openstack.org/p/tripleo-security-squad | 14:41 |
| jaosorior | edge | 14:41 |
| jaosorior | #link https://etherpad.openstack.org/p/tripleo-edge-squad-status | 14:41 |
| jaosorior | So, from the security squad side, we'll be working on reviving the patches that restrict SSH access for the overcloud (namely https://review.openstack.org/#/c/582437/ and https://review.openstack.org/#/c/582436/ ) | 14:42 |
| jaosorior | other than this, not a lot to share | 14:42 |
| jaosorior | any other squad that would like to share some highlights? | 14:42 |
| *** fhubik is now known as fhubik|brb | 14:42 | |
| slagle | it seems 1400UTC thursday will be a good time for the edge squad meeting | 14:42 |
| slagle | i'll send an update to the ML, and let's plan to meet this thursday | 14:43 |
| jaosorior | slagle++ | 14:43 |
| *** mjturek has quit IRC | 14:43 | |
| jaosorior | any other updates from other squads? | 14:45 |
| weshay | jaosorior, ci notes are summed up in the etherpad | 14:45 |
| jaosorior | great, thanks! | 14:45 |
| jaosorior | #topic bugs & blueprints | 14:46 |
| *** openstack changes topic to "bugs & blueprints (Meeting topic: tripleo)" | 14:46 | |
| jaosorior | #link https://launchpad.net/tripleo/+milestone/rocky-rc2 | 14:46 |
| jaosorior | #link https://launchpad.net/tripleo/+milestone/stein-1 | 14:46 |
| jaosorior | For Stein we currently have 28 blueprints open in Launchpad. | 14:46 |
| jaosorior | Bugs: 12 rocky-rc2, 772 (+32) stein-1. 103 (0) open Storyboard bugs. | 14:46 |
| jaosorior | #link https://storyboard.openstack.org/#!/project_group/76 | 14:46 |
| mwhahaha | we have a whole bunch of alert bugs open | 14:47 |
| mwhahaha | would be nice to get those addressed this week | 14:47 |
| jaosorior | they're all assigned to folks, so hopefully they do get addressed :) | 14:47 |
| *** mjturek has joined #tripleo | 14:47 | |
| jaosorior | #topic projects releases or stable backports | 14:48 |
| *** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)" | 14:48 | |
| mwhahaha | we're going to cut rc2 this week | 14:48 |
| mwhahaha | which if nothing major is wrong, will be the ga for rocky | 14:48 |
| *** bogdando has quit IRC | 14:48 | |
| * fultonj hopes to land https://review.openstack.org/#/q/topic:bug/1769769+(status:open+OR+status:merged) in rocky | 14:49 | |
| mwhahaha | so if there are any major blockers for rocky, please raise them now | 14:49 |
| jaosorior | mwhahaha: well, TLS everywhere is broken for rocky. Hope to get support for owalsh (and maybe beagles) on that. | 14:50 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Resolve get_build_command output before container_build_id https://review.openstack.org/602734 | 14:50 |
| beagles | mwhahaha: there may be some openvswitch upgrade from queens to rocky as well - looking into this right now | 14:51 |
| mwhahaha | k those will likely need to follow up after GA | 14:51 |
| beagles | mwhahaha: it won't affect things until we have a 2.10 package though | 14:51 |
| mwhahaha | k | 14:51 |
| jaosorior | #topic specs | 14:52 |
| *** openstack changes topic to "specs (Meeting topic: tripleo)" | 14:52 | |
| jaosorior | #link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open | 14:52 |
| jaosorior | it's a good time to review specs folks! | 14:52 |
| jaosorior | #topic open discussion | 14:54 |
| *** openstack changes topic to "open discussion (Meeting topic: tripleo)" | 14:54 | |
| fultonj | standalone installer works w/ ceph; docs patch https://review.openstack.org/#/c/602710 | 14:54 |
| jaosorior | Anything else folks want to bring up to the meeting? | 14:54 |
| weshay | nice | 14:54 |
| *** fhubik|brb is now known as fhubik | 14:54 | |
| weshay | fultonj++ | 14:54 |
| jaosorior | fultonj: nice! | 14:54 |
| weshay | FYI.. ci folks will be on irc to help, chat etc | 14:54 |
| weshay | we may also be on bluejeans.. | 14:54 |
| jaosorior | weshay++ | 14:55 |
| marios | 7050859455 weshay community call next | 14:55 |
| *** paramite|clone has quit IRC | 14:55 | |
| fultonj | is there a plan to replace some scenario ci jobs with stand alone versions? | 14:55 |
| fultonj | i remember the topic came up at PTG but doesn't sure if there's a squad with a todo list for it | 14:56 |
| *** hamzy has quit IRC | 14:56 | |
| marios | fultonj: right i dont think we've planned the work items or assigned to anyone yet | 14:56 |
| marios | fultonj: but there was no opposition at ptg at least | 14:57 |
| mwhahaha | i think we'll do that after we get a fedora28 standalone going | 14:57 |
| fultonj | mwhahaha: ok, that makes sense | 14:57 |
| marios | fultonj: so i guess tripleo ci team will at least be involved there but it would likely require input from other squads too | 14:57 |
| mwhahaha | it's part of further optimizations, we've got some other hurdles first | 14:57 |
| mwhahaha | like tempest on standalone (still not merged) | 14:57 |
| *** Chaserjim has quit IRC | 14:58 | |
| *** hamzy has joined #tripleo | 14:58 | |
| weshay | stupid mirrors | 14:59 |
| jaosorior | Anything else folks want to bring up? | 14:59 |
| jaosorior | Alright! thanks for joinin! | 15:00 |
| jaosorior | #endmeeting | 15:00 |
| *** openstack changes topic to "Welcome to Rocky | CI Status: most likely RED https://docs.openstack.org/tripleo-docs/latest/" | 15:00 | |
| openstack | Meeting ended Tue Sep 18 15:00:34 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-09-18-14.01.html | 15:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-09-18-14.01.txt | 15:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-09-18-14.01.log.html | 15:00 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: automatically build a test package when only CI is changed https://review.openstack.org/603277 | 15:02 |
| rook | mwhahaha: my bad! Didn't mean to hijack things -- that was the issue. Found what was missing. Thanks! | 15:02 |
| mwhahaha | rook: k. it's likely you forgot the ovn environments when you ran the container prepare stuff | 15:03 |
| rook | mwhahaha: I moved to using the new tripleo commands for container prepare -- and failed to include the ovn containers | 15:03 |
| rook | go figure | 15:03 |
| *** ksambor has quit IRC | 15:04 | |
| mwhahaha | rook: that's likely a bug, should raise that and ping stevebaker. usually there's a missing thing somewhere in THT when that happens | 15:04 |
| *** boazel has joined #tripleo | 15:04 | |
| *** Chaserjim has joined #tripleo | 15:05 | |
| rook | mwhahaha: the workflow has changed it seems. The user has to generate the docker_registry by running the new prepare command twice. One with no env file, one with the env file (in my case the OVN env file) | 15:05 |
| mwhahaha | rook: no i don't think that's right | 15:06 |
| mwhahaha | of course i could be wrong, would need to consult the docs | 15:06 |
| rook | mwhahaha: so in your opinion I should just pass with the ovn env and should be good to go. | 15:06 |
| mwhahaha | i think only once is required now | 15:06 |
| rook | The docs don't discuss how to pass env files, just the default deployment. | 15:06 |
| *** ramishra has quit IRC | 15:07 | |
| rook | I have a launchpad on this -- discussing the old mechanism to prepare -- but the new prepare command this is still true : https://bugs.launchpad.net/tripleo/+bug/1792917 | 15:08 |
| openstack | Launchpad bug 1792917 in tripleo "container image prepare not working as expected" [Medium,Triaged] | 15:08 |
| mwhahaha | rook: https://review.openstack.org/#/c/599462/ | 15:08 |
| *** zul has quit IRC | 15:08 | |
| *** hamdyk has quit IRC | 15:09 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Revert "Revert "Add ability to have dlrn build all the packages at once"" https://review.openstack.org/603406 | 15:09 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 15:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 15:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 15:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 15:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix committed] - Assigned to Mehdi Abaakouk (sileht) | 15:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 15:10 |
| *** Chaserjim has quit IRC | 15:10 | |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 15:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 15:10 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Revert "Revert "Add ability to have dlrn build all the packages at once"" https://review.openstack.org/603406 | 15:10 |
| mwhahaha | so many bugs | 15:10 |
| *** dxiri has quit IRC | 15:12 | |
| *** iranzo has quit IRC | 15:13 | |
| *** aufi has quit IRC | 15:14 | |
| *** florianf|biab is now known as florianf | 15:15 | |
| *** shyamb has quit IRC | 15:18 | |
| *** zul has joined #tripleo | 15:18 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Remove non-voting jobs from the gate https://review.openstack.org/603419 | 15:27 |
| openstackgerrit | Merged openstack/tripleo-common master: Add container runtime packages for cron image https://review.openstack.org/596277 | 15:30 |
| *** iranzo has joined #tripleo | 15:31 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates stable/ocata: DNM, wes testing https://review.openstack.org/603422 | 15:32 |
| *** bugzy has quit IRC | 15:34 | |
| *** Chaserjim has joined #tripleo | 15:37 | |
| *** dprince has joined #tripleo | 15:39 | |
| *** dprince has quit IRC | 15:40 | |
| *** dprince has joined #tripleo | 15:40 | |
| jrist | bfournie: good bob vs. evil bob | 15:41 |
| jrist | I like it | 15:41 |
| bfournie | :-) | 15:41 |
| nhicher | weshay, rlandy: could you have a look to https://review.openstack.org/#/c/596432/ , we need it to run jobs on vexxhost and rdocloud | 15:43 |
| *** fhubik has quit IRC | 15:43 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: provider: Add vexxhost https://review.openstack.org/596432 | 15:43 |
| *** Chaserjim has quit IRC | 15:44 | |
| *** bugzy has joined #tripleo | 15:45 | |
| *** Chaserjim has joined #tripleo | 15:45 | |
| *** iranzo has quit IRC | 15:45 | |
| rlandy | eek- there is a lot of movement in those files atm | 15:46 |
| weshay | rfolco, can you help nhicher w/ https://review.openstack.org/#/c/596432/ | 15:49 |
| *** saneax has quit IRC | 15:51 | |
| nhicher | thanks for the quick review weshay =) | 15:51 |
| openstackgerrit | Brad P. Crochet proposed openstack/python-tripleoclient master: WIP: Speed up plan operations by using a tarball in swift. https://review.openstack.org/581141 | 15:53 |
| weshay | nhicher, panda rfolco so.. what happens to the shell scripts in tripleo-ci/toci_gate_test.sh toci_quickstart.sh | 15:58 |
| weshay | shouldn't those already be removed or renamed to .deprecated | 15:58 |
| weshay | ? | 15:58 |
| weshay | nhicher, those shell scripts are not used in upstream-ci | 15:59 |
| rlandy | yes- but at the moment they are still in use | 15:59 |
| *** yprokule has quit IRC | 15:59 | |
| panda | ye we can't move then until we're sure nothing is using them | 15:59 |
| *** dxiri has joined #tripleo | 16:00 | |
| *** rdopiera has quit IRC | 16:00 | |
| nhicher | weshay, rlandy: I will add content in *j2 too | 16:00 |
| *** hamzy has quit IRC | 16:01 | |
| *** gkadam has joined #tripleo | 16:02 | |
| janki | weshay, hey. Can you please review https://review.openstack.org/#/c/602196/ | 16:03 |
| *** thrash is now known as thrash|biab | 16:09 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 16:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 16:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 16:10 |
| *** mjturek has quit IRC | 16:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 16:10 |
| *** ykarel|away has joined #tripleo | 16:10 | |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix committed] - Assigned to Mehdi Abaakouk (sileht) | 16:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 16:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 16:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 16:10 |
| openstackgerrit | Nicolas Hicher proposed openstack-infra/tripleo-ci master: provider: Add vexxhost https://review.openstack.org/596432 | 16:10 |
| *** mjturek has joined #tripleo | 16:12 | |
| openstackgerrit | Nicolas Hicher proposed openstack-infra/tripleo-ci master: provider: Add vexxhost https://review.openstack.org/596432 | 16:13 |
| *** rlandy is now known as rlandy|brb | 16:14 | |
| *** mjturek has quit IRC | 16:22 | |
| *** holser_ has quit IRC | 16:23 | |
| openstackgerrit | David Peacock proposed openstack/tripleo-image-elements master: add python 3.6 unit test job https://review.openstack.org/596064 | 16:24 |
| *** Chaserjim has quit IRC | 16:25 | |
| rfolco | nhicher, if this provider won't be used by legacy periodic rdo-jobs, then you only need to change templates j2 | 16:28 |
| *** bnemec has quit IRC | 16:28 | |
| *** dtantsur is now known as dtantsur|afk | 16:28 | |
| *** Chaserjim has joined #tripleo | 16:28 | |
| *** bnemec has joined #tripleo | 16:28 | |
| openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates master: Disable OVN related services in ODL env file https://review.openstack.org/603437 | 16:31 |
| *** jpich has quit IRC | 16:33 | |
| *** thrash|biab is now known as thrash | 16:35 | |
| *** Chaserjim has quit IRC | 16:35 | |
| *** rlandy|brb is now known as rlandy | 16:38 | |
| dprince | EmilienM: hey, regarding the reuse of ansible-role-container-registry | 16:39 |
| dprince | EmilienM: I don't think there is much point since almost none of the parameters can be shared: http://git.openstack.org/cgit/openstack/ansible-role-container-registry/tree/defaults/main.yml | 16:39 |
| *** mjturek has joined #tripleo | 16:40 | |
| EmilienM | dprince: right, I missed the point that the container was already configured sorry | 16:43 |
| EmilienM | dprince: as for the params, yeah we should make them more generic I guess | 16:43 |
| EmilienM | if needed | 16:43 |
| dprince | EmilienM: yeah, its going to be 3 more config files. Apache, crane, crane wsgi | 16:43 |
| dprince | EmilienM: kind of totally unrelated playbooks I think | 16:43 |
| EmilienM | ack | 16:44 |
| EmilienM | I just don't want to see extra puppet code (if any) and do it with ansible if we had to | 16:44 |
| EmilienM | but it doesn't sound the case now | 16:44 |
| EmilienM | dprince: so are will we be pushing for a new THT service, like Os::TripleO::Services::Crane, right? | 16:45 |
| dprince | EmilienM: yep, I should have it all posted this week | 16:45 |
| *** mjturek has quit IRC | 16:45 | |
| EmilienM | cool | 16:45 |
| * EmilienM lunch | 16:45 | |
| nhicher | rfolco: It will be used by legacy jobs | 16:49 |
| rfolco | nhicher, ack | 16:49 |
| *** amoralej is now known as amoralej|off | 16:50 | |
| *** dciabrin has quit IRC | 16:51 | |
| weshay | nhicher, we're not going to have legacy jobs :) | 16:52 |
| weshay | nhicher, those are going away now | 16:52 |
| weshay | :).. you have the j2.. so we're good | 16:53 |
| nhicher | weshay: ok, great =) | 16:55 |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: add branched versions of scen01-04 jobs https://review.openstack.org/600641 | 16:56 |
| *** dsneddon has joined #tripleo | 17:00 | |
| *** kopecmartin has quit IRC | 17:01 | |
| *** tzumainn has quit IRC | 17:01 | |
| mwhahaha | EmilienM, dprince: rather than Os:TripleO::Services::Crane, can we just have a generic name for the function like ContainerRegistry? That way we can just replace it later w/o having to add more services | 17:01 |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: add branched versions of scen01-04 jobs https://review.openstack.org/600641 | 17:02 |
| *** jpena is now known as jpena|off | 17:02 | |
| *** derekh has quit IRC | 17:02 | |
| *** gfidente is now known as gfidente|afk | 17:04 | |
| rlandy | nhicher: left a few questions on the review | 17:04 |
| dprince | mwhahaha: I think that is fine. | 17:04 |
| *** vinaykns has quit IRC | 17:05 | |
| *** gkadam has quit IRC | 17:07 | |
| openstackgerrit | Merged openstack/tripleo-specs master: import zuul job settings from project-config https://review.openstack.org/597786 | 17:07 |
| trown | mandre: I am hitting the permission issue with the container patch | 17:07 |
| openstackgerrit | Merged openstack/tripleo-docs master: switch documentation job to new PTI https://review.openstack.org/597774 | 17:07 |
| openstackgerrit | Merged openstack/tripleo-common master: Revert "Use YAML output of ansible instead of JSON" https://review.openstack.org/603181 | 17:09 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Fluentd configures rsyslog to send logs properly https://review.openstack.org/587496 | 17:09 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Remove roles blocking zuulv3 transition https://review.openstack.org/602445 | 17:09 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Create interface to create mysql resources via hieradata https://review.openstack.org/600000 | 17:09 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add pvremove to the disk clean step https://review.openstack.org/565182 | 17:09 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Set OVS local ip through OVS ODL class https://review.openstack.org/597007 | 17:09 |
| openstackgerrit | Merged openstack/instack-undercloud stable/rocky: Expose nova.conf config lines to be used as hiera overrides https://review.openstack.org/602565 | 17:10 |
| *** dsneddon has quit IRC | 17:10 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 17:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 17:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 17:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 17:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix committed] - Assigned to Mehdi Abaakouk (sileht) | 17:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 17:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 17:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 17:10 |
| *** salmankhan has quit IRC | 17:10 | |
| *** tzumainn has joined #tripleo | 17:14 | |
| *** jchhatbar has joined #tripleo | 17:14 | |
| *** errantekarmico has joined #tripleo | 17:16 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Add logrotate compress option https://review.openstack.org/601548 | 17:16 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Force GDPR compliance of containers logs https://review.openstack.org/601554 | 17:16 |
| *** janki has quit IRC | 17:17 | |
| *** akhila has joined #tripleo | 17:17 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Fix check mode for server deployments https://review.openstack.org/600182 | 17:21 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Check mode support for hiera deployments https://review.openstack.org/600183 | 17:21 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Fix check mode for server deployments https://review.openstack.org/600182 | 17:24 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Check mode support for hiera deployments https://review.openstack.org/600183 | 17:24 |
| *** dsneddon has joined #tripleo | 17:32 | |
| *** jchhatbar has quit IRC | 17:40 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: tripleo-ci/master: add virt7-container-common-candidate https://review.openstack.org/602973 | 17:48 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: tripleo-ci/master: add virt7-container-common-candidate https://review.openstack.org/602973 | 17:48 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: tripleo-ci/master: add virt7-container-common-candidate https://review.openstack.org/602973 | 17:49 |
| openstackgerrit | Merged openstack/tripleo-ipsec stable/queens: import zuul job settings from project-config https://review.openstack.org/597837 | 17:53 |
| *** gfidente|afk has quit IRC | 17:59 | |
| *** trown is now known as trown|lunch | 18:00 | |
| *** hjensas has quit IRC | 18:01 | |
| *** panda is now known as panda|dinner | 18:01 | |
| *** hjensas has joined #tripleo | 18:03 | |
| fultonj | jaosorior: i have a follow up question about https://review.openstack.org/#/c/597221 if you're still around. else i'll talk to you tmorrow | 18:03 |
| *** ykarel|away has quit IRC | 18:10 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 18:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 18:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 18:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 18:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix committed] - Assigned to Mehdi Abaakouk (sileht) | 18:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 18:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 18:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 18:10 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: f28 support for quickstart https://review.openstack.org/591652 | 18:12 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: enable fedora-28 for the reproducer https://review.openstack.org/602492 | 18:12 |
| *** mjturek has joined #tripleo | 18:16 | |
| *** tzumainn has quit IRC | 18:37 | |
| *** errantekarmico has quit IRC | 18:40 | |
| *** errantekarmico has joined #tripleo | 18:40 | |
| *** errantekarmico has quit IRC | 18:43 | |
| *** errantekarmico has joined #tripleo | 18:44 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Fix check mode for server deployments https://review.openstack.org/600182 | 18:53 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Check mode support for hiera deployments https://review.openstack.org/600183 | 18:53 |
| *** trown|lunch is now known as trown | 18:55 | |
| *** assassin has quit IRC | 18:59 | |
| *** errantekarmico has quit IRC | 19:00 | |
| *** errantekarmico has joined #tripleo | 19:01 | |
| *** errantekarmico has quit IRC | 19:03 | |
| *** errantekarmico has joined #tripleo | 19:03 | |
| *** hamzy has joined #tripleo | 19:04 | |
| *** dxiri has quit IRC | 19:06 | |
| *** errantekarmico has quit IRC | 19:06 | |
| *** errantekarmico has joined #tripleo | 19:07 | |
| *** errantekarmico has quit IRC | 19:08 | |
| *** errantekarmico has joined #tripleo | 19:09 | |
| fultonj | toure: i have a system you could use to debug lp 1789680, if you want to SSH in | 19:09 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] https://launchpad.net/bugs/1789680 - Assigned to Toure Dunnon (toure) | 19:09 |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 19:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 19:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792892 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 19:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 19:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix committed] - Assigned to Mehdi Abaakouk (sileht) | 19:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 19:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 19:10 |
| openstack | Launchpad bug 1792892 in tripleo "Undercloud upgrades fails at ERROR! Invalid callback for stdout specified: yaml" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 19:10 |
| *** errantekarmico has quit IRC | 19:14 | |
| *** raildo has quit IRC | 19:14 | |
| *** raildo has joined #tripleo | 19:20 | |
| *** errantekarmico has joined #tripleo | 19:20 | |
| *** boazel has quit IRC | 19:23 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-docs master: Update standalone documentation to include steps for Ceph https://review.openstack.org/602710 | 19:24 |
| *** errantekarmico has quit IRC | 19:24 | |
| *** errantekarmico has joined #tripleo | 19:25 | |
| *** Chaserjim has joined #tripleo | 19:28 | |
| *** panda|dinner is now known as panda | 19:30 | |
| *** mjturek has quit IRC | 19:34 | |
| *** errantekarmico has quit IRC | 19:35 | |
| openstackgerrit | Alex Schultz proposed openstack-infra/tripleo-ci master: Revert "Switch containerized undercloud job to nv" https://review.openstack.org/603478 | 19:35 |
| *** errantekarmico has joined #tripleo | 19:35 | |
| *** Chaserjim has quit IRC | 19:37 | |
| *** errantekarmico has quit IRC | 19:38 | |
| *** Chaserjim has joined #tripleo | 19:39 | |
| *** errantekarmico has joined #tripleo | 19:39 | |
| *** Chaserjim has quit IRC | 19:47 | |
| *** Chaserjim has joined #tripleo | 19:48 | |
| *** mjturek has joined #tripleo | 19:49 | |
| openstackgerrit | Nicolas Hicher proposed openstack-infra/tripleo-ci master: provider: Add vexxhost https://review.openstack.org/596432 | 19:49 |
| openstackgerrit | Nicolas Hicher proposed openstack-infra/tripleo-ci master: provider: Add vexxhost https://review.openstack.org/596432 | 19:50 |
| *** gouthamr has quit IRC | 20:00 | |
| *** Chaserjim has quit IRC | 20:00 | |
| *** stevebaker has quit IRC | 20:01 | |
| *** dmellado has quit IRC | 20:01 | |
| *** gouthamr has joined #tripleo | 20:03 | |
| *** raildo_ has joined #tripleo | 20:04 | |
| *** Chaserjim has joined #tripleo | 20:05 | |
| *** raildo has quit IRC | 20:06 | |
| toure | fultonj ping | 20:07 |
| fultonj | toure: pong | 20:07 |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 20:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 20:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 20:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 20:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix committed] - Assigned to Mehdi Abaakouk (sileht) | 20:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 20:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 20:10 |
| *** Chaserjim has quit IRC | 20:11 | |
| *** errantekarmico has quit IRC | 20:13 | |
| *** cgoncalves is now known as cgoncalves|pto | 20:13 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: WIP: Add chrony time service https://review.openstack.org/588111 | 20:13 |
| *** boazel has joined #tripleo | 20:15 | |
| *** akrivoka has quit IRC | 20:17 | |
| *** Chaserjim has joined #tripleo | 20:19 | |
| slagle | An error occurred during configuration validation, please check your host configuration and try again. Error message: Task 'loop on existing volumes, check available space' failed: | 20:24 |
| slagle | Host: undercloud | 20:24 |
| slagle | Message: Minimum required for /: 20G - volume free space: 20.5 | 20:24 |
| slagle | :) | 20:24 |
| slagle | it's an off by 0.5 error | 20:24 |
| *** Chaserjim has quit IRC | 20:24 | |
| *** Chaserjim has joined #tripleo | 20:25 | |
| *** rmascena__ has joined #tripleo | 20:26 | |
| EmilienM | mwhahaha: yes +2 to that idea | 20:27 |
| EmilienM | slagle: docker images |xargs docker rmi -f | 20:27 |
| EmilienM | that's what I do when I redeploy | 20:27 |
| mwhahaha | pffft math | 20:27 |
| mwhahaha | weshay: did rdo cloud just go poof | 20:28 |
| openstackgerrit | Damien Ciabrini proposed openstack/puppet-tripleo master: mysql: fix root password update for containerized mysql https://review.openstack.org/602499 | 20:28 |
| *** raildo_ has quit IRC | 20:29 | |
| *** mwhahaha changes topic to "Welcome to Rocky | CI Status: GREENish, except rdo cloud which is dead to me. https://docs.openstack.org/tripleo-docs/latest/" | 20:29 | |
| slagle | EmilienM: the point is, i had enough space already :) | 20:29 |
| mwhahaha | where is that validation anyway | 20:29 |
| mwhahaha | is that stuff we hide in tripleoclient | 20:29 |
| slagle | not sure, i did file a bug though | 20:30 |
| slagle | https://bugs.launchpad.net/tripleo/+bug/1793211 | 20:30 |
| openstack | Launchpad bug 1793211 in tripleo "undercloud ugprade root partition free space validation inaccurate" [Medium,Triaged] | 20:30 |
| slagle | i can take a close look a bit later | 20:30 |
| mwhahaha | we have a downstream bug for that | 20:30 |
| * mwhahaha updates it | 20:30 | |
| mwhahaha | that was the thing that artem was looking into | 20:31 |
| mwhahaha | does it with 50G too | 20:31 |
| mwhahaha | so our math is bad | 20:31 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: enable fedora-28 for the reproducer https://review.openstack.org/602492 | 20:31 |
| EmilienM | i thought it was in tripleoclient | 20:32 |
| openstackgerrit | wes hayutin proposed openstack/python-tripleoclient master: Add python3 fedora standalone https://review.openstack.org/600871 | 20:32 |
| EmilienM | https://git.openstack.org/cgit/openstack/tripleo-validations/tree/validations/tasks/disk_space.yaml#n17 | 20:32 |
| EmilienM | "(volumes | selectattr('mount', 'equalto', item.mount) | map(attribute='min_size') | list | join('')|int) >= (item.size_available|int / const_bytes_in_gb|int) |int" | 20:32 |
| mwhahaha | cani blame ansible? | 20:33 |
| *** med_ has joined #tripleo | 20:33 | |
| EmilienM | 1073741824 bytes == 0.999998301268 GB | 20:33 |
| mwhahaha | pfffft math | 20:33 |
| bnemec | Tis but a rounding error! | 20:34 |
| weshay | mwhahaha, ya.. poof | 20:34 |
| *** med_ has quit IRC | 20:34 | |
| *** rmascena__ has quit IRC | 20:35 | |
| bnemec | Also, I've been asked to request reviewers or abandon https://review.openstack.org/#/c/571321/ , so this is me requesting reviewers. :-) | 20:35 |
| *** akhila has quit IRC | 20:35 | |
| mwhahaha | why would we test functionality | 20:36 |
| *** Chaserjim has quit IRC | 20:36 | |
| mwhahaha | that seems... crazy | 20:36 |
| bnemec | Sounds like some high fallutin' software engineery business to me. | 20:36 |
| * mwhahaha goes back to other crazy things, like math | 20:37 | |
| *** ade_lee has quit IRC | 20:39 | |
| *** Chaserjim has joined #tripleo | 20:40 | |
| *** panda has quit IRC | 20:41 | |
| *** Chaserjim has quit IRC | 20:44 | |
| *** ansmith has quit IRC | 20:45 | |
| *** hamzy has quit IRC | 20:47 | |
| *** mjturek has quit IRC | 20:47 | |
| *** Chaserjim has joined #tripleo | 20:48 | |
| *** rh-jelabarre has quit IRC | 20:53 | |
| *** weshay is now known as weshay_pto | 20:53 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Te-broker: save all nodes console to html log dir https://review.openstack.org/588488 | 20:54 |
| *** mrsoul has joined #tripleo | 20:56 | |
| *** Chaserjim has quit IRC | 20:57 | |
| *** mschuppert has quit IRC | 20:57 | |
| *** abishop has quit IRC | 21:00 | |
| *** Chaserjim has joined #tripleo | 21:00 | |
| *** Chaserjim has quit IRC | 21:05 | |
| *** Chaserjim has joined #tripleo | 21:06 | |
| *** trown is now known as trown|outtypewww | 21:06 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 21:10 |
| openstack | Launchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 21:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 21:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 21:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix committed] - Assigned to Mehdi Abaakouk (sileht) | 21:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 21:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 21:10 |
| *** chem has quit IRC | 21:11 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Don't fail ironic upgrade if xinetd isn't present https://review.openstack.org/602550 | 21:15 |
| *** gouthamr_ has joined #tripleo | 21:18 | |
| *** dprince has quit IRC | 21:19 | |
| *** dmellado has joined #tripleo | 21:20 | |
| *** Chaserjim has quit IRC | 21:23 | |
| *** rmascena__ has joined #tripleo | 21:25 | |
| *** rmascena__ has quit IRC | 21:26 | |
| *** gouthamr has quit IRC | 21:26 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Create a Timesync service declaration https://review.openstack.org/586679 | 21:29 |
| openstackgerrit | Merged openstack/instack-undercloud stable/queens: import zuul job settings from project-config https://review.openstack.org/597826 | 21:29 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Move toci BASH variables to ansible https://review.openstack.org/589448 | 21:29 |
| openstackgerrit | Merged openstack/instack-undercloud stable/pike: import zuul job settings from project-config https://review.openstack.org/597809 | 21:29 |
| openstackgerrit | Merged openstack/tripleo-image-elements stable/ocata: import zuul job settings from project-config https://review.openstack.org/597804 | 21:29 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: import zuul job settings from project-config https://review.openstack.org/597800 | 21:29 |
| openstackgerrit | Merged openstack/os-collect-config stable/ocata: import zuul job settings from project-config https://review.openstack.org/597797 | 21:29 |
| openstackgerrit | Merged openstack/instack-undercloud stable/ocata: import zuul job settings from project-config https://review.openstack.org/597795 | 21:29 |
| openstackgerrit | Merged openstack/os-apply-config stable/ocata: import zuul job settings from project-config https://review.openstack.org/597796 | 21:29 |
| openstackgerrit | Merged openstack/tripleo-common stable/ocata: import zuul job settings from project-config https://review.openstack.org/597802 | 21:29 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: import zuul job settings from project-config https://review.openstack.org/597803 | 21:29 |
| *** rlandy has quit IRC | 21:31 | |
| openstackgerrit | Merged openstack/os-refresh-config stable/queens: import zuul job settings from project-config https://review.openstack.org/597830 | 21:31 |
| openstackgerrit | Merged openstack/os-refresh-config stable/ocata: import zuul job settings from project-config https://review.openstack.org/597799 | 21:31 |
| *** agopi has quit IRC | 21:32 | |
| weshay_pto | wow | 21:32 |
| *** stevebaker has joined #tripleo | 21:36 | |
| stevebaker | morning | 21:36 |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Remove timeout logic https://review.openstack.org/589068 | 21:36 |
| *** ansmith has joined #tripleo | 21:37 | |
| openstackgerrit | Merged openstack/os-refresh-config stable/pike: import zuul job settings from project-config https://review.openstack.org/597813 | 21:42 |
| *** mcornea has quit IRC | 21:42 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Store prepare defaults in packaged yaml https://review.openstack.org/602104 | 21:55 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: WIP delete overcloud_containers.yaml https://review.openstack.org/603505 | 21:55 |
| *** sshnaidm|ptg has joined #tripleo | 22:00 | |
| *** sshnaidm|ptg is now known as sshnaidm|pto | 22:00 | |
| *** florianf is now known as florianf|afk | 22:03 | |
| *** agopi has joined #tripleo | 22:05 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 22:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 22:10 |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 22:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix committed] - Assigned to Mehdi Abaakouk (sileht) | 22:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 22:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 22:10 |
| *** Chaserjim has joined #tripleo | 22:13 | |
| *** toure is now known as toure|gpne | 22:22 | |
| *** Chaserjim has quit IRC | 22:22 | |
| *** toure|gpne is now known as toure|gone | 22:22 | |
| openstackgerrit | Nicolas Hicher proposed openstack-infra/tripleo-ci master: provider: Add vexxhost https://review.openstack.org/596432 | 22:23 |
| *** Chaserjim has joined #tripleo | 22:24 | |
| *** slaweq has quit IRC | 22:26 | |
| *** ekarmic has joined #tripleo | 22:30 | |
| *** jaosorior_ has joined #tripleo | 22:43 | |
| *** jaosorior has quit IRC | 22:45 | |
| *** Chaserjim has quit IRC | 22:46 | |
| *** rcernin has joined #tripleo | 22:47 | |
| *** Chaserjim has joined #tripleo | 22:47 | |
| *** janki has joined #tripleo | 22:47 | |
| *** ekarmic has quit IRC | 22:47 | |
| *** errantekarmico has joined #tripleo | 22:48 | |
| *** Chaserjim has quit IRC | 22:51 | |
| *** sshnaidm|pto has quit IRC | 22:59 | |
| *** dhill_ has quit IRC | 22:59 | |
| *** Chaserjim has joined #tripleo | 23:00 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792296 | 23:10 |
| openstack | Launchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792343 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792862 | 23:10 |
| openstack | Launchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [Critical,Triaged] | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792870 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792872 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 23:10 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix committed] - Assigned to Mehdi Abaakouk (sileht) | 23:10 |
| openstack | Launchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 23:10 |
| openstack | Launchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 23:10 |
| *** Chaserjim has quit IRC | 23:12 | |
| *** Chaserjim has joined #tripleo | 23:16 | |
| *** tosky has quit IRC | 23:18 | |
| *** abishop has joined #tripleo | 23:20 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Update standalone docs https://review.openstack.org/603522 | 23:20 |
| openstackgerrit | Nicolas Hicher proposed openstack-infra/tripleo-ci master: provider: Add vexxhost https://review.openstack.org/596432 | 23:24 |
| *** dmacpher has quit IRC | 23:26 | |
| *** gfidente has joined #tripleo | 23:33 | |
| *** Chaserjim has quit IRC | 23:35 | |
| *** gfidente has quit IRC | 23:37 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-validations master: Fix diskspace validation when size is the limit https://review.openstack.org/603523 | 23:38 |
| mwhahaha | slagle: EmilienM: -^ disk space problem | 23:38 |
| *** errantekarmico has quit IRC | 23:40 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-validations master: Fix diskspace validation when size is the limit https://review.openstack.org/603523 | 23:54 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!