| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
|---|---|---|
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 00:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 00:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 00:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 00:10 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Action for the UI to prepare container image parameters https://review.openstack.org/503296 | 00:14 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-ui master: Container prepare in plan create/update workflows https://review.openstack.org/507720 | 00:16 |
| *** leitan has joined #tripleo | 00:18 | |
| *** ecerquei_ has joined #tripleo | 00:32 | |
| *** psachin has quit IRC | 00:40 | |
| *** psachin has joined #tripleo | 00:41 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 01:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 01:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 01:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 01:10 |
| *** cshastri has joined #tripleo | 01:26 | |
| *** dtrainor has joined #tripleo | 01:43 | |
| *** fzdarsky_ has joined #tripleo | 01:49 | |
| *** fzdarsky__ has quit IRC | 01:53 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 02:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 02:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 02:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 02:10 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Sudo fix overcloud-custom-tht-script.sh.j2 https://review.openstack.org/499018 | 02:44 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Use os_keypair for key upload https://review.openstack.org/445224 | 02:44 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Allow OVB to attach undercloud to existing floating IP https://review.openstack.org/506397 | 02:44 |
| *** bobh has quit IRC | 02:46 | |
| *** bobh has joined #tripleo | 03:01 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 03:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 03:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 03:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 03:10 |
| *** leitan has quit IRC | 03:26 | |
| *** achadha has joined #tripleo | 03:31 | |
| *** links has joined #tripleo | 03:48 | |
| *** sshnaidm|off is now known as sshnaidm | 03:54 | |
| *** ecerquei_ has quit IRC | 04:04 | |
| *** achadha has quit IRC | 04:07 | |
| *** achadha has joined #tripleo | 04:08 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 04:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 04:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 04:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 04:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 04:10 |
| *** achadha has quit IRC | 04:12 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Use sub_nodes_private file for getting IP of multinode https://review.openstack.org/508800 | 04:16 |
| *** jaosorior has joined #tripleo | 04:19 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Use sub_nodes_private instead of sub_nodes https://review.openstack.org/508801 | 04:20 |
| *** dsariel has quit IRC | 04:20 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test CI job https://review.openstack.org/508660 | 04:24 |
| *** yamahata has joined #tripleo | 04:35 | |
| *** ykarel has joined #tripleo | 04:36 | |
| *** dpawar has joined #tripleo | 04:54 | |
| *** dpawar has quit IRC | 04:55 | |
| *** aditya_r has joined #tripleo | 04:55 | |
| *** dpawar has joined #tripleo | 04:56 | |
| *** bobh has quit IRC | 04:58 | |
| *** bobh has joined #tripleo | 04:59 | |
| *** numans has quit IRC | 05:03 | |
| *** numans has joined #tripleo | 05:06 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 05:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 05:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 05:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 05:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 05:10 |
| *** dpawar has quit IRC | 05:13 | |
| *** dpawar has joined #tripleo | 05:13 | |
| *** dpawar has quit IRC | 05:18 | |
| *** psahoo has joined #tripleo | 05:25 | |
| *** bobh has quit IRC | 05:32 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Use sub_nodes_private https://review.openstack.org/508752 | 05:32 |
| *** aditya_r has quit IRC | 05:32 | |
| *** bobh has joined #tripleo | 05:34 | |
| *** bobh has quit IRC | 05:34 | |
| *** abregman|afk is now known as abregman | 05:36 | |
| *** iranzo has joined #tripleo | 05:39 | |
| *** mdnadeem has joined #tripleo | 05:40 | |
| *** achadha has joined #tripleo | 05:49 | |
| *** aufi has joined #tripleo | 05:51 | |
| *** marios has joined #tripleo | 05:54 | |
| *** yprokule has joined #tripleo | 05:59 | |
| *** bobh has joined #tripleo | 06:05 | |
| *** etingof has quit IRC | 06:09 | |
| *** bobh has quit IRC | 06:09 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 06:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 06:10 |
| *** dsariel has joined #tripleo | 06:10 | |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 06:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 06:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 06:10 |
| *** achadha has quit IRC | 06:11 | |
| lvdombrkr | morning folks | 06:12 |
| *** dpawar has joined #tripleo | 06:14 | |
| *** dparkes has joined #tripleo | 06:16 | |
| *** achadha has joined #tripleo | 06:18 | |
| *** achadha has quit IRC | 06:19 | |
| *** dpawar has quit IRC | 06:20 | |
| *** dciabrin has joined #tripleo | 06:22 | |
| *** etingof has joined #tripleo | 06:22 | |
| *** jtomasek has joined #tripleo | 06:24 | |
| *** shardy has joined #tripleo | 06:37 | |
| *** agurenko has joined #tripleo | 06:39 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-common master: Execute minor update via ansible on mistral https://review.openstack.org/487496 | 06:41 |
| lvdombrkr | shardy: morning, i have question about default route in compute.yaml.. by default its controlplane network how important it is leave defaults? can i change default route to managment network or external? | 06:42 |
| lvdombrkr | and what issues it can cause | 06:42 |
| *** abregman has quit IRC | 06:44 | |
| shardy | lvdombrkr: you can change the default route, but you still need _a_ route from all overcloud nodes back to the undercloud, which is only connected via the ctlplane network | 06:46 |
| *** ykarel has quit IRC | 06:48 | |
| *** iranzo has quit IRC | 06:51 | |
| *** iranzo has joined #tripleo | 06:53 | |
| *** jlinkes has joined #tripleo | 06:55 | |
| *** dsariel has quit IRC | 06:56 | |
| lvdombrkr | shardy: so if i in compute.yaml change default route to external, and leave ctlplane network not as default it fill be fine? ctplane-network will be but not as default | 06:56 |
| *** amoralej has joined #tripleo | 06:58 | |
| *** jpena has joined #tripleo | 06:59 | |
| *** rcernin has joined #tripleo | 07:04 | |
| *** pcaruana has joined #tripleo | 07:08 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 07:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 07:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 07:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 07:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 07:10 |
| *** jprovazn has joined #tripleo | 07:14 | |
| *** etingof has quit IRC | 07:16 | |
| *** etingof has joined #tripleo | 07:16 | |
| *** dpawar has joined #tripleo | 07:17 | |
| *** achadha has joined #tripleo | 07:19 | |
| *** jprovazn has quit IRC | 07:19 | |
| *** fzdarsky_ is now known as fzdarsky | 07:20 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor services/utils into selectors https://review.openstack.org/506661 | 07:20 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor Ironic and Ironic Inspector services https://review.openstack.org/506662 | 07:20 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor ZaqarWebSocketService functions into thunks https://review.openstack.org/506667 | 07:20 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor KeystoneApiService into thunks https://review.openstack.org/506663 | 07:20 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor MistralApiService to thunks https://review.openstack.org/506664 | 07:20 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor HeatApiService to thunks https://review.openstack.org/506665 | 07:20 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor SwiftApiService into thunks https://review.openstack.org/506666 | 07:20 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Delete services/utils https://review.openstack.org/508466 | 07:21 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Remove unnecessary store imports from tests https://review.openstack.org/508467 | 07:21 |
| *** dpawar has quit IRC | 07:21 | |
| *** ffiore has joined #tripleo | 07:21 | |
| *** tesseract has joined #tripleo | 07:22 | |
| *** achadha has quit IRC | 07:24 | |
| *** jfrancoa has joined #tripleo | 07:26 | |
| *** mrch has joined #tripleo | 07:29 | |
| *** mcornea has joined #tripleo | 07:30 | |
| *** ebarrera has joined #tripleo | 07:35 | |
| *** ukalifon has joined #tripleo | 07:42 | |
| *** egonzalez has joined #tripleo | 07:43 | |
| *** hjensas has joined #tripleo | 07:45 | |
| *** hjensas has quit IRC | 07:45 | |
| *** hjensas has joined #tripleo | 07:45 | |
| *** jpich has joined #tripleo | 07:50 | |
| *** abregman has joined #tripleo | 07:52 | |
| *** paramite has joined #tripleo | 07:52 | |
| *** nyechiel_ has joined #tripleo | 07:59 | |
| *** jprovazn has joined #tripleo | 08:01 | |
| *** dparkes has quit IRC | 08:02 | |
| *** dparkes has joined #tripleo | 08:02 | |
| *** lucas-pto is now known as lucasagomes | 08:03 | |
| *** bobh has joined #tripleo | 08:06 | |
| *** gfidente has joined #tripleo | 08:07 | |
| *** gfidente has quit IRC | 08:07 | |
| *** gfidente has joined #tripleo | 08:07 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 08:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 08:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 08:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 08:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 08:10 |
| *** bobh has quit IRC | 08:11 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: look for info https://review.openstack.org/508820 | 08:12 |
| *** etingof has quit IRC | 08:13 | |
| *** yprokule_ has joined #tripleo | 08:15 | |
| *** yprokule has quit IRC | 08:17 | |
| *** yprokule_ is now known as yprokule | 08:17 | |
| *** sid1 has joined #tripleo | 08:17 | |
| *** aditya_r has joined #tripleo | 08:19 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Use sub_nodes_private file for getting IP of multinode https://review.openstack.org/508800 | 08:23 |
| *** dparkes has quit IRC | 08:25 | |
| *** chem has joined #tripleo | 08:25 | |
| *** cmyster has joined #tripleo | 08:29 | |
| *** iranzo has quit IRC | 08:29 | |
| *** assassin has quit IRC | 08:30 | |
| *** derekh has joined #tripleo | 08:30 | |
| *** iranzo has joined #tripleo | 08:31 | |
| *** etingof has joined #tripleo | 08:32 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates stable/ocata: Remove osd_pool_default_min_size to allow Ceph cluster to do the right thing by default https://review.openstack.org/508821 | 08:32 |
| *** gkadam has joined #tripleo | 08:33 | |
| shardy | Ugh, everything CI related still looks very red - anyone know the current status, and what we need to be looking at to help move things forward? | 08:34 |
| *** assassin has joined #tripleo | 08:35 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates stable/newton: Remove osd_pool_default_min_size to allow Ceph cluster to do the right thing by default https://review.openstack.org/508823 | 08:35 |
| *** sayani0_0 has joined #tripleo | 08:36 | |
| *** sayani0_0 is now known as 07IAA98KG | 08:36 | |
| *** florianf has joined #tripleo | 08:37 | |
| *** 07IAA98KG has quit IRC | 08:37 | |
| *** dparkes has joined #tripleo | 08:39 | |
| *** cylopez has joined #tripleo | 08:39 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: WIP: Add option for containers to log to stdout/stderr https://review.openstack.org/508517 | 08:40 |
| *** athomas has joined #tripleo | 08:41 | |
| *** aditya_r has quit IRC | 08:45 | |
| *** aditya_r has joined #tripleo | 08:45 | |
| *** dsariel has joined #tripleo | 08:46 | |
| *** aditya_r has quit IRC | 08:46 | |
| *** aditya_r has joined #tripleo | 08:46 | |
| *** salmankhan has joined #tripleo | 08:51 | |
| *** akrivoka has joined #tripleo | 08:51 | |
| *** dparkes has quit IRC | 08:52 | |
| *** florianf has quit IRC | 08:55 | |
| *** yprokule_ has joined #tripleo | 08:57 | |
| *** florianf has joined #tripleo | 08:57 | |
| *** yprokule has quit IRC | 09:00 | |
| *** yprokule_ is now known as yprokule | 09:00 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-docs master: Add note about centos-release-opstools https://review.openstack.org/508829 | 09:03 |
| lvdombrkr | shardy: can compute.yaml can be without default route at all? | 09:07 |
| *** bobh has joined #tripleo | 09:07 | |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 09:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 09:10 |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 09:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 09:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 09:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 09:10 |
| *** bobh has quit IRC | 09:11 | |
| *** ffiore has quit IRC | 09:11 | |
| *** milan has joined #tripleo | 09:18 | |
| *** dbecker has joined #tripleo | 09:21 | |
| *** panda|bbl is now known as panda | 09:23 | |
| *** tosky has joined #tripleo | 09:23 | |
| *** ffiore has joined #tripleo | 09:27 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: Fix TripleO CI jobs https://review.openstack.org/508660 | 09:30 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: Fix TripleO CI jobs https://review.openstack.org/508660 | 09:36 |
| *** oidgar has quit IRC | 09:37 | |
| *** dparkes has joined #tripleo | 09:38 | |
| *** mdnadeem has quit IRC | 09:41 | |
| *** mdnadeem has joined #tripleo | 09:44 | |
| *** mdnadeem is now known as mdnadeem|afk | 09:49 | |
| *** egonzalez has quit IRC | 09:55 | |
| *** mdnadeem|afk is now known as mdnadeem | 09:58 | |
| *** akrivoka has quit IRC | 09:58 | |
| *** ejb1123 has quit IRC | 10:04 | |
| *** bobh has joined #tripleo | 10:08 | |
| *** cshastri has quit IRC | 10:08 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 10:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 10:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 10:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 10:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 10:10 |
| *** dsneddon has joined #tripleo | 10:12 | |
| *** bobh has quit IRC | 10:13 | |
| *** sid1 has quit IRC | 10:13 | |
| *** dtantsur|afk is now known as dtantsur | 10:18 | |
| *** dparkes has quit IRC | 10:19 | |
| Tengu | hello there! | 10:19 |
| Tengu | is there a way to push some custom tasks in tripleO deploy, especially some PostInstall task? | 10:20 |
| *** aditya_r has quit IRC | 10:22 | |
| *** aditya_r has joined #tripleo | 10:22 | |
| *** dparkes has joined #tripleo | 10:29 | |
| *** jkilpatr has quit IRC | 10:29 | |
| *** morazi has quit IRC | 10:31 | |
| *** thrash|g0ne is now known as thrash | 10:32 | |
| *** psachin has quit IRC | 10:34 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart master: Fix pike release config https://review.openstack.org/507493 | 10:38 |
| yolanda | hi, i'm unable to send a patch for newton: http://logs.openstack.org/72/508072/1/check/legacy-tripleo-ci-centos-7-nonha-multinode-oooq/6ae7a93/job-output.txt.gz | 10:45 |
| yolanda | seems to fail with the new zuul v3 | 10:45 |
| yolanda | http://logs.openstack.org/72/508072/1/check/legacy-tripleo-ci-centos-7-nonha-multinode-oooq/6ae7a93/job-output.txt.gz#_2017-10-02_10_37_22_197452 | 10:46 |
| *** adarazs is now known as adarazs_brb | 10:48 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Enable configuring error log file for mysql https://review.openstack.org/508848 | 10:49 |
| *** akrivoka has joined #tripleo | 10:51 | |
| *** suuuper has joined #tripleo | 10:56 | |
| *** cmyster has quit IRC | 10:59 | |
| *** cmyster has joined #tripleo | 11:01 | |
| *** cmyster has quit IRC | 11:01 | |
| *** cmyster has joined #tripleo | 11:01 | |
| *** pkovar has joined #tripleo | 11:03 | |
| *** pkovar has quit IRC | 11:04 | |
| *** pkovar has joined #tripleo | 11:04 | |
| *** jkilpatr has joined #tripleo | 11:06 | |
| *** adarazs_brb is now known as adarazs | 11:07 | |
| *** bobh has joined #tripleo | 11:09 | |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 11:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 11:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 11:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 11:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 11:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 11:10 |
| *** snecklifter has joined #tripleo | 11:10 | |
| *** bobh has quit IRC | 11:13 | |
| *** bogdando has joined #tripleo | 11:16 | |
| honza | oi, looks like tripleo-ui gate is fixed, thanks to whomever did that :) | 11:16 |
| *** lucasagomes is now known as lucas-hungry | 11:19 | |
| *** bogdando has quit IRC | 11:20 | |
| *** sid1 has joined #tripleo | 11:21 | |
| *** bobh has joined #tripleo | 11:22 | |
| *** florianf has quit IRC | 11:22 | |
| *** florianf has joined #tripleo | 11:22 | |
| lvdombrkr | folks, i trying deploy overcloud with 2 controllers and one compute node, to test controller HA, but deployment fails with : http://paste.openstack.org/raw/622458/ | 11:22 |
| lvdombrkr | any ideas? | 11:22 |
| *** bobh has quit IRC | 11:23 | |
| *** egonzalez has joined #tripleo | 11:24 | |
| *** mrunge has quit IRC | 11:24 | |
| Tengu | lvdombrkr: bad idea to get only 2 controllers for HA, you should use three, or any odd number. | 11:24 |
| *** achadha has joined #tripleo | 11:24 | |
| Tengu | and, seeing your error message, it's apparently a DHCP range that's not big wnough - check the ranges you have on your undercloud, especially the "External" ips. | 11:24 |
| *** mrunge has joined #tripleo | 11:24 | |
| *** dparkes has quit IRC | 11:28 | |
| *** bobh has joined #tripleo | 11:28 | |
| *** achadha has quit IRC | 11:29 | |
| lvdombrkr | Tengu: thanks, but it is possible deploy with 2 nodes just for test? | 11:29 |
| lvdombrkr | Tengu: mhmm.. i think with 3 IPS adre enought.. ExternalAllocationPools: [{'start': '85.31.103.10', 'end': '85.31.103.12'} | 11:30 |
| Tengu | lvdombrkr: not sure. anyway, your issue is more due to the lack of free IP | 11:30 |
| Tengu | depdens if you activated DVR or something like that? | 11:30 |
| Tengu | you'll need one external per controller + one as VIP | 11:31 |
| Tengu | and maybe one for the compute if DVR is activated. | 11:31 |
| *** aditya_ra has joined #tripleo | 11:33 | |
| lvdombrkr | Tengu: DVR not activated in this deployment, config file looks like : http://paste.openstack.org/raw/622459/ | 11:33 |
| Tengu | lvdombrkr: then no idea, sorry. we're using larger ranges in here without issue… maybe someone else more aware of the network subtilities in tripleo/openstack can help | 11:35 |
| *** aditya_r has quit IRC | 11:36 | |
| *** aditya_ra has quit IRC | 11:36 | |
| *** dparkes has joined #tripleo | 11:37 | |
| shardy | Tengu: re your post-install requirement, have you seen https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/extra_config.html#post-deploy-extra-configuration ? | 11:40 |
| shardy | that runs after all the puppet/container steps have happened | 11:40 |
| Tengu | shardy: hello! thanks for the pointer, I was investigating OS::TripleO::PostDeploySteps | 11:40 |
| shardy | Tengu: yeah OS::TripleO::PostDeploySteps isn't really designed to be overridden, as it's what does the per-step deployment via puppet or containers | 11:41 |
| lvdombrkr | Tengu: thanks anyway, i will try just extend external IPS range | 11:41 |
| Tengu | shardy: situation: I'd like to be able to deploy a custom rsyslog configuration based on some hiera content that are already present on the nodes, so I'll need a way to call some custom thngs. | 11:41 |
| shardy | in theory you could customize it, but NodeExtraConfigPost may be a safer bet | 11:41 |
| Tengu | shardy: cool, I was a bit affraid with my "solution" as it's called with the major-upgrade, at least | 11:41 |
| shardy | Tengu: have you considered a composable service template, if you want to do this via puppet? | 11:41 |
| Tengu | shardy: as I don't really know about that, nope. care to share a doc? | 11:42 |
| *** suuuper has quit IRC | 11:42 | |
| shardy | Tengu: https://github.com/openstack/tripleo-heat-templates/tree/master/puppet/services is all the built-in services, but it's designed to be pluggable, so you could define your own local rsyslog service | 11:42 |
| Tengu | and yup, I'd be able to do that with puppet I think, in an easy way. maybe. | 11:42 |
| shardy | which sets the hieradata you need then uses step_config to run the manifest | 11:42 |
| Tengu | shardy: and how may I call it from heat? | 11:43 |
| shardy | Tengu: in roles_data.yaml there's a list of services for each role, sec let me find some docs | 11:43 |
| shardy | the list of services can be overridden either via a parameter_default in an environment file, or by using a custom -r roles_data.yaml | 11:44 |
| Tengu | shardy: if I override it, I'll need to copy the current content of roles_data.yml I guess ? | 11:44 |
| Tengu | and then maintain the list up-to-date according to the updates that might occure in the future? | 11:45 |
| Tengu | or is there a way to simple add a new one | 11:45 |
| Tengu | *simple | 11:45 |
| Tengu | *simply | 11:45 |
| shardy | Tengu: I think we're missing a good "hello world" example for composable services in the upstream docs, but check this | 11:45 |
| Tengu | (Monday is always a hard day) | 11:45 |
| shardy | https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/11/html/partner_integration/composable_services | 11:45 |
| shardy | Tengu: yeah you either need to copy the roles_data.yaml and rebase it each release, or define a custom role in t-h-t/roles and use the openstack overcloud roles generate command to combine the roles | 11:46 |
| shardy | Tengu: or, copy the list of services for e.g ControllerServices and override via parameter_defaults | 11:46 |
| Tengu | hmm. not really nice :/ | 11:47 |
| shardy | Tengu: there is a way to merge/append to the list but currently it's not working due to bug #1635409 | 11:47 |
| openstack | bug 1635409 in tripleo "parameter_merge_strategies: merge behaves like overwrite" [High,In progress] https://launchpad.net/bugs/1635409 - Assigned to Steven Hardy (shardy) | 11:47 |
| Tengu | duh | 11:47 |
| Tengu | I'm always hitting that kind of issue | 11:47 |
| shardy | Tengu: I've been working on that but it's taking a while to resolve | 11:47 |
| Tengu | like… always :) | 11:47 |
| Tengu | shardy: pretty sure it's not that easy to catch ;) | 11:48 |
| shardy | Tengu: yeah the rebasing of a list isn't ideal, but until ^^ is fixed that's the only way unfortunately | 11:48 |
| Tengu | shardy: hmm ok. and how may I point to that list? | 11:48 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/multinode.yaml#L17 | 11:49 |
| shardy | Tengu: like that, define parameter_defaults:\n\tControllerServices: <list> | 11:49 |
| Tengu | ah, ok. | 11:49 |
| Tengu | hmm. anyway, it's an AllNode thing I want to do. | 11:49 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/roles_data.yaml#L28 | 11:49 |
| Tengu | even if, apparently, there aren't any interesting logs on the ceph backends. | 11:49 |
| shardy | the default list comes from there | 11:49 |
| Tengu | yup, saw that. ook. will need to document that for my colleagues then. | 11:50 |
| shardy | Tengu: you can deploy a composable service on all nodes, but yeah that would mean maintaining a *Services list for all roles | 11:50 |
| shardy | Tengu: one other option if it's a simple puppet operation is hiera includes, sec let me find doc | 11:50 |
| shardy | https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/node_config.html | 11:51 |
| shardy | Tengu: see the last example there | 11:51 |
| Tengu | shardy: it will call syslog module and create a syslog snippet per fluentd input source | 11:51 |
| Tengu | shardy: shardy hmmm. that one should be OK, and maybe better. I'll check how to do that. | 11:56 |
| Tengu | shardy: thank you :) | 11:56 |
| *** abregman has quit IRC | 11:56 | |
| *** bfournie has quit IRC | 11:56 | |
| Tengu | shardy: I see "compute_classes" as an array, I guess there's "controller_classes" and "ceph_storage_classes" as well? | 11:56 |
| Tengu | or ceph-storage_classes | 11:56 |
| *** bfournie has joined #tripleo | 11:57 | |
| *** raildo has joined #tripleo | 11:57 | |
| shardy | Tengu: yeah it's generated for all roles: | 11:58 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/manifests/overcloud_role.pp#L22 | 11:58 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/config.role.j2.yaml#L53 | 11:58 |
| Tengu | cool. I'll go with that one. | 11:58 |
| *** atoth has joined #tripleo | 11:59 | |
| *** dprince has joined #tripleo | 11:59 | |
| *** eck`gone is now known as eck` | 11:59 | |
| *** pblaho has joined #tripleo | 11:59 | |
| lyarwood | does anyone know if tripleo-repos is the best way of moving between repos upstream during upgrades? | 12:00 |
| Tengu | hmm. or maybe not. I'll need to add a new module -.-'. not the easiest way. damn. | 12:00 |
| *** bfournie has quit IRC | 12:01 | |
| *** fultonj has joined #tripleo | 12:01 | |
| *** ffiore has quit IRC | 12:02 | |
| shardy | Tengu: There are a few ways to add it, e.g virt-copy-in to the image, yum install during one of the other earlier *ExtraConfig hooks, or there's a facility to copy and unpack a tarball from swift on deployment called "DeployArtifacts" | 12:02 |
| Tengu | shardy: yep, the deployartifacts might help. will think about it. | 12:03 |
| shardy | Tengu: https://hardysteven.blogspot.co.uk/2016/08/tripleo-deploy-artifacts-and-puppet.html has detail re the last one | 12:03 |
| shardy | Example2 is about uploading extra/different puppet modules | 12:03 |
| Tengu | yup, I saw that a few minutes ago ;) | 12:03 |
| shardy | aha :) | 12:03 |
| *** rbrady has joined #tripleo | 12:04 | |
| *** rbrady has quit IRC | 12:04 | |
| *** rbrady has joined #tripleo | 12:04 | |
| *** morazi has joined #tripleo | 12:04 | |
| *** catintheroof has joined #tripleo | 12:06 | |
| *** catinthe_ has joined #tripleo | 12:07 | |
| *** catintheroof has quit IRC | 12:08 | |
| *** sshnaidm is now known as sshnaidm|afk | 12:08 | |
| Tengu | ah, cool, commands are directly in the path. | 12:08 |
| *** morazi has quit IRC | 12:09 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 12:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 12:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 12:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 12:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 12:10 |
| *** pradk has joined #tripleo | 12:10 | |
| *** lucas-hungry is now known as lucasagomes | 12:10 | |
| *** suuuper has joined #tripleo | 12:12 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Update CephPools format in the docker templates to fit ceph-ansible https://review.openstack.org/508859 | 12:13 |
| Tengu | shardy: :] another question: is there a way to take a puppet module from the puppet forge directly? | 12:13 |
| *** abregman has joined #tripleo | 12:14 | |
| *** trown|outtypewww is now known as trown | 12:14 | |
| gfidente | shardy do you know of any issue in heat when a json parameter starts with [] instead of {} ? | 12:14 |
| gfidente | (eg it's an array of objects) | 12:14 |
| gfidente | it seems valid as per the rfc but looks like we don't use that format anywhere else | 12:15 |
| shardy | gfidente: it should handle list and map values | 12:15 |
| *** aputtur has joined #tripleo | 12:15 | |
| *** amoralej is now known as amoralej|lunch | 12:15 | |
| shardy | IIRC there was a bug a long time ago where we assumed a map, but AFAIK it should work now | 12:15 |
| gfidente | shardy so https://review.openstack.org/#/c/508859/1/docker/services/ceph-ansible/ceph-base.yaml should be okay? | 12:15 |
| gfidente | nice, thanks! | 12:16 |
| shardy | gfidente: yes, but you should use comma_delimited_list if you want to validate only a list is passed | 12:16 |
| shardy | gfidente: that will accept a list or a csv string | 12:16 |
| gfidente | shardy but items within the list can be {} pbjects? | 12:16 |
| gfidente | *objects? | 12:17 |
| shardy | gfidente: yes you can just pass a list of maps | 12:17 |
| gfidente | shardy ah ok cool | 12:17 |
| gfidente | let me update that | 12:17 |
| *** dmarlin has quit IRC | 12:17 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Update CephPools format in the docker templates to fit ceph-ansible https://review.openstack.org/508859 | 12:18 |
| shardy | Tengu: there's no direct support for that as we mostly expect image based deployments | 12:18 |
| shardy | Tengu: but you could use one of https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/extra_config.html to run a script that installs things | 12:18 |
| * shardy seems to remember someone had an example posted which did this but can't find it atm | 12:18 | |
| *** aputtur has quit IRC | 12:19 | |
| shardy | Tengu: ah, found it https://review.openstack.org/#/c/406613/ | 12:19 |
| shardy | Tengu: that was abandoned in favor of upload-puppet-modules IIRC | 12:20 |
| Tengu | hmm ok. | 12:20 |
| *** sshnaidm|afk is now known as sshnaidm | 12:20 | |
| *** morazi has joined #tripleo | 12:22 | |
| *** aputtur has joined #tripleo | 12:23 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Fix ParameterInput component https://review.openstack.org/508860 | 12:24 |
| *** jpena is now known as jpena|lunch | 12:24 | |
| honza | dprince: I'm working on the kolla build for tripleo-ui. I can't find any examples of images that won't build on debian-based systems. I'd like to add a warning to the elseif clause but can't find any examples. Thoughts? | 12:24 |
| *** ipsecguy has quit IRC | 12:26 | |
| *** colonwq has quit IRC | 12:27 | |
| *** rbrady has quit IRC | 12:27 | |
| *** ipsecguy has joined #tripleo | 12:27 | |
| *** rbrady has joined #tripleo | 12:28 | |
| *** rbrady has joined #tripleo | 12:28 | |
| *** tzumainn has joined #tripleo | 12:28 | |
| mandre | honza: you'll want something like https://github.com/openstack/kolla/blob/master/docker/heat/heat-all/Dockerfile.j2#L15-L17 | 12:29 |
| *** pradk has quit IRC | 12:30 | |
| *** aputtur has quit IRC | 12:31 | |
| *** bfournie has joined #tripleo | 12:31 | |
| honza | mandre: ah, perfect, thanks // dprince | 12:32 |
| *** jfrancoa has quit IRC | 12:34 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-heat-templates master: Use sub_nodes_private instead of node_private https://review.openstack.org/508864 | 12:34 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: Fix TripleO CI jobs https://review.openstack.org/508660 | 12:35 |
| *** ffiore has joined #tripleo | 12:35 | |
| *** abregman has quit IRC | 12:36 | |
| *** abregman has joined #tripleo | 12:36 | |
| *** bobh has quit IRC | 12:36 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: Fix TripleO CI jobs https://review.openstack.org/508660 | 12:38 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common master: Take wwn_with_extension into account, when configuring a boot device https://review.openstack.org/508865 | 12:38 |
| *** rlandy has joined #tripleo | 12:39 | |
| *** brault has quit IRC | 12:40 | |
| *** brault has joined #tripleo | 12:40 | |
| *** aputtur has joined #tripleo | 12:44 | |
| *** brault has quit IRC | 12:45 | |
| *** pchavva has joined #tripleo | 12:46 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Enable configuring error log file for mysql https://review.openstack.org/508848 | 12:46 |
| *** amoralej|lunch is now known as amoralej | 12:47 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Make the convert-image role more generic https://review.openstack.org/508868 | 12:47 |
| jaosorior | dciabrin: any idea how to log to stdout with mysql? | 12:49 |
| *** suuuper has quit IRC | 12:51 | |
| *** jfrancoa has joined #tripleo | 12:51 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Make the convert-image role more generic https://review.openstack.org/508868 | 12:52 |
| Tengu | shardy: in the end, we will filter out the hiera hash that interrest me and report it as a fact, and use that fact on our puppet master. | 12:54 |
| Tengu | shardy: a bit easier. | 12:54 |
| *** ipsecguy_ has joined #tripleo | 12:54 | |
| *** rhallisey has joined #tripleo | 12:55 | |
| *** jfrancoa has quit IRC | 12:56 | |
| *** ipsecguy__ has joined #tripleo | 12:56 | |
| *** jcoufal has joined #tripleo | 12:56 | |
| *** liverpooler has joined #tripleo | 12:57 | |
| dprince | honza: yes, mandre gave you the correct answer. | 12:57 |
| * dprince was slow to answer... in a meeting | 12:57 | |
| *** ipsecguy has quit IRC | 12:58 | |
| *** links has quit IRC | 12:59 | |
| *** abregman has quit IRC | 13:00 | |
| *** ipsecguy_ has quit IRC | 13:00 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common master: Enhances Roles List https://review.openstack.org/508514 | 13:00 |
| *** tosky_ has joined #tripleo | 13:01 | |
| *** tosky has quit IRC | 13:01 | |
| *** tosky_ is now known as tosky | 13:01 | |
| lvdombrkr | Tengu: this error can mean that i cant deploy 2 controllers HA, i need third node? Error: /Stage[main]/Tripleo::Profile::Base::Database::Mongodb/Mongodb_replset[tripleo]: Could not evaluate: rs.initiate() failed for replicaset tripleo: host 172.17.0.17:27017 didn't become master | 13:01 |
| lvdombrkr | overcloud.AllNodesDeploySteps.ComputeDeployment_Step2: | 13:01 |
| sshnaidm | dmsimard, I work on it in: https://review.openstack.org/508660 | 13:02 |
| sshnaidm | dmsimard, you can check all last reviews | 13:02 |
| *** rmascena has joined #tripleo | 13:02 | |
| dmsimard | sshnaidm: ok, I'll get my daughter ready for school and I'll catch up in the meantime | 13:02 |
| sshnaidm | dmsimard, the main problem is still hardlinks as I mentioned in bug, clarkbs patch work only for part of jobs | 13:03 |
| sshnaidm | dmsimard, sure | 13:03 |
| dmsimard | sshnaidm: what hardlinks ? | 13:03 |
| openstackgerrit | Alan Pevec proposed openstack/tripleo-quickstart master: WIP: switch to RDO Queens deps repo https://review.openstack.org/508870 | 13:04 |
| sshnaidm | dmsimard, "Invalid cross-device link" errors | 13:04 |
| *** raildo has quit IRC | 13:05 | |
| dmsimard | ?? never seen that problem before, why is that happening ? | 13:05 |
| Tengu | lvdombrkr: that's possible, because you're unable to get a proper quorum. But I'm not 100% sure. | 13:05 |
| shardy | Yeah 2 controllers is not tested/supported, you should use either 1 or 3 | 13:06 |
| lvdombrkr | Tengu: thanks... i need to look for extra node | 13:06 |
| shardy | note you can deploy with pacemaker enabled on a single node if you want | 13:06 |
| *** abregman has joined #tripleo | 13:07 | |
| lvdombrkr | shardy: mhmm...yes but to do some tests i need at least 3 nodes... | 13:07 |
| shardy | lvdombrkr: yes to test the HA aspects you will need 3 Controller nodes | 13:08 |
| *** lblanchard has joined #tripleo | 13:08 | |
| lvdombrkr | shardy: thanks...on it ) | 13:09 |
| Tengu | or any odd number above three | 13:09 |
| *** cdearborn has joined #tripleo | 13:09 | |
| *** jmelvin has joined #tripleo | 13:09 | |
| shardy | We only really test/support 3 - to scale the services beyond that it's reccomended to enable custom roles with e.g additional/separated Neutron services or whatever | 13:09 |
| *** sid2 has joined #tripleo | 13:10 | |
| shardy | but yeah in theory > 3 | 13:10 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 13:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 13:10 |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 13:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 13:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 13:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 13:10 |
| *** bobh_ has joined #tripleo | 13:11 | |
| *** rmascena is now known as raildo | 13:11 | |
| pabelanger | I won't have time this morning to look at ^, FYI | 13:12 |
| *** sid1 has quit IRC | 13:12 | |
| pabelanger | I also don't think wheel builders are working, so it could be related | 13:12 |
| *** jfrancoa has joined #tripleo | 13:12 | |
| lvdombrkr | shardy: thanks now its clear | 13:13 |
| dciabrin | jaosorior, probably via the --log-error config flag. but then one must also logs the rsync/sst logs etc | 13:13 |
| *** ipsecguy has joined #tripleo | 13:13 | |
| *** cdearborn_ has joined #tripleo | 13:14 | |
| jaosorior | dciabrin: soo... I tried that, and tried to use /dev/stdout | 13:15 |
| jaosorior | but it complained that /dev/stdout.err didn't exist, or it didn't have permission to create it. | 13:15 |
| *** cdearborn has quit IRC | 13:16 | |
| dciabrin | jaosorior, oh so I'm not sure then :/ | 13:16 |
| jaosorior | dciabrin: stumbled upon this https://bugs.mysql.com/bug.php?id=57690 | 13:16 |
| *** ipsecguy__ has quit IRC | 13:17 | |
| dciabrin | jaosorior, yes it probably has to do with some security hardening :/ | 13:19 |
| *** vpickard has quit IRC | 13:20 | |
| *** jcoufal_ has joined #tripleo | 13:21 | |
| *** vpickard has joined #tripleo | 13:22 | |
| *** paramite_ has joined #tripleo | 13:23 | |
| *** paramite has quit IRC | 13:24 | |
| *** jcoufal has quit IRC | 13:24 | |
| *** jpena|lunch is now known as jpena | 13:24 | |
| *** toure|gone is now known as toure | 13:31 | |
| *** mrch has quit IRC | 13:31 | |
| EmilienM | hello | 13:31 |
| *** jfrancoa has quit IRC | 13:32 | |
| *** mrch has joined #tripleo | 13:32 | |
| *** jcoufal has joined #tripleo | 13:33 | |
| *** jcoufal_ has quit IRC | 13:33 | |
| *** mrch has quit IRC | 13:33 | |
| *** mrch has joined #tripleo | 13:34 | |
| *** Goneri has joined #tripleo | 13:35 | |
| *** sid1 has joined #tripleo | 13:35 | |
| *** abregman has quit IRC | 13:35 | |
| jaosorior | dciabrin: how does pacemaker start the rabbitmq container? | 13:36 |
| jaosorior | dciabrin: does it redirect the output anywhere? | 13:36 |
| dciabrin | jaosorior, no it lets rabbit write its output in the regular rabbit files | 13:37 |
| dciabrin | those show up on the host in /var/log/pacemaker/bundles/rabbit-* | 13:37 |
| dciabrin | same for galera | 13:37 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: Fix TripleO CI jobs https://review.openstack.org/508660 | 13:37 |
| jaosorior | dciabrin: so, I'm trying to set the file to be stdout, and now, there is just no logs :/ | 13:38 |
| jaosorior | so I was wondering if it was redirecting that anywhere. | 13:38 |
| *** sid2 has quit IRC | 13:39 | |
| dciabrin | jaosorior, in a container? | 13:39 |
| jaosorior | dciabrin: yep | 13:39 |
| jaosorior | dciabrin: I can open a tmate session if you wanna take a look | 13:40 |
| dciabrin | jaosorior, would be nice, on the host please | 13:40 |
| jaosorior | wait up | 13:40 |
| jaosorior | dciabrin: PMed you | 13:43 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-quickstart-extras master: Ensure that network.device type exists before using it https://review.openstack.org/508881 | 13:46 |
| *** jfrancoa has joined #tripleo | 13:47 | |
| mwhahaha | dmsimard: ci still broke? | 13:48 |
| *** abregman has joined #tripleo | 13:48 | |
| dmsimard | mwhahaha: making progress, but yes | 13:49 |
| mwhahaha | k | 13:49 |
| mwhahaha | dmsimard: anything I can do to help? | 13:49 |
| dmsimard | mwhahaha: please send alcohol | 13:50 |
| dmsimard | lots of it | 13:50 |
| dmsimard | for the foreseeable future | 13:50 |
| * mwhahaha starts a tab | 13:50 | |
| dmsimard | I liked the craft beer scene in Denver, never seen anything quite like it | 13:51 |
| *** pradk has joined #tripleo | 13:51 | |
| dmsimard | mwhahaha: right now what isn't helping is that -infra is struggling with zuul v3 and nodepool in general (as in, keeping them running and running fast enough) | 13:52 |
| dmsimard | v3 is struggling to keep up with the load of just queueing and dequeuing things | 13:52 |
| mwhahaha | :( | 13:52 |
| dmsimard | mwhahaha: last updates are in the bug https://bugs.launchpad.net/tripleo/+bug/1720220 | 13:52 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 13:52 |
| *** bnemec has joined #tripleo | 13:53 | |
| dmsimard | mwhahaha: I'm still waiting for a proper recheck to land on https://review.openstack.org/#/c/507889/ and sshnaidm is working on several fixes in https://review.openstack.org/#/c/508660/ | 13:53 |
| mwhahaha | yea i saw that one | 13:53 |
| *** vpickard has quit IRC | 13:54 | |
| openstackgerrit | Alfredo Moralejo proposed openstack-infra/tripleo-ci master: Use infra proxy server for trunk.r.o in delorean-deps https://review.openstack.org/508884 | 13:54 |
| sshnaidm | dmsimard, seems like zuul is completely stuck.. no any new patch appears in status page | 13:57 |
| cmyster | .3 | 13:58 |
| dmsimard | sshnaidm: they're aware and are working on it | 13:58 |
| dmsimard | sshnaidm: see my discussion with mwhahaha just now | 13:58 |
| openstackgerrit | waleed mousa proposed openstack/puppet-tripleo master: Add support for switchdev mode in SR-IOV https://review.openstack.org/507100 | 13:58 |
| sshnaidm | dmsimard, yeah, I liked this beer too | 13:59 |
| dmsimard | mwhahaha: on the positive spectrum, at least mnaser rocked the migration for puppet-openstack | 13:59 |
| mwhahaha | dmsimard: nice i'll have to take a look at that | 14:00 |
| mnaser | yeah its merged as well in puppet-openstack-integration (where i plan to store all our jobs and project templates) | 14:00 |
| dmsimard | mnaser: https://review.openstack.org/#/c/508296/ | 14:00 |
| dmsimard | er, mwhahaha ^ | 14:00 |
| mnaser | i have to admit, its a bit frustrating not being able to get much work done because of the zuul issue :( | 14:00 |
| mwhahaha | indeed | 14:01 |
| mnaser | so im taking a little break till things settle down (or trying to do work later at night where zuul is.. less likely to freeze) | 14:01 |
| mwhahaha | :D | 14:01 |
| *** jfrancoa has quit IRC | 14:02 | |
| *** morazi has quit IRC | 14:03 | |
| *** ecerquei has joined #tripleo | 14:05 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 14:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 14:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 14:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 14:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 14:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 14:10 |
| *** gbarros has joined #tripleo | 14:16 | |
| mandre | 🍺 | 14:17 |
| mandre | dmsimard: ^ | 14:17 |
| *** jfrancoa has joined #tripleo | 14:17 | |
| dmsimard | mandre: can't take all the credit but thanks :p | 14:18 |
| *** tbonds has quit IRC | 14:18 | |
| *** mrch has quit IRC | 14:19 | |
| hrybacki | trown: I've replicated my no valid hosts on another set of hardware | 14:19 |
| mandre | dmsimard: btw, this should help tripleo-ci https://review.openstack.org/#/c/508772/ | 14:19 |
| dmsimard | sshnaidm: ^ | 14:20 |
| *** mrch has joined #tripleo | 14:20 | |
| sshnaidm | weshay, trown it started to work.. | 14:23 |
| *** aditya_r has joined #tripleo | 14:23 | |
| *** sid2 has joined #tripleo | 14:26 | |
| *** vpickard has joined #tripleo | 14:27 | |
| *** sid1 has quit IRC | 14:29 | |
| *** salmankhan has quit IRC | 14:29 | |
| *** salmankhan has joined #tripleo | 14:33 | |
| dmsimard | weshay, sshnaidm: Would some of the upstream changes to unbreak the TripleO gate also break ci.centos jobs ? | 14:33 |
| trown | hrybacki: ick... running again this morning... does it happen with all releases? may need to get someone from ironic to take a look... | 14:33 |
| trown | dmsimard: what changes specifically? | 14:34 |
| *** morazi has joined #tripleo | 14:34 | |
| hrybacki | trown: while I have two sets of hardware I've got one running against master and the other against master-tripleo-ci. If both fail I'll try an older release too before reaching out to the ironic folks | 14:35 |
| dmsimard | trown: there's different changes a bit all over the place, they're mostly documented in https://bugs.launchpad.net/tripleo/+bug/1720220 | 14:35 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 14:35 |
| trown | dmsimard: I dont see any changes that would affect ci.centos which is libvirt only... there is some question whether these patches ( https://review.openstack.org/508800 ) will work on rdoproject zuul, but we can always add a fix in rdoproject if they do | 14:35 |
| dmsimard | trown: sshnaidm has been working on this set of changes: https://review.openstack.org/#/c/508660/ | 14:35 |
| dmsimard | trown: that particular patch ( 508800 ) works because you have 3rd party reporting back green | 14:36 |
| trown | dmsimard: ya, those are the ones I have looked at as well... nothing there will affect ci.centos which only does libvirt jobs | 14:36 |
| trown | dmsimard: well on an undercloud only job... the subnodes file would not be used in that job | 14:37 |
| dmsimard | trown: okay, it will certainly be challenging in the next few days/weeks to keep things working in both upstream and review.rdo, zuul v3 is not ready for prime time yet in review.rdo | 14:38 |
| trown | dmsimard: aiui we should be able to get our "legacy" jobs working in zuul v3 without much change... in fact I would have assumed they would not instantly get hosed in the first place | 14:39 |
| *** abregman has quit IRC | 14:39 | |
| *** achadha has joined #tripleo | 14:40 | |
| trown | dmsimard: if we need some shim in rdoproject to account for the different named subnodes file, that is really easy.... it is not yet clear what else we might need atm though | 14:40 |
| dmsimard | trown: I'm pretty sure we already have that file | 14:40 |
| *** achadha has quit IRC | 14:40 | |
| trown | dmsimard: ya that is why I said if... not sure that is even a problem | 14:40 |
| *** achadha has joined #tripleo | 14:41 | |
| dmsimard | trown: http://paste.openstack.org/raw/622476/ | 14:41 |
| *** psahoo has quit IRC | 14:43 | |
| trown | dmsimard: only other potential issues I see in sshnaidm's patch are wrt username (jenkins vs zuul) and cache dir (/opt/stack/cache vs /opt/stack/), but those seem minor to workaround for now in the tripleo jobs in software factory | 14:44 |
| trown | dmsimard: but until we get results back on the tripleo-ci patch we dont really know what else needs fixing | 14:44 |
| trown | dmsimard: in any case getting tripleo-ci back running is first priority, fixing fallout in review.rdoproject.org is secondary | 14:44 |
| dmsimard | ofc | 14:45 |
| *** tesseract has quit IRC | 14:46 | |
| gregwork | does tripleO know how to deploy a policy route for infrastructure services such as the external network? I just deployed my overcloud and it placed the horizon uri on the external network. However the default route of the controller nodes with the vip is the provisioning network interface so the only thing that can access the dashboard are machines on that external network. if this was a regular linux host id | 14:46 |
| gregwork | create a policy route/rule so traffic too and from the provisioning network would traverse that int, and likewise for the external network .. but this is all heat/puppet/rdo stuff so i dont really get to mess with that in any persistent way. the whole situation is kind of odd, when i ping the horizon vip from some external server, the packet gets right to the controller node with the vip, but it doesnt respond .. im | 14:46 |
| gregwork | guessing its getting lost in ovs / neutron? | 14:46 |
| trown | hmm we lost telnet links from the zuul status page too :( | 14:49 |
| trown | http://zuulv3.openstack.org/static/stream.html?uuid=fccb902c647045498dd9f3c23af8a8cf&logfile=console.log is not so useful | 14:49 |
| shardy | gregwork: we only use neutron for IPAM of overcloud nodes, so porbably not ovs/neutron - which network templates are you using? | 14:49 |
| sshnaidm | trown, I saw it working.. once | 14:50 |
| sshnaidm | trown, running log stream I mean | 14:50 |
| dmsimard | trown: there are different load issues right now | 14:50 |
| gregwork | shardy: network-isolation | 14:50 |
| shardy | gregwork: there are parameters to control the routes for each network and the network templates can be adjusted to further modify routing if needed | 14:50 |
| dmsimard | trown: the web console works great when these load issues aren't happening and infra is looking into it | 14:50 |
| trown | dmsimard: ah cool, thanks | 14:50 |
| sshnaidm | dmsimard, do you know maybe what "merger_failu" in status page means? | 14:51 |
| shardy | gregwork: yeah but was it e.g -e $TEMPLATES/environments/net-single-nic-with-vlans.yaml or some other nic configuration? | 14:51 |
| d0ugal | toure: I commented on the bug (twice!) | 14:51 |
| *** vpickard has quit IRC | 14:52 | |
| shardy | gregwork: network-isolation is independent of the nic config, other than that you need to configure the network interfaces to suit the networks that are enabled | 14:52 |
| shardy | gregwork: also have you seen https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/network_isolation.html#configuring-routes-and-default-routes ? | 14:53 |
| dmsimard | sshnaidm: what change # ? | 14:53 |
| sshnaidm | dmsimard, 508660 in http://status.openstack.org/zuul/ | 14:54 |
| *** vpickard has joined #tripleo | 14:55 | |
| dmsimard | sshnaidm: not sure, ask -infra | 14:55 |
| gregwork | shardy: its a variation of templates provided by mellanox, it is effectively a multiple nics with vlans | 14:55 |
| shardy | gregwork: Ok, so can you adjust e.g with defroute: no as mentioned in the docs to get the default route on the network you want? | 14:57 |
| shardy | gregwork: then you can set ExternalInterfaceDefaultRoute to the address you need | 14:57 |
| gregwork | so here is the deal, when i neutron subnet-show external i see the default route i defined with ExternalInterfaceDefaultRoute: | 14:58 |
| gregwork | however on the controller node | 14:58 |
| gregwork | if i do a ip ro ls | 14:58 |
| gregwork | i only see the 1 default route for the provisioning network | 14:58 |
| *** yamahata has quit IRC | 14:58 | |
| shardy | gregwork: yeah I suspect that's the DHCP case described in the docs I just linked? | 14:58 |
| *** yamahata has joined #tripleo | 14:59 | |
| jaosorior | larsks: sooo... apache processes seem to be easy to get to stdout (and eventually journald with the container metadata). But, mysql, rabbitmq and haproxy are quite painful to be honest; the sidecar container approach seems like a good idea for these. | 15:00 |
| gregwork | shardy: so the provisioning network is offering DHCP to the controller on the provision int and that is taking over the default route of the server ? | 15:00 |
| shardy | gregwork: yes, that's the situation described in the docs | 15:00 |
| shardy | so you may need to disable the dhcp offered route to allow the external route to take precedence | 15:00 |
| toure | d0ugal thanks | 15:00 |
| *** vpickard has quit IRC | 15:01 | |
| *** jlinkes has quit IRC | 15:01 | |
| d0ugal | toure: hopefully it helps, I wasn't sure if I understood your question fully | 15:02 |
| gregwork | shardy: so this gets tricky, during the overcloud deploy the controllers need to use the provisioning interface as their default route to perform rhel registration and other network tasks | 15:02 |
| *** mrch has quit IRC | 15:02 | |
| toure | d0ugal so it does a bit as I saw the new changes you mentioned and I was wondering what in addition was needed | 15:02 |
| *** iranzo has quit IRC | 15:02 | |
| gregwork | shardy: so while I could probably update the template/stack no to set defroute no on the provisioning interface, that might cause a clean overcloud deploy to fail would it not ? | 15:03 |
| *** aditya_r has quit IRC | 15:03 | |
| shardy | gregwork: sure, but you can still have _a_ route to the provisionining subnet without it being the default? | 15:03 |
| *** vpickard has joined #tripleo | 15:03 | |
| d0ugal | toure: so the real goal of that bug is to remove some logic from tripleoclient - so it is just a case of figuring out what it does and making sure that is in a workflow that it can use instead | 15:03 |
| shardy | gregwork: you may want to chat with dsneddon about it, but it seems to me this is the exact situation described in the docs | 15:04 |
| *** morazi has quit IRC | 15:04 | |
| toure | d0ugal ack | 15:05 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add notification message to nodes tagging dialog https://review.openstack.org/508903 | 15:05 |
| gregwork | shardy: ok | 15:06 |
| gregwork | dsneddon: hello are you around ? | 15:06 |
| *** ccamacho has quit IRC | 15:06 | |
| gregwork | er mentally thing /msg, hands disobeying heh | 15:07 |
| *** tesseract has joined #tripleo | 15:07 | |
| gregwork | this does seem like a pretty common scenario "deploy overcloud, connect to horizon, have external network" | 15:08 |
| *** gbarros has quit IRC | 15:08 | |
| shardy | gregwork: Yeah I think it is common - if you don't think those docs are sufficient we can discuss how to make them better for sure | 15:10 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 15:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 15:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 15:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 15:10 |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-quickstart-extras master: Workaround is not needed for releases after ocata https://review.openstack.org/485653 | 15:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 15:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 15:10 |
| *** ffiore has quit IRC | 15:13 | |
| *** sid1 has joined #tripleo | 15:16 | |
| *** morazi has joined #tripleo | 15:16 | |
| *** sid2 has quit IRC | 15:18 | |
| *** cylopez has quit IRC | 15:18 | |
| *** sid3 has joined #tripleo | 15:19 | |
| *** dmarlin has joined #tripleo | 15:21 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Make the Nodes dropdown actions truly disabled https://review.openstack.org/508910 | 15:21 |
| *** sid1 has quit IRC | 15:22 | |
| *** rhallisey has quit IRC | 15:23 | |
| *** rhallisey has joined #tripleo | 15:24 | |
| derekh | If I wanted to run something on the overcloud controller in a deployed server CI job after the overcloud deploy but before any pingtest , where would be the best place to hook that in? | 15:25 |
| *** ffiore has joined #tripleo | 15:26 | |
| *** iranzo has joined #tripleo | 15:26 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: if rdo on rhel then selinux permissive https://review.openstack.org/506737 | 15:27 |
| *** jlinkes has joined #tripleo | 15:27 | |
| *** pcaruana has quit IRC | 15:27 | |
| *** leitan has joined #tripleo | 15:30 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-docs master: Document use of undercloud_hostname https://review.openstack.org/508328 | 15:30 |
| *** iranzo has quit IRC | 15:31 | |
| *** achadha has quit IRC | 15:33 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add redux-form-validators dependency https://review.openstack.org/504902 | 15:34 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor Register nodes dialog to use redux-form https://review.openstack.org/504903 | 15:34 |
| *** achadha has joined #tripleo | 15:36 | |
| *** ukalifon has quit IRC | 15:36 | |
| *** cylopez has joined #tripleo | 15:37 | |
| *** rcernin has quit IRC | 15:41 | |
| *** dhill_ has quit IRC | 15:43 | |
| *** dhill__ has joined #tripleo | 15:43 | |
| *** sid3 has quit IRC | 15:48 | |
| EmilienM | derekh: something just for CI or useful for the any consummer? | 15:48 |
| *** jistr is now known as jistr|off|mtg | 15:48 | |
| *** jistr|off|mtg is now known as jistr | 15:49 | |
| derekh | EmilienM: just for CI, I want to get back to this review and add a node for ironic/nova to boot https://review.openstack.org/#/c/485261/ | 15:49 |
| *** sid1 has joined #tripleo | 15:50 | |
| *** yprokule has quit IRC | 15:50 | |
| honza | jtomasek: so. many. patches. do you ever sleep? :) | 15:51 |
| openstackgerrit | Jakub Libosvar proposed openstack/os-net-config master: Remove patch ports from provider bridges to br-int https://review.openstack.org/508918 | 15:51 |
| jtomasek | honza: I've just decided I am done for today hah | 15:51 |
| honza | jtomasek: +100 | 15:51 |
| * honza now has to review all of it | 15:52 | |
| EmilienM | derekh: in that case, it could be something that could leveraged in tripleo-quickstart | 15:52 |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates master: Fixes missing type for heat param TenantNetName https://review.openstack.org/508920 | 15:53 |
| jtomasek | honza: it would be great to get the patches which introduce new dependencies to merge so we unblock the other | 15:53 |
| honza | jtomasek: Yes, I'll hustle in #rdo | 15:53 |
| jtomasek | honza: thanks | 15:53 |
| *** egonzalez has quit IRC | 15:54 | |
| *** ffiore has quit IRC | 15:55 | |
| derekh | EmilienM: ok, is there a specific place in quickstart of that kind of thing? if not I'll just see what I can find poking about | 15:55 |
| EmilienM | derekh: I would maybe ask trown / sshnaidm / weshay on that regard, they know better the oooq architecture | 15:56 |
| derekh | EmilienM: ack, will do, thanks | 15:57 |
| *** lucasagomes is now known as lucas-afk | 15:57 | |
| *** Slower_ has joined #tripleo | 15:57 | |
| derekh | trown: sshnaidm weshay same question "If I wanted to run something on the overcloud controller in a deployed server CI job after the overcloud deploy but before any pingtest , where would be the best place to hook that in?" | 15:57 |
| *** dsariel has quit IRC | 15:59 | |
| *** marios has quit IRC | 15:59 | |
| sshnaidm | derekh, post-deploy? | 15:59 |
| sshnaidm | derekh, https://github.com/openstack/tripleo-quickstart-extras/blob/f791f5b3cdba607649b5f2cffda8ca177f5100ba/roles/overcloud-deploy/tasks/post-deploy.yml#L2-L1 | 16:00 |
| derekh | sshnaidm: yes, I'm hoping to setup a libvirt domain on the controler so that ironic in the overcloud can control it | 16:00 |
| derekh | sshnaidm: ok, I'll take a look there | 16:01 |
| derekh | sshnaidm: thanks | 16:01 |
| *** sid1 has quit IRC | 16:01 | |
| sshnaidm | derekh, oops, it runs on undercloud only.. | 16:01 |
| derekh | sshnaidm: hmm | 16:02 |
| *** Slower_ has quit IRC | 16:02 | |
| sshnaidm | derekh, I don't think we have something prepared to run on controller.. | 16:03 |
| *** trown is now known as trown|lunch | 16:04 | |
| sshnaidm | derekh, seems like it's needed to be added to playbook as separate task: https://github.com/openstack-infra/tripleo-ci/blob/85853ad2e50e25b8244e75d04da15702f84d7cde/toci-quickstart/playbooks/ovb.yml#L200-L202 | 16:05 |
| shardy | derekh: could you just specify a NodeExtraConfigPost template which quickstart could potentially render and add to the deploy arguments? | 16:05 |
| *** mcornea has quit IRC | 16:05 | |
| shardy | https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/extra_config.html#post-deploy-extra-configuration | 16:05 |
| shardy | derekh: e.g ^^ | 16:06 |
| *** chlong has joined #tripleo | 16:06 | |
| sshnaidm | yeah, it's option too.. | 16:07 |
| sshnaidm | this template could be added with "extra-args" argument | 16:07 |
| derekh | sshnaidm: shardy ok I think either of those could work, I'll take a look at both and figure out what fits | 16:08 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: Fix TripleO CI jobs https://review.openstack.org/508660 | 16:09 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 16:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 16:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 16:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 16:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 16:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 16:10 |
| *** dparkes has quit IRC | 16:13 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: Keep floating ip reachability during pacemaker migration. https://review.openstack.org/474967 | 16:15 |
| *** jfrancoa has quit IRC | 16:15 | |
| *** raildo has quit IRC | 16:15 | |
| *** raildo has joined #tripleo | 16:16 | |
| *** raildo has quit IRC | 16:18 | |
| trozet | dsneddon: is there a way to preserve the tmp directory used to render the templates? I'm hitting a failure to validate one of hte j2 rendered network templates and I want to see what the rendered output was. | 16:19 |
| *** raildo has joined #tripleo | 16:19 | |
| shardy | trozet: yes you can render them in t-h-t with either tox -e templates or ./tools/process-templates.py if you have j2 installed on the host | 16:20 |
| *** ecerquei_ has joined #tripleo | 16:21 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: WIP: fix race in cell_v2 discovery with containers https://review.openstack.org/508930 | 16:21 |
| shardy | trozet: there is a --no-cleanup option for tripleoclient, but I don't think that helps as we render them in a mistral action on the undercloud | 16:21 |
| shardy | often the mistral logs will expose more info about the error than the CLI shows | 16:22 |
| d0ugal | We should improve that :) | 16:22 |
| trozet | shardy: ah i forgot about that tool. Thanks | 16:22 |
| shardy | trozet: if they're rendering OK then you can also download the plan | 16:22 |
| shardy | trozet: mkdir tmp && cd tmp && openstack container save overcloud | 16:22 |
| trozet | shardy: when you use network_data.yaml. Do you have to use the env file: ips-from-pool-all.yaml ? | 16:23 |
| shardy | trozet: No you don't have to, you can use the defaults with is to use neutron to assign a port | 16:23 |
| trozet | shardy: ok thanks let me try the tool and see what i get | 16:24 |
| shardy | s/with/which | 16:24 |
| *** ecerquei has quit IRC | 16:24 | |
| *** achadha has quit IRC | 16:25 | |
| openstackgerrit | Alan Pevec proposed openstack/tripleo-quickstart master: WIP: switch to RDO Queens deps repo https://review.openstack.org/508870 | 16:29 |
| jpich | mwhahaha: Hi! Would it be ok if I took a stab at https://blueprints.launchpad.net/tripleo/+spec/os-client-config-switch this cycle, even if it wasn't targeted to Queens yet? Rather than "switch" I think for Queens providing the option to also use clouds.yaml would be useful, and might possibly help toward shedding some tech-debt around duplication of stackrc creation code | 16:30 |
| gregwork | hmmn lost internet | 16:30 |
| trozet | shardy: it looks like even when you use a network name in all lowercase, like 'storage', it makes it 'Storage' | 16:31 |
| trozet | shardy: is that intentional? | 16:31 |
| gregwork | shardy: side question, is it possible to reconfigure the ceph cluster that gets deployed with the overcloud? eg modify the pg_groups | 16:31 |
| gregwork | or do i need to do a full stack delete and clean redeploy | 16:31 |
| mwhahaha | jpich: given the large amount of work for the UI, do you think you can get it in? | 16:32 |
| gregwork | i tried modifying the ceph params in the template and doing an update but i believe this is a destructive operation and was probably ignored | 16:32 |
| *** panda is now known as panda|bbl | 16:32 | |
| *** jtomasek has quit IRC | 16:32 | |
| mwhahaha | jpich: also when would you target it's completion? Queens-1 or 2 | 16:33 |
| sshnaidm | dmsimard, do you know where to look now for jobs of specific project? like it was zuul/layout.yml before | 16:33 |
| *** aufi has quit IRC | 16:34 | |
| shardy | gregwork: it's possible to reconfigure any service deployed by either puppet, containers or ceph-ansible, but gfidente is probably the best contact for the specific query re pg_groups | 16:36 |
| shardy | trozet: Hmm, that storage/Storage thing sounds wrong, let me check | 16:36 |
| trozet | shardy: i get stuff like this /controller-role.yaml>.resources.NetworkConfig.properties: : Unknown Property storageIpSubnet" because i think it created it as StorageIpSubnet | 16:37 |
| shardy | trozet: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/role.role.j2.yaml#L378 | 16:38 |
| jpich | mwhahaha: I think I can give it a fair shot, though I still need to get familiar with how it all works in the backend. Queens-1 seems too optimistic, though I'd like to get it in a good shape before the end of the month if it is to happen | 16:39 |
| trozet | shardy: yeah i was looking at that | 16:39 |
| shardy | trozet: we don't yet render the nic templates, so if you want to change the name you'll need to adjust the nic templates to match | 16:39 |
| trozet | shardy: oh you think is the nics | 16:39 |
| shardy | trozet: e.g whatever OS::TripleO::{{role.name}}::Net::SoftwareConfig points to | 16:40 |
| shardy | trozet: yeah I think the sample OS::TripleO::{{role.name}}::Net::SoftwareConfig has StorageFoo but we're rendering storageFoo | 16:40 |
| trozet | shardy: that could be let me check | 16:40 |
| shardy | trozet: easiest fix is just use the same case as in the default network_data, but the plan is to render the nic templates, hopefully this cycle it will be done | 16:41 |
| *** jpena is now known as jpena|away | 16:41 | |
| mwhahaha | jpich: so we could tentatively target to queens-2 but if it is not going to land by that I would like to kick it out to rocky | 16:41 |
| mwhahaha | jpich: it's a nice to have but I think you'll find a lot more work in CI and other places | 16:42 |
| trozet | shardy: yeah we dynamically make the nic templates, but we dont use that network_data file thats why there is a mismatch | 16:43 |
| trozet | shardy: ok let me change the names to match and see if that works | 16:43 |
| shardy | trozet: ah, I guess we can perhaps work together on the dynamic nic rendering by default? | 16:44 |
| shardy | trozet: it'd be good if you have some working examples already | 16:44 |
| jpich | mwhahaha: That sounds very fair. I'm hoping supporting both stackrcs and clouds.yaml in parallel for the cycle, rather than switch over completely would help to mitigate the amount of work - for this cycle anyway | 16:44 |
| shardy | I had been planning to refactor the examples into j2 templates as a first step, but not got to it yet | 16:44 |
| jpich | mwhahaha: Thanks! | 16:45 |
| trozet | shardy: it would need to be a little more dynamic for networks, because we assume some network names :) But it does it per role, and renders for vlan or dpdk, or net isol, etc: https://github.com/opnfv/apex/blob/master/build/nics-template.yaml.jinja2 | 16:46 |
| sshnaidm | mwhahaha, dmsimard please vote: https://review.openstack.org/508936 | 16:47 |
| sshnaidm | weshay, trown|lunch ^^ | 16:47 |
| gfidente | gregwork you can change the pg_num after the deployment is finished | 16:49 |
| *** nyechiel_ has quit IRC | 16:52 | |
| trozet | shardy: for the variable cloud_name_<network> | 16:53 |
| trozet | shardy: Property error: : resources.allNodesConfig.properties: : Unknown Property cloud_name_api" | 16:56 |
| trozet | shardy: I have a network named Api | 16:56 |
| trozet | shardy: overcloud.j2.yaml: cloud_name_{{network.name_lower}}: {get_param: CloudName{{network.name}}} | 16:57 |
| shardy | trozet: Hmm, that looks like a bug https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/all-nodes-config.yaml | 16:57 |
| shardy | seems we missed refactoring that to j2 | 16:57 |
| trozet | shardy: ok I'll file a bug for it? | 16:58 |
| *** artom has joined #tripleo | 16:58 | |
| shardy | trozet: yes, please - do you have time to take a pass on the fix or do you want me to do it? | 16:58 |
| *** chlong has quit IRC | 16:58 | |
| trozet | shardy: i dont have time right now | 16:58 |
| trozet | shardy: im just going to change our Api network to be called InternalApi | 16:58 |
| shardy | trozet: Ok let me know the bug and I'll give it a first pass now | 16:59 |
| trozet | shardy: OK i'll assign to you | 16:59 |
| *** raildo has quit IRC | 16:59 | |
| *** idlemind has quit IRC | 16:59 | |
| *** derekh has quit IRC | 16:59 | |
| *** jpich has quit IRC | 16:59 | |
| *** milan has quit IRC | 17:00 | |
| *** gkadam has quit IRC | 17:01 | |
| *** raildo has joined #tripleo | 17:01 | |
| *** mdnadeem has quit IRC | 17:02 | |
| trozet | shardy: https://bugs.launchpad.net/tripleo/+bug/1720849 | 17:02 |
| openstack | Launchpad bug 1720849 in tripleo "dynamic network names error with Property error: : resources.allNodesConfig.properties: : Unknown Property cloud_name_<network_name.lower>" [Undecided,New] - Assigned to Steven Hardy (shardy) | 17:02 |
| *** yamahata has quit IRC | 17:05 | |
| gregwork | gfidente: i tried doing that via stack update and it didnt modify anything | 17:06 |
| trozet | shardy: heh seems like just fixing internal api doesnt work, because all nodes config is complaining that i didnt define storage_mgmt :) | 17:07 |
| trozet | shardy: Property error: : resources.allNodesConfig.properties: : Property cloud_name_storage_mgmt not assigned", | 17:07 |
| gregwork | gfidente: i am trying to fix a HEALTH_WARN too many PGs per OSD (456 > max 300) | 17:07 |
| fultonj | gregwork: that parameter controls only the default PG number of new PGs that are created | 17:08 |
| gfidente | gregwork sorry yes | 17:09 |
| fultonj | gregwork: to change the pg number of existing pools, use the ceph cli tools | 17:09 |
| gfidente | I meant to say you can change it after with regular ceph commands | 17:09 |
| gregwork | i see | 17:09 |
| gfidente | stack update does not enforce new values on pre-existing pools | 17:09 |
| *** yamahata has joined #tripleo | 17:09 | |
| gregwork | this is a destructive operation ? | 17:09 |
| gfidente | only on creation | 17:09 |
| gfidente | no it's not destructinve | 17:09 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 17:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 17:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 17:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 17:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 17:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 17:10 |
| gregwork | i see | 17:10 |
| *** ecerquei__ has joined #tripleo | 17:11 | |
| fultonj | gregwork: an example is at... | 17:12 |
| fultonj | https://ekuric.wordpress.com/2016/02/09/increase-number-of-pgpgp-for-ceph-cluster-ceph-error-too-few-pgs-per-osd/ | 17:12 |
| fultonj | just give the cluster time to make the change | 17:12 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Fix some missed hard-coded network references https://review.openstack.org/508947 | 17:12 |
| fultonj | it will still run and can be accessed by it will use cycles of your storage node to reballance | 17:12 |
| shardy | trozet: ^^ first pass at a fix (untested) | 17:12 |
| gregwork | fultonj: trying to get a good fit for the hyperconverged setup we are testing out. 3x osdcomputes with 8 6TB Drives and a 2 TB nvme | 17:13 |
| *** trown|lunch is now known as trown | 17:13 | |
| *** ykarel has joined #tripleo | 17:13 | |
| shardy | trozet: I'll be dropping for the day fairly soon so feel free to push to the review if you try it and I missed anything | 17:13 |
| gregwork | mixed workload | 17:13 |
| shardy | it renders cleanly but I've not deployed with it yet | 17:13 |
| gfidente | gregwork sorry which version of tripleo are you using? | 17:13 |
| *** ecerquei_ has quit IRC | 17:14 | |
| gregwork | 6.2.0 (ocata) | 17:14 |
| trozet | shardy: the networks are also hardcoded in other places: I was just fixing this one: https://review.openstack.org/#/c/508920/1/network/ports/net_ip_list_map.j2.yaml | 17:14 |
| trozet | shardy: shoudl all those net names just be removed? | 17:14 |
| *** chlong has joined #tripleo | 17:15 | |
| gregwork | we just got the mellanox dpdk stuff to work, and we wanted to go back and make sure everything else was lining up | 17:15 |
| *** achadha has joined #tripleo | 17:15 | |
| gregwork | if we have time we might try their ceph rdma library, but for now just straight 100gbe over tcpip will suffice | 17:15 |
| shardy | trozet: yeah they should be removed and only rendered in the loop | 17:15 |
| trozet | shardy: ok then I will change my patch as well to remove them from there | 17:16 |
| shardy | trozet: ack thanks for spotting it - I'll look at getting some CI coverage of custom networks soon (when CI working again) | 17:17 |
| gregwork | i have to say mellanox has been pretty good about supporting tripleO (rhosp), within a month they wrote an installer that merges their ofed drivers and software stack into the rhosp image so its fairly automatic now | 17:17 |
| *** yamahata has quit IRC | 17:18 | |
| *** achadha has quit IRC | 17:19 | |
| trozet | shardy: np | 17:19 |
| *** achadha has joined #tripleo | 17:20 | |
| dsneddon | gregwork, We don't yet support policy-based routing in TripleO. If you really need the default route to be on provisioning, but you want APIs on the External network to be reachable externally, you could modify the rp_filter (reverse path filter) to allow that. It will reduce your security slightly. | 17:21 |
| gregwork | dsneddon: i see | 17:21 |
| gregwork | dsneddon: is there a roadmap item for policy-based routing in the future ? | 17:21 |
| gregwork | pbr in rhel has been around for awhile and can be a fairly elegant solution | 17:22 |
| dsneddon | gregwork, There is an RFE on it, but I'm not currently expecting that in Queens | 17:22 |
| gregwork | ah | 17:22 |
| dsneddon | gregwork, sysctl settings are set in tripleo-heat-templates/puppet/services/kernel.yaml | 17:23 |
| gregwork | dsneddon: ill take a look, thanks | 17:23 |
| *** idlemind has joined #tripleo | 17:23 | |
| dsneddon | gregwork, So you can set "net.ipv4.conf.all.rp_filter" and "net.ipv4.conf.default.rp_filter" to 2. | 17:24 |
| gregwork | understood | 17:24 |
| gregwork | does anyone know why hardware iscsi is not a valid bare metal provisioning option for the overcloud nodes? or why booting from san is not supported? | 17:25 |
| trown | sshnaidm: not too familiar with how logs look now in zuulv3 ... this is some other infra issue before it ever gets to our job ya? http://logs.openstack.org/60/508660/10/check/legacy-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/481f366/job-output.txt.gz#_2017-10-02_17_09_06_965174 | 17:26 |
| *** suuuper has joined #tripleo | 17:27 | |
| gregwork | the poc gear we got was loaded with 4k sector drives and while i can specify uefi boot option all the overcloud images are 512-byte sectors and wont write properly. We had tried to configure the hardware to boot from iscsi via the iscsi hba's in the servers but the bootstrap process fell apart | 17:27 |
| sshnaidm | trown, yeah.. right now all infra work on zuul trying to make it work, so I don't think we'll see any reliable results today | 17:27 |
| gregwork | we ended up provisioning boot luns over san to the servers but the tigerteam guy we had on site said san boot wasnt supported | 17:28 |
| gregwork | (But acknowledged it did work) | 17:28 |
| trown | sshnaidm: k, I wont bother rechecking today then... weshay ^ | 17:28 |
| trown | weshay: tldr things are still too borked on infra side for our jobs to even get to run and give us feedback on what might be wrong | 17:29 |
| weshay | trown, ugh k | 17:29 |
| *** chlong has quit IRC | 17:30 | |
| *** chlong has joined #tripleo | 17:30 | |
| dsneddon | gregwork, There is a blueprint for booting from SAN in TripleO: https://blueprints.launchpad.net/tripleo/+spec/undercloud-boot-from-volume | 17:31 |
| *** tosky has quit IRC | 17:31 | |
| *** cylopez has quit IRC | 17:31 | |
| *** sshnaidm is now known as sshnaidm|afk | 17:33 | |
| *** fzdarsky is now known as fzdarsky|afk | 17:33 | |
| *** atoth has quit IRC | 17:35 | |
| *** dtantsur is now known as dtantsur|afk | 17:44 | |
| *** shardy has quit IRC | 17:52 | |
| *** yamahata has joined #tripleo | 17:52 | |
| hrybacki | trown: aye, ocata->master-tripleo-ci all broken. Anyone you'd recommend I ping to help me take a look at this bug? | 17:53 |
| *** tesseract has quit IRC | 17:55 | |
| *** tosky has joined #tripleo | 17:59 | |
| *** jlinkes has quit IRC | 17:59 | |
| gfidente | EmilienM mwhahaha do you guys know if there are changes we need to bring into tripleo-ci to make it work with zuul | 17:59 |
| gfidente | or if we're just waiting on zuul / infra fixes | 18:00 |
| gfidente | ? | 18:00 |
| weshay | gfidente, check the prod-chain escalation board for current work | 18:00 |
| EmilienM | gfidente: I've been following all the magics here | 18:00 |
| gfidente | have a link? | 18:00 |
| *** ebarrera has quit IRC | 18:03 | |
| mwhahaha | gfidente: are you talking about tripleo CI on Puppet patches or just in general | 18:03 |
| *** jpena|away is now known as jpena|off | 18:04 | |
| gfidente | mwhahaha changes needed for the tripleo jobs | 18:04 |
| gfidente | not to pass puppet submissions only | 18:04 |
| gfidente | but all tripleo submissions | 18:04 |
| *** bnemec has quit IRC | 18:04 | |
| mwhahaha | gfidente: see topic and alerts | 18:04 |
| gfidente | ok so it's tracked in bugs, that was my question really | 18:05 |
| mwhahaha | gfidente: yea it's been an ongoing thing since friday | 18:09 |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 18:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 18:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 18:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 18:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 18:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 18:10 |
| *** suuuper has quit IRC | 18:12 | |
| *** abregman has joined #tripleo | 18:17 | |
| *** abregman is now known as abregman|afk | 18:19 | |
| *** iranzo has joined #tripleo | 18:20 | |
| *** jbadiapa_ has joined #tripleo | 18:23 | |
| *** rhallisey has quit IRC | 18:23 | |
| EmilienM | mwhahaha, gfidente : it sounds like the patches that will bring back our CI are https://review.openstack.org/#/q/topic:fixci+(status:open+OR+status:merged) | 18:24 |
| mwhahaha | i like how we have the sub_nodes usage in 3 different projects | 18:25 |
| mwhahaha | mmm code sprawl | 18:25 |
| *** ykarel has quit IRC | 18:25 | |
| *** jbadiapa has quit IRC | 18:25 | |
| *** iranzo has quit IRC | 18:28 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Remove Heat Cloudwatch API https://review.openstack.org/508964 | 18:28 |
| *** itlinux has joined #tripleo | 18:28 | |
| *** tongl has joined #tripleo | 18:34 | |
| *** akrivoka has quit IRC | 18:35 | |
| *** etingof has quit IRC | 18:37 | |
| *** gfidente has quit IRC | 18:39 | |
| *** salmankhan has quit IRC | 18:43 | |
| *** morazi has quit IRC | 18:43 | |
| *** morazi has joined #tripleo | 18:44 | |
| trown | hrybacki: that is really odd ... dtantsur|afk is euro hours, but maybe he could get you pointed in the right direction... I have no clue what could make all releases suddenly broken, but working on my box and in CI | 18:44 |
| *** chlong has quit IRC | 18:45 | |
| *** chlong has joined #tripleo | 18:46 | |
| *** gfidente has joined #tripleo | 18:51 | |
| *** gfidente has quit IRC | 18:51 | |
| *** gfidente has joined #tripleo | 18:51 | |
| *** rcernin has joined #tripleo | 18:54 | |
| *** pkovar has quit IRC | 18:56 | |
| *** idlemind has quit IRC | 19:04 | |
| *** idlemind has joined #tripleo | 19:05 | |
| *** rbrady has quit IRC | 19:09 | |
| *** chlong_ has joined #tripleo | 19:09 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 19:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 19:10 |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 19:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 19:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 19:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 19:10 |
| *** cdearborn_ has quit IRC | 19:11 | |
| *** cdearborn has joined #tripleo | 19:11 | |
| *** jlinkes has joined #tripleo | 19:12 | |
| *** etingof has joined #tripleo | 19:13 | |
| *** etingof has quit IRC | 19:16 | |
| *** etingof has joined #tripleo | 19:16 | |
| *** jlinkes has quit IRC | 19:19 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: WIP: Set file mode permission for Ceph keyrings in containers https://review.openstack.org/508975 | 19:22 |
| openstackgerrit | Andy Smith proposed openstack/tripleo-heat-templates master: WIP Separate rpc and notify messaging backends https://review.openstack.org/507963 | 19:26 |
| weshay | snakes on a plane!!! | 19:26 |
| *** itlinux has quit IRC | 19:26 | |
| trozet | dsneddon: hey question about the network rendering | 19:34 |
| dsneddon | trozet, Yeah? | 19:34 |
| trozet | dsneddon: im seeing 3 subnets in os-net-config all have the same ip | 19:34 |
| trozet | dsneddon: which makes me think they are all getting the same port info, aka resource registry is not assgined right | 19:34 |
| trozet | dsneddon: i see https://github.com/openstack/tripleo-heat-templates/blob/master/environments/network-isolation.j2.yaml | 19:34 |
| trozet | dsneddon: however I'm not sure how to include that in my deployment. Is it pulled automatically when you list multiple networks in your network_data.yml? | 19:35 |
| gfidente | weshay what? | 19:37 |
| weshay | you heard me :) | 19:38 |
| *** toure is now known as toure_biab | 19:39 | |
| dsneddon | trozet, That usually happens when the ports for the role aren't instantiated. Did you forget to include network-isolation.yaml (or to create those ports elsewhere)? | 19:39 |
| fultonj | i think what he is trying to say is... https://youtu.be/amYzBQMT4VI | 19:39 |
| dsneddon | trozet, Network isolation still isn't enabled by default, but we do render network-isolation.yaml on the fly when you deploy. | 19:40 |
| dsneddon | trozet, So you still include it on the command-line when deploying. | 19:40 |
| trozet | dsneddon: well since you now define a network as enabled or not in the network_data, and THT renderes the port file, i figured it would also set the heat resource | 19:40 |
| dsneddon | trozet, We still haven't deprecated the default, non-isolated, DHCP-only deployment method that was developed in the HP days. | 19:40 |
| dsneddon | trozet, Now that you mention it, Queens is probably a good time to do that, so we can remove it in R | 19:41 |
| trozet | dsneddon: non-isolated deployment would just mean every network in the network_data is not enabled right? | 19:41 |
| dsneddon | trozet, It also means that all overcloud interfaces use DHCP only. | 19:41 |
| dsneddon | trozet, Which is a pretty useless thing for production, but some people still try to deploy on their corporate LAN, which can work in that case. | 19:42 |
| trozet | dsneddon: but what does DHCP have to do with assigning the port automatically? isnt the port rendered in j2 or are you saying they use a static template? | 19:43 |
| dsneddon | trozet, They use THT/net-config-bridge.yaml for the controller, and THT/net-config-noop.yaml for the other roles. | 19:46 |
| dsneddon | trozet, By default. it's in the overcloud-resource-registry.j2.yaml | 19:46 |
| *** catinthe_ has quit IRC | 19:47 | |
| *** catintheroof has joined #tripleo | 19:48 | |
| dsneddon | trozet, As you can see, those files don't do much, just configure a bridge on the controller (you can control which NIC this goes on), for Neutron to use. otherwise, dhcp-all-interfaces.sh runs and configures DHCP on all interfaces. | 19:48 |
| trozet | dsneddon: this is a nic template | 19:48 |
| trozet | dsneddon: im talking about the port | 19:48 |
| dsneddon | trozet, But let's say you include a reference to different NIC templates, but don't instantiate the Neutron ports for those networks. The end result is that all networks fall back to the control plane IP, and you get what you ended up with. | 19:49 |
| trozet | dsneddon: yeah | 19:49 |
| dsneddon | trozet, But if you include network-isolation.yaml, the Neutron ports get created so those interfaces get IPs. | 19:49 |
| trozet | dsneddon: but my point is I shouldnt need to do this OS::TripleO::Network::Ports::ExternalVipPort: ../network/ports/external.yaml | 19:49 |
| trozet | dsneddon: in network_data i have already indicated there is an External network and that it has a VIP, and that network is enabled | 19:50 |
| dsneddon | trozet, And my point is that you do, because that port is defaulted to noop.yaml in the overcloud-resource-registry.yaml. | 19:50 |
| dsneddon | trozet, All the network_data.yaml does is help generate the templates with jinja. That has nothing to do with whether they get included in the Heat stack. | 19:50 |
| dsneddon | For that, you have to include them on the command line. | 19:50 |
| trozet | dsneddon: ok...im saying it should | 19:51 |
| dsneddon | trozet, We do have a feature request for automatic inclusion, but that requires an "include" statement in Heat. | 19:51 |
| dsneddon | trozet, Maybe we could modify overcloud-resource-registry.j2.yaml to take the network_data.yaml and the network info in the roles into account when we render it. | 19:51 |
| trozet | dsneddon: why cant you just render the ports/networks resource registry with the process templates? | 19:52 |
| dsneddon | trozet, I see we are on the same page. | 19:52 |
| trozet | dsneddon: yeah | 19:52 |
| *** aputtur has quit IRC | 19:52 | |
| trozet | dsneddon: I'll write a launchpad for it | 19:52 |
| *** dparkes has joined #tripleo | 19:52 | |
| dsneddon | trozet, The reason for that is that we already have the default networks defined in network_data.yaml. If we made it active by default, then the DHCP deployment method wouldn't work. We need to deprecate that for one cycle before we remove it. | 19:53 |
| trozet | dsneddon: im not saying make it active by default | 19:53 |
| dsneddon | trozet, We might be able to float the idea of changing the default, and adding a command-line parameter to enable the DHCP method, but I'm not sure if that works with deprecation policies. | 19:53 |
| trozet | dsneddon: but when a user includes network_data.yaml (like me) then render the resource registry for me automatically | 19:54 |
| dsneddon | trozet, Maybe I'm blocking something out. Are you supposed to include network_data.yaml on the deployment command-line? I thought that file was only used by Jinja. | 19:55 |
| trozet | dsneddon: yeah i include it in command line | 19:55 |
| dsneddon | trozet, Did you get that from the docs somewhere? | 19:55 |
| dsneddon | trozet, That file isn't in Heat format. Heat probably ignores it. | 19:55 |
| dsneddon | trozet, It's a jinja YAML. | 19:56 |
| trozet | dsneddon: it is in the CLI | 19:56 |
| trozet | dsneddon: its not jinja its just yaml | 19:56 |
| trozet | dsneddon: --networks-file NETWORKS_FILE, -n NETWORKS_FILE | 19:56 |
| dsneddon | trozet, You're right. That gets passed to the tripleo-common script that calls jinja. But it isn't passed to Heat (currently), so we need a different approach. | 19:57 |
| dsneddon | trozet, But like we just discussed, we could have jinja set the correct defaults in the resource registry, and I think it should. | 19:57 |
| trozet | dsneddon: what do you mean it isnt passed to heat? | 19:57 |
| trozet | dsneddon: it directly controls all the rendering for the networks and ports | 19:57 |
| *** dhill__ has quit IRC | 19:57 | |
| dsneddon | trozet, The network-data.yaml file is passed to jinja, which generates Heat templates. Then Heat is called to build the stack, and the --includes files are passed to Heat. | 19:58 |
| *** dhill_ has joined #tripleo | 19:58 | |
| dsneddon | trozet, But Heat never sees the network_data.yaml file. | 19:58 |
| trozet | dsneddon: oh, right the current problem | 19:58 |
| dsneddon | trozet, But, we could either A) have jinja write out the defaults in the resource registry or B) teach the tripleo-client to pass network-isolation.yaml by default when network_data.yaml is included. | 19:59 |
| dsneddon | trozet, The second option is unworkable for two reasons. The first is that we want to stop passing templates in secret via tripleo-client, as that's gotten us in trouble before. | 19:59 |
| trozet | dsneddon: well you are still passing the information just in network_data.yaml, which is much better imo | 20:00 |
| dsneddon | trozet, The second is that users may want to override that file with a custom version (say to remove the Storage Management network or enable the Management network). | 20:00 |
| dsneddon | trozet, Yeah, we totally agree this should be fixed, and there are a few ways to fix it. Please file the RFE, and I'll think about how to do this in a review. | 20:00 |
| trozet | dsneddon: ok cool. thanks | 20:00 |
| dsneddon | trozet, It would certainly cut down on the frequency that people ask about this same issue on #tripleo and #rdo. | 20:01 |
| *** trown is now known as trown|brb | 20:01 | |
| trozet | dsneddon: its almost apex :) | 20:01 |
| *** liverpooler has quit IRC | 20:02 | |
| *** jprovazn has quit IRC | 20:05 | |
| trozet | dsneddon: so how does this all work today? What I mean is i dont see the ports and networks anymore in THT, so how do people today map the resource registry to things that dont exist yet? | 20:07 |
| trozet | dsneddon: do they manually run the renderer before they deploy? | 20:07 |
| *** artom has quit IRC | 20:08 | |
| *** morazi has quit IRC | 20:08 | |
| dsneddon | trozet, Try running ./tools/process_templates.py from the THT root directory. You'll see the familiar files (environments/network-isolation*.yaml, network/ports/*.yaml). | 20:10 |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 20:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 20:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 20:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 20:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 20:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 20:10 |
| dsneddon | trozet, Those all get generated by jinja on the fly when you deploy | 20:10 |
| trozet | dsneddon: right, but does a user run process_templates.py before htey deploy now? | 20:10 |
| *** jlinkes has joined #tripleo | 20:10 | |
| trozet | dsneddon: because those get generated to a tmp dir when you deploy | 20:11 |
| *** agurenko has quit IRC | 20:11 | |
| dsneddon | trozet, Nope. The functionality in that scipt is duplicated in a script in tripleo-common. https://git.openstack.org/cgit/openstack/tripleo-common/tree/tripleo_common/actions/templates.py?id=e77368b2351154cf92b23532f221bf6b9ea30f19 | 20:12 |
| dsneddon | trozet, That script will generate the templates and put them in Swift for TripleO to use. | 20:12 |
| dsneddon | trozet, The functionality is the same as process_templates.py, but that dumps out the files in the THT directories. | 20:13 |
| *** itlinux has joined #tripleo | 20:13 | |
| trozet | dsneddon: but if i deploy, they are not in the THT directory | 20:13 |
| dsneddon | trozet, Right, they get put in Swift. | 20:14 |
| dsneddon | trozet, The process_templates.py script just lets you see what TripleO would be using in Swift. | 20:14 |
| trozet | dsneddon: so then when you do resource registry, you map them like they are in your THT dir? | 20:14 |
| dsneddon | trozet, Yes. Confusing, huh? | 20:14 |
| trozet | dsneddon: >.< | 20:14 |
| trozet | dsneddon: so then I can do this OS::TripleO::Network::Ports::ExternalVipPort: ../network/ports/external.yaml | 20:15 |
| dsneddon | trozet, Sorry, I sent you the wrong URL. Here's the version of that script with the network stuff: https://git.openstack.org/cgit/openstack/tripleo-common/tree/tripleo_common/actions/templates.py | 20:15 |
| trozet | dsneddon: and it will work? | 20:15 |
| dsneddon | trozet, If that file is in THT/environments, then yes. | 20:15 |
| trozet | dsneddon: well i mean, it isnt in my filesystem, but i guess it is in swift | 20:16 |
| dsneddon | trozet, Right. TripleO actually loads the files from disk into Swift before deployment, and this script adds the jinja templates to Swift directly, without ever touching disk. | 20:16 |
| trozet | dsneddon: ok let me give it a try. thanks | 20:17 |
| dsneddon | trozet, If you just put those lines into your network-environment.yaml it will work, too. | 20:17 |
| trozet | dsneddon: yeah, thats what i was wondering, we dynamically build network-env | 20:17 |
| *** jlinkes has quit IRC | 20:18 | |
| *** dprince has quit IRC | 20:18 | |
| *** lblanchard has quit IRC | 20:23 | |
| *** athomas has quit IRC | 20:23 | |
| *** ccamacho has joined #tripleo | 20:27 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud master: Drop legacy ceilometer collector https://review.openstack.org/507917 | 20:32 |
| *** iranzo has joined #tripleo | 20:34 | |
| *** iranzo has quit IRC | 20:34 | |
| *** iranzo has joined #tripleo | 20:34 | |
| *** tzumainn has quit IRC | 20:36 | |
| *** Goneri has quit IRC | 20:36 | |
| *** bnemec has joined #tripleo | 20:37 | |
| *** trown|brb is now known as trown | 20:37 | |
| *** iranzo has quit IRC | 20:41 | |
| *** gbarros has joined #tripleo | 20:42 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: WIP: Set file mode permission for Ceph keyrings in containers https://review.openstack.org/508975 | 20:43 |
| *** ecerquei__ has quit IRC | 20:44 | |
| *** achadha_ has joined #tripleo | 20:48 | |
| *** jkilpatr has quit IRC | 20:48 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Allow to configure snmpd_config https://review.openstack.org/509000 | 20:49 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Ensure ssh key is active before returning from create_admin_via_nova https://review.openstack.org/509001 | 20:50 |
| *** morazi has joined #tripleo | 20:51 | |
| *** achadha has quit IRC | 20:51 | |
| *** gfidente has quit IRC | 20:52 | |
| *** achadha_ has quit IRC | 20:53 | |
| *** pchavva has quit IRC | 20:53 | |
| *** trown is now known as trown|outtypewww | 20:59 | |
| *** bfournie has quit IRC | 21:00 | |
| *** achadha has joined #tripleo | 21:04 | |
| *** dciabrin has quit IRC | 21:07 | |
| *** raildo has quit IRC | 21:08 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 21:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 21:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 21:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 21:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 21:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 21:10 |
| *** dhill_ has quit IRC | 21:11 | |
| *** dhill_ has joined #tripleo | 21:11 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Action to always populate container image parameters https://review.openstack.org/503296 | 21:12 |
| *** jkilpatr has joined #tripleo | 21:13 | |
| *** ccamacho has quit IRC | 21:14 | |
| *** catintheroof has quit IRC | 21:14 | |
| *** cdearborn has quit IRC | 21:16 | |
| *** chlong_ has quit IRC | 21:20 | |
| *** chlong has quit IRC | 21:20 | |
| *** gbarros has quit IRC | 21:24 | |
| *** rhallisey has joined #tripleo | 21:33 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Allow to configure snmpd_config https://review.openstack.org/509000 | 21:35 |
| *** itlinux has quit IRC | 21:36 | |
| *** jcoufal has quit IRC | 21:37 | |
| *** itlinux has joined #tripleo | 21:37 | |
| *** rhallisey has quit IRC | 21:42 | |
| *** gbarros has joined #tripleo | 21:47 | |
| *** itlinux has quit IRC | 21:56 | |
| *** leitan has quit IRC | 21:56 | |
| *** jmelvin has quit IRC | 22:01 | |
| *** rcernin has quit IRC | 22:02 | |
| *** cylopez has joined #tripleo | 22:06 | |
| *** bobh_ has quit IRC | 22:07 | |
| *** pradk has quit IRC | 22:07 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 22:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 22:10 |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 22:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 22:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 22:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 22:10 |
| *** cylopez has quit IRC | 22:11 | |
| *** brian83 has quit IRC | 22:17 | |
| *** gbarros has quit IRC | 22:21 | |
| *** pmannidi has joined #tripleo | 22:23 | |
| *** gbarros has joined #tripleo | 22:32 | |
| *** rlandy is now known as rlandy|brb | 22:37 | |
| *** atoth has joined #tripleo | 22:39 | |
| *** leitan has joined #tripleo | 22:41 | |
| *** achadha has quit IRC | 22:43 | |
| *** achadha has joined #tripleo | 22:44 | |
| *** achadha has quit IRC | 22:46 | |
| *** achadha has joined #tripleo | 22:46 | |
| *** achadha has quit IRC | 22:48 | |
| *** achadha has joined #tripleo | 22:49 | |
| *** achadha has quit IRC | 22:51 | |
| *** achadha has joined #tripleo | 22:53 | |
| *** achadha has quit IRC | 22:57 | |
| *** noslzzp has quit IRC | 23:00 | |
| *** dmarlin has quit IRC | 23:01 | |
| *** rlandy|brb is now known as rlandy | 23:02 | |
| *** mrunge_ has joined #tripleo | 23:05 | |
| *** mrunge has quit IRC | 23:07 | |
| *** tosky has quit IRC | 23:09 | |
| *** leitan has quit IRC | 23:10 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1718387 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1719123 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720220 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720458 | 23:10 |
| openstack | Launchpad bug 1718387 in tripleo "ping test is periodically failing for the gate-tripleo-ci-centos-7-nonha-multinode-oooq " [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot) | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720556 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1720721 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1719123 in tripleo "tempest fails on overcloud keystone admin tenant error" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 23:10 |
| openstack | Launchpad bug 1720220 in tripleo "CI: Most/all legacy-tripleo jobs failing on gate" [Critical,Triaged] | 23:10 |
| openstack | Launchpad bug 1720458 in tripleo "Lastest delorean pip package causes error in autodoc" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 23:10 |
| openstack | Launchpad bug 1720556 in tripleo "tracker: upstream zuul is not triggering periodic jobs" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 23:10 |
| openstack | Launchpad bug 1720721 in tripleo "CI: OVB jobs fail because can't install XStatic from PyPI mirror on rh1 cloud" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 23:10 |
| *** bfournie has joined #tripleo | 23:22 | |
| *** bfournie has quit IRC | 23:23 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: WIP: Set file ACLs for Ceph keyrings for non-containerized deployment https://review.openstack.org/509020 | 23:24 |
| *** lblanchard has joined #tripleo | 23:35 | |
| *** social_ has quit IRC | 23:38 | |
| *** lblanchard has quit IRC | 23:51 | |
| *** achadha has joined #tripleo | 23:53 | |
| *** lblanchard has joined #tripleo | 23:54 | |
| *** bfournie has joined #tripleo | 23:56 | |
| *** achadha has quit IRC | 23:58 | |
| *** lblanchard has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!