| openstackgerrit | Merged openstack/tripleo-common master: Consume blacklisted_ip_addresses in workflows https://review.openstack.org/533599 | 00:02 |
|---|---|---|
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Containerize multinode-3nodes https://review.openstack.org/532623 | 00:02 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Containerize featureset032 (multinode-3nodes) https://review.openstack.org/532624 | 00:02 |
| *** moshele has quit IRC | 00:02 | |
| *** stendulker has joined #tripleo | 00:04 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Containerize multinode-3nodes https://review.openstack.org/534977 | 00:09 |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 00:10 |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] | 00:10 |
| *** akrivoka has quit IRC | 00:12 | |
| openstackgerrit | David Peacock proposed openstack/tripleo-quickstart-extras master: Fix failure of UI validation in some shells https://review.openstack.org/529407 | 00:14 |
| *** stendulker has quit IRC | 00:15 | |
| *** jcoufal_ has joined #tripleo | 00:18 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] GPT partitioning support https://review.openstack.org/533490 | 00:19 |
| *** jcoufal has quit IRC | 00:22 | |
| *** tosky has quit IRC | 00:23 | |
| *** jcoufal_ has quit IRC | 00:28 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Resolve CI issues https://review.openstack.org/534954 | 00:36 |
| *** tzumainn has quit IRC | 00:40 | |
| *** threestrands_ has quit IRC | 00:48 | |
| *** threestrands has joined #tripleo | 00:48 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: WIP Define workflow interface for image prepare/upload https://review.openstack.org/534980 | 00:50 |
| *** toure is now known as toure|gone | 00:52 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Update dependencies https://review.openstack.org/534759 | 00:53 |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Update dependencies https://review.openstack.org/534759 | 00:55 |
| *** mdnadeem has joined #tripleo | 00:57 | |
| honza | npm-shrinkwrap diffs? utterly meaningless | 00:58 |
| *** daidv has quit IRC | 01:04 | |
| *** daidv has joined #tripleo | 01:04 | |
| *** psahoo has joined #tripleo | 01:07 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Don't run check-tripleo OVB jobs frm RH1 anymore https://review.openstack.org/526481 | 01:08 |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 01:10 |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] | 01:10 |
| *** liverpooler has joined #tripleo | 01:20 | |
| *** thrash is now known as thrash|g0ne | 01:22 | |
| *** fragatina has quit IRC | 01:34 | |
| *** fragatina has joined #tripleo | 01:35 | |
| *** fragatina has quit IRC | 01:36 | |
| *** fragatina has joined #tripleo | 01:36 | |
| *** fragatin_ has joined #tripleo | 01:38 | |
| *** fragatina has quit IRC | 01:40 | |
| *** fragatin_ has quit IRC | 01:42 | |
| *** itlinux has joined #tripleo | 01:50 | |
| *** openstackstatus has quit IRC | 01:55 | |
| *** gregwork has quit IRC | 01:55 | |
| *** rajinir has quit IRC | 01:55 | |
| *** hewbrocca_afk has quit IRC | 01:55 | |
| *** dobson has quit IRC | 01:55 | |
| *** Hazelesque has quit IRC | 01:55 | |
| *** toure|gone has quit IRC | 01:55 | |
| *** mnaser has quit IRC | 01:55 | |
| *** tbarron has quit IRC | 01:55 | |
| *** mandre has quit IRC | 01:55 | |
| *** mandre has joined #tripleo | 01:55 | |
| *** hewbrocca_afk has joined #tripleo | 01:55 | |
| *** toure has joined #tripleo | 01:55 | |
| *** Hazelesque has joined #tripleo | 01:55 | |
| *** tbarron has joined #tripleo | 01:55 | |
| *** rajinir has joined #tripleo | 01:55 | |
| *** dobson has joined #tripleo | 01:56 | |
| *** mnaser has joined #tripleo | 01:56 | |
| *** gregwork has joined #tripleo | 01:56 | |
| *** bandini has quit IRC | 01:57 | |
| *** openstackstatus has joined #tripleo | 01:57 | |
| *** ChanServ sets mode: +v openstackstatus | 01:58 | |
| *** bandini has joined #tripleo | 01:59 | |
| *** itlinux has quit IRC | 02:05 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Reduce race condition with timeout for ansible run https://review.openstack.org/534846 | 02:06 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/pike: Add condition to create container images download script. https://review.openstack.org/534838 | 02:06 |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 02:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] | 02:10 |
| *** gvrangan has joined #tripleo | 02:12 | |
| *** fragatina has joined #tripleo | 02:13 | |
| *** ecerquei has quit IRC | 02:14 | |
| *** ecerquei has joined #tripleo | 02:15 | |
| *** fragatina has quit IRC | 02:18 | |
| *** gvrangan has quit IRC | 02:19 | |
| *** jlabarre has quit IRC | 02:20 | |
| *** ecerquei has quit IRC | 02:21 | |
| *** ecerquei has joined #tripleo | 02:21 | |
| *** ecerquei has quit IRC | 02:21 | |
| *** apetrich has quit IRC | 02:41 | |
| *** apetrich has joined #tripleo | 02:41 | |
| *** yamahata has quit IRC | 02:42 | |
| *** fzdarsky_ has joined #tripleo | 02:44 | |
| *** fzdarsky has quit IRC | 02:48 | |
| *** rhallisey has quit IRC | 02:50 | |
| openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates master: Exclude Storage NFS network from networks hiera https://review.openstack.org/535005 | 02:50 |
| *** dpawar has joined #tripleo | 02:54 | |
| *** dpawar has quit IRC | 02:55 | |
| *** dpawar has joined #tripleo | 02:55 | |
| openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates master: Exclude Storage NFS network from networks hiera https://review.openstack.org/535005 | 02:57 |
| *** udesale has joined #tripleo | 02:58 | |
| *** bkopilov has quit IRC | 02:59 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 03:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] | 03:10 |
| *** gkadam has joined #tripleo | 03:10 | |
| *** tzumainn has joined #tripleo | 03:11 | |
| *** gvrangan has joined #tripleo | 03:13 | |
| *** anilvenkata has joined #tripleo | 03:21 | |
| *** ramishra has joined #tripleo | 03:21 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-collect-config master: Updated from global requirements https://review.openstack.org/535091 | 03:21 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-refresh-config master: Updated from global requirements https://review.openstack.org/535092 | 03:21 |
| *** stendulker has joined #tripleo | 03:22 | |
| *** jidar has quit IRC | 03:27 | |
| *** jidar has joined #tripleo | 03:27 | |
| *** jwb has quit IRC | 03:30 | |
| *** sdoran has quit IRC | 03:30 | |
| *** therve has quit IRC | 03:30 | |
| *** Tyrantelf has quit IRC | 03:30 | |
| *** GheRivero has quit IRC | 03:30 | |
| *** percevalbot has quit IRC | 03:30 | |
| *** saneax has quit IRC | 03:30 | |
| *** therve has joined #tripleo | 03:30 | |
| *** jwb has joined #tripleo | 03:30 | |
| *** sdoran has joined #tripleo | 03:31 | |
| *** GheRivero has joined #tripleo | 03:31 | |
| *** ChanServ sets mode: +v GheRivero | 03:31 | |
| *** Tyrantelf has joined #tripleo | 03:31 | |
| *** skramaja has joined #tripleo | 03:32 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient master: Updated from global requirements https://review.openstack.org/535130 | 03:32 |
| *** tzumainn has quit IRC | 03:32 | |
| *** saneax has joined #tripleo | 03:36 | |
| *** percevalbot has joined #tripleo | 03:36 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/535146 | 03:38 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements https://review.openstack.org/535147 | 03:38 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-validations master: Updated from global requirements https://review.openstack.org/535148 | 03:38 |
| *** liverpooler has quit IRC | 03:58 | |
| *** daidv has quit IRC | 04:00 | |
| *** daidv has joined #tripleo | 04:01 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 04:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] | 04:10 |
| *** psachin has joined #tripleo | 04:11 | |
| *** gvrangan has quit IRC | 04:11 | |
| *** fragatina has joined #tripleo | 04:18 | |
| *** bkopilov has joined #tripleo | 04:19 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] GPT partitioning support https://review.openstack.org/533490 | 04:20 |
| *** fragatina has quit IRC | 04:22 | |
| *** dpawar has quit IRC | 04:26 | |
| *** pdeore has joined #tripleo | 04:28 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] GPT partitioning support https://review.openstack.org/533490 | 04:28 |
| *** holser__ has joined #tripleo | 04:34 | |
| *** dpawar has joined #tripleo | 04:36 | |
| *** ykarel|away has joined #tripleo | 04:36 | |
| *** dpawar has quit IRC | 04:39 | |
| *** ratailor has joined #tripleo | 04:54 | |
| *** sonali85 has joined #tripleo | 04:57 | |
| Tengu | hello there :) | 05:02 |
| jaosorior | yooo | 05:03 |
| Tengu | jaosorior: you're early :) | 05:10 |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 05:10 |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] | 05:10 |
| Tengu | what's up ? | 05:10 |
| *** mdnadeem has quit IRC | 05:18 | |
| *** dpawar has joined #tripleo | 05:19 | |
| *** mdnadeem has joined #tripleo | 05:20 | |
| jaosorior | nothing much | 05:23 |
| jaosorior | making coffee n stuff | 05:23 |
| *** holser__ has quit IRC | 05:25 | |
| *** mdnadeem has quit IRC | 05:26 | |
| *** chlong has joined #tripleo | 05:26 | |
| Tengu | :) | 05:27 |
| Tengu | guess I'll need one today. Got back home at 11:30pm, I'm just dead this morning. working from home - snow is announced, no good for motorbike, and I don't want to lose my time in tranports -.-' | 05:28 |
| *** mdnadeem has joined #tripleo | 05:29 | |
| jaosorior | ouch | 05:29 |
| jaosorior | holy crap | 05:29 |
| jaosorior | gonna be a long day it seems | 05:29 |
| Tengu | not that much: working only the morning - thank youuuuu part-time :) | 05:30 |
| Tengu | but still - hard morning ;) | 05:30 |
| jaosorior | haha dude, that part time thing sounds pretty good | 05:31 |
| *** links has joined #tripleo | 05:31 | |
| *** psahoo has quit IRC | 05:32 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Drop redundant delay param https://review.openstack.org/531192 | 05:33 |
| openstackgerrit | Merged openstack/os-net-config master: Fix licenses to be explicit with Apache 2.0 https://review.openstack.org/510599 | 05:33 |
| *** psahoo has joined #tripleo | 05:34 | |
| *** psahoo has quit IRC | 05:36 | |
| *** holser__ has joined #tripleo | 05:37 | |
| *** psahoo has joined #tripleo | 05:38 | |
| *** nyechiel_ has joined #tripleo | 05:40 | |
| *** psahoo has quit IRC | 05:45 | |
| *** psahoo has joined #tripleo | 05:48 | |
| *** pdeore_ has joined #tripleo | 05:54 | |
| *** moshele has joined #tripleo | 05:55 | |
| *** pdeore has quit IRC | 05:55 | |
| *** pgadiya has joined #tripleo | 06:04 | |
| sonali85 | . | 06:08 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart master: Activate ipsec for ovb-ha https://review.openstack.org/534731 | 06:08 |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 06:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] | 06:10 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add IPSEC service to ovb-ha environment https://review.openstack.org/535171 | 06:10 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart master: Activate ipsec for ovb-ha https://review.openstack.org/534731 | 06:11 |
| openstackgerrit | Merged openstack/os-net-config master: Update .gitignore https://review.openstack.org/485168 | 06:12 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: GPT partitioning support https://review.openstack.org/533490 | 06:17 |
| *** janki has joined #tripleo | 06:17 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add IPSEC service to ovb-ha environment https://review.openstack.org/535171 | 06:19 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart master: Activate ipsec for ovb-ha https://review.openstack.org/534731 | 06:20 |
| *** itlinux has joined #tripleo | 06:20 | |
| *** gkadam has quit IRC | 06:21 | |
| *** masco has joined #tripleo | 06:27 | |
| *** jbadiapa has quit IRC | 06:29 | |
| *** jtomasek has quit IRC | 06:30 | |
| *** janki has quit IRC | 06:30 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Split IPSEC deployment in two https://review.openstack.org/534729 | 06:31 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add IPSEC service to ovb-ha environment https://review.openstack.org/535171 | 06:31 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart master: Activate ipsec for ovb-ha https://review.openstack.org/534731 | 06:32 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: GPT partitioning support https://review.openstack.org/533490 | 06:33 |
| *** fragatina has joined #tripleo | 06:36 | |
| *** jtomasek has joined #tripleo | 06:38 | |
| *** lebauce_ has quit IRC | 06:38 | |
| *** lebauce has joined #tripleo | 06:39 | |
| *** fragatina has quit IRC | 06:41 | |
| *** mdnadeem_ has joined #tripleo | 06:42 | |
| *** mdnadeem has quit IRC | 06:42 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Enable configuring IPSEC's phase 2 algorithm https://review.openstack.org/535184 | 06:43 |
| *** itlinux has quit IRC | 06:44 | |
| *** ccamacho has quit IRC | 06:49 | |
| openstackgerrit | Debo Zhang proposed openstack/tripleo-quickstart master: Correct link address in doc https://review.openstack.org/535187 | 06:53 |
| *** waleedm has joined #tripleo | 06:56 | |
| openstackgerrit | Merged openstack/os-apply-config master: Updated from global requirements https://review.openstack.org/535089 | 06:58 |
| openstackgerrit | Merged openstack/os-collect-config master: Updated from global requirements https://review.openstack.org/535091 | 06:59 |
| openstackgerrit | Merged openstack/os-refresh-config master: Updated from global requirements https://review.openstack.org/535092 | 06:59 |
| *** ianw has quit IRC | 07:02 | |
| *** marios has joined #tripleo | 07:05 | |
| *** dparkes has joined #tripleo | 07:05 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 07:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] | 07:10 |
| *** janki has joined #tripleo | 07:13 | |
| *** paramite has joined #tripleo | 07:15 | |
| *** pcaruana has joined #tripleo | 07:15 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Updated from global requirements https://review.openstack.org/535130 | 07:18 |
| openstackgerrit | Merged openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/535146 | 07:18 |
| *** mdnadeem_ has quit IRC | 07:25 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Set repo setup release in playbook https://review.openstack.org/504939 | 07:27 |
| *** mdnadeem has joined #tripleo | 07:27 | |
| openstackgerrit | Debo Zhang proposed openstack/diskimage-builder master: Correct link address https://review.openstack.org/535199 | 07:28 |
| *** cshastri has joined #tripleo | 07:30 | |
| *** ykarel|away is now known as ykarel | 07:38 | |
| *** brault has quit IRC | 07:53 | |
| *** cylopez has joined #tripleo | 07:58 | |
| *** agopi has quit IRC | 08:01 | |
| *** gkadam has joined #tripleo | 08:02 | |
| *** threestrands has quit IRC | 08:03 | |
| *** mdnadeem has quit IRC | 08:03 | |
| *** florianf has joined #tripleo | 08:04 | |
| *** brault has joined #tripleo | 08:04 | |
| *** tesseract has joined #tripleo | 08:08 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 08:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] | 08:10 |
| *** ccamacho has joined #tripleo | 08:11 | |
| openstackgerrit | Or Idgar proposed openstack/tripleo-heat-templates master: Add scenario010 for testing Octavia https://review.openstack.org/518331 | 08:11 |
| *** jfrancoa has joined #tripleo | 08:14 | |
| *** yprokule has joined #tripleo | 08:15 | |
| openstackgerrit | ShangXiao proposed openstack/python-tripleoclient master: Update the doc links to the right ones https://review.openstack.org/535217 | 08:19 |
| *** bogdando has joined #tripleo | 08:20 | |
| *** pdeore has joined #tripleo | 08:20 | |
| *** pdeore_ has quit IRC | 08:20 | |
| *** pgadiya has quit IRC | 08:22 | |
| *** oidgar has joined #tripleo | 08:23 | |
| *** aufi has joined #tripleo | 08:24 | |
| *** shardy has joined #tripleo | 08:27 | |
| *** pdeore_ has joined #tripleo | 08:28 | |
| *** rcernin has quit IRC | 08:28 | |
| jaosorior | shardy: hey, figured out the issue I was having with the ansible groups | 08:28 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Resolve CI issues https://review.openstack.org/534954 | 08:29 |
| jaosorior | shardy: I hadn't taken into account that featureset001 sets specific services for computes and controllers, so I needed to update that list. | 08:29 |
| *** jbadiapa has joined #tripleo | 08:29 | |
| *** pdeore has quit IRC | 08:29 | |
| jaosorior | shardy: which is this one https://review.openstack.org/#/c/535171/ | 08:29 |
| *** dparkes has quit IRC | 08:31 | |
| *** dparkes has joined #tripleo | 08:32 | |
| *** ebarrera has joined #tripleo | 08:33 | |
| jaosorior | shardy: is it possible to get verbose ansible output from CI ? | 08:33 |
| *** pdeore_ has quit IRC | 08:33 | |
| jaosorior | I'm having another issue now https://logs.rdoproject.org/31/534731/5/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Zf623bb320987424f8940521a43bee7fa/undercloud/var/lib/mistral/da617ea8-a881-47a4-b609-b9beb75f5768/ansible.log.txt.gz#_2018-01-18_08_05_55_823 that I suspect is the inventory_hostname not matching what's actually in the inventory; but need verbose output to debug | 08:34 |
| jaosorior | that | 08:34 |
| *** pdeore has joined #tripleo | 08:34 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-common master: Remove EOL for the step_config which break the inventory https://review.openstack.org/534844 | 08:36 |
| *** mdnadeem has joined #tripleo | 08:37 | |
| *** pgadiya has joined #tripleo | 08:38 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Resolve CI issues https://review.openstack.org/534954 | 08:39 |
| openstackgerrit | Moshe Levi proposed openstack/tripleo-heat-templates master: Adding support for odl hw offloading in containers https://review.openstack.org/534622 | 08:39 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-common master: Make config-download workflow's verbosity configurable https://review.openstack.org/535226 | 08:39 |
| openstackgerrit | Avishay Machluf proposed openstack/tripleo-upgrade master: Update readme to include InfraRed installation command https://review.openstack.org/534820 | 08:41 |
| *** pcaruana has quit IRC | 08:43 | |
| *** pcaruana has joined #tripleo | 08:43 | |
| *** etingof has quit IRC | 08:45 | |
| *** jpena|off is now known as jpena | 08:46 | |
| *** zoli is now known as zoli|trng | 08:48 | |
| *** zoli|trng is now known as zoli | 08:48 | |
| *** amoralej|off is now known as amoralej | 08:49 | |
| shardy | jaosorior: EmilienM found a similar issue with the hostname, does that job pass a HostnameMap parameter? | 08:51 |
| shardy | jaosorior: I think we have a bug because the RoleNetHostnameMap output doesn't consider that | 08:51 |
| shardy | I'm going to look at it this morning | 08:52 |
| shardy | we could wire in ConfigDebug to enable ansible verbose mode perhaps, or make a cli flag input to the workflow to add -vv | 08:52 |
| *** shardy has quit IRC | 08:53 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Set repo setup release in playbook https://review.openstack.org/504939 | 08:53 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Set repo setup release in playbook https://review.openstack.org/504939 | 08:54 |
| *** daidv has quit IRC | 08:55 | |
| *** sshnaidm is now known as sshnaidm|afk | 08:55 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/python-tripleoclient master: Configure ansible's verbosity according to command's verbosity https://review.openstack.org/535233 | 08:56 |
| *** shardy has joined #tripleo | 08:56 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart master: DO NOT MERGE: Increase ansible verbosity https://review.openstack.org/535234 | 08:56 |
| openstackgerrit | yatin proposed openstack/tripleo-quickstart-extras master: Use shell instead of command module as using &> operator https://review.openstack.org/509084 | 08:56 |
| jaosorior | shardy: I'm actually working on just that | 08:56 |
| jaosorior | shardy: but based it on the verbose level that's passed on to the tripleoclient | 08:57 |
| shardy | jaosorior: Ah, nice - I'll take a look at the hostname problem shortly | 08:57 |
| *** ianw has joined #tripleo | 08:58 | |
| jaosorior | shardy: I don't know if the job passes the HostnameMap | 08:58 |
| *** udesale has quit IRC | 08:58 | |
| shardy | jaosorior: Ok we'll have to figure that out - EmilienM was seeing issues on the multinode-3nodes job | 08:59 |
| jaosorior | shardy: we'll get more data when https://review.openstack.org/535234 runs. meanwhile I'll check what's passed to that job. | 09:00 |
| *** yprokule_ has joined #tripleo | 09:00 | |
| oidgar | shardy: hi good morning, I'm not sure if you got my last message in RH IRC as there was a disconnection | 09:02 |
| *** yprokule has quit IRC | 09:02 | |
| *** yprokule_ is now known as yprokule | 09:02 | |
| *** jpich has joined #tripleo | 09:03 | |
| shardy | oidgar: Hi, yeah sorry my connection dropped - how's it going? | 09:03 |
| shardy | oidgar: FYI I noticed several ovb-HA timeouts yesterday | 09:03 |
| shardy | I've not yet figured out the cause, certainly some of the jobs were taking a long time just to start the overcloud deploy | 09:04 |
| *** arxcruz|rover is now known as arxcruz | 09:06 | |
| *** holser__ has quit IRC | 09:06 | |
| *** holser__ has joined #tripleo | 09:07 | |
| *** udesale has joined #tripleo | 09:07 | |
| *** dtantsur|afk is now known as dtantsur | 09:07 | |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 09:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] | 09:10 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update dependencies https://review.openstack.org/534759 | 09:10 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Fix bugs caused by dependencies update https://review.openstack.org/534761 | 09:10 |
| dciabrin | jaosorior, ping can you help debugging an stunnel connection issue when you have time? | 09:10 |
| *** mdnadeem_ has joined #tripleo | 09:11 | |
| oidgar | shardy: oh that's good to hear. I've having lots of timeouts from toci-quickstack.sh | 09:12 |
| *** daidv has joined #tripleo | 09:13 | |
| *** ccamacho has quit IRC | 09:13 | |
| oidgar | shardy: I'm really stuck with those timeouts, I'm rechecking and every time another job is fails, and the point is that non of the gates deploying our octavia so the code shouldn't affect on the gates, except pep8 which evaluates the yaml files... correct me if I'm wrong | 09:14 |
| *** mdnadeem has quit IRC | 09:14 | |
| *** hewbrocca_afk is now known as hewbrocca | 09:14 | |
| *** cylopez has left #tripleo | 09:16 | |
| ansiwen | skramaja: around? | 09:17 |
| *** ccamacho has joined #tripleo | 09:19 | |
| *** mdnadeem__ has joined #tripleo | 09:20 | |
| *** zoli has quit IRC | 09:21 | |
| *** gchamoul has quit IRC | 09:21 | |
| *** dsariel has quit IRC | 09:22 | |
| *** mdnadeem_ has quit IRC | 09:23 | |
| *** gchamoul has joined #tripleo | 09:23 | |
| dtantsur | any DIB core around? could you please review https://review.openstack.org/#/c/526212/ ? | 09:23 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Make Horizon parameters: vhost_extra_params and customization_module configurable https://review.openstack.org/519480 | 09:25 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: Make Horizon parameters: vhost_extra_params and customization_module configurable https://review.openstack.org/520166 | 09:25 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Make Horizon parameters: vhost_extra_params and customization_module configurable https://review.openstack.org/519481 | 09:25 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Updated from global requirements https://review.openstack.org/535147 | 09:25 |
| openstackgerrit | Merged openstack/tripleo-validations master: Updated from global requirements https://review.openstack.org/535148 | 09:26 |
| skramaja | yes ansiwen | 09:26 |
| *** pgadiya has quit IRC | 09:27 | |
| *** mdnadeem__ has quit IRC | 09:28 | |
| *** zoli has joined #tripleo | 09:28 | |
| *** mdnadeem__ has joined #tripleo | 09:28 | |
| *** mdnadeem__ has quit IRC | 09:28 | |
| *** mdnadeem has joined #tripleo | 09:29 | |
| *** mcornea has joined #tripleo | 09:30 | |
| *** pgadiya has joined #tripleo | 09:31 | |
| *** etingof has joined #tripleo | 09:33 | |
| *** athomas has joined #tripleo | 09:33 | |
| *** mdnadeem has quit IRC | 09:33 | |
| *** mdnadeem has joined #tripleo | 09:33 | |
| jaosorior | dciabrin: sure | 09:34 |
| jaosorior | dciabrin: let me just brew some coffee and I'm ready | 09:34 |
| *** pmannidi has quit IRC | 09:35 | |
| shardy | oidgar: yes agree it's probably unrelated to your patches, but it'd be good to figure out the root cause, we're wasting a ton of CI time with all the rechecks atm | 09:36 |
| shardy | oidgar: do we have any CI coverage at all for octavia atm? | 09:36 |
| *** mdnadeem_ has joined #tripleo | 09:36 | |
| *** mdnadeem has quit IRC | 09:37 | |
| oidgar | shardy: only in https://review.openstack.org/#/c/515402/ except one of the RDO Third party's gate | 09:37 |
| *** mdnadeem__ has joined #tripleo | 09:38 | |
| oidgar | shardy: My understanding is we're wasting time because there's a load on the servers. if that's right, can we reduce the concurrent gate test running? | 09:38 |
| *** pgadiya has quit IRC | 09:38 | |
| oidgar | shardy: I'll be glad to assist further is there's anything else I can do. | 09:39 |
| *** derekh has joined #tripleo | 09:39 | |
| shardy | oidgar: I'm not sure, we probably need to look at the server load and also see if things like the image download are taking longer than they should | 09:39 |
| shardy | oidgar: we can perhaps chat with sshnaidm|afk and weshay about it later | 09:40 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: WIP ffu: Introduce ffu upgrade tasks https://review.openstack.org/528241 | 09:40 |
| *** gfidente has joined #tripleo | 09:41 | |
| *** gfidente has quit IRC | 09:41 | |
| *** gfidente has joined #tripleo | 09:41 | |
| shardy | oidgar: https://review.openstack.org/#/c/515402 lgtm, which featureset enables octavia for the third-party CI? | 09:41 |
| shardy | wondering if the 035 failure is related or not | 09:41 |
| oidgar | shardy: ok sounds good. maybe it will be a good idea if I will analyze the times for the gate Ansible tasks. I'll try to get to the root cause by creating some list with the most time consuming tasks. | 09:41 |
| *** mdnadeem__ has quit IRC | 09:42 | |
| shardy | oidgar: any help with that would be appreciated - it's a constant battle trying to keep the job times from increasing as folks keep adding new features ;) | 09:42 |
| *** mdnadeem_ has quit IRC | 09:42 | |
| *** dpawar has quit IRC | 09:42 | |
| oidgar | shardy: https://review.openstack.org/#/c/518331/ is a new gate/scenario for testing octavia. | 09:43 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates stable/pike: Workflow execution blacklist support https://review.openstack.org/535255 | 09:43 |
| oidgar | shardy: will do, hope I'll manage to assist with reducing gate times :) will update you later | 09:43 |
| *** udesale has quit IRC | 09:44 | |
| *** anilvenkata has quit IRC | 09:48 | |
| *** pgadiya has joined #tripleo | 09:49 | |
| *** mdnadeem has joined #tripleo | 09:54 | |
| ansiwen | skramaja: so, the environments/host-config-and-reboot.yaml is created automatically, when I reference it in the deploy command, or do I have to process the jinja2 template manually before? | 09:56 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: Add the option of specifying a custom overcloud stack name https://review.openstack.org/535260 | 09:57 |
| skramaja | ansiwen: it is created in the deployment process automatically. | 09:57 |
| skramaja | ansiwen: if you want to see those files, you could download the swift container to see it. openstack overcloud container save overcloud | 09:58 |
| skramaja | this will dowload all the template files including the j2 rendedred output templates.. | 09:58 |
| *** yprokule_ has joined #tripleo | 09:59 | |
| ansiwen | skramaja: is it created while doing the overcloud deployment. or during undercloud deployment? let's say I would change the j2 file, would it be enough to just do the "deploy overcloud" again? | 10:00 |
| *** ramishra has quit IRC | 10:00 | |
| skramaja | ansiwen: j2 rendering happens on every deploy command once the tempaltes are uploaded to swift, when triggered from cli.. | 10:00 |
| openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates master: Upgrade ODL https://review.openstack.org/489201 | 10:01 |
| skramaja | ansiwen: so yes, the file will be available everytime you deploy. | 10:01 |
| *** mdnadeem has quit IRC | 10:02 | |
| *** yprokule has quit IRC | 10:02 | |
| *** yprokule_ is now known as yprokule | 10:02 | |
| *** chem has joined #tripleo | 10:04 | |
| *** salmankhan has joined #tripleo | 10:06 | |
| *** anilvenkata has joined #tripleo | 10:07 | |
| *** suuuper has joined #tripleo | 10:07 | |
| *** pgadiya has quit IRC | 10:08 | |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-quickstart master: Make sure we clean up yum metadata at the right moment. https://review.openstack.org/534360 | 10:10 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-quickstart master: Clean up after deleting repo https://review.openstack.org/535268 | 10:10 |
| *** shreshtha has joined #tripleo | 10:10 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 10:10 |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] | 10:10 |
| *** dpawar has joined #tripleo | 10:11 | |
| dciabrin | jaosorior, nevermind I found my pb :) | 10:12 |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Add major update implementation https://review.openstack.org/526213 | 10:13 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Select Roles feature https://review.openstack.org/512266 | 10:14 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Submit select roles https://review.openstack.org/521510 | 10:14 |
| *** tosky has joined #tripleo | 10:15 | |
| jaosorior | dciabrin: sorry, had a quick snack too | 10:16 |
| jaosorior | dciabrin: what was the issue? | 10:16 |
| dciabrin | jaosorior, no worries in trying to explain you my issue, I found it :) | 10:16 |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Add major update implementation https://review.openstack.org/526213 | 10:16 |
| dciabrin | jaosorior, I misconfigured the redis resource in pacemaker, so no connection over tls to the peers | 10:16 |
| *** hasanq has joined #tripleo | 10:17 | |
| *** shreshtha has quit IRC | 10:17 | |
| *** pgadiya has joined #tripleo | 10:19 | |
| ansiwen | skramaja: seems to work, thanks a lot! | 10:20 |
| jaosorior | marios: could you check this out https://review.openstack.org/#/c/534729/2 ? | 10:21 |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Dont show the mistral failure when ansible has failed https://review.openstack.org/535276 | 10:22 |
| *** dsariel has joined #tripleo | 10:23 | |
| *** skramaja has quit IRC | 10:26 | |
| *** tesseract has quit IRC | 10:27 | |
| *** tesseract has joined #tripleo | 10:29 | |
| *** athomas has quit IRC | 10:30 | |
| ansiwen | skramaja: I was confused, because apparently the roles_data.yaml is not created during every deploy command. if I change the roles/* it didn't change the roles_data.yaml and I had to change it manually as well | 10:35 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates master: Point heat.conf[clients_keystone/auth_uri] to the public endpoint. https://review.openstack.org/532584 | 10:37 |
| *** fragatina has joined #tripleo | 10:37 | |
| *** ramishra has joined #tripleo | 10:38 | |
| *** dbecker has joined #tripleo | 10:41 | |
| shardy | ansiwen: there's a CLI command openstack overcloud roles generate | 10:41 |
| shardy | https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/custom_roles.html | 10:42 |
| *** fragatina has quit IRC | 10:42 | |
| ansiwen | shardy: yes, thanks, I just had the good idea to read roles/README.rst ;-) | 10:42 |
| marios | jaosorior: ack added to list | 10:42 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: Add the option of specifying a custom overcloud stack name https://review.openstack.org/535260 | 10:43 |
| *** salmankhan has quit IRC | 10:46 | |
| openstackgerrit | Julie Pichon proposed openstack/tripleo-ui master: (Do not merge) Testing undercloud job https://review.openstack.org/535285 | 10:53 |
| *** raildo has joined #tripleo | 10:55 | |
| *** salmankhan has joined #tripleo | 10:57 | |
| *** panda|ruck is now known as panda | 11:00 | |
| *** pmannidi has joined #tripleo | 11:05 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common stable/pike: Parameterize Ansible environment vars in Mistral Workflow https://review.openstack.org/535291 | 11:06 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates stable/pike: Parameterize ceph-ansible environment variables https://review.openstack.org/535292 | 11:07 |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras master: Restrict resolvers to IPv4 addresses https://review.openstack.org/534326 | 11:08 |
| *** pmannidi has quit IRC | 11:08 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common stable/pike: Parameterize Ansible environment vars in Mistral Workflow https://review.openstack.org/535291 | 11:10 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 11:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] | 11:10 |
| *** pdeore_ has joined #tripleo | 11:11 | |
| *** pdeore has quit IRC | 11:12 | |
| openstackgerrit | yatin proposed openstack/tripleo-quickstart-extras master: Set SUPERMIN_* variables to working kernel https://review.openstack.org/535293 | 11:14 |
| *** janki has quit IRC | 11:16 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common stable/pike: Consume blacklisted_ip_addresses in workflows https://review.openstack.org/535294 | 11:16 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Fix the rabbitmq fd limits validation https://review.openstack.org/535295 | 11:17 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Move step 1 preparation to deploy-steps-tasks.yaml https://review.openstack.org/525260 | 11:22 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Convert bind IPs to hiera interpolation https://review.openstack.org/526692 | 11:22 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: WIP write per-service data https://review.openstack.org/534400 | 11:22 |
| *** psahoo has quit IRC | 11:22 | |
| *** stendulker_ has joined #tripleo | 11:23 | |
| *** pgadiya has quit IRC | 11:24 | |
| *** stendulker has quit IRC | 11:26 | |
| *** moshele has quit IRC | 11:26 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Collect and send statistics to InfluxDB https://review.openstack.org/533795 | 11:27 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Configure RDO cloud jobs to send stats to InfluxDB https://review.openstack.org/534434 | 11:27 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Use overcloud_templates for deployed server scripts. https://review.openstack.org/535299 | 11:27 |
| *** pdeore_ has quit IRC | 11:28 | |
| *** stendulker_ has quit IRC | 11:29 | |
| *** pgadiya has joined #tripleo | 11:31 | |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: WIP: Upgrade UC and OC using tripleo-upgrade role https://review.openstack.org/515643 | 11:32 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: Make sure we clean up yum metadata at the right moment. https://review.openstack.org/534360 | 11:38 |
| *** salmankhan has quit IRC | 11:40 | |
| *** jistr is now known as jistr|mtg | 11:41 | |
| *** ebarrera has quit IRC | 11:42 | |
| *** ebarrera has joined #tripleo | 11:42 | |
| *** salmankhan has joined #tripleo | 11:43 | |
| *** bkopilov has quit IRC | 11:43 | |
| *** pgadiya has quit IRC | 11:45 | |
| *** cshastri has quit IRC | 11:48 | |
| chem | arxcruz: hi, I've been bitten by https://bugs.launchpad.net/tripleo/+bug/1742155, and have an env ready for debug if you want | 11:50 |
| openstack | Launchpad bug 1742155 in tripleo "quickstart containers minimal failing w/ error configuring heat_api" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 11:50 |
| *** janki has joined #tripleo | 11:51 | |
| *** jkilpatr has joined #tripleo | 11:52 | |
| *** jkilpatr has quit IRC | 11:53 | |
| *** jkilpatr_ has joined #tripleo | 11:54 | |
| *** cshastri has joined #tripleo | 11:56 | |
| openstackgerrit | yatin proposed openstack/tripleo-quickstart-extras master: Set SUPERMIN_* variables to working kernel https://review.openstack.org/535293 | 11:56 |
| *** jpena is now known as jpena|lunch | 11:59 | |
| *** pkovar has joined #tripleo | 12:00 | |
| *** udesale has joined #tripleo | 12:01 | |
| *** hewbrocca is now known as hewbrocca_afk | 12:02 | |
| *** udesale has quit IRC | 12:02 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/python-tripleoclient master: Configure ansible's verbosity according to command's verbosity https://review.openstack.org/535233 | 12:03 |
| *** udesale has joined #tripleo | 12:03 | |
| *** pchavva has joined #tripleo | 12:06 | |
| *** amoralej is now known as amoralej|lunch | 12:07 | |
| *** shardy has quit IRC | 12:07 | |
| *** moshele has joined #tripleo | 12:08 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 12:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] | 12:10 |
| *** salmankhan has quit IRC | 12:11 | |
| *** ratailor has quit IRC | 12:12 | |
| *** moshele has quit IRC | 12:13 | |
| *** udesale has quit IRC | 12:16 | |
| *** dparkes has quit IRC | 12:21 | |
| *** bfournie has quit IRC | 12:21 | |
| chem | marios: matbu I've got this error when deploying master using the upgrade ci jobs, does it ring a bell https://bugs.launchpad.net/tripleo/+bug/1742155 ? | 12:21 |
| openstack | Launchpad bug 1742155 in tripleo "quickstart containers minimal failing w/ error configuring heat_api" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 12:21 |
| chem | (pike->master mixed version upgrade) | 12:22 |
| *** salmankhan has joined #tripleo | 12:23 | |
| arxcruz | chem: hey, cool, I'm checking the VolumePattern issue, but sure | 12:24 |
| *** dpawar has quit IRC | 12:25 | |
| chem | arxcruz: I've added some puppet debug output to the lp, but I can't make sense of them | 12:25 |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-docs master: Documentation entry for AIDE https://review.openstack.org/535316 | 12:26 |
| arxcruz | apetrich: hey, you're heat expert right? :D | 12:28 |
| apetrich | arxcruz, nope. mistral maybe | 12:29 |
| *** pradk has quit IRC | 12:29 | |
| ansiwen | owalsh: so, everything with the RealTime role seems to work now, besides the RT kernel is not used. it is in the grub.cfg, but as the second entry, the first is a newer non-RT kernel... :-/ | 12:30 |
| *** dparkes has joined #tripleo | 12:31 | |
| owalsh | ansiwen: yea, need to remove the non-rt kernel | 12:31 |
| ansiwen | owalsh: can we also uninstall a package with the image elements? | 12:31 |
| apetrich | arxcruz, therve might help | 12:32 |
| owalsh | ansiwen: we are https://review.openstack.org/#/c/531442/3/elements/realtime-kernel/package-installs.yaml@5 | 12:32 |
| *** masco has quit IRC | 12:32 | |
| therve | Hi | 12:32 |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras master: Restrict resolvers to IPv4 addresses https://review.openstack.org/534326 | 12:32 |
| owalsh | ansiwen: did it get re-intsalled during a pkg upgrade? | 12:32 |
| ansiwen | owalsh: hmm... no idea, you mean during image building? | 12:33 |
| ansiwen | let me check the build log | 12:34 |
| therve | chem, arxcruz : it's the policy stuff, it should be fixed in master | 12:34 |
| owalsh | ansiwen: since then. Image building should have removed it. Worked when I tested it (and there was a new kernel available) | 12:34 |
| chem | therve: oh, oki, I checked the delorean-current file on the env, and it's empty so that may explain why I don't have the fix | 12:36 |
| chem | therve: just curious if you would happen to know what is the fix ? | 12:36 |
| therve | chem, https://review.openstack.org/#/c/530225/ | 12:36 |
| therve | https://ci.centos.org/artifacts/rdo/jenkins-tqe-containers-gate-master-tripleo-ci-delorean-full-containers_minimal-2294/undercloud/usr/share/openstack-tripleo-heat-templates/puppet/services/heat-base.yaml.gz | 12:36 |
| therve | Looks like it's missing indeed | 12:37 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add a StorageNFS network for use by Manila/Ganesha https://review.openstack.org/512239 | 12:38 |
| chem | therve: thanks for the pointers, going to check that this fix the issue and will close the lp | 12:39 |
| *** akrivoka has joined #tripleo | 12:39 | |
| *** flepied has joined #tripleo | 12:40 | |
| *** abishop has joined #tripleo | 12:41 | |
| *** dparkes has quit IRC | 12:41 | |
| *** fzdarsky_ is now known as fzdarsky|lunch | 12:45 | |
| *** jlabarre has joined #tripleo | 12:45 | |
| ansiwen | owalsh: my build log says: "yum -v -y erase kernel" and then "No Packages marked for removal"... that doesn't look right, does it? | 12:46 |
| owalsh | ansiwen: are you sure you've used that image? | 12:46 |
| *** dparkes has joined #tripleo | 12:47 | |
| *** ebarrera is now known as ebarrera|lunch | 12:47 | |
| *** matbu has quit IRC | 12:48 | |
| *** masco has joined #tripleo | 12:48 | |
| owalsh | ansiwen: said you have the RT kernel too so I guess so... errm no idea what's up here. It worked for me using ansible to configure | 12:49 |
| ansiwen | owalsh: well, the RT kernel and the rt-kvm modules are installed (and the repos activated) so yes, I'm pretty sure | 12:49 |
| *** salmankhan has quit IRC | 12:50 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart master: Add featureset040.yml for Pike to Q all containers upgrade https://review.openstack.org/527454 | 12:50 |
| ansiwen | owalsh: do you still have the image build logs available? can you check if the lines after "Map uninstall for realtime-kernel: kernel" show that is actually got uninstalled? | 12:51 |
| *** athomas has joined #tripleo | 12:51 | |
| owalsh | ansiwen: no, long gone | 12:51 |
| owalsh | ansiwen: but yes, it did | 12:51 |
| *** salmankhan has joined #tripleo | 12:52 | |
| ansiwen | ok, then the build is going wrong :-/ | 12:52 |
| owalsh | IIRC | 12:52 |
| *** rhallisey has joined #tripleo | 12:53 | |
| owalsh | ansiwen: raise an LP bug for this maybe, I can't look at it today | 12:53 |
| *** pchavva has quit IRC | 12:55 | |
| marios | chem: nop not seen that | 12:56 |
| *** dciabrin has quit IRC | 12:57 | |
| chem | marios: seems solved by a patch in master, it seems that the pike->master jobs definition lacks a proper delorean-current definition (it's an empty file) which lead to not having the latest and greatest on it ... will check why in a few | 12:57 |
| *** dciabrin has joined #tripleo | 12:57 | |
| ansiwen | owalsh: if I run the command in the running system, it says: "Skipping the running kernel: kernel-3.10.0-693.11.6.el7.x86_64", but the image building is in a chroot environment, right? not sure how the "running kernel" detection works, though... | 12:57 |
| owalsh | ansiwen: maybe | 12:58 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-quickstart master: Make sure we clean up yum metadata at the right moment. https://review.openstack.org/534360 | 12:58 |
| *** hasanq has quit IRC | 12:59 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Use overcloud_templates for deployed server prepare scripts. https://review.openstack.org/535299 | 12:59 |
| ansiwen | maybe you had an older undercloud and the kernel was different and so it allowed you to remove it? that would be a funny bug though... | 12:59 |
| ansiwen | owalsh: ^^^? | 12:59 |
| owalsh | ansiwen: yea, that's what I assumed | 13:00 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-quickstart master: Make sure we clean up yum metadata at the right moment. https://review.openstack.org/534360 | 13:01 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add a StorageNFS network for use by Manila/Ganesha https://review.openstack.org/512239 | 13:01 |
| *** agopi has joined #tripleo | 13:04 | |
| *** dsariel has quit IRC | 13:04 | |
| owalsh | ansiwen: IIRC dib removes any old unused kernels, might be where that message came from, not yum | 13:05 |
| *** dsariel has joined #tripleo | 13:05 | |
| *** salmankhan has quit IRC | 13:05 | |
| owalsh | ... but as I said, can't look at this today | 13:06 |
| *** jpena|lunch is now known as jpena | 13:06 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Define 'NeutronPluginExtensions' in OVN environment files with dns extension https://review.openstack.org/530921 | 13:07 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Docker file for running quickstart in container https://review.openstack.org/520583 | 13:07 |
| ansiwen | owalsh: the "No Packages marked for removal" came right after the "Map uninstall for realtime-kernel: kernel", so that is related | 13:07 |
| ansiwen | owalsh: yeah, no worries, I will try to figure it out | 13:08 |
| *** lvdombrkr has joined #tripleo | 13:08 | |
| ansiwen | owalsh: thanks! | 13:08 |
| owalsh | ansiwen: np, can always make the RT kernel the default in grub afterwards, but we'd probably need to do it after every minor update too | 13:09 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 13:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] | 13:10 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update dependencies part II https://review.openstack.org/535323 | 13:10 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Fix EnvironmentConfiguration dialog https://review.openstack.org/535324 | 13:10 |
| *** hasanq has joined #tripleo | 13:14 | |
| *** bkopilov has joined #tripleo | 13:14 | |
| *** aufi has quit IRC | 13:15 | |
| *** psachin has quit IRC | 13:15 | |
| *** cshastri_ has joined #tripleo | 13:16 | |
| *** aufi has joined #tripleo | 13:16 | |
| *** bfournie has joined #tripleo | 13:16 | |
| *** dciabrin has quit IRC | 13:16 | |
| *** dciabrin has joined #tripleo | 13:16 | |
| *** matbu has joined #tripleo | 13:17 | |
| bogdando | PTAL folks https://review.openstack.org/#/c/534708/ | 13:17 |
| *** psahoo has joined #tripleo | 13:17 | |
| *** cshastri has quit IRC | 13:18 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-common master: Add more UndercloudCinder services to auto eval https://review.openstack.org/534756 | 13:20 |
| *** rbowen has joined #tripleo | 13:20 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Run overcloud-upgrade role only in upgrades jobs. https://review.openstack.org/518367 | 13:20 |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Add the option of specifying a custom overcloud stack name https://review.openstack.org/535260 | 13:20 |
| *** tzumainn has joined #tripleo | 13:27 | |
| openstackgerrit | Julie Pichon proposed openstack/tripleo-ui master: Reenable the undercloud jobs https://review.openstack.org/526430 | 13:27 |
| openstackgerrit | Julie Pichon proposed openstack/tripleo-ui master: (Do not merge) Testing undercloud job https://review.openstack.org/535285 | 13:27 |
| *** rlandy has joined #tripleo | 13:27 | |
| *** ykarel is now known as ykarel|away | 13:28 | |
| *** ebarrera|lunch is now known as ebarrera | 13:30 | |
| *** oidgar has quit IRC | 13:31 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates stable/pike: Swap the order of stdout and stderr in debug output https://review.openstack.org/535326 | 13:31 |
| *** fzdarsky|lunch is now known as fzdarsky | 13:31 | |
| *** sonali85 has quit IRC | 13:32 | |
| *** thrash|g0ne is now known as thrash | 13:33 | |
| *** fragatina has joined #tripleo | 13:36 | |
| *** dpawar has joined #tripleo | 13:37 | |
| *** dpawar has quit IRC | 13:37 | |
| *** dpawar has joined #tripleo | 13:38 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: Set repo setup release in OVB playbook https://review.openstack.org/535327 | 13:38 |
| *** ykarel|away has quit IRC | 13:40 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Changing sahara tempest plugin names https://review.openstack.org/526388 | 13:41 |
| *** fragatina has quit IRC | 13:41 | |
| ansiwen | owalsh: `yum --setopt=protected_packages= erase kernel` does remove it... if we could pass configs or command line options to yum, we could override that "feature" | 13:41 |
| *** zoli is now known as zoli|dentist | 13:42 | |
| *** zoli|dentist is now known as zoli | 13:42 | |
| *** lblanchard has joined #tripleo | 13:46 | |
| *** matbu has quit IRC | 13:48 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-docs master: add reproducer-quickstart.sh documentation https://review.openstack.org/534621 | 13:48 |
| *** matbu has joined #tripleo | 13:49 | |
| *** aditya_r has joined #tripleo | 13:50 | |
| *** chandankumar has quit IRC | 13:51 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update dependencies part II https://review.openstack.org/535323 | 13:51 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Fix EnvironmentConfiguration dialog https://review.openstack.org/535324 | 13:51 |
| *** weshay is now known as weshay|rover | 13:52 | |
| *** chandankumar has joined #tripleo | 13:52 | |
| *** cylopez has joined #tripleo | 13:53 | |
| *** zoli is now known as zoli|dentist | 13:56 | |
| *** zoli|dentist is now known as zoli | 13:56 | |
| *** oidgar has joined #tripleo | 13:57 | |
| *** liverpooler has joined #tripleo | 13:57 | |
| *** oidgar has joined #tripleo | 13:57 | |
| *** sshnaidm|afk is now known as sshnaidm | 13:57 | |
| *** cylopez has left #tripleo | 13:58 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add subnet property to ctlplane network for server resources https://review.openstack.org/473817 | 13:58 |
| *** aputtur_ has quit IRC | 13:58 | |
| *** oidgar has quit IRC | 13:59 | |
| *** dprince has joined #tripleo | 13:59 | |
| *** rfolco has quit IRC | 13:59 | |
| *** rfolco has joined #tripleo | 14:00 | |
| *** pradk has joined #tripleo | 14:03 | |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Add major update implementation https://review.openstack.org/526213 | 14:03 |
| *** salmankhan has joined #tripleo | 14:04 | |
| *** dhill_ has joined #tripleo | 14:06 | |
| *** suuuper1 has joined #tripleo | 14:06 | |
| *** suuuper1 has quit IRC | 14:06 | |
| *** sshnaidm is now known as sshnaidm|afk | 14:06 | |
| *** sshnaidm|afk is now known as sshnaidm|mtg | 14:07 | |
| *** pdeore has joined #tripleo | 14:07 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-validations master: Invert validation task order https://review.openstack.org/535338 | 14:08 |
| *** jistr|mtg is now known as jistr | 14:08 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Update default value for derive params workflow inputs https://review.openstack.org/525986 | 14:08 |
| *** suuuper has quit IRC | 14:08 | |
| ansiwen | could someone kick this with a W+1? Everything is green: https://review.openstack.org/#/c/533634/ | 14:09 |
| ansiwen | EmilienM: ^^^ you maybe? you gave +2 already | 14:10 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 14:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 14:10 |
| *** Goneri has joined #tripleo | 14:10 | |
| jaosorior | thrash, rbrady: if you have some time could I get a review for this https://review.openstack.org/#/c/535226/ ? | 14:11 |
| *** atoth has joined #tripleo | 14:13 | |
| *** aufi has quit IRC | 14:14 | |
| rbrady | jaosorior: the workflow in the patch defaults verbosity to 1, the action defaults to 5. Should the defaults be the same? | 14:14 |
| rbrady | jaosorior: https://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/ansible.py#L72 | 14:14 |
| *** oidgar has joined #tripleo | 14:15 | |
| *** lvdombrkr has quit IRC | 14:15 | |
| *** flaper87 has quit IRC | 14:16 | |
| *** jmelvin has joined #tripleo | 14:16 | |
| *** flaper87 has joined #tripleo | 14:16 | |
| jaosorior | rbrady: well, defaulting to 5 will actually make it quite verbose | 14:17 |
| jaosorior | rbrady: not sure if that's what folks want as a default | 14:17 |
| *** ramishra_ has joined #tripleo | 14:17 | |
| *** ramishra has quit IRC | 14:17 | |
| jaosorior | rbrady: another thing is that the workflow itself used to pass 1 directly (which is what I ended up using) | 14:17 |
| EmilienM | ansiwen: done | 14:18 |
| EmilienM | hello | 14:18 |
| jaosorior | sup | 14:18 |
| *** ramishra_ is now known as ramishra | 14:18 | |
| *** dciabrin has quit IRC | 14:20 | |
| *** dciabrin_ has joined #tripleo | 14:20 | |
| *** aufi has joined #tripleo | 14:20 | |
| rbrady | jaosorior: I don't have a strong opinion on which value to default to, but it seems odd to have different defaults in a lib for the same thing | 14:20 |
| *** shardy has joined #tripleo | 14:20 | |
| jaosorior | rbrady: we could ask :D | 14:21 |
| rbrady | jaosoior: we can, but it shouldn't hold up your patch. I'll just file a bug so the question doesn't get lost. | 14:22 |
| shardy | hjensas: Hi! I wanted to ask if you've seen my comments on https://review.openstack.org/#/c/473817/ | 14:22 |
| jaosorior | slagle: hey, was there any reason why you set the verbosity to 1 instead of the action's default in the config_download_deploy workflow? config_download_deploy | 14:22 |
| shardy | hjensas: I'm being chased re progress but I think we need to resolve those questions to make progress? | 14:22 |
| jaosorior | Slower: https://github.com/openstack/tripleo-common/blob/master/workbooks/deployment.yaml#L382 | 14:22 |
| *** lblanchard has quit IRC | 14:24 | |
| jaosorior | slagle: not Slower :P | 14:24 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: DONOTMERGE https://review.openstack.org/535342 | 14:24 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add extra yaml validations in upgrade tasks. https://review.openstack.org/535343 | 14:24 |
| jaosorior | aaaah | 14:25 |
| jaosorior | gotta go | 14:25 |
| jaosorior | have a good day everyone! | 14:25 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: debug collectins https://review.openstack.org/535346 | 14:25 |
| *** ykarel|away has joined #tripleo | 14:25 | |
| *** jaosorior has quit IRC | 14:25 | |
| hjensas | shardy: yes, I made a comment on the review and submitted a new version. | 14:25 |
| *** ledo_ has joined #tripleo | 14:28 | |
| *** waleedm has quit IRC | 14:28 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add yaml validations for FFU. https://review.openstack.org/534709 | 14:28 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Fix the rabbitmq fd limits validation https://review.openstack.org/535295 | 14:30 |
| *** ccamacho has quit IRC | 14:31 | |
| openstackgerrit | yatin proposed openstack/tripleo-quickstart-extras master: Set SUPERMIN_* variables to working kernel https://review.openstack.org/535293 | 14:32 |
| *** jfrancoa has quit IRC | 14:33 | |
| shardy | hjensas: ack thanks will check it out! | 14:35 |
| owalsh | ansiwen:could just run yum directly instead of setting it in package_installs.yaml | 14:35 |
| *** pdeore has quit IRC | 14:42 | |
| *** ykarel|away has quit IRC | 14:42 | |
| *** masco has quit IRC | 14:43 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade stable/pike: Add the option of specifying a custom overcloud stack name https://review.openstack.org/535356 | 14:44 |
| *** dpawar has quit IRC | 14:44 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Convert bind IPs to hiera interpolation https://review.openstack.org/526692 | 14:44 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: WIP write per-service data https://review.openstack.org/534400 | 14:44 |
| *** jfrancoa has joined #tripleo | 14:49 | |
| *** oidgar has quit IRC | 14:49 | |
| *** ccamacho has joined #tripleo | 14:51 | |
| *** pradk has quit IRC | 14:51 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add subnet property to ctlplane network for server resources https://review.openstack.org/473817 | 14:52 |
| *** hasanq has quit IRC | 14:52 | |
| *** anilvenkata has quit IRC | 14:54 | |
| *** aputtur_ has joined #tripleo | 14:57 | |
| *** jaganathan has quit IRC | 14:58 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/puppet-tripleo master: Split docker mirror and debug configs https://review.openstack.org/535360 | 15:00 |
| *** ccamacho1 has joined #tripleo | 15:01 | |
| *** ccamacho has quit IRC | 15:02 | |
| *** oidgar has joined #tripleo | 15:03 | |
| *** jfrancoa has quit IRC | 15:05 | |
| *** jcoufal has joined #tripleo | 15:05 | |
| *** amoralej|lunch is now known as amoralej | 15:06 | |
| *** lblanchard has joined #tripleo | 15:09 | |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 15:10 |
| *** salmankhan has quit IRC | 15:10 | |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 15:10 |
| *** itlinux has joined #tripleo | 15:11 | |
| *** pchavva has joined #tripleo | 15:13 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart-extras master: Add ability to deploy FreeIPA on OVB https://review.openstack.org/534435 | 15:14 |
| *** itlinux has quit IRC | 15:17 | |
| *** salmankhan has joined #tripleo | 15:17 | |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: logging: use service_config_settings for fluentd https://review.openstack.org/501458 | 15:19 |
| trozet | shardy: hi, if you could comment on if what I wrote is right on line 162 that would be great. https://review.openstack.org/#/c/489201/10/docker/services/opendaylight-api.yaml | 15:20 |
| *** jfrancoa has joined #tripleo | 15:21 | |
| *** hamzy has quit IRC | 15:21 | |
| *** jbadiapa has quit IRC | 15:22 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: DONOTMERGE https://review.openstack.org/535342 | 15:26 |
| *** oidgar has quit IRC | 15:29 | |
| *** ledo_ has quit IRC | 15:36 | |
| *** aditya_ra has joined #tripleo | 15:37 | |
| *** links has quit IRC | 15:38 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: DONOTMERGE https://review.openstack.org/535376 | 15:39 |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: WIP: Upgrade UC and OC using tripleo-upgrade role https://review.openstack.org/515643 | 15:40 |
| *** aditya_r has quit IRC | 15:40 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates stable/pike: DONOTMERGE https://review.openstack.org/535377 | 15:40 |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: WIP: Upgrade UC and OC using tripleo-upgrade role https://review.openstack.org/515643 | 15:41 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: DONOTMERGE https://review.openstack.org/535376 | 15:42 |
| *** ukalifon has joined #tripleo | 15:42 | |
| *** ukalifon has quit IRC | 15:42 | |
| *** aditya_ra has quit IRC | 15:42 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates stable/pike: DONOTMERGE https://review.openstack.org/535377 | 15:42 |
| *** ramishra has quit IRC | 15:44 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: DONOTMERGE https://review.openstack.org/535380 | 15:45 |
| *** aditya_r has joined #tripleo | 15:45 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: DONOTMERGE https://review.openstack.org/535380 | 15:45 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates stable/pike: DONOTMERGE https://review.openstack.org/535381 | 15:46 |
| *** hjensas is now known as hjensas|afk | 15:48 | |
| *** zshi has quit IRC | 15:48 | |
| *** jerrygb has joined #tripleo | 15:50 | |
| *** jerrygb has left #tripleo | 15:51 | |
| *** zshi has joined #tripleo | 15:54 | |
| *** janki has quit IRC | 15:55 | |
| openstackgerrit | Merged openstack/tripleo-ui master: Resolve CI issues https://review.openstack.org/534954 | 15:58 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update dependencies part II https://review.openstack.org/535323 | 15:58 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Fix EnvironmentConfiguration dialog https://review.openstack.org/535324 | 15:58 |
| *** stendulker has joined #tripleo | 15:59 | |
| *** dpawar has joined #tripleo | 15:59 | |
| *** dpawar has quit IRC | 16:00 | |
| *** masco has joined #tripleo | 16:02 | |
| *** dpawar has joined #tripleo | 16:04 | |
| *** itlinux has joined #tripleo | 16:04 | |
| *** hamzy has joined #tripleo | 16:05 | |
| *** aufi has quit IRC | 16:06 | |
| *** hamzy has quit IRC | 16:07 | |
| *** hamzy has joined #tripleo | 16:07 | |
| itlinux | hello beagles_afk: are you around? | 16:08 |
| *** dbecker has quit IRC | 16:09 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 16:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 16:10 |
| *** fzdarsky is now known as fzdarsky|afk | 16:10 | |
| *** hamzy_ has joined #tripleo | 16:14 | |
| itlinux | hello all.. question on the timeout option | 16:16 |
| itlinux | does the timeout option gets apply only if it's waiting or does the time apply from the deployment start | 16:17 |
| *** hamzy has quit IRC | 16:17 | |
| *** chlong has quit IRC | 16:20 | |
| *** ramishra has joined #tripleo | 16:27 | |
| sileht | EmilienM, hi any idea why I can't get https://review.openstack.org/#/c/528078/ merged ? | 16:29 |
| *** pcaruana has quit IRC | 16:29 | |
| EmilienM | sileht: in a mtg, a sec | 16:30 |
| sileht | EmilienM, sometimes it fails due to #1742936, but for the last run I don't find the failure reason | 16:31 |
| *** atoth has quit IRC | 16:31 | |
| *** aditya_r has quit IRC | 16:32 | |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-heat-templates stable/pike: Update default value for derive params workflow inputs https://review.openstack.org/535397 | 16:33 |
| *** ramishra has quit IRC | 16:34 | |
| openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui master: Change link to button for clearer UI https://review.openstack.org/533989 | 16:35 |
| EmilienM | holser__, chem : is it possible to have unit tests on https://review.openstack.org/#/c/532580/ ? | 16:39 |
| chem | EmilienM: yeah, it should be, -1 it, so that we remember to do that, thanks. | 16:40 |
| *** dpawar has quit IRC | 16:40 | |
| EmilienM | chem: done, thank you sir | 16:40 |
| openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo master: Adds TLS support for OpenDaylight https://review.openstack.org/531003 | 16:41 |
| holser__ | chem - if you are busy I can write tests | 16:41 |
| holser__ | it's not a big deal | 16:41 |
| *** oidgar has joined #tripleo | 16:42 | |
| chem | holser__: oh, yeah, I want to finish my big workaronud to get the ffu ci "working" | 16:43 |
| *** fragatina has joined #tripleo | 16:43 | |
| holser__ | ok... I write test | 16:43 |
| holser__ | give me 10 min | 16:43 |
| chem | holser__: thanks | 16:43 |
| *** fragatina has quit IRC | 16:44 | |
| *** fragatina has joined #tripleo | 16:44 | |
| *** chlong has joined #tripleo | 16:45 | |
| *** chlong is now known as chlong|afk | 16:45 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/pike: gnocchi/ceilometer upgrade workflow fix https://review.openstack.org/528078 | 16:45 |
| EmilienM | sileht: let me take care of it, I know we had some job timeouts yesterday, infra related | 16:46 |
| EmilienM | sileht: it'll merge today | 16:46 |
| sileht | EmilienM, thx | 16:46 |
| *** dparkes has quit IRC | 16:48 | |
| *** jaganathan has joined #tripleo | 16:49 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing. https://review.openstack.org/525686 | 16:50 |
| *** salmankhan has quit IRC | 16:54 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Swift fast-forward upgrade tasks https://review.openstack.org/526642 | 16:55 |
| *** marios has quit IRC | 16:56 | |
| *** sshnaidm|mtg has quit IRC | 16:56 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Swift fast-forward upgrade tasks https://review.openstack.org/526642 | 16:56 |
| *** jfrancoa has quit IRC | 16:57 | |
| jrist | honza: prettier is very mad at my new patch | 16:58 |
| jrist | s/new/old/g | 16:58 |
| itlinux | hello @EmilienM: do you what timezone beagles_afk: is he in? Thanks | 17:01 |
| EmilienM | itlinux: atlantic | 17:02 |
| *** fzdarsky|afk is now known as fzdarsky | 17:02 | |
| *** salmankhan has joined #tripleo | 17:04 | |
| *** gkadam has quit IRC | 17:06 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Fix path to ceph-mgr in storage-environment https://review.openstack.org/535409 | 17:10 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 17:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 17:10 |
| EmilienM | weshay|rover, arxcruz : any news on master promotion? | 17:11 |
| EmilienM | I guess we still have no progress on https://bugs.launchpad.net/tripleo/+bug/1742936 | 17:12 |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 17:12 |
| arxcruz | EmilienM: no progress :( | 17:12 |
| weshay|rover | EmilienM, not good news yet | 17:12 |
| *** jcoufal has quit IRC | 17:13 | |
| weshay|rover | EmilienM, both arxcruz and I are trying but hitting other errors | 17:13 |
| *** itlinux has quit IRC | 17:14 | |
| EmilienM | arxcruz, weshay|rover: we're unable to reproduce? | 17:16 |
| EmilienM | and you're unable to hold a node in our own hardware? | 17:16 |
| *** pchavva has quit IRC | 17:16 | |
| arxcruz | EmilienM: the deployment on rdocloud is failing | 17:16 |
| *** yprokule has quit IRC | 17:16 | |
| EmilienM | arxcruz: failing on what error? | 17:16 |
| EmilienM | arxcruz: the tempest one? | 17:16 |
| *** dsneddon has joined #tripleo | 17:16 | |
| arxcruz | EmilienM: yes | 17:16 |
| arxcruz | EmilienM: some heat failure apetrich was looking into it, but I don't have the root cause | 17:17 |
| EmilienM | dmsimard: ^ need your help to hold the node when the job fails | 17:17 |
| *** itlinux has joined #tripleo | 17:17 | |
| EmilienM | I can't believe we can't hold nodes in our own environment | 17:18 |
| EmilienM | amoralej, dmsimard, jpena ^ please help here | 17:18 |
| arxcruz | EmilienM: no, we are not trying to hold the node, we are trying to reproduce the environment in rdocloud | 17:18 |
| EmilienM | but if we have the failure in RDO cloud in promotion jobs | 17:18 |
| EmilienM | why not just holding a node | 17:18 |
| dmsimard | We can hold nodes upstream and in RDO.. what's the problem ? | 17:18 |
| EmilienM | I'm confused why we can't hold nodes that run promotion CI jobs | 17:19 |
| EmilienM | so we can ssh and debug from there | 17:19 |
| dmsimard | We can hold them, just need to ask | 17:19 |
| apetrich | EmilienM, btw is not a heat error it looks like a ceph error http://paste.openstack.org/show/646902/ | 17:19 |
| dmsimard | Has anyone ever asked ? | 17:19 |
| *** itlinux has quit IRC | 17:20 | |
| arxcruz | apetrich: sorry, my mistake, it's ceph, not heat | 17:20 |
| EmilienM | dmsimard: I don't know. arxcruz, weshay|rover ^ ? | 17:20 |
| arxcruz | EmilienM: well, if a node can be holded, i'm okay with that, weshay|rover ? ^ | 17:20 |
| EmilienM | lol | 17:20 |
| EmilienM | of course it can be hold, just ask :-) | 17:21 |
| arxcruz | ok :) | 17:21 |
| dmsimard | Of course we can hold nodes, please don't assume otherwise before at least asking | 17:21 |
| EmilienM | yeah | 17:21 |
| EmilienM | dmsimard: give me one sec to tell you what to hold | 17:21 |
| dmsimard | Same thing for review.rdo and review.openstack | 17:21 |
| dmsimard | openstack-infra will be happy to hold nodes if it's a tough problem | 17:22 |
| EmilienM | arxcruz: which jobs we need to old | 17:22 |
| EmilienM | periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master ? | 17:22 |
| dmsimard | EmilienM: give me the Jenkins console link of the job we need to hold please | 17:22 |
| EmilienM | yeah, a sec | 17:22 |
| EmilienM | why there is no logs on https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/1c18228/ ? | 17:23 |
| EmilienM | arxcruz, weshay|rover ^ ? | 17:23 |
| amoralej | EmilienM, yes we can hold nodes | 17:23 |
| EmilienM | dmsimard: please hold https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/ next time it runs | 17:24 |
| EmilienM | let me check if there are other jobs we can hold | 17:24 |
| dmsimard | EmilienM: we don't have autohold (which is zuul v3), we need to trigger the hold once the job has started | 17:24 |
| dmsimard | so just ping me when the jobs you,re interested in starts, I'm going to feed my kids :p | 17:24 |
| EmilienM | let's stick on that one | 17:24 |
| EmilienM | dmsimard: can you start it now please in jenkins? | 17:25 |
| dmsimard | periodic jobs? no | 17:25 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: Update image prepare commands with the up to date locations https://review.openstack.org/535417 | 17:25 |
| dmsimard | they're dependant on an image build from a parent job and zuul can overlap by firing jobs on top because it's not aware the periodic jobs are already running | 17:25 |
| EmilienM | well, can we kick off the image build on master then? | 17:26 |
| dmsimard | we ran into an issue before where two sets of periodic jobs were stepping on each other | 17:26 |
| openstackgerrit | Merged openstack/tripleo-common master: Discover every tag on prepare https://review.openstack.org/529215 | 17:26 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Replace hardcoded profile name with _TUNED_PROFILE_NAME_ https://review.openstack.org/533634 | 17:26 |
| weshay|rover | amoralej, holding a node in this case would be awesome | 17:26 |
| dmsimard | let me see when the next periodic job should be due befor we start hacking things.. | 17:26 |
| weshay|rover | arxcruz, you have a minute to compare notes on a few things? | 17:27 |
| amoralej | yeah, launching manually periodic jobs is not a good idea, last time we messed it up, best option is just wait for next execution | 17:27 |
| weshay|rover | amoralej, hrm.. fs016 did not launch in last run because the containers build job failed | 17:27 |
| EmilienM | amoralej: ok we'll wait | 17:27 |
| EmilienM | and we need to ping dmsimard when it starts so he can hold it | 17:28 |
| dmsimard | also, when you have stuff like this, please use #rdo instead of #tripleo (like you would #openstack-infra instead of pinging people here), helps keep things on-topic | 17:28 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: WIP ffu: Introduce ffu upgrade tasks https://review.openstack.org/528241 | 17:28 |
| EmilienM | do we have an idea when it starts the next time? | 17:28 |
| *** psahoo has quit IRC | 17:28 | |
| dmsimard | I'm looking now | 17:28 |
| dmsimard | last one triggered 3h29 ago from looking at https://review.rdoproject.org/zuul/ I believe the config is every 4 hrs unless mistaken | 17:29 |
| *** atoth has joined #tripleo | 17:29 | |
| dmsimard | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul/upstream.yaml#L97 | 17:30 |
| *** ccamacho1 has quit IRC | 17:30 | |
| weshay|rover | looks like the jenkins slave lost the handle on the containers build job | 17:30 |
| dmsimard | looks like 19h00 UTC ? so 1h30 | 17:30 |
| amoralej | yes, i think so | 17:30 |
| *** sshnaidm|mtg has joined #tripleo | 17:31 | |
| *** sshnaidm|mtg is now known as sshnaidm | 17:32 | |
| *** rfolco is now known as rfolco|rover|lun | 17:32 | |
| *** rfolco|rover|lun is now known as rfolco|rover|afk | 17:32 | |
| *** axisys has joined #tripleo | 17:32 | |
| dmsimard | if you *really really* want to, we can patch the pipeline config to trigger at 18 instead so in 30 minutes | 17:32 |
| *** axisys has left #tripleo | 17:34 | |
| amoralej | lat time error looks like networking issue | 17:34 |
| amoralej | in containers-build job | 17:34 |
| dmsimard | amoralej: link ? | 17:34 |
| amoralej | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-centos-7-master-containers-build/953124c/kolla/logs/swift-container.log | 17:34 |
| *** morazi has quit IRC | 17:34 | |
| amoralej | Timeout on http://mirrorlist.centos.org/?release=7&arch=x86_64&repo=os&infra=container: (28, 'Operation too slow. Less than 1000 bytes/sec transferred the last 30 seconds') | 17:35 |
| dmsimard | amoralej: that's weird, why is it resolving ipv6 ? | 17:35 |
| EmilienM | I need to be afk 15 min, thanks for helping out | 17:35 |
| dmsimard | amoralej: errr that looks like a bug ? "http://mirrorlist.centos.org/?release=7&arch=x86_64&repo=os&infra=container" | 17:35 |
| dmsimard | oh wait nevermind, not sure what the infra=container is about | 17:35 |
| amoralej | and there is other error https://review.rdoproject.org/jenkins/job/periodic-tripleo-centos-7-master-containers-build/551/console | 17:35 |
| dmsimard | probably for identification from centos container image | 17:35 |
| amoralej | it seems comunication between jenkins and slave | 17:36 |
| amoralej | so, it looks like a legit networking issue? | 17:36 |
| honza | jrist: did you rebase? | 17:36 |
| jrist | aye | 17:36 |
| jrist | honza: perhaps I rebased wrongly? | 17:37 |
| jrist | honza: https://review.openstack.org/533989 | 17:37 |
| honza | jrist: rebase on top of the "Resolve CI issues" patch? | 17:37 |
| * honza looks | 17:37 | |
| jrist | aye, I believe so | 17:37 |
| amoralej | dmsimard, execution of openstack-periodic just finished so we can change schedule as you suggested if needed | 17:37 |
| *** jpich has quit IRC | 17:38 | |
| honza | jrist: did you "npm install && npm run lint" after rebasing? | 17:38 |
| dmsimard | amoralej: I don't know, I'm not sure if there was an emergency or why the pipeline is not set to run every 4 hours on purpose | 17:38 |
| amoralej | yeah, ok | 17:38 |
| jrist | honza: not I, zuul | 17:38 |
| honza | jrist: therein lies your problem | 17:38 |
| jrist | ? | 17:39 |
| jrist | /home/jrist/workspace/tripleo-ui/src/js/components/deployment_plan/ConfigurePlanStep.js | 17:39 |
| jrist | 35:10 error Insert `·` prettier/prettier | 17:39 |
| jrist | wut | 17:39 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: ipv4 address for overcloud nodes in ssh.config.ansible https://review.openstack.org/535421 | 17:39 |
| weshay|rover | arxcruz, ^ | 17:40 |
| *** cshastri_ has quit IRC | 17:40 | |
| *** yamahata has joined #tripleo | 17:40 | |
| honza | jrist: that does look rather strange | 17:41 |
| jrist | it wants me to put a period in a break | 17:41 |
| jrist | <br./> | 17:41 |
| jrist | wut | 17:41 |
| honza | that must be artisanal javascript | 17:41 |
| honza | let me pull that code | 17:41 |
| dmsimard | amoralej: why would the container try to use ipv6 if the default gateway is ipv4 ? | 17:41 |
| amoralej | no idea | 17:42 |
| dmsimard | how did it even resolve it in the first place | 17:42 |
| jrist | honza: omg | 17:42 |
| jrist | honza: it wants a space, not a . | 17:42 |
| *** athomas has quit IRC | 17:42 | |
| honza | :D | 17:42 |
| jrist | <br /> | 17:42 |
| *** shardy has quit IRC | 17:42 | |
| *** oidgar has quit IRC | 17:42 | |
| jrist | not <br/> | 17:42 |
| jrist | that's... dumb | 17:42 |
| honza | fancy! | 17:42 |
| dmsimard | </br> master race | 17:42 |
| openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui master: Change link to button for clearer UI https://review.openstack.org/533989 | 17:42 |
| honza | jrist: this can be fixed automatically with "npm run prettier" :) | 17:42 |
| jrist | can we alter the prettier rules to not give a **** about that? | 17:43 |
| amoralej | dmsimard, in the log it seems there are several retries | 17:43 |
| amoralej | it seems first time is not trying with ipv6 | 17:43 |
| amoralej | so, i'd say it tried with ipv6 after ipv4 failed | 17:44 |
| *** rfolco|rover|afk is now known as rfolco|rover | 17:44 | |
| weshay|rover | rfolco|rover, thanks.. | 17:44 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: WIP ffu: Introduce ffu upgrade tasks https://review.openstack.org/528241 | 17:44 |
| weshay|rover | rfolco|rover, keep your eyes on this channel | 17:45 |
| rfolco|rover | weshay|rover, ack | 17:46 |
| *** stendulker_ has joined #tripleo | 17:46 | |
| weshay|rover | rfolco|rover, fyi.. for the logging issue https://review.openstack.org/#/c/535421/ | 17:46 |
| *** morazi has joined #tripleo | 17:47 | |
| *** itlinux has joined #tripleo | 17:47 | |
| honza | jtomasek: just saw that resolve ci issues merged! A+ | 17:48 |
| honza | recheck all the things :) | 17:48 |
| *** stendulker has quit IRC | 17:49 | |
| *** bogdando has quit IRC | 17:50 | |
| *** stendulker_ has quit IRC | 17:51 | |
| *** owalsh_ has joined #tripleo | 17:53 | |
| *** gfidente has quit IRC | 17:54 | |
| *** gvrangan has joined #tripleo | 17:55 | |
| openstackgerrit | Luigi Toscano proposed openstack/tripleo-quickstart master: Fix/enable the Tempest tests for Sahara and Manila https://review.openstack.org/509554 | 17:55 |
| *** owalsh has quit IRC | 17:55 | |
| openstackgerrit | Sven Anderson proposed openstack/tripleo-image-elements master: Make sure, the realtime element removes the default kernel https://review.openstack.org/535428 | 17:56 |
| *** rfolco|rover is now known as rfolco|rover|brb | 17:56 | |
| arxcruz | weshay|rover: was that easy? (╯°□°）╯︵ ┻━┻ | 17:56 |
| weshay|rover | arxcruz, should be.. we'll see | 17:57 |
| jrist | third table flip I've seen today | 17:57 |
| *** dsariel has quit IRC | 17:58 | |
| *** dtantsur is now known as dtantsur|afk | 17:58 | |
| *** tesseract has quit IRC | 18:00 | |
| *** derekh has quit IRC | 18:00 | |
| *** sai_ has joined #tripleo | 18:04 | |
| * EmilienM back | 18:08 | |
| bnemec | It's good that everyone is doing their part to ensure we meet our table flip quota while Alex is out. ;-) | 18:09 |
| EmilienM | dmsimard: ok, so next time the job run I ping you and we hold the node, correct? | 18:09 |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 18:10 |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 18:10 |
| itlinux | hello all.. I wonder if anyone has seen this error when running the introspect https://pasteboard.co/H3wRqcs.png | 18:16 |
| itlinux | not sure this box will work.. | 18:16 |
| itlinux | thanks | 18:16 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: WIP ffu: Introduce ffu upgrade tasks https://review.openstack.org/528241 | 18:20 |
| dmsimard | EmilienM: you can ping me, amoralej, jpena and others (we'll formalize and write that list down somewhere soon) | 18:22 |
| *** pchavva has joined #tripleo | 18:23 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: Create default settings for environment types https://review.openstack.org/495407 | 18:25 |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart master: Fix ansible warning with jinja2 delimiters https://review.openstack.org/535439 | 18:26 |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart master: Fix ansible warning group and host with same name https://review.openstack.org/535440 | 18:26 |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart master: Stop using deprecated running state https://review.openstack.org/535441 | 18:26 |
| *** ebarrera has quit IRC | 18:29 | |
| *** ebarrera has joined #tripleo | 18:32 | |
| *** salmankhan has quit IRC | 18:35 | |
| EmilienM | dmsimard: I'm watching zuul queue | 18:36 |
| weshay|rover | I'm watching EmilienM | 18:42 |
| bfournie | itlinux: that failure you are seeing "Failed to load collector set(['numa-topology'])" occurs when you use an Pike undercloud with IPA images prior to Pike - the numa_topology collector is set in instack-undercloud but the IPA doesn't support it until Pike. You need to update your images. | 18:42 |
| itlinux | thanks where do I get the new image? | 18:44 |
| itlinux | and I am using pike | 18:44 |
| itlinux | thanks bfournie: | 18:44 |
| itlinux | will this be ok https://images.rdoproject.org/pike/delorean/old-tripleo/stable/ironic-python-agent.tar | 18:45 |
| *** jpena is now known as jpena|off | 18:46 | |
| bfournie | itlinux: that should be OK, normally I would just recommend updating your images via "openstack image create"… | 18:47 |
| itlinux | bfournie: can you share what will be your best opiton? | 18:47 |
| bfournie | itlinux: try the download, if still having problems rebuild | 18:48 |
| itlinux | thanks | 18:48 |
| itlinux | getting it down now. | 18:49 |
| itlinux | should I pull down the full as well I do not think that's a problem though.. | 18:49 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates stable/pike: DONOTMERGE https://review.openstack.org/535381 | 18:52 |
| *** itlinux has quit IRC | 18:53 | |
| weshay|rover | EmilienM, woot.. recreate is running tempest | 18:53 |
| weshay|rover | EmilienM, fs017 | 18:54 |
| EmilienM | weshay|rover: I think it's 016 no? | 18:55 |
| EmilienM | 017 is broken as well? | 18:55 |
| weshay|rover | 17 had both tests fail | 18:55 |
| weshay|rover | so I went w/ that | 18:55 |
| EmilienM | the same reason? ssh timeout in tempest? | 18:55 |
| weshay|rover | hrm.. wait | 18:56 |
| *** pkovar has quit IRC | 18:57 | |
| *** atoth has quit IRC | 18:58 | |
| *** mcornea has quit IRC | 18:59 | |
| *** hjensas|afk is now known as hjensas | 19:00 | |
| EmilienM | periodic jobs just started | 19:00 |
| EmilienM | dmsimard: fyi ^ I'm watching zuul now, I'll link the jenkins URL when the fs016 starts | 19:01 |
| dmsimard | EmilienM: ok, just coordinate with weshay|rover cause he's looking into it as well | 19:01 |
| EmilienM | ok | 19:01 |
| stevebaker | morning | 19:02 |
| *** itlinux has joined #tripleo | 19:03 | |
| *** atoth has joined #tripleo | 19:04 | |
| EmilienM | stevebaker: hola! | 19:04 |
| *** ebarrera has quit IRC | 19:04 | |
| dpeacock | Happy Friday stevebaker! | 19:05 |
| *** ebarrera has joined #tripleo | 19:05 | |
| stevebaker | dpeacock: thanks :) | 19:05 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: WIP ffu: Introduce ffu upgrade tasks https://review.openstack.org/528241 | 19:09 |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 19:10 |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 19:10 |
| EmilienM | weshay|rover: is it on pike as well? | 19:11 |
| EmilienM | weshay|rover: or just master? | 19:11 |
| EmilienM | arxcruz: ^ | 19:11 |
| *** yamahata has quit IRC | 19:11 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Split IPSEC deployment in two https://review.openstack.org/534729 | 19:11 |
| weshay|rover | EmilienM, fs016 fails in pike as well https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-pike/6fe8113/tempest.html.gz | 19:12 |
| *** amoralej is now known as amoralej|off | 19:12 | |
| EmilienM | weshay|rover: same reason? | 19:12 |
| EmilienM | weshay|rover: same tempest failure? | 19:12 |
| weshay|rover | same tempest failure | 19:13 |
| EmilienM | weshay|rover: ok | 19:13 |
| openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates master: Add a StorageNFS network for use by Manila/Ganesha https://review.openstack.org/512239 | 19:16 |
| openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates master: Add support for ceph-nfs manila backend https://review.openstack.org/471245 | 19:16 |
| openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates master: Pass storage nfs VIP to ceph-ansible https://review.openstack.org/512240 | 19:16 |
| weshay|rover | hrm.. fs017 passed .. no tempest errors | 19:16 |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: logging: use service_config_settings for fluentd https://review.openstack.org/501458 | 19:16 |
| *** atoth has quit IRC | 19:17 | |
| *** dprince has quit IRC | 19:18 | |
| *** jbadiapa has joined #tripleo | 19:18 | |
| *** itlinux has quit IRC | 19:19 | |
| weshay|rover | 2018-01-18 19:15:24 | Ran: 43 tests in 1165.0000 sec. | 19:22 |
| weshay|rover | 2018-01-18 19:15:24 | - Passed: 43 | 19:22 |
| weshay|rover | 2018-01-18 19:15:24 | - Skipped: 0 | 19:22 |
| weshay|rover | 2018-01-18 19:15:24 | - Expected Fail: 0 | 19:22 |
| weshay|rover | 2018-01-18 19:15:24 | - Unexpected Success: 0 | 19:22 |
| weshay|rover | 2018-01-18 19:15:24 | - Failed: 0 | 19:22 |
| weshay|rover | 2018-01-18 19:15:24 | Sum of execute time | 19:22 |
| *** itlinux has joined #tripleo | 19:24 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Separate common ovb settings https://review.openstack.org/535457 | 19:28 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Modify full-deploy-ovb to use common settings and nodes files https://review.openstack.org/535458 | 19:29 |
| *** tzumainn has quit IRC | 19:29 | |
| EmilienM | weshay|rover: on master? | 19:42 |
| weshay|rover | yup | 19:42 |
| EmilienM | weshay|rover: where? can I see it? | 19:43 |
| weshay|rover | EmilienM, ya | 19:43 |
| EmilienM | weshay|rover: with latest hash? | 19:43 |
| EmilienM | weshay|rover: I don't trust you :P | 19:43 |
| weshay|rover | :) | 19:43 |
| *** yamahata has joined #tripleo | 19:48 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Swap the order of stdout and stderr in debug output https://review.openstack.org/535326 | 19:50 |
| EmilienM | alee_: you asked for promotion | 19:51 |
| EmilienM | alee_: we're stuck on barbican tests | 19:51 |
| EmilienM | alee_: https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/3c1453c/undercloud/home/jenkins/tempest_output.log.txt.gz#_2018-01-18_03_47_10 | 19:51 |
| EmilienM | barbican_tempest_plugin.tests.scenario.test_volume_encryption.VolumeEncryptionTest.test_encrypted_cinder_volumes_cryptsetup is failing | 19:51 |
| EmilienM | can you help? | 19:51 |
| EmilienM | weshay|rover: do we have a bug for this one? it looks different from the ssh timeout | 19:52 |
| weshay|rover | ya.. it's different.. I don't think so my team is out | 19:52 |
| alee_ | EmilienM, looking | 19:53 |
| EmilienM | weshay|rover: we need one | 19:54 |
| *** dprince has joined #tripleo | 19:54 | |
| weshay|rover | ok | 19:54 |
| *** gvrangan has quit IRC | 19:54 | |
| weshay|rover | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/3c1453c/undercloud/home/jenkins/tempest/tempest.html.gz | 19:54 |
| weshay|rover | alee_, easier to read | 19:55 |
| *** jmelvin has quit IRC | 19:55 | |
| EmilienM | weshay|rover: -1 for skipping the test | 19:55 |
| EmilienM | we haven't looked at the failure yet | 19:55 |
| EmilienM | barbican_tempest_plugin.tests.scenario.test_volume_encryption.VolumeEncryptionTest.test_encrypted_cinder_volumes_cryptsetup is pretty important to test | 19:55 |
| *** rfolco|rover|brb is now known as rfolco|rover | 19:55 | |
| weshay|rover | EmilienM, ok.. just noting the results were not consistent.. mimi | 19:55 |
| EmilienM | weshay|rover: can you file a bug? i'm looking at the failure now | 19:55 |
| * weshay|rover runs | 19:55 | |
| weshay|rover | yes.. I am now | 19:55 |
| EmilienM | alee_: where is barbican logdir? https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/3c1453c/subnode-2/var/log/containers/ | 19:56 |
| EmilienM | I can find them here https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/3c1453c/subnode-2/var/log/extra/docker/containers/ | 19:56 |
| EmilienM | but barbican should have logs in /var/log/containers | 19:56 |
| EmilienM | alee_: please file a bug for this one ^ | 19:57 |
| ihrachys | I hit an issue with quickstart deployment that seems beyond my current knowledge. I would like to ask some questions about quickstart and how it configures baremetal nodes in rdo cloud. who's the best candidate for that? | 19:57 |
| EmilienM | ihrachys: we're debugging critical promotions issues now | 19:57 |
| EmilienM | if you want to join the party | 19:58 |
| ihrachys | heh | 19:58 |
| EmilienM | we had no promotion in the last 15 days | 19:58 |
| ihrachys | list in pipeline board? | 19:58 |
| *** itlinux has quit IRC | 19:58 | |
| weshay|rover | EmilienM, alee_ https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/3c1453c/subnode-2/var/log/extra/errors.txt.gz#_2018-01-18_03_46_40_141 | 19:59 |
| weshay|rover | maybe this is just a timing issue | 19:59 |
| EmilienM | openstack-cinder-backup error shouldn't be related to the temepst test | 19:59 |
| EmilienM | tempest is trying to create an encrypted volume and boot from it | 19:59 |
| EmilienM | but the error in cinder-volume is valid | 20:00 |
| EmilienM | that's the one we need to take a look at | 20:00 |
| EmilienM | abishop: ^ you around maybe? | 20:00 |
| alee_ | EmilienM, the fact that there are no logs is a bug we ran into before .. | 20:00 |
| weshay|rover | it's erroring out on the delte | 20:00 |
| EmilienM | alee_: is it reported? | 20:00 |
| weshay|rover | I think there is a bug on that, alee_ and I chatted about it previously | 20:01 |
| abishop | EmilienM: yes, context switching to check this | 20:01 |
| alee_ | EmilienM, yup -trying to find the bug number .. | 20:01 |
| EmilienM | abishop: sorry for that - tl;dr we're debugging why promotion jobs fail on master (and pike as well) | 20:02 |
| *** itlinux has joined #tripleo | 20:02 | |
| EmilienM | weshay|rover: it's weird because I don't see the trace in https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/3c1453c/subnode-2/var/log/extra/docker/containers/openstack-cinder-volume-docker-0/log/cinder/cinder-volume.log.txt.gz | 20:03 |
| EmilienM | oh but here: https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/3c1453c/subnode-2/var/log/extra/docker/containers/openstack-cinder-volume-docker-0/log/cinder/cinder-api.log.txt.gz#_2018-01-18_03_46_40_141 | 20:03 |
| *** itlinux has quit IRC | 20:04 | |
| *** salmankhan has joined #tripleo | 20:08 | |
| alee_ | EmilienM, whats going on here? https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/3c1453c/undercloud/home/jenkins/tempest_output.log.txt.gz#_2018-01-18_03_50_00 | 20:09 |
| EmilienM | alee_: I don't know, which is why I asked abishop to look if he can | 20:10 |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 20:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 20:10 |
| EmilienM | it looks like a timeout to remove a volume that is still in use | 20:10 |
| EmilienM | maybe it fails when detaching the volume? I don't know | 20:10 |
| weshay|rover | that could be a tempest bug? | 20:11 |
| weshay|rover | don't know | 20:11 |
| abishop | EmilienM: it smells like that, the cinder-api is complaining that it's asked to delete a volume-type when a volume of that type still exists | 20:11 |
| weshay|rover | yup | 20:11 |
| alee_ | abishop, there seem to be multiple timeouts here for ssl connections failing | 20:12 |
| EmilienM | there is no ssl | 20:12 |
| EmilienM | in this job | 20:12 |
| *** salmankhan has quit IRC | 20:12 | |
| alee_ | EmilienM, well it does seem like this results in huge time delays as a result .. https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/3c1453c/undercloud/home/jenkins/tempest_output.log.txt.gz#_2018-01-18_03_50_00 as an example | 20:14 |
| alee_ | EmilienM, just for that case looks like a 5 minute till timeout because of multiple retires | 20:15 |
| alee_ | EmilienM, and this happens a bunch of times --- it wouldn't surprise me if something timed out as a result | 20:15 |
| *** fultonj has quit IRC | 20:16 | |
| *** colonwq has quit IRC | 20:18 | |
| ihrachys | EmilienM, where are default tripleo gate settings configured? specifically, where do we enable debug for services? | 20:18 |
| *** colonwq has joined #tripleo | 20:18 | |
| openstackgerrit | Merged openstack/tripleo-validations master: Invert validation task order https://review.openstack.org/535338 | 20:19 |
| openstackgerrit | Dan Prince proposed openstack/python-tripleoclient master: undercloud_deploy: add opts to setup virtual-ips https://review.openstack.org/526879 | 20:19 |
| openstackgerrit | Dan Prince proposed openstack/python-tripleoclient master: undercloud_config: setup VIPs, haproxy, etc https://review.openstack.org/526881 | 20:19 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: config-download: handle special case for 3nodes job https://review.openstack.org/535472 | 20:21 |
| EmilienM | ihrachys: service debug should be enabled already | 20:21 |
| alee_ | EmilienM, https://bugs.launchpad.net/tripleo/+bug/1739492 | 20:21 |
| openstack | Launchpad bug 1739492 in tripleo "nova-compute.log, and other container logs are missing in some containerized deployments" [High,Triaged] | 20:21 |
| EmilienM | alee_: thx | 20:21 |
| ihrachys | haleyb, ^ you said metadata agent didn't have debug on right? | 20:21 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs032: activate config-download https://review.openstack.org/528761 | 20:22 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs032: activate config-download https://review.openstack.org/528761 | 20:22 |
| haleyb | ihrachys: yeah, i don't remember seeing it, was set in the other agents, let me look again | 20:22 |
| ihrachys | haleyb, it's enabled: https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/b09f8f0/subnode-2/var/log/config-data/neutron/etc/neutron/metadata_agent.ini.txt.gz | 20:23 |
| EmilienM | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/b09f8f0/subnode-2/var/log/extra/docker/containers/neutron_metadata_agent/stdout.log.txt.gz | 20:24 |
| EmilienM | but we don't have metadatalogs proxy per namespace | 20:24 |
| haleyb | ihrachys: i must have missed it | 20:25 |
| *** fultonj has joined #tripleo | 20:25 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: WIP ffu: Introduce ffu upgrade tasks https://review.openstack.org/528241 | 20:26 |
| *** jmelvin has joined #tripleo | 20:26 | |
| alee_ | EmilienM, abishop so the volume test seems to have cases where we test the connection to the booted vm -- using ssh - and these time out. (after about 5 minutes if you add up all the retries). We then do things like delete the volume right afterwards. | 20:26 |
| abishop | EmilienM, weshay|rover, alee_ : https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/3c1453c/subnode-2/var/log/containers/cinder/cinder-api.log.txt.gz#_2018-01-18_03_38_19_504 | 20:26 |
| *** rfolco|rover is now known as rfolco|rover|off | 20:27 | |
| abishop | alee_: request to delete the volume rejected, probably because it's in use | 20:27 |
| *** fragatina has quit IRC | 20:30 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: WIP Define workflow interface for image prepare/upload https://review.openstack.org/534980 | 20:31 |
| EmilienM | abishop: would a recent change in cinder could cause it? (one million dollar question) | 20:35 |
| *** ebarrera has quit IRC | 20:35 | |
| abishop | EmilienM: nope, this is standard cinder behavior | 20:35 |
| abishop | EmilienM, alee_; cinder does have a CLI command to reset the attach-status | 20:36 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add tls roles for undercloud https://review.openstack.org/517079 | 20:36 |
| abishop | EmilienM: the train left the tracks because of network issues timing things out | 20:37 |
| ihrachys | haleyb, btw I can't find any proxy logs in syslog in devstack env either | 20:37 |
| ihrachys | haleyb, but metadata agent logs each request when in debug | 20:37 |
| ihrachys | since the metadata agent log is basically empty, not a single request hit it | 20:38 |
| alee_ | EmilienM, abishop sorry if I'm a little confused here - but why are the ssl timeouts not significant here? they seem to happen right before we try to do cleanups and delete volumes | 20:38 |
| EmilienM | AFIK there is no ssl enabled | 20:38 |
| haleyb | ihrachys: this gets back at using haproxy and where it's logging | 20:38 |
| alee_ | EmilienM, to the instances created? if so, does tempest know this so that it does not try to test the connection? | 20:39 |
| abishop | alee_: agree that's causing the subsequent failures | 20:39 |
| *** aputtur_ has quit IRC | 20:39 | |
| *** fzdarsky is now known as fzdarsky|afk | 20:40 | |
| alee_ | abishop, EmilienM here is an example -- https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/3c1453c/undercloud/home/jenkins/tempest_output.log.txt.gz#_2018-01-18_03_50_00 | 20:41 |
| alee_ | right after this we attempt to do cleanups -- probably because the test looks like it failed - and we get the error that abishop points to - about not being able to delete a volume coz its in use | 20:42 |
| abishop | alee_: yup | 20:43 |
| *** itlinux has joined #tripleo | 20:43 | |
| *** dsariel has joined #tripleo | 20:45 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Undercloud: support for external VIP for SSL https://review.openstack.org/535479 | 20:46 |
| alee_ | abishop, EmilienM there are any number of places in the tempest tests where we call validate_authentication() which is what times out | 20:48 |
| itlinux | bfournie: looks like the image I got works and passed.. | 20:50 |
| itlinux | now will do the overcloud deployment | 20:50 |
| bfournie | itlinux: great | 20:50 |
| itlinux | thanks.. I was not sure about that.. so now I still have the OC as latest hopefully that does not have issues.. | 20:51 |
| haleyb | weshay|rover: were you able to get the reproducer script to run cleanly? i can run openstack client against rdo cloud but can't run the script | 20:51 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Undercloud: fix stackrc TLS URL detection https://review.openstack.org/535480 | 20:51 |
| weshay|rover | haleyb, I'm actually talking to rhos-ops now.. I had success w/ one deployment, and the other is unable to ping the fip's | 20:51 |
| weshay|rover | our jobs that run in rdo cloud, look terrible atm http://38.145.34.234/ "RDO cloud OVB" | 20:52 |
| haleyb | weshay|rover: ok. for me it fails finding an image to use, strange | 20:53 |
| weshay|rover | haleyb, I think you need to import the public centos imag | 20:53 |
| weshay|rover | e | 20:53 |
| weshay|rover | to your tenant | 20:53 |
| haleyb | openstack image list --long -f value -c ID --property latest=centos-7-latest | 20:53 |
| haleyb | ^^ that returns a uuid | 20:54 |
| weshay|rover | ffff3320-1bf8-4a9a-a26d-5abd639a6e33 | 20:54 |
| weshay|rover | ? | 20:54 |
| haleyb | yup | 20:54 |
| alee_ | EmilienM, abishop https://github.com/openstack/barbican-tempest-plugin/blob/da8979b10fa6733bac8fb43dce35a14f8af49301/barbican_tempest_plugin/tests/scenario/test_volume_encryption.py#L63 | 20:55 |
| ihrachys | haleyb, yeah but for what I understand, containers are not involved, so it's a generic logging issue I guess | 20:55 |
| ihrachys | haleyb, what's that 'local0' in 'log /dev/log local0 debug' | 20:55 |
| ihrachys | oh I guess it's just log level | 20:55 |
| alee_ | EmilienM, abishop this line calls get_remote_client() which calls validate_authentication() | 20:55 |
| alee_ | EmilienM, abishop which times out and throws an exception | 20:56 |
| alee_ | meaning that we never get to the end of the method and call detach() to detach the volume | 20:56 |
| ihrachys | haleyb, so local0 is a 'syslog facilities' | 20:56 |
| abishop | alee_, EmilienM: bingo | 20:57 |
| *** raildo has quit IRC | 20:59 | |
| ihrachys | haleyb, | 21:00 |
| ihrachys | [ihrachys@laptop tripleo-quickstart-extras]$ ls -l /dev/log | 21:00 |
| ihrachys | lrwxrwxrwx. 1 root root 28 Nov 26 17:55 /dev/log -> /run/systemd/journal/dev-log | 21:00 |
| ihrachys | so we share /dev/log with containers. do we share /run/... | 21:00 |
| ihrachys | ? | 21:00 |
| EmilienM | we won loto? | 21:03 |
| EmilienM | I need to drop off a little to eat something, I'm back shortly | 21:03 |
| alee_ | abishop, EmilienM I'm not sure what the "right" fix here is -- should we really be testing when ssh is disabled? | 21:04 |
| *** rhallisey has quit IRC | 21:04 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DO NOT MERGE: Add test commit to check gate triggers https://review.openstack.org/403818 | 21:05 |
| EmilienM | weshay|rover, dmsimard: fs016 won't run on master, periodic-tripleo-centos-7-master-containers-build failed | 21:05 |
| haleyb | ihrachys: i would think so | 21:05 |
| EmilienM | weshay|rover, dmsimard : I need to drop off for lunch a little, I'm back in 30 minutes | 21:05 |
| abishop | alee_: I've never worked w/ tempest code, but if this create_timestamp() relies on ssh, and it's not available then, ...? | 21:05 |
| weshay|rover | EmilienM, k.. I have a dentist app in a bit too, resync later tonight | 21:06 |
| ihrachys | haleyb, nothing here http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/docker/docker-puppet.py or here http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/docker/services/containers-common.yaml | 21:06 |
| openstackgerrit | Pradeep Kilambi proposed openstack/puppet-tripleo master: Add incoming storage driver param https://review.openstack.org/524240 | 21:06 |
| alee_ | abishop, well - it relies on connecting to the server - and running something there | 21:06 |
| ihrachys | haleyb, that being said, I see some haproxy messages from the load balancer haproxy instances that are I believe started with http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/docker/services/haproxy.yaml | 21:07 |
| ihrachys | so it probably works somehow for those services at least | 21:07 |
| alee_ | abishop, if ssh is not available, how do you get to an instance? | 21:07 |
| alee_ | abishop, ssh seems like a reasonable assumption, no? | 21:08 |
| abishop | alee_: that's what I'm stuck on; if test relies on getting to instance then that has to be global consideration running the test | 21:08 |
| ihrachys | why can't it ssh exactly? | 21:09 |
| *** liverpooler has quit IRC | 21:09 | |
| haleyb | ihrachys: i'll have to get back to this later, need to pick up daughter | 21:09 |
| alee_ | ihrachys, some global/ nova config to create instances without ssh? | 21:10 |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 21:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 21:10 |
| ihrachys | alee_, what does it mean without ssh? no daemon running? or no sec group rules? the latter is handled by test itself; the former is always running in cirros. | 21:11 |
| *** itlinux has quit IRC | 21:13 | |
| alee_ | ihrachys, I dont know -- all I know is that we are getting timeouts like this -- https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/3c1453c/undercloud/home/jenkins/tempest_output.log.txt.gz#_2018-01-18_03_50_00 | 21:13 |
| alee_ | weshay|rover, any idea why the timeouts are happening? some nova/global config? | 21:14 |
| ihrachys | revealing console output could help | 21:14 |
| ihrachys | this error is worth a fix: _log_console_output | 21:14 |
| ihrachys | sorry, I mean: AttributeError: 'VolumeEncryptionTest' object has no attribute '_log_console_output' | 21:15 |
| ihrachys | I will have a look at it | 21:15 |
| alee_ | cool | 21:15 |
| alee_ | abishop, so the test basically involves attaching the volume to an instance and booting it, then accessing the volume and writing a file with a timestamp to the volume (ie. writing to the volume) and then reading from the volume. | 21:18 |
| alee_ | (and detaching it) | 21:19 |
| alee_ | we try to reach the volume through an ssh client - and this is failing | 21:19 |
| abishop | alee_: makes perfect sense, and clearly the test relies on ssh | 21:20 |
| abishop | alee_: so the focus needs to be on why ssh is failing (networking) and not why this encrypted volume test is failing | 21:20 |
| alee_ | right | 21:20 |
| alee_ | abishop, EmilienM seemed to indicate that this was due to something being disabled. It would be good to know if this is indeed true - and if this is a valid setup | 21:22 |
| weshay|rover | alee_, thanks man | 21:22 |
| abishop | alee_: yes; if the setup disables ssh then tests that rely on it must also be disabled | 21:23 |
| alee_ | yup - or we need to modify the test to work in some other way for those scenarios | 21:23 |
| ihrachys | abishop, how does it 'disable' it exactly? the test correctly creates a security group with rules enabling ssh | 21:23 |
| ihrachys | it should work assuming firewall rules are applied | 21:24 |
| openstackgerrit | Merged openstack/tripleo-ui master: Update dependencies https://review.openstack.org/534759 | 21:24 |
| abishop | ihrachys: I don't know, just reacting to what I thought I heard others say (something about ssh disabled) | 21:24 |
| *** weshay|rover is now known as weshay|rover|den | 21:24 | |
| *** weshay|rover|den is now known as weshay|dentist | 21:24 | |
| ihrachys | I don't think it's possible or realistic that it's actually somehow disabled on infra side | 21:25 |
| abishop | ihrachys: I may have misheard, but either way, the encrypted volume test is failing due to inability to ssh to instance | 21:25 |
| ihrachys | yes | 21:25 |
| ihrachys | and getting console output for failed instance would help because it could show its networking / sshd daemon started | 21:26 |
| ihrachys | btw I see some GET messages in metadata agent so it works at least for some instances | 21:26 |
| ihrachys | it can also be cirros failed to boot | 21:27 |
| openstackgerrit | Steve Baker proposed openstack/python-tripleoclient master: Move more prepare logic into kolla_builder https://review.openstack.org/526576 | 21:27 |
| openstackgerrit | Steve Baker proposed openstack/python-tripleoclient master: Add --tag-from-label to prepare command https://review.openstack.org/529445 | 21:27 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Run "overcloud container image prepare" only once https://review.openstack.org/528621 | 21:28 |
| *** aputtur_ has joined #tripleo | 21:30 | |
| ihrachys | abishop, the timeout, which line of the test case does it happen. is it during self.create_server or later? | 21:31 |
| abishop | ihrachys: according to what I learned from alee_ it's https://github.com/openstack/barbican-tempest-plugin/blob/da8979b10fa6733bac8fb43dce35a14f8af49301/barbican_tempest_plugin/tests/scenario/test_volume_encryption.py#L63 | 21:32 |
| abishop | ihrachys: the create_timestamp function ssh's to the instance, and that's timing out and throwing an exception | 21:33 |
| *** openstackgerrit has quit IRC | 21:33 | |
| abishop | which prevents code at L76 from running, which subsequently makes things look like a cinder issue | 21:33 |
| abishop | nova doesn't detach the volume, so cinder then complains about deleting it | 21:34 |
| ihrachys | abishop, ok so it happens after we attach the disk | 21:34 |
| ihrachys | if e.g. the instance kernel would crash because of attachment, it could also be a reason | 21:34 |
| abishop | ihrachys: that's my understanding, yes | 21:34 |
| ihrachys | so there are multiple possible reasons | 21:34 |
| ihrachys | and console log should reveal it | 21:34 |
| ihrachys | abishop, see https://review.openstack.org/535488 | 21:34 |
| ihrachys | I just posted | 21:34 |
| abishop | ihrachys: yes, good point! might be the instance itself that's struggling | 21:35 |
| ihrachys | full disclosure: I haven't tried it for real | 21:35 |
| *** sshnaidm is now known as sshnaidm|off | 21:36 | |
| ihrachys | abishop, another thing we could do is validate that ssh works before messing with the disk | 21:36 |
| ihrachys | so that we are sure that it's not involved (or, that attachment is what breaks it) | 21:37 |
| abishop | ihrachys: yes, layers need to be peeled back until we know root failure, not symptom of a subsequent failure | 21:38 |
| *** openstackgerrit has joined #tripleo | 21:40 | |
| openstackgerrit | Ben Nemec proposed openstack/puppet-tripleo master: Add support for Designate https://review.openstack.org/518983 | 21:40 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates master: Designate Integration https://review.openstack.org/518998 | 21:40 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates master: Containerized Designate https://review.openstack.org/535489 | 21:40 |
| alee_ | ihrachys, abishop if you look at https://github.com/openstack/barbican-tempest-plugin/blob/da8979b10fa6733bac8fb43dce35a14f8af49301/barbican_tempest_plugin/tests/scenario/test_volume_encryption.py#L115 for instance and all the other tests there, the attach/detach call comes after we create the server | 21:42 |
| ihrachys | abishop, afaiu this should validate the instance before messing with disks: https://review.openstack.org/535491 | 21:42 |
| ihrachys | alee_, yeah but question is, whether instance booted correctly | 21:42 |
| alee_ | ihrachys, abishop in particular, the create_server call has a parameter wait_until="ACTIVE" | 21:43 |
| ihrachys | alee_, if it booted and accessible via ssh before we attached but fails after, then it's attachment that broke it | 21:43 |
| ihrachys | alee_, ACTIVE is just that it fired up on compute | 21:43 |
| ihrachys | it doesn't mean it meaningfully booted the system | 21:43 |
| ihrachys | so e.g. if it crashed with kernel stack trace / failed to find disk, it's still ACTIVE | 21:43 |
| alee_ | ihrachys, gotcha -- seems like you could have timing issues .. | 21:43 |
| ihrachys | alee_, abishop how can we plug in those two barbican test patches into tripleo gate to see what they reveal? | 21:44 |
| *** agopi has quit IRC | 21:45 | |
| *** aputtur_ has quit IRC | 21:45 | |
| *** agopi has joined #tripleo | 21:45 | |
| abishop | ihrachys: I'm not a tempest guy, but your patches look like good stuff! Probably need EmilienM to come back from lunch to comment on how to get this tested | 21:46 |
| ihrachys | alee_, abishop I am bailing out on this issue for today but if you can plug those into gate somehow that would be helpful. | 21:46 |
| ihrachys | ok | 21:46 |
| abishop | ihrachys: thx again! | 21:46 |
| ihrachys | np, I hope it will help | 21:46 |
| alee_ | ihrachys, validtable=true waits till we've booted? | 21:47 |
| ihrachys | afaiu it should attempt to ssh / ping | 21:47 |
| ihrachys | I haven't got enough time to check so figured I will throw it into the gate and see if it does what I need | 21:47 |
| alee_ | sounds useful for sure | 21:48 |
| ihrachys | if it doesn't work, we can always just call check_connectivity or smth | 21:48 |
| alee_ | yup | 21:48 |
| *** rlandy is now known as rlandy|brb | 21:48 | |
| alee_ | ihrachys, cool - thanks! | 21:49 |
| sshnaidm|off | weshay|dentist, trown|outtypewww please open a bug about logs collection failure in ovb jobs (rh1), seems like ovb nodes are unreachable in the middle of collect-logs running: http://logs.openstack.org/46/535346/1/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq-ipv6/1405327/logs/quickstart_collect_logs.txt.gz | 21:51 |
| *** rbowen has quit IRC | 21:53 | |
| *** ihrachys has quit IRC | 21:54 | |
| *** hamzy_ has quit IRC | 21:54 | |
| *** threestrands has joined #tripleo | 21:56 | |
| *** threestrands has quit IRC | 21:56 | |
| *** threestrands has joined #tripleo | 21:56 | |
| EmilienM | ok back | 21:56 |
| EmilienM | ok so thanks to ihrachys we would have console on scenario002 but we still have the ? on scenario0à1 | 22:01 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Add S3 storage driver as an option and its config https://review.openstack.org/521093 | 22:01 |
| EmilienM | 001 | 22:01 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Use os_keypair for key upload https://review.openstack.org/445224 | 22:02 |
| EmilienM | dmsimard: have you seen that failure ? https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-centos-7-master-containers-build/05b3539/console.txt.gz#_2018-01-18_21_03_17_489 | 22:03 |
| *** paramite has quit IRC | 22:03 | |
| dmsimard | EmilienM: https://trello.com/c/ztxTskDF/428-cixnobugtripleoci-java-exception-in-rdo-cloud-ovb-jobs-failing-rdo-cloud-ovb-jobs | 22:03 |
| EmilienM | ok | 22:04 |
| EmilienM | damn | 22:04 |
| *** itlinux has joined #tripleo | 22:05 | |
| *** rcernin has joined #tripleo | 22:06 | |
| *** etingof has quit IRC | 22:08 | |
| *** ihrachys has joined #tripleo | 22:09 | |
| *** rlandy|brb is now known as rlandy | 22:09 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 22:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 22:10 |
| *** aputtur_ has joined #tripleo | 22:11 | |
| fultonj | EmilienM: was there a theory that the SSH timout is caused by Ceph monitors not coming up? As per apetrich's http://paste.openstack.org/show/646902? | 22:13 |
| fultonj | If so, we could add https://bugzilla.redhat.com/show_bug.cgi?id=1507888#c5 to that job | 22:13 |
| openstack | bugzilla.redhat.com bug 1507888 in instack-undercloud "Deployment with ceph and TLS everywhere fails with: "WorkflowTasks_Step2_Execution: ERROR "cannot stat '/var/run/ceph/ceph-mon.overcloud-controller-2.asok': No such file or directory""" [High,Modified] - Assigned to gfidente | 22:13 |
| EmilienM | fultonj: it's highly possible because so far the issue is on scenario001 | 22:13 |
| *** sai_ has quit IRC | 22:13 | |
| *** Goneri has quit IRC | 22:14 | |
| fultonj | EmilienM: ok, i'll try put a WIP up and we can see if it helps | 22:14 |
| fultonj | apetrich: ^ | 22:14 |
| EmilienM | fultonj: thanks for your help | 22:14 |
| fultonj | np | 22:14 |
| fultonj | apetrich: did you see that ceph error in a specific log? | 22:15 |
| EmilienM | fultonj: however the issue hasn't been seen with TLS enabled | 22:15 |
| EmilienM | but on the promotion jobs which are really scenario001-container | 22:15 |
| EmilienM | (but with latest containers, not the one that we promoted) | 22:15 |
| *** fragatina has joined #tripleo | 22:17 | |
| fultonj | So will updating this help? https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/scenario001-multinode-containers.yaml | 22:17 |
| EmilienM | fultonj: updating what exactly? | 22:18 |
| apetrich | arxcruz, ^^ | 22:18 |
| EmilienM | fultonj: see the failure: https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/b09f8f0/tempest.html.gz | 22:18 |
| EmilienM | let's see how ceph is in that one | 22:18 |
| EmilienM | fultonj: why don't we have ceph logs here? https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/b09f8f0/subnode-2/var/log/containers/ | 22:19 |
| EmilienM | and we have to go in https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/b09f8f0/subnode-2/var/log/extra/docker/containers/ | 22:19 |
| apetrich | fultonj, I saw that on an ansible task called in mistral | 22:19 |
| EmilienM | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/b09f8f0/subnode-2/var/log/extra/docker/containers/ceph-mgr-upstream-centos-7-2-node-rdo-cloud-tripleo-35849-7735/stdout.log.txt.gz | 22:19 |
| EmilienM | ceph mon: https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/b09f8f0/subnode-2/var/log/extra/docker/containers/ceph-mon-upstream-centos-7-2-node-rdo-cloud-tripleo-35849-7735/stdout.log.txt.gz | 22:19 |
| EmilienM | and ceph-osd: https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/b09f8f0/subnode-2/var/log/extra/docker/containers/ceph-osd-upstream-centos-7-2-node-rdo-cloud-tripleo-35849-7735-loop3/stdout.log.txt.gz | 22:20 |
| apetrich | fultonj, I saw http://paste.openstack.org/show/646957/ | 22:20 |
| apetrich | fultonj, then when I drilled down to see the output of that task I saw the log on the other paste | 22:20 |
| EmilienM | fultonj: I don't see errors in my logs | 22:20 |
| fultonj | EmilienM: you asked about the log location, https://bugs.launchpad.net/tripleo/+bug/1721841 | 22:21 |
| openstack | Launchpad bug 1721841 in tripleo "ceph docker containers do not log to /var/log/containers" [High,Triaged] - Assigned to John Fulton (jfulton-org) | 22:21 |
| apetrich | EmilienM, I don't see mistral logs on that run b09f8f0 | 22:22 |
| apetrich | EmilienM, scratch that. I was looking at the subnode0 | 22:23 |
| *** liverpooler has joined #tripleo | 22:23 | |
| EmilienM | ok | 22:24 |
| fultonj | EmilienM: you said "update what exactly" if the failing job was scenario001-multinode-containers, i would update environments/scenario001-multinode-containers.yaml | 22:25 |
| fultonj | however, the failing job is elsewhere, so i need to update the env file for that job somewhere else | 22:25 |
| apetrich | EmilienM, looking at the mistral logs on that run the ceph docker playbook ran fine https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/b09f8f0/undercloud/var/log/mistral/executor.log.txt.gz#_2018-01-11_12_13_01_153 | 22:25 |
| fultonj | EmilienM: can you help me locate the approriate file? | 22:25 |
| EmilienM | sure | 22:25 |
| EmilienM | give me a sec | 22:25 |
| apetrich | fultonj, thanks for the help | 22:26 |
| EmilienM | fultonj: that? https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/b09f8f0/undercloud/var/log/mistral/ceph-install-workflow.log.txt.gz | 22:26 |
| *** matbu has quit IRC | 22:26 | |
| *** abishop has quit IRC | 22:27 | |
| *** itlinux has quit IRC | 22:27 | |
| *** pchavva has quit IRC | 22:27 | |
| *** itlinux has joined #tripleo | 22:29 | |
| *** lblanchard has quit IRC | 22:36 | |
| itlinux | hello guys.. I have a strange thing.. the oc says completed but there is not horizon.. any tips on what could the problem be? | 22:37 |
| EmilienM | fultonj: I need to go now, I'm back later. | 22:39 |
| fultonj | EmilienM: ok, i'm not sure where to send this wip, still looking around | 22:40 |
| fultonj | EmilienM: ttyl | 22:40 |
| fultonj | apetrich: do you have a sec? | 22:41 |
| apetrich | fultonj, sure | 22:42 |
| fultonj | for https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/b09f8f0/tempest.html.gz | 22:42 |
| fultonj | ^ that's the output of a job , where is the source code for that job? | 22:43 |
| fultonj | e.g. i edit ci jobs for tripleo by editing ci/environments in tripleo-heat-templates | 22:44 |
| apetrich | fultonj, http://codesearch.openstack.org/?q=TestVolumeBootPattern&i=nope&files=&repos= | 22:44 |
| fultonj | quickstart | 22:44 |
| apetrich | fultonj, I think the code for the test is here then http://git.openstack.org/cgit/openstack/tempest/tree/tempest/scenario/test_volume_boot_pattern.py#n35 | 22:45 |
| apetrich | oh you mean who called it? | 22:46 |
| fultonj | i'm basically looking for the env file that gets passed in | 22:46 |
| fultonj | openstack overcloud deploy ... -e foo.yaml | 22:46 |
| fultonj | presumablely the job runs ^ and foo.yaml is managed in a repo like quickstarts, or tht's or...? | 22:47 |
| *** dprince has quit IRC | 22:47 | |
| fultonj | i want to see if i can submit a change to foo.yaml under $project to see if it helps the situation | 22:47 |
| fultonj | so not tempest, but the env file that's used to stand up the overcloud | 22:48 |
| fultonj | before tempest runs | 22:49 |
| *** dtrainor has quit IRC | 22:49 | |
| fultonj | odd that we'd have container logs for the ceph-mon container is the ceph-mon never got running cause it never got its socket | 22:49 |
| fultonj | i mean: ... container IF the ceph-mon ... | 22:50 |
| apetrich | fultonj, so quickstart will have a deploy-overcloud.sh with that files that deploy-overcloud.sh is generated from tripleo-quickstart-extras roles/overcloud-deploy/defaults/main.yml | 22:50 |
| apetrich | so that is failing on a ansible action called from inside mistral | 22:51 |
| *** vpickard is now known as vpickard_ | 22:52 | |
| fultonj | apetrich: ok, we're getting warmer :) | 22:52 |
| apetrich | fultonj, if you look here http://codesearch.openstack.org/?q=site-docker.yml.sample&i=nope&files=&repos= there are two likely calls either tripleo-common or python-tripleoclient that could be calling that mistral action | 22:54 |
| fultonj | apetrich: i know which mistral workbook calls the playbook | 22:54 |
| fultonj | apetrich: i could show you if you like | 22:54 |
| fultonj | it's in tripleo-common | 22:54 |
| fultonj | but the workbook shouldnt' be changed nor ceph-ansible | 22:54 |
| fultonj | we just need to pass a tht param for this job so it doesn't have this issue | 22:55 |
| apetrich | oh good | 22:55 |
| *** dtrainor has joined #tripleo | 22:55 | |
| apetrich | oh better yet | 22:55 |
| apetrich | I saw the params passed. let me find it | 22:55 |
| hjensas | I have a few patches that depend on a yet to merge heat change, bulding openstack-heat rpm is failing. http://logs.openstack.org/17/473817/48/check/tripleo-ci-centos-7-undercloud-oooq/ac50af2/job-output.txt.gz#_2018-01-18_15_41_19_657428 | 22:56 |
| *** etingof has joined #tripleo | 22:56 | |
| fultonj | apetrich: fwiw https://github.com/openstack/tripleo-common/blob/master/workbooks/ceph-ansible.yaml#L123 | 22:56 |
| apetrich | aye | 22:56 |
| *** dsariel has quit IRC | 22:57 | |
| apetrich | fultonj, so here is the tht that calls that mistral action http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/docker/services/ceph-ansible/ceph-base.yaml#n51 | 22:58 |
| fultonj | apetrich: is the tht that's passed to this job genereated from these jinja templates? https://github.com/openstack/tripleo-quickstart-extras/tree/master/roles/overcloud-deploy/templates | 22:58 |
| fultonj | apetrich: but we don't want to change THT itself | 22:59 |
| fultonj | we want to override a parameter for a particular run of the job | 22:59 |
| fultonj | the parameter is called CephAnsibleExtraConfig | 22:59 |
| fultonj | e.g. line 207 of that file | 22:59 |
| fultonj | apetrich: let me give you an example... | 22:59 |
| *** jmelvin has quit IRC | 23:00 | |
| fultonj | apetrich: https://review.openstack.org/#/c/531495/ | 23:00 |
| fultonj | ^ i edited scenario001 and 004 multinode containers to have a value appropirate for those specific jobs | 23:01 |
| apetrich | fultonj, sorry it is late for me | 23:01 |
| fultonj | i want to edit a tht file like that which would help the ceph job you have failing | 23:01 |
| fultonj | apetrich: not at all | 23:01 |
| fultonj | apetrich: i'm too ignorant of our promotion system | 23:01 |
| apetrich | still waiting for the reviews to show your patch | 23:02 |
| fultonj | apetrich: i have no patch :( | 23:02 |
| fultonj | i want to send in a patch but i don't know which project to send it in on | 23:02 |
| apetrich | the patch that you showed the 531495 ^^ | 23:02 |
| fultonj | i know which project to send a patch in for triplo ci's scenario001-multinode-containers.yaml but i don't know which project to send a patch in for the promotion job | 23:03 |
| fultonj | i was just making an analogy | 23:03 |
| apetrich | fultonj, the problem is that I've been called to look at an issue on a machine but I don't know which job created it. | 23:04 |
| fultonj | me too :) i only have the outputs of a log | 23:04 |
| * fultonj reads backlog a little | 23:05 | |
| fultonj | apetrich: you pointed out http://paste.openstack.org/show/646902 earlier today | 23:05 |
| apetrich | fultonj, yeah that is what I found was the issue on a live machine that failed. I don't know what create it | 23:06 |
| apetrich | fultonj, arxcruz knows I think because he asked me to find what was the issue | 23:06 |
| fultonj | that issue can be helped by passing a param like https://bugzilla.redhat.com/show_bug.cgi?id=1507888#c5 | 23:06 |
| openstack | bugzilla.redhat.com bug 1507888 in instack-undercloud "Deployment with ceph and TLS everywhere fails with: "WorkflowTasks_Step2_Execution: ERROR "cannot stat '/var/run/ceph/ceph-mon.overcloud-controller-2.asok': No such file or directory""" [High,Modified] - Assigned to gfidente | 23:06 |
| fultonj | so i just want to pass that param to the problem job | 23:06 |
| apetrich | fultonj, I think that's the further that we can reach tonight | 23:06 |
| fultonj | but neither of us know where it's source is | 23:06 |
| fultonj | apetrich: ok | 23:07 |
| fultonj | i understand it's late | 23:07 |
| fultonj | someone else will be like "oh, it's foo" | 23:07 |
| apetrich | fultonj, that said thanks again for finding the solution | 23:07 |
| fultonj | hopefully that's the one | 23:07 |
| fultonj | apetrich: is there bug or card for this? | 23:08 |
| fultonj | i can add that note to it saying "wanna try this" | 23:08 |
| apetrich | not that I know. | 23:08 |
| fultonj | apetrich: ok | 23:08 |
| *** liverpooler has quit IRC | 23:08 | |
| apetrich | I will talk to arxcruz tomorrow and see where that came from | 23:08 |
| *** itlinux has quit IRC | 23:09 | |
| fultonj | but it was in the logs of a failed job from ci | 23:09 |
| fultonj | i could puruse the rest of the ci logs from that job, if you have the url | 23:09 |
| fultonj | (you might have shared it above) | 23:09 |
| * fultonj looks | 23:09 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 23:10 |
| openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 23:10 |
| apetrich | fultonj, I saw the error on a live machine not logs | 23:10 |
| fultonj | apetrich: ah ok | 23:10 |
| fultonj | i'll add a note to 1742936 | 23:10 |
| apetrich | thanks ooolpbot. fultonj I think it might be this https://bugs.launchpad.net/tripleo/+bug/1742465 | 23:10 |
| openstack | Launchpad bug 1742465 in tripleo "periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset002-ocata is failing with Resource could not be found on mistral" [High,Triaged] | 23:10 |
| *** liverpooler has joined #tripleo | 23:11 | |
| apetrich | not that sorry https://bugs.launchpad.net/tripleo/+bug/1742936 | 23:11 |
| *** itlinux has joined #tripleo | 23:11 | |
| apetrich | I need to reboot copy and paste are really weird on my machine | 23:11 |
| apetrich | fultonj, ^ | 23:11 |
| fultonj | apetrich: gnome3? | 23:11 |
| apetrich | aye | 23:11 |
| fultonj | apetrich: i had to bounce gnome3 for that today too! | 23:11 |
| apetrich | lol | 23:12 |
| fultonj | that one sucked | 23:12 |
| apetrich | more of tragic lol actually | 23:12 |
| fultonj | then you have to reopen tabs.... | 23:12 |
| fultonj | blah | 23:12 |
| fultonj | apetrich: does https://bugs.launchpad.net/tripleo/+bug/1742936 have the ceph issue you mentioned? | 23:14 |
| openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 23:14 |
| fultonj | doesn't look like it | 23:14 |
| *** pmannidi has joined #tripleo | 23:14 | |
| fultonj | i'll update that bug. thanks apetrich | 23:15 |
| apetrich | no that run doesn't have the issue | 23:15 |
| apetrich | just checked | 23:15 |
| *** dparkes has joined #tripleo | 23:15 | |
| fultonj | apetrich: oh, then that change wouldn't help | 23:16 |
| *** dsariel has joined #tripleo | 23:17 | |
| *** lblanchard has joined #tripleo | 23:20 | |
| * fultonj leaving for the night | 23:21 | |
| *** holser__ has quit IRC | 23:23 | |
| *** holser__ has joined #tripleo | 23:30 | |
| *** bfournie has quit IRC | 23:33 | |
| *** bfournie has joined #tripleo | 23:33 | |
| *** bfournie has quit IRC | 23:33 | |
| *** holser__ has quit IRC | 23:37 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: WIP ffu: Introduce ffu upgrade tasks https://review.openstack.org/528241 | 23:38 |
| *** liverpooler has quit IRC | 23:40 | |
| *** nyechiel_ has quit IRC | 23:41 | |
| *** itlinux has quit IRC | 23:43 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
