| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 00:00 |
|---|---|---|
| *** mjturek has quit IRC | 00:03 | |
| beagles | mwhahaha: ovn switch | 00:06 |
| beagles | mwhahaha: so that's dalvarez and myself | 00:06 |
| beagles | mwhahaha: EmilienM: dalvarez suggested a chat to see if a biweekly call would make sense for this | 00:08 |
| mwhahaha | Probably | 00:08 |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 00:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 00:10 |
| beagles | I think the two trickiest bits will be to a.) support upgrading from rocky to stein without forcing a migration and b.) coordinating the switch so it doesn't mess everybody up (rebase hell or whatever) | 00:10 |
| beagles | outside of that I'm not sure that it's that big of a deal | 00:11 |
| *** thrash|biab is now known as thrash | 00:26 | |
| *** thrash is now known as thrash|g0ne | 00:27 | |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Add a dual-bond example NIC config template https://review.openstack.org/604572 | 00:32 |
| *** ansmith has quit IRC | 00:42 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 01:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 01:10 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add simple validation that OpenShift is deployed https://review.openstack.org/600067 | 01:12 |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Don't change user during ping check. https://review.openstack.org/604990 | 01:12 |
| *** phuongnh has joined #tripleo | 01:15 | |
| *** rlandy has quit IRC | 01:31 | |
| *** numans has quit IRC | 01:34 | |
| *** pvc_ has quit IRC | 01:47 | |
| *** mrsoul has joined #tripleo | 01:54 | |
| *** mschuppert has quit IRC | 01:57 | |
| *** phuongnh has quit IRC | 01:58 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 02:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 02:10 |
| *** apetrich has quit IRC | 02:40 | |
| *** psachin has joined #tripleo | 02:49 | |
| *** rfolco has quit IRC | 02:54 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 03:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 03:10 |
| *** ramishra has joined #tripleo | 03:27 | |
| *** eggmaster has quit IRC | 03:36 | |
| *** rcernin_ has quit IRC | 03:42 | |
| *** rcernin has joined #tripleo | 03:43 | |
| *** dxiri has joined #tripleo | 03:53 | |
| *** dxiri has quit IRC | 03:57 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Undercloud - Restart keepalived on update https://review.openstack.org/603587 | 04:07 |
| *** haleyb has quit IRC | 04:07 | |
| openstackgerrit | Merged openstack/instack-undercloud master: Use templates for cover and lower-constraints https://review.openstack.org/604536 | 04:07 |
| openstackgerrit | Merged openstack/python-tripleoclient stable/rocky: Properly mock unlink https://review.openstack.org/605038 | 04:07 |
| openstackgerrit | Merged openstack/os-net-config stable/ocata: import zuul job settings from project-config https://review.openstack.org/597798 | 04:07 |
| openstackgerrit | Merged openstack/paunch stable/pike: import zuul job settings from project-config https://review.openstack.org/597814 | 04:07 |
| openstackgerrit | Merged openstack/python-tripleoclient stable/ocata: import zuul job settings from project-config https://review.openstack.org/597801 | 04:07 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Fix syntax for set_fact module. https://review.openstack.org/604681 | 04:07 |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 04:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 04:10 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Update sample-env-generator files to make it use ceph-ansible https://review.openstack.org/600017 | 04:11 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Stop cap granting to empty pool when telemetry disabled https://review.openstack.org/604735 | 04:11 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Fix bind-mount to manila's bootstrap container https://review.openstack.org/595014 | 04:11 |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Remove container_registry parameter from update workflows https://review.openstack.org/601630 | 04:11 |
| *** udesale has joined #tripleo | 04:18 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Add a script to compare reviews CI artifacts https://review.openstack.org/588475 | 04:21 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Stop cap granting to empty pool when telemetry disabled https://review.openstack.org/585911 | 04:26 |
| *** Petersingh has joined #tripleo | 04:27 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add tempest to standalone https://review.openstack.org/575588 | 04:34 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Handle missing or bad dmidecode https://review.openstack.org/601493 | 04:34 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Remove instack-undercloud and --use-heat https://review.openstack.org/588606 | 04:34 |
| *** Petersingh is now known as Petersingh|afk | 04:39 | |
| *** shyamb has joined #tripleo | 04:48 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 05:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 05:10 |
| *** Petersingh|afk is now known as Petersingh | 05:17 | |
| *** apetrich has joined #tripleo | 05:27 | |
| Tengu | hello there | 05:30 |
| *** quique|off is now known as quiquell | 05:31 | |
| quiquell | o/ | 05:31 |
| Tengu | hello quiquell :) | 05:33 |
| Tengu | anyone knows how to re-gate a patch that failed due to timeouts and the like? https://review.openstack.org/#/c/605039/ needs some love -.- | 05:34 |
| Tengu | ah, well, it IS in gate in fact. | 05:35 |
| Tengu | wow. | 05:35 |
| Tengu | 15 hours, still running. | 05:35 |
| quiquell | Tengu: still timeouts ? | 05:35 |
| Tengu | apparently it's still running. | 05:36 |
| Tengu | according to zuul | 05:36 |
| quiquell | Tengu: a fix for timeouts merged 12 hours ago | 05:36 |
| Tengu | it's running for over 15 hours | 05:36 |
| Tengu | remaining time is about 2h | 05:36 |
| Tengu | I have some doubts. | 05:36 |
| quiquell | Tengu: holy sh.. is the recurse thing still | 05:36 |
| Tengu | yep | 05:37 |
| quiquell | Tengu: un the fix is at python-tripleoclient... | 05:37 |
| quiquell | Tengu: maybe we need promotion for everyone to have it | 05:37 |
| Tengu | probably. | 05:37 |
| bandini | it will take same time for the gate to clear up (presuming the patch fixed most of the timeouts) | 05:38 |
| quiquell | Tengu: you patch is not bad in the gate | 05:38 |
| quiquell | Tengu: 6 reviews before it and non has fail yet, but we can try to priorize it at #openstack-infra | 05:39 |
| quiquell | Tengu: It fixed some promotion jobs as I recall | 05:39 |
| *** bnemec has quit IRC | 05:39 | |
| *** iranzo has joined #tripleo | 05:40 | |
| quiquell | bandini: If we have a change at python-tripleoclient, do we need a promotion for other projects to have it ? | 05:40 |
| quiquell | bandini: I should know this... | 05:40 |
| Tengu | quiquell: yeah, it apparently fixes a promotion blocker, according to the LP | 05:40 |
| quiquell | Tengu: we had master promotion yesterday :-) | 05:41 |
| Tengu | Champagne! | 05:41 |
| quiquell | Tengu: also gates are working fine, so is just a matter of time | 05:43 |
| Tengu | ok | 05:43 |
| Tengu | well. | 05:43 |
| quiquell | therve: You change worked for timeouts, thanks again mate ! | 05:43 |
| quiquell | Tengu: but wait going to task at openstack-infra as my last job as rover | 05:44 |
| Tengu | I have other things to do anyway ;). There's apparently some stuff with running modprobe within containers. | 05:44 |
| bandini | quiquell: meh I am a complete CI n00b, so not sure tbh | 05:44 |
| quiquell | bandini: ok | 05:44 |
| quiquell | Tengu: zuul masters are sleeping | 05:45 |
| quiquell | Tengu: this is it ? https://bugs.launchpad.net/tripleo/+bug/1794251 | 05:47 |
| openstack | Launchpad bug 1794251 in tripleo "[master] undercloud reinstall failed with invalid selinux context: [Errno 95] Operation not supported" [Critical,In progress] - Assigned to Cédric Jeanneret (cjeanner) | 05:47 |
| *** ratailor has joined #tripleo | 05:52 | |
| quiquell | Tengu: I also see this in the bug https://review.openstack.org/#/c/602703/ | 05:53 |
| quiquell | Tengu: ^ deactivate selinux upstream | 05:53 |
| quiquell | bandini, Tengu: Are you masters of standalone ? | 05:55 |
| bandini | quiquell: nope. but what's the issue? | 05:56 |
| Tengu | quiquell: so that's the LP issue yes, and mwhahaha patch will not correct the behavior at customer level. | 05:56 |
| Tengu | and nope, not a master of standalone. | 05:56 |
| quiquell | Tengu: ok so we need both reviews, since we don't have timeout and there is already a master promotion, we will wait in the gates | 05:56 |
| quiquell | Tengu: is not fair for others | 05:56 |
| Tengu | yep | 05:57 |
| quiquell | Tengu: we have being blocking gates for long | 05:57 |
| Tengu | :) | 05:57 |
| quiquell | bandini: Just general question, how feasible is to move check jobs we have to standalone ? I am totally noob to standalone | 05:57 |
| quiquell | jaosorior: To fix promotion release files for queens, pike, ocata https://review.openstack.org/#/c/604324/ | 05:59 |
| *** gfidente has joined #tripleo | 06:00 | |
| *** ksambor has joined #tripleo | 06:02 | |
| quiquell | marios: Remove timeout logic is good now https://review.openstack.org/#/c/589068/ | 06:04 |
| quiquell | bandini, Tengu: minor fix to catch zaqar connection closed propertly https://review.openstack.org/#/c/605387/ | 06:05 |
| quiquell | And trait it like timeouts | 06:06 |
| *** kopecmartin|off is now known as kopecmartin|ruck | 06:08 | |
| quiquell | kopecmartin|ruck: o/ | 06:08 |
| kopecmartin|ruck | quiquell, hi | 06:08 |
| marios | quiquell: checking | 06:08 |
| quiquell | kopecmartin|ruck: Updated the etherpad with current state | 06:08 |
| quiquell | marios, kopecmartin|ruck: https://review.rdoproject.org/etherpad/p/ruckrover-sprint20 | 06:09 |
| quiquell | gates are working like a clock now | 06:09 |
| marios | quiquell: ack thanks catching some reviews then will focus there | 06:09 |
| quiquell | marios: sure, let's wait for chkumar|off and do handover | 06:10 |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 06:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 06:10 |
| *** shyamb has quit IRC | 06:11 | |
| kopecmartin|ruck | quiquell, how do you know that gates are working? according to this, there is plenty of failures http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1 | 06:15 |
| *** aufi has joined #tripleo | 06:16 | |
| quiquell | kopecmartin|ruck: The fix for timeouts was merged 12 hours ago, good tool is noop (to the right) | 06:17 |
| quiquell | kopecmartin|ruck: we have some noop reviews that rebase and test CI, they exercise check pipeline, gate is a subset of jobs from check pipeline | 06:18 |
| quiquell | kopecmartin|ruck: Loking there we are good | 06:18 |
| kopecmartin|ruck | quiquell, these ones https://review.openstack.org/#/q/topic:gate-check+status:open ? | 06:18 |
| quiquell | kopecmartin|ruck: In the ruck rover etherpad, you have the reviews | 06:19 |
| *** shyamb has joined #tripleo | 06:19 | |
| *** holser_ has joined #tripleo | 06:23 | |
| *** slaweq has joined #tripleo | 06:23 | |
| *** mschuppert has joined #tripleo | 06:24 | |
| *** leanderthal has joined #tripleo | 06:25 | |
| *** shyamb has quit IRC | 06:25 | |
| *** pcaruana has joined #tripleo | 06:33 | |
| *** jfrancoa has joined #tripleo | 06:34 | |
| *** jamesdenton has quit IRC | 06:35 | |
| therve | quiquell: Hooray! :) | 06:36 |
| *** shyamb has joined #tripleo | 06:36 | |
| *** aufi has quit IRC | 06:37 | |
| *** holser_ has quit IRC | 06:41 | |
| *** holser_ has joined #tripleo | 06:43 | |
| *** cylopez has joined #tripleo | 06:46 | |
| *** cylopez has left #tripleo | 06:48 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP DNR Unify rabbitmq bind mounts and env vars https://review.openstack.org/605598 | 06:48 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP DNR Unify rabbitmq bind mounts https://review.openstack.org/605599 | 06:48 |
| *** zaneb has quit IRC | 06:55 | |
| *** quiquell is now known as quiquell|brb | 06:55 | |
| *** zaneb has joined #tripleo | 06:56 | |
| *** numans has joined #tripleo | 07:01 | |
| openstackgerrit | Merged openstack/tripleo-validations master: Fix diskspace validation when size is the limit https://review.openstack.org/603523 | 07:10 |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 07:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 07:10 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add ERL args parameter for rabbit and set the busy wait threshold to none https://review.openstack.org/602082 | 07:10 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Fix syntax for set_fact ansible task. https://review.openstack.org/604752 | 07:10 |
| *** shyamb has quit IRC | 07:11 | |
| *** rcernin has quit IRC | 07:12 | |
| *** rdopiera has joined #tripleo | 07:13 | |
| *** chkumar|off is now known as chandankumar | 07:18 | |
| chandankumar | quiquell|brb: \o/ | 07:19 |
| chandankumar | marios: \o/ | 07:19 |
| *** shardy has joined #tripleo | 07:21 | |
| *** Petersingh is now known as Petersingh|lunch | 07:28 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates stable/rocky: Undercloud - Restart keepalived on update https://review.openstack.org/605604 | 07:34 |
| *** gkadam has joined #tripleo | 07:36 | |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Disable external plugins in rabbitmq container https://review.openstack.org/601075 | 07:37 |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Assert services/containers are started after reboot. https://review.openstack.org/605084 | 07:37 |
| *** quiquell|brb is now known as quiquell | 07:38 | |
| *** florianf|afk is now known as florianf | 07:40 | |
| *** tosky has joined #tripleo | 07:45 | |
| Tengu | quiquell: if all goes well, we should get the fix in about 30 minutes. | 07:46 |
| Tengu | ah, less than 10 | 07:47 |
| Tengu | woohooo | 07:47 |
| quiquell | Tengu: A lot of stuff has merge !!! :-) | 07:47 |
| quiquell | Tengu: gates are very good now | 07:47 |
| Tengu | guess the CI isn't red anymore? | 07:47 |
| *** jpich has joined #tripleo | 07:47 | |
| quiquell | Tengu: nop, tiemouts are the worst that can happend, you cannot land fixes | 07:48 |
| Tengu | ah. they secured the topic. anyway. | 07:48 |
| *** amoralej|off is now known as amoralej | 07:49 | |
| quiquell | Tengu: yep... but I think people are workflowing | 07:50 |
| chandankumar | quiquell: I think it's time to change the chaneel topic message | 07:51 |
| *** shyamb has joined #tripleo | 07:52 | |
| *** hjensas has quit IRC | 07:57 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 08:00 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert RegisterNodesActions to named exports https://review.openstack.org/603094 | 08:00 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert RolesActions to named exports https://review.openstack.org/603095 | 08:00 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Convert ZaqarActions to named exports https://review.openstack.org/603097 | 08:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 08:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO https://review.openstack.org/604298 | 08:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO https://review.openstack.org/604293 | 08:00 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Fix used paths to match custom working dir https://review.openstack.org/594055 | 08:01 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Dropped "recurse" for idempotency https://review.openstack.org/605039 | 08:01 |
| *** jpena|off is now known as jpena | 08:01 | |
| *** skramaja has joined #tripleo | 08:02 | |
| *** bogdando has joined #tripleo | 08:02 | |
| quiquell | chandankumar: I canno tdo it | 08:02 |
| *** saneax has joined #tripleo | 08:06 | |
| *** saneax has quit IRC | 08:06 | |
| *** saneax has joined #tripleo | 08:07 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 08:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 08:10 |
| chandankumar | marios: kopecmartin|ruck https://review.openstack.org/#/c/602703/ for selinux one | 08:10 |
| bogdando | o/ let's merge https://review.openstack.org/#/c/578799/ | 08:12 |
| shyamb | Hi | 08:14 |
| *** moguimar has joined #tripleo | 08:14 | |
| shyamb | I am installing a python module during container build | 08:14 |
| *** Petersingh|lunch is now known as Petersingh | 08:19 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/diskimage-builder master: Add an element to configure iBFT network interfaces https://review.openstack.org/391787 | 08:26 |
| *** janki has joined #tripleo | 08:27 | |
| *** Petersingh is now known as Petersingh|mtg | 08:27 | |
| janki | EmilienM, hey | 08:28 |
| openstackgerrit | Filippo Inzaghi proposed openstack-infra/tripleo-ci master: fix tox python3 overrides https://review.openstack.org/605615 | 08:30 |
| *** fhubik has joined #tripleo | 08:33 | |
| mschuppert | jaosorior: do we again give +w? | 08:34 |
| Tengu | quiquell: apparently it's merged \o/ | 08:35 |
| openstackgerrit | Dmitry Tantsur proposed openstack/diskimage-builder master: Add an element to configure iBFT network interfaces https://review.openstack.org/391787 | 08:35 |
| *** verdurin has quit IRC | 08:36 | |
| *** dtantsur|afk is now known as dtantsur | 08:36 | |
| quiquell | Tengu: yey !!! | 08:36 |
| quiquell | Tengu: one less | 08:36 |
| jaosorior | mschuppert: yeah, the gate seems to be in a better condition | 08:37 |
| Tengu | :) | 08:37 |
| bogdando | jistr, shardy: thanks! | 08:37 |
| chandankumar | still we have 18 hrs zuul queue | 08:37 |
| dtantsur | jaosorior, slagle, shardy, FYI ironic is going to have a Forum session on Edge/Federation. If the federation idea flies, we may regain some kind of central Ironic API even with disconnected underclouds. | 08:38 |
| dtantsur | (unless you use pigeons instead of ironic, obviously :) | 08:38 |
| mschuppert | jaosorior: if we do, could you please https://review.openstack.org/#/c/582623/ https://review.openstack.org/#/c/595001/ | 08:39 |
| jaosorior | dtantsur: I had already named the pigeons :( | 08:39 |
| dtantsur | jaosorior: then you have something better than Ironic API, right? | 08:39 |
| *** verdurin has joined #tripleo | 08:39 | |
| jaosorior | wouldn't say better, they do poop a lot. | 08:39 |
| * dtantsur checks Ironic API for poop | 08:40 | |
| dtantsur | well, some bits of our API certainly count :D | 08:41 |
| jaosorior | lol | 08:41 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: Put create repo script into its own tasks file. https://review.openstack.org/605369 | 08:41 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: Add new featureset 056 for standalone upgarde. https://review.openstack.org/605363 | 08:41 |
| shardy | dtantsur: Ok, I'll be interested to attend - I'm still not sure how federation helps with far edge footprint though | 08:41 |
| *** yprokule has joined #tripleo | 08:42 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: WIP: Add necessary bits for N-1->N standalone upgrade. https://review.openstack.org/604736 | 08:42 |
| dtantsur | shardy: not with footprint. I'm doing other ironic things to reduce the footprint of ironic if we happen to use it. | 08:42 |
| dtantsur | here I'm only talking about doing $ openstack baremetal node list and still seeing all nodes everywhere | 08:42 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack-infra/tripleo-ci master: WIP: New workflow for standalone upgrade https://review.openstack.org/604706 | 08:42 |
| *** derekh has joined #tripleo | 08:43 | |
| shardy | dtantsur: Ok, I'll be interested to hear more - I'd never understood federation to mean a global view of multiple clouds, but I've not spent a lot of time looking into it yet | 08:43 |
| dtantsur | well, all the terms are still being defined in the context of openstack :) | 08:44 |
| dtantsur | some contributors really want to see this single view of bare metal resources | 08:44 |
| *** akrivoka has joined #tripleo | 08:44 | |
| shardy | dtantsur: yeah, the discussion has been going on for several years already, I've kinda lost track ;) | 08:44 |
| shardy | dtantsur: yeah - FWIW that requirement was expressed in the context of *all* resources in the session | 08:45 |
| shardy | but it was agreed that could be a second step after the minimal architecture we agreed on was working | 08:45 |
| dtantsur | right, but it seems that everyone will happen in parallel in the end :) | 08:45 |
| dtantsur | as messy as openstack always is | 08:46 |
| shardy | There were opinions on both sides - some folks wanted OpenStack to solve the "single plane of glass" problem in the central DC, others saw it more as an orchestration problem | 08:46 |
| shardy | I'm more in the latter group but happy to discuss it :) | 08:46 |
| *** numans has quit IRC | 08:49 | |
| *** gkadam is now known as gkadam-afk | 08:52 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: WIP - Fix stackviz https://review.openstack.org/605419 | 08:52 |
| *** hjensas has joined #tripleo | 08:53 | |
| dtantsur | shardy: I only find the first problem really interesting to concentrate on :) the second can be solved with a lot of ansible (which is close to what we're going to do). | 08:53 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates stable/rocky: Add ERL args parameter for rabbit and set the busy wait threshold to none https://review.openstack.org/605622 | 08:54 |
| openstackgerrit | Merged openstack/tripleo-docs master: Document standalone/UC update Heat stack specifics https://review.openstack.org/578799 | 08:55 |
| shardy | dtantsur: understood - the debate in the room at the PTG was whether the first problem is essentially already solved, or should we do all the work to make every service fully region/multi-cloud aware | 08:56 |
| dtantsur | that could be quite a task.. for the next 5 years :) | 08:56 |
| shardy | dtantsur: yeah, but it's what you're interested in solving I think? | 08:56 |
| dtantsur | I am, yes | 08:57 |
| dtantsur | I think if we decide to never solve it (I'm not saying right now ofc), we're losing the spirit of IaaS | 08:57 |
| shardy | I agree it's really hard which is why I tend to thing it'd be far, far easier to require a (any) central IdP and an orchestration tool that can deal with the fact that you have multiple clouds | 08:57 |
| shardy | dtantsur: sure, I just think focussing on the distributed compute problem first will enable more (and much quicker) operator benefit | 08:59 |
| *** gkadam-afk is now known as gkadam | 08:59 | |
| shardy | if, eventually, we've got full multi-cloud/region control-plane then great | 08:59 |
| dtantsur | right, one thing at a time | 08:59 |
| shardy | but it's not a hard requirement for most of the edge cases we're initially targetting | 08:59 |
| dtantsur | I'm still unsure about our usage of the term "distributed", it may be confused with what I was initially thinking | 09:00 |
| *** panda|off is now known as panda | 09:00 | |
| dtantsur | (one cloud spread of regions rather than many clouds orchestrated together) | 09:00 |
| shardy | dtantsur: Yeah, it was confusing at the PTG because there were several visions on that | 09:00 |
| shardy | I'm assuming many clouds, with distributed compute clusters/cells - but optionally with a central keystone that knows about each region (which is really a separate cloud) | 09:01 |
| shardy | that, AFAICT is pretty much how AWS works | 09:01 |
| shardy | and we can do it with the pieces we have now | 09:01 |
| dtantsur | yeah, support for multiple regions is nearly everywhere (and in most places is not broken) | 09:01 |
| shardy | dtantsur: yeah, so that plus distributed compute is enough for a bunch of the existing edge use-case | 09:02 |
| dtantsur | I envision quite some updates to THT with setting "region" all over the config files :) | 09:02 |
| dtantsur | shardy: wdym "distributed compute", cells? | 09:02 |
| shardy | and the single operator view is a cool idea, but mostly a convenience vs functional necessity | 09:02 |
| shardy | dtantsur: have you seen the diagrams from the PTG? | 09:02 |
| shardy | and the split-controlplane spec etc? | 09:03 |
| dtantsur | yep, but you overestimate how clear they are in details :) | 09:03 |
| dtantsur | the spec has a lot ??? and TBD in the key places | 09:03 |
| dtantsur | as to necessity.. we have different requirements with you. I'm a bare metal guy, so people will come to me saying "Wait, seriously, I cannot see all my nodes?" :) maybe they won't, we'll see. | 09:04 |
| shardy | https://specs.openstack.org/openstack/tripleo-specs/specs/rocky/split-controlplane.html | 09:04 |
| *** ykarel has joined #tripleo | 09:04 | |
| shardy | dtantsur: I think they may say that regardless of baremetal, it's not a service specific problem | 09:04 |
| dtantsur | totally | 09:04 |
| shardy | but if you implement this as a multi-region environment the solution is basically a loop in whatever tool you care to use | 09:05 |
| shardy | which is at least a simple interim workaround | 09:05 |
| dtantsur | right | 09:05 |
| bogdando | that's really an issue to get all folks onto the same page when someone says federated foo... | 09:05 |
| shardy | dtantsur: lets step back from the whole single API for the world thing and I'll try to clarify "distributed compute" | 09:05 |
| dtantsur | right, looking at http://specs.openstack.org/openstack/tripleo-specs/_images/ceph-details.png | 09:06 |
| dtantsur | Nova AZ implies one big Nova, right? with scaling Rabbit/Maria and things? as opposed to cells which IIRC have at least separate databases. | 09:06 |
| bogdando | like, making it clear for all, e.g.: | 09:06 |
| bogdando | federation to | 09:06 |
| bogdando | * mean a global view of multiple clouds | 09:06 |
| bogdando | * doing $ openstack baremetal node list and still seeing all nodes everywhere | 09:06 |
| shardy | dtantsur: it could be either but owalsh has been working on a model where each remote site can be an independent cell | 09:06 |
| bogdando | that's how I do get that, and dtantsur also :) | 09:06 |
| shardy | or you could have N sites which are physically close be a cell or something | 09:07 |
| bogdando | we need a spec with terms :/ | 09:07 |
| dtantsur | okay, so cells. this spec needs some clarification in details indeed. | 09:07 |
| shardy | bogdando: there have been several keystone specs on this topic which may be worth revisiting, but yeah it's not super clear in this context | 09:08 |
| bogdando | federated, distributed, autonomous - as we want these, and nothing more/else than that | 09:08 |
| dtantsur | (also why are we using the term Director upstream??) | 09:08 |
| bogdando | so please also add me to the call, dtantsur | 09:08 |
| dtantsur | bogdando: the call? if you mean the Forum session, it's f2f in Berlin (and you're very welcome to come :) | 09:08 |
| bogdando | and MVP scope for tripleo... | 09:09 |
| bogdando | IMO it must include ironic as dtantsur proposes | 09:09 |
| bogdando | not deployed servers with pigeons :) | 09:09 |
| dtantsur | +100 | 09:09 |
| dtantsur | no matter how simple, we need some solution to bm provisioning.. | 09:09 |
| * dtantsur nearly said "pigeons won't fly", but this is actually what they do :D | 09:10 | |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 09:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| shardy | Ok, well it's a shame you guys weren't in both the edge sessions at the PTG as we're burning quite a lot of time talking past each other lacking that context | 09:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 09:10 |
| shardy | but I'm sure we can iterate on the specs and clarify | 09:10 |
| bogdando | shardy: "single plane of glass" problem in the central DC, and an orchestration problem - why not both? | 09:10 |
| bogdando | it is in fact | 09:10 |
| shardy | the forum session sounds like a great idea though | 09:10 |
| dtantsur | shardy: I'd love to be there, but $personal_things :( | 09:10 |
| dtantsur | shardy, bogdando, FYI jaosorior submitted a session on UC Edge discussion | 09:11 |
| dtantsur | and we have another in ironic | 09:11 |
| dtantsur | so please do come :) | 09:11 |
| shardy | bogdando: The point is you can solve it with orchestration now, and do no work in OpenStack, or you can do 5 years work to avoid doing the Orchestration | 09:11 |
| *** phuongnh has joined #tripleo | 09:11 | |
| shardy | dtantsur: ack understood, not complaining, just noting that we need to align somehow to make this discussion easier/more productive | 09:12 |
| bogdando | and having those two addressed differently beings us back to special snowflakes architecture :( | 09:12 |
| owalsh | shardy, dtantsur: hey... | 09:12 |
| dtantsur | o/ | 09:12 |
| shardy | owalsh: Hey, just been discussing the edge topics - dtantsur and bogdando have some good ideas on this but we're missing some common context from the PTG | 09:13 |
| shardy | hopefully we can figure out how to iterate on that | 09:13 |
| *** janki has quit IRC | 09:13 | |
| * owalsh scrolls back... pigeon poop :-) | 09:14 | |
| shardy | heh, it's not even Friday yet and the vocabulary is going downhill ;) | 09:14 |
| *** salmankhan has joined #tripleo | 09:16 | |
| dtantsur | indeed :D | 09:16 |
| owalsh | dtantsur: I see cells as just sharding the nova mq/db.... not an edge thing but probably something that's required at the scales being mentioned for edge | 09:16 |
| *** shyamb has quit IRC | 09:16 | |
| dtantsur | owalsh: right, sharding mq/db is quite critical actually when you cannot guarantee connectivity between the DC and sites | 09:17 |
| dtantsur | especially DB. I can imagine an AMQP solution working with unreliable connection, but a DB... | 09:17 |
| owalsh | dtantsur: well.... if the api is at the DC then having an mq/db at the edge doesn't really help | 09:17 |
| shardy | yeah provided the workloads keep running you just do nothing until the outage ends I guess | 09:18 |
| dtantsur | owalsh: well.. this is the problem #0 to solve. | 09:18 |
| dtantsur | yesterday my idea with distributed ironic was essentially shot down because of relying on these two | 09:18 |
| shardy | nobody in the edge sessions was asking for API endpoints in the far edge clusters | 09:19 |
| dtantsur | shardy: "the workloads keeping running" is an optimistic assumption if your DB enters split-brain situation | 09:19 |
| owalsh | dtantsur: fibre from DC to site should be pretty reliable... | 09:19 |
| shardy | just that they could tolerate temporary disconnection to the controlplane DC | 09:19 |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Add a dual-bond example NIC config template https://review.openstack.org/604572 | 09:19 |
| shardy | dtantsur: running VMs don't write to the DB | 09:19 |
| dtantsur | shardy: can you guarantee it for all services? | 09:19 |
| bogdando | dtantsur, shardy, owalsh: https://etherpad.openstack.org/p/tripleo-edge-mvp | 09:19 |
| dtantsur | ironic uses DB-level locks for periodic tasks (I mean, Ironic in the overcloud) | 09:19 |
| shardy | dtantsur: we already require it for upgrades - we take the entire controlplane down | 09:20 |
| bogdando | just keeping some notes as I got it from discussions above | 09:20 |
| shardy | and the data plane must remain intact | 09:20 |
| bogdando | please let's comment/ add to the agenda of the meeting | 09:20 |
| owalsh | dtantsur: *might* have edge sites that use radio link to other edges though | 09:20 |
| bogdando | slagle: ^^ | 09:20 |
| bogdando | WDYT? | 09:20 |
| dtantsur | shardy: I'm talking more about how control plane is going to feel after a 30 minutes outage | 09:20 |
| owalsh | still, point to point radio links are very reliable too | 09:21 |
| dtantsur | owalsh: back looong time ago I've seen a messaging system without TCP/IP with connectivity several times a day :) | 09:21 |
| dtantsur | but I hope we'll never see anything like that here | 09:21 |
| owalsh | dtantsur: ack... recovering from the outage is what I'd be interested in too, and not just a short blip | 09:22 |
| shardy | dtantsur: the controlplane keeps running, and just schedules workload to compute clusters that are still up | 09:22 |
| shardy | some hypervisors go down but things keep running | 09:22 |
| shardy | but for storage that's a more interesting question ;) | 09:22 |
| shardy | assuming ceph etc | 09:22 |
| owalsh | or ephemeral | 09:22 |
| dtantsur | ironic would declare conductors dead in this situation, so the nodes will start rebalancing randomly on connectivity return | 09:23 |
| dtantsur | not critical, but quite unpleasant if happens often | 09:23 |
| owalsh | but yea, had side discussion with the ceph/cinder guys at PTG | 09:23 |
| dtantsur | ah, well, we won't have ironic-api in central DC | 09:23 |
| * dtantsur needs to draw this whole thing | 09:24 | |
| *** shyamb has joined #tripleo | 09:24 | |
| shardy | https://usercontent.irccloud-cdn.com/file/pTXEIdpu/edge_services_list_minimal.JPG is the PTG "diagram", there are some cleaned up versions too which I'll find | 09:26 |
| shardy | one source of confusion is, in TripleO we're currently ignoring "Main", and calling "Far Edge" the edge compute clusters | 09:27 |
| dtantsur | I see | 09:27 |
| shardy | and "edge" is a separate controlplane/cloud/region | 09:27 |
| dtantsur | so we assume more or less good connectivity between Edge and Far Edge? | 09:27 |
| shardy | There were multiple definitions of those things in the room, but we pretty much agreed on that diagram as an MvP regardless of what each layer is called | 09:28 |
| shardy | dtantsur: yes but if the network goes down between edge and far edge the NFV workloads e.g at antenna sites must keep running | 09:28 |
| dtantsur | okay, so keeping data plane but not control plane | 09:29 |
| dtantsur | thanks for clarification shardy. I'm asking so many question also because I need to understand how ironic in the *overcloud* maps into this picture | 09:29 |
| shardy | https://etherpad.openstack.org/p/tripleo-ptg-stein-edge links some slides with similar content, and there is a ML thread with another version | 09:30 |
| shardy | dtantsur: ack, hope that helps | 09:30 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/rocky: Don't change user during ping check. https://review.openstack.org/605630 | 09:30 |
| dtantsur | it does | 09:30 |
| *** phuongnh has quit IRC | 09:31 | |
| *** phuongnh has joined #tripleo | 09:32 | |
| * owalsh sighs, "edge" and "far edge" really annoys me, surely edges are at the extremes for the network... | 09:33 | |
| *** Petersingh|mtg is now known as Petersingh | 09:34 | |
| dtantsur | yeah, this was a part of my confusion | 09:34 |
| owalsh | just need to call the 2nd tier of nodes something else... | 09:34 |
| dtantsur | ++ | 09:34 |
| dtantsur | I'd use "headquarters", "region", "edge", but "region" is confusing because of keystone regions | 09:35 |
| owalsh | core/hub/edge maybe | 09:35 |
| dtantsur | also good | 09:37 |
| mschuppert | hi, could I please get reviews for https://review.openstack.org/#/c/587066/ ? | 09:38 |
| therve | Ah, semantic | 09:38 |
| therve | That's the occupation for the next 5 years? :) | 09:38 |
| shardy | pretty sure we can bikeshed on naming for 5 years?! ;) | 09:39 |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/rocky: Assert services/containers are started after reboot. https://review.openstack.org/605632 | 09:39 |
| dtantsur | shardy: sounds like fun \o/ | 09:40 |
| shardy | but yeah, it's confusing - I've been saying "region" but that could be confusing since keystone regions are only one possible approach to implementing it | 09:40 |
| dtantsur | and my that time we will have finished the full federation - double win | 09:40 |
| chandankumar | quiquell: https://review.rdoproject.org/r/#/c/16510/ it might be useful for one of the mirror patch you are working on | 09:40 |
| shardy | core/hub/edge seems like a pretty clear description to me though | 09:40 |
| *** yprokule has quit IRC | 09:44 | |
| shardy | jistr: Hey, continuing the purge of bootstrap_nodeid, do you know if we can remove ./extraconfig/tasks/pacemaker_* now? | 09:45 |
| shardy | IIRC we moved everything to upgrade_tasks so that should now be unused? | 09:46 |
| *** yprokule has joined #tripleo | 09:47 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart-extras master: WIP: Add subnode-setup.yml playbook. https://review.openstack.org/604120 | 09:51 |
| fultonj | dtantsur shardy bogdando owalsh saw you were talking about the edge | 09:52 |
| fultonj | https://etherpad.openstack.org/p/tripleo-edge-working-group-split-control-plane | 09:52 |
| *** moshele has joined #tripleo | 09:52 | |
| bogdando | fultonj, shardy, dtantsur, owalsh, slagle: see my notes to sum up what he have had here https://etherpad.openstack.org/p/tripleo-edge-mvp | 09:52 |
| fultonj | I wrote something on how the split control plane is compatible with the diagrams that came out of the PTG ^ | 09:52 |
| fultonj | bogdando: ok, i'll read them, please read mine too :) | 09:53 |
| jistr | shardy: i'm looking | 09:54 |
| openstackgerrit | Udi Kalifon proposed openstack/tempest-tripleo-ui master: Selenium infra https://review.openstack.org/605424 | 09:54 |
| dtantsur | fultonj: looking | 09:54 |
| fultonj | thanks | 09:54 |
| dtantsur | fultonj: see our discussion about "Far Edge" making no sense :) | 09:55 |
| fultonj | i made a PDF of it if it helps | 09:55 |
| rascasoft | shardy, hey hi! I got into https://bugs.launchpad.net/tripleo/+bug/1794038 and tried your workaround (ctlplane_masquerade: true) it correctly sets the [ctlplane-subnet] masquerade=True section in undercloud.conf, but then I still get this iptables rule: -A FORWARD -j REJECT --reject-with icmp-host-prohibited | 09:55 |
| openstack | Launchpad bug 1794038 in tripleo "undercloud masquerade_networks is now silently ignored" [High,In progress] - Assigned to Harald Jensås (harald-jensas) | 09:55 |
| dtantsur | fultonj: okay, this makes sense, assuming that Glance and Telemetry are/will be inherently multi-region | 09:56 |
| fultonj | "far edge" vs "edge" is annoying but as the edge working group is adopting the terms, unless we want to try to convince them otherwise post ptg, i'm sort of going with it or at least establishing equivalency | 09:56 |
| rascasoft | shardy, do you have any suggestion? | 09:56 |
| dtantsur | fultonj: I wonder what our chances are.. it's super confusing. | 09:56 |
| shardy | rascasoft: what does the entire FORWARD chain look like? | 09:56 |
| dtantsur | fultonj: though it may make sense if we accept an architecture without Tier 3 | 09:57 |
| *** shyamb has quit IRC | 09:57 | |
| shardy | rascasoft: maybe chat with hjensas as he posted a fix - I manually fixed up my rules and haven't yet rebuilt my environment with ctlplane_masquerade: true | 09:57 |
| rascasoft | shardy, http://pastebin.test.redhat.com/652030 | 09:57 |
| *** shyamb has joined #tripleo | 09:57 | |
| fultonj | dtantsur: you see the PDF? | 09:57 |
| shardy | rascasoft: it's at the end of the chain, so what's the problem exactly? | 09:58 |
| jistr | shardy: yea i think we can remove it. It has been obsoleted by switch to containers. I see docker-ha.yaml env file has this: | 09:58 |
| jistr | OS::TripleO::Tasks::ControllerPreConfig: OS::Heat::None | 09:58 |
| rascasoft | shardy, I'm using the undercloud as gateway for the overcloud | 09:58 |
| jistr | OS::TripleO::Tasks::ControllerPostConfig: OS::Heat::None | 09:58 |
| rascasoft | shardy, this prevents any ping/ntp whatever to the outside | 09:58 |
| jistr | shardy: i still can see the pre/post pacemaker templates referenced from other envs and CI envs, but that's probably just stale code. With containers we shouldn't need it, i'm almost sure. | 09:59 |
| fultonj | dtantsur: my proposal for first prototype is 2 tiers | 10:00 |
| shardy | rascasoft: got to go to a meeting, but if you can share you whole undercloud.conf either hjensas or myself may be able to help | 10:01 |
| fultonj | but it doesn't exluce a 3 tier, it just makes it a matter of federation | 10:01 |
| fultonj | exclude* | 10:01 |
| shardy | jistr: would you have time to look at cleaning that up and removing perhaps? | 10:01 |
| rascasoft | shardy, hjensas, http://pastebin.test.redhat.com/652031 | 10:01 |
| shardy | jistr: my series is getting big already, and this isn't exactly related if it's currently unused | 10:01 |
| * shardy trying to keep some possibility of backporting this ;) | 10:02 | |
| openstackgerrit | Udi Kalifon proposed openstack/tempest-tripleo-ui master: Selenium infra https://review.openstack.org/605424 | 10:02 |
| fultonj | no pigeons (nor penguins)? | 10:03 |
| shardy | owls? | 10:03 |
| dtantsur | owls \o/ | 10:03 |
| fultonj | bogdando: ? saw it that in your doc | 10:03 |
| dtantsur | fultonj: yep, the pdf lgtm | 10:03 |
| fultonj | ack | 10:03 |
| fultonj | cool | 10:03 |
| dtantsur | we need a cool owl codename for the project | 10:04 |
| * dtantsur thinks of a pun with owls and edges | 10:04 | |
| jistr | shardy: ack yea i can do that | 10:04 |
| dtantsur | are there owls that live in mountains? | 10:04 |
| fultonj | bogdando: +1 on line 35 of https://etherpad.openstack.org/p/tripleo-edge-mvp | 10:04 |
| rascasoft | shardy, hjensas, what I find strange is the fact that in Rocky the FORWARD rule is not present | 10:04 |
| fultonj | focussing on the distributed compute problem first will enable more (and much quicker) | 10:04 |
| hjensas | rascasoft: looking. | 10:04 |
| fultonj | bogdando: you want to add your etherpad to the edge squad agenda for today? | 10:06 |
| fultonj | https://etherpad.openstack.org/p/tripleo-edge-squad-status | 10:06 |
| hjensas | rascasoft: You are using several deprecated options, but what you have there should work. | 10:07 |
| * jistr re cleanup i reported https://bugs.launchpad.net/tripleo/+bug/1794720 and assigned to myself | 10:07 | |
| openstack | Launchpad bug 1794720 in tripleo "Clean up old templates for updates with pre-containerization pacemaker" [Medium,Triaged] - Assigned to Jiří Stránský (jistr) | 10:07 |
| rascasoft | hjensas, this is an environment produced by quickstart, so what are the deprecated options you are mentioning? | 10:08 |
| hjensas | rascasoft: Is it the ': -A FORWARD -j REJECT --reject-with icmp-host-prohibited' that is not in Rocky but you see it in current-dev/master ? | 10:08 |
| rascasoft | hjensas, yes sir | 10:08 |
| rascasoft | hjensas, and more important: the quickstart config I'm using for both the env is the same | 10:09 |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 10:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 10:10 |
| hjensas | rascasoft: these are deprecated: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/config/undercloud.py#L30-L39 + the masquerade_network one. | 10:11 |
| hjensas | rascasoft: there is a quickstart patch here: https://review.openstack.org/604922 | 10:12 |
| hjensas | rascasoft: yes, the quickstart conf should work in both. | 10:13 |
| rascasoft | hjensas, so I'm confused. I never used masquerade_network before, I tested it after looking at the bug opened by shardy | 10:14 |
| rascasoft | hjensas, my main issue is that FORWARD rule that has been created? | 10:15 |
| rascasoft | (sorry, no "?") | 10:15 |
| hjensas | rascasoft: ack, I don't know where that FORWARD -j REJECT rule come from. | 10:16 |
| dtantsur | shardy, bogdando, I guess for a non-pigeon bm provisioning solution we need to speed up the metalsmith work, wdyt? | 10:17 |
| dtantsur | otherwise we have to throw nova and glance in the "lightweight" edge provisioners | 10:17 |
| fultonj | dtantsur bogdando is "openstack baremetal node list" and seeing all nodes everywhere (e.g. far away on the edge) a likely outcome for your goal? | 10:18 |
| *** shardy is now known as shardy_mtg | 10:18 | |
| rascasoft | hjensas, so I see it in /usr/share/instack-undercloud/undercloud-install/os-apply-config/var/opt/undercloud-stack/masquerade | 10:19 |
| *** pvc has joined #tripleo | 10:19 | |
| pvc | hi | 10:19 |
| hjensas | rascasoft: Rocky and master does not use instack-undercloud | 10:19 |
| pvc | may i know if i can use a single nic? | 10:20 |
| pvc | also may i know what the NetworkDeployment do> | 10:20 |
| rascasoft | hjensas, oh, ok :) | 10:20 |
| pvc | on the overcloud deploy? | 10:20 |
| pvc | single nic for overcloud deploy | 10:20 |
| dtantsur | fultonj: this is not related to metalsmith work, the metalsmith work is about removing nova and glance from provisioning: https://review.openstack.org/604761. What you're talking about is what I'm calling "ironic federation", we're going to discuss it on the Forum. Oath is very interested in it. | 10:21 |
| rascasoft | hjensas, so the only other two places in which I see icmp-host-prohibited are in /usr/share/openstack-tripleo-heat-templates/ci/scripts/freeipa_setup.sh that should not affect us at all and another puppet module named midonet that to me is now and I don't think we use it | 10:22 |
| *** phuongnh has quit IRC | 10:22 | |
| *** phuongnh has joined #tripleo | 10:23 | |
| pvc | dtantsur | 10:24 |
| dtantsur | pvc: https://fedoraproject.org/wiki/No_naked_pings please | 10:25 |
| pvc | hi dtantsur can i use a single nic for my overcloud deploy? | 10:26 |
| fultonj | dtantsur: that's good stuff. even with nova/glance removed from provisioning i assume tripleo will still provison nodes and so having ironic federation would fit nicely with the split control plane plan | 10:29 |
| dtantsur | pvc: I think you can, but I'm not a tripleo networking expert. In the simplest case you can deploy without network isolation. Maybe you can also create tagged interfaces on top of the provisioning NIC on the OS level (when os-net-config runs). | 10:29 |
| dtantsur | fultonj: yep | 10:29 |
| pvc | Thank you so much | 10:29 |
| *** pvc has quit IRC | 10:36 | |
| bogdando | fultonj: thanks for the ref! | 10:37 |
| hjensas | rascasoft: sorry, got distracted. | 10:38 |
| *** phuongnh has quit IRC | 10:38 | |
| *** phuongnh has joined #tripleo | 10:39 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] add a job to test the reproducer https://review.openstack.org/604232 | 10:39 |
| *** Petersingh is now known as Petersingh|afk | 10:40 | |
| rascasoft | hjensas, no worries, I'm just thinking about that rule and why I see it now on master, making some comparisons, but my knowledge of these bits is too small | 10:40 |
| hjensas | rascasoft: sudo iptables -t nat -L FORWARD -v | 10:41 |
| hjensas | rascasoft: sudo iptables -L FORWARD -v | 10:41 |
| hjensas | rascasoft: can you put those in pastebin? | 10:41 |
| rascasoft | hjensas, sure: http://pastebin.test.redhat.com/652044 | 10:42 |
| hjensas | rascasoft: I see ' 0 0 ACCEPT all -- any any 10.0.0.0/24 anywhere' - I don't have 10.0.0.0/24 anywhere in my config, or any interface so why do we accept forwarding to that ... *sigh*. | 10:43 |
| hjensas | rascasoft: but the rules are correct. Allow rules for 192.168.24.0/24 comes prior to the reject rule, so the REJECT won't affect traffic from overcloud nodes. | 10:45 |
| rascasoft | hjensas, I tend to disagree | 10:45 |
| hjensas | rascasoft: explain. :) | 10:46 |
| rascasoft | hjensas, because the default gw for my overcloud hosts is default via 172.20.0.254 dev vlan2005 | 10:46 |
| rascasoft | hjensas, this means that traffic from the overcloud that will pass trhough the undercloud will come from 172.20.0.0/24 | 10:47 |
| rascasoft | hjensas, which means that that rule affects me | 10:47 |
| rascasoft | hjensas, and in fact removing it fixes the things | 10:47 |
| hjensas | rascasoft: Then why do you need the undercloud to forward packages? | 10:48 |
| rascasoft | hjensas, that's the question I can't answer, because I expect all of my overcloud traffic to be masqueraded | 10:48 |
| rascasoft | hjensas, ohhhh wait | 10:49 |
| hjensas | rascasoft: Where is 172.20.0.254 ? That's an external router? | 10:49 |
| rascasoft | hjensas, I think I understood | 10:49 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Use rdo mirror for q,p,o buildlogs at promotions https://review.openstack.org/604324 | 10:49 |
| hjensas | rascasoft: the overcloud nodes should'nt route traffic via the undercloud at all in your case. | 10:49 |
| openstackgerrit | Damien Ciabrini proposed openstack/puppet-tripleo master: mysql: fix root password update for containerized mysql https://review.openstack.org/602499 | 10:49 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Use rdo mirror for q,p,o buildlogs at promotions https://review.openstack.org/604324 | 10:49 |
| bogdando | dtantsur: an elf - smallest owl, may be cool to involve | 10:49 |
| rascasoft | hjensas, with the same setup, in rocky I get BOOTSTACK_MASQ all -- any any anywhere anywhere | 10:50 |
| rascasoft | hjensas, in master it is specified for just 10.0.0.0/24 (that I didn't EVER used) and 192.168.24.0/24 | 10:51 |
| rascasoft | hjensas, that's the problem | 10:51 |
| rascasoft | hjensas, keeping the FORWARD rule that, as you said, should not affect me | 10:51 |
| rascasoft | hjensas, and having a MASQUERADE for my external net should do the trick | 10:51 |
| bogdando | fultonj: added to agenda for today, but informational | 10:51 |
| rascasoft | hjensas, but I don't know how :) | 10:51 |
| dtantsur | bogdando++ | 10:52 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: move tripleo-ci release files inside CentOS-7 folder https://review.openstack.org/605642 | 10:52 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Create soft links for tripleo-ci release files https://review.openstack.org/605643 | 10:52 |
| fultonj | bogdando++ thanks | 10:52 |
| openstackgerrit | Merged openstack/tripleo-upgrade master: Configure undercloud for containerized upgrade. https://review.openstack.org/603151 | 10:52 |
| bogdando | so just a summary to expand into workable items | 10:52 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Retry id command for stack user https://review.openstack.org/602015 | 10:52 |
| hjensas | rascasoft: your overcloud nodes use 172.20.0.254 as the default gateway. 172.20.0.254 is not the undercloud? or is it? | 10:54 |
| rascasoft | hjensas, it is yes | 10:54 |
| *** udesale has quit IRC | 10:54 | |
| bogdando | dtantsur: is it T3 heavy penguins? | 10:54 |
| bogdando | or T2? | 10:54 |
| bogdando | wrt >> for a non-pigeon bm provisioning solution we need to speed up the metalsmith work | 10:54 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Use rdo mirror for q,p,o buildlogs at promotions https://review.openstack.org/604324 | 10:55 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart master: Use rdo mirror for q,p,o buildlogs at promotions https://review.openstack.org/604324 | 10:56 |
| *** shyamb has quit IRC | 10:56 | |
| dtantsur | heavy penguins, lol | 10:57 |
| dtantsur | well, an emperor penguin can weight up to 35kg | 10:57 |
| quiquell | ykarel, jaosorior: Fixed the review about mirror at promotions release files https://review.openstack.org/#/c/604324 | 10:58 |
| rascasoft | hjensas, is it clear to you why in rocky this is working and in master not? Did I make myself clear? | 10:58 |
| *** shyamb has joined #tripleo | 10:58 | |
| rascasoft | hjensas, to be it would be just a matter of adding a MASQUERADE rule for that interface | 10:59 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-docs master: Simplify / tidy up dev docs for upgrades https://review.openstack.org/605648 | 11:01 |
| *** sanjayu_ has joined #tripleo | 11:02 | |
| hjensas | rascasoft: yes, I hear that you say it works on Rocky. But I don't understand your setup. Using the undercloud as a router but not on the ctlplane interface. I don't think we intended for that. | 11:02 |
| *** saneax has quit IRC | 11:04 | |
| * bogdando thinks of an armored penguins now, like Starcraft 2 Thors T3 units | 11:04 | |
| *** jpena is now known as jpena|lunch | 11:06 | |
| *** amoralej is now known as amoralej|lunch | 11:06 | |
| *** thrash|g0ne is now known as thrash | 11:08 | |
| chandankumar | marios: is it a known issue 2018-09-27 05:35:37 | Introspection of node add47903-756d-4d9b-b66e-958cd2bac4fc completed. Status:FAILED. Errors:Failed to set boot device to PXE: Node add47903-756d-4d9b-b66e-958cd2bac4fc is locked by host undercloud.localdomain, please retry after the current operation is completed. (HTTP 409) | 11:10 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 11:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 11:10 |
| chandankumar | marios: http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-rocky/dbe29a5/logs/undercloud/home/zuul/overcloud_prep_images.log.txt.gz | 11:10 |
| chandankumar | marios: http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-rocky/dbe29a5/logs/undercloud/var/log/containers/ironic/app.log.txt.gz | 11:11 |
| chandankumar | DEBUG wsme.api [req-036bb712-8b88-4acb-af12-49dd1e8f3876 46fc88d409a14705a76adca69bc77a74 e2ffffd498ac47eea5ebaeb5ed56aca4 - default default] Client-side error: Node add47903-756d-4d9b-b66e-958cd2bac4fc is locked by host undercloud.localdomain, please retry after the current operation is completed. | 11:12 |
| *** vinaykns has quit IRC | 11:13 | |
| jaosorior | quiquell: ack | 11:13 |
| openstackgerrit | Honza Pokorny proposed openstack/puppet-tripleo master: [ui] Add option to configure apache expires https://review.openstack.org/589572 | 11:18 |
| *** Petersingh|afk is now known as Petersingh | 11:20 | |
| marios | chandankumar: is that the same issue though? when i checked earlier i couldn't find the same trace on rocky only pike/queens | 11:20 |
| chandankumar | marios: nope, it appears to be different | 11:21 |
| chandankumar | marios: it is seen on rocky currently one | 11:27 |
| chandankumar | *only | 11:27 |
| *** quiquell is now known as quiquell|lunch | 11:27 | |
| openstackgerrit | Udi Kalifon proposed openstack/tempest-tripleo-ui master: Selenium infra https://review.openstack.org/605424 | 11:28 |
| *** fhubik is now known as fhubik|brb | 11:29 | |
| *** dprince has joined #tripleo | 11:29 | |
| *** abishop has joined #tripleo | 11:32 | |
| *** ykarel_ has joined #tripleo | 11:37 | |
| *** ssbarnea|bkp has joined #tripleo | 11:37 | |
| ykarel_ | quiquell|lunch, ack | 11:38 |
| *** ykarel has quit IRC | 11:39 | |
| *** ratailor has quit IRC | 11:40 | |
| *** pvc has joined #tripleo | 11:41 | |
| *** quiquell|lunch is now known as quiquell | 11:43 | |
| *** tosky__ has joined #tripleo | 11:44 | |
| *** tosky has quit IRC | 11:44 | |
| *** tosky has joined #tripleo | 11:45 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Enable ceilometer-agent-compute health check https://review.openstack.org/552501 | 11:45 |
| *** dprince has quit IRC | 11:46 | |
| pvc | hi guys anyone not busy? | 11:48 |
| *** phuongnh has quit IRC | 11:48 | |
| *** pcaruana has quit IRC | 11:50 | |
| pvc | dtantsur can you enlighten me on the steps does the overcloud do? | 11:55 |
| pvc | after it launch the overcloud server | 11:55 |
| *** rfolco has joined #tripleo | 11:56 | |
| pvc | or if ever can i decrease the timeout of my overcloud deploy so it will failed fast | 11:57 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Do not enforce libguestfs emulation mode https://review.openstack.org/595566 | 11:58 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Enable fluentd health check https://review.openstack.org/563881 | 11:58 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Use python3 for tox linting https://review.openstack.org/588587 | 11:58 |
| openstackgerrit | Merged openstack/tripleo-common master: Optimize Heat stack check when processing roles https://review.openstack.org/605029 | 11:58 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Pacemaker-cinder-volume & pacemaker-cinder-backup log path fix https://review.openstack.org/597462 | 11:58 |
| openstackgerrit | Merged openstack/tripleo-common stable/rocky: Add workflow for config-download export https://review.openstack.org/604884 | 11:58 |
| openstackgerrit | Merged openstack/python-tripleoclient stable/rocky: Use workflow config_download_export https://review.openstack.org/604885 | 11:58 |
| *** lblanchard has joined #tripleo | 11:59 | |
| dtantsur | pvc: http://tripleo.org/install/introduction/architecture.html#deployment-workflow-overview may help | 12:02 |
| *** yprokule has quit IRC | 12:04 | |
| pvc | thank you so much dtantsur it seems my overcloud is stuck up on NetworkDeployment progress. We'll wait the overcloud to fail to check the logs. | 12:04 |
| *** yprokule has joined #tripleo | 12:06 | |
| *** trown|outtypewww is now known as trown | 12:06 | |
| *** salmankhan has quit IRC | 12:08 | |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade stable/rocky: Configure undercloud for containerized upgrade. https://review.openstack.org/605663 | 12:09 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 12:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 12:10 |
| *** artom has quit IRC | 12:12 | |
| *** shyamb has quit IRC | 12:13 | |
| *** shyamb has joined #tripleo | 12:14 | |
| shardy_mtg | pvc: as we discussed yesterday, NetworkDeployment applies the network configuration, the tool used is called os-net-config https://github.com/openstack/os-net-config, and the configuration is specified via templates e.g OS::TripleO::Controller::Net::SoftwareConfig | 12:14 |
| *** shardy_mtg is now known as shardy | 12:14 | |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.j2.yaml#L34 | 12:14 |
| pvc | it seems the instances doesnt get the /etc/os-net-config folder shardy | 12:15 |
| shardy | pvc: on which node, Controller or Compute? | 12:15 |
| *** tosky__ has quit IRC | 12:15 | |
| *** jamesdenton has joined #tripleo | 12:16 | |
| mschuppert | mwhahaha: EmilienM could you please review backport https://review.openstack.org/#/c/587066/ ? | 12:16 |
| EmilienM | mschuppert: yes | 12:17 |
| mschuppert | EmilienM: thx a lot! | 12:17 |
| pvc | may i know if i can ask shardy if doesnt pass an environment that saying if it is multiple nics or single nic, what template it will run by default? | 12:18 |
| shardy | pvc: as I said yesterday the default template is net-config-bridge.yaml | 12:18 |
| shardy | for Controller nodes | 12:18 |
| shardy | and OS::TripleO::{{role.name}}::Net::SoftwareConfig: net-config-noop.yaml for everything else | 12:19 |
| shardy | which means no configuration at all is expected by default on non-controller roles | 12:19 |
| shardy | typically on baremetal you want to provide some sort of configuration, but that's enough for basic VM testing | 12:19 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.j2.yaml#L29 | 12:19 |
| shardy | http://paste.openstack.org/show/731005/ | 12:19 |
| shardy | pvc: if you provided no -e arguments ^^ should exist on your overcloud-controller-0 node | 12:20 |
| shardy | and I show how to run it with debugging enabled if that config is not working | 12:20 |
| shardy | https://github.com/openstack/os-net-config/tree/master/etc/os-net-config/samples has a bunch of examples of the json for os-net-config | 12:21 |
| shardy | which is the same format used in the template examples e.g https://github.com/openstack/tripleo-heat-templates/tree/master/network/config | 12:21 |
| *** rlandy has joined #tripleo | 12:22 | |
| *** ade_lee has quit IRC | 12:22 | |
| *** pvc has quit IRC | 12:23 | |
| openstackgerrit | Merged openstack/python-tripleoclient stable/rocky: Add a guard to break if no connection https://review.openstack.org/603804 | 12:24 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Cleanup ControllerStorageNfs role https://review.openstack.org/601137 | 12:24 |
| openstackgerrit | Merged openstack/tripleo-common master: Remove non-voting jobs from the gate https://review.openstack.org/603419 | 12:24 |
| openstackgerrit | Merged openstack/tripleo-common stable/rocky: Set SSH server keep alive options https://review.openstack.org/604455 | 12:24 |
| openstackgerrit | Merged openstack/os-net-config master: Restart ivs/nvfswitch after config file is updated https://review.openstack.org/604901 | 12:24 |
| openstackgerrit | Merged openstack/tripleo-common stable/rocky: config: ignore missing server_id from the stack https://review.openstack.org/605412 | 12:24 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Pass NeutronMechanismDrivers parameter to prepare https://review.openstack.org/604952 | 12:24 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/rocky: Set container_images_file for containerized undercloud. https://review.openstack.org/602045 | 12:24 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Allow to run bootstrap containers in privileged mode. https://review.openstack.org/600533 | 12:25 |
| *** dprince has joined #tripleo | 12:25 | |
| *** tzumainn has joined #tripleo | 12:26 | |
| shardy | \o/ merging patches :) | 12:30 |
| trown | so much merging | 12:30 |
| weshay | shardy, :) | 12:30 |
| openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates stable/rocky: Cleanup ControllerStorageNfs role https://review.openstack.org/605667 | 12:30 |
| *** abishop has quit IRC | 12:31 | |
| quiquell | shardy: They will introduce new timeouts :-P | 12:31 |
| *** abishop has joined #tripleo | 12:32 | |
| weshay | mwhahaha, are you able to join a ci planning mtg in the near future.. 30-60min? | 12:32 |
| weshay | EmilienM, ^ | 12:32 |
| EmilienM | yes | 12:32 |
| *** pvc has joined #tripleo | 12:33 | |
| openstackgerrit | Bob Fournier proposed openstack/os-net-config stable/rocky: Restart ivs/nvfswitch after config file is updated https://review.openstack.org/605668 | 12:33 |
| *** jpena|lunch is now known as jpena | 12:34 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Document the KVM accelerated mode for building VMs https://review.openstack.org/605483 | 12:34 |
| mwhahaha | weshay: no | 12:38 |
| *** fhubik|brb has quit IRC | 12:39 | |
| *** pcaruana has joined #tripleo | 12:39 | |
| dtantsur | given the merges above, is the CI still RED? | 12:41 |
| *** amoralej|lunch is now known as amoralej | 12:42 | |
| *** ykarel_ is now known as ykarel | 12:44 | |
| *** ansmith has joined #tripleo | 12:44 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: Collect ARA stats as user, not root https://review.openstack.org/605678 | 12:46 |
| *** shyam89 has joined #tripleo | 12:50 | |
| *** toure|gone is now known as toure | 12:50 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Remove unused bootstrap-config.yaml https://review.openstack.org/605009 | 12:51 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Convert *tasks from bootstrap_nodeid to short_bootstrap_node_name https://review.openstack.org/605430 | 12:51 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Remove unused tls-cert-inject.yaml template https://review.openstack.org/605491 | 12:51 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add SERVICE_bootstrap_node_ip values to allNodesConfig https://review.openstack.org/605492 | 12:51 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Remove common bootstrap_nodeid from deploy_steps/tripleo-packages.yaml https://review.openstack.org/605682 | 12:51 |
| *** shyamb has quit IRC | 12:52 | |
| *** ramishra has quit IRC | 12:54 | |
| *** shyam89 has quit IRC | 12:55 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Move environment_type to the new base jobs https://review.openstack.org/605689 | 12:56 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Move environment_type to the new base jobs https://review.openstack.org/605689 | 12:58 |
| *** agopi has quit IRC | 12:58 | |
| *** mcornea has joined #tripleo | 12:59 | |
| chandankumar | EmilienM: Hello | 12:59 |
| EmilienM | chandankumar: yo | 12:59 |
| chandankumar | EmilienM: fs027 podman is failing while pulling container http://logs.openstack.org/17/600517/35/check/tripleo-ci-centos-7-undercloud-containers/2230845/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-09-27_03_16_15 | 12:59 |
| EmilienM | chandankumar: I know | 13:00 |
| chandankumar | EmilienM: I am not sure what is wrong going there | 13:00 |
| EmilienM | I'm investigating | 13:00 |
| chandankumar | EmilienM: thanks | 13:00 |
| EmilienM | and it's random, I didn't have it the other day | 13:00 |
| chandankumar | EmilienM: Will i recheck ? | 13:00 |
| *** raildo has joined #tripleo | 13:01 | |
| EmilienM | not useful | 13:01 |
| EmilienM | we need to track down this problem | 13:01 |
| chandankumar | ack | 13:01 |
| *** haleyb has joined #tripleo | 13:05 | |
| weshay | EmilienM, when ever you have time in the next 30 min | 13:07 |
| EmilienM | weshay: i think we should wait for mwhahaha | 13:08 |
| weshay | mwhahaha, so when? | 13:08 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 13:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 13:10 |
| mwhahaha | weshay: 30mins | 13:12 |
| weshay | mwhahaha, perfect thanks! EmilienM ^ | 13:12 |
| mwhahaha | Dealing with kids -> bus | 13:12 |
| EmilienM | ok see you in 30 | 13:12 |
| *** dhill_ has quit IRC | 13:13 | |
| *** dhill_ has joined #tripleo | 13:14 | |
| *** abishop has quit IRC | 13:15 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Document fedora28 cloud image example a VM deploy https://review.openstack.org/605696 | 13:17 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Document fedora28 cloud image example a VM deploy https://review.openstack.org/605696 | 13:18 |
| *** bnemec has joined #tripleo | 13:18 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Restart os-collect-config if journald was restarted. https://review.openstack.org/605698 | 13:19 |
| *** mjturek has joined #tripleo | 13:20 | |
| *** agopi has joined #tripleo | 13:20 | |
| fultonj | weshay: i want to add a CI scenario for the split control plane https://blueprints.launchpad.net/tripleo/+spec/split-controlplane-ci | 13:21 |
| *** ramishra has joined #tripleo | 13:22 | |
| fultonj | weshay: i recall a doc on adding a new oooq scenario which i could start with, but wondered about using standalone in place of it | 13:22 |
| fultonj | weshay: any advice? | 13:22 |
| weshay | fultonj, ya.. /me gets | 13:23 |
| weshay | https://github.com/openstack/tripleo-heat-templates/blob/master/README.rst#service-testing-matrix | 13:23 |
| fultonj | weshay: so a new column e.g. scn11 | 13:24 |
| *** skramaja has quit IRC | 13:33 | |
| weshay | fultonj, ya. good idea to add it to the next tripleo mtg | 13:33 |
| weshay | fultonj, https://etherpad.openstack.org/p/tripleo-meeting-items | 13:34 |
| fultonj | weshay: i think i want to add featureset056.yml which tests this | 13:35 |
| fultonj | i guess i could drop in a review for it | 13:35 |
| fultonj | weshay: do you know if oooq will be driving the standalone CI jobs? | 13:36 |
| fultonj | is it too early to say? | 13:36 |
| *** psachin has quit IRC | 13:36 | |
| weshay | we're about to talk about that.. | 13:36 |
| weshay | everything we do we do in concert and harmony w/ the tripleo ptl jaosorior :) | 13:36 |
| weshay | and the rest of the team | 13:36 |
| fultonj | weshay: ok, i'll keep going w/ oooq as it is and await your news when you have it | 13:38 |
| jaosorior | <_< | 13:39 |
| jaosorior | >_> | 13:39 |
| jaosorior | fultonj: that's the job with 3 nodes you were talking about, for the split ctlplane work, right? | 13:39 |
| fultonj | jaosorior: yeah | 13:39 |
| fultonj | weshay: FWIW we're probably going to talk about this some at the edge working group | 13:39 |
| fultonj | https://etherpad.openstack.org/p/tripleo-edge-squad-status | 13:40 |
| jaosorior | fultonj: I'll be joining too | 13:40 |
| beagles | chem,marios: when you get a sec can you have a look at https://review.openstack.org/#/c/605200/ - its openvswitch ugprade once again. Feel free to ping me about the inevitable "what the...?" questions | 13:40 |
| mwhahaha | weshay: k so where is this magical meeting? | 13:40 |
| EmilienM | mwhahaha: https://bluejeans.com/7050859455/ | 13:40 |
| fultonj | EmilienM: is ^ about using standalone in CI? | 13:40 |
| fultonj | or something else? | 13:40 |
| EmilienM | fultonj: yes | 13:40 |
| fultonj | can i listen? | 13:41 |
| EmilienM | fultonj: please join the party | 13:41 |
| *** abishop has joined #tripleo | 13:41 | |
| fultonj | gfidente: fyi ^ | 13:42 |
| *** rh-jelabarre has joined #tripleo | 13:43 | |
| *** salmankhan has joined #tripleo | 13:45 | |
| *** abishop has quit IRC | 13:48 | |
| *** abishop has joined #tripleo | 13:48 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: YAML NIC Config 2 script - fix comment indentation https://review.openstack.org/605722 | 13:53 |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: WIP - Telemetry Framework https://review.openstack.org/605724 | 13:54 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Handle LP openvswitch meta-package on upgrade https://review.openstack.org/605200 | 13:55 |
| *** itlinux has quit IRC | 13:59 | |
| *** ykarel has quit IRC | 13:59 | |
| openstackgerrit | Steven Hardy proposed openstack/puppet-tripleo master: Replace bootstrap_nodeid with SERVICE_short_bootstrap_node_name https://review.openstack.org/605728 | 13:59 |
| mwhahaha | fultonj: https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L14 | 13:59 |
| mwhahaha | fultonj: https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset052.yml | 14:00 |
| slagle | edge squad meeting time | 14:01 |
| fultonj | mwhahaha: thanks, i'll study and see if i can make a variation with what i'm looking for | 14:01 |
| slagle | #startmeeting TripleO Edge Squad Meeting | 14:01 |
| slagle | ping slagle, emilien, csatari, jaosorior, owalsh, fultonj, gfidente, hjensas, jtomasek,thrash, bogdando, dtantsur, rbrady | 14:01 |
| openstack | Meeting started Thu Sep 27 14:01:18 2018 UTC and is due to finish in 60 minutes. The chair is slagle. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:01 |
| *** openstack changes topic to " (Meeting topic: TripleO Edge Squad Meeting)" | 14:01 | |
| slagle | #info remove or update your nick from the Meeting Template on the etherpad if you want (or don't want) to be ping'd for the start of the meeting | 14:01 |
| openstack | The meeting name has been set to 'tripleo_edge_squad_meeting' | 14:01 |
| slagle | #link https://etherpad.openstack.org/p/tripleo-edge-squad-status | 14:01 |
| slagle | Anyone can use the #link, #action, #help, #idea and #info commands, not just the moderatorǃ | 14:01 |
| bogdando | o/ | 14:01 |
| slagle | #info remove or update your nick from the Meeting Template on the etherpad if you want (or don't want) to be ping'd for the start of the meeting | 14:01 |
| hjensas | o/ | 14:01 |
| fultonj | o/ | 14:01 |
| slagle | #link https://etherpad.openstack.org/p/tripleo-edge-squad-status | 14:01 |
| owalsh | o/ | 14:01 |
| EmilienM | o/ | 14:02 |
| jaosorior | o/ | 14:02 |
| dtantsur | o/ | 14:02 |
| slagle | hi everyone | 14:02 |
| shardy | o/ | 14:02 |
| slagle | #topic Agenda | 14:02 |
| slagle | * Review past action items | 14:02 |
| slagle | * One off items | 14:02 |
| slagle | * Ongoing Work | 14:02 |
| slagle | * New Work/Specs | 14:02 |
| *** openstack changes topic to "Agenda (Meeting topic: TripleO Edge Squad Meeting)" | 14:03 | |
| slagle | * Review Requests | 14:03 |
| slagle | * Goals for the week | 14:03 |
| slagle | #topic Review past action items | 14:03 |
| *** openstack changes topic to "Review past action items (Meeting topic: TripleO Edge Squad Meeting)" | 14:03 | |
| slagle | bogdando fultonj gfidente refine tripleo split-controlplane use case and see how it lines up with proposed Edge architecture from PTG | 14:03 |
| fultonj | Refine tripleo split-controlplane use case and see how it lines up with proposed Edge architecture from PTG | 14:03 |
| slagle | :) | 14:03 |
| fultonj | https://etherpad.openstack.org/p/tripleo-edge-working-group-split-control-plane | 14:03 |
| fultonj | slagle: i think ^ might cover that | 14:03 |
| fultonj | feedback welcome though | 14:04 |
| bogdando | and from my side, there is also something to review and align with | 14:04 |
| bogdando | #link https://etherpad.openstack.org/p/tripleo-edge-mvp | 14:04 |
| fultonj | #link https://etherpad.openstack.org/p/tripleo-edge-working-group-split-control-plane | 14:04 |
| slagle | great, this looks good. a lot of data to digest though | 14:04 |
| slagle | anything to highlight? | 14:05 |
| bogdando | concerns imo | 14:05 |
| bogdando | we need to remove contradictional things | 14:05 |
| bogdando | not now, ofc | 14:05 |
| gfidente | slagle we don't cover yet how to deploy the "main site" and in that context the glance images distribution poses some more challenges | 14:05 |
| openstackgerrit | Bob Fournier proposed openstack/tripleo-heat-templates master: In process-templates script write output files to provided dir when using base path https://review.openstack.org/605736 | 14:05 |
| *** Vorrtex has joined #tripleo | 14:06 | |
| gfidente | slagle but it matches pretty closely the edge/far-edge scenario though we use different terminology : ctlplane/edge | 14:06 |
| slagle | bogdando: would you say the point of your etherpad is to define the mvp? | 14:06 |
| fultonj | my highlight is that the edge working group's diagrams and compatible with the proposal in the split control plane | 14:06 |
| bogdando | slagle: there is 4 goals | 14:06 |
| bogdando | one of those is indeed define MVP | 14:07 |
| bogdando | and meet the goal 4 as well | 14:07 |
| bogdando | so it wouldn't look contradictional | 14:07 |
| slagle | bogdando: ok, so we may want to focus on what is needed in addition to split-controlplane to get to a MVP we agree on | 14:07 |
| *** artom has joined #tripleo | 14:08 | |
| bogdando | right | 14:08 |
| fultonj | bogdando: please be specific if you see contradictions in MVP defined in https://etherpad.openstack.org/p/tripleo-edge-working-group-split-control-plane | 14:08 |
| slagle | b/c i think we all mostly agree split-controlplane is the first step | 14:08 |
| slagle | but is not necessarily an MVP? | 14:08 |
| bogdando | fultonj: not there, by another link | 14:08 |
| fultonj | slagle: yeah, it doens't exactly have to be an MVP as much as step1 | 14:08 |
| bogdando | so I just captured all the contradictional view points there, raised just for a one day of discussions | 14:08 |
| slagle | fultonj: yep, thinking the same | 14:08 |
| slagle | bogdando: ok, i think this good to work through | 14:09 |
| bogdando | so it's very high level | 14:09 |
| dtantsur | one of the things is that someone do not consider MVP "V" without some provisioning approach | 14:09 |
| bogdando | to agree on terms at very least | 14:09 |
| slagle | let's all take an action to review your etherpad and continue the discussion there or on irc | 14:09 |
| slagle | sound good? | 14:09 |
| bogdando | yeah | 14:09 |
| slagle | #action all: review https://etherpad.openstack.org/p/tripleo-edge-mvp and discuss | 14:10 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 14:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 14:10 |
| bogdando | although I'd like to see the resulting bullet points (removed contradictional statements) in some spec... not just having discussions... | 14:10 |
| bogdando | example: single operator view is a cool idea/is a must | 14:11 |
| slagle | yes, one of the goals should be a spec documenting terms and the MVP | 14:11 |
| slagle | we could start with that, and then have discussion on the spec patch? | 14:11 |
| slagle | initially, etherpad seems a bit more fluid | 14:11 |
| slagle | but no objection if you want to throw up an initial spec | 14:11 |
| bogdando | I hope we already have some to edit? | 14:11 |
| slagle | a spec? | 14:12 |
| bogdando | yes | 14:12 |
| fultonj | we don't | 14:12 |
| fultonj | that i know of | 14:12 |
| slagle | don't think so, other than split-controlplane | 14:12 |
| bogdando | ok | 14:12 |
| bogdando | so we can update that one | 14:12 |
| bogdando | fits ideally | 14:12 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP DNR Unify rabbitmq bind mounts and env vars https://review.openstack.org/605598 | 14:12 |
| slagle | i think it should be a new one | 14:12 |
| bogdando | just that a person who updates it cannot resolve concerns on his/her own, cuz that's a conflicting view points we have | 14:13 |
| fultonj | split control plane spec merged | 14:13 |
| bogdando | we can amend | 14:13 |
| fultonj | blue prints exist | 14:13 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: Put create repo script into its own tasks file. https://review.openstack.org/605369 | 14:13 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: Add new featureset 056 for standalone upgarde. https://review.openstack.org/605363 | 14:13 |
| slagle | i don't really see much to amend in the split-controlplane spec | 14:13 |
| slagle | again, that work stands on its own | 14:13 |
| bogdando | I'm not sure we need another spec. The concerns and goals in that ehterpad ideally fit into the split control plane | 14:13 |
| dtantsur | the split-controlplane lacks the main site, it only has edge and far edge (hell, I hate these terms :) | 14:14 |
| bogdando | but if you insist... | 14:14 |
| bogdando | yes, that's one of the concerns | 14:14 |
| bogdando | worth amending | 14:14 |
| dtantsur | only it completely omits any undercloud business, except for shy "Director" somewhere in the corner | 14:15 |
| dtantsur | s/only/also/ | 14:15 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Add standalone upgrade role and playbook. https://review.openstack.org/604736 | 14:15 |
| fultonj | the UC is implicit we're deploying to heat stacks | 14:15 |
| slagle | dtantsur: bogdando that's because it's not what you're trying to redefine it as | 14:15 |
| * dtantsur ParseError | 14:16 | |
| *** Petersingh is now known as Petersingh|away | 14:16 | |
| slagle | it's simply what we do today, deploy 2 heat stacks | 14:16 |
| dtantsur | fultonj: if I take that picture literally, it implies one traditional undercloud per Edge | 14:16 |
| owalsh | or three stack (should work too) | 14:16 |
| fultonj | dtantsur: no | 14:16 |
| dtantsur | fultonj: then it needs updating | 14:16 |
| fultonj | i think there's a misunderstanding then | 14:16 |
| slagle | owalsh: yes, multiple compute stacks | 14:16 |
| owalsh | slagle: I mean tiers of stacks | 14:17 |
| fultonj | one undercloud | 14:17 |
| fultonj | multiple stacks | 14:17 |
| bogdando | see, we reading that spec differently right now, again | 14:17 |
| dtantsur | I think we should clean up and clarify that spec a bit, but not turn it into a full Edge spec | 14:17 |
| slagle | ok | 14:17 |
| bogdando | some of the points, captured by that etherpad, and I see the only action item is to update the spec so we all read it the same way | 14:17 |
| slagle | who is going to propose the amendment? then we can figure it out in the review | 14:17 |
| fultonj | split control plane covers a specific area | 14:18 |
| bogdando | w/o asking would we have Ironic central or federated or none | 14:18 |
| dtantsur | yeah, let's leave ironic for the 2nd spec | 14:18 |
| fultonj | i think ironic federation would be compatible but a separate probelm | 14:18 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-upgrade master: Update required packages for containerized undercloud upgrade https://review.openstack.org/605745 | 14:18 |
| bogdando | and more examples, just look into the open concerns please :) | 14:18 |
| bogdando | goal 4 | 14:18 |
| jistr | quiquell: i think this is it, the patch ^^ | 14:18 |
| dtantsur | for now it's enough to provide some vision for the undercloud OR explicitly say we deal with it later | 14:18 |
| jistr | quiquell: i'll add depends-on to the branch switch | 14:18 |
| hjensas | don't we want to have some distribution of undercloud? i.e images, inspector dhcp etc. very light weight with focus on not having to transfer too much data all the way to main site? (so edge has tiny-uc's, far-edge just the overcloud) ? | 14:18 |
| dtantsur | (later means in the next spec, not after MVP IMO) | 14:18 |
| bogdando | ok then, not sure for the action here... 2nd spec or amending... or both | 14:18 |
| fultonj | for the second AI i filed blueprints and it's clear how to proceed for me and others working on split control plane | 14:18 |
| dtantsur | hjensas: we do, just not in this particular spec (again, IMO) | 14:19 |
| slagle | fultonj: agreed | 14:19 |
| bogdando | slagle: before amending, we need to resolve conflicts in the etherpad perhaps | 14:19 |
| dtantsur | but we do need it for MVP | 14:19 |
| bogdando | then just dump the resulting | 14:19 |
| bogdando | I can do the latter | 14:19 |
| slagle | bogdando: dtantsur : you seem to not be clear about the scope of the split-controlplane spec? | 14:19 |
| *** Petersingh|away has quit IRC | 14:19 | |
| dtantsur | slagle: actually, I suggest not to increase it | 14:19 |
| *** lblanchard has quit IRC | 14:19 | |
| fultonj | dtantsur: agree | 14:19 |
| bogdando | ok, so another spec then | 14:19 |
| slagle | yes | 14:19 |
| dtantsur | only clarify and say explicitly what we leave out of it (e.g. undercloud) | 14:19 |
| slagle | ok, then bogdando :) | 14:19 |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Switch previous release of master from 'queens' to 'rocky' https://review.openstack.org/590774 | 14:19 |
| quiquell | jistr: ack | 14:19 |
| bogdando | just let please firstly fix contraditions ) | 14:19 |
| fultonj | thanks bogdando | 14:20 |
| quiquell | jistr: let's see | 14:20 |
| dtantsur | what I think we may disagree on is the scope of the MVP | 14:20 |
| fultonj | i would love to identify any contradictions i don't see any but please show me | 14:20 |
| fultonj | i think there will be many MVPs | 14:20 |
| slagle | bogdando: i'm not seeing how your contradictions relate to the split-controlplane spec | 14:20 |
| *** geneliu has left #tripleo | 14:20 | |
| bogdando | fultonj: see lines 53 and to the end | 14:20 |
| bogdando | https://etherpad.openstack.org/p/tripleo-edge-mvp | 14:20 |
| slagle | bogdando: please make this part more clear, or propose an amendment to the existing spec so we can discuss there | 14:20 |
| bogdando | those are all contradictional statements, including the scope of MVP | 14:21 |
| fultonj | i read that we should unpack that more | 14:21 |
| *** ade_lee has joined #tripleo | 14:21 | |
| slagle | bogdando: again, what i'm asking for is, if you think the split-controlplane spec is not clear, to address that | 14:21 |
| slagle | otherwise, let's move on | 14:21 |
| bogdando | ok, that may be an action item, to unpack it, before drafting an MVP spec | 14:21 |
| bogdando | makes sense? | 14:21 |
| bogdando | as far as dtantsur agrees Ironic for edge fits a new spec, I agree as well, so we need no to update that spec | 14:22 |
| * dtantsur agrees | 14:22 | |
| fultonj | bogdando: ok | 14:22 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Add ability to specify undercloud install command https://review.openstack.org/605747 | 14:23 |
| fultonj | there was a second action item | 14:23 |
| slagle | #agreed split-controlplane needs no updates and scope is clear based on filed blueprints | 14:23 |
| fultonj | File blueprints for split-controlplane work in stein | 14:23 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack-infra/tripleo-ci master: New workflow for standalone upgrade. https://review.openstack.org/604706 | 14:23 |
| fultonj | #link https://blueprints.launchpad.net/tripleo/+spec/split-controlplane | 14:23 |
| fultonj | the above blueprint has 3 blueprints which depend on it | 14:23 |
| slagle | i think it looks pretty good | 14:24 |
| slagle | i added a couple | 14:24 |
| dtantsur | yeah, the way this blueprint is written it's not even edge-specific, just a good feature to have | 14:24 |
| fultonj | slagle: nice | 14:24 |
| slagle | dtantsur: +1 | 14:24 |
| fultonj | template + workflow | 14:24 |
| bogdando | to be clear, we have nothing to amend to that spec from https://etherpad.openstack.org/p/tripleo-edge-working-group-split-control-plane ? | 14:24 |
| dtantsur | https://blueprints.launchpad.net/tripleo/+spec/split-controlplane-workflow may use some final decision on the ironic bits | 14:25 |
| bogdando | indeed | 14:25 |
| fultonj | dtantsur: yeah, it's something you can apply to edge | 14:25 |
| slagle | bogdando: yes, see earlier #agreed | 14:25 |
| slagle | it's settled :) | 14:25 |
| bogdando | ok | 14:25 |
| bogdando | ...some final decision on the ironic bits | 14:25 |
| openstackgerrit | Kamil Sambor proposed openstack/tripleo-heat-templates master: Add posibilities to set tunnel_csum in ovs agent https://review.openstack.org/605033 | 14:25 |
| bogdando | ruins a little bit that but ok | 14:25 |
| dtantsur | well, the final decision for this blueprint can be: use pigeons | 14:25 |
| bogdando | we'll make a 2nd spec for that, a partially contradictional to the split CP :) | 14:26 |
| dtantsur | which is probably a good idea to avoid the scope creep | 14:26 |
| * fultonj awaits statements of the form (P & ~P) | 14:26 | |
| dtantsur | and then we need a blueprint to figure out provisioning the servers (with a long and contentious spec attached to it :) | 14:26 |
| fultonj | dtantsur: yeah i agree | 14:27 |
| slagle | alright, other AI's? | 14:28 |
| slagle | dtantsur: do you plan to file this spec this week, or await more discussion? | 14:28 |
| dtantsur | slagle: oh, I hope bogdando will do it :D | 14:29 |
| dtantsur | but I can, if bogdando touched nose earlier :) | 14:29 |
| bogdando | I can, just please see my comment for unpacking | 14:29 |
| bogdando | that should predate creating spec | 14:29 |
| fultonj | #action fultonj to get feedback from tripleo CI group on https://blueprints.launchpad.net/tripleo/+spec/split-controlplane-ci | 14:29 |
| dtantsur | bogdando: I'll help with any assumptions/expectations around ironic | 14:29 |
| slagle | alright, well we already took an action to review that etherpad | 14:29 |
| slagle | so we'll wait on the spec | 14:29 |
| bogdando | ok, thanks! | 14:29 |
| slagle | #agenda One Off items | 14:30 |
| slagle | #topic One Off items | 14:30 |
| *** openstack changes topic to "One Off items (Meeting topic: TripleO Edge Squad Meeting)" | 14:30 | |
| bogdando | note, it would be nice if someone can capture ongoing daily discussions in a from like that I did IMO | 14:30 |
| bogdando | at least showing off contradictional things among folks | 14:30 |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Fix nova-placement healthcheck https://review.openstack.org/604272 | 14:30 |
| slagle | anything to highlight here? | 14:31 |
| fultonj | we do have a meeting bot | 14:31 |
| jistr | quiquell: sorry for pushing the tripleo-current promote, this time it was probably a red herring. It didn't click to me that it's actually t-h-t which is wrong, and that's taken from the bare metal host RPM. (Though if we don't have latest content in containers, we could still hit different issues potentially...) | 14:31 |
| fultonj | regarding CI | 14:31 |
| *** jistr is now known as jistr|call | 14:31 | |
| fultonj | i'm condering a using the standalone examples | 14:31 |
| bogdando | fultonj: I did not mean the meeting notes | 14:31 |
| slagle | fultonj: you mean standalone to deploy the separate compute? | 14:32 |
| fultonj | slagle: yeah | 14:32 |
| fultonj | tripleo-ci has stand-alone jobs... | 14:32 |
| fultonj | https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L14 | 14:32 |
| fultonj | #https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L14 | 14:32 |
| slagle | it should work. EmilienM and I experimented with that a few weeks back | 14:32 |
| fultonj | #link https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L14 | 14:32 |
| EmilienM | it was fun | 14:33 |
| slagle | i agree it might be easier initially, until we have the whole workflow in place | 14:33 |
| fultonj | #link https://gitlab.com/slagle/tripleo-standalone-edge/blob/master/standalone-central.sh | 14:33 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart master: Pull in instack-undercloud https://review.openstack.org/605753 | 14:33 |
| EmilienM | #link https://gitlab.com/emacchi/tripleo-standalone-edge | 14:33 |
| EmilienM | oh thanks fultonj | 14:34 |
| slagle | the job could even be 2 standalones. no UC | 14:34 |
| EmilienM | (just a note about that repo: it was an afternoon project and really basic/RAW) | 14:34 |
| gfidente | EmilienM I thought you only worked early mornings | 14:34 |
| EmilienM | well I even got a PR from slagle so | 14:34 |
| slagle | #idea use standalone for split-controlplane CI | 14:34 |
| openstackgerrit | Alex Schultz proposed openstack/instack-undercloud master: DNM: testing ci https://review.openstack.org/605755 | 14:35 |
| fultonj | owalsh: it would be an alternative to adding tripleo-quickstart/config/general_config/featureset056.yml | 14:35 |
| fultonj | which could be based on https://github.com/olliewalsh/split/tree/fix_computes | 14:36 |
| fultonj | any concerns about standalone not being sufficient to support the changes in the other blueprints? | 14:36 |
| bogdando | +1 for the slagle's idea | 14:36 |
| owalsh | fultonj: ack, good to test any custom roles etc... at least | 14:36 |
| fultonj | #action fultonj try standalone for https://blueprints.launchpad.net/tripleo/+spec/split-controlplane-ci based on https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L14 | 14:38 |
| fultonj | EmilienM: i'll probably ask you for help :) | 14:38 |
| openstackgerrit | Alex Schultz proposed openstack-infra/tripleo-ci master: Make standalone voting https://review.openstack.org/605756 | 14:38 |
| mwhahaha | weshay, EmilienM -^ | 14:38 |
| slagle | #link https://etherpad.openstack.org/p/tripleo-compute-standalone | 14:39 |
| slagle | fultonj: gfidente : there are notes i shared last week ^ | 14:39 |
| EmilienM | fultonj: please do | 14:40 |
| EmilienM | fultonj: even if edge isn't my full time focus at this moment, I'm happy to contribute how I can | 14:40 |
| gfidente | slagle yeah thanks I wanted to make sure we use same steps as I wanted to try some changes for cinder a/a | 14:40 |
| fultonj | thanks EmilienM | 14:40 |
| EmilienM | mwhahaha: it was about time | 14:40 |
| EmilienM | :P | 14:40 |
| * mwhahaha blames tempest | 14:40 | |
| dtantsur | $ rm -rf tempest | 14:41 |
| slagle | dtantsur: do you want to highlight what you added to the etherpad now? | 14:41 |
| dtantsur | tl;dr is that I'm working on swiftless undercloud from ironic and inspector side | 14:41 |
| *** moshele has quit IRC | 14:41 | |
| dtantsur | overall, I guess, my focus is lightweight ironic in the undercloud | 14:41 |
| slagle | awesome | 14:41 |
| dtantsur | falling under the same topic is my metalsmith work | 14:42 |
| dtantsur | (for which I responded to your comments slagle - thanks!) | 14:42 |
| EmilienM | swiftless, novaless wow :) | 14:42 |
| dtantsur | and glanceless, yes | 14:42 |
| EmilienM | (and I'm not trolling) | 14:42 |
| slagle | i may get around to filing a spec for a full swiftless | 14:42 |
| slagle | it will take a lot of work around the plan management area | 14:42 |
| mwhahaha | glance uses swift doesn't it | 14:42 |
| mwhahaha | so we just need to switch to file based | 14:42 |
| EmilienM | IIRC dprince mentioned some limitations if we get rid of Swift | 14:42 |
| EmilienM | at PTG | 14:42 |
| slagle | yes, there are some concerns | 14:43 |
| slagle | but general agreement i felt | 14:43 |
| slagle | hence, why a spec would be good | 14:43 |
| shardy | One issue is we still need an API for the UI, so we'll need to work that out | 14:43 |
| slagle | to get some concensus | 14:43 |
| dtantsur | ironic-inspector is a big user of swift as well | 14:43 |
| slagle | shardy: yea, ideally, the UI uses the mistral api for everything, and we can make changes transparently | 14:43 |
| *** dxiri has joined #tripleo | 14:44 | |
| slagle | i guess we'll see if that's the case | 14:44 |
| shardy | slagle: agreed but I don't think that is the case, jtomasek can confirm | 14:44 |
| shardy | some things do still interact with swift directly IIRC | 14:44 |
| slagle | ok | 14:45 |
| *** bugzy_ has joined #tripleo | 14:45 | |
| dprince | regarding the plan operations we are already working on speed those up by avoiding exploading the templates in Swift here: https://review.openstack.org/#/c/581153/ | 14:46 |
| *** bugzy has quit IRC | 14:46 | |
| dprince | that isn't related to getting rid of swift... but it would mean we'd be using it more effectiently/correctly | 14:46 |
| dtantsur | a question: if we switch the backend for introspection data, is it fine to just start from empty database? | 14:46 |
| slagle | cool | 14:47 |
| slagle | dtantsur: so delete all existing data? | 14:47 |
| dtantsur | slagle: essentially | 14:47 |
| slagle | dunno :/ | 14:47 |
| shardy | I don't think so, as on upgrade existing nodes would lose all their data? | 14:47 |
| dprince | dtantsur: you would loose data. Like re-introspecting a deployed overcloud machine won't be an option in some cases | 14:47 |
| shardy | yeah that's what I was thinking, migration would be better if possible | 14:48 |
| dtantsur | I guess it boils down to whether people use introspection data after deployment | 14:48 |
| dtantsur | if we come up with a separate script/playbook for migration, will it be okay? | 14:49 |
| slagle | i'd think so | 14:49 |
| slagle | as long as there's a way | 14:49 |
| fultonj | +1 | 14:50 |
| dprince | what about swift-lite? :). Its like keystone-lite but faster | 14:50 |
| EmilienM | no auth and basic middlewares only? | 14:51 |
| slagle | i'd like a swift-lite. if it acted like a keystone authenticated file server | 14:51 |
| weshay | bogdando, fyi.. I got master standalone deployed on f28 yesterday :) | 14:51 |
| bogdando | weshay: \o/ | 14:51 |
| slagle | that's really all we need | 14:51 |
| shardy | it can't be noauth because the plan contains passwords etc | 14:51 |
| dprince | yeah, like a minimum usage front end for swift that gives us basic file storage | 14:51 |
| slagle | +1 | 14:52 |
| slagle | alright, we're down to just a few mins left | 14:52 |
| slagle | #topic Goals for the week | 14:53 |
| *** openstack changes topic to "Goals for the week (Meeting topic: TripleO Edge Squad Meeting)" | 14:53 | |
| dprince | honestly, swift isn't that heavy as is. and can be peeled down if we really wanted to (Emilien may be on the right track with pealing off the middleware) | 14:53 |
| slagle | we've already captured a few AI's for the week | 14:53 |
| slagle | are there any others folks can think of? | 14:53 |
| fultonj | who wrote Anybody tried or is willng to do the work to have both isolated and shared networks in the Edge? | 14:55 |
| *** lblanchard has joined #tripleo | 14:55 | |
| slagle | dtantsur i think | 14:55 |
| dtantsur | wut | 14:55 |
| slagle | or not :) | 14:55 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: DNM: Ci test https://review.openstack.org/605764 | 14:55 |
| dtantsur | no, I did not :) | 14:55 |
| slagle | i'm not good at colors :) | 14:55 |
| bogdando | pigeons | 14:55 |
| bogdando | did | 14:55 |
| fultonj | w.r.t. to that comment i assume we'll be doing both types of networks | 14:56 |
| slagle | yea not sure if the comment is about undercloud or overcloud networks | 14:56 |
| slagle | for the standalone separate compute we prototypes, we just used an isolated provider network on the compute node | 14:56 |
| shardy | yeah with composable networks and/or separate stacks either should be possible | 14:58 |
| *** itlinux has joined #tripleo | 14:58 | |
| shardy | but we'll need better validation in the multiple stacks case | 14:58 |
| shardy | s/better/any | 14:58 |
| bogdando | slagle: just a side rant, I wish we were talking the same thing, instead of undercloud vs overcloud. I mean really, the shared networking architecture should be the next step | 14:58 |
| shardy | bogdando: the undercloud is one node, there's no need for multiple isolated networks? | 14:59 |
| bogdando | yet | 14:59 |
| *** moguimar has quit IRC | 14:59 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: WIP - Fix stackviz https://review.openstack.org/605419 | 14:59 |
| bogdando | but there is some bug already, as a first messenger | 14:59 |
| shardy | A multi-node undercloud is an overcloud with Ironic IMO, therefore the architecture is already the same | 15:00 |
| *** moguimar has joined #tripleo | 15:00 | |
| *** hamzy_ has quit IRC | 15:00 | |
| slagle | feel free to continue discussion post-meeting :) | 15:00 |
| slagle | #endmeeting | 15:00 |
| *** openstack changes topic to "Welcome to Rocky | CI Status: RED, DO NOT WORKFLOW https://docs.openstack.org/tripleo-docs/latest/" | 15:00 | |
| openstack | Meeting ended Thu Sep 27 15:00:46 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo_edge_squad_meeting/2018/tripleo_edge_squad_meeting.2018-09-27-14.01.html | 15:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo_edge_squad_meeting/2018/tripleo_edge_squad_meeting.2018-09-27-14.01.txt | 15:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo_edge_squad_meeting/2018/tripleo_edge_squad_meeting.2018-09-27-14.01.log.html | 15:00 |
| *** shardy is now known as shardy_afk | 15:00 | |
| marios | beagles: (ack sorry in long running call will added to reviews queue thanks) | 15:00 |
| *** moguimar has quit IRC | 15:03 | |
| bogdando | shardy_afk: mostly that one https://bugs.launchpad.net/bugs/1782438 | 15:03 |
| openstack | Launchpad bug 1782438 in tripleo "tripleo ui endpoints misconfigured in containerized undercloud" [High,In progress] - Assigned to Honza Pokorny (hpokorny) | 15:03 |
| *** moguimar has joined #tripleo | 15:04 | |
| *** moguimar has quit IRC | 15:04 | |
| shardy_afk | bogdando: I'm not sure that's a bug, added a comment | 15:07 |
| *** shardy_afk is now known as shardy | 15:07 | |
| bogdando | I was thinking of Edge cases, when we might need to have real public network | 15:08 |
| bogdando | and API network | 15:08 |
| bogdando | not just routed one | 15:08 |
| bogdando | shardy: ^^ | 15:08 |
| bogdando | so it needs to be availble from WAN connected remote sites | 15:08 |
| bogdando | makes sense? | 15:09 |
| shardy | bogdando: As slagle said, you can create a provider network per edge cluster - how you route that to an external network is outside the scope of TripleO | 15:09 |
| bogdando | would that work for WAN?.. | 15:09 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 15:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| shardy | bogdando: I'm not sure what you mean by WAN, the point is the compute clusters can connect to a dedicated network per cluster | 15:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 15:10 |
| shardy | there's no dependency for tenant traffic on the controlplane | 15:10 |
| *** ratailor has joined #tripleo | 15:11 | |
| shardy | e.g yes the antenna might have a provider network that's connected to the WAN via the wireless link | 15:11 |
| shardy | but as I said, that's outside the scope of TripleO | 15:11 |
| *** jfrancoa has quit IRC | 15:11 | |
| *** jfrancoa has joined #tripleo | 15:14 | |
| *** numans has joined #tripleo | 15:15 | |
| *** jbadiapa has quit IRC | 15:20 | |
| fultonj | +1 we need to define scope | 15:24 |
| fultonj | i think it is defined as per the PTG | 15:24 |
| *** mjturek has quit IRC | 15:24 | |
| * fultonj steps away for a few minutes | 15:25 | |
| fultonj | at least a good protion of it for now is | 15:26 |
| *** hamzy_ has joined #tripleo | 15:26 | |
| *** shardy has quit IRC | 15:26 | |
| *** jbadiapa has joined #tripleo | 15:27 | |
| *** quiquell is now known as quiquell|off | 15:28 | |
| beagles | marios: ack thanks! | 15:29 |
| *** hamzy has joined #tripleo | 15:29 | |
| *** hamzy_ has quit IRC | 15:30 | |
| *** kopecmartin|ruck is now known as kopecmartin|off | 15:31 | |
| *** artom has quit IRC | 15:31 | |
| openstackgerrit | Nicolas Hicher proposed openstack-infra/tripleo-ci master: provider: Add vexxhost https://review.openstack.org/596432 | 15:32 |
| *** mjturek has joined #tripleo | 15:33 | |
| *** shardy has joined #tripleo | 15:46 | |
| *** chandankumar is now known as chkumar|off | 15:46 | |
| *** jistr|call is now known as jistr | 15:46 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add openvswitch upgrade tasks where ovn controller is deployed. https://review.openstack.org/605792 | 15:54 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: WIP: configure the undercloud host https://review.openstack.org/605489 | 15:55 |
| *** vkapalav has joined #tripleo | 15:57 | |
| *** mjturek has quit IRC | 15:59 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 16:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO https://review.openstack.org/604298 | 16:00 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: move tripleo-ci release files inside CentOS-7 folder https://review.openstack.org/605642 | 16:03 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Create soft links for tripleo-ci release files https://review.openstack.org/605643 | 16:04 |
| *** ykarel has joined #tripleo | 16:04 | |
| *** ratailor has quit IRC | 16:04 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Make openshift-master service idempotent https://review.openstack.org/605796 | 16:05 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: DNM: fc28 mega-testing-patch https://review.openstack.org/605411 | 16:06 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Create soft links for tripleo-ci release files https://review.openstack.org/605643 | 16:07 |
| *** rdopiera has quit IRC | 16:10 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 16:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 16:10 |
| *** jpich has quit IRC | 16:12 | |
| *** leanderthal has quit IRC | 16:17 | |
| openstackgerrit | David Peacock proposed openstack/tripleo-heat-templates master: docker-puppet.py: used dedicated hiera entry, not uuid https://review.openstack.org/559182 | 16:19 |
| *** yprokule has quit IRC | 16:19 | |
| *** ykarel_ has joined #tripleo | 16:19 | |
| *** raildo_ has joined #tripleo | 16:19 | |
| *** jfrancoa has quit IRC | 16:20 | |
| *** ykarel has quit IRC | 16:22 | |
| *** raildo has quit IRC | 16:22 | |
| *** bogdando has quit IRC | 16:25 | |
| *** florianf is now known as florianf|afk | 16:25 | |
| *** bogdando has joined #tripleo | 16:26 | |
| bogdando | EmilienM, mwhahaha: please merge https://review.openstack.org/#/c/601555/ backport | 16:27 |
| EmilienM | bogdando: we need to land the deps first | 16:27 |
| EmilienM | then get a promotion | 16:27 |
| EmilienM | then merge https://review.openstack.org/#/c/601555/ | 16:28 |
| bogdando | EmilienM: right, it's https://review.openstack.org/#/c/601558/ and green | 16:28 |
| EmilienM | approved | 16:28 |
| bogdando | ack, promotion | 16:28 |
| bogdando | thanks! | 16:28 |
| *** holser_ has quit IRC | 16:29 | |
| openstackgerrit | Kamil Sambor proposed openstack/tripleo-heat-templates master: Add posibilities to set tunnel_csum in ovs agent https://review.openstack.org/605033 | 16:31 |
| *** ksambor has quit IRC | 16:32 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Re-factor process-templates https://review.openstack.org/605804 | 16:37 |
| *** akrivoka has quit IRC | 16:43 | |
| *** vkapalav has quit IRC | 16:43 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Merge new params - nic-config templates https://review.openstack.org/605807 | 16:43 |
| *** errantekarmico has joined #tripleo | 16:46 | |
| *** bogdando has quit IRC | 16:50 | |
| *** med_ has joined #tripleo | 16:53 | |
| *** dtantsur is now known as dtantsur|afk | 16:54 | |
| *** ykarel_ is now known as ykarel | 16:58 | |
| *** gfidente has quit IRC | 16:59 | |
| *** gfidente has joined #tripleo | 17:02 | |
| *** med_ has quit IRC | 17:03 | |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo master: Fix nic_alias fact error https://review.openstack.org/605811 | 17:03 |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo master: Fix nic_alias fact error https://review.openstack.org/605811 | 17:04 |
| *** derekh has quit IRC | 17:04 | |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo master: Fix nic_alias fact error https://review.openstack.org/605811 | 17:04 |
| *** artom has joined #tripleo | 17:06 | |
| *** sai_p has joined #tripleo | 17:06 | |
| *** salmankhan has quit IRC | 17:06 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 17:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 17:10 |
| *** jpena is now known as jpena|off | 17:11 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-validations stable/rocky: Fix diskspace validation when size is the limit https://review.openstack.org/605815 | 17:11 |
| *** trown is now known as trown|lunch | 17:12 | |
| *** ramishra has quit IRC | 17:13 | |
| *** agopi_ has joined #tripleo | 17:13 | |
| *** agopi has quit IRC | 17:16 | |
| *** mjturek has joined #tripleo | 17:16 | |
| *** gkadam has quit IRC | 17:20 | |
| *** dxiri has quit IRC | 17:20 | |
| *** agopi_ is now known as agopi | 17:21 | |
| *** dxiri has joined #tripleo | 17:21 | |
| *** hamzy_ has joined #tripleo | 17:31 | |
| *** hamzy has quit IRC | 17:32 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Update standalone container prep steps https://review.openstack.org/604487 | 17:32 |
| *** assassin has joined #tripleo | 17:33 | |
| *** hamzy_ has quit IRC | 17:35 | |
| *** hamzy has joined #tripleo | 17:35 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Update standalone container prep steps https://review.openstack.org/604487 | 17:36 |
| *** hamzy has quit IRC | 17:37 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Check if openstack-glance-registry is enabled before stopping it. https://review.openstack.org/603581 | 17:40 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart-extras master: Update standalone container prep steps https://review.openstack.org/604487 | 17:40 |
| *** jamesdenton has quit IRC | 17:44 | |
| *** panda is now known as panda|off | 17:46 | |
| *** hjensas has quit IRC | 17:46 | |
| *** dsneddon has quit IRC | 17:47 | |
| *** dsneddon has joined #tripleo | 17:47 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Enable support for running refstack tests in TQE https://review.openstack.org/570719 | 17:48 |
| *** amoralej is now known as amoralej|off | 17:56 | |
| dsneddon | beagles, Thanks for commenting on https://bugzilla.redhat.com/show_bug.cgi?id=1625732 but I have a question. Do you know at what stage the nodes use the link-local address to obtain the CA certs? The link-local address is a problem for spine/leaf, and we were under the impression that it was being phased out. Have you heard anything like that? | 18:00 |
| openstack | bugzilla.redhat.com bug 1625732 in rhosp-director "Overcloud nodes can't get metadata" [High,On_dev] - Assigned to beagles | 18:00 |
| *** sshnaidm is now known as sshnaidm|off | 18:03 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Use openshift-ansible container instead of RPMs https://review.openstack.org/583868 | 18:03 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: WIP Use glusterfs for registry when deploying with CNS https://review.openstack.org/605825 | 18:03 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: WIP Use glusterfs for registry when deploying with CNS https://review.openstack.org/605825 | 18:08 |
| *** ykarel_ has joined #tripleo | 18:08 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 18:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 18:10 |
| *** dxiri has quit IRC | 18:11 | |
| *** ykarel has quit IRC | 18:11 | |
| beagles | dsneddon: actually I have not. It's an interesting point though and it makes me wonder if the rule was omitted deliberately with the intent of "doing something else" and that "something else" never happened | 18:12 |
| dsneddon | beagles, I know that some people were under the impression that we were phasing out the 169.254.169.254 address, but I can't seem to find any info about that. In any case, this is a problem for spine/leaf because 169.254.x.x addresses are not supposed to be routable, so this requires special routes on the routers. We were able to deploy without that address in the non-TLS case, if I'm not mistaken. I'm | 18:14 |
| dsneddon | opening a BZ. | 18:14 |
| beagles | dsneddon: interestngly this iptables rule is a bit of a hack so requests can get through the neutron metadata agent to the nova metadaa api | 18:14 |
| dsneddon | beagles, Yeah, I wonder if we can switch to using the real address instead of the metadata link-local IP | 18:15 |
| beagles | dsneddon: oliver walsh tried this https://review.openstack.org/#/c/603571/ but I don't think this works because we don't populate the routing on the nodes with the information provided by neutron's dhcp server (afaik) | 18:15 |
| dsneddon | beagles, We are beginning to do that in Stein | 18:16 |
| beagles | dsneddon: ah | 18:16 |
| *** errantekarmico has quit IRC | 18:17 | |
| dtrainor | does zaqar have some sort of database? I didn't see anything under /var/lib/zaqar. I ask because I'm getting a weird error, a 502, when trying to interface with it from the UI. I think this may have something to do with running out of space on the Undercloud. i've done this before and found zaqar to be extremely sensitive to this, and not able to recover | 18:18 |
| dtrainor | I fear something is corrupt | 18:18 |
| dtrainor | i'm getting a trace but it looks incomplete... http://paste.openstack.org/show/731042/ | 18:21 |
| jillr | dtrainor: do you get an ssl error from the cli maybe? https://bugs.launchpad.net/tripleo/+bug/1791970 | 18:23 |
| openstack | Launchpad bug 1791970 in tripleo "Zaqar websocket ssl failures" [High,In progress] - Assigned to Jill Rouleau (jillrouleau) | 18:23 |
| jillr | dtrainor: try like 'openstack queue list' | 18:23 |
| dtrainor | i don't believe so. that command for example, does work | 18:24 |
| dtrainor | wonder if ui suffers from the same thing though | 18:24 |
| jillr | kay, thats all I got offhand | 18:24 |
| dtrainor | thx | 18:25 |
| *** trown|lunch is now known as trown | 18:31 | |
| *** jamesdenton has joined #tripleo | 18:31 | |
| *** mjturek has quit IRC | 18:31 | |
| *** gfidente has quit IRC | 18:32 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Create soft links for tripleo-ci release files https://review.openstack.org/605643 | 18:33 |
| *** salmankhan has joined #tripleo | 18:37 | |
| dtrainor | so the 502 is coming from haproxy. it's coming from haproxy because apache, which receives the connection in the backend, can't connect to zaqar. it can't connect to zaqar because zaqar is down. | 18:40 |
| *** salmankhan has quit IRC | 18:41 | |
| *** jistr has quit IRC | 18:47 | |
| *** jistr has joined #tripleo | 18:49 | |
| fultonj | slagle: https://etherpad.openstack.org/p/tripleo-compute-standalone line 7 isn't working for me | 18:49 |
| fultonj | do you normally export OS_CLOUD=standalone | 18:50 |
| fultonj | ? | 18:50 |
| fultonj | public endpoint for orchestration service in regionOne region not found | 18:51 |
| fultonj | http://paste.openstack.org/show/731043/ | 18:52 |
| *** mjturek has joined #tripleo | 18:52 | |
| *** dprince has quit IRC | 18:56 | |
| *** assassin has quit IRC | 19:00 | |
| *** ykarel_ is now known as ykarel|away | 19:05 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: add support for distro and major release delineation https://review.openstack.org/605843 | 19:06 |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: add support for distro and major release delineation https://review.openstack.org/605843 | 19:07 |
| *** jistr has quit IRC | 19:08 | |
| *** jistr has joined #tripleo | 19:08 | |
| *** itlinux has quit IRC | 19:09 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 19:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 19:10 |
| *** mjturek has quit IRC | 19:11 | |
| *** ykarel|away has quit IRC | 19:12 | |
| *** mjturek has joined #tripleo | 19:13 | |
| *** dxiri has joined #tripleo | 19:14 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: fedora28 standalone job definition https://review.openstack.org/595374 | 19:14 |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: fedora28 standalone job definition https://review.openstack.org/595374 | 19:16 |
| *** iranzo has quit IRC | 19:18 | |
| fultonj | slagle: perhaps you modified roles/Standalone.yaml to include heat? | 19:22 |
| *** jistr has quit IRC | 19:23 | |
| *** jistr has joined #tripleo | 19:26 | |
| *** jistr has quit IRC | 19:28 | |
| *** jistr has joined #tripleo | 19:29 | |
| fultonj | or modified -e environmentns/standalone.yaml to not no-op heat | 19:30 |
| fultonj | EmilienM: have you deployed heat in the standalone overcloud? | 19:31 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack-infra/tripleo-ci master: New workflow for standalone upgrade. https://review.openstack.org/604706 | 19:31 |
| *** jistr has quit IRC | 19:34 | |
| EmilienM | fultonj: yes, as ephemeral | 19:35 |
| fultonj | https://github.com/openstack/tripleo-heat-templates/blob/master/environments/standalone.yaml#L51-L55 | 19:35 |
| fultonj | EmilienM: so you commented out lines 51-55 ^ ? | 19:36 |
| EmilienM | oh wait no so | 19:37 |
| fultonj | EmilienM: or when you say ephemeral do you mean "heat as a library" | 19:37 |
| EmilienM | no I didn't have heat | 19:37 |
| EmilienM | yeah right | 19:37 |
| fultonj | or heat as the short lived container | 19:37 |
| *** jistr has joined #tripleo | 19:37 | |
| fultonj | EmilienM: i'm trying to follow https://etherpad.openstack.org/p/tripleo-compute-standalone | 19:37 |
| fultonj | from slagle | 19:37 |
| fultonj | i'm thinking his control-plane overcloud wasn't done with the stand alone | 19:38 |
| EmilienM | yeah heat is just here to have process the stack and generate the ansible playbooks with config download | 19:38 |
| fultonj | and only his edge node was done with th stand alone | 19:38 |
| fultonj | https://gitlab.com/slagle/tripleo-standalone-edge/tree/master | 19:38 |
| *** hamzy has joined #tripleo | 19:38 | |
| fultonj | you probably saw he foked your example ^ | 19:38 |
| fultonj | and you got it working by modifying your edge compute manually | 19:39 |
| fultonj | right? | 19:39 |
| fultonj | but i think he was saying you don't need to modify your edge compute manually if you do what's in that etherpad ^ | 19:39 |
| *** jistr has quit IRC | 19:39 | |
| fultonj | but 'openstack stack output show overcloud EndpointMap' won't work on standalone with defaults | 19:40 |
| fultonj | so either 1. he installed heat on his standalone OR 2. his central was a non-standalone traditional tripleo install | 19:41 |
| fultonj | EmilienM: any ideas? | 19:41 |
| fultonj | i guess i'll wait until slagle is back | 19:41 |
| fultonj | if not | 19:41 |
| EmilienM | fultonj: I had to modify the config of nova container in the compute node | 19:42 |
| EmilienM | after the deployment | 19:42 |
| EmilienM | some workarounds, to get rpc & memcached connection | 19:42 |
| EmilienM | fultonj: let me comment in the etherpad | 19:43 |
| EmilienM | although I didn't use it before | 19:43 |
| *** hamzy has quit IRC | 19:44 | |
| fultonj | EmilienM: https://gitlab.com/fultonj/tripleo-standalone-edge/blob/master/standalone-edge.sh#L72 | 19:44 |
| fultonj | the stand alone edge includes the files generated by following the ether pad | 19:45 |
| EmilienM | wow I managed to get everyone on gitlab lol | 19:46 |
| dpeacock | EmilienM: Tengu is still a hold out. ;-) | 19:46 |
| EmilienM | fultonj: yeah I think slagle didn't have to do my workarounds, as he managed to re-use the existing passwords | 19:46 |
| fultonj | EmilienM: exactly | 19:46 |
| EmilienM | which is cool | 19:46 |
| fultonj | so i'm trying to reuse the existing passwords | 19:46 |
| EmilienM | so yeah, use --keep-running | 19:46 |
| fultonj | --key-running ? | 19:47 |
| EmilienM | so you can still interact with the heat stack | 19:47 |
| * fultonj needs to understand this noption | 19:47 | |
| EmilienM | no --keep-running | 19:47 |
| EmilienM | see in tripleoclient | 19:47 |
| fultonj | yeah | 19:47 |
| fultonj | i just typed it wrong there | 19:47 |
| fultonj | i got the idea | 19:47 |
| EmilienM | it doesn't destroy the heat instance | 19:47 |
| EmilienM | so you can still query the stack | 19:47 |
| fultonj | EmilienM: --keep-running i think --keep-running was the missing part | 19:47 |
| EmilienM | like EndpointMap etc | 19:47 |
| EmilienM | yeah | 19:48 |
| fultonj | thank you | 19:48 |
| *** jistr has joined #tripleo | 19:49 | |
| weshay | jaosorior, mwhahaha EmilienM I see tripleo-ci-centos-7-3nodes-multinode coming back to life | 19:51 |
| * fultonj refreshes snapshot | 19:51 | |
| mwhahaha | lies? | 19:51 |
| weshay | not ready yet but getting there | 19:51 |
| mwhahaha | did we fix something? :D | 19:51 |
| weshay | mwhahaha, ha.. who the f knows | 19:52 |
| weshay | but it's passing at decent clip again | 19:52 |
| weshay | slagle, fyi ^ | 19:52 |
| *** dxiri has quit IRC | 19:53 | |
| *** dxiri has joined #tripleo | 19:53 | |
| *** pcaruana has quit IRC | 19:54 | |
| *** ade_lee has quit IRC | 19:58 | |
| *** jaganathan has quit IRC | 19:59 | |
| EmilienM | fultonj: let me know how it goes | 20:00 |
| fultonj | EmilienM: i will heat stack deploying now | 20:00 |
| EmilienM | "heat stack" is a new verb | 20:00 |
| fultonj | i will. heat stack deploying now | 20:01 |
| EmilienM | if you translate in french | 20:01 |
| fultonj | need those periods | 20:01 |
| EmilienM | heat stacking seems weird | 20:01 |
| fultonj | empilement de chaleur | 20:02 |
| fultonj | (thanks google) | 20:02 |
| EmilienM | right | 20:02 |
| * fultonj has no idea what that means | 20:02 | |
| EmilienM | you can't stack heat | 20:02 |
| fultonj | ah | 20:02 |
| EmilienM | anyway | 20:02 |
| slagle | fultonj: hey, so when I did it, only my compute node was standalone | 20:08 |
| fultonj | slagle: thanks that makes more sense | 20:08 |
| slagle | the controlplane was a properly deployed OC | 20:08 |
| slagle | yea sorry, the etherpad is kind of "stream of conscious" notes | 20:09 |
| fultonj | i'm curious if --keep-running will do the trick. i'll let you know | 20:09 |
| *** hamzy has joined #tripleo | 20:09 | |
| slagle | it should | 20:09 |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 20:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 20:10 |
| *** med_ has joined #tripleo | 20:10 | |
| *** mjturek has quit IRC | 20:11 | |
| slagle | fultonj: if you use --keep-running, then you can use openstack cli like this to talk to the Heat: | 20:11 |
| slagle | OS_AUTH_TYPE=none OS_ENDPOINT=http://127.0.0.1:8006/v1/admin openstack stack list | 20:11 |
| slagle | at least that worked last time I tried it | 20:11 |
| fultonj | slagle: do you didn't export OS_CLOUD=standalone | 20:12 |
| fultonj | ? | 20:12 |
| slagle | fultonj: you're not talking to the "standalone" cloud | 20:13 |
| slagle | you're talking to the ephemeral heat used to install the standalone cloud | 20:13 |
| fultonj | slagle: ok, that makes sense | 20:13 |
| fultonj | the fake undercloud | 20:14 |
| slagle | right | 20:14 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Set proper setype for service directories https://review.openstack.org/600534 | 20:14 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Allow to deactivate SELinux separation for selected containers https://review.openstack.org/600535 | 20:14 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Support podman when tagging container for Pacemaker https://review.openstack.org/604180 | 20:16 |
| fultonj | http://paste.openstack.org/show/731044/ | 20:17 |
| fultonj | yeah | 20:17 |
| *** hamzy has quit IRC | 20:20 | |
| *** hamzy has joined #tripleo | 20:20 | |
| fultonj | openstack object save standalone plan-environment.yaml | 20:23 |
| fultonj | isn't going to work ^ | 20:23 |
| fultonj | as we're swiftless | 20:23 |
| fultonj | slagle: ^ EmilienM ^ | 20:23 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: DNM: Ci test https://review.openstack.org/605764 | 20:24 |
| *** hamzy has quit IRC | 20:25 | |
| *** mjturek has joined #tripleo | 20:26 | |
| slagle | fultonj: yes, obviously :) | 20:28 |
| *** hamzy has joined #tripleo | 20:28 | |
| slagle | fultonj: like i said...it's notes from when I had a non standaloen OC | 20:28 |
| fultonj | sure, i'm just thinking about how to workaround it | 20:29 |
| *** mjturek has quit IRC | 20:29 | |
| slagle | fultonj: the point of that step is...re-use the same passwords | 20:29 |
| slagle | i assume the standalone installer has saved them somewhere | 20:29 |
| fultonj | tripleo-undercloud-passwords.yaml looks like it but will be undercloud passwords | 20:30 |
| * fultonj looking for overcloud paswords | 20:30 | |
| fultonj | probably in undercloud-ansible-3Ao7xi | 20:30 |
| slagle | that's probably what you want | 20:30 |
| slagle | it's the passwords for the standalone stack | 20:31 |
| slagle | rabbitmq, etc | 20:31 |
| slagle | you want to reuse those same values in the standalone compute stack | 20:31 |
| slagle | that file should probably be called tripleo-<stack name>-passwords.yaml | 20:32 |
| fultonj | thanks slagle | 20:32 |
| slagle | but i suspect there is some bleed over between the undercloud installer and standalone installer code | 20:32 |
| *** lblanchard has quit IRC | 20:33 | |
| *** artom has quit IRC | 20:33 | |
| *** hamzy has quit IRC | 20:34 | |
| *** hamzy has joined #tripleo | 20:34 | |
| *** mjturek has joined #tripleo | 20:43 | |
| *** hamzy has quit IRC | 20:43 | |
| *** ansmith has quit IRC | 20:48 | |
| openstackgerrit | Akhila Kishore proposed openstack/puppet-tripleo master: Add puppet base class for barometer service. https://review.openstack.org/604442 | 20:56 |
| *** rmascena__ has joined #tripleo | 20:57 | |
| *** rmascena__ has quit IRC | 20:57 | |
| *** mjturek has quit IRC | 20:58 | |
| *** trown is now known as trown|outtypewww | 20:59 | |
| *** mjturek has joined #tripleo | 21:00 | |
| *** raildo_ has quit IRC | 21:00 | |
| fultonj | https://gitlab.com/slagle/tripleo-standalone-edge/blob/master/standalone-edge.sh#L56 | 21:00 |
| fultonj | slagle: were did you get these passwords ^ ? | 21:01 |
| *** mjturek has quit IRC | 21:02 | |
| slagle | I may have had to look in the hieradata on the controlplane node | 21:02 |
| fultonj | slagle: thanks i see | 21:03 |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: add support for distro and major release delineation https://review.openstack.org/605843 | 21:07 |
| *** rh-jelabarre has quit IRC | 21:10 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 21:10 |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 21:10 |
| *** jamesdenton has quit IRC | 21:15 | |
| *** abishop has quit IRC | 21:16 | |
| *** dhill_ has quit IRC | 21:22 | |
| *** agopi_ has joined #tripleo | 21:24 | |
| weshay | merge party | 21:26 |
| *** agopi has quit IRC | 21:27 | |
| *** akhila has joined #tripleo | 21:28 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates stable/rocky: Pass NeutronMechanismDrivers parameter to prepare https://review.openstack.org/605867 | 21:31 |
| *** agopi_ is now known as agopi | 21:33 | |
| openstackgerrit | Alex Schultz proposed openstack/instack-undercloud master: Add instack-undercloud job https://review.openstack.org/605755 | 21:34 |
| mwhahaha | damn it steve | 21:35 |
| mwhahaha | stevebaker: you just nuked your patch out of the gate with that backport | 21:35 |
| openstackgerrit | Alex Schultz proposed openstack/instack-undercloud master: Add instack-undercloud job https://review.openstack.org/605755 | 21:37 |
| *** ansmith has joined #tripleo | 21:40 | |
| EmilienM | lol the gate | 21:41 |
| EmilienM | and it's only milestone 1 | 21:42 |
| EmilienM | we'll merge code during Christmas at this pace | 21:42 |
| *** toure is now known as toure|gone | 21:43 | |
| mwhahaha | we don't have anything important this cycle | 21:44 |
| mwhahaha | it'll be fine | 21:44 |
| mwhahaha | everything after 599072,5 will reset, timeout :/ | 21:46 |
| mwhahaha | wait did everything just reset | 21:48 |
| mwhahaha | POST_FAILURE | 21:49 |
| EmilienM | mwhahaha: why did you do https://review.openstack.org/#/c/605764/ ? | 21:49 |
| EmilienM | https://review.openstack.org/#/c/605515/ is enough to test no? | 21:49 |
| mwhahaha | EmilienM: they depend on different things | 21:49 |
| mwhahaha | EmilienM: So no | 21:49 |
| mwhahaha | oh maybe | 21:50 |
| *** mcornea has quit IRC | 21:50 | |
| mwhahaha | i wanted to check the jobs in THT (scenarios) | 21:51 |
| EmilienM | ah then you need to patch ci/env/scenarios | 21:51 |
| mwhahaha | it did drop the undercloud image prepare down to 18mins | 21:51 |
| EmilienM | mwhahaha: yeah which is why I +2 | 21:51 |
| mwhahaha | role.role.j2.yaml should triggere everything too | 21:51 |
| EmilienM | and I think we should send it to gate sooner than later | 21:51 |
| EmilienM | ah ok good | 21:51 |
| weshay | POST FAILURE | 21:51 |
| weshay | fak | 21:51 |
| EmilienM | yeah why that | 21:51 |
| EmilienM | we need to investigate that | 21:51 |
| EmilienM | maybe infra prob | 21:52 |
| EmilienM | mwhahaha: after https://review.openstack.org/#/c/605755/ we'll need to remove it into tripleo-ci but I guess you know | 21:52 |
| mwhahaha | EmilienM: what are you talking about | 21:52 |
| weshay | 2018-09-27 21:47:06.546148 | LOOP [upload-logs : gzip console log and json output] | 21:53 |
| mwhahaha | no we don't want ot move it in there | 21:53 |
| weshay | is the last word said | 21:53 |
| weshay | before POOF | 21:53 |
| *** Vorrtex has quit IRC | 21:53 | |
| EmilienM | mwhahaha: sorry I misused into | 21:54 |
| EmilienM | mwhahaha: I meant: removing it from tripleo-ci | 21:54 |
| mwhahaha | EmilienM: no i think we leave those | 21:54 |
| EmilienM | k | 21:54 |
| mwhahaha | we could i guess, if we moved the stuff from tripleo-ci into the stable branches of instack-undercloud | 21:54 |
| mwhahaha | but the undercloud-oooq is used everywhere for <= Rocky | 21:54 |
| mwhahaha | so that addition is just for instack-undercloud >=Stein | 21:55 |
| mwhahaha | until we finally axe instack-undercloud | 21:55 |
| mwhahaha | which maybe should be next cycle? | 21:55 |
| * mwhahaha shrugs | 21:55 | |
| mwhahaha | weshay: do we have the avg run time for undercloud-containers job stored somewhere? | 21:56 |
| mwhahaha | weshay: context, trying ot see if https://review.openstack.org/#/c/605515/2 is really an improvement. I think it shaves 10 mins off total run time but i'd like to compare if we have more data | 21:56 |
| weshay | mwhahaha, /me looks | 21:57 |
| EmilienM | mwhahaha: yeah we can find that info in zuul | 21:58 |
| EmilienM | a sec | 21:58 |
| EmilienM | in http://zuul.openstack.org/builds.html | 21:59 |
| weshay | mwhahaha, it doesn't have to be undercloud-containers does it? | 21:59 |
| EmilienM | http://zuul.openstack.org/builds.html?job_name=tripleo-ci-centos-7-undercloud-containers | 21:59 |
| EmilienM | variation is high | 21:59 |
| EmilienM | from 5700 seconds to 8837 | 22:00 |
| mwhahaha | yea | 22:00 |
| EmilienM | 1.5 hour to 2.5 hours | 22:00 |
| EmilienM | so yeah | 22:00 |
| EmilienM | hard to tell | 22:00 |
| EmilienM | maybe doing 10 rechecks could tell | 22:01 |
| EmilienM | the question is, can it hurt? | 22:01 |
| EmilienM | because otherwise it can only make it faster, even a bit | 22:01 |
| EmilienM | what we don't want to to make it worst | 22:01 |
| mwhahaha | so for all the runs in tripleo-common that job is the lowest | 22:03 |
| mwhahaha | at 5674 | 22:03 |
| *** rlandy is now known as rlandy|biab | 22:03 | |
| mwhahaha | since 9/25 13:40 | 22:03 |
| mwhahaha | so i think it is an improvement | 22:03 |
| EmilienM | what we need to track is the ansible task that prepare the images | 22:04 |
| EmilienM | weshay: do we track that in grafana now? | 22:04 |
| mwhahaha | we started | 22:04 |
| mwhahaha | but the problem is you need the numbers repeatedly to know | 22:04 |
| weshay | it needs love | 22:04 |
| weshay | we have the ci ansible, the undercloud tasks, and overcloud deploy tasks | 22:05 |
| weshay | I'm not finding this to be useful yet though | 22:05 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common stable/rocky: Set prepare neutron_driver from NeutronMechanismDrivers https://review.openstack.org/605870 | 22:06 |
| weshay | https://review.rdoproject.org/grafana/dashboard/db/tripleo-ci?orgId=1&var-pipeline=All&var-branch=All&var-cloud=All&var-type=All&var-jobtype=All | 22:06 |
| weshay | http://dashboard-ci.tripleo.org/d/poOr-d0mk/ansible-exploration?orgId=1&from=1536876211279&to=1538085811279 | 22:06 |
| weshay | http://dashboard-ci.tripleo.org/d/FEdraO0ik/jobs-exploration?orgId=1 | 22:07 |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 22:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 22:10 |
| *** agopi is now known as agopi|brb | 22:11 | |
| weshay | EmilienM, mwhahaha sorry.. when I try to pin this to a particular job there is some data loss | 22:12 |
| * mwhahaha shrugs | 22:12 | |
| mwhahaha | i think there's a bit of improvement but we'll see | 22:12 |
| weshay | this is decent | 22:13 |
| weshay | https://review.rdoproject.org/grafana/dashboard/db/tripleo-ci?orgId=1&var-pipeline=All&var-branch=master&var-cloud=All&var-type=multinode&var-jobtype=All | 22:13 |
| weshay | master, multinode | 22:13 |
| weshay | undercloud install varies from 25 - 45 min | 22:13 |
| stevebaker | mwhahaha: boo! | 22:14 |
| *** agopi|brb has quit IRC | 22:16 | |
| openstackgerrit | Nicolas Hicher proposed openstack-infra/tripleo-ci master: provider: Add vexxhost https://review.openstack.org/596432 | 22:16 |
| *** rcernin has joined #tripleo | 22:29 | |
| *** sanjayu_ has quit IRC | 22:29 | |
| *** jtomasek has quit IRC | 22:35 | |
| *** agopi|brb has joined #tripleo | 22:38 | |
| openstackgerrit | Jill Rouleau proposed openstack/tripleo-ansible master: Fix README filename https://review.openstack.org/605878 | 22:42 |
| *** tosky has quit IRC | 22:53 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Fix overcloud ARA data collection https://review.openstack.org/605678 | 23:07 |
| *** akhila has quit IRC | 23:07 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart master: Make setup repo task output visible when errored https://review.openstack.org/599358 | 23:07 |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1715374 | 23:10 |
| openstack | Launchpad bug 1715374 in tripleo "Reloading compute with SIGHUP prenvents instances to boot" [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1792560 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 23:10 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack-infra/tripleo-ci master: New workflow for standalone upgrade. https://review.openstack.org/604706 | 23:10 |
| *** artom has joined #tripleo | 23:12 | |
| *** rlandy|biab is now known as rlandy | 23:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
