| *** hjensas has joined #openstack-kolla | 00:01 | |
| *** LinPeiWen62 has joined #openstack-kolla | 00:37 | |
| *** dardelean has joined #openstack-kolla | 00:40 | |
| *** dardelean has quit IRC | 01:04 | |
| *** zzzeek has quit IRC | 01:09 | |
| *** zzzeek has joined #openstack-kolla | 01:11 | |
| *** zzzeek has quit IRC | 01:27 | |
| *** zzzeek has joined #openstack-kolla | 01:28 | |
| *** vishalmanchanda has joined #openstack-kolla | 02:44 | |
| *** zzzeek has quit IRC | 02:45 | |
| *** zzzeek has joined #openstack-kolla | 02:47 | |
| *** skramaja has joined #openstack-kolla | 02:52 | |
| *** bsanjeewa_ has joined #openstack-kolla | 03:02 | |
| *** bsanjeewa has joined #openstack-kolla | 03:02 | |
| *** k_mouza has joined #openstack-kolla | 03:14 | |
| *** k_mouza has quit IRC | 03:18 | |
| *** bsanjeewa_ has quit IRC | 04:16 | |
| *** bsanjeewa has quit IRC | 04:16 | |
| *** bsanjeewa_ has joined #openstack-kolla | 04:16 | |
| *** bsanjeewa has joined #openstack-kolla | 04:16 | |
| *** zzzeek has quit IRC | 04:18 | |
| *** zzzeek has joined #openstack-kolla | 04:20 | |
| *** k_mouza has joined #openstack-kolla | 04:28 | |
| *** k_mouza has quit IRC | 04:32 | |
| *** zzzeek has quit IRC | 04:58 | |
| *** zzzeek has joined #openstack-kolla | 04:58 | |
| *** zzzeek has quit IRC | 05:05 | |
| *** zzzeek has joined #openstack-kolla | 05:06 | |
| *** zzzeek has quit IRC | 05:15 | |
| *** zzzeek has joined #openstack-kolla | 05:19 | |
| *** zzzeek has quit IRC | 05:45 | |
| *** zzzeek has joined #openstack-kolla | 05:46 | |
| *** evrardjp has quit IRC | 05:47 | |
| *** evrardjp has joined #openstack-kolla | 05:48 | |
| *** openstackgerrit has joined #openstack-kolla | 05:53 | |
| openstackgerrit | likui proposed openstack/kolla-ansible master: Add enable_manila_backend_lvm support https://review.opendev.org/c/openstack/kolla-ansible/+/742782 | 05:53 |
|---|---|---|
| *** zenkuro has joined #openstack-kolla | 06:00 | |
| *** ricolin has joined #openstack-kolla | 06:13 | |
| *** k_mouza has joined #openstack-kolla | 06:26 | |
| *** bsanjeewa_ has quit IRC | 06:26 | |
| *** bsanjeewa has quit IRC | 06:26 | |
| *** bsanjeewa has joined #openstack-kolla | 06:27 | |
| *** bsanjeewa_ has joined #openstack-kolla | 06:27 | |
| *** k_mouza has quit IRC | 06:34 | |
| *** cah_link has joined #openstack-kolla | 06:43 | |
| *** nikparasyr has joined #openstack-kolla | 06:58 | |
| *** zzzeek has quit IRC | 07:05 | |
| *** zzzeek has joined #openstack-kolla | 07:07 | |
| *** zenkuro has quit IRC | 07:19 | |
| *** zenkuro has joined #openstack-kolla | 07:20 | |
| *** rpittau|afk is now known as rpittau | 07:37 | |
| *** bsanjeewa_ has quit IRC | 07:50 | |
| *** bsanjeewa has quit IRC | 07:50 | |
| *** bengates has joined #openstack-kolla | 07:54 | |
| *** wuchunyang has joined #openstack-kolla | 08:01 | |
| *** zzzeek has quit IRC | 08:05 | |
| *** zzzeek has joined #openstack-kolla | 08:07 | |
| *** bengates has quit IRC | 08:13 | |
| *** bengates has joined #openstack-kolla | 08:14 | |
| *** luksky has joined #openstack-kolla | 08:15 | |
| openstackgerrit | Lin PeiWen proposed openstack/kolla-ansible master: Can't get "sec_grp_info" variable https://review.opendev.org/c/openstack/kolla-ansible/+/764132 | 08:24 |
| *** bsanjeewa has joined #openstack-kolla | 08:33 | |
| openstackgerrit | Lin PeiWen proposed openstack/kolla-ansible master: Can't get "sec_grp_info" variable https://review.opendev.org/c/openstack/kolla-ansible/+/764132 | 08:51 |
| *** mgoddard has joined #openstack-kolla | 09:03 | |
| *** jbadiapa has joined #openstack-kolla | 09:04 | |
| *** jonaspaulo has joined #openstack-kolla | 09:04 | |
| mnasiadka | morning | 09:06 |
| *** sean-k-mooney1 has joined #openstack-kolla | 09:15 | |
| *** sean-k-mooney has quit IRC | 09:17 | |
| *** bsanjeewa_ has joined #openstack-kolla | 09:17 | |
| *** bsanjeewa_ has quit IRC | 09:19 | |
| openstackgerrit | Lin PeiWen proposed openstack/kolla-ansible master: Can't get "sec_grp_info" variable https://review.opendev.org/c/openstack/kolla-ansible/+/764132 | 09:24 |
| mgoddard | morning | 09:34 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/victoria: Fix stop containers task in Swift rolling restart https://review.opendev.org/c/openstack/kolla-ansible/+/764085 | 09:35 |
| mgoddard | new gerrit seems a lot slower | 09:36 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/ussuri: Fix stop containers task in Swift rolling restart https://review.opendev.org/c/openstack/kolla-ansible/+/764086 | 09:37 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/train: Fix stop containers task in Swift rolling restart https://review.opendev.org/c/openstack/kolla-ansible/+/764087 | 09:37 |
| *** zzzeek has quit IRC | 09:40 | |
| *** zzzeek has joined #openstack-kolla | 09:43 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/victoria: Performance: Use import_tasks in the main plays https://review.opendev.org/c/openstack/kolla-ansible/+/764088 | 09:43 |
| *** dardelean has joined #openstack-kolla | 09:44 | |
| *** kevko_ has joined #openstack-kolla | 09:44 | |
| *** k_mouza has joined #openstack-kolla | 09:47 | |
| *** gfidente|afk is now known as gfidente | 09:47 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/train: Performance: Use import_tasks in the main plays https://review.opendev.org/c/openstack/kolla-ansible/+/764146 | 09:49 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/ussuri: Performance: Use import_tasks in the main plays https://review.opendev.org/c/openstack/kolla-ansible/+/764147 | 09:54 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/victoria: Do not set 'always' tag where unnecessary https://review.opendev.org/c/openstack/kolla-ansible/+/764089 | 09:57 |
| *** bsanjeewa has quit IRC | 09:59 | |
| mnasiadka | mgoddard: well, even when you click 'submit' on a review, it takes some time... | 09:59 |
| *** wuchunyang has quit IRC | 10:09 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Add missing octavia-driver-agent https://review.opendev.org/c/openstack/kolla-ansible/+/761872 | 10:20 |
| *** luksky has quit IRC | 10:26 | |
| openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Add OVN bits to octavia.conf https://review.opendev.org/c/openstack/kolla-ansible/+/761927 | 10:35 |
| *** zzzeek has quit IRC | 10:58 | |
| *** zzzeek has joined #openstack-kolla | 10:59 | |
| *** mgoddard has quit IRC | 11:12 | |
| *** mgoddard has joined #openstack-kolla | 11:23 | |
| *** luksky has joined #openstack-kolla | 11:32 | |
| *** bengates has quit IRC | 11:37 | |
| *** bengates has joined #openstack-kolla | 11:38 | |
| *** e0ne has joined #openstack-kolla | 11:38 | |
| *** zzzeek has quit IRC | 11:42 | |
| *** zzzeek has joined #openstack-kolla | 11:44 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/ussuri: Do not set 'always' tag where unnecessary https://review.opendev.org/c/openstack/kolla-ansible/+/764176 | 11:46 |
| *** wuchunyang has joined #openstack-kolla | 11:56 | |
| *** jonaspaulo has quit IRC | 12:00 | |
| *** jonaspaulo has joined #openstack-kolla | 12:03 | |
| *** dardelean has quit IRC | 12:09 | |
| *** wuchunyang has quit IRC | 12:16 | |
| *** wuchunyang has joined #openstack-kolla | 12:31 | |
| *** zzzeek has quit IRC | 12:34 | |
| *** zzzeek has joined #openstack-kolla | 12:38 | |
| *** jonaspaulo has quit IRC | 12:47 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/train: Do not set 'always' tag where unnecessary https://review.opendev.org/c/openstack/kolla-ansible/+/764181 | 12:48 |
| *** jonaspaulo has joined #openstack-kolla | 12:51 | |
| *** TrevorV has joined #openstack-kolla | 13:02 | |
| *** j4m3s__ has joined #openstack-kolla | 13:06 | |
| *** kevko_ has quit IRC | 13:12 | |
| *** mgoddard has quit IRC | 13:15 | |
| *** mgoddard has joined #openstack-kolla | 13:17 | |
| *** e0ne has quit IRC | 13:25 | |
| *** e0ne has joined #openstack-kolla | 13:25 | |
| *** vishalmanchanda has quit IRC | 13:26 | |
| *** zenkuro has quit IRC | 13:37 | |
| *** zenkuro has joined #openstack-kolla | 13:38 | |
| oklhost | hey guys, normally I use ubuntu, but I try to help someone with centos8. For dev I use all-in-one at a ubuntu bionic host. I removed my whole deployment and try to deploy from centos-source instead of ubuntu-source but it fails: http://paste.openstack.org/show/800417/ | 13:41 |
| *** matthieuv4250 has joined #openstack-kolla | 13:42 | |
| oklhost | Yes, I really removed everything from /etc/kolla except my globals.yaml where I switched to centos | 13:42 |
| *** matthieuv42 has joined #openstack-kolla | 13:43 | |
| openstackgerrit | Merged openstack/kayobe master: CI: add dummy1 port for seed upgrade and VM jobs https://review.opendev.org/c/openstack/kayobe/+/763959 | 13:45 |
| *** bsanjeewa has joined #openstack-kolla | 13:49 | |
| *** bsanjeewa has quit IRC | 13:54 | |
| *** matthieuv42 has quit IRC | 13:54 | |
| wuchunyang | oklhost i guess you should install your kolla-ansible | 13:55 |
| oklhost | wuchunyang: ? | 13:55 |
| wuchunyang | http://paste.openstack.org/show/800417/ | 13:56 |
| wuchunyang | i saw this | 13:56 |
| oklhost | wuchunyang: Yeah, but kolla-ansible runs fine. That happens only if I try to deploy centos based containers. | 13:57 |
| wuchunyang | do you use develop mode ? right | 13:58 |
| wuchunyang | ? | 13:58 |
| oklhost | Okay, got it. | 13:58 |
| oklhost | Yes, thanks... my mistake | 13:59 |
| wuchunyang | i guess you are using this command ( ./tool/kolla-ansible) | 13:59 |
| oklhost | right | 13:59 |
| wuchunyang | just install it ,it will work | 14:00 |
| oklhost | Yeah, I did and it works. Thanks mate! | 14:01 |
| oklhost | hadn't thought about it anymore. in our prod everything is automated and pip3 install ./kolla-ansible will be executed via gitlab-ci. | 14:02 |
| wuchunyang | but pip3 install kolla-ansible, it should work too. | 14:05 |
| oklhost | wuchunyang: have to use my fork because I implemented adjutant there. ;) | 14:06 |
| wuchunyang | i know.. | 14:06 |
| oklhost | so without ./ pip3 won't install the local version, i guess?! | 14:08 |
| mgoddard | mnasiadka, jovial[m], priteau: https://review.opendev.org/c/openstack/kayobe/+/763375/ & https://review.opendev.org/c/openstack/kayobe/+/763374/ | 14:08 |
| wuchunyang | yes your are right | 14:10 |
| *** zzzeek has quit IRC | 14:28 | |
| *** zzzeek has joined #openstack-kolla | 14:29 | |
| *** rpittau is now known as rpittau|bbl | 14:29 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla master: DNM: testing mirror revert https://review.opendev.org/c/openstack/kolla/+/763351 | 14:31 |
| openstackgerrit | Mark Goddard proposed openstack/kolla stable/train: Bump OpenStack versions for Train https://review.opendev.org/c/openstack/kolla/+/764197 | 14:37 |
| *** rafaelweingartne has joined #openstack-kolla | 14:51 | |
| mgoddard | mgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne cosmicsound osmanlicilegi bbezak | 14:52 |
| mgoddard | ^ meeting in 8 | 14:52 |
| *** vishalmanchanda has joined #openstack-kolla | 14:53 | |
| *** bsanjeewa has joined #openstack-kolla | 14:55 | |
| mgoddard | #startmeeting kolla | 15:00 |
| openstack | Meeting started Wed Nov 25 15:00:31 2020 UTC and is due to finish in 60 minutes. The chair is mgoddard. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| *** openstack changes topic to " (Meeting topic: kolla)" | 15:00 | |
| openstack | The meeting name has been set to 'kolla' | 15:00 |
| mgoddard | #topic rollcall | 15:00 |
| *** openstack changes topic to "rollcall (Meeting topic: kolla)" | 15:01 | |
| mgoddard | \o | 15:01 |
| yoctozepto | o/ | 15:01 |
| jopdorp | o/ | 15:01 |
| rafaelweingartne | \o | 15:01 |
| mgoddard | #topic agenda | 15:02 |
| *** openstack changes topic to "agenda (Meeting topic: kolla)" | 15:02 | |
| mgoddard | * Roll-call | 15:02 |
| mgoddard | * Announcements | 15:02 |
| mgoddard | ** Kolla Wallaby priorities https://etherpad.opendev.org/p/kolla-wallaby-priorities | 15:02 |
| mgoddard | ** Stein release now in Extended Maintenance (EM) | 15:02 |
| mgoddard | * Review action items from the last meeting | 15:02 |
| mgoddard | * CI status | 15:02 |
| mgoddard | * Victoria release planning | 15:02 |
| mgoddard | * Dockerhub pull rate limits https://etherpad.opendev.org/p/docker-pull-limits | 15:02 |
| mgoddard | * Cinder active/active https://bugs.launchpad.net/kolla-ansible/+bug/1904062 | 15:02 |
| openstack | Launchpad bug 1904062 in kolla-ansible wallaby "external ceph cinder volume config breaks volumes on ussuri upgrade" [High,In progress] - Assigned to Michal Nasiadka (mnasiadka) | 15:02 |
| mgoddard | * Wallaby PTG actions | 15:02 |
| mgoddard | * Review new retirements (Wallaby) | 15:02 |
| mgoddard | * Cinder v2 to be dropped in Wallaby http://lists.openstack.org/pipermail/openstack-discuss/2020-November/018697.html | 15:02 |
| mgoddard | * Stein Extended Maintenance | 15:02 |
| mgoddard | #topic announcements | 15:02 |
| *** openstack changes topic to "announcements (Meeting topic: kolla)" | 15:02 | |
| mgoddard | #info Kolla Wallaby priorities | 15:03 |
| mgoddard | #link Kolla Wallaby priorities https://etherpad.opendev.org/p/kolla-wallaby-priorities | 15:03 |
| mgoddard | #undo | 15:03 |
| openstack | Removing item from minutes: #link https://etherpad.opendev.org/p/kolla-wallaby-priorities | 15:03 |
| mgoddard | #link https://etherpad.opendev.org/p/kolla-wallaby-priorities | 15:03 |
| mgoddard | Voting now finished, we have our priorities | 15:03 |
| mgoddard | I've added them to the whiteboard | 15:03 |
| mgoddard | #link https://etherpad.opendev.org/p/KollaWhiteBoard | 15:03 |
| mgoddard | Feel free to add yourself as an owner/interested party on one of the priorities | 15:04 |
| mgoddard | #info Stein release now in Extended Maintenance (EM) | 15:04 |
| mgoddard | Final releases have been created | 15:05 |
| mgoddard | We can discuss more later | 15:05 |
| mgoddard | Any others? | 15:05 |
| *** kevko_ has joined #openstack-kolla | 15:06 | |
| mgoddard | #topic Review action items from the last meeting | 15:06 |
| *** openstack changes topic to "Review action items from the last meeting (Meeting topic: kolla)" | 15:06 | |
| mgoddard | mgoddard to email openstack-discuss about final reminder for wallaby priority voting | 15:06 |
| mgoddard | yoctozepto fix NFV | 15:07 |
| mgoddard | mgoddard did his | 15:07 |
| mgoddard | yoctozepto seems to have been busy | 15:07 |
| mgoddard | do you want another action? | 15:07 |
| yoctozepto | mgoddard: yes, please | 15:08 |
| yoctozepto | mgoddard: health issues | 15:08 |
| mgoddard | yoctozepto: sorry to hear | 15:08 |
| mgoddard | #action yoctozepto fix NFV | 15:09 |
| mgoddard | #topic CI status | 15:09 |
| *** openstack changes topic to "CI status (Meeting topic: kolla)" | 15:09 | |
| mgoddard | 15:09 | |
| mgoddard | docker rate limits we can discuss again later | 15:09 |
| mgoddard | https://bugs.launchpad.net/nova/+bug/1902696 | 15:10 |
| openstack | Launchpad bug 1902696 in oslo.messaging "nova-compute fails with Unhandled error: TypeError: _wrap_socket_sni() got an unexpected keyword argument 'ca_certs'" [Undecided,New] | 15:10 |
| mgoddard | there was another patch for requirements, but it didn't help us | 15:10 |
| mgoddard | I'm sure there was a version of the patch that worked, do we need to go back and find out what it was | 15:11 |
| yoctozepto | 5.0.2 does not help | 15:11 |
| mgoddard | no | 15:12 |
| mgoddard | looks like PS1 passed | 15:13 |
| mgoddard | nov 7 11:35PM | 15:13 |
| yoctozepto | PS1 of which one? | 15:14 |
| mgoddard | at that time, the requirements patch was PS2: https://review.opendev.org/c/openstack/requirements/+/761194/2 | 15:14 |
| yoctozepto | OK | 15:14 |
| mgoddard | which pinned amqp<=2.6.1 | 15:14 |
| yoctozepto | so yeah, it simply says new kombu is b0rken | 15:14 |
| mgoddard | and kombu<=5.0.1 | 15:14 |
| mgoddard | current patch allows amqp 5.0.2 | 15:15 |
| yoctozepto | and kombu 5.0.2 | 15:16 |
| mgoddard | yes | 15:16 |
| yoctozepto | duh, new gerrit clumsy | 15:17 |
| mgoddard | yeah, and slow | 15:17 |
| mgoddard | hopefully it'll improve | 15:18 |
| yoctozepto | ++ | 15:18 |
| mgoddard | #action mgoddard to try reverting to https://review.opendev.org/c/openstack/requirements/+/761194/2 | 15:18 |
| mgoddard | I think other CI issues are unchanged | 15:19 |
| mgoddard | #topic Victoria release planning | 15:19 |
| *** openstack changes topic to "Victoria release planning (Meeting topic: kolla)" | 15:19 | |
| mgoddard | https://etherpad.opendev.org/p/KollaWhiteBoard | 15:19 |
| mgoddard | L144 lists release blockers | 15:19 |
| mgoddard | Kolla has the rabbitmq TLS issue we were just discussing | 15:20 |
| yoctozepto | anyone looked into a/a? | 15:20 |
| mgoddard | Kolla ansible has cinder-volume active/active | 15:20 |
| mgoddard | I don't think so | 15:20 |
| yoctozepto | heh | 15:20 |
| mgoddard | not beyond mnasiadka's patch anyway | 15:21 |
| mgoddard | I'll try to put some time into it tomorrow | 15:21 |
| yoctozepto | yeah | 15:21 |
| yoctozepto | best approach with CI testing | 15:21 |
| yoctozepto | what happens if we upgrade to new approach | 15:21 |
| yoctozepto | when we have volumes in place | 15:22 |
| yoctozepto | might be worth to have this in general | 15:22 |
| yoctozepto | instead of cleaning up | 15:22 |
| mgoddard | yes | 15:23 |
| mgoddard | create, test, delete, create, test, upgrade, test, delete, create, test, delete | 15:24 |
| mgoddard | something like that | 15:24 |
| yoctozepto | ++ | 15:24 |
| yoctozepto | for simplicity | 15:24 |
| yoctozepto | we can treat reconf = upgrade | 15:24 |
| yoctozepto | would not hurt | 15:24 |
| mnasiadka | well, we need to be sure that no volumes are in -ing state before upgrade | 15:25 |
| mgoddard | although it's effectively a noop, so we'd be unlikely to catch anything | 15:26 |
| yoctozepto | (ignore the above, we don't test after reconf) | 15:26 |
| mgoddard | (it = reconfigure in CI) | 15:26 |
| mnasiadka | (and remove old agents from db or ask the user to remove them) | 15:26 |
| mnasiadka | after upgrade | 15:26 |
| *** jonaspaulo has quit IRC | 15:26 | |
| mnasiadka | or am I missing something major? :) | 15:26 |
| yoctozepto | we are discussing testing to see the impact | 15:27 |
| yoctozepto | and strenghten our testing in general | 15:27 |
| yoctozepto | volumes disappearing due to an upgrade is a big no-no | 15:27 |
| mgoddard | ok, let's move on | 15:28 |
| mgoddard | #topic Dockerhub pull rate limits https://etherpad.opendev.org/p/docker-pull-limits | 15:28 |
| *** openstack changes topic to "Dockerhub pull rate limits https://etherpad.opendev.org/p/docker-pull-limits (Meeting topic: kolla)" | 15:28 | |
| mgoddard | I was thinking, given the lack of any action on this, how about we go with hrw's suggestion to publish less frequently? | 15:29 |
| mgoddard | it should help, although not guaranteed | 15:29 |
| mgoddard | pretty simple to implement though, and it might be nice to have a pattern for less frequent publishing, e.g. for EM branches | 15:30 |
| mgoddard | any thoughts? | 15:30 |
| yoctozepto | but we get penalized for *pulling* | 15:30 |
| yoctozepto | not pushing | 15:30 |
| mgoddard | yes | 15:30 |
| mgoddard | but the less we push, the less we have to pull into registry mirrors | 15:31 |
| mgoddard | since they should cache images | 15:31 |
| rafaelweingartne | Would it be possible for the community/foundation to implement a proxy-registry somehow? | 15:31 |
| yoctozepto | hmm, clever | 15:31 |
| wuchunyang | i think reconfigure can do some reload work(or restart one by one without downtime) | 15:31 |
| mgoddard | wuchunyang: rate limits are per 6 hours, not per second :) | 15:32 |
| mgoddard | rafaelweingartne: opendev infra provide registry mirrors, which we use | 15:32 |
| yoctozepto | weekly images sound fine | 15:32 |
| wuchunyang | ok.. | 15:32 |
| yoctozepto | and absurdly easy to implement now | 15:32 |
| yoctozepto | just switch the pipeline | 15:33 |
| yoctozepto | :D | 15:33 |
| rafaelweingartne | mgoddard: so, we do not actually need to worry about the pull problem, right? If we document on how people can use these mirrors then | 15:33 |
| mgoddard | oh nice, periodic-weekly exists | 15:33 |
| yoctozepto | indeed | 15:33 |
| yoctozepto | the only problem is | 15:33 |
| *** bsanjeewa has quit IRC | 15:33 | |
| yoctozepto | the failures | 15:33 |
| yoctozepto | :D | 15:33 |
| yoctozepto | ever-b0rken images | 15:34 |
| yoctozepto | never-new images | 15:34 |
| yoctozepto | sad reality | 15:34 |
| mgoddard | rafaelweingartne: we're mostly focussing on how it affects CI here. Users need their own solution, such as a local registry or registry mirror | 15:34 |
| rafaelweingartne | I see, that is actually what we are using. | 15:35 |
| mgoddard | rafaelweingartne: sensible, even before the rate limit | 15:35 |
| mgoddard | yoctozepto: true. I was thinking more like every 2-3 days | 15:35 |
| mgoddard | with some early exit in the publish job | 15:35 |
| mgoddard | if hash_of_job_info % 7 in days_to_publish then publish | 15:36 |
| mgoddard | would be nice if zuul gave the date of the last successful run of the job | 15:37 |
| mgoddard | possibly we could query it | 15:37 |
| yoctozepto | sounds sensible to query | 15:38 |
| mgoddard | that would allow for failures | 15:38 |
| yoctozepto | though never used the zuul api before | 15:38 |
| mgoddard | it's easy enough | 15:38 |
| yoctozepto | mhm | 15:38 |
| mgoddard | anyway, some solution in there | 15:39 |
| mgoddard | anyone want to pick it up? | 15:39 |
| mgoddard | I suppose periodic-weekly would be an easy win | 15:39 |
| mgoddard | although they probably all run on a sunday | 15:39 |
| yoctozepto | and an easy self-sabotage ;d | 15:39 |
| yoctozepto | let's go with the zuul querying | 15:40 |
| yoctozepto | though it's all problematic as these jobs only ever run periodically | 15:40 |
| yoctozepto | need to simulate in DNM first | 15:40 |
| mgoddard | yes | 15:40 |
| mgoddard | I think a static hash makes sense. It distributes jobs over days | 15:41 |
| *** zzzeek has quit IRC | 15:41 | |
| mgoddard | a system failure would lead to stampeding if we use the last success | 15:41 |
| yoctozepto | so you prefer stochastic approaches | 15:41 |
| yoctozepto | fine by me | 15:42 |
| mgoddard | I don't mind too much, as long as it gets fixed :) | 15:42 |
| yoctozepto | somebody fix :-) | 15:43 |
| *** zzzeek has joined #openstack-kolla | 15:43 | |
| mgoddard | it's available, if someone wants to pick it up | 15:43 |
| mgoddard | #topic Cinder active/active https://bugs.launchpad.net/kolla-ansible/+bug/1904062 | 15:43 |
| *** openstack changes topic to "Cinder active/active https://bugs.launchpad.net/kolla-ansible/+bug/1904062 (Meeting topic: kolla)" | 15:43 | |
| openstack | Launchpad bug 1904062 in kolla-ansible wallaby "external ceph cinder volume config breaks volumes on ussuri upgrade" [High,In progress] - Assigned to Michal Nasiadka (mnasiadka) | 15:43 |
| mgoddard | I don't think we have too much to discuss on this one, other than we need to get on with it | 15:43 |
| *** rpittau|bbl is now known as rpittau | 15:44 | |
| mgoddard | #topic Wallaby PTG actions | 15:44 |
| *** openstack changes topic to "Wallaby PTG actions (Meeting topic: kolla)" | 15:44 | |
| mgoddard | TODO(): High level documentation, eg. examples of networking config, diagrams, justification of use of containers, not k8s etc. | 15:44 |
| mgoddard | TODO(): document justification for kolla/kolla-ansible | 15:44 |
| mgoddard | TODO(yoctozepto): wait for zuul-runner, try it out, fix issues, document how to use it | 15:44 |
| mgoddard | TODO(mgoddard): Poll community for a new kolla klub timeslot | 15:44 |
| mgoddard | TODO(Fl1nt): Call for contributor campaign, offer some (limited) mentorship | 15:44 |
| mgoddard | TODO(mgoddard): Reach out to existing community members in non EU/US | 15:44 |
| mgoddard | TODO() find 'interested parties' for infra image CI work | 15:44 |
| mgoddard | TODO(Fl1nt): add a note to documentation (FAQ/troubleshooting?) about new Docker hub limits | 15:44 |
| mgoddard | TODO(): ask opendev infra about open source project application process | 15:44 |
| mgoddard | TODO(): add tags for register & bootstrap? | 15:44 |
| mgoddard | TODO(yoctozepto): make genconfig + deploy-containers work | 15:44 |
| mgoddard | TODO(yoctozepto): Deprecate reconfigure command | 15:44 |
| mgoddard | TODO(): Modernise the old skool Swift role | 15:44 |
| mgoddard | TODO(Fl1nt, or others): PoC and/or spec for podman | 15:44 |
| mgoddard | TODO(yoctozepto): work on masakari hostmonitor integration | 15:44 |
| mgoddard | TODO(headphoneJames): write up high level description of how Letsencrypt fits together | 15:44 |
| mgoddard | TODO(): write a high level design document/spec for kayobe multiple environments | 15:45 |
| mgoddard | TODO(): 'Deprecate' devicemapper on stable branches, require some action (set a flag) to override | 15:45 |
| mgoddard | TODO(jovial): make a kayobe story for switching to networkmanager | 15:45 |
| mgoddard | TODO(dougszu): Strip out Grafana post configure functionality and move it to Kolla-Ansible | 15:45 |
| mgoddard | TODO(dougszu): Investigate ansible collections, reference custom playbook repo (e.g. kayobe-ops) | 15:45 |
| mgoddard | any updates? | 15:45 |
| mgoddard | anyone want to pick one up that is not assigned? | 15:45 |
| headphoneJames | the high level description: https://etherpad.opendev.org/p/kolla-ansible-letsencrypt-https | 15:45 |
| rafaelweingartne | it is not in this list, but we did update https://review.opendev.org/c/openstack/kolla-ansible/+/695432 | 15:45 |
| yoctozepto | that was quick | 15:45 |
| rafaelweingartne | I added the requested documentation on how to create a DEV env. for testing | 15:45 |
| mgoddard | thanks rafaelweingartne, that should help reviewers & testers | 15:47 |
| rafaelweingartne | Cool, we are guessing that now, people would be more confident in testing | 15:47 |
| rafaelweingartne | and then we can move on with that | 15:47 |
| *** sean-k-mooney1 is now known as sean-k-mooney | 15:47 | |
| mgoddard | yes, I think we should prioritise it once Victoria is released | 15:48 |
| rafaelweingartne | awesome, thanks! | 15:48 |
| mgoddard | headphoneJames: a little off topic, but have you been communicating with Jason? | 15:49 |
| wuchunyang | Deprecate reconfigure command this task i can help | 15:49 |
| headphoneJames | I did reach out to him | 15:49 |
| *** skramaja has quit IRC | 15:49 | |
| headphoneJames | he knows that I'm running with LE | 15:49 |
| mgoddard | ok, great | 15:49 |
| headphoneJames | I also let him know that I updated the spec | 15:50 |
| mgoddard | as long as we're keeping him in the loop | 15:50 |
| wuchunyang | anyone uses podman in production ? | 15:50 |
| wuchunyang | i use podman to deploy ceph in production, but i hit a podman bug.. | 15:51 |
| mgoddard | wuchunyang: the list is on https://etherpad.opendev.org/p/kolla-wallaby-ptg, feel free to add your nick | 15:51 |
| wuchunyang | ok | 15:51 |
| mgoddard | wuchunyang: I think we normally use docker | 15:52 |
| mgoddard | #topic Review new retirements (Wallaby) | 15:52 |
| *** openstack changes topic to "Review new retirements (Wallaby) (Meeting topic: kolla)" | 15:52 | |
| mgoddard | yoctozepto: is this you? | 15:52 |
| wuchunyang | yes, i think docker is more reliable .. | 15:52 |
| yoctozepto | yees | 15:52 |
| dswebb | wuchunyang, we use a mix (docker for openstack, podman for ceph) | 15:53 |
| yoctozepto | we got a bit of retirements | 15:53 |
| yoctozepto | on the mailing list | 15:53 |
| mgoddard | should we allow time for people to come forward to help? | 15:53 |
| yoctozepto | so we might want to deprecate as well | 15:53 |
| wuchunyang | dswebb me too.. but our ceph hit a podman bug | 15:53 |
| yoctozepto | yeah, I'm fine with allowing more time | 15:53 |
| mgoddard | I guess deprecation doesn't hurt | 15:53 |
| dswebb | you having issues with the node exporter not starting properly on deploy? | 15:53 |
| yoctozepto | just keep this in the back of our minds | 15:53 |
| mgoddard | good thinking | 15:53 |
| yoctozepto | you can action me on it | 15:54 |
| yoctozepto | I will propose notes | 15:54 |
| yoctozepto | to keep around | 15:54 |
| mgoddard | #action yoctozepto deprecate the retired Wallabies | 15:54 |
| yoctozepto | thx | 15:54 |
| wuchunyang | dswebb https://github.com/containers/podman/issues/2553 | 15:54 |
| mgoddard | #topic Cinder v2 to be dropped in Wallaby http://lists.openstack.org/pipermail/openstack-discuss/2020-November/018697.html | 15:54 |
| *** openstack changes topic to "Cinder v2 to be dropped in Wallaby http://lists.openstack.org/pipermail/openstack-discuss/2020-November/018697.html (Meeting topic: kolla)" | 15:54 | |
| mgoddard | #link http://lists.openstack.org/pipermail/openstack-discuss/2020-November/018697.html | 15:54 |
| mgoddard | yoctozepto again? | 15:54 |
| yoctozepto | you guessed it! | 15:55 |
| mgoddard | I actually missed that one | 15:55 |
| yoctozepto | now, it's trickier than the previous one | 15:55 |
| yoctozepto | we need to handle the drop and removal of existing | 15:55 |
| yoctozepto | it should not be breaking if we forget | 15:55 |
| yoctozepto | but better play it safe | 15:55 |
| mgoddard | we need a way to track things like this | 15:56 |
| yoctozepto | another etherpad? | 15:56 |
| yoctozepto | whiteboard feels lengthy | 15:56 |
| yoctozepto | or maybe | 15:56 |
| mgoddard | was thinking another list next to priorities | 15:56 |
| yoctozepto | just use wiki | 15:56 |
| yoctozepto | oh well | 15:56 |
| mgoddard | considering it only has one item currently :) | 15:56 |
| yoctozepto | whatever works | 15:56 |
| yoctozepto | true that | 15:56 |
| mgoddard | etherpads get forgotten | 15:57 |
| mnasiadka | we can always start in a contest for longest etherpad :) | 15:57 |
| yoctozepto | mnasiadka: ++ | 15:57 |
| mnasiadka | yoctozepto: I remember we had the discussion before, that we need a role/change in service-ks-register to remove endpoints | 15:58 |
| yoctozepto | hopefully the prizes are worth it | 15:58 |
| yoctozepto | mnasiadka: we had | 15:58 |
| yoctozepto | but there was no urgency | 15:58 |
| yoctozepto | now there is | 15:58 |
| mgoddard | I've added it as a priority for kolla-ansible | 16:00 |
| hrw | what about one patch to deprecate and next one to remove with WIP status? | 16:00 |
| hrw | or similar | 16:00 |
| mgoddard | hrw: for cinder or retired projects? | 16:00 |
| hrw | retired | 16:00 |
| mgoddard | ok | 16:00 |
| mgoddard | can do, was just hoping to avoid possibly unnecessary work | 16:01 |
| mgoddard | if someone picks up the projects | 16:01 |
| *** rafaelweingartne has quit IRC | 16:01 | |
| mgoddard | but I won't/can't stop anyone proposing a patch | 16:01 |
| mgoddard | #topic Stein Extended Maintenance | 16:01 |
| *** openstack changes topic to "Stein Extended Maintenance (Meeting topic: kolla)" | 16:01 | |
| mgoddard | last topic | 16:01 |
| mgoddard | Stein is now EM | 16:01 |
| hrw | so we can stop publish/care? | 16:02 |
| mgoddard | I was hoping to see something on https://docs.openstack.org/kolla/latest/contributor/release-management.html about what we normally do for EM | 16:02 |
| mgoddard | but there is nothing | 16:02 |
| mgoddard | I think, we do this | 16:02 |
| mgoddard | stop backports by default, but accept if proposed | 16:03 |
| mgoddard | stop publishing (although not usually immediately) | 16:03 |
| mgoddard | we could also try switching to stable branches in source images (as we did in ussuri) | 16:04 |
| mgoddard | and switch to weekly publish | 16:04 |
| mgoddard | thoughts? | 16:04 |
| *** luksky has quit IRC | 16:04 | |
| mnasiadka | well, switching to stable branches could be good for users using Stein | 16:04 |
| hrw | it is em. I would do one final release if there were changes since previous | 16:05 |
| mgoddard | final release is done | 16:05 |
| hrw | I would end. | 16:05 |
| hrw | do final publish and done | 16:06 |
| hrw | switching to stable branches can bring new issues | 16:06 |
| mgoddard | rocky was last published 8 months ago | 16:07 |
| hrw | when someone propose backport with sensible reason then we merge and let users do build on they own or wait for weekly/monthly publish | 16:07 |
| hrw | mgoddard: and no one asked about rocky so we do not recognize that name anymore? | 16:07 |
| *** wuchunyang has quit IRC | 16:08 | |
| mgoddard | ok, we're past time | 16:08 |
| mgoddard | thanks all | 16:08 |
| mgoddard | #endmeeting | 16:08 |
| *** openstack changes topic to "IRC meetings on Wednesdays @ 15:00 UTC - agenda @ https://goo.gl/OXB0DL | Whiteboard: https://bit.ly/2MM7mWF | IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b" | 16:08 | |
| openstack | Meeting ended Wed Nov 25 16:08:19 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:08 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-11-25-15.00.html | 16:08 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-11-25-15.00.txt | 16:08 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-11-25-15.00.log.html | 16:08 |
| hrw | half a year and centos 7 will get forgotten in kolla ;D | 16:08 |
| *** bsanjeewa has joined #openstack-kolla | 16:14 | |
| yoctozepto | mgoddard, hrw: I can also propose and wip... easy to lift | 16:17 |
| yoctozepto | whatever works | 16:18 |
| yoctozepto | reverts are just as easy | 16:18 |
| *** bsanjeewa_ has joined #openstack-kolla | 16:18 | |
| mgoddard | hrw: EM != EOL :) | 16:20 |
| mgoddard | hrw: but yes, will be nice to move on | 16:20 |
| openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: docs: Add magnum guide https://review.opendev.org/c/openstack/kolla-ansible/+/763770 | 16:24 |
| *** bsanjeewa has quit IRC | 16:25 | |
| *** bsanjeewa has joined #openstack-kolla | 16:26 | |
| *** bsanjeewa_ has quit IRC | 16:27 | |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/victoria: CI: add dummy1 port for seed upgrade and VM jobs https://review.opendev.org/c/openstack/kayobe/+/764182 | 16:27 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/ussuri: CI: add dummy1 port for seed upgrade and VM jobs https://review.opendev.org/c/openstack/kayobe/+/764183 | 16:28 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: CI: add dummy1 port for seed upgrade and VM jobs https://review.opendev.org/c/openstack/kayobe/+/764184 | 16:30 |
| openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: CI: add dummy1 port for seed upgrade and VM jobs https://review.opendev.org/c/openstack/kayobe/+/764184 | 16:31 |
| bsanjeewa | mgodard: any advice on https://storyboard.openstack.org/#!/story/2008388 ? | 16:35 |
| bsanjeewa | mgoddard: any advice on https://storyboard.openstack.org/#!/story/2008388 ? | 16:36 |
| openstackgerrit | Merged openstack/kolla-ansible stable/ussuri: Performance: Use import_tasks in the main plays https://review.opendev.org/c/openstack/kolla-ansible/+/764147 | 16:37 |
| openstackgerrit | Merged openstack/kolla-ansible stable/victoria: Performance: Use import_tasks in the main plays https://review.opendev.org/c/openstack/kolla-ansible/+/764088 | 16:37 |
| mgoddard | bsanjeewa: so, the seed has an eth0? | 16:41 |
| *** irclogbot_1 has quit IRC | 16:41 | |
| mgoddard | I wonder why it does not appear in ansible facts | 16:41 |
| mgoddard | bsanjeewa: could be related: | 16:43 |
| mgoddard | "PLAY [Gather facts on localhost] ***********************************************", | 16:43 |
| mgoddard | "skipping: no hosts matched", | 16:43 |
| mgoddard | bsanjeewa: which release are you using? | 16:45 |
| *** irclogbot_3 has joined #openstack-kolla | 16:46 | |
| bsanjeewa | mgoddard: I tried stable/victoria | 16:46 |
| mgoddard | ok | 16:47 |
| mgoddard | bsanjeewa: it's not released yet :) | 16:47 |
| bsanjeewa | mgoddard: :), so reverting to ussuri is recommended? or waiting until releasing be better? | 16:49 |
| mgoddard | bsanjeewa: if it's a new deployment, I would use ussuri | 16:49 |
| mgoddard | bsanjeewa: if you cannot destroy and start again, then stay on victoria - downgrade isn't really recommended with openstack | 16:50 |
| bsanjeewa | mgoddard: it's a new and poc with a few exsisting servers. Want to play with it and see if we can use kayobe and openstack to manage our datacentre in the future | 16:51 |
| mgoddard | bsanjeewa: ok. ussuri will be a smoother ride :) | 16:51 |
| mgoddard | bsanjeewa: thanks for finding the bug though! | 16:51 |
| bsanjeewa | mgoddard: sure. will go back to ussuri then. | 16:53 |
| bsanjeewa | mgoddard: an additional thing, is there a low cost solution you can recommend for VDI other than leostream?( a free one may be :D). the licenses seems to cost a little bit than we would like to. | 16:57 |
| mgoddard | bsanjeewa: this keeps coming up for us, although I haven't tried it: https://guacamole.apache.org/ | 17:02 |
| bsanjeewa | mgoddard: thanks, will try it after studying kayobe | 17:04 |
| *** dougsz has joined #openstack-kolla | 17:07 | |
| dougsz | Are we missing a task to stop chronyd on the host (C8) before the chrony container is deployed, or did I miss something? | 17:09 |
| *** luksky has joined #openstack-kolla | 17:09 | |
| *** nikparasyr has left #openstack-kolla | 17:10 | |
| dougsz | And in Kayobe it looks like it would be nice to pass through ntp_config_server to external_ntp_servers | 17:10 |
| *** bsanjeewa has quit IRC | 17:11 | |
| openstackgerrit | Mark Goddard proposed openstack/kolla master: docs: stable branch lifecycle https://review.opendev.org/c/openstack/kolla/+/764221 | 17:18 |
| mgoddard | dougsz: hmm, yeah we do have some chrony debt | 17:18 |
| mgoddard | dougsz: https://bugs.launchpad.net/kolla-ansible/+bug/1885689 | 17:18 |
| openstack | Launchpad bug 1885689 in kolla-ansible victoria "Ceph octopus incompatible with containerised chrony" [Medium,In progress] - Assigned to Radosław Piliszek (yoctozepto) | 17:18 |
| dougsz | ah, thanks | 17:19 |
| mgoddard | dougsz: I would recommend disabling the container and enabling it on the host (which is the default in CentO) | 17:19 |
| dougsz | Nothing to manage the NTP servers then | 17:20 |
| dougsz | Can use a custom playbook I suppose | 17:20 |
| mgoddard | dougsz: {{ node_custom_config }}/chrony/chrony.conf | 17:22 |
| mgoddard | doh, that's for the container | 17:23 |
| dougsz | yeah, was just wondering if that could be dual purpose | 17:23 |
| mgoddard | potentially | 17:24 |
| dougsz | A bit weird supporting both though I suppose | 17:24 |
| *** bsanjeewa has joined #openstack-kolla | 17:25 | |
| dougsz | will try and smooth some edges tomorrow | 17:26 |
| *** dougsz has quit IRC | 17:32 | |
| *** Mr_Freezeex has joined #openstack-kolla | 17:33 | |
| *** bsanjeewa has joined #openstack-kolla | 17:35 | |
| *** gfidente is now known as gfidente|afk | 17:43 | |
| *** Arador has joined #openstack-kolla | 17:45 | |
| bsanjeewa | mgoddard: I didn't run the kayobe seed hypervisor host configure in stable/victoria. can this be the problem? | 17:48 |
| bsanjeewa | mgoddard: so the commands run in stable/ussuri virtualenv in /opt/kayobe? | 17:50 |
| mgoddard | bsanjeewa: I don't think it is the cause of your problem | 17:50 |
| bsanjeewa | mgoddard: anyway I cannot confirm that now, as I removed all and downloaded ussuri and now provisioning seed vm | 17:51 |
| *** bengates has quit IRC | 17:58 | |
| *** mgoddard has quit IRC | 18:04 | |
| *** luksky has quit IRC | 18:04 | |
| *** dave-mccowan has quit IRC | 18:04 | |
| *** zzzeek has quit IRC | 18:06 | |
| *** zzzeek has joined #openstack-kolla | 18:06 | |
| *** dave-mccowan has joined #openstack-kolla | 18:10 | |
| *** jbadiapa has quit IRC | 18:14 | |
| *** vishalmanchanda has quit IRC | 18:21 | |
| *** k_mouza has quit IRC | 18:24 | |
| *** zzzeek has quit IRC | 18:41 | |
| *** e0ne has quit IRC | 18:42 | |
| *** zzzeek has joined #openstack-kolla | 18:42 | |
| *** rpittau is now known as rpittau|afk | 18:52 | |
| *** dking has quit IRC | 19:02 | |
| *** bsanjeewa has quit IRC | 19:25 | |
| *** dougsz has joined #openstack-kolla | 19:34 | |
| *** dougsz has quit IRC | 19:58 | |
| *** cah_link has quit IRC | 20:03 | |
| *** zzzeek has quit IRC | 20:44 | |
| *** zzzeek has joined #openstack-kolla | 20:46 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/train: Performance: Use import_tasks in the main plays https://review.opendev.org/c/openstack/kolla-ansible/+/764146 | 21:14 |
| *** e0ne has joined #openstack-kolla | 21:30 | |
| *** e0ne has quit IRC | 21:31 | |
| *** zzzeek has quit IRC | 21:45 | |
| *** e0ne has joined #openstack-kolla | 21:46 | |
| *** zzzeek has joined #openstack-kolla | 21:47 | |
| *** TrevorV has quit IRC | 21:48 | |
| *** e0ne has quit IRC | 21:52 | |
| *** zenkuro has quit IRC | 22:18 | |
| *** zenkuro has joined #openstack-kolla | 22:18 | |
| *** k_mouza has joined #openstack-kolla | 22:25 | |
| *** k_mouza has quit IRC | 22:29 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!