| *** tosky has quit IRC | 00:06 | |
| *** rfolco has quit IRC | 00:12 | |
| *** yamamoto has joined #openstack-meeting-alt | 00:24 | |
| *** macz_ has quit IRC | 00:56 | |
| *** baojg has joined #openstack-meeting-alt | 01:03 | |
| *** zzzeek has quit IRC | 01:06 | |
| *** zzzeek has joined #openstack-meeting-alt | 01:09 | |
| *** yamamoto has quit IRC | 01:09 | |
| *** yamamoto has joined #openstack-meeting-alt | 01:23 | |
| *** rcernin has quit IRC | 02:44 | |
| *** rcernin has joined #openstack-meeting-alt | 03:06 | |
| *** rcernin has quit IRC | 03:13 | |
| *** rcernin has joined #openstack-meeting-alt | 03:43 | |
| *** rcernin has quit IRC | 03:48 | |
| *** vishalmanchanda has joined #openstack-meeting-alt | 03:52 | |
| *** rcernin has joined #openstack-meeting-alt | 03:53 | |
| *** rcernin has quit IRC | 03:54 | |
| *** rcernin has joined #openstack-meeting-alt | 03:54 | |
| *** vkmc has quit IRC | 04:16 | |
| *** vkmc has joined #openstack-meeting-alt | 04:16 | |
| *** cmurphy has quit IRC | 04:21 | |
| *** cmurphy has joined #openstack-meeting-alt | 04:22 | |
| *** walshh_ has quit IRC | 04:26 | |
| *** walshh_ has joined #openstack-meeting-alt | 04:26 | |
| *** hrybacki has quit IRC | 04:41 | |
| *** hrybacki has joined #openstack-meeting-alt | 04:42 | |
| *** johnsom has quit IRC | 04:46 | |
| *** johnsom has joined #openstack-meeting-alt | 04:49 | |
| *** rcernin has quit IRC | 04:56 | |
| *** rcernin has joined #openstack-meeting-alt | 04:57 | |
| *** jberg-dev has quit IRC | 05:06 | |
| *** jberg-dev has joined #openstack-meeting-alt | 05:07 | |
| *** johnsom has quit IRC | 05:18 | |
| *** johnsom has joined #openstack-meeting-alt | 05:19 | |
| *** zzzeek has quit IRC | 05:25 | |
| *** zzzeek has joined #openstack-meeting-alt | 05:27 | |
| *** zzzeek has quit IRC | 05:50 | |
| *** zzzeek has joined #openstack-meeting-alt | 05:51 | |
| *** zzzeek has quit IRC | 06:10 | |
| *** zzzeek has joined #openstack-meeting-alt | 06:11 | |
| *** vhari has quit IRC | 06:26 | |
| *** johnsom has quit IRC | 06:27 | |
| *** johnsom has joined #openstack-meeting-alt | 06:27 | |
| *** yamamoto has quit IRC | 07:07 | |
| *** rcernin has quit IRC | 07:10 | |
| *** rcernin has joined #openstack-meeting-alt | 07:13 | |
| *** zzzeek has quit IRC | 07:14 | |
| *** zzzeek has joined #openstack-meeting-alt | 07:16 | |
| *** zzzeek has quit IRC | 07:37 | |
| *** zzzeek has joined #openstack-meeting-alt | 07:38 | |
| *** yamamoto has joined #openstack-meeting-alt | 07:40 | |
| *** ralonsoh has joined #openstack-meeting-alt | 07:43 | |
| *** rcernin has quit IRC | 07:44 | |
| *** yamamoto has quit IRC | 07:45 | |
| *** rcernin has joined #openstack-meeting-alt | 07:47 | |
| *** gagehugo has quit IRC | 07:51 | |
| *** gagehugo has joined #openstack-meeting-alt | 07:51 | |
| *** yamamoto has joined #openstack-meeting-alt | 07:54 | |
| *** macz_ has joined #openstack-meeting-alt | 07:57 | |
| *** slaweq has joined #openstack-meeting-alt | 07:58 | |
| *** macz_ has quit IRC | 08:02 | |
| *** rcernin has quit IRC | 08:20 | |
| *** rdopiera has joined #openstack-meeting-alt | 08:24 | |
| *** zzzeek has quit IRC | 08:26 | |
| *** zzzeek has joined #openstack-meeting-alt | 08:30 | |
| *** rcernin has joined #openstack-meeting-alt | 08:33 | |
| *** zzzeek has quit IRC | 08:38 | |
| *** zzzeek has joined #openstack-meeting-alt | 08:40 | |
| *** rcernin has quit IRC | 08:40 | |
| *** zzzeek has quit IRC | 08:48 | |
| *** zzzeek has joined #openstack-meeting-alt | 08:51 | |
| *** tosky has joined #openstack-meeting-alt | 08:56 | |
| priteau | #startmeeting blazar | 09:00 |
|---|---|---|
| openstack | Meeting started Tue Nov 17 09:00:21 2020 UTC and is due to finish in 60 minutes. The chair is priteau. Information about MeetBot at http://wiki.debian.org/MeetBot. | 09:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 09:00 |
| *** openstack changes topic to " (Meeting topic: blazar)" | 09:00 | |
| openstack | The meeting name has been set to 'blazar' | 09:00 |
| priteau | #topic Roll call | 09:00 |
| *** openstack changes topic to "Roll call (Meeting topic: blazar)" | 09:00 | |
| priteau | Anyone today? | 09:03 |
| priteau | #endmeeting | 09:20 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 09:20 | |
| openstack | Meeting ended Tue Nov 17 09:20:50 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 09:20 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/blazar/2020/blazar.2020-11-17-09.00.html | 09:20 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/blazar/2020/blazar.2020-11-17-09.00.txt | 09:20 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/blazar/2020/blazar.2020-11-17-09.00.log.html | 09:20 |
| *** rcernin has joined #openstack-meeting-alt | 09:32 | |
| *** rcernin has quit IRC | 09:40 | |
| *** zzzeek has quit IRC | 09:57 | |
| *** zzzeek has joined #openstack-meeting-alt | 10:02 | |
| *** rcernin has joined #openstack-meeting-alt | 10:04 | |
| *** rcernin has quit IRC | 10:09 | |
| *** whoami-rajat__ has joined #openstack-meeting-alt | 10:12 | |
| *** yamamoto has quit IRC | 10:29 | |
| *** zzzeek has quit IRC | 10:38 | |
| *** zzzeek has joined #openstack-meeting-alt | 10:40 | |
| *** vhari has joined #openstack-meeting-alt | 10:48 | |
| *** rcernin has joined #openstack-meeting-alt | 10:58 | |
| *** e0ne has joined #openstack-meeting-alt | 11:08 | |
| *** baojg has quit IRC | 11:10 | |
| *** baojg has joined #openstack-meeting-alt | 11:11 | |
| *** zzzeek has quit IRC | 11:17 | |
| *** zzzeek has joined #openstack-meeting-alt | 11:20 | |
| *** baojg has quit IRC | 11:21 | |
| *** zzzeek has quit IRC | 11:27 | |
| *** zzzeek has joined #openstack-meeting-alt | 11:28 | |
| *** yamamoto has joined #openstack-meeting-alt | 11:30 | |
| *** macz_ has joined #openstack-meeting-alt | 11:33 | |
| *** macz_ has quit IRC | 11:38 | |
| *** rcernin has quit IRC | 11:45 | |
| *** yamamoto has quit IRC | 11:45 | |
| *** slaweq has quit IRC | 11:56 | |
| *** slaweq has joined #openstack-meeting-alt | 11:57 | |
| *** rcernin has joined #openstack-meeting-alt | 11:58 | |
| *** yamamoto has joined #openstack-meeting-alt | 12:02 | |
| *** yamamoto has quit IRC | 12:10 | |
| *** ianychoi_ has quit IRC | 12:10 | |
| *** raildo_ has joined #openstack-meeting-alt | 12:14 | |
| *** rcernin has quit IRC | 12:14 | |
| *** raildo has quit IRC | 12:16 | |
| *** yamamoto has joined #openstack-meeting-alt | 12:24 | |
| *** yamamoto has quit IRC | 12:24 | |
| *** yamamoto has joined #openstack-meeting-alt | 12:24 | |
| *** lpetrut has joined #openstack-meeting-alt | 12:24 | |
| *** rfolco has joined #openstack-meeting-alt | 12:26 | |
| *** rfolco has quit IRC | 12:28 | |
| *** yamamoto has quit IRC | 12:29 | |
| *** Luzi has joined #openstack-meeting-alt | 12:36 | |
| *** zzzeek has quit IRC | 12:39 | |
| *** zzzeek has joined #openstack-meeting-alt | 12:41 | |
| *** rcernin has joined #openstack-meeting-alt | 13:02 | |
| *** rcernin has quit IRC | 13:02 | |
| *** yamamoto has joined #openstack-meeting-alt | 13:39 | |
| *** baojg has joined #openstack-meeting-alt | 14:00 | |
| *** Luzi has quit IRC | 14:18 | |
| *** macz_ has joined #openstack-meeting-alt | 14:20 | |
| *** macz_ has quit IRC | 14:24 | |
| *** lbragstad__ has quit IRC | 14:37 | |
| *** lbragstad has joined #openstack-meeting-alt | 14:40 | |
| *** miniroy has joined #openstack-meeting-alt | 14:51 | |
| *** sangeet has joined #openstack-meeting-alt | 14:57 | |
| *** cliffparsons has joined #openstack-meeting-alt | 14:58 | |
| lamt | #startmeeting openstack-helm | 15:01 |
| openstack | Meeting started Tue Nov 17 15:01:40 2020 UTC and is due to finish in 60 minutes. The chair is lamt. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:01 |
| *** openstack changes topic to " (Meeting topic: openstack-helm)" | 15:01 | |
| openstack | The meeting name has been set to 'openstack_helm' | 15:01 |
| lamt | #link https://etherpad.opendev.org/p/openstack-helm-weekly-meeting agenda | 15:02 |
| stevthedev | Hello | 15:02 |
| lamt | o/ | 15:02 |
| miniroy | \o | 15:02 |
| cliffparsons | o/ | 15:02 |
| lamt | Our fearless leader is feeling unwell. He asked me to host this week's meeting | 15:03 |
| miniroy | I am glad he/she decides to take a day off | 15:03 |
| stevthedev | I hope they are getting some rest | 15:04 |
| lamt | I hope *he* is too. | 15:04 |
| lamt | I think we can get started. | 15:04 |
| lamt | Quick reminder, there is no meeting next week | 15:05 |
| lamt | #topic OSH compute gate failure | 15:05 |
| *** openstack changes topic to "OSH compute gate failure (Meeting topic: openstack-helm)" | 15:05 | |
| lamt | This is a follow up from last week, but the gate is still broken | 15:06 |
| miniroy | X) | 15:06 |
| lamt | so no OSH patches can merge | 15:06 |
| sangeet | oh no! | 15:07 |
| stevthedev | Do we know how it is broken? | 15:07 |
| lamt | Not exactly, conjecture is some system library in Bionic | 15:08 |
| lamt | starts to act up | 15:08 |
| miniroy | to be precise, causing openvswitch to gag when it can't create threads | 15:09 |
| stevthedev | Sounds tricky :/ | 15:09 |
| miniroy | let me try that tweak today | 15:09 |
| lamt | I tried to update all the old stuff in the gate (minikube version, helm version, k8s version) | 15:09 |
| miniroy | all signs point to a system issue though | 15:10 |
| lamt | (I think they should be updated anyway) - here was my last attempt that sort of work | 15:10 |
| miniroy | oh really... did that actually help? | 15:10 |
| lamt | https://review.opendev.org/#/c/762361/ | 15:10 |
| lamt | Updating the host to focal worked | 15:10 |
| lamt | "worked" - but | 15:11 |
| lamt | it introduced new problems | 15:11 |
| lamt | it crashes ceph and some other python/C library errored with Rocky | 15:11 |
| lamt | I assume it is some system library difference between focal and bionic was the cause, but I wasn't able to pinpoint it | 15:12 |
| miniroy | hmm.... so at least it confirms our suspicsion | 15:12 |
| lamt | if anyone wants to take a lot, I'd appreciate that | 15:13 |
| miniroy | I will take another crack at it today | 15:13 |
| lamt | Thanks - if upgrading to focal isn't the correct path, we have to find the fix for ovs | 15:14 |
| miniroy | so any other host we can try on besdies vexx and focal? | 15:14 |
| lamt | I believe Andrii tried to address the max task parameter, but from what I can tell it was never limited | 15:14 |
| lamt | so setting it to infinity doesn't do anything | 15:14 |
| lamt | I tried the 32gb node, and same error - doesn't look like system memory constrainted. | 15:15 |
| *** lpetrut has quit IRC | 15:16 | |
| lamt | Thanks miniroy for taking a look | 15:17 |
| miniroy | I wonder if something in the image change..... | 15:17 |
| miniroy | but these are great data points to have | 15:17 |
| lamt | I tried that too - I reverted the ovs image to the date the last gate passed | 15:17 |
| lamt | same failure :/ | 15:18 |
| miniroy | =( | 15:18 |
| lamt | others can chime in as well - but I exhausted all the possibilities why ovs keeps failing | 15:19 |
| miniroy | we don't have local access to any of these hosts right? | 15:20 |
| lamt | I do not think so | 15:20 |
| lamt | if it is not system library - it is some constraints preventing pthread creation | 15:22 |
| miniroy | any idea what kernel is running on focal? | 15:22 |
| lamt | ansible_kernel: 5.4.0-53-generic | 15:24 |
| miniroy | oh and that works actually... wow | 15:24 |
| lamt | it breaks other things | 15:24 |
| lamt | like ceph and rocky | 15:25 |
| lamt | with cffi | 15:25 |
| miniroy | so should we move ahead and try to get it work with focal? or try to get it working with vexx? | 15:26 |
| lamt | I will let others chime in - both require a bit of work | 15:26 |
| lamt | it is asking if you want to fix errors A or errors B. | 15:27 |
| miniroy | well let me poke at that ovs/vexx issue today more then | 15:28 |
| lamt | thanks miniroy | 15:28 |
| miniroy | sounds like probably more work at this point with upgrade to focal | 15:28 |
| miniroy | looks like an onion to me I am afraid | 15:29 |
| lamt | the alternative is to fix ovs | 15:29 |
| miniroy | ceph is probably just the first layer I am afraid | 15:29 |
| lamt | yup | 15:29 |
| miniroy | in the absense of our fearless leader, I say let's focus on fixing ovs for now | 15:30 |
| lamt | ++ | 15:30 |
| lamt | we can take this offline to troubleshoot | 15:31 |
| miniroy | + | 15:31 |
| lamt | let's move on | 15:31 |
| lamt | #topic Open Discussion | 15:31 |
| *** openstack changes topic to "Open Discussion (Meeting topic: openstack-helm)" | 15:31 | |
| lamt | there is no other agenda item - so opening the floor for discussion | 15:32 |
| lamt | if nothing else, we can end the meeting. Everyone have a great rest of the week. | 15:34 |
| lamt | #endmeeting | 15:34 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:34 | |
| openstack | Meeting ended Tue Nov 17 15:34:19 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:34 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_helm/2020/openstack_helm.2020-11-17-15.01.html | 15:34 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_helm/2020/openstack_helm.2020-11-17-15.01.txt | 15:34 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_helm/2020/openstack_helm.2020-11-17-15.01.log.html | 15:34 |
| stevthedev | Thanks Tin | 15:41 |
| *** bnemec has quit IRC | 16:16 | |
| *** hemna has quit IRC | 16:18 | |
| *** hemna has joined #openstack-meeting-alt | 16:23 | |
| *** bnemec has joined #openstack-meeting-alt | 16:50 | |
| *** rafaelweingartne has joined #openstack-meeting-alt | 16:56 | |
| knikolla | #startmeeting keystone | 16:59 |
| openstack | Meeting started Tue Nov 17 16:59:45 2020 UTC and is due to finish in 60 minutes. The chair is knikolla. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:59 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:59 |
| *** openstack changes topic to " (Meeting topic: keystone)" | 16:59 | |
| openstack | The meeting name has been set to 'keystone' | 16:59 |
| knikolla | o/ | 16:59 |
| cmurphy | o/ | 17:00 |
| lbragstad | o/ | 17:01 |
| knikolla | how's everyone? | 17:01 |
| rafaelweingartne | \0 | 17:02 |
| cmurphy | tired today Z.Z | 17:02 |
| knikolla | hey rafaelweingartne, thanks for joining us | 17:04 |
| knikolla | cmurphy: don't work too hard :) | 17:04 |
| rafaelweingartne | welcome :) | 17:04 |
| knikolla | #topic Gerrit Audit | 17:05 |
| *** openstack changes topic to "Gerrit Audit (Meeting topic: keystone)" | 17:05 | |
| knikolla | There was a breach during October, with someone getting gerrit admin permissions | 17:05 |
| knikolla | TC wanted us to perform an audit for changes merged during that period | 17:05 |
| knikolla | I did so and everything was ok | 17:05 |
| knikolla | just FYI | 17:05 |
| lbragstad | nice - thanks knikolla | 17:05 |
| knikolla | #topic Spec Review | 17:07 |
| *** openstack changes topic to "Spec Review (Meeting topic: keystone)" | 17:07 | |
| knikolla | #link https://review.opendev.org/#/c/748042/ | 17:08 |
| knikolla | #link https://review.opendev.org/#/c/748748/ | 17:08 |
| knikolla | cmurphy, lbragstad, please do review so we can merge, or provide feedback and iterate. | 17:08 |
| cmurphy | okay | 17:09 |
| *** geguileo has quit IRC | 17:09 | |
| knikolla | thank you | 17:10 |
| knikolla | #topic Open Discussion | 17:13 |
| *** openstack changes topic to "Open Discussion (Meeting topic: keystone)" | 17:13 | |
| lbragstad | sounds good | 17:13 |
| * lbragstad has to run early to prepare for another meeting | 17:20 | |
| lbragstad | o | 17:20 |
| lbragstad | o/ | 17:21 |
| knikolla | that's alright. we can end early too | 17:21 |
| knikolla | thanks all | 17:21 |
| knikolla | #endmeeting | 17:21 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 17:21 | |
| openstack | Meeting ended Tue Nov 17 17:21:24 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:21 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/keystone/2020/keystone.2020-11-17-16.59.html | 17:21 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/keystone/2020/keystone.2020-11-17-16.59.txt | 17:21 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/keystone/2020/keystone.2020-11-17-16.59.log.html | 17:21 |
| cmurphy | o/ | 17:21 |
| *** rafaelweingartne has quit IRC | 17:21 | |
| *** e0ne has quit IRC | 17:22 | |
| *** geguileo has joined #openstack-meeting-alt | 18:12 | |
| *** geguileo has quit IRC | 18:46 | |
| *** tmazur has joined #openstack-meeting-alt | 18:56 | |
| *** rdopiera has quit IRC | 19:05 | |
| *** gyee has joined #openstack-meeting-alt | 19:18 | |
| *** smcginnis has quit IRC | 20:24 | |
| *** rcernin has joined #openstack-meeting-alt | 21:02 | |
| *** tmazur has quit IRC | 21:04 | |
| *** smcginnis has joined #openstack-meeting-alt | 21:59 | |
| *** ralonsoh has quit IRC | 22:03 | |
| *** yamamoto has quit IRC | 23:14 | |
| *** yamamoto has joined #openstack-meeting-alt | 23:19 | |
| *** slaweq has quit IRC | 23:21 | |
| *** tosky has quit IRC | 23:58 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!