16:00:33 <johnsom> #startmeeting Octavia 16:00:34 <openstack> Meeting started Wed May 20 16:00:33 2020 UTC and is due to finish in 60 minutes. The chair is johnsom. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:00:36 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:00:38 <openstack> The meeting name has been set to 'octavia' 16:00:47 <johnsom> Hi everyone! 16:00:56 <gthiemonge> Hi! 16:01:28 <ataraday_> hi 16:01:29 <cgoncalves> hi 16:01:31 <johnsom> Welcome to the second week of Victoria development 16:01:59 <johnsom> #topic Announcements 16:02:01 <haleyb> hi 16:02:14 <johnsom> My regular items for the PTG: 16:02:20 <johnsom> PTG registartion is open 16:02:26 <johnsom> #link https://www.openstack.org/ptg/ 16:02:33 <johnsom> Our PTG etherpad: 16:02:41 <johnsom> #link https://etherpad.opendev.org/p/octavia-virtual-V-ptg 16:03:12 <johnsom> Next week I will try to put together a tentative schedule based on the topics we have in the etherpad. 16:03:34 <johnsom> It almost never goes to that plan, but it's better having a rough idea than nothing. 16:04:15 <johnsom> So, please add any topics you would like to discuss with the community this week or early next week so I can get a reasonable schedule put together. 16:04:42 <johnsom> Any other announcements this week? 16:05:25 <johnsom> #topic Brief progress reports / bugs needing review 16:05:40 <johnsom> I was off doing downstream stuff most of last week. 16:06:00 <johnsom> This week I have been trying to focus on code reviews and helping with rebasing 16:08:40 <johnsom> We have a number of things we need to catch up on that has me nervous. One is porting the failover patch to the v2 code path. Then some follow on patches (amphora delete for example). We also need to go back and do the "multi-process" code path for the TLS work. Double check it is all v2 ok, then finish the tempest and dashboard work on the TLS patches. I also have more tempest refactor work to finish, which 16:08:40 <johnsom> may require multi-node working. 16:09:25 <ataraday_> Probably better for open discussion, but grenade job start failing on default ciphers change https://review.opendev.org/#/c/685337/ 16:09:39 <johnsom> Doh 16:09:39 <ataraday_> not sure what is causing it... 16:11:15 <cgoncalves> the failover patch is still open and needs to be reviewed and merged asap, yeah. we've had customers hitting amphora failover issues due to broken clusters. 16:12:17 <johnsom> ataraday_ "unknown keyword 'ssl-default-bind-ciphersuites' in 'global' section\n" is the issue with ciphers 16:12:19 <cgoncalves> I want to give it a good review, but coming from Michael and been reviewed by Adam I'm sure it's in pretty good shape :) 16:12:42 <johnsom> Not sure why the tls test didn't also fail though. Plus, really points to the need to get the tempest tests done 16:13:33 <cgoncalves> yeah, I also noticed grenade job failing on the default ciphers. I did not have time to look deep but looked like a legit issue 16:14:00 <ataraday_> johnsom, yeah but all other jobs don't fail in that way - https://review.opendev.org/#/c/685337/27/octavia/amphorae/backends/agent/api_server/haproxy_compatibility.py@62 process_cfg_for_version_compat should remove it if it is not supported... 16:14:33 <cgoncalves> on a second thought, I think I saw in in relation to tls version, not cipher 16:15:01 <cgoncalves> https://review.opendev.org/#/c/726741/ 16:15:02 <ataraday_> I fixed tls version in tempest - so barbican job passed 16:15:10 <cgoncalves> __init__() got an unexpected keyword argument 'tls_ciphers' (HTTP 500) 16:15:21 <johnsom> I put figuring out the TLS 1.3 ciphersuite settings as a PTG topic as I think we have a choice to make there about the API 16:17:25 <johnsom> FYI, I got reviews on some of the TLS patches this week. I think Dawson is interested in seeing them through, so I will give him some time to address the comments before taking those over. 16:17:59 <johnsom> I'm not sure if the other students will do any additional updates to their patches 16:19:23 <johnsom> Any other updates today? 16:20:39 <johnsom> One more thing I could mention here or in open discussion. I'm poking at the configuration of our gate jobs some. This is specifically related to the tempest refactor and the pending need for faster testing. 16:21:27 <johnsom> I have posted a test job that moves the libvirt machine type over to q35 from i440fx. This is a long overdue change that the nova team is considering as well. 16:21:54 <johnsom> FYI, i440fx platform was the hot thing in 1997.... It is PCI based 16:22:09 <haleyb> Pentium Pro 16:22:21 <johnsom> q35 is a more modern platform and getting more attention from the kvm, etc. folks. It is PCIe based. 16:22:46 <johnsom> I don't expect a lot of performance benefit from this change, but I'm hoping for a bit more stability. 16:22:47 <cgoncalves> thank you for looking into it 16:23:02 <cgoncalves> question: why not wait for Nova to make it default? 16:23:13 <johnsom> So, just an FYI really. 16:23:34 <johnsom> Well, that has been kicking around nova for over a year. 16:23:34 <cgoncalves> is it to fix the KVM crashes in vexxhost? 16:24:05 <johnsom> I think it might help us and I want to get out in front of it so 8if* it breaks us in some way we know before it's the default in nova. 16:24:56 <gthiemonge> one more thing: tempest tests for UDP LBs are failing on CentOS because of the behavior of nmap-netcat (used by checkers), I proposed a fix at https://review.opendev.org/#/c/729230/ 16:24:57 <cgoncalves> ok. just wanted to understand the motivation behind it 16:25:03 <johnsom> It *might* help with the KVM stability issues. It also might help us with performance with the virtio drivers since it gets more attention than the i440 16:25:39 <johnsom> Basically I am kicking the tires and giving it a try to see what we get. 16:26:35 <johnsom> #topic RFE/Specifications 16:26:50 <johnsom> I also wanted to highlight we have a couple of specs up for review 16:26:56 <johnsom> Notifications 16:27:03 <johnsom> #link https://review.opendev.org/727915 16:27:13 <johnsom> Active/Active 16:27:22 <johnsom> #link https://review.opendev.org/723864 16:27:58 <johnsom> I would really like us to be responsive on these. It would be great if everyone could review, comment, and help out with wording. 16:28:38 <johnsom> I thought there was a third, but I didn't see it in my quick pre-meeting search. Let me know if you see it. 16:28:57 <johnsom> I expect both of these to need a few cycles before they are good to go. 16:29:12 <johnsom> Notifications are also on the PTG discussion list. 16:29:42 <johnsom> A reminder, we are not looking for perfection on these, but we want to make sure: 16:29:46 <johnsom> The use case is clear 16:29:58 <johnsom> We have designed any problem areas 16:30:06 <johnsom> Call out API changes required 16:30:18 <johnsom> Call out database schema changes/designs 16:30:56 <johnsom> Has a reasonably clear description of the change to the code base (i.e. where hooks for notifications would be placed, etc.) 16:31:33 <johnsom> We want to discuss anything that once merged we would be stuck with type design choices... 16:32:14 <johnsom> Any questions or comments on the specs? 16:34:02 <johnsom> #topic Open Discussion 16:34:02 <cgoncalves> I agree with your suggestions for the RFEs 16:34:45 <johnsom> Any other topics today? 16:35:17 <johnsom> ataraday_ Did we cover the grenade job issue or is there more we should discuss there? 16:37:10 <ataraday_> did something changed in this job recently? 16:37:22 <ataraday_> as it was successful before.. 16:38:07 <johnsom> I think the switch to zuul v3 based grenade merged recently (or it's still an open review) 16:38:47 <haleyb> https://review.opendev.org/#/c/726741/ 16:39:29 <haleyb> but it's failing too 16:40:00 <cgoncalves> __init__() got an unexpected keyword argument 'tls_ciphers' 16:40:07 <johnsom> #link https://review.opendev.org/#/c/725098/ 16:41:00 <cgoncalves> #link https://zuul.opendev.org/t/openstack/build/8c36ad31ce234aa7a2251566ddbf6e02/log/controller/logs/screen-o-api.txt#1787 16:42:06 <haleyb> my link was to the stable/ussuri one, which is failing in the same way 16:42:43 <cgoncalves> I see /opt/stack/old/octavia-lib/ in the trace. wondering if octavia-lib is not being upgraded, it should have been at that point 16:42:45 <johnsom> There might have been a bug here: 16:42:47 <johnsom> #link https://review.opendev.org/#/c/717154/ 16:43:23 <johnsom> Oh, that is interesting, yeah, if the transition doesn't update that module it would have issues 16:45:15 <cgoncalves> I can take point in this 16:45:38 <cgoncalves> may be a legit issue in our grenade job actually, so my bad 16:45:54 <johnsom> cgoncalves Thank you! 16:46:09 <johnsom> Any other topics today? 16:47:59 <johnsom> Ok, thank you for another great meeting. Good discussions. Have a great week! 16:48:04 <johnsom> #endmeeting