Wednesday, 2020-07-29

*** rcernin has quit IRC00:05
*** wuchunyang has joined #openstack-lbaas00:06
*** wuchunyang has quit IRC00:10
*** rcernin has joined #openstack-lbaas00:31
openstackgerritAdam Harwell proposed openstack/octavia master: Refactoring amphora stats driver interface  https://review.opendev.org/73711100:43
*** andrein has quit IRC00:57
*** zzzeek has quit IRC00:57
*** wuchunyang has joined #openstack-lbaas01:00
*** wuchunyang has quit IRC01:00
*** wuchunyang has joined #openstack-lbaas01:00
*** andrein has joined #openstack-lbaas01:01
*** zzzeek has joined #openstack-lbaas01:01
openstackgerritAnushka Singh proposed openstack/octavia master: [DNM] Create yamas driver for statistics  https://review.opendev.org/74365301:05
*** tkajinam has quit IRC01:06
*** wuchunyang has quit IRC01:06
*** tkajinam has joined #openstack-lbaas01:06
*** wuchunyang has joined #openstack-lbaas01:06
*** armax has quit IRC01:27
*** tkajinam has quit IRC01:33
*** tkajinam has joined #openstack-lbaas01:34
*** wuchunyang has quit IRC02:34
*** wuchunyang has joined #openstack-lbaas03:11
*** sapd1 has joined #openstack-lbaas03:14
*** armax has joined #openstack-lbaas03:28
*** psachin has joined #openstack-lbaas03:38
*** armax has quit IRC03:43
*** gcheresh has joined #openstack-lbaas03:50
*** wuchunyang has quit IRC04:02
*** wuchunyang has joined #openstack-lbaas04:12
*** wuchunyang has quit IRC04:17
*** sapd1 has quit IRC04:45
*** wuchunyang has joined #openstack-lbaas04:50
*** ramishra has quit IRC05:11
*** ramishra has joined #openstack-lbaas05:16
*** ccamposr has quit IRC05:32
*** wuchunyang has quit IRC05:36
*** wuchunyang has joined #openstack-lbaas05:36
*** trunghx has joined #openstack-lbaas06:08
trunghxDear All, About The "Fix listener update with SNI certificates" in https://review.opendev.org/#/c/712790/6, we wish it merged into stable/train branch. Who can help us. Thank you very much!!!06:10
cgoncalvestrunghx, hi. the fix has been backported to and merged in stable/train on July 1706:16
cgoncalveshttps://review.opendev.org/#/q/If5b6411a0b7c75441a406234c2792ea68d35d0fe06:16
*** brtknr has quit IRC06:17
trunghxcgoncalves, Is that so, and yet I don't see, thank you very much cgoncalves :D06:18
cgoncalvestrunghx, pretty sure. I see it on GitHub: https://github.com/openstack/octavia/commit/b9dd09450863a155490f9bbaf4b0dd1f23a00b0206:20
trunghxoh sorry, I saw it. thanks cgoncalves :)06:21
cgoncalvesno problem!06:22
*** gthiemonge has quit IRC06:23
*** gthiemonge has joined #openstack-lbaas06:23
*** ccamposr has joined #openstack-lbaas06:27
*** vishalmanchanda has joined #openstack-lbaas06:39
trunghxcgoncalves That would be a super feature (like)06:51
openstackgerritJay Liu proposed openstack/octavia master: Alternative Distributor for L3 Active-Active, N+1 Amphora Setup  https://review.opendev.org/72386407:03
*** wuchunyang has quit IRC07:19
*** born2bake has joined #openstack-lbaas07:37
*** ataraday_ has joined #openstack-lbaas07:45
*** wuchunyang has joined #openstack-lbaas07:52
*** wuchunyang has quit IRC08:06
*** maciejjozefczyk has joined #openstack-lbaas08:14
*** sapd1 has joined #openstack-lbaas08:22
openstackgerritAnn Taraday proposed openstack/octavia master: Add experimental amphorav2 jobs  https://review.opendev.org/73799308:45
*** brtknr has joined #openstack-lbaas08:46
*** wuchunyang has joined #openstack-lbaas08:47
*** wuchunyang has quit IRC08:50
*** wuchunyang has joined #openstack-lbaas08:50
*** rcernin has quit IRC09:12
*** wuchunyang has quit IRC09:14
*** wuchunyang has joined #openstack-lbaas09:14
*** wuchunyang has quit IRC09:26
*** sapd1 has quit IRC09:57
*** tkajinam has quit IRC10:01
*** ramishra has quit IRC10:08
*** trunghx has quit IRC10:37
*** wuchunyang has joined #openstack-lbaas10:42
*** ramishra has joined #openstack-lbaas10:49
openstackgerritCarlos Goncalves proposed openstack/octavia stable/ussuri: Fix haproxy user flow log format substitution  https://review.opendev.org/74372310:57
openstackgerritCarlos Goncalves proposed openstack/octavia stable/train: Fix haproxy user flow log format substitution  https://review.opendev.org/74372410:58
*** TrevorV has joined #openstack-lbaas13:50
*** rcernin has joined #openstack-lbaas14:41
*** spatel has joined #openstack-lbaas14:45
*** rcernin_ has joined #openstack-lbaas14:51
*** rcernin_ has quit IRC14:56
*** rcernin has quit IRC14:58
*** irclogbot_2 has quit IRC14:58
*** irclogbot_2 has joined #openstack-lbaas14:59
*** wuchunyang has quit IRC15:10
*** sapd1 has joined #openstack-lbaas15:13
*** also_stingrayza has joined #openstack-lbaas15:22
*** stingrayza has quit IRC15:24
*** also_stingrayza is now known as stingrayza15:24
*** spatel has quit IRC15:28
*** armax has joined #openstack-lbaas15:37
*** gcheresh has quit IRC15:43
johnsom#startmeeting Octavia16:00
openstackMeeting started Wed Jul 29 16:00:01 2020 UTC and is due to finish in 60 minutes.  The chair is johnsom. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: Octavia)"16:00
openstackThe meeting name has been set to 'octavia'16:00
johnsomHi everyone16:00
cgoncalveso/16:00
* xgerman lurking16:00
ataraday_hi16:00
*** shtepanie has joined #openstack-lbaas16:00
gthiemongeHi16:00
aannuusshhkkaa hi16:00
johnsom#topic Announcements16:00
*** openstack changes topic to "Announcements (Meeting topic: Octavia)"16:01
johnsomVote for PTG week16:01
johnsomThere is a poll open for which week we should have the PTG16:01
johnsom#link http://lists.openstack.org/pipermail/openstack-discuss/2020-July/016098.html16:01
rm_worko/16:01
johnsomYou should have got an e-mail about it, but if not the link in that e-mail should work16:02
johnsomAlso, call for presentations for the virtual summit16:02
johnsom#link https://cfp.openstack.org/16:02
johnsomRegistration for the summit is also open.16:03
johnsom#link https://www.openstack.org/summit/2020/16:03
johnsomFinally, I wanted to mention that our gates are broken due to a pyroute2 bump the neutron folks needed. 0.5.13 included another change that broke looking up interfaces.16:04
johnsomI have opened the following bug:16:04
johnsom#link https://github.com/svinota/pyroute2/issues/72416:04
johnsomThere is a proposed patch, but unfortunately they didn't merge it and release last night.16:05
johnsomA bit later in the meeting we should talk about our timeline and if we should revert the 0.5.13 version bump in upper-constraints.16:05
johnsomAny other announcements today?16:05
cgoncalvesone other announcement: Queens and Rocky releases are officially EOL16:06
rm_work\o/16:06
rm_workwoooooo16:06
cgoncalvesall open stable/queens and stable/rocky patches were abandoned16:07
johnsomYeah, that was great! Supporting those old OS releases and versions was a pain.16:07
johnsomcgoncalves Thank you, I had the window open to do that, but you beat me to it!16:07
johnsomAny thing else?16:09
johnsom#topic Brief progress reports / bugs needing review16:09
*** openstack changes topic to "Brief progress reports / bugs needing review (Meeting topic: Octavia)"16:09
johnsomI have wrapped up the first pass on backporting the failover flow update to the amphora v2 driver. It is passing for me.16:10
johnsom#link16:10
rm_workSweet16:10
rm_worklink? :D16:10
johnsom#link https://review.opendev.org/73829216:10
johnsomSorry, pebkac16:10
rm_workdelta-based metrics seems like it's about to merge, once gates are fixed! thanks for the reviews16:11
johnsomI have pivoted back to working on cleaning up the tempest tests.16:11
rm_workthe next thing in that chain is a refactor to make the drivers actually workable for more than just databases, and also more sane for third-party stuff that uses the agent to report stats16:11
rm_work#link https://review.opendev.org/#/c/73711116:11
ataraday_On top of my list review of update failover v2, I rebased experimental jobs change on top of it - as soon as gates fixed - we can check jobs there as well.16:11
rm_workThat is ready for review, and I'd love to at least know in general whether there's major objections to the overall plan16:12
johnsomExcellent on both accounts16:12
johnsomHa, that got big. I will add it to my review list. I have a few things on there already16:13
rm_workwe have an additional stats driver on top of that as an example -- but it is only for an internal stats service we use... though I think could be easily modified to work with something else like prometheus or influx/carbon16:13
rm_workah like 75% of that is just things moving from one file to another (over half is just a test file that moved, really)16:14
cgoncalvesfriendly reminder to add patches to the priority review list for better visibility/tracking16:14
cgoncalves#link https://etherpad.opendev.org/p/octavia-priority-reviews16:14
ataraday_Also cgoncalves change is ready https://review.opendev.org/#/c/739053/ - we may consider have jobboard disabled by default if we still want to drop v1/v2 code paths and do not feel that jobboard is ready to be default in next release16:14
johnsomYeah, I really need to spend some quality time there.16:14
rm_workyeah i'll for sure get to that at some point soon T_T16:14
johnsomataraday_ That is the next topic on the agenda!16:15
cgoncalvesataraday_, thank you for the reviews!16:15
ataraday_oops!16:15
rm_workyeah I think v2 without jobboard (as much as we do want jobboard) makes me more comfortable, to allow a slow transition16:15
johnsomNo worries, just highlighting the topic. It is an important one today.16:16
johnsomOk, any other updates today, or are we ready for the main event?16:17
cgoncalveshmm, now that I'm thinking about this again I guess we need to make some code in the devstack plugin conditional to jobboard being enabled. for example, skip redis install and octavia_persistence mysql database16:17
johnsom#topic Amphora V2 driver status for Victoria16:18
*** openstack changes topic to "Amphora V2 driver status for Victoria (Meeting topic: Octavia)"16:18
rm_workyeah make a devstack var that sets that AND the config i guess16:18
ataraday_cgoncalves, good point - this should be skipped16:18
johnsomOk, at the PTG we set Victoria milestone 2 as the checkpoint on if we are ready to transition the default driver to the amphora v2 code.16:18
johnsom#link https://etherpad.opendev.org/p/octavia-virtual-V-ptg16:19
johnsomMS 2 is this week, so we need to make a call if we are ready for that transition16:19
johnsomI have been working with the amphora v2 driver a bunch over the last few weeks for the failover backport and I have some concerns.16:20
johnsomWe put together an etherpad:16:20
johnsom#link https://etherpad.opendev.org/p/octavia-amphora-v216:20
rm_workPersonally, as much as I LOVE to deprecate things as fast as possible, and we'd need to do this to start the deprecation clock on v1 i think... I am not super comfortable opting to make it the default driver when we're only just now getting it to feature parity with v1. :/16:21
johnsomI think for the most part, the major code work is done, but I think we have some bugs/learning to do.16:21
rm_workYeah I'd much rather have a cycle to work out the bugs a bit and get some real world testing in, before we just go shove this in people's faces. We've worked very very hard to try to gain some amount of trust, I don't want to throw that away by releasing something prematurely16:22
johnsomMy biggest concern is I have had some endless loops fire off where jobs continuously get re-dispatched.16:22
johnsomThis burned my cloud down in one case by allocating all of the IPs on the lb-mgmt-net16:22
rm_workI think I would feel this way even if you didn't have concrete bugs to point to -- it's just my gut talking16:22
johnsomSo, personally I think we should hold on making V2 with jobboard the default one more cycle to work out these issues.16:23
ataraday_I can say if set v2 as default WITHOUT jobboard there will be still 2 changes to be merged - failover update and healthmotinor fixes16:23
johnsomYeah, so I kind of like this idea, switching to v2 with jobboard disabled.16:23
cgoncalves+116:24
johnsomI don't see any real issues (maybe a few minor things) that would stop that16:24
johnsomIn theory we could start the v1 deprecation as well, which really the sooner the better16:24
rm_workhmmm16:25
rm_workif you feel more comfortable with that16:25
rm_workso we'd switch at the end of this cycle (on release) which is... in a couple months?16:25
rm_workneed to look up the date again16:25
johnsomYeah, the issues I see don't happen with jobboard disabled. It's only when we are using the jobboard that things get redispatched and we need to update status.16:26
rm_workyeah i think i could be ok with that16:26
cgoncalves+1. starting deprecation signals on the v1 means not adding new features to it and that is a good thing16:26
johnsom#link https://releases.openstack.org/victoria/schedule.html16:26
rm_workthe flows need to get tested more... but it's maybe less complexity without jobboard in the loop16:26
rm_workso yes, 2 more months16:27
johnsomYeah, I would say we land cgoncalves changes, then switch to v2 default and deprecate v1 soon there after. We will be running the new code paths and transitioning to a more "provider driver" like path.16:27
rm_workI think that'll be acceptable16:27
johnsomI will say, currently v2 is *slightly* slower than v1 in that it is making more round trips to the DB. This is some optimization work we still need to complete, but I don't see it as a show stopper.16:28
johnsomOk, so any concerns with that plan?16:28
cgoncalvesshould we alias amphora -> amphorav2 too? and create "amphorav1"16:28
*** ccamposr has quit IRC16:28
johnsomNext question, are we doing this as an alias change?16:29
rm_workthat would be a sane way to do that i think16:29
johnsomlol, yeah, that question16:29
rm_workswaps the default with a path back to explicit v16:29
rm_work*explicit v116:29
johnsomYeah, I'm thinking amphora becomes amphorav1, amphorav2 stays, amphora points to amphorav2.16:30
cgoncalves+1. ship it!16:31
rm_work+116:31
rm_workand now i need to afk for like 10m, br16:31
rm_work*brb16:31
ataraday_+116:31
johnsomOk, I think we have a plan16:31
cgoncalvesyou're no fun, folks. everyone's in agreement16:32
johnsomAny other questions or comments on the amphora v2 driver?16:32
johnsomOk. If anyone has some cycles to help develop solutions to the issues on the etherpad, help is welcome. I think we just need to learn a bit more and create a few fixes.16:33
johnsomI wish Josh was still around, he could probably fix it in a matter of minutes. lol16:33
johnsom#topic Open Discussion16:34
*** openstack changes topic to "Open Discussion (Meeting topic: Octavia)"16:34
johnsomAny other topics today?16:34
johnsomIs anyone planning a summit presentation?16:34
johnsomI am considering doing a "new features" presentation. We have a bunch of stuff we can introduce and demonstrate16:36
cgoncalvesI think a deep-dive on the new features would be nice. I remember it has been presented in past releases and it was well received16:36
xgermansounds like a workshop :-)16:37
cgoncalveslol, we are in sync :)16:37
johnsomOk, I may submit something. Let me know if you are interested in co-presenting.16:37
cgoncalvessure, I can join you as co-presenter if no one else is interested16:38
johnsomI have an internal presentation I need to create as well, so I guess I will be engineering-by-slide here soon. lol16:39
aannuusshhkkaawill the metrics be a part of the "new features" if we are able to complete it before the summit?16:39
johnsomCertainly could be. I was planning on things that we have released but not preseneted, but if there is high confidence in there being work complete to present, we should do that!16:40
aannuusshhkkaayay! thanks!!16:41
johnsomI can help with preparing slides too, so we would collaborate on the content. I usually put them up on google drive for the presenters to work on it together.16:42
johnsomOk, so think about topics/content and I will bring the topic up again next week. If you want to submit your own presentation that is great as well, just remember I think it is down to a week before the deadline.16:43
johnsompresentation proposal deadline16:43
johnsom#link https://cfp.openstack.org/16:43
johnsomOk, one more thing, xgerman would like to have an informal "happy hour" type video chat after the meeting. If you are interested, the link is here:16:44
johnsom#link http://meet.google.com/ita-bmmu-uyw16:44
* xgerman approves this message16:44
johnsomlol16:44
johnsomSince we haven't had an in person chat in a while...16:45
johnsomNo worries if you can't make it, no Octavia decisions will be made, just a hang out and chat.16:45
xgerman+116:45
johnsomAny other topics today?16:46
johnsomOk, thank you all!16:46
johnsom#endmeeting16:46
*** openstack changes topic to "Discussions for OpenStack Octavia | Priority bug review list: https://etherpad.openstack.org/p/octavia-priority-reviews"16:46
openstackMeeting ended Wed Jul 29 16:46:54 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:46
openstackMinutes:        http://eavesdrop.openstack.org/meetings/octavia/2020/octavia.2020-07-29-16.00.html16:46
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/octavia/2020/octavia.2020-07-29-16.00.txt16:46
openstackLog:            http://eavesdrop.openstack.org/meetings/octavia/2020/octavia.2020-07-29-16.00.log.html16:47
rm_worko/16:47
rm_worklol16:47
*** ataraday_ has quit IRC16:50
*** psachin has quit IRC16:53
*** wuchunyang has joined #openstack-lbaas17:07
*** armax has quit IRC17:19
*** armax has joined #openstack-lbaas17:19
*** sapd1 has quit IRC17:26
*** maciejjozefczyk has quit IRC18:24
*** vishalmanchanda has quit IRC18:29
*** born2bake has quit IRC19:12
*** shtepanie has quit IRC19:20
*** born2bake has joined #openstack-lbaas20:10
*** TrevorV has quit IRC21:16
*** rcernin_ has joined #openstack-lbaas22:35
*** wuchunyang has quit IRC22:45
*** rcernin_ has quit IRC22:48
*** rcernin has joined #openstack-lbaas22:48
*** tkajinam has joined #openstack-lbaas22:53
johnsomrm_work aannuusshhkkaa and stephanie I have commented on teh stats driver interface. It looks good, just a few comments.23:33
*** ramishra has quit IRC23:52

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!