*** luksky has quit IRC | 01:04 | |
*** armax has quit IRC | 01:24 | |
*** mithilarun has quit IRC | 01:27 | |
*** goldyfruit_ has quit IRC | 01:43 | |
*** armax has joined #openstack-lbaas | 02:04 | |
*** armax has quit IRC | 02:49 | |
*** sapd1 has joined #openstack-lbaas | 03:20 | |
*** psachin has joined #openstack-lbaas | 03:35 | |
*** sapd1 has quit IRC | 04:46 | |
*** sapd1 has joined #openstack-lbaas | 04:59 | |
*** ramishra has joined #openstack-lbaas | 05:10 | |
*** sapd1 has quit IRC | 05:24 | |
rm_work | sorrison: found an icky bug T_T | 05:46 |
---|---|---|
rm_work | sorrison: https://github.com/openstack/octavia/blob/master/octavia/compute/drivers/nova_driver.py#L253-L263 | 05:47 |
rm_work | if you have a *default* AZ set up (so, in config you specify an availability_zone and amp_boot_network_list for the management net) and you also set up another AZ with the azprofile+az, and try to create a LB in it... this code won't find the right management interface and you'll end up with no lb_network_ip | 05:49 |
rm_work | but there's not an easy way here to actually tie this to an LB or AZ | 05:50 |
rm_work | it's a few layers deep away from actually knowing/caring about anything besides the compute id | 05:50 |
rm_work | would need to change compute_base :/ | 05:51 |
*** mithilarun has joined #openstack-lbaas | 06:10 | |
*** mithilarun has joined #openstack-lbaas | 06:11 | |
*** mithilar_ has joined #openstack-lbaas | 06:37 | |
*** mithilarun has quit IRC | 06:40 | |
*** mithilar_ has quit IRC | 06:40 | |
*** mithilarun has joined #openstack-lbaas | 06:41 | |
openstackgerrit | Adam Harwell proposed openstack/octavia master: Select the right lb_network_ip interface using AZ https://review.opendev.org/704927 | 06:51 |
rm_work | sorrison: ^^ FYI | 06:51 |
*** luksky has joined #openstack-lbaas | 07:14 | |
*** mithilar_ has joined #openstack-lbaas | 07:26 | |
*** mithilarun has quit IRC | 07:29 | |
*** mithilar_ has quit IRC | 07:30 | |
*** AlexStaf has joined #openstack-lbaas | 07:32 | |
*** gcheresh_ has joined #openstack-lbaas | 07:46 | |
*** tesseract has joined #openstack-lbaas | 07:47 | |
*** maciejjozefczyk has joined #openstack-lbaas | 07:53 | |
*** gcheresh_ has quit IRC | 08:09 | |
*** gcheresh_ has joined #openstack-lbaas | 08:13 | |
*** rpittau|afk is now known as rpittau | 08:14 | |
*** tkajinam has quit IRC | 08:15 | |
*** gcheresh_ has quit IRC | 08:47 | |
*** gcheresh_ has joined #openstack-lbaas | 08:50 | |
*** luksky has quit IRC | 08:58 | |
*** gcheresh_ has quit IRC | 09:15 | |
*** ivve has joined #openstack-lbaas | 09:19 | |
*** gcheresh_ has joined #openstack-lbaas | 09:22 | |
*** luksky has joined #openstack-lbaas | 09:35 | |
*** gcheresh_ has quit IRC | 09:36 | |
*** gcheresh_ has joined #openstack-lbaas | 09:41 | |
*** salmankhan has joined #openstack-lbaas | 10:09 | |
*** spatel has joined #openstack-lbaas | 10:29 | |
*** spatel has quit IRC | 10:34 | |
*** pcaruana has quit IRC | 10:46 | |
*** spatel has joined #openstack-lbaas | 10:47 | |
*** devfaz has quit IRC | 10:54 | |
*** devfaz has joined #openstack-lbaas | 10:55 | |
*** rpittau is now known as rpittau|bbl | 11:14 | |
*** ccamposr has joined #openstack-lbaas | 11:17 | |
*** ramishra has quit IRC | 11:47 | |
*** pcaruana has joined #openstack-lbaas | 11:48 | |
*** ramishra has joined #openstack-lbaas | 12:02 | |
*** pcaruana has quit IRC | 12:21 | |
*** goldyfruit_ has joined #openstack-lbaas | 12:59 | |
*** AlexStaf has quit IRC | 13:00 | |
*** maciejjozefczyk has quit IRC | 13:21 | |
*** rpittau|bbl is now known as rpittau | 13:29 | |
*** maciejjozefczyk has joined #openstack-lbaas | 13:30 | |
openstackgerrit | Carlos Goncalves proposed openstack/neutron-lbaas-dashboard stable/stein: Fix auth url for Barbican client https://review.opendev.org/705008 | 13:44 |
openstackgerrit | Carlos Goncalves proposed openstack/neutron-lbaas-dashboard stable/rocky: Fix auth url for Barbican client https://review.opendev.org/705009 | 13:45 |
openstackgerrit | Carlos Goncalves proposed openstack/neutron-lbaas-dashboard stable/queens: Fix auth url for Barbican client https://review.opendev.org/705011 | 13:46 |
*** pcaruana has joined #openstack-lbaas | 14:03 | |
*** psachin has quit IRC | 14:32 | |
*** pcaruana has quit IRC | 14:34 | |
*** gcheresh_ has quit IRC | 14:45 | |
*** gcheresh_ has joined #openstack-lbaas | 14:48 | |
*** pcaruana has joined #openstack-lbaas | 15:02 | |
*** salmankhan1 has joined #openstack-lbaas | 15:03 | |
*** gcheresh_ has quit IRC | 15:04 | |
*** salmankhan has quit IRC | 15:04 | |
*** salmankhan1 is now known as salmankhan | 15:04 | |
*** trident has quit IRC | 15:06 | |
*** trident has joined #openstack-lbaas | 15:17 | |
*** psachin has joined #openstack-lbaas | 15:29 | |
*** salmankhan1 has joined #openstack-lbaas | 15:35 | |
*** salmankhan has quit IRC | 15:38 | |
*** salmankhan1 is now known as salmankhan | 15:38 | |
*** spatel has quit IRC | 15:43 | |
*** armax has joined #openstack-lbaas | 15:44 | |
*** TrevorV has joined #openstack-lbaas | 15:44 | |
*** Trevor_V has joined #openstack-lbaas | 15:47 | |
*** TrevorV has quit IRC | 15:51 | |
*** spatel has joined #openstack-lbaas | 15:53 | |
*** nmickus has joined #openstack-lbaas | 16:01 | |
*** nmickus has quit IRC | 16:04 | |
*** nmickus has joined #openstack-lbaas | 16:05 | |
*** maciejjozefczyk has quit IRC | 16:06 | |
*** nmickus has quit IRC | 16:06 | |
*** ivve has quit IRC | 16:10 | |
johnsom | https://www.irccloud.com/pastebin/apVLTDQj/ | 16:23 |
*** ccamposr has quit IRC | 17:04 | |
*** dawzon has joined #openstack-lbaas | 17:08 | |
*** tesseract has quit IRC | 17:08 | |
*** stevenglasford__ has joined #openstack-lbaas | 17:29 | |
rm_work | johnsom: could you glance at https://review.opendev.org/#/c/704927/ ? | 17:41 |
rm_work | unrelated-ish, not sure why it got that random test failure, should be completely unrelated | 17:42 |
rm_work | since it only failed on one of the 2-4 places it ran? >_> | 17:42 |
rm_work | yep, 4 | 17:43 |
*** salmankhan has quit IRC | 17:46 | |
johnsom | Was dealing with storyboard. Looking. | 17:46 |
rm_work | anyway recheck should take care of that i assume | 17:50 |
rm_work | but the main issue is... an issue | 17:50 |
rm_work | just want eyes on it because i'm about 10 minutes from merging it internally and deploying to prod :D | 17:51 |
johnsom | I really don't like that "get_amphora" needs a management_network_id parameter...... | 17:51 |
johnsom | The compute driver *should not care* | 17:52 |
johnsom | rm_work Yeah, don't like it | 17:58 |
rm_work | well look what it does | 17:58 |
rm_work | it obviously cares | 17:59 |
rm_work | it already loads the management networks | 17:59 |
rm_work | it just loads them statically from config | 17:59 |
rm_work | if it didn't care, i wouldn't need to make this modification | 17:59 |
johnsom | I think you are missing my point. There is no reason I should need to pass that into get_amphora in the compute driver. The compute driver should not care about the lb-mgmt-net. | 18:01 |
rm_work | ok, then ignoring my patch, we need to rewrite that function | 18:01 |
rm_work | do you agree with that? | 18:01 |
rm_work | the function is already bad | 18:01 |
johnsom | Since the underlying code seems to care and blurs that line, we should hide this AZ issue too or simply remove that from the model if it's not used. | 18:01 |
johnsom | Yeah, we are on the same page for that | 18:01 |
rm_work | ok, so it should just return all of the interfaces | 18:02 |
rm_work | and there should be a different function that understands the other bits, in a different place | 18:02 |
johnsom | That seems more logical for a compute driver to me | 18:02 |
rm_work | and that should do the filtering | 18:02 |
rm_work | k | 18:02 |
*** rpittau is now known as rpittau|afk | 18:02 | |
rm_work | this is going to take me a bit to get to then | 18:02 |
rm_work | i guess i'll have to run this internally until then | 18:02 |
johnsom | It's trying to shove the nova data into the Amphora data model, which, maybe isn't the right answer. Maybe there needs to be a compute data model amphora object? or leave more bits "None". | 18:04 |
rm_work | maybe? but then how do we deal with that info | 18:05 |
johnsom | Another interim is to just pull the AZ records since you have the AZ from nova, and get the mgmt net info from that. It would still hide the ugly | 18:05 |
rm_work | and is it specific to the compute driver how the interfaces are plugged on compute? | 18:05 |
rm_work | uhh you can't | 18:05 |
rm_work | nova az != az | 18:05 |
rm_work | also there is no DB access in that part of the driver | 18:05 |
rm_work | i could pass the AZ object through entirely | 18:05 |
johnsom | Didn't I argue that AZ should == nova AZ? | 18:06 |
rm_work | but i opted for passing the smallest granularity | 18:06 |
rm_work | you may have? but that's a bad idea | 18:06 |
rm_work | but | 18:06 |
rm_work | *so, we didn't do that | 18:06 |
johnsom | Ah, but there is a mapping in the az profile right. | 18:06 |
johnsom | That is what I argued for I think | 18:06 |
rm_work | yeah so ... assuming there is only one AZ profile using that nova AZ (which we don't guarantee) and we had access to the DB at that layer of the driver (we do not) then yeah, we could pull it | 18:07 |
rm_work | that was the first thing i tried to do, for all of about 20 seconds :D | 18:07 |
rm_work | before i realized it's a no-go | 18:07 |
johnsom | Yeah, ok, I see.... | 18:07 |
johnsom | Would have to go from amp record down | 18:08 |
rm_work | amp record don't have it | 18:08 |
rm_work | LB has it | 18:08 |
rm_work | and as of yet, amp record isn't linked to LB at this stage | 18:08 |
rm_work | (we have another patch up to do that tho) | 18:08 |
johnsom | Yeah, so, ok, back to the original plan then. See if we can nuke that lb_mgmt_ip field | 18:09 |
rm_work | yeah so that requires us to not do the net filtering at that level (so, no returning the lb_network_ip) | 18:09 |
rm_work | we'd need to return more raw data? and then parse it out | 18:09 |
rm_work | in ... some other place? | 18:09 |
johnsom | I'm not sure it's even used at all | 18:09 |
johnsom | So, I would check that first | 18:10 |
rm_work | ?? | 18:10 |
rm_work | yes it absolutely is | 18:10 |
rm_work | that's the management IP address | 18:10 |
rm_work | which needs to be in the amp record in literally the next action | 18:10 |
rm_work | (compute wait) | 18:10 |
rm_work | that is how i found this issue | 18:10 |
johnsom | But I bet 99%+ of the code uses that from the DB record, not the return from an compute amphora get | 18:10 |
rm_work | right | 18:10 |
rm_work | but this function is called in the flow that updates the DB | 18:10 |
johnsom | Ah, got it | 18:10 |
rm_work | we've got a very tight window | 18:11 |
johnsom | At that point in the code, that IP should be the *only* one on the nova amp. | 18:12 |
rm_work | theoretically? | 18:12 |
johnsom | Hmm, maybe that isn't true in all clouds | 18:12 |
rm_work | right | 18:12 |
johnsom | I remember someone had some other automagic IPs | 18:12 |
rm_work | yes | 18:12 |
johnsom | So, we need to the get the list of possible lb-mgmt-nets down to that method | 18:12 |
rm_work | yes | 18:12 |
rm_work | except the only place it CAN be a list is in that config item | 18:13 |
rm_work | which we really need to deprecate <_< | 18:13 |
rm_work | and make a single network-id | 18:13 |
johnsom | Agreed | 18:13 |
johnsom | Ok, so catching up. | 18:13 |
johnsom | lol | 18:13 |
rm_work | i considered reading the config outside of there, and passing it through at the layer above | 18:13 |
rm_work | the difference is minimal but totally doable | 18:14 |
rm_work | just cut/paste the logic up to the task layer | 18:14 |
rm_work | and pass only the correct *list* (sigh) | 18:14 |
*** mithilarun has joined #openstack-lbaas | 18:14 | |
johnsom | It's the union of the list of lb-mgmt-nets in the AZ profiles and the default config option. right? | 18:15 |
*** numans has joined #openstack-lbaas | 18:16 | |
*** gcheresh has joined #openstack-lbaas | 18:19 | |
rm_work | no | 18:22 |
rm_work | AZ profile overrides config option | 18:22 |
rm_work | if there's one from the AZ, it uses that one only | 18:22 |
rm_work | if there isn't, it uses the config one | 18:22 |
rm_work | (even if that's None) | 18:22 |
johnsom | rm_work Ok, you brought me around on this. I posted a few new comments with the idea of moving forward with the optional pass in. | 18:23 |
johnsom | Though the more I think of it, I'm not sure it is optional.... or maybe something about the lb-mgmt-ip will be None.... ugh. This is messy | 18:24 |
*** luksky has quit IRC | 18:25 | |
rm_work | if it comes in as None, then we try the default config | 18:26 |
rm_work | it doesn't really change the flow, it's just a higher level override | 18:26 |
johnsom | Yeah | 18:26 |
johnsom | It's almost a rename this method kind of thing | 18:26 |
johnsom | But I guess it's getting an "amphora" and not compute record | 18:27 |
johnsom | Blah, yeah, just fix the =None and doc strings | 18:27 |
rm_work | k i'll look in a moment | 18:30 |
*** armax has quit IRC | 18:33 | |
*** gcheresh has quit IRC | 18:45 | |
*** ivve has joined #openstack-lbaas | 18:47 | |
*** stevenglasford has joined #openstack-lbaas | 18:54 | |
*** stevenglasford__ has quit IRC | 18:55 | |
rm_work | Yeah k will take care of that 👍 | 18:56 |
*** gcheresh has joined #openstack-lbaas | 19:07 | |
*** armax has joined #openstack-lbaas | 19:08 | |
*** luksky has joined #openstack-lbaas | 19:14 | |
*** luketollefson has joined #openstack-lbaas | 19:17 | |
*** gcheresh has quit IRC | 19:28 | |
*** psachin has quit IRC | 20:16 | |
*** mithilarun has quit IRC | 20:34 | |
*** andy_ has quit IRC | 20:35 | |
*** andy__ has joined #openstack-lbaas | 20:35 | |
*** rcernin has quit IRC | 20:36 | |
*** andy__ is now known as andy_ | 20:36 | |
*** mithilarun has joined #openstack-lbaas | 20:36 | |
*** mithilarun has quit IRC | 20:41 | |
openstackgerrit | Adam Harwell proposed openstack/octavia master: Select the right lb_network_ip interface using AZ https://review.opendev.org/704927 | 20:47 |
rm_work | should address your concerns johnsom | 20:47 |
johnsom | Ok | 20:48 |
*** mithilarun has joined #openstack-lbaas | 20:51 | |
*** Trevor_V has quit IRC | 20:55 | |
*** mithilarun has quit IRC | 20:55 | |
*** mithilarun has joined #openstack-lbaas | 21:11 | |
johnsom | rm_work re-reviewed, I think there is a bug | 21:22 |
rm_work | ok | 21:23 |
rm_work | it's not a bug | 21:39 |
rm_work | though i wrote the commit message explanation wrong, i see, lol | 21:39 |
rm_work | see: octavia/controller/worker/v2/tasks/compute_tasks.py:86 | 21:40 |
rm_work | literally just above this in the same file | 21:40 |
rm_work | same AZ object | 21:40 |
johnsom | rm_work so.... It's not an AZ object.... <glare> At a minimum can you add the doc string line for that. Really it would be nice to rename that to be something like az_metadata_dict or such..... | 21:42 |
rm_work | k | 21:42 |
*** spatel has quit IRC | 21:46 | |
rm_work | ok done | 21:47 |
openstackgerrit | Adam Harwell proposed openstack/octavia master: Select the right lb_network_ip interface using AZ https://review.opendev.org/704927 | 21:47 |
rm_work | so these are the four changes that most directly affect me right now: | 22:06 |
rm_work | Allow AZ to override valid_vip_networks config - https://review.opendev.org/699521 | 22:06 |
rm_work | Conf option to use VIP ip as source ip for backend - https://review.opendev.org/702535 | 22:06 |
rm_work | Select the right lb_network_ip interface using AZ - https://review.opendev.org/704927 | 22:06 |
rm_work | Update the lb_id on an amp earlier if we know it - https://review.opendev.org/698082 | 22:06 |
rm_work | I'll be trying to keep them up to date and ready to go | 22:06 |
rm_work | three of them have +1s already | 22:06 |
rm_work | at least one or two of them shouldn't be especially contentious | 22:06 |
rm_work | the vip-source-ip might be <_< | 22:07 |
*** sapd1 has joined #openstack-lbaas | 22:25 | |
*** sapd1_ has quit IRC | 22:26 | |
openstackgerrit | Merged openstack/octavia master: Fix unit test when run on CentOS 7 https://review.opendev.org/697958 | 22:35 |
johnsom | Michael's tip of the day: Want to use wireshark on a remote devstack to monitor an interface inside a network namespace such as the neutron qrouter? | 22:37 |
johnsom | ip netns exec qrouter-28ed9736-5bca-47de-acdc-22dbdc79b91b tcpdump -U -s0 -n -l -w - -i qg-8f23a725-84 "icmp6" | wireshark -k -i - | 22:37 |
johnsom | tcpdump through a pipe! | 22:37 |
openstackgerrit | Merged openstack/octavia master: Fix house keeping graceful shutdown https://review.opendev.org/698536 | 22:39 |
*** mithilarun has quit IRC | 22:50 | |
*** mithilarun has joined #openstack-lbaas | 22:51 | |
*** mithilarun has quit IRC | 23:00 | |
*** mithilarun has joined #openstack-lbaas | 23:00 | |
*** ivve has quit IRC | 23:07 | |
*** tkajinam has joined #openstack-lbaas | 23:10 | |
*** rcernin has joined #openstack-lbaas | 23:20 | |
*** luksky has quit IRC | 23:21 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!