*** spartakos has quit IRC | 00:30 | |
*** rcernin has quit IRC | 00:50 | |
*** rcernin has joined #openstack-lbaas | 00:51 | |
*** yamamoto has joined #openstack-lbaas | 00:55 | |
openstackgerrit | Jacky Hu proposed openstack/octavia-tempest-plugin master: Fix test_with_ipv6 = False failure https://review.openstack.org/598405 | 01:41 |
---|---|---|
*** hongbin has joined #openstack-lbaas | 01:51 | |
*** sapd1_ has joined #openstack-lbaas | 02:03 | |
*** sapd1 has quit IRC | 02:07 | |
*** sapd1_ has quit IRC | 02:09 | |
*** spartakos has joined #openstack-lbaas | 02:10 | |
*** sapd1 has joined #openstack-lbaas | 02:13 | |
lxkong | johnsom: could you please have a look at https://review.openstack.org/#/c/599467/? The member address validation is missing for graph lb creation. | 02:31 |
lxkong | which is urgent for us | 02:32 |
johnsom | lxkong Ok, thanks for letting me know it is urgent. It's a bit busy for me right now. I will try to take a look soon | 02:34 |
lxkong | johnsom: appreciate. After this is merged, I can continue to fix the batch member update function. | 02:35 |
johnsom | Ok cool. Yeah, glad to see more validations | 02:35 |
lxkong | BTW, for batch member update function, i found a bug here https://storyboard.openstack.org/#!/story/2003608 | 02:35 |
johnsom | Yeah, that is an odd one. Are you working on that? | 02:41 |
lxkong | johnsom: not yet. Currently I am dealing with our octavia related tickets in our production | 02:58 |
lxkong | and octavia support in various orchestration tooling support, gophercloud, ansible, etc. | 02:59 |
lxkong | johnsom: fyi, ansible support here https://github.com/ansible/ansible/issues/41829, and most of octavia functionality for gophercloud has been merged. | 03:00 |
johnsom | yeah, I'm still working at 8pm on a nasty bug.... | 03:00 |
johnsom | lxkong Excellent! | 03:00 |
johnsom | Do we have that on our SDK list? | 03:00 |
lxkong | johnsom: didn't check :-( | 03:00 |
johnsom | Yeah, it's there | 03:01 |
lxkong | i guess gophercloud is on the list, but ansible is not | 03:01 |
johnsom | https://docs.openstack.org/octavia/latest/user/sdks.html | 03:01 |
lxkong | there are still some modules i'm working on | 03:01 |
lxkong | currently, the graph creation support | 03:01 |
johnsom | Yeah, ansible is one of the deployment tools. It will be on that list once I write the install guide.... sigh | 03:01 |
lxkong | after the basic modules are done, i will let you know | 03:02 |
*** spartakos has quit IRC | 03:35 | |
*** ramishra has joined #openstack-lbaas | 03:39 | |
*** hongbin has quit IRC | 04:01 | |
*** yamamoto has quit IRC | 04:05 | |
*** yamamoto has joined #openstack-lbaas | 04:05 | |
*** yamamoto has quit IRC | 04:16 | |
*** yboaron_ has joined #openstack-lbaas | 04:34 | |
openstackgerrit | Michael Johnson proposed openstack/octavia master: Fix health manager performance regression https://review.openstack.org/600332 | 05:26 |
openstackgerrit | Michael Johnson proposed openstack/octavia master: Fix health manager performance regression https://review.openstack.org/600332 | 05:41 |
openstackgerrit | Michael Johnson proposed openstack/octavia master: Fix health manager performance regression https://review.openstack.org/600332 | 05:53 |
*** pcaruana has joined #openstack-lbaas | 06:25 | |
openstackgerrit | Reedip proposed openstack/octavia-tempest-plugin master: Add configuration support for skipping tests https://review.openstack.org/599393 | 06:35 |
*** rcernin has quit IRC | 07:00 | |
*** Emine has joined #openstack-lbaas | 07:06 | |
*** velizarx has joined #openstack-lbaas | 07:14 | |
*** velizarx has quit IRC | 07:27 | |
*** pcaruana has quit IRC | 07:36 | |
*** luksky has joined #openstack-lbaas | 07:41 | |
*** velizarx has joined #openstack-lbaas | 07:44 | |
*** pcaruana has joined #openstack-lbaas | 07:48 | |
*** velizarx has quit IRC | 07:58 | |
*** ccamposr has joined #openstack-lbaas | 08:04 | |
*** celebdor has joined #openstack-lbaas | 08:05 | |
*** velizarx has joined #openstack-lbaas | 08:08 | |
*** ktibi has joined #openstack-lbaas | 08:42 | |
openstackgerrit | Carlos Goncalves proposed openstack/octavia-tempest-plugin master: Fix the scenario parent job to use the live base https://review.openstack.org/600118 | 08:46 |
openstackgerrit | Carlos Goncalves proposed openstack/octavia-tempest-plugin master: WIP: Add octavia-v2-dsvm-py35-scenario-fedora-latest job https://review.openstack.org/600381 | 08:46 |
dolly | Hi all, does anyone knows who Adam Harwell is, just curios if he hangs around here ? I was looking for some input on my comment on the following patch-set, https://review.openstack.org/#/c/558962/ | 09:07 |
*** ktibi has quit IRC | 09:19 | |
*** numans is now known as numans_afk | 09:23 | |
*** luksky has quit IRC | 10:40 | |
*** luksky has joined #openstack-lbaas | 10:42 | |
*** numans_afk is now known as numans | 10:53 | |
cgoncalves | dolly, Adam is rm_work | 11:18 |
dolly | cgoncalves, Oh, coolers! thanks! | 11:19 |
*** Emine has quit IRC | 11:23 | |
*** Emine has joined #openstack-lbaas | 11:25 | |
*** yboaron_ has quit IRC | 12:32 | |
*** yboaron_ has joined #openstack-lbaas | 12:32 | |
*** yboaron_ has quit IRC | 13:14 | |
*** yboaron has joined #openstack-lbaas | 13:15 | |
*** velizarx has quit IRC | 13:20 | |
*** yboaron_ has joined #openstack-lbaas | 13:49 | |
*** yboaron has quit IRC | 13:52 | |
openstackgerrit | Michael Johnson proposed openstack/octavia-tempest-plugin master: Fix tests to honor Octavia API versioning https://review.openstack.org/594786 | 13:57 |
*** fnaval has joined #openstack-lbaas | 14:09 | |
*** luksky has quit IRC | 14:31 | |
*** reedipb has joined #openstack-lbaas | 14:35 | |
jiteka | Hello, I have a question regarding spare pool feature and the fact that it's not compatible with anti-affinity at the moment | 14:42 |
jiteka | 1. Are you currently discussing possible solution to have both compatible ? | 14:42 |
jiteka | 2. If I still decide to keep using ACTIVE_STANDBY topology with anti-affinity, and end-up in case where both MASTER and BACKUP are on the same compute, | 14:42 |
jiteka | Is it possible to disable spare pool then failing over one of the amphora to ensure anti-affinity ? | 14:42 |
*** yboaron_ has quit IRC | 14:43 | |
*** dolly has quit IRC | 14:50 | |
*** Swami has joined #openstack-lbaas | 14:50 | |
johnsom | jiteka I believe that if you have spares pool enabled it simply will not be used for failover. Basically we didn't want to get into the scheduler business and nova doesn't handle "adding" booted instances to an anti-affinity server group. | 14:52 |
jiteka | johnsom: spare pool is only used for new loadbalancer ? | 14:55 |
johnsom | In active/standy topology mode, I think that is correct | 14:56 |
johnsom | But it might be disabled there too due to the same issue adding booted instances to the server group | 14:56 |
johnsom | It's been a while since I have looked at that code. | 14:56 |
jiteka | johnsom: I'm gonna perform some testing on that as I want to see if I can use spare pool and still have some Ops way to remediate to VIP with degraded HA due to MASTER and BACKUP living on the same compute | 14:57 |
johnsom | jiteka You could open a Nova RFE to update the server group anti-affinity to support live migration or some other way of adding a node to a existing server group. If we had a way to do that reliably without requiring us to become a scheduling engine it would be best. | 14:59 |
johnsom | jiteka I think to date, we haven't had anyone that truely needed the performance of spares pool when running active/standby, so it hasn't been a focus for us. | 14:59 |
*** celebdor has quit IRC | 15:00 | |
johnsom | jiteka Would be good to get a story in for Octavia too, with your use case. Maybe we can get creative and go through the spares pool attempting to add them to the server group. I'm not sure if Nova will give us a useful exception that we could attempt to keep trying spare instances or not. Maybe it would just cycle through the list and force a boot anyway. | 15:05 |
jiteka | johnsom: unfortunately right now live-migration is not an option as we rely on flavor with vCPU pinning and NUMA, and nova-scheduler is not aware of NUMA topology and vCPU pinning when live-migrating on a targeted host leading to overlap vCPU and degraded performance | 15:08 |
johnsom | Gotcha | 15:08 |
johnsom | Fnacy | 15:08 |
johnsom | Fancy | 15:08 |
johnsom | So when you allocate a vCPU you actually mean it... ha | 15:09 |
jiteka | johnsom: that's why performing regular audit on amphora fleet to solve LB not fullfilling anti-affinity would do the trick | 15:09 |
jiteka | johnsom: will do some testing in devstack and in our pre-prod environment then see my options | 15:10 |
jiteka | johnsom: thanks for the precision :) | 15:11 |
xgerman_ | jiteka: what you want sounds like soft-anti-affinity | 15:11 |
jiteka | xgerman_: I saw that option but I don't really understand the difference between "soft" and "normal" anti-affinity | 15:11 |
xgerman_ | we “could” add a case if you specify soft that we use the spare pool for failover knowing you might end up on the same server | 15:11 |
johnsom | They are nova terms. xgerman_ is probably describing them as I type this.... | 15:12 |
jiteka | xgerman_: I had the feeling that soft-anti-affinity is a best effort as it will try to ensure anti-affinity without failing the build with NoValidHost exception if there is no available hypervisor that would be compliant with that filter | 15:12 |
xgerman_ | yeah, and we *could* enhance Octavia to use spare pool if you specify soft — since then you signal you tolerate being on the same “server" | 15:13 |
johnsom | Yeah, soft anti-affinity is "best effort" to not co-locate the amps on the same host, but if there is no other option in the cloud, go ahead and schedule the nova instance to the same compute host. | 15:14 |
xgerman_ | yep, which would make using spare pool legit | 15:14 |
xgerman_ | though probably not what jiteka wants ;-) | 15:15 |
jiteka | xgerman_: indeed, it's not exactly what I have in mind as HA and ensuring that losing an hypervisor won't end-up with a VIP going down because both amphora were running here, sounds to me like good Ops practice | 15:16 |
rm_work | cgoncalves: ah thanks :P missed dolly I guess | 15:17 |
jiteka | xgerman_: ideally having some LB flavor and choosing between, expendable LB that tolerate same host and downtime VS Critical LB that need to stay reachable at any time | 15:17 |
jiteka | xgerman_: would be better | 15:17 |
xgerman_ | well, that plays with our Stein goal of flavors ;-) | 15:18 |
rm_work | yeah that basically sounds like not having any anti-affinity | 15:19 |
rm_work | because it will basically just be random | 15:19 |
rm_work | which is ... exactly as good as not having it at all | 15:19 |
jiteka | is it possible to have 2 different octavia provider ? (with different configuration) | 15:20 |
jiteka | I mean 2 loadbalancing provider | 15:20 |
rm_work | sure | 15:20 |
rm_work | i believe so | 15:21 |
jiteka | which both would be octavia but with 2 separated control plane | 15:21 |
rm_work | oh hmmm | 15:21 |
rm_work | i'm ... not actually positive how that'd work | 15:21 |
rm_work | i guess i'm thinking about flavors | 15:22 |
jiteka | rm_work: was thinking about that when you don't have flavor but it solve the same problem | 15:22 |
johnsom | Yeah, might just be worth waiting for flavors. I think you will run into DB problems trying to run two Octavia amphora based provider drivers | 15:24 |
*** spartakos has joined #openstack-lbaas | 15:24 | |
xgerman_ | +1 | 15:28 |
rm_work | I prefer AZ anti-affinity anyway :) | 15:31 |
*** pcaruana has quit IRC | 15:42 | |
jiteka | rm_work: Stein is estimated to be released in april next year right ? | 15:45 |
rm_work | ummm | 15:46 |
rm_work | yes maybe? | 15:46 |
jiteka | rm_work: nvm I found it here https://releases.openstack.org/ | 15:46 |
jiteka | Apr 08 - Apr 12 (Stein release) | 15:47 |
jiteka | thanks all for the help | 15:47 |
rm_work | np ;) | 15:50 |
rm_work | such help lol | 15:51 |
rm_work | "uhhhhhhhh i dunno maybe" :P:P:P | 15:51 |
*** luksky has joined #openstack-lbaas | 15:55 | |
*** ramishra has quit IRC | 15:57 | |
*** Swami has quit IRC | 15:58 | |
*** pcaruana has joined #openstack-lbaas | 16:01 | |
*** luksky has quit IRC | 16:15 | |
openstackgerrit | Merged openstack/octavia-tempest-plugin master: Fix the scenario parent job to use the live base https://review.openstack.org/600118 | 16:30 |
*** ccamposr has quit IRC | 16:51 | |
*** spartakos has quit IRC | 17:11 | |
jiteka | rm_work: with my question I needed to see what are my option for Stability vs Provisionning time | 17:12 |
jiteka | rm_work: now I know more :) | 17:13 |
*** reedipb has quit IRC | 17:14 | |
*** ChanServ sets mode: -rf | 17:16 | |
*** LutzB has joined #openstack-lbaas | 17:16 | |
*** ptoohill1 has joined #openstack-lbaas | 17:16 | |
rm_work | yeah, i think really it's fine to have no spares pool if your cloud isn't SUPER slow | 17:19 |
rm_work | ~1m boot time should be achievable and then whatever | 17:20 |
rm_work | yeah, 1m to create a LB isn't GREAT but it's not horrible | 17:20 |
rm_work | and rebuilding a backup at ~1m is fine | 17:20 |
rm_work | though, AZ-anti-affinity is :P:P | 17:20 |
rm_work | actually i had intended to do host internally as well | 17:21 |
rm_work | <_< | 17:21 |
rm_work | but it's a little more complex, and probably no one would want to actually include THAT low level in octavia | 17:21 |
*** pcaruana has quit IRC | 17:27 | |
*** spartakos has joined #openstack-lbaas | 17:35 | |
*** links has joined #openstack-lbaas | 17:38 | |
*** links has quit IRC | 17:38 | |
*** irenab has quit IRC | 17:47 | |
*** irenab has joined #openstack-lbaas | 17:50 | |
*** pcaruana has joined #openstack-lbaas | 18:02 | |
*** links has joined #openstack-lbaas | 18:02 | |
*** openstackgerrit has quit IRC | 18:05 | |
*** links has quit IRC | 18:11 | |
*** spartakos has quit IRC | 18:15 | |
*** openstackgerrit has joined #openstack-lbaas | 18:37 | |
openstackgerrit | Andreas Jaeger proposed openstack/octavia master: Use openstack-tox-cover template https://review.openstack.org/600503 | 18:37 |
*** Swami has joined #openstack-lbaas | 18:37 | |
openstackgerrit | German Eichberger proposed openstack/octavia master: [WIP] Switch amphora agent to use privsep https://review.openstack.org/549295 | 19:18 |
*** spartakos has joined #openstack-lbaas | 19:30 | |
*** pcaruana has quit IRC | 19:35 | |
*** Emine has quit IRC | 19:37 | |
*** Emine has joined #openstack-lbaas | 19:38 | |
openstackgerrit | Michael Johnson proposed openstack/octavia-tempest-plugin master: Disable KVM at limestone (again) https://review.openstack.org/600536 | 19:41 |
openstackgerrit | Michael Johnson proposed openstack/octavia-tempest-plugin master: DNM: Testing bionic nodes https://review.openstack.org/600539 | 19:51 |
openstackgerrit | Michael Johnson proposed openstack/octavia master: Disable KVM at limestone (again) https://review.openstack.org/600542 | 19:58 |
openstackgerrit | Michael Johnson proposed openstack/neutron-lbaas master: Exclude limestone from running with kvm https://review.openstack.org/600543 | 20:00 |
logan- | :( did it break again johnsom? | 20:00 |
johnsom | Yeah, the latest ubuntu kernel regressed the issue. | 20:01 |
logan- | dang | 20:01 |
johnsom | I'm trying bionic nodepool hosts. I'm hoping the new kernel in bionic will be "fixed" and we can just switch over to that | 20:01 |
johnsom | It's clear it's the nodepool kernel now though, so that is progress | 20:02 |
logan- | yup | 20:03 |
xgerman_ | yeah, tried a bionic devstack and that did not work on my vmware | 20:05 |
johnsom | Hmm, yeah, I haven't had time to try that out yet. I just put up a job with the tempest plugin running under bionic to see what happens | 20:06 |
*** dims has quit IRC | 20:55 | |
openstackgerrit | Merged openstack/octavia-tempest-plugin master: Fix tests to honor Octavia API versioning https://review.openstack.org/594786 | 20:57 |
*** luksky has joined #openstack-lbaas | 21:06 | |
*** dims has joined #openstack-lbaas | 21:11 | |
*** fnaval has quit IRC | 21:30 | |
*** luksky has quit IRC | 22:01 | |
* colin- waves to logan- | 22:21 | |
*** rcernin has joined #openstack-lbaas | 22:29 | |
logan- | o/ colin-! | 23:16 |
openstackgerrit | Michael Johnson proposed openstack/octavia master: Raise minimum coverage to 90% https://review.openstack.org/600583 | 23:40 |
*** Swami has quit IRC | 23:48 | |
openstackgerrit | Michael Johnson proposed openstack/octavia master: Fix health manager performance regression https://review.openstack.org/600332 | 23:54 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!