Tuesday, 2018-07-03

*** threestrands_ has joined #openstack-lbaas00:07
*** threestrands_ has quit IRC00:07
*** threestrands_ has joined #openstack-lbaas00:07
*** threestrands_ has quit IRC00:08
*** threestrands_ has joined #openstack-lbaas00:09
*** threestrands_ has quit IRC00:09
*** threestrands_ has joined #openstack-lbaas00:09
*** threestrands has quit IRC00:10
*** threestrands_ has quit IRC00:10
*** threestrands_ has joined #openstack-lbaas00:10
*** threestrands_ has quit IRC00:11
*** threestrands_ has joined #openstack-lbaas00:12
*** threestrands_ has quit IRC00:13
*** threestrands_ has joined #openstack-lbaas00:13
*** threestrands_ has quit IRC00:13
*** threestrands_ has joined #openstack-lbaas00:13
*** threestrands_ has quit IRC00:14
*** threestrands_ has joined #openstack-lbaas00:15
*** threestrands_ has quit IRC00:15
*** threestrands_ has joined #openstack-lbaas00:15
*** threestrands_ has quit IRC00:16
*** threestrands_ has joined #openstack-lbaas00:16
*** JudeC_ has joined #openstack-lbaas00:24
*** JudeC__ has quit IRC00:25
openstackgerritMichael Johnson proposed openstack/neutron-lbaas master: Neutron-LBaaS to Octavia migration tool  https://review.openstack.org/57894200:28
*** longkb has joined #openstack-lbaas00:48
*** blake has quit IRC00:48
*** blake has joined #openstack-lbaas00:49
*** abaindur has quit IRC00:51
*** blake has quit IRC00:53
bzhao__johnsom:  Hi, michael, I build a local image, that seems the element "elements/keepalived-octavia/post-install.d/20-keepalived-lvs-tune-kernel" not work. :)00:54
johnsombzhao__ Hi. My day got a bit side tracked and I didn't get to install and review the new patch.  I will for sure tomorrow though.  Let me look at your element and see if I can help.00:54
bzhao__https://review.openstack.org/#/c/529651/32/elements/keepalived-octavia/post-install.d/20-keepalived-lvs-tune-kernel00:55
bzhao__johnsom:  Never mind, I can try my best to make it better. :)00:55
bzhao__johnsom:  I see the image build log, it seems that the process not load the element.00:56
johnsombzhao__ I think the file permissions are wrong. It must be executable00:56
johnsombzhao__ Add it here: https://github.com/openstack/octavia/blob/master/diskimage-create/diskimage-create.sh#L34600:57
*** hongbin has joined #openstack-lbaas00:57
bzhao__johnsom: Oh, yeah. Thanks, michael. It's very helpful to me. :). And I will post the fix in the second patch. If the test is OK, I will split them for ease to review. As the patch is too large for our kind reviewers and you.01:00
openstackgerritMerged openstack/octavia master: [amphora-agent] add local net to routing table 1  https://review.openstack.org/57799201:05
*** blake has joined #openstack-lbaas01:13
*** blake has quit IRC01:14
*** phuoc_ has joined #openstack-lbaas01:16
*** blake has joined #openstack-lbaas01:16
*** blake has quit IRC01:17
*** phuoc has quit IRC01:19
*** fnaval has joined #openstack-lbaas01:29
*** fnaval has quit IRC01:38
*** annp has joined #openstack-lbaas01:52
*** blake has joined #openstack-lbaas01:55
*** blake has quit IRC01:55
*** JudeC_ has quit IRC01:57
*** ramishra has joined #openstack-lbaas02:57
openstackgerritMichael Johnson proposed openstack/neutron-lbaas master: Neutron-LBaaS to Octavia migration tool  https://review.openstack.org/57894203:50
*** hongbin has quit IRC04:07
*** abaindur has joined #openstack-lbaas04:17
*** abaindur has quit IRC04:19
*** abaindur has joined #openstack-lbaas04:19
*** threestrands_ has quit IRC04:25
*** abaindur has quit IRC05:13
*** nmanos has joined #openstack-lbaas06:01
*** nmanos has quit IRC06:22
*** nmanos has joined #openstack-lbaas06:22
*** nmanos has left #openstack-lbaas06:23
openstackgerrithuangshan proposed openstack/octavia master: Improve resource quota response message  https://review.openstack.org/57831806:33
*** AlexStaf has quit IRC06:41
*** yboaron has joined #openstack-lbaas06:46
*** openstackgerrit has quit IRC06:49
*** rcernin has quit IRC06:55
*** abaindur has joined #openstack-lbaas06:56
*** tesseract has joined #openstack-lbaas07:06
*** ispp has joined #openstack-lbaas07:15
*** peereb has joined #openstack-lbaas07:21
*** ispp has quit IRC07:27
*** ramishra has quit IRC07:30
*** yboaron has quit IRC07:31
*** irenab has quit IRC07:39
*** oanson has quit IRC07:39
*** irenab has joined #openstack-lbaas07:40
*** ramishra has joined #openstack-lbaas07:40
*** oanson has joined #openstack-lbaas07:41
*** ispp has joined #openstack-lbaas07:42
*** abaindur has quit IRC07:47
*** ramishra has quit IRC07:52
*** ramishra has joined #openstack-lbaas07:55
*** ramishra has quit IRC08:00
*** rpittau has quit IRC08:02
*** ramishra has joined #openstack-lbaas08:04
*** ktibi has joined #openstack-lbaas08:08
*** rpittau has joined #openstack-lbaas08:10
*** ipsecguy has quit IRC08:14
*** ipsecguy has joined #openstack-lbaas08:15
*** AlexStaf has joined #openstack-lbaas08:21
*** ramishra has quit IRC08:33
*** ramishra has joined #openstack-lbaas08:34
*** yboaron has joined #openstack-lbaas08:43
*** kiennt26 has joined #openstack-lbaas09:03
*** ktibi is now known as ktibi_away10:07
*** kiennt26 has quit IRC10:39
*** openstackgerrit has joined #openstack-lbaas11:32
openstackgerritMerged openstack/octavia master: Fix fields translation on filtering  https://review.openstack.org/57955911:32
*** aojea_ has joined #openstack-lbaas11:37
*** yboaron has quit IRC11:43
*** yboaron has joined #openstack-lbaas11:52
*** yboaron has quit IRC11:57
*** voelzmo has joined #openstack-lbaas11:59
*** aojea_ has quit IRC12:00
*** ktibi_away is now known as ktibi12:09
*** longkb has quit IRC12:17
*** aojea has joined #openstack-lbaas12:32
*** fnaval has joined #openstack-lbaas12:32
*** yamamoto_ has quit IRC12:37
*** amuller has joined #openstack-lbaas12:39
*** kobis has joined #openstack-lbaas12:45
*** yboaron has joined #openstack-lbaas12:49
*** yamamoto has joined #openstack-lbaas12:53
*** yboaron has quit IRC12:55
*** yamamoto has quit IRC12:58
*** ispp has quit IRC13:02
*** ispp has joined #openstack-lbaas13:06
*** aojea has quit IRC13:06
*** yamamoto has joined #openstack-lbaas13:08
*** AlexStaf has quit IRC13:11
*** yamamoto has quit IRC13:13
*** yamamoto has joined #openstack-lbaas13:23
*** yamamoto has quit IRC13:28
*** yamamoto has joined #openstack-lbaas13:41
*** yamamoto has quit IRC13:41
*** kobis has quit IRC14:03
*** atoth has joined #openstack-lbaas14:11
*** ianychoi has quit IRC14:18
*** ianychoi has joined #openstack-lbaas14:19
*** aojea_ has joined #openstack-lbaas14:39
openstackgerritMerged openstack/neutron-lbaas master: Re-enable KVM  https://review.openstack.org/57921714:43
*** aojea_ has quit IRC14:45
*** yamamoto has joined #openstack-lbaas14:50
*** yamamoto has quit IRC14:58
*** kobis has joined #openstack-lbaas15:05
*** peereb has quit IRC15:05
*** voelzmo has quit IRC15:07
*** ramishra has quit IRC15:23
*** ktibi has quit IRC16:05
openstackgerritMerged openstack/octavia-tempest-plugin master: Add "wait for active" after object delete  https://review.openstack.org/57920516:09
kobishi, with the driver api, how/where does amphora driver update the stats? or where is it supposed to, in case that it's not implemented yet?16:11
johnsomkobis Hi, that code is in this patch: https://review.openstack.org/#/c/571358/16:17
johnsomThe amp driver itself is still using the health manager -> to DB. We will move that over in time to use the driver library in time16:18
*** tesseract has quit IRC16:20
kobisjohnsom so the driver should call periodically the update api?16:21
johnsomYes. It also supports bulk, so if your driver wants to batch them up it can16:22
kobisas we didn't see anything in o-api which calls the driver periodically16:22
johnsomCorrect, the spec defined it as a call back from the driver16:22
kobisok16:22
johnsomPersonally I want to make it a network endpoint drivers can call, but this was an interim solution16:23
kobiswell we could trigger this from a greenthread or such16:24
kobisrather than running a service in octavia context just for stats16:25
johnsomCorrect, you could implement it as a thread16:25
*** ispp has quit IRC16:26
*** aojea has joined #openstack-lbaas16:27
johnsomOr process, just to keep it more isolated16:28
kobisspinning a thread from the driver init won't work, I think - as it's initialized on each operation. is that correct?16:31
*** aojea has quit IRC16:32
johnsomYes, that is probably true. It does invoke on load, so you could spawn one then, but I'm not sure if the thread would terminate with the API call or not.16:35
kobisok. we'll figure it out :)16:36
johnsom+116:37
*** sapd has joined #openstack-lbaas16:43
sapdhi johnsom , as I know, each listener in loadbalancer in spawn 2 process to handle the listener, So I would like to custom this number . Can I adjust this number of haproxy process?16:45
*** kobis has quit IRC16:46
johnsomsapd Not currently. There were some bugs in HAProxy that caused session synchronization to fail if the nproc was > 1 (we actually set it to 1 now, the second is just a monitoring process).  Personally, I think the new multi-thread option in HAProxy 1.8 may be a better solution.16:47
johnsomsapd You of course could change that with a custom local template.  It is probably worth researching if those limitations have been fixed as well.16:47
*** yamamoto has joined #openstack-lbaas16:50
sapdjohnsom: I also know Haproxy 1.8 has multi-thread feature, but I have not tested yet.16:50
sapdBecause today I benchmarked loadbalancer with two backend server , amphora instance has 8cores and 4GB ram , but It just consumes 40-50% CPU. Number of concurrent connection request per second just reached 2k5.16:52
*** yamamoto has quit IRC16:55
johnsomYeah, there is definitely tuning we can do17:00
openstackgerritZhaoBo proposed openstack/octavia master: UDP jinja template  https://review.openstack.org/52542017:01
openstackgerritZhaoBo proposed openstack/octavia master: UDP for [2]  https://review.openstack.org/52965117:01
openstackgerritZhaoBo proposed openstack/octavia master: UDP for [3][5][6]  https://review.openstack.org/53939117:01
*** kobis has joined #openstack-lbaas17:01
*** kobis has quit IRC17:03
*** kobis has joined #openstack-lbaas17:04
*** kobis has quit IRC17:18
*** amuller has quit IRC17:48
*** yamamoto has joined #openstack-lbaas17:51
*** yamamoto has quit IRC17:56
*** sapd has quit IRC18:27
*** yamamoto has joined #openstack-lbaas18:52
*** yamamoto has quit IRC18:58
rm_workI get to ~15k on a 2-core 1GB instance19:00
*** kobis has joined #openstack-lbaas19:00
rm_workand still super low CPU usage19:00
rm_workT_T19:00
rm_workdefinitely need to figure out tuning19:00
johnsomYeah, I'm working on getting a lab for a few weeks.  I'm just short two servers....19:02
rm_worki wish our network was less F'd, I'd get you some servers to play with here :P19:02
xgerman_rm_work: with your network that sounds great ;-)19:02
rm_workheh yeah19:02
rm_workfound out my performance issue before was an intermittent thing that is environment based and due to the way our FLIPs work19:03
rm_workand certain switches having issues I think19:03
rm_workif I got a bad switch, shit would basically cap out at 1k lol19:03
johnsomlol, yeah, environment has a huge impact on it19:04
johnsomDid you figure out what was up with the rabbit queues?19:04
rm_work95% sure it's also an env thing19:04
rm_worki think it's flanneld being shitty in our crappy k8s env i'm on there19:04
johnsomYeah, kind of looked like it19:04
rm_workthe other k8s are way newer and have no problems19:04
rm_workand we've historically had a lot of issues with flannel19:05
rm_workmoving off it next week to a new k8s19:05
rm_workso expecting it to just go away19:05
*** kobis has quit IRC19:13
*** kobis has joined #openstack-lbaas19:14
*** kobis has quit IRC19:15
*** abaindur has joined #openstack-lbaas19:32
*** abaindur has quit IRC19:32
*** abaindur has joined #openstack-lbaas19:33
*** abaindur has quit IRC19:36
*** abaindur has joined #openstack-lbaas19:39
*** abaindur_ has joined #openstack-lbaas19:41
*** abaindur has quit IRC19:44
*** yamamoto has joined #openstack-lbaas19:54
*** yamamoto has quit IRC20:00
openstackgerritGerman Eichberger proposed openstack/neutron-lbaas master: Fix proxy extension for neutron RBAC  https://review.openstack.org/55400420:08
openstackgerritGerman Eichberger proposed openstack/neutron-lbaas master: Gate API test for the lbaasv2-proxy plugin  https://review.openstack.org/53935020:08
xgerman_^^ added all the @skip_tests needed for the L7 proxy to work20:09
xgerman_had to remove one of my skips… so let’s see how that goes20:09
*** aojea has joined #openstack-lbaas20:21
openstackgerritMichael Johnson proposed openstack/neutron-lbaas master: Neutron-LBaaS to Octavia migration tool  https://review.openstack.org/57894220:29
*** abaindur_ has quit IRC20:50
openstackgerritMichael Johnson proposed openstack/neutron-lbaas master: Neutron-LBaaS to Octavia migration tool  https://review.openstack.org/57894220:54
*** yamamoto has joined #openstack-lbaas20:56
openstackgerritGerman Eichberger proposed openstack/octavia master: Ignore a port not found when deleting an LB  https://review.openstack.org/56484821:00
*** yamamoto has quit IRC21:00
*** aojea has quit IRC21:10
openstackgerritGerman Eichberger proposed openstack/octavia master: [WIP] Switch amphora agent to use privsep  https://review.openstack.org/54929521:38
*** yamamoto has joined #openstack-lbaas21:57
*** yamamoto has quit IRC22:01
*** rcernin has joined #openstack-lbaas22:09
openstackgerritMichael Johnson proposed openstack/neutron-lbaas master: Neutron-LBaaS to Octavia migration tool  https://review.openstack.org/57894222:12
*** AlexStaf has joined #openstack-lbaas22:21
*** rcernin has quit IRC22:49
*** fnaval has quit IRC22:57
*** yamamoto has joined #openstack-lbaas22:57
*** rcernin has joined #openstack-lbaas23:02
*** yamamoto has quit IRC23:02
*** rcernin_ has joined #openstack-lbaas23:23
*** rcernin has quit IRC23:24
*** yamamoto has joined #openstack-lbaas23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!