| *** sapd1 has quit IRC | 00:05 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Add Octavia performance guide and 2vcpu flavor https://review.opendev.org/c/openstack/octavia/+/787286 | 00:06 |
|---|---|---|
| johnsom | Man, I even wrote the doc page for that... sigh | 00:06 |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Add Octavia performance guide and 2vcpu flavor https://review.opendev.org/c/openstack/octavia/+/787286 | 00:52 |
| openstackgerrit | Greg Rakauskas proposed openstack/octavia master: Edits for "Basic Load Balancing Cookbook" https://review.opendev.org/c/openstack/octavia/+/787643 | 01:37 |
| openstackgerrit | Greg Rakauskas proposed openstack/octavia master: Edits for "Basic Load Balancing Cookbook" https://review.opendev.org/c/openstack/octavia/+/787643 | 02:08 |
| *** sapd1 has joined #openstack-lbaas | 02:18 | |
| *** sapd1 has quit IRC | 03:15 | |
| *** xgerman has quit IRC | 03:36 | |
| *** zzzeek has quit IRC | 03:37 | |
| *** zzzeek has joined #openstack-lbaas | 03:38 | |
| *** vishalmanchanda has joined #openstack-lbaas | 04:36 | |
| *** priteau has joined #openstack-lbaas | 05:29 | |
| *** luksky has joined #openstack-lbaas | 06:32 | |
| openstackgerrit | Gregory Thiemonge proposed openstack/octavia master: Fix amphora failover flow in amphorav2 driver https://review.opendev.org/c/openstack/octavia/+/787667 | 06:45 |
| *** rpittau|afk is now known as rpittau | 07:12 | |
| *** rcernin has quit IRC | 07:25 | |
| *** gcheresh has joined #openstack-lbaas | 07:38 | |
| *** rcernin has joined #openstack-lbaas | 07:52 | |
| *** yamamoto has quit IRC | 07:54 | |
| *** rcernin has quit IRC | 07:57 | |
| *** rcernin has joined #openstack-lbaas | 08:09 | |
| *** rcernin has quit IRC | 08:14 | |
| *** rcernin has joined #openstack-lbaas | 09:00 | |
| *** yamamoto has joined #openstack-lbaas | 09:07 | |
| *** rcernin has quit IRC | 09:18 | |
| *** rcernin has joined #openstack-lbaas | 09:21 | |
| *** yamamoto has quit IRC | 09:22 | |
| *** yamamoto has joined #openstack-lbaas | 09:33 | |
| *** gcheresh has quit IRC | 09:48 | |
| *** yamamoto has quit IRC | 09:53 | |
| *** gcheresh has joined #openstack-lbaas | 10:35 | |
| *** yamamoto has joined #openstack-lbaas | 10:36 | |
| *** rcernin has quit IRC | 10:43 | |
| *** yamamoto has quit IRC | 10:50 | |
| *** rcernin has joined #openstack-lbaas | 11:15 | |
| *** ccamposr has quit IRC | 11:21 | |
| *** ccamposr has joined #openstack-lbaas | 11:21 | |
| *** sapd1 has joined #openstack-lbaas | 11:43 | |
| *** rcernin has quit IRC | 11:49 | |
| openstackgerrit | Gregory Thiemonge proposed openstack/octavia-tempest-plugin master: Removing spare-pool job for master https://review.opendev.org/c/openstack/octavia-tempest-plugin/+/787719 | 12:15 |
| openstackgerrit | Gregory Thiemonge proposed openstack/octavia master: Disable spare pool jobs https://review.opendev.org/c/openstack/octavia/+/787721 | 12:15 |
| openstackgerrit | Gregory Thiemonge proposed openstack/octavia master: Spare pool removal https://review.opendev.org/c/openstack/octavia/+/787722 | 12:15 |
| *** yamamoto has joined #openstack-lbaas | 12:19 | |
| *** sapd1 has quit IRC | 12:34 | |
| *** priteau has quit IRC | 12:48 | |
| *** priteau has joined #openstack-lbaas | 12:54 | |
| openstackgerrit | Ann Taraday proposed openstack/octavia master: Alias change amphorav2 -> amphora https://review.opendev.org/c/openstack/octavia/+/740432 | 12:56 |
| openstackgerrit | Brian Haley proposed openstack/octavia master: DO NOT REVIEW: Test OVN devstack module https://review.opendev.org/c/openstack/octavia/+/778411 | 13:04 |
| *** vishalmanchanda has quit IRC | 13:26 | |
| *** priteau has quit IRC | 13:43 | |
| *** priteau has joined #openstack-lbaas | 13:46 | |
| *** rpittau is now known as rpittau|afk | 14:15 | |
| *** sapd1 has joined #openstack-lbaas | 14:28 | |
| openstackgerrit | Gregory Thiemonge proposed openstack/octavia master: Fix jobboard_enabled setting in devstack https://review.opendev.org/c/openstack/octavia/+/787759 | 14:29 |
| sapd1 | johnsom: Hi johnson, I know You are working on performance tuning guide for haproxy amphora. | 14:34 |
| johnsom | It is a collaboration with another user. I am helping them get started. It came up as part of the PTG sessions. | 14:36 |
| sapd1 | Actually I have an issue with performance of haproxy. We setup haproxy for load balancer with nginx (default page) for backend server. I use wrk tool for benchmarking. If we use 1 nginx, I get ~34k requests/s. But when I use 2 nginx node, I only get ~23k requests/s . I don't know Why | 14:36 |
| sapd1 | My instance is setup with multi queues and dedicated cpu. | 14:37 |
| *** gcheresh has quit IRC | 14:37 | |
| sapd1 | johnsom: Could you send me the link to the PTG session. I missed that. Thanks | 14:38 |
| sapd1 | oh this one: https://etherpad.opendev.org/p/xena-ptg-octavia | 14:39 |
| johnsom | http://ptg.openstack.org | 14:39 |
| johnsom | 35k is about right for a single vCPU amphora | 14:40 |
| sapd1 | johnsom: My instance has 32 vCPUs. | 14:41 |
| johnsom | What OS are you using for the amphora? What haproxy version? | 14:41 |
| sapd1 | OS: Ubuntu 20.04. Haproxy 2.0.13-2ubuntu0.1. | 14:43 |
| sapd1 | I increased open file and some tuned options for sysctl as well. | 14:43 |
| johnsom | And you have 32 vCPUs in the amphora??? That is way too low | 14:43 |
| sapd1 | yes. | 14:44 |
| johnsom | That should already be done inside the amp | 14:44 |
| johnsom | Nginix can be an issue as well, and then content size will effect req/s tests depending on the client. | 14:45 |
| *** gcheresh has joined #openstack-lbaas | 14:46 | |
| sapd1 | With 1 nginx node . I get 34k . With 2 nginx nodes, I only get 23k. That's a big issue. | 14:46 |
| johnsom | Are you making sure you are not running out if ports on the client and server sides? | 14:46 |
| sapd1 | How can I check that issue ? | 14:48 |
| johnsom | Take a look at the cpu and memory usage inside the amp during a test. If they are not maxing out, it is likely and issue outside the amphora/haproxy | 14:48 |
| *** sapd1 has quit IRC | 14:52 | |
| *** sapd1 has joined #openstack-lbaas | 14:53 | |
| johnsom | netstat -nat will show the port status, compare that to how many ports you have allocated on those hosts | 14:54 |
| sapd1 | the output is about 6k~ | 14:56 |
| sapd1 | what option for that configuration, johnsom | 14:57 |
| *** gregraka has quit IRC | 14:58 | |
| johnsom | https://stackoverflow.com/questions/410616/increasing-the-maximum-number-of-tcp-ip-connections-in-linux | 14:58 |
| johnsom | I need to go make some coffee and start my work day. Back in a bit. | 14:59 |
| sapd1 | thank you so much | 15:01 |
| johnsom | sapd1: you may find this interesting https://www.haproxy.com/blog/haproxy-forwards-over-2-million-http-requests-per-second-on-a-single-aws-arm-instance/ | 15:07 |
| sapd1 | johnsom: yeah. I read that article few days ago. | 15:08 |
| sapd1 | My /proc/interrupts file does not include any interface. SO I cannot set IRQ for the interface. | 15:09 |
| sapd1 | I dont know why . | 15:09 |
| johnsom | Well, in the amp it should be possible. I have done it before, but with that many cores it's most likely something else that is causing you major problem | 15:23 |
| johnsom | I could write a book on how to properly test a network service, lol. There are so many variables involved. | 15:24 |
| sapd1 | johnsom: I think maybe the problem is qemu/kvm. network driver . | 15:33 |
| *** gcheresh has quit IRC | 17:32 | |
| *** gcheresh has joined #openstack-lbaas | 17:41 | |
| *** gcheresh has quit IRC | 17:47 | |
| *** gcheresh has joined #openstack-lbaas | 17:48 | |
| *** gcheresh has quit IRC | 18:14 | |
| *** gregraka has joined #openstack-lbaas | 18:29 | |
| -openstackstatus- NOTICE: The Gerrit service on review.openstack.org is being restarted to pick up some updates, and should be available again momentarily | 19:02 | |
| *** gcheresh has joined #openstack-lbaas | 19:24 | |
| *** gregraka has quit IRC | 19:52 | |
| *** gcheresh has quit IRC | 20:18 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Add Octavia performance guide and 2vcpu flavor https://review.opendev.org/c/openstack/octavia/+/787286 | 20:24 |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Add nightly test image build job for focal https://review.opendev.org/c/openstack/octavia/+/763092 | 20:38 |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Use TOX_CONSTRAINTS_FILE https://review.opendev.org/c/openstack/octavia/+/760711 | 20:43 |
| *** servagem has quit IRC | 21:06 | |
| openstackgerrit | Michael Johnson proposed openstack/octavia master: Add Octavia performance guide and 2vcpu flavor https://review.opendev.org/c/openstack/octavia/+/787286 | 21:42 |
| *** xgerman has joined #openstack-lbaas | 22:26 | |
| openstackgerrit | Merged openstack/octavia master: Fix jobboard_enabled setting in devstack https://review.opendev.org/c/openstack/octavia/+/787759 | 22:39 |
| openstackgerrit | Merged openstack/octavia master: Fix rsyslog configuration when disabling logs https://review.opendev.org/c/openstack/octavia/+/783608 | 22:48 |
| *** luksky has quit IRC | 23:02 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!