| *** sapd1_x has joined #openstack-lbaas | 00:07 | |
| *** yamamoto has joined #openstack-lbaas | 00:10 | |
| lxkong | rm_work: ping | 00:40 |
|---|---|---|
| lxkong | rm_work: i tested again, still failed to create pool, this is the error in amphora log http://dpaste.com/3GB7YR9 | 00:41 |
| lxkong | this is the haproxy service log: http://dpaste.com/27W2D5W | 00:41 |
| *** ricolin_ has joined #openstack-lbaas | 01:03 | |
| *** yamamoto has quit IRC | 01:04 | |
| *** yamamoto has joined #openstack-lbaas | 01:08 | |
| *** yamamoto has quit IRC | 01:21 | |
| rm_work | hmm | 01:51 |
| *** sapd1_x has quit IRC | 02:08 | |
| rm_work | that's odd | 02:10 |
| rm_work | curious why it's having FD limit issues, but not sure if related | 02:10 |
| rm_work | real problem appears to be the failure to fork a new PID? | 02:11 |
| openstackgerrit | Merged openstack/octavia master: Fix urgent amphora two-way auth security bug https://review.opendev.org/686540 | 02:16 |
| *** yamamoto has joined #openstack-lbaas | 02:38 | |
| *** yamamoto has quit IRC | 02:48 | |
| *** yamamoto has joined #openstack-lbaas | 02:59 | |
| *** AustinR has quit IRC | 03:37 | |
| *** yamamoto has quit IRC | 03:43 | |
| *** yamamoto has joined #openstack-lbaas | 03:48 | |
| *** yamamoto has quit IRC | 04:04 | |
| johnsom | lxkong: the FD limit message is normal, ignore it. The cannot fork is the true problem. The amp is out of memory. If this is a multi-listener LB make sure you have the recent single process patch. | 04:13 |
| * johnsom sinks back into the pacific for another few days to swim with the turtles. | 04:14 | |
| * johnsom girggles, you are using haproxy 1.8 that uses more RAM up front than previous versions, thus the single process patch. | 04:17 | |
| *** ccamposr has quit IRC | 04:26 | |
| *** yamamoto has joined #openstack-lbaas | 04:36 | |
| *** yamamoto has quit IRC | 04:47 | |
| *** gcheresh has joined #openstack-lbaas | 04:54 | |
| *** yamamoto has joined #openstack-lbaas | 05:22 | |
| *** gcheresh has quit IRC | 05:53 | |
| *** gcheresh has joined #openstack-lbaas | 06:11 | |
| *** gcheresh has quit IRC | 06:33 | |
| *** yamamoto has quit IRC | 06:35 | |
| *** yamamoto has joined #openstack-lbaas | 06:40 | |
| *** yamamoto has quit IRC | 06:40 | |
| *** yamamoto has joined #openstack-lbaas | 06:40 | |
| *** yamamoto has quit IRC | 06:44 | |
| f0o | cgoncalves rm_work Just doing the changes VMT asked for, do you already know which version numbers will contain the fixes or should I just add a minor to all them? | 06:46 |
| *** vishalmanchanda has quit IRC | 07:08 | |
| f0o | ^ https://review.opendev.org/#/c/686724/2/ossa/OSSA-2019-005.yaml - This is the new OSSA with the proposed changes | 07:09 |
| *** yamamoto has joined #openstack-lbaas | 07:20 | |
| *** yamamoto has quit IRC | 07:27 | |
| *** yamamoto has joined #openstack-lbaas | 07:50 | |
| *** yamamoto has quit IRC | 07:54 | |
| rm_work | f0o: well since apparently we aren't VMT managed... i don't know if it matters much | 08:07 |
| rm_work | but | 08:07 |
| f0o | Jeremy's comment sounded like they'd add the OSSA regardless since we did the legwork | 08:24 |
| f0o | It really is up to Octavia as a whole to decide how to communicate Security Advisories to the users and distributions | 08:25 |
| rm_work | Kk that's good but it's not as urgent. We can wait until we release | 08:25 |
| rm_work | I definitely think we should do it | 08:25 |
| f0o | having it as OSSA sounds like we got a good channel already open to make the announcement | 08:25 |
| rm_work | Yep | 08:27 |
| rm_work | I guess technically your strategy of bumping the number by 1 is fine regardless of actual release number, as it still wouldn't match anything else | 08:28 |
| rm_work | Even if we end up doing a larger bump | 08:28 |
| rm_work | But we could also wait and put the real numbers | 08:28 |
| rm_work | I'm ok either way. Was hoping we could get those merged today but it'll have to wait I guess | 08:28 |
| *** ccamposr has joined #openstack-lbaas | 08:28 | |
| lxkong | rm_work, johnsom, thanks for your response, problem was solved when changing the amphora flavor mem to 1G (was 512M) | 09:13 |
| rm_work | Cool | 09:16 |
| rm_work | As Michael mentioned though, you want to make sure you have the patch for multi-listener single process | 09:17 |
| rm_work | Otherwise even at 1G you could run into issues with a few listeners | 09:17 |
| lxkong | rm_work: may i know which patch it is? | 09:17 |
| lxkong | or how can i search for that? | 09:18 |
| lxkong | rm_work: from what i can see inside the amphora, there is only one haproxy processs running, because it's using `/var/lib/octavia/{lb-id}/haproxy.cfg` | 09:18 |
| lxkong | rather than /var/lib/octavia/{listener-id}/haproxy.cfg | 09:19 |
| rm_work | https://review.opendev.org/#/c/668068/ | 09:22 |
| rm_work | That's the patch. I believe we backported it to Stein | 09:22 |
| rm_work | So Stein or Train should have it, though not sure if we made a release for Stein afterwards | 09:23 |
| lxkong | rm_work: yeah, the stable/stein merge time was 31 Aug, we should have it | 09:38 |
| *** gthiemonge has quit IRC | 09:40 | |
| *** gthiemonge has joined #openstack-lbaas | 09:40 | |
| cgoncalves | lxkong, the stein backport hasn't made its way into a stein release yet | 09:44 |
| cgoncalves | https://review.opendev.org/#/c/683202/ | 09:44 |
| *** ccamposr has quit IRC | 09:44 | |
| lxkong | cgoncalves: Thanks for this info. Fortunately, we are using branch instead of tag :-) | 09:45 |
| cgoncalves | great | 09:46 |
| openstackgerrit | Carlos Goncalves proposed openstack/octavia-tempest-plugin master: Enable tempest jobs for stable/train https://review.opendev.org/686565 | 09:48 |
| f0o | rm_work: I agree regading the version numbers, it would be nice to have the actual values instead of projected imaginary ones | 09:48 |
| cgoncalves | core reviewers: please help review backport patches https://review.opendev.org/#/q/I5619f5e40d7c9a2ee7741bf4664c0d2d08963992 | 09:50 |
| *** yamamoto has joined #openstack-lbaas | 09:53 | |
| cgoncalves | dayou, thank you! | 09:57 |
| dayou | cgoncalves: my pleasure! | 09:58 |
| *** yamamoto has quit IRC | 10:47 | |
| *** yamamoto has joined #openstack-lbaas | 11:24 | |
| openstackgerrit | Merged openstack/octavia stable/train: Fix urgent amphora two-way auth security bug https://review.opendev.org/686541 | 11:29 |
| *** yamamoto has quit IRC | 11:35 | |
| openstackgerrit | Merged openstack/octavia stable/stein: Fix urgent amphora two-way auth security bug https://review.opendev.org/686543 | 11:38 |
| openstackgerrit | Merged openstack/octavia stable/rocky: Fix urgent amphora two-way auth security bug https://review.opendev.org/686544 | 11:41 |
| openstackgerrit | Merged openstack/octavia stable/ocata: Fix urgent amphora two-way auth security bug https://review.opendev.org/686547 | 11:41 |
| *** yamamoto has joined #openstack-lbaas | 11:44 | |
| *** yamamoto has quit IRC | 12:04 | |
| *** yamamoto has joined #openstack-lbaas | 12:09 | |
| *** yamamoto has quit IRC | 12:13 | |
| *** AustinR has joined #openstack-lbaas | 12:53 | |
| *** AustinR has quit IRC | 12:58 | |
| *** yamamoto has joined #openstack-lbaas | 12:58 | |
| *** yamamoto has quit IRC | 13:09 | |
| *** sapd1_x has joined #openstack-lbaas | 13:19 | |
| *** goldyfruit_ has quit IRC | 14:06 | |
| *** pcaruana has joined #openstack-lbaas | 14:36 | |
| *** lxkong has quit IRC | 14:41 | |
| openstackgerrit | Merged openstack/octavia-tempest-plugin master: Add an active/standby scenario test https://review.opendev.org/584681 | 15:05 |
| openstackgerrit | Merged openstack/octavia stable/pike: Fix urgent amphora two-way auth security bug https://review.opendev.org/686546 | 15:41 |
| f0o | Who maintains the octavia horizon dashboard? | 16:12 |
| f0o | basically, I can crate and manage loadbalancers just fine via CLI but with Horizon I always get logged out when I click on create or edit a loadbalancer. I enabled debug but I cant really get much info out of it other than 'logged out user' after 'task load-balancer.GET.lbaas' | 16:14 |
| *** ricolin_ has quit IRC | 16:20 | |
| cgoncalves | f0o, the octavia community itself. I'm a stranger to the dashboard. do you see any warning/error message in the horizon logs? | 16:34 |
| cgoncalves | could you also check that horizon and the octavia dashboard packages meet the same python version? | 16:35 |
| f0o | good point haha | 16:35 |
| cgoncalves | we had Ubuntu users having a python version mismatch | 16:35 |
| f0o | I dont trust ubuntu anymore | 16:36 |
| f0o | should've just gone gentoo again ;P | 16:36 |
| cgoncalves | also running horizon queens and dashboard rocky (or the other way around) | 16:36 |
| *** luksky has joined #openstack-lbaas | 17:04 | |
| *** gcheresh has joined #openstack-lbaas | 17:11 | |
| f0o | Anyone here with experience in terraform and octavia? upstream terraform provider for openstack doesnt seem to care about octavia, so I guess that has to be done via neutorn-lbaas? | 17:15 |
| *** pcaruana has quit IRC | 17:18 | |
| *** sapd1_x has quit IRC | 17:43 | |
| *** gcheresh has quit IRC | 17:48 | |
| *** gcheresh has joined #openstack-lbaas | 18:00 | |
| *** gcheresh has quit IRC | 18:05 | |
| *** goldyfruit_ has joined #openstack-lbaas | 18:25 | |
| f0o | I broke it again :'D | 18:31 |
| f0o | 2019-10-05 18:30:28.232 11585 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-a51c5041-e64d-4e63-8cc2-c48f00440973 - c3caf1b55bb84b78a795fd81838e5160 - - -] Could not connect to instance. Retrying.: requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='172.16.1.79', port=9443): Read timed out. (read timeout=10.0) | 18:31 |
| f0o | I think this is related to the multi-listener change mentioned earlier, this particular amphora was tested with 4 listeners and 2 pools | 18:34 |
| *** yamamoto has joined #openstack-lbaas | 19:07 | |
| *** yamamoto has quit IRC | 19:12 | |
| *** luksky has quit IRC | 22:16 | |
| *** yamamoto has joined #openstack-lbaas | 22:39 | |
| openstackgerrit | Merged openstack/octavia stable/queens: Fix urgent amphora two-way auth security bug https://review.opendev.org/686545 | 22:47 |
| *** yamamoto has quit IRC | 22:48 | |
| *** yamamoto has joined #openstack-lbaas | 22:51 | |
| *** yamamoto has quit IRC | 22:57 | |
| *** yamamoto has joined #openstack-lbaas | 23:23 | |
| *** yamamoto has quit IRC | 23:23 | |
| *** yamamoto has joined #openstack-lbaas | 23:24 | |
| *** yamamoto has quit IRC | 23:28 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!