*** luksky has quit IRC | 00:02 | |
johnsom | Ah, I was looking at mis matched, not non existent. So, yeah, will take a look tomorrow | 00:03 |
---|---|---|
*** sapd1_x has quit IRC | 00:12 | |
*** hongbin has joined #openstack-lbaas | 01:05 | |
*** psachin has joined #openstack-lbaas | 01:57 | |
*** Dinesh_Bhor has quit IRC | 02:07 | |
*** ricolin has joined #openstack-lbaas | 02:26 | |
openstackgerrit | pengyuesheng proposed openstack/neutron-lbaas-dashboard master: Prompt error when timeout is greater than interval https://review.openstack.org/621477 | 02:51 |
*** hongbin_ has joined #openstack-lbaas | 03:21 | |
*** hongbin has quit IRC | 03:23 | |
*** hongbin_ has quit IRC | 03:59 | |
openstackgerrit | Merged openstack/octavia master: Make sure the expected codes list is sorted https://review.openstack.org/645363 | 04:12 |
*** ramishra has joined #openstack-lbaas | 04:35 | |
openstackgerrit | Merged openstack/neutron-lbaas master: neutron-lbaas haproxy agent prevent vif unplug when failover occurs https://review.openstack.org/578966 | 05:39 |
openstackgerrit | Merged openstack/neutron-lbaas master: Feature correction: L7Policy/Rule for A10Networks https://review.openstack.org/639571 | 05:39 |
*** yamamoto has quit IRC | 06:24 | |
*** ivve has joined #openstack-lbaas | 06:37 | |
*** sapd1 has quit IRC | 06:44 | |
*** pcaruana has joined #openstack-lbaas | 07:07 | |
*** ramishra_ has joined #openstack-lbaas | 07:07 | |
*** ramishra has quit IRC | 07:09 | |
*** sapd1_x has joined #openstack-lbaas | 07:10 | |
*** yamamoto has joined #openstack-lbaas | 07:14 | |
*** velizarx has joined #openstack-lbaas | 07:18 | |
*** sapd1_x has quit IRC | 07:25 | |
*** numans_ has joined #openstack-lbaas | 07:31 | |
*** gthiemonge has joined #openstack-lbaas | 07:32 | |
*** oanson has joined #openstack-lbaas | 07:37 | |
*** velizarx has quit IRC | 07:46 | |
*** velizarx has joined #openstack-lbaas | 07:50 | |
*** gcheresh has joined #openstack-lbaas | 07:56 | |
*** yamamoto has quit IRC | 07:56 | |
*** yamamoto has joined #openstack-lbaas | 08:00 | |
*** yamamoto has quit IRC | 08:02 | |
*** yamamoto has joined #openstack-lbaas | 08:03 | |
*** luksky has joined #openstack-lbaas | 08:18 | |
*** rpittau|afk is now known as rpittau | 08:22 | |
*** velizarx has quit IRC | 08:25 | |
*** velizarx has joined #openstack-lbaas | 08:29 | |
*** Dinesh_Bhor has joined #openstack-lbaas | 08:40 | |
*** velizarx has quit IRC | 08:41 | |
*** velizarx has joined #openstack-lbaas | 08:47 | |
*** ramishra_ is now known as ramishra | 08:49 | |
*** yamamoto has quit IRC | 08:56 | |
*** ivve has quit IRC | 09:10 | |
*** ccamposr has joined #openstack-lbaas | 09:19 | |
*** yamamoto has joined #openstack-lbaas | 09:23 | |
*** yamamoto has quit IRC | 09:30 | |
*** yamamoto has joined #openstack-lbaas | 09:41 | |
*** yamamoto has quit IRC | 09:45 | |
*** ivve has joined #openstack-lbaas | 09:52 | |
openstackgerrit | Carlos Goncalves proposed openstack/octavia stable/rocky: DNM: Gate check https://review.openstack.org/628007 | 10:17 |
*** ivve has quit IRC | 10:21 | |
*** yamamoto has joined #openstack-lbaas | 10:24 | |
*** yamamoto has quit IRC | 10:29 | |
openstackgerrit | Carlos Goncalves proposed openstack/octavia stable/queens: Slightly reorder member flows https://review.openstack.org/647381 | 10:30 |
*** yamamoto has joined #openstack-lbaas | 10:36 | |
*** trident has quit IRC | 10:43 | |
*** yamamoto has quit IRC | 10:47 | |
*** yamamoto has joined #openstack-lbaas | 10:48 | |
*** ivve has joined #openstack-lbaas | 10:50 | |
*** trident has joined #openstack-lbaas | 11:08 | |
*** psachin has quit IRC | 11:16 | |
*** ivve has quit IRC | 11:19 | |
*** sapd1_x has joined #openstack-lbaas | 11:22 | |
*** rcernin has quit IRC | 11:31 | |
*** henriqueof has quit IRC | 11:38 | |
*** luksky has quit IRC | 11:39 | |
*** amuller has joined #openstack-lbaas | 11:49 | |
*** yamamoto has quit IRC | 11:52 | |
openstackgerrit | Ann Taraday proposed openstack/octavia master: [WIP]PoC Octavia taskflow persistence https://review.openstack.org/647406 | 11:59 |
*** ramishra has quit IRC | 12:08 | |
*** ramishra has joined #openstack-lbaas | 12:13 | |
*** luksky has joined #openstack-lbaas | 12:15 | |
*** yamamoto has joined #openstack-lbaas | 12:21 | |
*** trown|outtypewww is now known as trown | 12:22 | |
*** velizarx has quit IRC | 12:25 | |
*** velizarx has joined #openstack-lbaas | 12:25 | |
*** logan- has quit IRC | 12:27 | |
*** logan- has joined #openstack-lbaas | 12:31 | |
*** ricolin has quit IRC | 12:37 | |
*** gcheresh has quit IRC | 12:42 | |
*** gcheresh has joined #openstack-lbaas | 12:42 | |
*** henriqueof has joined #openstack-lbaas | 12:42 | |
*** velizarx has quit IRC | 12:58 | |
*** velizarx has joined #openstack-lbaas | 12:59 | |
*** ivve has joined #openstack-lbaas | 13:15 | |
*** trident has quit IRC | 13:27 | |
*** irclogbot_0 has joined #openstack-lbaas | 13:28 | |
*** trident has joined #openstack-lbaas | 13:29 | |
*** altlogbot_0 has quit IRC | 13:31 | |
*** altlogbot_2 has joined #openstack-lbaas | 13:32 | |
*** irclogbot_0 has quit IRC | 13:38 | |
*** irclogbot_0 has joined #openstack-lbaas | 13:39 | |
*** ivve has quit IRC | 14:11 | |
*** ivve has joined #openstack-lbaas | 14:23 | |
*** fnaval has joined #openstack-lbaas | 14:55 | |
*** yboaron has joined #openstack-lbaas | 15:06 | |
*** sapd1_x has quit IRC | 15:13 | |
*** fnaval has quit IRC | 15:19 | |
*** fnaval_ has joined #openstack-lbaas | 15:19 | |
cgoncalves | stable/rocky grenade job is driving me nuts! I simply can't reproduce the issue seeing in Zuul locally, neither running grenade or manually | 15:52 |
cgoncalves | eth2 is configured properly in amphora-haproxy netns | 15:52 |
johnsom | Trade you the multi-node job | 15:54 |
cgoncalves | octavia-v2-dsvm-scenario-two-nodeSUCCESS in 1h 49m 51s (non-voting) | 15:56 |
cgoncalves | what about it? | 15:56 |
johnsom | It fails when it tries to do IPv6 to the secondary node. The randomness is if the traffic test lands on the secondary | 15:57 |
johnsom | Unless it's magically fixed. (I was pretty sure it was a neutron bug, just didn't get it isolated yet) | 15:57 |
cgoncalves | crazy idea: let's disable secondary. we get both jobs passing. deal? :D | 15:58 |
*** yboaron has quit IRC | 15:58 | |
johnsom | lol, I was going to say "no trade if it's fixed" | 15:58 |
*** gcheresh has quit IRC | 16:05 | |
cgoncalves | I'm tempted to ask infra team to allocate a node for testing | 16:06 |
johnsom | Well, let me look at it today. I will do that after I get a stack running and look at Kong's issue from yesterday. | 16:07 |
cgoncalves | thank you! I'll continue looking around though | 16:13 |
johnsom | +1 | 16:14 |
*** trown is now known as trown|lunch | 16:14 | |
*** ricolin has joined #openstack-lbaas | 16:18 | |
*** luksky has quit IRC | 16:23 | |
*** ricolin has quit IRC | 16:24 | |
*** ivve has quit IRC | 16:26 | |
*** yamamoto has quit IRC | 16:30 | |
*** gcheresh has joined #openstack-lbaas | 16:31 | |
*** yamamoto has joined #openstack-lbaas | 16:32 | |
*** ramishra has quit IRC | 16:43 | |
*** AlexStaf has quit IRC | 17:06 | |
*** AlexStaf has joined #openstack-lbaas | 17:06 | |
*** rpittau is now known as rpittau|afk | 17:22 | |
*** trown|lunch is now known as trown | 17:25 | |
*** ccamposr has quit IRC | 17:36 | |
*** yamamoto has quit IRC | 17:39 | |
*** ivve has joined #openstack-lbaas | 17:48 | |
*** mmdurrant has joined #openstack-lbaas | 18:07 | |
mmdurrant | I have a question I cannot answer looking @ code. | 18:07 |
mmdurrant | Where do project ids for amphorae get specified in the tasks/workflow ? I'm trying to find out where the project ID from my API command gets set in the instance/LB being created and ... it's a mystery | 18:08 |
johnsom | mmdurrant The amphora are owned but the service, not the user, so they get created under the account specified in the "service_auth" section of the octavia.conf. This section is picked up by the OpenStack clients here: https://github.com/openstack/octavia/blob/master/octavia/common/keystone.py#L37 | 18:11 |
*** yamamoto has joined #openstack-lbaas | 18:18 | |
mmdurrant | AHHHHHHHHHHHHHHHH | 18:19 |
mmdurrant | Thank you! | 18:19 |
*** gthiemonge has quit IRC | 18:24 | |
*** yamamoto has quit IRC | 18:25 | |
*** luksky has joined #openstack-lbaas | 18:26 | |
*** AlexStaf has quit IRC | 18:36 | |
*** AlexStaf has joined #openstack-lbaas | 18:36 | |
*** ivve has quit IRC | 18:57 | |
*** gcheresh has quit IRC | 18:58 | |
*** velizarx has quit IRC | 19:01 | |
*** yamamoto has joined #openstack-lbaas | 19:17 | |
*** yamamoto has quit IRC | 19:23 | |
*** abaindur has joined #openstack-lbaas | 19:30 | |
*** abaindur has quit IRC | 19:32 | |
*** abaindur has joined #openstack-lbaas | 19:32 | |
*** amuller has quit IRC | 19:40 | |
*** abaindur has quit IRC | 19:55 | |
*** abaindur has joined #openstack-lbaas | 20:04 | |
johnsom | cgoncalves Yeah, this is a good one.... | 20:12 |
*** pcaruana has quit IRC | 20:23 | |
openstackgerrit | Michael Johnson proposed openstack/octavia stable/rocky: DNM: Gate check https://review.openstack.org/628007 | 20:29 |
*** abaindur has quit IRC | 20:36 | |
*** abaindur has joined #openstack-lbaas | 20:39 | |
abaindur | is there a recommendation of ubuntu vs centos for the amphora image? or does it not matter? | 20:43 |
johnsom | It is pretty much up to you. | 20:47 |
*** abaindur has quit IRC | 20:53 | |
*** abaindur has joined #openstack-lbaas | 20:55 | |
*** abaindur has quit IRC | 21:02 | |
*** trown is now known as trown|outtypewww | 21:04 | |
*** yamamoto has joined #openstack-lbaas | 21:06 | |
*** abaindur has joined #openstack-lbaas | 21:08 | |
*** yamamoto has quit IRC | 21:11 | |
*** abaindur has quit IRC | 21:15 | |
colin- | do most of you operate your amp fleets on unbuntu? just curious | 21:32 |
colin- | i do for now | 21:32 |
colin- | until a compelling reason not to presents itself :) | 21:32 |
openstackgerrit | Michael Johnson proposed openstack/octavia stable/rocky: DNM: Gate check https://review.openstack.org/628007 | 21:38 |
openstackgerrit | Carlos Goncalves proposed openstack/octavia stable/rocky: DNM: Gate check https://review.openstack.org/628007 | 21:39 |
*** yamamoto has joined #openstack-lbaas | 21:39 | |
cgoncalves | ooops! we both edited at the same time | 21:39 |
openstackgerrit | Carlos Goncalves proposed openstack/octavia stable/rocky: DNM: Gate check https://review.openstack.org/628007 | 21:40 |
johnsom | lol | 21:40 |
johnsom | I'm just full of typos today | 21:40 |
johnsom | Probably should not be doing two patches at the same time.... | 21:41 |
cgoncalves | heh | 21:42 |
cgoncalves | did you try running grenade locally? any suspicious about what it could be? | 21:42 |
johnsom | I tried out the scenario, including five different image combinations. Couldn't get it to fail | 21:43 |
johnsom | It's using the queens image BTW, which I think we are testing rocky->stein here | 21:44 |
*** velizarx has joined #openstack-lbaas | 21:44 | |
johnsom | But it didn't matter, the queens image passed as well | 21:44 |
*** yamamoto has quit IRC | 21:45 | |
*** abaindur has joined #openstack-lbaas | 22:06 | |
*** abaindur has quit IRC | 22:08 | |
lxkong | johnsom: hi, could anyone from the team help us to fix this issue https://storyboard.openstack.org/#!/story/2004283 if it's an easy one? I'm too busy with the customer support(k8s stuff) recently, otherwise i could definitely raise my hand. | 22:08 |
*** abaindur has joined #openstack-lbaas | 22:08 | |
johnsom | lxkong I'm already working on that | 22:09 |
lxkong | johnsom: great, thanks a lot, and do you think it could be backported? | 22:09 |
*** velizarx has quit IRC | 22:09 | |
johnsom | Yes. I'm still struggling to reproduce it, but I get the issue. What version are you running on? | 22:10 |
lxkong | 1 sec | 22:10 |
lxkong | http://paste.openstack.org/show/748342/ | 22:11 |
lxkong | my testing was based on this devstack env | 22:11 |
johnsom | Ok | 22:11 |
*** rcernin has joined #openstack-lbaas | 22:14 | |
*** ivve has joined #openstack-lbaas | 22:25 | |
openstackgerrit | Michael Johnson proposed openstack/python-octaviaclient master: Make sure we always requests JSON responses https://review.openstack.org/647628 | 22:27 |
johnsom | lxkong Try this: https://review.openstack.org/647628 | 22:27 |
* lxkong is replacing the code in his devstack | 22:28 | |
lxkong | johnsom: should the `{'Content-Type': 'application/json'}` be `{'Accept': 'application/json'}`? | 22:37 |
lxkong | i can still see the exception with that patch | 22:37 |
johnsom | That actually is probably the case yes | 22:38 |
* lxkong is trying Accept | 22:38 | |
lxkong | Accept works | 22:39 |
lxkong | https://www.irccloud.com/pastebin/lQrOPgLG/ | 22:39 |
johnsom | Cool, I will fix the patch | 22:39 |
openstackgerrit | Michael Johnson proposed openstack/python-octaviaclient master: Make sure we always requests JSON responses https://review.openstack.org/647628 | 22:40 |
lxkong | johnsom: but i don't know why the client is trying to get `faultstring` instead of `description`? | 22:41 |
lxkong | apprently this error object doesn't have faultstring | 22:41 |
johnsom | Yeah, that is odd, they all should have faultstring | 22:41 |
lxkong | johnsom: could you please hold that patch for a little bit? i need to do an integration test with Heat. | 22:43 |
johnsom | Sure | 22:43 |
lxkong | that's the scenario where the issue was found | 22:43 |
*** yamamoto has joined #openstack-lbaas | 22:57 | |
johnsom | cgoncalves Well, I think I see a race condition. I had seen this randomly and not understood it. | 23:01 |
johnsom | Basically when the netns systemd service was added, it's unordered, so it can start after the agent has started. The agent is in the middle of setting up the netns/interface files and the systemd service comes along and ALSO tries... | 23:02 |
*** yamamoto has quit IRC | 23:04 | |
openstackgerrit | Michael Johnson proposed openstack/octavia master: Fix a systemd race condition in the amphora https://review.openstack.org/647632 | 23:11 |
openstackgerrit | Michael Johnson proposed openstack/octavia stable/rocky: DNM: Gate check https://review.openstack.org/628007 | 23:13 |
colin- | what's the observed behavior with the amp race condition when that starts in the wrong order? | 23:17 |
colin- | just curious if i'm encountering it | 23:17 |
johnsom | colin- Amphora agent returned unexpected result code 500 with response {u'message': u'Error plugging network', u'details': u'RTNETLINK answers: File exists\nFailed to bring up eth2.\n'} | 23:19 |
colin- | thx | 23:21 |
*** fnaval_ has quit IRC | 23:22 | |
*** fnaval has joined #openstack-lbaas | 23:42 | |
*** fnaval has quit IRC | 23:42 | |
*** fnaval has joined #openstack-lbaas | 23:47 | |
*** fnaval has quit IRC | 23:48 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!