| *** longkb has joined #openstack-lbaas | 00:27 | |
| *** hongbin has joined #openstack-lbaas | 01:00 | |
| *** longkb has quit IRC | 01:20 | |
| *** longkb has joined #openstack-lbaas | 01:21 | |
| *** abaindur has quit IRC | 01:33 | |
| *** yamamoto has joined #openstack-lbaas | 02:31 | |
| *** yamamoto has quit IRC | 02:54 | |
| bzhao__ | abanidur: yes, you are right. 100 seconds for waiting the amp instance become ACTIVE. | 03:04 |
|---|---|---|
| bzhao__ | abanidur: You can increase the corresponding values in octavia.conf, then restart the octavia servers. | 03:06 |
| bzhao__ | abanidur: Seem not other options for it, why the 2 existing options can not fit your request? | 03:12 |
| openstackgerrit | Yang JianFeng proposed openstack/octavia master: [WIP]Add quota support to octavia's l7policy and l7rule https://review.openstack.org/590620 | 03:19 |
| *** hongbin has quit IRC | 03:19 | |
| openstackgerrit | Yang JianFeng proposed openstack/octavia master: [WIP] Add quota support to octavia's l7policy and l7rule https://review.openstack.org/590620 | 03:21 |
| *** ianychoi has joined #openstack-lbaas | 03:56 | |
| *** numans has quit IRC | 04:02 | |
| *** abaindur has joined #openstack-lbaas | 04:14 | |
| *** yamamoto has joined #openstack-lbaas | 04:51 | |
| *** abaindur has quit IRC | 05:00 | |
| *** abaindur has joined #openstack-lbaas | 05:01 | |
| *** yamamoto has quit IRC | 05:42 | |
| *** yamamoto has joined #openstack-lbaas | 05:46 | |
| openstackgerrit | Yang JianFeng proposed openstack/octavia master: Add compute_flavor field for amphora api https://review.openstack.org/582914 | 05:54 |
| openstackgerrit | Yang JianFeng proposed openstack/octavia master: Add compute_flavor field for amphora api https://review.openstack.org/582914 | 06:02 |
| *** yamamoto has quit IRC | 06:23 | |
| *** yamamoto has joined #openstack-lbaas | 06:24 | |
| *** yamamoto has quit IRC | 06:32 | |
| *** pcaruana has joined #openstack-lbaas | 06:43 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/octavia master: Imported Translations from Zanata https://review.openstack.org/590128 | 06:55 |
| *** velizarx has joined #openstack-lbaas | 07:05 | |
| *** rcernin has quit IRC | 07:07 | |
| *** numans has joined #openstack-lbaas | 07:22 | |
| *** velizarx has quit IRC | 07:43 | |
| *** velizarx has joined #openstack-lbaas | 07:50 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/neutron-lbaas master: Imported Translations from Zanata https://review.openstack.org/590173 | 08:04 |
| *** crazik has joined #openstack-lbaas | 08:17 | |
| crazik | hello | 08:17 |
| crazik | By default my LB have blocked ICMP on VIP | 08:17 |
| crazik | how to enable that? | 08:17 |
| crazik | I can edit SG after LB create | 08:17 |
| crazik | but need to make it persistent | 08:18 |
| crazik | I tried to modify default lb-mgmt-net sec group | 08:18 |
| crazik | but it has no effect | 08:18 |
| crazik | any idea? | 08:18 |
| crazik | what happens if I add a new SG to amphora_secgroup_list? | 08:19 |
| *** ktibi has joined #openstack-lbaas | 08:22 | |
| *** celebdor has joined #openstack-lbaas | 08:27 | |
| *** abaindur has quit IRC | 09:04 | |
| *** salmankhan has joined #openstack-lbaas | 09:09 | |
| cgoncalves | dayou, hi. could you please revisit https://review.openstack.org/#/c/588883/? thanks | 09:18 |
| dayou | cgoncalves: So if you rebase https://review.openstack.org/#/c/587442 to latest master, it does not work? | 09:21 |
| *** ktibi has quit IRC | 09:23 | |
| cgoncalves | dayou, https://review.openstack.org/#/c/587442 has to depend-on https://review.openstack.org/#/c/587414 but that cannot verify without first removing v2-ubuntu job definition, hence the revert in https://review.openstack.org/#/c/588883/ | 09:25 |
| *** KeithMnemonic has quit IRC | 09:33 | |
| *** ktibi has joined #openstack-lbaas | 09:33 | |
| openstackgerrit | Yang JianFeng proposed openstack/octavia master: [WIP] Add quota support to octavia's l7policy and l7rule https://review.openstack.org/590620 | 09:39 |
| dayou | cgoncalves: So if we merge 58883 into 587442 and then just make 587414 depends on 587442 is not going to work? | 09:40 |
| cgoncalves | dayou, it would work, but in that case we still would need to follow up with another patch to remove octavia-v1-dsvm-scenario-ubuntu.bionic from octavia repo | 09:45 |
| cgoncalves | I don't see a way it could work with less than 3 patches: 2 in octavia, 1 in octavia-tempest-plugin | 09:45 |
| dayou | It looks like there is only one way dependcy, octavia-v2-dsvm-scenario-ubuntu.bionic in 587414 relies on that job being removed in 587442 and there is nothing to do with octavia-v1-dsvm-scenario-ubuntu.bionic | 09:56 |
| *** abaindur has joined #openstack-lbaas | 10:38 | |
| *** abaindur has quit IRC | 10:44 | |
| *** rpittau has quit IRC | 11:00 | |
| openstackgerrit | Carlos Goncalves proposed openstack/octavia-tempest-plugin master: Update links in README.rst https://review.openstack.org/575030 | 11:22 |
| *** longkb has quit IRC | 11:23 | |
| *** rpittau has joined #openstack-lbaas | 12:23 | |
| *** abaindur has joined #openstack-lbaas | 12:40 | |
| *** abaindur has quit IRC | 12:44 | |
| *** amuller has joined #openstack-lbaas | 12:50 | |
| *** KeithMnemonic has joined #openstack-lbaas | 13:19 | |
| *** velizarx has quit IRC | 13:19 | |
| openstackgerrit | Yang JianFeng proposed openstack/octavia master: [WIP] Add quota support to octavia's l7policy and l7rule https://review.openstack.org/590620 | 13:20 |
| *** velizarx has joined #openstack-lbaas | 13:21 | |
| *** abaindur has joined #openstack-lbaas | 13:40 | |
| *** abaindur has quit IRC | 13:45 | |
| *** fnaval has joined #openstack-lbaas | 13:49 | |
| *** hongbin_ has joined #openstack-lbaas | 14:03 | |
| openstackgerrit | German Eichberger proposed openstack/neutron-lbaas master: Gate API test for the lbaasv2-proxy plugin https://review.openstack.org/539350 | 14:21 |
| *** velizarx has quit IRC | 14:39 | |
| *** salmankhan has quit IRC | 14:43 | |
| *** salmankhan has joined #openstack-lbaas | 14:49 | |
| *** kobis1 has joined #openstack-lbaas | 15:20 | |
| *** kobis1 has quit IRC | 15:20 | |
| *** rpittau has quit IRC | 15:48 | |
| mnaser | "Amphora 015bc2d9-22ff-4670-a85c-8fd82b58ca31 health message was processed too slowly: 43.7683420181s! The system may be overloaded or otherwise malfunctioning. This heartbeat has been ignored and no update was made to the amphora health entry. THIS IS NOT GOOD." | 16:09 |
| mnaser | i'm not really understanding what this means, the amphora is overloaded or the control plane is? | 16:09 |
| colby_ | Hey Everyone. I finally got all the octavia stuff going. But neutron is failing with a driver error: neutron.api.v2.resource DriverError: Driver error: 'NoneType' object has no attribute 'rstrip' | 16:34 |
| openstackgerrit | German Eichberger proposed openstack/neutron-lbaas master: Gate API test for the lbaasv2-proxy plugin https://review.openstack.org/539350 | 16:43 |
| *** celebdor has quit IRC | 16:44 | |
| *** celebdor has joined #openstack-lbaas | 16:45 | |
| *** aojea has joined #openstack-lbaas | 16:46 | |
| *** celebdor has quit IRC | 16:49 | |
| *** aojea has quit IRC | 16:52 | |
| *** salmankhan has quit IRC | 16:58 | |
| *** colby_ has quit IRC | 17:02 | |
| *** colby_ has joined #openstack-lbaas | 17:02 | |
| *** ktibi has quit IRC | 17:29 | |
| *** abaindur has joined #openstack-lbaas | 17:42 | |
| *** abaindur has quit IRC | 17:47 | |
| *** ianychoi has quit IRC | 18:10 | |
| *** ianychoi has joined #openstack-lbaas | 18:11 | |
| mnaser | welp | 18:27 |
| mnaser | found a bug | 18:27 |
| cgoncalves | mnaser, the octavia health manager | 18:45 |
| mnaser | no it looks like something happened | 18:45 |
| mnaser | where the vrrp port was deleted | 18:45 |
| mnaser | and then a failover happened | 18:45 |
| mnaser | and now it can't ever boot up again because when it tries to failover, it's trying to use the same port. | 18:45 |
| mnaser | https://github.com/openstack/octavia/blob/f1b9e463cc062c4943983944d371f604ea904609/octavia/controller/worker/flows/load_balancer_flows.py#L310-L312 -- this creates a vrrp port if none exist, before GetAmphoraeNetworkConfigs runs. | 18:59 |
| mnaser | in this case, the vrrp port id is gone | 18:59 |
| mnaser | so https://github.com/openstack/octavia/blob/a890f2ba35fed4424cf9dcff8224d699431beb45/octavia/controller/worker/flows/amphora_flows.py#L379-L381 fails to look up the vrrp port | 18:59 |
| mnaser | and https://github.com/openstack/octavia/blob/a890f2ba35fed4424cf9dcff8224d699431beb45/octavia/controller/worker/flows/amphora_flows.py#L391-L392 only happens afterwards.. too late for it to catch up | 19:00 |
| mnaser | and then the failover fails forever. | 19:00 |
| mnaser | the load balancer becomes pretty much totally unrecoverable | 19:00 |
| openstackgerrit | German Eichberger proposed openstack/neutron-lbaas master: Gate API test for the lbaasv2-proxy plugin https://review.openstack.org/539350 | 19:12 |
| *** pcaruana has quit IRC | 19:19 | |
| *** abaindur has joined #openstack-lbaas | 19:37 | |
| *** abaindur has quit IRC | 19:38 | |
| *** abaindur has joined #openstack-lbaas | 19:38 | |
| *** ivve has joined #openstack-lbaas | 19:59 | |
| colby_ | Hey Guys Ive made more progress. When I try and delete my failed load balancers I get the following error in neutron:Driver error: (sqlite3.OperationalError) no such table: load_balancer | 20:45 |
| colby_ | Ive got neutron db updated so why is it missing those tables: I even ran neutron-db-manage --subproject neutron-lbaas upgrade head just in case | 20:47 |
| *** savvas has quit IRC | 20:49 | |
| colby_ | ah it appears to be missing from octavia db. | 20:56 |
| colby_ | so when I run octavia-db-manage upgrade head I get this error: No support for ALTER of constraints in SQLite dialect | 20:58 |
| colby_ | ug nevermind my puppet config was not dropping in the database connection. So it was using sqllite by accident. But Im still not able to delete them since the ids do not exist in the octavia db | 21:09 |
| colby_ | So I guess my question is can I delete loadbalacers (that neutron thinks exist) that are in error state that dont exist in the octavia database. These lbs exist in neutron as I was testing attempting to spin up an octavia load balancer and troubleshoot the neutron connection | 21:13 |
| colby_ | Im guessing I will have to delete them from the neutron db, and remove the ports used by them. | 21:28 |
| *** aojea has joined #openstack-lbaas | 21:56 | |
| *** yamamoto has joined #openstack-lbaas | 22:02 | |
| abaindur | colby_: is there a reason to use neutron in the first place? | 22:03 |
| abaindur | and not octavia directly? | 22:03 |
| colby_ | I guess not. There was not cli that I was aware of with octavia | 22:05 |
| *** fnaval has quit IRC | 22:06 | |
| colby_ | I wanted to test spinning up load balancers and only way I saw to do that was using neutron | 22:09 |
| colby_ | Ive hit another issue. I have a lb that failed (due to an auth_plugin error on worker), that is now stuck in PENDING_CREATE so I cant delete it | 22:11 |
| abaindur | what do you mean? the openstack loadbalancer CLI uses octavia | 22:12 |
| abaindur | the neutron lbaas CLI uses neutron endpoint | 22:12 |
| colby_ | openstack loadbalancer does not exist in pike version (at least its not listed the help) | 22:12 |
| abaindur | did you pip install python octaviaclient | 22:13 |
| colby_ | no Im on centos and using the RPMs | 22:13 |
| abaindur | it is not there with just python-openstackclient | 22:13 |
| colby_ | I dont see an octavia client rpm | 22:13 |
| abaindur | cant you "pip install python-octaviaclient" | 22:13 |
| abaindur | you can install the CLI/clients on any machine | 22:14 |
| abaindur | the controller, dev machine, any machine | 22:14 |
| abaindur | https://docs.openstack.org/zh_CN/user-guide/common/cli-set-environment-variables-using-openstack-rc.html | 22:15 |
| abaindur | source those env variables that has endpoint URL for keystone, your user creds | 22:15 |
| abaindur | pip install the python-openstackclient and python-octaviaclient to these versions: https://github.com/openstack/requirements/blob/stable/pike/upper-constraints.txt | 22:16 |
| colby_ | ok this was on our controller and I was using the RPMs there for everything. There are RPMs for all the other clients | 22:16 |
| abaindur | Then you should be good to go with "openstack loadbalancer ..." CLIs which talk to octavia | 22:16 |
| abaindur | you dont need to install the clients from RPM. as long as they are anywhere in your system. or even in a virtualenv | 22:17 |
| abaindur | if you're using pike, use the version from pike upperconstraints... "pip install python-octaviaclient==1.2.0" | 22:17 |
| abaindur | if your "openstack endpoint list" shows an octavia endpoint with the service type as "load-balancer" you should be good to go | 22:19 |
| openstackgerrit | German Eichberger proposed openstack/neutron-lbaas master: Gate API test for the lbaasv2-proxy plugin https://review.openstack.org/539350 | 22:19 |
| colby_ | gotcha. | 22:19 |
| colby_ | just FYI I did not make endpoints for octavia because the docs say its unsecure and was only talked to by internal services | 22:20 |
| colby_ | Here: https://docs.openstack.org/octavia/latest/contributor/guides/dev-quick-start.html#id2 | 22:20 |
| colby_ | some newer install guides would be nice :-) | 22:21 |
| abaindur | yea... it says octavia 0.9 | 22:25 |
| abaindur | https://releases.openstack.org/teams/octavia.html | 22:25 |
| abaindur | which seems like its newton (another doc bug? newton release tags missing there), since Mitaka is 0.8 and ocata is 0.10 | 22:25 |
| colby_ | yea that was the only install guide I could find | 22:26 |
| abaindur | the intro page does say, "As of Pike, it is recommended to run Octavia as a standalone load balancing solution. Neutron LBaaS is deprecated in the Queens release, and Octavia is its replacement. Whenever possible, operators are strongly advised to migrate to Octavia. For end-users, this transition should be relatively seamless, because Octavia supports the Neutron LBaaS v2 API and it has a similar CLI | 22:26 |
| abaindur | interface." | 22:26 |
| *** aojea has quit IRC | 22:27 | |
| abaindur | Now might be a good time to ween off neutron-lbaas since it'll be gone soon | 22:27 |
| colby_ | yea I have zero problem ditching it..we never used it. | 22:27 |
| colby_ | so Ill do octavia stand alone | 22:28 |
| abaindur | we plan to use both.... have AVI which only has a driver for neutro-lbaas | 22:28 |
| abaindur | shouldnt conflict as different endpoint ports and service types in keystone, and they use the different CLI clients (neutron vs openstack) | 22:28 |
| colby_ | cool. Thanks for the info! | 22:29 |
| abaindur | thx... feel free to ask me questions as i am also trying to get Octavia up and running | 22:29 |
| abaindur | so far ive been able to create a basic HTTP load balancer, thats about it. havent done any https or health monitors or played around with anything else | 22:30 |
| abaindur | https://docs.openstack.org/octavia/queens/user/guides/basic-cookbook.html | 22:30 |
| abaindur | i'm just following those examples which have the openstack cli commands | 22:30 |
| *** ivve has quit IRC | 22:40 | |
| *** hongbin_ has quit IRC | 23:00 | |
| *** yamamoto has quit IRC | 23:05 | |
| *** yamamoto has joined #openstack-lbaas | 23:38 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!