johnsom | I was just going to recommend increasing amp_active_retries. Maybe your nova is super slow for some reason. Basically that timeout is the time it takes nova to start the qemu process. | 00:00 |
---|---|---|
johnsom | In a later release we have increased the default from 10 to 30. | 00:00 |
Swami | johnsom: Ok, will try it out with the recommended setting or even higher just to make sure if successfully get there. | 00:01 |
Swami | s/if/it | 00:01 |
openstackgerrit | Michael Johnson proposed openstack/octavia master: Fix VIP plug failure if netns directory exists https://review.openstack.org/616382 | 00:33 |
rm_work | I recommend having a spares pool... | 00:38 |
rm_work | johnsom: oy, what? lol | 00:38 |
rm_work | is that for bionic? or like... wat? | 00:38 |
rm_work | what causes that | 00:38 |
johnsom | Yeah, I haven't run it to ground completely. I saw it here: http://logs.openstack.org/87/616287/1/check/octavia-v2-dsvm-scenario-ubuntu-bionic/7990a28/controller/logs/screen-o-cw.txt.gz?#_Nov_07_21_01_06_415808 | 00:40 |
johnsom | I figure there is no harm in making that idempotent | 00:40 |
*** salmankhan has quit IRC | 00:48 | |
openstackgerrit | Michael Johnson proposed openstack/octavia master: Log the compute ID when nova fails https://review.openstack.org/616386 | 00:50 |
johnsom | This seems to be the nova failure flavor of the week: WARNING nova.compute.manager [None req-f97856e5-d8f7-4359-8753-2d9cffbd5b59 None None] While synchronizing instance power states, found 2 instances in the database and 0 instances on the hypervisor. | 00:54 |
*** emcco__ has quit IRC | 01:14 | |
*** Swami has quit IRC | 01:24 | |
*** yamamoto has joined #openstack-lbaas | 01:45 | |
*** hongbin has joined #openstack-lbaas | 02:13 | |
rm_work | <_< | 02:23 |
*** abaindur has quit IRC | 02:33 | |
*** yamamoto has quit IRC | 02:49 | |
*** sapd1 has quit IRC | 03:58 | |
*** sapd1 has joined #openstack-lbaas | 03:58 | |
*** yamamoto has joined #openstack-lbaas | 05:45 | |
*** hongbin has quit IRC | 06:02 | |
*** yboaron has joined #openstack-lbaas | 06:17 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/octavia-dashboard master: Imported Translations from Zanata https://review.openstack.org/616428 | 06:34 |
*** ccamposr has joined #openstack-lbaas | 06:53 | |
*** ccamposr__ has joined #openstack-lbaas | 06:55 | |
*** ccamposr has quit IRC | 06:59 | |
openstackgerrit | ZhaoBo proposed openstack/octavia master: Add client_ca_tls_container_ref to Octavia v2 listener API https://review.openstack.org/612267 | 07:10 |
*** pcaruana has joined #openstack-lbaas | 07:34 | |
*** yamamoto has quit IRC | 07:46 | |
*** yamamoto has joined #openstack-lbaas | 07:46 | |
*** yamamoto has quit IRC | 07:47 | |
*** sapd1 has quit IRC | 08:20 | |
*** sapd1 has joined #openstack-lbaas | 08:20 | |
*** yamamoto has joined #openstack-lbaas | 08:34 | |
*** yamamoto has quit IRC | 08:40 | |
*** yamamoto has joined #openstack-lbaas | 08:46 | |
*** yamamoto has quit IRC | 08:47 | |
*** sapd1_ has joined #openstack-lbaas | 08:47 | |
*** yamamoto has joined #openstack-lbaas | 08:49 | |
*** sapd1 has quit IRC | 08:49 | |
*** abaindur has joined #openstack-lbaas | 08:50 | |
*** abaindur has quit IRC | 08:51 | |
*** abaindur has joined #openstack-lbaas | 08:52 | |
*** velizarx has joined #openstack-lbaas | 09:08 | |
*** yamamoto has quit IRC | 09:13 | |
*** Horrorcat has joined #openstack-lbaas | 09:37 | |
Horrorcat | good $timeofday. is the documentation about certificate rollover in https://docs.openstack.org/octavia/latest/admin/guides/operator-maintenance.html#rotating-cryptographic-certificates still up-to-date? | 09:41 |
Horrorcat | we’re in the process of preparing octavia deployment and figuring out how our process for CA rollover should look like. From what I gather there, a Amphora CA rollover would require to (a) either manually intervene and change the amphora cert or (b) use the failover technique described for changing the Client CA. | 09:42 |
Horrorcat | are we missing something or is that correct? | 09:42 |
*** velizarx has quit IRC | 09:46 | |
*** yamamoto has joined #openstack-lbaas | 09:54 | |
*** sapd1_ has quit IRC | 09:55 | |
*** yamamoto has quit IRC | 10:00 | |
*** yamamoto has joined #openstack-lbaas | 10:04 | |
*** sapd1_ has joined #openstack-lbaas | 10:05 | |
*** abaindur has quit IRC | 10:25 | |
*** abaindur has joined #openstack-lbaas | 10:26 | |
*** salmankhan has joined #openstack-lbaas | 10:26 | |
*** abaindur has quit IRC | 10:29 | |
*** Emine has joined #openstack-lbaas | 10:32 | |
*** velizarx has joined #openstack-lbaas | 10:42 | |
openstackgerrit | Merged openstack/octavia master: Log the compute ID when nova fails https://review.openstack.org/616386 | 10:47 |
openstackgerrit | Carlos Goncalves proposed openstack/octavia stable/rocky: Log the compute ID when nova fails https://review.openstack.org/616506 | 10:51 |
openstackgerrit | Carlos Goncalves proposed openstack/octavia stable/queens: Log the compute ID when nova fails https://review.openstack.org/616507 | 10:51 |
*** velizarx has quit IRC | 10:52 | |
*** yamamoto has quit IRC | 11:10 | |
*** yamamoto has joined #openstack-lbaas | 11:14 | |
*** emine__ has joined #openstack-lbaas | 12:08 | |
*** Emine has quit IRC | 12:11 | |
openstackgerrit | 98k proposed openstack/neutron-lbaas master: Update min tox version to 2.0 https://review.openstack.org/614954 | 12:18 |
*** velizarx has joined #openstack-lbaas | 12:52 | |
*** emine__ has quit IRC | 13:00 | |
*** emine__ has joined #openstack-lbaas | 13:00 | |
*** velizarx has quit IRC | 13:04 | |
*** yamamoto has quit IRC | 13:07 | |
*** yamamoto has joined #openstack-lbaas | 13:09 | |
*** yamamoto has quit IRC | 13:14 | |
*** yboaron has quit IRC | 13:28 | |
*** velizarx has joined #openstack-lbaas | 13:38 | |
*** aojea_ has joined #openstack-lbaas | 13:48 | |
*** velizarx has quit IRC | 13:58 | |
*** yamamoto has joined #openstack-lbaas | 13:58 | |
*** velizarx has joined #openstack-lbaas | 14:00 | |
*** aojea_ has quit IRC | 14:02 | |
*** salmankhan has quit IRC | 14:02 | |
*** dmellado has quit IRC | 14:02 | |
*** eandersson has quit IRC | 14:02 | |
*** yamamoto has quit IRC | 14:03 | |
*** dmellado has joined #openstack-lbaas | 14:04 | |
*** aojea_ has joined #openstack-lbaas | 14:04 | |
*** numans has joined #openstack-lbaas | 14:04 | |
*** salmankhan has joined #openstack-lbaas | 14:06 | |
johnsom | Horrorcat: the amp certs get rotated by the housekeeping process. It is the CA certs that don’t. | 14:41 |
*** emine__ has quit IRC | 14:53 | |
*** Emine has joined #openstack-lbaas | 15:02 | |
*** velizarx has quit IRC | 15:06 | |
*** emccormick has joined #openstack-lbaas | 15:21 | |
Horrorcat | johnsom, thanks for confirming that the houskeeping does indeed take care of rotating the amphora certs. I am more concerned about how to rotate the CA certificates without pain though. | 15:21 |
johnsom | Horrorcat Yep. Right now the best answer is to make them long life. We plan to put an "update amphora" method in place (it was blocked by a bug in werkzeug), but no one has done that work yet. | 15:24 |
Horrorcat | johnsom, okay, thanks. making them long-lived is a workable solution for now. | 15:25 |
johnsom | Horrorcat This document might be helpful for you as well: https://review.openstack.org/613454 | 15:25 |
Horrorcat | dual CA looks like what we’re looking for, in fact. | 15:27 |
johnsom | I just wrote that up as a few folks were having trouble setting up the CAs by hand. I have tested it, but it is still open for reviews. | 15:28 |
cgoncalves | https://review.openstack.org/#/c/613454/ | 15:29 |
cgoncalves | FYI, http://logs.openstack.org/periodic/git.openstack.org/openstack/neutron-lbaas/master/neutron-lbaas-to-octavia-migration/ed77f12/job-output.txt.gz#_2018-11-08_07_00_42_176436 | 15:31 |
cgoncalves | stable/rocky is okay | 15:31 |
johnsom | Hmmm | 15:37 |
*** aojea_ has quit IRC | 15:56 | |
*** aojea_ has joined #openstack-lbaas | 15:56 | |
*** aojea_ has quit IRC | 15:58 | |
*** aojea_ has joined #openstack-lbaas | 15:58 | |
*** aojea_ has quit IRC | 16:03 | |
*** ccamposr__ has quit IRC | 16:08 | |
*** aojea_ has joined #openstack-lbaas | 16:09 | |
*** pcaruana has quit IRC | 16:14 | |
*** yboaron has joined #openstack-lbaas | 16:29 | |
*** yamamoto has joined #openstack-lbaas | 16:40 | |
*** yamamoto has quit IRC | 16:44 | |
*** ivve has joined #openstack-lbaas | 17:02 | |
*** nicolasbock has joined #openstack-lbaas | 17:03 | |
openstackgerrit | Michael Johnson proposed openstack/octavia master: Fix VIP plug failure if netns directory exists https://review.openstack.org/616382 | 17:18 |
*** irclogbot_1 has quit IRC | 17:31 | |
*** aojea_ has quit IRC | 17:35 | |
johnsom | Cores, can you please review the following LBaaS neutron-lib related patches? https://review.openstack.org/#/c/605466 https://review.openstack.org/#/c/605470 and https://review.openstack.org/#/c/605183 | 17:38 |
johnsom | Thanks! | 17:38 |
johnsom | Should be quick. Just need to keep things up to date with the neutron->neutron-lib work | 17:39 |
openstackgerrit | Nguyen Hai Truong proposed openstack/neutron-lbaas master: Add python 3.6 unit test job https://review.openstack.org/616641 | 17:41 |
*** velizarx has joined #openstack-lbaas | 17:51 | |
*** irclogbot_1 has joined #openstack-lbaas | 18:01 | |
*** irclogbot_1 has quit IRC | 18:05 | |
*** velizarx has quit IRC | 18:06 | |
*** pcaruana has joined #openstack-lbaas | 18:10 | |
*** salmankhan has quit IRC | 18:11 | |
*** velizarx has joined #openstack-lbaas | 18:13 | |
*** aojea_ has joined #openstack-lbaas | 18:15 | |
*** irclogbot_1 has joined #openstack-lbaas | 18:26 | |
*** irclogbot_1 has quit IRC | 18:32 | |
*** irclogbot_1 has joined #openstack-lbaas | 18:35 | |
*** Emine has quit IRC | 18:40 | |
*** aojea_ has quit IRC | 18:44 | |
*** Emine has joined #openstack-lbaas | 19:04 | |
rm_work | johnsom: hey so if a member fails to provision, it gets provisioning_status=ERROR but it doesn't mark anything else as an error, so people can keep doing updates -- which means they can add another member, and the update can *work*, and then both members are provisioned (proved by both going to ONLINE status via the HMs) -- but then the original member is still in provisioning_status=ERROR | 19:05 |
rm_work | because we didn't update *it*, it was just sent as a side-effect | 19:05 |
johnsom | Yeah, I can see that. Though an update would set it back active right? | 19:06 |
johnsom | Actually, they can't update it. ERROR is an immutable state. They should only be able to delete it | 19:08 |
*** aojea_ has joined #openstack-lbaas | 19:17 | |
*** Emine has quit IRC | 19:18 | |
*** salmankhan has joined #openstack-lbaas | 19:46 | |
openstackgerrit | Merged openstack/neutron-lbaas master: opt in for neutron-lib consumption patches https://review.openstack.org/605183 | 19:48 |
openstackgerrit | Merged openstack/neutron-lbaas master: add local tox targets for pep8 and py3 https://review.openstack.org/605466 | 19:48 |
openstackgerrit | Merged openstack/neutron-lbaas master: use common rpc and exceptions from neutron-lib https://review.openstack.org/605470 | 19:48 |
*** aojea_ has quit IRC | 19:49 | |
*** salmankhan has quit IRC | 19:51 | |
*** velizarx has quit IRC | 19:56 | |
*** aojea has joined #openstack-lbaas | 20:41 | |
*** aojea has quit IRC | 21:14 | |
*** yboaron has quit IRC | 21:15 | |
rm_work | johnsom: so yeah, umm... i feel like when a successful update is made, ALL objects should be updated to ACTIVE? | 21:24 |
rm_work | because... they now are | 21:24 |
rm_work | xgerman_: is the berlin summit only tues-thurs? | 21:26 |
rm_work | is there not more stuff going on? | 21:26 |
johnsom | rm_work Well, those objects under that listener. Other listeners may still be borked | 21:27 |
rm_work | true | 21:28 |
rm_work | but yeah | 21:28 |
rm_work | hmmmmmmmmm actually i could maybe still make it to the summit if i land monday night -- i just thought i'd be missing a day | 21:35 |
rm_work | tempting | 21:35 |
*** Emine has joined #openstack-lbaas | 21:36 | |
*** ivve has quit IRC | 21:38 | |
*** fnaval has joined #openstack-lbaas | 21:40 | |
xgerman_ | rm_work: yes | 21:41 |
xgerman_ | I get there Monday and leave Friday… | 21:42 |
xgerman_ | also since some reviewers are on a roll - my periodic reminder: https://review.openstack.org/#/c/613685/ | 21:44 |
xgerman_ | https://review.openstack.org/#/c/585864/ | 21:44 |
*** aojea has joined #openstack-lbaas | 21:47 | |
*** aojea has quit IRC | 21:58 | |
*** aojea has joined #openstack-lbaas | 21:59 | |
*** abaindur has joined #openstack-lbaas | 22:01 | |
*** abaindur has quit IRC | 22:01 | |
*** abaindur has joined #openstack-lbaas | 22:02 | |
xgerman_ | johnsom: what’s this CADF | 22:09 |
xgerman_ | ? | 22:09 |
johnsom | xgerman_ https://www.dmtf.org/standards/cadf | 22:10 |
xgerman_ | yeah, but what & why? | 22:10 |
johnsom | https://review.openstack.org/609854 | 22:10 |
xgerman_ | just a badge or deeper meaning? | 22:10 |
xgerman_ | ah, that thing | 22:10 |
xgerman_ | I recall/// | 22:10 |
johnsom | It's API usage auditing. The work was spawned by an internal discussion | 22:11 |
xgerman_ | yeah, didn’t know it had an offcial name | 22:11 |
*** Emine has quit IRC | 22:14 | |
*** emccormick has quit IRC | 22:19 | |
rm_work | neat | 22:34 |
rm_work | i think | 22:34 |
*** Emine has joined #openstack-lbaas | 22:41 | |
*** Emine has quit IRC | 23:06 | |
openstackgerrit | Michael Johnson proposed openstack/octavia-tempest-plugin master: Add traffic tests using an IPv6 VIP https://review.openstack.org/611980 | 23:19 |
*** fnaval has quit IRC | 23:35 | |
*** aojea has quit IRC | 23:50 | |
*** hyang has joined #openstack-lbaas | 23:50 | |
johnsom | Anyone else have some comments on this: https://storyboard.openstack.org/#!/story/2004255 | 23:56 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!