| *** kbyrne has joined #openstack-lbaas | 00:01 | |
| *** diogogmt has quit IRC | 00:02 | |
| *** piet has quit IRC | 00:03 | |
| *** diogogmt has joined #openstack-lbaas | 00:03 | |
| *** ajmiller has quit IRC | 00:03 | |
| *** ajmiller has joined #openstack-lbaas | 00:04 | |
| *** bana_k has joined #openstack-lbaas | 00:05 | |
| *** piet has joined #openstack-lbaas | 00:12 | |
| *** diogogmt has quit IRC | 00:16 | |
| *** diogogmt has joined #openstack-lbaas | 00:21 | |
| *** bana_k has quit IRC | 00:32 | |
| *** chenli has joined #openstack-lbaas | 00:50 | |
| *** kbyrne has quit IRC | 00:57 | |
| *** Purandar has quit IRC | 00:58 | |
| *** kevo has quit IRC | 00:59 | |
| *** rudrajit_ has quit IRC | 01:08 | |
| *** openstack has joined #openstack-lbaas | 01:25 | |
| *** somerville32 has joined #openstack-lbaas | 01:27 | |
| *** piet has quit IRC | 01:37 | |
| *** woodster_ has quit IRC | 01:39 | |
| *** daneyon has quit IRC | 01:50 | |
| *** fnaval has quit IRC | 02:02 | |
| *** fnaval has joined #openstack-lbaas | 02:07 | |
| *** fnaval has quit IRC | 02:18 | |
| *** fnaval has joined #openstack-lbaas | 02:18 | |
| *** Purandar has joined #openstack-lbaas | 02:29 | |
| *** armax_ has joined #openstack-lbaas | 02:42 | |
| *** armax has quit IRC | 02:44 | |
| *** armax_ is now known as armax | 02:44 | |
| *** numans has quit IRC | 02:49 | |
| *** yuanying has quit IRC | 02:50 | |
| *** eranra has quit IRC | 03:06 | |
| *** eranra has joined #openstack-lbaas | 03:06 | |
| *** Purandar has quit IRC | 03:17 | |
| *** Purandar has joined #openstack-lbaas | 03:26 | |
| *** numans has joined #openstack-lbaas | 03:30 | |
| *** yamamot__ has joined #openstack-lbaas | 03:32 | |
| *** eranra has quit IRC | 03:32 | |
| *** eranra has joined #openstack-lbaas | 03:32 | |
| *** ducttape_ has joined #openstack-lbaas | 03:35 | |
| *** ajmiller has quit IRC | 03:36 | |
| *** ajmiller has joined #openstack-lbaas | 03:36 | |
| *** gongysh has joined #openstack-lbaas | 03:39 | |
| *** yuanying has joined #openstack-lbaas | 03:47 | |
| *** ducttape_ has quit IRC | 04:07 | |
| *** chenli has quit IRC | 04:08 | |
| *** chenli has joined #openstack-lbaas | 04:08 | |
| *** rudrajit has joined #openstack-lbaas | 04:09 | |
| *** brad_behle has quit IRC | 04:13 | |
| *** rudrajit_ has joined #openstack-lbaas | 04:13 | |
| *** rudrajit has quit IRC | 04:13 | |
| *** links has joined #openstack-lbaas | 04:22 | |
| *** armax has quit IRC | 04:29 | |
| *** gongysh has quit IRC | 04:43 | |
| *** rcernin has joined #openstack-lbaas | 04:53 | |
| *** pcaruana has quit IRC | 04:58 | |
| *** yamamot__ has quit IRC | 04:59 | |
| *** bana_k has joined #openstack-lbaas | 05:03 | |
| *** M00nr41n has quit IRC | 05:06 | |
| *** eranra has quit IRC | 05:07 | |
| *** numans has quit IRC | 05:13 | |
| *** numans has joined #openstack-lbaas | 05:27 | |
| *** rcernin has quit IRC | 05:33 | |
| *** sputnik13 has joined #openstack-lbaas | 05:34 | |
| *** ducttape_ has joined #openstack-lbaas | 05:38 | |
| *** yamamot__ has joined #openstack-lbaas | 05:38 | |
| *** ducttape_ has quit IRC | 05:42 | |
| *** outofmemory has quit IRC | 05:47 | |
| *** numans has quit IRC | 05:48 | |
| *** somerville32 has quit IRC | 05:49 | |
| *** numans has joined #openstack-lbaas | 06:00 | |
| *** chenli has quit IRC | 06:01 | |
| *** kobis has joined #openstack-lbaas | 06:01 | |
| *** chenli has joined #openstack-lbaas | 06:01 | |
| *** rcernin has joined #openstack-lbaas | 06:06 | |
| *** M00nr41n has joined #openstack-lbaas | 06:08 | |
| *** Purandar has quit IRC | 06:15 | |
| *** pcaruana has joined #openstack-lbaas | 06:16 | |
| *** pcaruana is now known as pcaruana|afk| | 06:19 | |
| *** eranra has joined #openstack-lbaas | 06:19 | |
| *** eranra_ has joined #openstack-lbaas | 06:19 | |
| openstackgerrit | KaiLi proposed openstack/neutron-lbaas: Add status in Octavia https://review.openstack.org/324197 | 06:22 |
|---|---|---|
| *** M00nr41n has quit IRC | 06:22 | |
| *** M00nr41n has joined #openstack-lbaas | 06:23 | |
| *** eranra has quit IRC | 06:23 | |
| *** M00nr41n has quit IRC | 06:33 | |
| *** M00nr41n has joined #openstack-lbaas | 06:34 | |
| *** rudrajit_ has quit IRC | 06:37 | |
| *** rudrajit has joined #openstack-lbaas | 06:37 | |
| *** amotoki has joined #openstack-lbaas | 06:39 | |
| *** rudrajit has quit IRC | 06:42 | |
| *** pcaruana|afk| is now known as pcaruana | 06:49 | |
| *** jsheeren has joined #openstack-lbaas | 07:01 | |
| *** piet has joined #openstack-lbaas | 07:02 | |
| *** tesseract- has joined #openstack-lbaas | 07:09 | |
| openstackgerrit | KaiLi proposed openstack/neutron-lbaas: Add status in Octavia https://review.openstack.org/324197 | 07:11 |
| *** eezhova has joined #openstack-lbaas | 07:18 | |
| *** chenli has quit IRC | 07:18 | |
| *** nmagnezi has joined #openstack-lbaas | 07:20 | |
| *** chenli has joined #openstack-lbaas | 07:21 | |
| *** saju_m has joined #openstack-lbaas | 07:26 | |
| *** piet has quit IRC | 07:29 | |
| *** ajmiller has quit IRC | 07:33 | |
| *** ajmiller has joined #openstack-lbaas | 07:34 | |
| *** amotoki has quit IRC | 07:37 | |
| *** ducttape_ has joined #openstack-lbaas | 07:40 | |
| *** amotoki has joined #openstack-lbaas | 07:43 | |
| *** ducttape_ has quit IRC | 07:44 | |
| openstackgerrit | Elena Ezhova proposed openstack/octavia: Cleanup deleted load balancers in housekeeper's db_cleanup https://review.openstack.org/332913 | 07:50 |
| openstackgerrit | Elena Ezhova proposed openstack/octavia: Decrease default resource expiry age in DevStack setup https://review.openstack.org/334374 | 07:50 |
| *** saju_m has quit IRC | 07:51 | |
| *** saju_m has joined #openstack-lbaas | 07:52 | |
| *** noshankus has joined #openstack-lbaas | 07:54 | |
| *** ihrachys has joined #openstack-lbaas | 08:03 | |
| *** sbalukoff_ has quit IRC | 08:20 | |
| *** sbalukoff_ has joined #openstack-lbaas | 08:20 | |
| *** dmk0202 has joined #openstack-lbaas | 08:39 | |
| *** ducttape_ has joined #openstack-lbaas | 08:41 | |
| *** anilvenkata has joined #openstack-lbaas | 08:45 | |
| *** ducttape_ has quit IRC | 08:46 | |
| *** sputnik13 has quit IRC | 08:55 | |
| *** gongysh has joined #openstack-lbaas | 08:58 | |
| *** chlong has quit IRC | 09:04 | |
| openstackgerrit | Elena Ezhova proposed openstack/octavia: Cleanup deleted load balancers in housekeeper's db_cleanup https://review.openstack.org/332913 | 09:09 |
| openstackgerrit | Elena Ezhova proposed openstack/octavia: Decrease default resource expiry age in DevStack setup https://review.openstack.org/334374 | 09:11 |
| *** chlong has joined #openstack-lbaas | 09:17 | |
| *** gongysh has quit IRC | 09:27 | |
| jsheeren | hi all, so i've been trying to configure octavia | 09:29 |
| jsheeren | i'm at the point where my amphora image gets booted | 09:29 |
| jsheeren | ips are assigned from the lbnet and my private net | 09:30 |
| jsheeren | but the loadbalancer does not become active, it goes to error state | 09:30 |
| jsheeren | i'm seeing this in the logs: WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying | 09:30 |
| jsheeren | i created the amphora image with the diskimage-create script | 09:31 |
| jsheeren | i can't ping the amphora instance from my private network. i should be able to do this, correct? | 09:32 |
| *** amotoki has quit IRC | 09:37 | |
| *** chenli has quit IRC | 09:37 | |
| rm_work | jsheeren: your timeouts may be too low? | 09:40 |
| rm_work | that WARNING is normal, as octavia will poll for the rest agent | 09:40 |
| rm_work | and it will fail many times until the boot completes | 09:40 |
| jsheeren | but i can see in the console of the amphora instance that the boot has completed? | 09:40 |
| rm_work | it can take up to 10 minutes or so, if you don't have nested-virtualization (most clouds do not include this if you are running devstack in a VM, and also virtualbox does not have it) | 09:40 |
| rm_work | from "ACTIVE" in nova, to *actually responding* can be another while | 09:41 |
| rm_work | though usually only a minute or two | 09:41 |
| *** ducttape_ has joined #openstack-lbaas | 09:41 | |
| jsheeren | i would assume that when i can see the login prompt, that it should respond to ping? | 09:42 |
| rm_work | it depends a lot on what hardware or host VM you're using to run the VM | 09:42 |
| rm_work | yeah, if you can *log in* it should be working | 09:42 |
| jsheeren | i cannot ping the instance from the router namespace | 09:42 |
| jsheeren | as well | 09:42 |
| rm_work | did you follow a guide? or, is this devstack? | 09:42 |
| jsheeren | i did not find a guide .. using devstac/openstack-ansible as a "guide" on configureing it | 09:43 |
| rm_work | unfortunately if it's a networking problem, that is my weakness :/ I am not good at debugging low-level networking failures | 09:43 |
| jsheeren | where can i find a guie? | 09:43 |
| jsheeren | **guide? | 09:43 |
| rm_work | If you prefer to look at *code* to see how to set it up, there is our devstack plugin | 09:43 |
| rm_work | https://github.com/openstack/octavia/blob/master/devstack/plugin.sh | 09:44 |
| rm_work | I think someone has written a guide for basic setup too but I am not sure where it lives... I think it was a blog post by ajmiller? though it may also be out of date | 09:45 |
| rm_work | unfortunately the rest of the guides I can think of actually just use our devstack plugin T_ | 09:45 |
| rm_work | T_T | 09:45 |
| *** ducttape_ has quit IRC | 09:46 | |
| jsheeren | rm_work: thanks for the link to the plugin | 09:48 |
| jsheeren | i followed that more or less | 09:48 |
| jsheeren | i did not do this though: https://github.com/openstack/octavia/blob/master/devstack/plugin.sh#L141 | 09:49 |
| *** amotoki has joined #openstack-lbaas | 09:50 | |
| rm_work | The network stuff seems very particular... It needs to be exactly right, and unfortunately I don't understand it well enough to advise you. :( | 09:51 |
| rm_work | If you are still on much later (unfortunately, about 6 hours from now) there will be more people online that can help... | 09:51 |
| *** ajmiller has quit IRC | 09:52 | |
| jsheeren | ok thx if i don't figure it out by then, i'll be here :) | 09:52 |
| *** ajmiller has joined #openstack-lbaas | 09:52 | |
| rm_work | good luck! | 09:52 |
| *** eezhova has quit IRC | 09:53 | |
| *** eezhova has joined #openstack-lbaas | 09:59 | |
| *** eranra_ has quit IRC | 10:09 | |
| *** nokes has joined #openstack-lbaas | 10:17 | |
| *** noshankus has quit IRC | 10:18 | |
| *** nokes is now known as noshankus | 10:18 | |
| *** eezhova has quit IRC | 10:23 | |
| *** amotoki has quit IRC | 10:23 | |
| *** eezhova has joined #openstack-lbaas | 10:26 | |
| *** eezhova has quit IRC | 10:31 | |
| *** amotoki has joined #openstack-lbaas | 10:33 | |
| *** ajmiller has quit IRC | 10:37 | |
| *** ajmiller has joined #openstack-lbaas | 10:37 | |
| *** ducttape_ has joined #openstack-lbaas | 10:42 | |
| *** amotoki has quit IRC | 10:44 | |
| *** ducttape_ has quit IRC | 10:47 | |
| *** yamamot__ has quit IRC | 10:49 | |
| *** amotoki has joined #openstack-lbaas | 11:02 | |
| *** eranra has joined #openstack-lbaas | 11:20 | |
| *** noshankus has quit IRC | 11:29 | |
| *** noshankus has joined #openstack-lbaas | 11:30 | |
| *** svinota has joined #openstack-lbaas | 11:31 | |
| *** eezhova has joined #openstack-lbaas | 11:33 | |
| *** eranra has quit IRC | 11:34 | |
| *** eezhova has quit IRC | 11:40 | |
| *** ducttape_ has joined #openstack-lbaas | 11:43 | |
| *** amotoki has quit IRC | 11:44 | |
| *** eranra has joined #openstack-lbaas | 11:46 | |
| *** ducttape_ has quit IRC | 11:47 | |
| *** numans has quit IRC | 11:48 | |
| *** yamamoto has joined #openstack-lbaas | 11:57 | |
| *** eranra has quit IRC | 11:59 | |
| *** Frito has joined #openstack-lbaas | 12:00 | |
| *** ducttape_ has joined #openstack-lbaas | 12:04 | |
| *** ducttape_ has quit IRC | 12:05 | |
| *** ducttape_ has joined #openstack-lbaas | 12:06 | |
| *** eranra has joined #openstack-lbaas | 12:18 | |
| *** ebagdasa has quit IRC | 12:19 | |
| *** ducttape_ has quit IRC | 12:23 | |
| *** brad_behle has joined #openstack-lbaas | 12:35 | |
| *** diogogmt has quit IRC | 12:38 | |
| *** matt-borland has joined #openstack-lbaas | 12:44 | |
| *** gongysh has joined #openstack-lbaas | 12:48 | |
| *** diogogmt has joined #openstack-lbaas | 12:52 | |
| *** eranra has quit IRC | 12:59 | |
| *** woodster_ has joined #openstack-lbaas | 13:05 | |
| *** M00nr41n has quit IRC | 13:11 | |
| *** ihrachys has quit IRC | 13:11 | |
| *** ihrachys has joined #openstack-lbaas | 13:13 | |
| *** eranra has joined #openstack-lbaas | 13:22 | |
| *** eranra_ has joined #openstack-lbaas | 13:23 | |
| *** ducttape_ has joined #openstack-lbaas | 13:24 | |
| *** eranra has quit IRC | 13:27 | |
| *** anilvenkata has quit IRC | 13:27 | |
| *** ducttape_ has quit IRC | 13:29 | |
| *** diogogmt has quit IRC | 13:32 | |
| *** links has quit IRC | 13:36 | |
| *** eezhova has joined #openstack-lbaas | 13:40 | |
| *** eezhova has quit IRC | 13:45 | |
| *** bana_k has quit IRC | 13:46 | |
| *** eezhova has joined #openstack-lbaas | 13:47 | |
| ihrachys | dougwig: are there any docs on *using* octavia? | 14:00 |
| ihrachys | not API, not configuration options, but things like upgrades or HA | 14:00 |
| *** ajo_ has joined #openstack-lbaas | 14:00 | |
| *** yamamoto has quit IRC | 14:02 | |
| *** ajo_ has quit IRC | 14:03 | |
| *** ajo_ has joined #openstack-lbaas | 14:04 | |
| *** jsheeren has quit IRC | 14:06 | |
| *** ajo_ has quit IRC | 14:07 | |
| *** ajo_ has joined #openstack-lbaas | 14:07 | |
| *** fnaval has quit IRC | 14:08 | |
| *** ajo_ has quit IRC | 14:09 | |
| *** Purandar has joined #openstack-lbaas | 14:12 | |
| *** eezhova has quit IRC | 14:12 | |
| nmagnezi | dougwig, could you please check this one out? waiting for it's second +2 vote for a while now https://review.openstack.org/#/c/327966/ | 14:13 |
| *** kobis has quit IRC | 14:20 | |
| *** ducttape_ has joined #openstack-lbaas | 14:21 | |
| *** fnaval has joined #openstack-lbaas | 14:21 | |
| *** zw has joined #openstack-lbaas | 14:26 | |
| zw | Hi there | 14:26 |
| zw | Any octavia users online? :) | 14:26 |
| *** evgenyf has joined #openstack-lbaas | 14:31 | |
| *** eezhova has joined #openstack-lbaas | 14:31 | |
| *** amotoki has joined #openstack-lbaas | 14:31 | |
| Frito | I've done a couple of patches for Octavia but I'm fairly new to it. | 14:32 |
| Frito | zw: --^ | 14:33 |
| *** sputnik13 has joined #openstack-lbaas | 14:33 | |
| zw | Frito: ever set it up? | 14:33 |
| zw | In a DVR env? | 14:33 |
| Frito | Negative. I've only worked with it on DevStack. Sorry :-(. Some of the others should be getting online within the next hour or so though. | 14:34 |
| zw | Kay | 14:34 |
| zw | Our instances are booting up and so on | 14:35 |
| zw | But then : 2016-06-29 16:34:34.475 25979 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying | 14:35 |
| zw | If we ssh to the instance from within the correct namespace, it is listening | 14:35 |
| zw | But is looks like it tries to connect from the default eth0 interface towards the instance, not from the correct namespace | 14:36 |
| zw | Weird | 14:36 |
| Frito | tagging dougwig, johnsom, sbalukoff_ in case they can help. | 14:36 |
| *** amotoki has quit IRC | 14:38 | |
| johnsom | Zw The communication with the controller is over the non-namespace eth0. Only the tenant traffic is in the namespace. | 14:38 |
| johnsom | zw It is normal to see some warnings about connecting to the amphora. Typically the vm takes a while to boot. 30 seconds with nested virtualization, 8-10 minutes without nested virt (virtualbox for example) | 14:41 |
| johnsom | zw Also note DVR has a nasty bug where floating IPs don't work right. | 14:41 |
| openstackgerrit | Elena Ezhova proposed openstack/neutron-lbaas: Set up hooks for the functional job and add test_migrations test https://review.openstack.org/320999 | 14:42 |
| johnsom | But that won't stop creating an lb, etc | 14:42 |
| zw | johnsom: Well, the instace is already booted for 4 hours :) | 14:43 |
| *** yamamoto has joined #openstack-lbaas | 14:43 | |
| *** armax has joined #openstack-lbaas | 14:43 | |
| zw | So there must be something wrong :) That DVR bug, is that in mitaka also? | 14:43 |
| johnsom | Yes, last I checked it has not yet been fixed in newton either | 14:44 |
| zw | johnsom do you have a link to that bug report for me please? | 14:45 |
| zw | Thanks already for responding to my question | 14:45 |
| zw | johnsom: about octavia, "controller" = the instance running haproxy? | 14:46 |
| *** amotoki has joined #openstack-lbaas | 14:46 | |
| johnsom | Sure. If you can ssh into the amp, check the agent log, /var/log/upstart/amphora-agent.log | 14:46 |
| zw | Nevermind, you mean the communication between controller->amphorae instance | 14:46 |
| zw | let me see | 14:47 |
| johnsom | Controller == the controller worker process | 14:47 |
| johnsom | zw This is the bug: https://bugs.launchpad.net/neutron/+bug/1583694 | 14:50 |
| openstack | Launchpad bug 1583694 in neutron "[RFE] DVR support for Allowed_address_pair port that are bound to multiple ACTIVE VM ports" [Wishlist,In progress] - Assigned to Swaminathan Vasudevan (swaminathan-vasudevan) | 14:50 |
| zw | johnsom: 2016-06-29 14:50:47.488 1377 ERROR octavia.amphorae.backends.health_daemon.health_sender [-] No controller address found. Unable to send heartbeat | 14:51 |
| *** TrevorV has joined #openstack-lbaas | 14:51 | |
| johnsom | zw Ok, that is a configuration file error, but should not impact the ability to create an amphora | 14:51 |
| *** evgenyf has quit IRC | 14:52 | |
| johnsom | ihrachys We are rebooting the docs: https://bugs.launchpad.net/octavia/+bugs?field.tag=docs | 14:53 |
| zw | Indeed, but it does not get in the correct provision status | 14:53 |
| zw | It stays on Error | 14:53 |
| zw | But it is booted and so on | 14:53 |
| ihrachys | johnsom: the list is very promising! | 14:54 |
| *** anilvenkata has joined #openstack-lbaas | 14:55 | |
| zw | johnsom: I'm on the instance, can't really see something wrong, maybe ssl is the issue | 14:58 |
| zw | request url https://192.168.246.10:9443/0.5/plug/vip/192.168.1.97 request /opt/osp/mitaka/octavia/octavia/amphorae/drivers/haproxy/rest_api_driver.py:221 | 14:58 |
| zw | 192.168.246.10 is the instance I'm logged into | 14:58 |
| ihrachys | johnsom: is this bug the right one to include coverage for LB upgrade? https://bugs.launchpad.net/octavia/+bug/1558378 | 14:59 |
| openstack | Launchpad bug 1558378 in octavia "Docs: Octavia operator maintenance guide needed" [High,New] | 14:59 |
| *** piet has joined #openstack-lbaas | 15:00 | |
| ihrachys | johnsom: remember we talked at the last summit about octavia amphora upgrades? you were mentioning there is some mechanism in the work to upgrade with a quick-failover. is it ready to try? | 15:04 |
| ihrachys | back then I was also mentioning the approach with using FIPs to switch between old and new versions of a LB. I wonder if that approach could find its place in the official docs in addition to failover based approach. | 15:05 |
| *** jsheeren has joined #openstack-lbaas | 15:08 | |
| *** sputnik13 has quit IRC | 15:09 | |
| *** gongysh has quit IRC | 15:09 | |
| *** daneyon has joined #openstack-lbaas | 15:11 | |
| *** tesseract- has quit IRC | 15:12 | |
| johnsom | ihrachys Yes, you can use active/standby topology and do rolling upgrades of the amphora | 15:13 |
| johnsom | It would go in that guide. | 15:13 |
| johnsom | FIPs typically update too slowly to be of much use | 15:14 |
| ihrachys | johnsom: that assumes HA. is it a reasonable limitation? | 15:14 |
| johnsom | Well, the process still works in non-act/stndby mode, but the user will incur up to 30 seconds of outage | 15:14 |
| *** rcernin has quit IRC | 15:14 | |
| ihrachys | johnsom: not sure I follow an issue with FIPs. the idea is to start a clone of the old LB (using the new image), then once it's all ready to process requests, flip the FIP switch to using the new clone; after that deprovision the old LB. | 15:15 |
| johnsom | Yeah, but updating the backend to a FIP via neutron is a slow process | 15:15 |
| ihrachys | no need to update backend, the FIP points to VIP | 15:15 |
| johnsom | It is also essentially the same as the failover scenario I just mentioned, which incurs outage | 15:16 |
| ihrachys | nothing changes for amphora, it handles whatever router sends its direction | 15:16 |
| *** piet has quit IRC | 15:16 | |
| johnsom | Yes, that is what I meant by backend, the VIP the FIP points to | 15:16 |
| ihrachys | so what's the deal with the downtime then? I may not follow the exact concern. | 15:16 |
| johnsom | No need to update the amphora member list | 15:16 |
| *** catintheroof has joined #openstack-lbaas | 15:16 | |
| *** pcaruana has quit IRC | 15:17 | |
| ihrachys | there is no member list involved, it's a completely new LB resource | 15:17 |
| ihrachys | that by chance serves the same members | 15:17 |
| openstackgerrit | Bernard Cafarelli proposed openstack/octavia: Add nogroup in RHEL based images https://review.openstack.org/335556 | 15:17 |
| johnsom | If you aren't running act/standby you are not syncing the flows. Updating the FIP to point to a different VIP or doing a failover, both cause an outage window to the flows through the load balancer | 15:18 |
| ihrachys | johnsom: at least for new flows there is no extended downtime. right? | 15:20 |
| *** bana_k has joined #openstack-lbaas | 15:20 | |
| johnsom | Well, they would be rejected for a period of time | 15:21 |
| ihrachys | johnsom: not if the clone is ready to process new flows. also, with the clone approach, you have LB that has not degraded to single node on failover. | 15:22 |
| johnsom | I assume the FIP would fail connections while it is updating | 15:22 |
| ihrachys | johnsom: not really, updating FIP will be atomic, it will immediately redirect traffic to the clone | 15:22 |
| ihrachys | we handle FIPs with iptables, and afaik it's atomic using iptables-save | 15:23 |
| openstackgerrit | Elena Ezhova proposed openstack/neutron-lbaas: Set up hooks for the functional job and add test_migrations test https://review.openstack.org/320999 | 15:24 |
| *** somerville32 has joined #openstack-lbaas | 15:26 | |
| nmagnezi | johnsom, hi :) sent a mail about the meeting today. re: https://review.openstack.org/#/c/331841/ | 15:27 |
| johnsom | nmagnezi Hmm, I'm not seeing the e-mail. What was the subject? | 15:30 |
| *** rcernin has joined #openstack-lbaas | 15:30 | |
| *** amotoki has quit IRC | 15:31 | |
| *** sputnik13 has joined #openstack-lbaas | 15:31 | |
| *** somerville32 has quit IRC | 15:31 | |
| *** pcaruana has joined #openstack-lbaas | 15:32 | |
| johnsom | Ah, just got it | 15:32 |
| *** nmagnezi has quit IRC | 15:33 | |
| *** saju_m has quit IRC | 15:34 | |
| ihrachys | johnsom: how should I proceed with the FIP idea? maybe discussing its merit on mailing list, and if we agree there is some value in it in addition to failover approach, we can include that into official docs? or you think it's dead end? | 15:36 |
| *** eezhova has quit IRC | 15:36 | |
| *** eezhova has joined #openstack-lbaas | 15:36 | |
| johnsom | ihrachys Mailing list sounds like a good idea. I don't think it's a dead end, but I am also not convinced we have all of the details figured out. | 15:38 |
| ihrachys | johnsom: ok, I will craft something hopefully today. | 15:39 |
| johnsom | nmagnezi - Agenda for today: https://wiki.openstack.org/wiki/Octavia/Weekly_Meeting_Agenda#Meeting_2016-06-29 | 15:44 |
| *** piet has joined #openstack-lbaas | 15:45 | |
| *** amotoki has joined #openstack-lbaas | 15:45 | |
| *** sputnik13 has quit IRC | 15:45 | |
| *** svinota has quit IRC | 15:45 | |
| *** gongysh has joined #openstack-lbaas | 15:46 | |
| *** somerville32 has joined #openstack-lbaas | 15:54 | |
| *** diogogmt has joined #openstack-lbaas | 15:55 | |
| openstackgerrit | Elena Ezhova proposed openstack/neutron-lbaas: Set up hooks for the functional job and add test_migrations test https://review.openstack.org/320999 | 15:58 |
| *** amotoki has quit IRC | 15:59 | |
| *** _ducttape_ has joined #openstack-lbaas | 16:00 | |
| *** ducttape_ has quit IRC | 16:03 | |
| *** gongysh has quit IRC | 16:07 | |
| *** ajmiller has quit IRC | 16:09 | |
| *** ajmiller has joined #openstack-lbaas | 16:09 | |
| ihrachys | johnsom: fyi I sent http://lists.openstack.org/pipermail/openstack-dev/2016-June/098471.html I won't be able to join the meeting today in case you would like to discuss it there in more details, but I will read logs tomorrow. | 16:15 |
| *** HenryG has quit IRC | 16:16 | |
| *** HenryG has joined #openstack-lbaas | 16:16 | |
| *** _ducttape_ has quit IRC | 16:20 | |
| *** piet has quit IRC | 16:21 | |
| johnsom | ihrachys Thanks! | 16:21 |
| *** ducttape_ has joined #openstack-lbaas | 16:23 | |
| *** ihrachys has quit IRC | 16:27 | |
| *** dmk0202 has quit IRC | 16:31 | |
| *** piet has joined #openstack-lbaas | 16:35 | |
| *** bana_k has quit IRC | 16:36 | |
| *** pcaruana has quit IRC | 16:36 | |
| *** rudrajit has joined #openstack-lbaas | 16:36 | |
| *** rudrajit has quit IRC | 16:39 | |
| *** rudrajit has joined #openstack-lbaas | 16:40 | |
| *** rcernin has quit IRC | 16:45 | |
| *** bana_k has joined #openstack-lbaas | 16:47 | |
| *** rudrajit has quit IRC | 16:47 | |
| *** greghaynes has joined #openstack-lbaas | 16:47 | |
| *** kobis has joined #openstack-lbaas | 16:52 | |
| *** noshankus has quit IRC | 16:54 | |
| *** krotscheck is now known as krotscheck_vaca | 17:01 | |
| *** krotscheck_vaca is now known as krot_vaca_jul19 | 17:01 | |
| eezhova | johnsom, hi! I just hit this bug https://bugs.launchpad.net/octavia/+bug/1558934 both on stable/mitaka and master. Is it possible to re-open it or I have to file a new bug? | 17:03 |
| openstack | Launchpad bug 1558934 in octavia "Healthmonitor fails to spawn new amphora from spare pool" [Critical,Fix released] - Assigned to Michael Johnson (johnsom) | 17:03 |
| johnsom | eezhova Hmm, give me a second to read this. | 17:04 |
| johnsom | eezhova Could it be this issue: https://bugs.launchpad.net/octavia/+bug/1577963 | 17:06 |
| openstack | Launchpad bug 1577963 in octavia "Failover fails with haproxy network namespaces" [Critical,In progress] - Assigned to Michael Johnson (johnsom) | 17:06 |
| openstackgerrit | greghaynes proposed openstack/octavia: Modernize amphora-agent element https://review.openstack.org/335587 | 17:06 |
| *** saju_m has joined #openstack-lbaas | 17:06 | |
| *** kobis has quit IRC | 17:09 | |
| openstackgerrit | greghaynes proposed openstack/octavia: Use git.o.o rather than review.o.o for cloning https://review.openstack.org/335591 | 17:09 |
| eezhova | johnsom, not sure. what are the symptoms for this bug? the traces I see are just like in bug 1558934 description on stable/mitaka and like in Kevin's comment on master | 17:10 |
| openstack | bug 1558934 in octavia "Healthmonitor fails to spawn new amphora from spare pool" [Critical,Fix released] https://launchpad.net/bugs/1558934 - Assigned to Michael Johnson (johnsom) | 17:10 |
| greghaynes | quick question - do you all have some type of gating test which builds amphorae images? | 17:10 |
| greghaynes | and actually tests the image creation? | 17:10 |
| johnsom | greghaynes The scenario test builds an image | 17:10 |
| greghaynes | awesome. Does it run the image at all or just build? | 17:11 |
| johnsom | greghaynes It runs it | 17:11 |
| greghaynes | I'm wondering how careful I have to be with these dib cleanup patches | 17:11 |
| greghaynes | nice! | 17:11 |
| johnsom | careful == good. The scenario tests are a bit light at the moment since the gates struggle to boot nested VMs | 17:12 |
| greghaynes | Yea, we have simlar issues in dib ;) | 17:12 |
| johnsom | eezhova So, you are seeing "Unrecognized attribute(s) 'dns_name'" in the log? The other issue, with failover and namespace driver is that after an amphora failover, the network interfaces are not coming up reliably. | 17:13 |
| johnsom | greghaynes Thanks for helping us out with our DIB elements BTW! | 17:14 |
| *** dmk0202 has joined #openstack-lbaas | 17:16 | |
| greghaynes | NP | 17:16 |
| greghaynes | I had no idea you all used dib | 17:17 |
| greghaynes | theres a lot of stuff you all fixed that i'd like to fix in DIB proper so you all don't have to carry the code | 17:17 |
| johnsom | Sounds great. Yeah, I think we are one of the few projects that include gates that run DIB. | 17:18 |
| *** piet has quit IRC | 17:19 | |
| greghaynes | Theres a few who are just starting to and it seems like everyone is running in to the same issues | 17:19 |
| openstackgerrit | greghaynes proposed openstack/octavia: Use git.o.o rather than review.o.o for cloning https://review.openstack.org/335591 | 17:19 |
| openstackgerrit | greghaynes proposed openstack/octavia: Condense amphora-agent-ubuntu in to amphora-agent https://review.openstack.org/335596 | 17:19 |
| greghaynes | trove is the other big one | 17:19 |
| *** sbalukoff_ has quit IRC | 17:21 | |
| eezhova | johnsom, yes, I see "Unrecognized attribute(s) 'dns_name'". As for the second, there is no amphora-haproxy namespase on a failover node | 17:21 |
| *** svinota has joined #openstack-lbaas | 17:26 | |
| eezhova | johnsom, As for dns_name problem I think we can just check if dns-integration extension is enabled before calling port_update here https://github.com/openstack/octavia/blob/master/octavia/network/drivers/neutron/allowed_address_pairs.py#L436-L438 | 17:31 |
| johnsom | eezhova Hmmm, ok. Let's open a new bug to track this issue. | 17:31 |
| eezhova | johnsom, Ok, I will file a new bug | 17:32 |
| *** rudrajit has joined #openstack-lbaas | 17:32 | |
| johnsom | Thanks. Yeah, checking for the extension might be the right answer | 17:33 |
| *** kevo has joined #openstack-lbaas | 17:38 | |
| *** piet has joined #openstack-lbaas | 17:38 | |
| *** rcernin has joined #openstack-lbaas | 17:44 | |
| *** anilvenkata has quit IRC | 17:44 | |
| eezhova | johnsom, Here: https://bugs.launchpad.net/octavia/+bug/1597451 | 17:46 |
| openstack | Launchpad bug 1597451 in octavia "Failover to an amphora from a spares pool fails" [Undecided,New] | 17:46 |
| openstackgerrit | greghaynes proposed openstack/octavia: Merge haproxy-octavia-ubuntu into haproxy-octavia https://review.openstack.org/335603 | 17:47 |
| johnsom | eezhova Thanks! | 17:47 |
| *** eezhova has quit IRC | 17:50 | |
| *** chlong has quit IRC | 17:52 | |
| *** permalac has quit IRC | 17:57 | |
| *** _ducttape_ has joined #openstack-lbaas | 17:57 | |
| *** ducttape_ has quit IRC | 18:00 | |
| *** cody-somerville has joined #openstack-lbaas | 18:04 | |
| *** csomerville has joined #openstack-lbaas | 18:05 | |
| *** somerville32 has quit IRC | 18:07 | |
| *** yamamoto has quit IRC | 18:07 | |
| *** cody-somerville has quit IRC | 18:08 | |
| *** saju_m has quit IRC | 18:17 | |
| *** saju_m has joined #openstack-lbaas | 18:18 | |
| *** ajmiller has quit IRC | 18:22 | |
| *** ajmiller has joined #openstack-lbaas | 18:22 | |
| *** alhu has joined #openstack-lbaas | 18:29 | |
| *** dmk0202 has quit IRC | 18:32 | |
| *** dmk0202 has joined #openstack-lbaas | 18:34 | |
| *** dmk0202 has quit IRC | 18:37 | |
| *** csomerville has quit IRC | 18:39 | |
| *** amotoki has joined #openstack-lbaas | 18:41 | |
| *** csomerville has joined #openstack-lbaas | 18:42 | |
| *** _ducttape_ has quit IRC | 18:45 | |
| *** ducttape_ has joined #openstack-lbaas | 18:46 | |
| *** amotoki has quit IRC | 18:47 | |
| *** sbalukoff has joined #openstack-lbaas | 18:47 | |
| *** nmagnezi has joined #openstack-lbaas | 18:55 | |
| *** ajmiller has quit IRC | 18:56 | |
| *** ajmiller has joined #openstack-lbaas | 18:56 | |
| nmagnezi | johnsom, hi | 19:01 |
| nmagnezi | johnsom, meeting is now? | 19:02 |
| johnsom | nmagnezi It starts in an hour | 19:04 |
| nmagnezi | johnsom, oh, my bad | 19:04 |
| johnsom | It's at 20:00 UTC time | 19:04 |
| nmagnezi | johnsom, got the timezone diff wrong | 19:04 |
| nmagnezi | johnsom, ack | 19:04 |
| *** yamamoto has joined #openstack-lbaas | 19:08 | |
| *** yamamoto has quit IRC | 19:19 | |
| *** ihrachys has joined #openstack-lbaas | 19:25 | |
| *** csomerville has quit IRC | 19:25 | |
| *** Guest51388 has joined #openstack-lbaas | 19:30 | |
| *** ajmiller has quit IRC | 19:31 | |
| *** ajmiller has joined #openstack-lbaas | 19:32 | |
| jsheeren | hi everyone, i have a question about the octavia health manager listen port | 19:32 |
| jsheeren | i'm following https://github.com/openstack/octavia/blob/master/devstack/plugin.sh#L141 for reference | 19:33 |
| jsheeren | we create port in neutron and attach it on the br-int | 19:33 |
| jsheeren | this is ok if we only have one controller. we have 3 controllers | 19:33 |
| jsheeren | is it ok if i create an octavia health manager listen port on each controller? i assume this would not be an issue? | 19:34 |
| jsheeren | am i correct? | 19:34 |
| *** csomerville has joined #openstack-lbaas | 19:34 | |
| rm_work | i have no idea if multi-controller is actually *working* at the moment | 19:35 |
| rm_work | i can't think of exactly what would break, but i don't think we've specifically tested it | 19:35 |
| rm_work | and i remember there being discussion of it being a concern | 19:35 |
| jsheeren | ah | 19:35 |
| jsheeren | do you remember anything specific on that concern? i'm curious :-) | 19:36 |
| *** piet has quit IRC | 19:38 | |
| sbalukoff | I'm not sure that existing amphorae would fail-over to a different IP presently. However, it's possible to write your own method for taking over a VRRP IP that the health monitor would bind to. | 19:40 |
| sbalukoff | I'm not sure anyone has contributed code to do this at this point, yet, though. | 19:40 |
| sbalukoff | (It would be handy to have, if you feel like tackling that problem.) | 19:41 |
| *** catintheroof has quit IRC | 19:43 | |
| jsheeren | :-) i would like to, but my python coding skills are a little on the low end of the curve unfortunately | 19:43 |
| jsheeren | hmz, we are using neutron dvr, wouldn't the necessary namespaces be recreated by neutron when a controller goes out? | 19:45 |
| jsheeren | and if we have a octavia health listening port active on the controller, it should work in theory? | 19:47 |
| *** piet has joined #openstack-lbaas | 19:49 | |
| *** perelman has joined #openstack-lbaas | 19:53 | |
| *** eezhova_ has joined #openstack-lbaas | 19:57 | |
| johnsom | jsheeren Multi-controller should work fine. There is at least one vendor shipping with three controllers | 19:59 |
| jsheeren | johnsom: good to hear! thx | 19:59 |
| jsheeren | is the fact that we're using neutron dvr an issue? | 20:00 |
| johnsom | DVR has a bug with floating IPs | 20:00 |
| jsheeren | this one? https://bugs.launchpad.net/neutron/+bug/1583694 | 20:02 |
| openstack | Launchpad bug 1583694 in neutron "[RFE] DVR support for Allowed_address_pair port that are bound to multiple ACTIVE VM ports" [Wishlist,In progress] - Assigned to Swaminathan Vasudevan (swaminathan-vasudevan) | 20:02 |
| *** amotoki has joined #openstack-lbaas | 20:02 | |
| johnsom | Yes | 20:04 |
| *** Frito has quit IRC | 20:05 | |
| *** kobis has joined #openstack-lbaas | 20:06 | |
| *** amotoki has quit IRC | 20:06 | |
| *** Frito has joined #openstack-lbaas | 20:07 | |
| jsheeren | johnsom: isn't this only the case when using active/standby amphorae? is it an issue when providing single amphora? | 20:09 |
| johnsom | Yes, it impacts single amphora topology deploys as well | 20:10 |
| jsheeren | ok | 20:11 |
| *** ajmiller_ has joined #openstack-lbaas | 20:23 | |
| *** ajmiller has quit IRC | 20:25 | |
| *** kobis has quit IRC | 20:25 | |
| jsheeren | johnsom: do i need to create an octavia health manager port on each node that has router namespaces (with dvr, controllers and compute)? | 20:27 |
| *** _ducttape_ has joined #openstack-lbaas | 20:32 | |
| *** ducttape_ has quit IRC | 20:34 | |
| johnsom | jsheeren Just the ones with the octavia health manager process on them | 20:35 |
| *** rudrajit_ has joined #openstack-lbaas | 20:35 | |
| jsheeren | johnsom: thanks | 20:35 |
| *** rudrajit has quit IRC | 20:38 | |
| *** piet has quit IRC | 20:44 | |
| *** _ducttape_ has quit IRC | 20:50 | |
| *** ducttape_ has joined #openstack-lbaas | 20:50 | |
| *** ajmiller_ has quit IRC | 20:51 | |
| *** dmk0202 has joined #openstack-lbaas | 20:54 | |
| *** _ducttape_ has joined #openstack-lbaas | 20:59 | |
| *** ducttape_ has quit IRC | 21:02 | |
| *** TrevorV has quit IRC | 21:04 | |
| *** nmagnezi has quit IRC | 21:09 | |
| *** _ducttape_ has quit IRC | 21:14 | |
| *** Frito has quit IRC | 21:14 | |
| *** ducttape_ has joined #openstack-lbaas | 21:14 | |
| *** eezhova_ has quit IRC | 21:15 | |
| greghaynes | Hey, does anyone know the patch Adam is referring to here? https://review.openstack.org/#/c/335591/2 | 21:18 |
| greghaynes | Or Adam's nick, for that matter? :) | 21:19 |
| blogan | greghaynes: rm_work is his nick | 21:19 |
| greghaynes | blogan: ah, ty | 21:20 |
| blogan | greghaynes: and he's talking about what we just talked about in our meeting | 21:20 |
| greghaynes | rm_work: Hey, gerrit fails at showing a reply to a -2 so I just wanted to poke you :) | 21:20 |
| blogan | greghaynes: no patch yet that i know, just a decision to be made | 21:20 |
| greghaynes | ah, maybe Ill find a log | 21:20 |
| blogan | sorry a decision made, but a review shortly we can assume | 21:20 |
| greghaynes | but FWIW, infra really hates when people use review.o.o | 21:21 |
| greghaynes | for git clone | 21:21 |
| johnsom | https://review.openstack.org/#/c/317756/2/elements/amphora-agent-ubuntu/extra-data.d/50-copy_local_source_files | 21:21 |
| blogan | greghaynes: yeah dougwig just told us that in the meeting :) | 21:21 |
| johnsom | greghaynes That was what Adam mentioned in the meeting today | 21:21 |
| greghaynes | gotcha | 21:21 |
| johnsom | I think it is WIP | 21:22 |
| *** amotoki has joined #openstack-lbaas | 21:22 | |
| greghaynes | I can find the meeting logs and try and catch up | 21:22 |
| johnsom | http://eavesdrop.openstack.org/meetings/octavia/2016/octavia.2016-06-29-20.00.log.html | 21:23 |
| greghaynes | Thanks! | 21:23 |
| johnsom | Happened to have that handy | 21:23 |
| rm_work | greghaynes: one sec, it's going up NOW | 21:25 |
| greghaynes | oh hey, there was some convo about using an amphora container | 21:26 |
| rm_work | greghaynes: the update was in a combo patch | 21:26 |
| greghaynes | neat thing about that - you can make containers with DIB | 21:26 |
| rm_work | splitting it out | 21:26 |
| greghaynes | so you should be able to just use the same elements and tell dib to output a container | 21:26 |
| rm_work | and would be uploaded but my firewall is being dumb | 21:26 |
| johnsom | Yeah, we have the flag for the docker thing. | 21:26 |
| *** amotoki has quit IRC | 21:26 | |
| greghaynes | johnsom: ok, awesome | 21:26 |
| greghaynes | johnsom: its not used a ton but if you all hit issues its something I am really interested in making sure works | 21:27 |
| johnsom | I haven't looked at it or tried it in a very long time, but it's there | 21:27 |
| greghaynes | so just let me know | 21:27 |
| johnsom | Cool, thanks! | 21:27 |
| greghaynes | rm_work: What I am mostly wondering is - what are you switching to instead of git? | 21:27 |
| rm_work | greghaynes: local filesystem | 21:27 |
| rm_work | greghaynes: just copying the files *from the current review* | 21:27 |
| rm_work | which is actually the reason | 21:28 |
| johnsom | I think the proposal is to copy the already cloned repo into the amp | 21:28 |
| rm_work | using git that way is a but | 21:28 |
| rm_work | *bug | 21:28 |
| greghaynes | oh, so, thats the whole point of source-repositories | 21:28 |
| rm_work | it means changes to the amp agent are never actually tested in the current review | 21:28 |
| greghaynes | you dont have to edit that file, its just a default - as a user you can override where it hits to get that data | 21:28 |
| greghaynes | so you can just export DIB_REPOREF_amphora=zuul_ref | 21:28 |
| rm_work | ok, do you want to just update your patch to do cause that to happen? | 21:29 |
| rm_work | that'd be easier than what I was doing | 21:29 |
| *** saju_m has quit IRC | 21:29 | |
| rm_work | (very slightly) | 21:29 |
| greghaynes | well, I think you want to keep the code the way it is and then in your CI job definitions export that var | 21:29 |
| rm_work | ok, the alternative is what i am TRYING to submit but my VPN is blocking me | 21:30 |
| *** daneyon has quit IRC | 21:30 | |
| blogan | greghaynes: so if DIB_REPOREF_amphora isn't set then it'll use that value in that file? | 21:31 |
| greghaynes | blogan: yep | 21:31 |
| blogan | greghaynes: ah good to know! | 21:31 |
| greghaynes | Check out http://docs.openstack.org/developer/diskimage-builder/elements/source-repositories/README.html for the varios vars you can set | 21:31 |
| blogan | so we can set that to just a local path and it works? | 21:31 |
| greghaynes | for that youll want to set DIB_REPOLOCATION_amphora=/path | 21:31 |
| rm_work | ok, my solution is probably not as good then | 21:32 |
| rm_work | i was doing actual copying | 21:32 |
| rm_work | i'll submit it anyway | 21:32 |
| rm_work | but can -2 in favor of the other approach | 21:33 |
| openstackgerrit | Adam Harwell proposed openstack/octavia: [WIP] Use amphora-agent code from the current review https://review.openstack.org/335675 | 21:33 |
| rm_work | ^^ that | 21:33 |
| rm_work | is much more effort than what you describe, if it works automatically with that variable set :P | 21:33 |
| greghaynes | rm_work: ok, Ill have a look | 21:33 |
| greghaynes | yea | 21:33 |
| greghaynes | the source-repositories stuff isnt obvious but once you grok what its doing it can be pretty powerful | 21:34 |
| greghaynes | rm_work: the other concern I have is we should still change the default git location to git.o.o | 21:34 |
| blogan | greghaynes: ah REPOREF is just the branch/reference | 21:34 |
| rm_work | greghaynes: oh, we can't change the source-repo to the local filesystem? | 21:34 |
| greghaynes | blogan: yep | 21:34 |
| rm_work | there's really zero point to using git | 21:34 |
| rm_work | or rather, pulling the files again | 21:35 |
| rm_work | in fact in that case, i'd rather do my method | 21:35 |
| greghaynes | rm_work: I dont think you want to - by having git be the default the element will work on its own rather than relying on local state | 21:35 |
| rm_work | because it will work for testing | 21:35 |
| rm_work | we WANT local state | 21:35 |
| rm_work | at least, I do | 21:35 |
| greghaynes | in some cases, only in testing | 21:35 |
| rm_work | well | 21:35 |
| greghaynes | so for those cases you override | 21:35 |
| rm_work | hmm | 21:35 |
| rm_work | i was going to say "this is for devstack" | 21:35 |
| rm_work | but i guess it's theoretically for real images too | 21:35 |
| greghaynes | yep | 21:35 |
| rm_work | i dunno | 21:36 |
| rm_work | i'm a little bit on the fence | 21:36 |
| blogan | the devstack script can possibly override that no? | 21:36 |
| greghaynes | yes, it can | 21:36 |
| rm_work | ok | 21:36 |
| greghaynes | this is how tripleo and other dib users do it | 21:36 |
| greghaynes | since they have the same exact issue | 21:36 |
| rm_work | so the devstack script can override it to point to the local-fs git? | 21:37 |
| greghaynes | yep | 21:37 |
| rm_work | k | 21:37 |
| *** alhu has quit IRC | 21:37 | |
| greghaynes | all you ahve to do is export that var before you run the image build | 21:37 |
| *** alhu has joined #openstack-lbaas | 21:37 | |
| rm_work | ok, so we can do that in... | 21:37 |
| blogan | greghaynes: but will it recognize just a local fs path? or does it need to be an actual git repo? | 21:37 |
| greghaynes | blogan: it can do both | 21:38 |
| blogan | greghaynes: awesome | 21:38 |
| greghaynes | blogan: will the local fs path not be a git repo too? | 21:38 |
| rm_work | DIB_REPOREF_amphora is for ref, DIB_REPOLOCATION_amphora is for local | 21:38 |
| rm_work | AFAIU | 21:38 |
| blogan | rm_work: no they can be used both for remote | 21:38 |
| blogan | ref is like stable/mitaka, location is git url | 21:38 |
| blogan | or in our case the local path | 21:39 |
| greghaynes | yea, so unless there is something I am missing - the typical way to do this is only export DIB_REPOREF_amphora=zuuul_ref | 21:39 |
| blogan | greghaynes: it will be, but won't that mean it'll clone it again locally? | 21:39 |
| greghaynes | blogan: oh, no, itll run a clone from there in to the image | 21:39 |
| blogan | greghaynes: what is the zuul_ref usually pointing to? | 21:39 |
| *** matt-borland has quit IRC | 21:40 | |
| greghaynes | blogan: that identifies a ref in the git repo which is where zuul stores the current change being tested | 21:40 |
| blogan | greghaynes: ah okay | 21:40 |
| greghaynes | basically, if you do it that way you dont even need to clone locally first - itll just grab the current change being tested directly from zuul | 21:40 |
| blogan | sounds like the way to go to me | 21:40 |
| *** ducttape_ has quit IRC | 21:41 | |
| *** ducttape_ has joined #openstack-lbaas | 21:42 | |
| *** saju_m has joined #openstack-lbaas | 21:42 | |
| greghaynes | I think this can even live in the element, actually. Let me try and work up a patch real wuick | 21:42 |
| greghaynes | s/wuick/quick | 21:42 |
| blogan | greghaynes: won't that be a problem if people are trying to build it independently? | 21:43 |
| blogan | like say i just wanted to build the image locally | 21:43 |
| greghaynes | blogan: We can have it check the env var that zuul sets and only set the zuul ref if that var is set | 21:43 |
| greghaynes | so if zuul isnt running the build then it shouldnt do anything different | 21:44 |
| johnsom | It has to be "DIB_REPOREF_amphora-agent" BTW as that is what we "named" the element in the svc-map. I think.... | 21:44 |
| greghaynes | johnsom: ah, ty | 21:44 |
| blogan | greghaynes: sounds like that more belongs in the devstack/plugin.sh script than in the element | 21:44 |
| blogan | johnsom: yes thats how its named | 21:44 |
| greghaynes | blogan: yea, that works for me too | 21:44 |
| *** ducttape_ has quit IRC | 21:44 | |
| rm_work | greghaynes: i am fighting serious internal fires at the moment so can't focus on this for like ... at least an hour | 21:44 |
| rm_work | greghaynes: are you just "doing it"? | 21:44 |
| blogan | rm_work: just change your -2 | 21:44 |
| *** ducttape_ has joined #openstack-lbaas | 21:44 | |
| rm_work | greghaynes: if so i'll just remove that -2 and abandon my thing | 21:44 |
| greghaynes | the devstack deal I don't really understand so someone else might need to do that... I can supply the line to export if someone can find where to put it ;) | 21:45 |
| blogan | greghaynes: i'm looking into it now | 21:45 |
| greghaynes | ok | 21:45 |
| rm_work | switched to a -1 | 21:45 |
| greghaynes | based on http://docs.openstack.org/infra/zuul/launchers.html we need to set the reporef to ZUUL_REF, so it should just be DIB_REPOREF_amphora_agent=$ZUUL_REF | 21:47 |
| *** rudrajit has joined #openstack-lbaas | 21:47 | |
| greghaynes | (you cant have -'s in env vars so dib replaces them with _'s) | 21:47 |
| johnsom | Yeah, that is what I was going to do. It will git clone remote though | 21:47 |
| greghaynes | Yep, but itll grab the current patch under review so that should be fine | 21:48 |
| rm_work | I personally prefer local, but since that supposedly works too with a quick override, i'm fine with it | 21:49 |
| rm_work | but we should document EXPLICITLY how to make it do that | 21:49 |
| rm_work | like, line numbers or something | 21:49 |
| greghaynes | if you want to do local then youll need to jsut do DIB_REPOLOCATION_amphora_agent=/path/to/local | 21:49 |
| greghaynes | and obviously make sure the local checkout is of the correct ref | 21:50 |
| johnsom | Yeah, I would also make a note in the sources file that this is happening for the gates | 21:50 |
| rm_work | I really liked just copying, then i didn't have to constantly be committing every time i did a typo fix or something, but i guess it's not a huge deal | 21:50 |
| openstackgerrit | Brandon Logan proposed openstack/octavia: Use correct code version for amphora agent image https://review.openstack.org/335680 | 21:51 |
| *** rudrajit_ has quit IRC | 21:51 | |
| blogan | that is just a first stab at it, i may have totally missed it | 21:51 |
| rm_work | ah we're not just sticking it all in one patch? | 21:51 |
| rm_work | probably they shouldn't both be $ZUUL_REF | 21:51 |
| rm_work | because ... ... | 21:51 |
| rm_work | yeah | 21:51 |
| blogan | oh good point lol | 21:52 |
| greghaynes | blogan: commented | 21:52 |
| blogan | im dumb | 21:52 |
| johnsom | Yeah, that doesn't look right. | 21:52 |
| rm_work | lol | 21:52 |
| blogan | my brain is fried today | 21:52 |
| rm_work | ok if we're doing this as separate patches, we may as well merge your other one | 21:52 |
| openstackgerrit | Brandon Logan proposed openstack/octavia: Use correct code version for amphora agent image https://review.openstack.org/335680 | 21:52 |
| greghaynes | rm_work: for local dev I just export the DIB_REPOLOCATION_...=/my/repo | 21:52 |
| blogan | rm_work: thats why i +2'ed it | 21:53 |
| greghaynes | rm_work: and then dev that way | 21:53 |
| blogan | makes sense as separate patches | 21:53 |
| *** diogogmt has quit IRC | 21:53 | |
| rm_work | fine by me, as long as the end result is that this works :P | 21:53 |
| blogan | it fixes everything | 21:54 |
| blogan | all bugs, features requested, etc | 21:54 |
| rm_work | *everything* | 21:54 |
| *** rcernin has quit IRC | 21:54 | |
| greghaynes | Yea, this whole system was made because when we were doing tripleo we had this exact problem and wanted an easier way to deal with it | 21:54 |
| greghaynes | e.g. I want to dev on nova locally and build an image with it | 21:54 |
| blogan | greghaynes: i'm not sure if i'm glad that we're running into teh same issues yall solved a long time ago, or sad | 21:55 |
| greghaynes | heh | 21:55 |
| greghaynes | It just means we should have better docs I think | 21:55 |
| blogan | well the ZUUL_REF i didn't see in teh docs | 21:55 |
| blogan | but that kind of stuff is just hard to doc | 21:55 |
| greghaynes | Yea, that is infra dark magic | 21:55 |
| blogan | infra and dark magic are synonymous | 21:56 |
| blogan | i'm going to set that DIB_REPOLOCATION_amphora_agent in my bashrc so that i'll never have to deal with that again, and also never remember | 21:57 |
| greghaynes | hah | 21:57 |
| *** piet has joined #openstack-lbaas | 21:57 | |
| johnsom | Yeah, I just added it to my notes | 21:58 |
| blogan | greghaynes: thanks for hitting us with some knowledge | 21:58 |
| blogan | most productive -2 ever | 21:58 |
| greghaynes | yep, np | 21:59 |
| greghaynes | woo code review! | 21:59 |
| *** dmk0202 has quit IRC | 22:08 | |
| *** ihrachys has quit IRC | 22:08 | |
| *** ducttape_ has quit IRC | 22:11 | |
| jsheeren | hi all, i'm currently seeing this in my octavia-worker log after createing a loadbalancer: WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying. | 22:15 |
| jsheeren | the amphora is booted and has an ip in the lb-net and the private net | 22:15 |
| jsheeren | this does not get through: request url https://192.168.246.11:9443/0.5/plug/vip/192.168.1.126 | 22:16 |
| *** chlong has joined #openstack-lbaas | 22:17 | |
| *** ajmiller has joined #openstack-lbaas | 22:19 | |
| jsheeren | the amphora agent is running inside the amphora and listening on port 9443 | 22:19 |
| jsheeren | the correct sec group is attached to the amphora instance | 22:20 |
| *** perelman has quit IRC | 22:21 | |
| *** rtheis has quit IRC | 22:22 | |
| *** saju_m has quit IRC | 22:23 | |
| jsheeren | how do the octavia processes contact the amphora instance? it's trying to contact the lb-net ip, to also activate the private net ip inside the amphora instance; but how can it reach the amphora instance? | 22:25 |
| jsheeren | does it use the network namespaces? | 22:26 |
| *** ajmiller has quit IRC | 22:28 | |
| *** ajmiller has joined #openstack-lbaas | 22:28 | |
| *** minwang2 has joined #openstack-lbaas | 22:34 | |
| *** saju_m has joined #openstack-lbaas | 22:36 | |
| *** minwang2 has quit IRC | 22:37 | |
| jsheeren | also a quick question about the health manager port: after attaching the neutron port to the openvswitch br-int, do i need to set an ip on the physical network for it? | 22:38 |
| *** amotoki has joined #openstack-lbaas | 22:42 | |
| *** amotoki has quit IRC | 22:47 | |
| *** Guest51388 has quit IRC | 22:55 | |
| *** diogogmt has joined #openstack-lbaas | 22:56 | |
| *** mixos has joined #openstack-lbaas | 23:07 | |
| *** csomerville has quit IRC | 23:09 | |
| *** piet has quit IRC | 23:11 | |
| *** jsheeren has left #openstack-lbaas | 23:17 | |
| *** piet has joined #openstack-lbaas | 23:18 | |
| *** saju_m has quit IRC | 23:29 | |
| *** ajmiller has quit IRC | 23:33 | |
| *** ajmiller has joined #openstack-lbaas | 23:34 | |
| *** svinota has quit IRC | 23:37 | |
| *** daneyon has joined #openstack-lbaas | 23:38 | |
| *** ajmiller has quit IRC | 23:39 | |
| *** daneyon_ has joined #openstack-lbaas | 23:39 | |
| *** ajmiller has joined #openstack-lbaas | 23:39 | |
| *** daneyon has quit IRC | 23:43 | |
| *** mixos has quit IRC | 23:54 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!