*** VW_ has joined #openstack-operators | 00:01 | |
*** alop has quit IRC | 00:05 | |
*** geoffarnold has quit IRC | 00:08 | |
*** geoffarnold has joined #openstack-operators | 00:17 | |
*** SimonChung has quit IRC | 00:29 | |
*** stanchan has quit IRC | 00:32 | |
*** geoffarnold has quit IRC | 00:38 | |
*** saneax has quit IRC | 00:44 | |
*** markvoelker has joined #openstack-operators | 00:51 | |
*** markvoelker has quit IRC | 00:56 | |
*** mdorman has quit IRC | 01:03 | |
*** bhunter71 has joined #openstack-operators | 01:12 | |
*** gfa is now known as gfa_ | 01:36 | |
*** gfa_ is now known as gfa | 01:37 | |
*** markvoelker has joined #openstack-operators | 01:43 | |
*** markvoelker has quit IRC | 01:48 | |
*** ruagair has quit IRC | 02:48 | |
*** ruagair has joined #openstack-operators | 02:48 | |
*** hakimo has joined #openstack-operators | 02:53 | |
*** hakimo_ has quit IRC | 02:55 | |
*** markvoelker has joined #openstack-operators | 02:55 | |
*** Marga_ has joined #openstack-operators | 02:56 | |
*** Marga_ has quit IRC | 02:57 | |
*** Marga_ has joined #openstack-operators | 02:58 | |
*** pontusf has quit IRC | 03:31 | |
*** pontusf has joined #openstack-operators | 03:33 | |
*** VW_ has quit IRC | 04:00 | |
*** VW_ has joined #openstack-operators | 04:00 | |
*** VW_ has quit IRC | 04:05 | |
*** SimonChung has joined #openstack-operators | 04:19 | |
*** SimonChung1 has joined #openstack-operators | 04:20 | |
*** SimonChung has quit IRC | 04:24 | |
*** markvoelker has quit IRC | 04:26 | |
*** morgan_404 is now known as morgan_204 | 04:42 | |
*** morgan_204 is now known as morgan_206 | 04:44 | |
*** morgan_206 is now known as morgan_503 | 04:45 | |
*** bhunter71 has quit IRC | 05:00 | |
*** bvandenh has joined #openstack-operators | 05:22 | |
*** saneax has joined #openstack-operators | 05:34 | |
*** bvandenh has quit IRC | 05:38 | |
*** chlong has quit IRC | 05:41 | |
*** chlong has joined #openstack-operators | 05:44 | |
*** fawadkhaliq has joined #openstack-operators | 05:48 | |
*** fifieldt_ has quit IRC | 06:00 | |
*** chlong has quit IRC | 07:36 | |
*** matrohon has joined #openstack-operators | 07:38 | |
*** chlong has joined #openstack-operators | 07:39 | |
*** saneax has quit IRC | 07:43 | |
*** michchap has quit IRC | 08:22 | |
*** ferest has joined #openstack-operators | 08:37 | |
*** mahito has quit IRC | 08:38 | |
*** ferest has quit IRC | 08:45 | |
*** VW_ has joined #openstack-operators | 09:25 | |
*** matrohon has quit IRC | 09:29 | |
*** VW_ has quit IRC | 09:30 | |
*** matrohon has joined #openstack-operators | 10:20 | |
*** ggillies has quit IRC | 11:39 | |
*** delattec has joined #openstack-operators | 11:51 | |
*** cdelatte has quit IRC | 11:53 | |
*** delattec has quit IRC | 12:02 | |
*** delattec has joined #openstack-operators | 12:02 | |
*** markvoelker has joined #openstack-operators | 12:21 | |
*** britthouser has joined #openstack-operators | 12:33 | |
*** _nick has quit IRC | 12:33 | |
*** britthou_ has joined #openstack-operators | 12:34 | |
*** _nick has joined #openstack-operators | 12:34 | |
*** britthouser has quit IRC | 12:38 | |
*** radez is now known as radez_g0n3 | 12:48 | |
*** britthou_ has quit IRC | 12:57 | |
*** britthouser has joined #openstack-operators | 12:58 | |
*** VW_ has joined #openstack-operators | 13:00 | |
*** alaski is now known as lascii | 13:25 | |
*** fifieldt has joined #openstack-operators | 13:30 | |
*** jaypipes has joined #openstack-operators | 13:33 | |
*** jaypipes has quit IRC | 13:39 | |
*** radez_g0n3 is now known as radez | 13:41 | |
*** jaypipes has joined #openstack-operators | 13:42 | |
*** jaypipes is now known as leakypipes\ | 13:43 | |
*** jmckind has joined #openstack-operators | 13:46 | |
*** leakypipes\ is now known as leakypipes | 13:47 | |
*** jmckind has quit IRC | 13:52 | |
*** maishsk has joined #openstack-operators | 13:59 | |
*** jmckind has joined #openstack-operators | 14:02 | |
*** mdorman has joined #openstack-operators | 14:15 | |
*** chlong has quit IRC | 14:19 | |
*** fawadkhaliq has quit IRC | 14:22 | |
*** maishsk has quit IRC | 14:32 | |
*** geoffarnold has joined #openstack-operators | 14:35 | |
*** geoffarnold has quit IRC | 14:39 | |
*** geoffarnold has joined #openstack-operators | 14:41 | |
*** alejandrito has joined #openstack-operators | 14:44 | |
alejandrito | hi, we have a KILO cloud under ubuntu, after a total power off of the cloud after restarting rabbitmq, mysql databases and every service, half of the instances (on the compute nodes) dont have the tap interfaces on their XML's and the linux interfaces tap - qvo - qvbe never gets created, doing hard reboots, etc doesnt recreate the taps, someone ran into this problem ? | 14:51 |
---|---|---|
*** radez is now known as radez_g0n3 | 14:56 | |
*** radez_g0n3 is now known as radez | 15:08 | |
*** Piet has quit IRC | 15:19 | |
*** alop has joined #openstack-operators | 15:24 | |
*** laron has joined #openstack-operators | 15:33 | |
*** VW_ has quit IRC | 15:37 | |
*** VW_ has joined #openstack-operators | 15:38 | |
*** radez is now known as radez_g0n3 | 15:38 | |
*** alop has quit IRC | 15:43 | |
*** alop has joined #openstack-operators | 15:44 | |
*** matrohon has quit IRC | 16:04 | |
*** bhunter71 has joined #openstack-operators | 16:27 | |
*** Piet has joined #openstack-operators | 16:33 | |
*** gyee has joined #openstack-operators | 16:37 | |
*** david-lyle is now known as cbrown | 17:17 | |
mfisch | mdorman: you around? | 17:19 |
*** radez_g0n3 is now known as radez | 17:28 | |
*** Piet has quit IRC | 17:55 | |
*** Piet has joined #openstack-operators | 18:16 | |
*** VW_ has quit IRC | 18:20 | |
*** VW_ has joined #openstack-operators | 18:21 | |
*** fawadkhaliq has joined #openstack-operators | 18:30 | |
mdorman | mfisch: yup what’s up? | 18:41 |
mdorman | 80 minutes later | 18:41 |
mdorman | heh | 18:41 |
*** dminer has joined #openstack-operators | 18:43 | |
mfisch | mdorman: no worries I was at lunch anyway | 18:45 |
mfisch | mdorman: you've been using rabbit with haproxy for awhile now right? | 18:45 |
mdorman | we used to in our lab environments to mimic what we had in prod (rmq behing a a10 lb). but we moved away from that setup a while ago so now all the clients just connect directly via rabbimq_hosts instead of through the lb | 18:49 |
mfisch | okay, we just moved from that to the LB so we'd have an easier time with maintenance | 18:49 |
mfisch | its better than it was in kilo, nova-compute still is a piece of shit about reconnecting | 18:49 |
mfisch | some other weirdness too but sounds like you're not the right guy to discuss it with | 18:50 |
mdorman | klindgren probably has more swapped in to his brain to be able to talk intelligently about it. | 18:50 |
mdorman | but yeah my understanding is the newer oslo-messaging’s are better when you’re connecting through a LB | 18:50 |
mdorman | i mean regardless the client is going to see a reconnect | 18:51 |
mfisch | better but not perfect | 18:51 |
mfisch | nova-compute even if it reconnects randomly fails | 18:51 |
mdorman | although i guess with a real LB you can set a longer drain time and hopefully clients move organically | 18:51 |
mfisch | yeah | 18:51 |
mfisch | they dont | 18:51 |
mdorman | we haven’t really experienced that | 18:51 |
mfisch | which is what I'm wondering about | 18:51 |
mdorman | interesting | 18:51 |
mdorman | so even when things are just running normally and you’re not restarting RMQ or whatever, nova-compute loses connections? | 18:52 |
mfisch | mdorman: let me get back to you in 5 | 18:53 |
mdorman | np | 18:53 |
klindgren | yea - we moved back to list of hosts - even under 1.8.x when testing something was still not good with load blanacers. SOme error that they hand't found/fixed | 18:55 |
mdorman | possible it’s something in RMQ itself, too. we might be on a different version than you are | 18:56 |
klindgren | honestly - list of hosts for us has been much better. This is one of those do I use the thing that should make maintenance "easier"? Or do I do the thing that make maintenace "harder" but lets our cloud actually stay up wihtout restarting services all the time | 18:57 |
klindgren | we went with the later - after having nothing but problems with rabbitmq behind an lb | 18:57 |
klindgren | neutron - with the most unhelpful error messages ever: 2015-08-14 11:53:22.707 20919 INFO neutron.plugins.linuxbridge.agent.linuxbridge_neutron_agent [req-94a80bfc-709e-4e45-918a-c48f55b42fe8 ] Device tap2076ee2c-d8 not defined on plugin | 19:06 |
*** esker has quit IRC | 19:13 | |
*** fawadkhaliq has quit IRC | 19:14 | |
*** delattec has quit IRC | 19:53 | |
*** VW_ has quit IRC | 20:04 | |
*** VW_ has joined #openstack-operators | 20:04 | |
*** alejandrito has quit IRC | 20:04 | |
*** gyee has quit IRC | 21:09 | |
*** lascii is now known as alaski | 21:11 | |
*** radez is now known as radez_g0n3 | 21:11 | |
*** cbrown is now known as david-lyle | 21:20 | |
*** laron has quit IRC | 21:23 | |
*** jmckind has quit IRC | 21:32 | |
*** VW_ has quit IRC | 21:49 | |
*** VW_ has joined #openstack-operators | 21:50 | |
*** laron has joined #openstack-operators | 22:13 | |
*** markvoelker has quit IRC | 22:15 | |
*** laron has quit IRC | 22:17 | |
*** VW_ has quit IRC | 22:37 | |
*** VW_ has joined #openstack-operators | 22:37 | |
*** ToMiles has joined #openstack-operators | 22:48 | |
*** dminer has quit IRC | 22:49 | |
*** mdorman has quit IRC | 22:58 | |
*** saneax has joined #openstack-operators | 23:21 | |
*** markvoelker has joined #openstack-operators | 23:31 | |
*** markvoelker has quit IRC | 23:35 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!