| DHE | I had something funky happen that was MTU-related since I'm using VXLAN and didn't set it up quite right initially. :) | 00:10 |
|---|---|---|
| DHE | connections would established from a TCP standpoint, but would then hang afterwards | 00:10 |
| nsmeds | DHE: yeah, MTU is something we're investigating (no luck yet though) | 00:12 |
| DHE | but is that your symptom? connection is established (netstat or whatever shows ESTABLISHED) but no data flowing? | 00:12 |
| nsmeds | i'll go double check | 00:16 |
| nsmeds | even 50% of SSH connection attempts to the instance's fail, es good times | 00:19 |
| nsmeds | well isn't that interesting - even just running `netstat` hangs briefly half the time | 00:20 |
| nsmeds | ah, probably due to DNS resolution (which fails half the time). Ok, i'll look into what you suggested | 00:22 |
| *** vexorg has quit IRC | 00:28 | |
| nsmeds | so still figuring out netstat, but here's an example. 10 dig requests for `google.ca` with 10 second timeout http://paste.openstack.org/show/740007/ | 00:40 |
| nsmeds | half succeed instantly, half time out (never get response) | 00:41 |
| *** markvoelker has joined #openstack | 00:41 | |
| *** markvoelker has quit IRC | 00:45 | |
| nsmeds | ah, so attempted to curl an IP, using netstat can see it stalls at `SYN_SENT` | 00:48 |
| nsmeds | back to googling | 00:49 |
| jenglisch | nsmeds: sounds like a duplicate ip problem to me | 00:51 |
| nsmeds | jenglisch: right. Half of replies go to wrong IP and disappear, yes? That actually seems pretty reasonable | 00:53 |
| *** vexorg has joined #openstack | 00:55 | |
| *** TheJulia is now known as needsleep | 01:09 | |
| DHE | my suggestion was going to be some kind of LACP failure. if you have 2 links and one fails in strange ways, that could explain it | 01:21 |
| DHE | but again this assumes network topology which I don't actually know about in your particular setup | 01:21 |
| *** daMaestro has joined #openstack | 01:21 | |
| nsmeds | DHE: ok, thanks. Setup as spine-and-leaf topology (two firewalls, three spines, and six leafs). Currently five compute servers, each with a connection to two leafs. Issue occurs on OS instance running on any of the five compute hosts. | 01:26 |
| nsmeds | however, the issue is only on OS instances. The actual servers running in DC don't have any connection issues. | 01:26 |
| *** dslegends has quit IRC | 01:31 | |
| *** gyee has quit IRC | 01:38 | |
| *** vexorg has quit IRC | 01:44 | |
| *** vexorg has joined #openstack | 01:45 | |
| *** bobh has joined #openstack | 01:53 | |
| *** mikecmpbll has quit IRC | 02:16 | |
| *** igordc has quit IRC | 03:17 | |
| *** macza has joined #openstack | 03:20 | |
| *** gnufied has quit IRC | 03:44 | |
| *** macza has quit IRC | 03:50 | |
| *** mmethot has quit IRC | 04:04 | |
| *** mmethot has joined #openstack | 04:05 | |
| *** markvoelker has joined #openstack | 04:17 | |
| *** markvoelker has quit IRC | 04:24 | |
| *** bobh has quit IRC | 04:36 | |
| *** sauvin has joined #openstack | 04:49 | |
| *** bobh has joined #openstack | 04:59 | |
| *** bobh has quit IRC | 05:00 | |
| *** bobh has joined #openstack | 05:01 | |
| *** bobh has quit IRC | 05:05 | |
| *** daMaestro has quit IRC | 05:08 | |
| *** bobh has joined #openstack | 05:20 | |
| *** bobh has quit IRC | 05:25 | |
| *** shyamb has joined #openstack | 05:28 | |
| *** macza has joined #openstack | 05:30 | |
| *** macza has quit IRC | 05:35 | |
| *** shyam89 has joined #openstack | 05:41 | |
| *** daniel2 has quit IRC | 05:43 | |
| *** daniel3 has joined #openstack | 05:43 | |
| *** daniel3 is now known as daniel2 | 05:45 | |
| *** shyamb has quit IRC | 05:45 | |
| *** cah_link has joined #openstack | 05:50 | |
| *** rvd has joined #openstack | 05:56 | |
| *** bobh has joined #openstack | 06:03 | |
| *** cah_link1 has joined #openstack | 06:09 | |
| *** cah_link has quit IRC | 06:10 | |
| *** cah_link1 is now known as cah_link | 06:10 | |
| *** shyam89 has quit IRC | 06:21 | |
| *** boazel_ has joined #openstack | 06:31 | |
| *** boazel has quit IRC | 06:34 | |
| *** bobh has quit IRC | 06:56 | |
| *** slaweq has quit IRC | 06:59 | |
| *** GenteelBen has joined #openstack | 07:44 | |
| *** bobh has joined #openstack | 08:05 | |
| *** slaweq has joined #openstack | 08:11 | |
| *** daniel2 has quit IRC | 08:37 | |
| *** daniel2 has joined #openstack | 08:37 | |
| *** mikecmpbll has joined #openstack | 08:44 | |
| *** jbadiapa has quit IRC | 09:07 | |
| *** macza has joined #openstack | 09:23 | |
| *** macza has quit IRC | 09:27 | |
| *** b7219264_ has joined #openstack | 09:39 | |
| *** b7219264 has quit IRC | 09:40 | |
| *** macza has joined #openstack | 09:44 | |
| *** macza has quit IRC | 09:48 | |
| *** markvoelker has joined #openstack | 09:53 | |
| *** bobh has quit IRC | 10:08 | |
| *** bobh has joined #openstack | 10:16 | |
| *** macza has joined #openstack | 10:45 | |
| *** DarkIn5an1ty has quit IRC | 10:46 | |
| *** macza has quit IRC | 10:50 | |
| *** OrigenAG has joined #openstack | 10:55 | |
| *** irdr has quit IRC | 10:56 | |
| *** irdr has joined #openstack | 11:01 | |
| *** macza has joined #openstack | 11:06 | |
| *** macza has quit IRC | 11:11 | |
| *** bobh has quit IRC | 11:19 | |
| *** e0ne has joined #openstack | 11:49 | |
| *** radeks_ has joined #openstack | 12:13 | |
| *** bobh has joined #openstack | 13:16 | |
| *** bobh has quit IRC | 13:22 | |
| *** vquicksilver has quit IRC | 13:30 | |
| *** vquicksilver has joined #openstack | 13:32 | |
| *** vquicksilver has quit IRC | 13:37 | |
| *** Son_Goku has quit IRC | 13:37 | |
| *** Son_Goku has joined #openstack | 13:41 | |
| *** e0ne has quit IRC | 14:07 | |
| *** e0ne has joined #openstack | 14:09 | |
| *** e0ne has quit IRC | 14:09 | |
| *** bobh has joined #openstack | 14:35 | |
| *** bobh has quit IRC | 14:40 | |
| *** bobh has joined #openstack | 14:53 | |
| *** Son_Goku has quit IRC | 15:26 | |
| *** Son_Goku has joined #openstack | 15:53 | |
| *** dhill_ has quit IRC | 16:10 | |
| *** dhill_ has joined #openstack | 16:11 | |
| *** bobh has quit IRC | 16:11 | |
| *** bobh has joined #openstack | 16:20 | |
| *** bobh has quit IRC | 16:25 | |
| *** gmoro has quit IRC | 16:26 | |
| *** gmoro has joined #openstack | 16:26 | |
| *** gmoro has quit IRC | 16:29 | |
| *** gmoro has joined #openstack | 16:30 | |
| *** ssbarnea|bkp2 has joined #openstack | 16:30 | |
| *** gmoro has quit IRC | 16:31 | |
| *** ssbarnea has quit IRC | 16:33 | |
| *** gmoro has joined #openstack | 16:33 | |
| *** cah_link1 has joined #openstack | 16:39 | |
| *** cah_link has quit IRC | 16:41 | |
| *** cah_link1 is now known as cah_link | 16:41 | |
| *** Son_Goku has quit IRC | 16:46 | |
| *** Acinonyx has quit IRC | 16:48 | |
| *** shibboleth has joined #openstack | 16:50 | |
| *** Son_Goku has joined #openstack | 16:59 | |
| *** e0ne has joined #openstack | 17:01 | |
| *** bobh has joined #openstack | 17:06 | |
| *** l-j has quit IRC | 17:16 | |
| *** ssbarnea|bkp2 has quit IRC | 17:23 | |
| *** ssbarnea has joined #openstack | 17:23 | |
| *** bobh has quit IRC | 17:25 | |
| *** bobh has joined #openstack | 17:26 | |
| *** dhill_ has quit IRC | 17:27 | |
| *** bobh has quit IRC | 17:41 | |
| *** dhill_ has joined #openstack | 17:44 | |
| *** Son_Goku has quit IRC | 17:47 | |
| *** Son_Goku has joined #openstack | 17:50 | |
| *** jbadiapa has joined #openstack | 18:00 | |
| *** imacdonn has quit IRC | 18:00 | |
| *** imacdonn has joined #openstack | 18:00 | |
| *** shibboleth has quit IRC | 18:01 | |
| *** shibboleth has joined #openstack | 18:01 | |
| *** bobh has joined #openstack | 18:14 | |
| *** bobh has quit IRC | 18:28 | |
| *** bobh has joined #openstack | 18:29 | |
| *** jbadiapa has quit IRC | 18:31 | |
| *** dhill_ has quit IRC | 19:00 | |
| *** mikecmpbll has quit IRC | 19:03 | |
| *** e0ne has quit IRC | 19:03 | |
| *** mikecmpbll has joined #openstack | 19:04 | |
| *** K0HAX has quit IRC | 19:15 | |
| *** K0HAX has joined #openstack | 19:15 | |
| *** bobh has quit IRC | 19:20 | |
| *** e0ne has joined #openstack | 19:21 | |
| *** GenteelBen has quit IRC | 19:22 | |
| *** dtrainor_ is now known as dtrainor | 19:33 | |
| *** e0ne has quit IRC | 19:49 | |
| *** slashd has joined #openstack | 21:01 | |
| *** Haunted330 has joined #openstack | 21:12 | |
| *** sm806 has quit IRC | 21:16 | |
| *** sm806 has joined #openstack | 21:20 | |
| *** Warped has quit IRC | 21:42 | |
| *** chrizl has quit IRC | 21:48 | |
| *** chrizl has joined #openstack | 21:50 | |
| *** sm806 has quit IRC | 21:51 | |
| *** chrizl has quit IRC | 21:59 | |
| Haunted330 | This channel is closed and will reopen tomorrow at 8am CST. | 22:00 |
| *** chrizl has joined #openstack | 22:04 | |
| Haunted330 | we're closed | 22:04 |
| *** Haunted330 has left #openstack | 22:07 | |
| *** chrizl has quit IRC | 22:09 | |
| *** dhill_ has joined #openstack | 22:10 | |
| *** shibboleth has quit IRC | 22:10 | |
| *** chrizl has joined #openstack | 22:13 | |
| *** chrizl has quit IRC | 22:18 | |
| *** chrizl has joined #openstack | 22:23 | |
| *** sm806 has joined #openstack | 22:33 | |
| *** chrizl has quit IRC | 22:41 | |
| *** chrizl has joined #openstack | 22:55 | |
| *** RedW has quit IRC | 23:03 | |
| *** RedW has joined #openstack | 23:04 | |
| *** chrizl has quit IRC | 23:04 | |
| *** chrizl has joined #openstack | 23:05 | |
| *** chrizl has quit IRC | 23:13 | |
| *** chrizl has joined #openstack | 23:18 | |
| *** chrizl has quit IRC | 23:27 | |
| *** slaweq has quit IRC | 23:36 | |
| *** chrizl has joined #openstack | 23:51 | |
| *** slaweq has joined #openstack | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!