*** Marga_ has joined #openstack-operators | 00:01 | |
*** Marga_ has quit IRC | 00:02 | |
*** Marga_ has joined #openstack-operators | 00:03 | |
*** Marga_ has quit IRC | 00:03 | |
*** Marga_ has joined #openstack-operators | 00:03 | |
*** stanchan has joined #openstack-operators | 00:17 | |
*** lhcheng has quit IRC | 00:42 | |
*** esker has quit IRC | 00:43 | |
*** esker has joined #openstack-operators | 00:47 | |
*** mriedem has quit IRC | 01:20 | |
*** lhcheng has joined #openstack-operators | 01:23 | |
*** lhcheng_ has joined #openstack-operators | 01:24 | |
*** lhcheng has quit IRC | 01:24 | |
*** esker has quit IRC | 01:24 | |
*** apoorvad has quit IRC | 01:35 | |
*** ducttape_ has joined #openstack-operators | 01:38 | |
*** ducttape_ has quit IRC | 01:53 | |
*** busterswt has joined #openstack-operators | 01:55 | |
*** _ducttape_ has joined #openstack-operators | 01:56 | |
*** bustersw_ has joined #openstack-operators | 01:57 | |
*** busterswt has quit IRC | 02:01 | |
*** lhcheng_ has quit IRC | 02:01 | |
*** harshs has joined #openstack-operators | 02:08 | |
*** VW has joined #openstack-operators | 02:14 | |
*** VW has quit IRC | 02:20 | |
*** VW has joined #openstack-operators | 02:20 | |
*** lhcheng has joined #openstack-operators | 02:30 | |
*** lhcheng has quit IRC | 02:30 | |
*** lhcheng has joined #openstack-operators | 02:30 | |
*** bustersw_ has quit IRC | 02:33 | |
*** harshs_ has joined #openstack-operators | 02:38 | |
*** harshs has quit IRC | 02:40 | |
*** harshs_ is now known as harshs | 02:40 | |
*** _ducttape_ has quit IRC | 03:05 | |
*** stanchan has quit IRC | 03:06 | |
*** markvoelker has quit IRC | 03:26 | |
*** esker has joined #openstack-operators | 03:34 | |
*** esker has quit IRC | 03:52 | |
*** resker has joined #openstack-operators | 03:52 | |
*** VW has quit IRC | 03:55 | |
*** esker has joined #openstack-operators | 03:57 | |
*** resker has quit IRC | 03:59 | |
*** esker has quit IRC | 04:05 | |
*** esker has joined #openstack-operators | 04:07 | |
*** markvoelker has joined #openstack-operators | 04:26 | |
*** markvoelker has quit IRC | 04:32 | |
*** armax has quit IRC | 05:01 | |
*** simon-AS559 has joined #openstack-operators | 05:20 | |
*** sekrit has quit IRC | 05:30 | |
*** Marga_ has quit IRC | 05:34 | |
*** Marga_ has joined #openstack-operators | 05:37 | |
*** Marga_ has quit IRC | 05:38 | |
*** Marga_ has joined #openstack-operators | 05:38 | |
*** bvandenh has joined #openstack-operators | 05:38 | |
*** admin0 has joined #openstack-operators | 05:41 | |
*** Marga_ has quit IRC | 05:43 | |
*** liverpooler has quit IRC | 05:44 | |
*** saneax_AFK is now known as saneax | 05:44 | |
*** admin0 has quit IRC | 05:45 | |
*** Marga_ has joined #openstack-operators | 05:52 | |
*** Marga_ has quit IRC | 05:56 | |
*** harshs has quit IRC | 05:59 | |
*** rcernin has joined #openstack-operators | 05:59 | |
*** Marga_ has joined #openstack-operators | 06:01 | |
*** fawadkhaliq has joined #openstack-operators | 06:02 | |
*** vsedelnik has quit IRC | 06:04 | |
*** lhcheng has quit IRC | 06:13 | |
*** bvandenh has quit IRC | 06:13 | |
*** vsedelnik has joined #openstack-operators | 06:14 | |
*** bvandenh has joined #openstack-operators | 06:17 | |
*** vsedelnik has quit IRC | 06:18 | |
*** fawadkhaliq has quit IRC | 06:20 | |
*** sekrit has joined #openstack-operators | 06:23 | |
*** eddima has joined #openstack-operators | 06:26 | |
*** markvoelker has joined #openstack-operators | 06:29 | |
*** belmoreira has joined #openstack-operators | 06:30 | |
*** simon-AS559 has quit IRC | 06:30 | |
*** markvoelker has quit IRC | 06:35 | |
*** simon-AS559 has joined #openstack-operators | 06:37 | |
*** lhcheng has joined #openstack-operators | 07:00 | |
*** openstackgerrit has quit IRC | 07:02 | |
*** openstackgerrit has joined #openstack-operators | 07:03 | |
*** Marga_ has quit IRC | 07:05 | |
*** liverpooler has joined #openstack-operators | 07:05 | |
*** pcaruana has joined #openstack-operators | 07:06 | |
*** rcernin has quit IRC | 07:08 | |
*** rcernin has joined #openstack-operators | 07:09 | |
*** admin0 has joined #openstack-operators | 07:09 | |
*** admin0 has quit IRC | 07:09 | |
*** admin0 has joined #openstack-operators | 07:20 | |
*** vsedelnik has joined #openstack-operators | 07:33 | |
*** vsedelnik has quit IRC | 07:33 | |
*** vsedelnik has joined #openstack-operators | 07:33 | |
*** simon-AS559 has quit IRC | 07:37 | |
*** goretoxo has joined #openstack-operators | 07:55 | |
*** admin0 has quit IRC | 08:12 | |
*** admin0 has joined #openstack-operators | 08:15 | |
*** vsedelnik has quit IRC | 08:16 | |
*** vsedelnik has joined #openstack-operators | 08:18 | |
*** simon-AS559 has joined #openstack-operators | 08:24 | |
*** simon-AS5591 has joined #openstack-operators | 08:25 | |
*** simon-AS559 has quit IRC | 08:28 | |
*** markvoelker has joined #openstack-operators | 08:30 | |
*** simon-AS559 has joined #openstack-operators | 08:34 | |
*** markvoelker has quit IRC | 08:35 | |
*** simon-AS5592 has joined #openstack-operators | 08:35 | |
*** simon-AS5591 has quit IRC | 08:36 | |
*** vsedelnik has quit IRC | 08:37 | |
*** simon-AS5591 has joined #openstack-operators | 08:37 | |
*** haukebruno has joined #openstack-operators | 08:39 | |
*** simon-AS5593 has joined #openstack-operators | 08:39 | |
*** simon-AS5593 has quit IRC | 08:39 | |
*** simon-AS559 has quit IRC | 08:39 | |
*** simon-AS5592 has quit IRC | 08:40 | |
*** vsedelnik has joined #openstack-operators | 08:41 | |
*** simon-AS5591 has quit IRC | 08:41 | |
*** vsedelnik has quit IRC | 08:42 | |
*** vsedelnik has joined #openstack-operators | 08:42 | |
*** lhcheng has quit IRC | 08:43 | |
*** simon-AS559 has joined #openstack-operators | 08:43 | |
*** derekh has joined #openstack-operators | 08:46 | |
*** electrofelix has joined #openstack-operators | 09:05 | |
*** Marga_ has joined #openstack-operators | 09:05 | |
*** Marga_ has quit IRC | 09:10 | |
*** zeih has joined #openstack-operators | 09:32 | |
*** zeih has quit IRC | 09:44 | |
*** bvandenh has quit IRC | 10:19 | |
*** markvoelker has joined #openstack-operators | 10:31 | |
*** bvandenh has joined #openstack-operators | 10:33 | |
*** markvoelker has quit IRC | 10:36 | |
*** zeih has joined #openstack-operators | 10:51 | |
*** hieulq has joined #openstack-operators | 10:52 | |
*** vsedelnik has quit IRC | 10:55 | |
*** vsedelnik has joined #openstack-operators | 10:57 | |
*** vsedelnik has quit IRC | 10:59 | |
*** zioproto has quit IRC | 11:00 | |
*** admin0_ has joined #openstack-operators | 11:04 | |
*** zioproto has joined #openstack-operators | 11:06 | |
*** admin0 has quit IRC | 11:07 | |
*** admin0_ is now known as admin0 | 11:07 | |
*** Marga_ has joined #openstack-operators | 11:15 | |
*** hieulq_ has joined #openstack-operators | 11:15 | |
*** Marga_ has quit IRC | 11:16 | |
*** Marga_ has joined #openstack-operators | 11:16 | |
*** hieulq has quit IRC | 11:17 | |
*** vsedelnik has joined #openstack-operators | 11:26 | |
*** zeih has quit IRC | 11:31 | |
*** simon-AS559 has quit IRC | 11:32 | |
*** zeih has joined #openstack-operators | 11:33 | |
*** admin0 has quit IRC | 11:36 | |
*** admin0 has joined #openstack-operators | 11:37 | |
*** simon-AS559 has joined #openstack-operators | 11:52 | |
*** busterswt has joined #openstack-operators | 11:55 | |
*** busterswt has quit IRC | 11:59 | |
*** snecklifter_ has joined #openstack-operators | 12:00 | |
*** simon-AS5591 has joined #openstack-operators | 12:03 | |
*** hieulq_ has quit IRC | 12:05 | |
*** simon-AS5592 has joined #openstack-operators | 12:06 | |
*** simon-AS559 has quit IRC | 12:06 | |
*** Marga_ has quit IRC | 12:07 | |
*** simon-AS5591 has quit IRC | 12:07 | |
*** Marga_ has joined #openstack-operators | 12:09 | |
*** markvoelker has joined #openstack-operators | 12:15 | |
*** simon-AS5592 has quit IRC | 12:31 | |
*** Marga_ has quit IRC | 12:36 | |
*** simon-AS559 has joined #openstack-operators | 12:37 | |
*** rarcea has joined #openstack-operators | 12:39 | |
*** rarcea has quit IRC | 12:43 | |
*** simon-AS559 has quit IRC | 13:00 | |
*** haukebruno has quit IRC | 13:01 | |
*** simon-AS559 has joined #openstack-operators | 13:03 | |
*** bvandenh has quit IRC | 13:04 | |
*** saneax is now known as saneax_AFK | 13:06 | |
*** simon-AS5591 has joined #openstack-operators | 13:07 | |
*** simon-AS559 has quit IRC | 13:08 | |
*** Vinsh has quit IRC | 13:16 | |
*** simon-AS5591 has quit IRC | 13:16 | |
*** mriedem has joined #openstack-operators | 13:16 | |
*** admin0 has quit IRC | 13:18 | |
*** simon-AS559 has joined #openstack-operators | 13:23 | |
*** vsedelnik has quit IRC | 13:25 | |
*** simon-AS559 has quit IRC | 13:28 | |
*** vsedelnik has joined #openstack-operators | 13:30 | |
*** admin0 has joined #openstack-operators | 13:31 | |
*** kstev has joined #openstack-operators | 13:32 | |
*** bvandenh has joined #openstack-operators | 13:34 | |
*** vsedelnik has quit IRC | 13:35 | |
*** matrohon has joined #openstack-operators | 13:38 | |
*** vsedelnik has joined #openstack-operators | 13:40 | |
*** vinsh has joined #openstack-operators | 13:40 | |
*** esker has quit IRC | 13:42 | |
*** simon-AS559 has joined #openstack-operators | 13:43 | |
*** matrohon has quit IRC | 13:53 | |
*** matrohon has joined #openstack-operators | 13:53 | |
*** simon-AS559 has quit IRC | 13:55 | |
*** csoukup has joined #openstack-operators | 13:59 | |
*** mriedem is now known as mriedem_meeting | 14:00 | |
*** simon-AS559 has joined #openstack-operators | 14:00 | |
*** saneax_AFK is now known as saneax | 14:02 | |
*** electrofelix has quit IRC | 14:02 | |
*** kstev has quit IRC | 14:05 | |
*** krobzaur has joined #openstack-operators | 14:07 | |
*** busterswt has joined #openstack-operators | 14:08 | |
*** liverpooler has quit IRC | 14:10 | |
*** busterswt has quit IRC | 14:13 | |
*** snecklifter_ has quit IRC | 14:15 | |
*** busterswt has joined #openstack-operators | 14:15 | |
*** snecklifter_ has joined #openstack-operators | 14:15 | |
*** snecklifter_ has quit IRC | 14:16 | |
*** rpjr has joined #openstack-operators | 14:16 | |
*** snecklifter has joined #openstack-operators | 14:16 | |
*** zeih has quit IRC | 14:26 | |
*** matrohon has quit IRC | 14:31 | |
*** mriedem_meeting is now known as mriedem | 14:31 | |
*** zul has quit IRC | 14:35 | |
*** zeih has joined #openstack-operators | 14:36 | |
*** electrofelix has joined #openstack-operators | 14:40 | |
*** VW has joined #openstack-operators | 14:42 | |
*** zeih has quit IRC | 14:47 | |
*** zeih has joined #openstack-operators | 14:47 | |
*** mdorman has joined #openstack-operators | 14:50 | |
*** ducttape_ has joined #openstack-operators | 14:50 | |
*** zeih has quit IRC | 14:51 | |
*** zul has joined #openstack-operators | 15:01 | |
*** kstev has joined #openstack-operators | 15:07 | |
*** kstev has quit IRC | 15:11 | |
*** kstev has joined #openstack-operators | 15:12 | |
*** Marga_ has joined #openstack-operators | 15:16 | |
*** belmoreira has quit IRC | 15:17 | |
*** racedo has joined #openstack-operators | 15:17 | |
*** SimonChung has quit IRC | 15:19 | |
*** armax has joined #openstack-operators | 15:27 | |
*** zul_ has joined #openstack-operators | 15:27 | |
*** zul has quit IRC | 15:27 | |
*** esker has joined #openstack-operators | 15:29 | |
*** eddima has quit IRC | 15:33 | |
*** admin0 has quit IRC | 15:37 | |
*** armax_ has joined #openstack-operators | 15:41 | |
*** armax has quit IRC | 15:42 | |
*** armax_ is now known as armax | 15:42 | |
*** rpjr has quit IRC | 15:46 | |
*** electrofelix has quit IRC | 15:56 | |
*** Rockyg has joined #openstack-operators | 15:56 | |
*** vsedelnik has quit IRC | 15:57 | |
*** vsedelnik has joined #openstack-operators | 15:58 | |
*** simon-AS559 has quit IRC | 15:58 | |
*** ducttape_ has quit IRC | 16:00 | |
*** ducttape_ has joined #openstack-operators | 16:02 | |
*** apoorvad has joined #openstack-operators | 16:06 | |
*** xavpaice has quit IRC | 16:16 | |
*** SimonChung has joined #openstack-operators | 16:17 | |
*** xavpaice has joined #openstack-operators | 16:20 | |
*** goretoxo has quit IRC | 16:27 | |
*** Marga_ has quit IRC | 16:34 | |
*** zul_ has quit IRC | 16:35 | |
*** Marga_ has joined #openstack-operators | 16:37 | |
*** haukebruno has joined #openstack-operators | 16:42 | |
*** Marga_ has quit IRC | 16:44 | |
*** lhcheng has joined #openstack-operators | 16:44 | |
*** c_soukup has joined #openstack-operators | 16:46 | |
*** admin0 has joined #openstack-operators | 16:49 | |
*** csoukup has quit IRC | 16:49 | |
*** derekh has quit IRC | 16:50 | |
*** c_soukup has quit IRC | 16:50 | |
*** zul has joined #openstack-operators | 16:51 | |
*** zhangjn has quit IRC | 16:57 | |
*** zhangjn has joined #openstack-operators | 16:58 | |
*** saneax is now known as saneax_AFK | 17:00 | |
*** piet has joined #openstack-operators | 17:03 | |
*** esker has quit IRC | 17:05 | |
*** harshs has joined #openstack-operators | 17:05 | |
*** esker has joined #openstack-operators | 17:06 | |
*** vsedelnik has quit IRC | 17:06 | |
raginbajin | So, what we have found out while trying to run without L2_population is that we can't guarentee instances are avail at boot without it trying to communicate out. So, we are digging back into our vif_error problem that we have tracked back to l2_population (atleast it occurs during that time). We have found that there is code within the ovs_agent that during l2_pop if one of the other hypervisors does not respond correct | 17:11 |
---|---|---|
raginbajin | ly back to the l2_pop call with either a exception that is not the only exact expception that the code is looking for it will kill the VM and basically put the neutron into a state where new vms can not be created. | 17:11 |
raginbajin | The only way out of it is to restart the neutronagent which kills the flows and causes an interruption. | 17:11 |
*** simon-AS559 has joined #openstack-operators | 17:11 | |
raginbajin | It looks like it may be fixed in liberty but we are still going through the code for it. We think this is what is causing our vif_error problems that prevents us from building new instances. | 17:12 |
raginbajin | We are building a test for it to see if we cause Neutron to go 100% cpu like we see and not respond anymore. | 17:13 |
raginbajin | What causes the l2_pop to fail, we don't know yet, but we know it causes things to unwind and get us into this state. | 17:13 |
raginbajin | Just for anyone that was dying to know some update to a few questions I've asked about lately | 17:13 |
*** admin0 has quit IRC | 17:15 | |
*** simon-AS559 has quit IRC | 17:17 | |
*** simon-AS559 has joined #openstack-operators | 17:17 | |
*** eil397 has joined #openstack-operators | 17:18 | |
*** Rockyg has quit IRC | 17:21 | |
*** simon-AS559 has quit IRC | 17:22 | |
clayton | raginbajin: do you guys have metadata turned on? | 17:22 |
raginbajin | We do, but don't use it.. We use the CDROM instead as we saw early problems with it.. | 17:22 |
clayton | we use metadata, so that might be why it works for us | 17:23 |
raginbajin | ahhhhhh | 17:23 |
raginbajin | Yes it would be.. We thought about how it was working. | 17:23 |
clayton | but DHCP would also probably be sufficent | 17:24 |
*** eil397 has left #openstack-operators | 17:24 | |
clayton | are you not using DHCP either? | 17:24 |
raginbajin | We do, but DHCP doesn't do it | 17:24 |
*** simon-AS559 has joined #openstack-operators | 17:24 | |
raginbajin | because not all the other instances will know about it | 17:24 |
raginbajin | once the DHCP request goes out as broadcast it goes back as unicast | 17:24 |
clayton | it's the traffic that comes back that builds the forwarding entries | 17:24 |
raginbajin | and it talks unicast for the rest. So not everything will hear about it. | 17:24 |
clayton | I think you have something else wrong though | 17:25 |
clayton | there there is no learned entry, it should get flooded to all vteps | 17:25 |
raginbajin | That wouldn't be surprising.. | 17:25 |
raginbajin | Maybe they changed the code in Liberty to flood all vteps. | 17:25 |
raginbajin | We only see that code for VLAN | 17:25 |
clayton | we're still on kilo till next week | 17:26 |
raginbajin | but run with l2_pop there right? | 17:26 |
*** admin0 has joined #openstack-operators | 17:26 | |
clayton | the only changes in the flows for liberty are around arp anti-sproofing | 17:26 |
clayton | yeah, true | 17:26 |
clayton | but I've looked at the flow tables for both | 17:26 |
raginbajin | Hmm it's very strange.. Did you turn l2_pop off everywhere including gateways, servers and computes? | 17:27 |
clayton | yes | 17:27 |
clayton | can you post a gist of the output of ovs-ofctl dump-flows br-tun ? | 17:28 |
*** Marga_ has joined #openstack-operators | 17:28 | |
raginbajin | yeah one second. | 17:28 |
clayton | table 22 should flood all BUM traffic to all vteps | 17:28 |
raginbajin | I'm assuming you want it from a compute that has l2 totally turned off right? | 17:30 |
clayton | that should work | 17:30 |
raginbajin | alright.. give me a few. I need to set that back up. | 17:30 |
clayton | preferably from a smaller environment :) | 17:30 |
raginbajin | hehe.. yeah.. working on it now. | 17:33 |
*** esker has quit IRC | 17:39 | |
*** david-lyle has quit IRC | 17:44 | |
raginbajin | I thinking about this, if we don't use metadata service to initiate any network traffic, then that wouldn't create any traffic to get an arp added. DHCP is only going to respond in a unicast way so everyone doesn't know about it.. I guess I still don't get when a flood would happen. | 17:47 |
clayton | let's say you have an incoming ICMP, it will come into the router, there won't be an arp entry on the router, and it's going to flood the ARP traffic to all vxlan tunnels | 17:48 |
clayton | one of them will respond and that should populate the same thing that L2 pop normally does | 17:48 |
clayton | do you have arp responder turned on? | 17:49 |
*** SimonChung has quit IRC | 17:49 | |
*** SimonChung1 has joined #openstack-operators | 17:49 | |
raginbajin | You can't turn arp_responder on without turning on l2_pop | 17:49 |
clayton | making sure :) | 17:49 |
clayton | do you know if you're getting arp responses in the router namespace? | 17:50 |
raginbajin | So, if I'm on the brand new host that hasn't sent out any connectivity, and ping the router. Everything will work. | 17:52 |
raginbajin | Up until that point, no one can connect to that box. | 17:52 |
clayton | right, but the opposite direction should generate an ARP inside the private network, which should populate all your flows | 17:52 |
clayton | you should have something like this: | 17:53 |
clayton | # ovs-ofctl dump-flows br-tun table=10 | 17:54 |
clayton | NXST_FLOW reply (xid=0x4): | 17:54 |
clayton | cookie=0x86e68bf9735c84f1, duration=439104.776s, table=10, n_packets=1356583, n_bytes=106475933, idle_age=2, hard_age=65534, priority=1 actions=learn(table=20,hard_timeout=300,priority=1,cookie=0x86e68bf9735c84f1,NXM_OF_VLAN_TCI[0..11],NXM_OF_ETH_DST[]=NXM_OF_ETH_SRC[],load:0->NXM_OF_VLAN_TCI[],load:NXM_NX_TUN_ID[]->NXM_NX_TUN_ID[],output:NXM_OF_IN_PORT[]),output:8 | 17:54 |
clayton | when the traffic comes in the vxlan endpoint, it will create a new flow for the return traffic | 17:54 |
clayton | that's on the compute host | 17:54 |
clayton | on the router side, it should be generaing arp traffic for any new compute hosts it's not seen before, and since that's broadcast it will get flooded to all compute hosts that are on that network | 17:55 |
*** rcernin has quit IRC | 17:56 | |
*** mriedem has quit IRC | 17:56 | |
raginbajin | But those will eventually expires | 17:57 |
clayton | only if there is no traffic being passed, in which case the arp will expire also | 17:57 |
raginbajin | Then you could have connectivity issues. | 17:58 |
*** ducttape_ has quit IRC | 17:58 | |
raginbajin | right.. | 17:58 |
raginbajin | This network stuff is hurting my head. | 17:58 |
clayton | heh | 17:58 |
clayton | I spent a lot of time on this stuff earlier this year | 17:59 |
*** haukebruno has quit IRC | 18:00 | |
*** simon-AS559 has quit IRC | 18:00 | |
raginbajin | I don't think we see a lot of gratuitous type of arps.. | 18:00 |
raginbajin | We see only specific destination and sources, so I'm not sure how everyone else finds out about these mac's. | 18:00 |
clayton | anyone that wants to talk to the host will have to arp for it's MAC address | 18:01 |
clayton | and will expire the arp entry if it's not talking to it | 18:01 |
clayton | the learned flow will never expire if there is any traffic at all over a 5 minute time span | 18:01 |
raginbajin | to that instance or any traffic? | 18:02 |
clayton | these flows are all per instance, per hypervisor | 18:02 |
*** david-lyle has joined #openstack-operators | 18:02 | |
raginbajin | and with l2_pop do those flows have that same 5 minute time span? | 18:03 |
clayton | so if two instances talk to each other, they'll learn about each other via the flows that arp sets up, and those flows will stay up as long as they keep talking | 18:03 |
clayton | if they stop talking, the entries in the arp cache will expire and they'll have to arp for each other again, which will learn new flows | 18:03 |
clayton | any traffic between two instances will keep the learned flows alive | 18:03 |
raginbajin | And that is pretty much invisble to the user then say if they ssh into the host or anything like that. | 18:04 |
clayton | yes | 18:04 |
raginbajin | or will they get host not found, and then have to try again to get it to work | 18:04 |
clayton | it should just work | 18:04 |
raginbajin | ok | 18:04 |
clayton | no, the packets are held while all this is in progress | 18:04 |
clayton | the arp flow here is not specific to openstack/vxlan/ovs/etc at all | 18:04 |
clayton | that's all normal | 18:04 |
*** mriedem has joined #openstack-operators | 18:11 | |
*** piet has quit IRC | 18:15 | |
*** ducttape_ has joined #openstack-operators | 18:16 | |
*** haukebruno has joined #openstack-operators | 18:16 | |
raginbajin | Hmm. I think we are going to do some more testing first.. I think we have probably maybe a config prob or software issue.. | 18:17 |
raginbajin | What version of OVS are you using? I wonder if its an older version that is not creating our tunnels when a new vm is built | 18:17 |
*** regXboi has joined #openstack-operators | 18:18 | |
*** rockyg has joined #openstack-operators | 18:41 | |
*** rarcea has joined #openstack-operators | 18:45 | |
raginbajin | clayton: Ok I think I need more testing.. We turned off l2_pop on everything and we have it working as it should.. Which we have seen once or twoice, but not consistenly.. The only thing in the back of my mind is we did vxlan with icehouse and had an issue where eventually hosts were not able to talk to each other. The only way to resolve was to setup a cron to continiously ping each other.. Then things would work. | 18:46 |
*** maishsk has joined #openstack-operators | 19:05 | |
mriedem | ops meeting in #openstack-meeting-4 | 19:10 |
*** rockyg has quit IRC | 19:15 | |
*** ducttape_ has quit IRC | 19:17 | |
*** simon-AS559 has joined #openstack-operators | 19:18 | |
clayton | mriedem: thanks | 19:18 |
*** simon-AS559 has quit IRC | 19:23 | |
*** simon-AS559 has joined #openstack-operators | 19:23 | |
*** haukebruno has quit IRC | 19:25 | |
*** esker has joined #openstack-operators | 19:30 | |
*** ducttape_ has joined #openstack-operators | 19:32 | |
*** esker has quit IRC | 19:35 | |
*** esker has joined #openstack-operators | 19:36 | |
*** Long_yanG has joined #openstack-operators | 19:55 | |
*** LongyanG has quit IRC | 19:58 | |
*** maishsk has quit IRC | 19:58 | |
*** piet has joined #openstack-operators | 19:59 | |
*** maishsk has joined #openstack-operators | 20:00 | |
*** maishsk_ has joined #openstack-operators | 20:04 | |
*** mgagne_ is now known as mgagne | 20:04 | |
*** maishsk has quit IRC | 20:05 | |
*** maishsk has joined #openstack-operators | 20:07 | |
*** maishsk_ has quit IRC | 20:08 | |
*** vsedelnik has joined #openstack-operators | 20:09 | |
*** rcernin has joined #openstack-operators | 20:09 | |
*** rockyg has joined #openstack-operators | 20:13 | |
*** pcaruana has quit IRC | 20:14 | |
*** matrohon has joined #openstack-operators | 20:14 | |
*** maishsk has quit IRC | 20:29 | |
*** maishsk has joined #openstack-operators | 20:29 | |
*** matrohon has quit IRC | 20:37 | |
*** vsedelnik has quit IRC | 20:42 | |
*** rockyg has quit IRC | 20:47 | |
*** busterswt has quit IRC | 20:59 | |
*** busterswt has joined #openstack-operators | 21:00 | |
*** vsedelnik has joined #openstack-operators | 21:06 | |
*** vsedelnik has quit IRC | 21:20 | |
*** vsedelnik has joined #openstack-operators | 21:24 | |
*** rcernin has quit IRC | 21:27 | |
*** VW has quit IRC | 21:27 | |
*** VW has joined #openstack-operators | 21:29 | |
*** regXboi has quit IRC | 21:29 | |
*** vsedelnik has quit IRC | 21:30 | |
*** simon-AS559 has quit IRC | 21:31 | |
*** busterswt has quit IRC | 21:36 | |
*** piet has quit IRC | 21:40 | |
*** kstev has quit IRC | 21:42 | |
*** VW has quit IRC | 21:51 | |
*** admin0 has quit IRC | 21:54 | |
*** mriedem has quit IRC | 22:05 | |
*** rarcea has quit IRC | 22:06 | |
*** mdorman has quit IRC | 22:14 | |
*** piet has joined #openstack-operators | 22:19 | |
*** ducttape_ has quit IRC | 22:27 | |
*** exedore6 has joined #openstack-operators | 22:27 | |
*** piet has quit IRC | 22:32 | |
*** piet has joined #openstack-operators | 22:33 | |
*** exedore6 has quit IRC | 22:42 | |
*** piet has quit IRC | 22:45 | |
*** piet has joined #openstack-operators | 22:45 | |
*** beddari has quit IRC | 22:49 | |
*** exedore6 has joined #openstack-operators | 22:55 | |
*** piet has quit IRC | 22:59 | |
*** beddari has joined #openstack-operators | 23:02 | |
*** exedore6 has quit IRC | 23:05 | |
*** saneax_AFK is now known as saneax | 23:17 | |
*** mriedem has joined #openstack-operators | 23:36 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!