| *** yfried has quit IRC | 00:15 | |
| *** yamahata_ has quit IRC | 00:15 | |
| *** networkstatic has joined #openstack-neutron | 00:17 | |
| *** dims has joined #openstack-neutron | 00:23 | |
| *** matsuhashi has joined #openstack-neutron | 00:29 | |
| *** nati_uen_ has joined #openstack-neutron | 00:33 | |
| *** nati_ueno has quit IRC | 00:35 | |
| *** clev has joined #openstack-neutron | 00:36 | |
| *** otherwiseguy has quit IRC | 00:39 | |
| *** nati_uen_ has quit IRC | 00:45 | |
| *** nati_ueno has joined #openstack-neutron | 00:46 | |
| *** matsuhashi has quit IRC | 00:50 | |
| *** matsuhashi has joined #openstack-neutron | 00:50 | |
| *** matsuhas_ has joined #openstack-neutron | 00:53 | |
| *** clev has quit IRC | 00:53 | |
| *** matsuhashi has quit IRC | 00:54 | |
| *** marun has joined #openstack-neutron | 00:55 | |
| openstackgerrit | Edgar Magana proposed a change to openstack/neutron: Adds id in update_floatingip API https://review.openstack.org/59586 | 00:56 |
|---|---|---|
| openstackgerrit | Youcef Laribi proposed a change to openstack/neutron: Implements an LBaaS driver for NetScaler devices. https://review.openstack.org/57524 | 00:56 |
| *** reaper has quit IRC | 01:00 | |
| *** marun has quit IRC | 01:02 | |
| *** SumitNaiksatam has quit IRC | 01:09 | |
| *** jp_at_hp has quit IRC | 01:17 | |
| *** beagles has quit IRC | 01:19 | |
| *** yamahata_ has joined #openstack-neutron | 01:20 | |
| *** SumitNaiksatam has joined #openstack-neutron | 01:31 | |
| *** yamahata_ has quit IRC | 01:34 | |
| *** aymenfrikha has joined #openstack-neutron | 01:36 | |
| *** clev has joined #openstack-neutron | 01:36 | |
| *** aymenfrikha has left #openstack-neutron | 01:37 | |
| openstackgerrit | Nachi Ueno proposed a change to openstack/neutron: API Extension for SSL-VPN services https://review.openstack.org/58897 | 01:38 |
| *** jianingy_afk is now known as jianingy | 01:39 | |
| *** sb2 has joined #openstack-neutron | 01:42 | |
| *** sb2 has quit IRC | 01:43 | |
| *** banix has joined #openstack-neutron | 01:50 | |
| *** mengxd has joined #openstack-neutron | 01:52 | |
| *** carl_baldwin has joined #openstack-neutron | 02:02 | |
| *** carl_baldwin has quit IRC | 02:07 | |
| *** nati_ueno has quit IRC | 02:09 | |
| *** networkstatic has quit IRC | 02:12 | |
| *** Jianyong has joined #openstack-neutron | 02:22 | |
| *** matsuhas_ has quit IRC | 02:31 | |
| *** matsuhashi has joined #openstack-neutron | 02:31 | |
| *** nati_ueno has joined #openstack-neutron | 02:43 | |
| *** gongysh has joined #openstack-neutron | 02:52 | |
| *** nati_ueno has quit IRC | 02:53 | |
| *** RobinWang has quit IRC | 02:53 | |
| *** chandankumar has joined #openstack-neutron | 03:06 | |
| *** nati_ueno has joined #openstack-neutron | 03:07 | |
| *** mengxd has quit IRC | 03:13 | |
| *** alagalah has joined #openstack-neutron | 03:15 | |
| *** alagalah has left #openstack-neutron | 03:15 | |
| *** nati_ueno has quit IRC | 03:17 | |
| *** clev has quit IRC | 03:17 | |
| *** aymenfrikha has joined #openstack-neutron | 03:19 | |
| *** banix has quit IRC | 03:21 | |
| *** jecarey has joined #openstack-neutron | 03:24 | |
| *** suresh12 has quit IRC | 03:31 | |
| *** aymenfrikha has quit IRC | 03:31 | |
| *** suresh12 has joined #openstack-neutron | 03:31 | |
| openstackgerrit | Edgar Magana proposed a change to openstack/neutron: Adds id in update_floatingip API in PLUMgrid plugin driver https://review.openstack.org/59586 | 03:35 |
| *** suresh12 has quit IRC | 03:35 | |
| *** suresh12 has joined #openstack-neutron | 03:37 | |
| *** SushilKM has joined #openstack-neutron | 03:39 | |
| *** mrsnivvel has joined #openstack-neutron | 03:41 | |
| *** matsuhashi has quit IRC | 03:42 | |
| *** dims has quit IRC | 03:43 | |
| *** nati_ueno has joined #openstack-neutron | 03:45 | |
| *** SushilKM has quit IRC | 03:48 | |
| *** gongysh has quit IRC | 03:54 | |
| openstackgerrit | Youcef Laribi proposed a change to openstack/neutron: Implements an LBaaS driver for NetScaler devices https://review.openstack.org/57524 | 03:56 |
| *** suresh12 has quit IRC | 03:58 | |
| *** otherwiseguy has joined #openstack-neutron | 04:03 | |
| openstackgerrit | Sushil Kumar proposed a change to openstack/python-neutronclient: Updates .gitignore https://review.openstack.org/59075 | 04:07 |
| openstackgerrit | gongysh proposed a change to openstack/neutron: atomically setup ovs ports https://review.openstack.org/59612 | 04:09 |
| *** SushilKM has joined #openstack-neutron | 04:10 | |
| *** SushilKM has quit IRC | 04:20 | |
| *** SushilKM has joined #openstack-neutron | 04:20 | |
| *** matsuhashi has joined #openstack-neutron | 04:25 | |
| *** aveiga has quit IRC | 04:26 | |
| *** jecarey has quit IRC | 04:33 | |
| *** matsuhashi has quit IRC | 05:00 | |
| *** SushilKM has quit IRC | 05:00 | |
| *** networkstatic has joined #openstack-neutron | 05:01 | |
| *** matsuhashi has joined #openstack-neutron | 05:08 | |
| *** Abhishek has quit IRC | 05:09 | |
| *** Jianyong has quit IRC | 05:16 | |
| *** matsuhashi has quit IRC | 05:27 | |
| *** bashok has joined #openstack-neutron | 05:28 | |
| openstackgerrit | berlin proposed a change to openstack/neutron: Support advanced NVP IPsec VPN Service https://review.openstack.org/55207 | 05:36 |
| openstackgerrit | Isaku Yamahata proposed a change to openstack/neutron: l3-agent-consolidation(WIP): framework for consolidating l3 agents https://review.openstack.org/57627 | 05:42 |
| openstackgerrit | berlin proposed a change to openstack/neutron: Add Error Handling to NVP advanced LBaaS/FWaaS https://review.openstack.org/59625 | 05:44 |
| *** Jianyong has joined #openstack-neutron | 05:44 | |
| openstackgerrit | Zhongyue Luo proposed a change to openstack/neutron: Use DictOpt for mapping options https://review.openstack.org/45990 | 05:56 |
| *** matsuhashi has joined #openstack-neutron | 05:59 | |
| *** wenjianhn has joined #openstack-neutron | 06:04 | |
| *** x86brandon has quit IRC | 06:09 | |
| *** yfried has joined #openstack-neutron | 06:11 | |
| *** Abhishek has joined #openstack-neutron | 06:20 | |
| openstackgerrit | Jenkins proposed a change to openstack/neutron: Imported Translations from Transifex https://review.openstack.org/59632 | 06:31 |
| *** gongysh has joined #openstack-neutron | 06:31 | |
| *** SushilKM has joined #openstack-neutron | 06:38 | |
| *** yamahata_ has joined #openstack-neutron | 06:46 | |
| *** otherwiseguy has quit IRC | 06:47 | |
| *** amritanshu_RnD has joined #openstack-neutron | 06:49 | |
| openstackgerrit | gongysh proposed a change to openstack/neutron: atomically setup ovs ports https://review.openstack.org/59612 | 06:50 |
| *** SushilKM has quit IRC | 06:57 | |
| *** Abhishek has quit IRC | 07:06 | |
| *** Abhishek has joined #openstack-neutron | 07:07 | |
| *** yamahata_ has quit IRC | 07:07 | |
| *** networkstatic has quit IRC | 07:09 | |
| *** jlibosva has joined #openstack-neutron | 07:15 | |
| *** alex_klimov has joined #openstack-neutron | 07:21 | |
| *** gdubreui has quit IRC | 07:24 | |
| *** amuller has joined #openstack-neutron | 07:41 | |
| *** Abhishek has quit IRC | 07:41 | |
| *** zenoway has joined #openstack-neutron | 07:42 | |
| *** wenjianhn has quit IRC | 07:47 | |
| *** wenjianhn has joined #openstack-neutron | 08:03 | |
| doude | gongysh: ping | 08:08 |
| gongysh | doude: pong | 08:10 |
| doude | hi, just a question a bout the review you restored https://review.openstack.org/#/c/46911/ | 08:11 |
| gongysh | hi | 08:11 |
| doude | Do you plan to rebase it ? Or do you need help to merge it ? | 08:11 |
| gongysh | there is a rumor this bug just happened on ubuntu? | 08:12 |
| gongysh | so I am not quite sure if it should be fixed or not? | 08:12 |
| gongysh | do u have ideas? | 08:12 |
| doude | I made a test on a 10Gb/s physical link and the differences between veth and internal port is not very big | 08:12 |
| doude | simple test with iperf on TCP | 08:13 |
| doude | internal: 9,13Gb/s and veth 8,54Gb/s | 08:13 |
| gongysh | which platform? centos or ubuntu | 08:14 |
| gongysh | ? | 08:14 |
| doude | ubuntu 12.04 | 08:14 |
| gongysh | so do u think we still need this patch? | 08:14 |
| doude | but I made this test into manually configured namespaces | 08:14 |
| doude | I've got other performene issues into VM with vif driver OVSHybrid | 08:15 |
| doude | I'm not able to use jumbo frame with configuration | 08:15 |
| openstackgerrit | A change was merged to openstack/neutron: Move MidonetInterfaceDriver and use mm-ctl https://review.openstack.org/54259 | 08:15 |
| doude | You said in bug comment that you improve the bandwith from 2,25 to 19,8 | 08:16 |
| gongysh | doude: you can see my test record http://www.ustack.com/wp-content/uploads/2013/10/Neutron-performance-testing.pdf | 08:16 |
| doude | ha thanks ! | 08:17 |
| *** pasquier-s has joined #openstack-neutron | 08:17 | |
| gongysh | someone told me: | 08:18 |
| gongysh | While some people believe this is a Ubuntu kernel bug rather than Openstack. | 08:18 |
| gongysh | https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1201869 | 08:18 |
| doude | but link between namespace (l3 and DHCP) use internal port ? | 08:19 |
| doude | instead of the VM port with LB bridge which use veth | 08:20 |
| doude | gongysh: in anycase, I think it's better to use an OVS internal port as soon as possible | 08:22 |
| gongysh | doude: if there is no improvement or obvious problems with veth, it is hard to push that patch. | 08:23 |
| steven-weston | for bug 1201869 I see upstream patches listed but no links | 08:23 |
| steven-weston | do you know what the patches address? | 08:24 |
| steven-weston | ?? | 08:27 |
| *** fouxm has joined #openstack-neutron | 08:28 | |
| *** ihrachyska has quit IRC | 08:29 | |
| gongysh | steven-weston: sorry. but I think it is already in the update of ubuntu OS. | 08:30 |
| openstackgerrit | Ann Kamyshnikova proposed a change to openstack/neutron: Implement testing of migrations https://review.openstack.org/48594 | 08:31 |
| *** zenoway has quit IRC | 08:31 | |
| steven-weston | gongysh: ok. I am reading over your performance doc, very nice :-). it would be hard to pinpoint the problem without seeing the patch code ... performance problems are hard to diagnose in that they are dependent on so many factors. need more specifics ... | 08:34 |
| *** netredem-jr has joined #openstack-neutron | 08:34 | |
| doude | gongysh: I think we can defend this patch wich will be more heterogeneous between VM port and l3/DHCP namespaces and could clearly improve performances on certain Linux kernel version | 08:37 |
| doude | gongysh: Wich distrib do you use for your performance tests ? Wich kernel version ? | 08:40 |
| gongysh | doude: ubuntu 13.04 | 08:40 |
| doude | kernel 3.8 ? | 08:41 |
| doude | or 3.5 ? | 08:41 |
| gongysh | doude: sorry, I should have recorded ths OS kernel version. | 08:42 |
| doude | normaly the 13.04 uses the Linu kernel 3.5 | 08:43 |
| doude | but the bug 1201869 was backported | 08:43 |
| doude | on 3.5.0-39.60 | 08:44 |
| doude | in august | 08:44 |
| doude | no at the end of september | 08:46 |
| gongysh | doude: yes, It seems I have to reproduce it some other day. | 08:46 |
| doude | gongysh: but even if veth and internal have the same performance, I think it's better to user internal | 08:47 |
| openstackgerrit | berlin proposed a change to openstack/neutron: Add Error Handling to NVP advanced LBaaS/FWaaS https://review.openstack.org/59625 | 08:47 |
| doude | gongysh: another question, do you use jumbo frames on your network ? Are you able to use it with Neutron ML2/OVS ? | 08:48 |
| *** jistr has joined #openstack-neutron | 08:48 | |
| gongysh | doude: no, can u send me the way to do testing with 10G? | 08:49 |
| doude | gongysh: to test internal vs veth ? | 08:49 |
| doude | or test Jumbo frame ?? | 08:50 |
| gongysh | doude: any or both | 08:50 |
| gongysh | doude: I have not testing jumbo frame? | 08:50 |
| gongysh | I have not tested jumbo frame. | 08:50 |
| doude | gongysh: Ok, I started a ML mail but I need time to write an english email with my poor english :) I will cc'ed you to that mail | 08:51 |
| doude | And I'll send you another mail how I tested internal vs veth | 08:52 |
| doude | gongysh: thx for your help | 08:52 |
| steven-weston | doude: i don't think jumbo frames will make a difference, unless you are seeing high cpu utilization on the vm host | 08:52 |
| *** jorisroovers has joined #openstack-neutron | 08:53 | |
| wenjianhn | steven-weston, i don't think so | 08:53 |
| wenjianhn | doude, Grizzly doesn't support jumbo frame. related to bug 1075336 | 08:53 |
| wenjianhn | we need to increase the MTU of the physical and virtual devices | 08:54 |
| doude | steven-weston: no it doesn't. But I made test with manualy created OVS ports between 2 physical node: in this case the jumbo fram are used and I get throughput of 9,2Gb/s | 08:55 |
| steven-weston | doude: 9.2 vs ? | 08:55 |
| doude | but with Neutron Havana ML2/OVS I'm not able to use the jumbo frame and my throughput test fall in 1,2Gb/s | 08:56 |
| *** nati_ueno has quit IRC | 08:56 | |
| doude | on a physical frabics of 10Gb/s | 08:56 |
| steven-weston | doude: i see ... have you checked your mtu sizes on the physical cards? connected to one another with xover, or through a switch? then you would need to worry about mtu sizes end to end | 08:57 |
| steven-weston | but vm to vm on the same host should be negligible ... if you have a device that is fragmenting your pipe then you will see some issues | 08:59 |
| steven-weston | wenjianhn: agreed :-) | 09:00 |
| wenjianhn | :) | 09:01 |
| doude | steven-weston: of course | 09:01 |
| *** jpich has joined #openstack-neutron | 09:02 | |
| steven-weston | doude: so why can you not use jumbo frames with Havana ML2/OVS? | 09:02 |
| doude | in fact, I'm able to use jumbo frame if I send a large ping but if I make TCP tests, the packets are still have size of 1500 | 09:02 |
| *** ygbo has joined #openstack-neutron | 09:03 | |
| lifeless | doude: what link sizes does 'ip link' show | 09:03 |
| lifeless | repeated for the base namespace + each namespace listed by ip netns | 09:03 |
| doude | perhaphs a problem of NIC offloading configuration | 09:03 |
| doude | I use Cisco Nexus fabric with an MTU size of 9216 octets | 09:04 |
| *** jroovers has joined #openstack-neutron | 09:05 | |
| doude | to be able to test jumbo frame, I change the MTU of qvo and qvb MTU size | 09:05 |
| *** jorisroovers has quit IRC | 09:05 | |
| doude | manually | 09:05 |
| akamyshnikova | Hello everyone! I've got two very simple changes that fixed downgrade in migration https://review.openstack.org/56022 and https://review.openstack.org/5309. They have a lot of +1 and +2, can anyone approve? | 09:06 |
| steven-weston | that's nice hardware :-) on the nic cards you are changing the mtu? and then you see 'normal' performance? | 09:06 |
| doude | with ICMP it's works. The packet size going through the VM tap interface is 1500 and the Linux qbr bridge concatenates packet to jumbo size | 09:06 |
| doude | steven-weston: Yes, I tested performences between physical nodes and it's good 9.8Gb/s | 09:07 |
| doude | steven-weston: I will send an email to explain that, I can cc'ed you if you want ? | 09:08 |
| steven-weston | doude: sure, that would be helpful. lifeless suggested checking the link sizes in ip link ... any problems there? | 09:09 |
| steven-weston | doude: steven-weston@live.com | 09:09 |
| doude | I doesn't see any probleme when I check link size | 09:10 |
| steven-weston | ok ... any bumps in cpu utilization? | 09:10 |
| openstackgerrit | Ann Kamyshnikova proposed a change to openstack/neutron: Sync models with migrations https://review.openstack.org/55411 | 09:11 |
| doude | lifeless: which namespace are you talking about ? I just make test performance between VM on a same virtual networks. No namespaces involved in that use case | 09:11 |
| doude | steven-weston: I doesn't check that yet. I like to fix the packet size before | 09:12 |
| steven-weston | but you are using ml2? ml2 uses namespaces by default | 09:12 |
| doude | I'll check CPU after i able to use jumbo frame size | 09:12 |
| doude | steven-weston: namespace are only use by l3 and DHCP agents | 09:12 |
| doude | and other services | 09:13 |
| doude | but between 2 VNIC of VM, no namespaces are used | 09:13 |
| doude | on a same network | 09:13 |
| steven-weston | doude: i see, same network, you said above, i need more caffeine :-) | 09:13 |
| doude | steven-weston: :) | 09:13 |
| steven-weston | doude: did you verify the vms are using the same ports on the ovs bridge? | 09:15 |
| steven-weston | doude: same bridge, rather | 09:15 |
| doude | steven-weston: same bridge ? What do you mean ? | 09:16 |
| doude | My test case is: 2 physical nodes with 1 VM by physical node | 09:16 |
| steven-weston | doude: ah ok | 09:17 |
| doude | so on each physical node I've got: ethX with IP tunnel <--> br-tun <--> br-int <--> qvo <--> qvb <--> qbr <--> VMx TAP | 09:18 |
| doude | I'll finished my email | 09:19 |
| doude | steven-weston: on wich mailing list should I send it ? dev ? | 09:19 |
| steven-weston | doude: i'd double check with gongysh ... it is related to a bug report? | 09:22 |
| steven-weston | doude: i'd hate to give you wrong advise, i've seen some people on ml critisized for using the ml for 'usage questions' | 09:23 |
| openstackgerrit | berlin proposed a change to openstack/neutron: Add Error Handling to NVP advanced LBaaS/FWaaS https://review.openstack.org/59625 | 09:26 |
| *** jroovers has quit IRC | 09:32 | |
| *** ihrachyska has joined #openstack-neutron | 09:34 | |
| *** netredem-jr is now known as networkstatic | 09:37 | |
| *** networkstatic has quit IRC | 09:38 | |
| *** rossella_s has joined #openstack-neutron | 09:40 | |
| doude | steven-weston: no I didn't opened a bug. I'll send the mail on the OpenStack mailing list | 09:49 |
| steven-weston | doude: ok, that's what i'd do . i'm not on the general mailing list though, can you send me a copy as well? steven--weston@live.com | 09:51 |
| *** bvandenh has joined #openstack-neutron | 09:51 | |
| *** matsuhashi has quit IRC | 09:51 | |
| *** matsuhashi has joined #openstack-neutron | 09:54 | |
| openstackgerrit | Armando Migliaccio proposed a change to openstack/neutron: Handle exceptions on create_dhcp_port https://review.openstack.org/57812 | 09:54 |
| lifeless | doude: sure there are on the neutron network node | 09:57 |
| lifeless | doude: unless both vms are on the same hypervisor host | 09:58 |
| lifeless | doude: anyhow, basically point was to check all the devices the traffic passes through | 09:58 |
| akamyshnikova | SumitNaiksatam, Hello! I've got two very simple changes that fixed downgrade in migration https://review.openstack.org/56022 and https://review.openstack.org/5309. They have a lot of +1 and +2, can you take a look at them? | 10:05 |
| openstackgerrit | Armando Migliaccio proposed a change to openstack/neutron: Handle failures on update_dhcp_port https://review.openstack.org/59664 | 10:06 |
| openstackgerrit | Ann Kamyshnikova proposed a change to openstack/neutron: Update lockutils and fixture in openstack.common https://review.openstack.org/47557 | 10:08 |
| openstackgerrit | Ann Kamyshnikova proposed a change to openstack/neutron: Add testing of migrations from oslo https://review.openstack.org/46927 | 10:09 |
| openstackgerrit | Ann Kamyshnikova proposed a change to openstack/neutron: Implement testing of migrations https://review.openstack.org/48594 | 10:09 |
| *** gongysh has quit IRC | 10:14 | |
| *** fouxm_ has joined #openstack-neutron | 10:14 | |
| *** fouxm has quit IRC | 10:17 | |
| *** marun has joined #openstack-neutron | 10:20 | |
| *** yamahata_ has joined #openstack-neutron | 10:26 | |
| *** Jianyong has quit IRC | 10:39 | |
| *** yamahata_ has quit IRC | 10:43 | |
| *** markmcclain has joined #openstack-neutron | 10:49 | |
| *** markmcclain has quit IRC | 11:00 | |
| *** markmcclain has joined #openstack-neutron | 11:00 | |
| kashyap | Hi, any hints on why I notice this "Agent tunnel out of sync with plugin" on my Compute node -- http://paste.openstack.org/show/54346/ | 11:08 |
| openstackgerrit | A change was merged to openstack/neutron: update error msg for invalid state to update vpn resources https://review.openstack.org/59562 | 11:35 |
| *** pcm_ has joined #openstack-neutron | 11:41 | |
| *** pcm_ has quit IRC | 11:43 | |
| *** pcm_ has joined #openstack-neutron | 11:44 | |
| *** wenjianhn has quit IRC | 11:47 | |
| *** dims has joined #openstack-neutron | 11:58 | |
| marun | salv-orlando: ping | 11:59 |
| salv-orlando | marun: pong | 11:59 |
| marun | salv-orlando: I'm digging into a bug that is exhibiting strange behaviour | 11:59 |
| salv-orlando | marun: is there any bug without a strange behaviour lately? | 12:00 |
| marun | salv-orlando: sadly, no :( | 12:00 |
| marun | salv-orlando: I think it is amqp related, and I'm afraid I'm not clear on the delivery semantics. | 12:00 |
| marun | salv-orlando: here is the bug: https://bugs.launchpad.net/neutron/+bug/1192381 | 12:00 |
| marun | salv-orlando: I ran into this one on the way: https://bugs.launchpad.net/neutron/+bug/1160442 | 12:01 |
| marun | salv-orlando: but I think it's unlikely to be the problem. | 12:01 |
| marun | salv-orlando: I instrumented the dhcp notification send/receive, parsed the log results on both sides... | 12:02 |
| marun | salv-orlando: there were 91 notifications sent by the server for port.create.end | 12:02 |
| marun | salv-orlando: oh, sorry, preamble: I tried to boot 75 vms | 12:02 |
| salv-orlando | No I don't think either. I've come to the conclusion that this problem is happening also when I enable parallel testing, because that would be the only thing that explains how it's possible that a perfectly wired port does not have connectivty | 12:02 |
| marun | salv-orlando: so, the server sent 91 notifications for port.create.end (should have been only 75, but the second bug exhibited) | 12:03 |
| marun | salv-orlando: the dhcp agent only received 39 of the notifications | 12:03 |
| marun | salv-orlando: I'm wondering - why would the dhcp agent not receive notifications (and therefore not know to configure a host entry for the port)? | 12:04 |
| salv-orlando | let's look at the two problems separately starting with the latter which is more likely to be cause of your bug - is the notifier doing a cast or fanout case? | 12:05 |
| salv-orlando | * fanout_cast | 12:05 |
| marun | salv-orlando: why would it be one vs the other? | 12:05 |
| marun | salv-orlando: (I'm afraid I'm ignorant of amqp) | 12:06 |
| salv-orlando | I am looking at the message semantics as well, but my suspect is that some other process might consume the notification and take it off the queue | 12:06 |
| salv-orlando | ceilometer, for instance | 12:06 |
| marun | :( | 12:07 |
| marun | salv-orlando: f'ing agent scheduler code? | 12:07 |
| marun | salv-orlando: It looks like it would be a cast. | 12:08 |
| marun | https://github.com/openstack/neutron/blob/master/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py#L80 | 12:08 |
| salv-orlando | if you see only 39 notification on the dhcp agent out of 75 sent, that's serious. And since the number sounds like each other notification is received, makes me think there might be competing consumers | 12:09 |
| salv-orlando | but this is an hypothesis only and needs to be validated | 12:09 |
| marun | salv-orlando: *sigh* | 12:09 |
| marun | salv-orlando: I have a suspicion | 12:09 |
| marun | https://github.com/openstack/neutron/blob/master/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py#L48 | 12:09 |
| marun | the 'active' part | 12:09 |
| marun | Can 'active' be False if the agent heartbeat isn't recorded in a timely fashion? | 12:10 |
| salv-orlando | yes it could. I would like to see how this could affect receiving a notification. | 12:11 |
| marun | salv-orlando: That would be a huge hole. If the agent were ever seen as being down (even if it was not), the notification would not be sent. | 12:12 |
| marun | salv-orlando: hmmm, surely this is logged. | 12:12 |
| salv-orlando | yes, but is this a distinct issue? we were talking about notifications sent but not received, I guess | 12:12 |
| marun | salv-orlando: I think it's a problem in my instrumentation. i was logging 'sent' way before the logic to do with the cast (in base.py where the notifier is called). | 12:13 |
| marun | salv-orlando: So I should repeat the experiment with better logging. | 12:13 |
| marun | salv-orlando: sorry for the false start | 12:14 |
| marun | salv-orlando: another strange issue - under heavy load the request id appears in the log only sporadically. Did you review Akihiro's patch by chance? I'm wondering if there is a problem with the threadlocal replacement of the context. | 12:19 |
| salv-orlando | always interested in hearing about thes e issue. As I said I might be experiencing the same issue here: http://logs.openstack.org/20/57420/34/experimental/check-tempest-devstack-vm-neutron-isolated-parallel/d628fea | 12:19 |
| salv-orlando | marun: I think that just doesn't work | 12:19 |
| salv-orlando | I see the same request id over and over in the logs for different requests | 12:20 |
| marun | salv-orlando: :( | 12:20 |
| marun | salv-orlando: well, at least it's reproduceable | 12:20 |
| *** yfried has quit IRC | 12:24 | |
| *** markmcclain has quit IRC | 12:30 | |
| *** beagles has joined #openstack-neutron | 12:31 | |
| *** markmcclain has joined #openstack-neutron | 12:32 | |
| openstackgerrit | Darragh O'Reilly proposed a change to openstack/neutron: Fix bad call in port_update in linuxbridge agent https://review.openstack.org/59431 | 12:35 |
| *** markmcclain has quit IRC | 12:36 | |
| *** markmcclain has joined #openstack-neutron | 12:40 | |
| openstackgerrit | Ann Kamyshnikova proposed a change to openstack/neutron: Update lockutils and fixture in openstack.common https://review.openstack.org/47557 | 12:41 |
| openstackgerrit | Ann Kamyshnikova proposed a change to openstack/neutron: Add testing of migrations from oslo https://review.openstack.org/46927 | 12:49 |
| openstackgerrit | Ann Kamyshnikova proposed a change to openstack/neutron: Implement testing of migrations https://review.openstack.org/48594 | 12:49 |
| *** yfried has joined #openstack-neutron | 12:57 | |
| *** amuller has quit IRC | 13:01 | |
| *** amuller has joined #openstack-neutron | 13:02 | |
| *** yfried has quit IRC | 13:02 | |
| *** yfried has joined #openstack-neutron | 13:03 | |
| *** rossella_s has quit IRC | 13:04 | |
| *** wenjianhn has joined #openstack-neutron | 13:08 | |
| *** yamahata_ has joined #openstack-neutron | 13:08 | |
| *** amuller has quit IRC | 13:10 | |
| *** wenjianhn has quit IRC | 13:15 | |
| *** akamyshnikova has quit IRC | 13:18 | |
| *** dims has quit IRC | 13:21 | |
| *** rossella_s has joined #openstack-neutron | 13:23 | |
| *** dims has joined #openstack-neutron | 13:25 | |
| *** bvandenh has quit IRC | 13:26 | |
| *** rossella_s has quit IRC | 13:26 | |
| *** rossella-s has joined #openstack-neutron | 13:26 | |
| *** akamyshnikova has joined #openstack-neutron | 13:28 | |
| *** fouxm_ has quit IRC | 13:30 | |
| *** fouxm has joined #openstack-neutron | 13:30 | |
| *** matsuhashi has quit IRC | 13:40 | |
| *** rossella-s has quit IRC | 13:43 | |
| *** rossella_s has joined #openstack-neutron | 13:44 | |
| *** x86brandon has joined #openstack-neutron | 13:44 | |
| openstackgerrit | Darragh O'Reilly proposed a change to openstack/neutron: Prevent race calling brctl addif in linuxbridge agent https://review.openstack.org/59720 | 13:54 |
| *** aymenfrikha has joined #openstack-neutron | 13:55 | |
| *** jianingy is now known as jianingy_afk | 14:00 | |
| *** julim has joined #openstack-neutron | 14:01 | |
| *** reaper has joined #openstack-neutron | 14:04 | |
| *** amuller has joined #openstack-neutron | 14:05 | |
| *** SushilKM has joined #openstack-neutron | 14:06 | |
| openstackgerrit | Berezovsky Irena proposed a change to openstack/neutron: Add update from agent to plugin on device up https://review.openstack.org/53609 | 14:09 |
| *** alagalah has joined #openstack-neutron | 14:09 | |
| *** alagalah has left #openstack-neutron | 14:10 | |
| *** markmcclain has quit IRC | 14:10 | |
| openstackgerrit | Darragh O'Reilly proposed a change to openstack/neutron: Prevent race calling brctl addif in linuxbridge agent https://review.openstack.org/59720 | 14:20 |
| *** Qlawy has quit IRC | 14:21 | |
| *** Qlawy has joined #openstack-neutron | 14:22 | |
| *** Qlawy has joined #openstack-neutron | 14:22 | |
| *** banix has joined #openstack-neutron | 14:24 | |
| *** safchain has joined #openstack-neutron | 14:26 | |
| *** peristeri has joined #openstack-neutron | 14:28 | |
| *** reaper has quit IRC | 14:28 | |
| marun | salv-orlando: ping | 14:30 |
| *** salv-orlando has quit IRC | 14:33 | |
| *** ihrachyska has quit IRC | 14:34 | |
| *** ihrachyska has joined #openstack-neutron | 14:35 | |
| *** clev has joined #openstack-neutron | 14:36 | |
| *** BillTheKat has joined #openstack-neutron | 14:36 | |
| *** bashok has quit IRC | 14:38 | |
| *** amotoki has quit IRC | 14:41 | |
| *** sjcazzol_ has joined #openstack-neutron | 14:41 | |
| sjcazzol_ | Someone, please could take a look to this review? https://review.openstack.org/#/c/57522/ | 14:42 |
| sc68cal | sjcazzol_: Your commit message shouldn't have "rebase done!" in the message | 14:43 |
| *** SushilKM has quit IRC | 14:44 | |
| *** jp_at_hp has joined #openstack-neutron | 14:46 | |
| *** BillTheKat has quit IRC | 14:48 | |
| sjcazzol_ | sc68cal: thanks | 14:48 |
| marun | sjcazzol_: why are you importing '_'? | 14:53 |
| marun | sjcazzol_: Is there documentation somewhere that suggests that import? | 14:53 |
| marun | sjcazzol_: afaik importing gettext at the root of the project should be adding _ to builtins | 14:53 |
| marun | sjcazzol_: ah, looks like a legacy problem. | 14:54 |
| marun | sjcazzol_: Do you want to fix it? | 14:54 |
| *** alagalah has joined #openstack-neutron | 14:55 | |
| *** alagalah has left #openstack-neutron | 14:56 | |
| *** sjcazzol_ has quit IRC | 14:57 | |
| *** BillTheKat has joined #openstack-neutron | 14:58 | |
| *** jecarey has joined #openstack-neutron | 14:59 | |
| *** alagalah_ has joined #openstack-neutron | 14:59 | |
| openstackgerrit | Oleg Bondarev proposed a change to openstack/neutron: LBaaS: agent monitoring and instance rescheduling https://review.openstack.org/59743 | 15:00 |
| *** alagalah_ has quit IRC | 15:00 | |
| openstackgerrit | Sergio Cazzolato proposed a change to openstack/python-neutronclient: Fix i18n messages in neutronclient https://review.openstack.org/57522 | 15:04 |
| *** alagalah has joined #openstack-neutron | 15:15 | |
| *** alagalah has left #openstack-neutron | 15:15 | |
| *** amritanshu_RnD has quit IRC | 15:16 | |
| marun | arosen: ping | 15:31 |
| *** aveiga has joined #openstack-neutron | 15:31 | |
| *** otherwiseguy has joined #openstack-neutron | 15:35 | |
| *** jlibosva has quit IRC | 15:36 | |
| *** yfried has quit IRC | 15:43 | |
| openstackgerrit | A change was merged to openstack/neutron: Sync Log Levels from OSLO https://review.openstack.org/59238 | 15:44 |
| openstackgerrit | A change was merged to openstack/neutron: Adds id in update_floatingip API in PLUMgrid plugin driver https://review.openstack.org/59586 | 15:44 |
| *** unicell has quit IRC | 15:51 | |
| *** amuller has quit IRC | 15:52 | |
| *** yfried has joined #openstack-neutron | 15:57 | |
| *** SumitNaiksatam has quit IRC | 16:00 | |
| *** reaper has joined #openstack-neutron | 16:01 | |
| openstackgerrit | Sergio Cazzolato proposed a change to openstack/python-neutronclient: Fix i18n messages in neutronclient https://review.openstack.org/57522 | 16:01 |
| *** SushilKM has joined #openstack-neutron | 16:07 | |
| *** carl_baldwin has joined #openstack-neutron | 16:08 | |
| *** mlavalle has joined #openstack-neutron | 16:12 | |
| *** alex_klimov has quit IRC | 16:22 | |
| *** pete5 has joined #openstack-neutron | 16:24 | |
| *** SumitNaiksatam has joined #openstack-neutron | 16:27 | |
| *** mengxd has joined #openstack-neutron | 16:31 | |
| *** mengxd has quit IRC | 16:32 | |
| *** marun has quit IRC | 16:37 | |
| sc68cal | beagles: we've got clearance to go | 16:40 |
| *** mestery has quit IRC | 16:49 | |
| *** mestery has joined #openstack-neutron | 16:50 | |
| *** SushilKM has quit IRC | 16:51 | |
| openstackgerrit | A change was merged to openstack/neutron: Fix downgrade in migration https://review.openstack.org/56022 | 16:52 |
| *** marun has joined #openstack-neutron | 16:57 | |
| dkehn | which heat | 17:00 |
| dkehn | sorry wrong window | 17:00 |
| *** clev has quit IRC | 17:03 | |
| *** jlibosva has joined #openstack-neutron | 17:03 | |
| *** jistr has quit IRC | 17:10 | |
| *** clev has joined #openstack-neutron | 17:13 | |
| *** marun has quit IRC | 17:13 | |
| openstackgerrit | Aaron Rosen proposed a change to openstack/neutron: Bump api_workers from 0 to 4 https://review.openstack.org/59787 | 17:21 |
| *** sbasam has joined #openstack-neutron | 17:37 | |
| *** SushilKM has joined #openstack-neutron | 17:40 | |
| *** yfried has quit IRC | 17:42 | |
| *** alagalah has joined #openstack-neutron | 17:47 | |
| *** sbasam has quit IRC | 17:54 | |
| *** sbasam has joined #openstack-neutron | 17:55 | |
| *** ivar-lazzaro has joined #openstack-neutron | 17:59 | |
| *** ygbo has quit IRC | 18:01 | |
| *** SushilKM has quit IRC | 18:02 | |
| *** markmcclain has joined #openstack-neutron | 18:03 | |
| *** rossella_s has quit IRC | 18:03 | |
| *** suresh12 has joined #openstack-neutron | 18:05 | |
| *** yfried has joined #openstack-neutron | 18:06 | |
| *** SushilKM has joined #openstack-neutron | 18:08 | |
| *** SushilKM__ has joined #openstack-neutron | 18:12 | |
| *** SushilKM has quit IRC | 18:13 | |
| *** nati_ueno has joined #openstack-neutron | 18:15 | |
| *** devlaps has joined #openstack-neutron | 18:19 | |
| *** SushilKM__ has quit IRC | 18:23 | |
| *** amuller has joined #openstack-neutron | 18:25 | |
| openstackgerrit | Carl Baldwin proposed a change to openstack/neutron: Simplify ip allocation/recycling to relieve db pressure https://review.openstack.org/58017 | 18:26 |
| *** markmcclain has quit IRC | 18:26 | |
| *** SushilKM has joined #openstack-neutron | 18:27 | |
| *** Abhishek has joined #openstack-neutron | 18:29 | |
| *** openstackgerrit has quit IRC | 18:33 | |
| *** openstackgerrit has joined #openstack-neutron | 18:33 | |
| *** fouxm has quit IRC | 18:34 | |
| *** safchain has quit IRC | 18:45 | |
| *** jistr has joined #openstack-neutron | 19:00 | |
| openstackgerrit | Carl Baldwin proposed a change to openstack/neutron: Use information from the dnsmasq hosts file to call dhcp_release https://review.openstack.org/56263 | 19:02 |
| openstackgerrit | Nachi Ueno proposed a change to openstack/neutron: Fix misspells https://review.openstack.org/59809 | 19:10 |
| *** chandankumar has quit IRC | 19:15 | |
| *** amuller has quit IRC | 19:23 | |
| openstackgerrit | Carl Baldwin proposed a change to openstack/neutron: Remove release_lease from the DHCP driver interface https://review.openstack.org/56285 | 19:24 |
| *** jlibosva has quit IRC | 19:25 | |
| *** ivar-lazzaro has quit IRC | 19:28 | |
| *** wcaban has joined #openstack-neutron | 19:30 | |
| openstackgerrit | Nachi Ueno proposed a change to openstack/neutron: Improve vif attributes related with firewalling https://review.openstack.org/21946 | 19:33 |
| *** alagalah has left #openstack-neutron | 19:35 | |
| *** BillTheKat has quit IRC | 19:41 | |
| *** otherwiseguy has quit IRC | 19:43 | |
| *** gdubreui has joined #openstack-neutron | 19:44 | |
| openstackgerrit | Nachi Ueno proposed a change to openstack/neutron: Fix misspells https://review.openstack.org/59809 | 19:49 |
| openstackgerrit | Carl Baldwin proposed a change to openstack/neutron: Simplify ip allocation/recycling to relieve db pressure https://review.openstack.org/58017 | 19:49 |
| *** yfried has quit IRC | 19:59 | |
| *** yfried has joined #openstack-neutron | 19:59 | |
| *** dhellmann has quit IRC | 20:04 | |
| *** dhellmann has joined #openstack-neutron | 20:09 | |
| *** steven-weston has quit IRC | 20:13 | |
| *** salv-orlando has joined #openstack-neutron | 20:17 | |
| *** suresh12 has quit IRC | 20:18 | |
| *** Abhishek has quit IRC | 20:25 | |
| *** SushilKM has quit IRC | 20:27 | |
| *** Abhishek has joined #openstack-neutron | 20:27 | |
| *** salv-orlando_ has joined #openstack-neutron | 20:28 | |
| *** suresh12 has joined #openstack-neutron | 20:28 | |
| *** salv-orlando has quit IRC | 20:30 | |
| *** networkstatic has joined #openstack-neutron | 20:31 | |
| *** salv-orlando has joined #openstack-neutron | 20:31 | |
| *** salv-orlando_ has quit IRC | 20:33 | |
| openstackgerrit | A change was merged to openstack/neutron: Cisco nexus plugin fails to untrunk vlan if other hosts using vlan https://review.openstack.org/54612 | 20:42 |
| *** jistr has quit IRC | 20:48 | |
| *** salv-orlando has quit IRC | 20:51 | |
| *** dhellmann has quit IRC | 20:58 | |
| *** dhellmann has joined #openstack-neutron | 20:59 | |
| openstackgerrit | Aaron Rosen proposed a change to openstack/python-neutronclient: Fix neutron port-create --no-security-groups https://review.openstack.org/59836 | 21:04 |
| *** dhellmann has quit IRC | 21:13 | |
| openstackgerrit | Darragh O'Reilly proposed a change to openstack/neutron: Prevent race calling brctl addif in linuxbridge agent https://review.openstack.org/59720 | 21:19 |
| *** amuller has joined #openstack-neutron | 21:22 | |
| *** networkstatic has quit IRC | 21:30 | |
| *** amuller has quit IRC | 21:32 | |
| *** safchain has joined #openstack-neutron | 21:59 | |
| *** safchain has quit IRC | 21:59 | |
| openstackgerrit | Carl Baldwin proposed a change to openstack/neutron: Simplify ip allocation/recycling to relieve db pressure https://review.openstack.org/58017 | 22:04 |
| *** yfried has quit IRC | 22:08 | |
| *** aveiga has quit IRC | 22:08 | |
| *** pcm_ has quit IRC | 22:09 | |
| *** aymenfrikha has quit IRC | 22:16 | |
| *** salv-orlando has joined #openstack-neutron | 22:33 | |
| openstackgerrit | dekehn proposed a change to openstack/neutron: Add checks for empty strings https://review.openstack.org/59858 | 22:44 |
| *** alagalah has joined #openstack-neutron | 22:56 | |
| *** alagalah has left #openstack-neutron | 22:57 | |
| *** jpich has quit IRC | 23:01 | |
| openstackgerrit | Ed Bak proposed a change to openstack/neutron: Change to improve dhcp-agent sync_state https://review.openstack.org/59863 | 23:03 |
| *** devlaps has quit IRC | 23:05 | |
| *** clev has quit IRC | 23:06 | |
| *** peristeri has quit IRC | 23:11 | |
| *** x86brandon has quit IRC | 23:12 | |
| *** jecarey has quit IRC | 23:13 | |
| *** sc68cal has quit IRC | 23:17 | |
| *** sc68cal has joined #openstack-neutron | 23:18 | |
| openstackgerrit | Aaron Rosen proposed a change to openstack/neutron: Bump api_workers from 0 to 4 https://review.openstack.org/59787 | 23:23 |
| *** sbasam has quit IRC | 23:23 | |
| openstackgerrit | Carl Baldwin proposed a change to openstack/neutron: Simplify ip allocation/recycling to relieve db pressure https://review.openstack.org/58017 | 23:25 |
| openstackgerrit | Terry Wilson proposed a change to openstack/neutron: Add vpnaas and debug filters to setup.cfg https://review.openstack.org/59870 | 23:27 |
| *** nati_uen_ has joined #openstack-neutron | 23:28 | |
| *** nati_uen_ has quit IRC | 23:29 | |
| ekarlso | what notification does Neutron send on FloatingIP allocation and de-allocation ? | 23:30 |
| *** nati_uen_ has joined #openstack-neutron | 23:30 | |
| *** networkstatic has joined #openstack-neutron | 23:30 | |
| openstackgerrit | Nachi Ueno proposed a change to openstack/neutron: Fix misspells https://review.openstack.org/59809 | 23:30 |
| *** nati_ueno has quit IRC | 23:30 | |
| *** bvandenh has joined #openstack-neutron | 23:30 | |
| *** networkstatic has quit IRC | 23:31 | |
| *** banix has quit IRC | 23:33 | |
| *** yamahata_ has quit IRC | 23:34 | |
| *** aymenfrikha has joined #openstack-neutron | 23:55 | |
| *** openstackgerrit has quit IRC | 23:56 | |
| *** openstackgerrit has joined #openstack-neutron | 23:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!