*** jamielennox|away is now known as jamielennox | 00:00 | |
*** banix has joined #openstack-neutron | 00:01 | |
*** lnicolas has quit IRC | 00:04 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Add common way to extend standard attribute models https://review.openstack.org/364681 | 00:05 |
---|---|---|
*** wu_ng has quit IRC | 00:06 | |
*** wu_ng has joined #openstack-neutron | 00:06 | |
*** lnicolas has joined #openstack-neutron | 00:07 | |
*** lujinluo has joined #openstack-neutron | 00:08 | |
liuyulong_ | haleyb, kevinbenton, garyk, hi, guys, https://review.openstack.org/#/c/369846/ and https://review.openstack.org/#/c/312849/, Jenkins has +1 on them, can we get them in ? | 00:08 |
openstackgerrit | Kevin Benton proposed openstack/neutron: Catch DBReferenceError in IPAM and convert to retry https://review.openstack.org/369992 | 00:10 |
liuyulong_ | haleyb, thank you for adding the bug 1607746 to rc1. : ) | 00:10 |
openstack | bug 1607746 in neutron "Update floating IP extra attributes will unexpectedly disassociate it" [Medium,In progress] https://launchpad.net/bugs/1607746 - Assigned to LIU Yulong (dragon889) | 00:10 |
*** lucas-dinner has quit IRC | 00:10 | |
*** hieulq has joined #openstack-neutron | 00:13 | |
*** lucasagomes has joined #openstack-neutron | 00:16 | |
*** thorst has joined #openstack-neutron | 00:17 | |
*** liuyulong_ has quit IRC | 00:17 | |
*** mfuruta has joined #openstack-neutron | 00:18 | |
*** Swami__ has joined #openstack-neutron | 00:19 | |
*** abhiraut has quit IRC | 00:19 | |
*** Swami_ has quit IRC | 00:22 | |
*** thorst has quit IRC | 00:24 | |
*** hoangcx has joined #openstack-neutron | 00:26 | |
*** ivar-laz_ has joined #openstack-neutron | 00:26 | |
*** ivar-laz_ has quit IRC | 00:27 | |
*** banix has quit IRC | 00:28 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Catch DBReferenceError in IPAM and convert to retry https://review.openstack.org/369992 | 00:29 |
*** ivar-lazzaro has quit IRC | 00:30 | |
*** Swami__ has quit IRC | 00:36 | |
*** Swami__ has joined #openstack-neutron | 00:37 | |
*** jlvillal has quit IRC | 00:41 | |
*** vishwanathj has quit IRC | 00:43 | |
*** abhiraut has joined #openstack-neutron | 00:45 | |
*** rkrum has joined #openstack-neutron | 00:46 | |
*** jlvillal has joined #openstack-neutron | 00:46 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Catch DBReferenceError in IPAM and convert to retry https://review.openstack.org/369992 | 00:47 |
*** jlvillal has quit IRC | 00:47 | |
*** jlvillal has joined #openstack-neutron | 00:47 | |
*** jlvillal has quit IRC | 00:47 | |
*** jlvillal has joined #openstack-neutron | 00:47 | |
openstackgerrit | Jamie Lennox proposed openstack/neutron: Use to_policy_values for policy enforcement https://review.openstack.org/370499 | 00:48 |
openstackgerrit | Sindhu Devale proposed openstack/neutron-lib: [WIP] api-ref: Fix api-ref for port-binding https://review.openstack.org/364579 | 00:50 |
openstackgerrit | Kevin Benton proposed openstack/neutron: Mark CRUD methods in agent schedulers DB as retriable https://review.openstack.org/367183 | 00:50 |
*** akshai has joined #openstack-neutron | 00:51 | |
*** akshai has quit IRC | 00:53 | |
*** gongysh has joined #openstack-neutron | 00:55 | |
*** rkrum has quit IRC | 01:02 | |
*** azbiswas has joined #openstack-neutron | 01:04 | |
*** hoangcx has quit IRC | 01:05 | |
*** abhiraut has quit IRC | 01:08 | |
*** namnh has joined #openstack-neutron | 01:08 | |
*** itsuugo has quit IRC | 01:08 | |
*** itsuugo has joined #openstack-neutron | 01:10 | |
openstackgerrit | Merged openstack/neutron: Implementation of vlan-aware-vms for Linux Bridge https://review.openstack.org/346377 | 01:10 |
*** mmedvede has joined #openstack-neutron | 01:13 | |
*** pramod has quit IRC | 01:13 | |
*** bana_k has quit IRC | 01:14 | |
openstackgerrit | Brian Haley proposed openstack/neutron: Fix migration of legacy router to DVR https://review.openstack.org/370430 | 01:14 |
*** itsuugo has quit IRC | 01:15 | |
*** itsuugo has joined #openstack-neutron | 01:16 | |
*** ijw has quit IRC | 01:17 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Include timezone in timestamp fields https://review.openstack.org/368682 | 01:17 |
openstackgerrit | Kevin Benton proposed openstack/neutron: Add common way to extend standard attribute models https://review.openstack.org/364681 | 01:17 |
*** thorst has joined #openstack-neutron | 01:21 | |
*** itsuugo has quit IRC | 01:22 | |
*** itsuugo has joined #openstack-neutron | 01:22 | |
*** ijw has joined #openstack-neutron | 01:25 | |
*** chandanc__ has joined #openstack-neutron | 01:26 | |
*** kevo has quit IRC | 01:27 | |
*** EinstCrazy has joined #openstack-neutron | 01:27 | |
*** itsuugo has quit IRC | 01:27 | |
*** itsuugo has joined #openstack-neutron | 01:28 | |
*** thorst has quit IRC | 01:29 | |
*** hoangcx has joined #openstack-neutron | 01:30 | |
*** s3wong has quit IRC | 01:31 | |
*** EinstCrazy has quit IRC | 01:33 | |
*** gvrangan has quit IRC | 01:33 | |
*** thorst has joined #openstack-neutron | 01:35 | |
*** bana_k has joined #openstack-neutron | 01:35 | |
*** Leom has quit IRC | 01:36 | |
*** mickeys has quit IRC | 01:36 | |
*** Sukhdev has quit IRC | 01:37 | |
*** baoli has joined #openstack-neutron | 01:39 | |
*** baoli has quit IRC | 01:41 | |
*** salv-orlando has joined #openstack-neutron | 01:41 | |
*** baoli has joined #openstack-neutron | 01:41 | |
*** john-davidge has joined #openstack-neutron | 01:42 | |
*** chandanc__ has quit IRC | 01:42 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Add common way to extend standard attribute models https://review.openstack.org/364681 | 01:42 |
*** salv-orl_ has quit IRC | 01:43 | |
*** thorst has quit IRC | 01:45 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Catch DBReferenceError in IPAM and convert to retry https://review.openstack.org/369992 | 01:46 |
openstackgerrit | Kevin Benton proposed openstack/neutron: Don't raise RetryRequest for port in delete_subnet https://review.openstack.org/370508 | 01:46 |
*** baoli has quit IRC | 01:46 | |
*** john-davidge has quit IRC | 01:46 | |
*** gongysh has quit IRC | 01:47 | |
*** jckasper has quit IRC | 01:48 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Include timezone in timestamp fields https://review.openstack.org/368682 | 01:48 |
*** itsuugo has quit IRC | 01:48 | |
*** itsuugo has joined #openstack-neutron | 01:50 | |
*** tflynn_ has joined #openstack-neutron | 01:52 | |
*** itsuugo has quit IRC | 01:55 | |
*** tflynn has quit IRC | 01:55 | |
*** ijw has quit IRC | 01:56 | |
*** tflynn_ has quit IRC | 01:56 | |
*** itsuugo has joined #openstack-neutron | 01:57 | |
*** hoangcx has quit IRC | 02:00 | |
*** wolverineav has joined #openstack-neutron | 02:01 | |
*** rmcall has quit IRC | 02:02 | |
*** rmcall has joined #openstack-neutron | 02:03 | |
*** ijw has joined #openstack-neutron | 02:05 | |
*** marun has quit IRC | 02:06 | |
*** itsuugo has quit IRC | 02:08 | |
*** itsuugo has joined #openstack-neutron | 02:09 | |
*** iyamahat has quit IRC | 02:09 | |
*** itsuugo has quit IRC | 02:16 | |
*** bkopilov has quit IRC | 02:16 | |
*** itsuugo has joined #openstack-neutron | 02:17 | |
*** wolverin_ has joined #openstack-neutron | 02:19 | |
*** wolverineav has quit IRC | 02:21 | |
*** itsuugo has quit IRC | 02:22 | |
*** namnh has quit IRC | 02:22 | |
*** itsuugo has joined #openstack-neutron | 02:23 | |
*** michchap has quit IRC | 02:26 | |
*** michchap has joined #openstack-neutron | 02:26 | |
*** marun has joined #openstack-neutron | 02:28 | |
*** itsuugo has quit IRC | 02:29 | |
*** itsuugo has joined #openstack-neutron | 02:30 | |
*** absubram has quit IRC | 02:31 | |
*** marun has quit IRC | 02:32 | |
openstackgerrit | Merged openstack/neutron: Refactor for floating IP updating checks https://review.openstack.org/369846 | 02:33 |
openstackgerrit | Merged openstack/neutron: Correct floating IP extra attributes updating issues https://review.openstack.org/312849 | 02:33 |
*** itsuugo has quit IRC | 02:35 | |
*** itsuugo has joined #openstack-neutron | 02:36 | |
*** shangxdy has joined #openstack-neutron | 02:36 | |
*** itsuugo has quit IRC | 02:43 | |
*** itsuugo has joined #openstack-neutron | 02:44 | |
*** iyamahat has joined #openstack-neutron | 02:46 | |
*** thorst has joined #openstack-neutron | 02:47 | |
*** yuanying has quit IRC | 02:47 | |
*** itsuugo has quit IRC | 02:48 | |
*** mriedem has quit IRC | 02:49 | |
openstackgerrit | bin proposed openstack/neutron: Add routed network scenario test cases https://review.openstack.org/347188 | 02:49 |
*** itsuugo has joined #openstack-neutron | 02:50 | |
*** gongysh has joined #openstack-neutron | 02:50 | |
openstackgerrit | Hirofumi Ichihara proposed openstack/neutron: [WIP] Add QoS minimum egress bandwidth rule into ovs-agent https://review.openstack.org/318531 | 02:50 |
*** hoangcx has joined #openstack-neutron | 02:54 | |
*** thorst has quit IRC | 02:56 | |
*** rmcall has quit IRC | 02:59 | |
*** rmcall has joined #openstack-neutron | 02:59 | |
*** shangxdy has quit IRC | 03:00 | |
*** itsuugo has quit IRC | 03:01 | |
*** sdake has joined #openstack-neutron | 03:01 | |
*** Leo_ has joined #openstack-neutron | 03:03 | |
*** itsuugo has joined #openstack-neutron | 03:03 | |
*** ijw has quit IRC | 03:04 | |
*** ijw has joined #openstack-neutron | 03:05 | |
*** itsuugo has quit IRC | 03:08 | |
*** fnaval has quit IRC | 03:09 | |
*** SKipp has quit IRC | 03:09 | |
*** chandanc__ has joined #openstack-neutron | 03:10 | |
*** itsuugo has joined #openstack-neutron | 03:10 | |
*** iyamahat has quit IRC | 03:10 | |
*** yamahata has quit IRC | 03:11 | |
*** marun has joined #openstack-neutron | 03:13 | |
*** ijw has quit IRC | 03:13 | |
*** itsuugo has quit IRC | 03:17 | |
*** itsuugo has joined #openstack-neutron | 03:18 | |
*** gouthamr has quit IRC | 03:19 | |
*** namnh has joined #openstack-neutron | 03:19 | |
*** gongysh has quit IRC | 03:21 | |
*** marun has quit IRC | 03:22 | |
*** itsuugo has quit IRC | 03:23 | |
*** marst has joined #openstack-neutron | 03:23 | |
*** namnh has quit IRC | 03:24 | |
*** itsuugo has joined #openstack-neutron | 03:24 | |
*** marun has joined #openstack-neutron | 03:24 | |
*** fnaval has joined #openstack-neutron | 03:25 | |
*** gongysh has joined #openstack-neutron | 03:25 | |
*** namnh has joined #openstack-neutron | 03:25 | |
*** namnh has joined #openstack-neutron | 03:25 | |
*** namnh has quit IRC | 03:26 | |
*** namnh has joined #openstack-neutron | 03:27 | |
*** baojg has joined #openstack-neutron | 03:27 | |
*** namnh has quit IRC | 03:27 | |
*** chandanc__ has quit IRC | 03:27 | |
*** namnh has joined #openstack-neutron | 03:27 | |
*** hoangcx has quit IRC | 03:28 | |
*** fzdarsky has joined #openstack-neutron | 03:29 | |
*** hoangcx has joined #openstack-neutron | 03:31 | |
*** bkopilov has joined #openstack-neutron | 03:33 | |
*** itsuugo has quit IRC | 03:33 | |
*** vishwanathj_ has joined #openstack-neutron | 03:35 | |
*** itsuugo has joined #openstack-neutron | 03:36 | |
*** namnh has quit IRC | 03:39 | |
*** namnh has joined #openstack-neutron | 03:40 | |
*** namnh has quit IRC | 03:40 | |
*** itsuugo has quit IRC | 03:41 | |
*** namnh has joined #openstack-neutron | 03:41 | |
*** namnh has quit IRC | 03:41 | |
*** namnh has joined #openstack-neutron | 03:42 | |
*** itsuugo has joined #openstack-neutron | 03:42 | |
*** namnh has quit IRC | 03:43 | |
*** namnh has joined #openstack-neutron | 03:44 | |
*** thorst has joined #openstack-neutron | 03:44 | |
*** thorst has quit IRC | 03:46 | |
*** jckasper has joined #openstack-neutron | 03:48 | |
*** ijw_ has joined #openstack-neutron | 03:49 | |
*** yuanying has joined #openstack-neutron | 03:51 | |
*** itsuugo has quit IRC | 03:51 | |
*** itsuugo has joined #openstack-neutron | 03:52 | |
*** hoangcx has quit IRC | 03:53 | |
*** ijw_ has quit IRC | 03:54 | |
*** jckasper has quit IRC | 03:54 | |
*** chandanc__ has joined #openstack-neutron | 03:55 | |
*** kevo has joined #openstack-neutron | 03:58 | |
*** itsuugo has quit IRC | 03:59 | |
*** itsuugo has joined #openstack-neutron | 04:00 | |
*** hoangcx has joined #openstack-neutron | 04:05 | |
*** phschwartz has quit IRC | 04:07 | |
*** mordred has quit IRC | 04:08 | |
*** iyamahat has joined #openstack-neutron | 04:09 | |
*** mordred has joined #openstack-neutron | 04:10 | |
*** itsuugo has quit IRC | 04:10 | |
*** phschwartz has joined #openstack-neutron | 04:11 | |
*** itsuugo has joined #openstack-neutron | 04:12 | |
*** fzdarsky has quit IRC | 04:13 | |
*** ratailor has joined #openstack-neutron | 04:14 | |
*** mtaylor22 has joined #openstack-neutron | 04:14 | |
*** iyamahat has quit IRC | 04:15 | |
*** itsuugo has quit IRC | 04:16 | |
*** itsuugo has joined #openstack-neutron | 04:18 | |
*** Swami__ has quit IRC | 04:21 | |
*** yushiro has joined #openstack-neutron | 04:23 | |
*** itsuugo has quit IRC | 04:23 | |
*** yamamoto_ has joined #openstack-neutron | 04:24 | |
*** itsuugo has joined #openstack-neutron | 04:24 | |
*** ociuhandu has joined #openstack-neutron | 04:24 | |
*** Alex_Stef has joined #openstack-neutron | 04:26 | |
*** itsuugo has quit IRC | 04:29 | |
*** thorst has joined #openstack-neutron | 04:29 | |
*** fragatin_ has joined #openstack-neutron | 04:29 | |
*** itsuugo has joined #openstack-neutron | 04:29 | |
*** iyamahat has joined #openstack-neutron | 04:32 | |
*** fragatina has quit IRC | 04:32 | |
*** fragatin_ has quit IRC | 04:33 | |
*** itsuugo has quit IRC | 04:34 | |
*** itsuugo has joined #openstack-neutron | 04:35 | |
*** jhershbe has joined #openstack-neutron | 04:35 | |
*** abregman has joined #openstack-neutron | 04:38 | |
*** thorst has quit IRC | 04:39 | |
*** itsuugo has quit IRC | 04:40 | |
*** adriant has quit IRC | 04:40 | |
*** itsuugo has joined #openstack-neutron | 04:41 | |
*** mkolesni has joined #openstack-neutron | 04:42 | |
*** shausy has joined #openstack-neutron | 04:45 | |
*** thorst has joined #openstack-neutron | 04:45 | |
*** aswadr_ has joined #openstack-neutron | 04:49 | |
*** itsuugo has quit IRC | 04:53 | |
*** itsuugo has joined #openstack-neutron | 04:54 | |
*** gvrangan has joined #openstack-neutron | 04:56 | |
*** thorst has quit IRC | 04:58 | |
*** thorst has joined #openstack-neutron | 04:58 | |
*** Jeffrey4l__ has joined #openstack-neutron | 05:00 | |
*** donghao has quit IRC | 05:01 | |
*** sdake has quit IRC | 05:03 | |
*** thetrav has joined #openstack-neutron | 05:03 | |
*** itsuugo has quit IRC | 05:03 | |
thetrav | so I've got an external network here that has the implicit "everyone has access" rbac wildcard | 05:03 |
thetrav | it's used by one project right now | 05:03 |
thetrav | I want to change the rbac so only that project can access it | 05:04 |
thetrav | I trued adding a new rbac that specified that project and then deleting the wildcard, however it appears to be unhappy with that | 05:04 |
*** Jeffrey4l_ has quit IRC | 05:04 | |
thetrav | it assumes because there's a router, that the wildcard rbac is necessary | 05:04 |
*** itsuugo has joined #openstack-neutron | 05:04 | |
thetrav | is there an alternative I can make use of? | 05:04 |
thetrav | some "skip validation" or "force" or "no really, I know what I'm doing" argument? | 05:05 |
*** thorst has quit IRC | 05:07 | |
*** kevo has quit IRC | 05:07 | |
*** yamamoto_ has quit IRC | 05:07 | |
*** slaweq_ has joined #openstack-neutron | 05:08 | |
*** ivar-lazzaro has joined #openstack-neutron | 05:08 | |
*** yamamoto_ has joined #openstack-neutron | 05:09 | |
*** thorst has joined #openstack-neutron | 05:09 | |
*** itsuugo has quit IRC | 05:10 | |
*** itsuugo has joined #openstack-neutron | 05:10 | |
*** ivar-laz_ has joined #openstack-neutron | 05:12 | |
*** vikram has joined #openstack-neutron | 05:12 | |
*** jprovazn has joined #openstack-neutron | 05:13 | |
*** iyamahat has quit IRC | 05:13 | |
*** iyamahat_ has joined #openstack-neutron | 05:13 | |
*** thorst has quit IRC | 05:13 | |
*** ganeshnalawade has joined #openstack-neutron | 05:14 | |
*** ivar-lazzaro has quit IRC | 05:14 | |
*** thorst has joined #openstack-neutron | 05:15 | |
*** pgadiya has joined #openstack-neutron | 05:16 | |
*** rcernin has joined #openstack-neutron | 05:17 | |
*** yamamoto_ has quit IRC | 05:19 | |
*** thorst has quit IRC | 05:19 | |
*** itsuugo has quit IRC | 05:20 | |
*** ivar-laz_ has quit IRC | 05:20 | |
*** ganeshnalawade has quit IRC | 05:20 | |
*** dane_leblanc has quit IRC | 05:21 | |
*** itsuugo has joined #openstack-neutron | 05:21 | |
*** ganeshnalawade has joined #openstack-neutron | 05:22 | |
*** sdake has joined #openstack-neutron | 05:22 | |
*** bzhao has quit IRC | 05:25 | |
*** john-davidge has joined #openstack-neutron | 05:25 | |
*** bzhao has joined #openstack-neutron | 05:25 | |
*** itsuugo has quit IRC | 05:26 | |
*** itsuugo has joined #openstack-neutron | 05:28 | |
*** adriant has joined #openstack-neutron | 05:29 | |
*** john-davidge has quit IRC | 05:29 | |
*** gouthamr has joined #openstack-neutron | 05:31 | |
*** fragatina has joined #openstack-neutron | 05:32 | |
*** thorst has joined #openstack-neutron | 05:34 | |
*** vishwanathj_ has quit IRC | 05:36 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Stop olso_messaging from error logging CallbackNotFound https://review.openstack.org/370543 | 05:37 |
*** fragatina has quit IRC | 05:37 | |
*** itsuugo has quit IRC | 05:37 | |
*** itsuugo has joined #openstack-neutron | 05:38 | |
*** gvrangan has quit IRC | 05:38 | |
*** markvoelker has quit IRC | 05:41 | |
*** Leo_ has quit IRC | 05:41 | |
*** iwamoto has joined #openstack-neutron | 05:42 | |
*** thorst has quit IRC | 05:42 | |
*** itsuugo has quit IRC | 05:43 | |
*** itsuugo has joined #openstack-neutron | 05:43 | |
*** thorst has joined #openstack-neutron | 05:44 | |
*** hynekm has joined #openstack-neutron | 05:44 | |
*** vishwanathj has joined #openstack-neutron | 05:47 | |
*** azbiswas has quit IRC | 05:47 | |
*** ganeshnalawade has quit IRC | 05:48 | |
*** gvrangan has joined #openstack-neutron | 05:48 | |
*** donghao has joined #openstack-neutron | 05:48 | |
*** thorst has quit IRC | 05:49 | |
*** oshvartz has joined #openstack-neutron | 05:49 | |
*** thorst has joined #openstack-neutron | 05:50 | |
*** itsuugo has quit IRC | 05:51 | |
*** itsuugo has joined #openstack-neutron | 05:51 | |
*** s3wong has joined #openstack-neutron | 05:52 | |
*** ganeshnalawade has joined #openstack-neutron | 05:52 | |
*** lihi has joined #openstack-neutron | 05:55 | |
*** thorst has quit IRC | 05:55 | |
*** itsuugo has quit IRC | 05:56 | |
*** oanson has joined #openstack-neutron | 05:56 | |
*** thorst has joined #openstack-neutron | 05:56 | |
*** mosulica has joined #openstack-neutron | 05:57 | |
*** itsuugo has joined #openstack-neutron | 05:58 | |
*** thorst has quit IRC | 06:01 | |
*** nherciu has joined #openstack-neutron | 06:02 | |
*** thorst has joined #openstack-neutron | 06:02 | |
*** itsuugo has quit IRC | 06:03 | |
*** yamamoto_ has joined #openstack-neutron | 06:03 | |
*** itsuugo has joined #openstack-neutron | 06:03 | |
*** pcaruana has joined #openstack-neutron | 06:04 | |
*** karthiks has joined #openstack-neutron | 06:06 | |
*** thorst has quit IRC | 06:07 | |
*** tflynn has joined #openstack-neutron | 06:08 | |
*** thorst has joined #openstack-neutron | 06:08 | |
*** tflynn has quit IRC | 06:09 | |
*** tflynn has joined #openstack-neutron | 06:09 | |
*** karthiks has quit IRC | 06:10 | |
*** kobis has joined #openstack-neutron | 06:13 | |
*** pcaruana is now known as pcaruana|afk| | 06:13 | |
*** claudiub has joined #openstack-neutron | 06:15 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Don't warn in VLAN Plumber on tagless children https://review.openstack.org/370551 | 06:16 |
*** ushkalim has quit IRC | 06:16 | |
*** thorst has quit IRC | 06:17 | |
*** itsuugo has quit IRC | 06:18 | |
*** thorst has joined #openstack-neutron | 06:19 | |
*** itsuugo has joined #openstack-neutron | 06:19 | |
*** itzkb_ has joined #openstack-neutron | 06:20 | |
*** electrocucarach- has joined #openstack-neutron | 06:22 | |
*** thorst has quit IRC | 06:24 | |
*** karthiks has joined #openstack-neutron | 06:24 | |
*** thetrav has quit IRC | 06:25 | |
*** thorst has joined #openstack-neutron | 06:25 | |
*** kobis has quit IRC | 06:25 | |
*** absubram has joined #openstack-neutron | 06:26 | |
*** absubram_ has joined #openstack-neutron | 06:28 | |
*** kobis has joined #openstack-neutron | 06:28 | |
*** itsuugo has quit IRC | 06:28 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Catch DBReferenceError in IPAM and convert to retry https://review.openstack.org/369992 | 06:30 |
openstackgerrit | Kevin Benton proposed openstack/neutron: Lock DHCP port impacting operations on network_id https://review.openstack.org/370251 | 06:30 |
*** thorst has quit IRC | 06:30 | |
*** andreas_s has joined #openstack-neutron | 06:30 | |
*** ganeshnalawade has quit IRC | 06:30 | |
*** itsuugo has joined #openstack-neutron | 06:30 | |
*** wolverin_ has quit IRC | 06:31 | |
*** wolverineav has joined #openstack-neutron | 06:31 | |
*** absubram has quit IRC | 06:31 | |
*** adriant has quit IRC | 06:32 | |
*** thorst has joined #openstack-neutron | 06:32 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Catch DBReferenceError in IPAM and convert to SubnetNotFound https://review.openstack.org/369992 | 06:32 |
*** absubram_ has quit IRC | 06:34 | |
*** ganeshnalawade has joined #openstack-neutron | 06:34 | |
*** sdake has quit IRC | 06:36 | |
*** thorst has quit IRC | 06:36 | |
*** itsuugo has quit IRC | 06:37 | |
*** absubram has joined #openstack-neutron | 06:38 | |
*** itsuugo has joined #openstack-neutron | 06:38 | |
*** wolverineav has quit IRC | 06:39 | |
*** pcaruana|afk| is now known as pcaruana | 06:40 | |
*** nyechiel has joined #openstack-neutron | 06:41 | |
*** wolverineav has joined #openstack-neutron | 06:41 | |
*** gouthamr has quit IRC | 06:41 | |
*** iranzo has joined #openstack-neutron | 06:42 | |
*** iranzo has joined #openstack-neutron | 06:42 | |
*** itsuugo has quit IRC | 06:44 | |
*** thorst has joined #openstack-neutron | 06:44 | |
*** jamielennox is now known as jamielennox|away | 06:45 | |
*** itsuugo has joined #openstack-neutron | 06:45 | |
*** wolverineav has quit IRC | 06:45 | |
*** donghao has quit IRC | 06:47 | |
*** bana_k has quit IRC | 06:49 | |
*** salv-orlando has quit IRC | 06:50 | |
*** salv-orlando has joined #openstack-neutron | 06:51 | |
*** thorst has quit IRC | 06:52 | |
*** sridharg has joined #openstack-neutron | 06:54 | |
*** thorst has joined #openstack-neutron | 06:54 | |
*** hoangcx has quit IRC | 06:55 | |
*** azbiswas has joined #openstack-neutron | 06:56 | |
*** hoangcx has joined #openstack-neutron | 06:56 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Stop olso_messaging from error logging CallbackNotFound https://review.openstack.org/370543 | 06:57 |
*** azbiswas has quit IRC | 06:58 | |
*** azbiswas has joined #openstack-neutron | 06:58 | |
*** absubram has quit IRC | 06:58 | |
*** thorst has quit IRC | 06:59 | |
*** itsuugo has quit IRC | 07:00 | |
*** thorst has joined #openstack-neutron | 07:00 | |
*** ushkalim has joined #openstack-neutron | 07:01 | |
*** iyamahat_ has quit IRC | 07:01 | |
*** iyamahat_ has joined #openstack-neutron | 07:02 | |
*** itsuugo has joined #openstack-neutron | 07:02 | |
*** thorst has quit IRC | 07:05 | |
*** tmorin has joined #openstack-neutron | 07:05 | |
*** ganeshnalawade has quit IRC | 07:06 | |
*** obondarev has joined #openstack-neutron | 07:07 | |
*** bjolo_ is now known as bjolo | 07:08 | |
iwamoto | yamamoto_: ping | 07:08 |
yamamoto_ | iwamoto: pong | 07:08 |
iwamoto | about bug/1622644 | 07:08 |
iwamoto | why did you set native of_interface to OF1.3 only? | 07:09 |
*** sleviim has joined #openstack-neutron | 07:09 | |
yamamoto_ | just because it uses that version | 07:09 |
iwamoto | so you didn't care third-party flow modifiers ATM? | 07:11 |
*** tflynn has quit IRC | 07:11 | |
yamamoto_ | right | 07:11 |
*** thorst has joined #openstack-neutron | 07:11 | |
yamamoto_ | i don't think it's reasonable to provide flow-level compat | 07:11 |
yamamoto_ | but i guess it doesn't hurt to accept other versions. | 07:13 |
iwamoto | just allow OF1.0 and hide the issue deep seems to be the way to go. :) | 07:15 |
*** rubasov has quit IRC | 07:15 | |
*** ganeshnalawade has joined #openstack-neutron | 07:16 | |
*** itsuugo has quit IRC | 07:17 | |
*** thorst has quit IRC | 07:17 | |
*** ekuris has joined #openstack-neutron | 07:17 | |
*** thorst has joined #openstack-neutron | 07:18 | |
*** itsuugo has joined #openstack-neutron | 07:18 | |
yamamoto_ | iwamoto: no need to hide. it's better to make it clear flow-level things are internal details which external entities should not rely on. | 07:20 |
*** thorst_ has joined #openstack-neutron | 07:21 | |
iwamoto | yamamoto_: and disallow external entities to use add_flows etc? | 07:22 |
*** nmagnezi_ has joined #openstack-neutron | 07:22 | |
*** nmagnezi_ has quit IRC | 07:22 | |
*** thorst has quit IRC | 07:23 | |
*** itsuugo has quit IRC | 07:23 | |
yamamoto_ | iwamoto: i don't claim we should disallow. my claim is that if they rely on the intenal details, it's their responsibility to catch up with incompatibilities. | 07:23 |
*** nmagnezi has joined #openstack-neutron | 07:24 | |
*** jpena|off is now known as jpena | 07:24 | |
*** matrohon has joined #openstack-neutron | 07:24 | |
yamamoto_ | ie. do not expect ovs-agent to provide compatibility at that level | 07:24 |
*** itsuugo has joined #openstack-neutron | 07:24 | |
iwamoto | yamamoto_: something like "you can call if you want but I make no promise"? | 07:25 |
*** thorst_ has quit IRC | 07:25 | |
yamamoto_ | iwamoto: exactly | 07:25 |
yamamoto_ | iwamoto: hopefully l2 extension flow management effort might make some promise | 07:27 |
*** akamyshnikova_ has joined #openstack-neutron | 07:27 | |
*** abregman_ has joined #openstack-neutron | 07:28 | |
*** itsuugo has quit IRC | 07:29 | |
*** jlanoux has joined #openstack-neutron | 07:29 | |
*** rubasov has joined #openstack-neutron | 07:30 | |
*** abregman has quit IRC | 07:30 | |
*** itsuugo has joined #openstack-neutron | 07:30 | |
*** abregman_ has quit IRC | 07:30 | |
*** abregman has joined #openstack-neutron | 07:32 | |
*** iwamoto has quit IRC | 07:33 | |
openstackgerrit | Mathieu Rohon proposed openstack/neutron: Send a callback before attaching a subnet to a router https://review.openstack.org/369221 | 07:33 |
*** jlibosva has joined #openstack-neutron | 07:34 | |
*** itsuugo has quit IRC | 07:35 | |
*** itsuugo has joined #openstack-neutron | 07:35 | |
*** hichihara has joined #openstack-neutron | 07:36 | |
openstackgerrit | Anh Tran proposed openstack/neutron-lib: api-ref: Refactoring parameters in Networks APIs https://review.openstack.org/355773 | 07:37 |
*** obondarev has quit IRC | 07:38 | |
*** obondarev has joined #openstack-neutron | 07:38 | |
*** abregman is now known as abregman|mtg | 07:39 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Catch DBReferenceError in IPAM and convert to SubnetNotFound https://review.openstack.org/369992 | 07:40 |
openstackgerrit | Kevin Benton proposed openstack/neutron: Lock DHCP port impacting operations on network_id https://review.openstack.org/370251 | 07:40 |
*** gongysh has quit IRC | 07:40 | |
*** tobasco has quit IRC | 07:40 | |
*** salv-orl_ has joined #openstack-neutron | 07:40 | |
*** chandanc__ has quit IRC | 07:41 | |
*** ushkalim has quit IRC | 07:41 | |
*** markvoelker has joined #openstack-neutron | 07:42 | |
*** salv-orlando has quit IRC | 07:43 | |
*** jlanoux has quit IRC | 07:46 | |
*** jlanoux_ has joined #openstack-neutron | 07:46 | |
*** itsuugo has quit IRC | 07:47 | |
*** neiljerram has quit IRC | 07:48 | |
*** markvoelker has quit IRC | 07:48 | |
*** eezhova has joined #openstack-neutron | 07:49 | |
frickler | this looks like a regression to me, as it did work for mitaka, can anyone try to confirm? https://bugs.launchpad.net/neutron/+bug/1623813 | 07:49 |
openstack | Launchpad bug 1623813 in OpenStack Compute (nova) "IPv6 address not shown in metadata" [Undecided,New] | 07:49 |
*** itsuugo has joined #openstack-neutron | 07:49 | |
*** gvrangan has quit IRC | 07:50 | |
*** jckasper has joined #openstack-neutron | 07:50 | |
*** Alex_Stef has quit IRC | 07:53 | |
*** jckasper has quit IRC | 07:55 | |
*** hoangcx has quit IRC | 07:56 | |
*** jamielennox|away is now known as jamielennox | 07:57 | |
*** iyamahat_ has quit IRC | 07:58 | |
*** zzzeek has quit IRC | 08:00 | |
*** bks has joined #openstack-neutron | 08:00 | |
*** zzzeek has joined #openstack-neutron | 08:00 | |
*** basilAB has quit IRC | 08:03 | |
*** azbiswas has quit IRC | 08:04 | |
*** basilAB has joined #openstack-neutron | 08:05 | |
*** yamahata has joined #openstack-neutron | 08:13 | |
*** amotoki has joined #openstack-neutron | 08:14 | |
*** Alex_Stef has joined #openstack-neutron | 08:15 | |
*** s3wong has quit IRC | 08:16 | |
openstackgerrit | Hynek Mlnarik proposed openstack/neutron: API tests: Check MTU sanity of trunk/subport https://review.openstack.org/364208 | 08:19 |
*** itsuugo has quit IRC | 08:32 | |
*** chandanc__ has joined #openstack-neutron | 08:32 | |
*** itsuugo has joined #openstack-neutron | 08:34 | |
*** hoangcx has joined #openstack-neutron | 08:35 | |
*** devvesa has joined #openstack-neutron | 08:36 | |
*** iyamahat has joined #openstack-neutron | 08:36 | |
*** eezhova has quit IRC | 08:37 | |
*** korzen has joined #openstack-neutron | 08:39 | |
*** roeyc has joined #openstack-neutron | 08:41 | |
*** ushkalim has joined #openstack-neutron | 08:42 | |
*** moshele has joined #openstack-neutron | 08:44 | |
*** itsuugo has quit IRC | 08:46 | |
*** Alex_Stef has quit IRC | 08:46 | |
*** itsuugo has joined #openstack-neutron | 08:46 | |
*** ushkalim has quit IRC | 08:47 | |
*** mtaylor22 has quit IRC | 08:48 | |
*** mickeys has joined #openstack-neutron | 08:49 | |
openstackgerrit | Merged openstack/neutron: Add release note for blueprint vlan-aware-vms https://review.openstack.org/360089 | 08:49 |
*** hoangcx has quit IRC | 08:50 | |
*** itsuugo has quit IRC | 08:51 | |
*** itsuugo has joined #openstack-neutron | 08:52 | |
openstackgerrit | Merged openstack/neutron: tests: don't override base object test class attributes https://review.openstack.org/370037 | 08:52 |
*** neiljerram has joined #openstack-neutron | 08:54 | |
*** mickeys has quit IRC | 08:55 | |
*** ihrachys has joined #openstack-neutron | 08:55 | |
*** hoangcx has joined #openstack-neutron | 08:55 | |
*** ratailor has quit IRC | 08:57 | |
*** abregman_ has joined #openstack-neutron | 08:59 | |
*** john-davidge has joined #openstack-neutron | 08:59 | |
*** mfuruta has quit IRC | 09:00 | |
*** john-dav_ has joined #openstack-neutron | 09:02 | |
*** john-davidge has quit IRC | 09:02 | |
*** efoley has joined #openstack-neutron | 09:02 | |
*** abregman|mtg has quit IRC | 09:02 | |
*** hichihara has quit IRC | 09:04 | |
*** azbiswas has joined #openstack-neutron | 09:04 | |
*** ganeshnalawade has quit IRC | 09:05 | |
*** itsuugo has quit IRC | 09:06 | |
*** ganeshnalawade has joined #openstack-neutron | 09:06 | |
*** ganeshnalawade has quit IRC | 09:08 | |
*** itsuugo has joined #openstack-neutron | 09:08 | |
*** watanabe_isao has joined #openstack-neutron | 09:08 | |
*** azbiswas has quit IRC | 09:09 | |
*** Alex_Stef has joined #openstack-neutron | 09:11 | |
*** fzdarsky has joined #openstack-neutron | 09:16 | |
*** itsuugo has quit IRC | 09:18 | |
*** vijaykc4 has joined #openstack-neutron | 09:18 | |
*** rossella_ has quit IRC | 09:18 | |
*** itsuugo has joined #openstack-neutron | 09:19 | |
*** pmannidi has quit IRC | 09:19 | |
*** rossella_ has joined #openstack-neutron | 09:19 | |
*** ganeshnalawade has joined #openstack-neutron | 09:19 | |
*** Alex_Stef has quit IRC | 09:19 | |
*** mvk has quit IRC | 09:20 | |
*** gabor_antal has joined #openstack-neutron | 09:21 | |
*** rvasilets__ has joined #openstack-neutron | 09:22 | |
*** hieulq has quit IRC | 09:22 | |
*** hieulq has joined #openstack-neutron | 09:22 | |
*** devvesa has quit IRC | 09:25 | |
*** sambetts|afk is now known as sambetts | 09:25 | |
*** alex_xu has quit IRC | 09:26 | |
*** alex_xu has joined #openstack-neutron | 09:27 | |
openstackgerrit | Thomas Morin proposed openstack/neutron: ovs agent, native ARP response: set Eth src/dst https://review.openstack.org/370639 | 09:28 |
*** jlanoux_ has quit IRC | 09:30 | |
*** jlanoux has joined #openstack-neutron | 09:30 | |
matrohon | ihrachys, tmorin : hi | 09:31 |
ihrachys | matrohon: ^ ? | 09:31 |
tmorin | hi matrohon | 09:31 |
matrohon | ihrachys, tmorin : what about targeting this bug as a rc candidate? https://bugs.launchpad.net/neutron/+bug/1623849 | 09:31 |
openstack | Launchpad bug 1623849 in neutron "openvswitch native agent, ARP responder response has wrong Eth headers" [Undecided,In progress] - Assigned to Thomas Morin (tmmorin-orange) | 09:31 |
matrohon | ihrachys, just reported by tmorin | 09:31 |
tmorin | tmorin: I think this is simple/obvious enough, but of course, other's opinion would be needed | 09:32 |
ihrachys | matrohon: done | 09:33 |
matrohon | ihrachys, thanks! | 09:33 |
ihrachys | matrohon: we have some other bugs that fix difference between flows for those drivers. | 09:33 |
ihrachys | matrohon: I wonder whether we could catch diverge in some automated way | 09:33 |
ihrachys | like set a bunch of resources, then dump and compare | 09:33 |
*** john-dav_ is now known as john-davidge | 09:35 | |
evrardjp | look at what we have here john-davidge | 09:35 |
evrardjp | WARNING neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [req-aeb126a7-2cb3-4771-b3fb-6bc6cac3f728 e63b79858e8c46d5b2c4c7070df6232e b19cdf8acf14406ba1faeee6b3ae8af5 - - -] Unable to schedule network 409e1273-da1a-472d-9556-77d99c309642: no agents available; will retry on subsequent port and subnet creation events. | 09:35 |
evrardjp | sorry for the long paste the others :) | 09:35 |
matrohon | ihrachys, sounds interesting, tmorin : thoughs? | 09:36 |
evrardjp | and good morning everyone | 09:36 |
matrohon | ihrachys, sound like an interesting topic to discuss with ryu guys during the summit | 09:36 |
*** thorst has joined #openstack-neutron | 09:38 | |
*** wolverineav has joined #openstack-neutron | 09:38 | |
tmorin | ihrachys, matrohon: yes, indeed, the idea sounds interesting | 09:39 |
*** eezhova has joined #openstack-neutron | 09:39 | |
*** devvesa has joined #openstack-neutron | 09:41 | |
*** wolverineav has quit IRC | 09:43 | |
*** markvoelker has joined #openstack-neutron | 09:44 | |
*** ganeshnalawade has quit IRC | 09:46 | |
*** iyamahat has quit IRC | 09:47 | |
*** Trident has joined #openstack-neutron | 09:48 | |
*** yamahata has quit IRC | 09:49 | |
*** markvoelker has quit IRC | 09:49 | |
*** mvk has joined #openstack-neutron | 09:50 | |
*** ganeshnalawade has joined #openstack-neutron | 09:50 | |
*** yushiro has quit IRC | 09:55 | |
*** lujinluo has quit IRC | 09:57 | |
*** itsuugo has quit IRC | 10:00 | |
*** salv-orl_ has quit IRC | 10:01 | |
*** itsuugo has joined #openstack-neutron | 10:01 | |
openstackgerrit | Mathieu Rohon proposed openstack/neutron: Send a callback before attaching a subnet to a router https://review.openstack.org/369221 | 10:04 |
*** moshele has quit IRC | 10:06 | |
*** moshele has joined #openstack-neutron | 10:06 | |
*** efoley has quit IRC | 10:07 | |
*** efoley has joined #openstack-neutron | 10:09 | |
*** hoangcx has quit IRC | 10:09 | |
*** roeyc has quit IRC | 10:09 | |
*** gongysh has joined #openstack-neutron | 10:10 | |
openstackgerrit | Kevin Benton proposed openstack/os-vif: Add MTU to Network model and use it in plugging https://review.openstack.org/370667 | 10:10 |
*** itsuugo has quit IRC | 10:11 | |
*** itsuugo has joined #openstack-neutron | 10:12 | |
*** clsqwerty_ has joined #openstack-neutron | 10:14 | |
*** clsqwerty_ has quit IRC | 10:15 | |
*** vijaykc4 has quit IRC | 10:16 | |
*** ganeshnalawade has quit IRC | 10:16 | |
*** ganeshnalawade has joined #openstack-neutron | 10:17 | |
*** mbirru has quit IRC | 10:19 | |
*** fzdarsky has quit IRC | 10:24 | |
*** itsuugo has quit IRC | 10:25 | |
*** itsuugo has joined #openstack-neutron | 10:27 | |
*** itsuugo has quit IRC | 10:32 | |
*** ramishra has quit IRC | 10:32 | |
*** itsuugo has joined #openstack-neutron | 10:32 | |
*** ganeshnalawade has quit IRC | 10:32 | |
*** ganeshnalawade has joined #openstack-neutron | 10:33 | |
*** ramishra has joined #openstack-neutron | 10:33 | |
*** boden has joined #openstack-neutron | 10:34 | |
*** fzdarsky has joined #openstack-neutron | 10:35 | |
*** itsuugo has quit IRC | 10:39 | |
*** moshele has quit IRC | 10:39 | |
*** itsuugo has joined #openstack-neutron | 10:41 | |
*** moshele has joined #openstack-neutron | 10:42 | |
*** ganeshnalawade has quit IRC | 10:43 | |
*** itsuugo has quit IRC | 10:46 | |
*** itsuugo has joined #openstack-neutron | 10:46 | |
*** ratailor has joined #openstack-neutron | 10:47 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Lock DHCP port impacting operations on network_id https://review.openstack.org/370251 | 10:48 |
openstackgerrit | Kevin Benton proposed openstack/neutron: [test]: expire_all() on session for retries https://review.openstack.org/370686 | 10:48 |
*** rtheis has joined #openstack-neutron | 10:48 | |
*** hieulq has quit IRC | 10:51 | |
*** hieulq has joined #openstack-neutron | 10:51 | |
*** vijaykc4 has joined #openstack-neutron | 10:54 | |
*** anilvenkata has joined #openstack-neutron | 10:56 | |
*** vijaykc4 has quit IRC | 11:00 | |
*** sdague has joined #openstack-neutron | 11:01 | |
*** baojg has quit IRC | 11:01 | |
*** chandanc__ has quit IRC | 11:01 | |
*** yamamoto_ has quit IRC | 11:01 | |
*** salv-orlando has joined #openstack-neutron | 11:02 | |
*** obondarev has quit IRC | 11:02 | |
*** donghao has joined #openstack-neutron | 11:05 | |
*** lucasagomes is now known as lucas-hungry | 11:06 | |
*** dave-mccowan has joined #openstack-neutron | 11:06 | |
*** roeyc has joined #openstack-neutron | 11:06 | |
*** salv-orlando has quit IRC | 11:06 | |
*** Alex_Stef has joined #openstack-neutron | 11:06 | |
kevinbenton | ihrachys: btw, the MTU thing may be a reason for our grenade failures | 11:07 |
ihrachys | kevinbenton: do we have failures there? I haven't heard about any lately | 11:08 |
openstackgerrit | Thomas Morin proposed openstack/neutron: ovs agent, native ARP response: set Eth src/dst https://review.openstack.org/370639 | 11:08 |
kevinbenton | ihrachys: it's hit on a few of my patches | 11:08 |
kevinbenton | ihrachys: test network basic ops fails at SSH after successful ping | 11:08 |
ihrachys | ok would be nice to have a bug reported with links and all so that we can track | 11:08 |
*** bkopilov has quit IRC | 11:08 | |
ihrachys | yeah, that's a symptom you would see | 11:08 |
kevinbenton | ihrachys: well the bug i filed agains nova would probably cover it | 11:10 |
*** efoley_ has joined #openstack-neutron | 11:10 | |
openstackgerrit | Kengo Hobo proposed openstack/neutron: Add check that external gw port exist in metering-agent https://review.openstack.org/368823 | 11:12 |
ihrachys | kevinbenton: ack | 11:12 |
ihrachys | kevinbenton: I have a test that uses the unfragmented pings, just polishing the code. | 11:12 |
*** vijaykc4 has joined #openstack-neutron | 11:12 | |
kevinbenton | ihrachys: the link i put in the bug report is to one of our grenade failures | 11:13 |
kevinbenton | ihrachys: where the mtu is 1500 on compute and 1450 on neutron | 11:13 |
ihrachys | kevinbenton: but how does it fail then? 1500 should allow anything <=1450 in without an issue | 11:13 |
*** efoley has quit IRC | 11:13 | |
ihrachys | kevinbenton: and instances use dhcp advertised mtu from dhcp agent | 11:13 |
ihrachys | so there should be no functional problem | 11:13 |
kevinbenton | ihrachys: true, it's probably completely unrelated :) | 11:14 |
kevinbenton | ihrachys: it's a good thing i misdiagnosed... | 11:14 |
*** jlanoux has quit IRC | 11:14 | |
ihrachys | yeah, it means that we have a limited scope of people affected. | 11:14 |
*** jlanoux has joined #openstack-neutron | 11:15 | |
kevinbenton | ihrachys: yeah, that actually means your ping test wouldn't detect this either... | 11:15 |
kevinbenton | ihrachys: unless network_device_mtu is set to something really low | 11:15 |
ihrachys | kevinbenton: it will if nova.conf configures network_device_mtu = 1400 | 11:15 |
ihrachys | yeap | 11:15 |
kevinbenton | ihrachys: ack | 11:15 |
ihrachys | which we can trigger with a simple depends-on | 11:15 |
*** jlanoux has quit IRC | 11:17 | |
*** jlanoux has joined #openstack-neutron | 11:17 | |
*** baojg has joined #openstack-neutron | 11:18 | |
*** vijaykc4 has quit IRC | 11:19 | |
*** sridharg has quit IRC | 11:19 | |
*** ganeshnalawade has joined #openstack-neutron | 11:20 | |
*** vijaykc4 has joined #openstack-neutron | 11:21 | |
*** ganeshnalawade has quit IRC | 11:23 | |
*** itsuugo has quit IRC | 11:23 | |
*** itsuugo has joined #openstack-neutron | 11:25 | |
*** roeyc has quit IRC | 11:26 | |
*** thorst has quit IRC | 11:27 | |
*** ganeshnalawade has joined #openstack-neutron | 11:27 | |
*** salv-orlando has joined #openstack-neutron | 11:28 | |
*** roeyc has joined #openstack-neutron | 11:29 | |
*** vijaykc4 has quit IRC | 11:30 | |
*** fragatina has joined #openstack-neutron | 11:30 | |
*** karthiks has quit IRC | 11:30 | |
*** karthiks has joined #openstack-neutron | 11:32 | |
*** fragatina has quit IRC | 11:34 | |
*** ccard has joined #openstack-neutron | 11:34 | |
*** pgadiya has quit IRC | 11:35 | |
*** yamamoto has joined #openstack-neutron | 11:38 | |
ccard | (Apologies if this is the wrong channel) we are seeing an issue where broadcast udp messages > 1500 bytes are sometimes getting thrown away by (we assume) the iptables rules on the qbrxxxxxxxx-xx linux bridge, but single cast udp messages of any size and broadcast udp messages <= 1500 bytes are ok. Is this a known issue? (we are on CentOS 7, OpenStack Juno, but just about to upgrade to Liberty) | 11:40 |
*** fzdarsky has quit IRC | 11:41 | |
*** ganeshnalawade has quit IRC | 11:41 | |
*** yamamoto has quit IRC | 11:41 | |
*** edmondsw has joined #openstack-neutron | 11:42 | |
*** ganeshnalawade has joined #openstack-neutron | 11:42 | |
*** jckasper has joined #openstack-neutron | 11:43 | |
*** jckasper has quit IRC | 11:43 | |
*** itsuugo has quit IRC | 11:43 | |
*** jckasper has joined #openstack-neutron | 11:44 | |
*** itsuugo has joined #openstack-neutron | 11:44 | |
*** ganeshnalawade has quit IRC | 11:44 | |
*** ftersin has joined #openstack-neutron | 11:44 | |
reedip | ccard : I think the mtu has the max limit of 1500 | 11:45 |
*** markvoelker has joined #openstack-neutron | 11:45 | |
*** andrey-mp has joined #openstack-neutron | 11:45 | |
reedip | kevinbenton , ihrachys : can you confirm ( this is what I recall ) ^^ | 11:45 |
ihrachys | reedip: ?? no | 11:45 |
ihrachys | ccard: I don't think we support Juno or even Kilo these days. | 11:46 |
*** obondarev has joined #openstack-neutron | 11:46 | |
ihrachys | ccard: there were significant mtu related fixes starting from Liberty. | 11:46 |
reedip | ihrachys : so the mtu is modifiable ?? | 11:47 |
*** yamamoto has joined #openstack-neutron | 11:47 | |
ccard | reedip: yes, the mtu is 1500, but it should still cope with UDP messages > 1500, and indeed does except for broadcast messages | 11:47 |
ihrachys | reedip: yes, depending on infrastructure | 11:48 |
ihrachys | ccard: how come should it? | 11:48 |
ihrachys | ccard: if it's larger than MTU, fullstop, the frame is dropped | 11:48 |
reedip | ihrachys : okay, didnt know that . Thanks :) | 11:48 |
ihrachys | ccard: if it's not that a bug ;) | 11:48 |
ccard | ihrachys: I don't think it's directly related to the mtu, since singlecast udp works fine | 11:48 |
ccard | mtu is at layer 3 isn't it, while udp is layer 4? | 11:49 |
*** ganeshnalawade has joined #openstack-neutron | 11:49 | |
*** baoli has joined #openstack-neutron | 11:49 | |
*** markvoelker has quit IRC | 11:50 | |
ccard | so I would expect a udp message > 1500 to be split into multiple frames | 11:50 |
ihrachys | ccard: oh, so your endpoint that generates the oversized udp packet supports higher mtu | 11:51 |
ihrachys | ccard: then indeed assuming you cross L3 boundary, your router should fragment | 11:51 |
*** yamamoto has quit IRC | 11:51 | |
ihrachys | ccard: unless you set 'don't fragment' in the header | 11:51 |
*** yamamoto has joined #openstack-neutron | 11:52 | |
openstackgerrit | Kevin Benton proposed openstack/os-vif: Add MTU to Network model and use it in plugging https://review.openstack.org/370667 | 11:52 |
ihrachys | ccard: this is the first time I hear about such particular scenario of failure | 11:52 |
ihrachys | ccard: anyhow, I suggest to retest on something supported by upstream first before getting deeper into debugging the issue | 11:53 |
ccard | ihrachys: the application is sending broadcast UDP packets (to 255.255.255.255) which are typically around 1600 bytes | 11:53 |
ihrachys | ccard: do you cross l3 boundary? | 11:53 |
ccard | we think that an iptables rule on the linux bridge is dropping some of them because it thinks they are INVALID. We see the packets on the qvb interface with tcpdump, but not on the qbr. | 11:54 |
*** jhershbe has quit IRC | 11:55 | |
ccard | if we disable the filtering (so the iptables rules are not used), everything works fine | 11:55 |
openstackgerrit | Kevin Benton proposed openstack/neutron: [test]: expire_all() on session for retries https://review.openstack.org/370686 | 11:56 |
openstackgerrit | Slawek Kaplonski proposed openstack/neutron: Metadata agent HA for nova-api services https://review.openstack.org/370727 | 11:56 |
openstackgerrit | Kevin Benton proposed openstack/neutron: Lock DHCP port impacting operations on network_id https://review.openstack.org/370251 | 11:56 |
anilvenkata | obondarev, shz I am on PTO for past 2 weeks, and will be back on monday | 11:56 |
anilvenkata | obondarev, shz will look into https://review.openstack.org/#/c/352440/ on monday | 11:56 |
anilvenkata | obondarev, shz thanks for the review | 11:57 |
obondarev | anilvenkata: np, thanks | 11:57 |
*** yamamoto has quit IRC | 11:57 | |
*** jckasper has quit IRC | 11:58 | |
*** anilvenkata has quit IRC | 11:58 | |
*** baoli_ has joined #openstack-neutron | 11:58 | |
andrey-mp | hi, I found a bug that recently was merged with review https://bugs.launchpad.net/neutron/+bug/1623800 Can someone check it and make a desicion - revert or fix? | 11:58 |
openstack | Launchpad bug 1623800 in neutron "Can't add exact count of fixed ips to port (regression)" [Undecided,New] | 11:58 |
*** jckasper has joined #openstack-neutron | 11:58 | |
*** obondarev has quit IRC | 11:58 | |
ihrachys | ccard: seems related https://bugs.launchpad.net/neutron/+bug/1463911 | 11:59 |
openstack | Launchpad bug 1463911 in linux (Ubuntu) "IPV6 fragmentation and mtu issue" [Medium,Confirmed] - Assigned to Jay Vosburgh (jvosburgh) | 11:59 |
ihrachys | ccard: there seems to be a kernel fix for that | 11:59 |
ihrachys | ccard: do you have it in your setup? | 11:59 |
*** pgadiya has joined #openstack-neutron | 11:59 | |
openstackgerrit | Reedip proposed openstack/neutron-fwaas: [WIP]Add firewall_policy_id in FWaaS v2 https://review.openstack.org/370731 | 12:00 |
*** baoli has quit IRC | 12:01 | |
openstackgerrit | Thomas Morin proposed openstack/neutron: ovs agent, native ARP response: set Eth src/dst https://review.openstack.org/370639 | 12:01 |
*** obondarev has joined #openstack-neutron | 12:02 | |
*** jpena is now known as jpena|lunch | 12:02 | |
*** jckasper has quit IRC | 12:03 | |
*** jkraj has joined #openstack-neutron | 12:04 | |
*** ivc_ has joined #openstack-neutron | 12:06 | |
frickler | ccard: if the packets get indeed fragmented, only the first packet will contain the UDP port information. so depending on what the iptables rules look like, the other fragments may get discarded because they effectively target UDP port 0 | 12:07 |
ccard | ihrachys: we are on 3.10.0-327.13.1.el7 at the moment, so we won't have that kernel fix. But thanks for the pointer | 12:07 |
ihrachys | frickler: ideally they are captured as RELATED | 12:07 |
ihrachys | frickler: but apparently sometimes they are not :) | 12:08 |
ccard | frickler: we don't lose all the UDP messages, only some | 12:08 |
ihrachys | ccard: not sure the patch will help though, it talks about ipv6 only | 12:09 |
ihrachys | but generally, this sounds like a kernel isuse | 12:09 |
*** namnh has quit IRC | 12:09 | |
ihrachys | *issue | 12:09 |
ccard | it does mention ipv4 too | 12:09 |
*** jlanoux has quit IRC | 12:09 | |
ftersin | carl_baldwin: hi, are you around? | 12:12 |
*** gongysh has quit IRC | 12:12 | |
*** pradk has joined #openstack-neutron | 12:13 | |
*** claudiub has quit IRC | 12:16 | |
*** chandanc__ has joined #openstack-neutron | 12:17 | |
*** lucas-hungry is now known as lucasagomes | 12:17 | |
*** pgadiya has quit IRC | 12:19 | |
*** amuller has joined #openstack-neutron | 12:22 | |
*** itsuugo has quit IRC | 12:23 | |
*** ratailor has quit IRC | 12:23 | |
*** itsuugo has joined #openstack-neutron | 12:23 | |
*** obondarev has quit IRC | 12:24 | |
openstackgerrit | Hirofumi Ichihara proposed openstack/neutron: [WIP] Add QoS minimum egress bandwidth rule into ovs-agent https://review.openstack.org/318531 | 12:25 |
*** wu_ng has quit IRC | 12:27 | |
*** obondarev has joined #openstack-neutron | 12:27 | |
*** itsuugo has quit IRC | 12:28 | |
*** itsuugo has joined #openstack-neutron | 12:29 | |
*** yamamoto has joined #openstack-neutron | 12:30 | |
*** yamamoto has quit IRC | 12:31 | |
*** yamamoto has joined #openstack-neutron | 12:31 | |
*** ganeshnalawade has quit IRC | 12:31 | |
*** bkopilov has joined #openstack-neutron | 12:32 | |
*** vijaykc4 has joined #openstack-neutron | 12:33 | |
ihrachys | kevinbenton: sigh, no -M do support for ping in cirros | 12:33 |
* ihrachys hates cirros | 12:33 | |
kevinbenton | ihrachys: i suppose just having nova set a tiny mtu and doing ssh should be enough | 12:34 |
ihrachys | so I can ping FIP from outside, but not validate ping from inside the instance | 12:34 |
kevinbenton | ihrachys: well if you can ping the instance with a larger frame and it doens't get dropped in the veth, that's pretty good | 12:35 |
ihrachys | kevinbenton: well, at least I can validate FIP side. assuming it's -M do it should be same either way | 12:35 |
ihrachys | kevinbenton: right, I need to cover three cases: ping -M do -sMTU (pass), ping -M do -sMTU+1 (fail), ping -sMTU+1 (pass) | 12:36 |
ihrachys | the latter, I can do both ways, including from inside the remote client | 12:36 |
*** yamamoto has quit IRC | 12:37 | |
*** sdake has joined #openstack-neutron | 12:38 | |
*** markvoelker has joined #openstack-neutron | 12:38 | |
*** yamamoto has joined #openstack-neutron | 12:38 | |
*** ganeshnalawade has joined #openstack-neutron | 12:38 | |
*** jhershbe has joined #openstack-neutron | 12:39 | |
*** bks has quit IRC | 12:39 | |
andrey-mp | kevinbenton - hi! can you say something about this bug - https://bugs.launchpad.net/neutron/+bug/1623800 is it a new bug or new feature? | 12:40 |
openstack | Launchpad bug 1623800 in neutron "Can't add exact count of fixed ips to port (regression)" [Undecided,New] | 12:40 |
*** azbiswas has joined #openstack-neutron | 12:41 | |
kevinbenton | andrey-mp: yes, that looks like a regression | 12:41 |
andrey-mp | ok, thank you. will it be reverted or new fix will be? | 12:42 |
andrey-mp | (or I need to ask Carl about it?) | 12:42 |
kevinbenton | andrey-mp: i think we will need to revert | 12:43 |
andrey-mp | good news for us ) | 12:44 |
andrey-mp | kevinbenton: thanks, will wait. | 12:44 |
*** mriedem has joined #openstack-neutron | 12:44 | |
kevinbenton | andrey-mp: i'm quite surprised we don't have a test for this | 12:45 |
kevinbenton | andrey-mp: what is the port payload for the update? | 12:45 |
*** itsuugo has quit IRC | 12:45 | |
*** ganeshnalawade has quit IRC | 12:45 | |
*** cbouch has joined #openstack-neutron | 12:45 | |
*** azbiswas has quit IRC | 12:46 | |
*** ganeshnalawade has joined #openstack-neutron | 12:46 | |
*** itsuugo has joined #openstack-neutron | 12:46 | |
andrey-mp | kevinbenton: it's just a test in ec2-api project to check that our ec2-api is compatible with Amazon API. (if I correctly understood what means 'port payload' in the context) | 12:47 |
kevinbenton | andrey-mp: yeah, i was wondering if you had the request that was sent to neutron to add the IPs | 12:47 |
kevinbenton | andrey-mp: oh, i see it there | 12:47 |
andrey-mp | yeah, it's there | 12:48 |
*** vijaykc4 has quit IRC | 12:48 | |
*** jamesdenton has joined #openstack-neutron | 12:48 | |
*** zkassab_ has joined #openstack-neutron | 12:51 | |
openstackgerrit | Jakub Libosvar proposed openstack/neutron: fullstack: VLAN aware VMs test https://review.openstack.org/369001 | 12:51 |
*** banix has joined #openstack-neutron | 12:52 | |
*** ekuris has quit IRC | 12:55 | |
*** ranjithd has joined #openstack-neutron | 12:55 | |
*** yamamoto has quit IRC | 12:56 | |
*** reedip has quit IRC | 12:56 | |
*** mosulica has quit IRC | 12:57 | |
*** jprovazn has quit IRC | 12:58 | |
*** yamamoto has joined #openstack-neutron | 12:58 | |
*** jprovazn has joined #openstack-neutron | 12:58 | |
frickler | ihrachys: kevinbenton: jschwarz|ooo: I've started a writeup outlining the plan and motivation for building custom cirros-based images, please have a look: https://etherpad.openstack.org/p/cirros-respin | 12:59 |
*** chandanc__ has quit IRC | 12:59 | |
*** ganeshnalawade has quit IRC | 12:59 | |
*** ganeshnalawade has joined #openstack-neutron | 12:59 | |
ihrachys | frickler: oh that's nice! | 13:00 |
*** ftersin has left #openstack-neutron | 13:00 | |
*** ociuhandu has quit IRC | 13:01 | |
*** itsuugo has quit IRC | 13:01 | |
*** jpena|lunch is now known as jpena | 13:02 | |
*** itsuugo has joined #openstack-neutron | 13:02 | |
*** wolverineav has joined #openstack-neutron | 13:03 | |
*** SKipp has joined #openstack-neutron | 13:05 | |
*** oanson has quit IRC | 13:06 | |
*** fzdarsky has joined #openstack-neutron | 13:06 | |
*** yamamoto has quit IRC | 13:07 | |
*** yamamoto has joined #openstack-neutron | 13:07 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Revert "Don't allocate IP on port update when existing subnet specified" https://review.openstack.org/370801 | 13:07 |
openstackgerrit | Kevin Benton proposed openstack/neutron: Add API test to ensure IPs can be added by subnet https://review.openstack.org/370802 | 13:07 |
kevinbenton | ihrachys, HenryG ^^ | 13:07 |
kevinbenton | need to get those two patches in | 13:07 |
kevinbenton | well the revert mostly | 13:07 |
kevinbenton | the test just prevents another regression | 13:08 |
*** wolverineav has quit IRC | 13:08 | |
*** reedip has joined #openstack-neutron | 13:08 | |
*** devvesa has quit IRC | 13:10 | |
*** akshai has joined #openstack-neutron | 13:10 | |
*** DaveJ__ has joined #openstack-neutron | 13:11 | |
*** mkolesni has quit IRC | 13:13 | |
*** sdake_ has joined #openstack-neutron | 13:14 | |
*** wolverineav has joined #openstack-neutron | 13:15 | |
*** salv-orlando has quit IRC | 13:15 | |
*** DaveJ__ is now known as DaveJ | 13:15 | |
*** sdake has quit IRC | 13:16 | |
openstackgerrit | Kevin Benton proposed openstack/os-vif: Add MTU to Network model and use it in plugging https://review.openstack.org/370667 | 13:16 |
*** krtaylor has joined #openstack-neutron | 13:18 | |
*** rossella_ has quit IRC | 13:18 | |
openstackgerrit | Ryan Moats proposed openstack/neutron-vpnaas: [WIP] Add scheduler support for VPN service. https://review.openstack.org/368468 | 13:19 |
*** rossella_ has joined #openstack-neutron | 13:19 | |
*** wolverineav has quit IRC | 13:19 | |
*** ltomasbo has joined #openstack-neutron | 13:19 | |
*** crose has joined #openstack-neutron | 13:22 | |
*** yamahata has joined #openstack-neutron | 13:23 | |
haleyb | kevinbenton: just a nit, but is it better to hit the revert button in the original change? that way they're linked together and the bug will be tagged | 13:23 |
*** jckasper has joined #openstack-neutron | 13:23 | |
*** vijaykc4 has joined #openstack-neutron | 13:24 | |
kevinbenton | haleyb: oh, i'll do it manually | 13:24 |
*** vijaykc4 has quit IRC | 13:24 | |
kevinbenton | haleyb: i had done it locally to confirm with that API test before proposing the revert | 13:24 |
*** gouthamr has joined #openstack-neutron | 13:24 | |
kevinbenton | haleyb: didn't want to cry wolf :) | 13:24 |
haleyb | but that button is so easy :) | 13:24 |
*** SKipp has quit IRC | 13:25 | |
*** devvesa has joined #openstack-neutron | 13:25 | |
kevinbenton | haleyb: i was just thinking, this regression could have interferred with the dhcp agent... | 13:26 |
haleyb | kevinbenton: everything interferes with the dhcp agent :( | 13:27 |
kevinbenton | haleyb: oh, nevermind. it requests different subnets | 13:27 |
kevinbenton | this is particular to a single subnet | 13:27 |
kevinbenton | from what i can tell | 13:27 |
*** jhershbe has quit IRC | 13:27 | |
*** edand has joined #openstack-neutron | 13:28 | |
*** karad has joined #openstack-neutron | 13:28 | |
*** mriedem has quit IRC | 13:29 | |
*** wolverineav has joined #openstack-neutron | 13:29 | |
*** chandanc__ has joined #openstack-neutron | 13:30 | |
*** ganeshnalawade has quit IRC | 13:30 | |
*** lnicolas has quit IRC | 13:32 | |
carl_baldwin | kevinbenton: thanks for the new test. | 13:34 |
*** crose has quit IRC | 13:34 | |
openstackgerrit | Thomas Morin proposed openstack/neutron: ovs agent, native ARP response: set Eth src/dst https://review.openstack.org/370639 | 13:36 |
*** wolverineav has quit IRC | 13:36 | |
*** kbringard has joined #openstack-neutron | 13:36 | |
*** yamamoto has quit IRC | 13:38 | |
kevinbenton | carl_baldwin: no prob | 13:38 |
ihrachys | haleyb: do you plan to respin https://review.openstack.org/#/c/366291/ today? | 13:40 |
*** kriskend has joined #openstack-neutron | 13:41 | |
ihrachys | beagles: where do we stand with https://review.openstack.org/#/c/368553/ ? I see your -1 but I am not sure it's still valid considering the latest comments from you? | 13:42 |
*** dane_leblanc has joined #openstack-neutron | 13:43 | |
beagles | ihrachys: I haven't retested yet. I started redeploying that env this morning. I should be able to lift the -1 a bit later today. | 13:44 |
*** akshai has quit IRC | 13:44 | |
*** cleong has joined #openstack-neutron | 13:44 | |
*** vijaykc4 has joined #openstack-neutron | 13:44 | |
*** devvesa has quit IRC | 13:45 | |
ihrachys | beagles: ok cool. it may trigger rc2 though. | 13:45 |
beagles | ihrachys: ack | 13:45 |
beagles | ihrachys: what's the actual time deadline there? | 13:45 |
beagles | ihrachys: the thing it is competing with in terms of processing power for testing can take a back burner if a few hours will make a difference | 13:46 |
*** itsuugo has quit IRC | 13:46 | |
ihrachys | beagles: we land rc1 today I suspect | 13:47 |
ihrachys | deadline is tomorrow | 13:47 |
*** kobis has quit IRC | 13:47 | |
ihrachys | but then we may produce more RCs | 13:47 |
ihrachys | which we usually do :) | 13:47 |
*** akshai has joined #openstack-neutron | 13:48 | |
*** itsuugo has joined #openstack-neutron | 13:48 | |
beagles | ihrachys: okay. I'll give it more of a push just in case there's only the one RC | 13:48 |
*** EinstCrazy has joined #openstack-neutron | 13:48 | |
haleyb | ihrachys: yes, i do have some more questions, ping you in a few minutes | 13:50 |
ihrachys | kevinbenton: re https://review.openstack.org/#/c/369992/11 I see that rally test patch failed. does it indicate the problem? no logs available though for some reason. | 13:50 |
*** akshai has quit IRC | 13:50 | |
*** kriskend has quit IRC | 13:50 | |
ihrachys | kevinbenton: hm, weird, now the link to logs worked for me. some glitch I guess. | 13:51 |
*** dane_leblanc has quit IRC | 13:51 | |
*** gongysh has joined #openstack-neutron | 13:51 | |
kevinbenton | ihrachys: quota error? | 13:51 |
*** tonytan4ever has joined #openstack-neutron | 13:51 | |
kevinbenton | ihrachys: oh, you mean the one in the rally gate? | 13:51 |
*** Esha has joined #openstack-neutron | 13:52 | |
*** chandanc__ has quit IRC | 13:52 | |
ihrachys | kevinbenton: that one, yes | 13:52 |
ihrachys | kevinbenton: though it's some different thing it seems | 13:52 |
kevinbenton | ihrachys: yeah, i just changed it back | 13:52 |
ihrachys | kevinbenton: see though this http://logs.openstack.org/17/369417/11/check/gate-rally-dsvm-neutron-rally/9135215/logs/screen-q-svc.txt.gz?level=TRACE#_2016-09-15_11_15_52_773 | 13:52 |
kevinbenton | ihrachys: wait for another test run | 13:52 |
ihrachys | "TypeError: can only concatenate tuple (not "list") to tuple" | 13:52 |
Esha | Hi, I wanted to check about MTU setting for a neutron network. Is it possible to edit it to a value different than 1500.Default always gets set to 1500 | 13:53 |
kevinbenton | ihrachys: was testing something | 13:53 |
ihrachys | doesn't look right :P | 13:53 |
ihrachys | kevinbenton: ok, so that TypeError from your experiments? not a bug in neutron? | 13:53 |
kevinbenton | ihrachys: yeah | 13:53 |
ihrachys | ok | 13:53 |
ihrachys | I feel relieved | 13:53 |
*** lbrune has joined #openstack-neutron | 13:53 | |
kevinbenton | ihrachys: from the first version of this https://review.openstack.org/#/c/370686/ | 13:54 |
*** chandanc__ has joined #openstack-neutron | 13:54 | |
ihrachys | good | 13:54 |
Esha | 1618025 was raised for same - MTU issue | 13:54 |
*** baoli has joined #openstack-neutron | 13:54 | |
*** akshai has joined #openstack-neutron | 13:55 | |
Esha | https://bugs.launchpad.net/neutron/+bug/1618025 | 13:55 |
openstack | Launchpad bug 1618025 in neutron "MTU specified during neutron network create is not honored, always set to 1500" [Undecided,Incomplete] - Assigned to ramesram (ramesh.rayapureddi) | 13:55 |
*** vijaykc4 has quit IRC | 13:55 | |
*** gongysh has quit IRC | 13:55 | |
ihrachys | Esha: it's calculated by neutron, you can't set it | 13:56 |
*** tonytan_brb has joined #openstack-neutron | 13:56 | |
*** wolverineav has joined #openstack-neutron | 13:56 | |
Esha | ok, then how do we edit it? | 13:56 |
ihrachys | Esha: but it will calculate it as per your config options | 13:56 |
ihrachys | Esha: global_physnet_mtu and such | 13:56 |
*** baoli__ has joined #openstack-neutron | 13:56 | |
ihrachys | Esha: there is a separate page in user guide for MTU | 13:56 |
*** jckasper has quit IRC | 13:56 | |
*** janzian has joined #openstack-neutron | 13:57 | |
*** akshai has quit IRC | 13:57 | |
Esha | so via neutron net-update or REST API its not possible..cause I checked the parameters and it didnt have MTU | 13:57 |
kevinbenton | carl_baldwin: would like to know your thoughts on https://review.openstack.org/#/c/369992/ | 13:57 |
*** baoli_ has quit IRC | 13:57 | |
Esha | neutron ipsec-site-connection-update is the only cli I could see MTU as a parameter | 13:58 |
*** ganeshnalawade has joined #openstack-neutron | 13:58 | |
*** dane_leblanc has joined #openstack-neutron | 13:58 | |
*** akshai has joined #openstack-neutron | 13:58 | |
*** tonytan4ever has quit IRC | 13:58 | |
*** yamamoto has joined #openstack-neutron | 13:59 | |
*** baoli has quit IRC | 13:59 | |
Esha | ihrachys - Is this the reference page for MTU in Newton | 13:59 |
Esha | http://docs.openstack.org/draft/networking-guide/config-mtu.html | 13:59 |
ihrachys | Esha: yes | 14:00 |
carl_baldwin | kevinbenton: will look in a few minutes | 14:00 |
ihrachys | Esha: MTU is returned in network payload though | 14:00 |
*** devvesa has joined #openstack-neutron | 14:00 | |
ihrachys | Esha: assuming your plugin supports net-mtu API extension | 14:00 |
Esha | sure, but that is a GET only? POST wont work | 14:01 |
*** akshai has quit IRC | 14:01 | |
*** ramishra has quit IRC | 14:01 | |
Esha | So1618025 can be closed with the doc as reference as edit of MTU is not allowed directly | 14:01 |
Esha | ihrachys: Right? | 14:02 |
ihrachys | Esha: yea | 14:03 |
*** mriedem has joined #openstack-neutron | 14:03 | |
*** akshai has joined #openstack-neutron | 14:03 | |
ihrachys | Esha: we could in theory allow to request MTUs that are lower than plugin calculated | 14:03 |
ihrachys | Esha: so you could look at it as a feature request | 14:03 |
ihrachys | Esha: but I struggle to see why you may want to lower your MTU | 14:03 |
ihrachys | Esha: maybe for some obsolete apps? | 14:03 |
*** wolverineav has quit IRC | 14:04 | |
Esha | yes, depending on the network config | 14:04 |
*** chandanc__ has quit IRC | 14:05 | |
ihrachys | kevinbenton: re https://review.openstack.org/#/c/367340/ do we insist on not reusing/not moving the code and instead hardcoding names in the sanity checks? | 14:05 |
*** jckasper has joined #openstack-neutron | 14:05 | |
*** roeyc has quit IRC | 14:07 | |
*** gouthamr has quit IRC | 14:07 | |
kevinbenton | ihrachys: no, i'm okay with moving it | 14:07 |
*** ramishra has joined #openstack-neutron | 14:08 | |
ihrachys | armax: can you revisit https://review.openstack.org/#/c/367340/ ? I wonder what's the course of action | 14:09 |
*** korzen has quit IRC | 14:09 | |
*** claudiub has joined #openstack-neutron | 14:09 | |
*** jckasper has quit IRC | 14:10 | |
ihrachys | kevinbenton: re https://review.openstack.org/#/c/369250/ is it just logging though? | 14:11 |
ihrachys | kevinbenton: looks more like a filter not being applied because of it | 14:11 |
*** oshvartz has quit IRC | 14:11 | |
ihrachys | which would bump the importance of the bug from Low | 14:11 |
*** Leo_ has joined #openstack-neutron | 14:12 | |
*** lbrune has left #openstack-neutron | 14:12 | |
*** mlavalle has joined #openstack-neutron | 14:13 | |
kevinbenton | ihrachys: i'm not sure filtering is failing to be applied | 14:13 |
kevinbenton | ihrachys: i think it's just tracebacks in the agent | 14:13 |
ihrachys | kevinbenton: well at least first process_network_devices attempt crashes, though it will probably catch up next time because we set that True flag before trying to set the options | 14:14 |
kevinbenton | ihrachys: yep | 14:14 |
ihrachys | ok, agreed it's Low. | 14:14 |
*** jckasper has joined #openstack-neutron | 14:15 | |
*** wolverineav has joined #openstack-neutron | 14:15 | |
*** nmagnezi has quit IRC | 14:16 | |
*** wolverineav has quit IRC | 14:20 | |
*** moshele has quit IRC | 14:21 | |
*** ltomasbo has quit IRC | 14:22 | |
*** rajinir has joined #openstack-neutron | 14:23 | |
*** trevormc has joined #openstack-neutron | 14:23 | |
carl_baldwin | kevinbenton: what were you saying above about "interfering with the DHCP agent" with haleyb . I feel like I'm missing some context there. | 14:25 |
*** marst has quit IRC | 14:26 | |
kevinbenton | carl_baldwin: oh, when the dhcp agent serves multiple subnets on a network | 14:26 |
kevinbenton | carl_baldwin: it requests additional IPs for its existing port | 14:26 |
kevinbenton | carl_baldwin: but they are for different subnets, so i don't think that was impacted by this | 14:26 |
kevinbenton | carl_baldwin: this bug was multiple ips, same subnet | 14:27 |
carl_baldwin | kevinbenton: Was there an issue that you and Brian were looking at or were you just speculating? | 14:27 |
*** jheroux has joined #openstack-neutron | 14:27 | |
kevinbenton | carl_baldwin: was just speculating | 14:27 |
*** wolverineav has joined #openstack-neutron | 14:27 | |
*** rubasov has quit IRC | 14:27 | |
carl_baldwin | kevinbenton: ah, ok | 14:27 |
*** john-davidge has quit IRC | 14:27 | |
*** null0 has joined #openstack-neutron | 14:28 | |
carl_baldwin | kevinbenton: When I saw your revert, I knew immediately what was wrong. Wish I would have foreseen that. | 14:28 |
*** carlos__ has joined #openstack-neutron | 14:28 | |
*** yamamoto has quit IRC | 14:28 | |
kevinbenton | carl_baldwin: i was just surprised that we didn't have a test for it | 14:29 |
kevinbenton | carl_baldwin: luckily we have some watching users :) | 14:29 |
carl_baldwin | kevinbenton: yeah, me too. | 14:29 |
*** yamamoto has joined #openstack-neutron | 14:29 | |
kevinbenton | carl_baldwin: btw. i think i just realized why delete_subnet is having so much trouble | 14:29 |
*** yamamoto has quit IRC | 14:30 | |
*** null0 has quit IRC | 14:30 | |
kevinbenton | carl_baldwin: or at least something that will contribute a lot to it | 14:30 |
carl_baldwin | kevinbenton: What are you thinking? | 14:30 |
kevinbenton | carl_baldwin: it (and delete_network) use this glorious while True loop | 14:30 |
kevinbenton | carl_baldwin: it starts a transaction each time | 14:30 |
kevinbenton | carl_baldwin: but as we've learned, if a db object is in the session, we won't get the latest data even if we query for it | 14:31 |
carl_baldwin | kevinbenton: I was thinking about the same time. I noticed in the logs from yesterday that when the transaction got restarted, some of the port deletes stuck. | 14:31 |
*** shausy has quit IRC | 14:31 | |
kevinbenton | carl_baldwin: about to propose a patch putting in expires | 14:31 |
carl_baldwin | s/time/thing/ | 14:31 |
kevinbenton | carl_baldwin: this code was clearly written assuming a fresh start on each iteration | 14:32 |
*** wolverineav has quit IRC | 14:32 | |
carl_baldwin | kevinbenton: Oh, I see | 14:32 |
*** vijaykc4 has joined #openstack-neutron | 14:33 | |
*** edand has quit IRC | 14:33 | |
kevinbenton | carl_baldwin: in particular it's going to keep trying to bump a stale revision number for the network | 14:34 |
*** yamamoto has joined #openstack-neutron | 14:34 | |
kevinbenton | carl_baldwin: confirming right now with some well placed pdb and mysql fiddling | 14:34 |
*** yamamoto has quit IRC | 14:35 | |
carl_baldwin | kevinbenton: You think that is causing excessive retries? | 14:35 |
kevinbenton | carl_baldwin: possibly | 14:35 |
*** marst has joined #openstack-neutron | 14:36 | |
*** wolverineav has joined #openstack-neutron | 14:36 | |
carl_baldwin | I saw a lot of retries but I didn't look hard enough to know what was causing the retries. | 14:37 |
njohnston | Hi, could I get a neutron infra liason to look at https://review.openstack.org/#/c/368945/ please, at your convenience? | 14:37 |
*** watanabe_isao has quit IRC | 14:39 | |
*** Trident has quit IRC | 14:41 | |
*** Trident has joined #openstack-neutron | 14:41 | |
*** jckasper has quit IRC | 14:42 | |
*** pradk has quit IRC | 14:42 | |
*** rubasov has joined #openstack-neutron | 14:43 | |
*** wolverineav has quit IRC | 14:43 | |
*** jckasper has joined #openstack-neutron | 14:43 | |
*** thiagolib has joined #openstack-neutron | 14:44 | |
*** EinstCrazy has quit IRC | 14:44 | |
*** wolverineav has joined #openstack-neutron | 14:44 | |
*** pradk has joined #openstack-neutron | 14:45 | |
*** obondarev has quit IRC | 14:45 | |
*** eezhova has quit IRC | 14:45 | |
kevinbenton | carl_baldwin: yep, just reproduced the failure | 14:46 |
kevinbenton | carl_baldwin: this is a bad bug | 14:46 |
kevinbenton | :) | 14:46 |
kevinbenton | carl_baldwin: the network gets in the session either because of the subnet or the ports held down below | 14:46 |
*** eezhova has joined #openstack-neutron | 14:46 | |
openstackgerrit | Brian Haley proposed openstack/neutron: Fix metering-agent iptables restore failure https://review.openstack.org/370902 | 14:46 |
kevinbenton | carl_baldwin: so if something else updates the network revision at that point, it's stuck | 14:47 |
kevinbenton | carl_baldwin: unless it's lucky enough to throw a deadlock error | 14:47 |
kevinbenton | carl_baldwin: or find a new port and throw a retryrequest | 14:47 |
kevinbenton | carl_baldwin: at which point those vars go out of scope and are garbage collected | 14:47 |
carl_baldwin | kevinbenton: sounds bad | 14:48 |
openstackgerrit | Nakul Dahiwade proposed openstack/neutron: OVO for NetworkDhcpAgentBinding https://review.openstack.org/370452 | 14:48 |
*** wolverineav has quit IRC | 14:48 | |
*** akshai has quit IRC | 14:49 | |
*** yb has joined #openstack-neutron | 14:51 | |
*** akshai has joined #openstack-neutron | 14:51 | |
*** donghao has quit IRC | 14:51 | |
*** akshai has quit IRC | 14:51 | |
*** wolverineav has joined #openstack-neutron | 14:52 | |
*** absubram has joined #openstack-neutron | 14:52 | |
*** andrey-mp has left #openstack-neutron | 14:53 | |
Esha | There is a bug 1616357 https://bugs.launchpad.net/neutron/+bug/1616357 which I had opened as the response of GET/POST networks API is not getting translated and always returns english. I saw that https://github.com/openstack/neutron-lib/blob/master/neutron_lib/exceptions.py NetworkNotFound at line 115 does the translation by _. | 14:53 |
openstack | Launchpad bug 1616357 in neutron "The Error Response REST API GET/POST on networks is not translated" [Undecided,New] | 14:53 |
*** akshai has joined #openstack-neutron | 14:53 | |
Esha | However the API Response always returns English | 14:53 |
*** absubram_ has joined #openstack-neutron | 14:53 | |
*** baoli has joined #openstack-neutron | 14:54 | |
Esha | I have updated defect with required latest info. Why is the translation already done for the message working? | 14:55 |
*** baoli__ has quit IRC | 14:55 | |
Esha | *not working | 14:55 |
openstackgerrit | Pushkar Umaranikar proposed openstack/os-vif: os-vif pollute test output https://review.openstack.org/370908 | 14:56 |
*** tonytan_brb is now known as tonytan4ever | 14:57 | |
*** itzkb_ has quit IRC | 14:57 | |
*** tidwellr has joined #openstack-neutron | 14:57 | |
*** absubram has quit IRC | 14:57 | |
*** absubram_ is now known as absubram | 14:57 | |
*** azbiswas has joined #openstack-neutron | 14:58 | |
*** Esha has quit IRC | 15:02 | |
*** Esha has joined #openstack-neutron | 15:02 | |
openstackgerrit | Anindita Das proposed openstack/neutron: OVO for RouterL3AgentBinding https://review.openstack.org/360908 | 15:03 |
openstackgerrit | Kevin Benton proposed openstack/neutron: Expire DB objects in ML2 infinity loops https://review.openstack.org/370920 | 15:04 |
kevinbenton | carl_baldwin: ^^ | 15:04 |
*** lihi has quit IRC | 15:04 | |
kevinbenton | armax: ^^~1 | 15:04 |
*** tri2sing has joined #openstack-neutron | 15:05 | |
*** yamahata has quit IRC | 15:06 | |
*** regXboi has joined #openstack-neutron | 15:07 | |
*** regXboi has quit IRC | 15:07 | |
*** slaweq_ has quit IRC | 15:07 | |
*** baoli_ has joined #openstack-neutron | 15:07 | |
*** regXboi has joined #openstack-neutron | 15:07 | |
carl_baldwin | kevinbenton: ack | 15:07 |
*** slaweq_ has joined #openstack-neutron | 15:08 | |
*** mickeys has joined #openstack-neutron | 15:08 | |
*** yb has quit IRC | 15:09 | |
*** wolverineav has quit IRC | 15:09 | |
ihrachys | armax: amuller: I am puzzled by https://review.openstack.org/#/c/370918/ and related bugs | 15:09 |
ihrachys | puzzled as in 'why the heck gate passes'? | 15:09 |
armax | that’s the first time I see this patch | 15:10 |
*** sleviim has quit IRC | 15:10 | |
armax | I am as puzzled as you are | 15:10 |
*** baoli has quit IRC | 15:10 | |
jlibosva | ihrachys: from functional tests it seems br_netfilter is not needed | 15:10 |
* jlibosva looks for a link | 15:10 | |
kevinbenton | no negative security groups tests? | 15:10 |
ihrachys | jlibosva: but how come if the official page for the thing says without it filtering is not avail | 15:11 |
ihrachys | armax: the patch is mine of 5 mins ago, that's not a surprise | 15:12 |
ihrachys | armax: the surprise is gate passing | 15:12 |
jlibosva | ihrachys: yeah, that's weird. also the fact that module is called br_netfilter which sounds like you need it for haing netfilter on the bridge | 15:12 |
*** slaweq_ has quit IRC | 15:12 | |
ihrachys | jlibosva: I also found some red hat bugzilla bugs discussing that that suggest you need the module loaded | 15:12 |
beagles | ihrachys: just +1'd https://review.openstack.org/#/c/368553/ - seems to do the job in my env | 15:13 |
*** Esha_ has joined #openstack-neutron | 15:13 | |
ihrachys | jlibosva: https://bugzilla.redhat.com/show_bug.cgi?id=1182105 that one | 15:13 |
openstack | bugzilla.redhat.com bug 1182105 in systemd "sysctl.conf / sysctl.conf.d settings should be applied after bridge is added" [High,Closed: errata] - Assigned to systemd-maint | 15:13 |
jlibosva | ihrachys: http://logs.openstack.org/74/363474/2/experimental/gate-neutron-dsvm-functional-ubuntu-xenial/0ee2238/testr_results.html.gz - look at test_firewall | 15:13 |
*** Esha has quit IRC | 15:14 | |
ihrachys | jlibosva: could it be that some firewall functionality is available irrespective of the module, it's just for SOME frames (as in "bridged IPv4/IPv6/ARP packets, even when encapsulated in an 802.1Q VLAN or PPPoE header") | 15:14 |
*** Esha_ is now known as Esha | 15:15 | |
*** akamyshnikova_ has quit IRC | 15:15 | |
openstackgerrit | Anindita Das proposed openstack/neutron: OVO for VxlanAllocation and VxlanEndpoints https://review.openstack.org/362508 | 15:15 |
*** gouthamr has joined #openstack-neutron | 15:15 | |
*** brad_behle has joined #openstack-neutron | 15:15 | |
armax | ihrachys: btw: http://lists.openstack.org/pipermail/openstack-dev/2016-September/103779.html | 15:16 |
Esha | There is a bug 1616357 https://bugs.launchpad.net/neutron/+bug/1616357 which I had opened as the response of GET/POST networks API is not getting translated and always returns english. I saw that https://github.com/openstack/neutron-lib/blob/master/neutron_lib/exceptions.py NetworkNotFound at line 115 does the translation by _. | 15:16 |
openstack | Launchpad bug 1616357 in neutron "The Error Response REST API GET/POST on networks is not translated" [Undecided,New] | 15:16 |
Esha | However the API Response always returns English | 15:16 |
Esha | I have updated defect with required latest info. Why is the translation not working for the message NetworkNotFound | 15:16 |
Esha | ? | 15:16 |
*** akamyshnikova_ has joined #openstack-neutron | 15:17 | |
*** gouthamr has quit IRC | 15:17 | |
*** gouthamr has joined #openstack-neutron | 15:17 | |
*** HoloIRCUser2 has joined #openstack-neutron | 15:18 | |
ihrachys | armax: ack. I haven't tried to respin because the shape of the dashboard is not great yet. | 15:18 |
*** wolverineav has joined #openstack-neutron | 15:18 | |
*** tflynn has joined #openstack-neutron | 15:18 | |
armax | ihrachys: good man | 15:18 |
armax | it would not be a classic RC time if we did not have a crisis | 15:18 |
*** pcaruana has quit IRC | 15:19 | |
*** salv-orlando has joined #openstack-neutron | 15:19 | |
ihrachys | nah, it's just a crisis during RC is a special one. | 15:19 |
ihrachys | you are just used to them in other times | 15:19 |
*** andreas_s has quit IRC | 15:19 | |
armax | different words, same concept :) | 15:19 |
ihrachys | armax: kevinbenton also caught today nova broke MTU setup. not sure you are aware; there are patches though | 15:20 |
armax | he mentioned | 15:20 |
armax | not aware of the patches though | 15:20 |
ihrachys | https://review.openstack.org/#/q/status:open+topic:bug/1623876 | 15:20 |
armax | I am still scratching my eyes | 15:20 |
kevinbenton | ihrachys: armax and i secretly communicate in parseltongue : | 15:20 |
kevinbenton | :) | 15:20 |
*** jhershbe has joined #openstack-neutron | 15:21 | |
ihrachys | that explains a lot | 15:22 |
*** salv-orlando has quit IRC | 15:22 | |
armax | kevinbenton, ihrachys do you guys think that it might be related to bug 1623732? | 15:22 |
openstack | bug 1623732 in neutron "failed: route add -net "0.0.0.0/0" gw "10.1.0.1" leads to test_network_basic_ops to fail with SSHTimeout" [Critical,Confirmed] https://launchpad.net/bugs/1623732 | 15:22 |
*** slaweq_ has joined #openstack-neutron | 15:22 | |
ihrachys | armax: it == mtu? | 15:22 |
*** wolverineav has quit IRC | 15:22 | |
kevinbenton | armax: unfortunately probably not | 15:22 |
armax | ok | 15:23 |
ihrachys | yeah, probably not mtu | 15:23 |
ihrachys | hm, seems like the error just indicates that the same route is already set by something in the instance | 15:24 |
ihrachys | which may be fine | 15:24 |
clarkb | is that mtu issue also potentially causing all of these grenade job failures: http://logs.openstack.org/39/370639/4/check/gate-grenade-dsvm-neutron-ubuntu-trusty/4a61dcb/console.html ? | 15:24 |
ihrachys | or not, if it's another default route with wrong gateway. not sure what else could set it. | 15:25 |
ihrachys | clarkb: there is no known mtu *gate failure* I believe | 15:27 |
*** moshele has joined #openstack-neutron | 15:27 | |
armax | ihrachys, kevinbenton: do you think bug 1623876 will get a requirement freeze exception? | 15:27 |
openstack | bug 1623876 in OpenStack Compute (nova) "nova is not setting the MTU provided by Neutron" [Critical,In progress] https://launchpad.net/bugs/1623876 - Assigned to Kevin Benton (kevinbenton) | 15:27 |
clarkb | ihrachys: ok, that grenade job is super flaky right now at least and its having trouble sshing and its single node so no weird overlays in the job infrastructure | 15:27 |
kevinbenton | armax: that's up to the nova overlords | 15:28 |
armax | ok | 15:29 |
*** wolverineav has joined #openstack-neutron | 15:29 | |
kevinbenton | clarkb: in grenade are the agents left in the old version or is everything upgraded? | 15:29 |
ihrachys | armax: we have a backup plan with a nova only fix. | 15:30 |
clarkb | kevinbenton: in that job everythign is upgraded I think. its the single node grenade job where the entire cloud is tyurned off, upgraded, then started again | 15:30 |
kevinbenton | clarkb: right, and for this basic_ops test that keeps bombing it's freshly created VMs and networks | 15:31 |
kevinbenton | clarkb: IIUC | 15:31 |
clarkb | that I don't know. Not sure if the resoruces are preserved through the upgrade or not | 15:32 |
*** wolverineav has quit IRC | 15:34 | |
*** tflynn has quit IRC | 15:35 | |
*** tflynn has joined #openstack-neutron | 15:35 | |
*** yamamoto has joined #openstack-neutron | 15:35 | |
pc_m | kevinbenton: ping | 15:39 |
kevinbenton | pc_m: pong | 15:39 |
pc_m | kevinbenton: Is there info somewhere on how to update a project from using keystoneclient v2 to v3? | 15:40 |
*** tflynn has quit IRC | 15:40 | |
*** nyechiel has quit IRC | 15:41 | |
kevinbenton | pc_m: i would check with HenryG or dasm | 15:41 |
kevinbenton | pc_m: they did a lot of that for neutron | 15:41 |
pc_m | kevinbenton: thanks | 15:41 |
*** jckasper has quit IRC | 15:42 | |
*** yamamoto has quit IRC | 15:42 | |
*** jckasper has joined #openstack-neutron | 15:42 | |
*** jckasper has quit IRC | 15:43 | |
*** jckasper has joined #openstack-neutron | 15:43 | |
*** jckasper has quit IRC | 15:45 | |
*** jckasper has joined #openstack-neutron | 15:46 | |
pc_m | wondering what is involved to switch. | 15:46 |
*** jckasper has quit IRC | 15:46 | |
pc_m | kevinbenton: Do you know what release Neutron switched to v3? | 15:46 |
dasm | pc_m: this release. newton | 15:47 |
*** Esha has quit IRC | 15:47 | |
*** wolverineav has joined #openstack-neutron | 15:47 | |
pc_m | dasm: Is there any info, on what is entailed in switching to a new client version? | 15:47 |
dasm | pc_m: let me explain it.. so, initial keystone v3 work was done earlier. i don't recall the date/release, but cleanup and most of leftovers we did in this release. | 15:48 |
*** itsuugo has quit IRC | 15:48 | |
dasm | pc_m: could you describe your use-case? what are you trying to do? | 15:48 |
*** salv-orlando has joined #openstack-neutron | 15:49 | |
pc_m | dasm: have a vendor project that is using v2 of the client. I think mostly to just get the tenant ID. Wonder what is entailed in updating to v3 client. | 15:49 |
dasm | pc_m: btw. kuryr is currently doing keystone v3 change | 15:49 |
*** itsuugo has joined #openstack-neutron | 15:49 | |
openstackgerrit | Carl Baldwin proposed openstack/neutron: Raise level of message to info https://review.openstack.org/370964 | 15:50 |
pc_m | dasm: If running v3 client, should we be able to call the v2 API (backward compatible)? | 15:50 |
apuimedo | dasm: we already merged it ;-) | 15:50 |
apuimedo | thanks again for the help the other day | 15:51 |
dasm | apuimedo: i've seen it. congrats | 15:51 |
dasm | apuimedo: pc_m is trying to do the same. rewrite v2 into v3 | 15:51 |
*** jckasper has joined #openstack-neutron | 15:52 | |
*** wolverineav has quit IRC | 15:52 | |
dasm | pc_m: if you'll use v3, you will still have all features provided. you don't need to any longer get v2 info, because everything is there. | 15:52 |
apuimedo | dasm: for which project? | 15:52 |
dasm | apuimedo: 15:48:51 pc_m | dasm: have a vendor project that is using v2 of the client. | 15:53 |
pc_m | dasm: Looks like our project is using v2 API and calling keystoneclient to get tenant ID and the request is failing (404). | 15:53 |
apuimedo | aha | 15:53 |
apuimedo | pc_m: keystoneauth is your friend | 15:53 |
apuimedo | :-) | 15:53 |
apuimedo | it will make it easy to keep v2+v3 compatible | 15:53 |
dasm | pc_m: yes. keystoneclient is deprecated. you should use keystoneauth | 15:53 |
pc_m | Is it possible that it's a change from tenant to project ID? | 15:53 |
apuimedo | so your vendor can serve customers that are slow to upgrade | 15:53 |
*** obondarev has joined #openstack-neutron | 15:53 | |
*** vijaykc4 has quit IRC | 15:54 | |
dasm | pc_m: hmm.. if you have 404, i would suggest that something is wrong with authorization. | 15:54 |
pc_m | dasm: apuimedo: Cool. Where can I find info on how to switch from keystoneclient to keystoneauth? | 15:54 |
apuimedo | one sec | 15:54 |
dasm | pc_m: one of the sources: http://docs.openstack.org/developer/keystone/http-api.html | 15:54 |
apuimedo | pc_m: http://docs.openstack.org/developer/keystoneauth/migrating.html | 15:55 |
*** moshele has quit IRC | 15:55 | |
apuimedo | that's exactly what you want to do, probably | 15:55 |
pc_m | Thanks!!! | 15:55 |
dasm | apuimedo: ++ | 15:55 |
apuimedo | depends of it is a client (this url) or a service (check how nova/neutron/kuryr do it) | 15:55 |
pc_m | dasm: The 404 says "The resource could not be found." on a get request for specific tenant ID (that exists) | 15:56 |
dasm | pc_m: often, if user is unauthorized, then you'll get 404, instead of 403, to secure info about resources. | 15:57 |
apuimedo | yes, that happened to me | 15:57 |
apuimedo | pc_m: is this a devstack env? | 15:58 |
*** iyamahat has joined #openstack-neutron | 15:58 | |
*** jkraj has quit IRC | 15:58 | |
pc_m | dasm: It was on a working setup, where keystoneclient was updated to v3 recently. | 15:58 |
pc_m | apuimedo: no, on an openstack installation. | 15:59 |
apuimedo | pc_m: plesae, check the endpoints | 15:59 |
apuimedo | I was getting that when using the wrong url for v3 | 15:59 |
*** ltomasbo has joined #openstack-neutron | 16:00 | |
*** thumpba has joined #openstack-neutron | 16:00 | |
openstackgerrit | Anindita Das proposed openstack/neutron: OVO Gre Allocation Endpoints https://review.openstack.org/361289 | 16:00 |
*** abregman__ has joined #openstack-neutron | 16:00 | |
*** ltomasbo has quit IRC | 16:00 | |
pc_m | apuimedo: So, there are 3 endpoint entries for keystone identity that are v3 | 16:00 |
*** abregman_ has quit IRC | 16:00 | |
*** ltomasbo has joined #openstack-neutron | 16:00 | |
pc_m | apuimedo: But, I know that the project accessing keystoneclient is using v2_0 api | 16:01 |
*** abregman__ has quit IRC | 16:01 | |
*** abregman has joined #openstack-neutron | 16:01 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Revert "Removes host file contents from DHCP agent logs" https://review.openstack.org/370974 | 16:02 |
*** nmagnezi has joined #openstack-neutron | 16:03 | |
*** wolverineav has joined #openstack-neutron | 16:04 | |
apuimedo | pc_m: do a curl in the terminal to those | 16:04 |
pc_m | apuimedo: So if I call the v2 API, with a v3 client running, it'll just fail? | 16:04 |
apuimedo | and do a paste.openstack.org | 16:04 |
apuimedo | of what they return | 16:04 |
*** devvesa has quit IRC | 16:04 | |
*** sbelous__ has joined #openstack-neutron | 16:04 | |
*** sbelous__ has quit IRC | 16:05 | |
pc_m | apuimedo: Just did. With v2, I get 404 resource not found. With v3 I get output. | 16:05 |
*** Esha has joined #openstack-neutron | 16:05 | |
carl_baldwin | kevinbenton: I'm looking through those "while True" loops. They are a piece of work. | 16:05 |
sbelous | dasm, hichihara, Hi. About this one https://bugs.launchpad.net/neutron/+bug/1623390 I can't to reproduce it locally :( there is only one of many test runs, that was failed with same error (http://paste.openstack.org/show/576185/ should be two Quota exceeded errors instead of three). Can't imagine what's wrong in quota management. May be, that problem is related to concurrent tasks running in rally… | 16:06 |
openstack | Launchpad bug 1623390 in neutron "Wrong calculation of quotas " [Undecided,New] - Assigned to Sergey Belous (sbelous) | 16:06 |
apuimedo | pc_m: and you tried the keystoneauth library with that working v3 output? | 16:06 |
*** abregman has quit IRC | 16:06 | |
apuimedo | pc_m: can you paste the content? | 16:06 |
kevinbenton | carl_baldwin: aren't they? :) | 16:06 |
*** abregman has joined #openstack-neutron | 16:06 | |
kevinbenton | carl_baldwin: i like how it takes a while to even get the control flow | 16:07 |
pc_m | apuimedo: no, the project is using keystoneclient and not keystoneauth. | 16:07 |
kevinbenton | carl_baldwin: the commit and break is in the commit | 16:07 |
kevinbenton | carl_baldwin: and it's surrounded by the things that have to happen 1st | 16:07 |
*** vijaykc4 has joined #openstack-neutron | 16:07 | |
kevinbenton | carl_baldwin: i like to call it the ML2 commit sandwich | 16:07 |
pc_m | apuimedo: http://paste.openstack.org/show/577662/ | 16:08 |
*** wolverineav has quit IRC | 16:08 | |
carl_baldwin | kevinbenton: "if not to_allocate: .... break (commits) ... for a in to_deallocate" | 16:08 |
carl_baldwin | lol | 16:08 |
apuimedo | pc_m: so this is what you are using keystoneclient with "http://10.87.49.50:5000/v3/" ? | 16:08 |
pc_m | apuimedo: no. that's the issue AFAICT. | 16:09 |
kevinbenton | carl_baldwin: that's due for some refactoring :) | 16:09 |
apuimedo | so try with this address | 16:09 |
*** gvrangan has joined #openstack-neutron | 16:09 | |
pc_m | apuimedo: The project is trying to use v2 and not v3, but keystoneclient has been updated to v3. | 16:09 |
carl_baldwin | kevinbenton: "This approach should be revisited when the API layer is reworked during icehouse" | 16:09 |
kevinbenton | sounds about right :) | 16:09 |
carl_baldwin | kevinbenton: +1 | 16:09 |
pc_m | apuimedo: Is the API backward compatible (hoping it is)? | 16:10 |
apuimedo | pc_m: you mean REST? | 16:10 |
pc_m | apuimedo: IOW, is it just as simple as changing v2 to v3 in the URL usage in this project? | 16:10 |
apuimedo | if you have a python client that abstracts you from the REST yes | 16:11 |
apuimedo | if you have a custom client... | 16:11 |
apuimedo | you are trying to talk only to keystone or it's just getting token for talking to a service like neutron? | 16:11 |
*** tmorin has quit IRC | 16:11 | |
HoloIRCUser2 | njohnston : ping | 16:12 |
*** HoloIRCUser2 is now known as reedip-home | 16:12 | |
pc_m | apuimedo: It's a controller that is trying to get tenant info from keystone. | 16:12 |
apuimedo | pc_m: I think that part is changed | 16:12 |
kevinbenton | carl_baldwin: https://github.com/openstack/neutron/blob/master/neutron/agent/securitygroups_rpc.py#L35-L45 | 16:12 |
pc_m | apuimedo: It is currently using v2 in the URL, when talking to keystone. | 16:13 |
kevinbenton | carl_baldwin: speaking of old horrors | 16:13 |
carl_baldwin | kevinbenton: what's not to understand there? ;) | 16:13 |
pc_m | apuimedo: Wondering if it is as easy as just changing URI to have v3 instead. | 16:13 |
sdague | anyone have theories about why we might be regressing on neutron grenade job passing - http://tinyurl.com/zdpx7rh | 16:13 |
kevinbenton | sdague: not yet | 16:13 |
sdague | it would be a change in the last 24 hours | 16:14 |
sdague | that's when we start drifting up | 16:14 |
apuimedo | pc_m: is this a production system? | 16:14 |
apuimedo | otherwise just try | 16:14 |
njohnston | HoloIRCUser2: pong | 16:14 |
kevinbenton | sdague: i was digging into that when i discovered the mtu issue and got distracted | 16:14 |
kevinbenton | sdague: looking at it again now | 16:14 |
*** absubram has quit IRC | 16:14 | |
sdague | kevinbenton: ok, cool, as long as folks are aware | 16:14 |
sdague | kevinbenton: thanks | 16:14 |
pc_m | apuimedo: development. So I can give it a try. I'm hoping the returned info is the same or at least backward compatible. | 16:14 |
*** yamahata has joined #openstack-neutron | 16:15 | |
pc_m | apuimedo: In the future though, sounds like we should move to keystoneauth. | 16:15 |
*** obondarev has quit IRC | 16:16 | |
apuimedo | pc_m: if possible, you should move to it right now | 16:16 |
pc_m | apuimedo: Yeah, will likely make that change, as the permanent change, instead of just changing to v3. | 16:17 |
pc_m | apuimedo: Thanks for the help! | 16:17 |
apuimedo | pc_m: you're welcome | 16:18 |
*** ivar-lazzaro has joined #openstack-neutron | 16:18 | |
*** jhershbe has quit IRC | 16:19 | |
*** matrohon has quit IRC | 16:19 | |
dasm | apuimedo: thank you for the help provided to pc_m. i was in the meeting, but i see you made some progress :) | 16:20 |
dasm | pc_m | apuimedo: In the future though, sounds like we should move to keystoneauth. | 16:20 |
apuimedo | I'm in a meeting and baby sitting, but was easy enough | 16:20 |
dasm | pc_m: yes, it's the best possible way to be compliant with keystone | 16:20 |
dasm | apuimedo: :D | 16:20 |
pc_m | dasm: yeah. I'm going to hack the code to v3 URI now, and then look at using keystoneauth for the solution. | 16:21 |
dasm | pc_m: ok. | 16:21 |
*** trevormc has quit IRC | 16:21 | |
*** lucasagomes is now known as lucas-dinner | 16:24 | |
*** rcernin has quit IRC | 16:26 | |
*** fzdarsky has quit IRC | 16:26 | |
*** obondarev has joined #openstack-neutron | 16:26 | |
*** wolverineav has joined #openstack-neutron | 16:28 | |
*** bkopilov has quit IRC | 16:30 | |
*** absubram has joined #openstack-neutron | 16:31 | |
*** itsuugo has quit IRC | 16:32 | |
*** ltomasbo has quit IRC | 16:32 | |
*** ltomasbo has joined #openstack-neutron | 16:32 | |
armax | haleyb: bug 1623958 is not happening in the gate is it? | 16:32 |
openstack | bug 1623958 in neutron "Metering-agent fails to restore iptables with 'Bad argument'" [Critical,In progress] https://launchpad.net/bugs/1623958 - Assigned to Brian Haley (brian-haley) | 16:32 |
njohnston | sc68cal: Quick devstack question for you. There are a bunch of devstack setup functions for neutron in https://github.com/openstack/neutron/tree/master/devstack/lib - can things out of tree take advantage of them? For example in the l2_agent file is a function plugin_agent_add_l2_agent_extension, can a *-aas project use that file, or should they copy the logic to their own tree? | 16:32 |
mriedem | kevinbenton: armax: i checked logstash for http://logs.openstack.org/09/368709/3/check/gate-grenade-dsvm-neutron-ubuntu-trusty/dc9b80f/logs/new/screen-q-l3.txt.gz#_2016-09-15_01_17_49_874 and it's pretty common, and not a 100% failure scenario | 16:33 |
*** itzkb_ has joined #openstack-neutron | 16:33 | |
*** tflynn has joined #openstack-neutron | 16:33 | |
mriedem | https://goo.gl/wzYulq but spikes recently | 16:33 |
*** itsuugo has joined #openstack-neutron | 16:34 | |
armax | mriedem: http://grafana.openstack.org/dashboard/db/neutron-failure-rate?panelId=6&fullscreen | 16:34 |
armax | what’s puzzling me is that it’s particularly bad with grenade runs | 16:34 |
armax | mriedem: there’s gotta be a clue in there | 16:34 |
*** jhershbe has joined #openstack-neutron | 16:34 | |
*** baoli_ has quit IRC | 16:34 | |
*** wolverineav has quit IRC | 16:35 | |
armax | all of the grenade flavors are spiking with different gradients | 16:35 |
*** moshele has joined #openstack-neutron | 16:36 | |
haleyb | armax: i don't know | 16:37 |
armax | mriedem: for what I can tell those traces pertain a router that’s connecting an ipv6 private network with the external network | 16:39 |
armax | mriedem: it doesn’t seem like it might be related | 16:39 |
*** itzkb_ has quit IRC | 16:39 | |
*** wolverineav has joined #openstack-neutron | 16:40 | |
carl_baldwin | kevinbenton: armax: anything I can help out with today? | 16:40 |
openstackgerrit | Kevin Benton proposed openstack/neutron: Expire DB objects in ML2 infinity loops https://review.openstack.org/370920 | 16:40 |
*** gouthamr has quit IRC | 16:40 | |
*** obondarev has quit IRC | 16:41 | |
armax | carl_baldwin: right now I am trying to find out the root cause of bug 1623732 | 16:41 |
openstack | armax: Error: Could not gather data from Launchpad for bug #1623732 (https://launchpad.net/bugs/1623732). The error has been logged | 16:41 |
kevinbenton | carl_baldwin, armax: needed to respin ^^ to fix a l3_ha referring to a relationship to a network it just deleted | 16:41 |
armax | bug 1623732 | 16:41 |
sc68cal | njohnston: you do that at your own risk | 16:41 |
kevinbenton | armax: i wonder if this is just a different manifestation of the ovs port disappearing on us for vacation time | 16:41 |
carl_baldwin | kevinbenton: ack | 16:42 |
armax | kevinbenton: at this point I am happy to entertain any possibility | 16:42 |
njohnston | sc68cal: OK, so probably better to copy the logic over I suppose, and note it's provenance. | 16:42 |
armax | I just wish we could get hold of a node from infra and see if we can repro | 16:42 |
*** tonytan4ever has quit IRC | 16:42 | |
kevinbenton | sc68cal: did you see mriedem secretly tried to undo our MTU work? ;) | 16:42 |
mriedem | wat?! | 16:43 |
sc68cal | wat | 16:43 |
armax | clarkb: https://review.openstack.org/#/c/341098/ is failing with taht error, is it too late to get hold of the node? | 16:43 |
kevinbenton | sc68cal: they switched to using os-vif to plug the interfaces | 16:43 |
mriedem | i thought like half the os-vif core team was neutron people? | 16:43 |
kevinbenton | sc68cal: which didn't have any of our nova fixes yet | 16:43 |
*** gouthamr has joined #openstack-neutron | 16:43 | |
kevinbenton | mriedem: no, we were banished up front for lude behavior | 16:43 |
armax | though this is different actually | 16:43 |
clarkb | armax: I am on a phone the genral rule is its too late if the job has reported but if still running you can catch it | 16:43 |
armax | never mind | 16:43 |
mriedem | let's just revert os-vif integration, there is still time! | 16:43 |
armax | clarkb: ack | 16:44 |
armax | thanks | 16:44 |
armax | now I see modprobe: module virtio_blk not found in modules.dep | 16:44 |
armax | modprobe: module virtio_net not found in modules.dep | 16:44 |
kevinbenton | mriedem: nah, either johnthetubaguy's fix or the os-vif one should work | 16:44 |
armax | kevinbenton: http://logs.openstack.org/98/341098/7/gate/gate-grenade-dsvm-neutron-ubuntu-trusty/6c4ef6c/logs/testr_results.html.gz | 16:44 |
*** yamamoto has joined #openstack-neutron | 16:44 | |
*** regXboi has quit IRC | 16:44 | |
armax | this time we failed to get dhcp | 16:44 |
*** yamamoto has quit IRC | 16:44 | |
sc68cal | sorry, tried to help with os-vif integration for mtu but the patch got bogged down in bikeshedding | 16:45 |
armax | another one | 16:45 |
armax | in the gate | 16:45 |
armax | http://logs.openstack.org/09/350809/3/gate/gate-grenade-dsvm-neutron-ubuntu-trusty/76ebe73/logs/testr_results.html.gz | 16:45 |
kevinbenton | armax: see how strange this is http://logs.openstack.org/98/341098/7/gate/gate-grenade-dsvm-neutron-ubuntu-trusty/6c4ef6c/logs/testr_results.html.gz | 16:45 |
kevinbenton | armax: first vm got dhcp, floating ip and all | 16:45 |
kevinbenton | armax: and the other whithered on the vine | 16:45 |
mriedem | kevinbenton: let's blame it on a lack of integration testing, which it looks like ihar has a fix for | 16:46 |
kevinbenton | mriedem: yeah, will be nice to have something exercising that | 16:46 |
mriedem | https://review.openstack.org/#/c/370804/ | 16:48 |
*** thumpba has quit IRC | 16:48 | |
*** thumpba has joined #openstack-neutron | 16:49 | |
*** vhosakot has joined #openstack-neutron | 16:49 | |
kevinbenton | ihrachys: we don't compile OVS for grenade do we | 16:49 |
*** wolverineav has quit IRC | 16:49 | |
sc68cal | god please don't. | 16:50 |
openstackgerrit | Ankur proposed openstack/neutron: Update & Consolidate Neutron Test Coverage Devref https://review.openstack.org/371000 | 16:50 |
ihrachys | kevinbenton: no | 16:50 |
ihrachys | kevinbenton: just functional and fullstack | 16:50 |
amuller | no grenade on xenial? | 16:51 |
amuller | also uses ovs 2.5... | 16:51 |
*** Alex_Stef has quit IRC | 16:53 | |
armax | kevinbenton: http://logs.openstack.org/30/370430/6/check/gate-tempest-dsvm-neutron-dvr-ubuntu-xenial/c853e94/logs/testr_results.html.gz | 16:54 |
*** thumpba has quit IRC | 16:54 | |
armax | kevinbenton: that confirms your comment on the route warning being a red-herring? | 16:54 |
armax | it looks like the networking stack being set up fine | 16:55 |
armax | and the vm being able to get to metadata | 16:55 |
haleyb | armax: the only way that addrt warning is valid is if the existing default route isn't pointing at the neutron router, but it is most likely a red herring | 16:57 |
armax | haleyb: aye | 16:57 |
*** reedip-home has left #openstack-neutron | 16:57 | |
*** yamahata has quit IRC | 16:58 | |
*** yamahata has joined #openstack-neutron | 16:58 | |
haleyb | ihrachys: couple of questions about dhcp.filters | 16:59 |
*** fragatina has joined #openstack-neutron | 16:59 | |
haleyb | 1) how did this happen - http://logs.openstack.org/30/370430/6/check/gate-grenade-dsvm-neutron-multinode/408dfc3/logs/etc/neutron/rootwrap.d/dhcp.filters.txt.gz | 16:59 |
*** tflynn has quit IRC | 16:59 | |
*** azbiswas has quit IRC | 16:59 | |
haleyb | an upgrade and it didn't get upgraded | 16:59 |
*** tflynn has joined #openstack-neutron | 17:00 | |
*** fragatina has quit IRC | 17:00 | |
*** moshele has quit IRC | 17:00 | |
*** fragatina has joined #openstack-neutron | 17:01 | |
haleyb | armax: btw, i don't see that metering agent failure in the gate, i'm hoping the bug submitter can help a little, don't have a test env running it at the moment | 17:01 |
armax | haleyb: ok | 17:01 |
*** azbiswas_ has joined #openstack-neutron | 17:01 | |
*** nmagnezi has quit IRC | 17:03 | |
*** itlinux has joined #openstack-neutron | 17:03 | |
*** jhershbe has quit IRC | 17:03 | |
*** Fdaisuke has quit IRC | 17:04 | |
ihrachys | haleyb: I think rootwrap filters are considered config files by grenade | 17:05 |
ihrachys | so you may need to copy them in grenade | 17:05 |
haleyb | ihrachys: there is a "from-juno" directory where that is done, wondering if i need another, which would be silly | 17:06 |
*** hynekm has quit IRC | 17:06 | |
ihrachys | haleyb: exactly | 17:06 |
openstackgerrit | Nate Johnston proposed openstack/neutron-fwaas: Add devstack plugin support for fwaas v2 https://review.openstack.org/370274 | 17:08 |
haleyb | guess i have a from-mitaka patch in my future :( | 17:08 |
*** tflynn has quit IRC | 17:08 | |
haleyb | ihrachys: the other question - i don't think i need to catch NoFilterMatched, as running dhcp_release6 --help as non-root shouldn't trigger that | 17:09 |
ihrachys | haleyb: but why would you call --help at all? :) | 17:10 |
*** jpena is now known as jpena|off | 17:10 | |
*** s3wong has joined #openstack-neutron | 17:10 | |
haleyb | ihrachys: this is a better discussion then... i didn't want to continuously call dhcp-release6 if it's not there | 17:11 |
*** efoley_ has quit IRC | 17:13 | |
ihrachys | haleyb: yeah, though we consider it a broken setup | 17:17 |
*** thumpba has joined #openstack-neutron | 17:17 | |
openstackgerrit | Nate Johnston proposed openstack/neutron-fwaas: Add devstack plugin support for fwaas v2 https://review.openstack.org/370274 | 17:17 |
haleyb | ihrachys: well, if it's not easily fixable how many log.info messages do we want? :) | 17:18 |
*** rossella_ has quit IRC | 17:18 | |
*** rossella_ has joined #openstack-neutron | 17:19 | |
*** eezhova has quit IRC | 17:20 | |
*** abhiraut has joined #openstack-neutron | 17:21 | |
*** abregman has quit IRC | 17:23 | |
*** ganeshnalawade has quit IRC | 17:24 | |
*** mbirru has joined #openstack-neutron | 17:25 | |
*** carlos__ has quit IRC | 17:26 | |
*** john-davidge has joined #openstack-neutron | 17:28 | |
*** sambetts is now known as sambetts|afk | 17:30 | |
*** mvk has quit IRC | 17:32 | |
*** boden has quit IRC | 17:35 | |
*** fragatina has quit IRC | 17:36 | |
ihrachys | haleyb: ack. but you could capture it when it happens? | 17:37 |
*** tonytan4ever has joined #openstack-neutron | 17:37 | |
*** SumitNaiksatam has joined #openstack-neutron | 17:38 | |
*** obondarev has joined #openstack-neutron | 17:42 | |
*** itlinux has quit IRC | 17:43 | |
*** ihrachys has quit IRC | 17:43 | |
*** trevormc has joined #openstack-neutron | 17:44 | |
*** ltomasbo has quit IRC | 17:45 | |
*** yamamoto has joined #openstack-neutron | 17:45 | |
*** chandanc__ has joined #openstack-neutron | 17:45 | |
*** akamyshnikova_ has quit IRC | 17:47 | |
*** azbiswas_ has quit IRC | 17:47 | |
openstackgerrit | Nate Johnston proposed openstack/neutron-fwaas: Add devstack plugin support for fwaas v2 https://review.openstack.org/370274 | 17:49 |
openstackgerrit | Sindhu Devale proposed openstack/neutron: Integration of RouterRoute OVO https://review.openstack.org/367071 | 17:49 |
*** bana_k has joined #openstack-neutron | 17:50 | |
*** yamamoto has quit IRC | 17:52 | |
*** itlinux has joined #openstack-neutron | 17:53 | |
*** moshele has joined #openstack-neutron | 17:54 | |
*** ivar-lazzaro has quit IRC | 17:55 | |
*** obondarev has quit IRC | 17:55 | |
*** ivar-lazzaro has joined #openstack-neutron | 17:56 | |
*** tidwellr has quit IRC | 17:59 | |
*** ankur-gupta-f has quit IRC | 18:00 | |
*** brad_behle has quit IRC | 18:01 | |
*** ivar-lazzaro has quit IRC | 18:01 | |
*** brad_behle has joined #openstack-neutron | 18:01 | |
*** fragatina has joined #openstack-neutron | 18:04 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Retry setting mac address on new OVS port 10 times https://review.openstack.org/371032 | 18:05 |
*** tflynn has joined #openstack-neutron | 18:07 | |
*** bana_k has quit IRC | 18:08 | |
openstackgerrit | Merged openstack/neutron: Catch RPC errors in trunk skeleton https://review.openstack.org/368709 | 18:09 |
*** iyamahat has quit IRC | 18:11 | |
*** mvk has joined #openstack-neutron | 18:12 | |
*** yamahata has quit IRC | 18:13 | |
dasm | sbelous: just noticed info about https://bugs.launchpad.net/neutron/+bug/1623390 added extra findings.. it looks strange to me. | 18:16 |
openstack | Launchpad bug 1623390 in neutron "Wrong calculation of quotas " [Undecided,New] - Assigned to Sergey Belous (sbelous) | 18:16 |
*** vijaykc4 has quit IRC | 18:17 | |
*** vijaykc4 has joined #openstack-neutron | 18:17 | |
*** vijaykc4 has quit IRC | 18:18 | |
mriedem | damn ihar left | 18:19 |
mriedem | kevinbenton: have you looked at johnthetubaguy's workaround patch in nova for the mtu bug? https://review.openstack.org/#/c/370681/ | 18:19 |
mriedem | i've got a bunch of questions in there | 18:19 |
mriedem | ihar's test passed but that is i think only with ovs, doesn't test linuxbridge | 18:19 |
mriedem | since we don't run the lb job on d-g changes | 18:19 |
*** bana_k has joined #openstack-neutron | 18:21 | |
*** s3wong has quit IRC | 18:21 | |
*** rodrigods has quit IRC | 18:22 | |
*** rodrigods has joined #openstack-neutron | 18:22 | |
*** ivar-lazzaro has joined #openstack-neutron | 18:22 | |
*** pcaruana has joined #openstack-neutron | 18:22 | |
*** alraddarla_ has quit IRC | 18:25 | |
*** sdake_ is now known as sdake | 18:26 | |
*** iyamahat has joined #openstack-neutron | 18:27 | |
dasm | kevinbenton: any progress with this bug? any extra findings? | 18:27 |
kevinbenton | dasm: i did trace one of the failures directly to the disappearing ovs port issue | 18:35 |
kevinbenton | dasm: waiting for feedback on https://review.openstack.org/371032 from gate | 18:35 |
dasm | kevinbenton: ack. looking, thanks | 18:35 |
*** Esha_ has joined #openstack-neutron | 18:35 | |
kevinbenton | mriedem: yes, i checked out his patch | 18:35 |
kevinbenton | mriedem: tested locally with ovs and it seemed to be doing things sanely | 18:35 |
*** tidwellr has joined #openstack-neutron | 18:35 | |
kevinbenton | mriedem: haven't with linux bridge though | 18:36 |
*** Esha has quit IRC | 18:36 | |
kevinbenton | mriedem: can you propose a depends-on with his patch to neutron to trigger a linuxbridge run? | 18:36 |
rtheis | hi folks, networking-ovn gate is starting to show signs of trouble. Curious what are the critical neutron issues being worked so I can check if related | 18:36 |
*** Esha_ is now known as Esha | 18:36 | |
kevinbenton | rtheis: big one is grenade failures | 18:36 |
kevinbenton | rtheis: failing on network_basic_ops tests | 18:37 |
mriedem | kevinbenton: yup | 18:37 |
*** ivar-lazzaro has quit IRC | 18:37 | |
*** moshele has quit IRC | 18:38 | |
*** chandanc__ has quit IRC | 18:38 | |
dasm | rtheis: https://bugs.launchpad.net/neutron/+bug/1623732 | 18:39 |
openstack | Launchpad bug 1623732 in neutron "failed: route add -net "0.0.0.0/0" gw "10.1.0.1" leads to test_network_basic_ops to fail with SSHTimeout" [Critical,Confirmed] | 18:39 |
*** tongli has joined #openstack-neutron | 18:39 | |
openstackgerrit | Matt Riedemann proposed openstack/neutron: DNM: Test os-vif/mtu/linuxbridge fix https://review.openstack.org/371051 | 18:39 |
mriedem | kevinbenton: ^ | 18:39 |
*** mkolesni has joined #openstack-neutron | 18:39 | |
rtheis | thanks, will take a look | 18:39 |
kevinbenton | mriedem: danke | 18:39 |
mriedem | gah i need to update the regex here https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L2055 | 18:41 |
*** itsuugo has quit IRC | 18:42 | |
*** fragatina has quit IRC | 18:43 | |
*** fragatina has joined #openstack-neutron | 18:43 | |
*** itsuugo has joined #openstack-neutron | 18:44 | |
*** yamahata has joined #openstack-neutron | 18:45 | |
clarkb | armax: kevinbenton do you all still want a test instance held? | 18:47 |
armax | clarkb: that would be good | 18:47 |
clarkb | I am back home now from running errands and can do that if you point out one that is goign to fail to me | 18:47 |
clarkb | (I will try to keep my eyes open too) | 18:47 |
*** ivar-lazzaro has joined #openstack-neutron | 18:49 | |
openstackgerrit | Nate Johnston proposed openstack/neutron-fwaas: Add devstack plugin support for fwaas v2 https://review.openstack.org/370274 | 18:49 |
*** abhiraut has quit IRC | 18:49 | |
*** abhiraut1 has joined #openstack-neutron | 18:49 | |
*** fzdarsky has joined #openstack-neutron | 18:51 | |
armax | https://github.com/openstack/neutron/blob/master/neutron/services/trunk/drivers/openvswitch/agent/trunk_manager.py#L96 | 18:51 |
armax | sorry wrong window | 18:52 |
*** baoli has joined #openstack-neutron | 18:52 | |
*** dane_leblanc has quit IRC | 18:52 | |
*** dane_leblanc has joined #openstack-neutron | 18:53 | |
kevinbenton | armax: i suspect my fix should limp us by. check this out http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22%2C%20in%20set_address%5C%22 | 18:54 |
armax | so you think the underlying issue is https://bugs.launchpad.net/neutron/+bug/1618987 all along? | 18:56 |
openstack | Launchpad bug 1618987 in neutron "test_connection_from_diff_address_scope intermittent "Cannot find device" errors" [Critical,Confirmed] | 18:56 |
kevinbenton | armax: i think so | 18:56 |
kevinbenton | armax: i suspect my dhcp may have made the dhcp agent busier | 18:57 |
kevinbenton | armax: and ovs is experiencing difficulties | 18:57 |
armax | poor ovs | 18:57 |
kevinbenton | so far my patch has passed regular grenade | 18:57 |
kevinbenton | waitng on dvr grenade | 18:57 |
kevinbenton | multinode | 18:58 |
armax | jlibosva: ^ | 18:58 |
*** ivc_ has quit IRC | 18:59 | |
*** fzdarsky has quit IRC | 18:59 | |
*** hynekm has joined #openstack-neutron | 19:00 | |
*** john-davidge has quit IRC | 19:01 | |
*** absubram has quit IRC | 19:01 | |
*** hynekm has quit IRC | 19:01 | |
*** ankur-gupta-f has joined #openstack-neutron | 19:02 | |
dasm | kevinbenton: one thing about your patch: https://review.openstack.org/#/c/371032/1/neutron/agent/linux/interface.py if you'll respin, could you add extra info to Exception and comment, regarding bug number? | 19:03 |
*** ijw has joined #openstack-neutron | 19:03 | |
dasm | kevinbenton: just, for future reference (or simpler debugging) | 19:03 |
kevinbenton | dasm: will do, waiting for results and then respin with new commit | 19:03 |
dasm | kevinbenton: sure, understandable. | 19:03 |
dasm | zuul, so far, so good. | 19:04 |
*** azbiswas has joined #openstack-neutron | 19:04 | |
*** baojg has quit IRC | 19:05 | |
*** eezhova has joined #openstack-neutron | 19:05 | |
*** baojg has joined #openstack-neutron | 19:05 | |
kevinbenton | dasm, armax: got passes on all voting grenade jobs. going to respin so we get another run started | 19:06 |
armax | kevinbenton: ack | 19:06 |
openstackgerrit | Kevin Benton proposed openstack/neutron: Retry setting mac address on new OVS port 10 times https://review.openstack.org/371032 | 19:07 |
armax | talking to jlibosva, it looks like the port glitch may cause the metadata proxy to be spawned | 19:07 |
*** krtaylor has quit IRC | 19:07 | |
armax | that would explain why this happens on grenade more often | 19:07 |
*** salv-orlando has quit IRC | 19:07 | |
*** matrohon has joined #openstack-neutron | 19:07 | |
armax | as grenade is the only job that still uses metadata | 19:07 |
armax | clarkb: ^ correct? | 19:07 |
*** abregman has joined #openstack-neutron | 19:08 | |
armax | kevinbenton: errata corrige: may cause the metadata proxy failing to spawn | 19:08 |
kevinbenton | armax: grenade may be more contentious for ovs as well, since the agents are starting with pre-existing resources server side that they wire up very quickly | 19:09 |
*** akshai has quit IRC | 19:09 | |
rtheis | networking-ovn is seeing key errors on "ERROR neutron.agent.dhcp.agent subnet_dhcp_ip = subnet_to_interface_ip[subnet.id]" | 19:09 |
rtheis | is this a known issue? | 19:09 |
openstackgerrit | Nate Johnston proposed openstack/neutron-fwaas: Add devstack plugin support for fwaas v2 https://review.openstack.org/370274 | 19:09 |
armax | rtheis: probably caused by kevinbenton’s attempt to break dhcp for good | 19:10 |
rtheis | :) | 19:10 |
armax | rtheis: this one went in recently https://review.openstack.org/#/c/355117/ | 19:10 |
armax | I am surprsied those are seen on the ovn gate only thought | 19:11 |
clarkb | armax: that sounds right? I think we also use it in the live migration jobs too | 19:11 |
*** akshai has joined #openstack-neutron | 19:11 | |
armax | clarkb: ack | 19:11 |
*** fzdarsky has joined #openstack-neutron | 19:11 | |
kevinbenton | rtheis: looks like it's been lurking for a while http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22subnet_dhcp_ip%20%3D%20subnet_to_interface_ip%5Bsubnet.id%5D%5C%22 | 19:11 |
kevinbenton | rtheis: is it causing failures? | 19:12 |
*** john-davidge has joined #openstack-neutron | 19:12 | |
rtheis | kevinbenton: not entirely sure yet | 19:12 |
kevinbenton | rtheis: it should get a fix either way | 19:12 |
rtheis | networking-ovn native services job appears to run fine | 19:12 |
openstackgerrit | Ankur proposed openstack/neutron: Update & Consolidate Neutron Test Coverage Devref https://review.openstack.org/371000 | 19:12 |
rtheis | running neutron agents is were we are failing various tempest tests | 19:13 |
rtheis | still looking into it ... | 19:13 |
*** rkukura_ has joined #openstack-neutron | 19:14 | |
kevinbenton | rtheis: yeah, i see a bad assumption in there | 19:15 |
kevinbenton | rtheis: that leads to that keyerror | 19:16 |
*** rkukura has quit IRC | 19:16 | |
*** rkukura_ is now known as rkukura | 19:16 | |
*** fragatina has quit IRC | 19:17 | |
*** fragatina has joined #openstack-neutron | 19:18 | |
*** john-davidge has quit IRC | 19:19 | |
*** fragatina has quit IRC | 19:19 | |
*** fragatina has joined #openstack-neutron | 19:19 | |
*** john-davidge has joined #openstack-neutron | 19:19 | |
*** boden has joined #openstack-neutron | 19:20 | |
*** abregman has quit IRC | 19:21 | |
*** fzdarsky has quit IRC | 19:22 | |
*** mhickey has joined #openstack-neutron | 19:23 | |
openstackgerrit | Brian Haley proposed openstack/neutron: Fix dhcp_release6 error when not supported https://review.openstack.org/366291 | 19:23 |
*** john-davidge has quit IRC | 19:23 | |
*** ametts has joined #openstack-neutron | 19:26 | |
kevinbenton | rtheis: well can you file a bug for that keyerror? | 19:26 |
rtheis | kevinbenton: I will. Sorry, busy with another meeting | 19:27 |
rtheis | doing it now | 19:27 |
kevinbenton | rtheis: oh, no worries | 19:27 |
kevinbenton | rtheis: i didn't mean to make it sound like i was waiting | 19:27 |
rtheis | np | 19:28 |
kevinbenton | rtheis: that was the sound of me realizing it wasn't as obvious as i hoped | 19:28 |
amuller | otherwiseguy: https://review.openstack.org/#/c/371032/ | 19:29 |
*** ivar-lazzaro has quit IRC | 19:29 | |
otherwiseguy | amuller: see it. I'm thinking that the underlying issue is eventlet + ovsdb native = badness since my initial test script didn't catch it and it only seems to happen with l3 stuff and not ovs agent. | 19:30 |
amuller | uhum | 19:30 |
otherwiseguy | naively modifying my test script to use eventlet pools caused the same kind of error, but I need to modify the script to be slightly less dumb to be sure. | 19:31 |
otherwiseguy | in process. | 19:31 |
otherwiseguy | kevinbenton: ^ | 19:31 |
rtheis | kevinbenton: https://bugs.launchpad.net/neutron/+bug/1624079 | 19:31 |
openstack | Launchpad bug 1624079 in neutron "KeyError on "subnet_dhcp_ip = subnet_to_interface_ip[subnet.id]"" [Undecided,New] | 19:31 |
*** aswadr_ has quit IRC | 19:32 | |
*** fragatina has quit IRC | 19:32 | |
*** pcaruana has quit IRC | 19:32 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Expire DB objects in ML2 infinity loops https://review.openstack.org/370920 | 19:32 |
kevinbenton | carl_baldwin: addressed comments ^ | 19:33 |
kevinbenton | rtheis: thx | 19:33 |
*** davidlenwell has quit IRC | 19:34 | |
kevinbenton | otherwiseguy: do you think it could be from the multiple ovsdb connections from the different agents? | 19:34 |
*** Esha has quit IRC | 19:34 | |
kevinbenton | otherwiseguy: i.e. in your test script do you have two processes doing bad evil? | 19:34 |
*** fzdarsky has joined #openstack-neutron | 19:34 | |
kevinbenton | otherwiseguy: (in case you want more logs to look at. 500 occurences over 7 days http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22%2C%20in%20set_address%5C%22) | 19:37 |
openstackgerrit | Brian Haley proposed openstack/neutron: Fix metering-agent iptables restore failure https://review.openstack.org/370902 | 19:37 |
*** donghao has joined #openstack-neutron | 19:38 | |
*** tongli has quit IRC | 19:38 | |
*** fragatina has joined #openstack-neutron | 19:38 | |
*** donghao has quit IRC | 19:39 | |
*** itlinux has quit IRC | 19:39 | |
*** fragatin_ has joined #openstack-neutron | 19:40 | |
*** fragatina has quit IRC | 19:40 | |
*** jprovazn has quit IRC | 19:40 | |
*** david-lyle has quit IRC | 19:40 | |
*** david-lyle has joined #openstack-neutron | 19:40 | |
kevinbenton | HenryG: around? | 19:42 |
*** fragatin_ has quit IRC | 19:44 | |
*** korzen has joined #openstack-neutron | 19:45 | |
*** davidlenwell has joined #openstack-neutron | 19:47 | |
*** ivar-lazzaro has joined #openstack-neutron | 19:48 | |
*** itlinux has joined #openstack-neutron | 19:48 | |
*** fzdarsky_ has joined #openstack-neutron | 19:48 | |
*** sdake has quit IRC | 19:49 | |
*** sdake_ has joined #openstack-neutron | 19:49 | |
*** fzdarsky has quit IRC | 19:49 | |
otherwiseguy | kevinbenton: ugly script that seems to recreate the issue for me: http://paste.fedoraproject.org/428631/69109147/ | 19:52 |
*** rcernin has joined #openstack-neutron | 19:53 | |
otherwiseguy | (it could be much smaller, but has a bunch of stuff from trying to figure out wtf was going on) | 19:53 |
*** itsuugo has quit IRC | 19:53 | |
*** itsuugo has joined #openstack-neutron | 19:55 | |
openstackgerrit | Sindhu Devale proposed openstack/neutron: Integration of FlatAllocation OVO https://review.openstack.org/368499 | 19:55 |
*** baoli has quit IRC | 19:56 | |
*** manjeets__ has joined #openstack-neutron | 19:56 | |
*** baoli has joined #openstack-neutron | 19:56 | |
*** krtaylor has joined #openstack-neutron | 19:56 | |
kevinbenton | otherwiseguy: cool | 19:59 |
*** ametts has quit IRC | 20:01 | |
*** fragatina has joined #openstack-neutron | 20:01 | |
openstackgerrit | Sindhu Devale proposed openstack/neutron: Integration of FlatAllocation OVO https://review.openstack.org/368499 | 20:04 |
*** fragatina has quit IRC | 20:05 | |
rtheis | kevinbenton: some of the networking-ovn gate failures are related to vif binding timeout. The logs show OVN reporting the port up and then networking-ovn marking the provisioning status complete but that doesn't make its way to nova. | 20:05 |
*** mhickey has quit IRC | 20:06 | |
openstackgerrit | Armando Migliaccio proposed openstack/neutron: Add metadata router_update handler https://review.openstack.org/371085 | 20:07 |
armax | kevinbenton, carl_baldwin: ^ some WIP to amuller on | 20:07 |
armax | :) | 20:07 |
armax | jlibosva: ^ | 20:07 |
armax | mull over I mean | 20:07 |
amuller | armax: I don't understand... if process_router fails mid-way, a bunch of stuff won't work, including spawning the metadata proxy | 20:08 |
armax | correct | 20:08 |
amuller | why do we want to handle that particular thing | 20:08 |
armax | but then a router update may come along, which might sanitize things | 20:09 |
armax | and yet the metadata proxy is forgotten | 20:09 |
armax | because there’s no update callback for it | 20:09 |
amuller | gotcha | 20:09 |
amuller | I agree we need to able to recover in subsequent updates | 20:09 |
*** absubram has joined #openstack-neutron | 20:09 | |
armax | http://logs.openstack.org/24/369824/1/gate/gate-grenade-dsvm-neutron-ubuntu-trusty/4df9eb1/logs/new/screen-q-l3.txt.gz?#_2016-09-15_17_39_48_408 | 20:10 |
*** mkolesni has quit IRC | 20:10 | |
*** gvrangan has quit IRC | 20:10 | |
*** fragatina has joined #openstack-neutron | 20:10 | |
armax | my patch surely is not perfect now, don’t get me wrong | 20:10 |
amuller | so when it encounters an error it resyncs the router but doesn't spawn the proxy? | 20:10 |
armax | but i can see here the router create fails | 20:10 |
armax | http://logs.openstack.org/24/369824/1/gate/gate-grenade-dsvm-neutron-ubuntu-trusty/4df9eb1/logs/new/screen-q-l3.txt.gz?#_2016-09-15_17_39_48_411 | 20:10 |
armax | there’s no resync afaik | 20:10 |
armax | http://logs.openstack.org/24/369824/1/gate/gate-grenade-dsvm-neutron-ubuntu-trusty/4df9eb1/logs/new/screen-q-l3.txt.gz?#_2016-09-15_17_39_48_414 | 20:10 |
armax | but an update straight away | 20:11 |
*** ijw has quit IRC | 20:11 | |
*** ijw has joined #openstack-neutron | 20:11 | |
armax | could be that by the time the resync is processed the router might be gone already? | 20:12 |
*** korzen has quit IRC | 20:12 | |
*** iranzo has quit IRC | 20:12 | |
amuller | could be | 20:12 |
amuller | I would expect a resync on a failure to config a router interface | 20:12 |
amuller | looking at the log | 20:13 |
*** itlinux has quit IRC | 20:13 | |
armax | amuller: yeah, still going through the log | 20:13 |
*** ametts has joined #openstack-neutron | 20:13 | |
amuller | armax: do you see that the next 'update' has a priority of 1? | 20:14 |
amuller | armax: that's code for PRIORITY_SYNC_ROUTERS_TASK | 20:14 |
*** fragatina has quit IRC | 20:15 | |
armax | I do now yeah | 20:15 |
amuller | so yeah it resyncs | 20:15 |
armax | sure | 20:16 |
*** ijw has quit IRC | 20:16 | |
armax | but does that lead to a process_router_created call? | 20:16 |
amuller | no I don't think so | 20:17 |
armax | I see it being processed in http://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n471 | 20:17 |
armax | perhaps the problem lies here: | 20:18 |
armax | http://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n442 | 20:18 |
armax | we fail here: | 20:19 |
armax | http://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n451 | 20:19 |
armax | we should probably catch the exception, remove the router from the dict and reraise? | 20:19 |
armax | but that’s probably more awkward | 20:19 |
armax | we fail at line 451 | 20:19 |
armax | and thus the created event is not emitted | 20:19 |
amuller | you may be right, if we fail to add a router initially we should delete all traces of it | 20:19 |
armax | amuller: now on resync | 20:20 |
amuller | so it's considered a "new" router on resync | 20:20 |
armax | we go in the update branch | 20:20 |
amuller | right | 20:20 |
amuller | that's the issue, you're right | 20:20 |
armax | thus the clusterfudge | 20:20 |
armax | amuller: dunno | 20:20 |
armax | tell me what’s best | 20:20 |
armax | carl_baldwin: ^ | 20:20 |
* carl_baldwin reading back... | 20:20 | |
armax | the router should be removed though | 20:21 |
armax | http://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n515 | 20:21 |
armax | unless things interleave? | 20:21 |
armax | ah | 20:22 |
openstackgerrit | Nate Johnston proposed openstack/neutron-fwaas: Add devstack plugin support for fwaas v2 https://review.openstack.org/370274 | 20:22 |
armax | http://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n516 | 20:23 |
armax | we go in this block of the except | 20:23 |
armax | amuller: thus we don’t remove the router from the dict | 20:23 |
amuller | armax: there's a function called _resync_router | 20:23 |
amuller | armax: that should also delete the local cached copy of the router | 20:23 |
armax | amuller: it doesn’t as far as I can tell | 20:23 |
armax | I mean | 20:24 |
amuller | it should be patched to so do :) | 20:24 |
amuller | do so* | 20:24 |
armax | the router is not removed from self.router_info | 20:24 |
armax | if we fail badly here | 20:24 |
armax | http://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n508 | 20:24 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/os-vif: Updated from global requirements https://review.openstack.org/371116 | 20:24 |
*** tbachman has quit IRC | 20:25 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-neutronclient: Updated from global requirements https://review.openstack.org/371124 | 20:26 |
armax | not sure what’s the best course of action here | 20:26 |
armax | amuller: I could see that we’d want to do a safe remove unconditionally here? | 20:27 |
armax | http://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n509 | 20:27 |
amuller | a patch specifically for the metadata proxy leaves us open to other, similar issues where the router is not considered "new" on resync | 20:27 |
armax | amuller: I’ll let this simmer for a bit | 20:27 |
amuller | so I would go for a more general fix | 20:27 |
armax | that’s probably outside my area of comfort | 20:27 |
armax | and time I could spend on this | 20:27 |
*** jckasper has quit IRC | 20:28 | |
armax | I leave this in the capable hands of the L3 team | 20:28 |
*** abregman has joined #openstack-neutron | 20:28 | |
armax | carl_baldwin: ^ | 20:28 |
*** jckasper has joined #openstack-neutron | 20:28 | |
carl_baldwin | armax: Let me pull up the log and see the error. | 20:29 |
*** fragatina has joined #openstack-neutron | 20:29 | |
*** ivar-laz_ has joined #openstack-neutron | 20:29 | |
*** jlibosva has quit IRC | 20:30 | |
armax | amuller: so ideally we’d have a two pronged appraoch | 20:30 |
armax | kevinbenton’s stop-gap | 20:30 |
armax | https://review.openstack.org/#/c/371032/ | 20:30 |
armax | and a variant of https://review.openstack.org/#/c/371085/ | 20:30 |
armax | amuller: do you concur? | 20:30 |
amuller | carl_baldwin: A summary would be that there's an issue when configuring a router interface during process_router, the agent catches the exception and resyncs the router. When it configures it again everything succeeds. However, the metadata proxy is not spawned. This is because when the agent resyncs a router it doesn't consider it a "new" router (it already exists in self.router_info), and the metadata proxy is | 20:31 |
amuller | spawned only for new routers. | 20:31 |
amuller | armax: agreed it's two totally different bugs | 20:31 |
armax | same root cause though | 20:31 |
amuller | yup | 20:31 |
amuller | well | 20:31 |
amuller | same reproducer :) | 20:31 |
*** ivar-lazzaro has quit IRC | 20:32 | |
armax | carl_baldwin: so my half-assed fix is trying to addind an update listener on the metadata | 20:32 |
armax | and leave the existing l3 agent logic untouched | 20:32 |
*** jckasper has quit IRC | 20:32 | |
carl_baldwin | Give me a few minutes. Have to talk to someone at my desk. .... | 20:32 |
amuller | an alternative approach armax and I discussed is for the agent to consider resynced routers as "new" routers | 20:33 |
*** ijw has joined #openstack-neutron | 20:33 | |
*** abregman has quit IRC | 20:33 | |
amuller | to prevent similar issues in the future | 20:33 |
openstackgerrit | Manjeet Singh Bhatia proposed openstack/neutron: Introduce OVO for quotas https://review.openstack.org/338625 | 20:33 |
armax | amuller: perhaps we should always assume new routers every time we face an error | 20:34 |
amuller | right | 20:34 |
armax | though I am not sure why it was done the way it has | 20:34 |
amuller | it also means that the "new routers" code path needs to be idempotent to resources already on the system | 20:34 |
armax | hence I was hesitant to touch the existing error handling l3 agent side | 20:34 |
*** zzzeek has quit IRC | 20:35 | |
armax | I figured an update callback on the metadata proxy was a nice addition either way | 20:35 |
armax | and it has far fewer remifications | 20:35 |
armax | ramifications* | 20:35 |
rtheis | I believe that DHCP or a retry mechanism is marking port provisioning complete prematurely | 20:35 |
*** ranjithd has quit IRC | 20:36 | |
rtheis | OVN marks that port down yet something is indicating that it is up | 20:36 |
openstackgerrit | Shashank Kumar Shankar proposed openstack/neutron: Integration of OVO Provisioning Block https://review.openstack.org/361303 | 20:37 |
*** fzdarsky_ has quit IRC | 20:37 | |
*** ijw has quit IRC | 20:38 | |
*** jckasper has joined #openstack-neutron | 20:38 | |
*** jckasper has quit IRC | 20:38 | |
*** jckasper has joined #openstack-neutron | 20:39 | |
*** ranjithd has joined #openstack-neutron | 20:39 | |
*** zzzeek has joined #openstack-neutron | 20:39 | |
*** eezhova has quit IRC | 20:39 | |
*** wolverineav has joined #openstack-neutron | 20:40 | |
*** baoli has quit IRC | 20:41 | |
*** baoli has joined #openstack-neutron | 20:41 | |
*** ametts has quit IRC | 20:42 | |
armax | amuller, carl_baldwin: I posted a comment here: https://bugs.launchpad.net/neutron/+bug/1623732/comments/14 | 20:43 |
openstack | Launchpad bug 1623732 in neutron "test_network_basic_ops to fail with SSHTimeout" [Critical,In progress] - Assigned to Armando Migliaccio (armando-migliaccio) | 20:43 |
armax | I’ll be afk for a bit | 20:43 |
*** jckasper has quit IRC | 20:43 | |
openstackgerrit | Nate Johnston proposed openstack/neutron-fwaas: Add devstack plugin support for fwaas v2 https://review.openstack.org/370274 | 20:44 |
openstackgerrit | Anindita Das proposed openstack/neutron: OVO Gre Allocation Endpoints https://review.openstack.org/361289 | 20:46 |
*** itsuugo has quit IRC | 20:47 | |
*** itsuugo has joined #openstack-neutron | 20:50 | |
*** baoli has quit IRC | 20:53 | |
*** ijw has joined #openstack-neutron | 20:53 | |
*** akshai has quit IRC | 20:54 | |
*** gouthamr has quit IRC | 20:54 | |
*** baoli has joined #openstack-neutron | 20:55 | |
* carl_baldwin back | 20:56 | |
carl_baldwin | armax: amuller: sorry for the interruption. | 20:57 |
*** nherciu has quit IRC | 20:57 | |
openstackgerrit | Merged openstack/neutron-lib: Updated from global requirements https://review.openstack.org/368119 | 20:57 |
*** s3wong has joined #openstack-neutron | 20:58 | |
*** ijw has quit IRC | 20:58 | |
*** wolverineav has quit IRC | 20:58 | |
*** thumpba has quit IRC | 20:59 | |
*** thumpba has joined #openstack-neutron | 20:59 | |
openstackgerrit | Brian Haley proposed openstack/neutron: Fix dhcp_release6 error when not supported https://review.openstack.org/366291 | 21:00 |
*** gvrangan has joined #openstack-neutron | 21:00 | |
*** zkassab_ has quit IRC | 21:00 | |
carl_baldwin | armax: I'm not sure yet what the best thing to do is. Maybe it is a combination of things. | 21:01 |
carl_baldwin | armax: On one hand, avoiding the failure in the first place would be ideal. I think this is what kevinbenton is after, right? | 21:02 |
openstackgerrit | Aradhana Singh proposed openstack/neutron: OVO for Tag https://review.openstack.org/356825 | 21:03 |
carl_baldwin | armax: On the other hand, when/if there are failures in creating a router, it seems right to tear the router down and try again. | 21:04 |
*** cbouch has quit IRC | 21:04 | |
*** banix has quit IRC | 21:05 | |
*** matrohon has quit IRC | 21:05 | |
carl_baldwin | But, at that point, how do we know what kind of retry will result in success the next time? Can we just try again assuming its an intermittent failure like this one? Or, should we kick it back to the scheduler to try on another host? | 21:05 |
carl_baldwin | armax: Then, there's your proposed fix. If we're in the middle of an update and we notice the metadata service is not running, why not restart it? | 21:06 |
*** ivc_ has joined #openstack-neutron | 21:07 | |
carl_baldwin | armax: The L3, as far as I remember, has always worked in a "whatever isn't right, fix it" kind of mentality. | 21:08 |
*** gouthamr has joined #openstack-neutron | 21:09 | |
openstackgerrit | Kevin Benton proposed openstack/neutron: Retry setting mac address on new OVS port 10 times https://review.openstack.org/371032 | 21:09 |
*** ijw has joined #openstack-neutron | 21:09 | |
*** gvrangan_ has joined #openstack-neutron | 21:09 | |
*** thumpba has quit IRC | 21:10 | |
*** akshai has joined #openstack-neutron | 21:10 | |
*** salv-orlando has joined #openstack-neutron | 21:11 | |
*** gvrangan has quit IRC | 21:11 | |
openstackgerrit | Nate Johnston proposed openstack/neutron-fwaas: Add devstack plugin support for fwaas v2 https://review.openstack.org/370274 | 21:13 |
*** ivar-laz_ has quit IRC | 21:13 | |
*** ivar-lazzaro has joined #openstack-neutron | 21:13 | |
amuller | carl_baldwin: we already do retries though... we grab the information fresh from the server and try to configure it again | 21:14 |
amuller | carl_baldwin: seems correct to treat the router as new in the resync | 21:15 |
*** catintheroof has joined #openstack-neutron | 21:15 | |
amuller | carl_baldwin: it's possibly not a trivial change though to get it right | 21:15 |
*** ivar-lazzaro has quit IRC | 21:15 | |
*** krtaylor has quit IRC | 21:17 | |
*** salv-orlando has quit IRC | 21:18 | |
*** rossella_ has quit IRC | 21:18 | |
carl_baldwin | amuller: I know we do a retry treating it as an update. Since the original new router processing didn't succeed it doesn't make sense to treat it as an update. | 21:18 |
*** absubram has quit IRC | 21:19 | |
carl_baldwin | amuller: But, if it failed, should it be torn down until the retry or just left there hobbling along. | 21:19 |
*** rossella_ has joined #openstack-neutron | 21:19 | |
amuller | carl_baldwin: if you get errors during the cleanup? | 21:20 |
amuller | I don't see the point in a clean up | 21:20 |
amuller | the agent is designed for operations to be idempotent | 21:20 |
carl_baldwin | amuller: Then we don't need to differentiate between add and update. | 21:21 |
openstackgerrit | Kevin Benton proposed openstack/neutron: Don't raise RetryRequest for port in delete_subnet https://review.openstack.org/370508 | 21:21 |
*** salv-orlando has joined #openstack-neutron | 21:22 | |
amuller | carl_baldwin: that would be simpler | 21:22 |
amuller | also a huge change | 21:22 |
amuller | in code, not in functionality | 21:22 |
armax | carl_baldwin: the problem is that the metadata proxy is setup at all | 21:24 |
*** janzian has quit IRC | 21:24 | |
armax | *is not | 21:24 |
*** absubram has joined #openstack-neutron | 21:24 | |
armax | because during a resync the router is processed as if it were updated | 21:24 |
armax | and the metadata driver does not handle update events | 21:25 |
*** gvrangan_ has quit IRC | 21:25 | |
*** ijw has quit IRC | 21:25 | |
armax | metadata proxy life cycle is delegated to the metadata driver | 21:25 |
*** banix has joined #openstack-neutron | 21:26 | |
armax | I think the crux of the matter is this piece of code | 21:27 |
armax | http://git.openstack.org/cgit/openstack/neutron/tree/neutron/agent/l3/agent.py#n509 | 21:27 |
armax | for random exceptions we’re leaving the router in router_info | 21:27 |
armax | and thus on resync we treat the recovery by means of an update | 21:28 |
openstackgerrit | Aradhana Singh proposed openstack/neutron: [WIP] Integration for Tag OVO https://review.openstack.org/369720 | 21:28 |
*** adriant has joined #openstack-neutron | 21:28 | |
carl_baldwin | armax: I understand that. | 21:28 |
armax | and that does not make metadata proxy recover | 21:28 |
armax | carl_baldwin: ok | 21:29 |
carl_baldwin | armax: Hence your proposal to add a router_update handler. | 21:29 |
carl_baldwin | armax: I'm just thinking through it. | 21:29 |
armax | carl_baldwin: understood | 21:29 |
armax | carl_baldwin: :) | 21:30 |
carl_baldwin | armax: I think some variation on your patch (with varnish and polish) would be fine. | 21:30 |
armax | carl_baldwin: I need to go to the store and get some though | 21:31 |
carl_baldwin | armax: I was just thinking about if there is some better long-term fix. | 21:31 |
armax | carl_baldwin: I think so too | 21:31 |
armax | carl_baldwin: my mindset right now is the last impactful fix for RC | 21:32 |
armax | carl_baldwin: but kevinbenton’s might as well be a decent stop gap | 21:32 |
armax | though I don’t like the idea of leaving a hole in the l3 logic because we may fail for whatever other reason | 21:32 |
*** rvasilets___ has joined #openstack-neutron | 21:32 | |
carl_baldwin | armax: my thoughts exactly. We should fix that shy port syndrome failure | 21:33 |
openstackgerrit | Armando Migliaccio proposed openstack/neutron: Add metadata router_update handler https://review.openstack.org/371085 | 21:33 |
armax | carl_baldwin: would you still want to proceed with ^ in time for RC? | 21:34 |
openstackgerrit | Sindhu Devale proposed openstack/neutron: Relocate router route DB model https://review.openstack.org/354797 | 21:34 |
openstackgerrit | Sindhu Devale proposed openstack/neutron: OVO for Router Route https://review.openstack.org/356223 | 21:34 |
armax | clarkb: btw I think we have a lead on bug 1623732 | 21:35 |
openstack | bug 1623732 in neutron "test_network_basic_ops to fail with SSHTimeout" [Critical,In progress] https://launchpad.net/bugs/1623732 - Assigned to Armando Migliaccio (armando-migliaccio) | 21:35 |
armax | clarkb: I think we don’t need access to a faulty run | 21:35 |
carl_baldwin | armax: I think we should proceed even of not in time for rc1 | 21:35 |
carl_baldwin | I think update should probably do anything add does. Hence my suggestion that maybe they shouldn't be different. | 21:37 |
armax | carl_baldwin: indeed they hardly are | 21:37 |
*** janzian has joined #openstack-neutron | 21:37 | |
armax | https://review.openstack.org/#/c/371085/2/neutron/agent/metadata/driver.py@169 | 21:37 |
armax | carl_baldwin: I was not 100% sure if calling the created handler on update too | 21:38 |
armax | carl_baldwin: it felt a bit naughty | 21:38 |
openstackgerrit | Nakul Dahiwade proposed openstack/neutron-lib: api-ref: Fix api-ref for subnetpools https://review.openstack.org/371172 | 21:38 |
carl_baldwin | Yeah, I see where you're coming from | 21:38 |
carl_baldwin | kevinbenton: have you had much rally mileage on https://review.openstack.org/#/c/370920/ ? | 21:42 |
kevinbenton | yeah, it did quite a bit better on the one runi tried. there were some errors solved by the other fix i sent to the gate | 21:44 |
kevinbenton | then you're bug :) | 21:44 |
kevinbenton | your* | 21:44 |
*** xagent has joined #openstack-neutron | 21:44 | |
*** boden has quit IRC | 21:44 | |
*** karad has quit IRC | 21:44 | |
*** vaidy has quit IRC | 21:45 | |
*** 1JTAAIELL has quit IRC | 21:45 | |
*** scottda has quit IRC | 21:45 | |
*** sweston has quit IRC | 21:45 | |
*** adam_g has quit IRC | 21:45 | |
*** knikolla has quit IRC | 21:45 | |
*** kuromagi^ has joined #openstack-neutron | 21:46 | |
*** wasmum has quit IRC | 21:46 | |
*** quade has quit IRC | 21:46 | |
*** banix has quit IRC | 21:46 | |
*** kuromagi has quit IRC | 21:46 | |
*** cargonza has quit IRC | 21:46 | |
*** puck has quit IRC | 21:46 | |
*** rm_work has quit IRC | 21:46 | |
*** jamielennox has quit IRC | 21:46 | |
*** mhayden has quit IRC | 21:46 | |
*** amit213 has quit IRC | 21:47 | |
*** dkehn has quit IRC | 21:47 | |
*** gus has quit IRC | 21:47 | |
*** mrhillsman has quit IRC | 21:47 | |
*** vkmc has quit IRC | 21:47 | |
*** pradk has quit IRC | 21:48 | |
*** gus has joined #openstack-neutron | 21:48 | |
*** scottda has joined #openstack-neutron | 21:49 | |
*** sweston has joined #openstack-neutron | 21:49 | |
*** wolverineav has joined #openstack-neutron | 21:50 | |
*** saisrikiran has joined #openstack-neutron | 21:51 | |
*** adam_g has joined #openstack-neutron | 21:51 | |
*** adam_g has quit IRC | 21:51 | |
*** adam_g has joined #openstack-neutron | 21:51 | |
*** puck has joined #openstack-neutron | 21:51 | |
*** amit213 has joined #openstack-neutron | 21:51 | |
*** rm_work has joined #openstack-neutron | 21:51 | |
*** cargonza has joined #openstack-neutron | 21:52 | |
*** ijw has joined #openstack-neutron | 21:52 | |
*** knikolla has joined #openstack-neutron | 21:52 | |
*** vaidy has joined #openstack-neutron | 21:52 | |
*** wasmum has joined #openstack-neutron | 21:54 | |
*** wolverineav has quit IRC | 21:55 | |
*** jheroux has quit IRC | 21:57 | |
*** ivar-lazzaro has joined #openstack-neutron | 21:57 | |
*** vkmc has joined #openstack-neutron | 21:57 | |
*** mriedem has quit IRC | 21:58 | |
*** gvrangan has joined #openstack-neutron | 21:59 | |
*** quade has joined #openstack-neutron | 21:59 | |
*** dkehn has joined #openstack-neutron | 21:59 | |
*** mrhillsman has joined #openstack-neutron | 22:00 | |
*** mhayden has joined #openstack-neutron | 22:00 | |
*** jamielennox has joined #openstack-neutron | 22:01 | |
njohnston | drivers meeting? | 22:01 |
dougwig | Not today | 22:02 |
njohnston | ok, cool | 22:02 |
*** absubram has quit IRC | 22:02 | |
dougwig | Onwards to rc1 | 22:02 |
*** yamamoto has joined #openstack-neutron | 22:02 | |
*** akshai has quit IRC | 22:02 | |
*** yamamoto has quit IRC | 22:02 | |
*** rtheis has quit IRC | 22:03 | |
*** xagent has quit IRC | 22:03 | |
*** krtaylor has joined #openstack-neutron | 22:04 | |
*** kbringard has quit IRC | 22:05 | |
*** cleong has quit IRC | 22:05 | |
openstackgerrit | Assaf Muller proposed openstack/neutron: Add fullstack test with OVS arp_responder https://review.openstack.org/371183 | 22:05 |
*** absubram has joined #openstack-neutron | 22:08 | |
openstackgerrit | Assaf Muller proposed openstack/neutron: Add fullstack test with OVS arp_responder https://review.openstack.org/371183 | 22:08 |
*** amuller has quit IRC | 22:08 | |
*** abhiraut1 has quit IRC | 22:11 | |
*** yamamoto has joined #openstack-neutron | 22:13 | |
openstackgerrit | Armando Migliaccio proposed openstack/neutron: Add metadata router_update handler https://review.openstack.org/371085 | 22:14 |
*** edmondsw has quit IRC | 22:14 | |
*** itsuugo has quit IRC | 22:15 | |
*** itsuugo has joined #openstack-neutron | 22:17 | |
armax | haleyb: ping | 22:18 |
*** yamamoto has quit IRC | 22:18 | |
*** jkraj has joined #openstack-neutron | 22:19 | |
*** ijw has quit IRC | 22:19 | |
*** vhosakot has quit IRC | 22:20 | |
*** ijw has joined #openstack-neutron | 22:22 | |
*** marst has quit IRC | 22:22 | |
*** marst has joined #openstack-neutron | 22:23 | |
*** absubram has quit IRC | 22:23 | |
*** absubram has joined #openstack-neutron | 22:23 | |
*** yamamoto has joined #openstack-neutron | 22:24 | |
*** yamamoto has quit IRC | 22:24 | |
*** yamamoto has joined #openstack-neutron | 22:24 | |
*** marst has quit IRC | 22:26 | |
*** tonytan4ever has quit IRC | 22:27 | |
*** abhiraut has joined #openstack-neutron | 22:27 | |
*** yamamoto has quit IRC | 22:28 | |
*** salv-orlando has quit IRC | 22:32 | |
*** iyamahat_ has joined #openstack-neutron | 22:34 | |
*** iyamahat has quit IRC | 22:34 | |
*** itsuugo has quit IRC | 22:34 | |
*** azbiswas has quit IRC | 22:35 | |
*** azbiswas has joined #openstack-neutron | 22:35 | |
*** itsuugo has joined #openstack-neutron | 22:37 | |
*** azbiswas has quit IRC | 22:40 | |
*** thumpba has joined #openstack-neutron | 22:41 | |
*** marst has joined #openstack-neutron | 22:41 | |
*** itsuugo has quit IRC | 22:41 | |
*** brad_behle has quit IRC | 22:42 | |
*** brad_behle has joined #openstack-neutron | 22:42 | |
*** itsuugo has joined #openstack-neutron | 22:42 | |
*** mriedem has joined #openstack-neutron | 22:44 | |
carl_baldwin | kevinbenton: I don't quite understand. | 22:44 |
*** SKipp has joined #openstack-neutron | 22:45 | |
*** salv-orlando has joined #openstack-neutron | 22:46 | |
*** brad_behle has quit IRC | 22:46 | |
*** baojg_ has joined #openstack-neutron | 22:47 | |
*** baoli has quit IRC | 22:48 | |
*** iyamahat_ has quit IRC | 22:49 | |
*** yamahata has quit IRC | 22:49 | |
*** baojg has quit IRC | 22:49 | |
*** ijw has quit IRC | 22:50 | |
*** sdague has quit IRC | 22:52 | |
*** manjeets__ has quit IRC | 22:53 | |
carl_baldwin | kevinbenton: what did better than what? | 22:55 |
*** jamesdenton has quit IRC | 22:56 | |
*** banix has joined #openstack-neutron | 22:56 | |
*** absubram has quit IRC | 22:59 | |
*** absubram has joined #openstack-neutron | 23:03 | |
*** claudiub has quit IRC | 23:06 | |
*** itsuugo has quit IRC | 23:08 | |
*** tidwellr has quit IRC | 23:09 | |
*** itsuugo has joined #openstack-neutron | 23:09 | |
*** ijw has joined #openstack-neutron | 23:11 | |
kevinbenton | carl_baldwin: with the expire calls in there | 23:11 |
kevinbenton | carl_baldwin: there were much fewer failures | 23:11 |
*** banix has quit IRC | 23:12 | |
openstackgerrit | Manjeet Singh Bhatia proposed openstack/neutron: WIP QUOTA OVO implementation https://review.openstack.org/371212 | 23:12 |
*** jkraj has quit IRC | 23:13 | |
*** ijw has quit IRC | 23:16 | |
carl_baldwin | kevinbenton: I think I'm okay doing this. I've been trying to think of any downside. The only one I can think of is more DB round-trips. | 23:16 |
*** liuyulong_ has joined #openstack-neutron | 23:16 | |
*** Leo_ has quit IRC | 23:17 | |
*** pmannidi has joined #openstack-neutron | 23:17 | |
*** catintheroof has quit IRC | 23:21 | |
*** ivar-laz_ has joined #openstack-neutron | 23:21 | |
*** itsuugo has quit IRC | 23:23 | |
*** itsuugo has joined #openstack-neutron | 23:24 | |
*** ivar-lazzaro has quit IRC | 23:25 | |
openstackgerrit | Armando Migliaccio proposed openstack/neutron: Add metadata router_update handler https://review.openstack.org/371085 | 23:25 |
*** banix has joined #openstack-neutron | 23:28 | |
*** lujinluo has joined #openstack-neutron | 23:30 | |
*** thumpba has quit IRC | 23:30 | |
*** SKipp has quit IRC | 23:30 | |
*** trevormc has quit IRC | 23:31 | |
*** itsuugo has quit IRC | 23:35 | |
*** itsuugo has joined #openstack-neutron | 23:37 | |
*** armax has quit IRC | 23:37 | |
*** hoonetorg has quit IRC | 23:37 | |
*** rvasilets___ has quit IRC | 23:37 | |
*** markvoelker has quit IRC | 23:39 | |
*** Jeffrey4l__ is now known as Jeffrey4l | 23:40 | |
*** karad has joined #openstack-neutron | 23:41 | |
*** djan has joined #openstack-neutron | 23:42 | |
*** rmcall has quit IRC | 23:47 | |
*** itsuugo has quit IRC | 23:49 | |
*** ijw has joined #openstack-neutron | 23:50 | |
*** itsuugo has joined #openstack-neutron | 23:51 | |
*** tri2sing has quit IRC | 23:53 | |
*** armax has joined #openstack-neutron | 23:54 | |
*** hoonetorg has joined #openstack-neutron | 23:55 | |
*** thumpba has joined #openstack-neutron | 23:57 | |
*** yamamoto_ has joined #openstack-neutron | 23:58 | |
*** ijw has quit IRC | 23:58 | |
*** yb has joined #openstack-neutron | 23:58 | |
*** banix has quit IRC | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!