| *** mlavalle has quit IRC | 00:01 | |
| *** suresh12 has quit IRC | 00:10 | |
| *** jgrimm has quit IRC | 00:13 | |
| *** dave_tucker has quit IRC | 00:20 | |
| *** hxgqh1987 has joined #openstack-neutron | 00:22 | |
| *** openstackgerrit has quit IRC | 00:24 | |
| *** openstackgerrit has joined #openstack-neutron | 00:24 | |
| *** ekarlso has quit IRC | 00:25 | |
| *** ekarlso has joined #openstack-neutron | 00:25 | |
| *** banix has quit IRC | 00:29 | |
| *** carl_baldwin has quit IRC | 00:35 | |
| openstackgerrit | Aaron Rosen proposed a change to openstack/neutron: Bump api_workers from 0 to 4 https://review.openstack.org/59787 | 00:36 |
|---|---|---|
| anteaya | anyone work beside arosen? can you ask him to join us in irc? | 00:46 |
| *** alagalah has quit IRC | 00:56 | |
| *** Mr_W has joined #openstack-neutron | 00:57 | |
| openstackgerrit | Aaron Rosen proposed a change to openstack/neutron: Nicira: Fix core_plugin path and update default values in README https://review.openstack.org/61903 | 01:05 |
| anteaya | mestery: any progress for you on bug 1243896? | 01:05 |
| *** suresh12 has joined #openstack-neutron | 01:09 | |
| * anteaya looks around for other volunteers | 01:12 | |
| anteaya | garyk: you available to help on a bug? | 01:12 |
| anteaya | https://bugs.launchpad.net/tempest/+bug/1253896 | 01:12 |
| anteaya | HenryG: shopping this bug around | 01:14 |
| anteaya | dkehn: any chance you can spend some time helping with this bug? bug 1253896 | 01:16 |
| *** ljjjustin has joined #openstack-neutron | 01:18 | |
| *** hxgqh1987 has quit IRC | 01:20 | |
| beagles | the funny thing about these tests is that it is hard to define what they are testing... the best definition I can come up with is "will ssh work to a VM before some arbitrary time passes"... | 01:29 |
| beagles | arggh.. frickin chat client won't let me change my nick... weird | 01:30 |
| anteaya | beagles: yes | 01:30 |
| beagles | anyways... timeout based tests are ... interesting | 01:30 |
| anteaya | they are a moving target | 01:30 |
| anteaya | no kidding | 01:30 |
| anteaya | perhaps one solution is to change the test? | 01:31 |
| beagles | what it would need to be a more deterministic test is more control points | 01:31 |
| anteaya | that sounds reasonable to me | 01:31 |
| beagles | the fact that it is too slow could be a failure assertion based on the time to complete the test | 01:31 |
| anteaya | what control points would you like to see | 01:31 |
| anteaya | it could | 01:31 |
| beagles | hrmmm | 01:31 |
| *** SumitNaiksatam has joined #openstack-neutron | 01:32 | |
| beagles | ideally a token placed somewhere after the init scripts in the target VM had completed running.. but that might be asking too much | 01:34 |
| anteaya | yeah, tracking storing and then cleaning up tokens creates its own problems | 01:35 |
| beagles | the test would still have to time out somewhere is still an issue... | 01:35 |
| beagles | true that | 01:35 |
| anteaya | right | 01:35 |
| anteaya | so how to write a better test | 01:36 |
| beagles | re: time .. tests that take too long need to go away. | 01:36 |
| * anteaya nods | 01:36 | |
| beagles | heck.. even something other than SSH might be better... a simple HTTP reply or something | 01:38 |
| anteaya | beagles: do you see any possibilities for alteration in the test that is associated with bug 1253896? | 01:38 |
| anteaya | beagles: I just assumed ssh was necessary under the circumstances | 01:38 |
| beagles | anteaya: might be... | 01:38 |
| anteaya | it is possible that HTTP would suffice? | 01:38 |
| *** dims has quit IRC | 01:39 | |
| beagles | anteaya: I posted a patch to the tempest for review for the basic_network_test scenario that waited at least until the floating IP showed up in the nova client query before trying to ping it ;) | 01:39 |
| anteaya | beagles: do you have a url for your patch? | 01:40 |
| beagles | anteaya: that reduced the failure rate of that test somewhat | 01:40 |
| anteaya | really? | 01:40 |
| anteaya | lets see if we can get that reviewed and in | 01:40 |
| beagles | anteaya: in my env at least... | 01:40 |
| anteaya | a small reduction is a step in the right direction | 01:40 |
| anteaya | lets get some eyes on it and see what others think | 01:40 |
| anteaya | url? | 01:40 |
| beagles | anteaya: although to be fair it might have been that in conjunction with an experimental thing I was working on that tried to keep some dhcp state syncs from steamrolling each other | 01:41 |
| anteaya | let's look at it anyway | 01:42 |
| beagles | https://review.openstack.org/#/c/59517/ | 01:42 |
| openstackgerrit | Isaku Yamahata proposed a change to openstack/neutron: ml2: gre, vxlan type driver can leak segment_id https://review.openstack.org/61694 | 01:42 |
| *** jdev789 has joined #openstack-neutron | 01:43 | |
| * anteaya clicks | 01:44 | |
| anteaya | beagles: can you address dkranz's comment? | 01:45 |
| beagles | anteaya: yup... | 01:45 |
| *** clev has quit IRC | 01:45 | |
| beagles | anteaya: interesting how the test suite complains about the absence of the method on occasion.. I wonder why | 01:45 |
| anteaya | beagles: how do you mean? what test suite complains about the absence of what method? | 01:46 |
| anteaya | do you have a paste of the complaints, stacktrace etc? | 01:47 |
| beagles | not any more.. my devstack VM blew up today | 01:47 |
| beagles | but | 01:47 |
| beagles | if it were happening as often as I figured... it'll be there again | 01:47 |
| beagles | I've been experiencing weirdness with nested virt... this is the first time it trashed the vm's virtual disk though | 01:49 |
| anteaya | :( | 01:49 |
| anteaya | interesting | 01:49 |
| anteaya | yes, please save any stacktrace in a paste and post to the channel, I will read backscroll or logs | 01:49 |
| beagles | fortunately, I post all of my code for review or push elsewhere as precautionary measures | 01:50 |
| anteaya | woohoo | 01:51 |
| anteaya | one of the benefits of the work in progress setting in gerrit | 01:52 |
| anteaya | nothing stays locally for me | 01:52 |
| *** dims has joined #openstack-neutron | 01:52 | |
| beagles | it'll be a few minutes before I update... I just got called to pick my daughter up at a high school dance... back asap | 01:53 |
| anteaya | k | 01:53 |
| anteaya | I agree with your priorities | 01:53 |
| *** fandikurnia01 has joined #openstack-neutron | 01:59 | |
| fandikurnia01 | hi | 01:59 |
| fandikurnia01 | all | 01:59 |
| fandikurnia01 | can someone add subnet in quantum and try security groups in additional subnet then apply | 02:00 |
| fandikurnia01 | security group but, still can ping, etc | 02:00 |
| *** jdev789 has quit IRC | 02:01 | |
| anteaya | fandikurnia01: hello | 02:04 |
| anteaya | the project was renamed from quantum to neutron some time ago | 02:04 |
| anteaya | in the spring I do believe | 02:04 |
| anteaya | are you a developer? | 02:05 |
| anteaya | what version are you running? | 02:05 |
| *** yongli has quit IRC | 02:05 | |
| dkehn | anteaya: was making dinner when you rang, I'll look at it : https://bugs.launchpad.net/tempest/+bug/1253896 | 02:05 |
| anteaya | dkehn: awesome thanks | 02:06 |
| anteaya | beagles may have a patch that may lessen the occurances: https://review.openstack.org/#/c/59517/2 | 02:06 |
| anteaya | he is going to address the dkranz comment | 02:06 |
| anteaya | once he returns from picking up his daughter | 02:07 |
| *** jp_at_hp has quit IRC | 02:08 | |
| fandikurnia01 | hi anteaya, we use [root@node-53 ~]# quantum --version | 02:10 |
| fandikurnia01 | quantum 2.0 | 02:10 |
| fandikurnia01 | we still build this in grizlly openstack | 02:11 |
| anteaya | fandikurnia01: for development? | 02:11 |
| fandikurnia01 | yups, but will do this in production | 02:11 |
| fandikurnia01 | too | 02:11 |
| fandikurnia01 | we need add new subnet | 02:11 |
| fandikurnia01 | for leverage our network subnet | 02:12 |
| anteaya | you need to add a new subnet, for your production installation of grizzly quantum | 02:12 |
| fandikurnia01 | yups | 02:12 |
| anteaya | and you need to know how to develop this yourself, is that accurate? | 02:12 |
| fandikurnia01 | nope, actually we already add new subnet | 02:13 |
| * anteaya furrows her brow | 02:13 | |
| anteaya | okay | 02:13 |
| *** hxgqh1987 has joined #openstack-neutron | 02:13 | |
| anteaya | so what do you need from this channel? | 02:13 |
| fandikurnia01 | but when apply security groups thats looks like not working in that subnet | 02:14 |
| anteaya | the only upstream grizzly patches are security fixes | 02:14 |
| fandikurnia01 | probably any configuration in neutron/quantum | 02:14 |
| anteaya | when you apply security groups, it appears that security groups are not working in that subnet? | 02:14 |
| fandikurnia01 | to add new subnet and integration with security group | 02:14 |
| fandikurnia01 | yups | 02:14 |
| fandikurnia01 | security groups isnot working in new subnet | 02:15 |
| anteaya | for you | 02:15 |
| fandikurnia01 | but in old subnet it's working | 02:15 |
| anteaya | for the code that you wrote | 02:15 |
| anteaya | okay | 02:15 |
| anteaya | so this isn't a security issue for us | 02:15 |
| anteaya | correct? | 02:15 |
| anteaya | so based on my best understanding of what it is you want, help to get security groups working in the subnet you wrote for grizzly quantum | 02:17 |
| anteaya | there are only a few people who could help | 02:17 |
| anteaya | markmcclain, arosen and garyk | 02:18 |
| anteaya | possibly salv-orlando | 02:18 |
| anteaya | that is all I can think of | 02:18 |
| anteaya | none of them are here right now | 02:18 |
| anteaya | I suggest trying again in about 12 hours if you can | 02:18 |
| anteaya | that is the best I can offer | 02:19 |
| *** hxgqh1987 has quit IRC | 02:20 | |
| fandikurnia01 | anteaya, thanks you. ok I will try find out solution and ask to user that you already list. | 02:20 |
| anteaya | okay | 02:20 |
| anteaya | now it is possible that someone else can help you, but those are the people that I can think of | 02:20 |
| anteaya | and there are no guarentees they can help you | 02:21 |
| *** hxgqh1987 has joined #openstack-neutron | 02:21 | |
| *** hxgqh1987 has quit IRC | 02:22 | |
| anteaya | dims: thanks for the review on 59517 | 02:42 |
| *** hxgqh1987 has joined #openstack-neutron | 02:48 | |
| *** hxgqh1987 has quit IRC | 02:55 | |
| beagles | groan.. I just love it when devstack has itself some issues | 02:56 |
| anteaya | beagles: old faithful | 02:56 |
| anteaya | what are you hitting? | 02:57 |
| beagles | or more specifically: Table 'neutron_ml2.agents' doesn't exist") 'ALTER TABLE agents ADD CONSTRAINT uniq_agents0agent_type0host UNIQUE (agent_type, host)' () | 02:57 |
| *** hxgqh1987 has joined #openstack-neutron | 02:57 | |
| *** SushilKM has joined #openstack-neutron | 02:57 | |
| beagles | clean devstack | 02:57 |
| beagles | (environment that is) | 02:57 |
| *** dcahill has quit IRC | 02:57 | |
| *** yongli has joined #openstack-neutron | 02:58 | |
| *** alagalah has joined #openstack-neutron | 02:58 | |
| anteaya | hmmm | 02:59 |
| anteaya | the command that gives you that output usually doesn't give you that output? | 02:59 |
| beagles | nope.. that's a new one on me... 1s | 03:00 |
| dkehn | beagles: to get around the above issue: I use https://review.openstack.org/#/c/61663/ | 03:02 |
| *** otherwiseguy has joined #openstack-neutron | 03:03 | |
| beagles | dkehn: tks! | 03:04 |
| dkehn | beagles: assuming your not using anything strange for plugins | 03:04 |
| beagles | dkehn: nope | 03:05 |
| dkehn | beagles: I ran into it earlier, seems to work for me | 03:05 |
| *** yamahata_ has quit IRC | 03:05 | |
| *** banix has joined #openstack-neutron | 03:08 | |
| beagles | 1s..brb, bouncing my IRC bouncer | 03:08 |
| *** beagles has quit IRC | 03:08 | |
| *** b3nt_pin has joined #openstack-neutron | 03:09 | |
| *** b3nt_pin is now known as beagles | 03:09 | |
| *** mestery_ has joined #openstack-neutron | 03:11 | |
| beagles | dkehn: yay, works | 03:13 |
| dkehn | beagles: cool | 03:14 |
| *** mestery has quit IRC | 03:14 | |
| *** dcahill has joined #openstack-neutron | 03:16 | |
| *** x86brandon has quit IRC | 03:26 | |
| SushilKM | there is some problem with zull gating | 03:28 |
| SushilKM | https://review.openstack.org/#/c/60825/ is getting merged since last 11 hrs :( | 03:28 |
| *** AlexF has joined #openstack-neutron | 03:32 | |
| *** suresh12 has quit IRC | 03:32 | |
| anteaya | SushilKM: there are many problems with zuul gating | 03:33 |
| anteaya | if you want to lend a hand fixing https://bugs.launchpad.net/tempest/+bug/1253896 openstack's worst gate blocking bug, please do so | 03:33 |
| anteaya | dkehn: is taking a look right now | 03:33 |
| anteaya | beagles: is working on a patch which might help a little bit | 03:34 |
| anteaya | salv-orlando did all he could before he had to get some sleep | 03:34 |
| anteaya | SushilKM: can you help? | 03:34 |
| dkehn | anteaya: not sure I'm going to be of much help I'm trying to get a local dev env setup failing on the devstack exercises, which I want to see run before going on | 03:34 |
| dkehn | anteaya: there are a lot of issue presently | 03:35 |
| anteaya | dkehn: understood | 03:35 |
| anteaya | dkehn: it appears you are correct | 03:35 |
| anteaya | are all of the issues you are hitting documented? as in a bug report somewhere? | 03:35 |
| dkehn | anteaya: doing a dual dev env one local nad one in hpcloud to see if I can get to a good place | 03:35 |
| anteaya | cool | 03:36 |
| * anteaya throws some salt to the virtualization gods | 03:36 | |
| *** changbl has joined #openstack-neutron | 03:37 | |
| *** mestery has joined #openstack-neutron | 03:39 | |
| *** mestery_ has quit IRC | 03:42 | |
| *** AlexF has quit IRC | 03:45 | |
| SushilKM | i wud try to look into that, let me see if i can help ... | 03:46 |
| *** banix has quit IRC | 03:49 | |
| anteaya | SushilKM: yes please | 03:52 |
| anteaya | anything you learn please add it to the bug report | 03:52 |
| anteaya | beagles dkehn I updated the ml post with our current status: http://lists.openstack.org/pipermail/openstack-dev/2013-December/022158.html | 03:52 |
| anteaya | I hope you feel I accurately reflected the status | 03:52 |
| SushilKM | :) | 03:53 |
| anteaya | :D | 03:53 |
| anteaya | I have to sign off for sleep | 03:53 |
| dkehn | anteaya: sounds accurate | 03:53 |
| anteaya | thank you | 03:53 |
| beagles | sleep tight! and sounds good! | 03:53 |
| dkehn | anteaya: me too | 03:54 |
| anteaya | thank you | 03:54 |
| SushilKM | sure anteaya | 03:54 |
| SushilKM | gud nite | 03:54 |
| anteaya | okay if you have anything to update on the bug report | 03:54 |
| anteaya | that will help SushilKM and others please add it | 03:54 |
| anteaya | thanks SushilKM, ask for help if you need it | 03:54 |
| * beagles nods | 03:54 | |
| anteaya | we need to offer up some kind of solution for this | 03:54 |
| anteaya | okay tty tomorrow | 03:54 |
| beagles | and I will continue to think on (and possibly hack at) control point strategies | 03:55 |
| beagles | cheers | 03:55 |
| anteaya | good night | 03:55 |
| anteaya | beagles: thanks | 03:55 |
| dkehn | anteaya: gnight all | 03:55 |
| *** otherwiseguy has quit IRC | 03:58 | |
| *** SushilKM has quit IRC | 04:15 | |
| *** SushilKM has joined #openstack-neutron | 04:17 | |
| *** SushilKM has quit IRC | 04:20 | |
| *** SushilKM has joined #openstack-neutron | 04:21 | |
| *** SushilKM has quit IRC | 04:25 | |
| *** benner has quit IRC | 04:42 | |
| *** benner has joined #openstack-neutron | 04:45 | |
| *** dguitarbite has joined #openstack-neutron | 05:00 | |
| *** ljjjusti1 has joined #openstack-neutron | 05:20 | |
| *** ljjjustin has quit IRC | 05:21 | |
| *** gdubreui has quit IRC | 05:24 | |
| *** networkstatic has joined #openstack-neutron | 05:27 | |
| *** vkozhukalov has joined #openstack-neutron | 05:30 | |
| *** Jianyong has joined #openstack-neutron | 05:32 | |
| *** Abhishek has joined #openstack-neutron | 05:39 | |
| *** alagalah has left #openstack-neutron | 05:42 | |
| *** Abhishek has quit IRC | 05:44 | |
| *** suresh12 has joined #openstack-neutron | 05:46 | |
| *** dguitarbite has quit IRC | 05:47 | |
| *** suresh12 has quit IRC | 05:48 | |
| *** yamahata_ has joined #openstack-neutron | 05:51 | |
| *** networkstatic has quit IRC | 05:59 | |
| *** Abhishek_ has joined #openstack-neutron | 06:08 | |
| openstackgerrit | Isaku Yamahata proposed a change to openstack/neutron: ml2/type driver: race on reserve_provider_segment https://review.openstack.org/61922 | 06:21 |
| *** vkozhukalov has quit IRC | 06:21 | |
| openstackgerrit | Jenkins proposed a change to openstack/neutron: Imported Translations from Transifex https://review.openstack.org/61325 | 06:35 |
| *** suresh12 has joined #openstack-neutron | 06:38 | |
| *** SushilKM has joined #openstack-neutron | 06:39 | |
| *** alex_klimov has joined #openstack-neutron | 06:45 | |
| *** zhhuabj has quit IRC | 06:53 | |
| *** suresh12 has quit IRC | 07:14 | |
| *** suresh12 has joined #openstack-neutron | 07:14 | |
| *** suresh12 has quit IRC | 07:14 | |
| *** yfried has quit IRC | 07:24 | |
| *** jprovazn has joined #openstack-neutron | 07:24 | |
| *** gongysh has joined #openstack-neutron | 07:32 | |
| *** amritanshu_RnD has joined #openstack-neutron | 07:37 | |
| *** Abhishek_ has quit IRC | 07:46 | |
| *** vkozhukalov has joined #openstack-neutron | 07:52 | |
| *** hxgqh1987 has quit IRC | 07:58 | |
| *** vkozhukalov has quit IRC | 08:02 | |
| *** hxgqh1987 has joined #openstack-neutron | 08:03 | |
| *** vkozhukalov has joined #openstack-neutron | 08:14 | |
| *** fouxm has joined #openstack-neutron | 08:17 | |
| *** yfried has joined #openstack-neutron | 08:24 | |
| *** jlibosva has joined #openstack-neutron | 08:35 | |
| *** salv-orlando has joined #openstack-neutron | 08:39 | |
| *** yfried has quit IRC | 08:41 | |
| *** jpich has joined #openstack-neutron | 08:41 | |
| *** ygbo has joined #openstack-neutron | 08:44 | |
| *** afazekas has joined #openstack-neutron | 08:48 | |
| kruskakli | Hi, just want to introduce myself. My name is Torbjorn Tornkvist, working for Tail-f. I've just got the responsibility for the ML2 Tail-f NCS driver. I'm trying to get my head around the 'process'...anyway cheers! | 08:48 |
| *** yongli has quit IRC | 08:48 | |
| openstackgerrit | Dazhao Yu proposed a change to openstack/neutron: Calculate stateless IPv6 address https://review.openstack.org/56184 | 08:59 |
| *** safchain has joined #openstack-neutron | 09:04 | |
| *** yamahata_ has quit IRC | 09:04 | |
| openstackgerrit | Zang MingJie proposed a change to openstack/neutron: Modular L2 TypeDriver refact (service) https://review.openstack.org/37893 | 09:07 |
| openstackgerrit | Zang MingJie proposed a change to openstack/neutron: Modular L2 TypeDriver refact (ovs-agent) https://review.openstack.org/61761 | 09:07 |
| *** hxgqh1987 has quit IRC | 09:10 | |
| *** bashok has joined #openstack-neutron | 09:10 | |
| *** kruskakli has left #openstack-neutron | 09:12 | |
| *** kruskakli has joined #openstack-neutron | 09:13 | |
| *** Abhishek_ has joined #openstack-neutron | 09:14 | |
| *** hxgqh1987 has joined #openstack-neutron | 09:16 | |
| *** fandikurnia01 has quit IRC | 09:17 | |
| *** jistr has joined #openstack-neutron | 09:22 | |
| *** hxgqh1987 has quit IRC | 09:36 | |
| *** hxgqh1987 has joined #openstack-neutron | 09:46 | |
| *** rossella_s has joined #openstack-neutron | 09:49 | |
| *** jprovazn has quit IRC | 09:54 | |
| openstackgerrit | Mathieu Rohon proposed a change to openstack/neutron: Send fdb remove message when a port is migrated https://review.openstack.org/61767 | 09:59 |
| *** gongysh has quit IRC | 10:01 | |
| *** gongysh has joined #openstack-neutron | 10:02 | |
| *** wenjianhn has joined #openstack-neutron | 10:06 | |
| *** hxgqh1987 has quit IRC | 10:13 | |
| *** dosaboy has joined #openstack-neutron | 10:29 | |
| dosaboy | gongysh: ping | 10:30 |
| *** gdubreui has joined #openstack-neutron | 10:31 | |
| *** ljjjusti1 has quit IRC | 10:35 | |
| gongysh | dosaboy: pong | 10:37 |
| dosaboy | gongysh: hey | 10:38 |
| dosaboy | did you catch my reply in https://review.openstack.org/#/c/61183/ | 10:38 |
| dosaboy | if you're ok with that can you remove -1 | 10:38 |
| *** chandankumar has quit IRC | 10:43 | |
| gongysh | I think we can just use =0 means neutron client will not specify timeout. | 10:45 |
| *** chandankumar has joined #openstack-neutron | 10:46 | |
| gongysh | neutron client doesnot specify timeout does not mean the underlying httplib does not use timeout | 10:46 |
| gongysh | I have to go, see u later. | 10:46 |
| *** gongysh has quit IRC | 10:46 | |
| *** gdubreui has quit IRC | 10:48 | |
| *** marun has joined #openstack-neutron | 11:05 | |
| openstackgerrit | Salvatore Orlando proposed a change to openstack/neutron: Process port_update notifications in the main agent loop https://review.openstack.org/61964 | 11:11 |
| *** yfried has joined #openstack-neutron | 11:18 | |
| *** bashok has quit IRC | 11:20 | |
| *** pcm_ has joined #openstack-neutron | 11:24 | |
| openstackgerrit | Salvatore Orlando proposed a change to openstack/neutron: NVP plugin: Avoid timeouts if creating routers in parallel https://review.openstack.org/60861 | 11:26 |
| *** pcm_ has quit IRC | 11:26 | |
| *** pcm_ has joined #openstack-neutron | 11:27 | |
| *** marun has quit IRC | 11:29 | |
| openstackgerrit | Salvatore Orlando proposed a change to openstack/neutron: NVP plugin: Do backend router delete out from db transaction https://review.openstack.org/61604 | 11:35 |
| *** safchain has quit IRC | 11:37 | |
| *** Jianyong has quit IRC | 11:38 | |
| *** afazekas has quit IRC | 11:47 | |
| *** safchain has joined #openstack-neutron | 11:53 | |
| openstackgerrit | Salvatore Orlando proposed a change to openstack/neutron: NVP plugin: Do backend router delete out from db transaction https://review.openstack.org/61604 | 12:05 |
| salv-orlando | anybody willing to do more investigations on new failures for bug 1253896? I will be unable to work on that in the next 4 hours | 12:06 |
| *** wenjianhn has quit IRC | 12:10 | |
| *** yfried has quit IRC | 12:15 | |
| *** Abhishek_ has quit IRC | 12:37 | |
| dosaboy | gongysh: see my comment, since we are using httplib2 (not httplib) it does not set a timeout unless you provide one | 12:41 |
| *** bvandenh has joined #openstack-neutron | 12:41 | |
| dosaboy | gongysh: http://code.google.com/p/httplib2/source/browse/python2/httplib2/__init__.py#100 | 12:41 |
| openstackgerrit | Salvatore Orlando proposed a change to openstack/neutron: Process port_update notifications in the main agent loop https://review.openstack.org/61964 | 12:42 |
| *** HenryG has quit IRC | 12:51 | |
| *** HenryG has joined #openstack-neutron | 12:58 | |
| *** marun has joined #openstack-neutron | 13:03 | |
| *** skraynev has joined #openstack-neutron | 13:03 | |
| skraynev | Hello all. Could anybody tell me, when will new neutron-client release be available? | 13:05 |
| *** fouxm has quit IRC | 13:21 | |
| *** fouxm has joined #openstack-neutron | 13:22 | |
| *** Jianyong has joined #openstack-neutron | 13:31 | |
| *** fouxm has quit IRC | 13:32 | |
| *** fouxm has joined #openstack-neutron | 13:32 | |
| openstackgerrit | Maru Newby proposed a change to openstack/neutron: Send DHCP notifications regardless of agent status https://review.openstack.org/61168 | 13:34 |
| *** Jianyong has quit IRC | 13:34 | |
| *** Jianyong has joined #openstack-neutron | 13:34 | |
| openstackgerrit | Maru Newby proposed a change to openstack/neutron: Send DHCP notifications regardless of agent status https://review.openstack.org/61168 | 13:36 |
| openstackgerrit | Sylvain Afchain proposed a change to openstack/neutron: Add param and iptables rules to protect dhcp ports https://review.openstack.org/61994 | 13:41 |
| *** dhellmann_ is now known as dhellmann | 13:42 | |
| anteaya | salv-orlando: thanks for the update, I will try to find someone to work on 1253896 | 13:45 |
| anteaya | SushilKM: reverify no bug has been retired: http://lists.openstack.org/pipermail/openstack-dev/2013-December/021649.html | 13:49 |
| anteaya | you have to specify a bug number for Jenkins/Zuul to hear your wish to retest | 13:50 |
| openstackgerrit | Maru Newby proposed a change to openstack/neutron: Send DHCP notifications regardless of agent status https://review.openstack.org/61168 | 13:53 |
| anteaya | marun: hello | 13:56 |
| marun | anteaya: hi | 13:56 |
| anteaya | have you had a look at the state of the gate email on the ml? | 13:57 |
| anteaya | or elastic-recheck lately? | 13:57 |
| anteaya | status.openstack.org/elastic-recheck | 13:58 |
| enikanorov | Hi folks | 14:00 |
| marun | anteaya: hadn't yet, no | 14:00 |
| marun | anteaya: cripes | 14:00 |
| enikanorov | there are two migration-related patches hanging on review wating for another +2: https://review.openstack.org/#/c/61677/1 https://review.openstack.org/#/c/61663/ | 14:00 |
| anteaya | marun: ah okay, yes | 14:00 |
| anteaya | cripes | 14:00 |
| anteaya | enikanorov: we aren't approving anything right now | 14:00 |
| anteaya | the gate is in a bad way and we have two pip install -U patches that need to go in first | 14:01 |
| anteaya | marun: so here is the bug https://bugs.launchpad.net/tempest/+bug/1253896 | 14:01 |
| anteaya | any and all help appreciated | 14:01 |
| anteaya | I tried to stay up last night for you to come online but I had to go to bed | 14:02 |
| enikanorov | obviously other patches will not go in untill jenkings will verify them | 14:02 |
| *** aymenfrikha has joined #openstack-neutron | 14:02 | |
| anteaya | enikanorov: not clogging the gate with non-priority patches is part of playing nice with others | 14:02 |
| anteaya | so is fixing bugs that are preventing everyone else from doing their work | 14:03 |
| anteaya | any help you want to lend to https://bugs.launchpad.net/tempest/+bug/1253896 is appreciated enikanorov | 14:03 |
| enikanorov | these are priority patches | 14:03 |
| enikanorov | they are preventing folks from doing their work while not landed | 14:04 |
| marun | enikanorov: I can approve | 14:04 |
| anteaya | marun please don't | 14:05 |
| enikanorov | marun: cool, thanks. It just feels uncomfortable to not being able to install devstack with neutron | 14:05 |
| anteaya | see my email to cores from yesterday | 14:05 |
| marun | anteaya: *sigh* | 14:05 |
| anteaya | this patch has to land | 14:05 |
| enikanorov | anteaya: could you please take a look at the bugs that those patches address | 14:05 |
| anteaya | so if you want to help enikanorov you can find the bug that kicked this one out of the gate https://review.openstack.org/#/c/60825/ | 14:05 |
| anteaya | and put reverify bug <bug number> on it to get it merged | 14:06 |
| anteaya | thanks enikanorov | 14:06 |
| marun | anteaya: it's a jenkins failure? | 14:06 |
| anteaya | what is a jenkins failure? | 14:06 |
| marun | anteaya: or is that the wrong review? | 14:06 |
| marun | anteaya: the review you pointed at. the only voting failure was for py27 and it was a jenkins problem not something real; | 14:07 |
| anteaya | it is a bug | 14:07 |
| anteaya | and won't run again until it has reverify bug <bug number> | 14:07 |
| anteaya | if enikanorov wants to go into infra and ask what bug number to associate with it | 14:07 |
| salv-orlando | marun is perhaps saying jenkins crashed in unit tests | 14:07 |
| anteaya | that will get it running again | 14:07 |
| *** jpich has quit IRC | 14:07 | |
| anteaya | yes Jenkins01 was down last night | 14:08 |
| anteaya | but | 14:08 |
| marun | anteaya: the submitter has already attempted to reverify no bug | 14:08 |
| anteaya | reverify no bug has been retired | 14:08 |
| *** Damianz has joined #openstack-neutron | 14:08 | |
| anteaya | yes | 14:08 |
| anteaya | it won't work | 14:08 |
| marun | well, that's stupid | 14:08 |
| anteaya | that syntax has been retired | 14:08 |
| marun | infra should fix that | 14:08 |
| marun | because in this case it is needed | 14:08 |
| anteaya | http://lists.openstack.org/pipermail/openstack-dev/2013-December/021649.html | 14:08 |
| anteaya | marun: no | 14:08 |
| * marun shakes fist at infra | 14:08 | |
| salv-orlando | due to really bad luck that patch did not catch bug 1253896 but failed because of a jenkins error while layunching the py27 job | 14:08 |
| anteaya | yes | 14:09 |
| marun | anteaya: yes | 14:09 |
| marun | :) | 14:09 |
| anteaya | so there is a way to get it running again | 14:09 |
| enikanorov | and why 60825 should block other patches to land? | 14:09 |
| salv-orlando | yes | 14:09 |
| salv-orlando | infra in their email said just re approve | 14:09 |
| anteaya | enikanorov: because they have to merge first | 14:09 |
| anteaya | enikanorov: read the ml thread the state of the gate | 14:09 |
| enikanorov | coudl you explain? | 14:09 |
| salv-orlando | this way only responsible core devs would trigger the equivalent of reverify no bug | 14:09 |
| anteaya | salv-orlando: okay, what syntax will work? | 14:09 |
| salv-orlando | anteaya: I think all you need is just a new +A, which I just did | 14:10 |
| anteaya | or as core can you re-aprove salv-orlando | 14:10 |
| anteaya | cool | 14:10 |
| anteaya | thank you, then please reapprove | 14:10 |
| enikanorov | > Updates tox.ini to use new features. tox 1.6 allows us to skip the sdist step, which is slow. | 14:10 |
| salv-orlando | and indeed the patch is again in zuul's gate queeu | 14:10 |
| enikanorov | Coudl you explain the priority of this? | 14:10 |
| anteaya | salv-orlando: great | 14:11 |
| anteaya | salv-orlando: yes it is in the gate, thank you | 14:11 |
| anteaya | marun let me know how you are doing on https://bugs.launchpad.net/tempest/+bug/1253896 | 14:12 |
| anteaya | you can see it is our highest priority today, yes? | 14:12 |
| marun | anteaya: ? | 14:13 |
| marun | anteaya: I don't understand the question | 14:13 |
| marun | anteaya: are you expecting me to have dropped everything and started working on it? | 14:14 |
| anteaya | marun: I'm just wondering if you can see how important it is for the bug to be addressed | 14:14 |
| anteaya | by you or by someone else | 14:15 |
| beagles | anteaya: just a heads-up on the tempest patch update, I was having serious issues with my devstack last night and it was getting quite late... so I'm back at it this a.m. | 14:15 |
| *** banix has joined #openstack-neutron | 14:15 | |
| anteaya | if you can't work on it, I need to know so I can get people working on it | 14:15 |
| marun | anteaya: I can't work on it. | 14:15 |
| *** vkozhukalov has quit IRC | 14:15 | |
| marun | anteaya: I'm travelling. | 14:15 |
| anteaya | beagles: great thanks | 14:15 |
| enikanorov | salv-orlando: regarding 1253896 (verify guests are running via SSH fails), is there something specific in devstack setup that should be made? Could it be reproduced on regular single-node devstack? | 14:15 |
| anteaya | marun: thanks for letting me know, any suggestions on who might have the ability to make progress on it? | 14:15 |
| enikanorov | i might look at it if I have time. | 14:15 |
| anteaya | marun: I will try them | 14:16 |
| anteaya | enikanorov: awesome thank you, please update the bug report with any findings you might have | 14:16 |
| anteaya | enikanorov: all of our tests run on single node devstack | 14:16 |
| anteaya | so creating a single node devstack to reproduce would match our infra settings | 14:17 |
| marun | anteaya: if only | 14:17 |
| anteaya | marun: I hear that | 14:17 |
| anteaya | marun: travel safely | 14:17 |
| openstackgerrit | Sylvain Afchain proposed a change to openstack/neutron: Dhcp agent only allows multiple dnsmasq_dns_server https://review.openstack.org/62002 | 14:19 |
| *** SushilKM has quit IRC | 14:20 | |
| marun | salv-orlando: https://bugs.launchpad.net/tempest/+bug/1253896 just looks like another symptom of overloading the host under test | 14:20 |
| marun | anteaya: we need those fixes enikanorov was trying to get merged more than that other fix | 14:22 |
| marun | anteaya: or at least as much | 14:22 |
| * anteaya listens | 14:22 | |
| marun | anteaya: without the migration patches, devstack is broken | 14:23 |
| marun | anteaya: so this is blocking all developers who are trying to stack fresh | 14:23 |
| *** rkukura has joined #openstack-neutron | 14:23 | |
| anteaya | okay, can you post to the thread I sent out to all core, so they don't think they can just approve everything | 14:23 |
| anteaya | with the two patches you are going to approve and why, plus the fact that we discussed it? | 14:24 |
| marun | ok | 14:24 |
| anteaya | thank you | 14:24 |
| *** russellb is now known as rustlebee | 14:25 | |
| enikanorov | anteaya: i think if you don't want core to approve something, you could -2 the patch | 14:25 |
| marun | anteaya: Subject: 'State of the gate - Dec 12'? | 14:26 |
| marun | enikanorov: I think the hard part is that there are a lot of patches to -2 | 14:26 |
| marun | enikanorov: I don't think it's so much a matter of wanting to block specific patches as make sure nothing is approved until a target change clears | 14:26 |
| enikanorov | well... we all have to do some work some times :) | 14:26 |
| marun | frankly, I think this should be a feature that infra should tackle | 14:27 |
| anteaya | neutron is the only project where this is a problem | 14:28 |
| anteaya | enikanorov: any work addressing the gate blocking bug is greatly appreciated | 14:28 |
| anteaya | all of openstack is affected by it and it is a neutron bug | 14:28 |
| anteaya | otherwise other developers would be addressing it | 14:28 |
| anteaya | they don't like being stuck in their work either | 14:29 |
| *** yamahata_ has joined #openstack-neutron | 14:29 | |
| marun | I started a ml thread about this in the summer that sadly when nowhere | 14:29 |
| marun | the fact that everybody is blocked by neutron gate failure is stupid | 14:29 |
| anteaya | they think so too | 14:29 |
| *** Jianyong has quit IRC | 14:29 | |
| anteaya | do you have a link to that thread? | 14:29 |
| marun | so why doesn't infra do something about it? | 14:30 |
| anteaya | they want to | 14:30 |
| anteaya | they want to remove neutron from integrated status | 14:30 |
| anteaya | which is why I am here | 14:30 |
| anteaya | to see if there is any option besides that one | 14:30 |
| marun | anteaya: http://lists.openstack.org/pipermail/openstack-dev/2013-August/013779.html | 14:30 |
| marun | anteaya: *sigh* | 14:31 |
| marun | anteaya: I'll censor myself, for real. | 14:31 |
| anteaya | you don't have to censor yourself | 14:32 |
| marun | yes, yes I do. | 14:32 |
| anteaya | what bug # it timed out waiting for thing to become active | 14:32 |
| anteaya | marun: your call | 14:32 |
| marun | bug #? | 14:33 |
| anteaya | http://logs.openstack.org/08/61508/1/gate/gate-tempest-dsvm-neutron-pg/4e58d6f/console.html | 14:33 |
| anteaya | I need a bug number to get this patch back in the gate | 14:34 |
| anteaya | it is the pip install -U patch for neutronclient | 14:34 |
| *** jistr has quit IRC | 14:34 | |
| *** jecarey has joined #openstack-neutron | 14:35 | |
| enikanorov | reverify bug 123 | 14:35 |
| *** jistr has joined #openstack-neutron | 14:36 | |
| anteaya | enikanorov: how does that help? | 14:37 |
| anteaya | how is that being a responsbile community member? | 14:37 |
| anteaya | that just creates more problems like we are experiencing right now | 14:37 |
| enikanorov | that triggers reverification. if elastic recheck doesn't give you a hint, and 'no bug' is not working | 14:37 |
| enikanorov | what other options do you see? | 14:38 |
| anteaya | how about actually finding the real bug number | 14:38 |
| anteaya | I have seen timeout waiting for thing quite a bit | 14:38 |
| anteaya | there has to be a bug filed against it | 14:38 |
| *** Abhishe__ has joined #openstack-neutron | 14:41 | |
| *** HenryG_ has joined #openstack-neutron | 14:45 | |
| *** networkstatic has joined #openstack-neutron | 14:45 | |
| *** fouxm has quit IRC | 14:45 | |
| *** amritanshu_RnD has quit IRC | 14:46 | |
| *** fouxm has joined #openstack-neutron | 14:46 | |
| *** HenryG has quit IRC | 14:49 | |
| anteaya | look there it is https://bugs.launchpad.net/tempest/+bug/1254890 | 14:49 |
| marun | anteaya: i wonder why he abandoned the proposed fix | 14:52 |
| *** clev has joined #openstack-neutron | 14:52 | |
| marun | rkukura: ping | 14:55 |
| rkukura | marun: pong | 14:56 |
| *** mrsnivvel has quit IRC | 14:56 | |
| *** francois_eleouet has quit IRC | 14:57 | |
| openstackgerrit | Sylvain Afchain proposed a change to openstack/neutron: Dhcp agent only allows multiple dnsmasq_dns_server https://review.openstack.org/62002 | 14:57 |
| marun | rkukura: are you following the odl plugin status? | 14:59 |
| marun | rkukura: all this agent bs is making me pine for an agent-free solution. | 14:59 |
| rkukura | marun: Where? | 14:59 |
| anteaya | marun: let's ask him | 15:00 |
| marun | rkukura: I'm out of the loop, was hoping that you were in it, but no worries if not. | 15:00 |
| anteaya | dims: why did you abandon https://review.openstack.org/#/c/59769/ | 15:00 |
| anteaya | dims: we hit the bug that patch was aiming to address | 15:00 |
| rkukura | marun: I'm completely swamped with downstream work right now, so haven't looked into it. Where are you seeing the agent the "agent bs"? | 15:01 |
| *** markmcclain has joined #openstack-neutron | 15:02 | |
| marun | rkukura: agent bs -> constant races | 15:02 |
| *** mlavalle has joined #openstack-neutron | 15:03 | |
| marun | rkukura: it's a synchronization problem, it's a scaling problem, neither of which would exist if we offloaded it to an sdn controller implemented by competent people. | 15:03 |
| * marun stops beating the dead horse (for now) | 15:03 | |
| rkukura | marun: Not sure if the issue is the people or the language. | 15:04 |
| openstackgerrit | Oleg Bondarev proposed a change to openstack/neutron: LBaaS: synchronize haproxy deploy/undeploy_instance methods https://review.openstack.org/62010 | 15:04 |
| marun | rkukura: language? | 15:04 |
| marun | rkukura: you'd lay the blame for a shitty architecture on python? | 15:04 |
| marun | rkukura: what was that saying…a poor workman and his tools? | 15:05 |
| rkukura | marun: One with proper threading support | 15:05 |
| marun | rkukura: yeah, that's a bs argument. sorry | 15:05 |
| marun | rkukura: this is a distributed system. threading isn't a magic solution that process-based concurrency can't solve just as well | 15:05 |
| marun | now, eventlet.... | 15:06 |
| anteaya | hi markmcclain, I could use some help getting some attention on https://bugs.launchpad.net/tempest/+bug/1253896 | 15:07 |
| anteaya | salv-orlando has be away for 4 hours, marun is traveling | 15:07 |
| anteaya | beagles is working on a patch but it won't be an entire fix | 15:07 |
| anteaya | enikanorov said he would try to look at it | 15:08 |
| markmcclain | anteaya: ok.. let me read the scrollback to catch up | 15:08 |
| anteaya | thanks | 15:08 |
| anteaya | dkehn said he would look at it but he is just getting a devstack set up as of last night and I haven't seen him this morning | 15:08 |
| dkehn | anteaya: I'm here | 15:09 |
| anteaya | dkehn: welcome | 15:09 |
| anteaya | how goes your devstack set up? | 15:09 |
| dkehn | anteaya: after setting up the devstack via devstack-vm-gate, locally and watching it failin the neutron-adv-test, I think I'm going try and figure out whats up | 15:11 |
| anteaya | very good | 15:12 |
| dkehn | anteaya: devstack setup are pretty easy, but geting the exercises to work has been a problem at least in a localized setting | 15:13 |
| dkehn | anteaya: I use a devstack-vm-gate, modified, such that it mimic the gate as closely as possible | 15:14 |
| anteaya | interesting | 15:15 |
| anteaya | at some point if you document your modifications, I would be interested in reading | 15:15 |
| *** jistr_ has joined #openstack-neutron | 15:16 | |
| dkehn | anteaya: pretty much https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate.sh, but with https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate-wrap.sh param setup to isolated | 15:16 |
| *** alagalah has joined #openstack-neutron | 15:17 | |
| dkehn | anteaya: no real tricks, it allows to keep a new & old around when things get weird | 15:17 |
| dkehn | anteaya: and most importantly it allow to retrieve code I'm working on instead of repos | 15:18 |
| *** markmcclain has quit IRC | 15:19 | |
| anteaya | cool, thank you | 15:19 |
| *** jistr has quit IRC | 15:19 | |
| *** ihrachyska has quit IRC | 15:20 | |
| *** obondarev has quit IRC | 15:21 | |
| *** obondarev has joined #openstack-neutron | 15:22 | |
| dkehn | anteaya: http://paste.openstack.org/show/54958/ | 15:22 |
| * anteaya clicks | 15:26 | |
| *** dave_tucker has joined #openstack-neutron | 15:26 | |
| *** otherwiseguy has joined #openstack-neutron | 15:27 | |
| *** bvandenh has quit IRC | 15:27 | |
| anteaya | reddwarf and quantum, hmmmm | 15:28 |
| *** markmcclain has joined #openstack-neutron | 15:30 | |
| JoeHazzers | i had a very weird thing happen a moment ago | 15:30 |
| *** carl_baldwin has joined #openstack-neutron | 15:30 | |
| anteaya | JoeHazzers: do tell | 15:30 |
| JoeHazzers | i had a port, with two IPs (one per subnet on the network), and when i tried to delete the port, the operation succeeded | 15:30 |
| anteaya | \o/ | 15:30 |
| JoeHazzers | but then when i did a port-list (it was the only port) | 15:30 |
| JoeHazzers | the port "was still there" albeit with a different id and mac but identical configuration | 15:31 |
| anteaya | a very weird thing | 15:31 |
| *** rwsu has joined #openstack-neutron | 15:31 | |
| anteaya | can you connect to the still there port? | 15:31 |
| mlavalle | anteaya: hi…. I don't want to jinx it, but maybe we nailed https://bugs.launchpad.net/neutron/+bug/1251448 after merging nati_ueno 's fix to the vpnaas tempest test | 15:31 |
| * anteaya goes to elastic-recheck | 15:32 | |
| mlavalle | anteaya: very few cases since yesterday | 15:32 |
| JoeHazzers | anteaya: it wasn't bound | 15:33 |
| JoeHazzers | also, i'm looking to hack/add some functionality to neutron | 15:33 |
| JoeHazzers | i need to restrict IP/MAC addresses to specific hosts | 15:33 |
| JoeHazzers | how much (if at all) hacking do i have to do? | 15:33 |
| anteaya | mlavalle: reduced by not gone, 8 hits in the last 24 hours, if we don't address those they might flare up again | 15:34 |
| dkehn | anteaya: I put that together when I was getting reddwarf (trove) into devstack | 15:34 |
| anteaya | mlavalle: can you update the bug report and continue to see if you can address those 8 hits? http://bit.ly/1b2q1AN | 15:35 |
| anteaya | dkehn: thought it was a do it yourself, it looks good, thanks for sharing with me | 15:35 |
| anteaya | and the rest of the room | 15:35 |
| mlavalle | anteaya: agree…. i'll keep a vigilant eye….. and yes, i'll update the bug report…. just not right now…. I have to run to a meeting….. I'll do it during the morning | 15:36 |
| anteaya | JoeHazzers: ah, good questions and I wish I knew enough to answer you, alas I do not | 15:36 |
| anteaya | now if you do want to participate in neutron, and we welcome you, we have a long list of tasks that are very important, that need to be addressed | 15:36 |
| *** sneezewort has joined #openstack-neutron | 15:36 | |
| mlavalle | I was just itching to see where we were today so I took a quick look | 15:36 |
| anteaya | JoeHazzers: would you consider looking at any of them? | 15:37 |
| anteaya | mlavalle: understood and thank you for keeping up to date on that one | 15:37 |
| JoeHazzers | well my (current) job at work is to deploy neutron inside our cloud | 15:37 |
| anteaya | we are moving in the right direction | 15:37 |
| JoeHazzers | so i'd be happy to help, on the condition that i benefit in the end :) | 15:37 |
| *** SushilKM has joined #openstack-neutron | 15:37 | |
| anteaya | JoeHazzers: well all of openstack will benefit from your work | 15:37 |
| *** mlavalle has quit IRC | 15:38 | |
| anteaya | since it involves writing tests, which are critical for neutron | 15:38 |
| JoeHazzers | and i'll probably understand a considerable portion of the neutron architecture | 15:38 |
| anteaya | yes you will | 15:38 |
| JoeHazzers | :D | 15:38 |
| anteaya | JoeHazzers: can you look here: https://wiki.openstack.org/wiki/Neutron/TempestAPITests | 15:39 |
| anteaya | and share any comments you might have? | 15:39 |
| skraynev | markmcclain: hello. Could you tell me, when will new neutron-client release be available? | 15:39 |
| anteaya | SushilKM: hello | 15:39 |
| markmcclain | skraynev: we haven't set a date | 15:40 |
| markmcclain | is a particular feature you need? | 15:40 |
| markmcclain | or the update tox changes? | 15:40 |
| openstackgerrit | dekehn proposed a change to openstack/neutron: extra_dhcp_opt add checks for empty strings https://review.openstack.org/59858 | 15:40 |
| *** networkstatic has quit IRC | 15:43 | |
| *** Mr_W has left #openstack-neutron | 15:43 | |
| skraynev | markmcclain: Yeap, it's connected with tox requirements. Some cli command absent in current version. Really they are needed for some unittest in my feature. | 15:43 |
| *** marun has quit IRC | 15:43 | |
| *** jistr_ is now known as jistr | 15:45 | |
| *** dims has quit IRC | 15:45 | |
| markmcclain | skraynev: the tox changes have not merged yet | 15:45 |
| markmcclain | once those do I'll tag a point release | 15:45 |
| SushilKM | are we still sseeing the gating problems or r we through now | 15:46 |
| JoeHazzers | anteaya: what sort of comments were you looking for? | 15:46 |
| *** dims has joined #openstack-neutron | 15:47 | |
| *** aryan_ is now known as aryan | 15:47 | |
| markmcclain | SushilKM: there are still items in the gate which have not merged from yesterday | 15:48 |
| markmcclain | anteaya: requeued a few | 15:48 |
| SushilKM | this checkin is on zuul since last 1.5 hours | 15:48 |
| SushilKM | it runs, completes, and gets queued again | 15:49 |
| SushilKM | :( | 15:49 |
| anteaya | SushilKM: still seeing them | 15:49 |
| anteaya | JoeHazzers: do you think you can help? | 15:49 |
| SushilKM | yeah, they r still their :( | 15:49 |
| anteaya | SushilKM: did you make any progress on https://bugs.launchpad.net/tempest/+bug/1253896 | 15:49 |
| JoeHazzers | anteaya: with development? | 15:50 |
| anteaya | SushilKM: if you want to express frustration at the gate, that neutron bug is a big reason the gate is slow | 15:50 |
| anteaya | and things need to get requeued | 15:50 |
| anteaya | JoeHazzers: yes, will helping us write tests | 15:50 |
| SushilKM | not frustration, though | 15:51 |
| anteaya | you wanted to contribute to neutron, did you not? | 15:51 |
| skraynev | markmcclain: ok, I will wait it. | 15:51 |
| *** skraynev has quit IRC | 15:51 | |
| anteaya | SushilKM: fine, but all of openstack is waiting for us to fix that bug | 15:51 |
| JoeHazzers | anteaya: it's not what i had in mind, but sure :) | 15:51 |
| anteaya | so if you can lend a hand, that would be very helpful | 15:51 |
| anteaya | JoeHazzers: awesome, thank you | 15:51 |
| SushilKM | anteaya, i actually was busy in some other things though .... i got mail sometime back about its re-submission, thought that problem shot dead | 15:52 |
| anteaya | ping myself and mlavalle with any questions you have | 15:52 |
| anteaya | SushilKM: everyone one in neutron thinks the same as you | 15:52 |
| anteaya | which is why the problem isnt' fixed yet | 15:52 |
| anteaya | everybody figures it is someone elses problem | 15:52 |
| anteaya | hence, no fix | 15:52 |
| SushilKM | hmmm.... bad one actually :( | 15:54 |
| anteaya | very bad | 15:54 |
| *** matrohon has quit IRC | 15:54 | |
| anteaya | and it keeps happening | 15:54 |
| *** alex_klimov has quit IRC | 15:55 | |
| anteaya | the handful of people who address any of the problems, work like dogs | 15:55 |
| anteaya | everyone else carries on like it doesn't concern them | 15:55 |
| markmcclain | still trying to isolate what changed again to increase the likelihood | 15:56 |
| anteaya | markmcclain: great thanks | 15:57 |
| anteaya | let me know if you need any help | 15:57 |
| anteaya | SushilKM: so any help you can lend to https://bugs.launchpad.net/tempest/+bug/1253896 is greatly appreciated | 15:59 |
| *** csd has joined #openstack-neutron | 16:00 | |
| *** rossella_s has quit IRC | 16:00 | |
| *** csd has quit IRC | 16:09 | |
| *** srao has left #openstack-neutron | 16:10 | |
| *** jlibosva has quit IRC | 16:11 | |
| *** ashaikh has joined #openstack-neutron | 16:11 | |
| *** Sreedhar has joined #openstack-neutron | 16:13 | |
| *** csd has joined #openstack-neutron | 16:15 | |
| *** ashaikh has quit IRC | 16:26 | |
| *** ashaikh has joined #openstack-neutron | 16:28 | |
| *** ashaikh has quit IRC | 16:28 | |
| *** alagalah has left #openstack-neutron | 16:29 | |
| *** djbkd has joined #openstack-neutron | 16:30 | |
| *** lari has quit IRC | 16:33 | |
| *** lari has joined #openstack-neutron | 16:34 | |
| rpodolyaka | markmcclain: hey! I added a comment to Yong's patch (https://review.openstack.org/#/c/61677/) explaining why it's ok even for trunk chasers | 16:34 |
| *** djbkd has quit IRC | 16:34 | |
| markmcclain | rpodolyaka: thanks for adding more info | 16:36 |
| markmcclain | the problem still remains that we can't change the migrations in released cdoe | 16:36 |
| markmcclain | this is why salv-orlando's work to remove create_all() is important | 16:36 |
| markmcclain | because it covers up problems in migrations | 16:36 |
| rpodolyaka | yeah.. | 16:36 |
| *** yamahata_ has quit IRC | 16:37 | |
| *** pcm_ has quit IRC | 16:37 | |
| *** changbl has quit IRC | 16:37 | |
| *** openstackgerrit has quit IRC | 16:37 | |
| *** angryjesters has quit IRC | 16:37 | |
| *** rdo has quit IRC | 16:37 | |
| *** changbl_ has joined #openstack-neutron | 16:37 | |
| markmcclain | we're going to think of a better approach to fix this issue | 16:38 |
| *** yamahata_ has joined #openstack-neutron | 16:38 | |
| *** pcm_ has joined #openstack-neutron | 16:38 | |
| *** openstackgerrit has joined #openstack-neutron | 16:38 | |
| *** angryjesters has joined #openstack-neutron | 16:38 | |
| *** rdo has joined #openstack-neutron | 16:38 | |
| markmcclain | most likely with a different migrations for stable and trunk | 16:39 |
| rpodolyaka | but those tables are already in DB | 16:39 |
| rpodolyaka | of ML2 users | 16:39 |
| markmcclain | right because create_all() has added them | 16:39 |
| rpodolyaka | yep | 16:39 |
| rpodolyaka | so do we really need a new migration? | 16:39 |
| markmcclain | so retroactively modifying migrations would be no-op | 16:40 |
| markmcclain | if the deployer is using a user who has permissions to alter the database | 16:40 |
| *** SushilKM has quit IRC | 16:40 | |
| markmcclain | if the user does not have perms to alter the database then they'll have problems | 16:40 |
| markmcclain | which is why we'll need to develop a solution to the bad migrations | 16:40 |
| rpodolyaka | right, but you are talking about a 'general good way' | 16:41 |
| rpodolyaka | so if ML2 works for them now, it's ok fix those migrations in a point release | 16:41 |
| markmcclain | except for fixing the migration has no effect | 16:41 |
| rpodolyaka | yep, and that's fine | 16:42 |
| *** lari__ has joined #openstack-neutron | 16:42 | |
| rpodolyaka | because we only have to fix this for new installations | 16:42 |
| markmcclain | and still leaves the state broken if they're running with stronger security settings | 16:42 |
| *** fcoj has joined #openstack-neutron | 16:42 | |
| rpodolyaka | but create_all() already succeeded for them. Do you think they started neutron-server first with different security settings? | 16:43 |
| anteaya | yay | 16:43 |
| anteaya | beagles: had some thoughts last night | 16:43 |
| *** fcoj_ has quit IRC | 16:43 | |
| *** lari has quit IRC | 16:43 | |
| *** csd has quit IRC | 16:44 | |
| markmcclain | rpodolyaka: possibly | 16:44 |
| *** csd has joined #openstack-neutron | 16:44 | |
| anteaya | oh sorry, I thought you meant the ssh timeout issue, you were talking about the truck chaser's issue | 16:44 |
| markmcclain | anteaya: yeah the trunk chasing issue is even crazier | 16:44 |
| markmcclain | oops… s/ssh/trunk/ | 16:45 |
| *** rdo_ has joined #openstack-neutron | 16:45 | |
| anteaya | markmcclain: yes, do you think that the test that is breaking needs to be re-written with a different design? | 16:49 |
| *** yamahata_ has quit IRC | 16:49 | |
| *** pcm_ has quit IRC | 16:49 | |
| *** openstackgerrit has quit IRC | 16:49 | |
| *** angryjesters has quit IRC | 16:49 | |
| *** rdo has quit IRC | 16:49 | |
| anteaya | the test that is breaking ssh | 16:49 |
| *** rdo_ is now known as rdo | 16:50 | |
| *** SushilKM has joined #openstack-neutron | 16:51 | |
| markmcclain | anteaya: not sure.. reading the notes…I thinking there's a chance we're not cleaning up properly | 16:53 |
| anteaya | hmmm | 16:53 |
| *** djbkd has joined #openstack-neutron | 16:53 | |
| *** yamahata_ has joined #openstack-neutron | 16:54 | |
| *** pcm_ has joined #openstack-neutron | 16:54 | |
| *** aymenfrikha has left #openstack-neutron | 16:57 | |
| rpodolyaka | markmcclain: after thinking about this once again... trunk users: if they are using ML2 now - they have agents table created, fixing of this migrations will be no-op for them and that's ok; released code users - we provide fixed migrations in a point release, agents table already exists in their databases, migrations will be no-op and that's ok, new installations of both will use fixed migrations scripts. So even if security settings were m | 17:00 |
| *** markmcclain has quit IRC | 17:01 | |
| *** djbkd_ has joined #openstack-neutron | 17:04 | |
| *** djbkd_ has joined #openstack-neutron | 17:04 | |
| *** djbkd_ has quit IRC | 17:05 | |
| *** djbkd has quit IRC | 17:05 | |
| *** djbkd_ has joined #openstack-neutron | 17:05 | |
| *** jistr has quit IRC | 17:06 | |
| *** SushilKM has quit IRC | 17:08 | |
| marios | # | 17:10 |
| *** pcm__ has joined #openstack-neutron | 17:11 | |
| *** pcm_ has quit IRC | 17:13 | |
| *** ashaikh has joined #openstack-neutron | 17:13 | |
| *** jhurlbert has joined #openstack-neutron | 17:14 | |
| *** jecarey has quit IRC | 17:16 | |
| marios | happy friday neutron! | 17:21 |
| anteaya | happy friday marios | 17:21 |
| *** openstackgerrit has joined #openstack-neutron | 17:22 | |
| *** otherwiseguy has quit IRC | 17:23 | |
| *** clev has quit IRC | 17:24 | |
| *** pcm_ has joined #openstack-neutron | 17:25 | |
| *** pcm__ has quit IRC | 17:27 | |
| *** SushilKM has joined #openstack-neutron | 17:28 | |
| *** clev has joined #openstack-neutron | 17:34 | |
| *** garyk has quit IRC | 17:35 | |
| *** ygbo has quit IRC | 17:37 | |
| *** markmcclain has joined #openstack-neutron | 17:38 | |
| *** SushilKM has quit IRC | 17:43 | |
| *** safchain has quit IRC | 17:49 | |
| *** otherwiseguy has joined #openstack-neutron | 17:49 | |
| anteaya | hey otherwiseguy | 17:52 |
| otherwiseguy | hey anteaya | 17:52 |
| anteaya | any chance you can help us out by looking at https://bugs.launchpad.net/tempest/+bug/1253896 | 17:52 |
| *** garyk has joined #openstack-neutron | 17:52 | |
| anteaya | markmcclain beagles and dkehn are working on it as well, would be great to have your help too | 17:52 |
| anteaya | hey garyk | 17:53 |
| *** fouxm has quit IRC | 17:54 | |
| otherwiseguy | anteaya: i'll see what I can do, but currently *really* bogged down trying to get all of the bits together for our RH havana release. | 17:54 |
| *** fouxm has joined #openstack-neutron | 17:55 | |
| anteaya | otherwiseguy: any help you can offer is gratefully appreciated | 17:55 |
| anteaya | thank you | 17:55 |
| *** fouxm has quit IRC | 17:56 | |
| *** harlowja has quit IRC | 18:05 | |
| *** suresh12 has joined #openstack-neutron | 18:15 | |
| *** SumitNaiksatam has quit IRC | 18:21 | |
| *** harlowja has joined #openstack-neutron | 18:24 | |
| *** angryjesters has joined #openstack-neutron | 18:25 | |
| *** csd has quit IRC | 18:27 | |
| *** csd has joined #openstack-neutron | 18:28 | |
| *** clev has quit IRC | 18:31 | |
| *** rwsu has quit IRC | 18:32 | |
| *** rwsu has joined #openstack-neutron | 18:40 | |
| anteaya | salv-orlando: here is the bug for the Java IO failure we saw this morning: https://bugs.launchpad.net/openstack-ci/+bug/1260654 | 18:45 |
| anteaya | in case we hit it again | 18:45 |
| *** rossella_s has joined #openstack-neutron | 18:45 | |
| salv-orlando | thanks anteaya. Is there an elastic-recheck entry for it too? | 18:45 |
| anteaya | I'll look | 18:46 |
| *** dave_tucker has quit IRC | 18:46 | |
| anteaya | yes, top hit on http://status.openstack.org/elastic-recheck/ | 18:46 |
| anteaya | salv-orlando: and the last I heard from markmcclain is that he thinks https://bugs.launchpad.net/tempest/+bug/1253896 might be affected by a cleanup issue | 18:47 |
| salv-orlando | yes, I scrolled back on the log. I have now some time to look back into it. I have not seen updates since yesterday. | 18:48 |
| anteaya | salv-orlando: no, there have been no updates :( | 18:48 |
| anteaya | and thank you | 18:48 |
| anteaya | I'll be standing by if you find anything | 18:48 |
| *** SumitNaiksatam has joined #openstack-neutron | 18:51 | |
| doude | rkukura: ping | 18:54 |
| doude | rkukura: can I ask you 2 small questions about ML2 plugin ? | 18:55 |
| *** yamahata_ has quit IRC | 18:59 | |
| *** alagalah has joined #openstack-neutron | 19:03 | |
| *** networkstatic has joined #openstack-neutron | 19:04 | |
| *** jecarey has joined #openstack-neutron | 19:08 | |
| *** csd has quit IRC | 19:09 | |
| *** csd has joined #openstack-neutron | 19:10 | |
| *** clev has joined #openstack-neutron | 19:12 | |
| *** clev has quit IRC | 19:14 | |
| *** clev has joined #openstack-neutron | 19:16 | |
| *** dims has quit IRC | 19:21 | |
| *** dave_tucker has joined #openstack-neutron | 19:23 | |
| anteaya | and it looks like https://review.openstack.org/#/c/60825/ our tox patch for neutron is about to be kicked out of the gate for two failures | 19:28 |
| anteaya | I will track them and reverify | 19:29 |
| *** alagalah has left #openstack-neutron | 19:29 | |
| anteaya | we hit https://bugs.launchpad.net/tempest/+bug/1253896 | 19:31 |
| anteaya | interesting we are now the top patch in the gate | 19:32 |
| anteaya | let's we how we do this test run | 19:32 |
| anteaya | something must have failed in front of us | 19:32 |
| *** mlavalle has joined #openstack-neutron | 19:36 | |
| *** dims has joined #openstack-neutron | 19:36 | |
| anteaya | hey dims | 19:38 |
| anteaya | dims: can you tell me why you abandoned: https://review.openstack.org/#/c/59769/ | 19:39 |
| dims | [10:44] <dims> anteaya, that review was probably targeting a symptom of a small subset of the failures (not even the real cause of failures) | 19:40 |
| anteaya | ah sorry missed your earlier reply to me | 19:41 |
| anteaya | thanks for the repeat | 19:41 |
| dims | :) | 19:42 |
| anteaya | did you reply in this channel? | 19:42 |
| anteaya | I am going over the backscroll to ensure I am not crazy, still can't see it | 19:42 |
| anteaya | nope wasn't in this channel or in qa | 19:44 |
| *** csd has quit IRC | 19:44 | |
| anteaya | funny | 19:44 |
| anteaya | anyway thanks for the response | 19:44 |
| *** csd has joined #openstack-neutron | 19:44 | |
| *** alagalah has joined #openstack-neutron | 19:46 | |
| *** rossella_s has quit IRC | 19:47 | |
| mlavalle | anteaya: https://bugs.launchpad.net/neutron/+bug/1251448 only 4 hits in the past 24 hrs and none in the last 12 | 19:49 |
| *** ashaikh has quit IRC | 19:51 | |
| dims | anteaya, weird! np | 19:53 |
| anteaya | mlavalle: okay, let's keep it on our radar | 19:53 |
| anteaya | dims: yeah, odd | 19:53 |
| anteaya | mlavalle: I don't want to turn a blind eye to it and then have it blow up on us for some reason | 19:54 |
| anteaya | mlavalle: so thanks | 19:54 |
| mlavalle | anteaya: I'll monitor it constantly from now until this coming Monday IRC meeting. If this trend continues, I don't think it will completely disappear, but I don't think it's a Neutron bug anymore | 19:55 |
| mlavalle | anteaya: If this trend continues, we will see some occurrences, but they are a consequence of the way the gate job and tempest are setup, not a Neutron bug | 19:56 |
| *** alagalah has left #openstack-neutron | 19:56 | |
| anteaya | ah, I don't have agreement with all you say, but yes let's look at it Monday and talk about it again | 19:57 |
| anteaya | in other news JoeHazzers took a look at the wiki page you wrote and hopefully will find some time for some tempest api tests | 19:57 |
| JoeHazzers | :D | 19:58 |
| mlavalle | anteaya; cool | 19:58 |
| *** ashaikh has joined #openstack-neutron | 19:59 | |
| mlavalle | before Monday's IRC meeting I will update https://bugs.launchpad.net/neutron/+bug/1251448 with my observations so we can discuss with the rest of the team | 20:00 |
| anteaya | mlavalle: awesome thanks | 20:05 |
| *** harlowja has quit IRC | 20:07 | |
| rkukura | doude: Still looking for me? | 20:15 |
| *** Abhishe__ has quit IRC | 20:15 | |
| anteaya | and our neutron tox patch just failed on https://bugs.launchpad.net/tempest/+bug/1253896 | 20:26 |
| anteaya | so I will reverify and get it back in the gate queue | 20:26 |
| anteaya | once Jenkins posts results | 20:27 |
| *** clev has quit IRC | 20:28 | |
| anteaya | back in the queue | 20:29 |
| doude | rkukura: yes | 20:31 |
| doude | rkukura: if you have few minutes | 20:31 |
| markmcclain | sdague: think I might have a possible candidate for what caused the ssh to start failing again | 20:39 |
| markmcclain | (at a higher rate) | 20:39 |
| sdague | markmcclain: sure | 20:39 |
| markmcclain | https://review.openstack.org/#/c/61439/ | 20:39 |
| markmcclain | was merged approx the same time the problem started happening again | 20:39 |
| markmcclain | the corresponding nova change has not merged | 20:40 |
| markmcclain | https://review.openstack.org/#/c/61428/ | 20:40 |
| markmcclain | notice that only failure on teh nova change was docs | 20:40 |
| sdague | so once the nova change lands, this might get much better? | 20:40 |
| markmcclain | possibly the changes should go in as a pair | 20:40 |
| markmcclain | and if metadata is failing in usual ways then ssh is going to be wonky | 20:41 |
| sdague | yep | 20:41 |
| sdague | ok, good catch | 20:41 |
| markmcclain | willl still keep digging because we need to understand this failure | 20:42 |
| markmcclain | since the change was intended to allow a deployer to upgrade neutron and hten nova | 20:42 |
| sdague | yep | 20:43 |
| *** aymenfrikha has joined #openstack-neutron | 20:45 | |
| sdague | markmcclain: ok, we're bumping it to the top of the gate queue | 20:46 |
| markmcclain | cool.. thanks | 20:46 |
| sdague | so we should know within a couple of hours if it makes it better | 20:47 |
| *** vkozhukalov has joined #openstack-neutron | 20:51 | |
| *** aymenfrikha1 has joined #openstack-neutron | 20:52 | |
| *** aymenfrikha has quit IRC | 20:52 | |
| *** harlowja has joined #openstack-neutron | 20:56 | |
| *** clev has joined #openstack-neutron | 21:02 | |
| *** alagalah has joined #openstack-neutron | 21:03 | |
| *** otherwiseguy has quit IRC | 21:09 | |
| *** alagalah has left #openstack-neutron | 21:12 | |
| *** sneezewort has quit IRC | 21:19 | |
| *** changbl_ has quit IRC | 21:29 | |
| *** changbl has joined #openstack-neutron | 21:29 | |
| markmcclain | sdague: no luck | 21:31 |
| *** aymenfrikha1 has quit IRC | 21:32 | |
| *** aymenfrikha has joined #openstack-neutron | 21:32 | |
| *** vkozhukalov has quit IRC | 21:33 | |
| anteaya | sdague: I have reverified https://review.openstack.org/#/c/61428/ it hit https://bugs.launchpad.net/tempest/+bug/1253896 | 21:35 |
| anteaya | are you able to put it on the top of the queue again? | 21:36 |
| *** clev has quit IRC | 21:37 | |
| *** Sreedhar has quit IRC | 21:41 | |
| *** harlowja has quit IRC | 21:50 | |
| anteaya | sdague: no need, as fungi pointed out, if it failed on the bug, it probably isn't the fix for it | 21:52 |
| *** vkozhukalov has joined #openstack-neutron | 21:54 | |
| openstackgerrit | mark mcclain proposed a change to openstack/neutron: Revert "move rpc_setup to the last step of __init__" https://review.openstack.org/62098 | 21:55 |
| markmcclain | sdague: just pushed a revert up for review | 21:56 |
| markmcclain | https://review.openstack.org/62098 | 21:56 |
| markmcclain | letting the test run | 21:56 |
| markmcclain | turns out it was rechecked 4! times for this bug | 21:56 |
| sdague | ah fun | 21:59 |
| *** harlowja has joined #openstack-neutron | 22:00 | |
| *** aymenfrikha has quit IRC | 22:02 | |
| *** djbkd_ has quit IRC | 22:03 | |
| *** aymenfrikha has joined #openstack-neutron | 22:05 | |
| *** Mr_W has joined #openstack-neutron | 22:15 | |
| *** harlowja has quit IRC | 22:16 | |
| *** otherwiseguy has joined #openstack-neutron | 22:20 | |
| *** harlowja has joined #openstack-neutron | 22:24 | |
| *** AlexF has joined #openstack-neutron | 22:25 | |
| *** harlowja has quit IRC | 22:27 | |
| *** harlowja has joined #openstack-neutron | 22:28 | |
| *** vkozhukalov has quit IRC | 22:35 | |
| *** AlexF has quit IRC | 22:37 | |
| *** csd has quit IRC | 22:39 | |
| *** AlexF has joined #openstack-neutron | 22:40 | |
| *** csd has joined #openstack-neutron | 22:41 | |
| anteaya | woohoo: https://review.openstack.org/#/c/62098/ passed check | 22:53 |
| anteaya | salv-orlando mestery marun arosen can we get some core reviews on 62098? | 22:54 |
| anteaya | please | 22:54 |
| anteaya | who else is around, garyk | 22:54 |
| anteaya | rkukura | 22:54 |
| anteaya | armax | 22:55 |
| salv-orlando | another check to see if this is not an outlier would not harm | 22:55 |
| anteaya | let's do that | 22:55 |
| salv-orlando | I have one more hour at least before bed I can wait | 22:55 |
| anteaya | k | 22:55 |
| salv-orlando | still not sure why this patch started crashing the gate | 22:56 |
| anteaya | but the patch did hit the bug 4 times | 22:57 |
| anteaya | an no other bug | 22:57 |
| *** otherwiseguy has quit IRC | 22:58 | |
| anteaya | dkehn: :D | 23:00 |
| *** Mr_W has quit IRC | 23:09 | |
| salv-orlando | sure anteaya. I actually was already looking at this patch as the suspect yesterday, but I could not find any reason why it would harm the gate. | 23:10 |
| anteaya | okay | 23:10 |
| anteaya | let's see what happens if the revert merges | 23:11 |
| salv-orlando | ok then | 23:11 |
| *** Mr_W has joined #openstack-neutron | 23:13 | |
| *** pcm_ has quit IRC | 23:14 | |
| *** AlexF has quit IRC | 23:16 | |
| *** djbkd has joined #openstack-neutron | 23:23 | |
| *** networkstatic is now known as networkstatic_zZ | 23:24 | |
| anteaya | all tests are running on 62098 should finish in 30 minutes | 23:25 |
| *** dsockwell has quit IRC | 23:28 | |
| *** carl_baldwin has quit IRC | 23:29 | |
| *** dsockwell has joined #openstack-neutron | 23:29 | |
| *** alagalah has joined #openstack-neutron | 23:35 | |
| *** alagalah has quit IRC | 23:37 | |
| *** networkstatic_zZ is now known as networkstatic | 23:45 | |
| *** ashaikh has quit IRC | 23:48 | |
| anteaya | 62098 is about to fail on https://bugs.launchpad.net/nova/+bug/1254890 | 23:54 |
| anteaya | I'm hesitant to do recheck without an investigation since this is how we got into this mess in the first place | 23:56 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!