Tuesday, 2012-06-26

*** nati_uen_ has joined #openstack-dev00:00
*** chenxu has quit IRC00:02
*** nati_ueno has quit IRC00:03
mtaylorbcwaldon: nope. priority cues :)00:05
*** bhuvan has quit IRC00:06
*** ncode has quit IRC00:11
*** steveb_ has quit IRC00:13
*** littleidea has quit IRC00:13
*** steveb_ has joined #openstack-dev00:14
*** dubsquared has joined #openstack-dev00:16
mtaylors/cues/queues/00:17
bcwaldonno no, I got it00:17
*** jdg has quit IRC00:21
mtaylorbcwaldon: you're always so clairvoyant00:21
zulvishy: ping00:21
*** segfault923 has quit IRC00:21
*** ayoung has joined #openstack-dev00:23
*** ayoung has quit IRC00:26
*** zykes- has joined #openstack-dev00:28
*** sniperd has quit IRC00:28
*** littleidea has joined #openstack-dev00:30
vishyzul: sup?00:36
zulvishy: so checking the availability zone for volume creating should it be done in the csheduler or volume ?00:36
*** dubsquared has quit IRC00:36
*** kindaopsdevy has quit IRC00:37
vishyzul: the scheduler should update to error state like it does for instances00:37
zulvishy: right ok just double checking00:38
vishyzul: heading home for the day, gl00:39
zulvishy: k thanks00:39
*** torgomatic_ has joined #openstack-dev00:41
*** torgomatic has quit IRC00:42
*** torgomatic_ is now known as torgomatic00:42
*** markvoelker has joined #openstack-dev00:42
*** torgomatic has quit IRC00:42
*** spiffxp has quit IRC00:42
*** anderstj has joined #openstack-dev00:44
*** sniperd has joined #openstack-dev00:46
*** andrewsben_is_a_ is now known as andrewsben00:48
*** andrewbogott has joined #openstack-dev00:49
*** matwood has joined #openstack-dev00:50
*** rkukura has joined #openstack-dev00:51
andrewbogottDoes anyone know what the story is with Jenkins vs. openstack-common?00:53
andrewbogottIt seems to be ignoring all common patches, best I can tell.00:54
clarkbandrewbogott: correct Jenkins currently doesn't do anything for openstack-common00:54
clarkbhowever that will change soon00:54
andrewbogottAh, ok.  So that means that reviewers should not wait for Verification, huh?00:54
clarkbactually it may have changed00:55
*** dolphm has joined #openstack-dev00:55
clarkbnevermind was looking at the wrong queue. once https://review.openstack.org/#/c/8957/ lands then Jenkins will verify for you00:55
*** dubsquared has joined #openstack-dev00:56
andrewbogottBut, in the meantime...00:56
* andrewbogott is puzzled that his patch has two +1s and a +2 and a checkmark but is not yet 'approved'00:57
andrewbogottI guess I can't blame Jenkins :(00:57
*** s0mik has quit IRC01:00
*** s0mik has joined #openstack-dev01:02
*** markvoelker has left #openstack-dev01:03
*** Aaton is now known as Aaton_off01:11
*** rbasak has quit IRC01:13
*** issackelly has quit IRC01:13
*** andrewbogott has quit IRC01:14
*** rbasak has joined #openstack-dev01:15
*** jog0 has quit IRC01:16
*** asalkeld has quit IRC01:18
*** asalkeld has joined #openstack-dev01:18
*** andrewbogott has joined #openstack-dev01:19
*** andrewsben is now known as andrewsben_is_a_01:21
*** s0mik has quit IRC01:22
*** kindaopsdevy has joined #openstack-dev01:24
*** rnirmal has quit IRC01:29
*** reed has quit IRC01:30
*** PotHix has quit IRC01:33
*** littleidea has quit IRC01:33
*** iccha has quit IRC01:34
*** primeministerp has quit IRC01:36
*** shang has quit IRC01:38
*** nati_uen_ has quit IRC01:40
*** salgado-afk has quit IRC01:46
*** ywu has quit IRC01:50
*** adalbas has quit IRC01:57
*** steveb_ has quit IRC01:58
*** vanchester has joined #openstack-dev02:00
*** shang has joined #openstack-dev02:02
*** kindaopsdevy has quit IRC02:04
*** harlowja has quit IRC02:04
*** novas0x2a|laptop has quit IRC02:06
*** dolphm has quit IRC02:06
*** dolphm has joined #openstack-dev02:09
*** danwent has quit IRC02:12
*** roge has quit IRC02:12
*** matwood has quit IRC02:15
comstudvishy: more good stuff for you pushed up02:16
*** Ryan_Lane1 has joined #openstack-dev02:18
*** Ryan_Lane has quit IRC02:19
*** nati_ueno has joined #openstack-dev02:19
*** edygarcia has joined #openstack-dev02:37
*** eglynn_ has joined #openstack-dev02:42
*** davidha has joined #openstack-dev02:44
*** eglynn has quit IRC02:46
*** timjr has joined #openstack-dev02:53
*** timjr has left #openstack-dev02:53
*** dtroyer_zzz is now known as dtroyer02:53
*** timjr has joined #openstack-dev02:53
timjrhowdy :)02:53
timjrI'm a newbie trying to contribute my first patch... err, code review request02:53
timjrkinda stuck though02:54
timjrI changed my username on launchpad02:54
timjrit seems the change is not propagating to gerrit02:54
mtaylortimjr: there is a delay02:54
mtaylortimjr: how long ago did you change you username on launchpad?02:55
timjrabout an hour02:55
timjrthe old username was a crazy thing, ww3ib0sg9wt9-tim-8aw3u04umos202:55
timjrnew one is easier to pronounce -- timjr02:56
timjrhm.  wonder if I lost my team membership when I changed it02:57
timjryep, looks like I may have03:00
timjrwoohoo, ssh keys made it03:01
timjrI wonder if it's an hourly cron job or something -- it's 8:01 here03:01
*** dolphm has quit IRC03:04
timjrwell, I guess I'll go commute.  if anybody's around that could approve my openstack-cla team membership, I'd be much obliged. :)03:04
*** timjr has quit IRC03:04
*** nati_ueno has quit IRC03:12
*** davidha has quit IRC03:13
*** edygarcia has quit IRC03:14
*** seats has quit IRC03:29
*** seats has joined #openstack-dev03:30
*** timello has quit IRC03:31
*** dtroyer is now known as dtroyer_zzz03:32
*** sandywalsh has quit IRC03:36
*** andrewsmedina has quit IRC03:38
*** dolphm has joined #openstack-dev03:44
*** kindaopsdevy has joined #openstack-dev03:46
*** seats has quit IRC03:46
*** Gordonz has joined #openstack-dev03:47
*** Gordonz has quit IRC03:47
*** seats has joined #openstack-dev03:47
*** seats has quit IRC03:47
*** seats has joined #openstack-dev03:47
*** dolphm has quit IRC03:48
*** timjr has joined #openstack-dev03:51
*** timjr has quit IRC03:52
*** dubsquared has quit IRC03:52
*** adjohn has quit IRC03:53
*** matwood has joined #openstack-dev03:54
*** adjohn has joined #openstack-dev03:58
*** dolphm has joined #openstack-dev04:04
*** dubsquared has joined #openstack-dev04:05
*** markmcclain has quit IRC04:26
*** pmyers has quit IRC04:26
*** zigo has joined #openstack-dev04:29
*** kindaopsdevy has quit IRC04:31
*** Ryan_Lane1 has quit IRC04:33
*** matwood has quit IRC04:34
*** nunosantos has quit IRC04:34
*** nunosantos_ has quit IRC04:35
*** matwood has joined #openstack-dev04:35
*** matwood has quit IRC04:36
*** matwood has joined #openstack-dev04:38
*** garyk has quit IRC04:41
*** kindaopsdevy has joined #openstack-dev04:46
*** andrewbogott has quit IRC04:50
*** adjohn has quit IRC05:03
*** steveb_ has joined #openstack-dev05:06
*** mnaser has joined #openstack-dev05:06
*** kindaopsdevy has quit IRC05:08
*** maoy has quit IRC05:11
*** dolphm has quit IRC05:23
*** adjohn has joined #openstack-dev05:25
*** adjohn has quit IRC05:28
*** edygarcia has joined #openstack-dev05:29
*** steveb_ has quit IRC05:29
*** edygarcia has quit IRC05:32
*** adjohn has joined #openstack-dev05:38
*** sleepsonzzz is now known as sleepsonthefloor05:56
*** dachary has joined #openstack-dev05:58
*** Mandell has joined #openstack-dev06:02
*** garyk has joined #openstack-dev06:07
*** pmyers has joined #openstack-dev06:07
*** matwood has quit IRC06:08
*** sdake has quit IRC06:10
*** dachary has quit IRC06:10
*** jakedahn is now known as jakedahn_zz06:11
*** sdake has joined #openstack-dev06:11
*** mnaser has quit IRC06:17
*** sleepsonthefloor is now known as sleepsonzzz06:20
*** Mandell has quit IRC06:20
*** mrunge has joined #openstack-dev06:24
garykping gongys06:29
*** adjohn has joined #openstack-dev06:31
*** erikzaadi has joined #openstack-dev06:39
*** anderstj has quit IRC06:41
*** erikzaadi has quit IRC06:42
*** sdake has quit IRC06:43
*** littleidea has joined #openstack-dev06:44
*** sieutruc has joined #openstack-dev06:50
*** sdake has joined #openstack-dev06:55
*** adjohn has quit IRC07:03
*** mgz has joined #openstack-dev07:04
*** davidha has joined #openstack-dev07:07
*** dachary has joined #openstack-dev07:11
*** reidrac has joined #openstack-dev07:13
ttxannegentle: no, that's a new file in Folsom.07:14
*** huats_ has joined #openstack-dev07:18
*** camm_ has joined #openstack-dev07:18
*** ahale_ has joined #openstack-dev07:18
*** jeremydei_ has joined #openstack-dev07:19
*** dayou has joined #openstack-dev07:19
*** ahale has quit IRC07:19
*** camm has quit IRC07:19
*** jeremydei has quit IRC07:19
*** Aaton_off has quit IRC07:19
*** huats has quit IRC07:19
*** Aatong has joined #openstack-dev07:19
*** Aatong is now known as Aaton07:19
*** adjohn has joined #openstack-dev07:25
*** glenc_ has quit IRC07:26
*** erikzaadi has joined #openstack-dev07:26
*** glenc has joined #openstack-dev07:28
*** justinsb_ has joined #openstack-dev07:31
*** vuntz_ has joined #openstack-dev07:31
*** BLZbubba_ has joined #openstack-dev07:32
*** mindpixel has joined #openstack-dev07:32
*** smoser` has joined #openstack-dev07:35
*** BLZbubba has quit IRC07:36
*** vuntz has quit IRC07:36
*** smoser has quit IRC07:36
*** justinsb has quit IRC07:36
*** akscram has quit IRC07:36
*** haleyb has quit IRC07:36
*** vuntz_ is now known as vuntz07:47
*** ohnoimdead has quit IRC07:54
*** smoser` is now known as smoser08:03
*** littleidea has quit IRC08:03
*** littleidea has joined #openstack-dev08:04
*** haleyb has joined #openstack-dev08:04
*** akscram has joined #openstack-dev08:09
*** darraghb has joined #openstack-dev08:16
*** pixelbeat has joined #openstack-dev08:17
*** littleidea has quit IRC08:37
*** zigo-_- has joined #openstack-dev08:37
*** zigo has quit IRC08:38
*** danpb has joined #openstack-dev08:46
*** akscram has quit IRC08:59
*** akscram has joined #openstack-dev09:00
*** eglynn__ has joined #openstack-dev09:16
*** eglynn_ has quit IRC09:18
*** rods has joined #openstack-dev09:20
*** johngarbutt has joined #openstack-dev09:24
*** _val__ has joined #openstack-dev09:25
*** _val_ has quit IRC09:26
*** eglynn has joined #openstack-dev09:28
*** eglynn__ has quit IRC09:29
*** eglynn_ has joined #openstack-dev09:32
*** eglynn has quit IRC09:35
*** markmcclain has joined #openstack-dev10:01
*** eglynn__ has joined #openstack-dev10:02
*** eglynn_ has quit IRC10:05
vanchesteranyone of keystone ldap backend devs here?10:08
*** Leander_ has joined #openstack-dev10:10
*** zigo-_- has quit IRC10:11
Leander_hello all10:11
Leander_i'm having a problem with the tests10:11
Leander_i've created a custom branch10:12
Leander_and added one file to nova and modified the connection.py from libvirt10:12
Leander_now, none of the tests run10:12
Leander_i've tried applying the same changes to the master branch10:12
Leander_and as soon as the changes are made i somehow lose all the tests10:12
Leander_any ideas why this is happening?10:13
*** apevec has joined #openstack-dev10:23
*** dayou has quit IRC10:29
* danpb discovers the --no-merges flag to 'git log' which makes browsing openstack GIT history orders of magnitude more pleasant10:40
Leander_hello all,i'm having a problem with the tests10:42
Leander_i've created a custom branch and added one file to nova and modified the connection.py from libvirt.10:42
Leander_However, none of the tests run. I've tried applying the same changes to the master branch and as soon as the changes are made i somehow lose all the tests.10:42
Leander_any ideas why this is happening?10:42
vanchesterstill have the question: how does models are used in keystone ldap backend?10:44
vanchesteraha, there is the code10:47
*** alaski has joined #openstack-dev10:55
*** e1mer has quit IRC11:02
*** sandywalsh has joined #openstack-dev11:03
*** mgz has quit IRC11:11
*** markvoelker has joined #openstack-dev11:15
*** erikzaadi has quit IRC11:19
*** erikzaadi has joined #openstack-dev11:21
zykes-jk0: ping11:22
*** asalkeld has left #openstack-dev11:22
*** mrunge has quit IRC11:24
*** Leander_ has quit IRC11:30
*** zigo has joined #openstack-dev11:30
*** wiliam has joined #openstack-dev11:31
*** e1mer has joined #openstack-dev11:37
*** e1mer has joined #openstack-dev11:37
*** e1mer has quit IRC11:41
*** e1mer has joined #openstack-dev11:41
*** maoy has joined #openstack-dev11:41
*** RoboticCheese has quit IRC11:50
*** RoboticCheese has joined #openstack-dev11:50
*** salgado has joined #openstack-dev12:00
*** salgado has joined #openstack-dev12:00
*** vanchester has quit IRC12:03
*** darraghb has quit IRC12:05
*** vanchester has joined #openstack-dev12:10
*** sieutruc has quit IRC12:12
zykes-soren: ping12:18
*** segfault923 has joined #openstack-dev12:24
*** mgz has joined #openstack-dev12:26
*** pmyers has quit IRC12:29
*** Leander_ has joined #openstack-dev12:29
*** pmyers has joined #openstack-dev12:29
*** sandywalsh_ has joined #openstack-dev12:29
Leander_hello all,i'm having a problem with the tests12:30
Leander_i've created a custom branch and added one file to nova and modified the connection.py from libvirt12:30
Leander_However, none of the tests run. I've tried applying the same changes to the master branch and as soon as the changes are made i somehow lose all the tests.12:30
Leander_any ideas why this is happening?12:30
*** sandywalsh has quit IRC12:30
*** markmcclain has quit IRC12:40
*** lts has joined #openstack-dev12:42
*** apevec has quit IRC12:45
davidkranzvishy: I did multiple runs with and without the fix to suppress variance and there was no real difference after all. Oh well.12:45
*** vanchester has quit IRC12:46
*** chenxu has joined #openstack-dev12:47
*** Ryan_Lane has joined #openstack-dev12:48
*** japage has joined #openstack-dev12:54
*** maoy has quit IRC12:55
*** Dr_Who has joined #openstack-dev12:55
*** Dr_Who has quit IRC12:55
*** Dr_Who has joined #openstack-dev12:55
*** johngarbutt has quit IRC12:59
*** wiliam has quit IRC13:02
*** matwood has joined #openstack-dev13:06
*** matwood has quit IRC13:08
*** apevec has joined #openstack-dev13:09
*** mcolombo has quit IRC13:10
*** iccha has joined #openstack-dev13:10
*** dtroyer_zzz is now known as dtroyer13:11
*** timello has joined #openstack-dev13:16
*** edygarcia has joined #openstack-dev13:17
*** wiliam has joined #openstack-dev13:18
*** adalbas has joined #openstack-dev13:20
*** mnaser has joined #openstack-dev13:21
*** edygarcia has quit IRC13:23
*** dprince has joined #openstack-dev13:30
*** mnaser has quit IRC13:30
*** roge has joined #openstack-dev13:33
*** openstackjenkins has quit IRC13:34
*** openstackjenkins has joined #openstack-dev13:35
*** andrewsmedina has joined #openstack-dev13:36
*** dhellmann_ has joined #openstack-dev13:36
*** eglynn has joined #openstack-dev13:36
*** kbringard has joined #openstack-dev13:37
*** salv-orlando has joined #openstack-dev13:38
*** matwood has joined #openstack-dev13:39
*** eglynn__ has quit IRC13:39
*** dhellmann has quit IRC13:40
*** markmcclain has joined #openstack-dev13:40
*** dhellmann_ has quit IRC13:41
*** krtaylor has joined #openstack-dev13:42
*** ncode has joined #openstack-dev13:43
*** ncode has quit IRC13:43
*** ncode has joined #openstack-dev13:43
*** matwood has quit IRC13:45
*** openstackjenkins has quit IRC13:47
*** Ryan_Lane has quit IRC13:48
*** Ryan_Lane has joined #openstack-dev13:48
*** openstackjenkins has joined #openstack-dev13:48
*** sieutruc has joined #openstack-dev13:51
*** maoy has joined #openstack-dev13:52
*** iryoung has joined #openstack-dev13:53
*** mnaser has joined #openstack-dev13:54
*** dolphm has joined #openstack-dev13:58
*** edygarcia has joined #openstack-dev13:59
danpbttx: is there a place to submit bug reports about OpenStack Gerrit service mis-behaviour ?14:01
mtaylordanpb: yes.14:03
mtaylordanpb: bugs on the openstack-ci project in launchpad14:03
mtaylordanpb: so, http://bugs.launchpad.net/openstack-ci ...14:03
ttxdanpb: what Monty says ^14:03
mtaylordanpb: or you can just ping us in #openstack-infra if it might be a quick thing - what's up?14:03
danpbno its not a quick thing14:04
mtaylordanpb: ok. cool. then please do submit a bug! :)14:04
danpbsomeone just pointed out to me that if you submit a patch series for a bug fix, then gerrit will mark the bug as fixed the moment 1 single patch is committed14:04
danpbignoring the fact that other patches in the series are also required in order to complete the fix14:05
mtaylordanpb: ah. interesting14:05
mtaylordanpb: we've discussed splitting some of the verbs before for blueprints ...14:05
danpbwill file a BZ about it since there's probably many different ways to discuss resolving it14:05
mtaylordanpb: like "bug #blah" would associate it with a bug, but "closes #blah" would trigger the finalization ...14:06
mtaylordanpb: yeah, definitely - it's a good thing to discuss on the bug14:06
danpbyeah that's one idea i came up with too14:06
*** jaustinpage has joined #openstack-dev14:07
*** japage has quit IRC14:09
jaypipesmtaylor: mornin.14:12
*** dtroyer is now known as dtroyer_zzz14:15
Leander_hello all,i'm having a problem with the tests14:16
Leander_i've created a custom branch and added one file to nova and modified the connection.py from libvirt14:16
Leander_However, none of the tests run. I've tried applying the same changes to the master branch and as soon as the changes are made i somehow lose all the tests.14:16
Leander_any ideas why this is happening?14:16
*** mnaser has quit IRC14:16
mtaylormorning jaypipes !14:16
*** danwent has joined #openstack-dev14:16
mtaylorjaypipes: you know, if you wanted to approve https://review.openstack.org/#/c/8926/ I wouldn't hate you14:17
jaypipesLeander_: if you do git status, are you on a branch at all, or are you in the middle of a rebase?14:18
maoyjaypipes: do you know which services is dependent on nova-cert?14:18
jaypipesmtaylor: done. well, +2d14:19
jaypipesmaoy: I *think* the nova EC2 API controller... but you might want to get a second op :)14:19
*** mcolombo has joined #openstack-dev14:20
jaypipesdanpb: lol. "style you managed to inflict on mailman"14:21
maoyjaypipes: all right. i didn't see anything related to certificate when i went through the ec2 code though.14:22
*** martines has joined #openstack-dev14:22
jaypipesmaoy: one sec, lemme dig a little then.14:22
*** andrewbogott has joined #openstack-dev14:22
*** andrewbogott has joined #openstack-dev14:22
mtaylorjaypipes: you are a magical bunny rabbit14:22
* mtaylor warns the channel that he's going to be bugging people about merging the client lib version branches today14:23
jaypipesmtaylor: you are an evil unicorn.14:23
*** danwent has quit IRC14:25
*** mnewby has joined #openstack-dev14:27
*** primeministerp has joined #openstack-dev14:27
ameadebuilding a venv in nova right now seems to be busted14:28
danpbjaypipes: anyone who manages to get mailman UI to be even slightly better deserves a medal for their hard work ;-)14:29
jaypipesindeed, danpb14:29
Leander_jaypipes: # On branch diagnostics_libvirt14:30
jaypipesdanpb: I feel the same way about Nagios.14:30
Leander_that's the ouput from git14:30
jaypipesLeander_: k, just wanted to make sure you weren't in the middle of a rebase... and how are you running tests?14:30
Leander_jaypipes: ./run_tests.sh14:30
jaypipesLeander_: You might want to: rm -rf .venv && ./run_tests.sh -V14:31
jaypipesLeander_: perhaps you've got a half-installed venv...14:32
*** ewindisch has joined #openstack-dev14:32
Leander_jaypipes: the output is always14:33
Leander_----------------------------------------------------------------------14:33
Leander_Ran 0 tests in 0.000s14:33
Leander_OK14:33
Leander_Running PEP8 and HACKING compliance check...14:33
Leander_4 imports missing in this test environment14:33
Leander_i will try to reinstall the venv14:34
mtaylorthat's really weird14:34
*** dolphm has quit IRC14:34
mtaylorLeander_: but it _does_ run tests properly on a clean master for you?14:34
Leander_mtaylor: it works fine on the master14:34
Leander_mtaylor: as soon as i add my code, however, i get the same output14:34
mtaylorLeander_: can you push your change up to gerrit as a draft (git review -D) and then add me as a reviewer? I'd love to grab it and see what's happening14:34
jaypipesLeander_: try running just nosetests -v nova14:35
jaypipesLeander_: run_tests.sh and the openstack.nose_plugin tend to hide errors :(14:35
*** mnaser has joined #openstack-dev14:37
*** jeff_ has joined #openstack-dev14:37
Leander_jaypipes: currently reinstalling venv, please hold14:37
jaypipeskk14:37
*** nunosantos has joined #openstack-dev14:39
Leander_mtaylor: i think it did not get submitted as a draft14:40
*** mnaser has quit IRC14:40
Leander_see https://review.openstack.org/#/c/8839/14:40
Leander_i did use "git review -D"14:41
*** datsun180b has joined #openstack-dev14:43
icchai did a git pull and tried reinstalling the virtual env, and its breaking.14:44
icchafor nova14:44
*** jeff_ has quit IRC14:44
Leander_jaypipes: only nosetests -v nova runs14:44
*** iccha_ has joined #openstack-dev14:46
*** jgriffith1 has joined #openstack-dev14:47
Leander_say, how do i comment on the review system14:47
Leander_it says that i submitted new code, but none of it showed up14:47
*** Ryan_Lane1 has joined #openstack-dev14:47
Leander_and i can't find any way to inform the reviers14:48
Leander_:S14:48
jgriffith1Leander_: Gerrit should handle the email automatically for you (notification piece)14:48
jgriffith1Leander_: Not sure what you're seeing WRT "...none of it showed up"14:48
mtaylorLeander_: I do not see that you have uploaded anything since June 2214:48
mtayloroh, no, I'm sorry - I see "updated June 26"14:49
*** iccha has left #openstack-dev14:49
Leander_mtaylor: yes, but none of the changes showed up :/14:49
mtaylorlooking14:49
mtaylorLeander_: I have not seen this before, we are investigating14:50
*** andrewbogott_ has joined #openstack-dev14:50
*** andrewbogott_ has joined #openstack-dev14:50
mtaylorLeander_: you uploaded your updated change with -D yeah?14:51
*** Ryan_Lane has quit IRC14:51
Leander_mtaylor: i did git commit -a -amend, then git review -D14:51
mtaylorLeander_: could you try just plain git review?14:51
*** andrewbogott has quit IRC14:51
*** andrewbogott_ is now known as andrewbogott14:51
mtaylorLeander_: this might be an interesting interaction of trying to push a draft change to an already published change14:51
mtaylorLeander_: (which, if I'm right, should probably print an error)...14:52
mtaylorttx: could you help me wrangle client lib people to approve/merge the version code changes today?14:53
ttxmtaylor: I can.. try14:54
mtaylorttx: :)14:54
mtaylorjk0, bcwaldon: https://review.openstack.org/#/c/8427/ when you get a chance14:55
jk0on it14:55
*** rnirmal has joined #openstack-dev14:56
mtaylorchmouel, notmyname: https://review.openstack.org/#/c/8934/ if  you please?14:56
*** matwood has joined #openstack-dev14:57
notmynamemtaylor: give me the tldr14:57
*** matwood has quit IRC14:58
mtaylornotmyname: versions for client libs based on git tags14:58
mtaylornotmyname: so the vcsversion stuff we talked about ages ago14:58
notmynamecool14:58
*** anderstj has joined #openstack-dev14:59
Leander_mtaylor: submitted15:00
maoymtaylor: do you know how to disable the color stuff in devstack easily?15:00
mtaylormaoy: I believe there is a config option ... cause I'm pretty sure we set nocolor in devstack gate ... one sec15:00
mtaylormaoy: set LOG_COLOR=False15:01
maoymtaylor: cool. thx15:02
*** reidrac has quit IRC15:02
*** anderstj has quit IRC15:06
*** armaan has joined #openstack-dev15:07
*** mindpixel has quit IRC15:07
*** sdake has quit IRC15:08
*** dolphm has joined #openstack-dev15:08
*** sdake has joined #openstack-dev15:08
Leander_mtaylor: i think i found the issue:15:10
Leander_File "<stdin>", line 1, in <module>15:10
Leander_  File "connection.py", line 73, in <module>15:10
Leander_    from nova.virt.libvirt import diagnostics15:10
Leander_ImportError: cannot import name diagnostics15:10
Leander_the file is in the same directory as connection.py15:11
Leander_however i can't seem to import it15:11
Leander_the other files import just fine15:11
Leander_:s15:11
mtaylorLeander_: exciting!15:13
Leander_mtaylor i'm not sure how to fix it15:15
armaanAnyone from openstack-qa ?15:16
mtaylorLeander_: did you try doing a plain git review again yet?15:17
*** GheRivero_ has joined #openstack-dev15:17
Leander_mtaylor: that's what you asked me right?15:17
mtayloryes15:17
Leander_i hope i don't end up spamming the review system with things that don't work :s15:17
*** katell2 has joined #openstack-dev15:17
mtaylor:)15:18
mtayloryou'll be fine15:18
mtaylorI see your new change15:18
*** mnaser has joined #openstack-dev15:21
sdagueLeander_: does diagnostics have a bad import?15:21
Leander_sdague: diagnostics imports just fine15:22
*** ryant has joined #openstack-dev15:23
Leander_sdague: it just fails to import in connection.py form libvirt if i run the interpreter inside the directory nova/virt/libvirt15:23
*** armaan has left #openstack-dev15:24
ryantany sqlalchemy gurus out there? wondering whether nova should really be running with autoflush=True on the sqlalchemy session15:25
*** danwent has joined #openstack-dev15:25
mtaylordevananda: ^^^ ?15:25
devanandaryant: so, it basically doens't15:26
*** GheRivero has quit IRC15:26
sdagueLeander_: I assume we're talking about this review - https://review.openstack.org/#/c/8839/ ?15:26
*** GheRivero_ is now known as GheRivero15:26
Leander_sdague: yes15:27
GheRiveromorning people15:27
mtaylormorning GheRivero15:27
devanandaryant: in any case, what issue do you think autoflush=True presents?15:27
*** jaustinpage is now known as japage215:28
ryantdevananda: it was my understanding that autoflush defaults to True, I'm not seeing where it is explicitly set to False15:28
sdagueso, is there a reason you have "import libvirt" in diagnostics.py? it doesn't seem like it uses it, and it might be confusing the namespace15:28
mtaylorsdague: ++15:28
devanandaryant: look for "with session.begin():"15:28
bcwaldoneglynn: could this be the cause of our registry port binding problem?15:28
*** japage2 has quit IRC15:29
bcwaldoneglynn: https://bugs.launchpad.net/glance/+bug/101386715:29
uvirtbotLaunchpad bug 1013867 in glance "glance-registry hard coded for port 9191" [Undecided,Incomplete]15:29
*** japage has joined #openstack-dev15:29
* eglynn looking ...15:29
ryantdevananda: I'm seeing where when running with auto_assign_floating_ip=true, records in the floating_ips table are not completely updated on instance termination15:29
mtaylorbcwaldon: morning! you wanna do me a favor?15:30
devanandaryant: how would that relate to autoflush?15:30
eglynnbcwaldon: nope, the strace clearly indicates that its getting EADDRINUSE on the random port, not 919115:30
*** ohnoimdead has joined #openstack-dev15:30
eglynnbcwaldon: I'm working on service launch retry on a fresh port to get around the issue in the tests15:31
bcwaldonmtaylor: sure15:32
bcwaldoneglynn: ok15:32
ryantdevananda: I'm grapsing at straws here, but what I'm seeing is that 2 out of the 4 attributes that should be modified during deallocate_for_instance are not actually changing in the DB. the logic in the network manager code appears correct, the disconnect seems to be the mechanism committing changes to the DB15:33
ryantdevananda: the sqlalchemy docs also say that autoflush should be False when using autocommit15:33
mtaylorbcwaldon: you would make me a happy unicorn if you approved: https://review.openstack.org/#/c/8427/ and https://review.openstack.org/#/c/8926/15:34
devanandaryant: can you reproduce this in devstack? if so, i can trace it locally and see what's going on15:34
Leander_sdague: need to import it in order to access the libvirt bindings15:34
ryantdevananda: I'm only seeing this when running in production with 8-12 compute nodes15:35
ryantwe don't see this in devstack15:35
Leander_sdague: could there be a conflict of some sorts?15:35
bcwaldonmtaylor: le sigh15:35
bcwaldonmtaylor: I have feedback :(15:35
mtaylorbcwaldon: NOOOOOO15:35
bcwaldonmtaylor: why did you make a write_versioninfo, but no read_versioninfo?15:36
devanandaryant: hm, k. running trunk, by any chance?15:36
mtaylorbcwaldon: uh. because I'm clearly stoopid15:36
bcwaldonmtaylor: now I'm willing to overlook this, but I want you to know how I feel15:36
bcwaldonmtaylor: since my feelings are important!15:36
ryantdevananda: essex-stable15:36
mtaylorbcwaldon: how about if I follow up with a patch in a little bit that adds a read_versioninfo?15:36
bcwaldonmtaylor: sure15:36
bcwaldonmtaylor: I'll just ninja approve them15:37
*** heckj has joined #openstack-dev15:37
mtaylorbcwaldon: awesome. I would never want you to feel like I didn't value your feelings15:37
bcwaldonmtaylor: and did this code get into openstack-common already?15:37
mtaylorbcwaldon: yup15:37
mtaylorjkoelker landed it yesterday15:37
bcwaldonmtaylor: ok, so its now obvious that I need to be doing openstack-common reviews15:37
mtaylorbcwaldon: I would love it if you would!15:37
bcwaldonmtaylor: I havent in the past do to a lack of core memebership15:38
bcwaldonmtaylor: but thats a silly reason not to do reviews15:38
*** rbasak has quit IRC15:38
sdagueLeander_: where do you access the libvirt bindings in your file?15:38
sdaguebecause I don't see that15:38
bcwaldonLeander_: how are you generating that traceback you posted to the ML?15:39
mtaylorbcwaldon: well, if you wanted to start with https://review.openstack.org/#/c/8284/ ... :)15:39
bcwaldonmtaylor: looking15:39
*** rbasak has joined #openstack-dev15:39
*** rbasak has quit IRC15:40
bcwaldonmtaylor: added a 'd' to 'an' in your bug report15:40
ryantdevananda: these incomplete mods of floating ip records don't happen on every termination, just ~90% of time at non-trivial scale15:40
bcwaldonmtaylor: tsk tsk15:40
devanandaryant: see PM15:40
bcwaldonmtaylor: can you sell me on the bug report?15:40
*** jgriffith1 has quit IRC15:40
Leander_bcwaldon: i run nosetest instead of ./run_tests.sh15:40
bcwaldonmtaylor: because my immediate reaction is 'I don't want openstack-common handling my deps'15:40
bcwaldonmtaylor: because updating from it is a pain15:40
*** dhellmann has joined #openstack-dev15:41
bcwaldonLeander_: ok, I wanted to make sure you didnt cd into nova/virt/libvirt and run 'python connection.py' or something silly15:41
mtaylorbcwaldon: well... one of the things that people told us they wanted at the ODS was a single global dependency list15:41
Leander_sdague: the "domain" var is a libvirt class passed from connection.py15:41
bcwaldonmtaylor: which I can sort of get behind, but I dont know if openstack-common is the place to house it15:41
bcwaldonmtaylor: to me, openstack-common is for common code15:42
bcwaldonmtaylor: not common dep management15:42
mtaylorbcwaldon: we looked at a whole bunch of convoluted ways to do that, including weirdness with sub-repos and stuff, and it seems like cpoying was simpler15:42
sdagueLeander_: you don't need to import libvirt to access that15:42
mtaylorbcwaldon: oh, ok15:42
bcwaldonmtaylor: and how will this work once we use openstack-common as an actual library15:42
bcwaldonmtaylor: and we dont manually copy it in15:42
mtaylorbcwaldon: so perhaps an openstack-deps repo with those deps list and the code that does the copy?15:42
mtaylorbcwaldon: good point15:42
bcwaldonmtaylor: what's in our deps list?15:42
*** rbasak has joined #openstack-dev15:42
Leander_sdague: removing that import fix it15:43
Leander_what sorcery is this?!15:43
mtaylorbcwaldon: there's two files in there  - global-pip-requires and global-test-requires - which are the concatenation/de-dupped lists of what everything currently depends on15:43
bcwaldonyeah, I'm just now looking at the code15:44
bcwaldonmtaylor: had to get through the bug report first15:44
mtaylorgotcha15:44
bcwaldonmtaylor: I *really* like the common deps for versioning porpoises15:44
mtayloryeah. I think it'll be killer handy once we get the freight-train moving15:44
Leander_can anyone tell me how i can add a comment to the review i submitted?15:45
sdagueLeander_: it's just the way python works. I'm not a proper enough pythonista to give you the perfect explanation, but just realize that you only need to import namespaces if you need to access an object or definition in that namespace directly. Like libvirt.foo15:45
mtaylorit'll also help us aggressively cache in our mirror better, fwiw15:45
sdagueLeander_: just hit the "r" key15:45
sdagueyou can add your own comments to the review15:45
bcwaldonmtaylor: yeah, I realy like the goal15:45
mtaylorsince you shouldn't be adding a depend to a project without landing it in the global list - and the global list can drive what's in the mirror15:45
bcwaldonmtaylor: but I don't buy doing it here15:45
mtaylorbcwaldon: awesome. let em re-approach it with similar mechanics but a different repo15:45
mtaylorbcwaldon: I think that's a good feedback15:46
bcwaldonokie15:46
mtaylorbcwaldon: it also potentially solves one of the weirdnesses I had in there a little better15:46
mtaylorbcwaldon: see, I like it when you review things15:46
bcwaldonmtaylor: everybody does15:47
mtaylorbcwaldon: well, not jaypipes - but that's because he's evil15:47
bcwaldonmtaylor: or anybody working on the bittorrent stuff :)15:47
jaypipeslol15:47
Leander_sdague: nothing is happing and i can't see any place to add a comment15:48
mtaylorbcwaldon: anywhoo -- if you ninja approve those client lib changes, there'll be less folks I have to hassle today. and thanks!15:49
*** erikzaadi has quit IRC15:49
bcwaldonmtaylor: did you push to them?15:49
mtaylorbcwaldon: no?15:50
bcwaldonmtaylor: why would I ninja approve them!15:50
bcwaldonmtaylor: we talked about this!15:50
mtaylorbcwaldon: oh! you want me to add that function before you land them?15:50
bcwaldonmtaylor: were you not going to do the read_versioninfo thing15:50
bcwaldonmtaylor: I thought thats what we agreed on15:50
bcwaldonmtaylor: at least thats what *I* agreed to15:50
mtaylorI was going to follow up with that - since I'll need to land that in openstack-common first15:51
mtaylorbut I can do it now if needed15:51
bcwaldonmtaylor: ok15:51
bcwaldonmtaylor: done15:51
bcwaldonwell15:51
bcwaldonnot done done15:51
bcwaldonmtaylor: why is versioninfo within glanceclient/ ?15:51
bcwaldonmtaylor: I also want to be able to call 'import glanceclient; glanceclient.__version__'15:52
mtaylorso that it gets installed as part of the package_data and is accessible via pkg_resources15:52
bcwaldonmtaylor: is my request doable ^15:52
mtaylorbcwaldon: it is, although not currently implemented because it wasn't there before15:52
bcwaldonokay15:52
bcwaldonwrite that down15:52
mtaylorthat's actually one of the reasons for the versioninfo in glanceclient - is so that we can support that properly15:53
mtaylorbcwaldon: written down15:53
bcwaldonyes, when I ask questions, i sometimes already have a partial answer :)15:53
bcwaldonthat being one of them15:53
*** dhellmann has quit IRC15:53
*** markmcclain has quit IRC15:53
mtaylortricky tricky15:53
bcwaldonmtaylor: and its not 100% clear what these versions look like15:53
mtaylorI believe that's known as leading the witness15:53
bcwaldonmtaylor: X.Y.Z?15:53
mtaylordepends on the latest tag15:54
sdagueLeander_: go here - https://review.openstack.org/#/c/8839/ and either type the letter r on the page, or look for the review button on your last patch15:54
sdagueeither should take you to the review interface15:54
sdaguemake sure you are signed in15:54
mtaylorbcwaldon: if the latest tag is X.Y, then the version will be X.Y.Z - if the latest tag is X.Y.Z, it'll be X.Y.Z.A15:54
bcwaldonmtaylor: and where do the trailing bits come from?15:55
mtaylorbcwaldon: technically from git describe --tags ... but the trailing bits is number of revisions since the last tag15:55
Leander_sdague: there is no review button for me :/15:55
Leander_also the help does not list the 'r' command15:56
*** jgriffith_ has joined #openstack-dev15:56
mtaylorwe won't be publishing/uploading those to pypi, so they're less important - but we will be shoving tarballs on tarballs.o.o - so we want them to at least be version comparable15:56
bcwaldontarball owls?15:56
bcwaldontarballs. o.O15:56
sdagueLeander_: are you logged in?15:56
mtaylorbcwaldon: damn straight15:57
* mtaylor reminds self - needs to set up tarballs.o.o15:57
mtaylorLinuxJedi: ^^ remember that for me15:57
Leander_sdague: apparently not, i feel stupid right now -.-15:57
LinuxJedimtaylor: noted15:57
*** littleidea has joined #openstack-dev15:58
bcwaldonmtaylor: :(15:59
bcwaldonmtaylor: https://review.openstack.org/#/c/8427/15:59
bcwaldonmtaylor: sorry broski15:59
apevecmtaylor, LinuxJedi - where is the code adding comments in launchpad bugs like "OpenStack Hudson (hudson-openstack) wrote on 2012-06-08: Fix merged to keystone (master)" ?15:59
apevecdoes it trigger on simply any "bug xxxxxx" ?16:00
*** e1mer has quit IRC16:00
mtaylorLinuxJedi: http://dom.as/2012/06/26/memsql-rage/16:01
LinuxJediapevec: it is in the openstack-ci-puppet repo in /modules/gerrit/files16:01
*** dubsquared has joined #openstack-dev16:01
LinuxJediapevec: it does a regex match16:01
mtaylorbcwaldon: sad bunny rabbit - but yes16:01
LinuxJedimtaylor: I saw that :)16:01
*** littleidea has quit IRC16:01
*** littleidea has joined #openstack-dev16:01
apevecLinuxJedi, ah thanks, I was looking at github.com/openstack-ci/gerrit16:02
*** adalbas has quit IRC16:02
LinuxJedimtaylor: I have days where I think about writing an RDBMS from scratch but I've usually shaken off that idea within minutes ;)16:02
*** japage is now known as japage_afk16:02
LinuxJediapevec: ah yea, that is a dead repo now16:02
LinuxJediapevec: I think the one you are looking for is scripts/update_bug.py16:03
*** mnaser has quit IRC16:03
*** sdake has quit IRC16:04
bcwaldonmtaylor: ping me when you push16:04
bcwaldonmtaylor: I also can't seem to hit jenkins.openstack.org16:04
smoseranyone see this : http://paste.openstack.org/show/18842/16:04
LinuxJedimtaylor: and I'm very glad we didn't benchmark Drizzle against anything :)16:04
mtaylorbcwaldon: novaclient updated16:05
bcwaldonsmoser: what version of pep816:05
mtaylorbcwaldon: new patch with cleanup posted here: https://review.openstack.org/900316:05
smoserpep8    1.2-116:05
smoseri guess venv is 1.116:06
bcwaldonsmoser: I'm out of ideas16:06
*** spiffxp has joined #openstack-dev16:06
*** armaan has joined #openstack-dev16:06
*** sdake has joined #openstack-dev16:06
smoserwell, your idea was right. i think my pep8 is newer than expected.16:07
mtaylorsmoser: perhaps pep8 changed an api as of 1.2?16:07
bcwaldonsmoser: given the history of pep8's releases, there was a high probability they broke something16:07
* mtaylor is NOT a fan of the pep8 extension mechanism16:07
mtayloras in16:07
Daviey1.1 and 1.2 is VERY different16:07
* mtaylor thinks is a broken pile of monkey turds16:07
mtaylorDaviey: AWESOME16:07
bcwaldonthere's a reason I set a specific pep8 dep on our projects :)16:07
bcwaldonI think we've had 3 days now where we have to put out pep8 fires16:08
bcwaldonNO MORE, I TELL YOU16:08
mtaylorwell, I'm glad I haven't implemented that gate-on-hacking.py request yet16:08
*** rnirmal has quit IRC16:08
bcwaldonmtaylor, LinuxJedi: 502 from jenkins.openstack.org?16:08
LinuxJedibcwaldon: looking...16:09
LinuxJedior I would... not loading at all for me16:09
bcwaldonLinuxJedi: http://stsh.me/2Nx after timing out16:09
bcwaldonLinuxJedi: it takes a while16:09
LinuxJedibcwaldon: ah that would be the Apache proxy timing out connecting to Jenkins...16:10
LinuxJedimtaylor: restart? ^16:10
*** datsun180b_ has joined #openstack-dev16:10
mtaylorLinuxJedi: sure?16:10
smoserwell, to be fair to pep8... that tools/hacking.py program is calling '_main'. they did put a '_' in it.16:10
LinuxJedion it...16:10
mtaylorsmoser: well, but that's how pep8 suggests one extend it16:11
Leander_well, thanks for help!! see you guys tomorrow16:11
smosertouche!16:11
mtaylorsmoser: rather than, say, I dunno. using plugins or some sort16:11
*** openstackjenkins has quit IRC16:11
*** Leander_ has left #openstack-dev16:11
smoserwell, silly me thought the '_' meant "don't use this"16:11
bcwaldonsmoser: it does16:11
bcwaldonsmoser: its python's pseudo-private method syntax16:11
bcwaldonsmoser: s/syntax/convention/16:12
*** openstackjenkins has joined #openstack-dev16:12
smoserright. but apparently not if you are pep8, per mtaylor16:12
bcwaldonsmoser: pep8 does whatever the hell they want16:12
smoserthat is so awesomely ironic.16:12
bcwaldonsmoser: unfortunately, yes16:12
mtaylorbcwaldon: why would you write quality code if you're the code quality tool???16:12
* mtaylor hits bcwaldon with clue bat16:12
bcwaldonmtaylor: DOES NOT COMPUTE16:12
*** datsun180b has quit IRC16:13
*** datsun180b_ is now known as datsun180b16:13
LinuxJedibcwaldon: Jenkins should be good now (if a little slow at the moment)16:13
bcwaldonLinuxJedi: ok, thank you16:13
*** dubsquared has quit IRC16:14
*** Mandell has joined #openstack-dev16:16
*** sleepsonzzz is now known as sleepsonthefloor16:16
*** kindaopsdevy has joined #openstack-dev16:18
*** adalbas has joined #openstack-dev16:18
*** Mandell has quit IRC16:19
*** sandywalsh_ has quit IRC16:19
*** armaan has left #openstack-dev16:20
*** sandywalsh has joined #openstack-dev16:21
*** mnaser has joined #openstack-dev16:22
*** epim has joined #openstack-dev16:25
*** mnewby has quit IRC16:27
*** rnirmal has joined #openstack-dev16:29
*** kindaopsdevy has quit IRC16:31
*** mnewby has joined #openstack-dev16:31
*** kindaopsdevy has joined #openstack-dev16:31
*** datsun180b has quit IRC16:31
*** mnewby has quit IRC16:32
*** datsun180b has joined #openstack-dev16:32
*** fc__ has quit IRC16:33
*** mnewby has joined #openstack-dev16:33
*** thingee has joined #openstack-dev16:34
*** danpb has quit IRC16:35
*** issackelly has joined #openstack-dev16:36
bcwaldoneglynn: do you have time to do some reviews?16:44
eglynnbcwaldon: sure!16:45
bcwaldoneglynn: https://review.openstack.org/#/c/8989/16:45
bcwaldoneglynn: https://review.openstack.org/#/c/8992/16:45
* eglynn looking ...16:45
bcwaldoneglynn: I'm asking you since I know you're interested in the db cleanup stuff16:45
eglynncool16:45
*** ayoung has joined #openstack-dev16:47
*** mgz has quit IRC16:48
*** anderstj has joined #openstack-dev16:48
*** gyee has joined #openstack-dev16:51
*** edygarcia has quit IRC16:55
andrewbogottjkoelker or dhellmann, could one of you approve 8585?  It has many +s already.16:55
*** edygarcia has joined #openstack-dev16:57
vishymaoy: ping16:59
maoyvishy: yes16:59
vishymaoy: https://bugs.launchpad.net/nova/+bug/101741816:59
uvirtbotLaunchpad bug 1017418 in nova "NoMoreFloatingIps: Zero floating ips available after repeatedly creating and destroying instances over time" [High,Confirmed]16:59
*** andrewsben_is_a_ is now known as andrewsben16:59
vishymaoy: so we have a race condition on ip allocation if an instance is destroyed before the spawn is finished. Just wanted to get your thoughts on how to handle it17:00
vishymaoy: I think what is happening is the deallocate_for_instance is getting called before the allocate_for_instance17:00
maoyvishy: i see.17:01
maoyvishy: I will get back to you on this. running between meetings now.17:01
*** dtroyer_zzz is now known as dtroyer17:01
vishymaoy: no worries. I will think about some options too17:01
ryantvishy: I'm seeing this issue as well, but I don't think this the only scenario in which it occurs17:02
vishyryant: we need to be more careful about our deleting of instances. Perhaps by waiting to deallocate stuff until the current task has finished or something17:02
ryantvishy: what I've seen is that the DB is updated in an incomplete way17:03
*** jkelly has joined #openstack-dev17:03
ryantvishy: the floating_ips table doesn't always get updated correctly on instance termination, even when deleting long-lived instances17:04
vishyryant: I haven't seen that happen17:04
*** adalbas has quit IRC17:04
vishyryant: do you have a repro with an error message?17:04
ryantvishy: there is no error message, this happens silently until you "run out" of floating IP's17:05
*** reed has joined #openstack-dev17:05
*** sdake has quit IRC17:05
ryantvishy: basically, project_id column and the auto_assigned columns don't get update completely. FYI we're running with auto_assign_floating_ip=true17:06
vishyryant: Yes I saw the bug report on that but I can't seem to reproduce.17:07
vishyryant: is it possible you have an old deleted network in your db?17:07
*** dachary has quit IRC17:07
ryantvishy: no, we don't17:08
*** sdake has joined #openstack-dev17:08
vishyryant: darn, I was hoping maybe it was this bug: https://bugs.launchpad.net/nova/+bug/101763317:08
uvirtbotLaunchpad bug 1017633 in nova "deallocate_fixed_ip attempts to update an already deleted fixed_ip" [Medium,In progress]17:08
vishyryant: if you can get it to happen and find a traceback in the compute or network log, that would help17:08
ryantvishy: we tend to see "leaked" floating IP's on larger deployments (10+) compute nodes17:09
vishyryant: I can't see anywhere in the code where it would obviously fail.17:09
ryantvishy: me neither, the network manager code looks fine17:09
*** harlowja has joined #openstack-dev17:09
vishyryant: is it possible one of the network workers was not responding?17:09
vishyryant: So that the message to deallocate the network got lost?17:10
ryantvishy: no, we can still provision new instances through any network worker17:10
ryantvishy: no, the deallocate is incomplete17:10
ryantvishy: it makes the appropriate update the the fixed_ip_id & host columns17:11
*** torgomatic has joined #openstack-dev17:11
ryantvishy: the deallocate action fails to update the project_id & auto_assigned columns17:12
*** PotHix has joined #openstack-dev17:12
vishyryant: interesting, that should be done by the source worker that made the call...17:12
*** dhellmann has joined #openstack-dev17:13
*** markmcclain has joined #openstack-dev17:13
*** jakedahn_zz is now known as jakedahn17:13
vishyryant: and you get no traceback?17:14
vishyryant: keep in mind the traceback likely won't be on the network host of the vm17:14
ryantvishy: no traceback, just an incomplete mod of the floating_ips table17:14
vishyryant: since deallocate is not rpcd to another host17:14
*** zigo-_- has joined #openstack-dev17:15
vishyryant: so it will likely be on another network worker17:15
*** mnaser has quit IRC17:15
*** zigo has quit IRC17:15
ryantvishy: good to know, but I have been able to reproduce sporadically with a single compute node and network worker17:16
ryant:vishy: no tracebacks17:16
vishyryant: and still no traceback huh?17:16
vishyryant that is very odd17:16
*** dubsquared has joined #openstack-dev17:16
ryantvishy: I suspect DB performance17:17
bcwaldoneglynn: this one, too! https://review.openstack.org/#/c/8978/17:17
eglynnbcwaldon: got it ...17:17
bcwaldoneglynn: actually, I'll probably need to rebase it17:17
eglynnk17:17
bcwaldoneglynn: but a +2 wouldnt hurt17:17
*** mnaser has joined #openstack-dev17:17
ryantvishy: not sure how all this works, but it appears that the updates to floating_ips table are run as separate transactions in the DB, perhaps the mods we need are being rolled back in our deplyoment?17:18
vishyThey are separate commands17:18
vishyryant: but it is very odd that the second wouldn't be running without traceback17:19
*** s0mik has joined #openstack-dev17:19
ayoungheckj, I won't be able to be at today's meeting,  but here is my status https://gist.github.com/299721217:20
*** dubsquared has quit IRC17:20
*** adalbas has joined #openstack-dev17:20
ryantvishy: another tidbit, we have been seeing serious DB performance issues ie in a 12 node deployment we are running out of DB connections frequently17:21
vishyryant: how many connections are you allowing?17:21
heckjayoung: thanks17:21
ryantvishy: 100, we may up that number17:22
*** Slower has quit IRC17:22
*** rafaduran has joined #openstack-dev17:23
vishyryant: yeah you will need a lot more than that17:24
*** dubsquared has joined #openstack-dev17:24
vishyevery worker has a connection pool of 517:24
*** GheRivero has quit IRC17:24
ryantvishy: ah, that's good to know17:25
vishy12 * 3 (compute, network, metadata) * 5 = 180 connections potentially17:25
ryantvishy: + keystone + glance17:25
vishyryant: right :)17:25
ryantvishy: I think there may still be an issue since I can sporadically reproduce with a single compute node, but it seems more pronounced at scale17:26
vishyryant: If you can find me a traceback on one node that would be amazing17:27
vishyor at least a repro + a bunch of logs17:27
*** Slower has joined #openstack-dev17:27
ryantvishy: I'll go scour my logs to see what I can find, but I'm pretty sure I was tailing my logs in real-time and saw no tracebacks.  I'll spend some more time on this today17:28
vishyryant: cool, thanks17:28
ryantvishy: thanks for the help17:29
*** garyk has quit IRC17:29
vishyryant: no problem17:33
*** dachary has joined #openstack-dev17:37
bcwaldonmtaylor:17:38
bcwaldonmtaylor: we have a problem17:38
bcwaldonmtaylor: https://jenkins.openstack.org/job/gate-integration-tests-devstack-vm/6225/consoleFull17:38
bcwaldonmtaylor: please to the fix17:38
mtaylorbcwaldon: ephemeral17:42
bcwaldonmtaylor: you're ephemeral17:42
*** vanchester has joined #openstack-dev17:43
mtaylorbcwaldon: and we're (slowly) marching towards eliminating that ... it's sadly trickier than we'd like17:43
bcwaldonmtaylor: can you splain what happened17:43
mtaylorbcwaldon: so, what happened is that this require is listed in setup_requires17:44
mtaylorwhich means our mirror doesn't see it, since it does pip downloads, which grab most of the things17:44
mtaylorso this is getting attempted installed by distutils17:44
*** vanchester has left #openstack-dev17:44
mtaylorwhich doesn't use our mirror17:44
bcwaldonokie dokie17:44
mtaylorwhich means it's vulnerable to network suck17:44
mtaylorbcwaldon: BUT - I have ideas...17:44
mtaylorbcwaldon: actually, I have GREAT idea17:45
reedthere is a request to join the cla team from the NTT team ... https://launchpad.net/~openstack-cla/+editproposedmembers17:45
reedi'm writing to them now explaining that we don't allow team membership to that team, only individuals. Correct?17:46
*** japage_afk is now known as japage17:47
*** s0mik has quit IRC17:47
*** adjohn has joined #openstack-dev17:49
*** timjr has joined #openstack-dev17:52
*** garyk has joined #openstack-dev17:56
vishymtaylor: thoughts? https://jenkins.openstack.org/job/gate-integration-tests-devstack-vm/6215/consoleFull17:58
vishymtaylor: do we not have python-glanceclient in our pypi cache?17:58
vishyjeblair, LinuxJedi: ^^18:02
LinuxJedivishy: that appears to be a missing file in python-glanceclient to me (unless I'm missing something)18:04
bcwaldonLinuxJedi: mtaylor18:05
bcwaldonLinuxJedi: he did it18:06
bcwaldonLinuxJedi: and he just explained why this problem will go away18:06
bcwaldonbut it hasnt yet18:06
* LinuxJedi takes mtaylor's keyboard away from him :)18:06
*** ryant has quit IRC18:07
*** dprince has quit IRC18:07
dtroyermtaylor, LinuxJedi , bcwaldon: we can also address that by movie the glance client install ahead of the horizon install, where it arguably should be anyway...18:11
bcwaldonI'm curious how the glanceclient made it through the gate in the first place18:11
*** jaypipes has quit IRC18:15
*** apevec has quit IRC18:19
*** novas0x2a|laptop has joined #openstack-dev18:21
*** mattray has joined #openstack-dev18:23
*** mattray has quit IRC18:23
vishytr3buchet: https://review.openstack.org/#/c/8859/18:25
*** jaypipes has joined #openstack-dev18:25
maoyvishy: which bug is it again? sorry i lost the link..18:30
*** jaypipes has quit IRC18:30
vishymaoy: https://bugs.launchpad.net/nova/+bug/101741818:31
uvirtbotLaunchpad bug 1017418 in nova "NoMoreFloatingIps: Zero floating ips available after repeatedly creating and destroying instances over time" [High,Confirmed]18:31
vishymaoy: I'm going to lunch. Let me know if you have any thoughts18:31
maoyvishy: sure.18:31
*** jaypipes has joined #openstack-dev18:33
tr3buchetvishy: on it18:33
*** mnaser has quit IRC18:34
*** mnaser has joined #openstack-dev18:36
vishycomstud: https://review.openstack.org/#/c/8980/ posted some thoughts on how we might do it with a memoization approach18:36
vishycomstud: might actually be a bit nicer18:36
*** ryan3 has joined #openstack-dev18:39
*** jaypipes has quit IRC18:40
*** dachary has quit IRC18:40
vishycomstud: Only drawback i see is that we would need to redo search_opts and limiting in the extensions to make sure that the call is the same as the one we memoized earlier and that seems fragile18:40
vishyewindisch: ^^18:40
*** dachary has joined #openstack-dev18:40
ewindischvishy: ?18:41
vishyewindisch: the memoization strategy i posted on the review above18:42
ewindischlooking18:42
maoyvishy: during disassociate_floating_ip, shouldn't we ignore FloatingIpNotAssociated exception to make it idempotent?18:42
*** mnaser has quit IRC18:42
*** mnaser has joined #openstack-dev18:44
mtaylorbcwaldon: hrm. that's a different problem than the one I told you about before18:44
*** ryan3 has quit IRC18:44
ewindischvishy: Unless we offload the caching into something like memcache, keeping the cache in the request is a good idea, because it gets collected frequently.  We then eliminate a lot of complexity around expiry, etc.18:44
mtaylorbcwaldon: and I agree with you - I don't understand how glanceclient made it through the gate if that error exists...18:44
vishyewindisch: i suppose but putting a wrapper for db calls into the request object seems strange to me18:44
*** jaypipes has joined #openstack-dev18:45
ewindischbut having it in the request works fine for webob, but not everywhere...18:45
vishymaoy: well we could but I don't know if that really fixes the issue18:45
maoyvishy: at least that's how delete instance is handled right now -- ignore instances that are there.18:45
maoyvishy: of course.18:45
vishymaoy: the exception does stop the disassociation so that may help18:46
mtaylorheckj, dtroyer, bcwaldon: investigating18:46
vishymaoy: i still think we may have out of order problems though18:46
*** ryan3 has joined #openstack-dev18:46
ewindischvishy: it is strange. I don't really like it either.18:46
heckjmtaylor: thxusir!18:46
*** johnpostlethwait has joined #openstack-dev18:47
vishymaoy: i mean it would allow us to disassociate and deallocate, but the later associate / allocate will still leave things broken18:47
maoyvishy: in the design i have, a task may be preempted. it knows that by checking the current task_id to see if it matches. if it doesn't, then it will just stop executing (similar as being killed)18:47
maoyvishy: but i'd like to reproduce that bug in my environment first to understand it better.18:47
*** mnaser has quit IRC18:48
mtaylorSOD IT18:49
mtaylorGAH!!!!!!!!!!!!!18:49
mtaylorstab stab stab stab stab18:49
maoyvishy: this change would need a modification to the db models. so i haven't gone that far yet.18:49
mtaylorbcwaldon: just so you know, I hate everyone in the universe18:49
* mtaylor will rant about the specific set of circumstances which caused this later ... goes about fixing18:50
*** ryan3 has quit IRC18:50
mtaylordtroyer: also, moving python glanceclient install before horizon will also fix this bit18:50
mtaylordtroyer: and honestly is probably more correct anyway18:50
mtaylorbut this is ALSO a bug18:51
*** mnaser has joined #openstack-dev18:51
dtroyermtaylor: https://review.openstack.org/9018 when you're ready for it18:52
mtaylordtroyer: awesome18:52
*** ryan3 has joined #openstack-dev18:52
*** ryan3 has left #openstack-dev18:54
andrewbogottjkoelker or dhellmann, could one of you please merge 8585?  Each of you gave it a +2 but neither of you clicked the 'approve' button :(18:56
comstudvishy: replied without seeing this here..18:57
*** ryant has joined #openstack-dev18:57
comstudvishy: but yeah, that's my concern... with memoization, things are actually less efficient.18:58
dhellmannoops, sorry, andrewbogott18:58
dhellmannandrewbogott: approved18:59
andrewbogottThanks!18:59
comstudvishy: If you do the same instance_get_all() a 2nd time... you have to loop thru all of the results of the 2nd query... store them in a lookup table... so that you can loop thru the original list of servers and pluck the data out you need from the 2nd query18:59
* andrewbogott is unblocked at last! For a few minutes at least.18:59
comstudvishy: My patch results in a single loop through the servers... as you already have the lookup table.19:00
*** datsun180b has quit IRC19:01
mtaylorbcwaldon, dtroyer, heckj: https://review.openstack.org/902019:01
comstudvishy: memoization would still be an improvement...but this is better.  The most efficient alternative to this is true caching in the DB layer... which is somewhat the same thing19:01
mtaylorI'll get that applied to openstack-common and to the other libs in a few19:01
*** datsun180b has joined #openstack-dev19:03
heckjmtaylor: +1d https://review.openstack.org/#/c/9020/19:03
mtaylorheckj: awesome. I just re-uploaded. (/me learns to test BEFORE uploading)19:06
*** adalbas has quit IRC19:06
*** lloydde has joined #openstack-dev19:07
*** mnaser has quit IRC19:15
*** mnaser has joined #openstack-dev19:17
*** issackelly has quit IRC19:22
*** gyee has quit IRC19:24
*** s0mik has joined #openstack-dev19:24
*** iccha has joined #openstack-dev19:24
mtaylordtroyer: yeah - that patch of yours is going to need to go in before anything else19:25
maoyvishy: do you know the status of this bp: https://blueprints.launchpad.net/nova/+spec/delete-in-any-state19:26
dtroyermtaylor: I pinged bcwaldon and sleepsonthefloor about it, they may be at lunch… is jeblair around?19:28
*** rafaduran has quit IRC19:28
*** issackelly has joined #openstack-dev19:28
mtaylordtroyer: he's not, he's at a conference19:29
notmynamemtaylor: I've got something for you (when you are done with your meeting)19:29
mtaylordtroyer: I think we should ninja approve it - it's kind of a showstopper at the moment19:29
dtroyermtaylor: done19:30
mtaylordtroyer: awesome.19:30
* mtaylor sits and waits19:30
mtaylornotmyname: sup?19:30
ayoungdolphm, or termie can you add additional weight to https://review.openstack.org/#/c/8932/ ?  This is the start of a long slog...19:31
notmynamemtaylor: soemthing I asked you about a couple of weeks ago: my LP login is @racklabs (but my racklabs email has been completely removed from LP). doesn't really cause me any issues, unless something using the LP SSO grabs that email19:31
mtaylornotmyname: thanks for the reminder. I shall ping people...19:32
notmynamemtaylor: so if it's a non-issue, I'm fine. it hasn't caused me any issues yet. but it seems like it /should/ be changed...19:32
mtaylornotmyname: I think it should - it's not an issue for any of our systems either - whereas doing a new account then a merge (which is the consumer method of fixing this) will bork your account until we file a ticket to have them fix it in their db (don't even get me started)19:33
mtaylorso lemme see if there's behind the scenes magic that can be done19:33
notmynamemtaylor: cool19:33
notmynamemtaylor: thanks19:33
mtaylornotmyname: sure thing!19:35
*** littleidea has quit IRC19:36
*** iryoung has quit IRC19:36
*** mnaser has quit IRC19:39
Shrewsi don't suppose any Mac users here runs devstack in a Parallels VM, do they?19:41
Shrewsjaypipes: ^^^^  i know you at least used to be a mac guy at one point...19:41
jaypipesShrews: nope. not me.19:41
Shrewsdamn. can't get it to launch instances19:42
*** mnaser has joined #openstack-dev19:43
*** lloydde has quit IRC19:44
*** danwent has quit IRC19:48
*** johnpostlethwait has quit IRC19:48
maoyvishy: i wonder if you've seen this before: http://paste.openstack.org/show/18852/19:49
*** danwent has joined #openstack-dev19:49
*** alaski has quit IRC19:51
*** krtaylor has quit IRC19:54
*** alaski has joined #openstack-dev19:54
*** sdake has quit IRC19:54
*** Shrews has quit IRC19:57
*** sdake has joined #openstack-dev19:57
*** Shrews has joined #openstack-dev19:59
*** iccha1 has joined #openstack-dev20:00
*** s0mik has quit IRC20:01
*** iccha has quit IRC20:03
sdaguehmmm... so is someone working to fix glance in the devstack gate?20:04
*** zigo-_- has quit IRC20:07
maoysgague: i'm not sure but jenkins is passing jobs this morning20:07
vishytr3buchet: wow we have a big issue with ip deallocation20:08
vishytr3buchet: got a sec?20:08
vishymaoy: haven't seen that one but i guess it doesn't work with secondary ips properly20:09
*** adalbas has joined #openstack-dev20:09
*** jkelly has quit IRC20:10
*** markmcclain has quit IRC20:10
maoyvishy: is there a job to periodically recycle floating IPs with missing instances?20:10
*** rods has quit IRC20:11
*** dhellmann has quit IRC20:11
*** rods has joined #openstack-dev20:11
maoyvishy: i'm also way behind quantum/melange progress. will floating IPs still be managed by Nova by the end of Folsom?20:11
sdaguemaoy: it's not now. Looks like this change is needed to fix, but it got stomped by jenkins for other reasons - https://review.openstack.org/#/c/9018/20:11
vishymaoy: fixed20:12
*** wiliam has quit IRC20:12
vishymaoy: not floating20:12
sdaguedtroyer: maybe you want to reflush that change20:12
*** markmcclain has joined #openstack-dev20:12
vishymaoy: although I just discovered that the fixed is broken20:12
*** dhellmann has joined #openstack-dev20:13
maoyvishy: that link is for glance client, not fixed ip related..20:15
*** timello has quit IRC20:16
*** adalbas has quit IRC20:21
*** anderstj has quit IRC20:23
maoyvishy: to "hard" delete a VM is easier since it's local resource and will never to reused. IP addresses are different. We can force to mark a floating IP as disassociated in the db, but without the confirmation of nova-network, it's unclear if it's safe to reuse the floating IP on another nova-network instance. so periodically recycle garbage is probably a better idea for IPs?20:24
vishymaoy: sure but how should this recycle occur?20:25
vishymaoy: assuming network and compute don't know anything about each other20:26
maoyvishy: can n-net query a list of floating IPs that it is responsible for but has missing instances?20:27
*** mnaser has quit IRC20:27
maoyvishy: same for fixed ips..20:27
vishymaoy: it isn't supposed to know anything about instances20:29
vishymaoy: so it "can" but it shouldn't20:29
maoyvishy: does n-cpu know about those IPs?20:30
*** mnaser has joined #openstack-dev20:30
*** sandywalsh has quit IRC20:31
*** japage has quit IRC20:32
*** iccha1 has left #openstack-dev20:32
*** timjr has quit IRC20:33
*** timjr has joined #openstack-dev20:33
*** jog0 has joined #openstack-dev20:35
*** timjr_ has joined #openstack-dev20:37
vishytr3buchet: https://review.openstack.org/902620:38
*** timjr has quit IRC20:38
*** timjr_ is now known as timjr20:38
tr3buchetvishy: thx20:38
*** littleidea has joined #openstack-dev20:39
*** dolphm has quit IRC20:41
*** krtaylor has joined #openstack-dev20:46
vishytr3buchet: do you know anyone that is using nova-ipam with quantum to make sure that this doesn't break them?20:47
vishymaoy: it tells network to deallocate the network20:47
vishymaoy: which cleans up all ips for the instance20:48
Davieyvishy: did you see my question in #openstack?20:48
vishyDaviey: I did and i attempted to answer it but apparently I can't hit the return key properly20:49
Davieyheh20:49
*** nunosantos has quit IRC20:52
tr3buchetvishy: i don't...20:53
maoyvishy: is this right?  if nova-network is not reachable, or somehow misbehave, the network will not be properly deallocated, and no one will try that again (unlike an instance which will be periodically retried)20:53
*** dprince has joined #openstack-dev20:57
*** littleidea has quit IRC20:57
vishymaoy: correct21:02
*** adjohn has quit IRC21:02
vishymaoy: well it will throw an exception and the instance won't delete properly i believe21:03
*** dubsquared has quit IRC21:07
*** dhellmann has quit IRC21:07
*** littleidea has joined #openstack-dev21:07
maoyvishy: what's a more desirable behavior?21:08
comstudvishy: did you happen to see my other points above?21:08
comstud(saw your follow up to the review just now)21:08
comstudjust curious21:08
vishycomstud: yeah I mean i think we could do it if we are careful about making the same call in all places21:09
comstudya.. my point is that's actually less efficient than my patch21:09
comstudw/ extensions21:09
comstudsince if you 2 instance_get_alls21:09
comstudyou have to resolve all of the responses together21:10
vishy(we should have all the information we need to build the same exact request, but if we are going to do that anyway, we risk breaking it also)21:10
comstudit's probably a net-0 with 1 extension21:10
comstudbut is worse with 4 extensions21:10
mtaylorjkoelker: https://review.openstack.org/#/c/9021/ when you get a moment21:10
vishycomstud: I guess I don't follow exactly21:10
comstudi tried to explain above..21:10
comstudbut21:10
*** dubsquared has joined #openstack-dev21:10
comstudsay core API does 'instance_get_all'21:10
vishyeach subsequent compute_api.get_all() should return the memoized list21:11
comstudforms this list of servers for response21:11
comstudyeah, extension come around.. if you had them do get_all() again...21:11
comstudso you get the memoized list21:11
*** novas0x2a|laptop has quit IRC21:11
comstudyou now have to convert that to a dictionary/lookup table21:11
comstudso you can take the original response...21:11
comstudand add things to it efficiently.21:11
vishycomstud: ah gotcha21:11
comstudwith 3 extensions... it's really less efficient21:12
comstudthan having the lookup table up front21:12
comstudbuild it once21:12
comstudanyway.. just a minor point21:12
*** novas0x2a|laptop has joined #openstack-dev21:12
comstudsaying that real DB caching would be the better solution21:12
vishycomstud: yeah i just want it to suck less :)21:12
comstudover memoization21:12
comstudyeah :)21:12
*** steveb_ has joined #openstack-dev21:12
comstudi tend to want to make things as efficient as possible21:13
comstudit can lead to complicated code sometimes21:13
comstudin this case, it's fairly simple.. but it's specialized for API/extensions21:13
comstudWaiting for a reply from Eric on his last suggestion..21:14
vishycomstud: yeah and it is specialized to just the instance record21:14
comstudwhich is a good one, but we'd have to change the inheritence21:14
comstudand I'm not sure of the side effects there21:14
comstudhis concern that the server would not be in the cache is not a concern to me21:15
comstudif it's not in the cache.. your code would fail very quickly!21:15
comstudand you'd know you screwed up21:15
*** markvoelker has quit IRC21:15
comstudthe current tests for the extensions would fail, anyway21:16
*** alaski has quit IRC21:16
comstudanyway, cools.. if I had to implement something larger here, i'd probably have to punt it to someone else.21:17
comstudnot enough hours in a day21:17
*** mnaser has quit IRC21:18
*** gabrielhurley has joined #openstack-dev21:18
*** mnaser has joined #openstack-dev21:19
ewindischMy point was simply that  get_db_instances(self) seems to be redundant, because the caller could simply call _get_servers() instead.21:19
vishycomstud: yeah i think we go with this until someone does a better refactor21:19
ewindischit wouldn't be a big change, but would make the code more deterministic21:20
*** novas0x2a|laptop has quit IRC21:20
ewindisch(then _get_servers() could implement or call get_db_instances())21:20
*** krtaylor has quit IRC21:21
vishyewindisch: I'm moving https://blueprints.launchpad.net/nova/+spec/trusted-messaging to f-3 since it seems unlikely to be done in time for f-221:22
*** novas0x2a|laptop has joined #openstack-dev21:23
bcwaldonmtaylor: around?21:27
vishyjgriffith_, sleepsonthefloor: can you link the 8073 review to this blueprint: https://blueprints.launchpad.net/nova/+spec/extract-nova-volumes21:27
sorenCan someone help me point out which bit of code makes sure I don't update anyone else's  instances? I'm staring at the OSAPI code and I just don't see anything verifying that I have access to the server I'm trying to update.21:31
*** maoy has quit IRC21:31
jgriffith_vishy: Yes... and I'm hoping to have that ready for review tonight21:32
*** littleidea has quit IRC21:32
*** anderstj has joined #openstack-dev21:32
vishysoren: the tenant_id is in the url21:32
vishysoren: the tenant_id has to match the auth_token you pass in or you will get a 40321:33
sorenWhat if I put another tenant_id?21:33
sorenvishy: What if I put a tenant_id that matches my auth_token, but not the instance?21:33
vishysoren: good question. in theory the require_project_context in the db should take care of that as well as the policy admin_or_owner check21:34
comstudewindisch: ya.. i agree.. but see comment about how they're different classes right now21:34
*** salgado is now known as salgado-afk21:34
*** dachary has quit IRC21:34
*** dachary has joined #openstack-dev21:35
*** littleidea has joined #openstack-dev21:36
comstudewindisch: and I dunno..if someone messes up in the meantime, it'll be immediately clear when the extension fails on first query... that and the extension tests would fail21:36
sorenvishy: Hm... Ok, thanks. Those are probably the hints I needed.21:36
vishysoren: ideally it is done in wrap_check_policy21:37
vishysoren: but there is still the backup in the db call (which I'd like to remove)21:37
*** segfault923 has quit IRC21:37
steveb_hey, any chance I could get some merge love on this? https://review.openstack.org/#/c/8790/21:40
*** jog0_ has joined #openstack-dev21:41
*** jog0 has quit IRC21:42
*** jog0_ is now known as jog021:42
sorenvishy: Yes, thanks. That helped.21:43
*** johnpostlethwait has joined #openstack-dev21:44
vishysoren: cool21:44
*** dubsquared has quit IRC21:47
*** jog0 has quit IRC21:49
*** andrewbogott has quit IRC21:50
*** ywu has joined #openstack-dev21:54
ewindischvishy: that is fine. I haven't even /started/ that yet.21:57
*** adjohn has joined #openstack-dev21:59
*** markmcclain has quit IRC21:59
ryantvishy: I have a traceback for you22:01
*** ayoung has quit IRC22:03
*** rods has quit IRC22:04
heckjdolphm: looks like https://review.openstack.org/#/c/6875/ needs a rebase22:05
*** andrewbogott has joined #openstack-dev22:05
*** andrewbogott has joined #openstack-dev22:05
*** adjohn has quit IRC22:06
*** datsun180b has quit IRC22:10
*** asalkeld has joined #openstack-dev22:12
*** Dr_Who has quit IRC22:14
*** rods has joined #openstack-dev22:18
*** kbringard has quit IRC22:21
*** littleidea has quit IRC22:23
vishyryant: give it to me!22:25
*** dtroyer is now known as dtroyer_zzz22:26
ryantvishy: how do you wan it?22:26
vishypastie it is fine22:26
ryanthttps://bugs.launchpad.net/nova/+bug/101741822:26
uvirtbotLaunchpad bug 1017418 in nova "NoMoreFloatingIps: Zero floating ips available after repeatedly creating and destroying instances over time" [High,Confirmed]22:26
ryantI posted the info on launchpad22:27
*** andrewsmedina has quit IRC22:27
mtaylorbcwaldon: sup?22:28
*** sieutruc has quit IRC22:29
*** Ryan_Lane1 has quit IRC22:29
bcwaldonmtaylor: I dont remember22:30
*** asalkeld has left #openstack-dev22:31
mtaylorjaypipes: give a brother a hand? https://review.openstack.org/#/c/9021/22:32
bcwaldonmtaylor: whats the status of the gate?22:32
mtaylorbcwaldon: dtroyer's patch should have fixed it22:32
bcwaldonmtaylor: thats why I'm asking22:33
bcwaldonmtaylor: so whats the status22:33
*** adjohn has joined #openstack-dev22:33
mtaylorbcwaldon: well, his patch merged, so I'd say it's fixed22:33
bcwaldonok22:33
bcwaldonapprove all the things!22:33
mtaylorbcwaldon: I'm trying to!22:33
mtaylorbcwaldon: but they want me to ask other peoples :22:33
bcwaldonmtaylor: I'll hit some stuff22:33
mtaylor:(22:33
bcwaldonmtaylor: pre-approval tests are passing22:34
mtaylorw00t!22:35
mtaylordprince: I've got a question for you on how smokestack runs some stuff...22:35
mtaylordprince: http://smokestack.openstack.org/?go=/jobs/2354922:35
vishymikal: not sure why your thing insn't working22:36
vishyhave you tried running the command then reloading the table?22:36
mtaylordprince: I added a depend into test-requires in that patch that affects the running of setup.py22:36
mtaylordprince: which works in the venv/tox based workflow, but not in smokestack, so I wanted to understand what's different so I can take it in to account (the smokestack failure here probably means I didn't account properly for a legit workflow)22:37
*** lloydde has joined #openstack-dev22:37
*** ewindisch has quit IRC22:38
*** e1mer has joined #openstack-dev22:39
*** negronjl has quit IRC22:41
*** negronjl has joined #openstack-dev22:41
*** jog0 has joined #openstack-dev22:41
*** dtroyer_zzz is now known as dtroyer22:43
mikalvishy: I don't know a lot about sqlalchemy... How do I reload a table? I tried deleting and recreating the table object, is that what you mean?22:45
vishymikal: see the email. I mean just a repeat of the instances = line from the top22:46
mikalOk, I will look in a sec22:46
andrewbogottjerdfelt:  I have questions about a bit of your code in test_imagecache().  Specifically, the _intercept_log_messages bit.22:49
andrewbogottYou create a new logger and then hook that, rather than hooking the logger that's used elsewhere in the file...22:49
andrewbogottIt works!  but I don't understand why it works.22:49
andrewbogott(Probably because I don't quite understand what it means to have two different loggers with two different names.)22:51
*** ewindisch has joined #openstack-dev22:51
*** krtaylor has joined #openstack-dev22:54
mikalvishy: so yeah, that's exactly what I tried and it didn't help. However, putting the foreign key in a separate migration worked, but felt clunky.22:54
vishymikal: that is weird22:54
*** Dr_Who has joined #openstack-dev22:54
vishymikal: I guess we have to do separate migrations :(22:55
mikalvishy: ok. I _think_ that means I need three so it will work in reverse too... One to remove the old FK, one to rename the column, and then another to add the FK back. Is that going to survive review?22:55
vishymikal: yes i think so22:55
vishymikal: just put a note about why there are three22:56
mikalOk. I will work on that today then.22:56
*** andrewsmedina has joined #openstack-dev22:56
vishymikal: awesome, thanks22:56
*** dhellmann has joined #openstack-dev22:57
*** pixelbeat has quit IRC22:58
ryantvishy: I've got a theory23:05
vishyryant: good. I'm looking at how that could have happened23:05
vishyit looks like somehow it must get re-associated in between the disassocate and deallocate23:05
*** sandywalsh has joined #openstack-dev23:07
ryantvishy: disassociate_floating_ip will make an rpc cast when not on the host that has the floating IP23:08
ryantI assume the case is asynchronous23:08
ryant*cast23:08
vishyryant: wait, it isn't a call?23:09
ryantnope, it's a cast23:09
vishyryant: I have to head out, but summarize what you think and I will look at it later tonight23:09
vishyryant: well that sounds like the problem right there. sigh23:09
ryantlet's catch up tomorrow23:09
*** kindaopsdevy has quit IRC23:10
ryantvishy: I think there's a race condition, but it's not related to how quickly you terminate an instance after requesting it23:11
*** rnirmal has quit IRC23:13
*** heckj has quit IRC23:13
*** lloydde has quit IRC23:17
*** Dr_Who has quit IRC23:18
*** rods has quit IRC23:21
*** markmcclain has joined #openstack-dev23:22
*** sleepsonthefloor is now known as sleepsonzzz23:22
*** edygarcia has quit IRC23:24
*** edygarcia has joined #openstack-dev23:25
*** lloydde has joined #openstack-dev23:25
*** edygarcia has quit IRC23:29
*** salv-orlando has quit IRC23:33
*** issackelly has quit IRC23:34
*** littleidea has joined #openstack-dev23:35
*** mnaser has quit IRC23:36
*** lloydde has quit IRC23:38
*** anderstj has quit IRC23:38
*** mnaser has joined #openstack-dev23:39
*** agonella has joined #openstack-dev23:42
*** dachary has quit IRC23:43
*** dachary has joined #openstack-dev23:44
*** blamar has joined #openstack-dev23:47
*** kindaopsdevy has joined #openstack-dev23:48
*** epim has quit IRC23:48
*** ayoung has joined #openstack-dev23:48
*** ryant has quit IRC23:50
*** Aaton is now known as Aaton_off23:54
*** rkukura has quit IRC23:55
*** rkukura has joined #openstack-dev23:55
*** kindaopsdevy has quit IRC23:56
*** jakedahn is now known as jakedahn_zz23:57
*** ywu has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!