| *** pharkmillups has quit IRC | 00:01 | |
| *** silassewell has joined #openstack | 00:09 | |
| *** _anm has joined #openstack | 00:16 | |
| *** rnirmal has joined #openstack | 00:34 | |
| *** dendro-afk is now known as dendrobates | 00:36 | |
| *** joearnold has quit IRC | 00:38 | |
| *** jc_smith has quit IRC | 00:42 | |
| *** joearnold has joined #openstack | 00:44 | |
| *** sophiap has quit IRC | 00:53 | |
| *** miclorb has quit IRC | 00:59 | |
| *** Cybodog has joined #openstack | 01:02 | |
| *** rnirmal has quit IRC | 01:05 | |
| *** littleidea has quit IRC | 01:08 | |
| *** sophiap has joined #openstack | 01:09 | |
| *** sophiap_ has joined #openstack | 01:11 | |
| *** sophiap has quit IRC | 01:11 | |
| *** sophiap_ is now known as sophiap | 01:11 | |
| *** maplebed has quit IRC | 01:14 | |
| *** ooooPsss has quit IRC | 01:15 | |
| *** jessec has joined #openstack | 01:23 | |
| *** sophiap has quit IRC | 01:29 | |
| *** miclorb_ has joined #openstack | 01:32 | |
| *** hisaki has joined #openstack | 01:39 | |
| *** anm` has joined #openstack | 01:40 | |
| *** _anm has quit IRC | 01:41 | |
| *** anm` is now known as _anm | 01:41 | |
| *** hisaki has quit IRC | 01:44 | |
| *** Pentheus has quit IRC | 01:50 | |
| *** miclorb_ has quit IRC | 01:51 | |
| *** abecc has quit IRC | 01:54 | |
| *** miclorb has joined #openstack | 01:55 | |
| *** rnirmal has joined #openstack | 02:04 | |
| *** jessec has quit IRC | 02:07 | |
| *** sirp1 has joined #openstack | 02:30 | |
| *** Cybodog has quit IRC | 02:49 | |
| *** gundlach has quit IRC | 02:52 | |
| *** abecc has joined #openstack | 02:54 | |
| *** arcane has quit IRC | 02:59 | |
| *** arcane has joined #openstack | 03:23 | |
| *** jakedahn has joined #openstack | 03:31 | |
| *** mtaylor has joined #openstack | 03:32 | |
| *** ChanServ sets mode: +v mtaylor | 03:32 | |
| *** abecc has quit IRC | 03:37 | |
| *** sagi_ has joined #openstack | 03:44 | |
| *** kashyapc has joined #openstack | 03:46 | |
| *** Cybodog has joined #openstack | 03:53 | |
| *** kashyapc has quit IRC | 04:09 | |
| *** rnirmal has quit IRC | 04:19 | |
| *** kashyapc has joined #openstack | 04:26 | |
| *** hornbeck has quit IRC | 04:26 | |
| *** littleidea has joined #openstack | 04:35 | |
| *** jakedahn has quit IRC | 04:44 | |
| *** jakedahn has joined #openstack | 04:44 | |
| *** omidhdl has joined #openstack | 04:44 | |
| *** miclorb has quit IRC | 04:51 | |
| *** littleidea has quit IRC | 04:51 | |
| *** omidhdl has quit IRC | 04:51 | |
| *** littleidea has joined #openstack | 04:52 | |
| *** silassewell has quit IRC | 04:56 | |
| *** omidhdl has joined #openstack | 04:59 | |
| *** f4m8_ is now known as f4m8 | 05:00 | |
| *** cloud0 has joined #openstack | 05:01 | |
| *** hornbeck has joined #openstack | 05:26 | |
| *** joearnold has joined #openstack | 05:29 | |
| *** ibarrera has joined #openstack | 06:07 | |
| *** joearnold has quit IRC | 06:15 | |
| *** _anm has quit IRC | 06:19 | |
| *** allsystemsarego has joined #openstack | 06:19 | |
| *** guigui1 has joined #openstack | 06:21 | |
| *** jakedahn has quit IRC | 06:21 | |
| *** jakedahn has joined #openstack | 06:21 | |
| *** ArdRigh has joined #openstack | 06:46 | |
| *** stewart_ has joined #openstack | 06:57 | |
| *** stewart has quit IRC | 06:58 | |
| *** stewart_ is now known as stewart | 06:58 | |
| *** gaveen has joined #openstack | 07:00 | |
| *** brd_from_italy has joined #openstack | 07:01 | |
| *** whosjose has joined #openstack | 07:10 | |
| *** whosjose has left #openstack | 07:11 | |
| *** guigui1 has quit IRC | 07:36 | |
| *** anticw has quit IRC | 07:41 | |
| *** zheng_li has quit IRC | 07:51 | |
| *** gasbakid has joined #openstack | 07:57 | |
| *** guigui1 has joined #openstack | 08:05 | |
| *** zheng_li has joined #openstack | 08:15 | |
| soren | vishy, devcamcar: I asked a question on https://code.edge.launchpad.net/~devcamcar/nova/fix-iptables/+merge/36110 that hasn't been answered yet. Can you provide this feedback so that we can land this branch, please? | 08:51 |
|---|---|---|
| *** omidhdl has left #openstack | 08:56 | |
| *** omidhdl has joined #openstack | 09:14 | |
| *** littleidea has quit IRC | 09:19 | |
| *** miclorb_ has joined #openstack | 09:43 | |
| *** rsoutar has joined #openstack | 09:54 | |
| *** ptremblett has joined #openstack | 10:04 | |
| *** rsoutar_ has joined #openstack | 10:12 | |
| *** rsoutar has quit IRC | 10:14 | |
| *** rsoutar_ is now known as rsoutar | 10:14 | |
| *** ArdRigh has quit IRC | 10:19 | |
| *** rsoutar_ has joined #openstack | 10:21 | |
| *** rsoutar has quit IRC | 10:23 | |
| *** rsoutar_ is now known as rsoutar | 10:23 | |
| *** omidhdl has left #openstack | 10:28 | |
| *** ctennis has quit IRC | 10:51 | |
| chmouel | hey soren I am trying to checkout the ubuntu branch of nova but i am getting permission denied when doing a bzr branch lp:nova/ubuntu | 10:55 |
| *** ooooPsss has joined #openstack | 10:55 | |
| *** brd_from_italy has quit IRC | 10:56 | |
| chmouel | soren: nevermind was my ssh agent stucked... | 11:00 |
| *** gaveen has quit IRC | 11:00 | |
| *** ooooPsss has quit IRC | 11:01 | |
| chmouel | and from which place nova-scheduler is supposed to come ? | 11:05 |
| *** ctennis has joined #openstack | 11:07 | |
| *** guigui1 has quit IRC | 11:08 | |
| *** befreax has joined #openstack | 11:08 | |
| *** sophiap has joined #openstack | 11:11 | |
| *** brd_from_italy has joined #openstack | 11:12 | |
| *** miclor___ has joined #openstack | 11:12 | |
| *** miclorb_ has quit IRC | 11:12 | |
| *** gaveen has joined #openstack | 11:14 | |
| *** sophiap has quit IRC | 11:15 | |
| *** sophiap has joined #openstack | 11:16 | |
| chmouel | d | 11:28 |
| soren | chmouel: It's on the trunk. | 11:35 |
| chmouel | i am trying to figure out how to merge trunk in ubuntu branch (bzr noob) like a git rebase | 11:36 |
| soren | chmouel: Sorry about not posting instructions yet. I hit a bunch of blockers, fixed them, and then I got sidetracked on feature work. | 11:36 |
| soren | Don't rebase. | 11:36 |
| soren | Just grab trunk, and merge the ubuntu branch into it. | 11:36 |
| chmouel | like bzr merge lp:nova/ubuntu in trunk dir? | 11:37 |
| soren | Yup. | 11:37 |
| chmouel | soren: no worries I am trying to figure out stuff by myself and will post my notes of it somewhere... | 11:37 |
| * soren will not be joining eventlet's fan club anytime soon. | 11:38 | |
| *** gaveen has quit IRC | 11:39 | |
| chmouel | so now after bzr merge stuff bzr status show me bunch of new files modified etc... how do i get a clean branch back after I built package | 11:40 |
| chmouel | ie: git reset --hard | 11:40 |
| soren | bzr clean-tree | 11:54 |
| soren | But.. | 11:55 |
| soren | when you do a bzr merge, you need to commit the merge. | 11:55 |
| soren | I believe this is the same as in git. | 11:55 |
| soren | chmouel: Until you commit it, they'll appear as modified files (because, y'know... They are). | 11:56 |
| chmouel | ah yeah it is but I wanted something like a rebase of the commit from ubuntu branch and not having to merge a new commit... well i guess i'll workout a workflow... | 11:56 |
| chmouel | i had to do something like that btw: on setup.py to build the package: | 11:57 |
| chmouel | - 'bin/nova-api-new', | 11:57 |
| chmouel | + 'bin/nova-scheduler', | 11:57 |
| soren | Why your reluctance to commit stuff? | 11:58 |
| *** rsoutar has quit IRC | 11:58 | |
| chmouel | i am worry to screw up stuff to be honest with not masterizing the SCM | 11:58 |
| soren | This is a DVCS. You're just comitting stuff locally. You can't break anything :) | 11:58 |
| chmouel | ah ah yeah but if i want to propose the change back I may add all that ubuntu branch commit directly | 11:59 |
| soren | If you want to change stuff on the trunk, branch it and make your changes there. | 12:00 |
| chmouel | yep will get there ... | 12:01 |
| *** abien has left #openstack | 12:01 | |
| *** ctennis has quit IRC | 12:04 | |
| soren | chmouel: Hm... I actually have a branch with fixes for that setup.py stuff. | 12:04 |
| chmouel | cool will wait for it... | 12:04 |
| soren | It's identical to your patch :) | 12:05 |
| soren | Not sure why I never pushed it. | 12:06 |
| soren | Weird. | 12:06 |
| chmouel | i just installed those built packages from trunk/ubuntu branch and I am still getting a 644 perm on /etc/sudoers.d/nova_sudoers which crash sudo | 12:06 |
| soren | chmouel: Hm.. Yeah, you're right. | 12:07 |
| chmouel | soren: you got that fix in your branch as well? | 12:11 |
| soren | chmouel: Nope, working on it. | 12:12 |
| chmouel | i can help on that if you like | 12:12 |
| soren | I'm done :) | 12:13 |
| chmouel | sweet | 12:13 |
| chmouel | so well I was doing all of that so I can get the conf file samples from the packaging branch, any reason why those are not in trunk ? | 12:14 |
| soren | Not particularly, no. | 12:15 |
| chmouel | well i guess when the doc will be updated it will be easier for the one who does not know the syntax | 12:16 |
| *** brd_from_italy has quit IRC | 12:22 | |
| *** gundlach has joined #openstack | 12:29 | |
| *** sophiap has quit IRC | 12:33 | |
| *** sophiap has joined #openstack | 12:33 | |
| *** kashyapc has quit IRC | 12:45 | |
| *** Podilarius has joined #openstack | 12:50 | |
| *** klord has joined #openstack | 12:51 | |
| *** _anm has joined #openstack | 12:54 | |
| *** befreax has quit IRC | 12:57 | |
| *** sophiap has quit IRC | 13:00 | |
| *** littleidea has joined #openstack | 13:04 | |
| *** miclor___ has quit IRC | 13:06 | |
| *** abecc has joined #openstack | 13:06 | |
| *** sophiap has joined #openstack | 13:11 | |
| chmouel | soren: I am trying to generate a certificate to use with eucaools so I have created a project and user admin and I am doing a nova-manage project zipfile admin admin | 13:11 |
| chmouel | which fail because it can't find the openssl.cnf | 13:11 |
| chmouel | I can see the template from the package in /var/lib/nova/CA/openssl.cnf.tmpl do you know how would i use that for generate that zipfile? | 13:12 |
| *** guigui has joined #openstack | 13:16 | |
| *** jessec has joined #openstack | 13:18 | |
| chmouel | or everything works using the environement stuff now and no need ssl thingies? | 13:20 |
| *** devcamcar has quit IRC | 13:21 | |
| *** ChrisAM has quit IRC | 13:21 | |
| *** devcamcar has joined #openstack | 13:22 | |
| uvirtbot | New bug: #649806 in nova "AMQP concurrencty problem in API server" [Undecided,New] https://launchpad.net/bugs/649806 | 13:26 |
| uvirtbot | New bug: #649807 in nova "Redis concurrency problems in API server" [Undecided,New] https://launchpad.net/bugs/649807 | 13:26 |
| *** ChrisAM1 has joined #openstack | 13:27 | |
| *** ChrisAM1 is now known as ChrisAM | 13:28 | |
| *** vishy has quit IRC | 13:37 | |
| *** ChrisAM has quit IRC | 13:37 | |
| *** comstud has quit IRC | 13:37 | |
| *** xtoddx has quit IRC | 13:38 | |
| *** devcamcar has quit IRC | 13:38 | |
| *** anotherjesse has quit IRC | 13:39 | |
| *** jdarcy has joined #openstack | 13:39 | |
| *** vishy has joined #openstack | 13:39 | |
| *** xtoddx has joined #openstack | 13:40 | |
| *** anotherjesse has joined #openstack | 13:40 | |
| *** ppetraki has joined #openstack | 13:41 | |
| *** devcamcar has joined #openstack | 13:41 | |
| *** ChrisAM1 has joined #openstack | 13:41 | |
| soren | chmouel: Did you build packages and install them? | 13:44 |
| soren | chmouel: Or are you running from a bzr checkout directly | 13:44 |
| soren | ? | 13:44 |
| chmouel | built them and install | 13:44 |
| soren | sudo nova-manage project zipfile blah blah | 13:44 |
| chmouel | I think I have figred out on that zip file stuff, it just I was missed the sudo | 13:44 |
| soren | should do it, then. | 13:44 |
| soren | Right. | 13:44 |
| chmouel | since it could not read the /var/lib/nova/CA stuff | 13:44 |
| chmouel | but after i get a server error when trying to euca-upload-bundle -b mybucket -m file.manifest.. | 13:45 |
| *** mtaylor has quit IRC | 13:50 | |
| *** ChrisAM1 is now known as ChrisAM | 13:55 | |
| soren | gundlach: I would love your feedback on bug #649806 and bug #649807. | 13:59 |
| uvirtbot | Launchpad bug 649806 in nova "AMQP concurrencty problem in API server" [High,New] https://launchpad.net/bugs/649806 | 13:59 |
| uvirtbot | Launchpad bug 649807 in nova "Redis concurrency problems in API server" [High,New] https://launchpad.net/bugs/649807 | 13:59 |
| gundlach | soren: *just* finished reading the second one, actually | 13:59 |
| *** gasbakid has quit IRC | 14:01 | |
| soren | gundlach: I've been running some tests with those crude workarounds I suggested. It seems to work pretty well. | 14:01 |
| soren | gundlach: ...but some sort of actual pooling would be better, of course. | 14:02 |
| *** f4m8 is now known as f4m8_ | 14:02 | |
| gundlach | soren: yeah, it seems like that's what the thread safety error is saying | 14:02 |
| gundlach | soren: fyi, the redis usage in API is supposed to go away, tho vishy says he may not be able to get to it before FF | 14:04 |
| soren | gundlach: Exactly, so it needs to be addressed. | 14:04 |
| soren | Unless, of course, I decide to attack the redisectomy myself. | 14:04 |
| soren | (or someone else does) | 14:04 |
| gundlach | since this is firmly in "bug" territory, maybe we wait on this until we know whether we get redis out or not. | 14:05 |
| gundlach | if we don't, then we can replace w/ a pool. | 14:05 |
| soren | Right now, I can start and kill around 40 instances before things start to go sour. | 14:08 |
| soren | Not sure what happens then. Smells like a libvirt deadlock. | 14:10 |
| *** annegentle has joined #openstack | 14:11 | |
| *** hisaki has joined #openstack | 14:16 | |
| gundlach | soren: in case you hadn't seen: http://blog.eventlet.net/2010/03/18/safety/ | 14:16 |
| soren | gundlach: Seen it. Tried it. Failed miserably. | 14:17 |
| gundlach | mm, darn :) | 14:17 |
| soren | I mean /I/ failed miserably. | 14:18 |
| soren | Not it. | 14:18 |
| *** krish has joined #openstack | 14:18 | |
| soren | I just coulnd't really wrap my head around it just then. | 14:18 |
| *** anticw has joined #openstack | 14:19 | |
| *** ar1 has quit IRC | 14:22 | |
| *** guigui has quit IRC | 14:23 | |
| *** krish has quit IRC | 14:24 | |
| *** krish_ has joined #openstack | 14:24 | |
| *** ctennis has joined #openstack | 14:24 | |
| *** ctennis has joined #openstack | 14:24 | |
| *** krish_ is now known as krish | 14:27 | |
| *** jfluhmann_ has joined #openstack | 14:28 | |
| *** brd_from_italy has joined #openstack | 14:29 | |
| uvirtbot | New bug: #649865 in nova "uploading bundle failure" [Undecided,New] https://launchpad.net/bugs/649865 | 14:36 |
| *** rnirmal has joined #openstack | 14:37 | |
| *** pharkmillups has joined #openstack | 14:39 | |
| * soren calls it a day | 14:39 | |
| soren | Well, sort of. | 14:39 |
| soren | Until the meeting, anyways. | 14:39 |
| dendrobates | gundlach soren: after discussing the redis work with jaypipes, he asked if we could punt on it this release. | 14:43 |
| gundlach | what would punting mean | 14:43 |
| gundlach | keeping redis in Austin? | 14:43 |
| dendrobates | no not adding it back. | 14:43 |
| dendrobates | to the abstraction layer | 14:43 |
| gundlach | that works, as long as the RS API gets redis extracted. vishy had agreed to do that, but a couple days ago said he's too slammed to take care of it. | 14:43 |
| gundlach | s/extracted/replaced with db/ | 14:44 |
| dendrobates | someone needs to do it. | 14:44 |
| gundlach | right -- it will take work to get redis out, and it will take work to leave redis in, and everybody's busy... not sure what the best solution is | 14:44 |
| gundlach | what time is the meeting -- 4pm EST? maybe we can hash it out then | 14:46 |
| *** cloudmeat has joined #openstack | 14:46 | |
| dendrobates | 4pm cst | 14:48 |
| dendrobates | I will be on a plane, so jaypipes will be leading it. | 14:48 |
| *** oliver_ has quit IRC | 14:49 | |
| *** Pentheus has joined #openstack | 14:56 | |
| jaypipes | gundlach: I can remove the redis depends. | 14:58 |
| * jaypipes notes that breakfast is indeed the best meal of the day. | 14:58 | |
| gundlach | jaypipes: great -- there's a bug out for it (https://bugs.launchpad.net/bugs/649188). | 14:59 |
| uvirtbot | Launchpad bug 649188 in nova "RS API is still on Redis" [High,New] | 14:59 |
| gundlach | vishy: ^^ | 14:59 |
| jaypipes | gundlach: yep, saw it. I'll tackle it today. got one more thing with glance to push and then I'm on it. | 14:59 |
| gundlach | sweet. dendrobates: i now have no problem punting on redis -- we don't have to discuss at 4pm mtg | 15:00 |
| jaypipes | gundlach: yeah, we still do. there's still the fakeldap driver dependency on redis... | 15:01 |
| gundlach | ah! my mistake | 15:01 |
| jaypipes | gundlach: I may be able to get to that one tomorrow, though. | 15:01 |
| jaypipes | gundlach: but I want to check with todd since he was going to look at that piece... | 15:01 |
| jaypipes | xtoddx: ^^ | 15:01 |
| *** anm_ has quit IRC | 15:05 | |
| *** ctennis has quit IRC | 15:09 | |
| *** ctennis has joined #openstack | 15:11 | |
| *** anm_ has joined #openstack | 15:13 | |
| *** kashyapc has joined #openstack | 15:14 | |
| *** kashyapc has joined #openstack | 15:26 | |
| *** sophiap has quit IRC | 15:27 | |
| *** sophiap has joined #openstack | 15:28 | |
| *** annegentle_ has joined #openstack | 15:30 | |
| *** mtaylor has joined #openstack | 15:31 | |
| *** ChanServ sets mode: +v mtaylor | 15:31 | |
| *** krish_ has joined #openstack | 15:33 | |
| *** annegentle has quit IRC | 15:33 | |
| *** krish has quit IRC | 15:36 | |
| *** gondoi has joined #openstack | 15:40 | |
| *** hisaki has quit IRC | 15:43 | |
| *** dpackard has joined #openstack | 15:57 | |
| *** dpackard has quit IRC | 15:58 | |
| *** brd_from_italy has quit IRC | 16:10 | |
| *** dendrobates is now known as dendro-afk | 16:13 | |
| *** SandCube has joined #openstack | 16:16 | |
| *** zheng_li has quit IRC | 16:18 | |
| *** ibarrera has quit IRC | 16:18 | |
| *** joearnold has joined #openstack | 16:18 | |
| *** joearnold has joined #openstack | 16:20 | |
| *** krish__ has joined #openstack | 16:27 | |
| jaypipes | gundlach: how are you and eday testing the rackspace API? I see the test cases in /nova/tests/api/rackspace, but I don't see them hooked in to the test suite runner... | 16:27 |
| gundlach | i'm using nosetests | 16:27 |
| jaypipes | gundlach: every time I run nosetests, it complains of no module named gflags, even when I run it in a venv :( | 16:28 |
| gundlach | try 'python /usr/bin/nosetests' instead from inside venv | 16:28 |
| gundlach | i had the same problem | 16:28 |
| jaypipes | gundlach: ok. would have been nicer to use the existing test system...just a nit. | 16:29 |
| gundlach | i agree, i'm sure that's the plan but they just haven't been hooked in yet. | 16:29 |
| jaypipes | gundlach: I didn't even realize there were unit tests until I saw them in the tests folder.. | 16:29 |
| jaypipes | subfolder.. | 16:29 |
| gundlach | yep, this shouldn't be a permanent arrangement :) | 16:29 |
| gundlach | i could take care of that after FF assuming no other bugs crop up | 16:29 |
| jaypipes | gundlach: cool :) | 16:30 |
| *** krish_ has quit IRC | 16:30 | |
| gundlach | (i'm not actually sure how to get regular unit tests running under the existing Twisted-based test framework, but i'll figure it out) | 16:30 |
| jaypipes | gundlach: just add the import line to the run_tests.py file. | 16:30 |
| gundlach | really? that's it? | 16:31 |
| gundlach | somehow i thought i tried that and it vomited. will have to try that again :) | 16:31 |
| *** littleidea has quit IRC | 16:31 | |
| jaypipes | gundlach: any other suggestions? http://codepad.org/cpZrO2SV | 16:32 |
| gundlach | pip install nose within your venv, maybe? | 16:33 |
| gundlach | yeah, looks like i installed 0.11.4 in the venv that i have in my nova/ dir (so i don't have to recreate it for every branch) | 16:33 |
| *** SandCube has quit IRC | 16:34 | |
| jaypipes | gundlach: hmm, ok. | 16:35 |
| jaypipes | gundlach: do you have to run nosetests in sudo? :( | 16:37 |
| gundlach | nope | 16:38 |
| gundlach | sorry you're having trouble -- you could add the line to run_tests.py instead if that's all it takes? | 16:38 |
| jaypipes | gundlach: well it asks for a sudo password halfway through... | 16:38 |
| gundlach | weird! | 16:38 |
| gundlach | before running any tests? | 16:38 |
| jaypipes | no, during the test run. | 16:38 |
| gundlach | hmm which test? | 16:38 |
| gundlach | [if you give it the wrong credentials which test fails?] | 16:39 |
| *** jakedahn has quit IRC | 16:39 | |
| *** jakedahn has joined #openstack | 16:39 | |
| jaypipes | gundlach: well, unfortunately, instead of using/modifying the existing base test case in /nova/test.py, you used a new one, so I don't think that will work. | 16:39 |
| jaypipes | gundlach: nosetests is currently hung...lemme paste the output. one sec. | 16:39 |
| jaypipes | gundlach: http://codepad.org/w5h7GwM7 | 16:40 |
| jaypipes | gundlach: you can see near the bottom where I had to type in a sudo pass... | 16:40 |
| gundlach | i didn't use a new base test case -- i just inherited from the standard unittest.TestCase, didn't I? | 16:41 |
| jaypipes | gundlach: which I did. I don't think that is the source of the hang... | 16:41 |
| eday | jaypipes, gundlach: I was actually hoping to move tests the other way. Remove run_tests.py and make each test case independant so nosetests can run them | 16:41 |
| jaypipes | gundlach: there is a BaseTestCase in /nova/test.py | 16:41 |
| gundlach | eday: ++ | 16:41 |
| jaypipes | eday: I wouldn't mind that. | 16:41 |
| jaypipes | eday: but if we have a test runner, we should improve and modify it, not just create new test suites with no docs as to where they are. | 16:42 |
| *** littleidea has joined #openstack | 16:42 | |
| gundlach | jaypipes: i agree, the api unit tests need to be integrated -- running nosetests to test them was a halfway solution until they were integrated. | 16:43 |
| jaypipes | gundlach: again, I have no problem with nosetests (I use it a lot and I like it). Just wish there was some notification as to how to run these without issues :) | 16:43 |
| gundlach | jaypipes: not sure what to tell you, as it works on my box :/ | 16:44 |
| *** joearnold has quit IRC | 16:44 | |
| *** littleidea has quit IRC | 16:44 | |
| jaypipes | gundlach: I created unit tests for the image service yesterday not even realizing there was a unit test in the tests/api/rackspace/ subdirectory (though it doesn't do anything.) | 16:44 |
| jaypipes | gundlach: sorry, but "it works on my box" isn't a particularly useful way to get people working on this code ;) | 16:45 |
| *** pvo has joined #openstack | 16:46 | |
| *** ChanServ sets mode: +v pvo | 16:46 | |
| gundlach | jaypipes: http://paste.openstack.org/show/33/ | 16:46 |
| gundlach | jaypipes: let me rephrase: we've got features that haven't been written yet, and we've got a goal of a testing harness for the API to be finished. neither are finished, so the API test system isn't in a complete state. | 16:47 |
| jaypipes | gundlach: is that paste showing the *correct* output? | 16:47 |
| gundlach | jaypipes: were you able to get the tests running successfully by importing them into run_tests.py? | 16:47 |
| jaypipes | gundlach: no | 16:48 |
| jaypipes | gundlach: I didn't even know they were there. | 16:48 |
| gundlach | jaypipes: yes -- one failure i think is from cerberus's upstream branch | 16:48 |
| jaypipes | gundlach: k, cool. | 16:48 |
| jaypipes | gundlach: is there a reason for all the output to stderr/out? or just not completed yet? | 16:48 |
| *** maplebed has joined #openstack | 16:48 | |
| gundlach | jaypipes: i'm not aware of that either -- that started a couple days ago, so i assume ~cerberus/nova/servers_api turned on some debugging flag | 16:49 |
| gundlach | _cerberus_ might now | 16:49 |
| gundlach | s/now/know/ | 16:49 |
| jaypipes | gundlach: l | 16:49 |
| jaypipes | gundlach: k :) | 16:49 |
| jaypipes | gundlach: my typing sucks today. | 16:49 |
| _cerberus_ | A lot of the stdout junk was me testing stuff in my branch, yes | 16:49 |
| gundlach | jaypipes: so when you importing api and api.rackspace into run_tests.py it barfed? | 16:49 |
| *** burris has quit IRC | 16:50 | |
| gundlach | s/ing/ed/ | 16:50 |
| jaypipes | gundlach: no, I have not done that yet. I was just saying that, if you put the test cases in /nova/tests and used the existing BaseTestCase, all you should have needed to do was add the import line. | 16:50 |
| gundlach | ahh i see | 16:50 |
| jaypipes | gundlach: I'll see what happens :) | 16:50 |
| gundlach | i vaguely remember that BaseTestCase's tornado-related stuff made eventlet unhappy, but i could have made that up | 16:51 |
| jaypipes | gundlach: is the /nova/tests/api_integration.py source file bogus? | 16:51 |
| jaypipes | gundlach: seems to be... | 16:51 |
| gundlach | no idea, it's been there since before i started the RS API. i think it's frem EC2 | 16:51 |
| gundlach | api_unittest.py is just EC2 i believe | 16:51 |
| jaypipes | gundlach: hmm, do you have /etc/sudoers/nova_sudoers file? | 16:51 |
| gundlach | no | 16:52 |
| jaypipes | gundlach: so you do not have nova installed locally? | 16:52 |
| gundlach | correct | 16:52 |
| jaypipes | k, checking to see if that's the issue.. | 16:52 |
| * jaypipes doesn't have it installed locally either.. | 16:52 | |
| gundlach | heh, would be funny if tests failed only if nova were installed | 16:53 |
| jaypipes | gundlach: indeed :) | 16:53 |
| *** pharkmillups has quit IRC | 16:55 | |
| *** krish__ has quit IRC | 16:59 | |
| *** zheng_li has joined #openstack | 16:59 | |
| *** krish__ has joined #openstack | 17:00 | |
| jaypipes | gundlach: got it. I was running nosetests in the rootdir, and the rpc_unittest.py file was failing miserably (since it depends on the other test runner) | 17:01 |
| jaypipes | gundlach: if I run nose in /nova/tests/api/ all is good. | 17:01 |
| gundlach | ah, my mistake -- i run it from nova/tests/api | 17:01 |
| jaypipes | yep | 17:01 |
| gundlach | sorry -- were i more leet i would have been able to paste my actual console session including my pwd, instead of just the test output | 17:01 |
| gundlach | do you know how to make screen's Copy mode copy into the system clipboard? | 17:01 |
| jaypipes | gundlach: middle mouse button. | 17:02 |
| gundlach | doesn't work in screen, which can't scroll with the mouse afaik? | 17:02 |
| *** pvo has quit IRC | 17:02 | |
| jaypipes | gundlach: if it's like xterm...should just be able to highlight an area, and middle mouse button will paste that. | 17:02 |
| gundlach | right, but my output was more than one window-ful. | 17:03 |
| gundlach | nm :) | 17:03 |
| jaypipes | ah | 17:03 |
| jaypipes | yeah | 17:03 |
| gundlach | anyway, glad you figured it out and sorry for the trouble | 17:03 |
| jaypipes | gundlach: no worries mate | 17:03 |
| gundlach | _cerberus_: https://code.launchpad.net/~gundlach/nova/servers_api/+merge/36894 | 17:05 |
| *** jakedahn has quit IRC | 17:06 | |
| *** jakedahn has joined #openstack | 17:06 | |
| *** krish_ has joined #openstack | 17:07 | |
| *** krish__ has quit IRC | 17:10 | |
| _cerberus_ | gundlach: I'll take a look | 17:11 |
| *** comstud has joined #openstack | 17:14 | |
| *** ChanServ sets mode: +v comstud | 17:14 | |
| *** littleidea has joined #openstack | 17:15 | |
| *** littleidea has quit IRC | 17:15 | |
| *** joearnold has joined #openstack | 17:16 | |
| *** burris has joined #openstack | 17:18 | |
| *** dizz|away has quit IRC | 17:19 | |
| *** kevnfx has joined #openstack | 17:22 | |
| *** jc_smith has joined #openstack | 17:25 | |
| *** pvo has joined #openstack | 17:25 | |
| *** ChanServ sets mode: +v pvo | 17:25 | |
| eday | gundlach: for multi-page screen copies, I usually save to a /tmp file and just open to where I need it (possibly directly in the browser for copy/paste) | 17:27 |
| *** Ryan_Lane has joined #openstack | 17:27 | |
| Ryan_Lane | soren: is there any way other than ppas to add additional apt sources to a vm using vmbuilder? we have a repository, but it isn't on launchpad... | 17:28 |
| *** pharkmillups has joined #openstack | 17:33 | |
| gundlach | eday: perfect, i forgot you could write to a file. thanks! | 17:34 |
| gundlach | (there should be a /dev/clipboard that you can open for writing -- then you could copy to the clipboard :) ) | 17:34 |
| eday | gundlach: that would be cool :) | 17:35 |
| *** anm_ has quit IRC | 17:37 | |
| *** anm_ has joined #openstack | 17:38 | |
| gundlach | eday: hah -- turns out cygwin has a /dev/clipboard :) | 17:44 |
| *** littleidea has joined #openstack | 17:46 | |
| *** kevnfx has quit IRC | 18:02 | |
| *** kashyapc has quit IRC | 18:03 | |
| *** rlucio has joined #openstack | 18:03 | |
| *** krish__ has joined #openstack | 18:05 | |
| *** krish_ has quit IRC | 18:08 | |
| *** dendro-afk is now known as dendrobates | 18:22 | |
| _cerberus_ | eday: Mind checking out my merge prop? https://code.launchpad.net/~cerberus/nova/servers_api/+merge/36904 | 18:25 |
| eday | _cerberus_: already was :) | 18:25 |
| _cerberus_ | Ahh, thanks' | 18:25 |
| *** krish_ has joined #openstack | 18:30 | |
| *** krish__ has quit IRC | 18:32 | |
| *** alekibango has quit IRC | 18:36 | |
| *** krish__ has joined #openstack | 18:38 | |
| *** krish_ has quit IRC | 18:39 | |
| *** krish_ has joined #openstack | 18:46 | |
| *** krish__ has quit IRC | 18:47 | |
| *** burris has quit IRC | 18:48 | |
| *** joearnold has quit IRC | 18:48 | |
| *** jakedahn has quit IRC | 18:48 | |
| *** ptremblett has quit IRC | 18:49 | |
| *** jakedahn has joined #openstack | 18:49 | |
| *** burris has joined #openstack | 18:49 | |
| vishy | i just made an ugly ugly patch | 18:51 |
| *** alekibango has joined #openstack | 18:57 | |
| *** krish__ has joined #openstack | 19:00 | |
| *** krish_ has quit IRC | 19:04 | |
| soren | vishy: Ooh, our first entry for our hall of shame? | 19:08 |
| * eday denies the patch before it even makes it to a merge proposal | 19:09 | |
| *** pvo has quit IRC | 19:09 | |
| soren | Ryan_Lane: Sure. So, you start by writing a patch... :) | 19:09 |
| soren | dendrobates: I'm perfectly cool with dropping Redis completely for Austin. | 19:10 |
| vishy | soren: so multi-region | 19:10 |
| vishy | soren: we're sharing users and projects | 19:11 |
| vishy | soren: so creating and destroing network and default security group on project creation doesn't work | 19:11 |
| alekibango | hi. what is going on? | 19:11 |
| *** ewanmellor has joined #openstack | 19:11 | |
| dendrobates | soren: good, cause it looks like that is going to happen | 19:11 |
| vishy | soren: so I just hacked it in to api, which is a bit ugly | 19:11 |
| ewanmellor | Morning all | 19:12 |
| *** jakedahn has quit IRC | 19:12 | |
| ewanmellor | Does anyone have a .deb for Squeeze for eventlet? | 19:12 |
| *** krish__ has quit IRC | 19:12 | |
| soren | ewanmellor: morning?!? Where are you? | 19:12 |
| *** jakedahn has joined #openstack | 19:13 | |
| ewanmellor | I'm in Cambridge, UK. I'm just used to talking to Yanks, that's all ;-) | 19:13 |
| soren | ewanmellor: Ah :) | 19:13 |
| ewanmellor | soren: You're my .deb God -- I don't suppose you've packaged eventlet have you? | 19:13 |
| soren | ewanmellor: Of course I have. | 19:14 |
| soren | ewanmellor: In Debian, even. | 19:14 |
| soren | Not the right version, though. | 19:14 |
| ewanmellor | LOL | 19:14 |
| soren | At least I thought I did. | 19:14 |
| * soren checks | 19:14 | |
| ewanmellor | I couldn't find it. | 19:14 |
| alekibango | what would dropping redis mean? | 19:14 |
| soren | Not using it anymore. | 19:14 |
| ewanmellor | Unless it's disguised as python-event or python-gevent. | 19:15 |
| soren | ewanmellor: Err... I'm terribly sorry. I lied. I could have sworn I put it in Debian, too, but it seems not. | 19:15 |
| * soren digs through e-mail from ftp-master. | 19:15 | |
| alekibango | soren: source packages might be enough :) | 19:15 |
| soren | Grab 'em from Ubuntu. | 19:15 |
| ewanmellor | soren: Is there a particular version I need? | 19:16 |
| eday | soren, dendrobates: Dropping redis now? I'm in support of this, but I didn't see anything about it | 19:16 |
| dendrobates | eday: it came up yesterday, jaypipes can cover it in the meeting. | 19:16 |
| soren | ewanmellor: 0.9.12. It's in the nova-core PPA, and will be in Ubuntu as soon as I get my act together. | 19:16 |
| dendrobates | I'll be on a plane, but I'm about to send a meeting reminder. jaypipes will lead it in my absence | 19:17 |
| ewanmellor | soren: http://ppa.launchpad.net/soren/nova/ubuntu lucid main ? | 19:17 |
| ewanmellor | Or have you made another PPA? | 19:17 |
| soren | ewanmellor: That may have it, too. I was referring to http://launchpad.net/~nova-core/+archive/ppa (whose repo is at http://ppa.launchpad.net/nova-core/ppa/ubuntu). | 19:18 |
| ewanmellor | soren: Perfect, thanks. I'll look there. | 19:18 |
| *** krish__ has joined #openstack | 19:21 | |
| *** sophiap has quit IRC | 19:26 | |
| *** sophiap has joined #openstack | 19:26 | |
| *** krish__ has quit IRC | 19:27 | |
| *** krish__ has joined #openstack | 19:28 | |
| soren | ewanmellor: Thanks for the (unintended, but helpful nonetheless) reminder. Just uploaded eventlet 0.9.12 to Ubuntu. | 19:28 |
| soren | ewanmellor: My notes reveal that I was expecting mtaylor would upload it to Debian. Why I expect that and why it hasn't happened are two questions to which I have no answer. | 19:29 |
| soren | Maybe I made it all up. | 19:29 |
| mtaylor | soren: hrm. for some reason I thought you were going to | 19:30 |
| ewanmellor | soren: No problem -- thanks for the packages! It's working a lot better now ;-) | 19:30 |
| soren | mtaylor: I don't blame you. 5 minutes ago I thought I already did it! | 19:31 |
| mtaylor | hehe | 19:31 |
| mtaylor | soren: one of these days you and I are going to figure out which of us is doing what | 19:31 |
| soren | mtaylor: Apparantly, I'm doing python-gflags. I forgot all about that. | 19:32 |
| mtaylor | soren: oh lovely | 19:32 |
| soren | mtaylor: I put you as Original-Maintainer in the Ubuntu eventlet package. I'd be a liar (again) if you don't take that up on Debian :) | 19:32 |
| *** joearnold has joined #openstack | 19:33 | |
| mtaylor | soren: hehe. ok. I'll take it up | 19:35 |
| *** hazmat has joined #openstack | 19:35 | |
| *** jakedahn has quit IRC | 19:35 | |
| Ryan_Lane | soren: lol. that was the answer I was hoping not to hear :) | 19:37 |
| _cerberus_ | pylint question: the routes lib, by default, maps requests for resources with a specific id to methods expecting an "id" param, which conflicts with both our override declaration and pisses pylint off. However, it's also default behavior for a 3rd party library. What's the correct choice here? | 19:40 |
| *** krish_ has joined #openstack | 19:42 | |
| eday | _cerberus_: we need to ignore those. I thought there was a .pylintrc rule to ignore them | 19:43 |
| eday | _cerberus_: are you running it with pylintrc included? | 19:43 |
| _cerberus_ | Whoops :-D | 19:43 |
| *** mtaylor has quit IRC | 19:44 | |
| _cerberus_ | eday: actually, the pylintrc I'm looking at doesn't seem to define such an exclusion | 19:46 |
| *** krish__ has quit IRC | 19:46 | |
| eday | _cerberus_: ok, you can ignore the line by appending # pylint: disable-msg=... (where ... is the error code) | 19:47 |
| _cerberus_ | eday: thanks | 19:48 |
| soren | vishy: https://code.launchpad.net/~soren/nova/network-fixes/+merge/36700 ping (since you don't seem to be subscribed) | 19:52 |
| *** krish_ has quit IRC | 19:55 | |
| vishy | soren: is there a reason to start dhcp before an instance is started? | 19:56 |
| vishy | soren: is it just in case there are running instances already? | 19:57 |
| soren | vishy: In case there's already an instance running that's waiting for it. | 19:57 |
| soren | vishy: Precisely. | 19:57 |
| vishy | soren: ok, looks good | 19:57 |
| vishy | i'll approve | 19:57 |
| soren | vishy: I changed another few things today, don' tknow if you noticed. | 19:57 |
| soren | vishy: Notably s/os.kill/_execute('sudo kill')/ | 19:58 |
| vishy | yeah saw that | 19:58 |
| *** ptremblett has joined #openstack | 19:58 | |
| vishy | i always run as root, so i didn't notice that problem | 19:58 |
| soren | vishy: I guessed :) | 19:59 |
| vishy | btw: the lucid version of libvirt still fails with security groups | 19:59 |
| soren | vishy: Even with aa-complain /usr/sbin/libvirtd? | 20:00 |
| vishy | installing the maverick packages and making sure gawk ebtables and iptables are in works | 20:00 |
| vishy | soren: yeah | 20:00 |
| soren | vishy: With kvm? | 20:00 |
| soren | vishy: Or user-mode-linux? | 20:00 |
| vishy | soren: kvm | 20:00 |
| soren | What sort of errors are you seeing? | 20:00 |
| soren | In your honour, I've been doing my testing under Lucid. | 20:00 |
| soren | It works fine for me. | 20:00 |
| devcamcar | cerberus: i'm fixing something in our ec2 api that i think could help the rs api as well | 20:00 |
| *** dendrobates is now known as dendro-afk | 20:01 | |
| devcamcar | cerberus: i'm adding a field to our db schema called "api_id" | 20:01 |
| vishy | hmm...i'll have to roll back to the old version to find out | 20:01 |
| soren | vishy: Just a vague recollection? | 20:01 |
| devcamcar | cerberus: it looks like you guys are having to do an extra layer of mappings | 20:01 |
| *** pvo has joined #openstack | 20:01 | |
| *** pvo has joined #openstack | 20:01 | |
| *** ChanServ sets mode: +v pvo | 20:01 | |
| vishy | i think it was the same error i was seeing regarding ebiptables | 20:01 |
| vishy | no driver for ebiptables or some such | 20:01 |
| devcamcar | cerberus: and i think if each api sets this id as it wants and pushes it to database, that we can bypass a layer of mappings | 20:02 |
| gundlach | devcamcar: i don't know that i agree with that... | 20:03 |
| gundlach | 1) doesn't that segment our data into two groups, depending on which API you used? | 20:03 |
| gundlach | 2) why push API info down into the DB layer instead of keeping it encapsulated and hidden in the API layer? | 20:03 |
| devcamcar | gundlach: no, it just lets each api set the api specific string representation as it sees fit | 20:03 |
| devcamcar | so ec2 uses something like i-abc123 for an instance id | 20:04 |
| gundlach | right, so if i create an instance with ec2, can i later fetch data about it with the RS api? | 20:04 |
| devcamcar | and that needs to be stored - currently its based on the PK, which is bad | 20:04 |
| devcamcar | gundlach: yes | 20:04 |
| gundlach | ah, ok, i must be misunderstanding | 20:04 |
| devcamcar | gundlach: i'm not building any walls between anything | 20:04 |
| devcamcar | its just a string | 20:04 |
| devcamcar | for reference: | 20:05 |
| devcamcar | https://code.launchpad.net/~devcamcar/nova/random-ec2-ids/+merge/36908 | 20:05 |
| _cerberus_ | devcamcar: Sounds interesting. re: the notes on my merge, the branch isn't done, either. I hadn't gotten to handling the mapping of ids yet. I was just attempting to merge so I can continue to work on it without generating an encyclopedic diff | 20:05 |
| devcamcar | right now in this merge there is an ec2_id, but we decided that we don't want api specific stuff in the database | 20:05 |
| devcamcar | so i'm going to repush in a few and renamed ec2_id to api_id | 20:06 |
| gundlach | ok walk me through this: in RS i create a server, whose id is the integer 2. nova saves that into api_id as a string "2" i guess. then i try to read my list of instances via the EC2 api. what will i get? | 20:06 |
| devcamcar | which means you guys can push the rackspace id there as well | 20:06 |
| _cerberus_ | devcamcar: re: api stuff in the database, I added a model for our Rackspace auth tokens that may need to get pushed somewhere else | 20:06 |
| devcamcar | gundlach: so in your case, pk=2, api_id="2", if i then do an ec2-describe-instances i will just see a "2" where normally you would see "i-abc123", and you can use "2" in place of "i-abc123" | 20:07 |
| gundlach | ok, got it. now the reverse: i create an instance via EC2 and get "i-abc123" or some similar string stored into api_id. then i try to read my servers via the RS API. what are their IDs? | 20:08 |
| *** krish_ has joined #openstack | 20:08 | |
| devcamcar | gundlach: that is the part that i'm not clear on - i don't have much experience with the rs api yet | 20:08 |
| xtoddx | _cerberus_: have you looked at https://code.launchpad.net/~xtoddx/nova/authserver? has a session token model. You should probably pull out whatever is useful for you from that. | 20:09 |
| gundlach | yeah; the problem is that IDs are integers that can be reused between users [aka, each user gets his own id space]. i guess there's nothing stopping us from changing that so we have a single id space across all users, and new entities don't monotonically increase their IDs | 20:09 |
| gundlach | devcamcar: but i don't know how to map strings to ids :) would it be an option to make all EC2 ids strings that only contained digits? | 20:10 |
| _cerberus_ | xtoddx: I hadn't, but I will now. Thanks | 20:10 |
| *** theron has joined #openstack | 20:10 | |
| eday | gundlach, devcamcar: Can't we just used unique 64-bit ints and have i-[hex of id] for ec2 and just use the plain ID int for rs? | 20:12 |
| xtoddx | gundlach: or you can set api-id to username:id or something | 20:12 |
| eday | I don't see why each RS instance needs it's own namespace | 20:12 |
| gundlach | eday: i guess it would only matter if some code had come to rely on that, but i doubt it. | 20:13 |
| gundlach | [separate id spaces] | 20:13 |
| eday | gundlach: I can't imagine any code that would, it should just treat them as ints | 20:13 |
| *** Mike has joined #openstack | 20:13 | |
| devcamcar | gundlach: you can still do that if you want, its just up to the rackspace api to choose how to populate the api_id field | 20:13 |
| devcamcar | i think it provides a good common ground | 20:14 |
| *** Mike is now known as Guest19800 | 20:14 | |
| devcamcar | the strings do have to be unique though | 20:14 |
| devcamcar | so username:id ++ | 20:14 |
| devcamcar | there is currently a unique constraint on the field | 20:14 |
| eday | also, we probably don't want anything that is auto-incrementing - this is the death of distributed apps. we should be using unique IDs (UUIDs if space allows or some custom algorithm) | 20:15 |
| gundlach | eday: re 64-bit ints: maybe ec2 uses i-[hex of userid]-[hex of id], and rsapi just uses the id? that lets us retain id space per user, if that helps scaling | 20:15 |
| eday | gundlach: sure | 20:15 |
| *** rnirmal has quit IRC | 20:16 | |
| jaypipes | eday: ++ on uuids. | 20:16 |
| gundlach | devcamcar: maybe to make this clear, you could make the api_id field an int (the lowest common denominator)? | 20:16 |
| gundlach | or long, rather | 20:16 |
| devcamcar | eday: we do need to make the actual row id's themselves proper UUIDs instead of auto-increment ints, but that is a different issue | 20:17 |
| gundlach | so that any consumers can know how to translate that to/from the format they require | 20:17 |
| devcamcar | gundlach: the lowest common denomintator is a string, and if you guys need to denorm an int into a string i think thats fine | 20:18 |
| *** Guest19800 has quit IRC | 20:18 | |
| gundlach | devcamcar: if it's a string, then some future code that forgets that some people have to translate to an int might store e.g. "abc" | 20:19 |
| eday | devcamcar: hmm, I would thing we want the canonical type to be int, string->int conversions can break, but int->string never fails | 20:19 |
| gundlach | if it's an int, then all code is forced to turn it into an int, which all APIs can be sure to consume | 20:19 |
| devcamcar | the whole point is that ec2 api doesn't store ints here though, so i'm trying to find a middle ground | 20:19 |
| eday | devcamcar: the backend API can store ints, and just format it as "i-%x" % instance_id | 20:20 |
| eday | for ec2 | 20:20 |
| _0x44 | sirp1: You want to look this over before I suggest merging? http://bazaar.launchpad.net/~chris-slicehost/glance/implement_teller_parallax_lookup/revision/5 | 20:21 |
| devcamcar | i must enforce uniqueness on the field as well, how would rackspace id work in that context? | 20:21 |
| gundlach | devcamcar: rackspace can switch to a single id space | 20:22 |
| gundlach | rather than one per user | 20:22 |
| eday | devcamcar: string or int, we just need enough random bits to be unique. uuid is "guaranteed" but is 128 bits. We can probably get away with a 64-bit int though | 20:22 |
| eday | 64-bit gives (if we do time-based), 4096 IDs per microsecond | 20:23 |
| vishy | soren: i proposed my ugly hack to initiate commentary | 20:24 |
| gundlach | eday: you OK with exposing the create time of the entity via the ID? | 20:24 |
| soren | vishy: link? | 20:25 |
| eday | gundlach: I personally don't care, but others may. I don't like secrets | 20:26 |
| gundlach | same as i feel. | 20:26 |
| gundlach | let's proceed with it, and if there are complaints we can change the algorithm :) | 20:26 |
| eday | gundlach: we can always scramble it in a non-reversable way that keeps the uniqueness properties | 20:26 |
| gundlach | we can? i don't have enough math to be able to say that with confidence. cool. | 20:26 |
| eday | gundlach: I don't know off the top of my head, but I'm sure there is a way :) | 20:27 |
| gundlach | lol | 20:27 |
| eday | gundlach: or we can just use crypto-level random 64-bit ints and hope for the best, haha | 20:27 |
| sirp1 | _0x44: have you merged trunk into your topic branch (to pull in jaypipes directory re-org)? | 20:27 |
| _0x44 | sirp1: Yes, I branched this yesterday. | 20:28 |
| gundlach | yeah, i was just trying to figure out how big the brute force dictionary for a 64 bit key was :) anyway, it's bigger than the secret we're trying to protect. | 20:28 |
| _0x44 | sirp1: http://0x44.pastebin.com/JkDvA9TP | 20:28 |
| *** littleidea has quit IRC | 20:29 | |
| devcamcar | well this all sounds good, but i think you guys are missing that point that i can't convert a UUID to the format "i-abcdefgh" | 20:29 |
| *** ctennis has quit IRC | 20:29 | |
| *** littleidea has joined #openstack | 20:29 | |
| devcamcar | i dont want to make our ec2 api users type a 34 digit string everytime they want to terminate an instance | 20:29 |
| gundlach | devcamcar: is there a length limit on the ec2 id? | 20:29 |
| devcamcar | gundlach: not that i know of, but that doesn't mean i want to punish users with a 34 digit string | 20:29 |
| gundlach | devcamcar: how long would it be in base 26? | 20:30 |
| *** littleidea has quit IRC | 20:30 | |
| eday | devcamcar: we're not proposing using a proper UUID, just a 64bit int that would be "i-00000000" | 20:30 |
| soren | gundlach: 64 bits? | 20:31 |
| gundlach | soren: yeah but i convert to base 26 i'm asking how many digits it could take. i think it's log base 26 of 2^64 but i'm not sure | 20:31 |
| eday | devcamcar: are there length restrictins on the ec2 string? | 20:31 |
| soren | gundlach: 14 characters. | 20:31 |
| *** kevnfx has joined #openstack | 20:31 | |
| soren | gundlach: It is. | 20:31 |
| eday | devcamcar: also, is it case sensitive? | 20:31 |
| gundlach | devcamcar: 16 char string isn't horrible | 20:31 |
| devcamcar | i assume it is case sensitive | 20:32 |
| *** jtimberman has quit IRC | 20:32 | |
| soren | What does EC2 use? 7 characters, or so? | 20:32 |
| eday | devcamcar: then base64 would be fine too | 20:32 |
| * soren doesn't remember. | 20:32 | |
| devcamcar | so whats the problem with you guys storing a string? this is not meant to be an integer field. ec2 id is specifically s string | 20:32 |
| sirp1 | _0x44: jaypipes change hit trunk about 6 hoours ago, it moved parallax and teller under a new "glance" directory: http://bazaar.launchpad.net/~hudson-openstack/glance/trunk/revision/5 | 20:32 |
| gundlach | devcamcar: yeah, but we're trying not to tie to a specific API in the DB, remember? | 20:32 |
| devcamcar | so touching the data outside of python, for instance, for reporting, becomes impossible without another layer of transform | 20:32 |
| devcamcar | right, which is why i proposed a string :) | 20:33 |
| _0x44 | sirp1: Ah, then no, I haven't yet. :\ | 20:33 |
| eday | devcamcar: because it's ec2-specific. the canonical instance ID will need to be a 64-bit int | 20:33 |
| devcamcar | i could also argue that an int is rackspace specific in this case | 20:33 |
| gundlach | devcamcar: yes, but an int can be converted to a string automatically, guaranteed | 20:33 |
| eday | devcamcar: so rather than keep an extra field for ec2->int mapping, we can just make that a quick str format | 20:33 |
| devcamcar | the canonical id is not the api_id | 20:33 |
| devcamcar | it is the row_id | 20:33 |
| *** mtaylor has joined #openstack | 20:33 | |
| *** ChanServ sets mode: +v mtaylor | 20:33 | |
| vishy | soren: https://code.launchpad.net/~vishvananda/nova/move-default-group/+merge/36923 | 20:33 |
| gundlach | an arbitrary string can't be converted to an int | 20:33 |
| *** jtimberman has joined #openstack | 20:34 | |
| gundlach | and you're right that using an int instead of as tring will require another transform in ec2 reporting tools -- but keeping it as a string would require another layer of transformation in any RS API reporting tools :) | 20:34 |
| eday | gundlach: (well, it can, it just gets really large... it all bits... ;) | 20:34 |
| devcamcar | so the rs api requires the int? | 20:34 |
| _0x44 | sirp1: Merging now | 20:34 |
| devcamcar | if thats the case i'm happy to do the transform | 20:34 |
| gundlach | eday: yeah, i don't think that's what we're going for :) | 20:34 |
| gundlach | devcamcar: yes | 20:34 |
| pvo | eday: gundlach: we'd talked about doing a vm id combined with the region to make it unique within a region to avoid uuids | 20:34 |
| gundlach | devcamcar: the current RS API spec gives all IDs as integers | 20:34 |
| pvo | nyc:122345678:instance_name | 20:35 |
| pvo | if we are able to version the api int eh future | 20:35 |
| _0x44 | One crazy thing about the RS public API is that we don't refer to the images internally by integer id, only by UUID string | 20:35 |
| devcamcar | i have to research if the ec2 tools can support longer ids | 20:35 |
| *** krish__ has joined #openstack | 20:35 | |
| soren | vishy: Yikes! @ security_group_destroy_all | 20:36 |
| vishy | you don't have to convert if you have api_id vs id | 20:36 |
| vishy | soren: hehe, i needed a quick way to clean them up after tests | 20:36 |
| vishy | soren: I'm thinking the flag idea might work if FLAGS.cleanup_db_on_project_destroy: | 20:37 |
| vishy | soren then delete security groups and disassociate networks | 20:37 |
| _0x44 | pvo: Why would we want to avoid UUIDs? In our current system they're guaranteed unique because they eventually hit Nucleus and should get sorted out there. | 20:37 |
| pvo | _0x44: for the reason devcamcar mentioned. How do I reference that to anyone? Its guaranteed I'll have to email it or msg it. | 20:38 |
| pvo | if it is unique per region with an id and a name, there are other bits that can be identified with it. | 20:38 |
| pvo | or even just region:id | 20:38 |
| *** krish_ has quit IRC | 20:39 | |
| *** littleidea has joined #openstack | 20:39 | |
| pvo | uuids don't tell you much about the instance. if the urn had a region:id:name or just region:id you have a bit more info about it and wouldn't need to look any info up about an vm if it isn't in your region | 20:39 |
| _0x44 | UUIDs shouldn't tell you much about the instance. They're identifiers, not overloaded metadata objects. | 20:40 |
| pvo | ex. if I hit the IRE instence and pass it a urn of PHX:12345:somesillyname, don't bother with the request | 20:40 |
| pvo | a url is both | 20:40 |
| _0x44 | If we're looking for something with universality like a URL we should use a URL instead of making our own format. | 20:41 |
| *** miclorb_ has joined #openstack | 20:41 | |
| pvo | http://en.wikipedia.org/wiki/Uniform_Resource_Name | 20:42 |
| jaypipes | gundlach, _cerberus_: so, when's the last time you ran nosetests with --all-modules to actually run the /nova/tests/api/rackspace/auth.py file? I'm showing lots of failures. | 20:42 |
| _0x44 | pvo: We should register openstack as a valid namespace if we want to do something like that. | 20:43 |
| _cerberus_ | jaypipes: I've been running it individually without nosetests and everything passes | 20:43 |
| *** cloudmeat has quit IRC | 20:43 | |
| pvo | _0x44: we could. | 20:43 |
| *** cloudmeat has joined #openstack | 20:44 | |
| jaypipes | _cerberus_: hmmm. | 20:44 |
| soren | vishy: I'll need to look at it tomorrow. i'm having trouble forming opinions on it right now. | 20:44 |
| *** theron has quit IRC | 20:44 | |
| _0x44 | Then the id could be urn:openstack:nova:region:####:name, and we assume urn:openstack:nova during customer communication to nova, and urn:openstack:swift for swift. | 20:44 |
| soren | Mmm... | 20:45 |
| jaypipes | _cerberus_: http://codepad.org/R9Rua5Fe | 20:45 |
| soren | OpenStack is the software, not a service provider. | 20:45 |
| openstack | soren: Error: "is" is not a valid command. | 20:45 |
| soren | openstack: It wasn't meant as a command, so there. | 20:45 |
| openstack | soren: Error: "It" is not a valid command. | 20:45 |
| soren | openstack: ditto | 20:45 |
| openstack | soren: Error: "ditto" is not a valid command. | 20:45 |
| soren | bah | 20:45 |
| gundlach | jaypipes: i'm not familiar with all-modules; i thought nosetests ran every test it could find by default | 20:46 |
| jaypipes | gundlach: no, it runs tests objects in all files with "test" in them. | 20:46 |
| *** Cybodog has quit IRC | 20:47 | |
| _0x44 | soren: URN namespaces don't seem to have to identify service-providers. | 20:47 |
| jaypipes | gundlach: which is why, for instance, /nova/tests/api/wsgi_test.py works. | 20:47 |
| gundlach | ah, gotcha | 20:47 |
| _cerberus_ | jaypipes: I've been running everything inside of venv, but http://paste.openstack.org/show/35/ | 20:47 |
| _cerberus_ | That's in my servers_api branch | 20:47 |
| jaypipes | _cerberus_, mtaylor, gundlach: we *really* need to hook Tarmac into running these API tests... | 20:47 |
| _cerberus_ | perhaps it's broken in trunk atm | 20:48 |
| jaypipes | _cerberus_: I'm in a venv. | 20:48 |
| *** cloudmeat has quit IRC | 20:48 | |
| *** allsystemsarego has quit IRC | 20:48 | |
| _0x44 | soren: But I agree, making every id a URL would probably be a better idea in the long term? | 20:48 |
| jaypipes | _cerberus_: you can tell by the prompt in the codepad paste... | 20:48 |
| *** Cybodog has joined #openstack | 20:49 | |
| _cerberus_ | jaypipes: indeed | 20:49 |
| pvo | _0x44: I guess my thinking is if the vms were identified by a urn, it can be easily distinguished by a user as to which endpoint to ask for metadata about it instead of querying every endpoint you know about to find it. | 20:50 |
| soren | _0x44: I've always envisioned it eventually being a url. | 20:50 |
| devcamcar | all: slightly different suggestion - since disk space is cheap and the requirements of the api specific id's are fairly significantly different, i think it makes sense to store them separately now that i understand the rackspace requirements a bit better | 20:50 |
| soren | Right now, we don't have the luxury if such experimentation with the API design, though. | 20:51 |
| soren | Soon, but not right now. | 20:51 |
| zul | soren: i was thinking can you make the /var/lib/nova/nova.sqllite in the nova-common.postinst | 20:51 |
| pvo | soren: agreed | 20:51 |
| devcamcar | forcing them to share a specific id in this way seems counterproductive, but i suggest we discuss this in the context of multi region at the next design summit | 20:51 |
| soren | zul: Possibly. | 20:51 |
| jaypipes | _cerberus_: maybe I don't have your current work? is it merged yet? | 20:51 |
| devcamcar | for now i can just store an ec2_id and quickly move past this, and i have no problem with there also being a rs_id field in there as well | 20:51 |
| soren | zul: Hm... Actually, no. | 20:51 |
| jaypipes | _cerberus_: though all this test does is talk to the mock router and db... | 20:51 |
| _0x44 | pvo: You'd get the same thing from a URL and have the added bonus that it's parsable with urllib ;) | 20:52 |
| _cerberus_ | jaypipes: no, nothing is merged at the moment. I'm working on some pylint/pep8 related cleanup as suggested by eday, and then I'm going to repush for approval | 20:52 |
| zul | soren: why not? | 20:52 |
| soren | zul: I've thought about it before, but only just now realised why it's not a good diea. | 20:52 |
| soren | zul: ...because it shouldn't hard code the use of sqlite. | 20:52 |
| _0x44 | pvo: err urlparse | 20:52 |
| gundlach | jaypipes: lp:~cerberus/nova/servers_api | 20:52 |
| soren | zul: The real problem is that, for some reason, it gets created with root:root ownership. | 20:52 |
| soren | zul: I'm assuming that's what you're meaning to fix, right=? | 20:53 |
| zul | soren: agreed..then it should create the the right owner | 20:53 |
| pvo | _0x44: true, but api.dfw.rackspacecloud.com/servers/12345 seems it would contain a lot of extra info | 20:53 |
| zul | yeah | 20:53 |
| soren | zul: I really want to understand why it gets created that way to begin with. Everything setuid()'s to nova, so something must be instantiating the db before calling setuid. That sounds like a bug anyway. | 20:54 |
| _cerberus_ | jaypipes: I'm also having some really annoying pylint issues. I just realized I was using a too-new version, so I rolled back, and now I'm getting this http://paste.openstack.org/show/34/ | 20:54 |
| *** ctennis has joined #openstack | 20:54 | |
| *** ctennis has joined #openstack | 20:54 | |
| jaypipes | _cerberus_: no idea :( | 20:55 |
| soren | _cerberus_: Try clearing out your .pyc files? | 20:55 |
| zul | soren: its a bug imho | 20:55 |
| soren | zul: Precisely. Creating the db in postinst is a workaround. I'd rather actually fix it. If possible, that is. | 20:56 |
| *** jdarcy has quit IRC | 20:56 | |
| zul | soren: ack | 20:56 |
| *** dabo has joined #openstack | 20:56 | |
| *** littleidea has quit IRC | 20:56 | |
| soren | Release meeting in #openstack-meeting in two minutes! | 20:58 |
| zul | aiiiie! | 20:58 |
| jaypipes | christ there are so many levels of abstraction in nova... | 20:59 |
| sirp1 | _cerberus_: i figured out what the issue with the daemon library…. it relies on a module called lockfile, and the version in PyPI appears to incompatible because it defines a function called LinkFileLock rather than a class | 20:59 |
| vishy | jaypipes: i think we could use 2 or 3 more | 21:00 |
| vishy | :) | 21:00 |
| jaypipes | vishy: it's driving me nuts to be honest... | 21:00 |
| mtaylor | jaypipes: yes. totally agree | 21:02 |
| mtaylor | I'm going to try to carve out time to get that finished over the next coupla weeks | 21:02 |
| soren | zul: Hm.... When did you last see this problem? | 21:02 |
| *** rnirmal has joined #openstack | 21:02 | |
| zul | soren: the db problem? | 21:02 |
| soren | zul: Yeah. | 21:02 |
| anotherjesse | mtaylor / jaypipes suggestions for improvements? | 21:03 |
| zul | soren: this morning when i was trying to install openstack from lp:nova/ubuntu | 21:03 |
| soren | zul: I /think/ the api server may have been at blame, but it's been completely replaced, and I can't seem to reproduce it. | 21:03 |
| mtaylor | anotherjesse: yes | 21:03 |
| soren | zul: Oh, that's ancient. | 21:03 |
| mtaylor | jaypipes: well, the 'have hudson/tarmac run api tests' | 21:03 |
| zul | soren: oh | 21:03 |
| zul | soren: ill try it again tonight | 21:03 |
| soren | zul: You're meant to branch trunk and merge lp:nova/ubuntu into that. | 21:04 |
| zul | soren: ok...nice to know :) | 21:04 |
| soren | zul: I'll update lp:nova/ubuntu just for giggles, but it was never meant to be used on its own. | 21:04 |
| jaypipes | mtaylor: ya, I gotcha. | 21:04 |
| *** metcalfc has joined #openstack | 21:04 | |
| zul | soren: thanks | 21:04 |
| *** dabo has left #openstack | 21:04 | |
| *** burris has quit IRC | 21:06 | |
| *** krish__ has quit IRC | 21:27 | |
| *** _0x44 is now known as rootkit | 21:28 | |
| *** jakedahn has joined #openstack | 21:30 | |
| *** miclorb_ has quit IRC | 21:31 | |
| jaypipes | ewanmellor: got a sec to join us in #openstack-meeting? | 21:31 |
| gundlach | ach i missed the meeting | 21:33 |
| *** rootkit is now known as _0x44 | 21:34 | |
| *** burris has joined #openstack | 21:35 | |
| *** krish__ has joined #openstack | 21:43 | |
| *** abecc has quit IRC | 21:44 | |
| *** annegentle_ has quit IRC | 21:52 | |
| soren | xtoddx: https://launchpad.net/bugs/649806 https://launchpad.net/bugs/649807 <--- Sound familiar? | 21:52 |
| uvirtbot | Launchpad bug 649806 in nova "AMQP concurrencty problem in API server" [High,New] | 21:52 |
| xtoddx | i had a branch where i undid the authmanger singletone and had no problems | 21:52 |
| soren | xtoddx: Yup. I did the same for rpc.Connection and everything was suddenly smooth. | 21:53 |
| soren | https://launchpad.net/bugs/649807 | 21:53 |
| uvirtbot | Launchpad bug 649807 in nova "Redis concurrency problems in API server" [High,New] | 21:53 |
| xtoddx | soren: yea, with ldap and with redis | 21:53 |
| xtoddx | and de-singletonizing was the right call | 21:53 |
| xtoddx | i actually had problems putting them in a pool, but having them be an instance when needed wasn't a problem | 21:53 |
| eday | xtoddx: it works fine, but it means creating a new tcp connection/amql handshake (which is like 3RTTs) for each API request that needs a response | 21:54 |
| soren | xtoddx: Yup. Connections seem to be cleaned up nicely and everything, but we should probably use eventlet's pooling thingamajig nonetheless. | 21:54 |
| eday | xtoddx: pooling and reuse of cached connections is the way to go | 21:54 |
| soren | eday: Ouch, 3 roundtrips? | 21:54 |
| soren | eday: I didn't realised. | 21:54 |
| soren | -d | 21:54 |
| xtoddx | yea a pool for anything that takes multiple trips to auth is a good idea | 21:54 |
| xtoddx | eday: would there be a possibility of connection timeouts in a pool? | 21:55 |
| * jaypipes wonders why we don't just use Celery... http://ask.github.com/celery/ | 21:57 | |
| *** ArdRigh has joined #openstack | 21:58 | |
| eday | soren: AMQP is a feature rich but chatty protocol | 21:58 |
| eday | soren: it's ok for persistent conenctions, but short lived ones have an overhead | 21:58 |
| * Daviey recently toyed with celery, and was more impressed with it than i expected to be | 21:58 | |
| jaypipes | Daviey: so, so much better than carrot. | 21:59 |
| jaypipes | Daviey: plus, the @task decorators and webhooks would be perfect in Nova... but I digress ;) | 22:00 |
| *** gondoi has quit IRC | 22:02 | |
| alekibango | jaypipes: maybe because AMQP is a hot buzzword -- and rabbitmq is pretty nice, reliable and scaleable implementation... | 22:02 |
| alekibango | i never heard about celery :) | 22:02 |
| alekibango | http://celeryproject.org/ | 22:02 |
| alekibango | ah, it uses rabbitmq :) | 22:03 |
| alekibango | ic now | 22:03 |
| creiht | celery is more about queueing tasks rather than a general message queue | 22:04 |
| alekibango | i would need that celery for another project of mine :) nice catch | 22:04 |
| *** pvo has quit IRC | 22:05 | |
| Daviey | (it integrates into Django really well fwiw) | 22:05 |
| alekibango | its really lovely - for build server i need | 22:06 |
| soren | zul: Merged trunk into ubuntu branch, just for you :) | 22:06 |
| * soren calls it a day | 22:07 | |
| Daviey | better than calling it a fish, i suppose. | 22:08 |
| *** cyonyx has joined #openstack | 22:14 | |
| *** littleidea has joined #openstack | 22:15 | |
| burris | say I'd like to setup my own Hudson CI server and start with the same jobs as on hudson.openstack.org, are the Hudson configs shared anywhere? | 22:23 |
| creiht | mtaylor: -^ | 22:24 |
| *** cloudmeat has joined #openstack | 22:29 | |
| *** kevnfx has quit IRC | 22:32 | |
| *** ppetraki has quit IRC | 22:34 | |
| *** cyonyx has quit IRC | 22:37 | |
| *** krish_ has joined #openstack | 22:41 | |
| *** pharkmillups has quit IRC | 22:43 | |
| *** krish__ has quit IRC | 22:44 | |
| mtaylor | burris: no - but I certainly can share them... can you email me (I'm about to run out) and remind me to do that? | 22:47 |
| *** joearnold has quit IRC | 22:47 | |
| _cerberus_ | mtaylor: I've asked a few times, but no one seems to know. Are you aware of this issue with pylint 0.19? http://paste.openstack.org/show/34/ | 22:48 |
| mtaylor | _cerberus_: nope. never seen that before | 22:49 |
| _cerberus_ | Fair enough | 22:49 |
| *** krish_ has quit IRC | 22:52 | |
| *** krish_ has joined #openstack | 22:55 | |
| *** littleidea has quit IRC | 22:57 | |
| eday | _cerberus_: was it working for you before? if so what changed to break it? | 22:59 |
| _cerberus_ | eday: Turns out I was using a newer version by mistake, so I attempted to roll back to 0.19 | 23:00 |
| eday | was the old version removed first? might be a conflict there | 23:00 |
| eday | is this on an ubuntu box, or your mac? | 23:01 |
| _cerberus_ | eday: both, and as an extreme measure, I completely wiped out all of my site-packages on the ubuntu slice and started over | 23:01 |
| _cerberus_ | This time using the pip-requires as the basis | 23:02 |
| eday | for ubuntu, try apt-get install pylint | 23:02 |
| eday | thats the one I'm using | 23:02 |
| _cerberus_ | Hmm, ok | 23:02 |
| _cerberus_ | Yeah, that seems to be fine. Wonder if it's patched from the version available through pypi | 23:03 |
| * eday shrugs | 23:04 | |
| _cerberus_ | Thanks for the help either way | 23:04 |
| eday | i always hit ubuntu/nova ppas befoer trying pypi for things.. easier to upgrade :) | 23:04 |
| _cerberus_ | Noted | 23:05 |
| *** littleidea has joined #openstack | 23:09 | |
| *** joearnold has joined #openstack | 23:12 | |
| *** krish_ has quit IRC | 23:15 | |
| *** rnirmal has quit IRC | 23:20 | |
| *** pharkmillups has joined #openstack | 23:22 | |
| *** abecc has joined #openstack | 23:24 | |
| *** pharkmillups has quit IRC | 23:25 | |
| *** krish_ has joined #openstack | 23:27 | |
| *** joearnold has quit IRC | 23:28 | |
| *** abecc has quit IRC | 23:31 | |
| *** pvo has joined #openstack | 23:32 | |
| *** pvo has joined #openstack | 23:32 | |
| *** ChanServ sets mode: +v pvo | 23:32 | |
| *** pvo has quit IRC | 23:39 | |
| *** krish__ has joined #openstack | 23:40 | |
| *** ArdRigh has quit IRC | 23:43 | |
| *** ArdRigh has joined #openstack | 23:43 | |
| *** krish_ has quit IRC | 23:43 | |
| *** jc_smith has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!