Tuesday, 2011-05-17

*** dragondm has quit IRC00:26
*** mszilagyi has quit IRC00:51
*** jdurgin has quit IRC01:05
*** cloudgroups has joined #openstack-dev01:47
*** Binbin has joined #openstack-dev03:13
*** blamar__ has joined #openstack-dev03:23
*** Zangetsue has joined #openstack-dev03:24
*** cloudgroups has left #openstack-dev03:48
*** blamar__ has quit IRC04:54
*** zaitcev has quit IRC06:07
*** Binbin has quit IRC06:19
*** Binbin has joined #openstack-dev06:35
*** jaypipes has joined #openstack-dev08:03
sorengholt: Excellent, thanks for clearing that up.08:51
*** Binbin has quit IRC09:57
*** cweidenkeller has quit IRC10:22
*** markvoelker has joined #openstack-dev11:18
*** cweidenkeller has joined #openstack-dev11:39
*** cweidenkeller has quit IRC11:56
*** cweidenkeller has joined #openstack-dev11:56
*** cweidenkeller has quit IRC12:14
*** cweidenkeller has joined #openstack-dev12:14
*** cweidenkeller has quit IRC12:38
*** cweidenkeller has joined #openstack-dev12:38
*** cweidenkeller has quit IRC12:47
*** cweidenkeller has joined #openstack-dev12:47
*** cweidenkeller has quit IRC12:51
*** cweidenkeller has joined #openstack-dev12:51
daboI just grabbed the latest trunk, and getting the following error running the unit tests: DuplicateFlagError: The flag 'instances_path' is defined twice. First from nova.compute.manager, Second from nova.compute.manager12:53
daboAnyone else getting this? Which definition is the correct one?12:53
*** dprince has joined #openstack-dev12:53
sorennova.compute.manager for sure.12:54
dabosoren: that's what I thought, but the other looks like a more recent change.12:55
dabosurprised that both made it into trunk12:55
sorenOk, now I'm confused.12:56
* soren stares at "nova.compute.manager" and "nova.compute.manager"12:56
sorendabo: Are you pulling my leg?12:58
dabonot intentionally :)12:58
*** alex-meade has joined #openstack-dev12:58
dabothat's what the output said. The actual conflict is in nova.scheduler.driver12:59
dabodidnt' realize that the output was messed up12:59
daboGuess that's a bug in the flags module13:00
sorendabo: Where/when do you get that error?13:02
dabosoren: I ran bzr pull on trunk, and then run_tests.sh13:02
sorendabo: And then you got it right away?13:03
daboI get a bunch of test fails due to Duplicate Flag error. I was going to trash my trunk and start fresh, but wanted to check here first13:04
sorenGimme a sec.13:04
sorenI don't see those errors.13:07
dabook, then somehow my trunk is hosed. Guess it's time to wipe and re-branch13:07
sorenbzr clean-tree?13:07
daboOdd how that can happen, since I never edit trunk OMM13:08
soren"bzr clean-tree --unknown --ignored" even.13:08
dabosoren: ok, that cleaned up the problem.13:13
dabosoren: DVCS whine template: <DVCS I use infrequently> sucks! I just want to <task that's no easier in my fave DVCS but I've learned how it works>!13:13
sorenWhat's the equivalent in git?13:14
*** mattray has joined #openstack-dev13:15
sorengit clean -x, apparantly.13:15
dabosoren: yeah. But I've never seen a virgin branch go "bad" like this.13:15
sorenIt's probably due to leftover .pyc files.13:15
sorenbzr clean-tree doesn't touch anything other than unknown (unversioned) or ignored (e.g. .pyc) files.13:16
sorenThis wasn't a $VCS problem. $VCS was just a tool for cleaning up.13:17
daboit might be something in the venv, which the clean-tree command removed13:19
dabosoren: could be. It's just odd that the only thing I ever do in trunk is pull from lp, and run tests.13:23
*** salv-orlando has joined #openstack-dev13:24
*** taturiello has joined #openstack-dev13:25
sorenIt's not, really :)13:25
sorenDoing that will create all the .pyc files needed to screw something up.13:25
*** taturiello has left #openstack-dev13:26
sorenAnyways, /me wanders off for a number of hours.13:26
*** bcwaldon has joined #openstack-dev13:26
*** Zangetsue has quit IRC13:30
*** Zangetsue has joined #openstack-dev13:31
*** Zangetsue has quit IRC13:57
*** jkoelker has joined #openstack-dev14:06
*** dragondm has joined #openstack-dev14:10
*** rnirmal has joined #openstack-dev14:11
*** yamahata_lt has joined #openstack-dev14:17
*** salv-orlando has left #openstack-dev14:54
*** BK_man_ has joined #openstack-dev15:06
BK_man_hi all. how strict nova deps are? Can I use recent version of eventlet instead of 0.9.12?15:07
*** colinnich has joined #openstack-dev15:19
*** BK_man has quit IRC15:24
*** BK_man_ is now known as BK_man15:24
*** BK_man_ has joined #openstack-dev15:29
*** johnpur has joined #openstack-dev15:29
*** ChanServ sets mode: +v johnpur15:29
*** galthaus_ has joined #openstack-dev15:36
*** BK_man_ has quit IRC15:45
*** jmeredit has joined #openstack-dev15:50
*** bcwaldon has quit IRC15:56
openstackjenkinsProject swift build #260: SUCCESS in 37 sec: http://jenkins.openstack.org/job/swift/260/16:01
openstackjenkinsTarmac: Change the CHANGELOG; now we'll only change it as we cut a release.16:01
vishyBK_man: you will need bleeding edge eventlet16:13
vishyanyone around that can look at my no-db-messaging prototype?16:13
vishyhttps://code.launchpad.net/~vishvananda/nova/no-db-messaging/+merge/6118916:14
BK_manvishy: ok. why pip-requires still contains a reference to 0.9.12 ?16:15
vishynot sure :)16:18
vishyyou need a patched eventlet though16:18
openstackjenkinsProject nova build #905: SUCCESS in 2 min 43 sec: http://jenkins.openstack.org/job/nova/905/16:18
openstackjenkinsTarmac: Improved error notification in network create16:18
vishycomstud, soren: is the new eventlet patch in the ppa now?16:19
comstudhaven't heard that it's in there yet16:20
*** scotticus has joined #openstack-dev16:20
BK_manvishy: I applied eventlet patch and still getting Broken pipe error.16:24
BK_manvishy: http://paste.openstack.org/show/1357/16:25
BK_manvishy: this is using eventlet-0.9.15+ patch https://bitbucket-assetroot.s3.amazonaws.com/which_linden/eventlet/20110513/87/eventlet-socket-timeout.patch16:25
vishyBK_man: I've never seen that error16:26
BK_manvishy: 3 nodes (cc+compute and two computes), 200 instances16:26
vishycomstud: ^^ Is that the same error you were seeing running 100 instances?16:27
vishyi'm wondering if you need to raise ulimit16:27
comstudchecking16:27
BK_manvishy: another error: http://paste.openstack.org/show/1358/ (Socket closed)16:27
* BK_man wondering how can I raise it within start-stop-daemon16:28
comstudno16:28
comstudnot seeing Broken Pipe16:28
comstudBroken Pipe implies you have enough file descriptors in ulimit16:28
comstudsince the connection was active16:29
comstudi mean, since fd was allocated16:29
BK_manin total: 1 Broken pipe error, 2 Socket closed errors. 3/200 failure rate16:29
vishyi wonder if the broken pipe is a cascading failure from socket close...16:30
comstudi wonder if rabbit is closing the socket immediately on connect16:30
comstudyou could see both Socket closed and EPIPE from that16:30
comstudEPIPE if you happen to not catch the socket closed before trying to send()16:30
vishytr3buchet: ping16:33
comstudthat kinda looks to be what's going on16:33
vishycomstud: why would rabbit do such a thing?16:33
tr3buchetvishy: ping16:33
comstudi was seeing it in testing the other day when I was doing something wrong16:33
comstudthat something wrong happened to be invalid login credentials16:33
vishytr3buchet: how are we looking on multi-nic16:33
openstackjenkinsProject nova build #906: SUCCESS in 2 min 41 sec: http://jenkins.openstack.org/job/nova/906/16:34
openstackjenkinsTarmac: Added network_info into refresh_security_group_rules16:34
openstackjenkinsThat fixs https://bugs.launchpad.net/nova/+bug/77330816:34
vishytr3buchet: we only have a couple weeks until milestone 1, I'm hoping to get it in16:34
*** jmeredit has quit IRC16:34
comstudBK_man: did you happen to delete the 'guest' user from rabbitmqserver?16:35
tr3buchetvishy: i've got a few things related to adding networks to project through the api, and then all that's left is making sure the test coverage is there16:35
comstudor set an invalid rabbit_userid/rabbit_password?16:35
BK_mancomstud: nope. just installed rpm and started it. not configuration at all16:35
tr3bucheti expect the tests to take good few days at least16:35
comstudBK_man: Hm.  rabbitmqctl list_users16:36
comstudsee if 'guest' is there16:36
comstudand then see if this matches:16:36
comstud# rabbitmqctl list_user_permissions guest16:36
comstudListing permissions for user "guest" ...16:36
comstud/.*.*.*16:36
comstud...done.16:36
tr3buchetvishy: what's the plan for the hyperV, vmware, and ec2 conflicts?16:36
comstudoops, those are supposed to be tabs i guess16:36
BK_man# rabbitmqctl list_users16:37
BK_manListing users ...16:37
BK_manguest   true16:37
BK_man...done.16:37
comstudok.16:37
comstudi think i'd next check rabbit logs16:37
*** bcwaldon has joined #openstack-dev16:37
BK_mancomstud: the only thing that I do not rip between my test iterations is rabbit config16:37
comstudyou can try a quick test program, also16:39
comstudhttp://paste.openstack.org/show/1362/16:39
vishytr3buchet: can you email the list regarding vmware?  I think the guys from citrix will help there.  I think HyperV we will just have to only support single nic initially.  What breaks in 3c2?16:40
vishys/3c2/ec216:40
BK_mancomstud: passed silently16:41
tr3buchetvishy: the ec2 api is referring to instance['mac_address'] and instance['fixed_ip']16:41
comstudBK_man: Hm.  Well, that's interesting.16:41
vishytr3buchet: those should be fairly easy fixes though, no? It can just use the first from the list16:42
BK_mancomstud: let me add rabbitmq cleanup code to my cleanup sequenct and repeat test16:42
comstudok, the only other thing I can suggest right now is looking at rabbit logs, I think16:42
comstudsince it really appears it is closing the connection on you16:42
tr3buchetvishy: i can also put shims on the instance model for it. that means ec2 will be single nic also16:42
comstudso it must not like something.16:42
tr3bucheti'm fine with either way16:43
tr3buchetwasn't sure if that was a decision i should make16:43
tr3bucheti put shims on the model for now16:43
*** markvoelker has quit IRC16:48
tr3buchetvishy: there is also the tests for the hyperv vmware and libvirt hypervisors16:49
tr3bucheti'll get an email to you today with some specifics16:50
vishytr3buchet: thanks16:50
openstackjenkinsProject nova build #907: SUCCESS in 2 min 48 sec: http://jenkins.openstack.org/job/nova/907/16:58
openstackjenkinsTarmac: Convert instance_type_ids in the instances table from strings to integers to enable joins with instance_types. This in particular fixes a problem when using postgresql.16:58
*** mszilagyi has joined #openstack-dev16:59
vishysandywalsh: ping17:01
*** Tv has joined #openstack-dev17:02
*** scotticus has left #openstack-dev17:02
*** dprince has quit IRC17:03
*** Tv has quit IRC17:06
*** dprince has joined #openstack-dev17:07
*** yamahata_lt has quit IRC17:07
*** Tv has joined #openstack-dev17:09
*** jdurgin has joined #openstack-dev17:10
*** mattray has quit IRC17:16
dprincevishy: just looked at your no-db-messaging branch. Got some errors.17:23
*** zaitcev has joined #openstack-dev17:23
dprincevishy: noted them in the merge prop...17:23
vishycool thx17:23
*** jkoelker has quit IRC17:25
*** jkoelker has joined #openstack-dev17:26
*** dprince_ has joined #openstack-dev17:30
*** dprince_ has quit IRC17:30
*** dprince has quit IRC17:33
*** dprince has joined #openstack-dev17:34
*** blamar has quit IRC17:40
*** jmeredit has joined #openstack-dev17:42
vishydprince: interesting error, not quite sure how i broke that17:56
termiecomstud: heya, i hear you are interested in connection pools for rabbit, i'm intending to write that up today and wanted to see whether you'd started17:57
*** bcwaldon has quit IRC17:57
vishydprince: hmm how did that ever work?17:57
vishydprince: server_management_url != server_manageent_url17:57
*** antonyy has joined #openstack-dev17:58
dprincevishy: looking...17:58
comstudtermie: I have started as a part of working on a bug17:59
vishydprince: not only that but, the . syntax shouldn't be used18:00
vishyit should be token['auth_manageent_url']18:00
comstudtermie: I'm almost finished.. I'll have a branch pushed up soon that I wouldn't mind some feedback on18:00
termiecomstud: k, how soon is soon? (it's something blocking me right now)18:01
comstud2-3 hrs18:01
comstudmaybe much less18:01
comstudi have to deal with a couple other distractions real quick first18:01
termiecomstud: cool, will wait til then18:01
comstudlike my growling tummy18:01
*** blamar__ has joined #openstack-dev18:01
comstudas a part of this, I also have a change to make the 3 topic listeners all use the same connection18:02
comstudwith a wait()18:02
comstudinstead of these greenthreads that poll every .1 seconds18:02
termieright, that was part of my plan too18:02
termiecool, well sounds like you're on the right track, look forward to codeville18:03
comstudthis results in a poll on a single fd..18:03
comstudinstead of these constant send/recvs every .1 seconds for 3 connections18:03
comstudcools :)18:03
termie(unless we're both wrong)18:03
comstudhaha, right :)18:03
openstackjenkinsProject nova build #908: SUCCESS in 2 min 57 sec: http://jenkins.openstack.org/job/nova/908/18:03
openstackjenkinsTarmac: Added missing metadata join to instance_get calls.18:03
comstudi'd probably like to re-factor rpc.py a little more than I'm going to for now18:04
*** hub_cap has joined #openstack-dev18:04
comstudjust trying minimal disruptions to the current code to see how this works18:05
comstudanother thing i'm thinking about...18:05
comstudi wonder if there's any gain to using real threads vs greenlets for some things.18:05
comstudbut i've pushed that to the back of my head for now18:06
comstudwho's going to this meetup Thurs?18:07
comstuddeciding whether or not I want to go18:07
comstudmight try to camp at cloudkick during the day if I can find a corner18:08
termiehmm dunno about a meetup, link?18:15
termiewe tend to have space at our temp offices18:16
sandywalshvishy, just got back ... ping back18:19
vishysandywalsh: just wondering if there is any value to this bp: https://blueprints.launchpad.net/nova/+spec/zones10118:22
vishyseems like all the work is happening in distributed scheduler, do we need a bp for zone stuff?18:22
sandywalshvishy, yeah, I'll kill that one and keep it in dist sched.18:23
sandywalshI can link my summit presentation to the bp if that's sufficient?18:23
vishyi was thinking just marking it superseded by dist sched18:24
sandywalshsure, that's fine18:24
sandywalshfor my future reference, are these sorts of placeholders required as we move from one release to the next? Or can a previous bp carry over?18:25
comstudtermie: http://www.meetup.com/openstack/events/18167311/18:27
*** johan___ has joined #openstack-dev18:27
comstudyou guys going to be at your temp space on Thursday?18:27
johan___merge for LP778678 failed because of jenkins failures unrelated to the patch. does anyone know how to fix jenkins?18:28
pyholeLP Bug #778678: nova.virt.xenapi.vmops _run_ssl() should write directly to stdin instead of file [Status: In Progress, Assignee: Johannes Erdfelt] https://bugs.launchpad.net/bugs/77867818:28
termiecomstud: 7pm, yikes18:29
*** blamar has joined #openstack-dev18:29
comstudyeah, it's kinda late18:29
dprincevishy: I'm filing a ticket now.18:29
termiecomstud: yeah, i expect we'll be here18:29
dprincevishy: the column name is incorrect in auth_tokens.18:29
dprincevishy: in your code you changed the NovaBase model to reflect on the database table instead of using the model definition in models.py.18:30
comstudmight be worthwhile to come out there, if there's anything you want to go over with rabbit connection pooling, anyway18:30
dprincevishy: SInce the column is just plain wrong in the DB your branch breaks auth for the OSAPI. Pretty sweet hey!18:30
termiecomstud: worth it anyway, i'd say, good to co-hackl18:30
comstudyeah18:31
markwashdev question: what would you think if I changed quotas so that if the deployer specifies --quota_instances=-1, instances are unlimited by default18:31
comstudi'll ping you guys for the address18:31
comstudclose to bart?18:31
comstudcan't remember where vishy told me it was18:31
comstudor maybe it was jesse18:32
blamarmarkwash, also the lack of the flag would default to -1 aka unlimited?18:32
termiecomstud: yeah, close to bart, fremont and howard, get off at embarcadero, take the away from the bay exit and walk down fremont18:32
vishydprince: https://code.launchpad.net/~vishvananda/nova/fix-token18:32
vishydprince: not sure if it is worth a db migration or not?18:33
termiecomstud: address == search for rocketspace18:33
markwashblamar: the lack of a flag would probably still mean 10 instances18:33
vishycomstud: even closer to the bus station18:33
markwashsince that is the default value of that flag18:33
dprincevishy: https://bugs.launchpad.net/nova/+bug/78420718:33
comstudsome amount if walking is probably good for me18:33
comstud:)18:33
comstudof18:33
westmaastermie: really? that is so so awesome.  we had a guy apply for a job here and call us rocketspace.18:33
vishydprince: especially since that code will go away when we switch to keystone18:34
termiewestmaas: hmm?18:34
dabowestmaas: maybe they heard we were working with NASA and got confused?18:34
termiewestmaas: called rackspace rocketspace?18:35
westmaastermie: yes18:35
vishycomstud: 181 fremont18:35
comstudyep, got it.18:35
comstudneed anything special to get in?18:35
comstudsecret handshake?18:36
termiecomstud: circumcision18:36
dprincevishy: Even so I'd lean towards a migration.18:36
termiedoesn't hurt as much as you'd expect18:36
vishydprince: ok I started writing one18:36
comstudhaha18:37
blamarlimits don't make any sense to be flags, they're deployment options which should be in the database and not defined in two places (flags + database)18:37
dprincevishy: Cool. Wanna take that ticket then too?18:37
comstudi prob won't make it out til after 11am18:38
markwashblamar: I'm not necessarily disagreeing, just kind of trying to make a smaller change at this time--i.e. I would keep the quota config flags18:38
dprincevishy: Your branch looks Okay otherwise however I'd like to smoke test it again when we get this migration in.18:38
vishyok18:38
vishyI will work on migration18:38
vishyjust have to remember how to query db in sqlalchemy :)18:39
comstudor later, i guess.  i have a mtg until 10:3018:39
comstudand it's probably an 1h:15m trip for me18:40
comstudcan be there in time for lunch at the gold club.18:40
termiehoyoo18:41
comstud:)18:41
dprincemarkwash: -1 seems Okay for the default flag. I'd look for prior art in nova for an 'unlimited' default flag.18:42
comstudok, gonna make some lunch and then get some code pushed up18:43
termieDO IT18:43
termielooking forward to it, i mean18:43
comstudbeen prototyping outside of nova, so I need to merge it in18:43
comstudmostly cut n paste, though18:44
dprincemarkwash: Null for unlimited also seems fine.18:44
comstudok bbs18:44
* comstud &18:44
markwashdprince: yeah actually I like that better, but there doesn't seem to be a way to get DEFINE_integer to accept the string None18:44
termiemarkwash: many people use 0 or -1 for unlimited limits18:54
markwashtermie: cool, that is also the simplest way for me to take care of this, so I'm going for it18:55
*** bcwaldon has joined #openstack-dev19:00
vishyany sqlalchemy geniuses know how to reference another column in an update statement?19:03
ttxMeeting in ~2 hours in #openstack-meeting19:03
dprincevishy: Would something like we did in migration 014 work?19:06
markwashI think the value in the update can be a select statement19:09
markwasherr nm19:09
markwashfalse19:09
termiethese conversations are so terrifying to me after having managed the database for a high traffic production site19:10
termieevery one sounds like "24 hours of downtime"19:10
markwashyeah I get that feeling too19:10
vishygot it19:11
*** rnirmal has quit IRC19:38
openstackjenkinsProject nova build #909: SUCCESS in 2 min 44 sec: http://jenkins.openstack.org/job/nova/909/19:53
openstackjenkinsTarmac: Fixes improper attribute naming around instance types that broke Resizes.19:53
ttxMeeting in one hour in #openstack-meeting !19:59
*** mattray has joined #openstack-dev19:59
*** dprince has quit IRC20:05
openstackjenkinsProject nova build #910: SUCCESS in 2 min 47 sec: http://jenkins.openstack.org/job/nova/910/20:13
openstackjenkinsTarmac: Docstring cleanup and formatting (nova/network dir). Minor style fixes as well.20:13
sorenvishy: Not yet. Will be this evening at some point. There was a surprising amount of work involved in updating to 0.9.15 in Ubuntu.20:15
*** galthaus_ has quit IRC20:16
sorenvishy, comstud: Any particular version of Ubuntu you're most interested in?20:20
* soren has just had an awesome idea20:21
*** salv-orlando has joined #openstack-dev20:23
nhmsoren: does it involve alcohol?20:26
sorennhm: It should!20:27
*** alex-meade has quit IRC20:30
nhmsoren: great, I vote to improve the already good idea with liquor.20:30
bcwaldonseconded20:30
*** antonyy has quit IRC20:36
vishydprince: https://code.launchpad.net/~vishvananda/nova/fix-token/+merge/6130420:37
comstudtermie: lp:~cbehrens/nova/rpc-connection-pool20:53
termiecomstud: sweeet, checking it out20:53
comstudtell me how nasty this is20:54
termieso nasty20:54
termieyou bad boy20:54
comstud:)20:54
* termie got weird20:54
comstudi've not run tests yet20:54
termiethat's not promising20:54
comstudother than i tested my connectionpool class standalone20:54
comstudyeah, well, it's a wip20:54
comstudfigured i'd get you something sooner20:54
comstud:)20:54
termiecool, thanks :)20:54
comstudnp20:55
comstudi can be talked out of using a pool of threads for this, but i kinda like the idea20:56
termiecomstud: i don't see what is to be gained from threads...20:56
comstudthere's some work needed around handling reconnection to rabbit on errors still20:56
comstudthere's probably no gain20:57
comstudalthough what this gives you is..20:58
comstudan easy way to close idle connections when not in use20:58
ttxMeeting starts in 2 min. in #openstack-meeting20:58
comstudbut i suppose some sort of timer could do that also20:58
comstudthere's some tunables that should be flags that are just hardcoded right now, also20:59
comstudif this sucks, we can re-do it entirely.  i won't be offended.21:00
termieno worries, about to take a look at it21:00
comstudi think the 'ConsumerSet' for the topic listeners is what we want, tho21:00
termiecomstud: i was also looking at kombu21:01
termiecomstud: 'cause i guess that is the new version of carrot21:01
comstudahhh21:01
comstudi'm kinda annoyed with carrot.21:01
comstudi'll have to take a peak at that sometime21:02
termieit does some things in a way that would be much more wonderful if it was designed to be used with eventlet to begin with21:03
comstudah21:03
comstudimport eventlet.queue missing21:06
comstudbah, number of fixes to make21:06
*** uvirtbot has joined #openstack-dev21:06
*** bcwaldon has quit IRC21:06
sorenbug 12345621:06
uvirtbotLaunchpad bug 123456 in xine-lib "podcast crashes amarok" [Undecided,Fix released] https://launchpad.net/bugs/12345621:07
soren\o/21:07
*** bcwaldon has joined #openstack-dev21:07
jk0lp12345621:07
pyholeLP Bug #123456: podcast crashes amarok [Status: Fix Released, Assignee: None] https://bugs.launchpad.net/bugs/12345621:07
uvirtbotLaunchpad bug 123456 in xine-lib "podcast crashes amarok" [Undecided,Fix released]21:07
jk0pyhole > uvirtbot21:07
comstudpyhole doesn't tell the project name21:08
comstud:)21:08
comstudfix it!21:08
jk0good call21:08
*** markvoelker has joined #openstack-dev21:12
dabocomstud: check out celery. What I saw of it at PyCon looked much better than carrot.21:12
comstudyeah, i've looked at it somewhat21:13
comstudok, after fixing typos and junk, i have a real failure now21:14
comstudah21:16
termiedabo: celery is sort of a bigger change21:16
termiedabo: we've talked about it a lot21:16
termiedabo: not ruled out but requires a pretty fundamental re-organization of everything21:16
daboI know. The biggest argument in favor of carrot is that it would be a big change to go to anything else.21:17
termiedabo: except for kombu :p21:17
dabohaven't looked at kombu21:17
termiedabo: it is carrot compatible, by same guy just newer code21:17
dabojust figured that as long as comstud was messing around in the internals, he should look at all options.21:17
dabotermie: you mean rather than updating carrot?21:18
termiedabo: carrot was discontinued for whatever reason and kombu replaced it, yes21:19
comstudyeah, a lot of it looks the same21:20
dabothat sucks. Even more reason to move to kombu, then21:20
comstudi can't actually spot a difference at first glance21:20
termieanyway, re celery, it is getting closer to what we want both because it has improved and because the project is moving closer to wanting a task queue21:20
termiebut it will require a much bigger push than what we're working on today21:20
*** pyhole has quit IRC21:22
*** pyhole has joined #openstack-dev21:22
jk0lp12345621:22
pyholeLP Bug #123456 in xine-lib (Ubuntu): "podcast crashes amarok" [Status: Fix Released, Assignee: None] https://bugs.launchpad.net/bugs/12345621:22
uvirtbotLaunchpad bug 123456 in xine-lib "podcast crashes amarok" [Undecided,Fix released] https://launchpad.net/bugs/12345621:22
uvirtbotLaunchpad bug 123456 in xine-lib "podcast crashes amarok" [Undecided,Fix released]21:22
jk0done21:22
comstud:)21:23
termiecomstud: okay, looking at your stuff now, my original plan had just been to use an eventlet.pools.Pool subclass and make it provide Connection instances21:25
comstudi was looking at that, also21:25
termiecomstud: using the existing interface21:25
comstudtrying to remember why I didn't go that way21:25
termieso that .instance() is effectively a .get()21:25
comstudsome of the complications are from trying to handle errors and reconnecting21:26
termiecomstud: looks to me like the existing mechanisms can all be made to work the same way21:27
comstudhmmm yeah.21:29
termiecomstud: i'll hack on it a bit and see if i can provide an example of what i am thinking21:31
comstudi think the hard thing about that was trying to timeout old connections21:31
comstudsay21:31
comstudyou define a max # of conns you want21:31
comstudif you reach the max.. during bursting..21:31
comstudit'd  be nice when things settled down that you could close some21:31
comstudnot sure how easy that might be to implement with pools.Pool21:31
*** hub_cap has quit IRC21:32
comstudi was also just considering keeping an array of connections21:32
comstudand always pop, append21:33
comstudtimer can step through and remove old ones not used since 'x'21:33
comstudi blame overcomplicating this on it having been 1am and i misread something.21:41
* comstud smirks.21:41
* termie shrugs21:41
termiei had some pretty specific ideas in mind, too, so i'm mostly trying to match those21:42
comstudwell, it actuall turns out i think this does what i wanted, also, but i didn't thin it did21:43
openstackjenkinsProject nova build #911: SUCCESS in 2 min 42 sec: http://jenkins.openstack.org/job/nova/911/21:43
openstackjenkinsTarmac: Fixes the naming of the server_management_url in auth and tests.21:43
comstudeventlet (and python) is new to me.. i'm really a C person:)21:44
* Vek affirms--comstud *is* a C person21:45
comstud:)21:45
* jk0 prefers PHP21:45
jk0:D21:45
comstudriiight21:45
jk0jk :P21:45
VekI've programmed in PHP, Perl, Python, Bourne shell, C, JavaScript, even a little Java.21:46
Vek(and yes, I mean I *programmed* in Bourne shell.  A recursive dependency resolver, no less.  *not* fun...but boy I wish I'd saved that code!  ;)21:46
comstudi think i have pools.Pool working.. rpc tests pass21:57
comstudall tests pass21:58
comstudi think there's 1 problem here tho21:59
comstudthe spawn in AdapterConsumer.receive()21:59
comstudcan't really spawn until after the message has been acked22:00
*** alekibango has joined #openstack-dev22:01
*** mgius has joined #openstack-dev22:02
*** johnpur has quit IRC22:04
vishytv: ryu is working on a milder refactor of the exiting network code.22:05
vishytv: if we can be clear the specific calls that melange/dhcp service needs to support he should be able to put the proper stuff in22:05
*** letterj has joined #openstack-dev22:06
*** ChanServ sets mode: +v letterj22:06
Tvvishy: can you skim this quick: https://github.com/tv42/melange-discovery/blob/master/melange-discovery.rst22:06
*** hub_cap has joined #openstack-dev22:06
vishytv: looks interesting22:07
Tvvishy: so the basic idea is to push the decision making into the IPAM service22:08
vishytv: currently working on a "cloud config drive" which could replace the need for virtio 9p fs22:08
Tvvishy: oh i'm actually interested in details of that22:08
Tvvishy: because i think the virtiofs was pretty neat ;)22:08
vishytv: essentially it attaches a fat16 drive that contains config info22:08
Tvvishy: boot time only, then?22:08
vishytv: undetermined.  Looking at the possiblity of making it read/write by host and guest22:09
vishyinitially for boot time config though22:09
Tvvishy: that's pretty much impossible, as evidenced by usb-connected smartphones etc22:09
vishytv: interesting22:10
vishytv: another possiblity is just to use a host only nic22:10
Tvvishy: i don't really like the idea of needing networking to configure networking ;)22:10
comstudhost and guest can't mount fat16 at same time22:10
vishy:(22:11
comstudyou'd need a distributed fs22:11
comstudbut22:11
comstudyou could use the block device22:11
sorenI think we really, *really* need to come up with a stack of use cases.22:11
comstudraw block device to do something22:11
Tvbut why not use something like virtfs, then22:11
*** blamar__ has quit IRC22:11
soren...and determine which are valid and which aren't, and then see how block device, network interface, serial interface, etc. fit those use cases.22:12
Tvi mean, i understand it's virtio-specific for now, but 9p can be transported over any stream..22:12
comstudsoren, sure22:12
sorenSo far, I feel the discussion has been very vague ("what if I want to send sometihng back?"  What is "something", really?)22:12
sorenApart from network config.22:12
comstudi'm not proposing any particular solution yet22:12
soren...which has been quite clear.22:12
comstud:)22:12
comstudyea22:12
vishytv: configuring guests should use something that is extremely compatible22:12
vishytv: i think a special nic device that dhcps from host could work22:13
Tvvishy: sort of yes, but on the extreme side of that is aws-level "compatible with everything" that is hard to use for many people22:13
Tve.g. you can't transport secrets nicely with aws user-data22:13
sorenI think that particular use case is weird, though. In general, configuring network cards dynamically *so* a ssolved problem.22:14
sorenTv: Only because there's no way to turn it off.22:14
Tvsoren: yeah network cards is very easy, think about things like SSL keys and certs instead22:14
sorenTv: If there was a way to just tell the meta-data server that you're done with it, it would be ok. You could grab it at boot time, store it on disk readable only by root, disable the service, done.22:15
Tvsoren: yeah.. the other way around is "hey customer management node, i just created an ssh host key for myself, here it is" -- how do you build trust for that22:16
sorenTv: GetConsoleOutput?22:17
Tvparse the potentially big stream of text for a magic cookie and a base64-encoded blob?22:18
sorenYes.22:18
Tvugly but doable, doable but ugly ;)22:18
sorenIt's not super elegant, but it's delightfully extensible.22:19
*** jkoelker has quit IRC22:26
*** jkoelker has joined #openstack-dev22:27
openstackjenkinsProject swift build #261: SUCCESS in 29 sec: http://jenkins.openstack.org/job/swift/261/22:31
openstackjenkinsTarmac: Use bracketed notation for ip literals in rsync calls, so compressed ipv6 literals work.22:31
*** mattray has quit IRC22:32
*** jmeredit has left #openstack-dev22:33
*** mszilagyi has quit IRC22:51
comstudtermie: lp:~cbehrens/nova/rpc-improvements22:55
termiecomstud: hmm, seems to back out most of your other changes?22:59
comstudyeah23:00
comstudthis probably makes more sense23:00
comstudeasier23:00
comstudand I can implement the timeouts i want around this later23:00
comstudhrm23:01
comstudnova/service.py:95:9: E303 too many blank lines (2)23:01
termiecomstud: doesn't look like you are using the pool anywhere23:01
comstudConnectionPool.get ?23:01
comstudlook @ 'def call'23:01
termieah23:02
termiebut not in service?23:02
comstudi didn't make Service use it23:02
termiei was thinking actually swapping out the implementations23:02
comstudit's only 1 connection now23:02
comstud(Service)23:02
comstudvs 323:02
comstudeverything else will be used out of the pool23:02
comstudthe tests seem to be failing, though, due to fakerabbit Backend not supporting ConsumerSet properly.23:03
comstud(multiplexing 3 consumers onto 1 connection while listening for events for all 3)23:03
termieyou also have a single line that says "fuck"23:03
comstudLOL23:03
comstudprobably.23:03
comstudwhere is that?23:04
termiein consumerset.wait23:04
comstudstrange23:04
* comstud finds that kinda funny.23:04
comstudpushed some comment updates, pep8, and fuck removal.23:06
comstudlooks like i missed fanout_cast()23:06
comstudcan build instance despite test failing.23:10
comstudanyway23:10
comstudThis more like what you were looking for?23:10
termieaye23:10
termienot sure what is required to make fakerabbit work23:10
comstudI'm cool with it working like this23:10
comstudyeah23:10
comstudi only briefly looked at it so far23:11
comstudbut it looks like fakerabbit.Backend.consume() only looks at a single queue23:11
comstudeven tho multiple are registered23:11
comstudprobably not a difficult fix23:11
comstudyeah23:12
comstudok.23:12
termiedo you want to look at fixing fake rabbit or should i?23:13
comstudi see what needs to be done23:13
comstudat least initially23:14
termiethere are a few tests using mocks that are going to be confused as well23:14
comstudtaking a stab at it real quick23:14
comstudlet's see what this does23:20
termie. comstud has disconnected23:21
comstudfail23:23
*** bcwaldon has quit IRC23:27
*** hub_cap_ has joined #openstack-dev23:28
*** hub_cap_ has quit IRC23:28
*** hub_cap has quit IRC23:31
comstudargh23:33
comstudwas sitting here testing in an old branch23:33
*** Tushar has joined #openstack-dev23:34
termiei hate that23:35
*** mgius has quit IRC23:37
comstudok23:40
comstudlooks like i got that test to pass23:40
comstudlet's see if i broke anything else23:40
*** markvoelker has quit IRC23:50
comstudone last time23:51
comstud///looks like there was a bug in fakerabbit anyway, even without any changes.. just wasn't exerised23:52
comstudexercised23:52

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!