Friday, 2010-08-20

gholtcreiht: Yeah, I got that part working already. Actually the way code is now, it took about as long as it took to build a new vm to try it out. :)00:00
*** zooko has quit IRC00:02
creihthehe00:02
creihtYeah it doesn't take much to get it to work00:02
*** adjohn has joined #openstack00:18
*** sophiap has joined #openstack00:24
*** joearnold has quit IRC00:36
*** exlt has quit IRC00:40
*** novas0x2a has quit IRC00:51
*** exlt has joined #openstack00:52
*** ChanServ sets mode: +v exlt00:52
creihthttps://code.launchpad.net/~cthier/swift/middleware_refactor/+merge/3317700:54
creihtgholt: -^00:54
creihtUnit tests and funtional tests pass, and initial testing on my vm looks good00:54
creihtI still need to update docs, so it isn't ready to be approved yet, but wanted to get it up so people could look at it00:54
creihtTo all other onlookers, this change will refactor swift to make better use of wsgi middleware, and also introduces using paste.deploy for wsgi app configuration00:55
creihtThis also means that the swift configs for the web services have to change once this is committed00:55
creihtfeel free to take a look, and comments/bashing are more than welcome00:56
creihtgholt: I'll try to get the doc updates done this evening00:56
*** holoway has quit IRC01:11
*** holoway has joined #openstack01:13
*** holoway has quit IRC01:16
*** holoway has joined #openstack01:18
*** justinsb has quit IRC01:19
*** abecc has quit IRC01:21
*** littleidea has joined #openstack01:25
*** justinsb has joined #openstack01:31
*** hazmat has quit IRC01:32
*** gustavomzw has quit IRC01:34
*** pcrews has quit IRC01:42
*** zooko has joined #openstack01:49
*** abecc has joined #openstack01:50
*** rajijoom has joined #openstack01:55
*** e1mer has joined #openstack02:09
*** sophiap_ has joined #openstack02:10
*** sophiap__ has joined #openstack02:11
*** zooko has quit IRC02:12
*** zooko has joined #openstack02:12
*** tobym has joined #openstack02:13
*** sophiap has quit IRC02:14
*** sophiap__ is now known as sophiap02:14
*** sophiap_ has quit IRC02:14
*** sophiap has quit IRC02:20
*** zooko has quit IRC02:21
*** littleidea has quit IRC02:25
*** littleidea has joined #openstack02:28
*** zooko has joined #openstack02:30
creihtgholt: alright... docs are now committed, and it is ready to be reviewed :)02:33
*** mtaylor has quit IRC02:34
*** ichristo has joined #openstack02:37
*** johnbergoon has joined #openstack02:37
*** zooko has quit IRC02:38
*** yarco has joined #openstack02:41
*** sophiap has joined #openstack02:41
*** yarco has left #openstack02:42
*** sandywalsh has quit IRC02:48
*** sophiap_ has joined #openstack02:54
*** zooko has joined #openstack02:55
*** littleidea has quit IRC02:56
*** sophiap has quit IRC02:57
*** sophiap_ has quit IRC02:59
*** sophiap has joined #openstack03:01
*** littleidea has joined #openstack03:04
*** sophiap_ has joined #openstack03:08
*** sophiap has quit IRC03:10
*** sophiap_ is now known as sophiap03:10
*** jakedahn has joined #openstack03:12
*** novas0x2a has joined #openstack03:18
*** mtaylor has joined #openstack03:29
*** ChanServ sets mode: +v mtaylor03:29
*** zooko has quit IRC03:32
*** littleidea_ has joined #openstack03:37
*** ichristo has quit IRC03:37
*** joearnold has joined #openstack03:40
*** littleidea has quit IRC03:41
*** zaitcev has quit IRC03:46
*** littleidea_ has quit IRC03:48
*** littleidea has joined #openstack03:50
*** abecc has quit IRC04:02
*** e1mer has quit IRC04:09
*** RobertLJ has joined #openstack04:10
*** kashyapc has joined #openstack04:17
*** littleidea has quit IRC04:30
*** e1mer has joined #openstack04:42
*** f4m8_ is now known as f4m804:48
*** lyetz__ has joined #openstack05:02
*** johnbergoon has left #openstack05:04
*** John__ has joined #openstack05:04
*** adjohn_ has joined #openstack05:04
*** John__ has quit IRC05:06
*** adjohn has quit IRC05:07
*** adjohn_ is now known as adjohn05:07
*** RobertLJ has quit IRC05:14
*** joearnold has quit IRC05:14
*** joearnold has joined #openstack05:16
*** John__ has joined #openstack05:18
*** joearnold has quit IRC05:23
*** John___ has joined #openstack05:31
*** John__ has quit IRC05:34
*** John___ has quit IRC05:35
*** silassewell has quit IRC05:36
*** John__ has joined #openstack05:36
*** sophiap has quit IRC05:41
*** sophiap has joined #openstack05:41
*** sirp1 has quit IRC05:42
*** John__ has quit IRC05:45
*** John__ has joined #openstack05:48
*** gholt has quit IRC05:52
*** ibarrera has joined #openstack05:53
*** gholt has joined #openstack05:53
*** John__ has quit IRC05:58
*** guigui has joined #openstack06:02
*** John__ has joined #openstack06:06
*** sophiap has quit IRC06:16
*** mj0ne has joined #openstack06:35
*** johnbergoon has joined #openstack06:36
*** johnbergoon has quit IRC06:43
*** hazmat has joined #openstack07:00
*** yaneti has joined #openstack07:11
yanetijust a minor quibble07:12
yaneti"07:12
yanetiopenstack@lists.launchpad.net07:12
yanetiPolicy: You must be a team member to subscribe to the team mailing list.07:12
yaneti"07:12
yanetireally ?07:12
yanetinot that I don't have an account in launchpad but "team member" ...07:13
yanetianyways, cheers07:14
*** yaneti has left #openstack07:14
*** John___ has joined #openstack07:27
*** John__ has quit IRC07:27
*** calavera has joined #openstack07:28
*** miclorb_ has quit IRC07:48
*** alekibango has joined #openstack07:51
*** rnewson has joined #openstack08:01
*** imeyer has quit IRC08:02
*** John___ has quit IRC08:03
*** imeyer has joined #openstack08:03
*** allsystemsarego has joined #openstack08:15
*** zheng_li has joined #openstack08:21
*** pkhamre has quit IRC08:24
*** michalis has joined #openstack08:25
*** pkhamre has joined #openstack08:39
*** mj0ne- has joined #openstack08:39
*** mj0ne has quit IRC08:41
*** chilts_ has quit IRC08:42
*** chilts has joined #openstack08:42
*** ibarrera has quit IRC08:42
*** DogWater has quit IRC08:42
*** ibarrera has joined #openstack08:42
*** DogWater has joined #openstack08:46
*** guigui has quit IRC09:03
*** gasbakid has joined #openstack09:13
*** John__ has joined #openstack09:27
*** jpopi has left #openstack09:34
*** hazmat has quit IRC09:39
*** John__ has quit IRC09:49
*** rajijoom has quit IRC10:15
*** larissa has joined #openstack10:38
*** Robi_ has joined #openstack10:39
*** gasbakid has quit IRC10:41
*** gustavomzw has joined #openstack10:43
*** adjohn has quit IRC10:47
*** adjohn has joined #openstack10:50
klumpieaccount on10:52
klumpie<- drunk, sorry :o10:52
*** justinsb has quit IRC11:02
*** e1mer has quit IRC11:11
*** Podilarius has left #openstack11:12
*** ctennis has quit IRC11:12
*** justinsb has joined #openstack11:15
*** calavera has quit IRC11:17
*** kashyapc has quit IRC11:23
*** ctennis has joined #openstack11:27
*** sandywalsh has joined #openstack11:27
*** guigui has joined #openstack11:41
*** justinsheehy has quit IRC11:42
*** John__ has joined #openstack11:54
*** littleidea has joined #openstack12:00
*** justinsheehy has joined #openstack12:01
*** guigui has joined #openstack12:03
*** justinsheehy has quit IRC12:09
*** alekibango has quit IRC12:10
*** alekibango has joined #openstack12:11
*** johnbergoon has joined #openstack12:17
*** John__ has quit IRC12:17
*** guigui has quit IRC12:19
*** justinsheehy has joined #openstack12:29
*** gasbakid has joined #openstack12:43
*** aliguori has joined #openstack12:44
*** perestrelka_ has joined #openstack12:49
*** perestrelka has quit IRC12:51
*** perestrelka_ is now known as perestrelka12:51
*** jforester has joined #openstack12:56
*** drewlander has joined #openstack12:56
*** John__ has joined #openstack13:04
*** metoikos has quit IRC13:04
*** metoikos has joined #openstack13:05
*** johnbergoon_ has joined #openstack13:11
*** johnbergoon has quit IRC13:11
*** johnbergoon_ is now known as johnbergoon13:11
*** sophiap_ has joined #openstack13:13
*** johnbergoon has quit IRC13:16
*** ichristo has joined #openstack13:19
*** John__ has quit IRC13:24
*** gondoi has joined #openstack13:30
*** johnbergoon has joined #openstack13:31
*** ppetraki has joined #openstack13:31
*** ambo_ has left #openstack13:32
jeromorning13:32
*** justinsb has quit IRC13:46
*** aghaster has joined #openstack13:46
aghasterHi13:46
aghasterI successfully set up a swift installation in a virtual machine using the guide for swift all-in-one13:47
aghasterI started using php-cloudfiles to connect to it and send some simple commands, and did the same manually with curl13:47
aghasteris there any kind of web interface available?13:47
aghasterit'd be much easier13:47
aghasterI know there's cyberduck, but it's for mac os x only13:48
*** tobym has quit IRC13:49
*** f4m8 is now known as f4m8_13:49
notmynameaghaster: the trick is finding something that works with swift and doesn't assume cloud files13:51
notmynamefor example, fireuploader (a firefox extension) works with cloud files, but it will only work with swift if you can switch the auth url in fireuploader13:52
notmynameCloud Mobile is an iPhone app that will work with swift13:53
*** abecc has joined #openstack13:53
*** pcrews has joined #openstack13:55
*** Glace has joined #openstack13:56
*** Glace is now known as Guest72113:57
Guest721Hi, is it possible to use IPOIB for ring replication?13:57
*** Guest721 is now known as Glacee13:57
notmynameGlacee: IPOIB?13:57
Glaceefor swift13:57
GlaceeIP over infiniband13:58
GlaceeI want to use infiniband instead of 10gbe13:58
*** dendro-afk is now known as dendrobates13:58
notmynamesince swift is all at the application layer, the interconnects shouldn't matter too much13:58
notmynameuse token ring if it makes you happy :-)13:59
Glaceeok thanks..13:59
Glaceei will try it with infiniband13:59
aghasternotmyname: is there a page on the wiki that lists compatible apps?13:59
notmynameaghaster: no, I don't think so13:59
aghasterI'll try fireuploader then14:00
notmynameaghaster: look for 3rd party tools for cloud files and you may run across some other things14:00
notmynameGlacee: when you get it working, let us know. we don't use it at rackspace, so it would be good info for the next person who asks14:01
Glaceehehe sure14:01
Glaceei will receive my stuff within the next month and i will let you know14:01
notmynameGlacee: so to read between the lines: I don't know anything about infiniband. but I don't know why it won't work14:02
Glaceeyeah i understood that hehe.. but yes this is what i was thinking.. if I use it as IP over infiniband.. so I give an ip adress to my IB card.. it should be fine14:02
*** justinsheehy has quit IRC14:03
notmynameis infiniband more expensive than 10gbe?14:04
Glaceesuper less expensive14:04
Glacee:014:04
Glaceeand a lot faster14:04
Glaceedepends on your IB adapter and swtiches.. but you can go up as 25000mb14:05
Glaceethe best card and swtiches are 40gb14:05
Glaceea switch is around 5k and cards around 500-60014:06
*** hazmat has joined #openstack14:06
Glaceebut cables are more expansive.. about 60$ for 3feet14:07
notmynameour setup for cloud files is (multiple) 10gbe to the proxy servers and then 1gbe to the storage nodes14:07
Glaceecool.. i want to try infiniband for proxy servers and 1gb for storage nodes14:07
notmynameif you are using SSL (recommended for all but a completely private cluster), you may have some issues filling up the pipe14:10
*** mrayzenoss has joined #openstack14:14
*** mrayzenoss is now known as mray14:14
*** mray has joined #openstack14:14
*** tobym has joined #openstack14:14
*** mfoemmel has joined #openstack14:18
*** pvo has joined #openstack14:32
*** ChanServ sets mode: +v pvo14:32
*** sophiap_ has quit IRC14:33
*** Podilarius has joined #openstack14:37
*** Jim_Shew has joined #openstack14:38
*** sophiap has joined #openstack14:41
*** allstatehosting has joined #openstack14:42
*** cvanes has joined #openstack14:42
*** ibarrera has quit IRC14:48
*** sirp1 has joined #openstack14:49
*** cvanes has quit IRC14:51
*** dendrobates is now known as dendro-afk14:57
*** justinsheehy has joined #openstack15:06
*** dendro-afk is now known as dendrobates15:22
*** zooko has joined #openstack15:44
ctennisok, so if I'm building a ring on a device, and point it to some remote ip address nodes, I also have to similarly build the same ring on that device and point it back to the first node right?15:53
creihtctennis: We generall build the ring with all devices on it on one machine, and then distribute that ring out to all the servers15:54
ctennishow does it distribute?15:55
creihtThe ring should have all the storage devices that you want15:55
creihtctennis: that is left as an excersize for the reader :)15:55
creihtbut you could scp it15:55
creihtor have an rsync job on each machine that pulls the latest copy15:55
ctennisjust the ring.gz file?15:55
creihtetc.15:55
creihtyeah15:55
ctennisok, what about the secondary servers, like the reapers and whatnot, do they need to be running on all of the nodes as well?15:56
creihtand you will need a ring.gz for the object, container, and account15:56
creihtctennis: all the services need to be run as well15:56
ctennison each node15:56
creihtyes15:56
ctennisok, great15:56
creihtfor each server type15:57
creihtso if you aren't running the account server on a node, it doesn't need the other account-* services15:57
ctennisI assume though that in building the ring, we can't use 127.0.0.1 as an address, since if that gets distributed to another node, it won't know about the correct IP of the first one15:57
creihtcorrect15:57
ctennisrealizing it works fine in the examples for doing everything on just one machine though15:57
ctennisok, awesome15:57
ctennisonce the ring is built, does the .gz file change at all via other external means?15:58
creihtnope15:58
ctennisie, do we need to worry about keeping it rsynced15:58
creihtonly if you manually change it15:58
ctennisok, awesome15:58
ctennisthanks for the hints15:58
creihtnormally we have an admin machine that we do all the ring management on, then the rings get pushed out15:58
ctennisthe servers needed re-inited after a ring change then?15:59
creihtWe also have something that checks the md5sums of the rings on all the nodes to make sure we don't accidently get a node with the wrong ring15:59
creihtThe servers will reload the ring (within 15 seconds)15:59
ctennisawesome, so there's no need to tell them to manually rebalance on a ring change then?16:00
creihtcorrect, once you push out the rings, it should all take care of itself16:00
*** dendrobates is now known as dendro-afk16:00
creihtreplicators will pick up that partitions aren't supposed to be on there any longer, and rsync them to their new location16:00
creihtAnd I'm supposed to be off today, so time to spend some time with the kids :)16:02
zookoGood morning (UTC-6), people of #openstack.16:02
ctennisthanks creiht16:05
*** adjohn has quit IRC16:06
*** cwarner__ has joined #openstack16:16
cwarner__Hello, everyone. :)16:17
*** johnbergoon has quit IRC16:21
cwarner__I have a question about multi-tenancy in Swift. Objects are stored in ring partitions based purely on the MD5 of their contents, right? Does this mean that data from different customer accounts is co-mingled on the devices?16:23
*** zheng_li has quit IRC16:24
ctenniscwarner__ yes, that is correct16:28
gholtOther than it's the MD5 of the object's path, yes.16:28
cwarner__Ah, okay. Great, thanks! :)16:28
ctennisgholt: in allocating space for the various server data, I assume you allocate a lot more for the object-server than the container and account servers?16:29
*** johnbergoon has joined #openstack16:31
*** johnbergoon_ has joined #openstack16:33
*** johnbergoon has quit IRC16:33
*** johnbergoon_ is now known as johnbergoon16:33
*** joearnold has joined #openstack16:34
*** joearnold has quit IRC16:41
*** dendro-afk is now known as dendrobates16:41
*** cwarner__ has quit IRC16:42
*** joearnold has joined #openstack16:42
*** zheng_li has joined #openstack16:46
*** gasbakid_ has joined #openstack16:48
*** gasbakid_ has joined #openstack16:49
*** spsneo has joined #openstack16:53
redboctennis: they actually cohabitate on our installation.  But yeah, accounts generally take up little space, containers medium space, and objects lots of space.16:54
*** gasbakid has quit IRC16:55
*** mtaylor has quit IRC17:05
*** michalis has quit IRC17:10
*** JimCurry has joined #openstack17:20
*** pvo has quit IRC17:20
*** holoway has quit IRC17:27
*** mtaylor has joined #openstack17:28
*** ChanServ sets mode: +v mtaylor17:28
*** holoway has joined #openstack17:29
*** tobym has quit IRC17:32
*** holoway has quit IRC17:32
*** holoway has joined #openstack17:34
*** joearnold has quit IRC17:36
*** joearnold has joined #openstack17:37
*** rnewson has quit IRC17:45
*** rnewson has joined #openstack17:46
*** rnewson has joined #openstack17:46
mtaylorsoren: I got distracted by some things ... I'll try to get some swift packaging stuff pushed up for you to look at here in just a bit17:48
mtaylorletterj: ^^17:48
letterjmtaylor:  Cool,  I redid my merge to only include the rsync dependency and removed the duplicate net-tools reference17:49
mtaylorletterj: yup. saw that.17:50
letterjAt some point we need to have a good discussion about what the packages are suppose to do.17:51
*** jc_smith has joined #openstack17:54
*** tobym has joined #openstack17:59
vishydoes anyone know where auth.py came from?18:03
vishyi don't know how to do git blame with bzr18:03
cwannotate?18:07
* cw is guessing18:07
cwyeah, that works18:08
*** johnbergoon_ has joined #openstack18:09
*** johnbergoon has quit IRC18:09
*** johnbergoon_ is now known as johnbergoon18:09
*** jakedahn has quit IRC18:16
*** pvo has joined #openstack18:16
*** ChanServ sets mode: +v pvo18:16
*** brd_from_italy has joined #openstack18:24
*** brd_from_italy has quit IRC18:26
*** Jim_Shew has left #openstack18:27
gholtMost stuff will be attributed to creiht, since he did the initial uploads. :)18:28
gholtBut, in this case, he did write auth.py in swift.18:29
*** rnewson has quit IRC18:33
*** johnbergoon has quit IRC18:45
*** pcrews is now known as pcrews_lunch18:56
termiesoren: ping, was wondering whether denmark has telcos that offer flat rate data prepaid19:21
*** ichristo has quit IRC19:21
termiesoren: or alternatively at least who some mobile providers tehre are19:21
*** brd_from_italy has joined #openstack19:24
*** londo_ has quit IRC19:35
*** joearnold has quit IRC19:44
*** rnewson has joined #openstack19:45
*** pcrews_lunch is now known as pcrews19:46
*** Daviey has quit IRC19:49
*** Daviey has joined #openstack19:49
*** blpiatt has joined #openstack19:50
*** joearnold has joined #openstack19:51
blpiattanyone here able to answer some questions or point me to documentation about the vlan and advanced networking features in nova?19:51
edayblpiatt: http://nova.openstack.org/network.html is the best there is at the moment19:51
blpiatteday, perfect thanks19:52
*** joearnold has quit IRC20:00
*** Xenith has joined #openstack20:02
*** pquerna_ has joined #openstack20:04
*** pquerna has quit IRC20:06
*** sirp1 has quit IRC20:07
*** sirp1 has joined #openstack20:16
*** zaitcev has joined #openstack20:22
*** brd_from_italy has quit IRC20:26
*** novas0x2a has quit IRC20:41
*** sparkycollier has joined #openstack20:42
*** mtaylor has quit IRC20:45
*** joearnold has joined #openstack20:46
*** littleidea_ has joined #openstack20:53
vishyblpiatt: i know quite a bit about it if you have any questions20:54
*** littleidea has quit IRC20:55
jerodoes that include some form of IP filtering mechanism a la ec2's security groups  ?20:55
jerooh, yes20:55
*** pquerna_ has quit IRC20:56
*** pquerna_ has joined #openstack20:56
*** pquerna_ is now known as pquerna20:56
*** allsystemsarego has quit IRC20:58
*** ctennis has quit IRC20:58
*** sparkycollier has quit IRC20:59
vishyjero: security groups aren't implemented yet21:03
zaitcevI'm afraid I need coaching in Python.21:03
*** londo_ has joined #openstack21:03
zaitcev  File "/usr/lib/python2.7/site-packages/swift-1.0.2-py2.7.egg/swift/common/bufferedhttp.py", line 80, in connect21:03
zaitcev    return HTTPConnection.connect(self)21:03
zaitcev  File "/usr/lib64/python2.7/httplib.py", line 736, in connect21:04
zaitcev    self.timeout, self.source_address)21:04
zaitcevTypeError: create_connection() takes at most 2 arguments (3 given)21:04
vishyyour code or distro?21:04
zaitcevWhen I copy-pasted the code from bufferedhttp.py into my own test.py, it worked fine.21:04
vishydifferent version of httplib?21:05
zaitcevA possiblity, yes.21:05
*** gasbakid_ has quit IRC21:05
zaitcevActually, it should not be. But it's Python, and I'm entirely clueless about its workings.21:05
jerovishy: are they planned ?21:06
vishyjero: unsure21:10
vishyeventually yes21:10
vishyi should say that they are definitely planned, but they may not fit the aws api perfectly21:10
vishyso we'll have some sort of translation layer21:10
*** ctennis has joined #openstack21:13
*** gasbakid_ has joined #openstack21:19
jerovishy: does that mean instances should address network-level security at the guest os level ? or is there some kind of alternative mechanism21:20
jeroeg. to allow selective traffic between instances without knowing their ip addresses in advance21:21
*** littleidea_ has quit IRC21:23
*** novas0x2a has joined #openstack21:37
*** JimCurry has left #openstack21:38
*** ppetraki has quit IRC21:46
*** jk0 has quit IRC21:49
*** jk0 has joined #openstack21:49
*** jk0 has joined #openstack21:49
*** ChanServ sets mode: +v jk021:49
*** justinsheehy has quit IRC21:50
*** JimCurry has joined #openstack21:52
*** tobym has quit IRC21:53
*** coredump777 has quit IRC21:57
*** Bumiga has joined #openstack21:58
*** rnewson has quit IRC22:13
*** mtaylor has joined #openstack22:19
*** ChanServ sets mode: +v mtaylor22:19
*** dendrobates is now known as dendro-afk22:26
*** gondoi has quit IRC22:28
*** novas0x2a has quit IRC22:29
*** novas0x2a has joined #openstack22:30
*** metoikos has quit IRC22:30
*** Bumiga has quit IRC22:30
*** metoikos has joined #openstack22:30
*** JimCurry has left #openstack22:31
*** Podilarius has left #openstack22:32
vishyjero: right now it is trivial for all instances in a given project to be isolated22:39
vishyjero: we will have some sort of support for security groups, but rather than have it actually create unique subnets it will probably just be setting rules up per-instance22:41
sorentermie: Mobile, you mean? Sure.22:45
*** novas0x2a1 has joined #openstack22:46
*** blpiatt has quit IRC22:47
*** novas0x2a has quit IRC22:47
*** novas0x2a has joined #openstack22:48
*** mray has quit IRC22:49
*** tobym has joined #openstack22:51
*** novas0x2a1 has quit IRC22:52
*** vishy has quit IRC23:05
*** vishy has joined #openstack23:05
vishyhmmm...no permissions for logs at irclogs.openstack.org/logs23:08
*** littleidea has joined #openstack23:14
mtaylortits23:15
mtaylorvishy: sorry - that's my fault23:15
mtaylorvishy: fixed23:19
*** mtaylor has quit IRC23:25
*** luisico has joined #openstack23:25
*** sirp1 has quit IRC23:33
*** nika has joined #openstack23:44
*** mtaylor has joined #openstack23:52
*** ChanServ sets mode: +v mtaylor23:52
*** sirp1 has joined #openstack23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!