Wednesday, 2011-01-05

*** kevnfx has quit IRC00:00
nelson__question about /etc/swift/swift.conf#swift_hash_path_suffix00:03
nelson__why does it have to be a "random string of text"?00:04
nelson__is it for security reasons? Or just to ensure that short object names get well hashed?00:04
*** anotherjesse has joined #openstack00:04
*** dubsquared has quit IRC00:06
*** schisamo has quit IRC00:13
*** dfg_ has quit IRC00:21
*** rnirmal has joined #openstack00:21
*** allsystemsarego has quit IRC00:24
*** anotherjesse has quit IRC00:24
*** Ryan_Lane has quit IRC00:24
notmynamenelson__: heh. funny story about that00:34
notmynameok, maybe not really funny00:34
nelson__haha, I'm laughing already and we haven't even gotten to the punch line.00:34
notmynamewe has some people internally concerned with customers generating hash collisions. this was before we even talked about open-source and it would require a preimage attack (which has never been done, even with md5)00:35
notmynameso we offered persuasive arguments on why we didn't need it00:36
notmynameand then we added it because it was easier and doesn't really hurt anything00:36
notmynameso it's prepended to every request before the request is hashed to do the ring lookup00:36
notmynameso keep it secret and you can't ever change it (or every single object in the ring get's moved with replication)00:37
notmynameso it's kinda for security reasons, but only for vulnerabilities that have never happened. it's not a bad thing, but....00:39
*** ccustine has quit IRC00:39
*** dendrobates is now known as dendro-afk00:40
vishyconsidering using lockfile00:41
notmynamethe best argument for adding it was given by redbo. if one could generate many object names that hashed near to one another, and attacker could fill up one partition very quickly. by adding the prefix, you are protected because the attacker can't find the proper hash00:41
*** rlucio has quit IRC00:45
*** rlucio has joined #openstack00:45
nelson__so it shouldn't be *too* awful long. Like maybe the first part of a uuid?00:47
*** dendro-afk is now known as dendrobates00:48
nelson__annoyingly, Ubuntu doesn't install `uuid` by default.00:49
notmynameya, that would be good. or even a whole uuid in hex. don't make it huge. I'm not a security expert, but there may be something about being able to precompute the first blocks of a hash (not sure about md5, I know sha1 works that way), so it may be good to keep it less than the md5 block size00:49
nelson__dd if=/dev/random count=4 | od -x       :-)00:51
notmynameactually, thinking about it more, I think that since it's a prefix, that's not a problem (the block size thing). just some random characters or the name of your first pet or the ssn of your ceo or something ;-)00:51
notmynameya, that would be perfect :-)00:51
nelson__oh fuck, why can't programs just shut up and do their work??00:52
notmynamegotta go00:53
nelson__this is better: od -t u4 -N 4 -A n </dev/random00:55
nelson__Okay, I think I have that section of the docs in good shape. Thanks, notmyname.01:00
*** dirakx has quit IRC01:02
*** olivier_ has quit IRC01:05
*** olivier_ has joined #openstack01:05
*** sophiap_ has joined #openstack01:17
*** Ryan_Lane has joined #openstack01:21
*** sophiap has quit IRC01:22
*** sophiap_ is now known as sophiap01:22
*** jdurgin has quit IRC01:23
*** kevnfx has joined #openstack01:24
*** PiotrSikora has quit IRC01:31
*** MikeZ1 has quit IRC01:33
*** maplebed has quit IRC01:33
*** skrusty has quit IRC01:35
*** schisamo has joined #openstack01:35
*** Jordandev has quit IRC01:41
*** MarkAtwood has quit IRC01:41
*** MikeZ has joined #openstack01:44
*** skrusty has joined #openstack01:47
*** joearnold has quit IRC01:49
*** PiotrSikora has joined #openstack02:04
*** ccustine has joined #openstack02:04
*** MarkAtwood has joined #openstack02:05
*** Ryan_Lane has quit IRC02:09
*** sandywalsh has quit IRC02:16
*** Jordandev has joined #openstack02:18
*** masumotok_ has quit IRC02:24
*** sandywalsh has joined #openstack02:29
*** MikeZ has quit IRC02:32
*** Cybo has joined #openstack02:42
*** MarkAt2od has joined #openstack02:44
*** ccustine has quit IRC02:56
*** daleolds has quit IRC02:57
*** trin_cz has quit IRC03:19
*** jbryce has quit IRC03:19
Jordandevi am using RabbitMQ. Please, any advice about the best publisher/consumer: pika (I like it), carrot (others)...?03:25
*** Ryan_Lane has joined #openstack03:27
*** sophiap has quit IRC03:28
Jordandevwhat you think about kombu for AMQP?03:36
Jordandevany d03:36
Jordandevany feedback ? :)03:36
sandywalshJordandev, we're using carrot in nova currently03:40
sandywalshbut jk0 didn't exactly rave about it :)03:40
Jordandevfrom carrot site: "discontinued; Use Kombu instead"03:41
*** aliguori has quit IRC03:46
Jordandevsandywalsh, what is the main advantage of carrot compared to others like Pika?03:47
winston-dMy swift-bench test results: http://paste.openstack.org/show/395/03:47
winston-dNo much improvement compared to yesterday's.03:48
sandywalshJordandev, I personally haven't compared them. Carrot is a pretty thin wrapper.03:49
sandywalshJordandev, that's interesting about the carrot note. I'll pass that along.03:49
Jordandevthanks sandywalsh :)03:50
sandywalshJordandev, np, wish I could be of more help03:50
Jordandev:)03:51
*** mdomsch has joined #openstack03:56
*** Ryan_Lane has quit IRC04:03
*** Jordandev has quit IRC04:13
*** shermanboyd has quit IRC04:28
*** shermanboyd has joined #openstack04:28
*** shermanboyd has quit IRC04:30
*** dirakx has joined #openstack04:40
notmynamewinston-d: I'm running swift all-in-one on a 1024 slice. no tuning. xfs mounts are done on a loopback. basic config for dev only. absolutely zero effort spent on performance. http://paste.openstack.org/show/396/04:41
winston-dnotmyname: what do you mean by 1024 slice?04:47
notmynameslicehost 1GB slice04:48
winston-dmy swift setup is: 1 proxy, 1 auth (same machine); 6 account/container/object04:48
winston-d1GbE network connection, 3 replicate04:49
winston-daccording to creiht, my result is "incredibly slow"04:50
notmynameI just wanted to give you a baseline of numbers to expect. more machines should == more performance. we can get about 70 req/s on a VM on a laptop. you see my numbers for a dedicated VPS04:50
notmynameyes. "incredibly slow" is a nice way to say it ;-)04:50
winston-dany idea what is wrong with my system? or what should I look at first?04:52
notmynamethat's something that creiht can probably help with more than me (he's got a lot more experience walking people through setting up swift)04:52
notmynameI would look at your worker count (I'm using the default04:53
notmynamedo you know where you are slowing down? network? cpu?04:53
winston-dyou are right. yesterday creiht suggest the same thing.  I did modified worker count based on his recommendation.04:53
notmynameactually, I remember him saying something about that. which is why I think it's a good place to start :-)04:54
notmynamebur, really, it's hard to tune something when you don't know where it's slow. perhaps you could run a longer swift-bench run and do some profiling of the machines?04:55
winston-dgood idea.04:55
notmynamesince you are doing a multi node setup, I would look at the network utilization. are you routing through some switch that is limiting you? or maybe you are maxing one core on a node and need to increase workers04:56
winston-dno, my nodes are connected to the same GbE switch04:57
winston-dand I've already increase workers to 1x core count04:57
notmynamecreiht wrote swift-bench to give everyone a common set of tests so we could compare apples to apples. but you could do something like curl commands in a loop04:58
*** krish has joined #openstack04:58
*** Lcfseth has joined #openstack04:59
*** EdwinGrubbs has quit IRC04:59
winston-dswitch-bench is suppose to delete everything it creates after test (in default setting), right?04:59
notmynamethat won't give you good numbers to compare, but it may highlight a bottleneck04:59
notmynameyes, I think so04:59
*** krish has left #openstack05:01
notmynameif you look in the logs on the storage nodes, you will see what requests to them look like. you could also do requests yourself from the proxy node to the storage nodes to check the connectivity there05:01
winston-dalrite05:02
notmynameare you running memcache?05:02
notmynamecould it be something as simple as the auth token not being cached (or account/container existence)05:02
winston-dyes05:04
notmynamehmm..that would have been simple to fix :-)05:04
winston-dlet me restart 'memcached' service and try again05:04
winston-dI followed the instructions here to setup my testbed: http://swift.openstack.org/howto_installmultinode.html05:04
winston-ddidn't find any configuration for 'memcached'05:05
winston-dis there any?05:05
notmyname[filter:cache] section of the proxy server conf05:06
winston-dOK. that's what i did05:06
winston-danother question, when swift-bench is done, i found there's some directories and files let on XFS disks.  is that normal?05:07
notmynamemayber?05:07
notmynamemaybe?05:07
notmynameI'm not sure. actually, tonight is the first time I've run swift-bench05:08
winston-deven when i try st delete --all, there's still something05:08
winston-dalthough 'st list' didn't show any05:08
notmynamedeleting objects actually only creates tombstone files. the background processes take care of reclaiming the space on disk05:09
notmynameif you look in the proxy log, the last field is the time the request took05:11
winston-dOK. let me check05:11
notmynameyou could upload a 1K file and then fetch it and look at the times in the logs05:11
notmynamethings to look for will be times very close to 3 seconds or 10 seconds05:12
notmynameboth are used for various timeouts in the system05:12
*** EdwinGrubbs has joined #openstack05:12
*** EdwinGrubbs has joined #openstack05:12
notmynameactually, you should probably do zero byte files rather than 1K files. either way, adjust the math and you can get throughput rates05:13
winston-dI see.05:13
notmynamezero byte objects should highlight timeout errors. obviously it's hard to see timeouts if some requests actually take 3 or 10 seconds because of the amount of data transferred05:14
*** blpiatt has joined #openstack05:15
*** Cybo has quit IRC05:16
*** shermanboyd has joined #openstack05:19
winston-dnotmyname: how can i configure swift component to use its own log file instead of syslog?05:23
winston-dproxy server log is now messing-up with rest of system05:23
notmynamecheck out http://swift.openstack.org/overview_stats.html#running-the-stats-system-on-saio05:24
notmynamesteps 2-5 set up the proxy logs to go to a separate file05:24
*** rnirmal has quit IRC05:25
notmynameoh, and step 7 too05:25
*** michaeldreamhost has quit IRC05:27
winston-dnew result after restarted memcached service: http://paste.openstack.org/show/397/05:27
winston-dPUT still sucks, but GET and DEL are much better05:27
winston-dstill much lower than your baseline, though05:28
*** guynaor has joined #openstack05:31
*** guynaor has left #openstack05:31
*** kashyapc has joined #openstack05:32
*** Ryan_Lane has joined #openstack05:33
*** michaeldreamhost has joined #openstack05:33
*** hadrian has quit IRC05:33
*** Ryan_Lane is now known as Ryan_Lane|away05:39
*** shermanboyd has quit IRC05:39
*** Lcfseth has left #openstack05:41
*** jbryce has joined #openstack05:47
*** f4m8_ is now known as f4m806:07
*** ramkrsna has joined #openstack06:12
*** ramkrsna has quit IRC06:17
*** mdomsch has quit IRC06:22
*** ramkrsna has joined #openstack06:29
*** MarkAt2od has left #openstack06:41
*** MarkAtwood has quit IRC06:41
*** miclorb has quit IRC06:53
*** ramkrsna has quit IRC06:54
*** ramkrsna has joined #openstack06:54
*** kevnfx has quit IRC07:00
*** larstobi has joined #openstack07:02
*** larstobi has quit IRC07:19
*** littleidea has quit IRC07:33
*** zaitcev has quit IRC07:35
*** guigui1 has joined #openstack07:35
*** rcc has joined #openstack07:42
ttx<rlucio> looks like there is some web url you are supposed to use to create an account07:44
ttxuh?07:44
ttxYou're confusing UEC (based on eucalyptus) and the UEC images. the web UI is for eucalyptus credentials07:47
ttxrlucio: If you create a key with euca-add-keypair and pass it as "-k" to the euca-run-instances, it will get imported in the ubuntu user authorized_keys, to allow for SSH login07:47
ttxThe password on the serial console is only if you use "uncloudinit" (to run outside a cloud)07:49
ttxdubsquared: ^07:51
*** brd_from_italy has joined #openstack07:58
*** blpiatt has quit IRC08:01
*** rcc has quit IRC08:02
ttxFor those who missed the meeting yesrterday (spectorclan?), see the logs at http://wiki.openstack.org/MeetingLogs08:05
*** fabiand has joined #openstack08:11
*** dirakx has quit IRC08:30
*** calavera has joined #openstack08:38
*** miclorb_ has joined #openstack08:39
*** littleidea has joined #openstack08:44
*** irahgel has joined #openstack08:59
*** Firaga has joined #openstack09:13
Firagahello09:14
Firagaanyone whose successfully created an image for openstack compute, like CentOS/Windows image for openstack?09:14
*** allsystemsarego has joined #openstack09:15
*** allsystemsarego has joined #openstack09:15
Firagaanyone whose successfully created an image for openstack compute, like CentOS/Windows image for openstack?09:22
sorenxtoddx: Did you really intend to remove the "audit=INFO" element from the default_log_levels list?09:25
*** arthurc has joined #openstack09:27
fraggelnanyone have a clue on where to look when I get this error: HTTP/1.1 413 Request Entity Too Large09:33
fraggeln(its a 7gb file that im trying to upload)09:34
fabiandfraggeln: in swift?09:37
fraggelnfabiand: in st09:37
fraggelnim using st to upload a file to my swiftsetup09:38
fabiandfraggeln: You might need to segment your upload, as (single) uploads are limited to 5GB09:38
fraggelnis there any way to change that limit?09:38
fraggelnsince we are planning to use switf as a backend for our backupsoftware, and I think it creates larger files thaen 5gb.09:39
fabiandsegmenting is a good thing (tm), it is chossen to be 5gb to keep the nodes in a better balance ..09:39
fraggelnokay.09:39
fabiandfraggeln: segmenting means: you split your file into smaller ones ... you can retrieve the file afterwards in one go ..09:39
fabiandfraggeln: there you go http://swift.openstack.org/overview_large_objects.html?highlight=segment09:40
fraggelnfabiand: thanks09:40
fabiandnp09:40
fraggelnwhen you talked about segmenting, the first thing that crossed my mind was using tar/rar or something to split the file at the client itself09:42
Firagaanyone whose successfully created an image for openstack compute, like CentOS/Windows image for openstack?09:42
sorenFiraga: Not CentOS or Windows, no.09:43
sorenFiraga: Ubuntu, yes.09:43
Firagaubuntu image only soren?09:43
sorenI've only built Ubuntu images, yes.09:44
sorenThat's about all I really care about.09:44
Firaganeed directions on how to create from a Xen CentOS 5.5 VM pls09:45
FiragaI only got an .img file. where can i get the kernel & ramdisk?09:46
sorenHow do you usually run it?09:47
Firagaalso, I just updated my  nova and now I can't run my instances. "OperationalError: no such column:09:47
sorenDaviey: ^^ How's that db schema migration magic coming along? :)09:47
FiragaI create a VM using Xen/virt-lib09:48
sorenI'm not sure what you're saing.09:48
sorensaying, even.09:49
Firagaok, where are the docs to create & publish a Xen CentOS 5.5 VM that can be loaded into OpenStack?09:51
FiragaI need to create my own CentOS Xen image09:51
Firagattylinux is all i can run09:52
*** MarkAtwood has joined #openstack09:52
*** littleidea has quit IRC09:53
Firagado openstack have any documentation on how to create a CentOS.img?09:55
Firagado openstack have any documentation on how to create a CentOS.img?09:58
fabiandFiraga: repeating your question does not lead to quicker responses.10:00
*** trin_cz has joined #openstack10:00
Firagasorry about that, i accidentally press enter twice, pc is lagging... hehehe10:01
*** Firaga has quit IRC10:06
*** befreax has joined #openstack10:06
*** JohnFury has joined #openstack10:16
JohnFuryhello guys\10:16
JohnFuryi'm looking for any documentation for openstack running a Windows or any other Linux OS?10:17
sorenThere are Ubuntu images available.10:18
* soren has an odd sense of deja vu10:19
JohnFuryalright, where can i get it? i appreciate your answers man...10:19
sorenttx: I'm sure you have the link handy...10:19
JohnFurygreat...10:20
JohnFuryhow about any procedure on creating an image for openstack? do we got any documentation about that?10:20
ttxJohnFury: http://wiki.openstack.org/RunningNova10:21
ttxJohnFury: or http://fnords.wordpress.com/2010/12/02/bleeding-edge-openstack-nova-on-maverick/10:21
ttxcreating images: it's a bit out of our scope (the OS vendor should provide that) but I agree we could write some docs on how to do it :)10:22
JohnFuryjust need HOWTO guide on creating kernel & ramdisk10:24
JohnFuryi'm downloading them now...10:25
*** JohnFury has quit IRC10:30
*** JohnFury has joined #openstack10:32
JohnFurygot disconnected, sorry about that...10:33
JohnFuryyeah, creating a documentatio for a procedure on how to create a image for openstack is a very great idea...10:33
JohnFuryttx or Thierry? how did you guys created the ubuntu image.10:36
ttxJohnFury: I didn't. The Ubuntu Server team did.10:36
ttxJohnFury: we/they used vmbuilder, but that should be pretty Ubuntu specific10:37
JohnFuryi see... vmbuilder, i will check on that, great... i hope you guys can post a documentation on how you actually did it...10:39
JohnFuryanyway, ttx got any twitter account, so i can be your follower?10:40
ttxJohnFury: @tcarrez10:43
ttxJohnFury: you can talk to smoser, he owns that part on Ubuntu's side10:43
*** ArdRigh has quit IRC10:47
JohnFuryalright, great... i will check with him, i hope his online...10:47
*** icarus901 has quit IRC10:50
*** trin_cz has quit IRC10:51
*** MarkAtwood has quit IRC10:58
*** icarus901 has joined #openstack11:05
sorenJohnFury: It's 5 in the morning where he is, so unlikely.11:11
fraggelnHow do people normaly connect to their "cloud"? I doubt people are using the st-commant in applications and stuff.11:12
fraggelnis there anyway to mount it in ie linux/solaris?11:12
fraggelnor am I thinking all wrong here?11:13
JohnFury+sorren:: yeah that's why i got to finish some cooking and eating and dressing... while waiting for our friend to be awake... got to do dishes now openstack people... see yah in a minute.11:13
*** dagger has quit IRC11:26
*** dagger has joined #openstack11:26
sandywalshttx, nice openstack announcements today!11:29
*** colinnich has joined #openstack11:30
sorensandywalsh: What, where?11:36
befreaxsoren: http://twitter.com/tcarrez/status/2261377791662899311:37
*** colinnich has quit IRC11:37
*** colinnich has joined #openstack11:38
*** colinnich has quit IRC11:39
*** colinnich has joined #openstack11:40
sorenbefreax: ta11:41
*** miclorb_ has quit IRC11:47
*** colinnich has quit IRC11:49
*** colinnich has joined #openstack11:51
*** colinnich has joined #openstack11:52
*** kashyapc has quit IRC11:54
*** colinnich has quit IRC11:54
*** colinnich has joined #openstack11:55
*** colinnich has joined #openstack11:59
*** trin_cz has joined #openstack11:59
*** trin_cz has quit IRC12:02
*** trin_cz has joined #openstack12:06
*** ctennis has quit IRC12:10
*** skrusty has quit IRC12:21
*** skrusty has joined #openstack12:36
*** scaraffe has joined #openstack12:40
*** ctennis has joined #openstack12:57
*** colinnich_ has joined #openstack13:14
*** colinnich_ has quit IRC13:17
notmynamefraggeln: swift isn't mountable as a filesystem (cause it's not a filesystem). the way to interact with it is to use HTTP, a language binding, or a third-party tool like Cyberduck and others13:23
*** crago has joined #openstack13:24
*** ramkrsna has quit IRC13:28
*** scaraffe has quit IRC13:35
*** jbryce has quit IRC13:42
*** crago has left #openstack13:44
*** hadrian has joined #openstack13:49
*** rogue780 has joined #openstack13:53
rogue780howdy. anybody here today?13:56
sorennotmyname: Do we know a Ryan Brown?13:58
*** aliguori has joined #openstack13:59
sorennotmyname: Someone by that name who according to github works for Rackspace has written a gvfs backend for swift.13:59
sorenhttps://github.com/rbr/gvfs14:00
fabiandwow. cool.14:01
*** zul has quit IRC14:09
*** jbryce has joined #openstack14:09
*** zul has joined #openstack14:10
sandywalshsoren, nice find!14:10
*** westmaas has joined #openstack14:11
smoserJohnFury, kernel and ramdisk should not really need anything specific.  Ours are just a kernel and ramdisk like you might have on your desktop or any server installation.14:13
smoserthey use our '-virtual' kernel.  I'm not aware of any kernel specific things we've done that weren't a result of EC2 (xen)14:13
*** JohnFury has quit IRC14:17
ttxsmoser: oh no, you killed him.14:20
*** kashyapc has joined #openstack14:29
*** allsystemsarego_ has joined #openstack14:30
*** allsystemsarego has quit IRC14:31
*** littleidea has joined #openstack14:32
zulsoren: http://pastebin.ubuntu.com/550657/ im getting this error when using the upstart job in the packaging branch14:37
ttxtwisted ? that sounds so last decade14:39
sorenzul: nova-compute hasn't used twised since before christmas.14:39
sorentwisted, even.14:39
sorenzul: That's your first problem.14:39
zulsoren: *sigh*14:40
sorenzul: Your second problem is that you've been a bad boy and run nova-compute as root.14:40
zulno im running the upstart job14:40
sorenYes, now.14:40
* ttx spanks zul14:40
soren"have been"14:40
sorenOh, wait.14:40
soren/var/run/nova-compute.pid.. Why would it try to put it in /var/run?14:40
* soren has to go pick up daughter at day care... Will be back this evening at some point.14:41
sorentoodles.14:41
fabiandfraggeln: you can mount swift using that gvfs client noted above.14:44
*** spectorclan has joined #openstack14:45
*** dirakx has joined #openstack14:46
*** fabiand_ has joined #openstack14:48
*** f4m8 is now known as f4m8_14:48
*** ppetraki has joined #openstack14:49
uvirtbotNew bug: #697689 in openstack-ci "swift-debian broken since build #104" [Undecided,New] https://launchpad.net/bugs/69768914:51
*** bingoooo has joined #openstack14:51
notmynamesoren: nope. haven't met him. looks like he's in the austin office. good find, though14:53
*** fabiand has left #openstack14:54
*** calavera has quit IRC15:00
*** b_erb has joined #openstack15:01
*** nelson__ has quit IRC15:03
*** nelson__ has joined #openstack15:03
*** mdomsch has joined #openstack15:04
*** gondoi has joined #openstack15:06
*** kevnfx has joined #openstack15:07
*** Podilarius has joined #openstack15:08
*** kevnfx has quit IRC15:13
bingoooohi15:15
notmynamebingoooo: morning15:18
*** rnirmal has joined #openstack15:22
*** mdomsch has quit IRC15:26
*** guigui1 has quit IRC15:28
*** dfg_ has joined #openstack15:28
*** dragondm has joined #openstack15:42
*** Jbain has joined #openstack15:55
*** rogue780 has quit IRC15:56
*** blpiatt has joined #openstack15:58
*** dubsquared has joined #openstack16:03
*** b_erb has left #openstack16:06
*** bingoooo has quit IRC16:10
*** johnpur has joined #openstack16:11
*** ChanServ sets mode: +v johnpur16:11
vishyFiraga, JohnFury: I successfully created a centos image for openstack.  It required a few tweaks to kernel modules and such16:12
vishybut it should be easier know that raw-disk-images is in, you don't have to create a separate kernel and ramdisk16:13
dubsquaredvishy: did this get published anywhere?16:13
vishydubsquared: I sent it to JordanRinke, he was going to clean it up a bit and put it up somewhere16:14
vishywe really need a place to shove testing images16:14
dubsquaredalright, ill have to bug him some more…i got focused on xenserver stuff so i didn't have time to ask him about it16:14
dubsquaredyeah, that would be great...16:15
vishydubsquared: I can zip it up and put it somewhere if someone knows where I can stick a few gig file16:15
dubsquaredi have a hack site im using that has a mess of images16:15
dubsquaredcool, ill drop you an account on my cloudfiles16:15
dubsquaredunless i see rinke first...16:16
* dubsquared peers over at empty desk16:16
*** Ryan_Lane|away is now known as Ryan_Lane16:16
*** kevnfx has joined #openstack16:18
creihtwinston-d: What timezone are you in?16:18
fabiand_vishy: rawdisk images are supported now?16:24
*** Podilarius has quit IRC16:24
fabiand_sorry - you just said it :)16:24
vishyfabiand_: in trunk yes16:24
fabiand_very ince,16:24
fabiand_nice16:24
creihtwinston-d: And I can walk you through debugging your setup16:24
creihtwinston-d: it is usually something simple16:25
*** dirakx has quit IRC16:26
creihtwinston-d: and as a reference point, with decent hardware, you should be able to easily get over 1k puts/sec through one proxy16:27
creihtwith an upper bound of close to 2k with everything well tuned16:28
*** kashyapc has quit IRC16:34
*** dirakx has joined #openstack16:35
jk0would anyone mind reviewing https://code.launchpad.net/~jk0/nova/lp697019/+merge/45196 ? it's short & sweet16:39
*** Podilarius has joined #openstack16:39
*** opengeard has quit IRC16:44
letterj_mtaylor: You around?16:45
*** ChanServ sets mode: +v letterj_16:49
creihtlittleidea: notmyname said that you had some questions?16:50
*** singh has joined #openstack16:50
littleideacreiht: this is often the case16:50
creihtlol16:50
creiht:)16:50
littleideacreiht: I was asking about the design of swift16:51
creihtshoot16:51
*** kashyapc has joined #openstack16:52
*** cynb has left #openstack16:52
*** daleolds has joined #openstack16:52
littleideaIf I understand correctly, everything goes through the proxy server both ways and I was specifically wondering if you considered the object servers returning requests directly16:52
creihtlittleidea: that question comes up quite often :)16:52
creihtwe had considered that in the initial design16:53
notmynamelittleidea: sorry I couldn't answer yesterday. meeting and other commitments (I'm sure you can't relate ;-)16:53
littleideanotmyname: no sorrow necessary :)16:54
creihtOne thing is that going through the proxy was the simplest, and worked "good enough" :)16:54
creihtThe other thing that we liked about it is that we only have to have public addresses on the proxies16:54
Ryan_Lanewhen allocatng elastic IP addresses, is the IP address allocated to a user, or a project?16:55
Ryan_Laneand are these IPs the "floating" IPs in nova-manage?16:56
creihtThose are the simple answers, I believe there were more technical reasons why we didn't persue the idea, but I can't remember off the top of my head16:56
*** MarkAtwood has joined #openstack16:57
littleideacreiht: the short answer is 'we did the simplest thing and it works'17:00
creiht:)17:00
letterj_mtaylor: How do these usually get resolved?  http://hudson.openstack.org/view/Swift/job/swift-debian/104/console17:01
creihtThere are also some smarts in the proxy that can handle failure conditions that would be difficult if we handed the connection off to the storage node17:01
creihtPUTs would also not be easy, since those are streamed out to the 3 storage nodes17:02
*** Ryan_Lane has quit IRC17:02
*** Ryan_Lane has joined #openstack17:02
*** enigma has joined #openstack17:04
*** letterj_ is now known as letterj17:10
*** rlucio has joined #openstack17:11
*** dirakx has quit IRC17:12
*** brd_from_italy has quit IRC17:12
*** rogue780 has joined #openstack17:20
*** hggdh has quit IRC17:26
*** dirakx has joined #openstack17:33
*** maplebed has joined #openstack17:38
*** hggdh has joined #openstack17:39
*** jdarcy has joined #openstack17:46
*** befreax has quit IRC17:52
*** trin_cz has quit IRC17:53
*** joearnold has joined #openstack17:58
*** jdurgin has joined #openstack17:59
*** singh has quit IRC18:00
edaytermie, vishy: https://code.launchpad.net/~eday/nova/internal-api-cleanup/+merge/45152  is updated when you have a moment :)18:01
vishyeday: can we be sure each component will only be dealing with one type of resource?18:05
*** irahgel has left #openstack18:08
edayvishy: well, each component has a main resource (instances for compute, volumes for volume, ...)18:10
edayvishy: for example, in compute, we have compute.API.attach_volume, so we can have verbs on other types too18:10
vishyi guess i don't really see the advantage of removing the noun from the methods18:10
*** rogue780 has quit IRC18:11
vishyafk for 10 min18:11
edayredundancy?18:11
vishynm, back.  I think it makes it a bit less clear, but I guess it isn't a huge issue in my mind18:12
*** spectorclan has quit IRC18:12
edayie, volume_api.get_volume() seems silly to have the extra noun, but if others disagree I can change18:12
*** pharkmillups_ has joined #openstack18:15
*** pharkmillups_ has quit IRC18:16
*** adiantum has joined #openstack18:22
*** fabiand_ has quit IRC18:23
*** adiantum has quit IRC18:32
*** jc_smith has joined #openstack18:32
*** deshantm_cosi has quit IRC18:36
*** rlucio has quit IRC18:43
_0x44ttx: Are you around?18:48
*** anotherjesse has joined #openstack18:48
*** arthurc has quit IRC18:56
*** dfg_ has quit IRC19:02
_0x44ttx: Nevermind, sirp- and I figured out the best way to slice our gordian knot.19:02
nelson__with a sword, usually.19:07
*** maplebed has quit IRC19:07
_0x44nelson__: We decided to use a nerf bat.19:08
nelson__Nerf(tm) always my weapon of choice.19:08
*** fabiand_ has joined #openstack19:08
nelson__Now ... if only they made a jian.19:08
*** kevnfx has quit IRC19:11
*** dfg_ has joined #openstack19:11
*** hadrian has quit IRC19:13
*** WonTu has joined #openstack19:15
*** WonTu has left #openstack19:15
*** maplebed has joined #openstack19:19
sandywalshok, got api-parity tests passing again, now the laborious part ... pep819:22
*** Podilarius has left #openstack19:22
*** littleidea has quit IRC19:24
sandywalshso one of the things I discovered was the string-based image_id's from objectstore aren't compatible with RS API numeric image ids. Is there anything like the instances "internal_id" in objectstore/glance?19:25
*** hadrian has joined #openstack19:26
sirp-glance image ids are just ints right now19:30
sandywalshdo you impose those on top of the objectstore id's?19:30
sirp-well, right now glance doesn't work with the objectstore— it works with swift or using it's own filesystem. but yes, it hides object ids and exposes a single sequential id for an image19:32
sandywalshah, right. That's great ... when do we switch?!19:33
sandywalshthx sirp19:33
sirp-well we should able to switch in cactus if we want to, but i'm guessing we'll keep objectstore around for a while as an alternative19:34
sirp-also fyi, i'm working on getting the python-cloudservers image-create cmd to work with glance and the OpenStack API, i'm dealing with some of those issues as well19:35
sandywalshyou should look at my branch. I do the numeric mapping in there19:35
sandywalshthe image-create call goes through, but fails in dom019:35
sirp-a numeric mapping for images, or for instances (different from internal_id?)19:35
sandywalshimages19:36
sirp-ah ok19:36
sirp-i was planning on just passing through the glance id for now, down the road, we'll probably change that to add more flexibility19:36
xtoddxsoren: yea, the audit=INFO was an artifact that wasn't used anymore, there are no calls to getLogger('audit') anywhere19:37
sandywalshyeah, I needed it for boot and other things too19:37
sirp-have you published your branch on lp?19:37
sandywalshyup https://blueprints.launchpad.net/nova/+spec/openstack-api-parity19:37
sirp-cool *looking*19:37
sandywalshhere's the trace from the image-create call http://etherpad.openstack.org/BXOU0TTj9M19:37
*** trin_cz has joined #openstack19:38
sirp-sandywalsh: put_vdis; error; (111, 'Connection refused' … were you running glance-api and glance-registry?19:39
sandywalshnope ... are those services?19:39
sirp-yep19:39
sandywalsh:) excuse my ignorance19:40
sirp-right now, xs-snaps only supports glance, so it will need to be running for image-create to work19:40
sandywalshI haven't looked into glance yet, so no, sorry I didn't know what the steps were19:40
sirp-no worries, ill need to update the docs once get my second_cut patch up19:40
sandywalsh(beyond installing the plugin)19:40
sandywalshso ... maybe it'll work?19:40
sandywalshhmm, actually no19:41
sandywalshhmm,19:41
sandywalshhehe ... dunno19:41
sirp-it's really pretty simple… basically just check it out, make a conf file that overrides the filesystem_data_dir=/tmp, and then run both of the binaries19:41
sandywalshI was thinking about objectstore and glance running side by side19:41
sandywalshI think as soon as we get past bexar, we'll need to solidify glance for the new api work.19:42
sandywalshthe mapping of id's and the kernel/ramdisk/machine -> flavor/os stuff is ugly19:42
sirp-exactly, dubs and _0x44 were just talking about that19:42
sandywalshsweet! look forward to it. go cactus!19:43
sorenxtoddx: Oh, ok. It's just the commit message didn't mention it, so I thought I'd check.19:50
jk0would anyone mind reviewing https://code.launchpad.net/~jk0/nova/lp697019/+merge/45196 please? :)19:57
jk0(anyone *except* eday!)19:57
jk0just kidding eday :P19:57
sandywalshI need a bzr local commit hook that catches my pep8 violations. :)19:59
creihtlol19:59
creihtsandywalsh: ask notmyname about that :)19:59
sandywalshand sends an electric jolt to my chair19:59
jk0what makes it even more difficult is when different pep8.py versions are used19:59
notmynameheh19:59
sandywalshjk0, yeah, already ran into that "feature"20:00
notmynamealias bzr="echo 'DID YOU RUN THE TESTS' && bzr"20:00
jk0hah20:00
sandywalshhaha20:00
*** rnirmal has quit IRC20:00
sandywalshdoes runtests.sh run pep8?20:01
sandywalsh(if not ...)20:01
jk0no, at least if it does, it's really quiet about it20:01
jk0s/at least/or/20:01
sandywalshif you look at nearly every merge-prop, the last commit it usually "pep8"20:02
sandywalsh*is20:02
*** rh91uk has joined #openstack20:02
sandywalshwell, my merge props anyway20:02
jk0I find a lot of times that pops up after a trunk merge20:02
jk0mostly from the various pep8.py versions20:02
*** rh91uk has left #openstack20:03
daboIt's great that we're so anal about pep8, but have no problem with keywords being used as names in code.20:05
*** fabiand_ has quit IRC20:06
*** glenc_ has joined #openstack20:10
dabosandywalsh: Here's the error in the pause code: http://paste.openstack.org/show/403/20:11
*** glenc has quit IRC20:12
sandywalshbut it paused it, right?20:12
dabodunno - cloudservers list just shows it as 'build'20:13
sandywalshwhat about xe or xencenter?20:14
*** laurensell has joined #openstack20:14
dabothe point is that it's looking by name, which is defined as 'instance-' + the internal_id by sqlalchemy20:16
daboI'm looking into the VMHelper code now.20:16
sandywalshsomething must have changed, never used to do that20:16
sandywalshdabo, pause worked for me yesterday, it was just marking the db as "error". But it actually found and paused the instance. unpause worked too20:17
vishysoren: have you used qemu-nbd at all?20:18
sandywalshdabo, I'm going back to integration testing on api now, so I'll be revisiting all that.20:18
dabosandywalsh: yeah, I know - I reported a different error trying to pause a vm that was already paused: http://paste.openstack.org/show/389/20:18
sandywalshdabo, I'll need to look into that. That's another one that worked previously. After api.20:20
sandywalshdabo, not having the xen tests is painful20:21
dabosandywalsh: there is a discrepancy between what dom0 reports and what cloudservers list reports20:21
dabothat's the problem20:21
sandywalshyes, that's what I was saying, the db is now getting set to an odd state20:22
daboI think I'll wipe that xs and start again20:22
*** colinnich has quit IRC20:31
uvirtbotNew bug: #697841 in nova "Actions query should include date" [Undecided,In progress] https://launchpad.net/bugs/69784120:32
*** daleolds has quit IRC20:34
*** brd_from_italy has joined #openstack20:37
*** ctennis has quit IRC20:50
*** dirakx has quit IRC20:50
anotherjesseAnyone know why the trunk ppa is stuck at bzr rev 331?20:52
nelson__gholt: thanks for your patches. I'm not a big believer in splitting strings using backslashes, though.20:54
nelson__I'm not writing my code using punched cards, and I doubt anybody else is either.20:54
Ryan_Lanenelson__: that's the rules for the project20:55
Ryan_Lanenelson__: they use PEP820:55
Ryan_Laneor was this for something else? :)20:55
nelson__I use PEP8 also ... but it also says that everything in it is optional.20:55
vishysoren, eday, and whoever: https://code.launchpad.net/~vishvananda/nova/cow/+merge/4529320:55
vishycould use testing and reviews20:56
Ryan_Lanenelson__: their build tools actually enforce compliance. things won't build if it code isn't PEP8 compliant20:56
*** fabiand_ has joined #openstack20:57
nelson__Ryan_Lane, the last time I used a punched card, you weren't alive.20:58
* Ryan_Lane shrugs20:58
gholtWell, it has nothing to do with punched cards, or paper tape.20:58
Ryan_Lanethe rules is the rules :)20:58
creihtor formal proofs20:58
Ryan_Lanethey require something, I respect what they require20:58
creiht:)20:58
nelson__The last time I programmed on a terminal with 80 columns was, um, 1983.20:58
gholtAnd it'd still pass builds, no problem. It just shows up on "bad" graphs. :)20:58
creihtwe should require formal proofs of every check in :)20:59
Ryan_Lanehah20:59
Ryan_Lanethat would be rough20:59
creihtI'm glad that didn't catch on20:59
nelson__and it's easy to require lines <80 characters, which is obviously better code than code with lines >=80 characters.21:00
nelson__Anybody using a tool to enforce PEP8 compliance hasn't actually READ PEP8.21:00
nelson__They're more like guidelines than actual rules.21:00
*** damon__ has joined #openstack21:00
gholtWell, you can argue that until whenever you'd like. But, for the purposes of the project...21:01
Ryan_Lanefor these projects, it's rules. "Them's the breaks"21:01
nelson__sheesh.21:01
uvirtbotNew bug: #697861 in swift "object copy does not copy content-type" [Undecided,New] https://launchpad.net/bugs/69786121:01
gholtWait, uvirtbot, I thought that was an intended side effect?21:01
notmynamenot sure. it seemed weird to me21:02
gholtI thought /you/ were the one that wanted that, lol21:02
notmynameheh21:02
gholtSo folks could change the content-type of an uploaded file.21:02
notmynameyou still can by setting the header in the copy request. but if you don't set it, it falls back to the "guess-the-type" rules21:03
gholtAh, okay. I should've probably read the bug submission itself, eh?21:03
notmynamemaybe :-)21:03
creihtnelson__: Some tools (including launchpad tools) look better if you keep things <80 chars21:04
nelson__I don't suppose quoting PEP8 would help?21:04
creihtincluding the way launchpad sends emails21:04
nelson__creiht: but you do have a good point.21:04
creihtFor whatever it is worth, the PEP8 keeps things fairly consistent21:05
termieeday: lookin now :)21:05
dabocreiht: for some values of "consistent" :)21:05
creihtnelson__: and it is a very common practice21:05
creihtmore consistent21:05
creihteither way, as for most of your nitpics nelson__, if this is the worst that you can complain about with the openstack project, then I am a happy dev :)21:06
gholtlp21:07
gholtDamn, who said that?21:07
creihthehe21:07
*** joearnold has quit IRC21:10
*** colinnich has joined #openstack21:11
*** Ryan_Lane is now known as Ryan_Lane|food21:12
sorenvishy: Yes, I've used qemu-nbd.21:23
sorenanotherjesse: which trunk ppa?21:23
* soren screams21:24
dabocan anyone review this? It's a dependency for other blueprints. https://code.launchpad.net/~ed-leafe/nova/xenstore-plugin/+merge/4493121:24
sorentermie: Another example of stuff that's nitpicky about id's: elasticfox.21:25
sorentermie: Check out this little gem:21:25
sorentermie:     "ami" : new RegExp("^ami-[0-9a-f]{8}$"),21:25
termiesoren: we broke that already21:26
sorentermie: So far, that's two out of two tools I've looked at that are more strict than the spec asks them to be.21:26
sorentermie: I know.21:26
termiesoren: but that is an error in the "be tolerant in what you accept" category21:26
sorentermie: Hence the scream.21:26
sorentermie: I know. I never suggested it wasn't.21:26
sorenThe spec says it's a string.21:27
termiesoren: well, they probably also hardcodeded the aws urls ;)21:27
sorenNot much more than that.21:27
*** colinnich has quit IRC21:27
sorentermie: No, they're configurable in the ui.21:27
sorenYou can add additional endpoints.21:27
termiesoren: oh, well we'll just have to drink the ocean then21:27
*** rogue780 has joined #openstack21:29
sorenI'll add a "--strict-ec2" sort of option and that truncates to 32 bit in the EC2 api.21:30
soren32 bits, base-16.21:30
*** colinnich has joined #openstack21:30
sorenI'm deeply surprised they can fit their stuff in such a small keyspace.21:30
*** lvaughn has quit IRC21:30
termiesoren: they aren;t assigining things randomly21:31
sorenClearly not.21:31
*** lvaughn has joined #openstack21:31
anotherjessesoren: fixed the issue with ppa - user error21:32
sorenanotherjesse: Using one of the old ppa references?21:33
anotherjesseusing maverick, adding right ppa, forgetting to apt-get update, getting bzr 331 :)21:34
*** Ryan_Lane|food is now known as Ryan_Lane21:34
*** pharkmillups_ has joined #openstack21:38
termieeday: what's the current status of the nova/image/ directory?21:39
anotherjessesoren: we found some bugs in the ppa packages - what is your availability to merge fixes today?21:39
sorenanotherjesse: I'm right here :)21:39
sorenanotherjesse: For at least another 10 minutes.21:39
sorenanotherjesse: What's up?21:40
termieeday: i don't remember hearing about it coming into existence but it seems to be having work done on it from time ot time21:40
termieeday: but i am not aware of anything using it21:40
edaytermie: not really sure, there's an interface and some implementations that are not consistent, but a lot of that was being reworked with Glance. I think sirp has some plans for it21:40
sleepson-soren - looks like /etc/init/nova-volume.conf is referring to nova-scheduler21:40
termiesirp-: pingaling ^^21:40
sorensleepson-: :(21:41
sorensleepson-: Gah.21:41
sorensleepson-: Hah, it also says: description "Nova API server"21:41
sorensleepson-: I suck at cut and paste.21:41
sleepson-:)21:41
sorenEr..21:42
anotherjessesoren: should logging of stderr working again?21:43
sorenanotherjesse: Yes.21:43
sorenFix pushed. Hang on, I'll generate new packages.21:44
sleepson-soren anotherjesse - this is the contents of my nova-compute.log: "WARNING:root:Starting compute node" - and that's it, so there may be a logging issue still21:45
sleepson-(after running an instance)21:45
sorensleepson-: This should all be better once xtoddx's newlog magic lands, I think.21:45
sorensleepson-: If not, it should be a simple matter of just passing --verbose=true in nova.conf. The default verbosity level changed with the eventlet merge, it seems.21:46
sleepson-soren: gotcha.  thanks21:46
sorenSure thing.21:46
sorenanotherjesse, sleepson-: Thanks for catching the nova-volume thing. New packages pushed to Launchpad.21:46
sleepson-soren - awesome - thx mucho - I'll give them a shot21:47
sorensleepson-: It'll be a little bit before they're apt-getable, though.21:48
*** kevnfx has joined #openstack21:48
sorensleepson-: I uploaded source packages. They have to get built first, and then published. The queue is empty, though, so it shouldn't really be more than 10 minutes or so.21:49
sleepson-soren: makes sense.  I'll wait for 15, and then check for an update21:49
sirp-termie: pong21:50
jk0could someone please review https://code.launchpad.net/~jk0/nova/lp697019/+merge/45196 for me?21:50
termiesirp-: wondering what the current working status of the nova/image directory is21:50
termiesirp-: from what i can tell it has been being used in the context of 'openstack' api only21:51
sorensleepson-: https://launchpad.net/~nova-core/+archive/trunk/+packages  <--- You can follow the progress here. Any second now a 2011.1~bzr515-0ubuntu0ppa1~maverick2 will turn up.21:51
sorensleepson-: Then it'll get built (takes around 7 minutes) and then a publisher run needs to kick in. Yeah, 15 minutes from now sounds likely.21:52
termiesirp-: it has a bunch of things that look like they could or should be being used by the rest of the system, but nobody working on the rest of the system knows anything about it ;)21:52
sirp-termie: right, i'm not exactly sure how it's being used by the rest of the system, i've only been using it in the context of the openstack api21:53
*** hadrian has quit IRC21:53
sirp-termie: i don't find it very useful, and i think glance ultimately will replace it, but i'm currently updating it to use glance for now so that i can get image-create and image-list working correctly21:54
soreng'night, all21:54
termiesirp-: ftr it doesn't seem like those things can be developed separately21:54
termiesirp-: glance's development does not currently track the needs of the nova21:54
termiesirp-: so i am trying to fix some of htat21:55
termiesirp-: but as long as the 'openstack' api is being developed in a vacuum its tricky :/21:55
sirp-termie: right, that's def something that will need to be addressed; perhaps should be the major goal for glance in the cactus release; making it usuable not just in the context of OpenStackAPI, but also with any other supported apis21:55
termiesirp-: we already have some ways to solve that issue, glance doesn't necessarily need to do anything differently but the nova/image directory can't be serving the 'openstack' api only21:57
sirp-termie: for the bexar release, though; it really has been fairly isolated, some my interim goal is just to get OpenStackAPI working correctly, and then refactor it later to be more general. If we end up being okay with solely using glance for images, then ImageService can go away completely and simplify somethings21:57
*** fabiand_ has quit IRC22:01
edaysirp-, termie: THe goal of nova/image is to have an API like network/volume/compute that compute can depend on (and possibly volume if we want snapshots of volumes to go there). I was thinking Glance would be one provider, much like s3 and local are now22:02
termieeday: i agree fully with that22:02
termieeday: but the development of that directory has been in a very different direction :/22:02
edayit's used by ec2 API indirectly via image_service in nova.compute.API (choosing the s3 implemnetation)22:02
edaytermie: ahh, ok. I don't know what the correct API for that is, which is why I was punting and letting the glance folks figure it out :)22:03
termieeday, sirp-: by different direction i just mean that it has been developed as something directly integrated with the 'openstack' api22:04
termieeday, sirp-: rather than providing the inter-service api handle on top of a manager/service implementation22:04
*** brd_from_italy has quit IRC22:04
termieeday, sirp-: (in the context of compute.API, network.API and so forth)22:05
*** westmaas has quit IRC22:06
termieeday, sirp-: i guess i am just saying the equivelant of what eday did with the compute and network stuff now has to be done for the image stuff22:07
edaytermie: I'm guessing it won't be too hard to map ec2 methods onto it, but I've not looked22:07
termieeday, sirp-: and furthermore the stuff underneath it has to be done as well to map to our existing metaphors22:07
edayvishy: you ok with my branch now? we can rename those methods later as termie suggested22:08
termieeday: i think vishy is in transit22:09
*** hadrian has joined #openstack22:09
edayahh22:09
edaystill no excuse, he has a phone :)22:09
*** joearnold has joined #openstack22:10
*** dirakx has joined #openstack22:10
termiesirp-: anyway, i guess the real question i have for you is what do you plan on currently touching, as there are a bunch of things i plan on moving around22:10
edayI don't think there are any laws against driving and approving merge requests yet22:10
termieeday: ;)22:10
termiesirp-: and what functionality is currently working and tested22:10
sirp-termie: are you planning on moving them around for the bexar release, or in cactus?22:10
termiesirp-: i plan on moving them around right now, if you feel done with them for the bexar release then all the better i will expect that the tests are testing everything you care about22:11
sirp-termie:  functionality currently under dev is instance-snapshot create, which maps to ImageService.create22:12
*** pharkmillups_ has quit IRC22:12
termiesirp-: okies22:12
sirp-termie: per my email to the list, i was having Glance generate an image record so we could return that immediately to the user (which is how the OpenStack API works)22:13
*** troytoman has joined #openstack22:13
nelson__gholt: so what's the next step for merging? Do I have to actually merge it myself?22:13
termiesirp-: sounds like it is mostly how you expect it to look then so whatever thinking i am doing related to it can expect that all the functionality you require is at the very least stubbed out22:13
creihtnelson__: yeah you will have to merge his branch into yours22:14
termiesirp-: i.e. i am not going to make any choices that somehow impede your progress22:14
nelson__urgh, but I've kept on making changes.22:14
*** anotherjesse has quit IRC22:14
nelson__so I guess I need to check it out again .... merge, and check back.22:14
sirp-temie: 'not impeding progress' sounds great :)22:14
termiesirp-: :)22:14
sirp-termie: but yeah, if you have a direction to go with it, by all means do that, ill make it work with glance; and if there's any fundamental incompatibilities, ill let ya know22:15
termiesirp-: i'll ping you on any merges, what is your launchpad name?22:15
sirp-termie: rconradharris22:15
termiek22:15
gholtnelson__: Yeah, that's a bit of launchpad/bzr fun. Only the trunk merges are on auto, and that's because of this "hudson" thing.22:16
*** anotherjesse has joined #openstack22:17
daboPyCon tutorials announced: http://j.mp/e6LTbS   Some cloud sessions, but not a thing about OpenStack or Rackspace. :(22:17
JordanRinkeoff the top of their head, does anyone know the name of all the swift/glance services?22:19
*** troytoman has quit IRC22:19
*** miclorb has joined #openstack22:21
*** normanrichards has joined #openstack22:21
sirp-JordanRinke:  do you mean the individual components of glance, or its high-level responsibilities?22:23
dubsquaredswift-init object-updater start22:23
dubsquaredswift-init container-updater start22:23
dubsquaredswift-init object-replicator start22:23
dubsquaredswift-init container-replicator start22:23
dubsquaredswift-init account-replicator start22:23
dubsquaredswift-init object-auditor start22:23
dubsquaredswift-init container-auditor start22:23
dubsquaredswift-init account-auditor start22:23
dubsquaredswift-init account-reaper start22:23
dubsquaredthose?22:23
sirp-to follow suit: glance-api and glance-registry22:24
JordanRinkejust found it in the swift doc... looks like, Proxy, Auth, Object, Container, Account22:24
*** ctennis has joined #openstack22:24
*** ctennis has joined #openstack22:24
JordanRinkesirp- a box running glance, what services would it potentially have running to function?22:24
JordanRinkefor instance nova have network, api, scheduler, volume, objectstore, compute - what is that in relation to glance?22:25
sirp-right now, we only have the two services listed above— in the long run we'll probably have some monitoring/cleanup scripts but nothing there yet22:25
JordanRinkeso there is no longer, teller, parallax etc?22:25
sirp-jaypipes renamed them, avoided some collisions with some other OSS projects out there22:26
sirp-they both still exist, teller -> api, and parallax -> registry22:26
JordanRinkecool, thx for the help, much appreciated22:26
sirp-JordanRinke:  np22:26
openstackhudsonProject nova build #356: SUCCESS in 1 min 19 sec: http://hudson.openstack.org/job/nova/356/22:29
JordanRinkedubsquared: Check out the evernote general notes, I updated the naming scheme - look good?22:30
creihtJordanRinke: and don't forget replicators, updaters, auditors, and the reaper!22:32
*** lvaughn_ has joined #openstack22:32
JordanRinkecreiht: Are those services that would potentially not be enabled?22:33
creihtthey would be enabled22:33
JordanRinkeWhat I am doing is making a based36 naming scheme22:33
JordanRinkeso from a 4char unit code I can tell what services it was initially configured to run22:33
anotherjessesoren: stil up?22:33
dubsquaredjordanrinke:   looks solid…is that too big thou?  just thought about it, and that's large22:33
anotherjessesoren: /usr/sbin/ietadmn is missing from nova_sudoers22:33
edayanotherjesse: he went to bed22:33
anotherjesseanyone else have the ability to push to the trunk ppa?22:34
JordanRinkedubsquared: 12 char total unit name, I think that is reasonable-15 is the NetBIOS limit so that is what I was thinking as a max upper bound22:34
*** lvaughn has quit IRC22:34
JordanRinkeall these unit names are going to be automatically created based on deployment configs etc22:34
termiesirp-: what is the prupose of giving them the extra silly names (parallax and teller) when they are just components of a single project22:34
dubsquaredjordanrinke:  makes sense22:34
creihtJordanRinke: Oh, so you would only be interested if the object-server services are enabled, which would include the server, replication, auditor, and reclaimer22:35
creihtfor example22:35
creihtnot each individual service for the object server22:35
termiesirp-: i would just as soon not have the words parallax or teller anywhere in the projects22:35
sirp-termie: they *were* called that to make it a little easier to discuss the components individually, but they *arent* called that anymore, so ++ on removing any reference to that22:36
JordanRinkeok sweet, so then I am looking at Proxy, Auth, Account, Object, Container as services then right?22:36
termiesirp-: ah, okay22:36
JordanRinkefor swift that is22:36
creihtright22:36
JordanRinkeexcellent22:37
JordanRinkethx22:37
openstackhudsonProject nova build #357: SUCCESS in 1 min 18 sec: http://hudson.openstack.org/job/nova/357/22:39
dubsi got a traceback when running python setup.py build_sphinx - http://paste.openstack.org/show/405/  - anyone know what that's all about?22:39
dubsam I missing some package?22:40
JordanRinkedubsquared: updated the evernote with an example tree too22:43
*** littleidea has joined #openstack22:45
*** fabiand_ has joined #openstack22:47
*** allsystemsarego_ has quit IRC22:47
dubsah, i guess Maverick has sphinx 0.6.6 and doesn't yet have sphinx.builders.manpage.ManualPageBuilder, which was added in 1.022:49
dubsquaredjordanrinke: nice!22:53
*** matiu has joined #openstack22:55
*** matiu has quit IRC22:56
*** matiu has joined #openstack22:56
*** matiu has joined #openstack22:56
*** fabiand_ has left #openstack22:59
openstackhudsonProject nova build #358: SUCCESS in 1 min 21 sec: http://hudson.openstack.org/job/nova/358/22:59
*** johnpur has quit IRC23:02
vishydendrobates: are you here?23:03
dirakxHi all, I'm working on getting up a project on nova, but   nova-manage project zipfile is not working for me, openssl generates the certificates..how can i .zip the file without the .py script in order to source  novarc, and run an instance ?.23:04
*** ppetraki has quit IRC23:05
dendrobatesvishy: sup23:06
*** anotherjesse_ has joined #openstack23:07
sirp-dirakx:  is nova-manage project raising an exception, or is the zip file its generating just not working?23:08
vishydendrobates: so we have some potential fixes to the ppa23:09
vishydendrobates: it looks like it is automatically built via ~openstack-ubuntu-packagers branch23:09
dendrobatesvishy: it is23:09
dirakxsirp-: nova-manage generates an exception..about not been able to execute an openssl comand..23:10
vishydendrobates: you and soren are the only ones with the ability to upload there23:10
vishydendrobates: and soren is in bed23:10
dirakxsirp-: doing this openssl comand alone is working. but not with nova-manage23:10
sirp-dirakx:  could you make a paste using http://paste.openstack.org/ ?23:11
dendrobatesvishy: do you have a diff?23:11
vishydendrobates: is it possible that we can get someone else added so we can do fixes23:11
*** anotherjesse has quit IRC23:11
*** anotherjesse_ is now known as anotherjesse23:11
vishydendrobates: we're still debugging23:11
dirakxsirp-: im working this porblem in this question https://answers.launchpad.net/nova/+question/139603 ;)23:11
dendrobatesvishy:  I don;t think I can add people to that team, let me check23:12
dendrobatesvishy: ah, I am member because I'm an Ubuntu dev.  I can't add to it, but I can push code for you.23:13
vishydendrobates: ok will you be around for a bit?23:14
dendrobatesyep23:14
vishydendrobates: ok i'll get you a branch/diff asap23:14
JordanRinkeanyone want to take a look at this naming scheme and provide some feedback before I tweet it out and try to convince everyone it is awesome?23:14
JordanRinkehttp://www.jordanrinke.com/2011/01/05/based36-naming-scheme-for-openstack-servers/23:15
dirakxsirp-: anyway here is a paste http://paste.openstack.org/show/406/23:16
creihtJordanRinke: so how would these be used?23:18
sirp-dirakx: thx, i haven't run into this yet, so i'm just grep'ing around the source atm23:18
dirakxsirp-: oh thanks..i grep nova-manage without finding a clue.23:19
*** gondoi has quit IRC23:19
creihtI'm still a bit confused as to what problem you are trying to install23:19
creihtsolve23:19
JordanRinkecreiht: so, when I build out a large implementation I would just select what features what boxes would have on it, and then it would name them and build them accordingly (provided all the backend work was done obviously)23:19
JordanRinkethen, if a box ever had a problem in a customer environment I would know what/where it was just from the name23:20
*** dendrobates is now known as dendro-afk23:20
creihtoh a naming scheme for the boxes?23:20
JordanRinkecould also easily analyze designs/installs from anyone using my setup config/naming standard23:20
JordanRinkeyeah23:20
JordanRinkenaming of the physical machines23:20
*** dendro-afk is now known as dendrobates23:20
creihtso if I decide to install another service, I have to rename the machine?23:20
JordanRinkein large scale installs that type of change wouldn't be common and would typically happen with a migration box anyways23:21
JordanRinkebut to answer the question specifically, yes23:22
creihtSeems a bit silly to me, but whatever makes you happy23:22
creiht:)23:22
dirakxsirp-: the  manager.get_credentials method.23:23
creihtit seems that for most enterprise installs, you are going to have a handful of different types of machines23:24
creihtand that is usually pretty easy to name in context of how they are setting things up, without having to look up some matrix23:24
creihtfor example for swift at rs, we basically have proxy nodes and storage nodes23:25
creihtall proxies are set up the same, and all storage nodes are set up the same23:25
JordanRinkecreiht: right, I am trying to abstract that one level so a single globalized naming scheme could apply to all configs23:25
*** enigma has left #openstack23:25
JordanRinkeI would expect that people would learn that 01j4 boxes were swift boxes etc, but the standard would apply to any install using it23:26
*** trin_cz has quit IRC23:26
dubsJordanRinke: why not just simple namespaces?23:27
JordanRinkethinking large scale with the possibility of moving systems across providers, and the potential for the division between providers to be less clear23:27
creihtso when we run out of bits, and have to add more, then every install has to rename there machines?23:27
creihttheir23:27
JordanRinkewell, that is why I gave it 20 bits, the assumption (always the weak point) is that it we won't just keep adding service names23:28
creihtExcept what happens when we add a new project like block storage which is likely to have as many services as swift?23:28
JordanRinkewhich is why I said it would work for a number of years also :-D23:29
creihtand what happens when we have more projects that are optional23:29
creihtI doubt it will last until the end of this year :)23:29
JordanRinkethat depends how they are implemented, but that is definitely the issue with an coded naming scheme23:30
creihteither way, I don't think it is a good idea as a global strategy23:30
sirp-dirakx: what platform are you running on?23:32
dirakxsirp-: ubuntu 10.1023:33
*** schisamo has joined #openstack23:34
openstackhudsonProject nova build #359: SUCCESS in 1 min 15 sec: http://hudson.openstack.org/job/nova/359/23:34
JordanRinkecreiht: have a better suggestion that allows for globalization of naming standards and any style config?23:35
creihtdon't do it23:36
creiht:)23:36
JordanRinkewhy not?23:36
creihtbecause, while it may sound great in theory, in practice you are going to cause more problems than you solve23:37
sirp-dirakx:  can you run this in your nova-root directory find -name openssl.cnf -print23:38
creihtor we could do it right, and offer globalized naming as a service23:38
creiht;)23:38
creihtbut then again, that is just my opinion23:39
dirakxsirp-: ./bin/openssl.cnf23:39
dirakx./contrib/nova/CA/openssl.cnf23:39
*** dragondm has quit IRC23:39
JordanRinkecreiht: well my initial thought was to just use some standard names but I figured people are going to implement this in lots of different ways23:39
dubsdirakx: thats from the root of your nova directory?23:39
JordanRinkecreiht: one thought is to just step it up to a 6char ID which gives 31 service bits23:40
dirakxdubs yep.23:40
creihtIDv6?23:40
creiht:)23:40
JordanRinkeohh buzz word! win! haha23:40
dubsdirakx: then you've files appear to have been moved around.   from the root you should see CA/openssl.cnf23:40
dirakxdubs should i copy those from contrib ? .23:41
creihteach service could have a uuid, then name each server as the checksum of the ids of the servers :)23:42
dubsit looks like to me your contrib/nova dir *is* your root nova dir23:42
* creiht is not serious btw23:42
dirakxdubs running from contri/nova i'm getting a database error .23:45
dirakxsomething like this http://paste.openstack.org/show/408/23:46
*** trin_cz has joined #openstack23:46
sirp-dirakx:  two part question: in contrib/nova is there a file called "HACKING" and b) is there nova.sqlite3 or was that in the other directory?23:48
openstackhudsonProject nova build #360: SUCCESS in 1 min 19 sec: http://hudson.openstack.org/job/nova/360/23:49
*** daleolds has joined #openstack23:51
dirakxsirp-: a) yes23:51
*** opengeard has joined #openstack23:52
dirakxsirp-: and b...i'm trying to find that file :( ..xtrange.23:54
sirp-dirakx: hmm, one option is to start over with a fresh nova checkout and make sure all the commands are run from that nova-root dir; it's possible running cmds from various directories caused some files to get misplaced23:55
*** rogue780 has quit IRC23:56
dirakxsirp-: i should do that..also because i tried with nova.sh and with packages..so is just etter to start over again,23:56
dirakxsirp-: and dubs thanks for your great help. :)23:57
sirp-dirakx: np23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!