| *** guynaor has quit IRC | 00:17 | |
| *** guynaor has joined #openstack | 00:26 | |
| *** pharkmillups has quit IRC | 00:26 | |
| *** ChrisAM1 is now known as ChrisAM | 00:36 | |
| *** Ziad has joined #openstack | 00:45 | |
| *** zns has joined #openstack | 00:50 | |
| *** Ziad has quit IRC | 00:51 | |
| *** zns has quit IRC | 00:52 | |
| *** zns has joined #openstack | 00:53 | |
| *** guynaor has left #openstack | 00:55 | |
| *** zns has quit IRC | 01:02 | |
| *** miclorb_ has joined #openstack | 01:08 | |
| *** anotherjesse_ has joined #openstack | 01:12 | |
| *** rsampaio has joined #openstack | 01:16 | |
| *** anotherjesse_ has quit IRC | 01:17 | |
| *** anotherjesse_ has joined #openstack | 01:17 | |
| *** dizz|away has quit IRC | 01:18 | |
| *** dizz has joined #openstack | 01:22 | |
| *** seats_ has joined #openstack | 01:28 | |
| *** czajkows1i has joined #openstack | 01:29 | |
| *** anotherjesse_ has joined #openstack | 01:29 | |
| *** zns has joined #openstack | 01:29 | |
| *** seats has quit IRC | 01:29 | |
| *** ivan has quit IRC | 01:29 | |
| *** AlanBell has quit IRC | 01:29 | |
| *** czajkowski has quit IRC | 01:29 | |
| *** localhost has quit IRC | 01:29 | |
| *** jaypipes has quit IRC | 01:29 | |
| *** seats_ is now known as seats | 01:29 | |
| *** AlanBell has joined #openstack | 01:30 | |
| *** miclorb_ has quit IRC | 01:31 | |
| *** jaypipes has joined #openstack | 01:31 | |
| *** localhost has joined #openstack | 01:32 | |
| *** ivan has joined #openstack | 01:35 | |
| *** zns has quit IRC | 01:44 | |
| creiht | jeremyb: I think the use case you have been discussing is a bit outside what swift was designed for | 01:46 |
|---|---|---|
| creiht | and re: 1k files, in general that would be bad for storage since XFS has a default block size of 4k + 1k inode (but you will have that same issue storing those files on any system) | 01:47 |
| creiht | Now you could possibly take parts of swift and build what you are talking about (or possible build on top of) but I think a lot of that is outside the designed use case of swift | 01:48 |
| anotherjesse_ | creiht: what about 100GB files :) -- any thought to adding chunking at the API layer | 01:49 |
| creiht | anotherjesse_: We will be talking about that at the conference :) | 01:50 |
| anotherjesse_ | creiht: awesome - spent a few hours with folks at various govt agencies doing science and this was their #1 request | 01:50 |
| creiht | And you know there is a nifty unix command named split right? :) | 01:50 |
| anotherjesse_ | ORLY ;) yeah I know - you can do it on client side, but thought is that it should be built into api | 01:51 |
| creiht | right now split and designing a naming scheme with marker queries will get you quite far | 01:51 |
| creiht | anotherjesse_: agreed | 01:51 |
| anotherjesse_ | since it isn't a unique requirement | 01:51 |
| creiht | wow that last sentence didn't come out right at all | 01:51 |
| creiht | too much sun at the airfield today | 01:51 |
| anotherjesse_ | creiht: more generally, they were saddened with the state of existing object stores that only hit a single spindle per "replica" per file on upload | 01:52 |
| creiht | anotherjesse_: yeah devcamcar and I talked about it a bit | 01:52 |
| anotherjesse_ | (seems amazon does something similar is what they were saying) | 01:52 |
| creiht | So you can actually do that now | 01:53 |
| anotherjesse_ | oh, cool, didn't realize devin gave you the download | 01:53 |
| creiht | kinda | 01:53 |
| creiht | say you have a file name large_object.txt | 01:53 |
| creiht | you could write a client script that uses the unix split command to split it into chunks of whatever size | 01:54 |
| creiht | each chunk would be named large_object.txt.01 .02 .03, etc. | 01:54 |
| anotherjesse_ | and then parallelize the upload | 01:54 |
| creiht | yup | 01:54 |
| creiht | you can get a listing of all the objects for large_object.txt by doing a prefix query (I think that is the right term) on large_object.txt | 01:54 |
| anotherjesse_ | the use case we have seen is instruments producing information at GB/s or more - and wanting to push directly into object store | 01:54 |
| creiht | which would give you all the chunks, download them, and concat them back together | 01:55 |
| anotherjesse_ | ya | 01:55 |
| anotherjesse_ | I think we want to focus on geographic redundancy first - but if we can get the folks doing massive datasets to help improve swift it would be awesome | 01:56 |
| creiht | yeah | 01:56 |
| creiht | We'll talk about all of that a lot more next week :) | 01:56 |
| anotherjesse_ | looking forward to it | 01:56 |
| creiht | And it is also good for use to get requests for new features with actual use cases :) | 01:57 |
| creiht | is | 01:57 |
| creiht | erm | 01:57 |
| creiht | us | 01:57 |
| *** anotherjesse_ has quit IRC | 02:02 | |
| *** anotherjesse_ has joined #openstack | 02:02 | |
| *** felixdm has joined #openstack | 02:14 | |
| *** felixdm has quit IRC | 02:15 | |
| *** anotherjesse_ has quit IRC | 02:20 | |
| *** zykes- has quit IRC | 02:27 | |
| *** KnightHacker has quit IRC | 02:30 | |
| *** anotherjesse_ has joined #openstack | 02:52 | |
| *** ptremblett has joined #openstack | 03:04 | |
| *** miclorb has joined #openstack | 03:09 | |
| *** anotherjesse_ has quit IRC | 03:18 | |
| *** Cybodog has joined #openstack | 03:19 | |
| *** KnightHacker has joined #openstack | 03:20 | |
| *** miclorb has quit IRC | 03:23 | |
| *** Cybodog has quit IRC | 03:27 | |
| *** mlanner has joined #openstack | 03:43 | |
| *** joearnold has joined #openstack | 03:44 | |
| *** blpiatt has joined #openstack | 03:53 | |
| *** joearnold has quit IRC | 03:53 | |
| *** joearnold has joined #openstack | 03:54 | |
| *** omidhdl has joined #openstack | 04:03 | |
| *** ArdRigh has joined #openstack | 04:03 | |
| *** omidhdl1 has joined #openstack | 04:04 | |
| *** omidhdl has quit IRC | 04:04 | |
| *** blpiatt has quit IRC | 04:12 | |
| *** joearnold has quit IRC | 04:14 | |
| *** metcalfc has joined #openstack | 04:17 | |
| *** kim0 has quit IRC | 04:22 | |
| *** joearnold has joined #openstack | 04:43 | |
| *** Podilarius has joined #openstack | 04:46 | |
| *** joearnold has quit IRC | 04:47 | |
| *** KnightHacker has quit IRC | 04:49 | |
| *** joearnold has joined #openstack | 04:52 | |
| *** metcalfc has quit IRC | 04:54 | |
| *** omidhdl1 has quit IRC | 05:07 | |
| *** ptremblett_ has joined #openstack | 05:11 | |
| *** ptremblett has quit IRC | 05:14 | |
| *** ptremblett_ is now known as ptremblett | 05:14 | |
| *** chmouel has quit IRC | 05:26 | |
| *** KnightHacker has joined #openstack | 05:28 | |
| mlanner | hi, i've just installed swift for the first time. i followed the swift SAIO documentation. everything seemed to be going fine ... no errors along the way ... until i got to the very last statement, the probetest. while running the probetest the first time, it complained about 'user:group: in one file. i corrected a typo there, then ran it again. now, running both functest and probetest generate a ton of errors. anyone have | 05:30 |
| mlanner | suggestions what to look for? | 05:30 |
| *** hornbeck has joined #openstack | 05:42 | |
| *** joearnold has quit IRC | 05:43 | |
| *** chmouel has joined #openstack | 05:44 | |
| *** joearnold has joined #openstack | 05:44 | |
| *** arcane has quit IRC | 05:45 | |
| *** arcane has joined #openstack | 05:46 | |
| *** blakeyeager has joined #openstack | 05:51 | |
| *** guynaor has joined #openstack | 05:52 | |
| *** guynaor has left #openstack | 05:53 | |
| *** rsampaio has quit IRC | 05:59 | |
| *** rsampaio has joined #openstack | 06:08 | |
| *** pvo has quit IRC | 06:19 | |
| mlanner | k, nevermind. figured out my problem. had to delete all the .builder and .ring.gz and redo the entire last remakerings process again. it's all good now. | 06:20 |
| *** rsampaio has quit IRC | 06:32 | |
| *** burris has quit IRC | 06:36 | |
| *** mlanner has quit IRC | 06:37 | |
| *** omidhdl has joined #openstack | 06:40 | |
| *** arcane has quit IRC | 06:48 | |
| *** arcane has joined #openstack | 06:48 | |
| *** joearnold has quit IRC | 07:00 | |
| *** omidhdl has quit IRC | 07:04 | |
| *** blakeyeager has quit IRC | 07:17 | |
| *** burris has joined #openstack | 07:27 | |
| *** allsystemsarego has joined #openstack | 07:51 | |
| *** KnightHacker has quit IRC | 08:13 | |
| *** omidhdl has joined #openstack | 08:14 | |
| *** KanGouLya has joined #openstack | 08:37 | |
| *** kim0 has joined #openstack | 08:48 | |
| *** kim0 has joined #openstack | 08:48 | |
| *** jaypipes has quit IRC | 08:56 | |
| *** KanGouLya has quit IRC | 08:57 | |
| *** KanGouLya has joined #openstack | 08:58 | |
| *** jaypipes has joined #openstack | 09:10 | |
| *** KanGouLya has quit IRC | 09:27 | |
| *** KanGouLya has joined #openstack | 09:28 | |
| *** KanGouLya has left #openstack | 09:41 | |
| *** hornbeck has quit IRC | 09:48 | |
| *** ArdRigh has quit IRC | 10:12 | |
| *** czajkows1i is now known as czajkowski | 10:16 | |
| *** czajkowski has joined #openstack | 10:16 | |
| *** krish has joined #openstack | 11:36 | |
| *** ucu7 has quit IRC | 11:39 | |
| *** msinhore has joined #openstack | 11:45 | |
| *** msinhore1 has joined #openstack | 11:47 | |
| *** msinhore has quit IRC | 11:47 | |
| *** ucu7 has joined #openstack | 11:52 | |
| *** dkocher has joined #openstack | 11:54 | |
| *** dkocher has quit IRC | 12:00 | |
| *** befreax has joined #openstack | 12:01 | |
| *** omidhdl has quit IRC | 12:06 | |
| *** omidhdl has joined #openstack | 12:06 | |
| *** msinhore1 has quit IRC | 12:28 | |
| *** krish has quit IRC | 12:41 | |
| *** pvo has joined #openstack | 12:49 | |
| *** ChanServ sets mode: +v pvo | 12:49 | |
| *** dizz is now known as dizz|away | 12:50 | |
| *** Cybodog has joined #openstack | 12:58 | |
| *** krish has joined #openstack | 13:00 | |
| *** Cybodog has quit IRC | 13:02 | |
| *** houssem has joined #openstack | 13:08 | |
| *** dizz|away has quit IRC | 13:08 | |
| *** houssem has quit IRC | 13:09 | |
| *** jordandev has joined #openstack | 13:09 | |
| *** dizz has joined #openstack | 13:10 | |
| *** jordandev has quit IRC | 13:11 | |
| *** jordandev has joined #openstack | 13:11 | |
| *** jordandev has joined #openstack | 13:11 | |
| *** krish has quit IRC | 13:18 | |
| *** krish has joined #openstack | 13:31 | |
| *** zns has joined #openstack | 13:39 | |
| *** kim0 has joined #openstack | 13:46 | |
| kim0 | Hi folks, I'm playing with the novascript, getting the following error at "run" stage | 13:47 |
| kim0 | nova.exception.Error: volume group nova-volumes doesn't exist | 13:47 |
| kim0 | although I attached a new disk "/dev/vdb" and created a LVM VG on that called "nova-volumes" | 13:47 |
| *** zns has quit IRC | 13:49 | |
| termie | why does bzr even bother writing the "estimate" down when you are branching a remote repo | 13:53 |
| termie | it constantly changes, might as well be a windows progress bar | 13:53 |
| kim0 | bah I have to actually create a LV for the VG dir to be created at /dev/%s .. ok | 13:55 |
| *** befreax has quit IRC | 13:56 | |
| *** mischer has joined #openstack | 13:57 | |
| czajkowski | kim0: aloha | 13:58 |
| kim0 | czajkowski: hey ;) | 13:59 |
| kim0 | I'm past the nova-volumes issue, however it seems now libvirt can't create an instance, getting: | 14:06 |
| kim0 | libvirtError: internal error process exited while connecting to monitor: chardev: opening backend "file" failed | 14:06 |
| *** dizz is now known as dizz|away | 14:07 | |
| *** omidhdl has left #openstack | 14:08 | |
| *** befreax has joined #openstack | 14:10 | |
| kim0 | cool .. problem resolved .. instance launched | 14:20 |
| *** perestrelka has quit IRC | 14:22 | |
| *** befreax has quit IRC | 14:22 | |
| *** ttx has quit IRC | 14:24 | |
| *** ttx has joined #openstack | 14:24 | |
| *** ttx has joined #openstack | 14:24 | |
| *** perestrelka has joined #openstack | 14:24 | |
| *** ttx has quit IRC | 14:25 | |
| *** zns has joined #openstack | 14:33 | |
| *** msinhore has joined #openstack | 14:34 | |
| *** Cybodog has joined #openstack | 14:36 | |
| *** msinhore has quit IRC | 14:46 | |
| *** befreax has joined #openstack | 14:48 | |
| *** Cybo has joined #openstack | 14:57 | |
| *** mischer has quit IRC | 15:02 | |
| *** Cybodog has quit IRC | 15:10 | |
| *** mischer has joined #openstack | 15:16 | |
| *** sparkycollier has joined #openstack | 15:28 | |
| *** KnightHacker has joined #openstack | 15:34 | |
| *** msinhore has joined #openstack | 15:37 | |
| *** KnightHacker has quit IRC | 15:40 | |
| *** deshantm_cosi has quit IRC | 15:43 | |
| *** blakeyeager has joined #openstack | 15:44 | |
| *** joearnold has joined #openstack | 15:57 | |
| *** deshantm_cosi has joined #openstack | 15:58 | |
| *** zul has quit IRC | 15:59 | |
| *** befreax has quit IRC | 16:00 | |
| *** kim0 has quit IRC | 16:19 | |
| *** schisamo has joined #openstack | 16:20 | |
| *** msinhore has quit IRC | 16:27 | |
| *** joearnold has quit IRC | 16:56 | |
| *** joearnold has joined #openstack | 17:09 | |
| *** joearnold has quit IRC | 17:14 | |
| *** jbryce has joined #openstack | 17:16 | |
| *** krish has quit IRC | 17:18 | |
| *** romohr has joined #openstack | 17:26 | |
| *** joearnold has joined #openstack | 17:29 | |
| xtoddx | who handles the hudson configs? I'm curious as to the rules for building docs from nova source (is it using 'make html' or calling sphinx directly). | 17:54 |
| *** pvo has quit IRC | 18:05 | |
| *** underdone has joined #openstack | 18:12 | |
| *** rsampaio has joined #openstack | 18:42 | |
| *** dendrobates is now known as dendro-afk | 18:46 | |
| *** pvo has joined #openstack | 18:51 | |
| *** ChanServ sets mode: +v pvo | 18:51 | |
| *** rsampaio has quit IRC | 19:05 | |
| *** rsampaio has joined #openstack | 19:05 | |
| *** KnightHacker has joined #openstack | 19:12 | |
| eday | xtoddx: mtaylor does | 19:15 |
| xtoddx | eday: thanks | 19:15 |
| xtoddx | mtaylor: ^^^^ re: hudson sphinx config? | 19:16 |
| eday | xtoddx: looks like: | 19:21 |
| *** Abd4llA has joined #openstack | 19:21 | |
| eday | export HUDSON_PUBLISH_DOCS=1 | 19:21 |
| eday | python setup.py build_sphinx | 19:21 |
| xtoddx | huh | 19:22 |
| *** rsampaio has quit IRC | 19:22 | |
| *** rsampaio has joined #openstack | 19:22 | |
| *** AimanA is now known as HouseAway | 19:23 | |
| *** HouseAway is now known as AimanA | 19:23 | |
| *** jkakar has quit IRC | 19:30 | |
| *** rsampaio has quit IRC | 19:41 | |
| *** underdone has quit IRC | 19:42 | |
| *** jkakar has joined #openstack | 19:46 | |
| *** hggdh has quit IRC | 19:54 | |
| *** jkakar has quit IRC | 19:57 | |
| *** KnightHacker has quit IRC | 20:00 | |
| *** KnightHacker has joined #openstack | 20:03 | |
| *** hornbeck has joined #openstack | 20:04 | |
| *** msinhore has joined #openstack | 20:04 | |
| *** joearnold has quit IRC | 20:07 | |
| *** KnightHacker has quit IRC | 20:08 | |
| *** chmouel has quit IRC | 20:10 | |
| *** jkakar has joined #openstack | 20:14 | |
| *** jkakar has quit IRC | 20:26 | |
| *** pvo has quit IRC | 20:41 | |
| *** pvo_ has joined #openstack | 20:41 | |
| *** ChanServ sets mode: +v pvo_ | 20:41 | |
| *** jkakar has joined #openstack | 20:41 | |
| *** chmouel has joined #openstack | 20:43 | |
| *** ucu7 has quit IRC | 20:49 | |
| *** jkakar has quit IRC | 20:51 | |
| *** mischer has quit IRC | 20:51 | |
| *** gaveen has joined #openstack | 20:52 | |
| *** jordandev has quit IRC | 21:00 | |
| *** romohr has quit IRC | 21:05 | |
| *** jordandev has joined #openstack | 21:06 | |
| *** jkakar has joined #openstack | 21:07 | |
| *** joearnold has joined #openstack | 21:17 | |
| *** Podilarius has left #openstack | 21:23 | |
| *** jtimberman has joined #openstack | 21:31 | |
| *** zns has joined #openstack | 21:36 | |
| *** joearnold has quit IRC | 21:50 | |
| *** joearnold has joined #openstack | 21:52 | |
| *** dizz|away has quit IRC | 21:57 | |
| *** zns has quit IRC | 22:03 | |
| *** miclorb has joined #openstack | 22:07 | |
| *** DubLo7 has joined #openstack | 22:09 | |
| *** rsampaio has joined #openstack | 22:10 | |
| *** DubLo7 has left #openstack | 22:31 | |
| *** kim0 has joined #openstack | 22:32 | |
| *** jordandev has quit IRC | 22:46 | |
| *** joearnold has quit IRC | 22:48 | |
| *** joearnold has joined #openstack | 22:48 | |
| *** jordandev has joined #openstack | 23:00 | |
| mtaylor | xtoddx: python setup.py build_sphinx | 23:04 |
| mtaylor | xtoddx: the HUDSON_PUBLISH_DOCS=1 is a hack to allow us to inject google analytics headers into the output for the ones we publish and to not have those headers wind up in anything that folks generate locally | 23:06 |
| xtoddx | cool, i think we've pretty much got everything working again in lp:~anso/nova/trunkdoc using setup.py instead of relying on make html | 23:07 |
| mtaylor | xtoddx: excellent | 23:09 |
| mtaylor | where did make html come from? | 23:09 |
| xtoddx | initial sphinx setup make a makefile for you | 23:09 |
| mtaylor | ah yes. | 23:10 |
| mtaylor | sorry - I thought I'd deleted that ages ago | 23:10 |
| mtaylor | xtoddx: what does your ext.autodoc do? | 23:11 |
| xtoddx | generates module documentation | 23:11 |
| xtoddx | by inspecting the source tree and generating .rst files that call automodule | 23:11 |
| mtaylor | cool | 23:11 |
| * mtaylor has been meaning to write some sphinx extensions to do some similar things for the drizzle source... just hasn't gotten to it yet | 23:12 | |
| mtaylor | so I may browse through what you did | 23:12 |
| xtoddx | hopefully this can be a start | 23:12 |
| xtoddx | pretty simple | 23:12 |
| xtoddx | right now we're working on getting FLAGS documentation auto generating | 23:13 |
| mtaylor | sweet | 23:13 |
| mtaylor | that's a good idea | 23:13 |
| *** zns has joined #openstack | 23:16 | |
| *** msinhore has quit IRC | 23:22 | |
| *** jordandev has quit IRC | 23:24 | |
| *** ArdRigh has joined #openstack | 23:31 | |
| *** rsampaio has quit IRC | 23:31 | |
| *** zns has quit IRC | 23:32 | |
| *** anotherjesse_ has joined #openstack | 23:33 | |
| *** msinhore has joined #openstack | 23:34 | |
| *** anotherjesse_ has quit IRC | 23:39 | |
| *** hggdh has joined #openstack | 23:40 | |
| *** kim0 has quit IRC | 23:55 | |
| *** Abd4llA has quit IRC | 23:55 | |
| *** joearnold has quit IRC | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!