*** romank has quit IRC | 00:06 | |
*** jaypipes has joined #openstack | 00:13 | |
*** paltman has joined #openstack | 00:35 | |
*** joearnold has quit IRC | 00:35 | |
*** koolhead17 has quit IRC | 00:48 | |
*** dysinger has quit IRC | 00:54 | |
*** toddmorey has joined #openstack | 00:59 | |
*** dysinger has joined #openstack | 01:00 | |
*** miclorb_ has joined #openstack | 01:01 | |
*** zul has joined #openstack | 01:02 | |
*** obino has joined #openstack | 01:21 | |
uvirtbot | New bug: #789727 in nova "test_libvirt: cleanup instances_path dir" [Wishlist,In progress] https://launchpad.net/bugs/789727 | 01:22 |
---|---|---|
*** joearnold has joined #openstack | 01:44 | |
*** yamahata_lt has joined #openstack | 01:49 | |
*** joearnold has quit IRC | 01:51 | |
*** Ryan_Lane has joined #openstack | 02:11 | |
*** toddmorey has quit IRC | 02:19 | |
*** Ryan_Lane1 has joined #openstack | 02:19 | |
*** Ryan_Lane1 has joined #openstack | 02:20 | |
*** Ryan_Lane has quit IRC | 02:20 | |
*** Ryan_Lane1 is now known as Ryan_Lane | 02:22 | |
*** hadrian has quit IRC | 03:00 | |
*** toddmorey has joined #openstack | 03:07 | |
*** gaveen has quit IRC | 03:09 | |
*** sophiap has quit IRC | 03:10 | |
*** gaveen has joined #openstack | 03:16 | |
uvirtbot | New bug: #789741 in nova "fix instance rebuilds (compute manager and metadata)" [Undecided,In progress] https://launchpad.net/bugs/789741 | 03:31 |
*** gaveen has quit IRC | 03:39 | |
*** gaveen has joined #openstack | 03:52 | |
*** cdbs has quit IRC | 03:57 | |
*** zns has joined #openstack | 04:07 | |
uvirtbot | New bug: #789755 in nova "OSAPI: v1.1 /servers resize action with flavorRef" [Undecided,In progress] https://launchpad.net/bugs/789755 | 04:11 |
*** sebastianstadil has joined #openstack | 04:36 | |
*** cdbs has joined #openstack | 04:42 | |
*** zns has quit IRC | 04:44 | |
*** cdbs has quit IRC | 04:48 | |
*** toddmorey has quit IRC | 04:58 | |
*** toddmorey has joined #openstack | 05:04 | |
*** cdbs has joined #openstack | 05:10 | |
*** toddmorey has quit IRC | 05:33 | |
*** miclorb_ has quit IRC | 05:34 | |
*** zenmatt has joined #openstack | 05:38 | |
*** lucasnodine has quit IRC | 05:46 | |
*** burris has quit IRC | 06:27 | |
*** mgoldmann has joined #openstack | 06:38 | |
*** sebastianstadil has quit IRC | 06:48 | |
*** adjohn has joined #openstack | 07:04 | |
*** toddmorey has joined #openstack | 07:04 | |
*** adjohn has quit IRC | 07:05 | |
*** osier has joined #openstack | 07:05 | |
*** cdbs has quit IRC | 07:44 | |
*** kennethkalmer has joined #openstack | 08:00 | |
*** magglass1 has quit IRC | 08:06 | |
*** magglass1 has joined #openstack | 08:14 | |
*** allsystemsarego has joined #openstack | 08:21 | |
*** magglass1 has quit IRC | 08:22 | |
*** mcclurmc_ has left #openstack | 08:22 | |
*** Razique has joined #openstack | 08:29 | |
*** magglass1 has joined #openstack | 08:29 | |
Razique | Hi all! | 08:29 |
*** cdbs has joined #openstack | 08:30 | |
*** dysinger has quit IRC | 08:34 | |
*** cdbs has quit IRC | 08:40 | |
*** cdbs has joined #openstack | 08:44 | |
*** kennethkalmer has quit IRC | 08:47 | |
*** adiantum has joined #openstack | 08:54 | |
*** toddmorey has quit IRC | 09:04 | |
*** burris has joined #openstack | 09:39 | |
*** mgoldmann has quit IRC | 09:39 | |
*** Eyk^off is now known as Eyk | 09:56 | |
*** burris has quit IRC | 10:00 | |
*** HugoKuo__ has quit IRC | 10:16 | |
*** HugoKuo has joined #openstack | 10:17 | |
*** e1mer has joined #openstack | 10:20 | |
*** Razique has quit IRC | 10:42 | |
*** Ryan_Lane has quit IRC | 10:44 | |
*** cascone has joined #openstack | 10:48 | |
*** gaveen has quit IRC | 10:56 | |
*** reolik has joined #openstack | 11:13 | |
*** sranthony has joined #openstack | 11:16 | |
*** sranthony has quit IRC | 11:16 | |
*** reolik has quit IRC | 11:26 | |
*** adiantum has quit IRC | 11:37 | |
*** MarkAtwood has joined #openstack | 11:42 | |
*** sebastianstadil has joined #openstack | 11:47 | |
*** Eyk is now known as Eyk^off | 11:59 | |
*** ziyadb_ has joined #openstack | 12:21 | |
*** ziyadb_ has quit IRC | 12:27 | |
*** cascone has quit IRC | 12:30 | |
*** ziyadb has joined #openstack | 12:43 | |
*** ziyadb has joined #openstack | 12:43 | |
*** _william_ has joined #openstack | 12:44 | |
ziyadb | so you guys use a SAN for block storage w/ nova? | 12:46 |
ziyadb | where can I read up on that? | 12:46 |
*** RobertLaptop has quit IRC | 12:52 | |
*** kennethkalmer has joined #openstack | 12:53 | |
ziyadb | i presume swift uses a SAN for object storage as well? | 13:00 |
*** MarkAtwood has quit IRC | 13:07 | |
dsockwell | ziyadb: i've got a fibre channel setup i'm trying out today, i'll keep you posted if you want? | 13:08 |
dsockwell | not quite sure what i'm going to do about it | 13:08 |
ziyadb | dsockwell yea, I'm a network guy, I want to know what kind of infrastructure i need to build to support swift and nova storage. | 13:09 |
dsockwell | i must be upfront, i haven't actually gotten to the installing-openstack part on my setup | 13:10 |
dsockwell | but from poking through the code it seems to be set up for iscsi | 13:10 |
dsockwell | and from what I read about swift, it's supposed to be a clustered storage system; many machines with their own DAS that make up the service | 13:11 |
dsockwell | could be kludged with a san if you want, but if you are building out infrastructure from scratch you will probably want to do ethernet and not fc | 13:11 |
dsockwell | of course i could be completely wrong | 13:12 |
ziyadb | why hasn't anyone written a book about this? | 13:12 |
dsockwell | docs.openstack.org | 13:12 |
*** hadrian has joined #openstack | 13:12 | |
*** ziyadb has quit IRC | 13:14 | |
*** zns has joined #openstack | 13:23 | |
*** ziyadb has joined #openstack | 13:24 | |
*** ziyadb has joined #openstack | 13:24 | |
ziyadb | dsockwell not bad. but most of it is speaking from an implementation perspective, not the infrastructure required to support it. that's what im looking for. | 13:24 |
dsockwell | yeah, it doesn't say much other than 1000BaseTX or faster is recommended | 13:27 |
ziyadb | you know what | 13:27 |
ziyadb | i'll write a damned "building cloud infrastructure" book. | 13:27 |
ziyadb | just as soon as I figure it out | 13:28 |
dsockwell | heh | 13:28 |
dsockwell | so really you've got your image storage service, your block storage (swift), and your compute nodes | 13:28 |
dsockwell | wait, is swift block storage or objects? | 13:29 |
dsockwell | :( looks like i need to do this for myself too | 13:29 |
ziyadb | heh, swift is object storage | 13:30 |
ziyadb | so you cant use swift as block storage for nova | 13:30 |
dsockwell | right | 13:30 |
*** osier has quit IRC | 13:35 | |
dsockwell | anyway, good luck, sorry i'm not more help | 13:35 |
ziyadb | heh thanks, let me know how your build turns out | 13:36 |
dsockwell | all right. i'm planning on throwing it on a wiki, so i'll link it here when it's got substance. | 13:37 |
ziyadb | even if not much substance :) anything helps at this point. | 13:39 |
dsockwell | all right. the plan now is to base everything off a SAN, with the nova machines booting from LUNs on my openindiana box. | 13:39 |
dsockwell | i'm toying with the idea of a large, shared LUN for VMs but that's more complexity I probably won't deal with | 13:40 |
dsockwell | so i'll probably just use SAN storage teh same as DAS | 13:40 |
dsockwell | but that's all done through Linux, i'm going to keep nova ignorant of it | 13:42 |
ziyadb | interesting. I have some more reading to do, reading a storage book by EMC press. | 13:42 |
ziyadb | i'll ping you later. | 13:42 |
dsockwell | but, this is because I'm building this installation out of essentially spare parts | 13:42 |
ziyadb | for private use? | 13:43 |
dsockwell | sort of | 13:43 |
dsockwell | it's for a computer club | 13:43 |
dsockwell | so if there's a performance issue we can tell people to suck it up | 13:44 |
*** lucasnodine has joined #openstack | 13:44 | |
ziyadb | ah, i see. | 13:45 |
dsockwell | anyway if i had my choice of hardware i'd put my openindiana box on a 10GE uplink to a gbit switch and run iscsi for everything, booting the nova machines from DAS | 13:45 |
ziyadb | im building a public cloud | 13:45 |
dsockwell | since nova already has a driver for block storage on OI | 13:45 |
dsockwell | or any solaris | 13:45 |
*** Lucas_Nodine has joined #openstack | 13:46 | |
dsockwell | that way i could concentrate i/o on the cluster to a few SSDs | 13:46 |
dsockwell | but as it stands i'm doing sort of the same thing with an old 2gb FC switch | 13:47 |
ziyadb | interesting, interesting. | 13:47 |
ziyadb | I need to familiarize myself with nova further before moving forward. | 13:47 |
ziyadb | which, as you can imagine, is not as easy as it ought to be. | 13:48 |
dsockwell | yes | 13:48 |
dsockwell | what hypervisor are you considering? | 13:48 |
*** lucasnodine has quit IRC | 13:49 | |
ziyadb | most likely esx | 13:50 |
*** koolhead17 has joined #openstack | 13:51 | |
dsockwell | ah, can't say that i've dealt with that. i was going to say that centos6 is coming, and openstack has packages for el6 that should fit in nicely if you can deal with kvm instead of xen | 13:52 |
ziyadb | main reason we're considering esx is because I "think" it has better network support | 13:53 |
*** freeflyi1g is now known as freeflying | 13:54 | |
dsockwell | it might | 13:54 |
dsockwell | what kind of networking features do you need? | 13:54 |
ziyadb | whatever is needed to support openstack | 13:55 |
ziyadb | im a network guy and have been doing this open stack thing for 3 days | 13:55 |
ziyadb | so im yet to fully wrap my head around it. | 13:55 |
dsockwell | ok, so you're not being asked for multiple interfaces per instance or whatever else? | 13:55 |
ziyadb | I don't suppose we're gonna need more than a single interface per vm instance, no. | 13:56 |
ziyadb | assuming we're talking about network interfaces | 13:57 |
dsockwell | openstack's best networking mode, what i think you'd use for a public cloud, is l2 isolation per vm. that's all done in Linux | 13:57 |
dsockwell | the server is the switch | 13:57 |
dsockwell | so between the networking controller and the compute nodes is what amounts to an 802.11q trunk, and it's split into vlans in Linux on the compute nodes | 13:57 |
dsockwell | so in that respect esx doesn't have anything special | 13:58 |
ziyadb | yeah, I have an idea about all of that. But there are other things to consider, like having more than a VM in a L2 domain (i.e. extending the L2 domain from the virtual switch to a physical one which in turn extends it to another virtual switch) for backup purposes and mobility. | 13:58 |
dsockwell | well it is vanilla 802.11q, so i'm sure with enough patience you could do whatever you have in mind with just Linux. but if there's a feature in esx you know about and I don't, go for it | 14:01 |
*** e1mer has quit IRC | 14:02 | |
ziyadb | dsockwell awesomeness, and i take it you mean 802.1q not 11q :) | 14:04 |
ziyadb | thanks. | 14:04 |
ziyadb | idle around often? | 14:04 |
dsockwell | ah, yes | 14:04 |
dsockwell | ha | 14:04 |
dsockwell | and i'm usually here | 14:05 |
dsockwell | that is if you highlight me i'll see the activity, eventually | 14:06 |
notmyname | ziyadb: for swift, 10g is recommended for external connections and 1g or faster is recommended for internal cluster bandwidth | 14:10 |
notmyname | swift uses DAS, not SAN | 14:10 |
*** cascone has joined #openstack | 14:10 | |
*** cascone has quit IRC | 14:13 | |
notmyname | for a test cluster 1g could be used for external connections | 14:14 |
notmyname | swift is designed for 2 things: cheap storage ($/GB) and extremely high concurrency (ie optimize aggregate throughput rather than single stream throughput) | 14:23 |
*** yamahata_lt has quit IRC | 14:24 | |
ziyadb | notmyname and nova uses SAN? | 14:27 |
notmyname | I can't speak for nova | 14:28 |
*** burris has joined #openstack | 14:28 | |
ziyadb | notmyname awesome, thanks for your input | 14:29 |
dsockwell | nova-volume can use DAS or iscsi | 14:29 |
dsockwell | pretty sure most instances have a DAS component | 14:29 |
ziyadb | yeah, wondering if it's possible to use block storage instead via isci or fcip/fcoe | 14:31 |
notmyname | keeping in mind my last statement, I think so | 14:32 |
dsockwell | you can mount whatever you want for the disk image storage, and iscsi is the accepted elastic block storage driver | 14:33 |
*** ostck has joined #openstack | 14:33 | |
ziyadb | so it's iscsi and fc is mostly off the table | 14:33 |
dsockwell | pretty much | 14:33 |
dsockwell | i might get a driver together for solaris fc, but i think development is focusing on iscsi | 14:34 |
ziyadb | iscsi runs over ip, right? | 14:34 |
dsockwell | unless i'm sorely mistaken, yes | 14:34 |
ziyadb | awesomeness | 14:35 |
dsockwell | it at least operates over ethernet | 14:35 |
ziyadb | so no need for stupid specialized network gear | 14:35 |
dsockwell | and if it weren't ip it would be called aoe or fcoe | 14:35 |
dsockwell | no, just a good ethernet switch | 14:35 |
*** BoncOS has joined #openstack | 14:37 | |
ziyadb | awesome | 14:38 |
*** ziyadb is now known as imnotziyadb | 14:42 | |
*** imnotziyadb has quit IRC | 14:48 | |
*** ziyadb has joined #openstack | 15:03 | |
*** zns has quit IRC | 15:07 | |
*** BoncOS has quit IRC | 15:10 | |
*** RobertLaptop has joined #openstack | 15:12 | |
*** osier has joined #openstack | 15:19 | |
*** Eyk^off is now known as Eyk | 15:24 | |
*** BoncOS has joined #openstack | 15:26 | |
*** ostck has quit IRC | 15:38 | |
*** doude has quit IRC | 15:40 | |
*** citral has joined #openstack | 15:56 | |
*** BoncOS has quit IRC | 16:08 | |
*** osier has quit IRC | 16:18 | |
*** foxtrotgulf has joined #openstack | 16:31 | |
*** kennethkalmer has quit IRC | 16:35 | |
*** mgoldmann has joined #openstack | 16:42 | |
*** MarkAtwood has joined #openstack | 17:06 | |
*** foxtrotgulf has quit IRC | 17:20 | |
*** obino has quit IRC | 17:21 | |
*** Eyk is now known as Eyk^off | 17:27 | |
*** miki has joined #openstack | 17:28 | |
*** kennethkalmer has joined #openstack | 17:32 | |
*** kennethkalmer has quit IRC | 17:42 | |
*** obino has joined #openstack | 17:44 | |
*** miki has left #openstack | 17:45 | |
*** HugoKuo_ has joined #openstack | 18:04 | |
*** cbeck1 has joined #openstack | 18:05 | |
*** shentonfreude1 has joined #openstack | 18:05 | |
*** sebastianstadil_ has joined #openstack | 18:05 | |
*** jpipes has joined #openstack | 18:05 | |
*** drogoh_ has joined #openstack | 18:06 | |
*** thickski_ has joined #openstack | 18:06 | |
*** sebastianstadil has quit IRC | 18:06 | |
*** HugoKuo has quit IRC | 18:06 | |
*** jaypipes has quit IRC | 18:06 | |
*** aryan has quit IRC | 18:06 | |
*** termie has quit IRC | 18:06 | |
*** cbeck has quit IRC | 18:06 | |
*** shentonfreude has quit IRC | 18:06 | |
*** heden has quit IRC | 18:06 | |
*** thickskin has quit IRC | 18:06 | |
*** Xenith has quit IRC | 18:06 | |
*** Eyk^off has quit IRC | 18:06 | |
*** tahoe has quit IRC | 18:06 | |
*** arreyder has quit IRC | 18:06 | |
*** drogoh has quit IRC | 18:06 | |
*** arun has quit IRC | 18:06 | |
*** romans has quit IRC | 18:06 | |
*** sebastianstadil_ is now known as sebastianstadil | 18:06 | |
*** romans has joined #openstack | 18:06 | |
*** heden has joined #openstack | 18:08 | |
*** Xenith has joined #openstack | 18:09 | |
*** termie has joined #openstack | 18:11 | |
*** aryan has joined #openstack | 18:11 | |
*** arun has joined #openstack | 18:12 | |
*** RobertLaptop has quit IRC | 18:13 | |
*** arreyder has joined #openstack | 18:13 | |
*** jgb has quit IRC | 18:23 | |
*** RobertLaptop has joined #openstack | 18:26 | |
*** _william_ has left #openstack | 18:45 | |
*** maplebed has joined #openstack | 18:49 | |
*** konetzed has quit IRC | 18:50 | |
*** obino has quit IRC | 18:53 | |
*** drogoh_ is now known as drogoh | 18:54 | |
*** maplebed has quit IRC | 19:00 | |
*** citral has quit IRC | 19:01 | |
*** konetzed has joined #openstack | 19:02 | |
*** zenmatt has quit IRC | 19:12 | |
*** stewart has joined #openstack | 19:14 | |
*** stewart has quit IRC | 19:15 | |
*** ejat has joined #openstack | 19:22 | |
*** MarkAtwood has quit IRC | 19:25 | |
*** koolhead17 has quit IRC | 19:31 | |
*** kennethkalmer has joined #openstack | 19:35 | |
*** obino has joined #openstack | 19:50 | |
*** ejat has joined #openstack | 19:55 | |
*** ejat has joined #openstack | 19:56 | |
*** ejat has joined #openstack | 19:56 | |
*** ejat has joined #openstack | 19:57 | |
*** tahoe has joined #openstack | 20:02 | |
*** AWR has joined #openstack | 20:06 | |
AWR | hello | 20:06 |
*** obino has quit IRC | 20:15 | |
*** sebastianstadil has quit IRC | 20:16 | |
*** ejat has quit IRC | 20:19 | |
*** zenmatt has joined #openstack | 20:21 | |
*** ejat has joined #openstack | 20:22 | |
*** BK_man[away] has quit IRC | 20:27 | |
*** katkee has joined #openstack | 20:27 | |
*** obino has joined #openstack | 20:29 | |
*** mgoldmann has quit IRC | 20:35 | |
*** ejat has quit IRC | 20:40 | |
*** zenmatt has quit IRC | 20:43 | |
*** ejat has joined #openstack | 20:48 | |
*** ejat has joined #openstack | 20:48 | |
*** BK_man has joined #openstack | 20:53 | |
*** jero has joined #openstack | 21:05 | |
*** arreyder has quit IRC | 21:19 | |
*** arreyder has joined #openstack | 21:19 | |
*** zenmatt has joined #openstack | 21:27 | |
*** RobertLaptop has quit IRC | 21:28 | |
*** z0 has quit IRC | 21:32 | |
*** BK_man has quit IRC | 21:35 | |
*** RobertLaptop has joined #openstack | 21:40 | |
*** zenmatt has quit IRC | 21:43 | |
*** julian_c has joined #openstack | 21:48 | |
*** Eyk has joined #openstack | 21:48 | |
*** zenmatt has joined #openstack | 21:56 | |
*** katkee has quit IRC | 22:01 | |
*** burris has quit IRC | 22:03 | |
*** antenagora has joined #openstack | 22:05 | |
*** HouseAway is now known as AimanA | 22:07 | |
*** allsystemsarego has quit IRC | 22:08 | |
*** antenagora has quit IRC | 22:11 | |
*** RobertLaptop has quit IRC | 22:14 | |
*** lucasnodine has joined #openstack | 22:23 | |
*** Lucas_Nodine has quit IRC | 22:25 | |
lucasnodine | Documentation question: at http://docs.openstack.org/cactus/openstack-object-storage/developer/content/overview-api.html the section 2.2 states "Maximum length of all HTTP headers: 4096 bytes | 22:26 |
lucasnodine | ". Does this mean that all headers (cumulative) must be 4kb or less or does it mean that each individual header must be 4kb or less, but that this rule applies to all of them? | 22:26 |
notmyname | all total | 22:28 |
*** ShermanBoyd_ has joined #openstack | 22:28 | |
notmyname | you shouldn't be able to store all of your data in the headers! ;-) | 22:29 |
*** ShermanBoyd has quit IRC | 22:29 | |
*** ShermanBoyd_ is now known as ShermanBoyd | 22:29 | |
notmyname | however, if you want to up that limit (or lower it), I believe the value is stored in swift/common/consts.py | 22:29 |
lucasnodine | ah, really, thanks :D | 22:30 |
lucasnodine | yea, I'm hoping to store the meta information for files in them and then not have 1 file for meta and another for data | 22:30 |
notmyname | ya, that's what it's for | 22:31 |
notmyname | however, with no limit, it would be possible for a user to store the actual data in the headers and have a zero byte file | 22:32 |
lucasnodine | *nod* very useful feature btw. That has proven to be combersome with Couch | 22:32 |
notmyname | now, on disk, the metadata will always be stored in xattrs, but it may or may not be metadata on the original file | 22:32 |
notmyname | that is, on disk, some usage patterns can result in one file with the data and one file with the metadata. to the user, though, it's all one logical object/file | 22:33 |
notmyname | so the user will never have to maintain a separate metadata file (unless they need more than the limit, of course) | 22:34 |
lucasnodine | well that's still fine. I just hate having to make a reference for a meta and data files | 22:34 |
notmyname | no need with swift :-) | 22:35 |
*** lborda has joined #openstack | 22:35 | |
lucasnodine | that's excellent news :) | 22:35 |
*** lborda has quit IRC | 22:35 | |
*** ziyadb_ has joined #openstack | 22:36 | |
notmyname | for performance reasons, you may want to maintain your own indexes of containers (with some metadata per object). for example, you may want to sort on something other than object name or you may want to quickly list the objects in a container with a million files. both of these use cases are hard or impossible with swift | 22:36 |
notmyname | well, current versions of swift ;-) | 22:37 |
*** Ryan_Lane has joined #openstack | 22:37 | |
lucasnodine | Yea, are there any swift-lucene setups yet? ;P | 22:37 |
lucasnodine | that woudl make it easier maybe *shrug* | 22:37 |
*** ziyadb has quit IRC | 22:39 | |
*** zenmatt has quit IRC | 22:50 | |
*** miclorb_ has joined #openstack | 22:53 | |
*** julian_c has quit IRC | 22:57 | |
*** hadrian has quit IRC | 23:12 | |
*** hadrian has joined #openstack | 23:13 | |
*** zenmatt has joined #openstack | 23:30 | |
*** kennethkalmer has quit IRC | 23:41 | |
*** zenmatt_ has joined #openstack | 23:41 | |
*** zenmatt has quit IRC | 23:42 | |
*** jeffjapan has joined #openstack | 23:50 | |
*** obino has quit IRC | 23:52 | |
*** Eyk has quit IRC | 23:55 | |
*** zenmatt_ has quit IRC | 23:56 | |
*** MarkAtwood has joined #openstack | 23:56 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!