| gholt | Cool! And thanks! I don't know if someone already mentioned, but if you use the debian packages you'll get init scripts from there. Unfortunately, I don't think they're 100% atm; so that'll have to wait until they are. https://launchpad.net/~swift-core/+archive/ppa | 00:03 |
|---|---|---|
| uvirtbot | New bug: #666083 in nova "remove tornado.escape" [Undecided,New] https://launchpad.net/bugs/666083 | 00:11 |
| *** Cybodog has quit IRC | 00:13 | |
| *** masumotok has quit IRC | 00:22 | |
| mtaylor | gholt: oh, are our init scripts not great? | 00:32 |
| mtaylor | gholt: actually, I've been meaning to make upstart scripts for ubuntu... (never enough time in the day) | 00:32 |
| *** mtaylor has quit IRC | 00:32 | |
| *** sophiap has joined #openstack | 00:33 | |
| *** aliguori has quit IRC | 00:37 | |
| *** miclorb has quit IRC | 00:45 | |
| *** codejunkie has joined #openstack | 00:50 | |
| *** mfoemmel has quit IRC | 01:03 | |
| *** ar1 has joined #openstack | 01:03 | |
| *** zul_ has joined #openstack | 01:10 | |
| gholt | mtaylor: Ah no. Reading back my line before I realize I forgot a key word or three. I meant the packages weren't 100% up to date. I don't see the latest version there yet, assuming we're all 1.1.0 official and such. | 01:23 |
| *** mfoemmel has joined #openstack | 01:34 | |
| *** chmouel has quit IRC | 01:34 | |
| *** sandywalsh has quit IRC | 01:39 | |
| *** mtaylor has joined #openstack | 01:51 | |
| *** ChanServ sets mode: +v mtaylor | 01:51 | |
| *** codejunkie has quit IRC | 01:56 | |
| *** mtaylor has quit IRC | 01:59 | |
| *** miclorb has joined #openstack | 02:14 | |
| *** iammartian has quit IRC | 02:30 | |
| *** romain_ has joined #openstack | 02:39 | |
| *** romain_ has left #openstack | 02:39 | |
| *** ppetraki has joined #openstack | 03:09 | |
| *** miclorb has quit IRC | 03:16 | |
| *** ppetraki has quit IRC | 03:43 | |
| *** scarabx has joined #openstack | 03:44 | |
| *** joeallens has joined #openstack | 03:47 | |
| joeallens | can two swift proxies adress the same storage? | 03:48 |
| gholt | Yes, in fact that's usually the case. As many proxy servers as needed behind a load balancer. | 03:51 |
| *** scarabx has quit IRC | 03:53 | |
| joeallens | thanks. how do they not step on each other? don't you need a kind of dlm to avoid that? | 03:56 |
| *** ArdRigh has joined #openstack | 03:56 | |
| *** hazmat has quit IRC | 03:56 | |
| gholt | dlm? distributed lock manager? | 03:56 |
| joeallens | yes | 03:56 |
| gholt | I'm not sure which part your thinking about, but no dlm is needed. | 03:58 |
| gholt | For instance, if two concurrent PUTs for the same object occur, the last one wins once it completes. | 03:59 |
| joeallens | ok, I was just thinking about two write accesses to the same file at the same time. | 03:59 |
| joeallens | ok I see. | 03:59 |
| gholt | Yes, there's a requirement that the proxy servers have very close times. The start time of the request indicates who wins. | 04:00 |
| *** miclorb has joined #openstack | 04:00 | |
| joeallens | how do the proxies know about each other? and do they all manage the same set of rings? | 04:00 |
| gholt | The rings are managed externally for the whole of the cluster. Once new rings are created, updated, they are pushed/pulled out to all the servers. The proxies don't actually need to know about one another, with the exception that usually they each also run memcached and share all of those. | 04:02 |
| joeallens | ah, ok, so they find out about the avaialable targets when everyone else does... | 04:03 |
| gholt | Yes, the way the ring works no two partitions are ever moved at the same time for a given object. With 3 replicas, even if a proxy hasn't received the latest ring yet, it'll still have the proper address to 2 of the 3 replicas. | 04:05 |
| joeallens | ok i see. do you know why raid is discouraged? is it just not needed given the redundancy model or is there some specific penalty involved? | 04:06 |
| gholt | Performance was dramatically poorer with raid in testing. | 04:07 |
| *** kashyapc has joined #openstack | 04:08 | |
| joeallens | ah ok, does that mean software raid or an external array (something like fiber channel) | 04:09 |
| gholt | With raid, if a drive fails you just replace it and the raid rebuilds. Which seems like a big win. But it took forever to rebuild (many hours). Without it, the drive unmount is detected and Swift starts replicating a new third copy of the affected objects, usually completing within an hour (depending on cluster size of course). | 04:10 |
| gholt | Well, I don't know the specifics on the hardware used (sorry). I do know it was a hardware raid controller, not software. And that a couple folks have played around with it with different hardware. | 04:11 |
| joeallens | I see, so you avoid rebuilds altogether and fail the drive immediately to invoke new copies. that makes sense. thank you for answering. | 04:12 |
| gholt | No problem! I happen to have the computer nearby while watching some tv. :) | 04:12 |
| *** joeallens has quit IRC | 04:13 | |
| *** dendro-afk is now known as dendrobates | 04:15 | |
| *** Grizzletooth has quit IRC | 04:43 | |
| *** dendrobates is now known as dendro-afk | 05:18 | |
| *** omidhdl has joined #openstack | 05:51 | |
| *** mfoemmel has quit IRC | 05:57 | |
| *** mfoemmel has joined #openstack | 06:06 | |
| *** DubLo7 has quit IRC | 06:08 | |
| *** BK_man has joined #openstack | 06:46 | |
| *** stewart has quit IRC | 06:55 | |
| *** guigui1 has joined #openstack | 07:01 | |
| *** Cybodog has joined #openstack | 07:01 | |
| *** miclorb has quit IRC | 07:06 | |
| *** stewart has joined #openstack | 07:12 | |
| *** ibarrera has joined #openstack | 07:13 | |
| *** befreax has joined #openstack | 07:13 | |
| *** calavera has joined #openstack | 07:13 | |
| *** omidhdl has quit IRC | 07:22 | |
| *** omidhdl1 has joined #openstack | 07:23 | |
| *** befreax has quit IRC | 07:28 | |
| *** stewart has joined #openstack | 07:29 | |
| *** omidhdl has joined #openstack | 07:33 | |
| *** omidhdl1 has quit IRC | 07:34 | |
| *** allsystemsarego has joined #openstack | 07:37 | |
| *** taihen has quit IRC | 07:50 | |
| *** mfoemmel has quit IRC | 07:59 | |
| *** krish has joined #openstack | 08:02 | |
| *** Ryan_Lane has joined #openstack | 08:14 | |
| *** Ryan_Lane has quit IRC | 08:17 | |
| *** miclorb_ has joined #openstack | 08:25 | |
| *** mfoemmel has joined #openstack | 08:28 | |
| *** ArdRigh has quit IRC | 08:29 | |
| *** miclorb_ has quit IRC | 08:35 | |
| *** ramkrsna has joined #openstack | 08:36 | |
| *** almaisan-away is now known as al-maisan | 08:37 | |
| *** sophiap has quit IRC | 08:43 | |
| *** taihen has joined #openstack | 08:46 | |
| *** irahgel has quit IRC | 09:03 | |
| *** irahgel has joined #openstack | 09:04 | |
| *** ramkrsna has quit IRC | 09:05 | |
| *** ramkrsna has joined #openstack | 09:19 | |
| *** miclorb has joined #openstack | 09:20 | |
| *** irahgel has quit IRC | 09:20 | |
| *** befreax has joined #openstack | 09:22 | |
| *** irahgel has joined #openstack | 09:30 | |
| *** irahgel has left #openstack | 09:41 | |
| vishy | soren: | 09:42 |
| vishy | soren: are you around? | 09:42 |
| vishy | soren: I just discovered that if you do a virsh detach-disk on a logical volume, it leaves an open file descriptor | 09:43 |
| *** irahgel has joined #openstack | 09:44 | |
| *** scaraffe has joined #openstack | 09:48 | |
| vishy | really really annoying | 09:55 |
| *** chmouel has joined #openstack | 09:58 | |
| *** mfoemmel has quit IRC | 10:05 | |
| *** mfoemmel has joined #openstack | 10:17 | |
| *** befreax has quit IRC | 10:19 | |
| *** mfoemmel has quit IRC | 10:26 | |
| *** ambo has left #openstack | 10:26 | |
| *** veiko has joined #openstack | 10:28 | |
| *** scaraffe has left #openstack | 10:35 | |
| *** gustavomzw has joined #openstack | 10:38 | |
| *** kashyapc has quit IRC | 10:46 | |
| *** dendro-afk is now known as dendrobates | 10:49 | |
| *** ramkrsna has quit IRC | 10:50 | |
| *** miclorb has quit IRC | 11:03 | |
| *** itguru has joined #openstack | 11:14 | |
| *** mfoemmel has joined #openstack | 11:33 | |
| *** dendrobates is now known as dendro-afk | 11:34 | |
| *** ctennis has quit IRC | 11:36 | |
| *** dendro-afk is now known as dendrobates | 11:44 | |
| *** ramkrsna has joined #openstack | 11:46 | |
| *** westmaas has joined #openstack | 11:46 | |
| *** irahgel has left #openstack | 11:55 | |
| *** aliguori has joined #openstack | 11:59 | |
| *** sophiap has joined #openstack | 12:01 | |
| *** ctennis has joined #openstack | 12:12 | |
| *** ctennis has joined #openstack | 12:12 | |
| *** sophiap has quit IRC | 12:19 | |
| *** dendrobates is now known as dendro-afk | 12:22 | |
| *** hazmat has joined #openstack | 12:34 | |
| *** mischer has joined #openstack | 12:40 | |
| *** masumotok has joined #openstack | 12:42 | |
| *** BK_man has quit IRC | 12:42 | |
| *** itguru has quit IRC | 12:44 | |
| *** kashyapc has joined #openstack | 12:46 | |
| *** perestrelka has quit IRC | 12:47 | |
| masumotok | Hi there | 12:47 |
| *** perestrelka has joined #openstack | 12:51 | |
| *** jdarcy has joined #openstack | 12:57 | |
| *** hazmat has quit IRC | 13:00 | |
| *** omidhdl has left #openstack | 13:02 | |
| *** hazmat has joined #openstack | 13:03 | |
| masumotok | Has anyone encountered "ebiptables" problem? | 13:05 |
| *** littleidea has joined #openstack | 13:06 | |
| masumotok | libvirtError: internal error Could not get access to ACL tech driver 'ebiptables' | 13:06 |
| masumotok | I installed ebtables iptables gawk | 13:06 |
| soren | masumotok: Which distro? | 13:07 |
| masumotok | Ubuntu Lucid 10.04 | 13:07 |
| masumotok | Austin release for nova | 13:07 |
| masumotok | I checked libvirtd source code, but "grep -r ebiptables libvirtd-0.7.5" does not show anything. | 13:08 |
| *** hazmat has quit IRC | 13:09 | |
| *** zul_ has joined #openstack | 13:10 | |
| *** zul_ is now known as zul | 13:11 | |
| *** zul has joined #openstack | 13:11 | |
| *** zul has joined #openstack | 13:18 | |
| *** krish has quit IRC | 13:19 | |
| *** iammartian has joined #openstack | 13:24 | |
| *** mtaylor has joined #openstack | 13:29 | |
| *** ChanServ sets mode: +v mtaylor | 13:29 | |
| *** dendro-afk is now known as dendrobates | 13:29 | |
| *** krish has joined #openstack | 13:29 | |
| *** zul has quit IRC | 13:30 | |
| *** AimanA has joined #openstack | 13:32 | |
| *** hazmat has joined #openstack | 13:34 | |
| *** ramkrsna has quit IRC | 13:38 | |
| *** mischer has quit IRC | 13:44 | |
| *** zul has joined #openstack | 13:44 | |
| *** piken has joined #openstack | 13:44 | |
| annegentle | Grizzletooth: thanks a bunch for the MultiServerSwift install info | 13:51 |
| *** schisamo has joined #openstack | 13:51 | |
| *** hazmat has quit IRC | 13:56 | |
| *** irahgel has joined #openstack | 13:57 | |
| *** Podilarius has joined #openstack | 13:57 | |
| *** krish has quit IRC | 13:57 | |
| *** electroniceagle has joined #openstack | 13:59 | |
| *** pvo has joined #openstack | 14:00 | |
| *** ChanServ sets mode: +v pvo | 14:00 | |
| *** ppetraki has joined #openstack | 14:04 | |
| *** mordred_ has joined #openstack | 14:05 | |
| *** ChanServ sets mode: +v mordred_ | 14:05 | |
| *** mtaylor has quit IRC | 14:06 | |
| *** Grizzletooth has joined #openstack | 14:10 | |
| *** al-maisan has quit IRC | 14:11 | |
| *** Grizzletooth has quit IRC | 14:11 | |
| *** gondoi has joined #openstack | 14:11 | |
| *** grizzletooth has joined #openstack | 14:11 | |
| *** mordred_ has quit IRC | 14:19 | |
| *** krish has joined #openstack | 14:20 | |
| *** zul has quit IRC | 14:25 | |
| *** zul has joined #openstack | 14:27 | |
| grizzletooth | annegentle: glad to be of service - FYI I signed the CDA this weekend, and the project is certainly welcome to use that howto in distro or wiki or whatever. | 14:31 |
| annegentle | Grizzletooth: awesome. I'm pondering an RST to Wiki to RST process. | 14:32 |
| annegentle | Grizzletooth: I'll edit in Etherpad and hopefully get the RST into the code base today | 14:33 |
| *** dendrobates is now known as dendro-afk | 14:34 | |
| *** zul has quit IRC | 14:38 | |
| *** rnirmal has joined #openstack | 14:38 | |
| *** spectorclan has joined #openstack | 14:42 | |
| grizzletooth | annegentle: I noticed it is a little complicated trying to format back and forth between the Etherpad, RST, and the Wiki. All different markup languages. Looks like a rst2wiki.py would be useful. As well as an etherpad->RST exporter. | 14:42 |
| *** gundlach has joined #openstack | 14:42 | |
| *** pharkmillups has joined #openstack | 14:48 | |
| *** sirp has quit IRC | 14:48 | |
| *** sirp has joined #openstack | 14:49 | |
| annegentle | Grizzletooth: yup, agreed. | 14:49 |
| annegentle | Grizzletooth: it's interesting, the Swift team uses Etherpad to collaborative author RST, then brings it into code. So we're doing their method basically. | 14:49 |
| creiht | RST is basically a text file | 14:50 |
| creiht | etherpad doesn't have any RST helpers, but the markup gets pretty easy the more you use it | 14:51 |
| *** ttx has joined #openstack | 14:52 | |
| *** ttx has joined #openstack | 14:52 | |
| *** schisamo has quit IRC | 14:53 | |
| *** schisamo has joined #openstack | 14:53 | |
| *** silassewell has joined #openstack | 14:54 | |
| *** littleidea has quit IRC | 14:54 | |
| *** schisamo_ has joined #openstack | 14:54 | |
| *** hazmat has joined #openstack | 14:57 | |
| *** jarrod_ has quit IRC | 14:57 | |
| *** jarrod has joined #openstack | 14:57 | |
| *** mtaylor has joined #openstack | 14:58 | |
| *** ChanServ sets mode: +v mtaylor | 14:58 | |
| *** Daviey has quit IRC | 14:59 | |
| grizzletooth | my first draft was directly in Etherpad's built-in. I exported to text and re-built the markup using RST, and pastebin'd that into the channel. Then creiht re-loaded that into a named etherpad to do more editing :) | 15:00 |
| *** schisamo has quit IRC | 15:00 | |
| grizzletooth | on another topic... does anyone have any quick hints on setting up the stats process on multi-server? The config file seems generally assume it will be run on a server with access to the proxy logs, but it also wants access to an account-server config. In my multiserver implementation those are on separate servers. | 15:00 |
| *** kashyapc has quit IRC | 15:00 | |
| *** schisamo_ is now known as schisamo | 15:00 | |
| creiht | notmyname: -^ :) | 15:00 |
| *** 52AACIHR4 has joined #openstack | 15:01 | |
| *** mtaylor has quit IRC | 15:01 | |
| *** ptremblett has joined #openstack | 15:01 | |
| *** nijaba has joined #openstack | 15:02 | |
| *** mischer has joined #openstack | 15:03 | |
| *** Daviey has joined #openstack | 15:05 | |
| notmyname | grizzletooth: you ready? I could talk for a long time about the stats stuff. I lived and breathed it for about 2 or 3 months | 15:06 |
| creiht | notmyname: get a channel | 15:06 |
| creiht | :) | 15:06 |
| notmyname | heh | 15:06 |
| notmyname | grizzletooth: there are 3 parts to the stats system: 1) generate logs 2) upload logs to swift 3) process logs | 15:07 |
| *** jkakar has joined #openstack | 15:07 | |
| notmyname | part 1 is done across the entire cluster | 15:07 |
| notmyname | part 2 is done similarly to part 1, just as a second step (allows for more code reuse) | 15:08 |
| notmyname | part 3 is done on a box with internal access to the cluster, but on one box (with lots of RAM and CPU) | 15:08 |
| *** zul has joined #openstack | 15:08 | |
| notmyname | grizzletooth: which part are you curious about? | 15:09 |
| grizzletooth | notmyname: I was trying to adapt the methods in http://swift.openstack.org/overview_stats.html#running-the-stats-system-on-saio to my multiserver howto | 15:09 |
| grizzletooth | notmyname: the portion of the config that didn't make sense was the [log-processor-stats] section | 15:11 |
| notmyname | it's simple to me (because I wrote it), so please help me clarify where I am being obtuse. the instructions are the same, but where they are run changes in a multi-server config | 15:11 |
| notmyname | ok | 15:11 |
| grizzletooth | since it assumes local access to the account-server configs | 15:11 |
| notmyname | that is a stats system plugin | 15:11 |
| creiht | grizzletooth: don't feel bad, he tells us the same thing when we ask questions about it :) | 15:11 |
| notmyname | grizzletooth: not really | 15:11 |
| grizzletooth | I was assuming that I would run the log processor on the proxy server since there it had access to the proxy logs. but sounds like I need to be running some version of it on all of the servers? | 15:12 |
| vishy | masumotok: maybe you already figured this out, but you need a much newer libvirt, try gettting the package from the nova-core ppa | 15:12 |
| notmyname | I mean, yes it does have references to "local" things. but that is because it's written to have one config file for all of the parts. just in some stages not all of the config options are used | 15:12 |
| grizzletooth | which in the case of the SAIO is the case | 15:13 |
| *** pvo_ has joined #openstack | 15:13 | |
| notmyname | yes, but it's the case for non-SAIO too | 15:13 |
| notmyname | let me back up | 15:14 |
| grizzletooth | gak - I have to run out and work with battery and ups techs. will have to learn more on this later | 15:15 |
| notmyname | our ops guys have one config file for the stats system that they put in svn, sync to all the machines, and use as an argument in all the scipts | 15:15 |
| notmyname | the config file is a union of all the options for each of the 3 step | 15:15 |
| *** allsystemsarego has quit IRC | 15:16 | |
| notmyname | but there is overlap, so 3 separate config files would repeat a bunch of stuff | 15:16 |
| notmyname | grizzletooth: let me know when you have time | 15:16 |
| *** gondoi_ has joined #openstack | 15:20 | |
| *** kashyapc has joined #openstack | 15:21 | |
| grizzletooth | notmyname: okay, I think I get that part. for the three phases you mentioned above, what named process gets run on each different type of server? | 15:24 |
| *** gondoi has quit IRC | 15:24 | |
| *** littleidea has joined #openstack | 15:24 | |
| *** silassewell has quit IRC | 15:25 | |
| notmyname | part 1) the proxy servers generate logs (via syslong-ng to split them hourly). also the swift-account-stats-logger generates the account stats log files | 15:25 |
| *** gondoi_ has quit IRC | 15:25 | |
| notmyname | part 2) swift-log-uploader | 15:25 |
| notmyname | part 3) swift-log-stats-collector | 15:25 |
| grizzletooth | so all 1) and 2) run on the proxy server, and then 3) runs on a dedicated stats processor? | 15:27 |
| notmyname | for the access logs, yes | 15:28 |
| notmyname | 1 and 2 run on every account server box (every box storing account server data) for the stats logs | 15:29 |
| grizzletooth | ah | 15:29 |
| notmyname | and it written so that, if you want to, you can add your own plugin. we do this internally for CDN logs | 15:30 |
| grizzletooth | okay, so referring to the steps in your SAIO-stats howto: 1-7 on every proxy and account server. 8-9 on all account servers. 10 on all proxy servers. 11 on the stats processor box. is that right? | 15:31 |
| *** ttx has quit IRC | 15:32 | |
| grizzletooth | err 7 only on proxy servers, not account servers. | 15:32 |
| *** gondoi has joined #openstack | 15:32 | |
| notmyname | err..let me pull up that doc again :-) | 15:32 |
| *** gondoi has quit IRC | 15:32 | |
| grizzletooth | http://swift.openstack.org/overview_stats.html#running-the-stats-system-on-saio | 15:32 |
| *** gondoi has joined #openstack | 15:33 | |
| *** dendro-afk is now known as dendrobates | 15:33 | |
| notmyname | step 1 is done once | 15:33 |
| notmyname | step 2 on the proxy servers (at a minimum | 15:33 |
| *** gondoi has quit IRC | 15:34 | |
| notmyname | steps 3 and 4 are for the proxy servers | 15:34 |
| grizzletooth | ok, so the syslog breakouts don't apply to the account-servers. got it | 15:34 |
| *** adrian_otto has joined #openstack | 15:35 | |
| notmyname | right | 15:35 |
| notmyname | so step 5 is split | 15:35 |
| grizzletooth | right | 15:35 |
| notmyname | anything local under [log-processor-stats] should be local to the account server boxes | 15:36 |
| grizzletooth | swift-account-stats-logger generates the log files that get put in /var/log/swift/stats? | 15:36 |
| *** hazmat has quit IRC | 15:36 | |
| notmyname | they get put in log_dir (from the config) | 15:36 |
| grizzletooth | ok | 15:36 |
| notmyname | and for the cron jobs, access stuff is for the proxy servers and stats logs is for the account servers | 15:37 |
| *** scaraffe has joined #openstack | 15:37 | |
| *** jkakar has quit IRC | 15:37 | |
| grizzletooth | ok, I think I have that. what uses /etc/swift/stats.conf? | 15:38 |
| notmyname | and now you get to the dark side of this whole mess :-) | 15:39 |
| notmyname | stats is an overloaded term in the codebase now | 15:39 |
| grizzletooth | heh | 15:39 |
| notmyname | stats.conf actually has nothing to do with the stats system | 15:39 |
| grizzletooth | ok | 15:39 |
| *** adrian_otto1 has joined #openstack | 15:40 | |
| grizzletooth | that is for statistics about the overall operation of swift? | 15:40 |
| grizzletooth | as opposed to user accounting | 15:40 |
| *** adrian_otto2 has joined #openstack | 15:41 | |
| notmyname | gholt can explain | 15:41 |
| eday | jaypipes: you have access to the openstack hudson machine? | 15:41 |
| gholt | Ah, http://swift.openstack.org/admin_guide.html#cluster-health | 15:41 |
| grizzletooth | okay, I will get to that later then. plenty to work on now to get the stats collectors working on my setup :) | 15:41 |
| *** adrian_otto has quit IRC | 15:41 | |
| grizzletooth | ok, will look at that gholt | 15:41 |
| gholt | That may be the explanation you're looking for for swift-stats-report | 15:41 |
| jaypipes | eday: no. | 15:42 |
| eday | jaypipes: ahh, bummer. nice pug pic btw :) | 15:43 |
| grizzletooth | thanks notmyname and gholt - will study and test some more | 15:44 |
| *** adrian_otto1 has quit IRC | 15:44 | |
| jaypipes | eday: :) thx | 15:44 |
| *** kevnfx has joined #openstack | 15:45 | |
| *** 52AACIHR4 has quit IRC | 15:45 | |
| *** zul has quit IRC | 15:52 | |
| *** dendrobates is now known as dendro-afk | 15:53 | |
| *** electroniceagle has quit IRC | 15:56 | |
| *** adrian_otto2 has quit IRC | 15:57 | |
| *** dendro-afk is now known as dendrobates | 15:57 | |
| *** adrian_otto has joined #openstack | 15:58 | |
| *** metcalfc has joined #openstack | 15:58 | |
| *** hazmat has joined #openstack | 15:59 | |
| jaypipes | termie: http://wiki.openstack.org/UnifiedServiceArchitecture ++ :) /me likey. | 15:59 |
| *** hazmat has quit IRC | 16:00 | |
| *** hazmat has joined #openstack | 16:00 | |
| *** ttx has joined #openstack | 16:04 | |
| *** calavera has quit IRC | 16:04 | |
| creiht | jaypipes, termie: fwiw, a lot of that type of stuff is implemented in swift if you are interested in looking at it | 16:05 |
| jaypipes | creiht: a lot of it is implemented in Nova, too ;) | 16:05 |
| jaypipes | creiht: it's just that things aren't consistent... | 16:05 |
| creiht | heh | 16:06 |
| creiht | It is consistent within swift :) | 16:06 |
| creiht | just noting in case there is anything useful | 16:06 |
| grizzletooth | notmyname: should I run swift-account-stats-logger on all of the account-servers? or just one? | 16:07 |
| notmyname | all | 16:07 |
| notmyname | it only generates account stats logs for the machine it is running on (it walks the filesystem and finds the account dbs) | 16:07 |
| gundlach | jaypipes: in cleanup-unittests, your plan is to have nova/tests/__init__.py have a setUp() module level function that installs test fixtures and fake flags, and an equivalent tearDown(), right? | 16:08 |
| grizzletooth | ah, ok, that makes sense. forgot that not all accounts end up on each account server | 16:08 |
| jaypipes | gundlach: yep. | 16:09 |
| jaypipes | creiht: yep, noted :) | 16:09 |
| *** littleidea has quit IRC | 16:09 | |
| gundlach | jaypipes: if i say "cd nova; nosetests tests/api/" will the tests/__init__ setup() and teardown() still be run? | 16:09 |
| notmyname | grizzletooth: another "Feature" is that you can not run step 3 and write your own parser. by that point all the logs are in swift, so it's a matter of downloading and tracking them | 16:09 |
| jdarcy | Statements like "patterns more consistently meet the expectations of developers for simple tasks" could spark an interesting conversation at summit. | 16:10 |
| notmyname | grizzletooth: there is one clarification I need to make | 16:12 |
| *** mordred_ has joined #openstack | 16:13 | |
| *** ChanServ sets mode: +v mordred_ | 16:13 | |
| jaypipes | gundlach: it should, yes. | 16:13 |
| eday | mordred_: there you are :) | 16:13 |
| *** mordred_ is now known as mtaylor | 16:13 | |
| notmyname | I may have spoken prematurely | 16:14 |
| gundlach | jaypipes: great, thanks. | 16:14 |
| mtaylor | eday: morning | 16:14 |
| eday | mtaylor: what version of pep8 is on the hudson machine? it seems to be reporting issues, although 0.5.0 and 0.6.1 (ubuntu/pypi versions) don't | 16:14 |
| eday | mtaylor: morning, hows uds :) | 16:14 |
| grizzletooth | notmyname: about the clarification, or the need to make it ;) | 16:15 |
| notmyname | the need to make the clarification | 16:15 |
| notmyname | looks like there is a config section in the code that is no longer used, but still there | 16:15 |
| *** zul has joined #openstack | 16:16 | |
| notmyname | I thought I still might be using it | 16:16 |
| notmyname | [account-stats] section in account-server.conf | 16:16 |
| notmyname | but, it isn't referenced in the code anywhere | 16:16 |
| mtaylor | eday: uds is great - I'll look at pep8 version in a sec | 16:16 |
| * notmyname lunch | 16:16 | |
| grizzletooth | not referenced in my implementation | 16:17 |
| eday | mtaylor: cool, thanks. I also think we're ready for the merge check too, assuming it's just a version issue there | 16:17 |
| *** Ryan_Lane has joined #openstack | 16:18 | |
| grizzletooth | so it was successfully elided from the SAIO howto | 16:18 |
| eday | mtaylor: one of these days I should check out a UDS, you always speak so highly of them :) | 16:18 |
| jaypipes | mtaylor: heads up... http://wiki.openstack.org/NovaTestingHudson | 16:24 |
| jaypipes | mtaylor: I'll be proposing it at the summit... | 16:24 |
| *** dendrobates is now known as dendro-afk | 16:26 | |
| mtaylor | jaypipes: cool. I'll look at it in a sec - my laptop is running the project with my browser in another desktop | 16:28 |
| jaypipes | mtaylor: no worries :) | 16:29 |
| *** pvo_ has quit IRC | 16:29 | |
| soren | vishy: libvirt does? | 16:30 |
| vishy | soren: yeah | 16:30 |
| vishy | soren: testing using python instead of virsh | 16:30 |
| vishy | soren: atm | 16:30 |
| jaypipes | gundlach: got any code to merge into cleanup-unittests? | 16:31 |
| vishy | afk for a few bbs | 16:31 |
| *** silassewell has joined #openstack | 16:34 | |
| *** Ryan_Lane has quit IRC | 16:36 | |
| *** hazmat has quit IRC | 16:38 | |
| *** Cybodog has quit IRC | 16:42 | |
| soren | vishy: That won't change anything. | 16:43 |
| *** ttx has quit IRC | 16:45 | |
| gundlach | jaypipes: nothing worth mentioning. I spent most of Thursday reading Twisted documentation trying to wrap my head around it enough to know how to clean up the Twisted tests... and failed :) | 16:45 |
| gundlach | I'm going through the low hanging fruit now. | 16:46 |
| gundlach | and then probably going to go on a docstring campaign so I can understand what's actually going on in the code. | 16:46 |
| *** electroniceagle has joined #openstack | 16:46 | |
| jaypipes | gundlach: :) you may want to check out termie's work here then: http://wiki.openstack.org/UnifiedServiceArchitecture | 16:48 |
| soren | gundlach: I'd be happy to help with Twisted, if needed. | 16:50 |
| gundlach | jaypipes: hey thanks :) | 16:50 |
| gundlach | soren: cool, thanks. well, until i started reading UnifiedServiceArchitecture I assumed we'd need to be converting Twisted unittests to run without the help of Trial; but perhaps the right thing to do is to leave Trial in place until everything's off of Twisted? | 16:50 |
| soren | I don't see a good reason not to use trial. | 16:51 |
| gundlach | soren: i think some of the inputs were that being able to use nosetests is a good thing; being able to run tests in just one part of the code without requiring hand-hacking of run_tests.py is nice; and not having another dependency is always nice. | 16:53 |
| gundlach | soren: but as i understand it, Trial is mostly for Twisted testing, right? And I'm assuming based on UnifiedServiceArchitecture that we're moving away from Twisted? | 16:54 |
| *** guigui1 has quit IRC | 16:54 | |
| soren | gundlach: Anyone is free to submit a blueprint. Just because someone did, doesn't mean it represents a decision of any kind. | 16:56 |
| gundlach | soren: ah, i didn't realize that was a blueprint. | 16:56 |
| soren | Also, trial does (afaik) most of the interesting stuff nosetests also does. | 16:56 |
| soren | gundlach: Well, s/blueprint/wiki page/ on my statement, and it'll still be true. | 16:57 |
| jaypipes | soren, gundlach: it is a blueprint with a spec: https://blueprints.launchpad.net/nova/+spec/unified-service-architecture | 16:57 |
| gundlach | soren: ok, well, i'm definitely for reducing the number of architectures we run upon, so i don't know what process it requires to come to a formal decision, but i'm happy to throw my effort into Getting It Done. | 16:58 |
| jaypipes | soren: I don't see a good reason *not* to just use Eventlet, to be honest. | 16:58 |
| soren | jaypipes: I see a few, but that's really besides the point. | 16:58 |
| soren | I'm just saying that just because there's a wiki page that lays out a plan for something, doesn't mean that we've (as a group) decided that it's a good plan or something we should pursue. | 16:59 |
| jaypipes | soren: agreed. | 16:59 |
| gundlach | soren: agreed. when jaypipes pointed me to that page, i assumed i had missed some meeting, and that we had decided to move in that direction. | 16:59 |
| mtaylor | jaypipes: yes. I agree | 17:00 |
| mtaylor | jaypipes: we need to figure out how to call hudson jobs from tarmac... which is on my todo list | 17:00 |
| jaypipes | mtaylor: cool | 17:00 |
| * soren heads lunchwards | 17:01 | |
| * mtaylor also lunch | 17:01 | |
| *** mtaylor has quit IRC | 17:01 | |
| *** zul has quit IRC | 17:04 | |
| *** DubLo7 has joined #openstack | 17:05 | |
| *** masudo has joined #openstack | 17:07 | |
| gundlach | bbiab | 17:08 |
| *** gundlach has quit IRC | 17:13 | |
| spectorclan | Fun break, search for your location and add it to the OpenStack Community Page at http://maps.google.com/maps/ms?ie=UTF&msa=0&msid=107776216432605685150.00049371b04db57d55015&mid=1288018729 | 17:14 |
| *** abecc has joined #openstack | 17:17 | |
| *** rlucio has joined #openstack | 17:17 | |
| *** abecc has joined #openstack | 17:17 | |
| *** ambo has joined #openstack | 17:20 | |
| *** ambo has left #openstack | 17:20 | |
| *** Ryan_Lane has joined #openstack | 17:22 | |
| *** jc_smith has joined #openstack | 17:30 | |
| *** littleidea has joined #openstack | 17:32 | |
| grizzletooth | w | 17:34 |
| *** littleidea has quit IRC | 17:36 | |
| *** littleidea has joined #openstack | 17:43 | |
| *** pharkmillups has quit IRC | 17:48 | |
| * creiht thinks you guys should just use eventlet, but yeah that's really besides the point ;) | 17:51 | |
| *** adrian_otto1 has joined #openstack | 17:53 | |
| *** adrian_otto has quit IRC | 17:53 | |
| *** kevnfx has quit IRC | 17:55 | |
| *** sophiap has joined #openstack | 17:56 | |
| *** gundlach has joined #openstack | 17:56 | |
| *** adrian_otto has joined #openstack | 17:56 | |
| *** spectorclan has quit IRC | 17:57 | |
| *** sirp has quit IRC | 17:58 | |
| *** adrian_otto1 has quit IRC | 18:00 | |
| *** electroniceagle has quit IRC | 18:00 | |
| *** adrian_otto has quit IRC | 18:01 | |
| *** joearnold has joined #openstack | 18:01 | |
| vishy | soren: I think i found a workaround for the attach issue | 18:02 |
| *** mdomsch_ has joined #openstack | 18:03 | |
| *** scaraffe has quit IRC | 18:03 | |
| *** adrian_otto has joined #openstack | 18:03 | |
| eday | creiht: we are where it matters (API server). THe workers would probably be fine with simple threads/processes even (just a couple things reading the queue) | 18:03 |
| * creiht is just poking at soren :) | 18:04 | |
| *** anotherjesse_ has joined #openstack | 18:05 | |
| *** anotherjesse_ has quit IRC | 18:07 | |
| *** electroniceagle has joined #openstack | 18:07 | |
| *** sirp has joined #openstack | 18:08 | |
| *** adrian_otto1 has joined #openstack | 18:10 | |
| *** anotherjesse_ has joined #openstack | 18:11 | |
| *** sirp has quit IRC | 18:12 | |
| *** adrian_otto has quit IRC | 18:12 | |
| *** sirp1 has joined #openstack | 18:12 | |
| *** spectorclan has joined #openstack | 18:14 | |
| vishy | wow, I don't know why that works | 18:16 |
| vishy | really odd | 18:16 |
| *** krish has quit IRC | 18:16 | |
| *** anotherjesse_ has joined #openstack | 18:21 | |
| *** zul has joined #openstack | 18:23 | |
| *** neogenix has joined #openstack | 18:23 | |
| *** neogenix has quit IRC | 18:24 | |
| *** neogenix has joined #openstack | 18:25 | |
| *** mtaylor has joined #openstack | 18:26 | |
| *** mtaylor has joined #openstack | 18:26 | |
| *** ChanServ sets mode: +v mtaylor | 18:26 | |
| *** masudo has left #openstack | 18:27 | |
| *** kw1 has joined #openstack | 18:30 | |
| *** mischer has quit IRC | 18:30 | |
| *** zul has quit IRC | 18:32 | |
| *** kakoni has joined #openstack | 18:32 | |
| kakoni | congrats on the release! | 18:32 |
| kakoni | creiht: around? | 18:32 |
| creiht | kakoni: howdy | 18:33 |
| *** londo has quit IRC | 18:34 | |
| kakoni | howdy. question. I guess in the current swift design all the traffic goes thru the proxy server(s). Has there been some thought at anypoint to do this differently (lets say you would initiate the connection with proxy and the redirect to storage server...)? | 18:34 |
| creiht | That question seems to come up often :) | 18:34 |
| *** zul has joined #openstack | 18:35 | |
| *** ptremblett has quit IRC | 18:35 | |
| creiht | During the initial development, we talked about several different designs which also included something like what you are asking about | 18:35 |
| *** zaitcev has joined #openstack | 18:36 | |
| _0x44 | jaypipes: Did you have any comments about that blueprint? | 18:36 |
| creiht | The current design was simpler, and also gave us a lot of flexibility and control | 18:36 |
| creiht | and it worked well enough that we haven't considered trying anything else | 18:37 |
| creiht | there are a lot of smarts in the proxy that become more difficult if you hand the connection off to the backend servers | 18:37 |
| creiht | it is also easier to handle failure scenarios in a reasonable way | 18:38 |
| creiht | all that said, if someone comes up with a better idea/implementation we are all ears :) | 18:38 |
| kakoni | valid points. thanks for the detailed answer. | 18:39 |
| *** pharkmillups has joined #openstack | 18:40 | |
| jaypipes | _0x44: not yet, sorry :) | 18:42 |
| _0x44 | jaypipes: No worries, I was just curious :) | 18:43 |
| piken | Is there a way to have a vm mount a mount from the node it is on? | 18:46 |
| *** zul has quit IRC | 18:46 | |
| *** niks has joined #openstack | 18:48 | |
| niks | Hi All, | 18:49 |
| piken | hi | 18:49 |
| niks | I have downloaded nova and trying to install it on RHEL VM | 18:49 |
| niks | is there a doc which i can use to proceed with install? | 18:49 |
| niks | i see current rhel instructions are more for swift..anything for nova @ documented yet? | 18:50 |
| *** mischer has joined #openstack | 18:51 | |
| kakoni | niks: btw, what rhel version do you have? | 18:56 |
| annegentle | niks: I haven't seen anything about nova with rhel yet on the wiki or mailing list in the last month or os | 18:57 |
| annegentle | er, so | 18:57 |
| piken | Should be easy as long as you install all the pre-req's | 18:58 |
| piken | redis, rabbit, and all python libs needed. | 18:58 |
| piken | I had the most issue with gflags that was needed for redis on RHEL5.5 | 18:58 |
| *** ttx has joined #openstack | 18:58 | |
| niks | i am using centos 5.4 (not RHEL) | 18:59 |
| piken | it is binary compatible | 18:59 |
| jaypipes | _0x44: ok, added some comments to that blueprint | 18:59 |
| piken | niks: make sure you use epel yum repo as it will help with the prereq's for python | 19:00 |
| _0x44 | jaypipes: Thanks! | 19:00 |
| jaypipes | piken: I don't think gflags is a requirement for Redis... but it IS a requirement for Nova. | 19:01 |
| jaypipes | _0x44: lemme know if the comments make sense :) | 19:01 |
| niks | piken: ok..where do i get other prerequs from...like redis and rabbit mq | 19:01 |
| piken | jaypipes: To build redis I need gflags c lib installed. | 19:01 |
| jaypipes | piken: hmm, I see... | 19:01 |
| piken | niks: redis you have to build from source. rabbit is in epel | 19:02 |
| jaypipes | piken: so not the python-gflags | 19:02 |
| jaypipes | gotcha | 19:02 |
| piken | jaypipes: That was solved for nova when I built gflags for redis as it includes the python and ruby bindings when you do the install. | 19:02 |
| niks | piken: will do..thanks | 19:02 |
| piken | niks: np | 19:03 |
| annegentle | niks: scroll to the bottom of http://wiki.openstack.org/InstallFromSource for Centos instructions (with wget for python-gflags) | 19:03 |
| jaypipes | gundlach: FYI, I pushed a few more revisions with more unit tests of that new test utils module to cleanup-unittests... so bzr merge em in when you want (shouldn't overlap anything you are doing) | 19:03 |
| jaypipes | piken: gotcha :) | 19:03 |
| gundlach | jaypipes: thx. my work's in ~gundlach/nova/cleanup-unittests fyi. | 19:03 |
| jaypipes | gundlach: sweet. can I merge it? | 19:03 |
| *** AimanA has quit IRC | 19:03 | |
| gundlach | jaypipes: should be able to; be aware that cloud_unittest breaks until the module-level fixtures are in place to wipe the database between tests. | 19:04 |
| jaypipes | gundlach: gotcha. | 19:04 |
| _0x44 | jaypipes: Good call on the testing problem, neither sirp or I had thought of that. | 19:04 |
| piken | pretty soon libcloud will support openstack directly as I am building the driver set as an extenstion to the rackspace as euca has one extending ec2. | 19:04 |
| piken | Just a heads up for all | 19:04 |
| niks | annegentle: looks good to get me started..do let me know if there is something that you know is out there...will let you guys know how it goes :) | 19:04 |
| jaypipes | gundlach: merged and pushed to my lp branch with commit comment "Merge Gundy." | 19:05 |
| vishy | soren: so the fd issue goes away if i use the python libvirt conn to attach and detach | 19:05 |
| jaypipes | _0x44: yeah, otherwise in order to test, we'll basically have to install every library...which is kinda annoying ;) | 19:05 |
| *** jkakar has joined #openstack | 19:05 | |
| vishy | perhaps simple_execute isn't closing the session to virsh properly so it leaves the file open? | 19:05 |
| gundlach | jaypipes: great! | 19:05 |
| *** rlucio has quit IRC | 19:06 | |
| *** westmaas has quit IRC | 19:07 | |
| *** westmaas has joined #openstack | 19:08 | |
| *** dendro-afk is now known as dendrobates | 19:08 | |
| *** westmaas has quit IRC | 19:08 | |
| *** zul has joined #openstack | 19:09 | |
| *** westmaas has joined #openstack | 19:09 | |
| *** mischer has quit IRC | 19:10 | |
| *** ppetraki has quit IRC | 19:10 | |
| *** AimanA has joined #openstack | 19:12 | |
| *** rlucio has joined #openstack | 19:12 | |
| *** londo has joined #openstack | 19:13 | |
| *** AimanA has quit IRC | 19:14 | |
| *** AimanA has joined #openstack | 19:15 | |
| *** miclorb has joined #openstack | 19:16 | |
| *** anotherjesse_ has quit IRC | 19:16 | |
| *** CodeBlock[s] has joined #openstack | 19:19 | |
| *** kakoni has quit IRC | 19:21 | |
| soren | vishy: Perhaps. I seriusly doubt just using the python bindings would make a difference. The python bindings are a very thin wrapper around the C lib. | 19:22 |
| *** miclorb has quit IRC | 19:23 | |
| *** Ryan_Lane is now known as Ryan_Lane|food | 19:24 | |
| gundlach | jaypipes: hmm, looks like nose module-level setup is run once, before all tests are run in the module. your goal was for reset_test_environment() to be called before every test, i believe? | 19:27 |
| gundlach | s/setup/setUp()/ | 19:27 |
| jaypipes | gundlach: yeah, was just going to put that into a base test case class for use when the test data environment needed to be wiped between each test case execution. | 19:30 |
| gundlach | jaypipes: fair enough. | 19:30 |
| jaypipes | gundlach: as well as use nose's @with_setup decorator for more custom stuff. | 19:30 |
| *** electroniceagle has quit IRC | 19:32 | |
| *** electroniceagle has joined #openstack | 19:33 | |
| eday | soren: you have access to the hudson machine don't you? can you see what version of pep8 is on there? | 19:36 |
| *** littleidea has quit IRC | 19:38 | |
| gundlach | s/get off of Twisted/get off of Trial/ | 19:40 |
| *** spectorclan has quit IRC | 19:48 | |
| *** ctennis has quit IRC | 19:50 | |
| *** dendrobates is now known as dendro-afk | 19:50 | |
| *** neogenix has quit IRC | 19:52 | |
| *** westmaas has quit IRC | 19:52 | |
| *** hornbeck has joined #openstack | 19:55 | |
| vishy | soren: I blame threading, but it could be something in the way that virsh attach-disk is implemented, I notice that the xml shows driver name='qemu' instead of name='phy' | 19:57 |
| *** pvo_ has joined #openstack | 19:58 | |
| *** pvo_ has joined #openstack | 19:58 | |
| *** ChanServ sets mode: +v pvo_ | 19:58 | |
| *** ttx has quit IRC | 19:59 | |
| *** pvo_ has quit IRC | 19:59 | |
| *** pvo_ has joined #openstack | 20:00 | |
| *** ChanServ sets mode: +v pvo_ | 20:00 | |
| *** pvo has quit IRC | 20:00 | |
| *** pvo_ is now known as pvo | 20:00 | |
| *** anotherjesse_ has joined #openstack | 20:01 | |
| *** pvo has quit IRC | 20:01 | |
| *** pvo has joined #openstack | 20:02 | |
| *** ChanServ sets mode: +v pvo | 20:02 | |
| *** ptremblett has joined #openstack | 20:02 | |
| *** zul has quit IRC | 20:03 | |
| *** ctennis has joined #openstack | 20:03 | |
| *** ctennis has joined #openstack | 20:03 | |
| piken | Is there a way to have a vm mount a directory from a mount on the node? | 20:08 |
| *** jdmaturen has joined #openstack | 20:08 | |
| piken | I want to take advantage of the infiniband for lustre even though kvm doesn't support infiniband | 20:08 |
| *** electroniceagle has left #openstack | 20:13 | |
| *** pvo has quit IRC | 20:14 | |
| *** vnaren has joined #openstack | 20:15 | |
| *** joearnold has quit IRC | 20:21 | |
| *** silassewell has quit IRC | 20:23 | |
| *** Ryan_Lane|food is now known as Ryan_Lane | 20:25 | |
| *** pvo has joined #openstack | 20:26 | |
| *** pvo has joined #openstack | 20:26 | |
| *** ChanServ sets mode: +v pvo | 20:26 | |
| *** pvo has quit IRC | 20:26 | |
| *** pvo has joined #openstack | 20:27 | |
| *** pvo has joined #openstack | 20:27 | |
| *** ChanServ sets mode: +v pvo | 20:27 | |
| jaypipes | eday: on a bug-status-changing rampage today, eh!? :) | 20:28 |
| vishy | piken: you can attach block devices to vms, i don't know about straight dirs | 20:29 |
| eday | jaypipes: trying to clean up blueprints/bugs for summit :) | 20:31 |
| jaypipes | eday: nice job :) | 20:32 |
| eday | jaypipes: I figure this is a good janitor week.. pep8/pylint/lp cleanup :) | 20:32 |
| jaypipes | eday: yup! badly needed... | 20:33 |
| jdarcy | http://www.slideshare.net/ericvh/virtfs | 20:33 |
| jdarcy | That was for piken - paravirtualized FS for qemu-based virt environments. | 20:34 |
| piken | jdarcy: ty very much. That should do what we want. :) | 20:34 |
| *** Ryan_Lane has quit IRC | 20:36 | |
| *** dendro-afk is now known as dendrobates | 20:36 | |
| piken | now to find out a way to get that option added to the vm creation line for openstack along with custom params based on the user creating the vm | 20:36 |
| *** hazmat has joined #openstack | 20:37 | |
| *** joearnold has joined #openstack | 20:37 | |
| *** zul has joined #openstack | 20:38 | |
| *** miclorb has joined #openstack | 20:40 | |
| *** Ryan_Lane has joined #openstack | 20:40 | |
| grizzletooth | gak - cyberduck's problem reading objects from swift with slashes in their name is annoying | 20:41 |
| *** sirp1 has quit IRC | 20:42 | |
| vishy | piken: it would be great to have a volume driver that can use it | 20:42 |
| vishy | s/use/implement | 20:43 |
| *** kevnfx has joined #openstack | 20:44 | |
| *** joearnold has quit IRC | 20:44 | |
| piken | Well, I will most likely have to write it and submit it as it will be needed for my project since kvm doesn't support virtual infiniband devices | 20:44 |
| *** ttx has joined #openstack | 20:44 | |
| *** silassewell has joined #openstack | 20:47 | |
| *** joearnold has joined #openstack | 20:48 | |
| *** ppetraki has joined #openstack | 20:49 | |
| *** sirp1 has joined #openstack | 20:50 | |
| *** arthurc has quit IRC | 20:53 | |
| *** gundlach has quit IRC | 20:55 | |
| *** gaveen has joined #openstack | 20:58 | |
| *** gaveen has joined #openstack | 20:58 | |
| vishy | iscsi branch proposed: | 21:03 |
| vishy | https://code.launchpad.net/~vishvananda/nova/iscsi-volumes/+merge/39317 | 21:03 |
| soren | vishy: *awesome* | 21:03 |
| vishy | soren: i noticed in the xen libvirt xml that it attaches disks to sda instead of vda? Xen doesn't support virtio? | 21:04 |
| soren | vishy: I'm.... not sure. | 21:05 |
| vishy | soren: also, i'd really like to get rid of this: <!-- <model type='virtio'/> CANT RUN virtio network right now --> | 21:06 |
| vishy | soren: but only the maverick kernel actually works with virtio network turned on | 21:07 |
| *** abecc has quit IRC | 21:07 | |
| *** jdarcy has quit IRC | 21:08 | |
| kevnfx | Has there ever been any discussion in the team wrt using/integrating Openvswitch/OpenFlow with Nova? | 21:09 |
| vishy | soren: I'm doing this ugly hack at the moment in deploy: http://pastie.org/1248448 | 21:09 |
| vishy | kevnfx: it has been mentioned as a nice to have a few times, but i don't think there is an official blue print | 21:10 |
| Ryan_Lane | I have a few patches to submit. how do I go about that for this project? :) | 21:11 |
| Ryan_Lane | I was told I need to submit something? | 21:11 |
| vishy | Ryan_Lane: have you signed the cla? | 21:11 |
| Ryan_Lane | nope | 21:11 |
| Ryan_Lane | how do I go about that | 21:11 |
| vishy | http://wiki.openstack.org/HowToContribute | 21:11 |
| kevnfx | vishy: cool ... perhaps something I'm interested in looking into .... | 21:12 |
| kevnfx | just wanted to make sure it hadn't already been done or dismissed ... | 21:15 |
| pvo | kevnfx: yea, we've been talking about it. | 21:16 |
| pvo | kevnfx: but haven't moved to start working on it yet. | 21:16 |
| kevnfx | pvo: was this a private discussion, or transcripts I can find in the IRC history? | 21:17 |
| soren | vishy: Yeah, I wish there was a cleaner way. | 21:18 |
| soren | vishy: Ideally, there would be a clever way for the guest to switch the disk from IDE to virtio on the fly. | 21:18 |
| vishy | soren: we can stick a flag in kernel i suppose, but that fails as soon as we have whole disk images. | 21:19 |
| vishy | soren: is that possible? | 21:19 |
| soren | vishy: Not at the moment, no. | 21:19 |
| zul | vishy: pv xen does support xvd | 21:19 |
| soren | vishy: I've wanted to do it for years, but never had the time. | 21:19 |
| *** rlucio_ has joined #openstack | 21:20 | |
| *** DubLo7 has quit IRC | 21:21 | |
| *** ttx has quit IRC | 21:22 | |
| pvo | kevnfx: this was "we" being rackspace. | 21:22 |
| *** sanjib has joined #openstack | 21:22 | |
| pvo | kevnfx: but if you want to get a leap on us, feel free. : ) | 21:23 |
| kevnfx | pvo: understood ... just wanted to try and leverage any previous discussion or requirements banter ... | 21:24 |
| *** rlucio has quit IRC | 21:25 | |
| *** rlucio_ is now known as rlucio | 21:25 | |
| *** pothos has joined #openstack | 21:28 | |
| *** joearnold has quit IRC | 21:28 | |
| *** gundlach has joined #openstack | 21:29 | |
| zul | vishy: the xen pv-ops kernel uses the xvda1 devices etc | 21:29 |
| *** pothos_ has quit IRC | 21:30 | |
| vishy | zul: interesting | 21:30 |
| *** ttx has joined #openstack | 21:33 | |
| *** ttx has joined #openstack | 21:33 | |
| *** kevnfx has quit IRC | 21:35 | |
| *** joearnold has joined #openstack | 21:36 | |
| *** zul has quit IRC | 21:38 | |
| * eday pokes mtaylor :) | 21:39 | |
| mtaylor | hey eday | 21:41 |
| mtaylor | eday: was I supposed to be looking at something for you? | 21:41 |
| mtaylor | eday: oh! pep8 | 21:41 |
| mtaylor | eday: Installed: 0.4.2-3 | 21:41 |
| eday | mtaylor: ahh, would it be a pain to upgrade? | 21:42 |
| mtaylor | well... | 21:42 |
| mtaylor | it depends | 21:42 |
| mtaylor | easiest way would be to upgrade the hudson box to maverick | 21:42 |
| eday | pypi would be better, as it's 0.6.1 (maverick is only 0.5.0) | 21:43 |
| eday | so probably easier too | 21:43 |
| niks | do i need tornado for nova install? | 21:44 |
| *** dysinger has joined #openstack | 21:45 | |
| eday | niks: not as of today, the last dependency was just removed | 21:46 |
| eday | niks: but the release still had a dep on it with the object server | 21:46 |
| niks | eday: I am installing austin release..did that had the dependency on it? | 21:46 |
| eday | niks: yes | 21:47 |
| niks | oh! ok..well trying to install nova on centos 5.4 which comes with python 2.4 but looks like tornado needs python 2.5+ | 21:48 |
| niks | looks like i would have to upgrade python to get it working :( | 21:48 |
| vishy | btw, I'd like to state on record that i find instance-342423534524 highly annoying | 21:49 |
| vishy | :) | 21:49 |
| eday | vishy: make a blueprint, I think we should discuss canonical/secondary ID management :) | 21:49 |
| vishy | eday: ok. I think we need to be able to specify which id to use for the 'name' value, since that shows up in libvirt/filesystem etc. | 21:50 |
| vishy | I'm stuck with my standard command line ui which uses ec2_id for everything | 21:51 |
| vishy | :) | 21:51 |
| *** sophiap has quit IRC | 21:54 | |
| *** ttx has quit IRC | 21:55 | |
| *** dendrobates is now known as dendro-afk | 21:55 | |
| kw1 | niks, EPEL has pre-built python2.6 distros for CentOS 5 | 21:57 |
| kw1 | that run alongside the system python | 21:57 |
| kw1 | that work well for tornado | 21:57 |
| niks | kw1: did you mean http://www.geekymedia.com/tech-articles/rhel5-centos5-rpms-for-python-2-5-and-2-6/? | 21:58 |
| kw1 | nah, EPEL | 21:58 |
| kw1 | http://fedoraproject.org/wiki/EPEL | 21:58 |
| niks | good | 21:58 |
| niks | got it | 21:58 |
| niks | :) | 21:58 |
| kw1 | install their RPM to get the distro, then 'yum search python26' | 21:58 |
| niks | kw1: yes..works :) | 21:59 |
| *** Grizzletooth_ has joined #openstack | 22:01 | |
| *** rnirmal has quit IRC | 22:02 | |
| *** jkakar has quit IRC | 22:05 | |
| vishy | kw1: have you managed to get nova running on centos? | 22:06 |
| kw1 | no, haven't tried; I'm new | 22:07 |
| *** metcalfc has quit IRC | 22:10 | |
| *** hazmat has quit IRC | 22:11 | |
| *** stewart has quit IRC | 22:13 | |
| eday | soren, dendro-afk: could one of you mark https://blueprints.edge.launchpad.net/nova/+spec/datastore-abstraction as implemented? was the ORM branch | 22:19 |
| niks | i have installed all dependencies mentioned in bottom part of http://wiki.openstack.org/InstallFromSource..any idea what next ? | 22:20 |
| *** rlucio has quit IRC | 22:21 | |
| eday | soren, dendro-afk: https://blueprints.edge.launchpad.net/nova/+spec/basic-quota-system this one too please :) | 22:21 |
| *** metcalfc has joined #openstack | 22:23 | |
| *** jc_smith has quit IRC | 22:24 | |
| *** metcalfc has joined #openstack | 22:24 | |
| niks | hi..i get following error while trying to build austin release of nova | 22:28 |
| niks | File "setup.py", line 37 with open("ChangeLog", "w") as changelog_file:SyntaxError: invalid syntax | 22:28 |
| *** silassewell has quit IRC | 22:29 | |
| niks | any idea what could be wrong?? | 22:32 |
| *** vnaren has quit IRC | 22:34 | |
| vishy | niks: setup.py is unneccessary | 22:34 |
| vishy | niks: if you're just trying to run it | 22:34 |
| *** pvo has quit IRC | 22:35 | |
| niks | vishy: All dependencies seems to be configured..now what? python setup.py install also seems to throw lot of Syntax errors | 22:36 |
| niks | am i doing something wrong? is it expected to work against Python 2.4 or do i need other version of python? | 22:37 |
| *** gundlach has quit IRC | 22:38 | |
| *** niks is now known as niks2 | 22:39 | |
| *** niks2 is now known as niks | 22:39 | |
| vishy | that is odd | 22:40 |
| *** dysinger has quit IRC | 22:40 | |
| *** mtaylor has quit IRC | 22:40 | |
| vishy | niks: no 2.6 | 22:40 |
| vishy | it could probably be modified to work against 2.5 with some changes | 22:40 |
| vishy | 2.4 will be a big pain though | 22:40 |
| niks | vishy u mean it needs 2.6 or it doesnot need 2.6 | 22:41 |
| vishy | niks: it needs 2.6 | 22:41 |
| niks | ok | 22:41 |
| *** hazmat has joined #openstack | 22:42 | |
| *** jc_smith has joined #openstack | 22:42 | |
| *** bwalk7125 has joined #openstack | 22:43 | |
| *** zuhaib has joined #openstack | 22:43 | |
| *** lukey has joined #openstack | 22:46 | |
| *** lukey has left #openstack | 22:47 | |
| *** hazmat has quit IRC | 22:49 | |
| *** joearnold has quit IRC | 22:52 | |
| *** jc_smith_ has joined #openstack | 22:54 | |
| Ryan_Lane | I've added a branch for ldap support improvements: https://code.launchpad.net/~rlane/nova/ldapimprovements | 22:55 |
| *** joearnold has joined #openstack | 22:56 | |
| Ryan_Lane | I moved the openldap schema out of nova.sh, and added the sun (opends/opendj/sun directory server/fedora ds) schemas | 22:56 |
| *** jc_smith has quit IRC | 22:57 | |
| *** jc_smith_ is now known as jc_smith | 22:57 | |
| *** DubLo7 has joined #openstack | 23:01 | |
| *** adrian_otto1 has quit IRC | 23:02 | |
| *** metoikos has joined #openstack | 23:04 | |
| uvirtbot | New bug: #666554 in nova "_inject_net_info_fs in compute/disk.py fails if /etc/network doesn't exist" [Undecided,New] https://launchpad.net/bugs/666554 | 23:16 |
| *** stewart has joined #openstack | 23:19 | |
| eday | whew, I think that's the last of the bug/blueprint cleaning | 23:23 |
| *** mtaylor has joined #openstack | 23:23 | |
| *** mtaylor has joined #openstack | 23:23 | |
| *** ChanServ sets mode: +v mtaylor | 23:23 | |
| *** littleidea has joined #openstack | 23:24 | |
| *** DubLo7 has quit IRC | 23:24 | |
| *** mtaylor has quit IRC | 23:27 | |
| *** Ryan_Lane has quit IRC | 23:29 | |
| *** Ryan_Lane has joined #openstack | 23:30 | |
| anotherjesse_ | eday: wow, thank god | 23:30 |
| *** pvo has joined #openstack | 23:31 | |
| *** ChanServ sets mode: +v pvo | 23:31 | |
| *** Podilarius has left #openstack | 23:36 | |
| *** hornbeck has quit IRC | 23:41 | |
| eday | vishy: you would make a good salesman :) (nova-debug prop) | 23:42 |
| vishy | eday: hehe, i was getting a little punchy :) | 23:43 |
| *** sirp1 has quit IRC | 23:51 | |
| niks | hmm..had to install all modules again in 2.6 | 23:56 |
| niks | nova-manage user now throwing errors | 23:56 |
| niks | AttributeError: 'module' object has no attribute 'BrokerConnection' | 23:56 |
| niks | any guesses guys ? :) | 23:57 |
| *** arcane has quit IRC | 23:58 | |
| *** arcane has joined #openstack | 23:59 | |
| *** RamD has joined #openstack | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!