| *** adiantum has joined #openstack | 00:00 | |
| *** Ryan_Lane is now known as Ryan_Lane|away | 00:02 | |
| *** j05h has joined #openstack | 00:03 | |
| desai | (or for anyone else around) when i boot an instance, it only gets local addressing (a 10.0.X.X address). how do we get it to hand out public ips as well for nodes? | 00:05 |
|---|---|---|
| desai | i've associated a floating block of ips with the system, but they don't seem to get used | 00:05 |
| desai | I'm als getting these in the nova-network log: http://paste.openstack.org/show/619/ | 00:08 |
| *** grapex has joined #openstack | 00:10 | |
| *** drico has quit IRC | 00:11 | |
| *** zul has quit IRC | 00:11 | |
| *** westmaas has joined #openstack | 00:15 | |
| *** zul has joined #openstack | 00:18 | |
| *** KnuckleSangwich has joined #openstack | 00:21 | |
| *** KnuckleSangwich has quit IRC | 00:23 | |
| *** KnuckleSangwich has joined #openstack | 00:23 | |
| *** fysa has quit IRC | 00:25 | |
| *** devcamcar has left #openstack | 00:26 | |
| *** devcamcar has joined #openstack | 00:26 | |
| masumotok | devcamca: Hi, could you please tell me how to handle this error about openstack-dashboard? "ImproperlyConfigured: Error importing middleware django.middleware.csrf: "No module named csrf" | 00:26 |
| devcamcar | masumotk: what version of django are you using? | 00:27 |
| devcamcar | devcamcar: openstack-dashboard requires django 1.2.3 | 00:27 |
| devcamcar | or higher | 00:27 |
| devcamcar | msaumotk: if you look in the tools/ folder there is a pip-requires file so you can easily install all the dependencies with pip | 00:27 |
| masumotok | devcamcar: that's why.. I'm using 1.1.1-2, ubuntu10.04 | 00:27 |
| masumotok | devcamcar: thanks! I'm gonna try it right now. | 00:28 |
| devcamcar | masumotok: recommend using pip -r tools/pip-requires | 00:29 |
| devcamcar | to install the dependencies | 00:29 |
| *** dirakx has quit IRC | 00:33 | |
| desai | another dumb question: does all of the relevant network state (which nova-compute is RoutingNode for a given security group) get tracked in the networks table of the database? | 00:33 |
| *** fysa has joined #openstack | 00:36 | |
| *** adiantum has quit IRC | 00:39 | |
| *** zul has quit IRC | 00:42 | |
| *** adiantum has joined #openstack | 00:46 | |
| *** londo has quit IRC | 00:48 | |
| *** ranger57 has joined #openstack | 00:48 | |
| *** ranger57 has quit IRC | 00:49 | |
| *** masumotok has quit IRC | 00:49 | |
| kpepple | is anyone a sqlalchemy-migrate expert here ? i'm running into some strangeness trying to write a migration ... | 00:50 |
| *** dragondm has quit IRC | 00:50 | |
| *** grapex has quit IRC | 00:51 | |
| *** joearnold has quit IRC | 00:57 | |
| *** littleidea has quit IRC | 00:59 | |
| *** MarkAtwood has quit IRC | 01:03 | |
| *** hadrian has quit IRC | 01:06 | |
| *** adiantum has quit IRC | 01:08 | |
| *** zul has joined #openstack | 01:09 | |
| *** Ryan_Lane has joined #openstack | 01:12 | |
| *** adiantum has joined #openstack | 01:13 | |
| kpepple | never mind about the sqlalchemy-migrate request :) | 01:13 |
| *** grapex has joined #openstack | 01:17 | |
| *** kpepple has left #openstack | 01:19 | |
| *** zenmatt has quit IRC | 01:20 | |
| *** Ryan_Lane has quit IRC | 01:23 | |
| *** reldan has quit IRC | 01:34 | |
| *** adiantum has quit IRC | 01:37 | |
| *** adiantum has joined #openstack | 01:42 | |
| *** blakeyeager has quit IRC | 01:43 | |
| *** hazmat has quit IRC | 01:48 | |
| *** fcarsten has joined #openstack | 01:50 | |
| *** baldben has quit IRC | 01:50 | |
| *** dirakx has joined #openstack | 01:51 | |
| fcarsten | swift + RAID 5/6: According to the docu swift on RAID 5/6 is a bad idea. I'm currently facing some IT guys here saying "We only do RAID 5/6. It's better. The Swift documentation is wrong". Is there some material which I can use to back up the swift documentation? | 01:52 |
| *** littleidea has joined #openstack | 01:52 | |
| *** pvo is now known as pvo_away | 01:54 | |
| *** kpepple has joined #openstack | 01:57 | |
| *** daleolds has joined #openstack | 02:00 | |
| *** hazmat has joined #openstack | 02:02 | |
| kpepple | fcarsten: that will be tough … when the storage guys gets their hearts set on something (Raid S anyone ?), they can be quite insistent. You're going to need to walk them through the swift architecture. I used to explain it as "we're doing RAID, but on the server level not on the disk level" | 02:05 |
| notmyname | fcarsten: tell them that they can do RAID 5/6 if they want, but expect orders of magnitude worse performance :-) | 02:07 |
| notmyname | fcarsten: swift does lots of small random reads and writes which is pathological worst case for RAID 5/6 | 02:08 |
| desai | raid5 is also a terrible idea if you are using large disks | 02:09 |
| notmyname | and if you loose a single node, rebuild times get horrible (on the order of weeks, with the size of volumes we were/are using) | 02:09 |
| notmyname | even if you lose it ;-) | 02:09 |
| *** computr has quit IRC | 02:10 | |
| fcarsten | notmyname: Problem is that I want it to be a success, they don't care. | 02:11 |
| notmyname | then that is a difficult position to be in. | 02:12 |
| kpepple | fcarsten: how about that it is 25% more expensive ? | 02:12 |
| notmyname | creiht: do we have any empirical data on the badness of RAID + swift? didn't we have a graph somewhere? | 02:12 |
| desai | notmyname: you need to be really careful about making sweeping statements like that when you want to win over cynical it staff | 02:16 |
| *** mray has joined #openstack | 02:16 | |
| fcarsten | kpepple: since the RAIDed hardware already exists in abundance here but they probably have to buy new hardware to do non-RAID the 25% don't matter :-( | 02:16 |
| desai | they are different design tradeoffs, that is all | 02:16 |
| kpepple | fcarsten: true, true | 02:17 |
| *** zenmatt has joined #openstack | 02:17 | |
| notmyname | desai: true. I wouldn't suggest using that ("well, fine, just do it and watch it be really bad") as an opening argument ;-) | 02:17 |
| notmyname | RAID 5/6 is great in certain cases. it just happens to be bad for swift and doesn't really gain you much | 02:18 |
| desai | ;) | 02:18 |
| notmyname | RAID controllers in JBOD mode with a battery-backed cache is a great thing for swift, so already having the hardware may be a plus | 02:20 |
| creiht | fcarsten: I think redbo has a graph somewhere | 02:30 |
| fcarsten | creiht: that would be great. | 02:30 |
| creiht | But it does turn out that data usage with swift is the pathalogical worst case for RAID 5 | 02:31 |
| creiht | namely large number random writes (usually in small chunks) | 02:31 |
| creiht | If they absolutely have to have raid, then RAID 10 should be ok | 02:32 |
| creiht | One of the test systems that we had we had a 24 disk raid 6 | 02:33 |
| creiht | on one drive failure, it was going to take 2-3 weeks to rebuild | 02:33 |
| creiht | and in the degraded state, it really affected the performance of swift negatively | 02:34 |
| creiht | If you imagine that in a largish cluster, you can count on there being at least a failed drive every day, those 2-3 week rebuilds stack up pretty quick | 02:34 |
| creiht | Even if the raids are in good health, with the average swift use case, the raid performance was no better, and often worse than just the machine writing to a single drive | 02:35 |
| creiht | We really wanted to make RAID work, because that would have made the software much easier to write | 02:36 |
| fcarsten | creiht: to simulate swift what would be a suitable io size per read/write and what read : write ratio? | 02:37 |
| creiht | RAID 5/6 that is | 02:37 |
| *** kashyapc has joined #openstack | 02:37 | |
| creiht | In our use case we are pretty heavy write (I don't remember the exact ratio, but it is the largest chunk of requests) | 02:37 |
| fcarsten | (apparently they have a tool that can simulate IO access behavior for benchmarking) | 02:38 |
| creiht | We try to optimize writes as much as possible | 02:38 |
| creiht | or I should say, given a choice, we try to optimize the write over the read performance | 02:38 |
| creiht | fcarsten: The best thing to do would be to set up a small cluster of say 5 machines, and try both ways and do some performance testing | 02:39 |
| *** ctennis has joined #openstack | 02:39 | |
| *** ctennis has joined #openstack | 02:39 | |
| creiht | Since we do not have RAID to fall back on, swift does the following to work around failure | 02:40 |
| creiht | 1. we store 3 replicas of all data (objects, containers, accounts) in swift | 02:40 |
| creiht | 2. replication is always running accross the cluster | 02:41 |
| fcarsten | creiht: Is it possible to make a rough estimate of what numbers in their simulator would give representative results for swift usage? They want to know 3 things: | 02:42 |
| fcarsten | 1) read / write ratio, e.g 70:30 or 50:50, ... | 02:42 |
| creiht | 3. When drive failure is detected, replication will push the data that was supposed to be on that drive to handoff nodes | 02:42 |
| fcarsten | 2) Size of io - e.g. 4k, 8k, .... | 02:42 |
| fcarsten | 3) number of parallel streams / users | 02:43 |
| creiht | those handoffs are spread evenly accross the cluster, so it happens very quickly, and is more efficient the larger the cluster is | 02:43 |
| creiht | 4. When an object PUT comes in, at least 2 replicas have to be written successfully, and if one of the main replica nodes is down, it will write one copy to the handoff node (which gets replicated back as soon as the device is back up) | 02:44 |
| creiht | fcarsten: the answer to those is going to depend on your use cases | 02:45 |
| *** littleidea has quit IRC | 02:45 | |
| notmyname | fcarsten: those numbers would be very dependent on your users. would you use a swift cluster as a backup target or as a CDN origin (or something in between) | 02:45 |
| creiht | fcarsten: and all that said, simulation is one thing, but real world tests are completly different | 02:46 |
| fcarsten | creiht: mostly probably around things like: Sensors aquire data (from small temperature reading to MRI scans in size) and store on swift. Backend process download /stream data from swift and do some processing on it. | 02:46 |
| creiht | fcarsten: so you would want to figure out what the average size of those data points, how many/how often are collected | 02:47 |
| fcarsten | creiht: Yes, simulation goes only so far, but if it shows bad performance in their simulator it makes it easier for me to convince them not to use RAID 5/6 :-) | 02:47 |
| creiht | and then how often they are processed | 02:47 |
| creiht | hehe | 02:48 |
| creiht | once you have that data though, you should be able to create a pretty good estimate of the variables they are asking for | 02:48 |
| fcarsten | creiht: avg size is very hard to guess since the potential range in our application is large, from a few bytes to gigabytes; and I can't predict which will make more use of ythe service. | 02:49 |
| *** vvuksan has quit IRC | 02:49 | |
| creiht | fcarsten: then it might make good sense to run two simulations, one with smaller files, and one with larger average size files | 02:50 |
| fcarsten | creiht: I was under the impression that swift does small read/writes independent of the size of the stored files? | 02:51 |
| creiht | fcarsten: it writes the whole file to disk in one piece | 02:52 |
| notmyname | yes, but as it gets the data it fsyncs, so there are some smaller writes | 02:52 |
| creiht | Our use cases happen to gives us smallish (sorry I can't give you a real answer there :/) | 02:52 |
| fcarsten | creiht: so if the distribution of files and access is similar to files normally found on a harddisk, swift would not perform worse under RAID 5 than when stroing the data on RAID 5 disks? | 02:53 |
| creiht | correct | 02:53 |
| notmyname | fcarsten: but remember that another big factor is the size of the volumes and the rebuild times | 02:53 |
| creiht | And the very poor performance when the raid array is in a degraded state | 02:54 |
| *** dendrobates is now known as dendro-afk | 02:54 | |
| fcarsten | So, if they currently use RAID 5 to store data and we are considering swift as an alternative, running swift on raid 5 will not incur additional performance penalties due to raid 5? | 02:54 |
| fcarsten | ... sorry have to go ... Ithanks a lot ! | 02:55 |
| notmyname | if everything is working correctly (no dead drives, etc), probably | 02:55 |
| fcarsten | I'll read any replies when I get back. thanks. | 02:55 |
| creiht | fcarsten: That is hard to say, but I guess possibly | 02:57 |
| creiht | Though I would argue that you would not be making very good use of the hardware :) | 02:57 |
| creiht | fcarsten: http://wiki.openstack.org/redbo?action=AttachFile&do=view&target=raid6_chart.png | 02:58 |
| creiht | fcarsten: that was a fairly simple test of blasting writes to the partition as fast as could be done in a mannder similar to how swift does a 24 drive raid 6 volume vs. 1 hard drive | 02:59 |
| creiht | heh, and redbo just updated to show a raid 0 test as well :) | 03:00 |
| creiht | But like I said, there is also nothing like testing the real thing. We went back and forth between raid and non raid several times | 03:01 |
| *** mray has quit IRC | 03:05 | |
| redbo | Raids 3 through 6 are always going to be slow, no matter what SAN vendors say. Now they may be fast enough, but the rebuild times when you do lose a drive are terrible. You'll probably lose another drive before it completes. | 03:06 |
| *** miclorb has quit IRC | 03:08 | |
| redbo | So... not generally a fan of parity, other than the algorithms are pretty cool. | 03:08 |
| *** zx225 has joined #openstack | 03:08 | |
| *** miclorb_ has joined #openstack | 03:08 | |
| *** zx225 has quit IRC | 03:09 | |
| *** miclorb__ has joined #openstack | 03:11 | |
| *** miclorb_ has quit IRC | 03:14 | |
| *** mray has joined #openstack | 03:19 | |
| *** iammartian has joined #openstack | 03:22 | |
| *** BK_man has quit IRC | 03:22 | |
| *** mray has quit IRC | 03:26 | |
| *** littleidea has joined #openstack | 03:28 | |
| desai | so another probably dumb networking question: i've setup a series of networks on 10.0.0.0/8 using vlanmanager, which are used for VMs; when i start an instance, both addresses show up as being in one of the 10.0.X.0/24 networks that are in the network pool. I've tried adding floating addresses to the system as well, but they don't seem to be used. I'm likely doing something wrong, any pointers? | 03:28 |
| *** dendro-afk is now known as dendrobates | 03:36 | |
| *** adiantum has quit IRC | 03:39 | |
| *** littleidea has quit IRC | 03:44 | |
| *** adiantum has joined #openstack | 03:44 | |
| *** kpepple has left #openstack | 03:49 | |
| *** mdomsch has joined #openstack | 03:54 | |
| *** littleidea has joined #openstack | 03:56 | |
| *** jsgotangco has joined #openstack | 04:01 | |
| *** jsgotangco has quit IRC | 04:08 | |
| *** jsgotangco has joined #openstack | 04:08 | |
| *** RJD22 is now known as RJD22|away | 04:08 | |
| *** jsgotangco has quit IRC | 04:08 | |
| *** jsgotangco has joined #openstack | 04:09 | |
| *** baldben has joined #openstack | 04:09 | |
| *** bwalker7125 has quit IRC | 04:10 | |
| *** fcarsten has quit IRC | 04:14 | |
| *** RJD22|away is now known as RJD22 | 04:14 | |
| *** hadrian has joined #openstack | 04:20 | |
| *** adiantum has quit IRC | 04:23 | |
| *** fcarsten has joined #openstack | 04:27 | |
| *** adiantum has joined #openstack | 04:35 | |
| *** maplebed has quit IRC | 04:37 | |
| *** kashyapc has quit IRC | 04:41 | |
| *** ctennis has quit IRC | 04:42 | |
| *** sateesh has joined #openstack | 04:45 | |
| *** desai has quit IRC | 04:51 | |
| *** kpepple_ has joined #openstack | 04:55 | |
| *** kpepple has joined #openstack | 04:56 | |
| *** kpepple_ has left #openstack | 04:56 | |
| *** pvo_away is now known as pvo | 05:02 | |
| *** kpepple has quit IRC | 05:06 | |
| *** kpepple has joined #openstack | 05:07 | |
| *** kpepple has quit IRC | 05:14 | |
| *** kpepple has joined #openstack | 05:15 | |
| *** kpepple has quit IRC | 05:19 | |
| *** kpepple has joined #openstack | 05:19 | |
| *** pvo is now known as pvo_away | 05:21 | |
| *** kpepple has left #openstack | 05:23 | |
| *** kpepple_ has joined #openstack | 05:23 | |
| *** kpepple_ has quit IRC | 05:23 | |
| *** kashyapc has joined #openstack | 05:25 | |
| *** kpepple has joined #openstack | 05:28 | |
| *** dirakx has quit IRC | 05:28 | |
| *** kpepple has left #openstack | 05:30 | |
| *** iammartian has quit IRC | 05:43 | |
| *** BK_man has joined #openstack | 05:48 | |
| *** f4m8_ is now known as f4m8 | 05:50 | |
| *** kpepple has joined #openstack | 05:52 | |
| *** fcarsten has quit IRC | 05:53 | |
| *** kpepple has left #openstack | 05:57 | |
| *** kpepple1 has joined #openstack | 05:59 | |
| *** kpepple1 has left #openstack | 06:00 | |
| *** kpepple has joined #openstack | 06:04 | |
| openstackhudson | Project nova-tarmac build #57,733: FAILURE in 37 sec: http://hudson.openstack.org/job/nova-tarmac/57733/ | 06:11 |
| *** thimble has joined #openstack | 06:13 | |
| *** zul has quit IRC | 06:13 | |
| openstackhudson | Yippie, build fixed! | 06:15 |
| openstackhudson | Project nova-tarmac build #57,734: FIXED in 2.8 sec: http://hudson.openstack.org/job/nova-tarmac/57734/ | 06:15 |
| *** notmyname has quit IRC | 06:22 | |
| *** notmyname has joined #openstack | 06:23 | |
| *** ChanServ sets mode: +v notmyname | 06:23 | |
| *** omidhdl has joined #openstack | 06:24 | |
| *** mdomsch has quit IRC | 06:37 | |
| *** adiantum has quit IRC | 06:39 | |
| *** adiantum has joined #openstack | 06:39 | |
| *** hadrian has quit IRC | 06:40 | |
| *** daleolds has quit IRC | 06:45 | |
| *** jfluhmann__ has joined #openstack | 06:52 | |
| *** jfluhmann_ has quit IRC | 06:55 | |
| *** guigui has joined #openstack | 07:13 | |
| *** grapex has quit IRC | 07:22 | |
| *** adiantum has quit IRC | 07:27 | |
| *** miclorb__ has quit IRC | 07:31 | |
| *** adiantum has joined #openstack | 07:33 | |
| *** guynaor has joined #openstack | 07:34 | |
| *** guynaor has left #openstack | 07:34 | |
| *** miclorb_ has joined #openstack | 07:48 | |
| *** londo has joined #openstack | 08:01 | |
| *** jsgotangco has quit IRC | 08:02 | |
| *** rcc has joined #openstack | 08:02 | |
| ttx | creiht: ack | 08:04 |
| *** miclorb_ has quit IRC | 08:07 | |
| *** miclorb_ has joined #openstack | 08:07 | |
| *** ccustine has quit IRC | 08:07 | |
| *** miclorb has joined #openstack | 08:08 | |
| *** miclorb_ has quit IRC | 08:13 | |
| *** littleidea has quit IRC | 08:18 | |
| *** adiantum has quit IRC | 08:25 | |
| *** adiantum has joined #openstack | 08:30 | |
| *** befreax has joined #openstack | 08:35 | |
| *** omidhdl has quit IRC | 08:37 | |
| *** calavera has joined #openstack | 08:40 | |
| *** Nacx has joined #openstack | 08:41 | |
| *** adiantum_ has joined #openstack | 08:50 | |
| *** adiantum has quit IRC | 08:51 | |
| *** ramkrsna has joined #openstack | 08:56 | |
| *** ramkrsna has joined #openstack | 08:56 | |
| *** omidhdl has joined #openstack | 09:16 | |
| *** arthurc has joined #openstack | 09:17 | |
| *** londo has quit IRC | 09:29 | |
| *** reldan has joined #openstack | 09:30 | |
| *** jakedahn has quit IRC | 09:31 | |
| *** londo has joined #openstack | 09:35 | |
| *** metoikos has joined #openstack | 09:36 | |
| *** tomo_bot has quit IRC | 09:39 | |
| *** akaii has joined #openstack | 09:39 | |
| *** adiantum_ has quit IRC | 09:40 | |
| *** omidhdl has quit IRC | 09:41 | |
| akaii | is anyone here still awake? or is everyone asleep? | 09:42 |
| alekibango | akaii: most people will come here after some 5-7 hours... but there are some... try asking real question... | 09:43 |
| akaii | i was just wondering where the end-user API is documented | 09:43 |
| alekibango | which api you mean? eucatools? | 09:45 |
| kpepple | akaii: which API ? nova (compute) supports openstack and EC2. | 09:45 |
| akaii | the openstack api | 09:46 |
| *** adiantum_ has joined #openstack | 09:46 | |
| akaii | the one modeled after rackspace? | 09:46 |
| alekibango | akaii: i didnt use that one much :) but i will try this week | 09:47 |
| akaii | i see... but is the api documented anywhere? | 09:47 |
| kpepple | i think here - http://www.rackspacecloud.com/cloud_hosting_products/servers/api/ | 09:48 |
| *** omidhdl has joined #openstack | 09:49 | |
| kpepple | but the openstack interpretation/implementation docs are http://nova.openstack.org/devref/api.html#openstack-api | 09:49 |
| alekibango | kpepple: ty | 09:49 |
| kpepple | np | 09:50 |
| akaii | wondering, since swift and nova function differently, dont they have different interfaces? | 09:51 |
| akaii | and openstack hasn't made any changes to rackspace's interface as of now? it would be alright to just follow rackspace's documentation? | 09:52 |
| akaii | ah, i missed the second link, ill check that first | 09:53 |
| akaii | ty | 09:53 |
| RJD22 | isn't the storage modelled after Rackspace and the Compute modelled after the nasa cloud source? | 10:01 |
| kpepple | RJD22: yes, but compute offers both ec2 api (which i believe nasa's cloud uses) and openstack api | 10:02 |
| RJD22 | ok | 10:03 |
| RJD22 | cool | 10:03 |
| * RJD22 is waiting for tommorow | 10:03 | |
| RJD22 | I need to make a cloud for scalr >.> So they can implement the openstack API | 10:04 |
| akaii | the wiki (http://wiki.openstack.org/OpenStackRESTAPI) says that the openstack API is intended to be a superset of rackspace's API... | 10:08 |
| akaii | the rest of this superset is still in development? it doesnt exist yet, just in the planning stages? | 10:08 |
| kpepple | akaii: yes - planning documents (design proposals) are held here: https://blueprints.launchpad.net/nova (this is compute) | 10:10 |
| akaii | ty | 10:11 |
| *** reldan has quit IRC | 10:11 | |
| akaii | so currently, both rackspace and amazon's ec2 are functional... i suppose there's a configuration switch to choose one of the two? | 10:12 |
| akaii | and will swift have a completely different/separate api from nova? or will swift's api be a subset/superset of nova's? | 10:13 |
| kpepple | akaii: yes, there are flags in /etc/nova/nova.conf that let you set the API end-points for both EC2 and Openstack. You then talk to the correct end point depending on which you've configured. | 10:13 |
| kpepple | akaii: haven't done much work on swift … but it appears to use the S3 API .. docs are at http://swift.openstack.org/ | 10:14 |
| *** arthurc has quit IRC | 10:15 | |
| *** omidhdl has quit IRC | 10:19 | |
| *** arthurc has joined #openstack | 10:21 | |
| *** kpepple has left #openstack | 10:24 | |
| *** miclorb has quit IRC | 10:26 | |
| *** adiantum_ has quit IRC | 10:28 | |
| *** adiantum_ has joined #openstack | 10:34 | |
| *** omidhdl has joined #openstack | 10:38 | |
| *** fabiand_ has joined #openstack | 10:40 | |
| *** colinnich has joined #openstack | 10:44 | |
| *** justinc has joined #openstack | 11:02 | |
| *** adiantum_ is now known as adiantum | 11:02 | |
| *** reldan has joined #openstack | 11:06 | |
| justinc | I installed nova on two hosts, as described on wiki. Instances can be run either from controller or compute node. But ssh and ping to VMs works from controller node only. | 11:09 |
| justinc | I'm not sure if I corectlly understand http://nova.openstack.org/adminguide/network.vlan.html (which is default). So I would like to ask if this behaviour is normal, eg part of design? | 11:11 |
| openstackhudson | Project dashboard-tarmac build #117: FAILURE in 4 hr 38 min: http://hudson.openstack.org/job/dashboard-tarmac/117/ | 11:14 |
| openstackhudson | Yippie, build fixed! | 11:14 |
| openstackhudson | Project dashboard-tarmac build #118: FIXED in 2.5 sec: http://hudson.openstack.org/job/dashboard-tarmac/118/ | 11:14 |
| *** zul has joined #openstack | 11:18 | |
| *** omidhdl has quit IRC | 11:19 | |
| openstackhudson | Project nova build #485: SUCCESS in 1 min 30 sec: http://hudson.openstack.org/job/nova/485/ | 11:22 |
| openstackhudson | Tarmac: Set FINAL = True in version.py. | 11:22 |
| *** adiantum has quit IRC | 11:31 | |
| *** adiantum has joined #openstack | 11:31 | |
| *** jaypipes has quit IRC | 11:37 | |
| *** adiantum has quit IRC | 11:38 | |
| *** fabiand_ has quit IRC | 11:42 | |
| *** adiantum has joined #openstack | 11:43 | |
| *** berendt has joined #openstack | 11:44 | |
| berendt | I try running the DevAuth, but I can't add a new user (only getting the error Update failed: 503 Service Unavailable). auth-server and proxy-server are up and running. has someone an idea what can be wrong? | 11:45 |
| *** alekibango has quit IRC | 11:45 | |
| *** akaii has quit IRC | 11:46 | |
| *** alekibango has joined #openstack | 11:46 | |
| berendt | looks like my account-server has a problem | 11:47 |
| *** Sebastien-Lo has left #openstack | 11:47 | |
| *** guigui has quit IRC | 11:53 | |
| *** akaii has joined #openstack | 11:54 | |
| *** akaii has joined #openstack | 11:54 | |
| *** justinc has quit IRC | 11:56 | |
| *** dendrobates is now known as dendro-afk | 12:23 | |
| *** justinc has joined #openstack | 12:40 | |
| *** dirakx has joined #openstack | 12:43 | |
| *** omidhdl has joined #openstack | 12:46 | |
| uvirtbot | New bug: #711822 in openstack-devel "Only trunk docs are published" [Undecided,New] https://launchpad.net/bugs/711822 | 12:46 |
| *** adiantum has quit IRC | 12:48 | |
| *** adiantum has joined #openstack | 12:53 | |
| *** jaypipes has joined #openstack | 13:00 | |
| *** iRTermite has quit IRC | 13:11 | |
| *** grapex has joined #openstack | 13:14 | |
| ttx | jaypipes: ping me when you arrive | 13:15 |
| *** desai has joined #openstack | 13:17 | |
| zul | soren: do you want me to do an upload of glance when its released tomorrow? | 13:20 |
| *** ctennis has joined #openstack | 13:22 | |
| *** ctennis has joined #openstack | 13:22 | |
| *** Winston has joined #openstack | 13:23 | |
| *** Winston is now known as Guest7706 | 13:23 | |
| *** hggdh has quit IRC | 13:26 | |
| *** Guest7706 has left #openstack | 13:26 | |
| *** omidhdl has quit IRC | 13:28 | |
| *** BK_man has quit IRC | 13:31 | |
| *** dprince has joined #openstack | 13:32 | |
| *** ramkrsna has quit IRC | 13:33 | |
| *** adiantum has quit IRC | 13:38 | |
| *** adiantum has joined #openstack | 13:43 | |
| *** KnuckleSangwich has quit IRC | 13:46 | |
| uvirtbot | New bug: #711853 in swift "account-replicator fails while reading SQLite database file" [Undecided,New] https://launchpad.net/bugs/711853 | 13:46 |
| *** sandywalsh has quit IRC | 13:51 | |
| *** nelson has quit IRC | 13:52 | |
| *** sandywalsh has joined #openstack | 13:53 | |
| *** adiantum has quit IRC | 13:56 | |
| *** grapex has quit IRC | 13:56 | |
| *** sandywalsh has quit IRC | 13:58 | |
| *** sandywalsh has joined #openstack | 14:01 | |
| *** hggdh has joined #openstack | 14:02 | |
| *** adiantum has joined #openstack | 14:02 | |
| *** hggdh has quit IRC | 14:04 | |
| *** hadrian has joined #openstack | 14:06 | |
| *** littleidea has joined #openstack | 14:06 | |
| *** dirakx has joined #openstack | 14:10 | |
| *** mdomsch has joined #openstack | 14:13 | |
| *** pvo_away is now known as pvo | 14:18 | |
| *** nelson has joined #openstack | 14:20 | |
| *** gondoi has joined #openstack | 14:22 | |
| *** adiantum has quit IRC | 14:23 | |
| *** hggdh has joined #openstack | 14:23 | |
| *** lvaughn_ has joined #openstack | 14:24 | |
| *** dendro-afk is now known as dendrobates | 14:24 | |
| *** adiantum has joined #openstack | 14:25 | |
| *** lvaughn has quit IRC | 14:26 | |
| *** hggdh has quit IRC | 14:28 | |
| *** hggdh has joined #openstack | 14:28 | |
| *** dendrobates is now known as dendro-afk | 14:28 | |
| *** dendro-afk is now known as dendrobates | 14:30 | |
| *** hggdh has quit IRC | 14:32 | |
| *** sandywalsh has quit IRC | 14:33 | |
| *** hggdh has joined #openstack | 14:35 | |
| *** adiantum has quit IRC | 14:37 | |
| *** vvuksan has joined #openstack | 14:41 | |
| *** omidhdl has joined #openstack | 14:42 | |
| *** f4m8 is now known as f4m8_ | 14:45 | |
| *** sandywalsh has joined #openstack | 14:46 | |
| *** iammartian has joined #openstack | 14:47 | |
| *** that__guy has joined #openstack | 14:47 | |
| *** adiantum has joined #openstack | 14:50 | |
| desai | vvuksan: thanks for the ec2_dmz tip yesterday, it helped a bunch. (it didn't fix everything, but that got me unstuck) | 14:50 |
| *** westmaas_ has joined #openstack | 14:51 | |
| *** mdomsch has quit IRC | 14:53 | |
| *** pvo is now known as pvo_away | 14:58 | |
| *** pvo_away is now known as pvo | 14:58 | |
| *** iRTermite has joined #openstack | 15:02 | |
| vvuksan | desai: excellent | 15:03 |
| *** littleidea has quit IRC | 15:04 | |
| *** imsplitbit has joined #openstack | 15:04 | |
| vvuksan | desai: you may want to update the Wiki documentation | 15:04 |
| desai | yeah, i was planning to do that once everything is actually working ;) | 15:04 |
| vvuksan | i'd do it as you discover things | 15:05 |
| vvuksan | as you will inadvertently forget things | 15:05 |
| desai | yeah, i know what you mean | 15:05 |
| desai | does anyone know if it is safe to remove stale entries from the services table in the db? | 15:07 |
| desai | i think that things are getting slowed down by old references to nova-compute instances that aren't up any longer | 15:07 |
| *** imsplitbit has quit IRC | 15:07 | |
| *** imsplitbit has joined #openstack | 15:08 | |
| *** justinc has quit IRC | 15:08 | |
| *** hggdh has quit IRC | 15:11 | |
| *** hggdh has joined #openstack | 15:13 | |
| *** rnirmal has joined #openstack | 15:15 | |
| *** grapex has joined #openstack | 15:20 | |
| *** dendrobates is now known as dendro-afk | 15:21 | |
| *** mray has joined #openstack | 15:21 | |
| *** dendro-afk is now known as dendrobates | 15:22 | |
| *** adiantum has quit IRC | 15:23 | |
| *** nelson has quit IRC | 15:24 | |
| *** aliguori has quit IRC | 15:26 | |
| desai | nova-network seems to be spinning and kicking out this traceback: http://paste.openstack.org/show/621/ | 15:30 |
| desai | does it ring any bells for anyone? | 15:30 |
| *** Ryan_Lane has joined #openstack | 15:30 | |
| ttx | creiht: any swift known bug you want to mention in http://wiki.openstack.org/ReleaseNotes/Bexar ? | 15:30 |
| ttx | jaypipes: ping | 15:31 |
| creiht | ttx: Not that I know of | 15:31 |
| ttx | creiht: ok | 15:31 |
| ttx | nova-core: please review http://wiki.openstack.org/ReleaseNotes/Bexar for correctness | 15:32 |
| *** mray1 has joined #openstack | 15:35 | |
| *** nelson has joined #openstack | 15:35 | |
| *** adiantum has joined #openstack | 15:35 | |
| *** blakeyeager has joined #openstack | 15:36 | |
| *** mray has quit IRC | 15:37 | |
| *** troytoman has joined #openstack | 15:38 | |
| *** mray1 is now known as mray | 15:38 | |
| *** abecc has joined #openstack | 15:39 | |
| *** tomo_bot has joined #openstack | 15:42 | |
| *** grapex has quit IRC | 15:43 | |
| *** dendrobates is now known as dendro-afk | 15:44 | |
| *** ivan has quit IRC | 15:45 | |
| *** Isvara has joined #openstack | 15:45 | |
| *** ivan has joined #openstack | 15:50 | |
| vishy | desai: that is a bug | 15:52 |
| vishy | desai: you can fix it by manually adding an SNATTING chain | 15:53 |
| *** adiantum has quit IRC | 15:53 | |
| vishy | sudo iptables -t nat -N SNATTING | 15:53 |
| vishy | sudo iptables -t nat -A POSTROUTING -j SNATTING | 15:53 |
| *** aliguori has joined #openstack | 15:54 | |
| ttx | vishy: I put a note in release notes about single interfaces and FlatDHCPManager, please check it makes sense | 15:58 |
| *** adiantum has joined #openstack | 15:58 | |
| *** j05h has quit IRC | 15:58 | |
| vishy | ttx: the bug desai is hitting we need to document or fix | 15:58 |
| ttx | desai: could you file a bug at https://bugs.launchpad.net/nova/+filebug ? | 16:01 |
| vishy | ttx: where can I find release notes | 16:01 |
| ttx | http://wiki.openstack.org/ReleaseNotes/Bexar | 16:01 |
| vishy | ttx, desai: i'll file the bug i just made a fix | 16:01 |
| *** thimble has quit IRC | 16:01 | |
| ttx | vishy: ok | 16:01 |
| vishy | ttx: note in release notes looks fine | 16:02 |
| ttx | vishy: Please detail in which case that would trigger, since nobody else hit it yet | 16:02 |
| vishy | ttx, yes | 16:02 |
| vishy | (it is on restart of nova-network if iptables have been flushed and a floating ip is assigned) | 16:03 |
| vishy | I'll put a workaround in as well | 16:03 |
| ttx | ok, then I propose to document it | 16:03 |
| *** dragondm has joined #openstack | 16:03 | |
| ttx | mtaylor: up yet ? | 16:05 |
| *** ctennis has quit IRC | 16:06 | |
| *** sateesh has quit IRC | 16:06 | |
| *** adiantum has quit IRC | 16:08 | |
| *** dragondm has quit IRC | 16:08 | |
| *** dragondm has joined #openstack | 16:09 | |
| *** littleidea has joined #openstack | 16:09 | |
| *** adiantum has joined #openstack | 16:13 | |
| *** j05h has joined #openstack | 16:15 | |
| *** dendro-afk is now known as dendrobates | 16:16 | |
| desai | vishy: can i get a pointer to the fix? | 16:16 |
| desai | oh wait | 16:16 |
| desai | nm, read scrollback now | 16:16 |
| vishy | bug 711948 | 16:17 |
| uvirtbot | Launchpad bug 711948 in nova "nova-network crashes on restart with floating ips assigned" [Medium,In progress] https://launchpad.net/bugs/711948 | 16:17 |
| desai | vishy: thx | 16:17 |
| *** kirkland has joined #openstack | 16:17 | |
| vishy | desai: np | 16:19 |
| *** Ryan_Lane has quit IRC | 16:20 | |
| that__guy | vishy, ttx: applied the fix you gave to desai and got this: http://paste.openstack.org/show/622/ | 16:20 |
| that__guy | vishy, ttx: should this be filed as a bug or does our network table need to be reinit'd | 16:21 |
| uvirtbot | New bug: #711948 in nova "nova-network crashes on restart with floating ips assigned" [Medium,In progress] https://launchpad.net/bugs/711948 | 16:21 |
| *** Ryan_Lane has joined #openstack | 16:23 | |
| Ryan_Lane | is there any documentation for multi-zone configurations? | 16:23 |
| Ryan_Lane | and if I don't use multi-zone when I start, will it be difficult to transition later? | 16:23 |
| *** kpepple has joined #openstack | 16:24 | |
| *** westmaas_ has quit IRC | 16:29 | |
| *** RJD22 is now known as RJD22|away | 16:30 | |
| *** blakeyeager_ has joined #openstack | 16:32 | |
| vishy | that__guy: how did that happen? | 16:34 |
| *** baldben has quit IRC | 16:34 | |
| *** blakeyeager has quit IRC | 16:35 | |
| mtaylor | ttx: yup | 16:35 |
| that__guy | vishy: stopped nova-network, added the snatting chain, restarted, and euca-run-instance | 16:35 |
| vishy | that__guy: looks like you had an instance already running and you blew away the networking tables? | 16:35 |
| vishy | that__guy: or you have multiple databases | 16:36 |
| desai | vishy: we've got a database that has a day worth of weird info in it from debugging | 16:36 |
| desai | should we drop the network table and re-create it? | 16:36 |
| *** berendt has quit IRC | 16:37 | |
| *** blakeyeager_ has quit IRC | 16:37 | |
| vishy | desai: sure, but if so, you have to destroy all the running instances | 16:37 |
| desai | we can do that | 16:37 |
| desai | we're still trying to get things working reliably | 16:37 |
| vishy | that might be best | 16:37 |
| desai | ok | 16:37 |
| desai | so we kill all of the instances that we can | 16:37 |
| vishy | you're definitely in some weird middle state at the moment | 16:37 |
| desai | there are a few zombies kicking around still | 16:37 |
| desai | yeah, it definitely looks like that | 16:37 |
| vishy | desai | 16:37 |
| vishy | virsh list | 16:38 |
| desai | on which node? | 16:38 |
| vishy | virsh destroy X | 16:38 |
| vishy | on all of the compute nodes | 16:38 |
| vishy | to kill instances that are running but somehow disappeared from the db | 16:38 |
| desai | we have the opposite | 16:38 |
| desai | we have things in the db that aren't running | 16:38 |
| vishy | oh in that case | 16:38 |
| desai | at one point, we had scaled up the number of nova-compute nodes | 16:39 |
| desai | and it was making debugging much harder | 16:39 |
| vishy | ah i see, and euca-terminate won't work because the compute host doesn't exist anymore | 16:39 |
| vishy | you can manually just set those to deleted=1 | 16:39 |
| desai | in the db instances table? | 16:40 |
| colinnich | creiht, notmyname : Hi. Got 2 problems with RC (revision 206). While account authentication seems fine, and actual requests are ok - none of the swauth- commands work. All return 400/Bad Request. | 16:42 |
| colinnich | Other problem is all the services log everything twice into syslog and proxy-server twice into /var/log/swift/proxy.log | 16:42 |
| *** ciswrk has joined #openstack | 16:42 | |
| colinnich | I know logging changed, so hopefully that's a config thing | 16:43 |
| *** omidhdl has quit IRC | 16:43 | |
| notmyname | colinnich: the second issue sounds like a syslog-ng config issue | 16:43 |
| colinnich | notmyname: storage nodes are doing it too, and they don't have syslog-ng installed | 16:44 |
| *** adiantum has quit IRC | 16:44 | |
| colinnich | notmyname: It doesn't seem to be *everything*. I'll paste something | 16:45 |
| *** grapex has joined #openstack | 16:45 | |
| *** blakeyeager has joined #openstack | 16:46 | |
| vishy | desai: yes | 16:46 |
| colinnich | notmyname: ok, it is - but it's weird. The last line in syslog is always a single, with the duplicate appearing whenever the next thing is output, which may be many seconds later | 16:46 |
| desai | vishy: ok, got them | 16:46 |
| desai | vishy: so which tables should i empty out? networks, and what else? | 16:47 |
| *** MarkAtwood has joined #openstack | 16:47 | |
| vishy | desai: fixed_ips, floating_ips | 16:48 |
| colinnich | notmyname: doesn't look like a problem in the code, more of a system thing | 16:48 |
| vishy | and recreate networks and floating ips | 16:48 |
| desai | k | 16:48 |
| vishy | via nova-manage | 16:48 |
| colinnich | notmyname: I also did an apt-get upgrade today | 16:48 |
| desai | vishy: and finish it off with a nova-network restart? | 16:50 |
| vishy | yeah | 16:51 |
| *** adiantum has joined #openstack | 16:51 | |
| *** iRTermite has quit IRC | 16:52 | |
| vishy | desai: we had a nova-manage command at some point to clean up zombie instances like that...perhaps it never made it into trunk | 16:52 |
| desai | i suspect we might be writing a few things like that in the next few weeks | 16:53 |
| *** nelson has quit IRC | 16:54 | |
| ttx | mtaylor: ignore me, got jaypipes | 16:54 |
| desai | hm, looks like i can't hit the metadata service from the nodes again, but the nat rule looks ok | 16:54 |
| vishy | interesting | 16:55 |
| vishy | is it getting hit? (iptables -t nat -L -n -v) | 16:55 |
| vishy | cat /proc/sys/net/ipv4/ip_forward (on network host) | 16:56 |
| desai | the latter command returns 0 | 16:56 |
| vishy | echo 1 into it | 16:56 |
| vishy | probably should change sysctl to set it to 1 so it happens on reboot | 16:57 |
| vishy | edit /etc/sysctl.conf | 16:57 |
| desai | k | 16:57 |
| *** ccustine has joined #openstack | 16:57 | |
| vishy | did that fix it? | 16:58 |
| desai | this is weird, since hitting the metadata service was working beforehand | 16:58 |
| desai | doesn't look like | 16:58 |
| desai | i'm giving it a minute to retrans | 16:58 |
| desai | i don't think that it did | 16:58 |
| vishy | pastie iptables -t nat -L -n -v | 16:58 |
| desai | i'm starting a fresh instance | 16:58 |
| desai | will paste in a sec | 16:58 |
| vishy | k | 16:58 |
| desai | new instance still failing | 16:59 |
| vishy | you are getting leased messages in nova-network log? | 16:59 |
| desai | http://paste.openstack.org/show/623/ | 17:00 |
| desai | yeah, leasing messages showing up as expected | 17:00 |
| vishy | but the prerouting rule isn't working... | 17:01 |
| vishy | did it associate a public ip on boot? | 17:02 |
| colinnich | creiht, notmyname: scratch the swauth problem, that was me - dodgy auth url | 17:02 |
| vishy | or is that from a different instance? | 17:02 |
| colinnich | notmyname: log problem goes away when I go back the code I was running this morning | 17:02 |
| notmyname | the swift code? what versions before and after the problem? I'll do a diff | 17:02 |
| desai | vishy: euca-describe-instances only shows 10.X addresses | 17:03 |
| colinnich | notmyname: yes, swift code. Good question.... I'll try and find out | 17:03 |
| desai | so i don't think that it is associating a public address | 17:03 |
| desai | i suspect that address maybe from before | 17:03 |
| *** befreax has quit IRC | 17:03 | |
| vishy | ah ok that must be leftover | 17:04 |
| vishy | desai: what instance are you running? | 17:04 |
| desai | 10.0.0.4 and 10.0.0.5 are both mine | 17:05 |
| vishy | i mean which image | 17:05 |
| vishy | is it an ami-tty? | 17:05 |
| desai | yeah | 17:05 |
| colinnich | notmyname: any way of finding out from the code? Failing that, I'll have to send you it | 17:05 |
| vishy | and you are getting leased messages for both of them? but metadata is failing? | 17:06 |
| desai | yeah | 17:06 |
| desai | it is timing out | 17:06 |
| creiht | colinnich: huh... I just repeated what you are seeing | 17:06 |
| vishy | and cat /proc/sys/net/ipv4/ip_forward shows 1 now? | 17:07 |
| desai | yeah | 17:07 |
| vishy | if you ifconfig on the network and compute host | 17:07 |
| vishy | do they both show traffic on vlan100 | 17:07 |
| vishy | ? | 17:07 |
| notmyname | colinnich: swift/__init__.py (or import swift; swift.__version__) | 17:08 |
| notmyname | creiht: what changed? | 17:08 |
| creiht | notmyname: not sure, gholt fixed some logging problems that we had | 17:08 |
| notmyname | colinnich: or bzr log, I guess | 17:08 |
| creiht | I'll have to look | 17:08 |
| *** adiantum has quit IRC | 17:08 | |
| desai | fishy: that is fine (it is vlan3010, due to local requirements); i can ping the instance from the node running nova-network, so the vlan is being brought up properly | 17:09 |
| colinnich | notmyname: it doesn't have bzr history (I keep my own local repo of the code I am using) and __version__ = '1.1.0' :-( | 17:09 |
| desai | shouldn't any outbound traffic to the metadata service be hitting the PREROUTING DNAT rule for 169.254.169.254? | 17:09 |
| colinnich | notmyname: http://downloads.netintelligence.com/temp/colin/swift-add9c36.tar.gz | 17:10 |
| desai | vishy: sorry, somehow autocorrect got turned on in my im client, need to fix that | 17:10 |
| colinnich | notmyname: would have been from around Jan 20th | 17:10 |
| creiht | colinnich: yeah don't worry about that, we have duplicated the issue... looking into it now | 17:10 |
| notmyname | we're looking in to it | 17:10 |
| *** guigui1 has joined #openstack | 17:11 | |
| colinnich | cool | 17:11 |
| creiht | and thanks for catching that | 17:11 |
| vishy | desai yes | 17:11 |
| vishy | desai: if you can ping you might wait for the metadata to fail and then ssh in | 17:12 |
| vishy | and see what is happening | 17:12 |
| creiht | colinnich: would you mind posting a bug? | 17:12 |
| colinnich | creiht: ok | 17:12 |
| vishy | desai: you could also try killall dnsmasq and restart nova-network | 17:12 |
| vishy | desai: possibly some settings changed and the old dnsmasq instances don't have the right settigns? | 17:13 |
| desai | could me | 17:13 |
| desai | could be, i'll try that | 17:13 |
| *** adiantum has joined #openstack | 17:13 | |
| desai | vishy: still failing | 17:16 |
| vishy | ok just as a sanity check | 17:16 |
| vishy | curl 172.16.60.254:8773 | 17:16 |
| vishy | this was working previously, yes? | 17:17 |
| desai | the curl works | 17:17 |
| colinnich | creiht: Bug #711995 | 17:17 |
| uvirtbot | Launchpad bug 711995 in swift "all components output duplicate logging" [Undecided,New] https://launchpad.net/bugs/711995 | 17:17 |
| creiht | colinnich: thanks | 17:18 |
| vishy | ok so for some reason the 169 req isn't making it | 17:18 |
| desai | yeah | 17:18 |
| vishy | desai: if you wait for metadata to time out you should be able to ssh in to the instance | 17:18 |
| desai | so it looks like it is hitting the PREROUTING rule, but not making it through to the subsequent DNAT rule | 17:18 |
| desai | ok, i'll ssh in when it become available | 17:18 |
| vishy | when you do, try pinging 10.0.0.1 then try to wget 169.254.169.254 | 17:20 |
| vishy | you might have to do some tcpdumps on various interfaces to figure out where it is getting dropped | 17:21 |
| vishy | it looks like the packet is not making it to the network host for some reason | 17:21 |
| desai | 10.0.0.1 will ping; i tested that out on the last instance before the restart (and is needed for the ssh to work in the first place) | 17:21 |
| vishy | otherwise it would be hitting | 17:22 |
| vishy | is it possible you have another host claiming 10.0.0.1? | 17:22 |
| *** adiantum has quit IRC | 17:22 | |
| desai | possible, let me run a quick check | 17:22 |
| vishy | like an old network host that is running dnsmasq? | 17:22 |
| desai | i went through and killed them all | 17:22 |
| desai | i'll check the arp table when the node is up | 17:22 |
| *** lvaughn_ has quit IRC | 17:23 | |
| vishy | cuz killing nova-network doesn't remove the bridge with the ip or kill dnsmasq | 17:23 |
| desai | ok | 17:23 |
| desai | i see a few old interfaces kicking around on former network hosts | 17:24 |
| *** lvaughn has joined #openstack | 17:24 | |
| desai | but not 10.0.0.1 | 17:24 |
| *** dendrobates is now known as dendro-afk | 17:25 | |
| *** adiantum has joined #openstack | 17:25 | |
| uvirtbot | New bug: #711995 in swift "all components output duplicate logging" [Critical,Confirmed] https://launchpad.net/bugs/711995 | 17:26 |
| vishy | odd. Gotta head in to the office. BB in 30 min. I'll keep thinking about what else could be going wrong. Some instances (desktop ubuntu for example) try to arp for 169.254... This fails, but can be fixed by adding 169.254 to the network host. I don't think i've ever seen ami-tty arp for the address though | 17:28 |
| *** blueadept has joined #openstack | 17:28 | |
| *** blueadept has joined #openstack | 17:28 | |
| vishy | you could add the 169 address to the network host and see if that helps but i think it is probably something else | 17:28 |
| *** guigui1 has quit IRC | 17:28 | |
| vishy | ip addr add 169.254.169.254/32 scope link dev <eth where vlans are added> | 17:30 |
| desai | cool, thanks, i'll keep digging | 17:30 |
| *** hggdh has quit IRC | 17:31 | |
| *** hggdh has joined #openstack | 17:32 | |
| *** colinnich has quit IRC | 17:32 | |
| *** adiantum has quit IRC | 17:33 | |
| *** pvo is now known as pvo_away | 17:33 | |
| *** dendro-afk is now known as dendrobates | 17:33 | |
| desai | oh, i think that i figured it out | 17:33 |
| *** MarcMorata has joined #openstack | 17:34 | |
| desai | it looks like the traffic is being natted (though left on 3010) because nova-network used to run on the host running nova-compute | 17:34 |
| *** adiantum has joined #openstack | 17:34 | |
| jaypipes | sirp-: option groups merged into lp:glance/cactus. (with merge comment: "Merge Rick's Super-Cool Option Group Extravanganza.") | 17:38 |
| *** MarcMorata is now known as Seoman | 17:38 | |
| *** Seoman is now known as MarcMorata | 17:38 | |
| sirp- | jaypipes: woot | 17:39 |
| jaypipes | sirp-: and re: the migrations patch... patch looks great, but wondering if we can verify it with some sort of test? | 17:40 |
| *** joearnold has joined #openstack | 17:42 | |
| sirp- | jaypipes: hmm that could be tricky since it's really just a cli wrapper on sqlaclhemy-migrate, no real logic to speak of | 17:43 |
| desai | vishy: that seems to have done the trick | 17:44 |
| jaypipes | sirp-: yeah, I know, which is why I wasn't *demanding* a test case, just asking what your thoughts were on it... | 17:46 |
| *** adiantum has quit IRC | 17:47 | |
| *** piken has quit IRC | 17:48 | |
| *** adiantum has joined #openstack | 17:49 | |
| *** pvo_away is now known as pvo | 17:52 | |
| *** pvo is now known as pvo_away | 17:52 | |
| *** Isvara has quit IRC | 17:52 | |
| *** blakeyeager has quit IRC | 17:58 | |
| *** adiantum has quit IRC | 18:00 | |
| *** daleolds has joined #openstack | 18:02 | |
| *** pvo_away is now known as pvo | 18:02 | |
| *** maplebed has joined #openstack | 18:02 | |
| *** maplebed has joined #openstack | 18:03 | |
| *** adiantum has joined #openstack | 18:05 | |
| tmarble | /names | 18:08 |
| *** tmarble has left #openstack | 18:08 | |
| *** tmarble has joined #openstack | 18:09 | |
| *** dendrobates is now known as dendro-afk | 18:09 | |
| *** RJD22|away is now known as RJD22 | 18:11 | |
| vishy | desai: cool | 18:13 |
| desai | i think that there is one question left, and we might be good | 18:13 |
| vvuksan | i'm tempted to go out and jump in the snow cause I nearly got my own custom RHEL5 image going on openstack | 18:14 |
| blueadept | anyone know the names of any companies currently using openstack compute as the baselayer for their vm offering? | 18:14 |
| desai | when we'd run instances with euca, it would auto-associate an external ip if one was available | 18:14 |
| desai | that doesn't seem to happen automagically with nova | 18:14 |
| desai | should it? | 18:14 |
| desai | or is there something that we need to tell our users to do differently? | 18:14 |
| vishy | vvuksan: it is a bit tricky, i got centos working ok so it can be done | 18:14 |
| vishy | desai: no there is no auto-associate | 18:15 |
| desai | ok | 18:15 |
| vvuksan | vishy: last issue I'm trying to resolve is that virtio doesn't work | 18:15 |
| mray | vishy: is there a list of images to feed into nova's /var/lib/nova/images somewhere? I'm digging through your setup recipe in your Chef repo | 18:15 |
| *** calavera has quit IRC | 18:15 | |
| mray | like some public ones for testing? | 18:15 |
| vishy | vvuksan: did you mkinitrd? | 18:16 |
| vvuksan | vishy: inside the image ? | 18:16 |
| vishy | aye | 18:16 |
| vishy | mkinitrd --with virtio_pci --with virtio_blk ---with virtio -f /boot/initrd-$(uname -r) $(uname -r ) | 18:16 |
| vishy | i had to do that (and if you are using separate kernel and ramdisk, copy it out of the image | 18:17 |
| vishy | i think you also need to make sure that ahpci is modprobed on boot if you want volumes to work | 18:18 |
| vishy | mray: i was just grabbing ami-tty | 18:18 |
| desai | vishy: i think that we're nearly there | 18:20 |
| vishy | mray: there isn't really a default list but i use :nova => { :images => ["http://images.ansolabs.com/tty.tgz"] } | 18:20 |
| desai | when i try adding an external address, i get the following trace from nova-network | 18:20 |
| desai | http://paste.openstack.org/show/624/ | 18:20 |
| *** nelson has joined #openstack | 18:20 | |
| desai | i'm not sure why it thinks that it needs to add the address to that vlan | 18:21 |
| vishy | desai: you need to specify your public interface | 18:21 |
| vishy | in flags | 18:21 |
| desai | in the floating create? | 18:21 |
| vishy | --flags.DEFINE_string('public_interface', 'vlan1', | 18:22 |
| vishy | in nova.conf | 18:22 |
| vishy | --public_interface=<xxx> | 18:22 |
| desai | ah | 18:22 |
| desai | cool | 18:22 |
| vishy | otherwise it doesn't know where to put the ips | 18:22 |
| mray | vishy: just making minor changes as I get a feel for what all the recipes and roles do, replacing shell calls with Chef resources | 18:23 |
| vishy | mray there is a maverick one also there: http://images.ansolabs.com/maverick.tgz | 18:23 |
| *** adiantum has quit IRC | 18:24 | |
| vishy | mray: good deal, my most up-to-date stuff is in the devpackages branch btw | 18:24 |
| mray | oh, crap | 18:24 |
| vishy | :) | 18:24 |
| mray | well, I actually want to make a "Bexar" release first rather than target the build tools | 18:25 |
| mray | s/build tools/dev builds/ | 18:25 |
| vishy | the differences are mostly to support bexar | 18:25 |
| vishy | packages is off of an older release about 3 weeks ago | 18:25 |
| mray | ok, thanks for the heads-up | 18:25 |
| mray | https://github.com/mattray/openstack-cookbooks/raw/master/roles/roles.png | 18:26 |
| vishy | cool | 18:26 |
| mray | a little visualization I made to keep things straight in my head | 18:26 |
| vishy | those roles were made by adam a long time ago | 18:27 |
| desai | vishy: once i add that to the config, then things seem to work more correctly, though i'm not sure the nat is completely working properly | 18:27 |
| vishy | I have been using the recipes directly | 18:27 |
| desai | if i try connecting to port 22 on the external ip, i seem to get the management node | 18:27 |
| vishy | (that's why nova network and nova scheduler aren't included in the roles, they didn't exist then | 18:27 |
| mray | yeah, I'm doc'ing them as I figure out what's going on | 18:27 |
| vishy | and the nova::mysql and nova::rabbit are new as well | 18:28 |
| vishy | desai: from where? | 18:28 |
| desai | from the management node, but also from the outside | 18:29 |
| vishy | from the mgmnt node that is expected | 18:29 |
| desai | ok | 18:29 |
| vishy | because local traffic doesn't use natting tables | 18:29 |
| vishy | outside should work though | 18:29 |
| *** adiantum has joined #openstack | 18:29 | |
| desai | oh, that makes sense | 18:29 |
| vishy | although you have to authorize 22 | 18:29 |
| desai | yeah, i already did that | 18:29 |
| vishy | or it will be blocked on the host | 18:29 |
| mray | ok, I'll update my fork to go off the devpackages branch. I'm thinking I should just call my a 'bexar' branch since all I want to do is maintain a stable releases for now | 18:30 |
| vishy | sure | 18:30 |
| vishy | mray: the only differences between devpackages and bexar is that devpackages expect an /etc/default/nova-common file to be created | 18:30 |
| vishy | so the devpackages branch creates it | 18:30 |
| vishy | but there shouldn't be any problem creating it anyway | 18:31 |
| mray | cool | 18:31 |
| *** MarkAtwood has quit IRC | 18:31 | |
| vishy | (+ there is a bugfix in devpackages that actually makes flatdhcp work properly) | 18:31 |
| vishy | it is a little broken if you don't have a spare interface with no ip in bexar | 18:32 |
| mray | bbiab | 18:32 |
| * mray away | 18:32 | |
| desai | hm, it looks like euca-describe-instances is consistently failing with this trace:http://paste.openstack.org/show/625/ | 18:34 |
| *** ctennis has joined #openstack | 18:34 | |
| *** ctennis has joined #openstack | 18:34 | |
| vvuksan | vishy: you da bomb | 18:36 |
| vvuksan | vishy: mkinitrd works :-) | 18:36 |
| vishy | whoot | 18:36 |
| desai | sorry, not describe-instances, describe-addresses | 18:36 |
| vvuksan | i must run out and shovel my driveway now :-) | 18:36 |
| vvuksan | that's the only way to celebrate ;-) | 18:37 |
| vishy | desai: are you using packages? | 18:37 |
| desai | yeah, from the anso apt source | 18:37 |
| vvuksan | vishy: thanks a lot | 18:37 |
| vishy | that was fixed a while ago, but after packages | 18:37 |
| desai | i don't mind hacking up the code on the head node until we get newer packages on everything | 18:38 |
| vishy | desai: ok it is a pretty easy fix | 18:39 |
| vishy | desai, just need to change 'ec2_id' to 'id' | 18:39 |
| desai | heh | 18:39 |
| desai | ok, one sec | 18:39 |
| *** adiantum has quit IRC | 18:41 | |
| desai | great, that fixed it | 18:41 |
| *** hub_cap has joined #openstack | 18:41 | |
| desai | so i think that we have some routing issues to overcome with our net folk, but it looks like everything is working now | 18:41 |
| vishy | desai: we should be updating packages soon | 18:41 |
| desai | vishy: thank you so much for all of the hlep | 18:41 |
| desai | vishy: cool, we'll upgrade when that is ready | 18:42 |
| vishy | desai: yw | 18:42 |
| *** ctennis has quit IRC | 18:42 | |
| *** colinnich has joined #openstack | 18:44 | |
| vvuksan | now quick desai document everything :-) | 18:44 |
| * desai grins | 18:45 | |
| desai | i think that a set of details for a multi-node system network would be helpful | 18:45 |
| desai | i can write that up | 18:45 |
| vvuksan | please | 18:45 |
| *** Isvara has joined #openstack | 18:46 | |
| *** adiantum has joined #openstack | 18:46 | |
| *** jfluhmann_ has joined #openstack | 18:52 | |
| *** rabbityard has joined #openstack | 18:53 | |
| *** kpepple has left #openstack | 18:53 | |
| rabbityard | kpepple: concall ? | 18:53 |
| *** rabbityard has quit IRC | 18:54 | |
| *** pvo is now known as pvo_away | 18:55 | |
| *** jfluhmann__ has quit IRC | 18:56 | |
| *** littleidea has quit IRC | 18:57 | |
| *** adiantum has quit IRC | 18:57 | |
| *** arthurc has quit IRC | 18:58 | |
| *** kashyapc has quit IRC | 18:59 | |
| *** rnirmal_ has joined #openstack | 19:00 | |
| *** pvo_away is now known as pvo | 19:02 | |
| *** adiantum has joined #openstack | 19:02 | |
| *** rnirmal has quit IRC | 19:03 | |
| *** rnirmal_ is now known as rnirmal | 19:03 | |
| *** joe123 has joined #openstack | 19:06 | |
| that__guy | vishy: what has to be done to get m1.small and m1.large instances launched | 19:07 |
| that__guy | vishy: they're currently just hanging in 'pending' status | 19:07 |
| that__guy | vishy: m1.tiny instances launch just fine | 19:07 |
| *** adiantum has quit IRC | 19:08 | |
| *** grapex has quit IRC | 19:08 | |
| *** omidhdl has joined #openstack | 19:08 | |
| vishy | that__guy: hmm it should just work | 19:08 |
| vishy | that__guy: do you get an error in nova-compute? | 19:09 |
| *** colinnich has left #openstack | 19:09 | |
| *** hub_cap_ has joined #openstack | 19:09 | |
| vishy | that__guy perhaps there is an unmet dependency? | 19:09 |
| *** hub_cap has quit IRC | 19:10 | |
| *** hub_cap_ is now known as hub_cap | 19:10 | |
| Ryan_Lane | that__guy: does your compute node have enough free memory to launch an instance of that size? | 19:10 |
| *** adiantum has joined #openstack | 19:10 | |
| that__guy | ryan: yes, it has plenty | 19:10 |
| Ryan_Lane | and enough free storage space? | 19:11 |
| vvuksan | vishy: here is the doc :-) http://wiki.openstack.org/CreatingRHELImages#preview | 19:11 |
| that__guy | ah, it's the partitioning on the nodes... | 19:12 |
| *** ctennis has joined #openstack | 19:12 | |
| *** ctennis has joined #openstack | 19:12 | |
| vvuksan | vishy: do you recommend including any of the other virtio drivers like balloon ? | 19:12 |
| *** Ryan_Lane is now known as Ryan_Lane|food | 19:13 | |
| *** colinnich has joined #openstack | 19:15 | |
| *** grapex has joined #openstack | 19:15 | |
| *** baldben has joined #openstack | 19:16 | |
| *** miclorb has joined #openstack | 19:16 | |
| *** reldan has quit IRC | 19:18 | |
| *** ctennis has quit IRC | 19:19 | |
| *** laurensell has left #openstack | 19:21 | |
| *** aimon has joined #openstack | 19:21 | |
| *** RJD22 is now known as RJD22|away | 19:23 | |
| *** fabiand_ has joined #openstack | 19:23 | |
| *** RJD22|away is now known as RJD22 | 19:24 | |
| vishy | virtio: yes i think balloon is needed too | 19:24 |
| vishy | vvuksan: ^^ | 19:24 |
| vvuksan | k | 19:25 |
| *** baldben has quit IRC | 19:25 | |
| *** BK_man has joined #openstack | 19:25 | |
| vvuksan | vishy: how about ring ? | 19:25 |
| vvuksan | i suppose I should to net as well | 19:25 |
| vishy | don't know about ring... | 19:25 |
| vishy | i do net because virtio net is much faster | 19:25 |
| vvuksan | right | 19:26 |
| vishy | although there is no logic to set it properly in libvirt.xml yet, but that will be soon | 19:26 |
| vvuksan | k | 19:26 |
| *** baldben has joined #openstack | 19:26 | |
| vvuksan | added it to the Wiki | 19:26 |
| *** adiantum has quit IRC | 19:27 | |
| *** adiantum has joined #openstack | 19:33 | |
| *** nelson has quit IRC | 19:34 | |
| *** mtaylor has quit IRC | 19:37 | |
| *** kbringard has joined #openstack | 19:38 | |
| *** burris has quit IRC | 19:38 | |
| *** littleidea has joined #openstack | 19:38 | |
| *** MarcMorata has quit IRC | 19:40 | |
| *** mtaylor has joined #openstack | 19:42 | |
| *** ChanServ sets mode: +v mtaylor | 19:42 | |
| *** adiantum has quit IRC | 19:43 | |
| jaypipes | vishy: hey. vagrant looks interesting. however, if I read the instructions correctly, you are using Virtualbox to deploy VMs with Nova on them, which then deploys VMs somewhere else? Can you help me wrap my head around how you are using vagrant? Thanks! | 19:44 |
| vishy | jaypipes that is it exactly | 19:44 |
| *** bcherian has joined #openstack | 19:44 | |
| jaypipes | vishy: ah, ok :) | 19:44 |
| jaypipes | vishy: cheers | 19:44 |
| jaypipes | vishy: I'm not going to comment any more on that particular merge req cuz I'm no expert in networking, and any input I had would be superficial :) | 19:45 |
| jaypipes | vishy: very MCEscher, btw ;) | 19:45 |
| kbringard | jaypipes: it's just turtles, all the way down :-) | 19:46 |
| kbringard | hey vishy, I have (what I hope is) a quick question | 19:46 |
| *** rkstager has joined #openstack | 19:46 | |
| termie | heya, what are the valid characters in a bzr tag/branch name? | 19:46 |
| jaypipes | kbringard: :) | 19:46 |
| kbringard | I create a project and assign it an admin | 19:46 |
| kbringard | then I create a new user, who isn't an admin, and add them to said project | 19:47 |
| kbringard | but when I try to launch an instance in that project as the non-admin user, it's giving me a 401 | 19:47 |
| jaypipes | termie: hmm, good question... I think alphanum, hyphen, dot... | 19:47 |
| jaypipes | termie: whatcha trying? :) | 19:47 |
| *** baldben has quit IRC | 19:47 | |
| termie | jaypipes: i just want a full list, bzr allows tilde and git does not, for example | 19:47 |
| jaypipes | termie: ah, I see... I'll see what I can dig up. | 19:48 |
| termie | git has a page like this: http://www.kernel.org/pub/software/scm/git/docs/git-check-ref-format.html | 19:48 |
| termie | but i couldn't figure out what to search for with bzr | 19:48 |
| vishy | kbringard: nova-manage r a <user> sysadmin | 19:48 |
| jaypipes | termie: I'll see what I can find. | 19:48 |
| termie | jaypipes: thanks :) | 19:48 |
| *** colinnich_ has joined #openstack | 19:48 | |
| vishy | kbringard: then nova-manage r a <user> sysadmin <proj> | 19:48 |
| termie | (the recent creation of a tag named '2011.1~rc1' caused my to have to filter something | 19:49 |
| kbringard | ok, so they have to be a sysadmin to launch instances | 19:49 |
| *** adiantum has joined #openstack | 19:49 | |
| vishy | aye, permissions are listed in nova/api/ec2/__init__.py | 19:49 |
| * jaypipes heads over to #bzr... | 19:49 | |
| vvuksan | kbringard: now you have to document what vishy said | 19:49 |
| kbringard | vvuksan: hehe | 19:50 |
| vvuksan | kbringard: no weaseling out | 19:50 |
| vvuksan | :-P | 19:50 |
| devcamcar | creiht: are you around? | 19:50 |
| creiht | devcamcar: what's up? | 19:50 |
| devcamcar | creiht: howdy! | 19:51 |
| devcamcar | so we're rolling out swift for nebula this week in an alpha state for some users to start playing with, after going through a few experimental installs | 19:51 |
| devcamcar | it's been a few months since I did a roll out, just wanted to sync up with you and find out what i've missed :) | 19:51 |
| creiht | hehe | 19:52 |
| creiht | alright | 19:52 |
| creiht | what version are you installing? | 19:52 |
| devcamcar | we're rolling out 5 zones with 3 machines each | 19:52 |
| devcamcar | whichever one you tell me to | 19:52 |
| creiht | I would highly recommend 1.2 | 19:52 |
| devcamcar | our goal is to create a stable small cluster and then add to it | 19:52 |
| devcamcar | ok | 19:52 |
| *** colinnich has quit IRC | 19:52 | |
| *** colinnich has joined #openstack | 19:53 | |
| devcamcar | i got a bit of a strange mix of capacity, what kind of issues will we have if the zones aren't the same size? | 19:53 |
| creiht | devcamcar: how much of a delta? | 19:53 |
| creiht | We haven't specifically tested zones that have a large variance in capacity | 19:54 |
| *** colinnich_ has quit IRC | 19:54 | |
| *** colinnich has joined #openstack | 19:54 | |
| devcamcar | creiht: my problem is i got dropped on me a mix of 12T and 24T storage blades | 19:55 |
| devcamcar | so i have 7 x 24T and 8 x 12T | 19:55 |
| devcamcar | which isn't ideal | 19:55 |
| creiht | hehe | 19:55 |
| *** kpepple has joined #openstack | 19:56 | |
| creiht | so 2 zones will have 12T more than the others? | 19:56 |
| devcamcar | creiht: yea, thats what it looks like | 19:56 |
| *** kpepple has left #openstack | 19:56 | |
| *** kpepple has joined #openstack | 19:56 | |
| *** adiantum has quit IRC | 19:56 | |
| devcamcar | creiht: we won't be filling those to capacity before we expand though, so i'm not worried about filling it | 19:56 |
| creiht | k, I think you should be alright | 19:56 |
| creiht | Those 2 zones will just have excess capacity that can't really be used until you expand | 19:57 |
| devcamcar | creiht: figured, but can't hurt to ask | 19:57 |
| creiht | yeah | 19:57 |
| *** hggdh has quit IRC | 19:58 | |
| creiht | devcamcar: I need to go fix some power issues real quick, leave you questions here, and I will answer when I get back | 19:58 |
| *** hggdh has joined #openstack | 19:58 | |
| *** reldan has joined #openstack | 19:59 | |
| devcamcar | creiht: that's all i have for now, thanks | 19:59 |
| *** pvo is now known as pvo_away | 19:59 | |
| kbringard | where can I get a list of the role types... I am looking in the nova admin manual, but it doesn't look like those are current | 20:01 |
| *** adiantum has joined #openstack | 20:02 | |
| *** pvo_away is now known as pvo | 20:04 | |
| jaypipes | termie: answer from Robert Collins: "tags are unicode pretty much anything except newlines and 0x00". | 20:04 |
| *** Ryan_Lane|food is now known as Ryan_Lane | 20:05 | |
| kbringard | in the tests I only see "netadmin", "sysadmin", and "cloudadmin" | 20:06 |
| *** littleidea has quit IRC | 20:07 | |
| kpepple | kbringard: i think the allowed_roles flag controls this … it's currently set to ['cloudadmin', 'itsec', 'sysadmin', 'netadmin', 'developer'] in trunk | 20:08 |
| kbringard | kpepple: ah, cool, thanks | 20:08 |
| kpepple | kbringard: i assume you can override this in /etc/nova/nova.conf | 20:09 |
| kbringard | I was looking for the projectadmin role... | 20:09 |
| kbringard | I want a role that can fire up and terminate machines in the project, but doesn't have full access to everything | 20:09 |
| kbringard | kpepple: thanks | 20:11 |
| kpepple | kbringard: hmmm … when you create the project, you name the admin … but not sure what role that actually is | 20:11 |
| kpepple | kbringard: hold on, i'm hacking nova-manage right now | 20:11 |
| *** littleidea has joined #openstack | 20:12 | |
| kbringard | yea... I want to have a project admin, but then I want to create users who can act within that project | 20:12 |
| kbringard | shouldn't the developer role be able to fully manage it's own instances and nothing more? | 20:13 |
| colinnich | creiht: updated proxy to 207 and it looks fixed | 20:14 |
| *** adiantum has quit IRC | 20:15 | |
| openstackhudson | Project swift build #188: SUCCESS in 31 sec: http://hudson.openstack.org/job/swift/188/ | 20:16 |
| openstackhudson | Tarmac: Fix duplicate logging | 20:16 |
| *** rnirmal has quit IRC | 20:18 | |
| *** rnirmal has joined #openstack | 20:19 | |
| *** adiantum has joined #openstack | 20:21 | |
| vvuksan | kpepple: BTW I got everything up and running on RHEL5 including repurposing existing guests | 20:21 |
| *** fabiand_ has quit IRC | 20:22 | |
| creiht | colinnich: awesome, thanks! | 20:22 |
| creiht | colinnich: let me know if you run into any further issues | 20:22 |
| creiht | devcamcar: cool | 20:22 |
| ttx | creiht: got a post-RC fix in ? | 20:23 |
| creiht | yes, it fixes the double logging issue | 20:23 |
| ttx | ok, typically annoying | 20:23 |
| ttx | any reason why we didn't catch this before ? Recent regression ? | 20:24 |
| ttx | creiht: ^ | 20:24 |
| *** rcc has quit IRC | 20:24 | |
| creiht | It was a bug from a pre-gamma fix that wasn't noticed | 20:25 |
| ttx | creiht: ok, thanks for the details | 20:25 |
| ttx | creiht: don't forget to commit the release version number before the end of your day. | 20:25 |
| creiht | We might be able to have a functional test that checks for duplicate logging | 20:25 |
| creiht | oh yeah | 20:26 |
| creiht | forgot we have a 1 day RC | 20:26 |
| ttx | should release tomorrow before you get up. | 20:26 |
| creiht | will do | 20:26 |
| ttx | thanks | 20:27 |
| ttx | creiht: the release notes are OK from your perspective ? | 20:27 |
| creiht | ttx: yeah sent them to the team, and we are good | 20:27 |
| ttx | jaypipes: same question to you for the Glance part | 20:28 |
| jaypipes | ttx: haven't gotten to that yet... I'll edit the wiki page shortly. | 20:31 |
| ttx | ok | 20:31 |
| *** lucasnodine has joined #openstack | 20:33 | |
| *** glenc_ has joined #openstack | 20:33 | |
| *** ciswrk has left #openstack | 20:34 | |
| *** miclorb has quit IRC | 20:35 | |
| *** glenc has quit IRC | 20:35 | |
| *** dubsquared has joined #openstack | 20:36 | |
| *** adiantum has quit IRC | 20:36 | |
| jaypipes | ttx: done: http://wiki.openstack.org/ReleaseNotes/Bexar | 20:41 |
| *** grapex has quit IRC | 20:42 | |
| *** adiantum has joined #openstack | 20:42 | |
| *** hggdh has quit IRC | 20:46 | |
| *** pvo is now known as pvo_away | 20:48 | |
| *** dprince has quit IRC | 20:50 | |
| *** rnirmal has quit IRC | 20:51 | |
| *** reldan has quit IRC | 20:51 | |
| *** dprince has joined #openstack | 20:52 | |
| *** adiantum has quit IRC | 20:53 | |
| *** adiantum has joined #openstack | 20:54 | |
| *** ctennis has joined #openstack | 20:55 | |
| *** ctennis has joined #openstack | 20:55 | |
| *** hub_cap has quit IRC | 20:57 | |
| *** rnirmal has joined #openstack | 20:57 | |
| *** hub_cap has joined #openstack | 20:57 | |
| *** hggdh has joined #openstack | 21:01 | |
| *** dprince has quit IRC | 21:02 | |
| ttx | jaypipes: ok, thanks | 21:06 |
| *** miclorb has joined #openstack | 21:06 | |
| *** pvo_away is now known as pvo | 21:10 | |
| *** omidhdl has left #openstack | 21:12 | |
| *** adiantum has quit IRC | 21:17 | |
| devcamcar | creiht: i'm building our swift deployment using chef this go around. opscode put up openstack recipes awhile ago, but i think they are out of date. if you have a minute can you look at these templates and let me know how out of date they are https://github.com/opscode/openstack-cookbooks/tree/master/cookbooks/swift/templates/default | 21:18 |
| creiht | devcamcar: unfortunately I'm not that familiar with chef, but given that they were committed in July, they are likely quite out of date | 21:21 |
| creiht | yeah, opening one of the config files has the old style config (which was swift 1.0) | 21:21 |
| devcamcar | creiht: yea that was my assumption | 21:21 |
| *** dirakx has quit IRC | 21:22 | |
| *** adiantum has joined #openstack | 21:22 | |
| *** rnirmal_ has joined #openstack | 21:29 | |
| zykes- | anyone here familiar with openvswitch and kvm ? | 21:31 |
| *** ctennis has quit IRC | 21:32 | |
| *** rnirmal has quit IRC | 21:32 | |
| *** rnirmal_ is now known as rnirmal | 21:32 | |
| *** bwalker7125 has joined #openstack | 21:34 | |
| termie | jaypipes: hrm, disappointingish :/ sort of generates an unreconcilable incompatibility between git and bzr | 21:41 |
| *** adiantum has quit IRC | 21:43 | |
| *** rkstager has quit IRC | 21:43 | |
| termie | ttx: is it possible to reset that tag to something without a tilde in it? | 21:47 |
| *** littleidea has quit IRC | 21:47 | |
| termie | ttx: while i can hack the tool to replace tilde with something, it would be easiest if the repo simply used git-compatible names (tilde is the only one that looks like it would ever turn up) | 21:48 |
| jaypipes | ttx: yeah, agreed with termie... tildes in branch names isn't a good idea for compat. | 21:48 |
| *** adiantum has joined #openstack | 21:49 | |
| *** kpepple has left #openstack | 21:49 | |
| jaypipes | termie: though... what tool would you have to hack? just curious... | 21:49 |
| termie | jaypipes: i have git-bzr-ng working well again | 21:50 |
| termie | jaypipes: so i can manage things in git and import/export with bzr | 21:50 |
| termie | jaypipes: greatly improves my workflow | 21:50 |
| termie | jaypipes: but the addition of a tag with tilde in it today made the latest update invalid for git so i had to patch the bzr-fastimport library again | 21:50 |
| termie | and since i just finally yesterday got my bzr-fastimport patches accepted into trunk it is a little disappointing to be foiled by a name choice | 21:51 |
| termie | anything things done to automatically escape invalid characters and de-escape them when pulling them back into bzr are going to be hacks at best | 21:51 |
| *** joe123 has quit IRC | 21:52 | |
| jaypipes | termie: gotcha, understood. | 21:53 |
| termie | ttx: so, in summary, is it possible to roll back and just an underscore? 2011.1_rc1 | 21:54 |
| termie | it will force anybody who has pulled today to grab a new branch, but there aren't any code changes there | 21:56 |
| jaypipes | termie: how about a hyphen instead of underscore? | 21:56 |
| termie | jaypipes: i don't care what it is as long as it is git compatible | 21:57 |
| jaypipes | :) | 21:57 |
| * jaypipes votes for hyphen | 21:57 | |
| termie | jaypipes: usually if somebody uses a tilde it means they are trying to imply something different from a hyphen | 21:57 |
| termie | jaypipes: but i don't see a problem with a hypen | 21:57 |
| jaypipes | termie: agreed. it means "home directory" to me... | 21:57 |
| jaypipes | or "user-related" | 21:57 |
| termie | it means version number outside of actual app versioning to me | 21:58 |
| termie | which is appropriate for this | 21:58 |
| termie | but underscore can be used first | 21:58 |
| termie | and tilde is the secondary outside of app number | 21:58 |
| termie | as in a package version on apt | 21:58 |
| termie | blahblah-2.3_b254~ubuntu1 | 21:59 |
| jaypipes | ah, yes | 21:59 |
| termie | is ttx the appropriate person to be asking about this, anyway? | 21:59 |
| *** kpepple has joined #openstack | 22:00 | |
| termie | who has access to the repo | 22:00 |
| annegentle | jaypipes: do you have access to the /openstack-devel/ Launchpad page, and can I submit my documentation code there? Right now it won't let me - says it isn't set up for that. | 22:01 |
| *** blakeyeager has joined #openstack | 22:02 | |
| termie | ttx: actually, the old releases used a hyphen anyway | 22:02 |
| termie | https://launchpad.net/nova/austin/2010.1-rc2 | 22:02 |
| *** adiantum has quit IRC | 22:03 | |
| jaypipes | annegentle: lemme check | 22:06 |
| jaypipes | termie: soren and ttx, yes | 22:06 |
| jaypipes | termie: ttx may be asleep. (he's in Paris, AFAIK) | 22:06 |
| annegentle | jaypipes: thank you for the help | 22:06 |
| jaypipes | termie: he's also been pretty ill. | 22:06 |
| *** blakeyeager has quit IRC | 22:07 | |
| jarrod | i can figure what to do xen or kvm | 22:07 |
| soren | jaypipes: hm? | 22:07 |
| soren | Oh, the tilde? | 22:08 |
| jaypipes | annegentle: no branch is linked to openstack-devel's trunk... https://launchpad.net/openstack-devel/trunk. I would ask mtaylor what the plan was for that... I'm not sure myself. | 22:08 |
| termie | soren: heya, trying to get the tag 2011.1~rc1 renamed to 2011.1-rc1 in a history rewriting way | 22:08 |
| jaypipes | soren: ya, read back. termie's asking to replace the tilde with a hyphen. I think it's a reasonable request. | 22:08 |
| soren | Uh... Why? | 22:08 |
| termie | soren: the existing names have used hyphens instead of tildes | 22:08 |
| soren | It's totally intentional. | 22:08 |
| soren | termie: Yeah. That was a mistake. | 22:08 |
| annegentle | ah ok. I'll ask him... can I link my branch to its trunk? Or is that a permissions issue that only mtaylor has ability to do? | 22:08 |
| jaypipes | soren: git branch names cannot contain a tilde | 22:08 |
| *** adiantum has joined #openstack | 22:09 | |
| soren | I'm not sure limitations in git should mandate our versioning scheme. | 22:10 |
| termie | soren: i am asking that they do, it is just a simple name | 22:10 |
| soren | Why do you want a branch off an rc anyway? | 22:10 |
| termie | soren: i don't, but i have to import the history | 22:10 |
| termie | soren: and when it attempts to create an invalid name it errors | 22:10 |
| soren | Te tilde was chosen because dpkg sorts foo~ before foo. | 22:11 |
| termie | soren: this is the first invalid name in the history of the project | 22:11 |
| termie | soren: who does it sort _ | 22:11 |
| termie | soren: s/who/how | 22:11 |
| zykes- | how would look into implementing openvswitch in openstack ? | 22:11 |
| soren | termie: Sorry, I don't understand the question. | 22:11 |
| soren | termie: Well,I think I do, but I also think I just answered it, so I must have misunderstood the question. | 22:11 |
| termie | soren: does dpkg sort foo_ before foo. ? | 22:11 |
| jaypipes | annegentle: that's something you'll have to ask mtaylor. Typically, it is a team that owns the trunk branch (or Hudson owns it). I don't know what the intentions were in the case of openstack-devel | 22:12 |
| soren | termie: underscores have very special meaning in dpkg. | 22:12 |
| termie | soren: or foo- before foo. | 22:12 |
| annegentle | jaypipes: ok, got it. Thanks! | 22:12 |
| soren | termie: No. | 22:12 |
| mtaylor | annegentle: I wasn't sure what was going to go in there | 22:12 |
| soren | termie: Or... wait. | 22:12 |
| soren | termie: no. | 22:13 |
| jaypipes | zykes-: Step one: Read http://wiki.openstack.org/NetworkService :) | 22:13 |
| soren | termie: The goal is to make the rc version sort as older than the final version. | 22:13 |
| soren | termie: Only the tilde has that property. | 22:13 |
| notmyname | for swift we decided on 1.2-rc and 1.2.0 (for final) | 22:13 |
| mtaylor | annegentle: feel free to link your branch to it | 22:13 |
| bwalker7125 | is there a simple command in swift to see how much storage space is remaining (free) in the cluster, or would that have to be calculated by a custom program? | 22:13 |
| notmyname | - < . | 22:13 |
| zykes- | jaypipes: more thinking of that libvirt doesn't support it | 22:13 |
| termie | soren: that can be managed in packaging, too | 22:13 |
| termie | soren: rather than in the branch tag name | 22:14 |
| termie | soren: since it is a packaging specific issue | 22:14 |
| soren | termie: vs. a git specific issue. | 22:14 |
| notmyname | bwalker7125: we use dsh and df | 22:14 |
| termie | soren: vs a core developer specific issue | 22:14 |
| bwalker7125 | ok, thanks | 22:14 |
| soren | termie: Sorry, why can't you work around this? | 22:15 |
| creiht | lol | 22:15 |
| soren | Well, one of us have to. | 22:15 |
| termie | soren: i told you what my issue is, you are choosing a simple name | 22:15 |
| soren | Apparently. | 22:15 |
| jaypipes | zykes-: I'm no networking expert, I just know that OpenVSwitch has been discussed in relation to that spec/blueprint. vishy may have some insight on it, or you could email the mailing list. should get some quick feedback. | 22:15 |
| termie | soren: the name can be easily changed | 22:15 |
| soren | termie: Ok, so one of us have to do some rewriting somewhere. | 22:15 |
| soren | That I understand. | 22:16 |
| uvirtbot | New bug: #712147 in swift "logging doesn't support differing log_levels for the same log_name" [Low,In progress] https://launchpad.net/bugs/712147 | 22:16 |
| soren | I'm not sure why it necessarily can't be you. | 22:16 |
| *** burris has joined #openstack | 22:16 | |
| termie | i am not asking you to patch dpkg | 22:16 |
| creiht | ~ seems like an odd character to use in a release name | 22:17 |
| soren | I'm not asking you to patch git.. i think. | 22:17 |
| soren | Am I? | 22:17 |
| * creiht shrugs | 22:17 | |
| *** adiantum has quit IRC | 22:17 | |
| termie | you are asking me to patch a variety of libraries that deal with bzr and git | 22:17 |
| soren | I'm cool patching, dpkg, though. I used to maintain the bloody thing in Ubuntu :) | 22:17 |
| creiht | why can't you guys find a reasonable name that works with both, and nobody has to patch anything? | 22:18 |
| soren | I can explain that. | 22:18 |
| *** adiantum has joined #openstack | 22:18 | |
| termie | creiht: that is all i am asking for | 22:18 |
| jaypipes | creiht: I think that's what termie's asking for ;) | 22:18 |
| jaypipes | ah, jinx. | 22:18 |
| creiht | I agree, just stating the obvious to show how silly soren's argument is :) | 22:18 |
| soren | We want the final version to sort as newer than the rc version. Assuming that the rc version is made up of the final version+some suffix, the first character of suffix must sort as newer than the emptry string. The only character in the whole wide world that has that property is the tilde. | 22:19 |
| notmyname | but that's a packaging issue, right? how does that affect the branch names? | 22:20 |
| gholt | } | { | 22:20 |
| gholt | ;P | 22:20 |
| soren | gholt: hm? | 22:20 |
| soren | notmyname: I'm not sure how branch names fit into this at all. | 22:21 |
| mtaylor | soren, notmyname: it's not branch names in bzr - it's tags | 22:21 |
| mtaylor | we tag releases with their version | 22:21 |
| gholt | I guess it depends on your sorting algorithm. Maybe collate = soren? | 22:21 |
| creiht | so how about 2011.1-rc and 2011.1.0? or something like that | 22:21 |
| mtaylor | that ^^^ does sort properly | 22:21 |
| soren | gholt: Sorry, the assumption was dpkg's sorting algorithm. | 22:21 |
| soren | mtaylor: What does? | 22:22 |
| mtaylor | soren: .0 sorts newer than -rc | 22:22 |
| mtaylor | dpkg --compare-versions 1.2-rc lt 1.2.0 | 22:22 |
| gholt | Isn't ~ normally used for local patches? | 22:22 |
| soren | gholt: No. | 22:22 |
| soren | gholt: Well, yes. | 22:22 |
| gholt | Ah, I'm a packaging newb, so, heh. | 22:22 |
| soren | gholt: Because you usually want those to have this property. | 22:23 |
| jaypipes | this conversation brought to you by the letter ~ and the number #. | 22:23 |
| soren | gholt: So it's not made for that specific purpose, but for that specific purpose, it's usually what you want to use. | 22:23 |
| gholt | Hehe | 22:23 |
| soren | mtaylor: Uh. No. | 22:23 |
| kbringard | did bundling an entire image, kernel, ramdisk, and all end up making it into bexar? | 22:23 |
| mtaylor | soren, termie: perhaps we should see what git-buildpackage does to deal with debian packages with ~ in it | 22:23 |
| mtaylor | soren: no? | 22:23 |
| soren | mtaylor: uh, sorry. | 22:23 |
| sirp- | *shakes fist at sqlalchemy-migrate* | 22:24 |
| soren | mtaylor: You're right. | 22:24 |
| termie | mtaylor: i don't think git-buildpackage would really apply, the tilde is a packaging issue, not a branch name issue, i would doubt that git-buildpackage would attempt to make a new tag named after the released package | 22:25 |
| soren | I would totally expect it to. | 22:25 |
| soren | The other blah-buildpackage do, I believe. | 22:25 |
| termie | soren: they change yoru source repo? | 22:26 |
| *** adiantum has quit IRC | 22:26 | |
| termie | regardless it seems like we have a working suggestion from mtaylor | 22:26 |
| jaypipes | kbringard: for EC2 API or OpenStack API? In Nova, or just in Glance? | 22:26 |
| soren | I suggesed the .0 extenstion long ago. At the release meeting where we decided on the versioning scheme, I believe. | 22:26 |
| jaypipes | sirp-: oh, did my "useless test" uncover something? ;P | 22:26 |
| soren | I forget why it was rejected. | 22:27 |
| soren | Man, I type like crap on this laggy connection. | 22:27 |
| *** baldben has joined #openstack | 22:27 | |
| * soren looks through meeting logs | 22:28 | |
| kbringard | jaypipes: ec2 | 22:28 |
| *** hub_cap has quit IRC | 22:29 | |
| *** bcherian has quit IRC | 22:30 | |
| sirp- | jaypipes: oh it uncovered something, the pit-of-despair that is migrate :P | 22:30 |
| jaypipes | kbringard: no. still have to do the euca2ools method of creating the kernel, ramdisk, then bundling the machine image and using euca-bundle-image, which talks to nova-objectstore under the covers. | 22:31 |
| jaypipes | sirp-: ha! :) | 22:31 |
| termie | sirp-: agreed on despair, but what is the problem? | 22:31 |
| kbringard | jaypipes: cool, thanks :-) | 22:31 |
| sirp- | termie: migrate doesn't seem to be playing nicely with db-indexes, it wants to recreate them erroneously which causes an OperationalError | 22:31 |
| *** kpepple_ has joined #openstack | 22:31 | |
| termie | sirp-: when migrating austin->bexar? | 22:32 |
| termie | sirp-: or from scratch | 22:32 |
| sirp- | termie: this is migrations for glance (just added) | 22:32 |
| *** adiantum has joined #openstack | 22:32 | |
| termie | sirp-: ah i see | 22:32 |
| *** kpepple_ has quit IRC | 22:32 | |
| sirp- | termie: i'm running a test that jaypipes suggested where i downgrade and them immediately re-upgrade | 22:32 |
| sirp- | it should work, but just happens not to | 22:33 |
| * jaypipes couldn't think of a better/smarter test :( | 22:33 | |
| sirp- | if i remove the index from the column, all is well :| | 22:33 |
| pvo | jaypipes: do you know then the bps are getting cut off? is it 12:00 on the 4th? | 22:33 |
| termie | sirp-: i don't necessarily expect downgrade to work | 22:33 |
| termie | sirp-, jaypipes: is the migrate stuff modelled after nova's migrate? | 22:33 |
| sirp- | termie: it's similar, but i tweaked some small things | 22:34 |
| termie | soren: any luck on the meeting logs? would it be an irc meeting | 22:34 |
| sirp- | termie: https://code.launchpad.net/~rconradharris/glance/registry_db_migration/+merge/48273 | 22:35 |
| jaypipes | termie: yes, almost identical to nova's | 22:35 |
| *** kbringard has quit IRC | 22:36 | |
| jaypipes | pvo: ? no idea. I would assume midnight on the 4th, UTC? | 22:36 |
| pvo | k, thats what I thought too | 22:36 |
| soren | termie: I thought it was, but perhaps not. | 22:36 |
| sirp- | *might be spoiled by rails migrations, which Just Work* | 22:36 |
| soren | termie: Well, it was on IRC for sure, but perhaps not in #openstack-meeting. | 22:36 |
| *** kpepple_ has joined #openstack | 22:37 | |
| soren | termie: Can you help me understand what exactly breaks because of this? | 22:37 |
| termie | soren: when i import a bzr repository, some of the history can't be played because one command attempts to create an invalid tag name | 22:37 |
| *** grapex has joined #openstack | 22:38 | |
| kpepple | sirp- : i hear you on the rails migrations … struggled with sqlalchemy-migration last night | 22:38 |
| soren | termie: What do you use to "import a bzr repository"? How does that work? | 22:38 |
| termie | bzr-fast-export into git-fast-import | 22:38 |
| dabo | heading out a little early tonight. Besides the lab being down, I have to go to a wake (my wife's cousin-in-law's mother or something like that - never met the woman) | 22:39 |
| sirp- | kpepple: yeah, wish there were some better tutorials out there, hard to figure out what the best-practices are | 22:39 |
| *** kpepple_ has quit IRC | 22:39 | |
| *** kpepple_ has joined #openstack | 22:40 | |
| *** adiantum has quit IRC | 22:40 | |
| *** kpepple_ has quit IRC | 22:41 | |
| soren | termie: Would it be terribly complicated to change the tag name in flight in that pipeline? | 22:41 |
| soren | termie: I don't know the fast-export format. | 22:41 |
| *** hazmat has quit IRC | 22:41 | |
| *** hazmat has joined #openstack | 22:41 | |
| * soren is still digging through logs.. | 22:41 | |
| termie | soren: if i change the name my history is different | 22:42 |
| termie | soren: the amount that that affects things is somewhat unknown as to the future | 22:43 |
| termie | however, changing the name to a compatible name | 22:43 |
| termie | would solve all of this, and would not require patching third-party libraries | 22:43 |
| *** vvuksan has quit IRC | 22:43 | |
| soren | Right. | 22:44 |
| termie | i have to go to a meeting | 22:44 |
| soren | Well, I wasn't thinking you'd patch bzr fast-export, just add a bit of sed or something to the pipeline. | 22:44 |
| soren | but meh. | 22:44 |
| termie | so, please consider mtaylor's suggestion | 22:44 |
| termie | and i'll be back in a bit | 22:44 |
| soren | Hey, I'm not the one who needs convincing. I like it. | 22:44 |
| soren | I can't find anything in my logs. | 22:45 |
| *** adiantum has joined #openstack | 22:46 | |
| soren | Weird. I specifically remember a stack of ideas for versioning being thrown around and then finally settling on YYYY.X (specifically rejecting YYYY.X.X). | 22:46 |
| soren | My grep-fu is failing me. | 22:46 |
| soren | Well, or I don't have logs of it, but that sounds even stranger to me. | 22:47 |
| *** kpepple has left #openstack | 22:47 | |
| * soren has a *lot* of IRC logs. | 22:47 | |
| pvo | my logs would be full too if irc was my "office" : ) | 22:48 |
| * soren has probably a couple of GB of irc logs | 22:48 | |
| *** konetzed_ has joined #openstack | 22:48 | |
| soren | pvo: Yeah. It's pretty neat that you can keep a log of everything that goes on in your office :) | 22:49 |
| *** konetzed_ is now known as koko | 22:49 | |
| pvo | methinks that could be good and bad. | 22:49 |
| *** koko is now known as Guest64962 | 22:49 | |
| sirp- | jaypipes: i think i have migrate figured out now; moral: do NOT use the autogenerated scripts, full of bad-practices (module-wide meta, import *, etc) | 22:49 |
| sirp- | the module-wide meta burned me (how exactly still a little unclear on) | 22:50 |
| *** imsplitbit has quit IRC | 22:51 | |
| *** Guest64962 has left #openstack | 22:51 | |
| jaypipes | sirp-: good to know :) | 22:51 |
| *** kpepple has joined #openstack | 22:51 | |
| *** dirakx has joined #openstack | 22:58 | |
| creiht | ttx: version update is in trunk | 22:59 |
| *** ctennis has joined #openstack | 23:00 | |
| *** kpepple has left #openstack | 23:00 | |
| *** colinnich has quit IRC | 23:01 | |
| *** adiantum has quit IRC | 23:01 | |
| *** colinnich has joined #openstack | 23:01 | |
| openstackhudson | Project swift build #189: SUCCESS in 32 sec: http://hudson.openstack.org/job/swift/189/ | 23:01 |
| openstackhudson | Tarmac: Bumping version to 1.2.0 in preparation for release | 23:01 |
| *** kpepple has joined #openstack | 23:03 | |
| kpepple | sirp-: have you found a way around this "AttributeError: 'module' object has no attribute 'MigrateDeprecationWarning'" error in sqlalchemy-migrate ? it seems to just be a bug in the version we are using … but can't figure out how to get away from it (i'm prepopulating the db with some custom SQL in my migration). | 23:03 |
| sirp- | kpepple: you're getting this error in nova? | 23:04 |
| kpepple | sirp-: in my branch, i've written a new migration (to add instance_types table) and i get it ... | 23:05 |
| sirp- | kpepple: i ran into a simillar issue once or twice; the way i got around it, was i figured out what was causing the deprecation warning and then fixed that | 23:05 |
| *** dendro-afk is now known as dendrobates | 23:06 | |
| *** adiantum has joined #openstack | 23:06 | |
| kpepple | sirp-: i know what's causing it (custom sql query) … but not sure how to get "undeprecated" … the docs are a bit unclear on some of this | 23:07 |
| sirp- | kpeppe: agreed, the docs have been very little help | 23:09 |
| kpepple | sirp-: i'll keep plugging away … i'm pretty close … just need to prepopulate a few ec2 types and it'll be done | 23:09 |
| *** kpepple has left #openstack | 23:10 | |
| *** bcherian has joined #openstack | 23:11 | |
| *** adiantum has quit IRC | 23:12 | |
| sirp- | ha, can't use normal import on migrations since they begin with a number (effin' thing sucks) | 23:12 |
| *** adiantum has joined #openstack | 23:13 | |
| *** baldben has quit IRC | 23:14 | |
| *** abecc has quit IRC | 23:16 | |
| *** abecc has joined #openstack | 23:17 | |
| *** kpepple has joined #openstack | 23:21 | |
| *** baldben has joined #openstack | 23:30 | |
| *** bcherian has quit IRC | 23:33 | |
| *** Isvara has left #openstack | 23:37 | |
| *** reldan has joined #openstack | 23:37 | |
| *** gondoi_ has joined #openstack | 23:45 | |
| *** dubsquared has left #openstack | 23:46 | |
| *** blakeyeager has joined #openstack | 23:46 | |
| *** reldan has quit IRC | 23:48 | |
| *** gondoi has quit IRC | 23:48 | |
| *** gondoi_ is now known as gondoi | 23:48 | |
| *** reldan has joined #openstack | 23:51 | |
| *** opengeard has quit IRC | 23:57 | |
| *** troytoman has quit IRC | 23:57 | |
| *** konetzed has joined #openstack | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
