| *** joearnold has quit IRC | 00:03 | |
| openfly | yeah | 00:04 |
|---|---|---|
| openfly | matches to the ip in nova.conf in hosts | 00:04 |
| *** joearnold has joined #openstack | 00:05 | |
| *** siebrand has left #openstack | 00:07 | |
| kpepple | openfly: is your machine connected to the internet ? | 00:08 |
| kpepple | openfly: | 00:08 |
| *** j05h has quit IRC | 00:09 | |
| kpepple | openfly: for some reason, it's querying networks for something similar to "select * from networks WHERE deleted = False AND host = barad-dur" but your networks table entry has a NULL for the hosts ... | 00:10 |
| openfly | yeah | 00:11 |
| openfly | it's on the internet | 00:11 |
| openfly | natted though | 00:11 |
| openfly | not using FQDN | 00:12 |
| openfly | maybe that's the issue. | 00:12 |
| kpepple | openfly: hold on, checking code on the nova-manage network create ... | 00:13 |
| *** kashyapc_ has quit IRC | 00:14 | |
| *** jbaker_ has quit IRC | 00:14 | |
| *** kashyapc_ has joined #openstack | 00:14 | |
| *** MarkAtwood has joined #openstack | 00:15 | |
| *** ccustine has quit IRC | 00:16 | |
| kpepple | openfly: what command did you use to start nova-network ? what did the logfile include above what you posted -- there is usually a dump of flags when it first starts. we are looking for the sql_connection flag to make sure it is using mysql and not sqlite | 00:17 |
| openfly | in nova-network log? | 00:17 |
| openfly | or nova-compute / api | 00:17 |
| *** desai has joined #openstack | 00:17 | |
| kpepple | openfly: yes, in nova-network log ... it looks like the nova-compute and nova-api ... | 00:19 |
| openfly | gonna have to wait | 00:19 |
| openfly | i've accidently knocked myself out of that box for the next couple hours | 00:19 |
| *** aimon has joined #openstack | 00:20 | |
| kpepple | okay ... you should be starting nova-network with the "--flagfile=/etc/nova/nova.conf" option to make sure it looks for your flag file | 00:20 |
| kpepple | openfly: if you don't, it will default to sqlite3 | 00:20 |
| openfly | kpepple where is that set? | 00:21 |
| *** jbaker_ has joined #openstack | 00:21 | |
| kpepple | openfly: in /etc/nova/nova.conf, it's your --sql_connection flag -- which is set in the nova.conf file that you posted. however, you have to make sure and point each of the nova-* workers at the same nova.conf file to make sure they are all querying the same database | 00:22 |
| openfly | okay | 00:23 |
| openfly | how? | 00:23 |
| openfly | is there an example somewhere? | 00:23 |
| *** pcoca has quit IRC | 00:23 | |
| openfly | like just put it in /etc/nova/nova-network.conf ? | 00:23 |
| openfly | and i'm good? | 00:24 |
| kpepple | openfly: no, you should have one nova.conf file and point all your nova-* workers (nova-compute, nova-network, nova-scheduler, etc.) and that same file by adding "--flagfile=/etc/nova/nova.conf" to each of their startup commands. you can check and make sure that they are using the right conf file by looking in their log files as they dump their flags when they startup. | 00:25 |
| openfly | okay | 00:26 |
| *** msassak has quit IRC | 00:28 | |
| *** kashyapc_ has quit IRC | 00:34 | |
| *** aimon_ has joined #openstack | 00:40 | |
| *** clauden_ has quit IRC | 00:41 | |
| *** jbaker_ has quit IRC | 00:42 | |
| *** aimon has quit IRC | 00:42 | |
| *** zul has quit IRC | 00:46 | |
| *** evtoews has joined #openstack | 00:46 | |
| *** diegoparrilla has quit IRC | 00:47 | |
| desai | are availability zones used for anything at this point? | 00:58 |
| sirp_ | justinsb: i must have missed the merge-prop related to http://bazaar.launchpad.net/~hudson-openstack/nova/trunk/revision/677 - i'm a tad worried by it since deep within eventlet it clears exceptions by calling sys.clear_exc; this means that a 'raise' with no args can fail | 00:58 |
| *** eikke has quit IRC | 00:59 | |
| sirp_ | justinsb: i've run into this before, so i just wanted to raise that issue; may not necessarily be a problem this time around | 01:00 |
| *** kashyapc has joined #openstack | 01:03 | |
| *** aimon has joined #openstack | 01:05 | |
| *** jaypipes has quit IRC | 01:06 | |
| *** desai has quit IRC | 01:09 | |
| *** desai has joined #openstack | 01:09 | |
| *** jaypipes has joined #openstack | 01:10 | |
| *** dirakx has joined #openstack | 01:10 | |
| *** littleidea has joined #openstack | 01:17 | |
| *** aimon_ has joined #openstack | 01:20 | |
| *** aimon has quit IRC | 01:22 | |
| *** aimon_ is now known as aimon | 01:22 | |
| *** RJD22 is now known as RJD22|away | 01:29 | |
| *** clauden_ has joined #openstack | 01:38 | |
| justinsb | sirp_: termie raised that bug. He seemed to think it was OK. What's the right thing to do here so we don't lose the stack trace? The 3-arg "raise" form? | 01:44 |
| *** pvo has joined #openstack | 01:45 | |
| sirp_ | justinsb: i had solved it with just 'raise e' in my case; but i think you're right, 3-arg raise might be the way to go | 01:45 |
| *** dendro-afk is now known as dendrobates | 01:47 | |
| justinsb | sirp_: The problem with raise e is that it swallows the inner exception; I don't really know python that well so didn't really grok what the 3 args should be though :-) | 01:49 |
| sirp_ | justinsb: yeah, that hadn't occurred to me until now; yeah reading http://docs.python.org/release/2.5.2/ref/raise.html seems to indicate we should use 3-arg, and use a tb object | 01:52 |
| *** jheiss has quit IRC | 01:53 | |
| *** RJD22|away is now known as RJD22 | 01:54 | |
| *** pvo has quit IRC | 01:54 | |
| *** zul has joined #openstack | 01:55 | |
| justinsb | sirp_: I'm about to log off for the night, but if you tell me what the syntax should be I can revise the patch. Is an exception a 'traceback object'? Do you know of any examples of how to do this stuff? | 01:56 |
| sirp_ | justinsb: not sure offhand, but ill look into it tonight, we can catch up on this tomorrow morn :) | 01:57 |
| *** joearnold has quit IRC | 02:00 | |
| *** jheiss has joined #openstack | 02:01 | |
| *** joearnold has joined #openstack | 02:06 | |
| *** ryker has quit IRC | 02:06 | |
| *** dendrobates is now known as dendro-afk | 02:11 | |
| *** vbn has joined #openstack | 02:13 | |
| *** vbn has quit IRC | 02:16 | |
| *** dendro-afk is now known as dendrobates | 02:26 | |
| *** dragondm has quit IRC | 02:27 | |
| *** pvo has joined #openstack | 02:32 | |
| *** clauden_ has quit IRC | 02:33 | |
| *** Xenith_ is now known as Xenith | 02:36 | |
| *** mray has joined #openstack | 02:37 | |
| *** pvo has quit IRC | 02:45 | |
| *** fcarsten has quit IRC | 02:54 | |
| *** nati has joined #openstack | 02:55 | |
| *** aimon has quit IRC | 03:04 | |
| *** aimon has joined #openstack | 03:05 | |
| *** nati has quit IRC | 03:11 | |
| *** MarkAtwood has quit IRC | 03:14 | |
| *** jheiss has quit IRC | 03:26 | |
| *** freeflying has quit IRC | 03:27 | |
| *** jheiss has joined #openstack | 03:28 | |
| *** freeflying has joined #openstack | 03:28 | |
| *** jheiss_ has joined #openstack | 03:31 | |
| *** jheiss has quit IRC | 03:32 | |
| *** jheiss_ is now known as jheiss | 03:32 | |
| *** jheiss has joined #openstack | 03:33 | |
| *** hadrian has quit IRC | 03:36 | |
| *** anticw has quit IRC | 03:38 | |
| *** anticw has joined #openstack | 03:38 | |
| uvirtbot | New bug: #719765 in nova "Network Worker crashes on start with Eventlet Error" [Undecided,New] https://launchpad.net/bugs/719765 | 03:47 |
| *** aimon has quit IRC | 03:53 | |
| *** jk0 has joined #openstack | 03:53 | |
| *** jk0 has joined #openstack | 03:53 | |
| *** ChanServ sets mode: +v jk0 | 03:53 | |
| *** aimon has joined #openstack | 03:53 | |
| *** desai has quit IRC | 03:54 | |
| *** miclorb_ has quit IRC | 03:54 | |
| *** aimon has quit IRC | 03:57 | |
| *** aimon has joined #openstack | 03:57 | |
| *** aimon_ has joined #openstack | 03:58 | |
| *** aimon has quit IRC | 04:01 | |
| *** aimon_ is now known as aimon | 04:01 | |
| *** jheiss has quit IRC | 04:03 | |
| *** vvuksan has quit IRC | 04:07 | |
| *** maplebed has quit IRC | 04:13 | |
| *** jheiss has joined #openstack | 04:15 | |
| *** jheiss has quit IRC | 04:16 | |
| *** jheiss has joined #openstack | 04:17 | |
| *** miclorb has joined #openstack | 04:19 | |
| *** pvo has joined #openstack | 04:24 | |
| *** Gh0sty has quit IRC | 04:26 | |
| *** jheiss has quit IRC | 04:26 | |
| *** jheiss has joined #openstack | 04:27 | |
| *** miclorb has quit IRC | 04:27 | |
| *** Gh0sty has joined #openstack | 04:27 | |
| *** jbaker_ has joined #openstack | 04:37 | |
| *** jbaker__ has joined #openstack | 04:38 | |
| *** jbaker_ has quit IRC | 04:38 | |
| *** jheiss_ has joined #openstack | 04:41 | |
| *** jheiss has quit IRC | 04:41 | |
| *** jheiss_ is now known as jheiss | 04:41 | |
| *** omidhdl has joined #openstack | 04:47 | |
| *** miclorb_ has joined #openstack | 04:48 | |
| dsockwell | does there exist a puppet recipe for installing openstack on debian squeeze? | 04:57 |
| *** kashyapc has quit IRC | 05:00 | |
| *** MarkAtwood has joined #openstack | 05:09 | |
| *** jtran has quit IRC | 05:13 | |
| *** ichristo has joined #openstack | 05:18 | |
| *** kashyapc has joined #openstack | 05:20 | |
| *** sebastianstadil has joined #openstack | 05:20 | |
| uvirtbot | New bug: #719798 in nova "Instance fails to access metadata server" [Undecided,New] https://launchpad.net/bugs/719798 | 05:21 |
| *** jheiss has quit IRC | 05:21 | |
| *** jheiss has joined #openstack | 05:25 | |
| *** jheiss has quit IRC | 05:27 | |
| *** aimon has quit IRC | 05:28 | |
| *** jheiss has joined #openstack | 05:33 | |
| *** miclorb_ has quit IRC | 05:37 | |
| *** miclorb_ has joined #openstack | 05:39 | |
| *** littleidea has quit IRC | 05:40 | |
| *** f4m8_ is now known as f4m8 | 05:42 | |
| *** miclorb_ has quit IRC | 05:45 | |
| *** dirakx has quit IRC | 05:45 | |
| *** nati has joined #openstack | 05:47 | |
| *** dirakx has joined #openstack | 05:52 | |
| *** pvo has quit IRC | 05:54 | |
| *** jheiss has quit IRC | 06:00 | |
| *** mark is now known as mark|coffee | 06:01 | |
| nati | The bexer version with mysql is working? I faild to launch instance | 06:01 |
| nati | I got (nova.root): TRACE: InstanceNotFound: Instance 2 not found | 06:02 |
| nati | This is same for trunk. | 06:02 |
| *** jheiss has joined #openstack | 06:07 | |
| kpepple | nati: are you having problems with nova-networking ? | 06:26 |
| nati | kpeople: no nova-compute fails | 06:27 |
| kpepple | nati: does the instance stick in the "networking" state ? that is what i am seeing | 06:28 |
| nati | kpeople: It looks no database entry created, before "networking" state. | 06:28 |
| nati | I checked instances table, but nothing in there. | 06:29 |
| kpepple | nati: hmmm ... how does nova-compute fail in the logs ? | 06:30 |
| nati | kpeople: instance is "scheduling" state | 06:30 |
| nati | I could find no other error logs. X: | 06:30 |
| kpepple | nati: when i have "scheduling" state problems, most of the time it has something to do with KVM/Xen not working | 06:31 |
| nati | kpeople: KVM with SQLLite works well. | 06:32 |
| *** kashyapc has quit IRC | 06:32 | |
| nati | kpeople: Thank you for your help! I'm looking forward to debug. :) | 06:34 |
| kpepple | nati: sorry i couldn't be of more help :) | 06:34 |
| *** DigitalFlux has joined #openstack | 06:37 | |
| *** mark|coffee is now known as mark | 06:37 | |
| *** kashyapc has joined #openstack | 06:44 | |
| uvirtbot | New bug: #719825 in glance "POST /images should return 201 on success" [Low,Confirmed] https://launchpad.net/bugs/719825 | 06:56 |
| *** littleidea has joined #openstack | 06:56 | |
| *** westmaas_away has quit IRC | 07:13 | |
| *** ramkrsna has joined #openstack | 07:20 | |
| *** ramkrsna has joined #openstack | 07:20 | |
| *** guigui has joined #openstack | 07:20 | |
| *** Cybo has joined #openstack | 07:25 | |
| *** littleidea has quit IRC | 07:26 | |
| *** rchavik has joined #openstack | 07:29 | |
| *** thimble has joined #openstack | 07:29 | |
| *** thimble has left #openstack | 07:29 | |
| uvirtbot | New bug: #719834 in glance "sqlalchemy-migrate ImportError" [High,In progress] https://launchpad.net/bugs/719834 | 07:31 |
| *** aimon has joined #openstack | 07:42 | |
| *** thimble has joined #openstack | 07:43 | |
| *** berendt has joined #openstack | 07:46 | |
| alekibango | nati: please look into logs, there must be more info somewhere... some errors | 07:52 |
| nati | alekibango: Yes Thank you! | 07:53 |
| *** gaveen has joined #openstack | 08:06 | |
| *** gaveen has joined #openstack | 08:06 | |
| *** MarkAtwood has quit IRC | 08:11 | |
| *** winston-d has quit IRC | 08:17 | |
| openstackhudson | Project nova build #519: SUCCESS in 1 min 31 sec: http://hudson.openstack.org/job/nova/519/ | 08:22 |
| openstackhudson | Tarmac: This branch should resolve nova bug #718675 (https://bugs.launchpad.net/nova/+bug/718675). | 08:22 |
| uvirtbot | Launchpad bug 718675 in nova "Can't create db with PostgreSQL backend" [Medium,Fix committed] https://launchpad.net/bugs/718675 | 08:22 |
| openstackhudson | Also added dropping of tables in case of failures so `nova-manage sync db` will can restart next time. | 08:22 |
| uvirtbot | Launchpad bug 718675 in nova "Can't create db with PostgreSQL backend" [Medium,Fix committed] | 08:22 |
| *** CloudChris has joined #openstack | 08:26 | |
| soren | jaypipes: Oh, you're still here? | 08:29 |
| soren | jaypipes: I addressed your comment on https://code.launchpad.net/~soren/nova/logdir/+merge/49722 if you care to take a peek. | 08:29 |
| jaypipes | soren: ya | 08:34 |
| jaypipes | soren: can't sleep... | 08:34 |
| soren | jaypipes: :( | 08:35 |
| *** Nacx has joined #openstack | 08:36 | |
| jaypipes | soren: approved. :) | 08:37 |
| * ttx wonders how many times we'll fix one by breaking the other : https://code.launchpad.net/~dan-prince/nova/bug719093/+merge/49746 | 08:39 | |
| *** calavera has joined #openstack | 08:44 | |
| *** ramkrsna has quit IRC | 08:44 | |
| *** allsystemsarego has joined #openstack | 08:54 | |
| *** allsystemsarego has joined #openstack | 08:54 | |
| *** drico has joined #openstack | 08:54 | |
| *** Cybo has quit IRC | 08:56 | |
| jaypipes | soren: unittest2 issue? https://code.launchpad.net/~soren/nova/logdir/+merge/49722 | 08:57 |
| soren | jaypipes: Weird. | 08:57 |
| soren | jaypipes: Yeah, maybe. | 08:57 |
| *** aimon has quit IRC | 08:59 | |
| soren | jaypipes: Ah, assertIsNone is new in Python 2.7. | 09:00 |
| *** ramkrsna has joined #openstack | 09:00 | |
| *** ramkrsna has joined #openstack | 09:00 | |
| * soren fixes | 09:00 | |
| *** omidhdl has left #openstack | 09:07 | |
| *** aimon has joined #openstack | 09:08 | |
| *** aimon_ has joined #openstack | 09:11 | |
| ttx | jaypipes: still around ? | 09:13 |
| *** aimon has quit IRC | 09:14 | |
| *** aimon_ is now known as aimon | 09:14 | |
| ttx | ok, good :) | 09:14 |
| *** sateesh has joined #openstack | 09:18 | |
| *** sateesh is now known as bird | 09:18 | |
| jaypipes | ttx: yup | 09:18 |
| DigitalFlux | Oh, the cloudservers command has been renamed to novatools :-) | 09:20 |
| DigitalFlux | I hope i can find more new stuff/fixes with this push :) | 09:21 |
| DigitalFlux | OK first change, the generated novarc file in Bexar doesn't work | 09:22 |
| DigitalFlux | the env vars names have also been changed | 09:22 |
| soren | jaypipes: Oh, in that case, could you re-approve https://code.launchpad.net/~soren/nova/logdir/+merge/49722 ? I fixed the 2.7-ism. | 09:24 |
| ttx | jaypipes: a number of glance specs are "pending approval" with me set as approver. Do you want me to look at them and approve their design ? | 09:25 |
| jaypipes | ttx: yes, please :) | 09:27 |
| ttx | ok :) | 09:27 |
| *** irahgel has joined #openstack | 09:28 | |
| jaypipes | soren: done | 09:30 |
| soren | \o/ | 09:30 |
| soren | We need more core-devs in this timezone. | 09:30 |
| soren | Or more insomniacs in "the other" timezone. | 09:31 |
| *** gaveen has quit IRC | 09:31 | |
| *** eikke has joined #openstack | 09:32 | |
| soren | zul: What do we need python-paramiko for? | 09:33 |
| ttx | soren: so that you can review it, I proposed for merging the adminclient split on the ubuntu packaging | 09:34 |
| soren | ttx: Just now? | 09:36 |
| DigitalFlux | :( | 09:36 |
| soren | ttx: Link to the bmp? | 09:36 |
| DigitalFlux | What's up with this error -> "novatools.exceptions.OpenStackException: list index out of range (HTTP 500)" ? | 09:37 |
| DigitalFlux | I can almost do everything with novatools | 09:37 |
| DigitalFlux | But not launch an instance ! | 09:37 |
| ttx | soren: yesterday | 09:37 |
| ttx | https://code.launchpad.net/~ttx/ubuntu/natty/nova/adminclient/+merge/49837 | 09:37 |
| jaypipes | soren: hehe, ++ on insomniacs, eh? ;) | 09:38 |
| DigitalFlux | on a side note, good to know that ttx is working on the adminclient ;) | 09:38 |
| ttx | DigitalFlux: you should try to corner sandywalsh about that error, he is da novatools master | 09:39 |
| soren | ttx: Ta. | 09:40 |
| DigitalFlux | ttx: Great, will do, Thanks | 09:40 |
| DigitalFlux | IRC needs a "timezone" field :/ | 09:42 |
| *** MarcMorata has joined #openstack | 09:42 | |
| *** gaveen has joined #openstack | 09:43 | |
| jaypipes | soren: bitten by pep8. | 09:44 |
| soren | That makes no sense. | 09:44 |
| soren | I copied the style from somewhere else. | 09:44 |
| soren | And I thought run_tests.sh would run pep8? I fixed that a while ago. | 09:45 |
| soren | Oh. Not if you're passing extra args to nose... which I always do. | 09:46 |
| soren | (I always pass -x) | 09:47 |
| soren | ttx: adminclient stuff looks great. Merged and pushed. Thanks! | 09:56 |
| ttx | ok, cool | 09:56 |
| ttx | I haven't created a dependency for nova on nova.adminclient | 09:56 |
| ttx | I don't think it needs it | 09:56 |
| openstackhudson | Project nova build #520: SUCCESS in 1 min 35 sec: http://hudson.openstack.org/job/nova/520/ | 09:57 |
| openstackhudson | Tarmac: Add back --logdir=DIR option. If set, a logfile named after the binary (e.g. nova-api.log) will be kept in DIR. | 09:57 |
| *** miclorb_ has joined #openstack | 09:58 | |
| *** guigui has quit IRC | 09:59 | |
| *** nati has quit IRC | 10:03 | |
| soren | ttx: I thought about that too and decided against it. | 10:04 |
| jaypipes | alright, g'night guys... gonna try and get a few hours of sleep. night. anyone feel like reviewing any/all of the little branches in Glance here would be most appreciated: https://code.launchpad.net/glance/+activereviews | 10:07 |
| * soren takes a look | 10:08 | |
| *** kashyapc has quit IRC | 10:08 | |
| *** kashyapc has joined #openstack | 10:08 | |
| *** ramkrsna__ has joined #openstack | 10:08 | |
| *** aimon has quit IRC | 10:09 | |
| *** ramkrsna has quit IRC | 10:11 | |
| *** miclorb_ has quit IRC | 10:15 | |
| *** miclorb_ has joined #openstack | 10:23 | |
| *** bird has quit IRC | 10:27 | |
| *** sateesh has joined #openstack | 10:27 | |
| *** sateesh is now known as bird | 10:28 | |
| *** herki has quit IRC | 10:29 | |
| *** aimon has joined #openstack | 10:35 | |
| *** miclor___ has joined #openstack | 10:59 | |
| *** aimon has quit IRC | 11:00 | |
| *** miclorb_ has quit IRC | 11:01 | |
| *** aimon has joined #openstack | 11:17 | |
| *** miclor___ has quit IRC | 11:31 | |
| uvirtbot | New bug: #719967 in nova "UnicodeDecodeError on project description" [Undecided,New] https://launchpad.net/bugs/719967 | 11:32 |
| *** h0cin has joined #openstack | 11:38 | |
| *** thimble has quit IRC | 11:46 | |
| *** berendt has quit IRC | 11:47 | |
| *** CloudChris has quit IRC | 11:52 | |
| *** CloudChris has joined #openstack | 11:52 | |
| *** drico has quit IRC | 11:54 | |
| *** ctennis has quit IRC | 11:56 | |
| *** DigitalFlux has left #openstack | 11:58 | |
| *** DigitalFlux has joined #openstack | 11:58 | |
| *** DigitalFlux has left #openstack | 11:58 | |
| *** DigitalFlux has joined #openstack | 11:58 | |
| *** jheiss has quit IRC | 12:00 | |
| *** j05h has joined #openstack | 12:00 | |
| *** jheiss has joined #openstack | 12:07 | |
| *** fabiand_ has joined #openstack | 12:15 | |
| soren | xtoddx: I'd appreciate it if you could approve https://code.launchpad.net/~soren/nova/logrotate/+merge/49723 since you had reservations about it. | 12:25 |
| *** guigui has joined #openstack | 12:37 | |
| *** eikke has quit IRC | 12:42 | |
| *** CloudChris has quit IRC | 12:42 | |
| *** CloudChris has joined #openstack | 12:43 | |
| *** bird has quit IRC | 12:43 | |
| *** bird has joined #openstack | 12:43 | |
| ttx | while you're at it, please also have a look into xtoddx: https://code.launchpad.net/~ttx/nova/lp716919/+merge/49624 since you wrote the original code | 12:44 |
| ttx | aw | 12:44 |
| ttx | xtoddx: while you're at it, please also have a look into https://code.launchpad.net/~ttx/nova/lp716919/+merge/49624 since you wrote the original code | 12:44 |
| *** eikke has joined #openstack | 12:49 | |
| soren | jaypipes: Ok, so I want to make Glance support EC2 style image uploads. | 12:57 |
| soren | jaypipes: I'm hoping you can guide me a bit. | 12:57 |
| soren | jaypipes: EC2 style image uploads work as follows: | 12:57 |
| soren | jaypipes: 1. You have an image locally. You use a special tool to turn that image into a bunch of compressed, signed (maybe encrypted, I don't remember), parts plus a manifest. | 12:58 |
| *** eikke has quit IRC | 12:59 | |
| soren | jaypipes: 2. You use an upload tool to upload all these things to S3. The tool just reads the manifest and uploads everything, it doesn't process the contents or anything cool like that. | 12:59 |
| zul | soren: its needed because of nova/volume/san.py | 13:00 |
| soren | zul: Ah, so it is. | 13:00 |
| soren | zul: Cool, thanks. | 13:00 |
| *** berendt has joined #openstack | 13:01 | |
| soren | jaypipes: 3. You call EC2's RegisterImage method with an S3 URL pointing to the manifest. This makes EC2 grab the manifest and the image parts, checks the signature, (decrypts the parts?), and stitches the parts together, forming a complete image. | 13:02 |
| soren | jaypipes: ...and in response, you get back an ID for the image. | 13:02 |
| soren | jaypipes: Would I just let the register part contain the S3 URL, and then do the download when asked to run the image for the first time? | 13:03 |
| *** desai has joined #openstack | 13:03 | |
| soren | jaypipes: Is there no validation of the given URL during the registration phase? | 13:03 |
| *** rossij has quit IRC | 13:04 | |
| *** thimble has joined #openstack | 13:05 | |
| *** eikke has joined #openstack | 13:11 | |
| *** rchavik has quit IRC | 13:17 | |
| *** hggdh_ has joined #openstack | 13:23 | |
| *** hggdh has quit IRC | 13:23 | |
| *** kashyapc has quit IRC | 13:25 | |
| *** DanEllis has joined #openstack | 13:38 | |
| *** jbaker__ has quit IRC | 13:42 | |
| *** nelson has quit IRC | 13:52 | |
| *** nelson has joined #openstack | 13:52 | |
| *** dprince has joined #openstack | 13:54 | |
| *** aimon has quit IRC | 13:58 | |
| *** hadrian has joined #openstack | 14:00 | |
| *** fabiand_ has quit IRC | 14:06 | |
| *** allsystemsarego has quit IRC | 14:13 | |
| *** westmaas has joined #openstack | 14:15 | |
| *** hggdh_ is now known as hggdh | 14:16 | |
| *** fabiand_ has joined #openstack | 14:17 | |
| *** dprince has quit IRC | 14:17 | |
| *** dprince has joined #openstack | 14:19 | |
| *** desai has quit IRC | 14:20 | |
| *** desai has joined #openstack | 14:21 | |
| *** desai has quit IRC | 14:23 | |
| *** Ryan_Lane has joined #openstack | 14:28 | |
| *** thimble has quit IRC | 14:30 | |
| DigitalFlux | So i just fired an instance with novatools | 14:33 |
| *** ppetraki has joined #openstack | 14:33 | |
| DigitalFlux | however looks like curl can't get the image from the nova node | 14:33 |
| DigitalFlux | http://paste.openstack.org/show/708/ | 14:33 |
| *** thimble has joined #openstack | 14:35 | |
| *** aryko has joined #openstack | 14:41 | |
| *** gaveen has quit IRC | 14:42 | |
| *** Paul_Miller has joined #openstack | 14:42 | |
| *** f4m8 is now known as f4m8_ | 14:49 | |
| *** Ryan_Lane is now known as Ryan_Lane|dc | 14:49 | |
| *** ramkrsna__ has quit IRC | 14:52 | |
| *** dirakx has quit IRC | 14:53 | |
| *** kashyapc has joined #openstack | 14:56 | |
| *** skiold has joined #openstack | 15:03 | |
| *** pvo has joined #openstack | 15:03 | |
| *** m_3 has quit IRC | 15:07 | |
| *** Paul_Miller has quit IRC | 15:08 | |
| ttx | DigitalFlux: what was the problem with that 500 error you had ? | 15:10 |
| ttx | DigitalFlux: what do you use for an image service ? | 15:13 |
| *** m_3 has joined #openstack | 15:13 | |
| ttx | DigitalFlux: If you use Glance you should run with --image_service=nova.image.glance.GlanceImageService | 15:14 |
| *** hub_cap has joined #openstack | 15:16 | |
| DigitalFlux | ttx: yes it's Glance | 15:17 |
| DigitalFlux | with the flag you mentioned already in nova.conf | 15:17 |
| jarrod | can libvirt/kvm make volume snapshots yet? | 15:17 |
| *** gondoi has joined #openstack | 15:17 | |
| DigitalFlux | jarrod: I truly need that too | 15:18 |
| DigitalFlux | ttx: so what do you think ? | 15:18 |
| jarrod | hmm.. i can look into contributing | 15:19 |
| ttx | DigitalFlux: what version are you running ? | 15:20 |
| DigitalFlux | ttx: Glance ? | 15:20 |
| *** tmarble_ is now known as tmarble | 15:20 | |
| DigitalFlux | ttx: The trunk, installed a couple of hours ago | 15:20 |
| ttx | DigitalFlux: I hit that bug, but fixed it in https://bugs.launchpad.net/nova/+bug/708673 | 15:20 |
| uvirtbot | Launchpad bug 708673 in nova "libvirt/hyperv do not support Glance" [Wishlist,Fix released] | 15:20 |
| DigitalFlux | ttx: I see, I am already using Bexar | 15:21 |
| *** aryko has quit IRC | 15:22 | |
| ttx | DigitalFlux: if you look at the patch if image_service=nova.image.glance.GlanceImageService it should not fetch a :3333 url | 15:22 |
| *** westmaas has quit IRC | 15:23 | |
| ttx | DigitalFlux: the fix is in Bexar release so if you run that it should work... | 15:24 |
| *** westmaas has joined #openstack | 15:24 | |
| DigitalFlux | ttx: it should NOT fetch a :3333 URL ? | 15:25 |
| DigitalFlux | it's fetching a :3333 URL currently | 15:25 |
| ttx | DigitalFlux: right, that's where I don't understand. With the config you claim to have it should not happen. | 15:26 |
| ttx | (--image_service=nova.image.glance.GlanceImageService) | 15:26 |
| DigitalFlux | ttx: i see | 15:26 |
| DigitalFlux | well, i have --image_service=nova.image.glance.GlanceImageService on nova.conf of the main node and also the compute node | 15:26 |
| DigitalFlux | that's weird .. | 15:26 |
| *** msassak has joined #openstack | 15:27 | |
| DigitalFlux | I was this close to launching an instance via the novatools :( | 15:28 |
| DigitalFlux | But i hit this image issue .. | 15:28 |
| berendt | at the moment only on instance per compute node is launched at one point. how is it possible to launch more instances at the same time on one node? | 15:29 |
| *** westmaas has quit IRC | 15:29 | |
| *** joearnold has joined #openstack | 15:32 | |
| *** joearnold has quit IRC | 15:41 | |
| *** vvuksan has joined #openstack | 15:41 | |
| jaypipes | soren: I'm up now, after a terrible mornings sleep. I'll respond to your EC2/Glance stuff after I grab some coffee and breakfast. | 15:42 |
| ttx | soren / nova-core: you can probably switch https://code.launchpad.net/~sleepsonthefloor/nova/716847/+merge/49689 to approved now that fix-unittest is in | 15:42 |
| *** dendrobates is now known as dendro-afk | 15:42 | |
| *** westmaas has joined #openstack | 15:43 | |
| jaypipes | DigitalFlux, jarrod: Can I ask a favour? Could you start a conversation on the mailing list about what you were discussing above re: Glance, libvirt/kvm snapshots? I'd like to get more opinion on that. IRC is great, but mailing list can generate some excellent threads as well...cheers. | 15:44 |
| DigitalFlux | jaypipes: OK, will do ;) | 15:47 |
| uvirtbot | New bug: #720133 in nova "Nova returns non-compliant tag for DescribeKeypairs" [Undecided,New] https://launchpad.net/bugs/720133 | 15:47 |
| *** DigitalFlux has quit IRC | 15:47 | |
| *** fabiand_ has quit IRC | 15:54 | |
| *** dragondm has joined #openstack | 15:58 | |
| *** troytoman-away is now known as troytoman | 16:03 | |
| Kegaro | hello. Where does swift write it's error logs? | 16:03 |
| Kegaro | I see this in an strace: "write(2, "Error: [swift-hash]: swift_hash_"..., 78) = 78" but I can't figure out where it is writing this file to read the rest of the error. | 16:04 |
| vish1 | soren: I think we need to separate out crypto to make it actually work in glance. Glance needs a way to retrieve the projects key to decrypt. | 16:05 |
| uvirtbot | New bug: #720157 in nova "Nova returns HTTP 400 for SignatureVersion=1 requests" [Undecided,New] https://launchpad.net/bugs/720157 | 16:05 |
| *** dirakx has joined #openstack | 16:12 | |
| soren | vish1: That was the plan, yeah. | 16:13 |
| soren | ttx: Marked as approved. Thanks for the reminder. | 16:15 |
| *** vish1 is now known as vishy | 16:16 | |
| vishy | soren: I was considering making it a separate worker | 16:16 |
| vishy | soren nova-crypto or something | 16:16 |
| vishy | soren: was that your plan? | 16:16 |
| vishy | soren: the code for unpacking the image should actually go in to ec2_api imo | 16:17 |
| soren | vishy: It was one of the options. | 16:17 |
| soren | Anyways, /me goes to do dinner stuff | 16:17 |
| vishy | i think rather than making glance support an s3 front end | 16:17 |
| vishy | k | 16:18 |
| *** berendt has quit IRC | 16:19 | |
| ttx | 2011.1.1 nova/bexar branch merge proposals up at https://code.launchpad.net/~hudson-openstack/nova/bexar/+activereviews | 16:19 |
| *** thimble has quit IRC | 16:19 | |
| ttx | note that I'd prefer if the translationbs branch landed in cactus first | 16:20 |
| ttx | so give https://code.launchpad.net/~jaypipes/nova/translations/+merge/49833 some love please :) | 16:20 |
| creiht | Kegaro: by default the logs will go to /var/log/syslog or messages | 16:21 |
| *** CloudChris has quit IRC | 16:22 | |
| *** CloudChris has joined #openstack | 16:22 | |
| openstackhudson | Project nova build #521: SUCCESS in 1 min 34 sec: http://hudson.openstack.org/job/nova/521/ | 16:22 |
| openstackhudson | Tarmac: Fix for bug #716847 | 16:22 |
| uvirtbot | Launchpad bug 716847 in nova "euca-delete-volume cannot delete volumes in error state" [Medium,In progress] https://launchpad.net/bugs/716847 | 16:22 |
| openstackhudson | If a volume has not yet been assigned to a host, then have "nova-manage volume delete" delete from database and skip the rpc. | 16:22 |
| *** desai has joined #openstack | 16:23 | |
| ttx | soren: i suspect that tarmac won't pick up approved BMPs on lp:nova/bexar, and we'll have to land them manually ? | 16:23 |
| *** sebastianstadil has quit IRC | 16:24 | |
| *** bird has quit IRC | 16:25 | |
| *** guigui has quit IRC | 16:26 | |
| *** skiold has quit IRC | 16:31 | |
| *** kashyapc has quit IRC | 16:33 | |
| *** sebastianstadil has joined #openstack | 16:34 | |
| ttx | jaypipes: could you look into sirp's last comment on https://code.launchpad.net/~dan-prince/nova/bug719093/+merge/49746 ? I'd hate it if we were breaking one while fixing the other | 16:34 |
| *** rds__ has joined #openstack | 16:35 | |
| zul | soren: what do you think of shipping things like virt/libvirt virt/xenapi in their own seperate packages | 16:35 |
| *** skiold has joined #openstack | 16:36 | |
| *** skiold has quit IRC | 16:42 | |
| mtaylor | soren: ping | 16:43 |
| *** reldan has joined #openstack | 16:44 | |
| mtaylor | ttx: we can set up a tarmac job that watches lp:nova/bexar | 16:44 |
| *** sebastianstadil_ has joined #openstack | 16:45 | |
| *** sebastianstadil has quit IRC | 16:47 | |
| *** sebastianstadil_ is now known as sebastianstadil | 16:47 | |
| *** kashyapc has joined #openstack | 16:50 | |
| *** CloudChris has quit IRC | 16:51 | |
| *** rds__ has quit IRC | 16:54 | |
| *** calavera has quit IRC | 16:55 | |
| *** ccustine has joined #openstack | 16:56 | |
| jaypipes | ttx: we aren't. dprince's fix is correct. I'll note on the merge prop. | 16:58 |
| dprince | ttx, jaypipes: Sorry. I just saw that comment. I'll update the merge proposal. | 17:00 |
| *** littleidea has joined #openstack | 17:00 | |
| jaypipes | dprince: no, please don't. your fix is correct. | 17:00 |
| dprince | jaypipes: Sorry. I just meant I'd add a comment that it works fine. | 17:01 |
| jaypipes | dprince: ah, sorry, misunderstood :) | 17:01 |
| dprince | jaypipes: Hey. While I've got your attention I'm looking at https://bugs.launchpad.net/nova/+bug/709355 now. | 17:01 |
| uvirtbot | Launchpad bug 709355 in nova ""kernel_id property not found" Openstack API w/ S3ImageService " [Medium,In progress] | 17:01 |
| jaypipes | dprince: looking.. | 17:02 |
| dprince | jaypipes: I've pretty much got it however are you cool with relaxing that check on kernel_id and ramdisk so that it just passes. | 17:02 |
| dprince | jaypipes: the _get_kernel_ramdisk_from_image function. | 17:03 |
| jaypipes | dprince: lemme look. gimme a few ;) | 17:04 |
| dprince | jaypipes: Okay. One more thing. Glance uses image['properties']['kernel_id'] where S3 just uses image['kernel_id']. | 17:06 |
| dprince | jaypipes: should we standardize these further? | 17:06 |
| jaypipes | dprince: unfortunately, your bugs about the s3/glance/nova/objectstore inconsistencies hit while I was down in San Antonio, and that whole week was a bit of a mess :) | 17:07 |
| dprince | jaypipes: or at least put the check in the compute/api code? | 17:07 |
| dprince | jaypipes: Sure. Understood. :) I was waiting on devcamcar's patch anyway. | 17:07 |
| jaypipes | dprince: as for "standardizing", we just need to make sure the API represented by the BaseImageService explains what is expected to be returned. Right now, only "top-level" attributes like type, is_public, etc, are explained in the API. What do you think? Should be standardize on kernel_id and ramdisk_id in properties? Or should they be "top-level" attributes? | 17:08 |
| dprince | jaypipes: I can go either way. A slight preference for them being top level within the nova code. | 17:10 |
| jaypipes | dprince: k. devcamcar, any opinion? | 17:10 |
| doude_ | Hi all, the bug https://bugs.launchpad.net/glance/+bug/717431 makes Glance unable to fetch images with a Swift backend (in the bexar releases) ? | 17:11 |
| uvirtbot | Launchpad bug 717431 in glance "Swift backend not taking into account new Swift account:user:key in URI" [High,Confirmed] | 17:11 |
| jaypipes | dprince: even though kernel_id and ramdisk_id can very likely be None? | 17:11 |
| jaypipes | dprince: I don't mind, either way, to be honest :) | 17:11 |
| *** rcc has quit IRC | 17:11 | |
| jaypipes | dprince: let's just go ahead and make them "top-level attributes" as far as Nova is concerned, then. | 17:11 |
| dprince | jaypipes: gotcha. So another question since I just saw this ticket. Should I do #717431 at the same time? | 17:12 |
| dprince | jaypipes: These are related issues here. | 17:12 |
| dprince | jaypipes: I might as well get them all at once... | 17:12 |
| jaypipes | dprince: so, the "fix" is 1) modify BaseImageService to be 100% clear about what attributes are expected to be returned from each implementing image service 2) Make sure the various ImageService subclasses are translating any keys (or lack of keys) coming from the host image service (glance, local or nova-objectstore) into the keys that are required by the documented API in BaseImageService. | 17:13 |
| jaypipes | dprince: that sound like a plan to you? ^^ | 17:13 |
| dprince | jaypipes: gotcha | 17:13 |
| jaypipes | dprince: yes, I would do both in a single branch, since they're interrelated. | 17:13 |
| jaypipes | dprince: you might even mark 717431 a dup? | 17:14 |
| jaypipes | dprince: and finally, 3) tests, tests, tests ;) | 17:14 |
| dprince | jaypipes: Okay. I'll try and get this stuff worked out today then. Thanks. | 17:14 |
| *** sebastianstadil has quit IRC | 17:14 | |
| dprince | jaypipes: That brings up another question... Glance. So the cactus branch now uses a config file again? | 17:15 |
| *** littleidea has quit IRC | 17:16 | |
| jaypipes | dprince: config file is for paste.deploy. And yes, check the docs here for info on starting/stopping/restarting Glance servers in Cactus: http://glance.openstack.org/controllingservers.html | 17:16 |
| dprince | jaypipes: Thank you sir. | 17:17 |
| dprince | back in a bit... | 17:17 |
| *** dprince has quit IRC | 17:17 | |
| doude_ | jaypipes:Hi, the bug https://bugs.launchpad.net/glance/+bug/717431 that you opened, makes Glance unable to fetch images with a Swift backend (in the bexar releases) ? | 17:20 |
| uvirtbot | Launchpad bug 717431 in glance "Swift backend not taking into account new Swift account:user:key in URI" [High,Confirmed] | 17:20 |
| *** jbaker_ has joined #openstack | 17:21 | |
| doude_ | jaypipes: no workaround ? | 17:21 |
| *** maplebed has joined #openstack | 17:22 | |
| *** vvuksan has quit IRC | 17:23 | |
| mtaylor | creiht: hey. ok - let's chat about packages real quick | 17:25 |
| mtaylor | creiht: I'm cutting 1.2 packages (sorry for the delay) ... but I'm a little confused about versioning. do we want them in the 1.2 ppa? or in the swift-core ppa? | 17:26 |
| *** maplebed has quit IRC | 17:26 | |
| mtaylor | creiht: it feels to me like the want to be in the normal ppa - but I suppose if you want people to still be able to install 1.1 for some reason? | 17:27 |
| *** maplebed has joined #openstack | 17:27 | |
| jaypipes | doude_: looking... | 17:28 |
| *** blueadept has joined #openstack | 17:28 | |
| jaypipes | doude_: I didn't think there was a workaround, no. Did you know of one? | 17:28 |
| jaypipes | doude_: or were you making a subtle suggestion that I should increase the priority of the bug? ;) | 17:30 |
| *** reldan has quit IRC | 17:30 | |
| doude_ | jaypipes: no I don't find one and I don't want you increase the priority. But perhaps, it will be nice to update the release note of Bexar release | 17:34 |
| jaypipes | doude_: much agreed. :) | 17:36 |
| doude_ | jaypipes: the release note says "The S3 and Swift backends do not currently support the POST /images/ API command in the Glance API. These backends only currently support fetching disk images via GET calls. Support for storing disk images in S3 and Swift directly through the Glance API is planned for the Cactus release" | 17:36 |
| doude_ | jaypipes: Ok, bye | 17:37 |
| jaypipes | doude_: I'll update the release notes accordingly. cheers! | 17:38 |
| *** joearnold has joined #openstack | 17:41 | |
| *** Nacx has quit IRC | 17:42 | |
| jaypipes | sandywalsh_: what are you using as a mail client to respond to dabo? MS Word? ;P | 17:43 |
| sandywalsh_ | bad enough ... outlook web (the rs standard) | 17:43 |
| *** Ryan_Lane|dc has quit IRC | 17:43 | |
| jaypipes | sandywalsh_: or possibly Rackspace's wonderful Outlook Web Access!? :) | 17:43 |
| jaypipes | sandywalsh_: yup, that's what I figured. god I hate MS Outlook Web Access... | 17:43 |
| mtaylor | rs standard is dumb in this case | 17:43 |
| * jaypipes runs from johnpur | 17:43 | |
| *** Ryan_Lane|dc has joined #openstack | 17:44 | |
| jaypipes | the preferred mail client for monkeys. | 17:44 |
| * mtaylor stands his ground ... anything that thinks that a) executing code found in emails and b) sending emails in ms word format are good ideas is obviously flawed | 17:44 | |
| jaypipes | sandywalsh_: you in SA or something? not at home in Nova Scotia? | 17:45 |
| sandywalsh_ | jaypipes, I'm home | 17:46 |
| jaypipes | sandywalsh_: hmm, I won't ask then :) | 17:46 |
| sandywalsh_ | jaypipes, heh. I use gmail for my normal email. Don't want to mix business and pleasure :) | 17:46 |
| jk0 | kpepple: how close are you to proposing that branch to trunk? | 17:47 |
| jk0 | kpepple: I only have a few more changes -- do you think it's possible to have it proposed by tomorrow sometime? | 17:47 |
| jk0 | kpepple: if it's good to go now, I can always propose my changes later too | 17:48 |
| kpepple | jk0: it's feature functional and passing all new tests ... i only have coding style issues (mainly that i'd like to mox instance_types instead of leaving the constant in tests) | 17:48 |
| jk0 | cool | 17:48 |
| jk0 | all I'm working on is adding create/destroy to the OS API | 17:48 |
| kpepple | jk0: why don't you finish up tonight and we'll push for code review tomorrow pm ? | 17:49 |
| jk0 | other than that, it's done | 17:49 |
| jk0 | that sounds great | 17:49 |
| kpepple | jk0: i'm traveling today, so can you hold nova-core from merging the config file patch that was proposed ? | 17:50 |
| jk0 | which one was that? | 17:50 |
| kpepple | jk0: https://bugs.launchpad.net/nova/+bug/681411 and https://code.launchpad.net/~berendt/nova/lp681411 | 17:52 |
| uvirtbot | Launchpad bug 681411 in nova "Instance types should not be hard coded" [Wishlist,In progress] | 17:52 |
| jk0 | ohh | 17:52 |
| jk0 | yeah, that wont go in. we talked about it in email this morning | 17:52 |
| kpepple | jk0: okay. cool. | 17:52 |
| *** sebastianstadil has joined #openstack | 17:54 | |
| tr3buchet | openstack process question: suppose i have a cactus approved blueprint and I'd like to split it into multiple blueprints.. since we're after the blueprint freeze, what can I do? | 18:05 |
| *** hub_cap_ has joined #openstack | 18:08 | |
| *** vvuksan has joined #openstack | 18:08 | |
| *** hub_cap has quit IRC | 18:09 | |
| *** hub_cap_ is now known as hub_cap | 18:09 | |
| vishy | Ryan_Lane: are you here? | 18:11 |
| uvirtbot | New bug: #720252 in nova "adminclient create_user fails with --auth_driver=nova.auth.ldapdriver.LdapDriver" [Undecided,New] https://launchpad.net/bugs/720252 | 18:21 |
| sirp_ | dprince: whenever you're available, have a question re: imageservice change | 18:23 |
| *** RobertLaptop has left #openstack | 18:24 | |
| *** drico has joined #openstack | 18:24 | |
| *** evtoews has quit IRC | 18:27 | |
| *** allsystemsarego has joined #openstack | 18:28 | |
| openfly | how do I diagnose a problem with the meta-data server operating on 8773 ? | 18:33 |
| openfly | getting 500 internal errors. | 18:33 |
| jaypipes | tr3buchet: just split it. | 18:35 |
| vvuksan | openfly: watch nova-api debug log | 18:35 |
| *** littleidea has joined #openstack | 18:51 | |
| creiht | mtaylor: hrm | 18:51 |
| creiht | mtaylor: can't you still have multiple versions available in the PPA? | 18:51 |
| mtaylor | no. not in a single ppa | 18:51 |
| creiht | and I'm not sure where the other PPA sections came from | 18:51 |
| openfly | vvuksan thanks | 18:52 |
| openfly | will do | 18:52 |
| mtaylor | a single ppa is like a miniature debian archive, so it only keeps the most recent version | 18:52 |
| openfly | 011-02-16 10:53:55,324 CRITICAL nova.root [-] [Errno 2] No such file or directory: '/usr/lib/pymodules/python2.6/nova/..//CA' | 18:54 |
| openfly | that's the symlink to /var/lib/nova/CA right? | 18:54 |
| vvuksan | openfly: read http://wiki.openstack.org/NovaInstall/CentOSNotes. Find section that talks about copying to /var/lib/nova/CA | 18:55 |
| creiht | mtaylor: let me do a little research | 18:55 |
| * jaypipes taking a short break before tackling the live-migrations review for the first time....deep breath... | 18:58 | |
| openfly | http://pastebin.com/Tzwp5XGA | 19:00 |
| openfly | i fixed the CA issue | 19:01 |
| openfly | this i can't seem to figure out though | 19:01 |
| *** Pentheus has joined #openstack | 19:01 | |
| *** jheiss has quit IRC | 19:02 | |
| openfly | nova-api 14130 nova 5u IPv4 336485 0t0 TCP *:8773 (LISTEN) | 19:03 |
| jaypipes | devcamcar: what the heck was that latest DEFINE_integer thing on soren's merge? | 19:03 |
| openfly | well that's just plain wierd | 19:03 |
| henrichrubin | anyone know why this nova-networks fails from the latest trunk during launching an instance? http://paste.org/pastebin/view/29010 | 19:03 |
| henrichrubin | are the instances supposed to be removed from the instances db after a euca-terminate-instance? | 19:04 |
| openfly | henrichrubin beyond me. | 19:08 |
| vvuksan | openfly: there is an existing nova-api running | 19:09 |
| vvuksan | openfly: kill it | 19:09 |
| *** dprince has joined #openstack | 19:09 | |
| dprince | sirp_: hi. What is your question? | 19:11 |
| henrichrubin | openfly: thanks. anyone else have a clue on this error w/ the latest trunk? http://paste.org/pastebin/view/29010 | 19:11 |
| vvuksan | henrichrubin: doesn't look like instances table is cleaned up | 19:11 |
| vvuksan | henrichrubin: I assume it's needed for accounting purposes | 19:12 |
| henrichrubin | vvuksan: if a euca-run-instances stays in the networking state b/c nova-network fails, then i terminate the instance, it is still in the instances table in the 'shutdown' state. would this cause this problem? if so, then this is a bug. | 19:13 |
| *** clauden has joined #openstack | 19:13 | |
| vvuksan | henrichrubin: i suppose it's possible. You are using a /28 block so you may be exhausting the 14 ips | 19:14 |
| *** MarcMorata has quit IRC | 19:14 | |
| *** bcwaldon has quit IRC | 19:17 | |
| *** sebastianstadil has quit IRC | 19:19 | |
| *** fabiand_ has joined #openstack | 19:21 | |
| *** hub_cap has quit IRC | 19:21 | |
| henrichrubin | vvuksan: i deleted all the instances from the table and have the same problem | 19:22 |
| *** hub_cap has joined #openstack | 19:22 | |
| soren | jaypipes: I think it's a mutiny by my brain. It's telling me to stop proposing branches at such an ungodly hour. | 19:23 |
| *** imsplitbit has joined #openstack | 19:23 | |
| openfly | okay so vvuksan i shut down the nova-api | 19:24 |
| openfly | then i ran it through watch | 19:24 |
| openfly | and got no output at all | 19:24 |
| openfly | still getting 500 internal errors on the meta-data service | 19:24 |
| vvuksan | I run nova-api in a screen session with nova-api --nodaemon --flagfile /etc/nova/nova.conf | 19:25 |
| vvuksan | henrichrubin: hmmm | 19:25 |
| openfly | okay did that vvuksan i see it starting up... binding to a port | 19:26 |
| vvuksan | henrichrubin: type ps auxww | grep dnsmasq on the nova-network node. | 19:26 |
| asksol | sandywalsh_: what are the quirky errors you refer to here? http://wiki.openstack.org/MultiClusterZones ? | 19:26 |
| openfly | but when i do a http://10.100.70.137:8773/2009-04-04/ | 19:26 |
| openfly | i get an internal 500 error | 19:26 |
| openfly | and nothing in the api logs | 19:26 |
| *** elastic_dog has quit IRC | 19:27 | |
| vvuksan | that's odd | 19:27 |
| sandywalsh_ | asksol, ok, it was the error passing, which you fixed in that patch. I should update that page | 19:28 |
| sandywalsh_ | s/ok/oh/ | 19:28 |
| asksol | sandywalsh_: ok :) | 19:28 |
| openfly | maybe i should try bouncing the api server through strace... | 19:28 |
| *** elastic_dog has joined #openstack | 19:28 | |
| asksol | that looks really interesting, btw | 19:28 |
| sandywalsh_ | interesting is a good word for it :) | 19:28 |
| henrichrubin | vvuksan: http://paste.org/pastebin/view/29012 . this is the line that causes the error "network_ref = db.fixed_ip_get_network(context, address)" | 19:29 |
| henrichrubin | could it be b/c the network table id doesn't start at 1? | 19:30 |
| vvuksan | henrichrubin: i know but I don't quite get that piece of code :-) | 19:30 |
| vvuksan | henrichrubin: btw has this ever worked for you ? | 19:31 |
| vvuksan | henrichrubin: the nova network that is ? | 19:31 |
| henrichrubin | vvuksan: i think all it does is look in the network table and returns a context based upon the address it returns from the DHCP command | 19:31 |
| vvuksan | henrichrubin: what it does it looks for the bridge name then returns the proper network settings | 19:31 |
| vvuksan | DHCP settings | 19:32 |
| henrichrubin | this trunk has never worked for me. i had an earlier branch working on single node, but am trying on multi-node now and i can't get past this. | 19:32 |
| vvuksan | i have had trouble with it since this dhcp-range=10.0.0.2 has to be in the range of the br100 interface | 19:32 |
| vvuksan | ie. i was using 192.168.0.0/24 addresses | 19:32 |
| asksol | sandywalsh_: do you know what the problems with AMQP the newly proposed QueueService is supposed to solve? | 19:32 |
| vvuksan | and since dhcp-range said 10.0.0.2 dnsmasq would refuse to hand out addresses | 19:33 |
| *** jc_smith has joined #openstack | 19:33 | |
| asksol | -the | 19:33 |
| henrichrubin | vvuksan: so what address did you use for your nova-network? | 19:33 |
| vvuksan | what I ended up doing | 19:33 |
| sandywalsh_ | asksol, I haven't read the entire thread on the ML yet, perhaps eday has a blue print he can point you to? | 19:33 |
| vvuksan | henrichrubin: add following to /etc/nova/nova.conf --flat_network_dhcp_start=192.168.0.2 | 19:34 |
| devcamcar | jaypipes: what DEFINE_integer thing on which soren's merge? :) | 19:34 |
| henrichrubin | i am using the same address for "nova-network create" as "fixed_range" in nova.conf. | 19:34 |
| *** sebastianstadil has joined #openstack | 19:34 | |
| vvuksan | henrichrubin: assuming that br100 is e.g. 192.168.0.1 | 19:34 |
| * soren hugs devcamcar | 19:35 | |
| vvuksan | henrichrubin: it has to be in the range | 19:35 |
| henrichrubin | ok, my br100 is different than 10.0.0.2, so that may be the problem? | 19:35 |
| devcamcar | soren: <3 | 19:35 |
| * soren is rather embarrassed about it, really. | 19:35 | |
| vvuksan | henrichrubin: yes it has to be in the range. However that shouldn't break nova-network | 19:35 |
| *** colinnich_ has quit IRC | 19:36 | |
| vvuksan | henrichrubin: also these are helpful --dhcpbridge=/usr/bin/nova-dhcpbridge | 19:36 |
| vvuksan | --dhcpbridge_flagfile=/etc/nova/nova.conf | 19:36 |
| soren | I seem to have this dreadful habit of doing all the hard bits (admittedly, in this case, the hard bits weren't really that hard), running the unit tests, going "cool, it works, I'll just make this last change, so the patch looks prettier." and then apparantly forget to rerun the test suite. | 19:36 |
| * soren has an idea for a bzr plugin | 19:37 | |
| *** colinnich has joined #openstack | 19:37 | |
| *** troytoman has quit IRC | 19:38 | |
| *** troytoman has joined #openstack | 19:38 | |
| ttx | mtaylor: might be the easiest solution, even if it's a one-off, we can disable it afterwards | 19:39 |
| *** drico has quit IRC | 19:40 | |
| soren | mtaylor: wazzup? | 19:41 |
| devcamcar | soren: i had a moment of concern the other day when i submitted a patch that had nothing to do with sec groups, and then all the sec group tests broke. it was a real head scratcher, but turned out something else broke the sec group tests. i'm still confused about how that happened actually | 19:41 |
| soren | devcamcar: I can explain that. | 19:41 |
| soren | devcamcar: It took almost a day to work out. | 19:42 |
| mtaylor | soren: I was going to ask you questions about what you'd done to swift packaging - but I got it worked out | 19:42 |
| soren | devcamcar: It turned out to be because we now order security groups in DescribeSecurityGroups by name or something. | 19:42 |
| soren | devcamcar: ...and the test case generates a random name. | 19:42 |
| soren | devcamcar: If the random name sorted earlier than "default", it failed. If not, it succeeded. | 19:43 |
| devcamcar | ah hah! | 19:43 |
| soren | devcamcar: Before, we'd always get them in the order in which they were found in the DB. | 19:43 |
| soren | devcamcar: It had *all* the character traits of a race condition, so I was looking in all the wrong places. | 19:43 |
| henrichrubin | vvuksan: i tried the dhcp_start in nova.conf but it gives an error. seems like before dnsmasq starts.... | 19:44 |
| henrichrubin | http://paste.org/pastebin/view/29015 | 19:44 |
| Ryan_Lane|dc | vishy: yes/no. I'm building out a new datacenter, so I'm here, but will be not terribly responsive | 19:44 |
| vvuksan | henrichrubin: kill dnsmasq before you rerun nova-network | 19:45 |
| henrichrubin | vvuksan: it is already dead. and it doesn't start when restarting nova-network | 19:46 |
| vvuksan | hmm | 19:46 |
| mtaylor | ttx: ok. http://jenkins.openstack.org/view/Nova-Bexar/ | 19:48 |
| mtaylor | ttx, soren: ^^^ I set it up to do tarmac and docs publishing. I did not set up pep8 or pylint or tarball publishing | 19:48 |
| ttx | mtaylor/soren: I guess I culd use tarball publishing. | 19:48 |
| annegentle | mtaylor: just Sphinx dox publishing or also the new DocBook publishing (ant and maven)? | 19:49 |
| ttx | that would prevent me from doing it manually, which is errorprone | 19:49 |
| creiht | mtaylor: for now lets just do the release in the current release ppa | 19:49 |
| soren | ttx, mtaylor: Yeah, tarballs should be safe. | 19:50 |
| mtaylor | annegentle: there is new docbook publishing? | 19:50 |
| creiht | I don't think there is a reason for keeping around the 1.1 ppa | 19:50 |
| mtaylor | creiht: ok. cool. | 19:50 |
| creiht | If there becaomes one at some point, then we can facilitate that | 19:51 |
| annegentle | mtaylor: yeah I sent an email with a description and request... with details. I can meet with you to go through it if needed. Maybe you filter out anne@openstack :) | 19:51 |
| ttx | mtaylor/soren: once we have tarballs publishing set up, we can start approving the bmps on lp:nova/bexar | 19:51 |
| creiht | But I don't want to add extra burden unless really needed | 19:51 |
| mtaylor | annegentle: I filter _many_ things :) | 19:51 |
| annegentle | mtaylor: ayup! email is for email! Or something like that. :) | 19:51 |
| annegentle | mtaylor: completely see my request as further down on the todo list though | 19:52 |
| mtaylor | annegentle: oh hey look... there's the email | 19:52 |
| openstackhudson | Project nova-bexar build #1: FAILURE in 1 min 32 sec: http://hudson.openstack.org/job/nova-bexar/1/ | 19:52 |
| ttx | oops | 19:52 |
| mtaylor | annegentle: should I ask why we want two doc systems now? or just be snarky about it next time I see you in person? ;) | 19:53 |
| ttx | mtaylor: failure ? ^ | 19:53 |
| mtaylor | rsync: mkstemp "/srv/docs/nova/bexar/.nova.concepts.html.Q2KkGp" failed: Permission denied (13) | 19:53 |
| annegentle | mtaylor: snark is welcome :) RST didn't meet all the requirements - I hemmed and hawwed (just ask jbryce) and went with XML | 19:53 |
| mtaylor | gross | 19:54 |
| *** rnirmal has joined #openstack | 19:54 | |
| mtaylor | well, as long as it caused you and continues to cause you pain, I guess I'm ok with it. :) | 19:54 |
| devcamcar | soren: yea, that's good times! | 19:55 |
| *** olivier_ has quit IRC | 19:55 | |
| mtaylor | soren: do you have root on nova.openstack.org? | 19:56 |
| mtaylor | soren: and if so, can you please add me to the sudoers file? | 19:56 |
| mtaylor | soren: or, just do chown hudson:hudson /srv/docs/nova/bexar/ | 19:57 |
| mtaylor | antonym: ^^^ | 19:57 |
| soren | mtaylor: I am, and I can. | 19:59 |
| *** fabiand_ has quit IRC | 19:59 | |
| antonym | soren: you have it? | 19:59 |
| soren | Yeah. | 20:00 |
| antonym | k | 20:00 |
| soren | mtaylor: You don | 20:00 |
| soren | t even have a user on that box, do you? | 20:00 |
| soren | Oh, mordred. | 20:00 |
| soren | i see it. | 20:00 |
| soren | mtaylor: Done. | 20:00 |
| soren | mtaylor: Enjoy. | 20:00 |
| openstackhudson | Project swift build #198: SUCCESS in 29 sec: http://hudson.openstack.org/job/swift/198/ | 20:02 |
| openstackhudson | Tarmac: creating a Ring will ensure a valid HASH_PATH_SUFFIX | 20:02 |
| openstackhudson | Project nova build #522: SUCCESS in 1 min 38 sec: http://hudson.openstack.org/job/nova/522/ | 20:02 |
| openstackhudson | Tarmac: Use a threadpool for handling requests coming in through RPC. | 20:02 |
| mtaylor | soren: you rock | 20:07 |
| *** dendro-afk is now known as dendrobates | 20:08 | |
| mtaylor | soren: sorry to bug you - but I don't actually seem to have a working password on that machine :) | 20:08 |
| asksol | sandywalsh_: i only saw the wiki page, and it had very little rationale for such a big move. but is the plan to replace rabbitmq in Nova with this? | 20:08 |
| sandywalsh_ | asksol, I don't think so initially, but if it evolves to a point where it could ... | 20:09 |
| sandywalsh_ | asksol, I think they have some internal plans for it out of the gate | 20:09 |
| *** littleidea has quit IRC | 20:10 | |
| soren | mtaylor: on it | 20:10 |
| asksol | sandywalsh_: ok, thank you | 20:11 |
| *** h0cin has quit IRC | 20:11 | |
| desai | does anyone have any pointers on tuning kvm? | 20:11 |
| *** joearnold has quit IRC | 20:13 | |
| *** olivier_ has joined #openstack | 20:14 | |
| openstackhudson | Yippie, build fixed! | 20:15 |
| openstackhudson | Project nova-bexar build #2: FIXED in 1 min 36 sec: http://hudson.openstack.org/job/nova-bexar/2/ | 20:15 |
| openstackhudson | Project nova build #523: SUCCESS in 1 min 33 sec: http://hudson.openstack.org/job/nova/523/ | 20:17 |
| openstackhudson | Tarmac: Use RotatingFileHandler instead of FileHandler. | 20:17 |
| soren | Yay! | 20:18 |
| * soren adjusts packaging | 20:18 | |
| *** eikke has quit IRC | 20:22 | |
| *** joearnold has joined #openstack | 20:23 | |
| *** troytoman is now known as troytoman-away | 20:23 | |
| *** lvaughn_ has quit IRC | 20:26 | |
| *** lvaughn has joined #openstack | 20:27 | |
| *** irahgel has left #openstack | 20:33 | |
| *** sebastianstadil has quit IRC | 20:34 | |
| desai | so it looks like nova-compute starts up kvm with a restricted set of cpu features passed through to instances; is there a way to tune that? i'm not seeing anything in the code | 20:35 |
| openfly | well i got nothing,. my metadata server is still spitting out internal error 500 and i still have no logs anywhere telling me why that could be | 20:36 |
| *** drico has joined #openstack | 20:37 | |
| desai | openfly: whenever i have metadata server problems, i get errors in the nova-api.log | 20:38 |
| desai | sometimes it looks like log rotation gets off kilter tho; you might check nova-api.log.* | 20:39 |
| *** lvaughn_ has joined #openstack | 20:39 | |
| *** lvaughn has quit IRC | 20:42 | |
| vvuksan | desai: like what options ? | 20:42 |
| openfly | desai there is nothing in that log | 20:43 |
| openfly | it all looks like it's operating correctly. | 20:43 |
| openfly | just the running instances keep erroring out trying to contact the meta data controller... | 20:43 |
| openfly | the nat / iptables rules are there | 20:43 |
| openfly | and locally i can't hit the metadata url either without that 500 internal error | 20:44 |
| desai | vvuksan: i'm trying to get sse3 passed through to the vm, otherwise our apps take a performance hit | 20:44 |
| desai | openfly: any metadata url or a particular one? | 20:44 |
| desai | we had a problem with the availability-zone one | 20:44 |
| desai | but not with the others | 20:44 |
| *** joearnold has quit IRC | 20:44 | |
| openfly | i can hit the list of dates | 20:44 |
| vvuksan | desai: if you have an idea how to pass it in in the libvirt.xml you can change the template | 20:44 |
| openfly | but anything inside the dates 500 | 20:44 |
| tr3buchet | can't get nova network to start: http://pastie.org/1572091 | 20:45 |
| tr3buchet | any ideas? | 20:45 |
| tr3buchet | happens in trunk and in the past few reviews | 20:45 |
| tr3buchet | revisions | 20:45 |
| desai | vvuksan: no love with that yet; it looks like you can tell qemu/kvm directly with a command line flag, but i can't figure out how to get that through libvirt | 20:45 |
| vvuksan | desai: what's the flag? | 20:45 |
| desai | -cpu on the command line | 20:46 |
| vvuksan | desai: perhaps this http://libvirt.org/formatdomain.html#elementsCPU | 20:49 |
| vvuksan | what is the invocation for -cpu ie. complete args ? | 20:49 |
| *** sebastianstadil has joined #openstack | 20:49 | |
| *** nelson has quit IRC | 20:50 | |
| *** nelson has joined #openstack | 20:50 | |
| desai | -cpu host, will pass through the host system capabilities | 20:51 |
| openfly | man installing openstack is way too hard. | 20:51 |
| *** sebastianstadil has quit IRC | 20:51 | |
| *** decramy has quit IRC | 20:51 | |
| desai | hm | 20:51 |
| tr3buchet | so is dating XD | 20:52 |
| tr3buchet | openstack has better docs though | 20:52 |
| openfly | I dunno | 20:52 |
| openfly | I am pretty sure openstack docs are comparable to docs on dating | 20:52 |
| openfly | a million methods that all don't work. | 20:52 |
| vvuksan | openfly: yes it has been a challenge for me as well | 20:52 |
| tr3buchet | i have more trouble keeping it working | 20:53 |
| jaypipes | openfly: Nova contestant #3, what is your preferred hypervisor? ooooh, XenServer? Good answer, contestant #3. | 20:54 |
| vvuksan | openfly: actually you know what :-) | 20:54 |
| *** Ryan_Lane|dc is now known as Ryan_Lane | 20:54 | |
| vvuksan | openfly: I get 500 doing 2009-04-04 as well | 20:54 |
| vvuksan | that may be quite normal | 20:54 |
| tr3buchet | jaypipes: nice :D | 20:55 |
| openfly | vvuksan is the correct next argument instanceid? | 20:55 |
| vvuksan | let me look | 20:55 |
| openfly | 2011-02-16 20:54:46,086 - DataSourceEc2.py[WARNING]: waiting for metadata service at http:\/\/169.254.169.254\/2009-04-04\/meta-data\/instance-id | 20:55 |
| openfly | that's what i am seeing in my instances | 20:55 |
| vvuksan | right | 20:56 |
| vvuksan | that could be it | 20:56 |
| *** sebastianstadil has joined #openstack | 20:56 | |
| openfly | no joy on that | 20:57 |
| openfly | still 500 | 20:57 |
| vvuksan | are you executing that from the instance itself ? | 20:59 |
| *** Ryan_Lane is now known as Ryan_Lane|dc | 20:59 | |
| openfly | i can't get into the instances | 20:59 |
| openfly | they are hanging trying | 21:00 |
| openfly | =/ | 21:00 |
| vvuksan | right | 21:00 |
| * jaypipes realized that his reference to the 70s game show "The Dating Game" may have been lost on some poor souls in the IRC channel... (http://en.wikipedia.org/wiki/The_Dating_Game) | 21:00 | |
| vvuksan | on the network node | 21:00 |
| vvuksan | type | 21:00 |
| openfly | 2011-02-16 21:00:11,455 - DataSourceEc2.py[WARNING]: 21:00:11 [47\/100]: url error [timed out] | 21:00 |
| vvuksan | iptables -t nat -L | 21:00 |
| vvuksan | does 169.254 show up ? | 21:00 |
| openfly | DNAT udp -- anywhere barad-dur udp dpt:1000 to:192.168.100.2:1194 | 21:01 |
| openfly | DNAT tcp -- anywhere 169.254.169.254 tcp dpt:www to:10.100.70.137:8773 | 21:01 |
| vvuksan | that looks good | 21:01 |
| vvuksan | try this | 21:01 |
| vvuksan | ifconfig eth0:100 inet 169.254.169.254/32 | 21:02 |
| openfly | done | 21:02 |
| vvuksan | you can ping the IP now ? | 21:02 |
| openfly | the instances are still timing out | 21:03 |
| vvuksan | try restarting instances | 21:03 |
| jarrod | is there anyway to use VlanManager, but not use NAT and allow the instances to possess the public IP? | 21:03 |
| openfly | same error | 21:05 |
| openfly | i can't ping the instance from the api system | 21:06 |
| openfly | i added a default allow in the availability zone | 21:06 |
| openfly | and i see it in the iptables | 21:06 |
| openfly | maybe there is a forwarding issue between bridges | 21:06 |
| openfly | might have found it | 21:07 |
| vvuksan | openfly: r u using DHCP ? | 21:07 |
| vvuksan | turn of stp | 21:07 |
| *** ironcamel2 has joined #openstack | 21:07 | |
| openfly | hrmm | 21:07 |
| openfly | didn't see sysctl net.ipv4.ip_forward | 21:08 |
| openfly | in the sysctl.conf | 21:08 |
| openfly | but it looks right in /proc | 21:08 |
| openfly | so guess it's not that | 21:08 |
| vvuksan | sysctl -a | grep forwa | 21:08 |
| openfly | stp? | 21:08 |
| vvuksan | yes brctl stp br100 off | 21:08 |
| openfly | net.ipv4.conf.all.forwarding = 1 | 21:09 |
| openfly | net.ipv4.conf.all.mc_forwarding = 0 | 21:09 |
| openfly | net.ipv4.conf.default.forwarding = 1 | 21:09 |
| openfly | net.ipv4.conf.default.mc_forwarding = 0 | 21:09 |
| vvuksan | net.ipv4.ip_forward = 1 | 21:09 |
| vvuksan | ? | 21:09 |
| henrichrubin | tr3buchet: did you get that error fixed yet? if not try apt-get update; apt-get install python-eventlet | 21:09 |
| openfly | yeah | 21:09 |
| vvuksan | i would have assumed libvirt would have turned on ip forward | 21:09 |
| openfly | root@barad-dur:~# sysctl net.ipv4.ip_forward | 21:10 |
| openfly | net.ipv4.ip_forward = 1 | 21:10 |
| henrichrubin | anyone else have any idea on this error? http://paste.org/pastebin/view/29015 i think vvuksan ran out of ideas. | 21:10 |
| openfly | yeah i was just confirming | 21:10 |
| openfly | still no joy | 21:10 |
| openfly | stp didn't do it. | 21:10 |
| *** dendrobates is now known as dendro-afk | 21:11 | |
| tr3buchet | henrichrubin: did that, need to add the ppa also | 21:13 |
| henrichrubin | tr3buchet: so did you get paste that error? i had the same problem, but now i am stuck on the error here: http://paste.org/pastebin/view/29015 | 21:14 |
| *** brd_from_italy has joined #openstack | 21:14 | |
| vvuksan | openfly: what instances are you using ? | 21:16 |
| vvuksan | what images that is ? | 21:16 |
| openstackhudson | Project swift build #199: SUCCESS in 31 sec: http://hudson.openstack.org/job/swift/199/ | 21:16 |
| openstackhudson | Tarmac: I rewrote swift-init cause I wanted it to do somethings it didn't, and I | 21:16 |
| openstackhudson | tried to make some of the error conditions a little better too. It has | 21:16 |
| openstackhudson | some new features, but overall it's behavior is mostly compatible with | 21:16 |
| openstackhudson | the old swift-init (input, return codes) - but if someone had some weird | 21:16 |
| openstackhudson | greps on the output they're hozed. | 21:16 |
| openstackhudson | swift-init --help is a good place to start | 21:16 |
| openstackhudson | some highlights might be: | 21:16 |
| openstackhudson | ?$swift-init start main --wait # wait for all "main" services to start, | 21:16 |
| openstackhudson | printing any errors to console | 21:16 |
| openstackhudson | ?$swift-init rest wait # same as above but for replicators, updaters & auditors | 21:16 |
| openstackhudson | ?$swift-init stop object -c1 # kill the first object-server "node" | 21:16 |
| openstackhudson | ?$swift-init object-server status # make sure it's dead - yay status! | 21:16 |
| openstackhudson | ?$swift-init proxy auth reload # devauth? srsly? | 21:16 |
| openstackhudson | ?$swift-init *-replicator once -n # run the object, container, | 21:16 |
| openstackhudson | and account replicators in "once mode" and watch them log to console | 21:16 |
| openstackhudson | until they're finished | 21:16 |
| openstackhudson | ... probably some other stuff too. Looking forward to feedback... | 21:16 |
| creiht | lol | 21:17 |
| openfly | vvuksan i've tried it with 10.10 and 10.04 ubuntu cloud images | 21:17 |
| *** dirakx has quit IRC | 21:17 | |
| tr3buchet | henrichrubin: i'll let you know when i get there | 21:18 |
| vvuksan | openfly: are you using dhcp or flat ? | 21:18 |
| openfly | ttylinux-uec-amd64-12.1_2.6.35-22_1.tar.gz <--- also tried that | 21:18 |
| openfly | no success | 21:18 |
| openfly | whatever is default | 21:19 |
| openfly | i think dhcp | 21:19 |
| vvuksan | ok | 21:19 |
| openfly | i'm not setting the flag | 21:19 |
| vvuksan | on the network node | 21:19 |
| vvuksan | verify dnsmasq is running ? | 21:19 |
| openfly | network node is compute / api node | 21:19 |
| vvuksan | ok | 21:20 |
| vvuksan | same here | 21:20 |
| vvuksan | i have one that does all jobs | 21:20 |
| openfly | I see it | 21:20 |
| vvuksan | and one that has compute and network | 21:20 |
| openfly | dnsmasq is running | 21:20 |
| vvuksan | paste the ps output | 21:20 |
| openfly | http://pastebin.com/WdfppEnm | 21:21 |
| openfly | that looks off | 21:21 |
| openfly | the instance is saying it's 192.168.100.4 | 21:21 |
| openfly | but dnsmasq is set for 100.3? | 21:21 |
| vvuksan | ignore the 100.3 part | 21:21 |
| vvuksan | this is the key file | 21:22 |
| vvuksan | /var/lib/nova/networks/nova-br100.conf | 21:22 |
| vvuksan | i would however | 21:22 |
| vvuksan | kill the dnsmasq that was invoked by libvirt | 21:22 |
| vvuksan | one dishing 122 addresses | 21:22 |
| vvuksan | it likely doesn't matter | 21:22 |
| vvuksan | but who knows | 21:22 |
| vvuksan | can you ping 192.168.100.4 ? | 21:23 |
| openfly | no | 21:24 |
| openfly | no idea why | 21:25 |
| vvuksan | check syslog | 21:25 |
| vvuksan | for messages from dnsmasq | 21:25 |
| vvuksan | see if there is anything suspicious | 21:25 |
| openfly | http://pastebin.com/nPBT4cVZ | 21:27 |
| openfly | i see some app armor issues on libvirt i think | 21:27 |
| openfly | not sure how relevant they are | 21:27 |
| openfly | and some vmnet issues | 21:27 |
| tr3buchet | henrichrubin: not hitting your error, but instead compute manager is getting stuck at "plugging VBD..." | 21:27 |
| openfly | did i mention i hate app armor? | 21:28 |
| vvuksan | openfly: turn it off :-) | 21:28 |
| openfly | app armor, network manager, and upstart | 21:28 |
| openfly | hate em all | 21:28 |
| henrichrubin | tr3buchet: send me the trace from nova-compute.log | 21:29 |
| vvuksan | openfly: how about this then | 21:29 |
| vvuksan | kill dnsmasq | 21:29 |
| vvuksan | then run it with exact same options | 21:29 |
| vvuksan | but append -d for debug | 21:30 |
| vvuksan | use virsh to destroy the instance | 21:30 |
| vvuksan | then start it up with virsh create | 21:30 |
| *** berendt has joined #openstack | 21:31 | |
| openfly | http://pastebin.com/f8a7K8AF | 21:31 |
| openfly | that's with app armor unloaded | 21:31 |
| openfly | give me a sec for the other stuff | 21:31 |
| openstackhudson | Project nova build #524: SUCCESS in 1 min 33 sec: http://hudson.openstack.org/job/nova/524/ | 21:32 |
| openstackhudson | Tarmac: -from migrate.versioning import exceptions as versioning_exceptions | 21:32 |
| openstackhudson | + | 21:32 |
| openstackhudson | +try: | 21:32 |
| openstackhudson | + from migrate.versioning import exceptions as versioning_exceptions | 21:32 |
| openstackhudson | +except ImportError: | 21:32 |
| openstackhudson | + try: | 21:32 |
| openstackhudson | + # python-migration changed location of exceptions after 1.6.3 | 21:32 |
| openstackhudson | + # See LP Bug #717467 | 21:32 |
| openstackhudson | + from migrate import exceptions as versioning_exceptions | 21:32 |
| openstackhudson | + except ImportError: | 21:32 |
| uvirtbot | Launchpad bug 717467 in nova "from migrate.versioning import exceptions fails with recent venv" [Medium,In progress] https://launchpad.net/bugs/717467 | 21:32 |
| openstackhudson | + sys.exit(_("python-migrate is not installed. Exiting.")) | 21:32 |
| berendt | i'm creating a new network with "nova-manage network create 192.168.3.0/24 1 255" but I only got 128 entries in the fixed_ips tables. is that normal? I thought I should got 255 entries in fixed_ips.. (http://paste.openstack.org/show/713/) | 21:33 |
| openfly | is vnet0 supposed to get an address? | 21:33 |
| vvuksan | no | 21:33 |
| berendt | and the new network in networks is "192.168.3.0/25" with netmask "255.255.255.128" | 21:34 |
| vishy | hmm | 21:34 |
| vishy | try 256 | 21:34 |
| vishy | not 255 | 21:34 |
| vishy | network_size is should be a power of 2 | 21:35 |
| *** joearnold has joined #openstack | 21:35 | |
| jaypipes | blamar: still an issue with the Authors file? | 21:35 |
| berendt | vishy: ok i'll try it.. is it useful to add a check there? | 21:35 |
| openfly | http://pastebin.com/4H6yPxZm | 21:36 |
| openfly | yeah dnsmasq won't even load | 21:36 |
| vishy | yes we need lots of checks | 21:36 |
| vishy | :) | 21:36 |
| jaypipes | blamar: I think you need to change this: 8+<brian.lamar@rackspace.com> <brian.lamar@gmail.com> | 21:36 |
| vishy | in nova-manage | 21:36 |
| jaypipes | blamar: reverse that, so your gmail address maps to your rackspace address, which is what is in AUTHORS. | 21:36 |
| berendt | vishy: it's working fine with 256.. it's so simple.. :) | 21:36 |
| berendt | vishy: thanks | 21:36 |
| vishy | np | 21:36 |
| *** DanEllis has quit IRC | 21:36 | |
| *** miclorb has joined #openstack | 21:36 | |
| vishy | openfly: looks like you are missing a flag | 21:37 |
| vishy | are you running from packages | 21:37 |
| vishy | --dhcpbridge_flagfile=/path/to/nova.conf (usually /etc/nova/nova.conf) | 21:37 |
| openfly | vishy yes | 21:38 |
| tr3buchet | henrichrubin: http://pastie.org/1572290 | 21:38 |
| tr3buchet | not a trace.. that's just where it hangs | 21:38 |
| henrichrubin | vishy: any idea on http://paste.org/pastebin/view/29015 | 21:40 |
| blamar | jaypipes, arg, mea culpa, fixed and pushed | 21:40 |
| nelson | Are there python bindings for swift other than python-cloudfiles? https://github.com/rackspace/python-cloudfiles/tree/master/cloudfiles | 21:41 |
| jaypipes | blamar: :) cool, I'll re-approve | 21:41 |
| vishy | henrichrubin: weird it looks like db.fixed_ip_get_network is failing | 21:42 |
| notmyname | nelson: any *-cloudfiles repo at https://github.com/rackspace should work with swift | 21:42 |
| henrichrubin | tr3buchet: i don't see an error. what does euca-run-instances say | 21:42 |
| vishy | do you have some old fixed ips in your db that are part of a network that has been deleted? | 21:42 |
| henrichrubin | vishy: i know. for some reason it returns a null db reference | 21:43 |
| notmyname | nelson: ah. but those are the only python bindings | 21:43 |
| nelson | notmyname: right; that's all I need. | 21:43 |
| tr3buchet | henrichrubin: i'm using the cloudservers api and it returns as usual, a list says status is in "build" | 21:43 |
| henrichrubin | vishy: my network table is shown on the paste | 21:43 |
| *** nelson has quit IRC | 21:43 | |
| vishy | henrichrubin: check your fixed_ips table | 21:44 |
| *** nelson has joined #openstack | 21:44 | |
| tr3buchet | henrichrubin: i'm going to upgrade to xenserver 5.6 and see if that helps, may have some random dirtiness hidden away somewhere | 21:44 |
| openfly | vishy no | 21:44 |
| openfly | everything is brand new | 21:44 |
| vishy | henrichrubin: I'm guessing there are some in there that have network_id=1 or network_id=2 | 21:45 |
| henrichrubin | vishy: ok, there are some references to some old networks which i deleted. i'll delete those. | 21:45 |
| vishy | cool | 21:45 |
| vishy | openfly: so do you have a flagfile? | 21:45 |
| notmyname | nelson: you could use the swift.common.client bindings distributed with swift itself. actually, they will be better than using python-cloudfiles | 21:46 |
| nelson | frig; those bindings aren't going to work for my use case either. Oh well, there's always s = socket.socket() | 21:46 |
| henrichrubin | vishy: i deleted them and relauched an instance. so when you remove a network from the networks table, you also have to remove it from the fixed_ips table? | 21:46 |
| openfly | vishy when i execute from nova-network service it pops up fine | 21:48 |
| openfly | i can't manually kick off dnsmasq to get debug output for whatever reason | 21:48 |
| openfly | 2011-02-16 21:42:45,918 - DataSourceEc2.py[WARNING]: 21:42:45 [75\/100]: url error [timed out] | 21:48 |
| openfly | that is my primary issue at the moment | 21:49 |
| openfly | and i can't figure out what the cause is. | 21:49 |
| creiht | nelson: what use case? | 21:49 |
| jaypipes | blamar: gah, again Hudson isn't happy with the Authors file. :( | 21:51 |
| blamar | jaypipes, just looking at that, any details on what it doesn't like? | 21:51 |
| jaypipes | blamar: :( I don't know. | 21:54 |
| *** dendro-afk is now known as dendrobates | 21:55 | |
| vishy | henrichrubin: correct | 21:55 |
| *** berendt has quit IRC | 21:55 | |
| vishy | openfly: it is nova-dhcpbridge failing | 21:56 |
| vishy | openfly: hence the mention of needing a flagfile | 21:57 |
| henrichrubin | vishy: if you try a bunch of instances that never get to the running state, then terminate the instance, they are never cleaned from the fixed_ips table. so you would run out of ips eventually, even though you have no instances running. shouldn't there be a mechanism to clean this table up if the instance isn't running or is terminated? | 21:57 |
| *** vvuksan has quit IRC | 21:57 | |
| nelson | creiht: reading from a URL, writing to the storage AND returning a copy to the swift client. | 21:57 |
| creiht | that is a pretty specific use case :) | 21:58 |
| vishy | henrichrubin: they are cleaned up after 10 minutes or so | 21:58 |
| vishy | by default | 21:58 |
| jarrod | is there anyway to use VlanManager, but not use NAT and allow the instances to possess the public IP? | 21:58 |
| henrichrubin | or send a warning to the user that they need to clean up | 21:58 |
| creiht | nelson: but I highly recommend using swift/common/client.py for the writing to the storage part | 21:58 |
| vishy | henrichrubin: at least they are supposed to be | 21:58 |
| nelson | reading it now. | 21:58 |
| henrichrubin | vishy: i am not sure about the default time. the old fixed_ips were still there from yesterday. | 21:59 |
| creiht | nelson: it is a pretty direct mapping to the various swift functions | 21:59 |
| vishy | henrichrubin: the ones that no longer had a network? | 21:59 |
| creiht | and we use it for all of our internal tools | 21:59 |
| henrichrubin | vishy: yes. plus there were ones that did have a network that i killed this morning. | 22:00 |
| openfly | vishy i have one | 22:00 |
| openfly | it's part of the default package | 22:00 |
| vishy | henrichrubin: hmm let me check something, there may be a bug with flatdhcp | 22:00 |
| nelson | creiht: yeah, but it expects a function with a 'read' so it can consume the entire stream. doesn't work for me, since the *other* data sink also wants an iterator. :) | 22:01 |
| vishy | henrichrubin: you are correct, the disassociate only happens in vlan manage | 22:01 |
| *** hub_cap has quit IRC | 22:01 | |
| jaypipes | eday: cheers, those were the details I was looking for. sorry for being a pest about details on that thread. I know you feel you've repeated yourself, oh, about a million times, on the distributed scheduler blueprint. :) | 22:01 |
| creiht | nelson: ahh... so you want it to stream through the whole path | 22:02 |
| vishy | henrichrubin: the periodic_tasks code needs to be copied over, and made to work without a host, if you report it as a bug i will make a fix. | 22:02 |
| henrichrubin | vishy: ok, i'll file a bug report. also, why wouldn't my dnsmasq be starting now after i cleaned up the fixed_ips table. | 22:02 |
| vishy | henrichrubin: not sure, are you getting an error? | 22:02 |
| henrichrubin | vishy: the error was here: http://paste.org/pastebin/view/28878. but now i see no error. | 22:03 |
| vishy | you might try deleting the networks/br100.conf and pid and restarting nova-network | 22:03 |
| nelson | creiht: I need put_object to be put_object_start, which returns an opaque object with two methods: write() and close(). | 22:03 |
| henrichrubin | vishy: wrong pastie. | 22:03 |
| henrichrubin | no more error. just doesn't start | 22:04 |
| vishy | henrichrubin: it won't start it unless there is an instance running | 22:04 |
| nelson | creiht: maybe I'll cut-n-paste out of client.py and structure it that way. Maybe other people will find that useful and you can pull it into swift? | 22:04 |
| *** alekibango has quit IRC | 22:04 | |
| *** grapex has joined #openstack | 22:04 | |
| vishy | henrichrubin: otherwise it starts when you run an instance | 22:04 |
| henrichrubin | vishy: ok, then i get no error from nova-network and it is in the "networking" state | 22:04 |
| creiht | nelson: sure | 22:05 |
| vishy | possible the message isn't getting to rabbit | 22:05 |
| creiht | nelson: as long as it is pep8 compliant of course ;) | 22:05 |
| vishy | do your fixed_ips now all have the proper network_id? | 22:05 |
| nelson | wouldn't DREAM of not. | 22:06 |
| creiht | :) | 22:06 |
| henrichrubin | vishy: i got to run, but here is the bug report...https://bugs.launchpad.net/nova/+bug/720393 | 22:07 |
| uvirtbot | Launchpad bug 720393 in nova "fixed_ips table is not cleaned up by default" [Undecided,New] | 22:07 |
| eday | jaypipes: no worries, happy to share. without the details it would just be hand-wavey, which is not helpful :) | 22:08 |
| * nelson goes for a walk. | 22:08 | |
| openfly | still nothing. | 22:08 |
| openfly | for whatever reason instances just cannot hit the meta-data server | 22:09 |
| openfly | and i have no clue why | 22:09 |
| *** MarkAtwood has joined #openstack | 22:12 | |
| *** dendrobates is now known as dendro-afk | 22:13 | |
| uvirtbot | New bug: #720393 in nova "fixed_ips table is not cleaned up by default using FlatDHCPManager" [Undecided,New] https://launchpad.net/bugs/720393 | 22:16 |
| openfly | Okay does someone... anyone at all have functional actually tested and working instructions for installing bexar on a stand alone ubuntu 10.10 system? | 22:18 |
| *** blueadept has quit IRC | 22:22 | |
| *** CloudChris has joined #openstack | 22:25 | |
| vishy | openfly: which instructions are you following? | 22:25 |
| openfly | vishy i've tried everything I could find | 22:26 |
| openfly | wiki and website. | 22:26 |
| vishy | openfly: I'm working on bexar++ cuz there were some bugs | 22:26 |
| *** littleidea has joined #openstack | 22:26 | |
| vishy | openfly: but I think bexar packages work just fine | 22:26 |
| openfly | not working for me | 22:26 |
| openfly | i can get instances to kick off | 22:27 |
| openfly | but they get stuck trying to hit the metadata server | 22:27 |
| openfly | and then... nothing | 22:27 |
| openfly | no errors | 22:27 |
| openfly | just... nothing | 22:27 |
| *** dprince has quit IRC | 22:27 | |
| vishy | openfly: do you have two interfaces on the machine? | 22:27 |
| openfly | no | 22:27 |
| openfly | physical anyways | 22:27 |
| *** glenc has quit IRC | 22:28 | |
| vishy | openfly: can you pastie me the output of iptables -t nat -L -n -v | 22:28 |
| *** glenc has joined #openstack | 22:28 | |
| vishy | openfly: can you ping the instances? | 22:28 |
| openfly | http://pastebin.com/i72CCBQD | 22:29 |
| openfly | nope | 22:29 |
| *** dprince has joined #openstack | 22:29 | |
| vishy | openfly: do you get any messages in /etc/nova/nova-network.log about ips getting leased? | 22:29 |
| openfly | yes | 22:29 |
| vishy | oh | 22:29 |
| openfly | actually | 22:30 |
| openfly | i think i might have it | 22:30 |
| vishy | you may have an extra copy of dnsmasq running as well | 22:30 |
| openfly | does the packaged version of bexar assume you use 10.0.0.0/8 ? | 22:30 |
| vishy | that is a common issue | 22:30 |
| vishy | openfly: yes | 22:30 |
| openfly | because that appears to be the case from the iptables. | 22:30 |
| vishy | openfly: do you have a conflict? | 22:30 |
| openfly | yeah | 22:30 |
| openfly | i don't use 10.0.0.0/8 at all in my config | 22:31 |
| vishy | openfly: looks like your host machine is using 10.100.70 | 22:31 |
| vishy | yeah that will cause issues | 22:31 |
| openfly | how do i change nova? | 22:32 |
| *** m_3 has quit IRC | 22:33 | |
| *** allsystemsarego has quit IRC | 22:35 | |
| vishy | openfly: --fixed_range=10.1.1.0/24 in /etc/nova/nova.conf | 22:35 |
| vishy | or something like that | 22:35 |
| vishy | you'll probably need to flush iptables | 22:35 |
| vishy | and restart nova-network | 22:35 |
| vishy | you should also kill your running instances first as well | 22:35 |
| openfly | will that be fine if I use 192.168.100 address space? | 22:35 |
| vishy | sure you can use that if you want | 22:35 |
| *** benlake_ has joined #openstack | 22:38 | |
| openfly | that chagned stuff | 22:40 |
| openfly | but not 100% | 22:41 |
| openfly | still can't ping still seeing natting rules for 10.0.0.0 | 22:41 |
| openfly | =/ | 22:41 |
| *** benlake has quit IRC | 22:41 | |
| *** hazmat has quit IRC | 22:41 | |
| *** hazmat has joined #openstack | 22:41 | |
| jaypipes | soren: if you have a moment to re-check this one, would be appreciaed: https://code.launchpad.net/~jaypipes/glance/bug704854/+merge/49930 | 22:41 |
| *** m_3 has joined #openstack | 22:41 | |
| *** miclorb has quit IRC | 22:42 | |
| vishy | did you flush iptables first | 22:42 |
| vishy | iptables -f | 22:42 |
| vishy | ? | 22:42 |
| vishy | i have to go, sorry, you should still see natting rules showing the ip of your host machine | 22:43 |
| jaypipes | dprince: know if Brian Waldon hangs out on IRC? Wanted to see what his plans were on https://code.launchpad.net/~bcwaldon/nova/lp713144/+merge/49135 | 22:45 |
| soren | jaypipes: Which editor do you use? | 22:46 |
| jaypipes | soren: vim. why? | 22:46 |
| soren | jaypipes: There's a lovely pyflakes plugin for it that highlights unused variables and a bunch of other things. | 22:47 |
| soren | jaypipes: That's how I spotted those things in my review. | 22:47 |
| jaypipes | soren: ah, cool. link? | 22:47 |
| soren | jaypipes: https://github.com/kevinw/pyflakes-vim | 22:48 |
| soren | jaypipes: It is *awesome*. | 22:49 |
| * soren heads bedwards | 22:49 | |
| jaypipes | soren: cheers mate. | 22:49 |
| soren | jaypipes: Let me know if you can't get it working. I remember it took a bit of tweaking back when I set it up. | 22:49 |
| jaypipes | k | 22:49 |
| soren | That might be fixed now. It was about a year ago. | 22:49 |
| * soren wanders off | 22:49 | |
| *** imsplitbit has quit IRC | 22:50 | |
| openstackhudson | Project nova build #525: SUCCESS in 1 min 33 sec: http://hudson.openstack.org/job/nova/525/ | 22:57 |
| openstackhudson | Tarmac: Update to our HACKING doc to add examples of our docstring style. | 22:57 |
| *** grapex has left #openstack | 23:01 | |
| jaypipes | sandywalsh_ or dabo: one more set of eyes on tr3buchet's patch would be appreciated: https://code.launchpad.net/~tr3buchet/nova/xs_network_inject/+merge/49906. | 23:04 |
| *** rnirmal has quit IRC | 23:05 | |
| *** gondoi has quit IRC | 23:07 | |
| *** pvo has quit IRC | 23:07 | |
| *** adiantum has joined #openstack | 23:11 | |
| *** brd_from_italy has quit IRC | 23:12 | |
| tr3buchet | now that's GM Goodwrench Service PLUS | 23:17 |
| tr3buchet | think i can get cerberus to take a look at it to | 23:18 |
| *** desai has quit IRC | 23:20 | |
| dsockwell | the wiki mentions installing openstack on centos 6; is there documentation for that case? | 23:20 |
| *** adiantum has quit IRC | 23:20 | |
| dsockwell | erm -- centos 6 being unreleased i'm going to guess 'maybe not' | 23:22 |
| *** adiantum has joined #openstack | 23:24 | |
| *** GasbaKid has joined #openstack | 23:30 | |
| *** dprince has quit IRC | 23:31 | |
| *** eikke has joined #openstack | 23:32 | |
| nelson | creiht: split up put_object into a class with three methods: open, write, and close | 23:37 |
| nelson | creiht: seems like the obvious set of names. | 23:37 |
| kpepple | dsockwell: RHEL 6 packages are available so you should be ready when CentOS 6 hits | 23:37 |
| *** adiantum has quit IRC | 23:38 | |
| *** adiantum has joined #openstack | 23:40 | |
| *** msassak has quit IRC | 23:52 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!