Wednesday, 2011-03-30

*** MotoMilind has joined #openstack00:00
pvoRyan_Lane: very cool00:01
*** st-17217 has joined #openstack00:01
Ryan_Lanejust created a new instance: http://nova-controller.tesla.usability.wikimedia.org/t-1/index.php?title=Resource_query_examples&action=purge00:01
Ryan_Lanegah. bad url :)00:02
Ryan_Lanehttp://nova-controller.tesla.usability.wikimedia.org/trunk.1/Resource_query_examples00:02
termiejustinsb: responded to your volumes bits00:02
justinsbtermie: thanks00:03
*** santhoshtw has joined #openstack00:08
termiejustinsb: ping when you're ready and i'll look again00:08
*** reldan has quit IRC00:09
justinsbtermie: Thanks - also found a leftover from the EC2 code - the attachment format in the volume is different from the attachment format if you query it directly, so just fixing that.  Even fewer lines of non-supporting code :-)00:09
aixenvim trying vishy's anso packages openstack build.. scrapping what i have currently00:09
*** icarus901 has joined #openstack00:11
*** zaccone has quit IRC00:14
*** adiantum has quit IRC00:19
*** dragondm has quit IRC00:19
justinsbtermie: Delousification complete: https://code.launchpad.net/~justin-fathomdb/nova/volumes-api/+merge/5446400:23
*** santhoshtw has quit IRC00:23
termiejustinsb: that docstirng on get_console_pool_info is still whacky00:24
termiewhat syntax is it? why don't you know what the values mean?00:24
justinsbtermie: I don't know what the values mean because I didn't write the function00:25
justinsbtermie: I can just delete it...00:25
justinsbtermie: No docstring better than poor docstring?00:26
*** notmyname has quit IRC00:28
*** notmyname has joined #openstack00:28
*** ChanServ sets mode: +v notmyname00:28
*** benb__ has joined #openstack00:30
justinsbtermie: Docstring will be gone once LP finishes running the diff00:30
justinsbI think we should see if Canonical want to use our test cloud to run their diffs :-)00:31
*** adiantum has joined #openstack00:32
winston-dcreiht : around?00:33
termiejustinsb: okies00:37
termiejustinsb: approved00:39
justinsbtermie: Thanks!00:40
justinsbvishy: You around for a review of the volumes-api?00:40
vishyjustinsb: yeah i'll do it tonight00:41
vishyI'm tracking an annoying bug or three atm00:41
justinsbvishy: OK!00:42
justinsbAnyone else from nova-core around for a review of the volumes-api?  My FFE expires in a few hours...00:42
vishynote to self: don't merge and push a changed bzr branch that builds off of version numbers00:42
*** dirakx has joined #openstack00:45
*** jeffjapan has quit IRC00:46
justinsbdevcamcar: Any chance I could ask you to have a look at the volumes-api branch?00:47
devcamcarjustinsb: hah, weird timing, i had just pulled it up in fact00:48
*** st-17217 has quit IRC00:48
justinsbdevcamcar: Awesome!  Just saw you review another branch, which is why I asked!00:48
*** jeffjapan has joined #openstack00:52
devcamcarjustinsb: class ExtensionDescriptor(object)00:54
devcamcari do agree with jay, that does seem above and beyond the proposal00:54
devcamcarits useful but mixing multiple features in a single branch makes it hard for reviewers00:54
justinsbdevcamcar: It's just a base class, to simplify creating an extension.  It makes my extension shorter.00:55
justinsbdevcamcar: I thought everyone's objection was to the _use_ of the base class in discovering the extension00:56
justinsbdevcamcar: Not to the use of the base class to simplify creating extensions ?00:56
devcamcark may have been biased by prev reviews, i'll keep reading00:56
devcamcarjustinsb: still looks like there was a lot of foundational work done in nova/api/openstack/extensions.py00:59
devcamcarthat looks like it a should be a prereq branch00:59
devcamcarhow about contrib vs incubator?00:59
justinsbdevcamcar: This was the first 'real' extension00:59
justinsbdevcamcar: nova/api/openstack/contrib or contrib/ ?01:00
*** pmatulis has quit IRC01:00
devcamcarnova/api/openstack/contrib instead of nova/api/openstack/incubator01:00
justinsbIf it'll get you to approve, I'll call it nova/api/openstack/devcamcarisawesome/01:01
benb__Hi, I'm a complete newbie.  Does Nova run on 64 bit Intel processors?01:01
dabobenb__: yes01:01
*** pmatulis has joined #openstack01:01
*** pmatulis has left #openstack01:02
creihtwinston-d: kinda? :)01:03
winston-dcreiht : sorry to bug you again.01:03
creihthehe01:03
creihtwhat's up?01:03
benb__It looks like Bleeding edge OpenStack Nova on Maverick by Thierry Carrez is the easiest way to get started.  I have a new (blank) hard disk on my server.  Where do I get (download) the software?01:04
*** icarus901 has quit IRC01:04
justinsbdevcamcar: There's almost no new genuine code in extensions.py.  There's add_extension but I can remove that if you'd prefer.01:04
*** adiantum has quit IRC01:04
devcamcarjustinsb: yea i'm starting to agree01:05
devcamcarjustinsb: approve with a nit:01:06
devcamcar833+class MockImageService(service.BaseImageService):01:06
devcamcarA nit - can we call this a FakeImageService? A mock is different.01:06
winston-dcreiht : 1) can i alter container ACL via API bindings?  i'd obtain the URL for public accessable object (to be used in website), but with PHP bindings, the only option is to get URL via $container->public_uri(), which requires CDN support.01:06
justinsbdevcamcar: Sure - will change Mock -> Fake ... good point!01:06
justinsbdevcamcar: Thanks01:07
creihtwinston-d: since the feature for public containers isn't in cloudfiles yet, the current bindings do not have that functionality, yet01:07
devcamcarjustinsb: glad to see this patch going in!01:07
devcamcarif you can knock that out real quick i'll approve it01:07
devcamcarback in a few01:07
justinsbdevcamcar: Me too!01:07
winston-dcreiht : that's bad news for me01:07
creihtwinston-d: if you want binding compatibility, then what you could do is either01:08
dabobenb__: best place is from the nova trunk, available on Launchpad. If you have bzr installed, just do: bzr branch lp:nova trunk01:08
creihta: have auth return the cdn-management-url which is an endpoint that you would write that would make the container changes01:08
dabobenb__: with the caveat that trunk is changing often, and may break at times.01:08
creihtb: write a piece of middleware that turns the cdn-management functions into public container functions01:09
*** rchavik has joined #openstack01:09
*** rchavik has joined #openstack01:09
*** adiantum has joined #openstack01:10
winston-dcreiht : yeah, i'd perfer binding compatibility.  option a look more straightforward to me.01:10
uvirtbotNew bug: #745388 in nova "images fail to register with --use_project_ca=True" [Medium,In progress] https://launchpad.net/bugs/74538801:12
winston-dcreiht : thanks for the hints.  btw, any plan to support 1) cdn in swift 2) public container in CloudFile API?01:13
benb__Thanks dabo.  I see lp:nova/bexar, probably more stable than Cactus.  Does this download contain Ubuntu, everything needed to install on bare metal (a freshly formatted hard disk)?01:13
*** mray has joined #openstack01:13
dabobenb__: You'll need some sort of hypervisor; nova supports several of the most common01:14
*** MotoMilind has quit IRC01:15
dabobenb__: e.g., I have a box with Xenserver installed; I created a domU instance on that, running ubuntu 10.10, and then installed nova on that.01:15
*** zul has quit IRC01:17
*** zul has joined #openstack01:18
creihtwinston-d: 1) is a little complicated, as our current solution is kinda tailored for our cdn provider.  That functionality is fairly thin though, so it wouldn't be hard to add a thin layer on top of swift to act as an origin for a cdn provider.  At some point we *may* have a more general solution for this, but I can't gurantee it01:18
vishybenb__: fresh install of maverick + this might be your easiest install: http://images.ansolabs.com/single_node_install.sh01:19
creiht2.) There is some discussion of making openstack specific bindings, with the cloudfiles specific bindings an extension to those.  Once we do that, then it should be easier to track openstack features in the bindings.01:19
creihtand to all of the above, patches are always welcome :)01:20
winston-dcreiht : sounds good. :)01:20
*** ewindisch has quit IRC01:23
*** miclorb has quit IRC01:26
*** EdwinGrubbs has joined #openstack01:29
*** EdwinGrubbs has joined #openstack01:29
*** nelson has quit IRC01:30
*** nelson has joined #openstack01:30
benb__Hi vishy.  First I install Ubuntu Maverick 64 bit, then I follow http://images.ansolabs.com/single_node_install.sh?  I don't need to install a hypervisor?01:34
*** dprince has joined #openstack01:37
*** rchavik has quit IRC01:39
*** mray has quit IRC01:40
*** gregp76 has joined #openstack01:42
*** kashyap has joined #openstack01:43
*** dprince has quit IRC01:45
*** Ryan_Lane has quit IRC01:54
*** RobertLaptop has quit IRC01:56
*** adiantum has quit IRC01:56
*** ewindisch has joined #openstack01:58
*** RobertLaptop has joined #openstack01:59
*** joearnold has quit IRC02:03
*** adiantum has joined #openstack02:09
*** pharkmillups has joined #openstack02:14
*** littleidea has quit IRC02:15
justinsbAny nova core still around to repush volumes-api?  Unit tests failed due to new requirements from the image service.  All fixed now...02:16
justinsbhttps://code.launchpad.net/~justin-fathomdb/nova/volumes-api/+merge/5446402:16
*** littleidea has joined #openstack02:20
*** miclorb has joined #openstack02:22
*** ccustine has quit IRC02:26
winston-dcreiht : now that i'm using swauth, should i put 'cdn-management-url' part into proxy-server?02:28
creihtwell I would add it to the headers returned from the swauth middleware when a user authenticates02:30
*** pandemicsyn has joined #openstack02:31
*** ChanServ sets mode: +v pandemicsyn02:31
creihtwinston-d: handle_get_token in swift/common/middleware/swauth.py02:33
*** adiantum has quit IRC02:33
winston-dcreiht : got it.02:33
* winston-d looking to swift source02:33
creihtwinston-d: looks like you would add the header at the very end of the function02:34
*** adiantum has joined #openstack02:39
*** yamahata has quit IRC02:45
*** aimon has joined #openstack02:51
*** aimon has left #openstack02:52
openstackjenkinsProject nova build #744: SUCCESS in 2 min 29 sec: http://hudson.openstack.org/job/nova/744/02:54
openstackjenkinsTarmac: Support for volumes in the OpenStack API02:54
openstackjenkinsTwo new endpoints: /volumes and /servers/<id>/volume_attachments02:54
*** aliguori has quit IRC02:54
*** miclorb has quit IRC03:03
*** santhoshtw has joined #openstack03:08
*** maplebed has quit IRC03:13
*** mdomsch has joined #openstack03:18
aixenvwhen im logging into the openstack dashboard , where is that username/password generated from?03:22
aixenvis this user supposed to be my nova_user in the novarc ?03:22
*** adjohn has joined #openstack03:22
aixenvand is the password the key associated in nova-manage?03:22
aixenvuser = my nova-manage user and pass = my EC2_ACCESS_KEY (or SECRET_KEY)?03:24
*** santhoshtw has quit IRC03:26
*** miclorb has joined #openstack03:37
*** littleidea has quit IRC03:44
*** yamahata has joined #openstack03:44
*** MotoMilind has joined #openstack03:46
*** AimanA is now known as HouseAway03:53
*** jeffjapan has quit IRC03:56
*** guynaor has joined #openstack03:56
*** guynaor has left #openstack03:57
*** MotoMilind has quit IRC04:02
*** jeffjapan has joined #openstack04:05
*** santhoshtw has joined #openstack04:10
sleepsontheflooraixenv - the username/password is generated by and for the django app (probably when you initialized the db).  separate credentials, specified in settings.py, are used to communicate with nova04:12
sleepsonthefloorbut... usernames in the dash need to map to nova users to behave as expected.  dashboard will try to create nova users upon registration if they do not exist04:14
*** MotoMilind has joined #openstack04:15
*** MotoMilind has joined #openstack04:16
*** joearnold has joined #openstack04:16
*** littleidea has joined #openstack04:16
*** burris has quit IRC04:21
*** littleidea has quit IRC04:23
*** hadrian has quit IRC04:24
*** burris has joined #openstack04:26
*** MotoMilind has quit IRC04:26
*** littleidea has joined #openstack04:29
*** mdomsch has quit IRC04:33
*** t_yas1 has joined #openstack04:34
*** nijaba has quit IRC04:41
aixenvsleepsonthefloor: ty, you can sleep on the sofa04:42
*** nijaba has joined #openstack04:42
*** f4m8_ is now known as f4m804:49
*** pvo has quit IRC04:54
*** pvoccio has joined #openstack04:55
*** pvoccio is now known as pvo04:55
*** pvo has joined #openstack04:56
*** ChanServ sets mode: +v pvo04:56
*** pharkmillups has quit IRC04:56
*** kashyap has quit IRC04:58
*** _morfeas has quit IRC05:10
*** mastermind has quit IRC05:10
*** kashyap has joined #openstack05:17
*** dendro-afk is now known as dendrobates05:17
*** joearnold has quit IRC05:20
*** mastermind has joined #openstack05:24
*** ttt has joined #openstack05:25
*** adiantum has quit IRC05:32
*** gregp76 has quit IRC05:34
*** jeffjapan has quit IRC05:35
*** dendrobates is now known as dendro-afk05:37
*** dirakx has quit IRC05:41
*** dendro-afk is now known as dendrobates05:42
*** adiantum has joined #openstack05:45
*** gregp76 has joined #openstack05:48
*** gregp76 has quit IRC05:53
*** freeflying has quit IRC05:53
*** jeffjapan has joined #openstack05:53
*** benb__ has quit IRC05:54
*** freeflying has joined #openstack05:55
*** jeremyb has quit IRC05:56
*** jeremyb has joined #openstack05:56
*** ewindisch has quit IRC05:56
*** ivan has quit IRC05:58
*** jbryce has quit IRC06:00
openstackjenkinsProject nova build #745: SUCCESS in 2 min 30 sec: http://hudson.openstack.org/job/nova/745/06:04
openstackjenkinsTarmac: The VNC Proxy is an OpenStack component that allows users of Nova to access06:04
openstackjenkinstheir instances through a websocket enabled browser (like Google Chrome).06:04
openstackjenkinsA VNC Connection works like so:06:04
openstackjenkins* User connects over an api and gets a url like http://ip:port/?token=xyz06:04
openstackjenkins* User pastes url in browser06:04
openstackjenkins* Browser connects to VNC Proxy though a websocket enabled client like noVNC06:04
openstackjenkins* VNC Proxy authorizes users token, maps the token to a host and port of an06:04
openstackjenkinsinstance's VNC server06:04
openstackjenkins* VNC Proxy initiates connection to VNC server, and continues proxying until06:04
openstackjenkinsthe session ends06:04
openstackjenkinsFor more info see vncconsole.rst06:04
*** matiu has quit IRC06:07
*** gregp76 has joined #openstack06:07
*** jeremyb has quit IRC06:08
*** ivan has joined #openstack06:09
*** ivan has joined #openstack06:09
*** jeremyb has joined #openstack06:14
*** dendrobates is now known as dendro-afk06:15
uvirtbotNew bug: #745481 in nova "FLAGS.vncproxy_topic doesn't exist in compute.api" [Low,In progress] https://launchpad.net/bugs/74548106:16
*** adiantum has quit IRC06:16
*** MotoMilind has joined #openstack06:26
*** nerens has joined #openstack06:29
*** adiantum has joined #openstack06:29
HugoKuo_ does anyone use deployment tool before ?06:30
*** gregp76 has quit IRC06:32
*** MotoMilind has quit IRC06:36
*** littleidea has quit IRC06:42
*** mgoldmann has joined #openstack06:45
*** zenmatt has quit IRC06:45
openstackjenkinsProject nova build #746: SUCCESS in 2 min 28 sec: http://hudson.openstack.org/job/nova/746/06:48
openstackjenkinsTarmac: Uses the proc filesystem to check the volume size in volume smoketests so that it works with a very limited busybox image.06:49
*** lionel has quit IRC06:52
*** lionel has joined #openstack06:52
*** burris has quit IRC06:59
*** flopflip_ has joined #openstack07:04
*** allsystemsarego has joined #openstack07:05
*** allsystemsarego has joined #openstack07:05
*** flopflip has quit IRC07:08
*** CloudChris has joined #openstack07:15
*** miclorb has quit IRC07:17
*** miclorb has joined #openstack07:22
*** miclorb has quit IRC07:25
*** bkkrw has joined #openstack07:27
*** koolhead11|afk is now known as koolhead1107:33
*** miclorb_ has joined #openstack07:36
*** daveiw has joined #openstack07:37
*** santhoshtw has quit IRC07:45
*** Nacx has joined #openstack07:47
*** reldan has joined #openstack07:50
*** drico has quit IRC07:54
*** drico has joined #openstack07:55
*** uksysadmin has joined #openstack07:59
*** ramkrsna has joined #openstack08:14
*** ramkrsna has joined #openstack08:14
*** nijaba has quit IRC08:20
*** nijaba has joined #openstack08:22
*** nijaba has joined #openstack08:22
*** Daviey has quit IRC08:32
*** Daviey has joined #openstack08:34
*** Daviey has quit IRC08:38
*** t_yas1 has quit IRC08:38
*** Daviey has joined #openstack08:39
uvirtbotNew bug: #745541 in nova "nova-compute failed on import_class error" [Undecided,New] https://launchpad.net/bugs/74554108:46
*** gasbakid has joined #openstack08:50
*** kashyap has quit IRC08:54
*** jeffjapan has quit IRC08:56
*** winston-d has quit IRC08:58
*** kashyap has joined #openstack09:02
sorenW000t! The green is back: https://jenkins.linux2go.dk/09:03
*** jfluhmann has quit IRC09:03
*** miclorb_ has quit IRC09:04
*** miclorb__ has joined #openstack09:04
* soren treats himself to an orange to celebrate09:04
zigo-_-soren: Hi there!09:05
sorenzigo-_-: Hi.09:09
zigo-_-I'm having issues to start some of the daemons.09:10
sorenzigo-_-: Which ones?09:10
zigo-_-Let me check.09:10
zigo-_-nova-network, I believe, but not sure.09:10
ttxsoren: did we fix bug 739609 already ? rings a bell but cannot find reference.09:11
uvirtbotLaunchpad bug 739609 in nova "Cannot set body to unicode without a charset errors" [Undecided,New] https://launchpad.net/bugs/73960909:11
zigo-_-You guys don't use debian/*.init at all in Ubuntu, right?09:11
zigo-_-I mean, I can change things, it wont influence?09:11
sorenzigo-_-: Right.09:11
zigo-_-Cool.09:11
sorenYes.09:11
sorenttx: Ah, it's the webob version that's off.09:12
* soren fixes09:12
zigo-_-Do we HAVE to use libvirt? My understanding is that we can do without, right?09:14
*** reldan has quit IRC09:14
zigo-_-Setting up nova-compute (2011.2~bzr828-1) ...09:14
zigo-_-adduser: The group `libvirtd' does not exist.09:14
sorenzigo-_-: Well, sure, if you don't want to run any instances.09:14
zigo-_-:)09:14
sorenzigo-_-: Yeah, you guys call it libvirt.09:14
zigo-_-Oh, shit, yet another difference?09:15
zigo-_-That's crap.09:15
sorenHysterical raisins.09:15
*** reldan has joined #openstack09:15
zigo-_-:)09:15
zigo-_-Are you for dpkg-vendor --derives-from ubuntu or for getent?09:15
zigo-_-I'd be for a getent check ...09:15
*** jfluhmann has joined #openstack09:16
sorenWhy?09:16
zigo-_-Because there's more chance it's gona work.09:18
sorenI'm not convinced that's true.09:19
zigo-_-if getent group libvirtd09:19
zigo-_-AND09:19
zigo-_-if getent group libvirt09:19
zigo-_-Then add to both groups if we see both ...09:19
zigo-_-(which wont happen, but still ...)09:20
sorenI don't like that.09:20
HugoKuo_there r several point should be describe more detail or correct in deplomentTool?09:20
HugoKuo_where should I report it ?09:20
HugoKuo_on launchpad ?09:20
sorenUbuntu systems have this group named libvirtd. The admin may have created another group called libvirt and I'm sure he wouldn't enjoy us fiddling around with it.09:20
zigo-_-So what do you suggest?09:20
sorendpkg-vendor.09:20
zigo-_-dpkg-vendor --derives-from ubuntu?09:20
zigo-_-I don't mind ...09:21
alekibangozigo-_-: libvirt, yes thats the small patch i wanted to give you :)09:21
zigo-_-Ok, I do that then.09:21
alekibangolibvirtd09:21
sorenI don't see the downside to using dpkg-vendor?09:21
alekibangozigo-_-: where is your code?09:21
sorenWhat am I missing?09:21
alekibangozigo-_-: i can send you patch09:21
zigo-_-soren: As I said, I'm ok either ways, as long as we have a fix.09:22
sorenok09:22
alekibangobtw i used getent group like you zigo-_- :)09:23
sorenzigo-_-: With bzr, you shouldn't just remove a file and add it again with a different name. Use bzr rename to track renames.09:23
zigo-_-I saw that.09:23
zigo-_-Git wouldn't mind, but I read bzr does.09:23
zigo-_-I should use "bzr mv" ?09:24
zigo-_-What is the way?09:24
sorenIt's not about "minding". it's about tracking these things as two different actions.09:24
alekibangosoren: git is smarter a bit there :)  its code management, not file management09:24
sorenbzr's data model is somewhat richer than git's (for better or worse).09:24
alekibangolol09:24
sorenalekibango: that's a pointless generalisation.09:25
zigo-_-Could we stop digressing and progress in what we do? :)09:25
zigo-_-"bzr mv", right?09:25
alekibangosoren: i could say that too :)   hehe09:25
sorenzigo-_-: Yes, or "bzr rename".09:25
zigo-_-Cheers.09:25
sorenalekibango: About what?09:25
alekibangosoren: dont worry, we should rather work on something good09:26
alekibangoflamewars about editor or code management systems will not help :)09:26
sorenI don't see the flamewar, to be honest.09:27
sorenNot yet, at least.09:27
alekibangosoren: it always start like that :)09:27
sorenIt's a simple conversation, exchanging information about version control systems.09:27
alekibangozigo-_-: where is your code repo?09:27
alekibangosoren: OS will not move from bzr, so its moot to discuss this now :)09:28
sorenAt least that's what I was aiming for.09:28
alekibangobut i would love to use git, tahts sure09:28
* soren gives up09:28
zigo-_-alekibango: My lp ID is thomas-goirand09:28
*** miclorb_ has joined #openstack09:28
*** miclorb__ has quit IRC09:29
zigo-_-Starting nova compute: nova-computelibvir: error : Unknown failure09:29
zigo-_-:/09:29
*** miclorb_ has quit IRC09:30
alekibangozigo-_-: thats almost as goot as 'error: operation finished successfully'09:30
alekibangogood*09:30
sorenzigo-_-: What do you need lsb-base for? something about the init scripts?09:32
*** reldan has quit IRC09:33
zigo-_-It's for when you use log_daemon_msg things.09:33
sorenAh, right.09:34
alekibangozigo-_-: imho it might be nice to use runit... what do you think?09:34
sorenzigo-_-: Isn't lsb-base required in Debian?09:34
alekibangosoren: not required09:34
alekibangonot always09:34
sorenWell, either it is, or it isn't.09:35
sorenWhich is it?09:35
alekibangoyou can isnstall base system without lsb09:35
zigo-_-runit? What's that?09:35
alekibangozigo-_-: something like smarters daemontools09:35
zigo-_-soren: Required doesn't mean essential, you still need to depend on it.09:35
zigo-_-At least, to my knowledge.09:35
zigo-_-Or, I should say...09:36
alekibangoyes its not essential...09:36
sorenPackage: lsb-base09:36
sorenPriority: required09:36
zigo-_-If it didn't change since last time I did use lsb-base.09:36
zigo-_-Again, required != essential09:36
sorenYeah.09:36
alekibangozigo-_-: i would not mind this dependency09:36
zigo-_-required means that it's going to be installed by default by the debian installer.09:36
zigo-_-While essential means you don't need to depend on it, it's going to be always there.09:37
alekibango... i do not use installer much :)09:37
zigo-_-alekibango: I'm not fan of stuff like daemontools and such.09:37
zigo-_-It hides crashes...09:37
alekibango... http://smarden.org/runit/benefits.html09:38
zigo-_-A daemon should always run, and never crash, that's it.09:38
zigo-_-Also, that's not very convential to use these.09:38
zigo-_-This doesn't mean that an admin can't use it...09:38
alekibangomaybe as alternative?09:38
zigo-_-Just that the official package shouddn't by default.09:39
alekibangook zigo-_-...09:39
alekibangoi just was tempted to do so... as i like how it treats restarts, logs etc09:39
alekibangoold initscripts are not that good09:39
*** sebastianstadil has quit IRC09:40
alekibangoand it is really small, clean, easy to understand09:40
zigo-_-alekibango: What I like is monit!09:41
zigo-_-Ever used it?09:41
zigo-_-It's great, modular, etc.09:41
alekibangozigo-_-: i like zabbix :)09:41
zigo-_-Monit is *not* a monitoring software.09:41
alekibangoah, no never used it :)09:41
zigo-_-It checks if a service is up and running, and restarts it if needed.09:41
zigo-_-What's good is that it doesn't only check for the process, but for the functionality of the daemon.09:42
alekibango <zigo-_-> A daemon should always run, and never crash, that's it.09:42
alekibango:)09:42
zigo-_-Right! :)09:42
zigo-_-BRB09:42
alekibangozigo-_-: zabbix can do some actions too... :) its not only monitoring...09:43
sorenzigo-_-: This will turn your add/removes into proper renames: for f in debian/nova-*.upstart.in; do bzr revert -r 123 ${f%.in}; bzr rm ${f} ; bzr rename ${f%.in} ${f}; done09:46
sorenzigo-_-: For each file it reverts it to r123 (you deleted it in r124), removes the new .in, and does a proper bzr rename instead.09:47
*** adiantum has quit IRC09:47
sorenzigo-_-: We don't really need the lsb-base dependency under Ubuntu. You could put it in substvars, perhaps?09:49
zigo-_-soren: How do you do that?09:51
sorenzigo-_-: Those ${misc:Depends} things you often see in debian/control... You can add your own.09:52
zigo-_-Yes, but then? How do I substitute?09:52
sorendpkg-gencontrol does it.09:52
sorenzigo-_-: You know... Never mind. It just adds complexity and I don't really care if we needlessly depend on a required package.09:53
zigo-_-Ok, found it.09:54
sorenzigo-_-: But see deb-substvars(5), if you're interested.09:54
zigo-_-dh_gencontrol --dpkg-gencontrol-params=params09:54
*** miclorb has joined #openstack09:55
sorenUh..09:55
sorenwell, yeah, or you just just put it in debian/substvars09:55
*** benbenhappy has joined #openstack09:58
*** adiantum has joined #openstack10:01
*** joloughlin has joined #openstack10:04
joloughlinnova-compute service not enabled after latest update from trunk10:05
sorenjoloughlin: https://bugs.launchpad.net/nova/+bug/744833 by any chance?10:06
uvirtbotLaunchpad bug 744833 in nova "python-suds shouldn't be a hard dependency" [Medium,In progress]10:06
sorenjoloughlin: Put differently: does it help if you install python-suds?10:07
joloughlinsoren: let me check10:07
joloughlinthis is the error logs10:08
joloughlinhttp://pastebin.com/b5ZMhwhg10:08
sorenyup, that's it10:08
joloughlinyeah, thanks10:09
joloughlinthat enabled now10:09
*** reldan has joined #openstack10:14
*** adiantum has quit IRC10:15
HugoKuo_https://answers.launchpad.net/nova-deployment-tool/+question/15102010:23
HugoKuo_package never been installed on nova-network host with deployment tool10:23
*** yamahata has quit IRC10:25
sorenHugoKuo_: Is that "service dnsmasq stop" thing something from the deployment tool, or is it something you're trying to do yourself?10:26
*** benbenhappy has left #openstack10:27
*** adiantum has joined #openstack10:27
sorenzigo-_-: You could use the ${f%.in} substitution thing in your override_dh_installinit thing, by the way. That would be easier on the eyes :)10:30
sorenzigo-_-: ...and you should remove them up again in the clean target.10:30
sorens/ up / /10:30
sorenzigo-_-: Any particular reason why you put the man pages in a separate directory?10:31
sorenzigo-_-: ..and you seem to be missing a ; before done in override_dh_installinit.10:32
sorenzigo-_-: I think. I haven't actually run the build, I'm just looking at the diff so far.10:32
*** omidhdl has joined #openstack10:36
*** adiantum has quit IRC10:43
*** drico has quit IRC10:44
*** drico has joined #openstack10:45
*** adiantum has joined #openstack10:48
zigo-_-soren: Why do you think everything should be in the same folder? :)10:49
*** adjohn has quit IRC10:49
zigo-_-Anyway, these mans have to go in the upstream code.10:49
zigo-_-Not in our Debian folder.10:49
sorenI wouldn't spend a lot of time on that.10:51
sorenI believe the arg parsing system is being revamped.10:52
sorenYou might be interested to learn about gflags2man, by the way.10:52
zykes-are anyone running rpm builds for openstack ?10:53
*** rcc has joined #openstack10:59
rccttx: hi thierry, lp702636 apparently is no longer valid, Unknown exception is no longer shown . as there's no branch, i can't ask for a review11:00
zigo-_-soren: Fixed accordingly.11:00
rccshould i put it as INVALID ?11:00
zigo-_-Funny that the missing ; didn't bother me when building!11:00
zigo-_-now pushing...11:00
zigo-_-pushed11:01
*** dlafferty has quit IRC11:06
*** timbo_ has joined #openstack11:06
*** drico has quit IRC11:06
*** drico has joined #openstack11:07
timbo_can anybody please explain what i need to install or configure in my custom images so that iscsi volumes are injected? it works flawlessly with an uec-image, but nothing is logged inside my custom instance, based on a normal ubuntu server installation.11:08
*** adiantum has quit IRC11:09
*** miclorb has quit IRC11:11
HugoKuo_soren : as you said11:16
HugoKuo_soren : radvd and dnsmasq and nova-nework would not be installed11:17
HugoKuo_I'm going to try different component on different host to make sure the problem11:18
sorenHugoKuo_: I don't understand.11:18
sorenHugoKuo_: What did I say?11:19
*** ctennis has quit IRC11:19
HugoKuo_hmm...11:19
HugoKuo_ok make it simpler11:19
HugoKuo_deploymenttool process stop at 'service dnsmasq stop'11:20
HugoKuo_so I checked if dnsmasq has been installed on nova-network host ..  the answer is not11:21
HugoKuo_after that I check radvd & nova-netowork packages on nova-netowork component, same answer , they were not been installed11:22
*** benbenhappy has joined #openstack11:27
HugoKuo_oh~wait.....I found those package is installed while I change a host computer !!!11:27
HugoKuo_soren : just forget about it , it must be something wrong with my laptop11:28
sorenOk.11:28
*** adjohn has joined #openstack11:28
HugoKuo_thanks11:29
*** lionel has quit IRC11:29
*** photron has joined #openstack11:30
HugoKuo_is there any problem if I'm using different OS version ?  for example 3 ubuntu 10.10/ 64bits   and 1 ubuntu10.10/ 32bits11:30
photronwhat's the recommended ubuntu version to run openstack?11:31
HugoKuo_photron : 10.10 & 10.0411:31
*** ctennis has joined #openstack11:31
*** ctennis has joined #openstack11:31
benbenhappyis ubuntu 32bit ok?11:31
HugoKuo_I think yes11:32
*** timbo_ has quit IRC11:32
*** benbenhappy has left #openstack11:33
*** lionel has joined #openstack11:34
*** omidhdl has quit IRC11:39
*** morfeas has joined #openstack11:41
joloughlinI can add images to nova via uec-publish-image or nova-manage image and glance details show they are there11:44
joloughlinbut euca-describe-images returns 'an Unknown error has occured'11:45
joloughlinis nova with glance currently working ?11:54
zigo-_-http://paste.debian.net/112410/ <-- What happens when I start nova-network12:01
zigo-_-Any idea what's happening here?12:01
zigo-_-Could it be because /var/lock/nova doesn't exist?12:01
* zigo-_- tries...12:01
*** adjohn has quit IRC12:02
sandywalshttx, taking 71886912:03
ttxsandywalsh: yay!12:03
*** aloga has joined #openstack12:04
alekibangozigo-_-: was it missing dir?12:07
zigo-_-It seems so yes.12:09
alekibangozigo-_-: i think i had to do the same...12:09
zigo-_-But now, nova-network doesn't create the pid file.12:09
alekibangozigo-_-: why? dont you see something in logs?12:10
*** dmshelton has quit IRC12:10
* zigo-_- is buzy with server migration, will resume after done12:11
alekibangozigo-_-: imho you should be done soon with nova...12:12
*** h0cin has joined #openstack12:12
*** koolhead11 has quit IRC12:15
*** romain_lenglet_ has joined #openstack12:17
*** guigui1 has joined #openstack12:19
*** dendro-afk is now known as dendrobates12:19
*** stewart has quit IRC12:27
*** stewart has joined #openstack12:27
joloughlinis nova with glance currently working ?12:28
HugoKuo_see you guys ~12:28
openstackjenkinsProject nova build #747: SUCCESS in 2 min 28 sec: http://hudson.openstack.org/job/nova/747/12:28
openstackjenkinsTarmac: TopicAdapterConsumer uses a different callback model than TopicConsumer.  This patch updates the console proxy to use this pattern.12:28
openstackjenkinsWithout this patch, nova-ajax-console proxy will generate an error every time an auth token is cast to it, and hence it won't work.12:29
*** santhoshtw has joined #openstack12:32
*** shentonfreude has quit IRC12:36
n1md4do I install ALL nova- packages for a compute node?12:36
*** gasbakid has quit IRC12:41
*** kirshil has joined #openstack12:43
*** spring has joined #openstack12:43
springhi12:43
springcould u help me please, how can i reset the instance ids?12:43
*** hadrian has joined #openstack12:43
springi had a VM with i-0000001 id, after i have terminated it12:43
springbut new vm get an incremented id12:44
*** adiantum has joined #openstack12:44
springis there any way to reset this id?12:44
zulmorning12:44
joloughlinare there currently any problems with nova and glance ?12:48
n1md4hi.   failing to spawn instances on compute node http://paste.openstack.org/show/1032/ any ideas?12:49
*** shentonfreude has joined #openstack12:52
*** aliguori has joined #openstack12:56
*** zenmatt has joined #openstack12:57
*** santhoshtw has quit IRC13:08
zuln1md4: " Instance '13' failed to spawn. Is virtualization enabled in the BIOS?  "13:14
*** dendrobates is now known as dendro-afk13:15
*** dendro-afk is now known as dendrobates13:15
*** MarcMorata has joined #openstack13:21
*** dprince has joined #openstack13:24
*** joloughlin has quit IRC13:24
*** dendrobates is now known as dendro-afk13:26
blamarspring: I think the instance id is based on an auto-increment field in the database so you'd have to reset that value I think?13:28
n1md4zul: yeah, i'd seen that too. I'm sure I'd had instances running on that machine before though.13:31
n1md4zul: it's not ideal hardware, gigabyte boards, so flashing them with an update is a window$ affair, that I'm having difficulty doing.13:36
*** burris has joined #openstack13:41
openstackjenkinsProject nova-tarmac build #73,800: FAILURE in 7 min 26 sec: http://hudson.openstack.org/job/nova-tarmac/73800/13:43
cjreynhey guys, I'm having the following error for glance: ERROR: Unable to load glance-registry from configuration file /etc/glance/glance.conf.13:46
cjreynGot: ImportError('No module named MySQLdb',)13:46
cjreynI'm guessing there is a dependency here?13:46
*** EdwinGrubbs has quit IRC13:50
dubscjreyn: yes, you'll need to install the python mysql adapter13:52
*** f4m8 is now known as f4m8_13:52
cjreynand the --log-config switch is broken? Gives me the error:13:54
pvosoren: are you also doing the packaging in Ubuntu for glance?13:54
cjreynConfigParser.NoSectionError: No section: 'formatters'13:54
openstackjenkinsProject nova-tarmac build #73,801: STILL FAILING in 11 min: http://hudson.openstack.org/job/nova-tarmac/73801/13:55
pvosoren: I found it.13:56
*** theOG has joined #openstack13:56
*** santhoshtw has joined #openstack13:57
*** theOG is now known as OliG13:57
OliGHi All#13:57
openstackjenkinsProject nova build #748: SUCCESS in 2 min 29 sec: http://hudson.openstack.org/job/nova/748/13:59
openstackjenkinsTarmac: Makes the image decryption code use the per-project private key to decrpyt uploaded images if use_project_ca is set.  This allows the decryption code to work properly when we are using a different ca per project.13:59
*** ppetraki has joined #openstack13:59
OliGI'm looking to do a compute install on Ubuntu in our blade environment, does anyone know if I need TV on the board/chip in order to run 64-bit OSes14:00
OliG*VT even :s14:01
openstackjenkinsYippie, build fixed!14:02
openstackjenkinsProject nova-tarmac build #73,802: FIXED in 7 min 15 sec: http://hudson.openstack.org/job/nova-tarmac/73802/14:02
dprinceSo it looks like the glance PPA is broken:14:10
dprincehttp://hudson.openstack.org/job/glance-ppa/71/14:10
dprinceAny idea why?14:10
*** adjohn has joined #openstack14:10
*** adjohn has quit IRC14:10
*** Zangetsue has joined #openstack14:11
*** nRy has joined #openstack14:17
n1md4"Instance '17' failed to spawn. Is virtualization enabled in the BIOS?" this is a separate machine, and yes, it is.  Any ideas?14:17
springOliG u need VT for nodes14:18
*** omidhdl has joined #openstack14:18
*** zul has quit IRC14:21
*** zul has joined #openstack14:23
*** dirakx has joined #openstack14:24
OliGbut not the controller right spring :?14:29
*** jaypipes-afk is now known as jaypipes14:30
*** jeremyb has quit IRC14:31
*** jeremyb has joined #openstack14:31
* zigo-_- just finished migration from one DC to another. :)14:32
*** shentonfreude has quit IRC14:33
*** rds__ has joined #openstack14:33
*** jaypipes has joined #openstack14:34
*** ttt has joined #openstack14:36
*** ttt has quit IRC14:37
*** t_yas1 has joined #openstack14:38
n1md4where does openstack look for api_host?14:41
*** gondoi has joined #openstack14:41
*** allsystemsarego_ has joined #openstack14:42
*** CloudChris has quit IRC14:42
*** MarcMorata has quit IRC14:46
*** sebastianstadil has joined #openstack14:47
*** MarcMorata has joined #openstack14:49
*** t_yas1 has quit IRC14:49
zigo-_-nova-network fails with the following log: http://paste.debian.net/112435/14:50
zigo-_-Then never creates the pid file ...14:50
*** MarcMorata has quit IRC14:51
*** littleidea has joined #openstack14:52
zigo-_-Anyone knows why?14:52
*** mray has joined #openstack14:57
*** omidhdl has left #openstack14:58
ttxzigo-_-: that's https://bugs.launchpad.net/nova/+bug/73597414:58
uvirtbotLaunchpad bug 735974 in nova "nova-network logs exception when starting up" [Low,Confirmed]14:58
ttxzigo-_-: the trace is actually harmless14:58
ttxyour pidfile issue is probably unrelated14:59
zigo-_-Thanks.14:59
*** dragondm has joined #openstack14:59
*** nelson has quit IRC14:59
zigo-_-Trying last bzr.14:59
ttxzigo-_-: we may not be using pidfiles anymore -- ask soren to be sure15:01
n1md4i'm having trouble with every node that is not the controller. saying "Is virtualization enabled in the BIOS" even though it is.  This must be the way I'm configuring the nodes, but I can't figure out what.  I'm part following these guidelines http://wiki.openstack.org/NovaInstall/MultipleServer and http://docs.openstack.org/openstack-compute/admin/content/ch03s02.html15:02
zigo-_-I don't mind, start-stop-daemon can create them for me.15:02
zigo-_-But I think that the option can stay...15:02
*** reldan has quit IRC15:05
*** rcc has quit IRC15:06
*** dmshelton has joined #openstack15:06
*** daveiw has quit IRC15:06
*** guigui1 has quit IRC15:07
*** ramkrsna has quit IRC15:07
openstackjenkinsProject nova build #749: SUCCESS in 2 min 33 sec: http://hudson.openstack.org/job/nova/749/15:09
openstackjenkinsTarmac: Fixes metadata for ec2_api to specify owner_id so that it filters properly.15:09
*** reldan has joined #openstack15:09
markwashtermie: if you're in, can you see if I have addressed your concerns on my merge prop? https://code.launchpad.net/~rackspace-titan/nova/change-password-v1-1/+merge/5491715:09
*** mgoldmann has quit IRC15:13
openstackjenkinsProject nova build #750: SUCCESS in 2 min 30 sec: http://hudson.openstack.org/job/nova/750/15:16
openstackjenkins* Tarmac: Moving server update adminPass support to be v1.0-specific15:16
openstackjenkinsOS API servers update tests actually assert and pass now15:16
openstackjenkinsEnforcing server name being a string of length > 015:16
openstackjenkins* Tarmac: Adding Content-Type code to openstack.api.versions.Versions wsgi.Application15:16
*** pharkmillups has joined #openstack15:16
*** OliG has quit IRC15:16
*** uksysadmin has quit IRC15:22
*** dendro-afk is now known as dendrobates15:28
n1md4on the node I only have nova-common15:32
n1md4 ...and nova-compute.  Is this enough to build the node successfully?15:32
*** syn__ has joined #openstack15:34
*** ccustine has joined #openstack15:34
*** syn__ has quit IRC15:34
*** dendrobates is now known as dendro-afk15:34
*** dendro-afk is now known as dendrobates15:34
*** kapil has quit IRC15:34
*** adiantum has quit IRC15:35
*** kapil has joined #openstack15:37
*** maplebed has joined #openstack15:38
*** gaveen has joined #openstack15:42
openstackjenkinsProject nova build #751: SUCCESS in 2 min 28 sec: http://hudson.openstack.org/job/nova/751/15:43
openstackjenkinsTarmac: Key was converted through str() even if None, resulting in "None" being15:43
openstackjenkinsadded to authorized_keys when no key was specified.15:44
*** aloga has quit IRC15:44
*** aloga has joined #openstack15:44
*** aloga has quit IRC15:45
*** aloga has joined #openstack15:46
*** adiantum has joined #openstack15:51
*** pharkmillups has quit IRC15:52
*** niksnut has joined #openstack15:53
mtaylordevcamcar: fixed it!15:57
mtaylordevcamcar: lp:~mordred/nova-adminclient/fix-dist15:57
n1md4can someone paste the output of 'dpkg -l | grep nova' on a working compute node please?15:59
blamarn1md4: http://paste.openstack.org/show/1034/16:01
n1md4blamar: cheers16:02
*** gregp76 has joined #openstack16:04
*** spring has quit IRC16:05
*** ppetraki has quit IRC16:05
n1md4blamar: having now installed the other nova services (I only had nova-common and compute), nova-scheduler and network and now entries in the services table, is that right?16:05
n1md4I thought only nova-compute was supposed to be present16:06
blamarn1md4: sorry, that might not have been what you wanted...that node I pasted has multiple jobs, not just compute :\16:07
n1md4blamar: don't worry, I'm still breaking things here.  Trying to get it to work16:08
n1md4http://paste.openstack.org/show/1035/16:09
n1md4Still can't get it right! :(16:09
*** photron has quit IRC16:14
*** MotoMilind has joined #openstack16:17
n1md4blamar: have you got an output of one that is only being a node? :)16:19
blamarn1md4: I don't at the moment, no.. sorry I can't be of more help but I'm just learning a lot of the internals myself. If you need some help with the OS API I'd love to be more assistance heh16:20
*** dubsquared has joined #openstack16:20
n1md4i'm having enough trouble getting the nodes to work with the controllers, I'm sure there'll just be a couple of lines of config that I'm messing up, but I can't yet find the needle ;)16:21
*** pharkmillups has joined #openstack16:24
*** MotoMilind has quit IRC16:24
*** lionel has quit IRC16:25
justinsbHi guys - Python style question.  I need to create a base class for _every_ OpenStack API Controller.  I wanted to call it openstack.Controller instead of wsgi.Controller, but I'm not sure if I then fall foul of Python style.  Should I put it in __init__.py?  In a new file called nova/api/openstack/openstack.py?16:25
justinsb(This is to support XML namespacing, not for type-checking, before anyone asks :-) )16:26
*** bkkrw has quit IRC16:26
*** johnpur has joined #openstack16:27
*** ChanServ sets mode: +v johnpur16:27
markwashjustinsb: that sounds like a lot of work--I think we are coming up against the limitations of the template method pattern16:27
*** lionel has joined #openstack16:28
justinsbmarkwash: What's the alternative you're suggesting?16:28
markwashjustinsb: one sec16:29
markwashjustinsb: so its not 100% clear to me, but I think basically we should factor the deserialization (and probably the wsgification) out of the controllers16:30
markwashcreate a strategy that is a wsgified callable class16:30
markwashwhich upon instantiation is given a deserializer and controller16:30
n1md4"Error: operation failed: failed to retrieve chardev info in qemu with 'info chardev'" and "qemu: could not load kernel '/var/lib/nova/instances/instance-00000014/kernel': Inappropriate ioctl for device" on different nodes, any ideas?  I'm I commenting in the right place too, I do get ignored a lot ;)16:30
markwashthe latter _not_ inherited from wsgi.Controller16:30
n1md4s/I'm/Am/16:31
markwashin any case, this gives us an opportunity to inject an os api specific deserializer16:31
*** MotoMilind has joined #openstack16:31
markwashjustinsb: this is probably as much if not more work16:31
justinsbmarkwash: Good suggestion... I think though that this is already done in wsgi.Controller16:31
justinsbmarkwash: It creates a Serializer object16:31
justinsbmarkwash: Or do you mean going even further?16:32
markwashjustinsb: I agree--however the problem is that serializer is given to the controllers through inheritance16:32
justinsbmarkwash: Ah, I think I get it now16:32
*** s1cz has quit IRC16:32
markwashthus in order to give a new one, you have to modify the inheritance hierarchy16:32
*** maplebed has quit IRC16:33
*** s1cz has joined #openstack16:33
markwashjustinsb: honestly, I'm about to start working on a blueprint to refactor how the serialization works in openstack api16:33
justinsbmarkwash: I think we've chosen inheritance for this now16:33
justinsbmarkwash: No objection to a blueprint16:33
markwashso we might want to just do something expedient here16:33
*** gregp76 has quit IRC16:33
justinsbmarkwash: But I just need XML namespaces in there...16:33
justinsbI think we likely have a lot of hidden XML problems, and I think we need to get the namespace in asap16:34
markwashI don't think there is going to be any "right" way to do this short of a larger refactoring, unfortunately16:34
markwashwill the namespaces help flush out the xml problems?16:35
justinsbmarkwash: Thanks.  I think I'll probably just do it "my way" and wait for someone to shoot me down in the MP :-)16:35
markwashjustinsb: lol :-) good hunting16:35
justinsbmarkwash: Yes... without a NS, we can't parse the XML against the schema16:35
justinsbmarkwash: Well, I could inject it, but I _thought_ it would be easier just to fix the OS API :-)16:35
justinsbmarkwash: Inject it client-side, that is16:36
markwashlol :-)16:36
*** adjohn has joined #openstack16:37
justinsbI'm putting it into common - seems the right place for it for now16:42
*** joearnold has joined #openstack16:42
*** joearnold has quit IRC16:43
*** maplebed has joined #openstack16:43
*** adjohn has quit IRC16:45
*** Ryan_Lane has joined #openstack16:47
*** adjohn has joined #openstack16:49
*** kapil has quit IRC16:52
*** zenmatt has quit IRC16:53
*** adjohn has quit IRC16:54
*** zenmatt has joined #openstack16:54
*** Nacx has quit IRC16:59
*** gregp76 has joined #openstack16:59
*** nelson has joined #openstack16:59
*** bcwaldon has joined #openstack17:00
n1md4I'm currently using a localuser image, I assume from launchpad Q+A this will not work for a multi-node install, what image should I use?17:01
*** Ryan_Lane1 has joined #openstack17:01
*** maple_bed has joined #openstack17:04
*** maplebed has quit IRC17:04
*** Ryan_Lane has quit IRC17:05
*** sparkycollier has joined #openstack17:09
*** keds has joined #openstack17:10
cjreynhey guys,17:11
cjreynIm having trouble getting Glance and Euca-describe-images to work17:11
cjreynI've uploaded an image to Glance, and it shows up in Glance details17:11
cjreynbut when queried via euca-describe-images, I get "An unknown error has occurred."17:12
cjreynThe database lookup happens on the Glance server (I can see the log print)17:12
cjreynbut nova-api just dumps "File "/usr/lib/pymodules/python2.6/nova/api/ec2/cloud.py", line 863, in _image_ec2_id"17:13
cjreynin the trace17:13
cjreynthis is the latest ppa. I know jologhlin was having the same error17:14
justinsbcjreyn: Could you please pastie the full trace from nova-api.  It sounds like a known issue, albeit one we thought was fixed.17:16
cjreynjustinsb: http://pastebin.com/k1GZDBcV17:18
*** maple_bed has quit IRC17:19
justinsbcjreyn: Looks like the same one... I'm finding the links now17:19
*** maplebed has joined #openstack17:19
*** MotoMilind has quit IRC17:19
cjreynjustinsb: cheers. I treid both disk images, kernels, and initrd's17:20
justinsbcjreyn: Here's the fix I proposed: https://code.launchpad.net/~justin-fathomdb/nova/ec2-api-with-glance/+merge/5428817:21
justinsbcjreyn: And here's a related bug: https://bugs.launchpad.net/nova/+bug/74211317:21
uvirtbotLaunchpad bug 742113 in nova "EC2 API doesn't work well with arbitrary glance images" [Medium,In progress]17:21
justinsbcjreyn: I guess the bug is still there :-(17:22
*** maplebed has quit IRC17:22
*** maplebed has joined #openstack17:22
justinsbcjreyn: The problem is that (some versions of) glance disagrees with (some versions of) nova on what the image format should be, and (some versions of) image upload tools upload with unexpected metadata17:23
justinsbcjreyn: How did you upload your image?17:23
*** lionel has quit IRC17:23
cjreynjustinsb: using the cmd: glance add name="PBS_NODE_debian_v1.4.img" is_public=True container_format=bare disk_format=raw < PBS_NODE_debian_v1.4.img -H 172.16.10.417:23
*** lionel has joined #openstack17:23
justinsbcjreyn: Ah - there's some magic that you need there... let me dig it up17:24
cjreynjustinsb: ok cool. Does the magic relate to uploading kernels and initrd's aswell?17:24
justinsbcjreyn: Well the bug right now is that even one malformed image will block euca-describe-images (unless it's been fixed)17:25
cjreynjustinsb, the images are all rqaw format, i.e. unmodified kernels initrds and diska images with no metadat17:26
cjreynjustinsb, srry "raw"17:26
justinsbcjreyn: I just use raw disk images (no kernels / initrds) so that's all I know... sorry17:27
justinsbcjreyn: I think you need to pass a "type=ami" argument to glance so that the type is populated in the properties17:27
*** MotoMilind has joined #openstack17:27
justinsbcjreyn: You'll also have to delete your 'bad' image from glance17:27
justinsbcjreyn: I've also seen a recommendation to upload using the 'proper' tool rather than glance directly17:28
cjreynjustinsb, ah ok makes sense. Maybe passing type="ari" will sort out the ramdisk image.17:28
cjreynjustinsb, whats the 'proper' tool?17:28
justinsbcjreyn: " If you want images to work with ec2, you17:28
justinsbshould probably upload them with nova-manage image commands."17:28
justinsbcjreyn: That's what vishy said on my merge proposal17:28
justinsbcjreyn: The values should be type=machine, type=kernel and type=ramdisk17:29
justinsbcjreyn: Based on looking at the code17:29
justinsbcjreyn: They get mapped to ami, aki, ari17:29
justinsbcjreyn: (It's that mapping that's fragile, BTW)17:29
*** joearnold has joined #openstack17:30
cjreynjustinsb, ok cool. I'm not sure using nova-manage solves the problem. I was speaking with a guy who had the same problem and he pasted me his upload. It included the 'type': 'machine' entry17:31
termiemarkwash: checking it out17:31
cjreynjustinsb, ok, ill try the explict setting of the properties, and if its broke, report a bug.17:32
justinsbcjreyn: Yes, great, thanks.  That's a bit worrying if specifying type=machine still fails17:32
cjreynjustinsb, cheers for the help btw17:32
justinsbcjreyn: np17:32
*** kashyap has quit IRC17:32
termiemarkwash: commented17:33
*** reldan has quit IRC17:35
*** MarcMorata has joined #openstack17:37
*** dragondm has quit IRC17:40
*** joearnold has quit IRC17:40
*** joearnold has joined #openstack17:40
*** reldan has joined #openstack17:42
cjreynjustinsb, well adding type=machine didn't work. Same error17:45
justinsbcjreyn: Bugger17:45
cjreynjustinsb, bug I guess?17:46
justinsbcjreyn: Can you please pastie the output of your glance images details...17:46
justinsbcjreyn: Just getting the URL.  Likely a bug!17:46
justinsbcjreyn: Well, I think it's a bug if it's possible to break it just by uploading bad metadata, but that's a different issue...17:46
justinsbcjreyn: URL is /images/details Probably http://127.0.0.1:9292/images/details17:46
cjreynjustinsb, URI: http://172.16.10.4/images/717:47
cjreynId: 717:47
cjreynPublic: Yes17:47
cjreynName: PBS_NODE_debian_v1.4.img17:47
cjreynSize: 104962457617:47
cjreynLocation: file:///srv/glance/images/717:47
cjreynDisk format: raw17:47
cjreynContainer format: bare17:47
cjreynjustinsb, it only shows up in the properties field if I dry-run the glance add cmd17:47
cjreynjustinsb, should details show the properties fields?17:48
justinsbcjreyn: I think it only shows up in details.  Can you pastie that (it's likely to be big)17:48
cjreynjustinsb, that was it, after running the cmd glance details --verbose -H 172.16.10.417:48
justinsbcjreyn: Can you do a curl http://172.16.10.4:9292/images/details17:49
justinsbcjreyn: It gets the raw JSON data17:49
*** drico has joined #openstack17:51
vishydisk format conatainer format should both be ami for ec217:53
justinsbvishy: Do you think this should work?  I don't see how it can...17:56
justinsbI just commented on here: https://code.launchpad.net/~justin-fathomdb/nova/ec2-api-with-glance/+merge/5428817:56
cjreynvishy, I'm uploading a raw disk image. Tried both ami types, and base/raw, and euca-describe-instances fails17:56
justinsbcjreyn: Any luck on that curl output?  It would help us here I think...17:57
*** kapil has joined #openstack17:57
vishycjreyn: and you have type set in properties?17:57
cjreynvishy, type=machine17:58
*** kapil has quit IRC17:58
*** kapil has joined #openstack17:58
openstackjenkinsProject nova build #752: SUCCESS in 2 min 31 sec: http://hudson.openstack.org/job/nova/752/17:59
openstackjenkinsTarmac: OpenStack API faults have been changed to now return the appropriated Content-Type header.17:59
markwashtermie: thanks for the comments17:59
markwashtermie: I think that for now I would like to keep the mock class defined in the function since it does not need to be used anywhere else17:59
termiemarkwash: most other tests define their mocks outside of the test itself18:00
*** kapil has quit IRC18:00
termiemarkwash: for things that are just classes18:00
termiemarkwash: i can dig up a couple examples18:00
*** dendrobates is now known as dendro-afk18:00
*** dendro-afk is now known as dendrobates18:00
markwashtermie: cool, I'll look too18:00
cjreynjustinsb, just sorting the network. Glance is running in a non routed VM at the mo... 2 secs18:00
*** kapil has joined #openstack18:01
justinsbcjreyn: No worries.. If you're able to run glance details though, you should be able to run curl from the same machine18:01
*** kapil has quit IRC18:01
termiemarkwash: test_api, test_compute, test_direct, test_rpc, test_service18:01
vishycjreyn: it is properties: {'type': 'machine'}18:02
termiemarkwash: test_scheduler18:02
markwashtermie: I think perhaps I was copying test_server_rebuild, test_delete-server_instance, test_resize_* all in the test_servers.py file18:02
termiemarkwash: none of those appear to have any classes defined in them?18:03
markwashtermie: oh, my class is actually a function18:03
cjreynvishy, yes that shows on the dry run, but not on a print via glance details18:03
vishycjreyn: regardless this needs to be fixed18:03
markwashtermie: that's right, that's how it happened, it started as a function, and then I made it a callable18:04
termiemarkwash: it is a callable, yes18:04
markwashtermie: but what is the difference?18:04
vishyjustinsb, cjreyn: probably we should key type off of container format and default bare to ami18:04
termiemarkwash: nothing much, just that if it is the kind of thing that could be useful outside that method it is effectively hidden by being inside it18:04
markwashtermie: ah, I don't think it is useful outside of that18:05
termiemarkwash: it's not a big issue obvs, just looked unusual to me18:05
*** zaitcev has joined #openstack18:05
markwashtermie: at least not with the current tests18:05
termiemarkwash: aight, well i guess let's leave it there18:05
justinsbvishy: Do the other image stores all define container_format always?18:05
justinsbvishy: Could we just default to ami always instead of axi?18:05
justinsbvishy: (I proposed axi as the minimal fix)18:06
vishyjustinsb: seems ok18:06
markwashtermie: thanks again for the comments18:06
vishyjustinsb; we don't really need properties type now that container format is in18:06
*** dmshelton has quit IRC18:07
vishyjustinsb: we should key off of container_format ari -> prefix ari type ramdisk  | container_format aki -> prefix aki type kernel | all others -> prefix ami type machine18:08
*** BinaryBlob has joined #openstack18:09
*** dmshelton has joined #openstack18:09
justinsbvishy: I'm a bit bored of this bug... I've already proposed fixes for it twice :-(18:09
justinsbvishy: I'm just checking if the other image services return container_format18:10
vishyjustinsb: the only other service is local18:10
cjreynjustinsb, srry, curl wasn;t installed and my ethernet adapter went down! Ok,so it returns a 40418:10
vishyand it returns whatever is set (doesn't check)18:10
justinsbvishy: And S3 service, right?18:11
justinsbvishy: S3 seems to populate it18:11
vishys3 just wraps the other services18:11
vishyit populates the metadata on image create18:11
vishyjustinsb: if you don't want to mess with it, I can propose a fix18:12
*** gaveen_ has joined #openstack18:12
justinsbvishy: That would be great.  I've tried twice already now...18:12
justinsbvishy: And I have to go to the post office :-)18:13
vishyok i'm on it18:13
justinsbThanks!18:13
*** sparkycollier has quit IRC18:13
cjreynvishy, is there a workaround so that I can add a kernel, ramdisk and image? All raw/no meta-data18:14
jk0would two cores mind looking at https://code.launchpad.net/~jk0/nova/lp744833/+merge/55604 for me please?18:14
cjreynvishy, without crashing euca-describe-images18:15
vishycjreyn: it should work if type is in properties, not sure why it isn't adding type properly18:15
*** _0x44 has quit IRC18:15
*** gaveen has quit IRC18:16
cjreynvishy, and for a raw disk image the container and disk format should be ami18:16
cjreynvishy, ?18:16
vishyin theory yes18:17
dendrobatesjk0: done18:17
jk0thanks dendrobates18:17
*** _0x44 has joined #openstack18:18
*** ChanServ sets mode: +v _0x4418:18
*** nelson has quit IRC18:20
*** nelson has joined #openstack18:20
dprincejaypipes: What are your thoughts on quotas in Glance?18:21
dprincejaypipes: specifically for properties.18:21
dprinceI'm looking at doing https://bugs.launchpad.net/nova/+bug/74280918:21
uvirtbotLaunchpad bug 742809 in nova "OSAPI: enforce quota for number of image metadata items" [Medium,In progress]18:21
dprinceWhich can certainly be done in nova but that may not be the right place for it.18:21
*** metoikos has quit IRC18:22
*** localhost has quit IRC18:23
*** localhost has joined #openstack18:23
*** kashyap has joined #openstack18:24
*** sparkycollier has joined #openstack18:28
btorchis there a problem with nova after bzr 866 ? If I roll back to that version everything works fine on my CN but if I upgrade to the latest 900+ the same instance (maverick-server-uec-amd64) that I can run fine on 866 won't run anymore18:30
btorcheither some network or iptables rules inserted are screwing up with the snat rules to reach  http://169.254.169.254 and causing that url error18:38
*** joearnol_ has joined #openstack18:40
*** joearnold has quit IRC18:40
dubsdprince: what is the motivation for implementing those quotas?18:40
*** clauden has joined #openstack18:41
dprincedubs: Well. I guess you could consider it a security risk.18:43
dubsdprince: how so?18:43
dprincedubs: Anyone with an API key could fill up the glance image_properties table.18:43
dubscan't that same person upload arbitrarily large images as well?18:44
dprincedubs: I thought we had a ticket on that too. :)18:44
dubsheh18:44
*** ppetraki has joined #openstack18:44
dprincedubs: Hmm. Well. The images aren't store in the DB anyway.18:45
pvodprince: but they could fill whatever backend glance is using18:45
dubsnot trying to be confrontational, just seems that Glance is a service that already allows people to upload large amounts of untrusted data.  i'm not sure limiting the number of properties on an image solves any security issue18:45
dprincedubs: So if someone wants to upload massive images into S3 or Swift I suppose they'd pay for it somehow.18:46
dprinceSure.18:46
*** dragondm has joined #openstack18:46
dubsdprince: that's true, there is a monetary cost in most cases (though not all — public images).18:46
*** sparkycollier has quit IRC18:46
dprinceI'm happy to punt on this for now if we need to talk out a longer term solution.18:47
*** gregp76 has quit IRC18:47
dprinceIn the short term I was just trying to prevent our image metadata controller in the OSAPI from exposing the data.18:48
dubsdprince: jaypipes and sirp may have more thoughts on this.  I just spoke up to try to understand what problem it would be solving.  I'll keep quiet now :)18:48
*** arun_ has quit IRC18:48
dprinceIt kind of seems like Glance may be the right place for a quota mechanism however.18:48
cjreynvishy, ok, so I tried adding a kernel image through both the glance cli, and through nova image image-create. I checked the mysql glance database and type is set to kernel.18:48
*** joearnol_ has quit IRC18:48
jaypipesdprince: sorry, was on phone....18:48
dprincedubs: Sure. Thanks for the input. Much appreciated.18:48
dubsdprince: there may be good reasons for it.  better security is probably not one of them18:48
jaypipesdprince: I would prefer to make any quotas a middleware in Glance that can easily be excluded.18:49
cjreynvishy, running euca-describe-instances returns the original error I pastebin dumped earlier (line 863 in cloud.py)18:49
deepyCan I try out nova in virtualbox if I lack VT-x and such?18:49
dprincejaypipes: Okay. I'd go for that. So is this something to punt on for now then? I mean we are in feature freeze for GLance too right.18:50
jaypipesdprince: no, it should be a trivial middleware after https://blueprints.launchpad.net/glance/+spec/api-limited-results is done in early Diablo.18:50
jaypipesdprince: yes, FF in Glance too.18:50
dprincejaypipes: gotcha. When I said punt I just meant for Cactus. So it shoulds like maybe we should make this ticket a Glance ticket then and put it in for diablo?18:51
*** gregp76 has joined #openstack18:52
jaypipesdprince: well, Glance work would just be making it more efficient (i.e. passing the quote limit all the way down to the registry DB API as a LIMIT X, X. but OpenStack doesn't depend on Glance, and therefore quotas in the OS API need to be enforced on the Nova side for image services other than Glance, no?18:54
jaypipess/OpenStack doesn't depend/Nova doesn't depend/ ^^18:54
dprincejaypipes: The options are really local image service or glance right? The S3 image service (used by the EC2 API now wraps either local or glance too).18:56
*** daveiw has joined #openstack18:56
btorchanyone has an image that I could use that does not pull anything from " http://169.254.169.254/2009-04-04/meta-data/instance-id"18:57
justinsbjaypipes: Isn't glance going to be our images API in OpenStack?18:57
dprincejaypipes: And how likely is it that someone would deploy with a local image service instead of using Glance?18:57
jaypipesjustinsb: ? totally separate.18:57
dprincejaypipes: I mean I can put this in the API sure. Initially I filed the ticket with that in mind.18:57
justinsbjaypipes: I thought it was the first devolved service?  Like volumes is going to be its own API and service18:58
vishydreyn: describe instances or describe images?18:58
dprincejaypipes: After talking about it a bit more that seems like it may not be the best spot.18:58
vishydprince, jaypipes almost zero for deployments18:58
justinsbjaypipes: So there will be no /images in the openstack API long term18:58
justinsbjaypipes: We'll just hit glance directly18:58
jaypipesdprince, justinsb: the point of pulling glance out was to create a stand-alone image delivery/registry service. making the OpenStack /images and quote system somehow intrinsic to Glance is counter-productive to making decoupled components.18:59
dprincejaypipes: I could certianly bang out a patch to make this work for cactus (as a bug fix) and then we can revert it for Glance. If we aren't concerned about the security aspects of someone deploying with it then why not just wait and do it in Glance Diablo.18:59
justinsbjaypipes: You've lost me.  Isn't the point of making a standalone service that clients would hit it directly rather than proxying through the OpenStack API?19:00
*** maplebed has quit IRC19:00
justinsbjaypipes: That's what I thought everyone's been saying on the ML19:00
jaypipesjustinsb: we're talking about the OS API /images endpoint, which has limitations (quotas) on it that have nothing to do with Glance.19:00
justinsbjaypipes: But there will be no /images endpoint; it will be Glance, right?19:01
jaypipesjustinsb: Glance is the image service. It has it's own REST API. That REST API does not correspond to the RS CloudServers or OpenStack 1.1 API.19:01
justinsbjaypipes: Agreed.  But that REST API will be the only API that is used for images at OS API v1.X where X>=219:02
*** kashyap has quit IRC19:02
jaypipesjustinsb: that's not up to me. I have no idea about that.19:02
*** pharkmillups has quit IRC19:03
jaypipesjustinsb: the point is that someone can stand up Glance as an image service without knowing a thing about Nova or the CloudServers/OpenStack Compute API.19:03
justinsbjaypipes: Well, that's what all those long API conversations on the ML were saying19:03
justinsbjaypipes: Sure, they can stand up glance standalone if they want to19:03
jaypipesjustinsb: link?19:03
*** brd_from_italy has joined #openstack19:04
justinsbjaypipes: Oh great, now I have to re-read that thread :-)19:04
jaypipesjustinsb: the point is that Quotas have nothing to do with /images. They are a Rackspace-specific part of the Rackspace API.19:04
justinsbjaypipes: Which, unfortunately for you, is the Glance API19:04
justinsbjaypipes: Working on the link!19:05
jaypipesjustinsb: I don't know what you're talking about. the Glance API is not the Rackspace API.19:05
*** Ryan_Lane1 is now known as Ryan_Lane19:05
justinsbjaypipes: Don't shoot the messenger!19:05
jaypipeswtf are people talking about here... I thought it was a perfectly clear concept that quotas have ZERO to do with images.19:06
dprinceThe quotas I initially brought up where image property quotas.19:06
uvirtbotNew bug: #745965 in swift "Lookback Command Line Options For Log Processor Daemon" [Undecided,New] https://launchpad.net/bugs/74596519:07
*** gregp76 has quit IRC19:07
edayjaypipes: so, just trying to understand... if I wanted to use glance as a stand-alone image service, who would do the quota checking?19:08
jk0termie: mind having another quick looksee at that merge?19:09
justinsbhttps://lists.launchpad.net/openstack/msg00665.html  https://lists.launchpad.net/openstack/msg00786.html19:09
justinsbjaypipes: Those are the links19:10
justinsbjaypipes: But it was one of those meandering threads19:10
jaypipesdprince: that has nothing to do with Glance, though. That is the Cloud Servers API... the *compute* API. Glance will support limiting results using, say, ?offset=X&limit=Y, but in no way is the Glance API supposed to be a mirror of the Cloud Servers /images API, along with concepts that only apply to Cloud Servers API, like quotas.19:10
justinsbjaypipes: That's not what I interpreted from Jorge and Pvo's vision19:11
*** BinaryBlob has quit IRC19:11
justinsbjaypipes: Sounds like a design summit topic19:11
justinsbjaypipes: But I think you're going to end up with quotas unless you're very lucky ;-)19:12
cjreynbtorch, how did you roll back?19:13
jaypipesjustinsb: you wrote "A better approach is to simply provide a service catalog with list of endpoints, you can easily detect whether a volume service  is available etc". while that is true, that's pointless unless each endpoint can describe itself and its API.  Furthermore, if the /images endpoint is always supposed to be the same API, what is the point of having separate services publishing different APIs to begin with?19:14
justinsbjaypipes: Sadly I think I lost the argument, so there's not much point quoting me back to me :-)19:14
justinsbjaypipes: I agree that the "why" was very much missing from the thread19:15
*** sparkycollier has joined #openstack19:15
jaypipesjustinsb: I don't see how pvo's end vision in http://wiki.openstack.org/api_transition is at all contradictory to what I am saying above... that quotas (which are part of the Public API) have nothing to do with API of the image service.19:17
vishysirp_: are you here?19:17
dprincejaypipes: You gave me the info I need for now. I'll work up a quota patch for the OSAPI for this specific issue (which is in the SPEC). If Glance middleware eventually evolves into something cleaner maybe we can make use of that at some point in the future.19:17
dprinceSorry for the confusion. Just wanted to ask about Glance quota plans before I started in on things.19:18
justinsbjaypipes: The way I read pvo's "proxy" was as a dumb proxy.  I think you'If you read that as a "smart proxy" then19:18
justinsbjaypipes: Whoops... early enter key19:18
jaypipesjustinsb: in other words, the public API controller is the one that a) knows what the quotas are and b) updates those quotas. The image service shouldn't do either. The public API controller will send a message (REST or otherwise) to the image service containing the value of the quota (a limit), but the image service itself doesn't know what the quotas for the API are set to...19:19
vishyjaypipes, justinsb: general question about images.  What container format should a whole-disk-image have? Bare?19:19
jaypipesvishy: yes19:19
justinsbjaypipes: I read pvo's "proxy" as dumb.  You're reading it as "smart".  Pistols at the design summit :-)19:19
jaypipesjustinsb: :) ok.19:19
jaypipesjustinsb: what? you're saying pvo's dumb? pvo!19:20
* jaypipes runs and hides.19:20
justinsbjaypipes: Well, if pvo's around, I suppose he can clarify his thoughts for our benefit :-)19:20
justinsbjaypipes: But we really do need a design summit discussion to figure out where we're going here and make sure everyone's on the same page19:20
justinsbjaypipes: Because if nova assumes glance is doing it, and glance assumes nova is doing it, that's not really going to work!19:21
jaypipesjustinsb: my general theory is this: if it doesn't have to do with images, it doesn't belong in glance.19:21
justinsbjaypipes,vishy: Oh, the container_format for a whole disk image, are we using compression?19:22
justinsbjaypipes, vishy: Because I tend to use an 8G image which compresses down to say 250MB19:22
jaypipesjustinsb: no, vishy was just referring to what to set the container_format attribute of the image to...19:22
sirpvishy: hey19:22
vishyjustinsb: you can use a disk format like qcow219:22
justinsbjaypipes: I know, I'm asking a related but different question :-)19:22
vishysirp: hey i was just modifying a bit of your code19:22
jaypipesoh, sorry19:22
justinsbvishy: Any way to specify 'just the bits, maam' with compression?19:23
justinsbvishy: I'm asking for my notsovm code19:23
cjreynjustinsb, so shall I go ahead and post a bug report? I checked the database and the fields seem top be set correctly19:23
justinsbcjreyn: I think vishy is looking at it right now, hence his questions about container_format19:23
*** reldan has quit IRC19:24
justinsbcjreyn: But no harm in posting a bug report19:24
justinsbcjreyn: It'll presumably give vishy a bit more karma when he closes it19:24
justinsbcjreyn: And you may have some extra information to provide!19:24
cjreynjustinsb, ok cool. I had a working revision, pre-glance from ppa. Is there any way of installing from an old revision?19:24
cjreynjustinsb, karma eh!?19:24
justinsbcjreyn: No idea on the ppa stuff..  I tend to use the source.  Sorry!19:25
btorchcjreyn: sorry got dragged to a meeting ... I installed the debs that are cached19:26
cjreynbtorch, now worries. ok, where are they on ubuntu?19:26
btorchcjreyn: under /var/cache/apt/archives/ just installed the old nova pkgs from there19:26
justinsbjaypipes, vishy: So no compression? :-(  I know qcow2 is sparse, but it isn't compressed either, is it?19:27
btorchcjreyn: i got figure out what's up with this cause the only pkg I don't have cached is nova-volume and we need that now :(19:27
vishyjustinsb: i think we could support compression, and have logic to decompress on the other end19:27
justinsbvishy: But not yet... maybe a feature request for Diablo19:28
vishysirp: the lines are in _do_get_kernel_and_ramdisk19:28
sirpvishy: have a paste of the diff?19:28
cjreynbtorch, yeah i don't have that one listed. so it was as simple as purging the current pkg, then dpkg -i the cached versions?19:29
btorchcjreyn: yep19:29
btorchcjreyn: didn't purge anything19:29
vishysirp: if image_meta['properties']['disk_format'] != 'ami':19:30
vishysirp: changed it to if image_meta['container_format'] != 'ami':19:30
btorchcjreyn: just did a dpkg -i nova-doc_2011.2~bzr866-0ubuntu0ppa1~maverick1_all.deb ... and dpkg will take care of downgrading them19:30
vishybecause the formats aren't in properties, and i think it is the container format that is important there no?19:30
cjreynbtorch, ok, nice19:30
justinsbvishy: how about image_meta.get('container_format', 'ami') != 'ami': for safety?19:30
cjreynbtorch, I had a pre-glance revison working. Then updated a compute node and it ruined the cloud controller19:31
*** adiantum has quit IRC19:31
*** sebastianstadil has quit IRC19:31
vishyjustinsb: get seems good, i don't want to default it to ami there though, because it will try to grab the kernel and ramdisk for non ami images there19:31
sirpvishy, that's fine, we just need to update the ImageService contract so 'disk_format' and 'container_format' are required first-class attributes across the board, and then tweak the GlanceImageService to populate the field accordling..... assuming that's done, your patch should be good-to-go19:32
justinsbvishy: Sounds great!  Thanks for taking this on!19:32
*** gaveen_ has quit IRC19:35
vishysirp: yes there is a bug to update the docstrings on ImageService19:35
vishysirp: my basic plan is to essentially have image service use glances default format19:35
vishyand just treat local image service as sort of a "fake" glance client19:35
cjreynbtorch, did you have to set up a new database?  The problem I had was that the schema changed19:35
cjreynvishy, justinsb its late here in the ukso I have to go. Is there anything you need from me re this problem?19:37
btorchcjreyn: no I didn't, but from version 866 to the 913 the db version stayed on 13. I don't know or have checked the kind of db schema changes take place but if it's only adding new tables or fields to a table having it at a higher version may not be an issue since the old code would not use the new schemas ( that just an aggressive guess)19:39
btorchcjreyn: to be safe though I would create a new DB and start from scratch anyway19:39
cjreynbtorch, ok cool. cheers.19:40
vishyjustinsb, sirp, cjreyn: https://code.launchpad.net/~vishvananda/nova/fix-describe-images/+merge/5561719:40
uvirtbotNew bug: #745985 in nova "Support compressed raw images" [Undecided,New] https://launchpad.net/bugs/74598519:41
*** HouseAway is now known as AimanA19:43
*** jstinson has joined #openstack19:43
cjreynvishy, I've not looked at the source, but will defaulting to ami cause problems when uploading raw say kernel or ramdisks19:44
*** Zangetsue has quit IRC19:49
*** Zangetsue has joined #openstack19:53
*** sparkycollier has quit IRC19:53
*** vernhart has quit IRC19:55
*** joearnold has joined #openstack19:58
*** dprince has quit IRC19:58
*** sparkycollier has joined #openstack20:04
*** Ryan_Lane is now known as Ryan_Lane|food20:05
*** brd_from_italy has quit IRC20:08
*** nerens has quit IRC20:09
*** nerens has joined #openstack20:09
*** sparkycollier has quit IRC20:10
*** westmaas has quit IRC20:14
*** reldan has joined #openstack20:15
*** nelson has quit IRC20:17
*** nelson has joined #openstack20:17
nelsonThis is somewhat amusing: Example:20:18
nelson  st -A https://auth.api.rackspacecloud.com/v1.0 -U user -K key stat20:18
nelsonst: error: no such option: --A20:18
nelsonOh, --A. DOH!20:18
creihthaha20:19
btorchhmm  it should just be -A unless the code has changed ... I'm using 1.020:19
creihtwait... nelson are you saying it thinks -A is --A, or did you accidently use --A?20:20
*** vernhart has joined #openstack20:20
*** westmaas has joined #openstack20:21
*** westmaas has quit IRC20:21
*** westmaas has joined #openstack20:22
*** westmaas has quit IRC20:22
*** westmaas has joined #openstack20:23
*** gregp76 has joined #openstack20:24
*** pharkmillups has joined #openstack20:25
justinsbQuestion: Is there anything in OSAPI v1.1 that is not also in v1.020:25
uvirtbotNew bug: #746016 in nova "Limits response is not correct in OSAPI v1.1" [Undecided,New] https://launchpad.net/bugs/74601620:26
justinsbThat's the motivating bug for the question, BTW :-)20:26
bcwaldonjustinsb: Yes, there is. Mostly changes20:26
bcwaldonjustinsb: extensions comes to mind20:27
justinsbbcwaldon: Yes, I love extensions :-)20:27
justinsbbcwaldon: But anything else?20:27
bcwaldondo you have the specs?20:27
justinsbbcwaldon: I mean there's some element rearranging...20:27
bcwaldonjustinsb: changePassword action20:27
justinsbbcwaldon: I do have the specs20:27
vishycjreyn, if you are uploading kernels and ramdisks you should be setting container_format properly20:28
justinsbbcwaldon: Could we retrofit that into the v1.0 API if we had to?20:28
justinsbbcwaldon: I presume you can guess where I'm going with this...20:28
*** vernhart has quit IRC20:28
bcwaldonjustinsb: how about you just tell me20:29
justinsbbcwaldon: I'm wondering if we're going to be able to support both v1.0 and v1.120:29
justinsbbcwaldon: By Cactus20:29
bcwaldonjustinsb: not fully, but 1.0 isnt even supported yet20:29
bcwaldonjustinsb: we already have the versioning code in20:30
*** littleidea has quit IRC20:30
justinsbbcwaldon: I know we have a lot of v1.1 code in there.  I think it'll be a death march to get both v1.0 and v1.1 working in Cactus20:30
justinsbbcwaldon: because of issues like bug 74601620:30
uvirtbotLaunchpad bug 746016 in nova "Limits response is not correct in OSAPI v1.1" [Undecided,New] https://launchpad.net/bugs/74601620:31
bcwaldonjustinsb: I agree there is a lot of work to be done to separate the versions where they need to be20:31
bcwaldonjustinsb: but it is just a matter of getting it done, it isn't necessarily difficult20:31
*** littleidea has joined #openstack20:32
justinsbbcwaldon: OK!  It's not me that's death marching :-)20:32
bcwaldonjustinsb: the difficult part was establishing the conventions for versioning20:32
markwashjustinsb:is any part of the death march related to XML issues?20:32
jk0termie: you go night night?20:33
justinsbmarkwash: Not really... the XML schemas let us check more, but the real issue is that the data just isn't to spec20:33
termiejk0: lunch, just got back20:33
jk0:)20:33
*** hggdh has quit IRC20:33
justinsbmarkwash: I did think about dumping XML.20:33
justinsbmarkwash: If we dump XML though, it's much harder to check the JSON20:33
*** littleidea has quit IRC20:33
*** joearnol_ has joined #openstack20:34
*** RobertLaptop has quit IRC20:34
markwashjustinsb: :-)20:34
*** joearnold has quit IRC20:34
bcwaldonmarkwash: ;-)20:34
justinsbmarkwash, bcwaldon: I just see a lot of work for v1.1 and comparatively little payback.  But I'm hoping to understand the payback better!20:34
*** RobertLaptop has joined #openstack20:34
justinsbmarkwash: You want to dump the XML?20:34
markwashjustinsb: I don't see how the xml is going to work in Cactus20:35
*** hggdh has joined #openstack20:35
justinsbmarkwash: I think the XML will work if the JSON is to spec20:35
*** littleidea has joined #openstack20:35
*** littleidea has quit IRC20:36
justinsbmarkwash: But I agree that I don't see how we're going to get the JSON to spec in time :-)20:36
markwashjustinsb: interesting. I guess the limits bug is an example of this problem?20:36
jk0termie: thanks, you can see now why I did it the first way :)20:36
justinsbmarkwash: Yes, I think it's a fairly good example20:36
markwashjustinsb: cool I'll check it out20:36
justinsbmarkwash: It came up because the XML is much stricter about all this20:36
justinsbmarkwash: And the format changed between v1.0 and v1.120:37
justinsbmarkwash: Though I can't see why it changed for limits20:37
justinsbmarkwash: Which then led me to ponder what did motivate v1.1?20:37
justinsbmarkwash: And all that extra work!20:37
justinsbBrian Lamar pointed this out to me on this MP: https://code.launchpad.net/~justin-fathomdb/nova/bug740576/+merge/5444720:38
markwashjustinsb: I'm not really sure I can answer the question "why v1.1"20:42
markwashjustinsb: but I think the general idea is extensions and tweaks for extensibility20:42
justinsbmarkwash: I mean I think changePassword is a good answer20:42
justinsbmarkwash: But I don't understand the random tweaks20:42
markwashjustinsb: I'm not sure I understand them any better, so I'll have to refrain from comment20:43
justinsbmarkwash: Because I really want XML, and I was still debating whether we should dump it20:43
justinsbmarkwash: I think something's got to give.20:43
justinsbmarkwash: And I don't think dumping XML is the answer, because validating JSON is probably harder20:43
justinsbmarkwash, bcwaldon: I was thinking about proposing a super-limited v1.1 API, that would just have the bare minimums we need over v1.0 to do what made it into Cactus20:44
markwashjustinsb: so I'm all about validating stuff up front to make our parsing easier20:44
markwashjustinsb: but do we *need* validation20:44
justinsbmarkwash: Not sure what you mean by "up front".  I totally agree that we need validation though20:45
justinsbmarkwash: We have an awesome test suite in the form of our XML schema20:45
justinsbmarkwash: We just need to use it ;-)20:45
justinsbmarkwash, bcwaldon: Any reason not to just do a minimal v1.1 and revert out the "unnecessary" tweaks?20:46
justinsbmarkwash, bcwaldon: Where "unnecessary" will no doubt be the subject of intense flamewars :-)20:46
*** bkkrw has joined #openstack20:46
*** sebastianstadil has joined #openstack20:47
justinsbmarkwash, bcwaldon: Or rather, can you think of any reasons not to propose that on the ML?20:47
openstackjenkinsProject swift build #231: SUCCESS in 27 sec: http://hudson.openstack.org/job/swift/231/20:48
openstackjenkins* Tarmac: Remove boto dependency by implementing request canonicalization logic in swift3 middleware.20:48
openstackjenkins* Tarmac: fixed lockups and lost messages in swift-init and capture_stdio20:48
bcwaldonjustinsb: what would you deem "minimal" at this stage?20:48
markwashjustinsb: I think proposing it along with its motivations would be a good idea20:48
justinsbbcwaldon: Whatever we need to support the actions that v1.0 can't.  So, your example of changePassword is a great one...20:48
justinsbbcwaldon: It returns a new element "changePassword" I presume, which isn't in v1.020:49
justinsbbcwaldon: Sorry, didn't mean to just restrict to actions20:49
bcwaldonjustinsb: it doesn't return anything different, it supports POSTing a new entity20:49
justinsbbcwaldon: Whatever we need to support the functionality that v1.0 can't20:49
bcwaldonjustinsb: I understand, and I do agree with the idea20:50
bcwaldonjustinsb: but I don't think we can take this approach at this point20:50
justinsbbcwaldon: I dpm20:50
justinsbbcwaldon: Whoops20:50
openstackjenkinsProject nova build #753: SUCCESS in 2 min 36 sec: http://hudson.openstack.org/job/nova/753/20:50
openstackjenkinsTarmac: Handles situation where Connection._instances doesn't exist (ie. production)20:50
justinsbbcwaldon: I don't think it's a great option, and ideally you guys can get everything working in both v1.0 and v1.1 formats20:51
bcwaldonjustinsb: it is our main goal to get v1.0 and v1.1 as well supported as possible for cactus20:52
bcwaldonjustinsb: more of a focus on 1.120:52
justinsbbcwaldon: BTW, just checked, you're right, I misread the spec.  It's a new element that must be POSTed, not returned.20:52
*** Ryan_Lane|food is now known as Ryan_Lane20:52
*** johnpur has quit IRC20:53
justinsbbcwaldon: That's great - hopefully there's not as much work as I thought.20:53
bcwaldonjustinsb: most of our team's branches recently have been version-related issues20:53
justinsbbcwaldon: Another problem is that without a big v1.1 carrot, are clients going to bother porting to the v1.1 API20:53
justinsbbcwaldon: I know - you're all doing great stuff20:53
justinsbbcwaldon: If you think you can make the deadline, then I can drop it.20:54
bcwaldonjustinsb: we recognize there is still a lot of testing to get done to find all of these version-specific inconsistencies. And I agree, clients may not see the value in supporting v1.1 in cactus, and wait till diablo20:54
bcwaldonjustinsb: I can guarantee we won't meet the full v1.0 AND v1.1 specs by the cactus deadline20:55
justinsbbcwaldon: Would it be OK to propose it a fallback to the ML then for general discussion?20:55
bcwaldonjustinsb: what exactly would you want to propose?20:56
justinsbbcwaldon: That we consider making v1.1 experimental, possibly renaming it to v2...20:56
justinsbbcwaldon: And we redefine v1.1 to be a tiny set of extensions to v1.020:56
justinsbbcwaldon: Adding _only_ what is actually needed20:56
justinsbbcwaldon: And no 'nice to haves'20:57
justinsbbcwaldon: e.g. I see the list of atom URLs as a nice to have20:57
bcwaldonjustinsb: I do agree that it is a major version change. But you have to understand that the spec wasn't developed by the community. I do agree most of the changes in v1.1 shouldnt be there20:57
*** adiantum has joined #openstack20:57
justinsbbcwaldon: Do you mean "was developed by the community"?20:57
markwashlabeling it experimental for Cactus could be good20:57
openstackjenkinsProject nova build #754: SUCCESS in 2 min 30 sec: http://hudson.openstack.org/job/nova/754/20:57
openstackjenkinsTarmac: Avoid any hard dependencies in nova.virt.vmwareapi.vim.20:57
bcwaldonjustinsb: the spec came from a small group in rackspace, i.e. not the OS community20:58
justinsbbcwaldon: Oh great, I've just unearthed another land mine :-)20:59
termiejustinsb: ding ding ding20:59
bcwaldonjustinsb: didn't you wonder where that magical spec came from? And why it matches the Cloud Servers spec so closely?20:59
justinsbbcwaldon: I thought everyone else was on board21:00
bcwaldonjustinsb: yeah, it was accepted as a blueprint, so it was21:00
termiewhat is the acceptance process?21:00
justinsbbcwaldon: Oh no, this involves blueprints as well ? :-(21:00
bcwaldonjustinsb: yeah, stand by for link21:01
*** Glace has quit IRC21:01
termiejustinsb: anyway, i agree with bcwaldon here, i'm not a fan of the api nor how it came into being21:01
bcwaldonhttps://blueprints.launchpad.net/nova/+spec/openstack-api-1-121:02
justinsbI'm going to draft an email to the ML.  I want to make sure everyone's aware of the XML issues anyway. If anyone would like to see the email before I send it to avoid stepping on anyones toes (bcwaldon?), just let me know.21:02
*** ctennis has quit IRC21:02
bcwaldonso just to make it clear, the spec was proposed and accepted through the proper channels21:02
*** Glace has joined #openstack21:02
termiebcwaldon: it was automatically accepted21:03
termiebcwaldon: at the very least i certainly had no input on it nor anybody on my team21:03
justinsbI think this could be a scheduling/release issue.  i.e. we could defer the blueprint21:03
*** Ep5iloN_ has quit IRC21:03
justinsbI want at least one API that works 100%21:03
blamartermie: It was discussed on the ML for a while? I think the biggest hurt was this coming in between summits...21:04
justinsbAnd I'd like that to be the OS API21:04
termieblamar: it was discussed that we needed an api and various arguments were brought up, the blueprint itself was just marked accepted by somebody randomly21:04
bcwaldontermie: it was approved by Rick Clark21:05
termieblamar: long before the giant pdf that is the spec was even in existence21:05
justinsbCan we leave aside the blueprint acceptance for the moment...21:05
*** troytoma` is now known as troytoman-away21:05
justinsb...if the Titan team can do magic (as they have been doing) and get working APIs that's great21:05
*** pharkmillups has quit IRC21:05
justinsbBut there's a lot of work to be done, and I'm going to propose an option that could free up resources21:05
*** Ep5iloN_ has joined #openstack21:05
justinsbIf the Titan team says they've got it under control, they can smack me down on the ML :-)21:06
bcwaldonI dont think we can really accomplish much here in IRC at the moment. Send out an email to the ML describing your concerns and we will see what everybody thinks21:06
blamarbcwaldon: Agreed21:06
justinsbWill do... wanted to run it by the IRC crowd first to get a better understanding before the ML email.  I think I've got that, so I will email the ML.  Thanks!21:07
bcwaldonjustinsb: Good idea. Glad we could help21:08
openstackjenkinsProject nova build #755: SUCCESS in 2 min 30 sec: http://hudson.openstack.org/job/nova/755/21:09
openstackjenkinsTarmac: Add obviously-missing method that prevents an Hyper-V compute node from even21:09
openstackjenkinsstarting up21:09
*** adiantum has quit IRC21:13
*** ctennis has joined #openstack21:14
*** ctennis has joined #openstack21:14
openstackjenkinsProject swift build #232: SUCCESS in 27 sec: http://hudson.openstack.org/job/swift/232/21:16
openstackjenkinsTarmac: Added two command line options to bin/swift-log-stats-collector.21:16
*** YellowMenace has joined #openstack21:24
*** h0cin has quit IRC21:25
*** YellowMenace has quit IRC21:25
*** allsystemsarego has quit IRC21:26
*** jaypipes is now known as jaypipes-afk21:31
*** joearnol_ has quit IRC21:32
*** hadrian has quit IRC21:33
*** joearnold has joined #openstack21:33
*** littleidea has joined #openstack21:36
*** joearnol_ has joined #openstack21:43
*** joearnold has quit IRC21:46
*** spectorclan_ has joined #openstack21:47
*** _vinay has joined #openstack21:50
_vinayHi,21:50
*** bcwaldon has quit IRC21:50
*** jfluhmann has quit IRC21:51
_vinaythe nova.sh script for installation, uses kvm as virtualization software right?21:51
*** miclorb has joined #openstack21:51
uvirtbotNew bug: #746068 in swift "stats system needs to better track differences between clients and load balancers" [Low,Confirmed] https://launchpad.net/bugs/74606821:51
spectorclan_OpenStack Design Summit - Registration at 287; PLEASE REGISTER TODAY if you plan to come; only have 350 slots (http://openstack.org/register)21:51
*** jfluhmann has joined #openstack21:55
*** dragondm has quit IRC21:56
vishy_vinay: kvm or qemu yes21:57
*** mray has quit IRC22:04
*** spectorclan_ has quit IRC22:05
*** ppetraki has quit IRC22:06
*** lionel has quit IRC22:06
btorchvishy: u got a sec ? I'm having some problems trying to get a uec image to boot using the nova client ... I have uploaded the kernel and img with the nova-mange but no ramdisk.22:08
*** gondoi has quit IRC22:10
*** reldan has quit IRC22:14
*** reldan has joined #openstack22:17
vishyhmm22:18
vishydoes that work?22:18
vishy:)22:18
vishyI just put out a patch to make the kernel and ramdisk thing easier22:19
*** lionel has joined #openstack22:19
vishyI would just put a blank ramdisk in if it isn't needed22:19
btorchvishy: I still using an older nova version on this node that I have glance .. since I'm still troubleshooting the other node that I have with the latest trunk . I can't reach the VMs on the latest trunk22:20
btorchvishy: I have registered the image and kernel and then used glance to set the ramdisk=None since it wasn't set22:20
*** dmshelton has quit IRC22:21
*** aixenv2 has joined #openstack22:21
btorchvishy: but whenever I try to nova boot the image is complains that there is no ramdisk and quits22:21
btorchanyway got take the dog out .. brb22:21
*** dubsquared has quit IRC22:21
*** gregp76 has quit IRC22:22
*** aixenv has quit IRC22:22
*** reldan has quit IRC22:23
vishybtorch: yes i don't think nova supports that22:27
vishyyou need a null ramdisk22:27
*** santhoshtw has quit IRC22:32
*** Zangetsue has quit IRC22:32
*** anotherjesse has joined #openstack22:38
*** kapil has joined #openstack22:39
*** kapil has joined #openstack22:41
uvirtbotNew bug: #746088 in nova "nova with glance image problem" [Undecided,New] https://launchpad.net/bugs/74608822:41
anotherjesseAny experts at ubuntu/debian preseed automation?22:42
anotherjesseI'm having aperiodic issues with needing to hit return on "Partition Disks" - "Write the changes to disks?" - screenshot - http://twitpic.com/4f3liy22:43
_vinayvishy, so which one? kvm or qemu??22:44
_vinayI see this line in nova.sh22:44
_vinayLIBVIRT_TYPE=${LIBVIRT_TYPE:-qemu}22:44
_vinayI installed using nova.sh install22:44
_vinayis there a way from cmd line to find out what was installed?22:44
vishyit defaults using to qemu22:45
vishyit is a run param though22:45
vishyqemu == software kvm22:45
vishyso you can change it to kvm when you run22:45
vishyif your hardware supports it22:46
_vinayright, ok so run using ./nova.sh run22:46
_vinayso I assume default its using qemu22:46
_vinaycool.. makes sense .. thx.. I will figure out how to change to kvm from cmd line :)22:47
_vinaybtw: do you know if xen is supported as well ? vishy22:49
*** jstinson has quit IRC22:50
vishy_vinay: xen is supported through libvirt (largely untested)22:51
*** reldan has joined #openstack22:51
vishyand XenServer is also supported natively22:51
vishyinstall instructions for XenServer here: http://wiki.openstack.org/XenServerDevelopment22:53
*** joearnol_ has quit IRC22:54
*** gregp76 has joined #openstack23:00
_vinayok great.. thanks for pointing out the link23:00
vishy_vinay: swich to kvm by changing the line above from :-qemu to :-kvm23:04
vishyor23:04
vishysudo LIBVIRT_TYPE=kvm ./nova.sh run23:05
*** bkkrw has quit IRC23:05
*** MotoMilind has quit IRC23:23
*** adjohn has joined #openstack23:26
*** MotoMilind has joined #openstack23:27
*** MotoMilind has quit IRC23:32
*** gregp76 has quit IRC23:36
*** vernhart has joined #openstack23:36
_vinaygreat thanks vishy23:37
*** joearnold has joined #openstack23:41
*** littleidea has quit IRC23:44
*** jeffjapan has joined #openstack23:52

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!