15:00:07 #startmeeting 15:00:08 Meeting started Tue Jul 31 15:00:07 2012 UTC. The chair is primeministerp. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:00:09 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:00:21 #topic Hyper-V 15:00:34 Howdy everyone 15:00:56 I sent out the topics for discussion to the list 15:01:16 • Status of the Mock Hyper-V Compute 15:01:16 • Move from Essex to Folsom 15:01:16 o Installer is for essex integration 15:01:16 • Hyper-V Testing Procedures 15:01:16 o Dev stack for hyper-v testing 15:01:19 o Chef for Windows automation 15:01:39 We'll go through those now 15:02:01 #topic Hyper-V Moc driver 15:02:24 Alessandro and I have been working to put together a plan of attack 15:02:37 alexpilotti: care to add some input 15:03:22 In a nutshell he is in the process of the implementing the wmi moc interface 15:05:09 alexpilotti: needs a minute 15:05:16 we'll come back to this 15:05:53 #topic Upstream Code integration 15:06:25 Work needs to begin to integrate the upstream code 15:06:38 pnavarro: is this something you can begin looking at 15:07:16 pnavarro: we know we have issues w/ the glance, python-novaclient 15:07:24 * primeministerp looks up the other 15:07:43 primeministerp: yes we have, some packages are not compatible with windows 15:07:52 pnavarro: right 15:07:58 so wee need to flush those out 15:07:59 hi guys! 15:08:04 and have the code put in to exclude it 15:08:20 alexpilotti: great 15:08:46 pnavarro: hi! 15:08:54 hi alexpilotti 15:08:54 pnavarro: i'll be able to flush this out once testing is underway 15:09:07 pnavarro: and hopefully supply useful bits for bugs 15:09:37 pnavarro: can you expand on what you know? 15:10:45 so 15:10:52 no hitesh today 15:10:55 ok 15:11:08 so I guess what needs to happen is people need to manually install the bits 15:11:26 to see exactly these incompatibilites exist 15:11:31 pnavarro: do you have a list of the packages that were incompatible in your setup? 15:11:35 and then notify the people upstream 15:11:38 alexpilotti: i Have that 15:11:49 alexpilotti: at least some of it 15:11:50 pnavarro: I'd like to cross check as well so we can file up the relevant bugs 15:11:50 one sec 15:12:00 from glance, xattr and pysendfile are incompatible 15:12:40 so 15:12:43 this is whyat i have 15:12:54 glance 2012.2 15:13:02 anyjson 0.3.2+ 15:13:18 pnavarro: pysendfile and xattr are dependencies of another package I guess. Glance itself? 15:13:18 python-novaclient-2.6.0 15:13:54 alexpilotti: yes, they are dependencies introduced in glance Folsom 15:14:05 pnavarro: then we need to file an upstream bug asap 15:14:14 pnavarro: do you have enough data to file a bug 15:14:31 primeministerp: but, it can be considered as a bug? 15:14:45 pnavarro: well we need to make someone aware 15:14:51 pnavarro: or we need to fix it 15:15:45 pnavarro: do we need to include new deps 15:16:14 primeministerp: what it's clear, they need to be considering windows when introducing new deps 15:16:22 pnavarro: correct 15:16:28 jaypipes: ping 15:16:59 primeministerp: pon 15:17:01 g 15:17:02 primeministerp: if filing a bug it's the way... why not... 15:17:16 pnavarro: I'm going to do a full folsom setup so that we can compare the results 15:17:20 jaypipes: is filing a bug the best way to get windows considered when creating deps 15:17:26 er introducing deps 15:17:28 for example 15:17:32 pnavarro: xattr afaik is a Linux specific package 15:17:43 glance now requires xattr 15:17:43 pnavarro: *nix non linux 15:17:54 which is a *nix only package 15:18:05 and breaks hyper-v integration 15:18:15 primeministerp: glance does NOT require xattr. I specifiically removed the xattr requirement so that the image cache could work on windows.' 15:18:22 o sorry 15:18:25 pnavarro: if that's the case, we have to get it out of Glance, starting w a temporary patch workaround 15:18:34 jaypipes: something is requiring xattr 15:18:59 jaypipes: is that in the current versions? 15:19:13 jaypipes: maybe we haven't tried w/ the newer stuff since then 15:19:14 jaypipes: i found it in pip-requires in F2 tar.gz 15:19:23 primeministerp: well, I'm positive xattr is not needed :) perhaps this is a packaging thing? maybe xattr has been left in the packaging deps by accident. 15:19:46 primeministerp: you could certainly file a bug to remove it from pip-requires (and put it in test-requires) 15:20:24 pnavarro: can you add your data to a new bug re: ^^^^ 15:20:32 primeministerp: best to file a bug, sure, and assign it to me. 15:20:52 jaypipes: thanks!! 15:20:53 primeministerp: I'll move it from pip-requires to test-requires, but I'll bring mtaylor in to ensure it's not listed in any package deps. 15:20:55 jaypipes: and what about pysendfile, it's used? 15:21:09 pnavarro: not a requirement, same as xattr.. 15:21:21 pnavarro: it's used if available, ignored if not. 15:21:36 pnavarro: were you using the installer for setting up the environment? 15:22:00 pnavarro: can you cc me on the bug as well 15:22:20 primeministerp: ok ! 15:22:33 pnavarro: perfect 15:22:36 pnavarro: thx 15:22:59 jaypipes: ok 15:23:01 er 15:23:02 ok 15:23:04 alexpilotti: That happened when jordan installer version was installing Folsom versions of glance 15:23:40 jaypipes: what version of Glance should we use for Folsom? 15:24:23 alexpilotti: Folsom :) 15:24:29 jaypipes, primeministerp: I am not the right person for removing it from pacakge deps 15:24:35 jaypipes: lol 15:24:40 but I support the moving of it to test-requires 15:24:41 mtaylor: zul? 15:24:46 jaypipes: yah 15:24:50 mtaylor: gotcha. will do. 15:24:53 jaypipes: and whoever does stuff for redhat 15:25:00 ayoung: ping 15:25:08 hey primeministerp 15:25:32 mtaylor: hmm? 15:25:34 jaypipes: we need someone from rh in the discussion for removing it from package deps? 15:25:55 primeministerp, is this a nova thing? markmc is your man 15:26:00 ayoung: thx 15:26:27 mtaylor: is zul the person to talk to re: the package deps? 15:26:44 primeministerp: yeah, but I'll take care of that if you assign me the bug 15:26:49 jaypipes: perfect 15:27:06 ok 15:27:09 we'll move on 15:27:18 cheerio 15:27:23 let's note bug to be filed, assigned to jaypipes 15:27:57 #topic hyper-v moc interface 15:28:23 jaypipes: what's your launchpad ID ? 15:28:33 pnavarro: should be jaypipes 15:28:35 i believe 15:29:14 pnavarro: if you paste the link to the bug I can add it to the meeting notes 15:29:19 yup 15:29:33 jaypipes: launchpad id for pnavarro 15:29:37 to add you to the bug 15:29:45 https://bugs.launchpad.net/glance/+bug/1031396 15:29:47 Launchpad bug 1031396 in glance "xattr and pysendfile dependencies broke Hyper-V integration" [Undecided,New] 15:30:05 #link https://bugs.launchpad.net/glance/+bug/1031396 15:30:28 #topic hyper-v/chef 15:30:47 :) 15:30:48 ok let's dicuss work to automate the provisioning and prep for a hyper-v compute node 15:31:13 I have implemented the chef infrastructure in my lab and began the process of gathering 15:31:30 all the windows chef recipes we can use as a base for our hyper-v efforts and ci integration 15:32:18 so 15:32:33 mattray: is from opscode and he has offered to help us in this process 15:33:00 ok, let me level set real quick 15:33:08 mattray: yes 15:33:12 mattray: please do 15:33:14 jaypipes: I couldn't change the assignee of the bug to you 15:33:27 mattray: i was thinking from a guidence perspective 15:33:35 opscode.com/openstack describes the Chef for OpenStack project and links to the ML and IRC channel 15:33:54 we have a WIP for deploying openstack with chef based on Rackspace's cookbooks 15:34:13 mattray: are those specific to essex? 15:34:15 lots of folks are working on it, the key is that it's very modular and Chef already has good support for Windows 15:34:23 currently, Folsom work probably starts next week 15:34:32 mattray: exactly i'm using the existing cookbooks as a base 15:34:59 mattray: execelent, our work is specifically for configuring a hyper-v node to work w/ our openstack compute driver 15:35:04 there is a nova/compute recipe that I plan on pulling all the kvm support out and into another cookbook 15:35:16 mattray: interesting 15:35:31 once that supports pluggable back-ends, hyper-v will be a reasonable backend 15:35:37 (initially it will be lxc and kvm) 15:35:42 just following the same patterns 15:35:46 mattray: execelent 15:35:57 you also need glance-client right? 15:36:05 and keystone-client? 15:36:27 mattray: no 15:36:39 mattray: we only install nova 15:36:49 mattray: no, we don't 15:37:15 mattray: opscode openstack cookbooks are the same that crowbar ones? 15:37:22 pnavarro: no 15:37:29 pnavarro: forked off awhile back by Rackspace 15:37:35 Dell is coming back to these eventually 15:37:41 pnavarro: I just did a pip install glance on a clean VM 15:37:54 mattray: then we should coordinate 15:37:55 pnavarro: I can confirm that I had the same error you had 15:38:02 primeministerp: definitely. 15:38:07 pnavarro: there's an xattr dependency 15:38:09 alexpilotti: thanks to confirm ! 15:38:10 mattray: so when i add our building out of nova-compute 15:38:10 pnavarro: I'll assign myself... 15:38:35 jaypipes: ok, thanks ! 15:38:43 jaypipes: I did pip install glance, I confirm the xattr dep 15:39:18 mattray: i can hopefull use some of the upstream bits as well 15:39:22 mattray: specific to nova 15:39:23 jaypipes: for Folsom, should we get Glance from its github's active branch? 15:39:43 jaypipes: or can we relay on pip? 15:39:51 pnavarro: done 15:40:08 alexpilotti: uhm... the client or the server? 15:40:12 primeministerp: sure. The loose plan is that sometime next week we'll start coordinating on folsom deployments and source builds. This will lend itself well to hyper-v support 15:40:27 jaypipes: client, running on hyper-v's nova-compute nodes 15:40:35 alexpilotti: from PIP. 15:40:39 mattray: are you expecting to have a nova chef deployment be agnostic 15:40:51 i.e. 15:41:00 jaypipes: ok, we need a quick workaround to get rid of xattr 15:41:05 i just have a nova recipe and it is already platform independent 15:41:49 alexpilotti: yup, onit. 15:41:58 jaypipes: tx! 15:42:21 primeministerp: I think we can work to accommodate deploying on Windows, either by attributing-out anything platform specific or with a separate recipe 15:42:32 mattray: ok then 15:42:42 mattray: i was going to build a seperate recipe 15:42:46 primeministerp: there will be a lot of recipes, we'll just have to have good documentation and roles to accomodate that 15:42:47 mattray: i'll continue on that path 15:43:07 mattray: hopefully I can reuse a lot of what's there and transliate it to windows 15:43:13 yeah 15:43:16 mattray: when you typicall deploy 15:43:26 mattray: are you doing it from package or source? 15:43:31 mattray: or both 15:43:44 primeministerp: currently packages. We're working on a strategy for source 15:44:00 mattray: and for python deps, pip or also packages? 15:44:05 all the above 15:44:13 you show up with the code, we'll find a way to accomodate 15:44:15 mattray: perfect 15:44:17 hehe 15:44:19 ok 15:44:29 mattray: i'm going to need help running it 15:44:31 as long as other stuff doesn't get broken, we'll kick to fit 15:44:39 mattray: at least from a understanding how to push to all nodes 15:44:47 yeah, #openstack-chef is where we gather 15:45:02 mattray: ok i'll hop in there 15:45:07 and I'm usually online, and #chef is full of 400+ helpful people 15:45:16 mattray: perfect 15:45:43 on that note 15:45:55 let's quickly go through the bits that need to be set for windows 15:46:04 1. disable all fw's 15:46:10 2. enable iscsi target svs 15:46:16 3. set ntp 15:46:26 4. set diskpart std policy 15:46:34 jaypipes: by looking at the install log, I notice that it has also "greenlet" as a dep 15:46:42 5. live migration enablement 15:46:47 6. enable powershell 15:46:54 jaypipes: building green let fails, I'm adding a comment to the bug 15:47:04 pnavarro: anything else to add to that list 15:47:18 primeministerp: it's ok for me 15:47:18 7. enable hyper-v role if server is not hyper-v server 15:47:42 8. configure bridge interfaces 15:48:07 those are the specific for hyper-v 15:48:08 pnavarro: I noticed that compiling green let fails not (or not yet) xattr 15:48:19 for nova, we have the following 15:48:24 pnavarro: *greenlet 15:48:25 that needs to be addressed by chef 15:48:42 1. installation of python 15:48:54 2. pip install of python deps 15:49:02 3. install hv code from src 15:49:11 also 15:49:15 1 install python 15:49:27 1 & 2 sound like we need to update the python cookbook for windows support 15:49:34 #3 will probably use the git resource 15:49:40 2 run installation from the openstack hyper-v installer 15:49:47 mattray: i have one 15:49:50 mattray: that i found 15:49:58 mattray: i was planning on updating it today 15:50:08 primeministerp: cool 15:50:14 mattray: we use 2.7.x 15:50:22 feel free to follow up with me directly and I'll help get your patches upstreamed quickly 15:51:02 mattray: if i'm going send it upstream and I have to sign the contrib, it could take time 15:51:15 i'll have to get that into lcs 15:51:16 yeah, we need to get on that ASAP 15:51:17 er lca 15:51:25 mattray: do you have the link 15:51:32 primeministerp: wiki.opscode.com/display/chef/How+to+Contribute 15:52:23 mattray: how different is it than the openstack agreement 15:52:31 it's the Apache CLA 15:52:41 standard 15:52:42 s/Apache Foundation/Opscode, Inc./ 15:52:42 ? 15:52:47 ok 15:53:03 it got through VMware, Dell & HP so it's not impossible ;) 15:53:26 mattray: ok then, I'll start that process today 15:53:52 ok 15:54:08 we'll I guess we can use that as a base 15:54:19 I'll send out a email to the list as soon as my starting point is online 15:54:41 mattray: i'll send that to lca today 15:54:42 ok, I'll be sure to follow up on the posts outlining how we'll be collaborating 15:54:51 perfect 15:55:14 ok let's see what's left to discuss 15:56:30 #topic Status of Hyper-V ci Infrastructure 15:56:36 so 15:56:40 good news 15:57:05 I have been given an asa and have configured it to support the circuit i am waiting to be pulled to my rack 15:57:45 once that is done i will have control of the network infrastructure and can begin building out the pxe infrastructure to support the deployment of the hyper-v nodes 15:58:00 additionally i have provisioned vpn access throught the asa 15:58:06 for individuals to debug 15:58:13 primeministerp: that's great ! 15:58:28 additional work will need to be done to get a centralized auth infrasturcutre and other long term bits 15:58:31 however 15:58:32 as a start 15:58:37 we have some something secured 15:58:40 to use 15:59:21 once I have this in place I will also be able to complete tie into gerrit, as I currenlty have no outbound ssh 15:59:59 anything anyone else want to add? 16:00:33 ok 16:01:54 ok 16:02:04 if that it i'm ending the meeting 16:02:06 thanks everyone 16:02:10 #endmeeting