Tuesday, 2013-01-15

*** jog0_ has joined #openstack-meeting-alt00:58
*** jog0 has quit IRC01:04
*** jog0_ is now known as jog001:04
*** juice has quit IRC01:37
*** kaganos has quit IRC01:39
*** juice has joined #openstack-meeting-alt02:12
*** amyt has joined #openstack-meeting-alt02:36
*** robertmyers has joined #openstack-meeting-alt03:24
*** robertmyers has quit IRC03:48
*** robertmyers has joined #openstack-meeting-alt03:48
*** esp has joined #openstack-meeting-alt03:58
*** robertmyers has quit IRC05:29
*** robertmyers has joined #openstack-meeting-alt05:29
*** robertmyers has quit IRC05:34
*** amyt has quit IRC13:40
*** grapex has joined #openstack-meeting-alt14:31
*** grapex has joined #openstack-meeting-alt14:32
*** robertmyers has joined #openstack-meeting-alt14:32
*** jcru has joined #openstack-meeting-alt15:11
*** djohnstone has joined #openstack-meeting-alt15:23
*** cp16net|away is now known as cp16net15:26
*** jcru is now known as jcru|away15:45
*** jcru|away is now known as jcru15:51
*** amyt has joined #openstack-meeting-alt16:18
*** amyt has quit IRC16:18
*** amyt has joined #openstack-meeting-alt16:18
*** esp1 has joined #openstack-meeting-alt16:56
*** esp1 has left #openstack-meeting-alt16:57
*** cp16net is now known as cp16net|away17:22
*** kaganos has joined #openstack-meeting-alt17:28
*** cp16net|away is now known as cp16net18:13
*** juice has quit IRC18:56
*** juice has joined #openstack-meeting-alt19:14
*** vipul is now known as vipul|away20:10
*** vipul|away is now known as vipul20:10
*** vipul is now known as vipul|away20:25
*** vipul|away is now known as vipul21:13
*** esp has joined #openstack-meeting-alt21:22
*** esp has left #openstack-meeting-alt21:23
*** saurabhs has joined #openstack-meeting-alt21:23
*** hub_cap has joined #openstack-meeting-alt21:46
*** esp has joined #openstack-meeting-alt21:55
*** dkehn has joined #openstack-meeting-alt21:58
*** SlickNik has joined #openstack-meeting-alt21:59
*** ddemir has joined #openstack-meeting-alt22:00
hub_caphi all lets give a sec for stragglers22:00
*** jog0 has left #openstack-meeting-alt22:00
vipulsup22:00
steveleonhello22:00
SlickNikhello guys 'n gals...22:00
hub_cap#startmeeting22:00
openstackhub_cap: Error: A meeting name is required, e.g., '#startmeeting Marketing Committee'22:00
juicepresent22:00
hub_capLOL22:00
hub_cap#startmeeting reddwarf22:00
openstackMeeting started Tue Jan 15 22:00:58 2013 UTC.  The chair is hub_cap. Information about MeetBot at http://wiki.debian.org/MeetBot.22:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.22:01
*** openstack changes topic to " (Meeting topic: reddwarf)"22:01
vipuli see you're rusty22:01
openstackThe meeting name has been set to 'reddwarf'22:01
hub_capvipul: yes i am22:01
hub_capso i updated the meeting notes a bit22:01
*** jdbarry has joined #openstack-meeting-alt22:01
hub_cap#link http://wiki.openstack.org/Meetings/RedDwarfMeeting22:01
*** datsun180b has joined #openstack-meeting-alt22:01
cp16nethi22:01
datsun180bhello22:01
espgreetings22:02
grapexYo22:02
SlickNikI see.22:02
hub_capi just screamed 'meetings now' to our team so they should be comin in22:02
vipulfull house22:02
SlickNikI like the "MERGED!" part of the notes. :P22:02
hub_capso lets start w/ action items22:02
hub_capSlickNik:  ;)22:02
hub_cap#topic action items22:02
*** openstack changes topic to "action items (Meeting topic: reddwarf)"22:02
cp16netya!22:03
hub_capvipul: had a chance to file a BP for quotas?22:03
vipulNo, not yet, obviously you heard about our policies changing again22:03
hub_capOHHHH ya22:03
hub_capill file a dummy for ya22:03
vipulk, put it back on my plate though22:03
hub_capwill do22:03
jcooleybest if you guys file-em and we edit for now.  we'll take our existing ones through the process22:03
hub_cap#action Vipul to file blueprint on quota support in Reddwarf22:04
hub_capyup jcooley ill do that22:04
hub_capjust hit me up if u need one filed22:04
vipulk22:04
jcooleythanks!22:04
hub_capso next one says dan, assuming esp?22:04
vipulesp it is22:04
espyep22:05
*** yidclare has joined #openstack-meeting-alt22:05
hub_capwas it esp who filed the BP? Dan file a blue print for planning testr -> reddwarf22:05
hub_capthe last bp22:05
espyep, that was me.22:05
hub_capok so u have done that then nice22:05
espprobably could use some edits22:05
hub_capcool. lets look it over, ill action that22:05
espyes sir, I have it marked done (completing a BP) on our end22:06
hub_cap#action vipul SlickNik grapex hub_cap to look over the testr BP22:06
espthx22:06
hub_capesp: so u cancelled it out? do we need a new bp?22:06
SlickNikCool, will look it over. Thanks esp…22:06
espOh yeah?  that was silly22:06
esplet me take a look at it.22:06
vipul#link https://blueprints.launchpad.net/reddwarf/+spec/testr-unit-tests22:06
hub_capvipul: check out blueprint-test-222:06
hub_capu can use that one22:07
vipulhub_cap: thanks22:07
hub_capok nice vipul on that link22:07
hub_capnext, imma assume we have not talked aobut22:07
hub_capthe ongoing debate :)22:07
hub_cap#action SlickNik, hub_cap, juice, vipul talk to mordred about housing multiple images (elements) in reddwarf22:07
vipuldkehn may have some updates?22:07
juiceyowsers22:07
juicestill open22:07
dkehnI have been talking to mordred about that22:08
juicemordred is back22:08
juicetry to close this one out today22:08
espthat BP looks like my work, I can see a bunch of typos and run-on sentences22:08
hub_capya? whats the story22:08
dkehnand he belives that the build code should go into reddwarf,22:08
dkehnthis can be conditionally called or not to avoid testing issues22:08
*** lifeless has joined #openstack-meeting-alt22:08
dkehnin the future we are most likely going to have more (i.e. mariaDB, etc.)22:09
dkehndrizzle22:09
dkehnetc.22:09
vipulhub_cap, dkehn: let's try to get mordred into #reddwarf and hash this out22:09
hub_capcool. id like to have a chat w/ him about it too... so lets bring it in to the open sometime this wk22:09
dkehnif someone is not supporting ti they should exclude it22:09
hub_capnot today tho :)22:09
dkehnmade the request22:09
hub_capthx22:09
hub_capso lets talk volume support cp16net vipul22:09
hub_capthats the next action item22:10
hub_capi dont have much context on that.. can yall fill me in22:10
vipulvolume-support seems to be work as advertised22:10
cp16neti did not get to looking into much22:10
vipulI think there were some issues before ,but those may be resolved by cp16net22:10
hub_capso is this a action item? or can we move on22:10
vipulafaict, it's good for now22:11
SlickNikI was able to use volumes too.22:11
hub_capsweet22:11
cp16netcool22:11
SlickNikI think it's working now.22:11
hub_capSlicknik, your turn22:11
SlickNikSo might not be an issue.22:11
espI think we are good on volume support22:11
hub_capconfiguring gate to run devstack with reddwarf's local.sh22:11
hub_capany update to that sucker22:11
SlickNikHad to make some changes to local.sh and redstack22:12
SlickNikRunning with juice's new imagebuilder and still working on making sure the tests are all green.22:12
SlickNikSo still work in progress.22:12
hub_capcool should we put the same AI on next wks? care to reword it?22:13
SlickNikDkehn's made some good headway into looking into the vm-gate integration.22:13
hub_capgood deal. im also working on it in cloud server land22:13
dkehnyes, we have a working model, heaviely modifuled and running into issues22:13
vipulyea, let's try to get the int-tests running in cloud servers, since that's where jenkins will run the gates22:13
SlickNik#action Slicknik working on making integration tests run post devstack install + local.sh run for CI22:14
dkehnWebOb, glance 1.0.8 issues22:14
hub_capim trying to get the int-tests runnin on the cloud servers22:14
vipulhub_cap, i'm trying to get them running in hpcloud server22:14
hub_caphuh? ive got everything runnin except i have routing issues22:14
hub_capw/ the local ip22:14
hub_capfrom teh bridge....22:14
hub_capive gone thru these issues before and fixed them w/ some networking fu22:15
espmaybe check /etc/hosts to see if you have an entry for 127.0.1.1 ?22:15
grapexQuick note re: volumes - looks like the resize volume test isn't enabled.22:15
grapexI'll file a bug on it22:15
hub_capgrapex: <322:15
juicewonder if those are the same issues SlickNik was having22:15
SlickNik#action dkehn slicknik working on setting up CI integrating reddwarf tests with devstack-vm-gate22:15
hub_capnaw esp it has to do w/ routing, and the bridge, and the eth device its on, w a little nat masquerading fu to get out to the real world for apt-get22:15
hub_capi should have more info tomorrow22:16
espgotcha22:16
hub_capand give u guys a script of what we have to run in the vm-gate22:16
dkehnhub_cap, please ping me with it22:16
vipulhub_cap: is this different thna the scripts that are in openstack-ci?22:16
hub_capdkehn: u will see it for sure22:16
hub_capvipul: it will be different22:16
dkehnk22:16
hub_capbecuase they dont really care about what goes on _in_ the vm22:17
hub_capthey just make sure it spawns and goes to active rigth?22:17
dkehny22:17
hub_capwe have to log in, and install a guest, and have that guest talk to the world22:17
hub_capso its tricky22:17
dkehnthere is an issue though with what I mentioned previously https://review.openstack.org/#/q/status:open+message:webob,n,z22:17
grapexhttps://bugs.launchpad.net/reddwarf-integration/+bug/110005822:17
hub_capill give u guys the info, and let u work w/ mordred to decide if its _ours_ or belongs in openstack-ci22:17
dkehnconcerning the glance pip-requires22:17
vipulhmm, ok - although that shoudl be done by our tests..22:17
SlickNikhub_cap: FWIW, I was having bridge issues between the host and guest after the diskimage-builder changes.22:18
vipulunless there is stuff that needs to happen on the host, which may be the case22:18
hub_caphmm, i havent seen those SlickNik... and i havent updated the cloud server im on to use the new builder changes22:18
hub_capvipul: this is all host stuff22:18
vipulk22:18
SlickNikhub_cap: Still working through them22:18
hub_capits tweaking the host so that it can talk out and that it can route properly22:18
SlickNikhub_cap: Will keep you posted if I find something.22:18
hub_capSlickNik:  lets chat tomrrow then22:18
hub_capmaybe i can help u22:18
hub_capive dealt w/ bridges and routing like 100 times at this point22:19
SlickNikcool, sounds good.22:19
hub_capand banged my head bloody > 1 time22:19
hub_capok so now for esp add unit testing details to testr blueprint sqlite vs fakes22:19
SlickNiklol, I'm almost there.22:19
hub_capok cool SlickNik if u arent lets chat tomorrow22:19
SlickNikcool, thanks!22:20
kaganoshub_cap: just making sure, you're not using virtual ip's, right?22:20
vipulfloating ips?22:20
hub_capkaganos: naw22:20
kaganosyep, sorry ...22:20
hub_capand naw22:20
hub_capfixed ip from the bridge 10.0.0.X22:20
SlickNikyep, same here.22:21
vipulesp: i think you're up22:21
kaganosok, cause if you set those up, then you can't access out ...22:21
esphub_cap: I'll try flesh out the details of that BP regarding sqlite/fakes22:21
hub_capok if u need a fakie created esp hit me up22:21
hub_capjust a fyi, i filed a BP to make fakes external to the codebase, using fake rabbit.. there is still an issue w/ the implementations for nova/guest etc... but at least itll address that22:21
esplast we discussed I think we decided to use both strategies22:21
hub_capyes its VERY nice to have the fakes run. its worth its weight in gold at present for a developer22:22
espok, I'll checkout that BP as well22:22
hub_capesp: k22:22
hub_capaight done w/ the action items! woo22:22
hub_cap22min good job team22:22
SlickNiksweet22:22
hub_cap#topic Testing updates22:22
*** openstack changes topic to "Testing updates (Meeting topic: reddwarf)"22:22
datsun180bA new record?22:22
hub_capfirst one is CI, sholdve prolly added that to topic22:23
hub_capdatsun180b: me thinks22:23
SlickNikdatsun180b: certainly seems like it.22:23
hub_capso as i previously mentioned im working on getting it to work in a cloud server env22:23
hub_cap#action hub_cap to work w/ dkehn on running int-tests in a cloud server22:23
vipulyep, i'm running inot issues with the Stop Tests, when run as a whole22:23
vipulwhen running just the stop group, everything is good22:23
hub_caplocal or on your cloud?22:24
vipulcloud22:24
hub_capnot bad22:24
hub_capthats further than ive gotten w/ the cloud server22:24
hub_cap:D22:24
espyeah much better than before all the fixes22:24
vipuli think it's possible that the previous resize or restart tests couuld be causing the issues22:24
vipulsince those aren't run when running the group separately22:24
cp16netI'm working on making the tests adapt between kvm and ovz entering the server22:24
hub_capits possible. can u ssh in to the inception vm on the cloud node?22:24
vipulyep22:25
hub_capgood22:25
vipuli see the guest logs show the instance state as SHUTDOWN22:25
vipulbut that doesn't seem to be reflected in DB22:25
vipulor something like that.. still gotta investigate22:25
hub_capok we might ahve a bug in the tests22:25
hub_capor in the guest22:25
hub_capcool22:25
vipulbut this only happens in conjuction with another test :p22:25
vipulgotta figure out which test that is22:25
hub_cap#action vipul to provide update wrt running int-tests on hp cloud22:25
hub_capvipul: 1/2 the fun is not knowing what the hells going on ;)22:26
vipultell me about it22:26
hub_capother 1/2 is solving it :P22:26
cp16netyup22:26
hub_capok lets talk about local tests... is anyone having issues in vmware?22:26
hub_capor w/ any other local virt22:26
cp16netno issues as of late22:26
SlickNikSeems unfair that you can have the second half of fun only after eradicating the first half… :P22:27
hub_capnice22:27
hub_cap^ ^ SlickNik22:27
espno issues for me lately22:27
SlickNikno issues in Virtualbox.22:27
grapexI just set up a VM on a new machine today and had all the tests run fine accept for one.22:27
hub_capok good so i think the rax guys have been pretty successful since cp16net fixed things22:27
hub_capgrapex: do u remember what test? was it the same test i wsa having issues w/?22:27
grapextest_make_sure_mysql_is_running_after_resize22:28
vipulgrapex: that passed for me, 148 secs22:28
hub_caphmm22:28
cp16nethehee "works for me!"22:28
hub_cap        test_make_sure_mysql_is_running_after_resize                OK  0.8422:28
grapexIt's a fresh VM, so maybe I missed something.22:29
vipulnvm, wrong one         test_make_sure_mysql_is_running_after_resize                OK  1.6722:29
grapexI was glad it got that far.22:29
hub_capi will say... our tests are pretty damn good, but we might see odd errors here or there22:29
hub_capit could mean bugs or timing issues of sorts22:29
hub_capwe might see some false positives on the VMs too, so lets be minddful and fix em as they come along22:29
vipuli think the issue is they are very inter-twined, so hard to diagnose issues22:29
cp16netyeah seems like the tests are fragile22:30
hub_capya id hate to see them non intertwined tho based on how long it would take to spin up an instance for each one :D22:30
espthey scare me22:30
hub_capthere is improvement we can make22:30
vipulwonder if it's worth making the groups be smaller, so that we can run a subset22:30
cp16netvipul: thats the benifit of running some of the cheat codes22:30
cp16net:)22:30
SlickNikcheat codes?22:30
vipulcp16net: you'll have to educate me on that22:30
hub_capLOL22:30
grapexIts undoubtable there is a real bug somewhere that's hard to hit. I bet will find there's something we should be checking or asserting which we haven't thought about yet.22:31
hub_capya thre is a backdoor trojan22:31
cp16netbasically dont create a server use this existsing server22:31
hub_capgrapex: yup22:31
cp16netsaves massive time :)22:31
SlickNikI tried up, up, down, down, etc… didn't do anything :P22:31
grapexlol22:31
hub_capso we are getting a bit OT, lets tlak about the "cheat code" offline22:31
cp16net#agreed grapex22:31
hub_cap#action cp16net to discuss "cheat codes" w HP22:31
SlickNikokay, sounds good. I'd be interested as well.22:31
vipulnice22:31
cp16netsounds good :)22:31
cp16netSlickNik: lol22:32
grapexCheck instances.py, the environment var "TESTS_USE_INSTANCE_ID" can be used to skip to the point where the instance is created.22:32
vipulwow22:32
hub_capwe def need to update the tests in some form or fashion. lets keep it on the forfront of our brains while we develop22:32
espnice22:32
hub_capanything else w/ the tests for now?22:32
hub_capif not we be movin on22:33
vipuli think we shoudl all just try to get them running, to iron out any issues22:33
SlickNikgood for now.22:33
vipulso we can't say 'works on mine' :)22:33
SlickNik#agreed22:33
hub_capuh oh we found #agreed :D22:33
hub_capi wonder what that does on the notes cp16net SlickNik22:34
hub_cap:P22:34
hub_capwe will find out22:34
hub_cap#topic Image builder22:34
*** openstack changes topic to "Image builder (Meeting topic: reddwarf)"22:34
hub_capwe are officially merged w/ the image builder22:34
hub_capjuice: can u action item what u want to update22:34
SlickNikw00t!22:34
* cp16net shrugs22:34
cp16net#agreed22:34
vipullol22:34
hub_caplol22:34
juicethanks hub_cap for your effort in reviewing this22:34
SlickNikheh22:34
juicenot much to update22:34
hub_capjuice: np!22:34
juicejust the one tweak22:34
juicefor linking rather than copying files22:35
hub_capcool. so maybe we just skip on then22:35
hub_cap#info its merged - booya22:35
juiceother than that ready to move on to something else22:35
vipulpercona!22:35
vipul:)22:35
hub_capLOL22:35
vipulnext week that is22:35
vipulonce we know where to put it22:35
SlickNikOnce we figure out where it can live. :P22:35
SlickNikyead22:35
dkehnwill try to get Monty for that one22:35
SlickNikyeah*22:35
hub_capimma change things up a bit22:36
hub_cap#topic database-api22:36
*** openstack changes topic to "database-api (Meeting topic: reddwarf)"22:36
hub_capso, we had a meeting wrt doc'ing and our api22:36
hub_cap#link https://github.com/stackforge/database-api22:36
hub_capbasically, the codebase as it stands will be called the V1 api. we have to make sure it stays solid22:36
vipulhub_cap: any reason why it's called database-api instead of reddwarf-api?22:36
hub_capya... anne and jeblair said no codenames22:37
hub_capcp16net: pointed out a mistype22:37
hub_capi meant the reddwarf api/codebase as it stands22:37
hub_cap_not_ the database-api project22:37
hub_capwill be the V1 apo22:37
hub_cap*api22:37
hub_capvipul: note compute-api, volume-api, no mention of cinder/nova/etc...22:38
hub_capour doc writer mike a (ill get him to get on irc.. hopefully ;) ) will be adding it to the repo22:38
vipulk, hub_cap: what do you mean by reddwarf codebase = v1 api22:38
SlickNikgoing with the flow.22:38
hub_capwell whats in the code as it stands today vipul22:38
vipulright ok... yes so all we have now is v122:39
hub_capcorrect22:39
hub_capwe need to sit down and start designing the v2 api22:39
SlickNikSo we will doc the reference implementation's API and christen it v1.22:39
hub_capcorrect SlickNik22:39
hub_capV2 will have all our features that we want to implement over the next 6mo or more22:39
cp16net#agree hub_cap v1 of api is what is currently in stackforge/reddwarf22:39
hub_capu missed a d22:39
cp16net#agreed hub_cap v1 of api is what is currently in stackforge/reddwarf22:39
hub_capsnaps/replication/backup/restore/updates...etc etc will form the V2 api22:40
hub_capbut instead of organically growing it we gotta waterfall it w/ a spec22:40
hub_capexample: keystone is doing this now w/ their new spec22:40
*** mordred has joined #openstack-meeting-alt22:40
mordredwhat's up guys?22:40
hub_capmordred: welcome to the party22:40
SlickNikw00t! welcome...22:40
hub_capwere discussing your favorite thing, api specs22:40
vipulonly issue i'd have is ... do we have the capability to rev version now... or is that something we have to wait for22:41
hub_capu mean in the code?22:41
vipulmeaning, can we start working on those v2 features now22:41
vipulright, assuming we have spec'd it out22:41
vipulor is that a summit hting22:41
hub_capwe can start working on them now sure22:41
hub_capno not summit22:41
hub_capitll be irc / wiki thing22:41
hub_cap#action hub_cap to talk to heckj and bcwaldon about how they are doing their next gen specs22:42
vipuland by spec, just need a wiki tech spec around it?22:42
hub_capvipul: thats how it starts22:42
vipullinked to blueprint22:42
vipulk22:42
hub_capit will eventually be a wadl22:42
SlickNikwadl?22:42
hub_capand tech writers will make it sound nice and generate very basic docs around it22:42
hub_capSlickNik: http://en.wikipedia.org/wiki/Web_Application_Description_Language22:42
vipulwadl = wsdl for rest22:42
SlickNikah, gotcha…thanks hub_cap, vipul.22:43
hub_capwe will be doing things inline w/ how the other teams _in_ openstack are doing it, ill make sure of that22:43
hub_cap;)22:43
hub_cap#action hub_cap to get the featureset for V2 started, BP & wiki22:43
vipulok, so besides the wadl, the boilerplate in database-api will just be copy/paste?22:44
hub_capso lets chat over the next few days w/ what u want for v2 and what we want for v222:44
hub_capvipul: im not sure what u mean22:44
vipulthere is some javascript, doc generation code22:44
hub_capitll look like this https://github.com/openstack/compute-api22:44
vipulk22:44
hub_capvipul: our doc team has some stuff, but its not really fleshed out yet. ive asked them to find an open way to say, hey, company X, use this to generate internal docs22:45
jcooleyhub_cap: right on!22:45
hub_capso HP and other companies can use it... they want to do something liek that and say they are working toward it already22:45
hub_capso itll be a bit of a bumpy road, but its not a road we have teo deal w/. mike A will be our POC for that stuff22:45
hub_capas far as we care, its a wadl22:46
hub_cap#link https://github.com/openstack/compute-api/blob/master/openstack-compute-api-2/src/os-compute-2.wadl22:46
vipulk, makes sense22:46
hub_capan example22:46
hub_capwe should be adding to the wadl tho, we are the owners of it22:46
hub_capany other question on doc-fun22:47
vipulyou have an eta on when we'll have a baseline to start adding to?22:47
hub_capvipul:  thats a good question22:47
hub_cap#action hub_cap to talk to mikeA about timelines for v1 wadl22:48
hub_capi hope soon vipul22:48
vipulk cool22:48
hub_capok so now the fun part22:48
hub_cap#topic open discussion22:49
*** openstack changes topic to "open discussion (Meeting topic: reddwarf)"22:49
hub_capanyone else have any random reddwarf stuff to talk about? anyone annoyed to no end w/ hub_cap and just need to air it22:49
dkehncan we talk about the where abouts of the image building22:49
* cp16net raises hand22:49
vipulis now a good time to bring mordred into the discussion?22:49
dkehnfor non-mysql images22:49
SlickNikI guess mordred is hwere.22:49
dkehnmordred, ?22:49
SlickNikhere*22:49
hub_capive got a strict deadline of 10 min22:49
hub_capso if we can get there lets do it22:50
juiceI'll walk over to see if mordred is still around22:50
mordredok. so - what's the problem here?22:50
hub_capso heres my opinion22:50
hub_capid like reddwarf to be _an_ implementation of a database as a service, ie, a impl of postgres, of mysql, etc...22:50
juicenada - afk22:51
hub_capi feel like if we focus on 4 different impls of mysql, we will end up in edge case hell for a long time22:51
hub_capvs focusing on a supported version of each of the major databases22:51
mordredwhat's the actual split though - package name + apt repo?22:51
hub_capmy.cnf differences?22:51
mordredlike, what if the apt package name was parameterizable with a default value?22:52
mordredhub_cap: are there?22:52
* mordred asking22:52
* mordred not trolling22:52
hub_capwell id assume there were tweaks that HP wanted to put in22:52
hub_capor i _did_22:52
hub_capand percona has removed some features of mysql (mind u its prolly a good idea...)22:52
hub_capbut maybe we want to support X or Y that percona deems unsafe22:53
mordredso - there's NO WAY that there is a one-size-fixts-all my.cnf across any of these installs, right?22:53
mordredhub_cap: I hear that - I'm just wondering what the actual incomptability is22:53
mordredbecause in _theory_ I hear you22:53
hub_cap:P22:53
hub_capi get ya man no worries22:53
mordredbut in practice, if it's literally jus a package name change, you know?22:53
hub_capi dont have a problem if its a package change22:53
hub_capas long as there is an understanding that the environment is a development env22:53
dkehnthere are defaults and in the case of percona and a devops situation one does not have to take advantage of expert options22:54
vipuli think also need to look at what happens when the next db is introduced.. like mariadb or something22:54
hub_capnot _the_ env that each of us will be tweaking our production my.cnfs22:54
mordredright.22:54
mordredI think we _have_ to grok that whatever my.cnf is put in here is for dev purposes22:54
hub_capagreed22:54
mordredgreat. so with that - let's see what the actual split is - and honestly, if there's an elements tree22:54
vipulmordred: how does this work in CI, you only test one path?22:55
mordredand  there either a parameter on the command line or 2 1-line files, one for percona and one for mysql, it shouldn't be too terrible22:55
mordredbut then that what we _don't_ want22:55
mordredis 4 different super complex and divergent things, right?22:55
hub_capcorrect mordred22:55
mordredvipul: does that seem workable to you?22:56
hub_capfor instance we have a diff my.cnf that we use for prod, and test that in our own ci env22:56
mordredvipul: also, I think we could potentially set up multiple jobs, one for each22:56
mordredhub_cap: exactly.22:56
hub_capvs whats in the development env... whis is honestly throwaway22:56
hub_cap*which22:56
mordredopenstack itself needs a config or two to test22:56
hub_capin terms of production readyness22:56
mordredthat's "sensible" for testing functionality22:56
vipulyep, just need to make sure that we are testing both paths, so nothing gets stale22:57
mordredyah. I think that's doable22:57
hub_capps, v22:57
hub_caphttp://www.percona.com/software/percona-server/feature-comparison22:57
hub_caplol22:57
hub_cappercona has a bunch of extra features22:57
mordredbut if we get to the point where the percona path starts to get complex, then we should discuss whether or not that should be in an HP CI22:58
hub_capthat we cant rely on...22:58
mordredhub_cap: you guys should start using percona :)22:58
dkehnagreed22:58
mordredhub_cap: stewart, their head of engineering, is pretty fun to drink with :)22:58
hub_capim not opposed to it22:58
hub_capbut i dont make those decisions ;) my engineers do!22:58
hub_capand ill have a drink w/ him/u next time i see and corner u both22:58
cp16netheh22:58
hub_capthe only tink i dont want to see is this22:59
hub_capDurability and Reliability Enhancements22:59
hub_capthere is a ton of nicities that percona has that stock mysql does not22:59
hub_capso when we go down the path of durability22:59
hub_capwe will have a nice code split between them22:59
mordredyeah. I would say that reddwarf itself should not depend on percona23:00
mordreduntil such a point as ubuntu replaces its stock mysql with percona23:00
hub_capcorrect23:00
dkehnor mariaDB for that matter, which note has all the percona patches23:00
vipulmordred: regarding HP CI, i think that's something we really should be doing, since our production images are different than what will be in reddwarf anyway23:00
hub_capso as long as the team is a-ok w/ not using percona features (winkie) we are good to go23:00
vipulhub_cap, i'm cool with not using them in CI23:01
hub_cap:D exactly vipul23:01
mordredvipul: yes. remind me to show you some slides that aleksander from the hp nova team put together about following upstream closely but doing internal testing too23:01
SlickNikWell, we can make a conscious decision not to make any percona specific changes in the reddwarf codebase.23:01
hub_capif u want to use wizbang feature X in your impl i say DO IT!!23:01
hub_capso here is my beef really...23:01
hub_capdo we _need_ to test percona23:02
cp16netwouldnt that be nice to be able to easily add it via extensions in reddwarf23:02
hub_capif we are relying on ubuntu, stock mysql, and cant use the features in ci23:02
hub_capi get that we cna make it configurable, sure23:02
hub_capi want wizbang mysql product X w/ a nosql backend23:02
hub_capbut thats _my_ internal responsibiilty, not something that we need a codepath for in the public23:02
hub_capand then why do we need to run it in ci23:03
hub_capi _do_ want it to be configurable tho23:03
hub_capwe agree there23:03
vipuli just want to be able to test any 'elements' that support percona in CI23:03
hub_capwhat cha mean by elements?23:04
vipuldiskimage-builder elements (flavor)23:04
kaganoselements == flavors of an image23:04
vipulif we're not introducing any for percona, then fine23:04
hub_capso that goes back to my initial question23:04
hub_capwhy, if we only support ubuntu and stock mysql, w/ no support for percona23:04
vipul(if we decide to drive those values by variables or whatrever)23:04
hub_capdo we add the percona elements to the script and put it in ci in the puiblic23:04
hub_capseems like a lot of overhead for something that we arent going to say we officially support23:05
juiceright now its one folder with one file23:05
hub_capi get that juice its not the size of the files23:05
hub_capits the notion of supporting it23:05
hub_capif someone wants ot use maria, do we really need ot add it to our imagebuilder, and start running CI tests against it?23:06
juiceif either company is going to support it, I suppose so23:06
hub_capor do we say, hey, we support mysql, and as long as maria does, feel free to run it in your infra and tst against it... and then use maria in production23:06
kaganossomeone just went through a stop sign about 5 minutes ago … anyone caught his plate number?  ;)23:06
hub_capLOL23:06
juiceeither being rackspace or hp23:06
vipuli think we've come full circle23:07
hub_capbut then we are making a company responsible for supporting a specific implementation of mysql in a public product23:07
hub_capwe have vipul and mordred hath dissapeared23:07
lifelesshub_cap: how much confidence do you have that oracle mysql will be representative of performance etc vs maria ;)23:07
hub_caplifeless: it has nothing to do w/ that :)23:07
mordredI'm right here23:07
hub_cappercona is likely a nice solution23:07
hub_capbut since its a drop in replacement for any other mysql23:07
hub_capwhy do we have to put it in the public codebase23:08
hub_capif u want to support it, i say go for it23:08
mordredlifeless: do we have parameterizable elements?23:08
hub_capbut does it belong in our CI infra in our public23:08
hub_capwhen we get maria, or drizzle23:08
vipulif we put it in reddwarf... and it's a new element... we have to test it23:08
lifelessmordred: in the sense that they are arbitrary shell code, yes.23:08
hub_capthen we have 4 complete CI runs w/ different mysql bakcends23:08
mordredlifeless: I mean, if there was a "mysql-server" element - and only one23:09
mordredlifeless: would there be a way to write it such that at disk-image-build time one could choose to install percona-server instead?23:09
mordredlifeless: or would you need a percona-server element?23:09
hub_capim all for making it configurable, dont get me wrong23:09
lifelessmordred: thinking out loud23:09
lifelessthere are two angles they may differ23:09
lifelessone is the software source23:09
hub_capbut why do we, the community, need to test it in the puiblic CI23:09
juicewhether it's configurable or not, don't we want all the same ci support for it?23:10
hub_capif HP uses percona, then HP can use HP resources to test it23:10
lifelessdifferent repo, and or different package name, or git tree, or whatever.23:10
mordredhub_cap: just looking at what's _possible_23:10
vipulif it's parameterized, probably not...23:10
hub_capsure mordred i get ya23:10
lifelessYou can imagine that minor differences are straight forward, but big ones less so.23:10
juicehub_cap: is your concern that you don't want to burn any extra cycles on the percona ci process in the public space?23:10
hub_capif we want to run drizzle internally, i dont see that we shoudl be adding it to the public codebase... we support mysql, if drizzle supports mysql, run it in production23:10
hub_cap:)23:10
hub_capjuice: mainly yes23:10
vipuljuice: how much different are the two elements?23:10
lifelessThe second way that they may differ, is that the needed boot-time orchestration to properly run could be very different - nbd or not, is there a ring /quorum system etc.23:11
juiceits just the name of the packages23:11
vipuland additional of another apt-repo?23:11
lifelessif its /only/ the package name, and you guys are confident that it will stay that narrow a difference23:11
juicealso there could be different cnf files needed if we want to take advantage of any percona features23:11
lifelessI don't see any benefit in a new element23:11
lifelessconfiguration is outside the diskimage-builder domain, so orthogonal.23:11
hub_capbut we def wont have those in the default impl juice (as discussed above)23:11
mordredwell, the last thing juice said I think is inappropriate for reddwarf upstream23:12
juiceoh yes the apt-repo. good call vipul23:12
lifelesshub_cap: FWIW, if rackspace or whoever runs drizzle for reddwarf, I'd really like to see the support for that - including the status of how well it works etc - in public. Why would it be private?23:12
juicedoes HP have it's own ci processes for reddwarf?23:12
vipulso if we make it parameter-driven, but only ever set the community mysql flags, then what does that buy us23:12
mordredvipul: who said we'd ever set the community?23:13
juiceif so, then we should just have some small tweak (tbd) that builds and tests reddwarf with the small changes for percona23:13
mordredwe'd only ever23:13
hub_caplifeless: i guess i dont see the need for it to be all public... it seems like a lot of work to keep every different impl of mysql running in reddwarf23:13
lifelessI mean, surely the same question applies to nova with postgresql. Someone runs postgresql, why does the community CI need to test it ?23:13
mordredhub_cap: I think in general though, the hp team is willing to do that work ... which is kinda how it happens with postgres in nova23:13
mordredright?23:13
hub_caplifeless: thats a different db entirely tho. i see reddwarf as a reference impl to multiple types of dbs23:14
mordredI mean, we made the CI job config self-service for a reason23:14
lifelessAFAICT the answer so far has been 'if someone steps up to maintain it, and the code is clean, it goes in'.23:14
lifelesshub_cap: it is a different DB, but I was using nova by analogy, which doesn't expose the backend DB to anyone.23:14
hub_capwell i think it more close to xen community vs xenserver23:15
juicesounds like we need a way to make the image building extensible in reddwarf (without making it complicated)23:15
hub_capdoes nova support both impls? and devstack too?23:16
lifelesshub_cap: nova does, and devstack, and nova gates on it.23:16
lifelesshub_cap: sorry, misread - thats the pg answer.23:16
hub_caplifeless: if thats the case my arguement is moot23:16
lifelesshub_cap: I don't know about the xen stack at all23:16
hub_cap:P23:17
hub_capwhen cloud servers moved xen impls, they didnt keep support for the previous one did they?23:17
hub_capi see xen vs vmware like i see mysql vs postgres23:17
hub_cap1 api, 2 different products on the backend w/ the ability for choice23:17
lifelesshub_cap: I guess I'm confused here. Is it a resource concern, or a philosophical concern you have. If its resourcing, lets state up front what resources are needed for a variant and seek commitment before patches.23:17
lifelessIf its a philospohical concern, lets focus on that.23:18
hub_capat this point philosophical23:18
hub_capi understand hp has the resources for htis :)23:18
hub_cap*this23:18
hub_caplikely more than us hehe23:18
lifelessheh, no comment :)23:18
hub_capthe vision for me is that reddwarf has a reference implementation of each major database player23:19
lifelessthat makes a huge amount of sense :)23:19
hub_cappg, mysql, (hopefully) sqlserver, etc...23:19
lifelesscassandra and riak :)23:19
hub_capand if a company wants to support a different impl of the reference, they can23:19
hub_capeventually lifeless ;)23:19
lifelesscool23:20
hub_capbut i dont necessarily see it as being part of the public reddwarf code23:20
lifelessso, why /wouldn't/ the upstream code base know how to deploy etc a different implementaiton23:20
lifelesshow does that compromise the vision ?23:20
hub_capwell its not a compromise of the vision23:20
hub_capits a question of does it need to23:20
lifelessHmm, I'm confused.23:21
hub_capi guess i dont see it as being necessary23:21
lifelessI got the impression you were pushing back *against* it, which speaks - to me- of a concern or problem vs being additional stuff that doesn't have to happen but could23:21
hub_capcorrect. i really dont know what it could bring in terms of differences23:21
hub_capor if it evn will be different23:21
*** djohnstone has quit IRC23:21
vipulfrom a end user perspective, i think there is value in providing the tools/support to others interested in reddwarf, to be able to pull it down, set some flags, and they can run what they want under the covers23:22
vipulinstead of having to learn the intricacies of image building23:22
hub_capvipul: correct im not aruging against that23:22
lifelessvipul: right!23:22
hub_capi want the system to be configurable23:22
hub_capi want it to be able to run maria or percona23:22
hub_capbut do we need ot devote resources in the public to that, is my problem23:22
hub_capshort term it does not seem like a lot of work23:23
lifelesshub_cap: so do we have to decide this now? Could we perhaps run an experiment where we put (say) percona in, conditional on no-bad-things-happening, and if bad things happen, we make a commitment to pull it out later.23:23
hub_caplifeless: i guess i dont have an arguement against that :D23:23
hub_capbut do we need to run it in the CI stuff?23:23
hub_capas is the CI tests take upwards of 30+min23:23
hub_capso duping it to run them both is gonna be a time sink23:23
lifelessok, so *that* is a good question.23:23
vipulhub_cap: that's a concern..23:24
lifelessWhat if we did it in parallel ?23:24
hub_caplifeless: i could live w/ that23:24
lifelessso it was still 30+m, but maybe only a little longer for percona?23:24
hub_capso _if_ there is a error w/ percona23:24
mordredwe have good parallel testing capabilities23:24
hub_capdo we throw our hands up and say HP fix this23:24
hub_capfrom rax perspective23:24
hub_capand then the gating waits?23:24
lifelesshub_cap: I think if there is an error isolated to percona, it would demonstrate the shared benefits that accrue to every org choosing to deploy w/percona of having it in the public space.23:25
hub_capmy guess is that there wont be honestly23:25
lifelesshub_cap: in that it would prove that percona is different enough that saying 'reddwarf works with mysql' is not enough to say 'random percona customer can run reddward+percona safely'23:26
hub_capsure... and again thats what i see as scary, but i know the liklihood is soooo small23:26
*** robertmyers has quit IRC23:26
hub_capand of course when we decide to use whiz bang trickery to do things that stock mysql doesnt support23:27
*** robertmyers has joined #openstack-meeting-alt23:27
vipulhub_cap: i think that's where we have to reject such patches.. possibly even have a single my.cnf for the entire project23:28
hub_capvipul: single my.cnf only makes sense23:28
hub_capa developer my.cnf23:28
hub_cap:)23:28
vipulhub_cap: let's give this a shot.. run both versions in parallel.. see where it gets us23:28
lifelesssorry, wife calling, I need to disappear for a few23:28
vipulwe may come back and say it was a bad idea.. and pull it out.. or it may not be that much of a headache23:29
hub_capok so 1) we wont support anything that is _not_ stock mysql, 2) we wont allow patches to percona specific stuff, 3) we have a single my.cnf for development23:29
hub_capya?23:29
vipul#agreed23:29
SlickNik#agreed23:29
*** yidclare has quit IRC23:29
hub_capgiven those requirements, i guess i dont see the use of adding it, but i will concede :)23:30
vipullol ;)23:30
juicewe can always remove it23:30
juiceif things don't work out23:30
hub_capof course :D we will see how it goes23:31
vipulyep, this will at least give it a home, even if it's temporary23:31
hub_capsomeone action item it23:31
SlickNikI actually like the idea since there are also benefits of being able to test the reddwarf eco system being able to pick and use a different db implementation under the covers.23:31
*** robertmyers has quit IRC23:31
hub_capwhoever on yalls end for whos gonna test it23:31
vipul#action juice to publish percona elements to Reddwarf-int23:31
hub_capcoo23:31
hub_capfin?23:31
vipulyes sir!23:31
hub_cap#endmeeting23:31
*** openstack changes topic to "OpenStack meetings (alternate) || Development in #openstack-dev || Help in #openstack"23:31
openstackMeeting ended Tue Jan 15 23:31:58 2013 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)23:32
openstackMinutes:        http://eavesdrop.openstack.org/meetings/reddwarf/2013/reddwarf.2013-01-15-22.00.html23:32
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/reddwarf/2013/reddwarf.2013-01-15-22.00.txt23:32
openstackLog:            http://eavesdrop.openstack.org/meetings/reddwarf/2013/reddwarf.2013-01-15-22.00.log.html23:32
*** esp has left #openstack-meeting-alt23:32
*** yidclare has joined #openstack-meeting-alt23:32
*** jcru has quit IRC23:40
*** datsun180b has left #openstack-meeting-alt23:41
*** amyt has quit IRC23:43
*** juice has quit IRC23:44

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!