Thursday, 2015-06-25

*** jtriley has quit IRC00:03
*** ccrouch has quit IRC00:07
*** dims_ has joined #kolla00:14
*** dims has quit IRC00:16
*** diogogmt has quit IRC00:48
*** tobe has joined #kolla00:56
*** zhiwei has joined #kolla00:59
*** mandre has joined #kolla00:59
*** vinkman has quit IRC01:11
*** sdake has joined #kolla01:28
*** sdake_ has joined #kolla01:29
sdake_harmw around01:30
*** sdake has quit IRC01:33
sdake_jpeeler any success01:34
*** jasonsb has joined #kolla01:35
sdake_need a core to review https://review.openstack.org/#/c/195193/01:35
openstackgerritMerged stackforge/kolla: Minor doc fixups in dev-quickstart.md  https://review.openstack.org/19054301:39
*** dims_ has quit IRC01:45
*** jtriley has joined #kolla01:48
*** dims has joined #kolla01:50
*** rhallisey has quit IRC01:50
*** jtriley has quit IRC01:54
*** dontalton has quit IRC01:56
mandrehi all01:57
mandrei'm back from the dead, i've been super busy the last few days01:58
mandreit should be better now :)01:59
mandredid I  miss anything?01:59
*** erkules_ has joined #kolla01:59
*** erkules has quit IRC02:01
*** dims has quit IRC02:04
sdake_mandre house is on fire02:05
sdake_mandre you have a bug assigned to you02:05
sdake_it involves making a new cmd line flag that takes an optional # of retries02:05
sdake_the retry will retry the container build02:06
sdake_we will want to pass this flag from the master build script to the individual build script02:06
sdake_we hve a release on the 25th02:06
sdake_(tomorrow)02:06
*** jasonsb has quit IRC02:07
*** jasonsb has joined #kolla02:08
mandreshould be doable02:08
*** gfidente has quit IRC02:08
*** jasonsb has quit IRC02:08
sdake_higher priority are these 3 bugs02:09
sdake_https://launchpad.net/kolla/+milestone/liberty-102:09
sdake_if you want t tae some or all of them over that would rock02:09
sdake_most of the us crew have signed off for the night since its 11pm on the east coast iirc02:09
*** dims has joined #kolla02:10
sdake_one is a rebase02:11
*** jruano has joined #kolla02:11
mandreokay02:12
sdake_brb connecting to hardware02:13
*** sdake has joined #kolla02:13
openstackgerritSteven Dake proposed stackforge/kolla: Add more checks to the glance containers  https://review.openstack.org/19519302:14
*** sdake_ has quit IRC02:17
sdakemandre i'll tae this one https://bugs.launchpad.net/kolla/+bug/146846402:17
openstackLaunchpad bug 1468464 in kolla "Unable to install Docker 1.7 following dev-quickstart guide" [Critical,Confirmed] - Assigned to Steven Dake (sdake)02:17
openstackgerritMerged stackforge/kolla: Set up glance to use a data container.  https://review.openstack.org/19197502:18
mandrei'll rebase https://bugs.launchpad.net/kolla/+bug/146310102:19
openstackLaunchpad bug 1463101 in kolla "genenv dependent on openssl without verifying its existence" [Medium,In progress] - Assigned to Harm Weites (harmw)02:19
openstackgerritMartin André proposed stackforge/kolla: Check if tools/genenv binary dependencies are met.  https://review.openstack.org/19158002:21
mandrewhy isn't gerrit adding comments to launchpad for patches that reference a bug?02:36
mandreI'm thinking about https://bugs.launchpad.net/kolla/+bug/143233602:37
openstackLaunchpad bug 1432336 in kolla "Need add more check var for glance-api" [High,In progress] - Assigned to Ryan Hallisey (rthall14)02:37
mandrethere are 3 concurent patches in gerrit fixing the bug02:37
sdakei am not sure02:37
sdakesometimes it doesn't wor peroply02:37
sdakehttps://launchpad.net/kolla/+milestone/liberty-102:38
sdake3 bugs to go02:38
*** diogogmt has joined #kolla02:40
*** jtriley has joined #kolla02:49
*** jtriley has quit IRC02:54
*** dims has quit IRC02:58
openstackgerritMerged stackforge/kolla: Check if tools/genenv binary dependencies are met.  https://review.openstack.org/19158002:59
sdakemandre can you run fix all the build linsk script and see if it changes anything03:05
sdakeI have concerns ovs link scripts are nto setup properly03:05
openstackgerritSteven Dake proposed stackforge/kolla: Correct dev-quickstart installation directions kUse was using yum to install docker 1.7.0.  This wanted to install all of the fedora 23 dependencies.  Instead, simply use RPM to install via http with the --nodeps option.  This works because we don't reall  https://review.openstack.org/19539503:10
mandresdake:  I noticed the same, I was about to fill a bug for it03:11
sdakepleae do so03:12
sdakeand fix if yo ucan03:12
mandrehow do we treat bugs that have already been fixed in master? https://bugs.launchpad.net/kolla/+bug/146691303:12
openstackLaunchpad bug 1466913 in kolla "Cinder symlinks broken in fedora + rhel" [Undecided,New]03:12
mandrechange to invalid?03:12
sdakealready merged?03:12
sdakethey shoudl be assigned to lierty-103:12
sdakeand assigned a priority and assigned to the person who fixed it03:13
sdakethat would be a critical priority03:13
sdakemake sense?  We fixed it in liberty 1, should be recorded there03:13
sdakeset to "Fix committeed"03:13
sdakei am not superman maintaining the launchpad tracer is a fulltime job03:14
mandreokay03:14
sdakecan use all the help people can give :)03:14
*** jruano has quit IRC03:15
mandreall the new containers (galera, keepalived, openvswitch) were only added to centos base image, is that intentional?03:23
sdakeyes03:24
sdakethe idea is we would symlink to centos03:24
sdakeexcept the dockerfile03:24
sdakewhich would be unique per os/container03:24
mandrei mean, the symlinks are missing...03:25
jpeeleri can't stay for long, but i'm back03:25
jpeeleryes, in ovs-base the build symlink is wrong03:25
sdakehey jpeeler i fixed upt hat doc bug03:25
sdakeperhaps you have time to review03:25
*** tobe has quit IRC03:26
jpeelersdake: yeah, i wouldn't have come up with that. but it looks simple, so if it works then great03:26
sdakei buit a fresh f21 vm and amd buidling all docker containers now03:26
sdakeso it definately wors03:26
openstackgerritMerged stackforge/kolla: Add more checks to the glance containers  https://review.openstack.org/19519303:26
mandrebad rebase on the glance-data container, it ended up at the wrong place03:26
jpeelerthe ovs container will fail due to the broken symlink03:26
sdakemandre was going to file a bug for the ovs container03:27
sdakeand get a patch up i think03:27
jpeeleri know we're trying to be good about having 1:1 commits to launchpad, but it's a symlink03:27
mandrejpeeler: https://bugs.launchpad.net/kolla/+bug/146859103:27
openstackLaunchpad bug 1468591 in kolla "Broken links to build sript for OVS container" [Critical,New] - Assigned to Martin André (mandre)03:27
jpeelerheh, well alrighty then03:28
*** jasonsb has joined #kolla03:28
jpeelersince rdo is a symlink, it's actually just one03:28
sdakewhen you make exceptiosn thy expand03:28
sdakeinto more areas03:28
sdake"it only a symlin"03:28
sdake"its only a one liner"03:28
sdakeetc03:28
sdakethis is why they are the way to th dark side03:29
sdakebecause they are the easy path ;)03:29
sdakethen gain life ins't perfect and judgement matters03:30
jpeelerso mandre, you got that symlink fix then?03:30
sdakewhat i want to avoid is one or two linters turning into no tracking in the launchpad03:30
sdakebecause that is real work03:30
sdakesomeone had to figure that shit out03:30
openstackgerritMartin André proposed stackforge/kolla: Fix build link for ovs container  https://review.openstack.org/19539803:30
sdakeand if its not tracked its not counted03:30
sdakeand if its not counted, omeone looing at stacklaytics may make a decision not to invest in kolla03:30
sdakewhen "one more" would have put them over the line03:30
sdakelike that rm doc fix03:31
sdakethat took me over 1 hour to setup and verify03:31
sdakeif i left it untracked, what was I doing for that 1 hour?03:31
sdakedashboarding sucks03:31
sdakeevil03:31
sdakebut lots of shit in this world is evil03:32
sdakeand we put up with it03:32
jpeeleryou have a good point03:32
sdakebecause some idiot decided it wold be a good idea to make a dashboard to track performance03:32
sdakesome idiot/group of idiots03:32
sdakedashboarding takes judgement out of the decision making process03:32
sdakeit turns things into a simple binary equation03:32
sdakeif X > Y then yes03:33
sdakeotherwise03:33
sdakePOUNDSAND03:33
sdakehow do you explain judgement to someone?03:33
sdakevs X > Y03:33
sdakeplz tell me and Ill have a solutio nto kill dashboarding03:33
sdakeit also causes unnatural gaming behavior03:34
*** jruano has joined #kolla03:34
sdakethat would not occured if there werne't a dashboard to be gamed03:35
jpeelerwhoa i opened a can of worms03:35
sdakelet me follow that up with an example since this channel is logged03:36
sdakeand I want peopel to read it in perupetuity03:37
sdakeby commits03:38
sdakehttp://stackalytics.com/?metric=commits&project_type=all&module=kolla03:38
*** diogogmt has quit IRC03:38
sdakecisco is 48%03:38
sdakeof kolla commits03:38
sdakeof that more then half were bashhate changes which took me less then 16 hours to finish03:38
sdakeso 25% of our commit output was done in 16 hours03:38
sdakebut does the dashboard show thta?03:39
sdakeNO03:39
*** tobe has joined #kolla03:39
sdakeis 25% of this release output "bashate gating"?03:39
sdakeI don't even know if we mentioned it in the release announcement tbh03:39
sdakemeanwhile harmw and rhallisey wehtn through 30 revisions03:40
sdakeof a super hard set of work03:40
sdakenot to dismiss the wor of the other containers - they were hard too03:41
sdakethat goes in as 1 commit03:41
sdakethat is like 1% on that chart03:41
sdakeok done ranting thanks for listening ;)03:41
openstackgerritMartin André proposed stackforge/kolla: Move glance-data container to the correct place  https://review.openstack.org/19540003:46
sdakejpeeler not only if my life difficult because of stackalytics dashboarding, but csco is big into dashboarding as well03:47
sdakeso there are two systems to game03:47
sdakethat gets harder :(03:47
openstackgerritMartin André proposed stackforge/kolla: Add retry parameter to build-docker-image  https://review.openstack.org/19540203:49
jpeelermandre: if you knew the python equivalent of "find -L docker -type l" , I'd say that should be put in test_images.py03:50
sdakemandre I too https://bugs.launchpad.net/kolla/+bug/1466677 and placed in liberty 103:51
openstackLaunchpad bug 1466677 in kolla "build script errors out in yum" [Critical,In progress] - Assigned to Martin André (mandre)03:51
mandrejpeeler: agreed, i'll have a look later03:51
sdaketook03:52
mandreabout https://bugs.launchpad.net/kolla/+bug/1466677, there is still the second part missing, to have the gate actually use the new arg03:53
openstackLaunchpad bug 1466677 in kolla "build script errors out in yum" [Critical,In progress] - Assigned to Martin André (mandre)03:53
sdakemandre https://bugs.launchpad.net/kolla/+bug/1468596 I put in l103:53
openstackLaunchpad bug 1468596 in kolla "glance-data ended up at the wrong place due to bad rebase" [High,In progress] - Assigned to Martin André (mandre)03:53
mandrei'll do it later today03:53
sdakemandre yup hear ya - just revert my patch03:53
sdakeand add a second which add retries03:53
mandresdake, fine for l103:54
mandreneed to go now, bye03:55
sdakethans mandre03:55
sdakedid you fix the ovs script real quick03:55
sdakeor file a bug on it?03:55
mandrei'm on vacation today, going to see mad max :)03:57
mandrebe back in a few hours03:57
jpeelerhe did, i'm waiting for the gate to verify03:57
jpeelerand then i'm going to bed03:57
sdakemovie03:58
sdakemaybe i'll do that tomorrow03:58
sdakejpeeler did you fix the ovs db server link as well04:08
jpeelermandre did. once i see the gate pass i'll approve it and you should too04:08
jpeelerit's within minutes of finishing04:08
sdakei think we have another broken gate patch iirc04:11
sdakebut that may have merged already04:11
sdakei can't rmemeber04:11
sdaketoday is a blur ;)04:11
sdakebrought on by norco and too much work04:11
*** jruano has quit IRC04:13
openstackgerritMerged stackforge/kolla: Correct dev-quickstart installation directions kUse was using yum to install docker 1.7.0.  This wanted to install all of the fedora 23 dependencies.  Instead, simply use RPM to install via http with the --nodeps option.  This works because we don't reall  https://review.openstack.org/19539504:13
sdakehmm i must have jacked up that commit message04:14
jpeelerall green, yay04:14
sdakemandre if you see this msg, pleasepu t a hold on the gating until after I hae releawsed liberty-104:15
sdakeI don't want a repeat of the charlie foxtrot that was the gating mess created by the fedora infrstractrure imploding04:16
openstackgerritMerged stackforge/kolla: Fix build link for ovs container  https://review.openstack.org/19539804:16
sdakemandre another approach is to maek the gate non-voting ut try out the retyr operations nd see if that gives us relief04:18
sdakeand then revert th gate change in 1-2 weeks04:18
sdakebed time good job folks04:21
sdakenight ;)04:21
sdakeif anyone gets bored, test neutron thin agents04:21
sdakesince i'm not sure how they could possibly have worked as they didnt build :)04:22
openstackgerritMerged stackforge/kolla: Move glance-data container to the correct place  https://review.openstack.org/19540004:26
*** jtriley has joined #kolla04:31
*** jruano has joined #kolla04:34
*** jtriley has quit IRC04:36
*** jruano has quit IRC05:05
*** inc0 has joined #kolla06:01
inc0good morning06:02
*** tobe has quit IRC06:14
*** jtriley has joined #kolla06:20
SamYaplemorning06:24
*** jtriley has quit IRC06:24
SamYaplesdake: the neutron-base did not build in the gate, I told you that. But it builds locally because of some wierd symlink stuff. Did you guys merge it before it jenkins said it built?06:25
* SamYaple looks, yup06:26
SamYaplejenkins kicked it back06:26
*** tobe has joined #kolla06:33
*** nihilifer has joined #kolla06:45
openstackgerritSam Yaple proposed stackforge/kolla: Add neutron-openvswitch-agent contianer  https://review.openstack.org/18173706:48
*** jmccarthy has joined #kolla06:55
*** bradjones has quit IRC07:02
*** bradjones has joined #kolla07:04
*** bradjones has joined #kolla07:04
*** athomas has joined #kolla07:06
*** dasm is now known as dasm|afk07:13
*** dasm|afk is now known as dasm07:14
nihilifero/07:17
SamYaple\o07:17
*** shardy has joined #kolla07:20
*** erkules_ is now known as erkules07:46
*** erkules has quit IRC07:46
*** erkules has joined #kolla07:46
*** tobe has quit IRC07:48
inc0sooo...nothing to review?07:54
*** gfidente has joined #kolla07:54
SamYapleinc0: https://review.openstack.org/18173707:55
inc0SamYaple, for start, any reason you install ovs AND neutron agent therE?07:57
SamYaplebecause its required07:57
inc0having 2 OVSes installed on same hosts doesn't break anything?07:57
SamYaplethese are thin containers remember, only one process it run in them07:58
SamYapleits not like a new OVS process is running07:58
inc0so its just installed for API?07:58
SamYaplethe only reason it is installed is for the ovs cli utils07:58
inc0kk07:58
SamYaplei wish neutron used python libs07:58
openstackgerritSam Yaple proposed stackforge/kolla: Add neutron-openvswitch-agent contianer  https://review.openstack.org/18173707:58
SamYaplebashate changes07:58
inc0that's why it didn't show up on my fancy reviewer dashboard07:59
inc0it filters out jenkins -1s07:59
SamYaplefancy07:59
inc0soo...I guess you'd want me to test it08:01
inc0because neutron tends to be magical08:02
SamYapleif you want to08:02
inc0by the way, ovs is merged after all?08:02
SamYaplethis doesn't have any config-internal/compose stuff08:02
SamYapleyea08:02
inc0cool08:02
inc0I was kinda afraid about this one08:03
SamYaplewhy?08:03
*** tobe has joined #kolla08:04
inc0everything network-related scares me, and ovs can be tricky08:04
inc0given how much depends on it08:04
SamYapleOVS is super solid in containers from what ive seen08:05
SamYaplemainly because the kernel module does al lthe works08:05
inc0well, I'm just mistrustful about that stuff, that's all08:05
inc0my inborn mistrust saved me several times already;)08:05
*** jtriley has joined #kolla08:09
*** jtriley has quit IRC08:13
*** mstachow has joined #kolla08:27
mstachowo/ all08:27
* mstachow feels neck pain - 5/10 sdake's holy f*ck scale08:29
jmccarthyIn the neck ?! Ow - gotta love that scale tho ;)08:38
mstachowThis scale rocks!08:39
jmccarthyAnyone build a fresh kolla dev env lately ? Squakws for me at:08:40
jmccarthyError: image kollaglue/centos-rdo-glance-data:latest not found08:40
inc0I build my own images :#08:45
inc0:308:45
nihiliferjmccarthy: this happens when you try to do sudo ./tools/kolla?08:46
nihiliferjmccarthy: or something else?08:47
jmccarthysudo ./tools/kolla start08:53
inc0for me glance-api failed08:56
*** shardy has quit IRC09:14
*** shardy has joined #kolla09:15
inc0git log says last commit is "move glance-registry to correct place"09:20
inc0I sense there is connection out there...09:20
jmccarthyHrm ok yea I'm just building my own for the moment now also09:29
*** mfalatic has quit IRC09:29
inc0hmf, right now I can't run glance, dependency fuckup09:53
inc0I rebuilt my images and it doesn't have oslo.i18n:(09:54
inc0that might be root cause as well09:54
*** jtriley has joined #kolla09:57
*** jtriley has quit IRC10:02
*** dims has joined #kolla10:14
*** athomas has quit IRC10:15
*** athomas has joined #kolla10:29
*** gfidente is now known as gfidente|afk10:30
*** mstachow has quit IRC10:49
*** sdake has quit IRC10:50
openstackgerritMichal Jastrzebski (inc0) proposed stackforge/kolla: Glance missing oslo.i18n  https://review.openstack.org/19551610:54
*** mstachow has joined #kolla10:57
SamYapleinc0: you have a link to an upstream bug with that problem?11:02
*** dims has quit IRC11:02
*** zhiwei has quit IRC11:04
inc0nope, just noticed that I can't run it locally11:05
*** dims has joined #kolla11:05
inc0and yum didn't show oslo.i18n in depends11:06
*** dims_ has joined #kolla11:10
*** dims has quit IRC11:11
*** tobe has quit IRC11:11
inc0SamYaple, we don't use compose for OVS?11:15
*** dims_ has quit IRC11:16
*** dims has joined #kolla11:21
*** rhallisey has joined #kolla11:22
*** prad has joined #kolla11:32
nihiliferinc0: why your bug's status is "Fix Commited" if it's still in review? ;)11:34
inc0guess my mistake11:35
*** bradjones has quit IRC11:38
*** alisonh has joined #kolla11:39
*** bradjones has joined #kolla11:41
*** bradjones has joined #kolla11:41
inc0our CI will catch up EVERY broken dependency in EVERY project11:45
inc0yay.11:45
*** jtriley has joined #kolla11:46
SamYapleinc0: i haven't built any compose things for OVS, no11:46
SamYaplenew containers don't require it to be merged11:47
SamYapleif someone wants to add it, go for it11:47
inc0uhh so many new rules:P11:47
inc0what about genenv stuff?11:48
SamYaplesame deal. not required for new containers. In this case I think fang may have added that though11:48
inc0don't you think we should have neutron-ovs-agent.yml compose if we have linuxbridge one?11:49
SamYapleif you want to implement it, yes11:49
SamYaplebut its more complicated than a single compose file11:49
SamYaplethere is also logic that needs to be added into the containers and scripts11:50
SamYaple(kolla scripts)11:50
*** jtriley has quit IRC11:51
inc0shouldn't we keep up with that stuff until we have ansible scripts up and running?11:52
SamYaplekeep isnt the same as add new things. We are keeping up with all of that stuff as long as it is used11:52
inc0but with neutron being 80% done in compose...I think this one container should be there too.11:54
SamYapleok well add it in, but there is more too it than that since all the config-internal scripts need if/else for linuxbridge or openvswitch11:55
SamYaplesame with gen environment11:55
*** vbel1 has joined #kolla11:57
inc0also, you didn't implement GRE there right?11:59
inc0I'm reffering to https://review.openstack.org/#/c/18173711:59
SamYapleimplement how?11:59
inc0GRE reqires several variables12:00
SamYapleI wrote none of the config-internal bits12:00
harmwinc0: can't we skip GRE and move straight to vxlan instead?12:06
harmwfor scale12:06
inc0harmw, why? vxlan are quite properitary technology12:06
*** gfidente|afk is now known as gfidente12:07
inc0people might have problems with this12:07
SamYapleinc0: you got that backwards12:07
inc0GRE is far more used in the wild12:07
SamYapleinc0: my job does not use GRE at all12:07
SamYaplebut im not arguing you should not be able to use it12:08
SamYapleif you want gre support, add it12:08
harmwafter all, we could just support both12:08
harmwit's not that big a deal12:08
inc0yeah, I guess that's best12:09
harmwand default to vxlan :>12:09
inc0personally 90% of my depolyments are old, trusty vlans:P12:09
SamYaplethats where its at for performance12:09
vbel1vlans are messy :)12:10
SamYaplevlans dont scale12:10
vbel1vlans are obsolete :)12:10
SamYaplebut they are easier to work with to get around neutron being neutro12:10
SamYapleinc0: i have no intention of doing anything further on that OVS container for config-internal stuff. If someone else wants to add it, be my guest12:11
inc0vlans uses least CPU and are easyiest to debug12:11
harmwit's L2, what'd you expect :p12:12
inc0L3 tunneling is cheating :P12:12
inc0and it's costly cheating12:12
harmwno no , it's called scaling :)12:13
vbel1we have to wait true SDN :)12:13
harmwand what would that be?12:13
inc0every big vendor says they have their own true sdn12:13
vbel1no cheating :)12:13
harmwwhich is just some ASIC running linux12:14
inc0juniper has contrail, cisco vxlan12:14
harmwvxlan is protocol, contrail is a producting (probably using vxlan, iirc)12:14
harmwhow are we looking for liberty-1 btw?12:15
inc0I'm not sure tbh12:15
inc0pretty good I'd say12:15
harmwlast time i checked there was 1 open thingy12:15
inc0I think only one bp targeted didn't land12:15
harmwhttps://launchpad.net/kolla/+milestone/liberty-112:16
SamYaplevxlan is going to replace gre12:16
harmwopenvswitch is missing inc012:16
inc0it has landed12:16
inc0so we should change its status12:16
harmwhttps://blueprints.launchpad.net/kolla/+spec/openvswitch-container12:16
SamYapleit is supported and pushed by the networking compains where gre is supported by microsoft12:16
SamYapleinc0: it hanst landed12:17
harmwit's listed as needs code review :)12:17
inc0SamYaple, your patches are parts of it?12:17
SamYaplethe neutron agent is part of that BP as originally agreed12:17
SamYapleyea12:17
SamYaplewell they are fangs12:17
SamYaplei just tweak them since he is MIA12:17
inc0sure sure12:17
harmwhe's been mia for quite a while now12:17
SamYaplesdake mistakenly marked it completed yesterday12:17
inc0then yeah, it hasn't I just thought it was part of thin agents stuff12:18
inc0I think there was bp for that12:18
SamYapleyea12:18
SamYapleit was blocked until the thin agents landed12:18
SamYaplebut it was part of the openvswitch BP12:18
inc0kk12:18
SamYaplehas anyone other than me tried the thin neutron containers?12:19
harmwnope, waiting for coreos to update their alpha12:19
harmwfor docker1.712:19
SamYaple:/12:19
harmwshould happen today12:19
harmwwhich is why I choose to wait12:19
SamYapleive been doing thin agents since march but as far as i know no else has tested them :(12:20
inc0I've set up everything around12:20
SamYaplestressful12:20
inc0I just havent run neutron yet because of no-compose:P12:20
harmwmarch? I wasn't even on board in march :p12:20
inc0but that's just me being lazy12:20
SamYapleharmw: in yaodu i did thin12:20
harmwSamYaple: I can understand it's stressful12:20
SamYaplei just had to ptch docker to make it work12:20
harmwIll see if I can abuse my laptop tonight, to take out a dependency12:21
SamYapleinc0: there is compose support for all the thin containers12:21
inc0not ovs:P12:21
SamYaplewell i didnt test my thin containers against OVS12:21
SamYaplebecause it didnt exist yet12:21
SamYaplei mean in yaodu i did, but this is with docker 1.7 not some patched 1.512:22
inc0tomorrow set up bigger cluster and try it out12:23
inc0I'll be on PTO next week so I don't know if I manage to finish it12:23
mstachowI'll take that then12:25
mstachowI should be "fully operational" tommrow12:25
inc0I knew I could count on you mstachow12:25
mstachowI hope...12:25
mstachownp ;)12:25
* mstachow feels like a local hero12:25
dasminc0: you're counting on mstachow?12:25
SamYaplei just need some feedback on neutron12:26
inc0always12:26
dasmone mstachow, two mstachows, three mstachows?12:26
dasmsth like this?12:26
inc0no dasm, learn some English12:26
mstachowdasm Have you ever heard about multithreading ;P?12:26
inc0its first, second, third...12:27
dasminc0: ah.. right :D12:27
dasmmstachow: i don't think so, you're capable to be multithreading.12:28
inc0gotta love these random useless comments:P12:28
SamYapleinc0: got a local repo with the Dockerfiles in jinja2 template form12:29
SamYapleI would submit it but I can't see a clean way to patch that into the existing build scripts12:30
inc0whats the issue?12:30
SamYapleSo im working on a rebuild of the build system too using python, all parallel like12:30
SamYapleinc0: its not clean12:30
SamYaplei mean it _can_ be patched in, its just not clean looking12:31
inc0yeah, I thought about pythonisation of our scripts12:31
*** dims has quit IRC12:31
SamYapleGood news is I can add it as a seperate script so we can merge it in early12:31
inc0start from not-clean and incrementally refactor it?12:31
*** dims has joined #kolla12:31
inc0or that12:32
SamYapleid rather just add in an all new build system12:32
SamYapleIts really really not that much work12:32
*** vbel has quit IRC12:32
SamYaplePlus now we can jinja2 the FROM header12:32
SamYaplesince ive got ansible, im targeting l3 for the rewrite12:33
SamYapleI just want to get the templates in before M-cycle12:33
SamYaplei bet well have alot more people then and it will be more confusing12:33
inc0btw SamYaple I'm trying to get Rackspace people to talk about kolla:P12:36
SamYapleme too12:36
vbel1SamYaple: moving away from sed ;)  Dockerfiles can easily be templates, either Mako or Jinja212:43
vbel1SamYaple: also it could be easy to embedd http proxy into templates if necessary12:44
vbel1no more human readable Dockerfiles (kidding)12:45
SamYapleargggg12:45
SamYaplevbell im ok with all of that.... in time12:46
SamYapleintially it will just be a refactor and only if the community agrees to it12:46
SamYaplesmlink spegehtti wont work long term12:46
*** bradjones has quit IRC12:47
*** bradjones has joined #kolla12:50
*** bradjones has joined #kolla12:50
*** absubram has quit IRC12:55
*** sdake has joined #kolla12:56
inc0hello sdake12:57
mstachowo/ sdake13:03
SamYaplethere is no sdake13:03
SamYaplesdake is a lie!13:04
mstachowoh no13:08
mstachow:O13:08
mstachowI will have a nightmares because of this :/13:09
inc0because of nonexistand Steven?13:09
mstachowthat's right13:10
inc0Nonexistant Steve sounds like con-artists alias13:10
mstachowlike a psychedelic rock band13:11
mstachowcool13:11
inc0well, maybe not con artist13:11
*** jruano has joined #kolla13:11
SamYaplehave you met steve?13:16
SamYapleim just saying13:16
*** mickt has joined #kolla13:17
*** shardy has quit IRC13:17
*** shardy has joined #kolla13:22
openstackgerritMartin André proposed stackforge/kolla: Have test retry building failed images  https://review.openstack.org/19557413:30
*** jtriley has joined #kolla13:31
*** absubram has joined #kolla13:35
*** shardy has quit IRC13:42
*** walters has joined #kolla13:43
*** shardy has joined #kolla13:44
*** dasm is now known as dasm|afk13:50
inc0I'm going home, have a good rest of day13:56
inc0cyas13:56
mstachowbye inc013:56
*** inc0 has quit IRC13:57
*** athomas has quit IRC13:58
sdakemorning folks13:59
sdakewhat is the state of kolla13:59
sdakeready to pull the trigger on the release?13:59
sdakei tested building works at about 11pm last night14:00
sdakebefore passing the fuck out ;)14:00
rhalliseyya I did rebuilt yesterday morning too14:01
* mstachow is now confused because of SamYaple14:01
sdakemost important in my mind is that thin containers work14:01
rhalliseyall green14:01
sdakethin neutron containers work14:01
sdakethat is our bigget change this release14:01
sdakeovs was not building yesterday - there wer epatches n the patch queue14:02
*** jmccarthy has quit IRC14:03
mstachowo/ sdake14:03
sdakehey mstachow14:05
sdakesamyaple any word on thin containers working/not working?14:05
sdakerhallisey can you review https://review.openstack.org/#/c/195574/14:08
sdakerhallisey and it's parent patch as well14:09
sdakemstachow have you tested neutron thin containers?14:13
mstachowI will test It tomorrow14:14
sdaketomorrow too late14:14
sdakejust curious if anyone has tested besides sam yaple14:14
mstachowIn this case - No, I didn't14:15
sdakesamyaple how would one select OVS instead of linuxbridge14:15
SamYaplesdake: no one has tested thin neutron containers other than me14:21
sdakesamyaple and it wfu with kolla start?14:21
SamYapleI have never run anything with kolla start14:22
sdakesamyaple how does one select between ovs and linuxbridge14:22
sdakesamyaple could you test with kolla start just to validate that operational mode works14:22
sdakethat is what our quickstart guide recommends14:22
sdakemy computers are AFU atm14:22
SamYaplesure i can try it out14:22
sdakeand I have a hard time testing14:22
sdakeI'm going to spend a couple hours trying to get my vm rolling with two nics14:23
sdaketo try out kolla start as well14:23
sdakewhen do you head to bed?14:23
SamYaplere: ovs versus linuxbridge. I suppose that logic needs to be written into kolla start and what not. i dont have a way for the config-internal people to test both14:23
sdakesamyaple ok tech debt to be solved after l214:23
sdakehttps://bugs.launchpad.net/kolla/+bug/146877914:25
openstackLaunchpad bug 1468779 in kolla "Need way to select between linuxbridge and OVS" [High,Confirmed]14:25
sdakenow its tracked14:25
sdakesamyaple when you know about kolla start get back to me plz14:25
sdakethe default is still linuxbridge samyaple?14:26
SamYapleyea the openvswitch-agent container doesnt change anything, just adds the container14:26
SamYapleits self contained14:26
sdakedoesn't the agent type need to be set in neutron config somewhere?14:27
sdakeor does neutron just figure it out14:27
SamYapleno, but the config-internal code needs it14:27
SamYaplethe agents check in over message queue14:27
SamYapleyou can actually have mix/match environments with linuxbridge and OVS14:27
sdakewfm, so kolla start shuld be unimpacted14:27
SamYaplecorrect14:27
sdakeok lets get varification on that14:28
sdakeget those two patches merged14:28
SamYaplewhat two?14:28
sdakeand I'll send out a release announcement after tagging14:28
sdakehttps://review.openstack.org/#/c/195574/14:28
sdakeand its parent14:29
*** shardy has quit IRC14:29
*** shardy has joined #kolla14:30
sdakethere is some anestaphine in the back of the medlock!14:32
*** mickt has left #kolla14:35
sdakesamyaple re the relicense of the ansible magic we need, what is the status of that effort14:36
sdakethat is now the primary blocker i need to get unblocked if possible14:36
*** athomas has joined #kolla14:37
SamYaplejust ping'd mordred about that. they are setting up a seperate repo14:37
SamYapleunable to proceed with the keystone container until the modules, I am working on the galera one14:40
sdakenice14:40
SamYaplewhat was my LOC estimate?14:42
SamYaplewhatever it was I am revising it to 200 LOC for ansible per service on the outside14:43
openstackgerritMerged stackforge/kolla: Add retry parameter to build-docker-image  https://review.openstack.org/19540214:45
sdakei said 1k total14:45
sdakeit was just a really rough estimate14:45
sdakenothing you are being held to14:46
SamYapleno that seems right. Keystone is sitting at 100 LOC. With this generic code for DRY stuff the others should be 125-175 i think14:47
SamYaple~1000 total sounds good14:47
openstackgerritMerged stackforge/kolla: Have test retry building failed images  https://review.openstack.org/19557414:59
*** mickt has joined #kolla15:04
sdakeit was 1kloc, 100 tasks15:04
sdakeloth said it should be 250 tasks15:04
SamYaplehe knows nothing!15:05
SamYaple:)15:05
SamYapleive got some common tasks, so while 250 may run, well only have 100 (maybe) to maintain15:06
*** shardy has quit IRC15:08
*** shardy has joined #kolla15:08
sdakesamyaple does that olla start stuff work ;)15:08
micktHey fang, we (in Oracle) were intending to look at murano too; I see that you have a blueprint in for it.  I was wondering what is your plan or if you have done anything on it?15:10
*** shardy has quit IRC15:13
*** shardy has joined #kolla15:13
sdakemickt I haven' tseen fang on irc for atlaest a month, I think because of the great firewall of china15:17
sdakeso plans of action:15:17
sdakecommunicate on blueprint15:17
sdakeor take over blueprint15:17
sdakei'd go with communicate first see i f that works15:18
micktwill do, cheers15:18
sdakebut fang also not responding well on blueprint messages15:18
sdakeos give him a week15:18
sdakeand if no success I guess just take his blueprint15:18
sdakeI dont have his phone # so not sure what his status is15:18
micktI'll keep it in mind :)15:19
*** daneyon has joined #kolla15:33
*** daneyon_ has joined #kolla15:34
*** daneyon has quit IRC15:37
*** pbourke has quit IRC15:38
*** pbourke has joined #kolla15:39
sdakedaneyon_ did you see that mail hit your inbox15:42
sdakesamyaple any word on kolla start woring or not working15:42
daneyon_sdake i'm working through my email then I need to prepare for a 9:00 webex meeting that i'm leading15:42
*** jtriley has quit IRC15:42
sdakedaneyon_ need 2 minutes of your time https://bugs.launchpad.net/kolla/+bug/146805615:43
openstackLaunchpad bug 1468056 in kolla "Supermin unable to load kernel modules" [High,Triaged] - Assigned to Daneyon Hansen (danehans)15:43
sdakeis this because f22 ernel modules are compressed15:43
sdakeand supermin in centos expects them to be incompressed?15:44
*** mstachow has quit IRC15:44
daneyon_sdake, I updated https://bugs.launchpad.net/kolla/+bug/1468056 a few minutes ago.15:45
openstackLaunchpad bug 1468056 in kolla "Supermin unable to load kernel modules" [High,Triaged] - Assigned to Daneyon Hansen (danehans)15:45
sdakeok well tht would be my assumption s to what the problem is15:45
sdakenote i updated teh devstart guide15:45
sdakewith instructions i personally tested15:46
sdakeenjoy your webex :)15:46
sdakethanks15:46
*** jtriley has joined #kolla15:48
*** sdake_ has joined #kolla15:50
*** sdake has quit IRC15:54
SamYaplesdake_: its been running15:55
SamYaplefew issues with glance data15:55
*** jmccarthy has joined #kolla15:56
SamYapledaneyon_: sorry i was asleep yesterday15:56
sdake_samyaple any idea what is going on with glance?15:56
SamYaplewhat were your questions regarding dokcer 1.715:56
SamYapleglance-data container doesnt exist/isnt built15:56
sdake_samyaple danyeon- is afk15:56
sdake_oh but if you build yourself itworks right?15:56
daneyon_SamYaple what base OS did you use for 1.7?15:56
SamYapledaneyon_: fedora22 and ubuntu 14.0415:57
sdake_samyaple fedora 22 kernel model loaded for you?15:57
SamYapledocker kernel module15:57
SamYaple?15:57
sdake_https://bugs.launchpad.net/kolla/+bug/146805615:58
openstackLaunchpad bug 1468056 in kolla "Supermin unable to load kernel modules" [High,Triaged] - Assigned to Daneyon Hansen (danehans)15:58
SamYapleive had my head buried in ansible for a week im out of loop15:58
rhalliseySamYaple, the glance-data doesn't work?15:58
sdake_someone changed the ovs container to "needs review" was that you sam, or fang or the infra?15:58
SamYaplerhallisey:  Error: image kollaglue/centos-rdo-glance-data:latest not found15:59
rhalliseyI haven't had any issues.. what's wrong with it?15:59
rhalliseyok15:59
SamYaplelooks like its not pushed15:59
rhalliseyyup15:59
sdake_not pushed15:59
sdake_but thats ok15:59
rhalliseywas it merged?15:59
sdake_it can still be built locally15:59
daneyon_SamYaple I tried F22 and had some problems. I am now using F21 with the Docker daemon using overlay instead of devicemapper graphdriver.15:59
sdake_overlay doesnt work - rpm bug15:59
SamYapledaneyon_: ah yea. ive been using zfs driver15:59
daneyon_SO far it works, but I notice I have to restart the daemon whenever I need to stop/start a container.15:59
sdake_daneyon_ read new quickstart16:00
sdake_daneyon_ you can't build images with overlayfs16:00
SamYaplesdake_: no but theyll run fine16:00
daneyon_sdake_ I'll take a look after this meeting. Gotta disconnect for about an hour.16:00
sdake_agree]16:00
SamYapledaneyon_: ill look into replicating16:00
*** vbel1 has quit IRC16:03
openstackgerritSteven Dake proposed stackforge/kolla: Add warnings about running on F22 and later  https://review.openstack.org/19565416:05
SamYaplewho pushes to the kollaglue namespace?16:05
sdake_typically I do16:08
*** jmccarthy has quit IRC16:08
sdake_but anyone in core can16:08
*** jmccarthy has joined #kolla16:08
sdake_if you don't have permissions hit me up and I'll add you16:08
sdake_it takes me about 5 hours to do the push16:09
sdake_i had a 300$ rackspace bill from my last sset of pushes16:09
sdake_so now i'm just going to abuse my isp instead ;)16:09
SamYaplei probably dont have perms, but ill check16:09
SamYaplepsshh ive got free stuff16:09
sdake_the way I push is build-all-containers --push --release16:10
sdake_if you want to tae on responsibility for pushing on releae day that owuld rock ;)16:10
sdake_can I get a couple cores to ack https://review.openstack.org/#/c/195654/16:11
sdake_and then I'll tag and announce the release16:12
sdake_517 pulls https://registry.hub.docker.com/u/kollaglue/centos-rdo-nova-compute/16:14
sdake_pretty good - that means maybe like ~250 people have tried out our software16:14
SamYaplesdake_: sure, but im not setup for that yet16:15
sdake_sam your all set on permissions16:15
sdake_I added sam@yaple.net16:15
sdake_harmw what is your email adr?16:16
sdake_mandre if your still awake what is yours as well16:16
*** vbel1 has joined #kolla16:20
sdake_note i'll be pushing the olla images now16:23
SamYaplequestion on tagging16:24
sdake_we tag with --release flag16:24
SamYaplewill we be tagging :kilo :liberty etc?16:24
sdake_which uses "latest"16:24
sdake_we already tag kilo liberty etc16:24
SamYapleright but is that how we do it?16:24
sdake_yup16:24
SamYapleso liberty == latest atm?16:24
sdake_I thin we have :laatet as lateast atm16:25
jmccarthyWill that remedy this complaint ? Error: image kollaglue/centos-rdo-glance-data:latest not found16:25
sdake_what do the compose files have?16:25
harmwsdake_: underscore!16:25
*** sdake_ is now known as sdake16:25
sdakeI broke harmw's underscore parser16:25
harmwyup16:25
sdakeharmw email address plz :)16:25
sdakeand pleae approve that patch in the scroll log16:25
sdake(if you want access to docker push)16:26
harmwis that the F22?16:26
harmwsupermin16:26
*** vinkman has joined #kolla16:27
sdakesupermin i in both f21 and f2216:28
sdakesee the bug log for an alaysis16:28
sdakenote we should be super nitpicky on docs16:28
sdakethey are our users first interaction wit hthe prjoect16:29
sdakeso if there are mispellings/etc we dont want that ;)16:29
harmwis it realy .zx?16:29
sdakeyes16:29
sdakepretty sure16:29
sdakeif not sure check the bug - it has details16:30
harmwwell my F21 has .xz :)16:30
sdakegroan16:30
SamYaplexz is a compression type16:31
harmwyep16:31
SamYaplezx is the alphabet backwards missing y16:31
openstackgerritSteven Dake proposed stackforge/kolla: Add warnings about running on F22 and later  https://review.openstack.org/19565416:32
harmwseconds away from -1 :p16:33
harmwsdake: commitmsg has .zx16:33
sdakewell add your coments in if they were beyond the xz thing16:33
SamYaplethats not the docs though!16:33
sdakeso i can fix them16:33
harmwi know SamYaple :)16:33
SamYaplesdake: your words are not in alphabetical order16:34
harmwif they were, the sentences would look/read vry weird16:34
* sdake smacks samyaple around16:34
harmwhow about a typo sdake16:35
harmw'THen'16:35
SamYaple:)16:35
harmwuhm, without n16:35
SamYapleshould be spelled 'ehT' anyway16:35
sdakein ascibetical, it should be spelled Teh :)16:35
sdakeharmw leave review comments - be super nitpicky - docs are our first introduction for the user16:36
SamYaplei only no l33t speek16:36
harmwjust did sdake :)16:36
jpeelerman gerrit should make it very clear a new patchset came in while you were looking at the files16:37
SamYapleblind merging is my style16:37
SamYapleask for forgiveness, not permissions16:37
openstackgerritSteven Dake proposed stackforge/kolla: Add warnings about running on F22 and later  https://review.openstack.org/19565416:38
jpeelernow you have a triple space16:39
sdakewhich line jpeeler16:39
jpeelerthe first of modifications, 1216:39
harmwlol yes indeed, damn16:40
harmwmissed it :P16:40
sdakebetween which words?16:40
sdakeI dont see it16:40
harmwlater.   Fedora 2216:40
openstackgerritSteven Dake proposed stackforge/kolla: Add warnings about running on F22 and later  https://review.openstack.org/19565416:41
SamYapleah i understand this issue now daneyon_. Yea I do my deploys on ubuntu. ive _used_ docker1.7 on fedora22 and ubuntu 14.0416:41
sdaketriple spacing is the new single spacing!16:41
SamYapleive run into the same thing when deploying on F2216:41
* jpeeler single spaces and thinks it's superior16:41
sdakeI ased my 7th grader id what they teach in school16:42
sdakeshe said double spacing16:42
sdakeid/kid16:42
* SamYaple thinks all spaces need to be escpaed or otherwise sanatized16:42
jpeelerit's still triple spaced16:42
jpeeleroh wait16:42
jpeelersorry wrong patchset16:42
SamYaplelol16:42
sdakesamyaple is this implemented or still in "Needs code review"16:43
sdakeI set it to implemented but someone else set it to needs code review16:43
sdakehttps://blueprints.launchpad.net/kolla/+spec/openvswitch-container16:43
SamYaplethe neutron agent part of that isnt commited yet16:44
SamYaplehttps://review.openstack.org/#/c/181737/16:45
*** shardy has quit IRC16:45
SamYapleyou abandonded yesterday16:45
*** shardy has joined #kolla16:45
sdakei see16:45
sdakewell i fucked that one up16:46
sdakehttps://review.openstack.org/#/c/181737/16:46
sdakemy bad16:46
sdakethats what I get for abandoning someone elses work16:46
sdakecan you fix the review comment so we can get that in16:46
sdakethat is the last peice of work that needs to hit the repo then16:46
SamYaplewhat do you want me to fix?16:47
sdakeadd the variables to integration-guide.md16:47
sdakepatch set 4 has 1 comment16:47
SamYapleok. let me open that file.16:48
SamYaplenot for the first time...16:48
SamYaplesdake: i havent tested magnum yet. how does that work docker-on-docker?16:52
sdakeit works16:52
sdakemagnum runs idocker in vms16:52
sdakenot on bare metal16:52
SamYapleah16:52
SamYaplei was banging the nova-docker driver around16:53
SamYaplewe could get that to work with kolla16:53
vinkmanI thought Magnum can run Docker on baremetal using Ironic as well??16:53
harmwSamYaple: you've only one keystone ansible, right?16:54
harmwis docs updated to walk an operator through it?16:54
SamYapleharmw: nope16:54
SamYapleafaik there are on ansible docs written16:54
harmwok16:54
SamYapleexcept a little one i wrote on first ansible commit16:54
harmwwhat the url to get docker again?16:55
SamYapleits official docker stable now16:55
SamYapledocker.io16:55
SamYapleget.docker.io16:55
SamYapleall kinds of ways16:55
harmwI didn't want to use yum16:56
SamYaple im sure there is a directurl floating around16:56
*** jmccarthy has quit IRC16:57
*** athomas has quit IRC16:57
harmwhttp://docs.docker.com/installation/binaries/16:58
SamYapleDB_CLUSTER_WSREP_METHOD=<rsync|mysqldump|xtremebackup|xtremebackup-v2>16:59
SamYaplelol16:59
SamYaplethats from our docs16:59
SamYaple(its xtrabackup for those not getting it)16:59
harmw:p16:59
harmwpercona stuff16:59
SamYaplethe only way to fly man17:00
openstackgerritSam Yaple proposed stackforge/kolla: Add neutron-openvswitch-agent contianer  https://review.openstack.org/18173717:03
*** gfidente has quit IRC17:06
sdakesamyaple shouldn't this be a mandatory chec vars? NEUTRON_NETWORK_VLAN_RANGES17:06
SamYaplesdake: i have no idea about that stuff. fang wrote it all17:07
sdakecan you add to check required vars17:07
sdakei dont now what that crudini command does17:07
sdakebut if the variable isnt set the container will implode17:07
sdakeand we wan't it to implode corectly not raondmly :)17:08
SamYaplefrankly i dont think thats enough to get the container running17:08
SamYaplethe only way i can use it is with the config-external method17:08
sdakewell can you add to the check required vars17:08
sdakeand docs17:08
SamYaplevlans arent actually required so we cant put it in check_required17:09
sdakeand then we are +2 :)17:09
sdakebut its required by crudini17:09
SamYapleif you use vlan networks17:09
sdakeoh good point17:09
SamYaplewhich isnt required17:09
sdakeyup your right that one is tricy17:09
SamYaplei would actually feel more comfortable scraping that whole start script17:09
SamYaplebecause i really dont think itll work for config-internal17:10
sdakewell lets not do that right at this point in time17:10
sdakeafter l1 is released, we can sort it out17:10
SamYapleyup, its why i didnt17:10
sdakejpeeler or rhallisey or harmw if we could get a second review please17:10
sdakehttps://review.openstack.org/#/c/181737/17:10
vbel1http://docs.docker.com/installation/binaries  are not good on devicemapper distros because they try to use aufs/overlay by default17:11
vbel1and most of distros are devicemapper fans17:12
SamYaplevbel1: you should explictly set that17:12
vbel1SamYaple: yes17:12
SamYapledocker has never been very good at guessing what i want17:12
rhalliseymissing some required vars17:13
sdakeharmw if you are using fedora, you will want the rpm in the quickstart guide17:13
harmwhm, DESIGNATE_INITDB is empty on a fresh git pull17:13
sdakerhallisey we just had that discussion on irc17:13
harmwthis is CentOS 7 :)17:13
sdakeread scrollbck17:13
rhalliseyoh I missed it17:13
rhalliseyharmw, I changed it to INIT_DESIGNATE_DB17:13
rhalliseyif that merged..17:14
harmwthats not merged,17:14
rhalliseynvm them17:14
harmwbut, yes I was expecting to see just that :p17:14
harmwoh, no, it is merged17:14
harmwinteresting17:14
sdakeharmw the fedora 23 imagesshoudl lwor on centos17:14
sdakeclose enough ;)17:14
vbel1I used https://docs.docker.com/installation/fedora/ and  fedora22 rpms on centos 7 /oracle linux 717:15
rhalliseyok I think it's fine then17:15
vbel11.7 as well17:16
sdakeswitching networks brb17:19
*** sdake_ has joined #kolla17:20
*** sdake has quit IRC17:24
*** shardy has quit IRC17:25
*** vbel1 has quit IRC17:25
*** bradjones has quit IRC17:26
*** shardy has joined #kolla17:26
harmwhuh: kollaglue/centos-rdo-glance-data:latest not found17:28
harmwsup with that17:28
*** bradjones has joined #kolla17:28
*** bradjones has joined #kolla17:28
sdake_it has not been pushed17:28
harmwargh! underscores! everywhere!17:28
harmwtaking over the world!17:29
*** sdake_ is now known as sdake17:29
harmwis it on queue to be pushed or somthing?17:29
sdakehere is the release process17:29
sdake1. all blueprints go to implemented17:30
sdake2. all critical bugs go to fix commited17:30
sdake3. git tagged with release17:30
sdake4. reelase announcement on mailing list17:30
sdake5. docker images pushed17:30
sdakefor 2 its nice to fix all the bugs17:31
sdakebut only critical ones are blockers17:31
sdakeatm we are waiting on jenkins to do its thing17:31
*** jtriley_ has joined #kolla17:31
*** jtriley has quit IRC17:31
harmwcool17:31
harmwlets wait for jenkins :)17:31
sdakemy 10 year old son saed me ytersday17:32
sdake"daddy do you spend most of your time waiting on things"17:32
harmwlol!17:32
sdakemy response "that isn't the half of it warren"17:32
*** jtriley_ has quit IRC17:37
sdakesamyaple jsut to confirm in case I havent, the current thin containers for neutron work in the docer-compsoe mode with kolla start?17:44
*** rhallisey has quit IRC17:45
SamYaplesdake: im testing kolla start17:48
SamYaplethey work with docker-compose17:48
sdakeboy this centos shirt i have is hilarious17:50
sdake"Because you know what your doing."17:50
sdakeI'm sure the sales dudes at rht love that17:50
SamYaplegentoo -- "I swear I am not a ricer"17:50
sdakethe funny part is they printed like 20k of these shirts17:51
sdakeand everyone wants one ;)17:51
SamYaplefor kolla, are we going to switch to apache2 based keystone before rdo packaging?17:52
sdakei can't even imagine the chaos that is causing for the sales teams at rht :)17:52
SamYaplethey only gate with apache keystone17:52
SamYaplewait.... that t-shirt isn't ironic?17:52
sdakethey being who17:52
SamYaplekeystone upstream17:53
SamYaplethey dont use evelent and havent for a while17:53
sdakewhat are we doing at present?17:53
sdakejust using eventlet?17:53
SamYapleyes17:53
sdakei guess if that is what upstream is doing that makes sense17:53
sdakethey probably did that for a good reason :)17:53
sdakedamn what the hell is up with the gate17:55
sdakeneed a second reviewer on https://review.openstack.org/#/c/195516/17:57
SamYaple$517:57
harmwIll do it for free :>17:57
sdakeneed to switch networks bbiaf17:59
sdakeactually on the correct networ :)17:59
harmwhm, those new neutron containrs are not build yt, right?18:01
*** dontalton has joined #kolla18:02
SamYapleharmw: right18:04
SamYaplehas anyone tried rabbit lately? this fresh build is.... not working18:04
harmwno but ill run into that probably later :)18:05
harmwstill pulling18:05
harmwand then I have to build neutron18:05
*** rhallisey has joined #kolla18:05
SamYaplethose HA changes screwed rabbit up18:06
harmwouch18:06
harmwNo '/dev/log' or 'logger' included for syslog logging18:11
harmw/var/tmp/initramfs.5p1L8L/bin is on different filesystem than the rest.18:11
harmwUse -f option to override.18:11
sdakei thought the ha rabbit went int o a separate container18:11
sdakeor perhaps that was somethign else18:11
harmwanyone seen that before?18:11
sdakeharmw havent seen but looks bad - google may have the answers :)18:11
sdakesamyaple my guess is a missing genev somewhere - or borken rabbit upstream - or config optoins broe things18:13
sdakecould be one of many things18:13
SamYapleits a bad sed line18:13
harmwdamn18:13
SamYaplewe really need functional gate tests sdake18:20
sdake                   there were 5 things blocking that18:20
sdakenow we are down to 118:20
sdakeprogress18:20
SamYaplewhich is?18:20
sdakefunctional gate tests are the #1 thing on my blocker list to unblock18:20
sdakesingle nic operation18:20
SamYapleugh18:21
*** rhallisey has quit IRC18:22
sdakesamyaple so this sed bug, is there a bug filed and patch incoming to fix ;)18:27
SamYapleno. im not sure what it needs to be18:28
SamYaplei should have been asleep 2 hours ago18:28
harmwwhich piece is broken?18:28
harmw(link pls)18:29
*** jruano has quit IRC18:33
*** jasonsb has quit IRC18:33
*** jasonsb has joined #kolla18:34
SamYapleharmw: https://github.com/stackforge/kolla/blob/master/docker/centos/binary/rabbitmq/config-rabbit.sh#L1518:36
SamYapleCLUSTER_NODES should be CLUSTER_CONFIGURATION18:36
SamYaplei think18:36
SamYapleat least it sorta builds18:36
SamYaplethen i get permission errors with logs18:36
sdakejpeeler around18:36
jpeeleryeah18:36
sdakejpeeler would you mind addressing https://bugs.launchpad.net/kolla/+bug/146886318:37
openstackLaunchpad bug 1468863 in kolla "neutron-base needs oslo.policy package" [Critical,Confirmed]18:37
harmwhm, I known for sure I asked him to remove those quotes...18:37
harmwSamYaple: Ill take a look, just not this instant18:37
sdakeharmw i need to know when you will be done with the fix18:37
sdakeor find someone else ot fix it18:37
jpeelerok18:37
harmwI'm trying to test the new neutron containers18:37
sdakethose are fucked up because of that oslo policy bug18:38
harmwseriously...18:38
openstackgerritMerged stackforge/kolla: Glance missing oslo.i18n  https://review.openstack.org/19551618:38
sdakeya rdo needs better gating18:38
SamYapleImportError: No module named oslo_policy18:38
harmwjeez, not that again18:38
*** jasonsb has quit IRC18:38
jpeelersdake: it's because of delorean packages through, right?18:39
lothSamYaple: http://fun.irq.dk/funroll-loops.org/ re: gentooricer?18:39
sdakeyes18:39
jpeeleri assume we'll eventually stop using those18:39
harmwthose are only used for :latest18:40
SamYaple-funroll -math-fast-and-loose18:40
harmwSamYaple: is thre a bug regarding Rabbit?18:41
SamYaplei think sdake said he was making one. im walking to bed18:42
harmwcool18:42
harmwthought so to18:42
harmw*too18:42
sdakeharmw make he bug18:42
sdakei dont know what bug to make18:42
harmwme neither :>18:42
harmwill take a look18:42
harmwjust pulling it in18:42
sdake". . . and I liked the idea of running an entire system that wasn't compiled for a 386."18:43
*** jtriley has joined #kolla18:43
harmwsounds like gentoo18:43
*** dontalton has quit IRC18:44
openstackgerritJeff Peeler proposed stackforge/kolla: Add missing dependency oslo policy  https://review.openstack.org/19570018:44
sdakeso jpeeler we will be running delorean on master forever18:46
sdakewhen we make a branch o maintain (such as liberty) we will switch that to the liberty packages18:46
jpeelersounds like we need to put kolla into delorean18:46
sdakeonce we gate kolla delorean gets automatic gating for nothing :)18:47
jpeelersure, if they pay attention to our results18:48
sdakewell we can always file bugs ;)18:48
sdakedelorean should really ahve a dependency gate though18:49
sdakethat checks requirements.txt against the package dependencies and asks for manual intervention on failure18:49
jpeelerpython can't catch requires issues until run time18:49
jpeelerdelorean doesn't do that18:49
sdakei'd bet 1 dollar against 100 wherever delorean pulled that neutrron code from had oslo.policy in the requirements.txt18:50
jpeeleroh i see what you're saying18:50
*** jtriley has quit IRC18:50
jpeelerwith the fast pace of openstack, it would benefit us to help delorean18:51
jpeelerbut too many more important things i know18:51
sdakeyes this is hte manual bug reporting that should be done following these dependency faiures18:52
sdakeglance has one for i18n as well if you are in a  bug filing mood18:53
harmwwhich we all so happily do, right guys :)18:53
* sdake loves filing bugs18:53
sdakealmost as much as jerking around with launchpad all day long18:53
harmw:p18:53
harmwreporting packaging bugs sucks though18:53
sdakeharmw when will you e able to fix the rabbit container18:53
harmwhopefully tonight18:54
harmwcoming 2hrs18:54
sdakeso 2 hrs from now18:54
sdake?18:54
harmwuhm, yes18:54
sdakeok that wfm18:54
sdakei have meetings and what not so wont be around to hep18:54
sdakehelp18:54
harmw'coming 2hrs', jeez18:54
*** rhallisey has joined #kolla18:54
sdakerhalllisey you up for fixing the busted rabbitmq container18:55
harmwI just need to get clear what the issue is, fix it, file a bug, get reviews rolling and done18:55
sdakeits blocking our releae18:55
harmwwe could revert...18:55
sdakei'd prefer to fix18:55
sdakeif we can't fix it today we will revert it18:56
sdakeand let the owner fix it properly18:56
harmwok, good to know reverting is a valid option18:56
sdakebut its almost the wekeend and I don't want to slip at all18:56
sdake25th hard deadline18:56
harmwI rather see it fixed as well :)18:57
harmwdon't get me wrong on that :>18:57
sdakerhallisey if you can help get harmw warmed up on the rabbitmq container that would be fantastic18:57
sdakeor jpeeler as well :)18:57
sdakeapparently it has soething to do with a bad sed line18:57
sdakeand incorrect logging permissions18:57
sdakesamyaple hit the wall so he was unable to file a bug report on the issue he saw18:58
rhalliseyk18:58
sdakei'll be back in 30 mins for 1.5 hours18:58
sdakethen i'm locked up the rest of the day in meetings18:58
sdakeso please try to have some kind of bug report filed in the next 30 minutes so I can spend my 1.5 hours available working on the problem as well18:59
sdakeall hands on deck sort of thing18:59
sdakeharmw can't begin for 2 hours18:59
harmwno no, I'm at it right now18:59
sdakewhich puts us late into the night and possibly unable to get the review through the review queue18:59
sdakeharmw oh I misunderstood my bad :)18:59
harmwperhaps I wrote it down in some cranky way though :p19:00
sdakeharmw well as soon as you get a bug filed get it linekd in channel so rhallisey  and possibly jpeeler can investigate19:00
harmwyeppers19:00
harmwwell it stars up just fine, no errors no nothign19:03
harmwstill awaiting the pull though, to fire up kolla19:03
harmwin all it's might and glory!19:03
sdakedont pull19:03
sdakebuild19:03
sdake./build --release --no-cache19:03
sdakepull means your pulling something that we now works :)19:03
harmwb/c rabbit wsn't build yet19:04
* harmw smacks face19:04
* harmw does that again19:04
harmwRABBITMQ_CLUSTER_COOKIE=<rabbit-cookie> - Default to none.19:07
harmwbut we run itthrough check_varrs19:07
harmw...19:08
sdakenow/known works19:08
*** jruano has joined #kolla19:08
sdakeok i'm back for a short bit - scrum meetings ftl19:08
sdakeso lets default that to RABBIT_COOKIE or something19:09
sdakeor if it needs to be some uuid or something19:09
sdakelets generate it19:09
harmwwell if it's set, the cluster code kicks in19:09
sdakeharmw one more thing I wanted to point out, make sure to run a clean genev19:09
sdakegenenv19:09
harmwyea19:09
sdakeso your running like our users would19:09
harmwyep19:09
sdakeoh i see, so remoe from checkvars?19:09
harmwindeed, I'm gonna try that19:09
harmw(plus, did I realy +2 this?)19:10
*** jtriley has joined #kolla19:10
harmw(if so, /me smacks again)19:10
sdakeguys dont go hard on yourelf for +2 an error19:10
sdakeit happens all the time in openstack19:10
sdakewe rshould also be reling on functioanl gating19:10
sdakeas well as human inspection19:10
harmwtornado's happen al the time as well, doesn't mean we don't like 'em either now does it :p19:11
sdakein other words, our gating is only half the power of gating technique19:11
harmwyep19:11
sdakeso clearl ywe need functional gating19:12
sdakeand we are gettting that unblocked ;)19:12
sdakesuperman samyaple has done a tremendous job on helping remove some blockers there19:13
*** jasonsb has joined #kolla19:13
*** jasonsb has quit IRC19:13
*** jasonsb has joined #kolla19:13
*** jtriley has quit IRC19:17
*** jtriley has joined #kolla19:17
sdakeharmw get reviews in as soon as possible - they can be separate commits19:21
sdakethe reason is because the gate is really overloaded atm19:21
harmwstill debugging the shit19:21
sdakeso I want to get our changes in quickly19:21
sdakewell the check vars, you know that is busted19:21
harmwthats just one thing, half of it19:21
sdakeif you think its faster not to do that then dont19:21
sdakejust trying to optimize our progress through the gerrit queue :)19:22
sdakehp cloud services had a major outage earlier19:22
sdakeso it busted the gate19:22
*** vbel has joined #kolla19:24
harmware there details on the matter available?19:28
harmwfor personal joy :)19:29
harmwbtw, I'll be making a bugreport covering multiple issues with rabbit19:29
harmwall related to one thing, the cluster patch19:29
*** jtriley has quit IRC19:35
harmwsdake: check19:42
*** daneyon_ has quit IRC19:42
openstackgerritHarm Weites proposed stackforge/kolla: Do not run all vars through check_required_vars  https://review.openstack.org/19571719:42
sdakeharmw whatever you think is best19:42
harmwno, just 1 fix for 1 problem19:42
harmwnot having LOG_BASE was already thre19:42
*** shardy has quit IRC19:42
harmwI'm looking at a running broker now :)19:42
harmwwoohoo19:42
harmwsingle-node though19:42
sdakemake sure it works (by using heat or something)19:43
sdakeor nova19:43
harmwconfig hasn't changed19:43
*** shardy has joined #kolla19:43
harmwjust missing the cluster-specific bit19:43
*** vbel has quit IRC19:43
sdakeharmw does that last change require changes to the integration-guide.md?19:44
harmwlet me double check that19:44
harmwno19:45
sdakethe cluster nodes vs cluster configuration thing19:45
sdakejpeeler or rhallisey can you ack that patch plz19:45
sdakeharmw is more work needed for rabbitmq?19:45
harmwnope, just ran a tools/genenv and compose up -d19:45
harmwsill works19:46
rhalliseyya I saw that line was missing in his patch19:46
rhalliseygood catch19:46
sdakeso we are good to release once the gerrit queues up?19:46
sdakewe should probably double check neutron thin agents19:46
sdakeharmw I think you were doing that right?19:46
harmwwere, yes19:46
harmwlets see if I can get more time from my timemachine19:47
sdakeappreciate the commitment harmw19:47
sdakeI know its a pita19:47
sdakeso what went wrong with that original commit is it was only tested in cluster mode19:48
sdakenot in single user mode19:48
sdakesingle ndoe mode i mean19:48
harmwprobably19:48
*** jtriley has joined #kolla19:49
harmwrebuilding neutron now19:54
sdakeguys19:56
sdakeI changed the release announcement a bit19:56
sdakeand gals if we have any :)19:57
harmwchanged what19:57
sdakehttps://etherpad.openstack.org/p/kolla-liberty-1-announcement19:57
harmwgood improvements20:00
sdakethansk20:01
sdakeneed more core reviewers20:01
sdakewhich is reaon for throwing in the core reviewer part :)20:01
harmw:)20:02
sdakethis is your last chance20:02
sdakeafter this, there is no turning back ;)20:02
harmwchance for what20:02
openstackgerritMerged stackforge/kolla: Add warnings about running on F22 and later  https://review.openstack.org/19565420:03
sdakeoh just watching the matrix20:03
harmwwasn't that something with pills?20:03
harmw"take the green pill, take the yellow pill"20:04
sdakered pill = reality20:05
sdakeblue pill = fat dumb happy20:05
sdakeharmw any word on the neutron thin containers?20:06
sdakeor still building20:06
vinkmanHmmm… Is it just me or is glance container broken? It is stuck at 35% creating the image…20:06
harmwchecking logs now20:06
sdakeharmws were you able to register an image with glance?20:06
harmwyep20:06
harmwfrom the pull20:06
sdakevinkman which distro20:06
harmwI didn't reubild20:06
sdakeoh from the pull20:06
* sdake groans20:06
sdakeok wel dont buid20:06
sdakewe can debug that problem next ;)20:06
vinkmanUbuntu 15.04 with local build20:07
harmwI'm testing nutron, remember ;)20:07
sdakevinkman my machines are broke atm20:07
sdakeso harmw and jpeeler and rhallisey are the only guys that can debug20:07
vinkmanThat's what VMs are for :D20:07
sdakevinkman i'd suggest doing a pull of the container to get unblocked20:07
vinkmankk…20:07
sdakevinkman my mahchines are really broken20:07
vinkmanlol… time for a hammer then...20:08
harmwlinuxbridgecontainer is broken20:08
sdakeharmw could you go into more detail20:08
harmwofcourse ;)20:08
harmw2015-06-25 20:06:34.339 1 ERROR neutron AttributeError: 'LinuxBridgeNeutronAgentRPC' object has no attribute 'state_rpc'20:08
harmwand20:09
harmw2015-06-25 20:06:34.338 1 ERROR neutron.openstack.common.threadgroup     mac = utils.get_interface_mac(physical_interfaces[0])20:09
harmw2015-06-25 20:06:34.338 1 ERROR neutron.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 153, in get_interface_mac20:09
harmw2015-06-25 20:06:34.338 1 ERROR neutron.openstack.common.threadgroup     struct.pack('256s', interface[:constants.DEVICE_NAME_MAX_LEN]))20:09
harmw2015-06-25 20:06:34.338 1 ERROR neutron.openstack.common.threadgroup IOError: [Errno 19] No such device20:09
harmwcould be this laptop, dunno yet20:09
sdakeget me some anestaphine plz20:09
harmwthere, FLAT_INTERFACE=eth120:10
harmwdoesn't exist20:10
sdakeoh well you need to configure your system20:10
sdakedoes your system have two nics?20:10
harmwchanged to wlp3s0b120:10
harmwlets see what happens20:10
sdakeuse cleanup-containers -f20:10
sdakebefoer starting fresh plz20:10
harmwno just kolla restart?20:10
sdakedo cleanup-containers -f20:10
sdakeit will result in a totally clean environment20:11
harmwyea I know, ok20:11
sdakeyour db is probably afu from that config error20:11
harmwyup, good point20:11
sdakebut if not, lets not chase thatproblem down - just elimiate it entirely20:11
harmwtrying with enp2s0f0 btw, lets see what happens20:11
harmweven though that nic isn't online20:11
sdakethe flat interface shouldn't be active20:12
sdakeneutron activates it20:12
harmwit's not20:12
sdakethe public intefface should be active20:12
*** rhallisey is now known as rhallisey|brb20:12
harmwbtw, when running virtualboxed coreos I'm only using (having) eth0...20:12
harmwok, now tools/kolla start20:12
sdakeand that works?20:12
harmwyep20:12
harmwwhich is why I never understood what the problem with that was20:13
harmwyou guys seemed to be having20:13
harmwbut lets get this neutron stuff sorted first20:13
harmwbefore heading over to either glance or my bed :>20:13
sdakewere your vms able to communicate in/out20:13
sdakevia floating ips /etc20:13
harmwyes20:13
harmwbut I want to test that again20:14
harmwjust to make sure I'm not wrong after all20:14
harmwok, waiting for containers to settle20:14
harmwcrap, same error :|20:14
harmwah, there is a NEUTRON_FLAT_NETWORK_INTERFACE20:18
sdakeya the other flat interface is for nova20:19
harmwgreat :|20:19
harmwtime to run it again20:19
harmwweird, as if those two would result in something different...20:20
harmw(different discussion though)20:20
harmwtools/kolla start20:20
sdakeya imperfect20:21
sdakewe also have PUBLIC_IP defined twice in the scripts20:21
sdakewhy?  no idea :)20:21
harmwyup20:21
sdakeI keep hoping someone else will fix it20:21
sdakebroken window theory ftw20:21
harmwme too, actually :p20:21
harmwI'd love to just sweep to all those script and cleanup - bad20:22
harmwok, neutron is up and running now20:22
harmwso they start20:22
sdakedo they work is the question :)20:23
harmwand will my laptop play nice as well20:23
sdakei'll brb - need to break harmw's _ filter20:23
*** sdake_ has joined #kolla20:24
harmwah, my glance is broken b/c of that i18n bug20:28
harmwlts build again20:28
*** sdake has quit IRC20:28
sdake_vinkman have you rebuilt with the i18n bug merged into your repo?20:28
harmwgod that hurts man!20:28
harmwsdake_: pain!20:28
*** sdake_ is now known as sdake20:29
sdakeblame csco for their stupid split routing policy20:29
harmwrebuil glnce, can I now kolla restart?20:30
harmwor should I nuke it20:30
sdakenuke20:30
harmwif neutron 'just works' it should atleast have metadata running without issues20:31
harmwmy laptop probably isn't fit for routing beyond that20:31
vinkmanI am going to rebuild everything now…20:31
sdakei'm not sure if i18n has hit the repo yet20:32
harmwvinkman: make sure you got that fix in20:32
vinkmankk.. checking...20:32
harmwhttps://review.openstack.org/#/c/195516/1/docker/centos/binary/glance/glance-base/Dockerfile20:32
vinkmanYup it is in : Merge: 75b8cdd 89d69ec20:33
vinkmanAuthor: Jenkins <jenkins@review.openstack.org>20:33
vinkmanDate:   Thu Jun 25 18:38:30 2015 +000020:33
vinkman    Merge "Glance missing oslo.i18n"20:33
harmwhuh, I rebuilt my glance stuff but it still complains :|20:33
harmw[root@27f8938b5dca /]# rpm -qa|grep oslo20:34
harmwpython-oslo-i18n-1.7.0-post4.el7.centos.noarch20:34
harmwhm (thats the glnce-base)20:34
openstackgerritMerged stackforge/kolla: Add neutron-openvswitch-agent contianer  https://review.openstack.org/18173720:36
sdakedid you ./build --release20:37
sdake--release will tag it with latest20:37
harmwyep20:37
harmwthe rpm is installed though20:38
*** vinkman has quit IRC20:40
*** vinkman has joined #kolla20:41
harmwsdake: this feels like some issue at RDO though20:42
sdakecould you go into more detail20:42
sdakei juset got a vm setup so  Ican help debug20:42
harmwwell, the files are in plce20:42
sdakeafter jerking around getting my system setup today20:43
harmw[root@1dc417b06238 /]# python20:43
harmwPython 2.7.5 (default, Jun 17 2014, 18:11:42)20:43
harmw[GCC 4.8.2 20140120 (Red Hat 4.8.2-16)] on linux220:43
harmwType "help", "copyright", "credits" or "license" for more information.20:43
harmw>>> from oslo.i18n import *20:43
harmwTraceback (most recent call last): File "<stdin>", line 1, in <module>20:43
harmwImportError: No module named i18n20:43
dimsharm: try20:43
dimsfrom oslo_i18n import *20:43
harmwoslo_i18n seems to work, that folder exists20:44
harmwlol dims :) just did that20:44
harmwworks20:44
dimsharmw: this may provide some context http://markmail.org/message/nxyy7bmxxgueftzn20:46
harmwglance doesn't start though, it stays quiet20:46
harmwso whn that hits upstream Glance, and ripples through RDO, we're gold20:47
harmwhe should've waited a week though :p20:47
sdakeok well we aren't waiting a week20:51
sdakedims what is the workaround20:51
harmwpatching glance20:52
sdakeobviously20:52
sdakewith what ;)20:52
dimsharmw: or cap oslo.i18n library version20:52
dimsi don't know much about what you are doing20:52
sdakedims we are installing from rdo delorean packaging20:52
sdakeso we can't cap20:53
sdakewhy would we need to patch glance - guess I dont get that part20:53
sdakedoesn't the glance gate, like check if glance works20:53
sdakeand if not, rrejects the patch?20:53
harmwlol20:54
harmwyou'd expect that to happen yes20:54
dimsharmw: sdake: https://review.openstack.org/#/c/193335/20:54
harmwperhps gate didn't know of the change20:54
dimsmerged on june 20th20:54
dimsoslo.i18n-2.0.0 was cut on june 23rd20:55
harmwpython-oslo-i18n-1.7.0-post4.el7.centos.noarch20:55
*** jtriley has quit IRC20:55
harmwis what I'm running in the container20:55
harmwthat rpm is from 06-2220:56
sdakedims so we need oslo.18n-2.0.0?20:56
harmwhttp://trunk.rdoproject.org/centos70/e6/8b/e68b6c1a86ed452893165aa03f5d3c1ad0ffd41b_2a8263cb/python-oslo-i18n-2.0.0-post1.el7.centos.noarch.rpm20:57
harmwits there20:57
harmwjust not in a corner we look at20:58
harmwor is this me fucking up on -base --no-cache again :|20:58
harmwsdake: you got your rig up&running?20:58
sdakeharmw i've got a 30 minute meeting then will be back20:58
harmwill be gone by then20:58
sdakeunderstood i'll take over20:58
sdakeplease file a bug with the info you know20:58
harmwwill do20:58
harmwnext time lets do this kind of thing on friday, ok :p20:59
harmw*evening20:59
dimsharmw: sdake: glance CI jobs seem to be doing ok. not sure what the rpms from deloran contain (which version of glance?)20:59
sdakeharms can you answer dims question plz21:00
sdakei've got to jet for 30 mins21:00
harmwdims: openstack-glance-2015.1.0-3.el7.noarch21:00
*** prad has quit IRC21:05
harmwhttps://bugs.launchpad.net/kolla/+bug/146890821:08
openstackLaunchpad bug 1468908 in kolla "glance oslo.i18n not found, should be oslo_i18n" [Undecided,New]21:08
harmwwe could open up https://bugs.launchpad.net/kolla/+bug/1468729 instead though, Ill leave that to you sdake21:10
openstackLaunchpad bug 1468729 in kolla "Glance - missing oslo.i18n" [Critical,Fix committed] - Assigned to Michał Jastrzębski (inc007)21:10
harmwI'm out guys21:10
sdakedims how do I fix this problem21:31
dimssdake: http://git.openstack.org/cgit/openstack/glance/tree/requirements.txt?id=2015.1.021:32
dimsoslo.i18n>=1.5.0,<1.6.021:32
sdakei cant cap, i am installing from packages21:32
dimsjust pointing out that the package does not seem to do the right thing21:33
sdakeyes delorean packaging doesn't gate on reuirements.txt (it should)21:33
sdakein other words, it doesn't verify its dependencies in its srpms match the upstream requirements21:34
dimssdake: what can i say? either the glance code needs to be fixed or the right oslo.i18n library should be used... :(21:34
sdakehow do I fix teh glance code21:35
dimsdoesn't delorean folks have a CI that tests their rpms against each other?21:35
sdakei can apply patches after package instlal21:35
sdakeno they dont21:35
dimssdake: grab the clean_oslo_namespaces.sh  and run that? https://review.openstack.org/#/c/195263/21:36
dimsjust a bunch of seds21:36
sdakehow would I get that to operate on /usr/lib/python2.7/site-packages/glance?21:37
*** shardy has quit IRC21:40
dimsback it up, try it and see which files are touched and show me a diff? i can take a peek21:40
openstackgerritMerged stackforge/kolla: Add missing dependency oslo policy  https://review.openstack.org/19570021:41
sdakehow do I run the script tho - it looks like it wants setup.py21:42
sdakebut these are installed pacages21:42
jpeelersdake: the glance package seems to only install to /usr/bin/21:44
jpeelerjust run it on rpm -ql openstack-glance | grep /usr/bin21:44
jpeeleryou may have to adjust the script, the sed is the important part21:44
sdakejpeeler interesting21:51
sdakejpeeler if I ls -l /usr/bin/glance-* in the container I get file not found21:55
sdakeyet rpm openstack-glance shows the files as there21:55
sdakejpeeler any idea why?21:55
jpeelerno because they show up for me21:56
sdakeI have 1 hour meeting, jpeeler if you can take the action to investigate further so dims can provide some sort of woraround, that would be fantastic ;)21:56
jpeeleroh wait, i'm not using current images21:56
jpeeleri think what needs to be done is understood21:56
sdakeI dont understand what needs to be done21:57
jpeelerthe sed script needs to run on the installed glance service files21:57
jpeelerif they aren't there, that doesn't make any sense. glance won't run then21:57
sdakeat this point i'd be happy with a pip install of the correct oslo i18n package21:57
sdakejpeeler i agree, perhaps that is the real problem21:57
sdakeor maybe my system is just broke21:57
jpeelerthat is one other solution, using pip21:57
jpeelernot any hackier than patching rpm installed files i suppose21:58
sdakei could go with pip with a techdebt bug21:58
sdakejpeeler can you try to investigate the pip techdebt bug option?21:58
jpeelerinvestigate or do it?21:58
sdakei dont understand why the files are there21:59
sdakeya do it21:59
sdakearen't there that is21:59
sdakethe fact that /dev/pts/ptmx ends up with 000 permissions totally breaks my system as well21:59
jpeelerare there any people timezones who are just starting? dims what time is it for you?21:59
sdakei thought rhallisey|brb was going to force that issue21:59
sdakejpeeler we have a timezone gap until around 6 hours from now22:00
sdakeand in 6 hours is saturday :(22:00
jpeeleroh right22:00
jpeelerwait, today is thursday22:00
sdakeya for other people i mean22:00
sdakei really want to releae toady - ithink its critical22:00
sdakebut more important is not releasing something that is doa22:00
jpeeleri guess that makes sense22:00
jpeeleri'll look into fixing it via pip then. but i'm going to go for a run while there's still light outside22:01
jpeeleractually, do you care if i just do the sed patch?22:01
openstackgerritMerged stackforge/kolla: Do not run all vars through check_required_vars  https://review.openstack.org/19571722:08
*** dims has quit IRC22:30
*** dontalton has joined #kolla22:32
*** jruano has quit IRC22:35
*** dims_ has joined #kolla22:38
sdakejpeeler I dont care the solution I care it works22:40
*** jasonsb has quit IRC22:45
*** jasonsb has joined #kolla22:45
*** dontalton has quit IRC22:45
*** rhallisey|brb is now known as rhallisey22:59
*** sdake_ has joined #kolla23:00
rhalliseysdake, is cinder breaking stuff?23:00
*** sdake has quit IRC23:04
*** sdake has joined #kolla23:07
*** sdake_ has quit IRC23:11
*** vinkman has quit IRC23:12
*** absubram has quit IRC23:29
*** jtriley has joined #kolla23:38
sdakecinder breaks the whole system23:42
sdakeno /dev/pts, everything depends on ptmx in a typical user system23:42
sdakeneed to set the permissions in the container on each container start23:42
*** vinkman has joined #kolla23:43
sdakerhallisey ^^23:43
*** juggler_ is now known as juggler23:44
sdakerhallisey can you address https://bugs.launchpad.net/kolla/+bug/1468951 asap plz23:46
openstackLaunchpad bug 1468951 in kolla "/dev/pts/ptmx needs to be set to 666" [Critical,Confirmed] - Assigned to Ryan Hallisey (rthall14)23:46
sdakeshould be easy23:46
rhalliseyI though I did :/23:47
sdakei just rebuilt23:48
sdakeit doesn't get set23:48
*** vinkman has quit IRC23:48
sdaketelling the users to do it in docs is not sufficient23:48
*** sdake has quit IRC23:54
*** sdake has joined #kolla23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!