*** jtriley has quit IRC | 00:03 | |
*** ccrouch has quit IRC | 00:07 | |
*** dims_ has joined #kolla | 00:14 | |
*** dims has quit IRC | 00:16 | |
*** diogogmt has quit IRC | 00:48 | |
*** tobe has joined #kolla | 00:56 | |
*** zhiwei has joined #kolla | 00:59 | |
*** mandre has joined #kolla | 00:59 | |
*** vinkman has quit IRC | 01:11 | |
*** sdake has joined #kolla | 01:28 | |
*** sdake_ has joined #kolla | 01:29 | |
sdake_ | harmw around | 01:30 |
---|---|---|
*** sdake has quit IRC | 01:33 | |
sdake_ | jpeeler any success | 01:34 |
*** jasonsb has joined #kolla | 01:35 | |
sdake_ | need a core to review https://review.openstack.org/#/c/195193/ | 01:35 |
openstackgerrit | Merged stackforge/kolla: Minor doc fixups in dev-quickstart.md https://review.openstack.org/190543 | 01:39 |
*** dims_ has quit IRC | 01:45 | |
*** jtriley has joined #kolla | 01:48 | |
*** dims has joined #kolla | 01:50 | |
*** rhallisey has quit IRC | 01:50 | |
*** jtriley has quit IRC | 01:54 | |
*** dontalton has quit IRC | 01:56 | |
mandre | hi all | 01:57 |
mandre | i'm back from the dead, i've been super busy the last few days | 01:58 |
mandre | it should be better now :) | 01:59 |
mandre | did I miss anything? | 01:59 |
*** erkules_ has joined #kolla | 01:59 | |
*** erkules has quit IRC | 02:01 | |
*** dims has quit IRC | 02:04 | |
sdake_ | mandre house is on fire | 02:05 |
sdake_ | mandre you have a bug assigned to you | 02:05 |
sdake_ | it involves making a new cmd line flag that takes an optional # of retries | 02:05 |
sdake_ | the retry will retry the container build | 02:06 |
sdake_ | we will want to pass this flag from the master build script to the individual build script | 02:06 |
sdake_ | we hve a release on the 25th | 02:06 |
sdake_ | (tomorrow) | 02:06 |
*** jasonsb has quit IRC | 02:07 | |
*** jasonsb has joined #kolla | 02:08 | |
mandre | should be doable | 02:08 |
*** gfidente has quit IRC | 02:08 | |
*** jasonsb has quit IRC | 02:08 | |
sdake_ | higher priority are these 3 bugs | 02:09 |
sdake_ | https://launchpad.net/kolla/+milestone/liberty-1 | 02:09 |
sdake_ | if you want t tae some or all of them over that would rock | 02:09 |
sdake_ | most of the us crew have signed off for the night since its 11pm on the east coast iirc | 02:09 |
*** dims has joined #kolla | 02:10 | |
sdake_ | one is a rebase | 02:11 |
*** jruano has joined #kolla | 02:11 | |
mandre | okay | 02:12 |
sdake_ | brb connecting to hardware | 02:13 |
*** sdake has joined #kolla | 02:13 | |
openstackgerrit | Steven Dake proposed stackforge/kolla: Add more checks to the glance containers https://review.openstack.org/195193 | 02:14 |
*** sdake_ has quit IRC | 02:17 | |
sdake | mandre i'll tae this one https://bugs.launchpad.net/kolla/+bug/1468464 | 02:17 |
openstack | Launchpad bug 1468464 in kolla "Unable to install Docker 1.7 following dev-quickstart guide" [Critical,Confirmed] - Assigned to Steven Dake (sdake) | 02:17 |
openstackgerrit | Merged stackforge/kolla: Set up glance to use a data container. https://review.openstack.org/191975 | 02:18 |
mandre | i'll rebase https://bugs.launchpad.net/kolla/+bug/1463101 | 02:19 |
openstack | Launchpad bug 1463101 in kolla "genenv dependent on openssl without verifying its existence" [Medium,In progress] - Assigned to Harm Weites (harmw) | 02:19 |
openstackgerrit | Martin André proposed stackforge/kolla: Check if tools/genenv binary dependencies are met. https://review.openstack.org/191580 | 02:21 |
mandre | why isn't gerrit adding comments to launchpad for patches that reference a bug? | 02:36 |
mandre | I'm thinking about https://bugs.launchpad.net/kolla/+bug/1432336 | 02:37 |
openstack | Launchpad bug 1432336 in kolla "Need add more check var for glance-api" [High,In progress] - Assigned to Ryan Hallisey (rthall14) | 02:37 |
mandre | there are 3 concurent patches in gerrit fixing the bug | 02:37 |
sdake | i am not sure | 02:37 |
sdake | sometimes it doesn't wor peroply | 02:37 |
sdake | https://launchpad.net/kolla/+milestone/liberty-1 | 02:38 |
sdake | 3 bugs to go | 02:38 |
*** diogogmt has joined #kolla | 02:40 | |
*** jtriley has joined #kolla | 02:49 | |
*** jtriley has quit IRC | 02:54 | |
*** dims has quit IRC | 02:58 | |
openstackgerrit | Merged stackforge/kolla: Check if tools/genenv binary dependencies are met. https://review.openstack.org/191580 | 02:59 |
sdake | mandre can you run fix all the build linsk script and see if it changes anything | 03:05 |
sdake | I have concerns ovs link scripts are nto setup properly | 03:05 |
openstackgerrit | Steven Dake proposed stackforge/kolla: Correct dev-quickstart installation directions kUse was using yum to install docker 1.7.0. This wanted to install all of the fedora 23 dependencies. Instead, simply use RPM to install via http with the --nodeps option. This works because we don't reall https://review.openstack.org/195395 | 03:10 |
mandre | sdake: I noticed the same, I was about to fill a bug for it | 03:11 |
sdake | pleae do so | 03:12 |
sdake | and fix if yo ucan | 03:12 |
mandre | how do we treat bugs that have already been fixed in master? https://bugs.launchpad.net/kolla/+bug/1466913 | 03:12 |
openstack | Launchpad bug 1466913 in kolla "Cinder symlinks broken in fedora + rhel" [Undecided,New] | 03:12 |
mandre | change to invalid? | 03:12 |
sdake | already merged? | 03:12 |
sdake | they shoudl be assigned to lierty-1 | 03:12 |
sdake | and assigned a priority and assigned to the person who fixed it | 03:13 |
sdake | that would be a critical priority | 03:13 |
sdake | make sense? We fixed it in liberty 1, should be recorded there | 03:13 |
sdake | set to "Fix committeed" | 03:13 |
sdake | i am not superman maintaining the launchpad tracer is a fulltime job | 03:14 |
mandre | okay | 03:14 |
sdake | can use all the help people can give :) | 03:14 |
*** jruano has quit IRC | 03:15 | |
mandre | all the new containers (galera, keepalived, openvswitch) were only added to centos base image, is that intentional? | 03:23 |
sdake | yes | 03:24 |
sdake | the idea is we would symlink to centos | 03:24 |
sdake | except the dockerfile | 03:24 |
sdake | which would be unique per os/container | 03:24 |
mandre | i mean, the symlinks are missing... | 03:25 |
jpeeler | i can't stay for long, but i'm back | 03:25 |
jpeeler | yes, in ovs-base the build symlink is wrong | 03:25 |
sdake | hey jpeeler i fixed upt hat doc bug | 03:25 |
sdake | perhaps you have time to review | 03:25 |
*** tobe has quit IRC | 03:26 | |
jpeeler | sdake: yeah, i wouldn't have come up with that. but it looks simple, so if it works then great | 03:26 |
sdake | i buit a fresh f21 vm and amd buidling all docker containers now | 03:26 |
sdake | so it definately wors | 03:26 |
openstackgerrit | Merged stackforge/kolla: Add more checks to the glance containers https://review.openstack.org/195193 | 03:26 |
mandre | bad rebase on the glance-data container, it ended up at the wrong place | 03:26 |
jpeeler | the ovs container will fail due to the broken symlink | 03:26 |
sdake | mandre was going to file a bug for the ovs container | 03:27 |
sdake | and get a patch up i think | 03:27 |
jpeeler | i know we're trying to be good about having 1:1 commits to launchpad, but it's a symlink | 03:27 |
mandre | jpeeler: https://bugs.launchpad.net/kolla/+bug/1468591 | 03:27 |
openstack | Launchpad bug 1468591 in kolla "Broken links to build sript for OVS container" [Critical,New] - Assigned to Martin André (mandre) | 03:27 |
jpeeler | heh, well alrighty then | 03:28 |
*** jasonsb has joined #kolla | 03:28 | |
jpeeler | since rdo is a symlink, it's actually just one | 03:28 |
sdake | when you make exceptiosn thy expand | 03:28 |
sdake | into more areas | 03:28 |
sdake | "it only a symlin" | 03:28 |
sdake | "its only a one liner" | 03:28 |
sdake | etc | 03:28 |
sdake | this is why they are the way to th dark side | 03:29 |
sdake | because they are the easy path ;) | 03:29 |
sdake | then gain life ins't perfect and judgement matters | 03:30 |
jpeeler | so mandre, you got that symlink fix then? | 03:30 |
sdake | what i want to avoid is one or two linters turning into no tracking in the launchpad | 03:30 |
sdake | because that is real work | 03:30 |
sdake | someone had to figure that shit out | 03:30 |
openstackgerrit | Martin André proposed stackforge/kolla: Fix build link for ovs container https://review.openstack.org/195398 | 03:30 |
sdake | and if its not tracked its not counted | 03:30 |
sdake | and if its not counted, omeone looing at stacklaytics may make a decision not to invest in kolla | 03:30 |
sdake | when "one more" would have put them over the line | 03:30 |
sdake | like that rm doc fix | 03:31 |
sdake | that took me over 1 hour to setup and verify | 03:31 |
sdake | if i left it untracked, what was I doing for that 1 hour? | 03:31 |
sdake | dashboarding sucks | 03:31 |
sdake | evil | 03:31 |
sdake | but lots of shit in this world is evil | 03:32 |
sdake | and we put up with it | 03:32 |
jpeeler | you have a good point | 03:32 |
sdake | because some idiot decided it wold be a good idea to make a dashboard to track performance | 03:32 |
sdake | some idiot/group of idiots | 03:32 |
sdake | dashboarding takes judgement out of the decision making process | 03:32 |
sdake | it turns things into a simple binary equation | 03:32 |
sdake | if X > Y then yes | 03:33 |
sdake | otherwise | 03:33 |
sdake | POUNDSAND | 03:33 |
sdake | how do you explain judgement to someone? | 03:33 |
sdake | vs X > Y | 03:33 |
sdake | plz tell me and Ill have a solutio nto kill dashboarding | 03:33 |
sdake | it also causes unnatural gaming behavior | 03:34 |
*** jruano has joined #kolla | 03:34 | |
sdake | that would not occured if there werne't a dashboard to be gamed | 03:35 |
jpeeler | whoa i opened a can of worms | 03:35 |
sdake | let me follow that up with an example since this channel is logged | 03:36 |
sdake | and I want peopel to read it in perupetuity | 03:37 |
sdake | by commits | 03:38 |
sdake | http://stackalytics.com/?metric=commits&project_type=all&module=kolla | 03:38 |
*** diogogmt has quit IRC | 03:38 | |
sdake | cisco is 48% | 03:38 |
sdake | of kolla commits | 03:38 |
sdake | of that more then half were bashhate changes which took me less then 16 hours to finish | 03:38 |
sdake | so 25% of our commit output was done in 16 hours | 03:38 |
sdake | but does the dashboard show thta? | 03:39 |
sdake | NO | 03:39 |
*** tobe has joined #kolla | 03:39 | |
sdake | is 25% of this release output "bashate gating"? | 03:39 |
sdake | I don't even know if we mentioned it in the release announcement tbh | 03:39 |
sdake | meanwhile harmw and rhallisey wehtn through 30 revisions | 03:40 |
sdake | of a super hard set of work | 03:40 |
sdake | not to dismiss the wor of the other containers - they were hard too | 03:41 |
sdake | that goes in as 1 commit | 03:41 |
sdake | that is like 1% on that chart | 03:41 |
sdake | ok done ranting thanks for listening ;) | 03:41 |
openstackgerrit | Martin André proposed stackforge/kolla: Move glance-data container to the correct place https://review.openstack.org/195400 | 03:46 |
sdake | jpeeler not only if my life difficult because of stackalytics dashboarding, but csco is big into dashboarding as well | 03:47 |
sdake | so there are two systems to game | 03:47 |
sdake | that gets harder :( | 03:47 |
openstackgerrit | Martin André proposed stackforge/kolla: Add retry parameter to build-docker-image https://review.openstack.org/195402 | 03:49 |
jpeeler | mandre: if you knew the python equivalent of "find -L docker -type l" , I'd say that should be put in test_images.py | 03:50 |
sdake | mandre I too https://bugs.launchpad.net/kolla/+bug/1466677 and placed in liberty 1 | 03:51 |
openstack | Launchpad bug 1466677 in kolla "build script errors out in yum" [Critical,In progress] - Assigned to Martin André (mandre) | 03:51 |
mandre | jpeeler: agreed, i'll have a look later | 03:51 |
sdake | took | 03:52 |
mandre | about https://bugs.launchpad.net/kolla/+bug/1466677, there is still the second part missing, to have the gate actually use the new arg | 03:53 |
openstack | Launchpad bug 1466677 in kolla "build script errors out in yum" [Critical,In progress] - Assigned to Martin André (mandre) | 03:53 |
sdake | mandre https://bugs.launchpad.net/kolla/+bug/1468596 I put in l1 | 03:53 |
openstack | Launchpad bug 1468596 in kolla "glance-data ended up at the wrong place due to bad rebase" [High,In progress] - Assigned to Martin André (mandre) | 03:53 |
mandre | i'll do it later today | 03:53 |
sdake | mandre yup hear ya - just revert my patch | 03:53 |
sdake | and add a second which add retries | 03:53 |
mandre | sdake, fine for l1 | 03:54 |
mandre | need to go now, bye | 03:55 |
sdake | thans mandre | 03:55 |
sdake | did you fix the ovs script real quick | 03:55 |
sdake | or file a bug on it? | 03:55 |
mandre | i'm on vacation today, going to see mad max :) | 03:57 |
mandre | be back in a few hours | 03:57 |
jpeeler | he did, i'm waiting for the gate to verify | 03:57 |
jpeeler | and then i'm going to bed | 03:57 |
sdake | movie | 03:58 |
sdake | maybe i'll do that tomorrow | 03:58 |
sdake | jpeeler did you fix the ovs db server link as well | 04:08 |
jpeeler | mandre did. once i see the gate pass i'll approve it and you should too | 04:08 |
jpeeler | it's within minutes of finishing | 04:08 |
sdake | i think we have another broken gate patch iirc | 04:11 |
sdake | but that may have merged already | 04:11 |
sdake | i can't rmemeber | 04:11 |
sdake | today is a blur ;) | 04:11 |
sdake | brought on by norco and too much work | 04:11 |
*** jruano has quit IRC | 04:13 | |
openstackgerrit | Merged stackforge/kolla: Correct dev-quickstart installation directions kUse was using yum to install docker 1.7.0. This wanted to install all of the fedora 23 dependencies. Instead, simply use RPM to install via http with the --nodeps option. This works because we don't reall https://review.openstack.org/195395 | 04:13 |
sdake | hmm i must have jacked up that commit message | 04:14 |
jpeeler | all green, yay | 04:14 |
sdake | mandre if you see this msg, pleasepu t a hold on the gating until after I hae releawsed liberty-1 | 04:15 |
sdake | I don't want a repeat of the charlie foxtrot that was the gating mess created by the fedora infrstractrure imploding | 04:16 |
openstackgerrit | Merged stackforge/kolla: Fix build link for ovs container https://review.openstack.org/195398 | 04:16 |
sdake | mandre another approach is to maek the gate non-voting ut try out the retyr operations nd see if that gives us relief | 04:18 |
sdake | and then revert th gate change in 1-2 weeks | 04:18 |
sdake | bed time good job folks | 04:21 |
sdake | night ;) | 04:21 |
sdake | if anyone gets bored, test neutron thin agents | 04:21 |
sdake | since i'm not sure how they could possibly have worked as they didnt build :) | 04:22 |
openstackgerrit | Merged stackforge/kolla: Move glance-data container to the correct place https://review.openstack.org/195400 | 04:26 |
*** jtriley has joined #kolla | 04:31 | |
*** jruano has joined #kolla | 04:34 | |
*** jtriley has quit IRC | 04:36 | |
*** jruano has quit IRC | 05:05 | |
*** inc0 has joined #kolla | 06:01 | |
inc0 | good morning | 06:02 |
*** tobe has quit IRC | 06:14 | |
*** jtriley has joined #kolla | 06:20 | |
SamYaple | morning | 06:24 |
*** jtriley has quit IRC | 06:24 | |
SamYaple | sdake: the neutron-base did not build in the gate, I told you that. But it builds locally because of some wierd symlink stuff. Did you guys merge it before it jenkins said it built? | 06:25 |
* SamYaple looks, yup | 06:26 | |
SamYaple | jenkins kicked it back | 06:26 |
*** tobe has joined #kolla | 06:33 | |
*** nihilifer has joined #kolla | 06:45 | |
openstackgerrit | Sam Yaple proposed stackforge/kolla: Add neutron-openvswitch-agent contianer https://review.openstack.org/181737 | 06:48 |
*** jmccarthy has joined #kolla | 06:55 | |
*** bradjones has quit IRC | 07:02 | |
*** bradjones has joined #kolla | 07:04 | |
*** bradjones has joined #kolla | 07:04 | |
*** athomas has joined #kolla | 07:06 | |
*** dasm is now known as dasm|afk | 07:13 | |
*** dasm|afk is now known as dasm | 07:14 | |
nihilifer | o/ | 07:17 |
SamYaple | \o | 07:17 |
*** shardy has joined #kolla | 07:20 | |
*** erkules_ is now known as erkules | 07:46 | |
*** erkules has quit IRC | 07:46 | |
*** erkules has joined #kolla | 07:46 | |
*** tobe has quit IRC | 07:48 | |
inc0 | sooo...nothing to review? | 07:54 |
*** gfidente has joined #kolla | 07:54 | |
SamYaple | inc0: https://review.openstack.org/181737 | 07:55 |
inc0 | SamYaple, for start, any reason you install ovs AND neutron agent therE? | 07:57 |
SamYaple | because its required | 07:57 |
inc0 | having 2 OVSes installed on same hosts doesn't break anything? | 07:57 |
SamYaple | these are thin containers remember, only one process it run in them | 07:58 |
SamYaple | its not like a new OVS process is running | 07:58 |
inc0 | so its just installed for API? | 07:58 |
SamYaple | the only reason it is installed is for the ovs cli utils | 07:58 |
inc0 | kk | 07:58 |
SamYaple | i wish neutron used python libs | 07:58 |
openstackgerrit | Sam Yaple proposed stackforge/kolla: Add neutron-openvswitch-agent contianer https://review.openstack.org/181737 | 07:58 |
SamYaple | bashate changes | 07:58 |
inc0 | that's why it didn't show up on my fancy reviewer dashboard | 07:59 |
inc0 | it filters out jenkins -1s | 07:59 |
SamYaple | fancy | 07:59 |
inc0 | soo...I guess you'd want me to test it | 08:01 |
inc0 | because neutron tends to be magical | 08:02 |
SamYaple | if you want to | 08:02 |
inc0 | by the way, ovs is merged after all? | 08:02 |
SamYaple | this doesn't have any config-internal/compose stuff | 08:02 |
SamYaple | yea | 08:02 |
inc0 | cool | 08:02 |
inc0 | I was kinda afraid about this one | 08:03 |
SamYaple | why? | 08:03 |
*** tobe has joined #kolla | 08:04 | |
inc0 | everything network-related scares me, and ovs can be tricky | 08:04 |
inc0 | given how much depends on it | 08:04 |
SamYaple | OVS is super solid in containers from what ive seen | 08:05 |
SamYaple | mainly because the kernel module does al lthe works | 08:05 |
inc0 | well, I'm just mistrustful about that stuff, that's all | 08:05 |
inc0 | my inborn mistrust saved me several times already;) | 08:05 |
*** jtriley has joined #kolla | 08:09 | |
*** jtriley has quit IRC | 08:13 | |
*** mstachow has joined #kolla | 08:27 | |
mstachow | o/ all | 08:27 |
* mstachow feels neck pain - 5/10 sdake's holy f*ck scale | 08:29 | |
jmccarthy | In the neck ?! Ow - gotta love that scale tho ;) | 08:38 |
mstachow | This scale rocks! | 08:39 |
jmccarthy | Anyone build a fresh kolla dev env lately ? Squakws for me at: | 08:40 |
jmccarthy | Error: image kollaglue/centos-rdo-glance-data:latest not found | 08:40 |
inc0 | I build my own images :# | 08:45 |
inc0 | :3 | 08:45 |
nihilifer | jmccarthy: this happens when you try to do sudo ./tools/kolla? | 08:46 |
nihilifer | jmccarthy: or something else? | 08:47 |
jmccarthy | sudo ./tools/kolla start | 08:53 |
inc0 | for me glance-api failed | 08:56 |
*** shardy has quit IRC | 09:14 | |
*** shardy has joined #kolla | 09:15 | |
inc0 | git log says last commit is "move glance-registry to correct place" | 09:20 |
inc0 | I sense there is connection out there... | 09:20 |
jmccarthy | Hrm ok yea I'm just building my own for the moment now also | 09:29 |
*** mfalatic has quit IRC | 09:29 | |
inc0 | hmf, right now I can't run glance, dependency fuckup | 09:53 |
inc0 | I rebuilt my images and it doesn't have oslo.i18n:( | 09:54 |
inc0 | that might be root cause as well | 09:54 |
*** jtriley has joined #kolla | 09:57 | |
*** jtriley has quit IRC | 10:02 | |
*** dims has joined #kolla | 10:14 | |
*** athomas has quit IRC | 10:15 | |
*** athomas has joined #kolla | 10:29 | |
*** gfidente is now known as gfidente|afk | 10:30 | |
*** mstachow has quit IRC | 10:49 | |
*** sdake has quit IRC | 10:50 | |
openstackgerrit | Michal Jastrzebski (inc0) proposed stackforge/kolla: Glance missing oslo.i18n https://review.openstack.org/195516 | 10:54 |
*** mstachow has joined #kolla | 10:57 | |
SamYaple | inc0: you have a link to an upstream bug with that problem? | 11:02 |
*** dims has quit IRC | 11:02 | |
*** zhiwei has quit IRC | 11:04 | |
inc0 | nope, just noticed that I can't run it locally | 11:05 |
*** dims has joined #kolla | 11:05 | |
inc0 | and yum didn't show oslo.i18n in depends | 11:06 |
*** dims_ has joined #kolla | 11:10 | |
*** dims has quit IRC | 11:11 | |
*** tobe has quit IRC | 11:11 | |
inc0 | SamYaple, we don't use compose for OVS? | 11:15 |
*** dims_ has quit IRC | 11:16 | |
*** dims has joined #kolla | 11:21 | |
*** rhallisey has joined #kolla | 11:22 | |
*** prad has joined #kolla | 11:32 | |
nihilifer | inc0: why your bug's status is "Fix Commited" if it's still in review? ;) | 11:34 |
inc0 | guess my mistake | 11:35 |
*** bradjones has quit IRC | 11:38 | |
*** alisonh has joined #kolla | 11:39 | |
*** bradjones has joined #kolla | 11:41 | |
*** bradjones has joined #kolla | 11:41 | |
inc0 | our CI will catch up EVERY broken dependency in EVERY project | 11:45 |
inc0 | yay. | 11:45 |
*** jtriley has joined #kolla | 11:46 | |
SamYaple | inc0: i haven't built any compose things for OVS, no | 11:46 |
SamYaple | new containers don't require it to be merged | 11:47 |
SamYaple | if someone wants to add it, go for it | 11:47 |
inc0 | uhh so many new rules:P | 11:47 |
inc0 | what about genenv stuff? | 11:48 |
SamYaple | same deal. not required for new containers. In this case I think fang may have added that though | 11:48 |
inc0 | don't you think we should have neutron-ovs-agent.yml compose if we have linuxbridge one? | 11:49 |
SamYaple | if you want to implement it, yes | 11:49 |
SamYaple | but its more complicated than a single compose file | 11:49 |
SamYaple | there is also logic that needs to be added into the containers and scripts | 11:50 |
SamYaple | (kolla scripts) | 11:50 |
*** jtriley has quit IRC | 11:51 | |
inc0 | shouldn't we keep up with that stuff until we have ansible scripts up and running? | 11:52 |
SamYaple | keep isnt the same as add new things. We are keeping up with all of that stuff as long as it is used | 11:52 |
inc0 | but with neutron being 80% done in compose...I think this one container should be there too. | 11:54 |
SamYaple | ok well add it in, but there is more too it than that since all the config-internal scripts need if/else for linuxbridge or openvswitch | 11:55 |
SamYaple | same with gen environment | 11:55 |
*** vbel1 has joined #kolla | 11:57 | |
inc0 | also, you didn't implement GRE there right? | 11:59 |
inc0 | I'm reffering to https://review.openstack.org/#/c/181737 | 11:59 |
SamYaple | implement how? | 11:59 |
inc0 | GRE reqires several variables | 12:00 |
SamYaple | I wrote none of the config-internal bits | 12:00 |
harmw | inc0: can't we skip GRE and move straight to vxlan instead? | 12:06 |
harmw | for scale | 12:06 |
inc0 | harmw, why? vxlan are quite properitary technology | 12:06 |
*** gfidente|afk is now known as gfidente | 12:07 | |
inc0 | people might have problems with this | 12:07 |
SamYaple | inc0: you got that backwards | 12:07 |
inc0 | GRE is far more used in the wild | 12:07 |
SamYaple | inc0: my job does not use GRE at all | 12:07 |
SamYaple | but im not arguing you should not be able to use it | 12:08 |
SamYaple | if you want gre support, add it | 12:08 |
harmw | after all, we could just support both | 12:08 |
harmw | it's not that big a deal | 12:08 |
inc0 | yeah, I guess that's best | 12:09 |
harmw | and default to vxlan :> | 12:09 |
inc0 | personally 90% of my depolyments are old, trusty vlans:P | 12:09 |
SamYaple | thats where its at for performance | 12:09 |
vbel1 | vlans are messy :) | 12:10 |
SamYaple | vlans dont scale | 12:10 |
vbel1 | vlans are obsolete :) | 12:10 |
SamYaple | but they are easier to work with to get around neutron being neutro | 12:10 |
SamYaple | inc0: i have no intention of doing anything further on that OVS container for config-internal stuff. If someone else wants to add it, be my guest | 12:11 |
inc0 | vlans uses least CPU and are easyiest to debug | 12:11 |
harmw | it's L2, what'd you expect :p | 12:12 |
inc0 | L3 tunneling is cheating :P | 12:12 |
inc0 | and it's costly cheating | 12:12 |
harmw | no no , it's called scaling :) | 12:13 |
vbel1 | we have to wait true SDN :) | 12:13 |
harmw | and what would that be? | 12:13 |
inc0 | every big vendor says they have their own true sdn | 12:13 |
vbel1 | no cheating :) | 12:13 |
harmw | which is just some ASIC running linux | 12:14 |
inc0 | juniper has contrail, cisco vxlan | 12:14 |
harmw | vxlan is protocol, contrail is a producting (probably using vxlan, iirc) | 12:14 |
harmw | how are we looking for liberty-1 btw? | 12:15 |
inc0 | I'm not sure tbh | 12:15 |
inc0 | pretty good I'd say | 12:15 |
harmw | last time i checked there was 1 open thingy | 12:15 |
inc0 | I think only one bp targeted didn't land | 12:15 |
harmw | https://launchpad.net/kolla/+milestone/liberty-1 | 12:16 |
SamYaple | vxlan is going to replace gre | 12:16 |
harmw | openvswitch is missing inc0 | 12:16 |
inc0 | it has landed | 12:16 |
inc0 | so we should change its status | 12:16 |
harmw | https://blueprints.launchpad.net/kolla/+spec/openvswitch-container | 12:16 |
SamYaple | it is supported and pushed by the networking compains where gre is supported by microsoft | 12:16 |
SamYaple | inc0: it hanst landed | 12:17 |
harmw | it's listed as needs code review :) | 12:17 |
inc0 | SamYaple, your patches are parts of it? | 12:17 |
SamYaple | the neutron agent is part of that BP as originally agreed | 12:17 |
SamYaple | yea | 12:17 |
SamYaple | well they are fangs | 12:17 |
SamYaple | i just tweak them since he is MIA | 12:17 |
inc0 | sure sure | 12:17 |
harmw | he's been mia for quite a while now | 12:17 |
SamYaple | sdake mistakenly marked it completed yesterday | 12:17 |
inc0 | then yeah, it hasn't I just thought it was part of thin agents stuff | 12:18 |
inc0 | I think there was bp for that | 12:18 |
SamYaple | yea | 12:18 |
SamYaple | it was blocked until the thin agents landed | 12:18 |
SamYaple | but it was part of the openvswitch BP | 12:18 |
inc0 | kk | 12:18 |
SamYaple | has anyone other than me tried the thin neutron containers? | 12:19 |
harmw | nope, waiting for coreos to update their alpha | 12:19 |
harmw | for docker1.7 | 12:19 |
SamYaple | :/ | 12:19 |
harmw | should happen today | 12:19 |
harmw | which is why I choose to wait | 12:19 |
SamYaple | ive been doing thin agents since march but as far as i know no else has tested them :( | 12:20 |
inc0 | I've set up everything around | 12:20 |
SamYaple | stressful | 12:20 |
inc0 | I just havent run neutron yet because of no-compose:P | 12:20 |
harmw | march? I wasn't even on board in march :p | 12:20 |
inc0 | but that's just me being lazy | 12:20 |
SamYaple | harmw: in yaodu i did thin | 12:20 |
harmw | SamYaple: I can understand it's stressful | 12:20 |
SamYaple | i just had to ptch docker to make it work | 12:20 |
harmw | Ill see if I can abuse my laptop tonight, to take out a dependency | 12:21 |
SamYaple | inc0: there is compose support for all the thin containers | 12:21 |
inc0 | not ovs:P | 12:21 |
SamYaple | well i didnt test my thin containers against OVS | 12:21 |
SamYaple | because it didnt exist yet | 12:21 |
SamYaple | i mean in yaodu i did, but this is with docker 1.7 not some patched 1.5 | 12:22 |
inc0 | tomorrow set up bigger cluster and try it out | 12:23 |
inc0 | I'll be on PTO next week so I don't know if I manage to finish it | 12:23 |
mstachow | I'll take that then | 12:25 |
mstachow | I should be "fully operational" tommrow | 12:25 |
inc0 | I knew I could count on you mstachow | 12:25 |
mstachow | I hope... | 12:25 |
mstachow | np ;) | 12:25 |
* mstachow feels like a local hero | 12:25 | |
dasm | inc0: you're counting on mstachow? | 12:25 |
SamYaple | i just need some feedback on neutron | 12:26 |
inc0 | always | 12:26 |
dasm | one mstachow, two mstachows, three mstachows? | 12:26 |
dasm | sth like this? | 12:26 |
inc0 | no dasm, learn some English | 12:26 |
mstachow | dasm Have you ever heard about multithreading ;P? | 12:26 |
inc0 | its first, second, third... | 12:27 |
dasm | inc0: ah.. right :D | 12:27 |
dasm | mstachow: i don't think so, you're capable to be multithreading. | 12:28 |
inc0 | gotta love these random useless comments:P | 12:28 |
SamYaple | inc0: got a local repo with the Dockerfiles in jinja2 template form | 12:29 |
SamYaple | I would submit it but I can't see a clean way to patch that into the existing build scripts | 12:30 |
inc0 | whats the issue? | 12:30 |
SamYaple | So im working on a rebuild of the build system too using python, all parallel like | 12:30 |
SamYaple | inc0: its not clean | 12:30 |
SamYaple | i mean it _can_ be patched in, its just not clean looking | 12:31 |
inc0 | yeah, I thought about pythonisation of our scripts | 12:31 |
*** dims has quit IRC | 12:31 | |
SamYaple | Good news is I can add it as a seperate script so we can merge it in early | 12:31 |
inc0 | start from not-clean and incrementally refactor it? | 12:31 |
*** dims has joined #kolla | 12:31 | |
inc0 | or that | 12:32 |
SamYaple | id rather just add in an all new build system | 12:32 |
SamYaple | Its really really not that much work | 12:32 |
*** vbel has quit IRC | 12:32 | |
SamYaple | Plus now we can jinja2 the FROM header | 12:32 |
SamYaple | since ive got ansible, im targeting l3 for the rewrite | 12:33 |
SamYaple | I just want to get the templates in before M-cycle | 12:33 |
SamYaple | i bet well have alot more people then and it will be more confusing | 12:33 |
inc0 | btw SamYaple I'm trying to get Rackspace people to talk about kolla:P | 12:36 |
SamYaple | me too | 12:36 |
vbel1 | SamYaple: moving away from sed ;) Dockerfiles can easily be templates, either Mako or Jinja2 | 12:43 |
vbel1 | SamYaple: also it could be easy to embedd http proxy into templates if necessary | 12:44 |
vbel1 | no more human readable Dockerfiles (kidding) | 12:45 |
SamYaple | argggg | 12:45 |
SamYaple | vbell im ok with all of that.... in time | 12:46 |
SamYaple | intially it will just be a refactor and only if the community agrees to it | 12:46 |
SamYaple | smlink spegehtti wont work long term | 12:46 |
*** bradjones has quit IRC | 12:47 | |
*** bradjones has joined #kolla | 12:50 | |
*** bradjones has joined #kolla | 12:50 | |
*** absubram has quit IRC | 12:55 | |
*** sdake has joined #kolla | 12:56 | |
inc0 | hello sdake | 12:57 |
mstachow | o/ sdake | 13:03 |
SamYaple | there is no sdake | 13:03 |
SamYaple | sdake is a lie! | 13:04 |
mstachow | oh no | 13:08 |
mstachow | :O | 13:08 |
mstachow | I will have a nightmares because of this :/ | 13:09 |
inc0 | because of nonexistand Steven? | 13:09 |
mstachow | that's right | 13:10 |
inc0 | Nonexistant Steve sounds like con-artists alias | 13:10 |
mstachow | like a psychedelic rock band | 13:11 |
mstachow | cool | 13:11 |
inc0 | well, maybe not con artist | 13:11 |
*** jruano has joined #kolla | 13:11 | |
SamYaple | have you met steve? | 13:16 |
SamYaple | im just saying | 13:16 |
*** mickt has joined #kolla | 13:17 | |
*** shardy has quit IRC | 13:17 | |
*** shardy has joined #kolla | 13:22 | |
openstackgerrit | Martin André proposed stackforge/kolla: Have test retry building failed images https://review.openstack.org/195574 | 13:30 |
*** jtriley has joined #kolla | 13:31 | |
*** absubram has joined #kolla | 13:35 | |
*** shardy has quit IRC | 13:42 | |
*** walters has joined #kolla | 13:43 | |
*** shardy has joined #kolla | 13:44 | |
*** dasm is now known as dasm|afk | 13:50 | |
inc0 | I'm going home, have a good rest of day | 13:56 |
inc0 | cyas | 13:56 |
mstachow | bye inc0 | 13:56 |
*** inc0 has quit IRC | 13:57 | |
*** athomas has quit IRC | 13:58 | |
sdake | morning folks | 13:59 |
sdake | what is the state of kolla | 13:59 |
sdake | ready to pull the trigger on the release? | 13:59 |
sdake | i tested building works at about 11pm last night | 14:00 |
sdake | before passing the fuck out ;) | 14:00 |
rhallisey | ya I did rebuilt yesterday morning too | 14:01 |
* mstachow is now confused because of SamYaple | 14:01 | |
sdake | most important in my mind is that thin containers work | 14:01 |
rhallisey | all green | 14:01 |
sdake | thin neutron containers work | 14:01 |
sdake | that is our bigget change this release | 14:01 |
sdake | ovs was not building yesterday - there wer epatches n the patch queue | 14:02 |
*** jmccarthy has quit IRC | 14:03 | |
mstachow | o/ sdake | 14:03 |
sdake | hey mstachow | 14:05 |
sdake | samyaple any word on thin containers working/not working? | 14:05 |
sdake | rhallisey can you review https://review.openstack.org/#/c/195574/ | 14:08 |
sdake | rhallisey and it's parent patch as well | 14:09 |
sdake | mstachow have you tested neutron thin containers? | 14:13 |
mstachow | I will test It tomorrow | 14:14 |
sdake | tomorrow too late | 14:14 |
sdake | just curious if anyone has tested besides sam yaple | 14:14 |
mstachow | In this case - No, I didn't | 14:15 |
sdake | samyaple how would one select OVS instead of linuxbridge | 14:15 |
SamYaple | sdake: no one has tested thin neutron containers other than me | 14:21 |
sdake | samyaple and it wfu with kolla start? | 14:21 |
SamYaple | I have never run anything with kolla start | 14:22 |
sdake | samyaple how does one select between ovs and linuxbridge | 14:22 |
sdake | samyaple could you test with kolla start just to validate that operational mode works | 14:22 |
sdake | that is what our quickstart guide recommends | 14:22 |
sdake | my computers are AFU atm | 14:22 |
SamYaple | sure i can try it out | 14:22 |
sdake | and I have a hard time testing | 14:22 |
sdake | I'm going to spend a couple hours trying to get my vm rolling with two nics | 14:23 |
sdake | to try out kolla start as well | 14:23 |
sdake | when do you head to bed? | 14:23 |
SamYaple | re: ovs versus linuxbridge. I suppose that logic needs to be written into kolla start and what not. i dont have a way for the config-internal people to test both | 14:23 |
sdake | samyaple ok tech debt to be solved after l2 | 14:23 |
sdake | https://bugs.launchpad.net/kolla/+bug/1468779 | 14:25 |
openstack | Launchpad bug 1468779 in kolla "Need way to select between linuxbridge and OVS" [High,Confirmed] | 14:25 |
sdake | now its tracked | 14:25 |
sdake | samyaple when you know about kolla start get back to me plz | 14:25 |
sdake | the default is still linuxbridge samyaple? | 14:26 |
SamYaple | yea the openvswitch-agent container doesnt change anything, just adds the container | 14:26 |
SamYaple | its self contained | 14:26 |
sdake | doesn't the agent type need to be set in neutron config somewhere? | 14:27 |
sdake | or does neutron just figure it out | 14:27 |
SamYaple | no, but the config-internal code needs it | 14:27 |
SamYaple | the agents check in over message queue | 14:27 |
SamYaple | you can actually have mix/match environments with linuxbridge and OVS | 14:27 |
sdake | wfm, so kolla start shuld be unimpacted | 14:27 |
SamYaple | correct | 14:27 |
sdake | ok lets get varification on that | 14:28 |
sdake | get those two patches merged | 14:28 |
SamYaple | what two? | 14:28 |
sdake | and I'll send out a release announcement after tagging | 14:28 |
sdake | https://review.openstack.org/#/c/195574/ | 14:28 |
sdake | and its parent | 14:29 |
*** shardy has quit IRC | 14:29 | |
*** shardy has joined #kolla | 14:30 | |
sdake | there is some anestaphine in the back of the medlock! | 14:32 |
*** mickt has left #kolla | 14:35 | |
sdake | samyaple re the relicense of the ansible magic we need, what is the status of that effort | 14:36 |
sdake | that is now the primary blocker i need to get unblocked if possible | 14:36 |
*** athomas has joined #kolla | 14:37 | |
SamYaple | just ping'd mordred about that. they are setting up a seperate repo | 14:37 |
SamYaple | unable to proceed with the keystone container until the modules, I am working on the galera one | 14:40 |
sdake | nice | 14:40 |
SamYaple | what was my LOC estimate? | 14:42 |
SamYaple | whatever it was I am revising it to 200 LOC for ansible per service on the outside | 14:43 |
openstackgerrit | Merged stackforge/kolla: Add retry parameter to build-docker-image https://review.openstack.org/195402 | 14:45 |
sdake | i said 1k total | 14:45 |
sdake | it was just a really rough estimate | 14:45 |
sdake | nothing you are being held to | 14:46 |
SamYaple | no that seems right. Keystone is sitting at 100 LOC. With this generic code for DRY stuff the others should be 125-175 i think | 14:47 |
SamYaple | ~1000 total sounds good | 14:47 |
openstackgerrit | Merged stackforge/kolla: Have test retry building failed images https://review.openstack.org/195574 | 14:59 |
*** mickt has joined #kolla | 15:04 | |
sdake | it was 1kloc, 100 tasks | 15:04 |
sdake | loth said it should be 250 tasks | 15:04 |
SamYaple | he knows nothing! | 15:05 |
SamYaple | :) | 15:05 |
SamYaple | ive got some common tasks, so while 250 may run, well only have 100 (maybe) to maintain | 15:06 |
*** shardy has quit IRC | 15:08 | |
*** shardy has joined #kolla | 15:08 | |
sdake | samyaple does that olla start stuff work ;) | 15:08 |
mickt | Hey fang, we (in Oracle) were intending to look at murano too; I see that you have a blueprint in for it. I was wondering what is your plan or if you have done anything on it? | 15:10 |
*** shardy has quit IRC | 15:13 | |
*** shardy has joined #kolla | 15:13 | |
sdake | mickt I haven' tseen fang on irc for atlaest a month, I think because of the great firewall of china | 15:17 |
sdake | so plans of action: | 15:17 |
sdake | communicate on blueprint | 15:17 |
sdake | or take over blueprint | 15:17 |
sdake | i'd go with communicate first see i f that works | 15:18 |
mickt | will do, cheers | 15:18 |
sdake | but fang also not responding well on blueprint messages | 15:18 |
sdake | os give him a week | 15:18 |
sdake | and if no success I guess just take his blueprint | 15:18 |
sdake | I dont have his phone # so not sure what his status is | 15:18 |
mickt | I'll keep it in mind :) | 15:19 |
*** daneyon has joined #kolla | 15:33 | |
*** daneyon_ has joined #kolla | 15:34 | |
*** daneyon has quit IRC | 15:37 | |
*** pbourke has quit IRC | 15:38 | |
*** pbourke has joined #kolla | 15:39 | |
sdake | daneyon_ did you see that mail hit your inbox | 15:42 |
sdake | samyaple any word on kolla start woring or not working | 15:42 |
daneyon_ | sdake i'm working through my email then I need to prepare for a 9:00 webex meeting that i'm leading | 15:42 |
*** jtriley has quit IRC | 15:42 | |
sdake | daneyon_ need 2 minutes of your time https://bugs.launchpad.net/kolla/+bug/1468056 | 15:43 |
openstack | Launchpad bug 1468056 in kolla "Supermin unable to load kernel modules" [High,Triaged] - Assigned to Daneyon Hansen (danehans) | 15:43 |
sdake | is this because f22 ernel modules are compressed | 15:43 |
sdake | and supermin in centos expects them to be incompressed? | 15:44 |
*** mstachow has quit IRC | 15:44 | |
daneyon_ | sdake, I updated https://bugs.launchpad.net/kolla/+bug/1468056 a few minutes ago. | 15:45 |
openstack | Launchpad bug 1468056 in kolla "Supermin unable to load kernel modules" [High,Triaged] - Assigned to Daneyon Hansen (danehans) | 15:45 |
sdake | ok well tht would be my assumption s to what the problem is | 15:45 |
sdake | note i updated teh devstart guide | 15:45 |
sdake | with instructions i personally tested | 15:46 |
sdake | enjoy your webex :) | 15:46 |
sdake | thanks | 15:46 |
*** jtriley has joined #kolla | 15:48 | |
*** sdake_ has joined #kolla | 15:50 | |
*** sdake has quit IRC | 15:54 | |
SamYaple | sdake_: its been running | 15:55 |
SamYaple | few issues with glance data | 15:55 |
*** jmccarthy has joined #kolla | 15:56 | |
SamYaple | daneyon_: sorry i was asleep yesterday | 15:56 |
sdake_ | samyaple any idea what is going on with glance? | 15:56 |
SamYaple | what were your questions regarding dokcer 1.7 | 15:56 |
SamYaple | glance-data container doesnt exist/isnt built | 15:56 |
sdake_ | samyaple danyeon- is afk | 15:56 |
sdake_ | oh but if you build yourself itworks right? | 15:56 |
daneyon_ | SamYaple what base OS did you use for 1.7? | 15:56 |
SamYaple | daneyon_: fedora22 and ubuntu 14.04 | 15:57 |
sdake_ | samyaple fedora 22 kernel model loaded for you? | 15:57 |
SamYaple | docker kernel module | 15:57 |
SamYaple | ? | 15:57 |
sdake_ | https://bugs.launchpad.net/kolla/+bug/1468056 | 15:58 |
openstack | Launchpad bug 1468056 in kolla "Supermin unable to load kernel modules" [High,Triaged] - Assigned to Daneyon Hansen (danehans) | 15:58 |
SamYaple | ive had my head buried in ansible for a week im out of loop | 15:58 |
rhallisey | SamYaple, the glance-data doesn't work? | 15:58 |
sdake_ | someone changed the ovs container to "needs review" was that you sam, or fang or the infra? | 15:58 |
SamYaple | rhallisey: Error: image kollaglue/centos-rdo-glance-data:latest not found | 15:59 |
rhallisey | I haven't had any issues.. what's wrong with it? | 15:59 |
rhallisey | ok | 15:59 |
SamYaple | looks like its not pushed | 15:59 |
rhallisey | yup | 15:59 |
sdake_ | not pushed | 15:59 |
sdake_ | but thats ok | 15:59 |
rhallisey | was it merged? | 15:59 |
sdake_ | it can still be built locally | 15:59 |
daneyon_ | SamYaple I tried F22 and had some problems. I am now using F21 with the Docker daemon using overlay instead of devicemapper graphdriver. | 15:59 |
sdake_ | overlay doesnt work - rpm bug | 15:59 |
SamYaple | daneyon_: ah yea. ive been using zfs driver | 15:59 |
daneyon_ | SO far it works, but I notice I have to restart the daemon whenever I need to stop/start a container. | 15:59 |
sdake_ | daneyon_ read new quickstart | 16:00 |
sdake_ | daneyon_ you can't build images with overlayfs | 16:00 |
SamYaple | sdake_: no but theyll run fine | 16:00 |
daneyon_ | sdake_ I'll take a look after this meeting. Gotta disconnect for about an hour. | 16:00 |
sdake_ | agree] | 16:00 |
SamYaple | daneyon_: ill look into replicating | 16:00 |
*** vbel1 has quit IRC | 16:03 | |
openstackgerrit | Steven Dake proposed stackforge/kolla: Add warnings about running on F22 and later https://review.openstack.org/195654 | 16:05 |
SamYaple | who pushes to the kollaglue namespace? | 16:05 |
sdake_ | typically I do | 16:08 |
*** jmccarthy has quit IRC | 16:08 | |
sdake_ | but anyone in core can | 16:08 |
*** jmccarthy has joined #kolla | 16:08 | |
sdake_ | if you don't have permissions hit me up and I'll add you | 16:08 |
sdake_ | it takes me about 5 hours to do the push | 16:09 |
sdake_ | i had a 300$ rackspace bill from my last sset of pushes | 16:09 |
sdake_ | so now i'm just going to abuse my isp instead ;) | 16:09 |
SamYaple | i probably dont have perms, but ill check | 16:09 |
SamYaple | psshh ive got free stuff | 16:09 |
sdake_ | the way I push is build-all-containers --push --release | 16:10 |
sdake_ | if you want to tae on responsibility for pushing on releae day that owuld rock ;) | 16:10 |
sdake_ | can I get a couple cores to ack https://review.openstack.org/#/c/195654/ | 16:11 |
sdake_ | and then I'll tag and announce the release | 16:12 |
sdake_ | 517 pulls https://registry.hub.docker.com/u/kollaglue/centos-rdo-nova-compute/ | 16:14 |
sdake_ | pretty good - that means maybe like ~250 people have tried out our software | 16:14 |
SamYaple | sdake_: sure, but im not setup for that yet | 16:15 |
sdake_ | sam your all set on permissions | 16:15 |
sdake_ | I added sam@yaple.net | 16:15 |
sdake_ | harmw what is your email adr? | 16:16 |
sdake_ | mandre if your still awake what is yours as well | 16:16 |
*** vbel1 has joined #kolla | 16:20 | |
sdake_ | note i'll be pushing the olla images now | 16:23 |
SamYaple | question on tagging | 16:24 |
sdake_ | we tag with --release flag | 16:24 |
SamYaple | will we be tagging :kilo :liberty etc? | 16:24 |
sdake_ | which uses "latest" | 16:24 |
sdake_ | we already tag kilo liberty etc | 16:24 |
SamYaple | right but is that how we do it? | 16:24 |
sdake_ | yup | 16:24 |
SamYaple | so liberty == latest atm? | 16:24 |
sdake_ | I thin we have :laatet as lateast atm | 16:25 |
jmccarthy | Will that remedy this complaint ? Error: image kollaglue/centos-rdo-glance-data:latest not found | 16:25 |
sdake_ | what do the compose files have? | 16:25 |
harmw | sdake_: underscore! | 16:25 |
*** sdake_ is now known as sdake | 16:25 | |
sdake | I broke harmw's underscore parser | 16:25 |
harmw | yup | 16:25 |
sdake | harmw email address plz :) | 16:25 |
sdake | and pleae approve that patch in the scroll log | 16:25 |
sdake | (if you want access to docker push) | 16:26 |
harmw | is that the F22? | 16:26 |
harmw | supermin | 16:26 |
*** vinkman has joined #kolla | 16:27 | |
sdake | supermin i in both f21 and f22 | 16:28 |
sdake | see the bug log for an alaysis | 16:28 |
sdake | note we should be super nitpicky on docs | 16:28 |
sdake | they are our users first interaction wit hthe prjoect | 16:29 |
sdake | so if there are mispellings/etc we dont want that ;) | 16:29 |
harmw | is it realy .zx? | 16:29 |
sdake | yes | 16:29 |
sdake | pretty sure | 16:29 |
sdake | if not sure check the bug - it has details | 16:30 |
harmw | well my F21 has .xz :) | 16:30 |
sdake | groan | 16:30 |
SamYaple | xz is a compression type | 16:31 |
harmw | yep | 16:31 |
SamYaple | zx is the alphabet backwards missing y | 16:31 |
openstackgerrit | Steven Dake proposed stackforge/kolla: Add warnings about running on F22 and later https://review.openstack.org/195654 | 16:32 |
harmw | seconds away from -1 :p | 16:33 |
harmw | sdake: commitmsg has .zx | 16:33 |
sdake | well add your coments in if they were beyond the xz thing | 16:33 |
SamYaple | thats not the docs though! | 16:33 |
sdake | so i can fix them | 16:33 |
harmw | i know SamYaple :) | 16:33 |
SamYaple | sdake: your words are not in alphabetical order | 16:34 |
harmw | if they were, the sentences would look/read vry weird | 16:34 |
* sdake smacks samyaple around | 16:34 | |
harmw | how about a typo sdake | 16:35 |
harmw | 'THen' | 16:35 |
SamYaple | :) | 16:35 |
harmw | uhm, without n | 16:35 |
SamYaple | should be spelled 'ehT' anyway | 16:35 |
sdake | in ascibetical, it should be spelled Teh :) | 16:35 |
sdake | harmw leave review comments - be super nitpicky - docs are our first introduction for the user | 16:36 |
SamYaple | i only no l33t speek | 16:36 |
harmw | just did sdake :) | 16:36 |
jpeeler | man gerrit should make it very clear a new patchset came in while you were looking at the files | 16:37 |
SamYaple | blind merging is my style | 16:37 |
SamYaple | ask for forgiveness, not permissions | 16:37 |
openstackgerrit | Steven Dake proposed stackforge/kolla: Add warnings about running on F22 and later https://review.openstack.org/195654 | 16:38 |
jpeeler | now you have a triple space | 16:39 |
sdake | which line jpeeler | 16:39 |
jpeeler | the first of modifications, 12 | 16:39 |
harmw | lol yes indeed, damn | 16:40 |
harmw | missed it :P | 16:40 |
sdake | between which words? | 16:40 |
sdake | I dont see it | 16:40 |
harmw | later. Fedora 22 | 16:40 |
openstackgerrit | Steven Dake proposed stackforge/kolla: Add warnings about running on F22 and later https://review.openstack.org/195654 | 16:41 |
SamYaple | ah i understand this issue now daneyon_. Yea I do my deploys on ubuntu. ive _used_ docker1.7 on fedora22 and ubuntu 14.04 | 16:41 |
sdake | triple spacing is the new single spacing! | 16:41 |
SamYaple | ive run into the same thing when deploying on F22 | 16:41 |
* jpeeler single spaces and thinks it's superior | 16:41 | |
sdake | I ased my 7th grader id what they teach in school | 16:42 |
sdake | she said double spacing | 16:42 |
sdake | id/kid | 16:42 |
* SamYaple thinks all spaces need to be escpaed or otherwise sanatized | 16:42 | |
jpeeler | it's still triple spaced | 16:42 |
jpeeler | oh wait | 16:42 |
jpeeler | sorry wrong patchset | 16:42 |
SamYaple | lol | 16:42 |
sdake | samyaple is this implemented or still in "Needs code review" | 16:43 |
sdake | I set it to implemented but someone else set it to needs code review | 16:43 |
sdake | https://blueprints.launchpad.net/kolla/+spec/openvswitch-container | 16:43 |
SamYaple | the neutron agent part of that isnt commited yet | 16:44 |
SamYaple | https://review.openstack.org/#/c/181737/ | 16:45 |
*** shardy has quit IRC | 16:45 | |
SamYaple | you abandonded yesterday | 16:45 |
*** shardy has joined #kolla | 16:45 | |
sdake | i see | 16:45 |
sdake | well i fucked that one up | 16:46 |
sdake | https://review.openstack.org/#/c/181737/ | 16:46 |
sdake | my bad | 16:46 |
sdake | thats what I get for abandoning someone elses work | 16:46 |
sdake | can you fix the review comment so we can get that in | 16:46 |
sdake | that is the last peice of work that needs to hit the repo then | 16:46 |
SamYaple | what do you want me to fix? | 16:47 |
sdake | add the variables to integration-guide.md | 16:47 |
sdake | patch set 4 has 1 comment | 16:47 |
SamYaple | ok. let me open that file. | 16:48 |
SamYaple | not for the first time... | 16:48 |
SamYaple | sdake: i havent tested magnum yet. how does that work docker-on-docker? | 16:52 |
sdake | it works | 16:52 |
sdake | magnum runs idocker in vms | 16:52 |
sdake | not on bare metal | 16:52 |
SamYaple | ah | 16:52 |
SamYaple | i was banging the nova-docker driver around | 16:53 |
SamYaple | we could get that to work with kolla | 16:53 |
vinkman | I thought Magnum can run Docker on baremetal using Ironic as well?? | 16:53 |
harmw | SamYaple: you've only one keystone ansible, right? | 16:54 |
harmw | is docs updated to walk an operator through it? | 16:54 |
SamYaple | harmw: nope | 16:54 |
SamYaple | afaik there are on ansible docs written | 16:54 |
harmw | ok | 16:54 |
SamYaple | except a little one i wrote on first ansible commit | 16:54 |
harmw | what the url to get docker again? | 16:55 |
SamYaple | its official docker stable now | 16:55 |
SamYaple | docker.io | 16:55 |
SamYaple | get.docker.io | 16:55 |
SamYaple | all kinds of ways | 16:55 |
harmw | I didn't want to use yum | 16:56 |
SamYaple | im sure there is a directurl floating around | 16:56 |
*** jmccarthy has quit IRC | 16:57 | |
*** athomas has quit IRC | 16:57 | |
harmw | http://docs.docker.com/installation/binaries/ | 16:58 |
SamYaple | DB_CLUSTER_WSREP_METHOD=<rsync|mysqldump|xtremebackup|xtremebackup-v2> | 16:59 |
SamYaple | lol | 16:59 |
SamYaple | thats from our docs | 16:59 |
SamYaple | (its xtrabackup for those not getting it) | 16:59 |
harmw | :p | 16:59 |
harmw | percona stuff | 16:59 |
SamYaple | the only way to fly man | 17:00 |
openstackgerrit | Sam Yaple proposed stackforge/kolla: Add neutron-openvswitch-agent contianer https://review.openstack.org/181737 | 17:03 |
*** gfidente has quit IRC | 17:06 | |
sdake | samyaple shouldn't this be a mandatory chec vars? NEUTRON_NETWORK_VLAN_RANGES | 17:06 |
SamYaple | sdake: i have no idea about that stuff. fang wrote it all | 17:07 |
sdake | can you add to check required vars | 17:07 |
sdake | i dont now what that crudini command does | 17:07 |
sdake | but if the variable isnt set the container will implode | 17:07 |
sdake | and we wan't it to implode corectly not raondmly :) | 17:08 |
SamYaple | frankly i dont think thats enough to get the container running | 17:08 |
SamYaple | the only way i can use it is with the config-external method | 17:08 |
sdake | well can you add to the check required vars | 17:08 |
sdake | and docs | 17:08 |
SamYaple | vlans arent actually required so we cant put it in check_required | 17:09 |
sdake | and then we are +2 :) | 17:09 |
sdake | but its required by crudini | 17:09 |
SamYaple | if you use vlan networks | 17:09 |
sdake | oh good point | 17:09 |
SamYaple | which isnt required | 17:09 |
sdake | yup your right that one is tricy | 17:09 |
SamYaple | i would actually feel more comfortable scraping that whole start script | 17:09 |
SamYaple | because i really dont think itll work for config-internal | 17:10 |
sdake | well lets not do that right at this point in time | 17:10 |
sdake | after l1 is released, we can sort it out | 17:10 |
SamYaple | yup, its why i didnt | 17:10 |
sdake | jpeeler or rhallisey or harmw if we could get a second review please | 17:10 |
sdake | https://review.openstack.org/#/c/181737/ | 17:10 |
vbel1 | http://docs.docker.com/installation/binaries are not good on devicemapper distros because they try to use aufs/overlay by default | 17:11 |
vbel1 | and most of distros are devicemapper fans | 17:12 |
SamYaple | vbel1: you should explictly set that | 17:12 |
vbel1 | SamYaple: yes | 17:12 |
SamYaple | docker has never been very good at guessing what i want | 17:12 |
rhallisey | missing some required vars | 17:13 |
sdake | harmw if you are using fedora, you will want the rpm in the quickstart guide | 17:13 |
harmw | hm, DESIGNATE_INITDB is empty on a fresh git pull | 17:13 |
sdake | rhallisey we just had that discussion on irc | 17:13 |
harmw | this is CentOS 7 :) | 17:13 |
sdake | read scrollbck | 17:13 |
rhallisey | oh I missed it | 17:13 |
rhallisey | harmw, I changed it to INIT_DESIGNATE_DB | 17:13 |
rhallisey | if that merged.. | 17:14 |
harmw | thats not merged, | 17:14 |
rhallisey | nvm them | 17:14 |
harmw | but, yes I was expecting to see just that :p | 17:14 |
harmw | oh, no, it is merged | 17:14 |
harmw | interesting | 17:14 |
sdake | harmw the fedora 23 imagesshoudl lwor on centos | 17:14 |
sdake | close enough ;) | 17:14 |
vbel1 | I used https://docs.docker.com/installation/fedora/ and fedora22 rpms on centos 7 /oracle linux 7 | 17:15 |
rhallisey | ok I think it's fine then | 17:15 |
vbel1 | 1.7 as well | 17:16 |
sdake | switching networks brb | 17:19 |
*** sdake_ has joined #kolla | 17:20 | |
*** sdake has quit IRC | 17:24 | |
*** shardy has quit IRC | 17:25 | |
*** vbel1 has quit IRC | 17:25 | |
*** bradjones has quit IRC | 17:26 | |
*** shardy has joined #kolla | 17:26 | |
harmw | huh: kollaglue/centos-rdo-glance-data:latest not found | 17:28 |
harmw | sup with that | 17:28 |
*** bradjones has joined #kolla | 17:28 | |
*** bradjones has joined #kolla | 17:28 | |
sdake_ | it has not been pushed | 17:28 |
harmw | argh! underscores! everywhere! | 17:28 |
harmw | taking over the world! | 17:29 |
*** sdake_ is now known as sdake | 17:29 | |
harmw | is it on queue to be pushed or somthing? | 17:29 |
sdake | here is the release process | 17:29 |
sdake | 1. all blueprints go to implemented | 17:30 |
sdake | 2. all critical bugs go to fix commited | 17:30 |
sdake | 3. git tagged with release | 17:30 |
sdake | 4. reelase announcement on mailing list | 17:30 |
sdake | 5. docker images pushed | 17:30 |
sdake | for 2 its nice to fix all the bugs | 17:31 |
sdake | but only critical ones are blockers | 17:31 |
sdake | atm we are waiting on jenkins to do its thing | 17:31 |
*** jtriley_ has joined #kolla | 17:31 | |
*** jtriley has quit IRC | 17:31 | |
harmw | cool | 17:31 |
harmw | lets wait for jenkins :) | 17:31 |
sdake | my 10 year old son saed me ytersday | 17:32 |
sdake | "daddy do you spend most of your time waiting on things" | 17:32 |
harmw | lol! | 17:32 |
sdake | my response "that isn't the half of it warren" | 17:32 |
*** jtriley_ has quit IRC | 17:37 | |
sdake | samyaple jsut to confirm in case I havent, the current thin containers for neutron work in the docer-compsoe mode with kolla start? | 17:44 |
*** rhallisey has quit IRC | 17:45 | |
SamYaple | sdake: im testing kolla start | 17:48 |
SamYaple | they work with docker-compose | 17:48 |
sdake | boy this centos shirt i have is hilarious | 17:50 |
sdake | "Because you know what your doing." | 17:50 |
sdake | I'm sure the sales dudes at rht love that | 17:50 |
SamYaple | gentoo -- "I swear I am not a ricer" | 17:50 |
sdake | the funny part is they printed like 20k of these shirts | 17:51 |
sdake | and everyone wants one ;) | 17:51 |
SamYaple | for kolla, are we going to switch to apache2 based keystone before rdo packaging? | 17:52 |
sdake | i can't even imagine the chaos that is causing for the sales teams at rht :) | 17:52 |
SamYaple | they only gate with apache keystone | 17:52 |
SamYaple | wait.... that t-shirt isn't ironic? | 17:52 |
sdake | they being who | 17:52 |
SamYaple | keystone upstream | 17:53 |
SamYaple | they dont use evelent and havent for a while | 17:53 |
sdake | what are we doing at present? | 17:53 |
sdake | just using eventlet? | 17:53 |
SamYaple | yes | 17:53 |
sdake | i guess if that is what upstream is doing that makes sense | 17:53 |
sdake | they probably did that for a good reason :) | 17:53 |
sdake | damn what the hell is up with the gate | 17:55 |
sdake | need a second reviewer on https://review.openstack.org/#/c/195516/ | 17:57 |
SamYaple | $5 | 17:57 |
harmw | Ill do it for free :> | 17:57 |
sdake | need to switch networks bbiaf | 17:59 |
sdake | actually on the correct networ :) | 17:59 |
harmw | hm, those new neutron containrs are not build yt, right? | 18:01 |
*** dontalton has joined #kolla | 18:02 | |
SamYaple | harmw: right | 18:04 |
SamYaple | has anyone tried rabbit lately? this fresh build is.... not working | 18:04 |
harmw | no but ill run into that probably later :) | 18:05 |
harmw | still pulling | 18:05 |
harmw | and then I have to build neutron | 18:05 |
*** rhallisey has joined #kolla | 18:05 | |
SamYaple | those HA changes screwed rabbit up | 18:06 |
harmw | ouch | 18:06 |
harmw | No '/dev/log' or 'logger' included for syslog logging | 18:11 |
harmw | /var/tmp/initramfs.5p1L8L/bin is on different filesystem than the rest. | 18:11 |
harmw | Use -f option to override. | 18:11 |
sdake | i thought the ha rabbit went int o a separate container | 18:11 |
sdake | or perhaps that was somethign else | 18:11 |
harmw | anyone seen that before? | 18:11 |
sdake | harmw havent seen but looks bad - google may have the answers :) | 18:11 |
sdake | samyaple my guess is a missing genev somewhere - or borken rabbit upstream - or config optoins broe things | 18:13 |
sdake | could be one of many things | 18:13 |
SamYaple | its a bad sed line | 18:13 |
harmw | damn | 18:13 |
SamYaple | we really need functional gate tests sdake | 18:20 |
sdake | there were 5 things blocking that | 18:20 |
sdake | now we are down to 1 | 18:20 |
sdake | progress | 18:20 |
SamYaple | which is? | 18:20 |
sdake | functional gate tests are the #1 thing on my blocker list to unblock | 18:20 |
sdake | single nic operation | 18:20 |
SamYaple | ugh | 18:21 |
*** rhallisey has quit IRC | 18:22 | |
sdake | samyaple so this sed bug, is there a bug filed and patch incoming to fix ;) | 18:27 |
SamYaple | no. im not sure what it needs to be | 18:28 |
SamYaple | i should have been asleep 2 hours ago | 18:28 |
harmw | which piece is broken? | 18:28 |
harmw | (link pls) | 18:29 |
*** jruano has quit IRC | 18:33 | |
*** jasonsb has quit IRC | 18:33 | |
*** jasonsb has joined #kolla | 18:34 | |
SamYaple | harmw: https://github.com/stackforge/kolla/blob/master/docker/centos/binary/rabbitmq/config-rabbit.sh#L15 | 18:36 |
SamYaple | CLUSTER_NODES should be CLUSTER_CONFIGURATION | 18:36 |
SamYaple | i think | 18:36 |
SamYaple | at least it sorta builds | 18:36 |
SamYaple | then i get permission errors with logs | 18:36 |
sdake | jpeeler around | 18:36 |
jpeeler | yeah | 18:36 |
sdake | jpeeler would you mind addressing https://bugs.launchpad.net/kolla/+bug/1468863 | 18:37 |
openstack | Launchpad bug 1468863 in kolla "neutron-base needs oslo.policy package" [Critical,Confirmed] | 18:37 |
harmw | hm, I known for sure I asked him to remove those quotes... | 18:37 |
harmw | SamYaple: Ill take a look, just not this instant | 18:37 |
sdake | harmw i need to know when you will be done with the fix | 18:37 |
sdake | or find someone else ot fix it | 18:37 |
jpeeler | ok | 18:37 |
harmw | I'm trying to test the new neutron containers | 18:37 |
sdake | those are fucked up because of that oslo policy bug | 18:38 |
harmw | seriously... | 18:38 |
openstackgerrit | Merged stackforge/kolla: Glance missing oslo.i18n https://review.openstack.org/195516 | 18:38 |
sdake | ya rdo needs better gating | 18:38 |
SamYaple | ImportError: No module named oslo_policy | 18:38 |
harmw | jeez, not that again | 18:38 |
*** jasonsb has quit IRC | 18:38 | |
jpeeler | sdake: it's because of delorean packages through, right? | 18:39 |
loth | SamYaple: http://fun.irq.dk/funroll-loops.org/ re: gentooricer? | 18:39 |
sdake | yes | 18:39 |
jpeeler | i assume we'll eventually stop using those | 18:39 |
harmw | those are only used for :latest | 18:40 |
SamYaple | -funroll -math-fast-and-loose | 18:40 |
harmw | SamYaple: is thre a bug regarding Rabbit? | 18:41 |
SamYaple | i think sdake said he was making one. im walking to bed | 18:42 |
harmw | cool | 18:42 |
harmw | thought so to | 18:42 |
harmw | *too | 18:42 |
sdake | harmw make he bug | 18:42 |
sdake | i dont know what bug to make | 18:42 |
harmw | me neither :> | 18:42 |
harmw | ill take a look | 18:42 |
harmw | just pulling it in | 18:42 |
sdake | ". . . and I liked the idea of running an entire system that wasn't compiled for a 386." | 18:43 |
*** jtriley has joined #kolla | 18:43 | |
harmw | sounds like gentoo | 18:43 |
*** dontalton has quit IRC | 18:44 | |
openstackgerrit | Jeff Peeler proposed stackforge/kolla: Add missing dependency oslo policy https://review.openstack.org/195700 | 18:44 |
sdake | so jpeeler we will be running delorean on master forever | 18:46 |
sdake | when we make a branch o maintain (such as liberty) we will switch that to the liberty packages | 18:46 |
jpeeler | sounds like we need to put kolla into delorean | 18:46 |
sdake | once we gate kolla delorean gets automatic gating for nothing :) | 18:47 |
jpeeler | sure, if they pay attention to our results | 18:48 |
sdake | well we can always file bugs ;) | 18:48 |
sdake | delorean should really ahve a dependency gate though | 18:49 |
sdake | that checks requirements.txt against the package dependencies and asks for manual intervention on failure | 18:49 |
jpeeler | python can't catch requires issues until run time | 18:49 |
jpeeler | delorean doesn't do that | 18:49 |
sdake | i'd bet 1 dollar against 100 wherever delorean pulled that neutrron code from had oslo.policy in the requirements.txt | 18:50 |
jpeeler | oh i see what you're saying | 18:50 |
*** jtriley has quit IRC | 18:50 | |
jpeeler | with the fast pace of openstack, it would benefit us to help delorean | 18:51 |
jpeeler | but too many more important things i know | 18:51 |
sdake | yes this is hte manual bug reporting that should be done following these dependency faiures | 18:52 |
sdake | glance has one for i18n as well if you are in a bug filing mood | 18:53 |
harmw | which we all so happily do, right guys :) | 18:53 |
* sdake loves filing bugs | 18:53 | |
sdake | almost as much as jerking around with launchpad all day long | 18:53 |
harmw | :p | 18:53 |
harmw | reporting packaging bugs sucks though | 18:53 |
sdake | harmw when will you e able to fix the rabbit container | 18:53 |
harmw | hopefully tonight | 18:54 |
harmw | coming 2hrs | 18:54 |
sdake | so 2 hrs from now | 18:54 |
sdake | ? | 18:54 |
harmw | uhm, yes | 18:54 |
sdake | ok that wfm | 18:54 |
sdake | i have meetings and what not so wont be around to hep | 18:54 |
sdake | help | 18:54 |
harmw | 'coming 2hrs', jeez | 18:54 |
*** rhallisey has joined #kolla | 18:54 | |
sdake | rhalllisey you up for fixing the busted rabbitmq container | 18:55 |
harmw | I just need to get clear what the issue is, fix it, file a bug, get reviews rolling and done | 18:55 |
sdake | its blocking our releae | 18:55 |
harmw | we could revert... | 18:55 |
sdake | i'd prefer to fix | 18:55 |
sdake | if we can't fix it today we will revert it | 18:56 |
sdake | and let the owner fix it properly | 18:56 |
harmw | ok, good to know reverting is a valid option | 18:56 |
sdake | but its almost the wekeend and I don't want to slip at all | 18:56 |
sdake | 25th hard deadline | 18:56 |
harmw | I rather see it fixed as well :) | 18:57 |
harmw | don't get me wrong on that :> | 18:57 |
sdake | rhallisey if you can help get harmw warmed up on the rabbitmq container that would be fantastic | 18:57 |
sdake | or jpeeler as well :) | 18:57 |
sdake | apparently it has soething to do with a bad sed line | 18:57 |
sdake | and incorrect logging permissions | 18:57 |
sdake | samyaple hit the wall so he was unable to file a bug report on the issue he saw | 18:58 |
rhallisey | k | 18:58 |
sdake | i'll be back in 30 mins for 1.5 hours | 18:58 |
sdake | then i'm locked up the rest of the day in meetings | 18:58 |
sdake | so please try to have some kind of bug report filed in the next 30 minutes so I can spend my 1.5 hours available working on the problem as well | 18:59 |
sdake | all hands on deck sort of thing | 18:59 |
sdake | harmw can't begin for 2 hours | 18:59 |
harmw | no no, I'm at it right now | 18:59 |
sdake | which puts us late into the night and possibly unable to get the review through the review queue | 18:59 |
sdake | harmw oh I misunderstood my bad :) | 18:59 |
harmw | perhaps I wrote it down in some cranky way though :p | 19:00 |
sdake | harmw well as soon as you get a bug filed get it linekd in channel so rhallisey and possibly jpeeler can investigate | 19:00 |
harmw | yeppers | 19:00 |
harmw | well it stars up just fine, no errors no nothign | 19:03 |
harmw | still awaiting the pull though, to fire up kolla | 19:03 |
harmw | in all it's might and glory! | 19:03 |
sdake | dont pull | 19:03 |
sdake | build | 19:03 |
sdake | ./build --release --no-cache | 19:03 |
sdake | pull means your pulling something that we now works :) | 19:03 |
harmw | b/c rabbit wsn't build yet | 19:04 |
* harmw smacks face | 19:04 | |
* harmw does that again | 19:04 | |
harmw | RABBITMQ_CLUSTER_COOKIE=<rabbit-cookie> - Default to none. | 19:07 |
harmw | but we run itthrough check_varrs | 19:07 |
harmw | ... | 19:08 |
sdake | now/known works | 19:08 |
*** jruano has joined #kolla | 19:08 | |
sdake | ok i'm back for a short bit - scrum meetings ftl | 19:08 |
sdake | so lets default that to RABBIT_COOKIE or something | 19:09 |
sdake | or if it needs to be some uuid or something | 19:09 |
sdake | lets generate it | 19:09 |
harmw | well if it's set, the cluster code kicks in | 19:09 |
sdake | harmw one more thing I wanted to point out, make sure to run a clean genev | 19:09 |
sdake | genenv | 19:09 |
harmw | yea | 19:09 |
sdake | so your running like our users would | 19:09 |
harmw | yep | 19:09 |
sdake | oh i see, so remoe from checkvars? | 19:09 |
harmw | indeed, I'm gonna try that | 19:09 |
harmw | (plus, did I realy +2 this?) | 19:10 |
*** jtriley has joined #kolla | 19:10 | |
harmw | (if so, /me smacks again) | 19:10 |
sdake | guys dont go hard on yourelf for +2 an error | 19:10 |
sdake | it happens all the time in openstack | 19:10 |
sdake | we rshould also be reling on functioanl gating | 19:10 |
sdake | as well as human inspection | 19:10 |
harmw | tornado's happen al the time as well, doesn't mean we don't like 'em either now does it :p | 19:11 |
sdake | in other words, our gating is only half the power of gating technique | 19:11 |
harmw | yep | 19:11 |
sdake | so clearl ywe need functional gating | 19:12 |
sdake | and we are gettting that unblocked ;) | 19:12 |
sdake | superman samyaple has done a tremendous job on helping remove some blockers there | 19:13 |
*** jasonsb has joined #kolla | 19:13 | |
*** jasonsb has quit IRC | 19:13 | |
*** jasonsb has joined #kolla | 19:13 | |
*** jtriley has quit IRC | 19:17 | |
*** jtriley has joined #kolla | 19:17 | |
sdake | harmw get reviews in as soon as possible - they can be separate commits | 19:21 |
sdake | the reason is because the gate is really overloaded atm | 19:21 |
harmw | still debugging the shit | 19:21 |
sdake | so I want to get our changes in quickly | 19:21 |
sdake | well the check vars, you know that is busted | 19:21 |
harmw | thats just one thing, half of it | 19:21 |
sdake | if you think its faster not to do that then dont | 19:21 |
sdake | just trying to optimize our progress through the gerrit queue :) | 19:22 |
sdake | hp cloud services had a major outage earlier | 19:22 |
sdake | so it busted the gate | 19:22 |
*** vbel has joined #kolla | 19:24 | |
harmw | are there details on the matter available? | 19:28 |
harmw | for personal joy :) | 19:29 |
harmw | btw, I'll be making a bugreport covering multiple issues with rabbit | 19:29 |
harmw | all related to one thing, the cluster patch | 19:29 |
*** jtriley has quit IRC | 19:35 | |
harmw | sdake: check | 19:42 |
*** daneyon_ has quit IRC | 19:42 | |
openstackgerrit | Harm Weites proposed stackforge/kolla: Do not run all vars through check_required_vars https://review.openstack.org/195717 | 19:42 |
sdake | harmw whatever you think is best | 19:42 |
harmw | no, just 1 fix for 1 problem | 19:42 |
harmw | not having LOG_BASE was already thre | 19:42 |
*** shardy has quit IRC | 19:42 | |
harmw | I'm looking at a running broker now :) | 19:42 |
harmw | woohoo | 19:42 |
harmw | single-node though | 19:42 |
sdake | make sure it works (by using heat or something) | 19:43 |
sdake | or nova | 19:43 |
harmw | config hasn't changed | 19:43 |
*** shardy has joined #kolla | 19:43 | |
harmw | just missing the cluster-specific bit | 19:43 |
*** vbel has quit IRC | 19:43 | |
sdake | harmw does that last change require changes to the integration-guide.md? | 19:44 |
harmw | let me double check that | 19:44 |
harmw | no | 19:45 |
sdake | the cluster nodes vs cluster configuration thing | 19:45 |
sdake | jpeeler or rhallisey can you ack that patch plz | 19:45 |
sdake | harmw is more work needed for rabbitmq? | 19:45 |
harmw | nope, just ran a tools/genenv and compose up -d | 19:45 |
harmw | sill works | 19:46 |
rhallisey | ya I saw that line was missing in his patch | 19:46 |
rhallisey | good catch | 19:46 |
sdake | so we are good to release once the gerrit queues up? | 19:46 |
sdake | we should probably double check neutron thin agents | 19:46 |
sdake | harmw I think you were doing that right? | 19:46 |
harmw | were, yes | 19:46 |
harmw | lets see if I can get more time from my timemachine | 19:47 |
sdake | appreciate the commitment harmw | 19:47 |
sdake | I know its a pita | 19:47 |
sdake | so what went wrong with that original commit is it was only tested in cluster mode | 19:48 |
sdake | not in single user mode | 19:48 |
sdake | single ndoe mode i mean | 19:48 |
harmw | probably | 19:48 |
*** jtriley has joined #kolla | 19:49 | |
harmw | rebuilding neutron now | 19:54 |
sdake | guys | 19:56 |
sdake | I changed the release announcement a bit | 19:56 |
sdake | and gals if we have any :) | 19:57 |
harmw | changed what | 19:57 |
sdake | https://etherpad.openstack.org/p/kolla-liberty-1-announcement | 19:57 |
harmw | good improvements | 20:00 |
sdake | thansk | 20:01 |
sdake | need more core reviewers | 20:01 |
sdake | which is reaon for throwing in the core reviewer part :) | 20:01 |
harmw | :) | 20:02 |
sdake | this is your last chance | 20:02 |
sdake | after this, there is no turning back ;) | 20:02 |
harmw | chance for what | 20:02 |
openstackgerrit | Merged stackforge/kolla: Add warnings about running on F22 and later https://review.openstack.org/195654 | 20:03 |
sdake | oh just watching the matrix | 20:03 |
harmw | wasn't that something with pills? | 20:03 |
harmw | "take the green pill, take the yellow pill" | 20:04 |
sdake | red pill = reality | 20:05 |
sdake | blue pill = fat dumb happy | 20:05 |
sdake | harmw any word on the neutron thin containers? | 20:06 |
sdake | or still building | 20:06 |
vinkman | Hmmm… Is it just me or is glance container broken? It is stuck at 35% creating the image… | 20:06 |
harmw | checking logs now | 20:06 |
sdake | harmws were you able to register an image with glance? | 20:06 |
harmw | yep | 20:06 |
harmw | from the pull | 20:06 |
sdake | vinkman which distro | 20:06 |
harmw | I didn't reubild | 20:06 |
sdake | oh from the pull | 20:06 |
* sdake groans | 20:06 | |
sdake | ok wel dont buid | 20:06 |
sdake | we can debug that problem next ;) | 20:06 |
vinkman | Ubuntu 15.04 with local build | 20:07 |
harmw | I'm testing nutron, remember ;) | 20:07 |
sdake | vinkman my machines are broke atm | 20:07 |
sdake | so harmw and jpeeler and rhallisey are the only guys that can debug | 20:07 |
vinkman | That's what VMs are for :D | 20:07 |
sdake | vinkman i'd suggest doing a pull of the container to get unblocked | 20:07 |
vinkman | kk… | 20:07 |
sdake | vinkman my mahchines are really broken | 20:07 |
vinkman | lol… time for a hammer then... | 20:08 |
harmw | linuxbridgecontainer is broken | 20:08 |
sdake | harmw could you go into more detail | 20:08 |
harmw | ofcourse ;) | 20:08 |
harmw | 2015-06-25 20:06:34.339 1 ERROR neutron AttributeError: 'LinuxBridgeNeutronAgentRPC' object has no attribute 'state_rpc' | 20:08 |
harmw | and | 20:09 |
harmw | 2015-06-25 20:06:34.338 1 ERROR neutron.openstack.common.threadgroup mac = utils.get_interface_mac(physical_interfaces[0]) | 20:09 |
harmw | 2015-06-25 20:06:34.338 1 ERROR neutron.openstack.common.threadgroup File "/usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 153, in get_interface_mac | 20:09 |
harmw | 2015-06-25 20:06:34.338 1 ERROR neutron.openstack.common.threadgroup struct.pack('256s', interface[:constants.DEVICE_NAME_MAX_LEN])) | 20:09 |
harmw | 2015-06-25 20:06:34.338 1 ERROR neutron.openstack.common.threadgroup IOError: [Errno 19] No such device | 20:09 |
harmw | could be this laptop, dunno yet | 20:09 |
sdake | get me some anestaphine plz | 20:09 |
harmw | there, FLAT_INTERFACE=eth1 | 20:10 |
harmw | doesn't exist | 20:10 |
sdake | oh well you need to configure your system | 20:10 |
sdake | does your system have two nics? | 20:10 |
harmw | changed to wlp3s0b1 | 20:10 |
harmw | lets see what happens | 20:10 |
sdake | use cleanup-containers -f | 20:10 |
sdake | befoer starting fresh plz | 20:10 |
harmw | no just kolla restart? | 20:10 |
sdake | do cleanup-containers -f | 20:10 |
sdake | it will result in a totally clean environment | 20:11 |
harmw | yea I know, ok | 20:11 |
sdake | your db is probably afu from that config error | 20:11 |
harmw | yup, good point | 20:11 |
sdake | but if not, lets not chase thatproblem down - just elimiate it entirely | 20:11 |
harmw | trying with enp2s0f0 btw, lets see what happens | 20:11 |
harmw | even though that nic isn't online | 20:11 |
sdake | the flat interface shouldn't be active | 20:12 |
sdake | neutron activates it | 20:12 |
harmw | it's not | 20:12 |
sdake | the public intefface should be active | 20:12 |
*** rhallisey is now known as rhallisey|brb | 20:12 | |
harmw | btw, when running virtualboxed coreos I'm only using (having) eth0... | 20:12 |
harmw | ok, now tools/kolla start | 20:12 |
sdake | and that works? | 20:12 |
harmw | yep | 20:12 |
harmw | which is why I never understood what the problem with that was | 20:13 |
harmw | you guys seemed to be having | 20:13 |
harmw | but lets get this neutron stuff sorted first | 20:13 |
harmw | before heading over to either glance or my bed :> | 20:13 |
sdake | were your vms able to communicate in/out | 20:13 |
sdake | via floating ips /etc | 20:13 |
harmw | yes | 20:13 |
harmw | but I want to test that again | 20:14 |
harmw | just to make sure I'm not wrong after all | 20:14 |
harmw | ok, waiting for containers to settle | 20:14 |
harmw | crap, same error :| | 20:14 |
harmw | ah, there is a NEUTRON_FLAT_NETWORK_INTERFACE | 20:18 |
sdake | ya the other flat interface is for nova | 20:19 |
harmw | great :| | 20:19 |
harmw | time to run it again | 20:19 |
harmw | weird, as if those two would result in something different... | 20:20 |
harmw | (different discussion though) | 20:20 |
harmw | tools/kolla start | 20:20 |
sdake | ya imperfect | 20:21 |
sdake | we also have PUBLIC_IP defined twice in the scripts | 20:21 |
sdake | why? no idea :) | 20:21 |
harmw | yup | 20:21 |
sdake | I keep hoping someone else will fix it | 20:21 |
sdake | broken window theory ftw | 20:21 |
harmw | me too, actually :p | 20:21 |
harmw | I'd love to just sweep to all those script and cleanup - bad | 20:22 |
harmw | ok, neutron is up and running now | 20:22 |
harmw | so they start | 20:22 |
sdake | do they work is the question :) | 20:23 |
harmw | and will my laptop play nice as well | 20:23 |
sdake | i'll brb - need to break harmw's _ filter | 20:23 |
*** sdake_ has joined #kolla | 20:24 | |
harmw | ah, my glance is broken b/c of that i18n bug | 20:28 |
harmw | lts build again | 20:28 |
*** sdake has quit IRC | 20:28 | |
sdake_ | vinkman have you rebuilt with the i18n bug merged into your repo? | 20:28 |
harmw | god that hurts man! | 20:28 |
harmw | sdake_: pain! | 20:28 |
*** sdake_ is now known as sdake | 20:29 | |
sdake | blame csco for their stupid split routing policy | 20:29 |
harmw | rebuil glnce, can I now kolla restart? | 20:30 |
harmw | or should I nuke it | 20:30 |
sdake | nuke | 20:30 |
harmw | if neutron 'just works' it should atleast have metadata running without issues | 20:31 |
harmw | my laptop probably isn't fit for routing beyond that | 20:31 |
vinkman | I am going to rebuild everything now… | 20:31 |
sdake | i'm not sure if i18n has hit the repo yet | 20:32 |
harmw | vinkman: make sure you got that fix in | 20:32 |
vinkman | kk.. checking... | 20:32 |
harmw | https://review.openstack.org/#/c/195516/1/docker/centos/binary/glance/glance-base/Dockerfile | 20:32 |
vinkman | Yup it is in : Merge: 75b8cdd 89d69ec | 20:33 |
vinkman | Author: Jenkins <jenkins@review.openstack.org> | 20:33 |
vinkman | Date: Thu Jun 25 18:38:30 2015 +0000 | 20:33 |
vinkman | Merge "Glance missing oslo.i18n" | 20:33 |
harmw | huh, I rebuilt my glance stuff but it still complains :| | 20:33 |
harmw | [root@27f8938b5dca /]# rpm -qa|grep oslo | 20:34 |
harmw | python-oslo-i18n-1.7.0-post4.el7.centos.noarch | 20:34 |
harmw | hm (thats the glnce-base) | 20:34 |
openstackgerrit | Merged stackforge/kolla: Add neutron-openvswitch-agent contianer https://review.openstack.org/181737 | 20:36 |
sdake | did you ./build --release | 20:37 |
sdake | --release will tag it with latest | 20:37 |
harmw | yep | 20:37 |
harmw | the rpm is installed though | 20:38 |
*** vinkman has quit IRC | 20:40 | |
*** vinkman has joined #kolla | 20:41 | |
harmw | sdake: this feels like some issue at RDO though | 20:42 |
sdake | could you go into more detail | 20:42 |
sdake | i juset got a vm setup so Ican help debug | 20:42 |
harmw | well, the files are in plce | 20:42 |
sdake | after jerking around getting my system setup today | 20:43 |
harmw | [root@1dc417b06238 /]# python | 20:43 |
harmw | Python 2.7.5 (default, Jun 17 2014, 18:11:42) | 20:43 |
harmw | [GCC 4.8.2 20140120 (Red Hat 4.8.2-16)] on linux2 | 20:43 |
harmw | Type "help", "copyright", "credits" or "license" for more information. | 20:43 |
harmw | >>> from oslo.i18n import * | 20:43 |
harmw | Traceback (most recent call last): File "<stdin>", line 1, in <module> | 20:43 |
harmw | ImportError: No module named i18n | 20:43 |
dims | harm: try | 20:43 |
dims | from oslo_i18n import * | 20:43 |
harmw | oslo_i18n seems to work, that folder exists | 20:44 |
harmw | lol dims :) just did that | 20:44 |
harmw | works | 20:44 |
dims | harmw: this may provide some context http://markmail.org/message/nxyy7bmxxgueftzn | 20:46 |
harmw | glance doesn't start though, it stays quiet | 20:46 |
harmw | so whn that hits upstream Glance, and ripples through RDO, we're gold | 20:47 |
harmw | he should've waited a week though :p | 20:47 |
sdake | ok well we aren't waiting a week | 20:51 |
sdake | dims what is the workaround | 20:51 |
harmw | patching glance | 20:52 |
sdake | obviously | 20:52 |
sdake | with what ;) | 20:52 |
dims | harmw: or cap oslo.i18n library version | 20:52 |
dims | i don't know much about what you are doing | 20:52 |
sdake | dims we are installing from rdo delorean packaging | 20:52 |
sdake | so we can't cap | 20:53 |
sdake | why would we need to patch glance - guess I dont get that part | 20:53 |
sdake | doesn't the glance gate, like check if glance works | 20:53 |
sdake | and if not, rrejects the patch? | 20:53 |
harmw | lol | 20:54 |
harmw | you'd expect that to happen yes | 20:54 |
dims | harmw: sdake: https://review.openstack.org/#/c/193335/ | 20:54 |
harmw | perhps gate didn't know of the change | 20:54 |
dims | merged on june 20th | 20:54 |
dims | oslo.i18n-2.0.0 was cut on june 23rd | 20:55 |
harmw | python-oslo-i18n-1.7.0-post4.el7.centos.noarch | 20:55 |
*** jtriley has quit IRC | 20:55 | |
harmw | is what I'm running in the container | 20:55 |
harmw | that rpm is from 06-22 | 20:56 |
sdake | dims so we need oslo.18n-2.0.0? | 20:56 |
harmw | http://trunk.rdoproject.org/centos70/e6/8b/e68b6c1a86ed452893165aa03f5d3c1ad0ffd41b_2a8263cb/python-oslo-i18n-2.0.0-post1.el7.centos.noarch.rpm | 20:57 |
harmw | its there | 20:57 |
harmw | just not in a corner we look at | 20:58 |
harmw | or is this me fucking up on -base --no-cache again :| | 20:58 |
harmw | sdake: you got your rig up&running? | 20:58 |
sdake | harmw i've got a 30 minute meeting then will be back | 20:58 |
harmw | ill be gone by then | 20:58 |
sdake | understood i'll take over | 20:58 |
sdake | please file a bug with the info you know | 20:58 |
harmw | will do | 20:58 |
harmw | next time lets do this kind of thing on friday, ok :p | 20:59 |
harmw | *evening | 20:59 |
dims | harmw: sdake: glance CI jobs seem to be doing ok. not sure what the rpms from deloran contain (which version of glance?) | 20:59 |
sdake | harms can you answer dims question plz | 21:00 |
sdake | i've got to jet for 30 mins | 21:00 |
harmw | dims: openstack-glance-2015.1.0-3.el7.noarch | 21:00 |
*** prad has quit IRC | 21:05 | |
harmw | https://bugs.launchpad.net/kolla/+bug/1468908 | 21:08 |
openstack | Launchpad bug 1468908 in kolla "glance oslo.i18n not found, should be oslo_i18n" [Undecided,New] | 21:08 |
harmw | we could open up https://bugs.launchpad.net/kolla/+bug/1468729 instead though, Ill leave that to you sdake | 21:10 |
openstack | Launchpad bug 1468729 in kolla "Glance - missing oslo.i18n" [Critical,Fix committed] - Assigned to Michał Jastrzębski (inc007) | 21:10 |
harmw | I'm out guys | 21:10 |
sdake | dims how do I fix this problem | 21:31 |
dims | sdake: http://git.openstack.org/cgit/openstack/glance/tree/requirements.txt?id=2015.1.0 | 21:32 |
dims | oslo.i18n>=1.5.0,<1.6.0 | 21:32 |
sdake | i cant cap, i am installing from packages | 21:32 |
dims | just pointing out that the package does not seem to do the right thing | 21:33 |
sdake | yes delorean packaging doesn't gate on reuirements.txt (it should) | 21:33 |
sdake | in other words, it doesn't verify its dependencies in its srpms match the upstream requirements | 21:34 |
dims | sdake: what can i say? either the glance code needs to be fixed or the right oslo.i18n library should be used... :( | 21:34 |
sdake | how do I fix teh glance code | 21:35 |
dims | doesn't delorean folks have a CI that tests their rpms against each other? | 21:35 |
sdake | i can apply patches after package instlal | 21:35 |
sdake | no they dont | 21:35 |
dims | sdake: grab the clean_oslo_namespaces.sh and run that? https://review.openstack.org/#/c/195263/ | 21:36 |
dims | just a bunch of seds | 21:36 |
sdake | how would I get that to operate on /usr/lib/python2.7/site-packages/glance? | 21:37 |
*** shardy has quit IRC | 21:40 | |
dims | back it up, try it and see which files are touched and show me a diff? i can take a peek | 21:40 |
openstackgerrit | Merged stackforge/kolla: Add missing dependency oslo policy https://review.openstack.org/195700 | 21:41 |
sdake | how do I run the script tho - it looks like it wants setup.py | 21:42 |
sdake | but these are installed pacages | 21:42 |
jpeeler | sdake: the glance package seems to only install to /usr/bin/ | 21:44 |
jpeeler | just run it on rpm -ql openstack-glance | grep /usr/bin | 21:44 |
jpeeler | you may have to adjust the script, the sed is the important part | 21:44 |
sdake | jpeeler interesting | 21:51 |
sdake | jpeeler if I ls -l /usr/bin/glance-* in the container I get file not found | 21:55 |
sdake | yet rpm openstack-glance shows the files as there | 21:55 |
sdake | jpeeler any idea why? | 21:55 |
jpeeler | no because they show up for me | 21:56 |
sdake | I have 1 hour meeting, jpeeler if you can take the action to investigate further so dims can provide some sort of woraround, that would be fantastic ;) | 21:56 |
jpeeler | oh wait, i'm not using current images | 21:56 |
jpeeler | i think what needs to be done is understood | 21:56 |
sdake | I dont understand what needs to be done | 21:57 |
jpeeler | the sed script needs to run on the installed glance service files | 21:57 |
jpeeler | if they aren't there, that doesn't make any sense. glance won't run then | 21:57 |
sdake | at this point i'd be happy with a pip install of the correct oslo i18n package | 21:57 |
sdake | jpeeler i agree, perhaps that is the real problem | 21:57 |
sdake | or maybe my system is just broke | 21:57 |
jpeeler | that is one other solution, using pip | 21:57 |
jpeeler | not any hackier than patching rpm installed files i suppose | 21:58 |
sdake | i could go with pip with a techdebt bug | 21:58 |
sdake | jpeeler can you try to investigate the pip techdebt bug option? | 21:58 |
jpeeler | investigate or do it? | 21:58 |
sdake | i dont understand why the files are there | 21:59 |
sdake | ya do it | 21:59 |
sdake | aren't there that is | 21:59 |
sdake | the fact that /dev/pts/ptmx ends up with 000 permissions totally breaks my system as well | 21:59 |
jpeeler | are there any people timezones who are just starting? dims what time is it for you? | 21:59 |
sdake | i thought rhallisey|brb was going to force that issue | 21:59 |
sdake | jpeeler we have a timezone gap until around 6 hours from now | 22:00 |
sdake | and in 6 hours is saturday :( | 22:00 |
jpeeler | oh right | 22:00 |
jpeeler | wait, today is thursday | 22:00 |
sdake | ya for other people i mean | 22:00 |
sdake | i really want to releae toady - ithink its critical | 22:00 |
sdake | but more important is not releasing something that is doa | 22:00 |
jpeeler | i guess that makes sense | 22:00 |
jpeeler | i'll look into fixing it via pip then. but i'm going to go for a run while there's still light outside | 22:01 |
jpeeler | actually, do you care if i just do the sed patch? | 22:01 |
openstackgerrit | Merged stackforge/kolla: Do not run all vars through check_required_vars https://review.openstack.org/195717 | 22:08 |
*** dims has quit IRC | 22:30 | |
*** dontalton has joined #kolla | 22:32 | |
*** jruano has quit IRC | 22:35 | |
*** dims_ has joined #kolla | 22:38 | |
sdake | jpeeler I dont care the solution I care it works | 22:40 |
*** jasonsb has quit IRC | 22:45 | |
*** jasonsb has joined #kolla | 22:45 | |
*** dontalton has quit IRC | 22:45 | |
*** rhallisey|brb is now known as rhallisey | 22:59 | |
*** sdake_ has joined #kolla | 23:00 | |
rhallisey | sdake, is cinder breaking stuff? | 23:00 |
*** sdake has quit IRC | 23:04 | |
*** sdake has joined #kolla | 23:07 | |
*** sdake_ has quit IRC | 23:11 | |
*** vinkman has quit IRC | 23:12 | |
*** absubram has quit IRC | 23:29 | |
*** jtriley has joined #kolla | 23:38 | |
sdake | cinder breaks the whole system | 23:42 |
sdake | no /dev/pts, everything depends on ptmx in a typical user system | 23:42 |
sdake | need to set the permissions in the container on each container start | 23:42 |
*** vinkman has joined #kolla | 23:43 | |
sdake | rhallisey ^^ | 23:43 |
*** juggler_ is now known as juggler | 23:44 | |
sdake | rhallisey can you address https://bugs.launchpad.net/kolla/+bug/1468951 asap plz | 23:46 |
openstack | Launchpad bug 1468951 in kolla "/dev/pts/ptmx needs to be set to 666" [Critical,Confirmed] - Assigned to Ryan Hallisey (rthall14) | 23:46 |
sdake | should be easy | 23:46 |
rhallisey | I though I did :/ | 23:47 |
sdake | i just rebuilt | 23:48 |
sdake | it doesn't get set | 23:48 |
*** vinkman has quit IRC | 23:48 | |
sdake | telling the users to do it in docs is not sufficient | 23:48 |
*** sdake has quit IRC | 23:54 | |
*** sdake has joined #kolla | 23:55 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!