Tuesday, 2015-10-20

*** jasonsb_ has joined #kolla00:00
*** jasonsb has quit IRC00:00
*** cloudnautique has quit IRC00:03
*** achanda has quit IRC00:05
*** tpot has joined #kolla00:08
*** jtriley has joined #kolla00:16
*** jtriley has quit IRC00:37
*** dims_ has joined #kolla00:38
*** jasonsb_ has quit IRC01:28
*** dims_ has quit IRC01:41
*** vinkman1 has joined #kolla01:43
*** vinkman1 has quit IRC01:47
*** vinkman has joined #kolla01:58
*** vinkman has quit IRC02:01
*** unicell has quit IRC02:02
*** vinkman has joined #kolla02:02
*** vinkman has left #kolla02:02
*** cemason has joined #kolla02:11
*** dolpher has joined #kolla02:15
*** devlaps has quit IRC02:15
*** cemason has quit IRC02:15
*** rhallisey has quit IRC02:17
*** achanda has joined #kolla02:24
*** devlaps has joined #kolla02:29
*** jasonsb has joined #kolla02:29
*** jasonsb has joined #kolla02:29
*** devlaps has quit IRC02:40
*** klint has joined #kolla02:41
*** dims_ has joined #kolla02:41
*** sdake has quit IRC02:43
*** dims_ has quit IRC02:47
*** vinkman has joined #kolla02:47
*** vinkman has quit IRC02:49
*** achanda has quit IRC02:54
*** vinkman has joined #kolla03:04
*** vinkman has quit IRC03:05
*** vinkman has joined #kolla03:12
*** tummy has joined #kolla03:15
*** kjelly has quit IRC03:31
*** CBR09 has joined #kolla03:34
CBR09morning all03:40
CBR09ah SamYample, when kolla will release v1.0.0?03:42
*** dims_ has joined #kolla03:43
*** dims_ has quit IRC03:48
*** alisonh has quit IRC03:51
*** unicell has joined #kolla03:52
*** cloudnautique has joined #kolla03:57
*** vinkman has left #kolla03:57
*** Hui has quit IRC03:58
*** alisonh has joined #kolla04:06
*** sdake has joined #kolla04:10
*** daneyon has joined #kolla04:21
*** daneyon_ has joined #kolla04:24
*** daneyon has quit IRC04:27
*** bmace has quit IRC04:40
*** bmace has joined #kolla04:41
*** dims_ has joined #kolla04:45
*** CBR09 has quit IRC04:49
*** dims_ has quit IRC04:50
*** inc0 has joined #kolla04:55
inc0good morning04:56
inc0asalkeld, did you see schedule?04:56
*** achanda has joined #kolla05:04
*** alisonh has quit IRC05:08
*** alisonh has joined #kolla05:11
nihilifermorning05:15
*** inc0 has quit IRC05:16
*** cemason has joined #kolla05:21
asalkeldinc0 not yet05:24
*** cemason has quit IRC05:25
*** tfukushima has joined #kolla05:38
*** tpot has quit IRC05:41
*** dims_ has joined #kolla05:47
*** kjelly has joined #kolla05:49
*** dims_ has quit IRC05:52
*** tummy has quit IRC06:00
*** sdake has quit IRC06:05
*** exploreshaifali has joined #kolla06:06
*** unicell1 has joined #kolla06:12
*** achanda has quit IRC06:12
*** shardy_a1k has joined #kolla06:13
*** unicell has quit IRC06:13
*** shardy_afk has quit IRC06:14
*** shardy_a1k has quit IRC06:18
*** inc0 has joined #kolla06:18
*** shardy_afk has joined #kolla06:19
*** gfidente has joined #kolla06:23
*** CBR09 has joined #kolla06:42
*** kragniz has quit IRC06:46
*** dims_ has joined #kolla06:48
asalkeldinc0: where is the schedule? steve said he would get that done06:52
*** dims_ has quit IRC06:53
*** shardy_afk is now known as shardy07:27
*** daneyon_ has quit IRC07:31
*** jmccarthy has quit IRC07:32
*** jmccarthy has joined #kolla07:33
*** daneyon has joined #kolla07:34
*** sdake has joined #kolla07:35
*** tfukushima has quit IRC07:44
*** openstackgerrit has quit IRC07:46
*** openstackgerrit has joined #kolla07:46
*** dims_ has joined #kolla07:49
inc0asalkeld, https://etherpad.openstack.org/p/kolla-mitaka-all-sessions07:52
inc0there was mail on openstack-dev07:52
*** dims_ has quit IRC07:55
*** mbound has joined #kolla08:00
*** sdake has quit IRC08:08
*** CBR09 has quit IRC08:13
*** athomas has joined #kolla08:22
*** sdake has joined #kolla08:36
*** kragniz_ has joined #kolla08:41
*** pbourke has quit IRC08:41
*** pbourke has joined #kolla08:41
*** kragniz_ is now known as kragniz08:41
*** tfukushima has joined #kolla08:48
*** dims_ has joined #kolla08:51
*** sdake has quit IRC08:56
*** dims_ has quit IRC08:57
*** shardy_ has joined #kolla08:59
*** shardy has quit IRC09:00
*** shardy_ has quit IRC09:04
*** shardy has joined #kolla09:05
*** dolpher has quit IRC09:08
asalkeldooo thanks inc009:21
inc0you're up late;)09:21
*** sdake has joined #kolla09:48
*** dims_ has joined #kolla09:49
pbourkehey all09:49
pbourkehas anyone done AIO *without* a registry lately09:50
pbourkeseems to be not looking in my local cache and going straight to docker.io ...09:50
nihiliferyes, I did it recently, worked well09:50
nihiliferwhat namespace are you using?09:52
pbourkejust the default, kollaglue/09:54
pbourkeit usually does this if I forget to change docker_pull_policy to missing09:55
inc0I'm doing it all the time, I didn't use registry at all09:59
*** sdake has quit IRC10:03
SamYaplepbourke: yea AIO no registry is common for me10:07
pbourkehttps://paste.fedoraproject.org/281338/35723144/10:09
pbourkemaybe something to do with the fact im using a virtualenv and its confusing the configs10:09
SamYaplepbourke: are you sure you build the data container?10:11
SamYaplei often forget that with my regex10:11
pbourkeyeah you can see it in the bottom of the above paste. I'll try building again10:12
SamYapleah yea10:12
SamYaplewhat version of docker?10:12
nihiliferpbourke: what's yout /etc/kolla/global.yml?10:12
nihiliferyour*10:12
pbourkehttp://paste.fedoraproject.org/281340/5335973110:13
pbourkehaven't changed much10:13
*** cemason has joined #kolla10:15
*** exploreshaifali has quit IRC10:18
*** Kennan2 has quit IRC10:19
*** cemason has quit IRC10:20
*** Kennan has joined #kolla10:24
*** dolpher has joined #kolla10:24
*** jmccarthy has quit IRC10:29
*** jmccarthy has joined #kolla10:33
SamYapleany testers around running centos willing to test out rabbitmq for me?10:47
SamYaplepbourke....10:48
SamYapleill buy you beer....10:48
pbourkeSamYaple: i'll try soon as I get a deploy up10:48
SamYaplefyi, it really needs multinode to test10:49
SamYaplebut who knows it might break in AIO ;)10:49
pbourkethat's a problem then :(10:49
SamYapleyou should deploy kolla and then launch three vms and deploy kolla10:50
pbourkeim stuck for hardware atm, vm's were too slow and making me depressed10:50
pbourkeso trying to just do AIO on a desktop10:50
pbourkewe're getting access to lab equipment soon10:50
SamYapledamn10:50
SamYaplecool10:50
pbourkethis seems to work fine https://paste.fedoraproject.org/281365/14453385/10:57
pbourkeso whats wrong kolla :/10:57
SamYaplewhat version of docker-py and docker pbourke ?10:58
pbourkedocker-py (1.5.0)10:58
pbourkedocker 1.8.210:59
pbourkeansible 1.9.210:59
SamYapleyea all thats good10:59
SamYaplethat test you posed is going to pull down the data container pbourke ...10:59
SamYapleit doesnt have missing set11:00
pbourkemissing is default11:00
SamYapleoh is it11:00
pbourkeseems so yeah11:00
SamYapleremove the api btw11:00
SamYaplewe dont use that anymore11:00
*** dolpher has quit IRC11:22
pbourkeSamYaple: im getting the error you get when you dont have it ...11:23
SamYaplewhich error?11:23
pbourkethis one https://github.com/ansible/ansible-modules-core/issues/170711:24
pbourkehttp://paste.openstack.org/show/476837/11:24
SamYaplepbourke: oh then you need to be running something newer than 1.9.211:24
SamYaplelook at that bug, it happens in 1.9.211:24
pbourkeright, but officially I thought the requirement was >=1.9.211:25
SamYaplesure. but if its broke its broke11:25
pbourkeit wasn't broke until that api line was removed though11:26
SamYaplethe api line was only a stop gap for a different issue and had to be removed for causing an issue11:26
SamYaplethe different issue was fixed in 1.9.211:26
SamYapleand you can use 1.9.2 if you use an older version of docker and docker-py11:27
pbourkeok11:27
SamYaplethere is a floating table of the crap that works together11:27
SamYaplebest advice is run the newest stuff11:27
SamYaplethe only _cap_ we have is docker at 1.8.211:27
SamYapleand thats only until ansible 1.9.511:28
*** rhallisey has joined #kolla11:33
*** rhallisey has quit IRC11:33
*** rhallisey has joined #kolla11:33
*** cemason has joined #kolla11:38
*** inc0 has quit IRC11:46
SamYapleso with the erasure pool i see about the same perforamnce when using the cache tier12:16
SamYaplegranted the cluster itself probably can't perform as well12:17
SamYaplebut an instance is not affected, which is cool12:17
openstackgerritSam Yaple proposed openstack/kolla: Automate setting up a cache tier  https://review.openstack.org/23675612:25
openstackgerritSam Yaple proposed openstack/kolla: Allow specifying erasure as the pool type  https://review.openstack.org/23675412:25
openstackgerritSam Yaple proposed openstack/kolla: Allow ceph pool names to be configurable  https://review.openstack.org/23675512:25
*** klint has quit IRC12:58
*** jruano has joined #kolla13:01
jmccarthySamYaple: Sorry - haven't had a chance to double check that nova_consoleauth patch, I know you did - and it's merged now anyway ;)13:06
SamYapleno problem13:08
SamYaplejmccarthy: try out the rabbitmq patches, they are good13:08
jmccarthySamYaple: I don't have a working kolla env at the moment sadly =/13:11
SamYaplejmccarthy: sadness13:16
SamYaplewhat happened to all your environments gusy?13:16
jmccarthySamYaple: I'll have another go with the Vagrant dev-env soon hopefully, the last attempt bailed on a kernel crash =/13:17
pbourkeI seem to fight different issues daily13:18
SamYapleyou guys need to get your act together!13:18
jmccarthySamYaple: 'you guys' Who is that now ? ;)13:18
SamYapleyou know all you people13:19
jmccarthySamYaple: Ya ! We should get with the program !13:19
SamYaple;)13:19
jmccarthy=)13:20
SamYapleive got my dev environment I am going to be opening up to a few people with slow builds as soon as its ready13:20
SamYaplebasically kolla underneath, openstack on top13:20
SamYapleso all kolla dev is done on kolla-in-kolla13:20
pbourkefor dev docker seems no more repeatable than rpms13:20
pbourkeim hoping the experience for end users will be smoother13:20
SamYapleyou run dev docker?13:21
pbourkeno I just mean docker as a build/deployment method13:21
SamYapleah13:21
*** dims_ has quit IRC13:30
*** dims_ has joined #kolla13:30
jmccarthyWondering: Are there folks using the vagrant-devent with virtualbox much ?13:30
jmccarthys/devent/devenv13:31
SamYaplei think thats the majority of vagrant users...13:31
SamYapleoh well i dont know about kolla13:31
jmccarthyYea I remember the previous incarnation of it was good, or might be my imagination since libvirt/nfs etc style came in13:32
pbourkejmccarthy: it hasn't changed hugely the last while13:45
pbourkejmccarthy: change libvirt to virtualbox at the top, that should be all13:46
jmccarthyI'll give it another spin hopefully soon13:47
SamYaplefyi13:48
SamYapleive got a few patches in to start getting the requiremnens bot to propose things13:48
SamYapleanyone see an issue with that13:48
*** inc0 has joined #kolla13:49
pbourkehow does it work13:53
pbourkenot turning up too much so far on google13:54
*** jruano has quit IRC14:05
SamYaplepbourke: it just proposes changes14:09
SamYaplepbourke: so a new pathset will pop up with a requirements change and we just approve it14:10
openstackgerritPaul Bourke proposed openstack/kolla: Add documentation around how to build behind a proxy  https://review.openstack.org/23759814:10
pbourkeSamYaple: does it watch pypi for new versions is it?14:10
*** sdake has joined #kolla14:10
SamYapleno its syncs our requirements.txt with global-requirements.txt14:11
SamYapleits how all the projects operator14:11
SamYapleoperate*14:11
pbourkeah14:12
pbourkesounds good14:12
SamYapleso the automated cachetier things is working really well14:18
SamYaplemade it liberty compatible14:18
SamYapleit doesnt change xisting behaviour14:18
*** inc0 has quit IRC14:23
*** vbel has joined #kolla14:25
vbelgood morning/evening everyone :)14:26
SamYaplemorning vbel14:27
vbelgot a question - hard one... I tried to revive cinder and have working iscsi lvm that survives reboots :)  Now I tried to use nfsdriver and got design problem. I could get volumes created in nfs but could not attach them to libvirt. The problem is that nova-compute creates disks for libvirt - mounts nfs shares. Then it commands libvirt to start with them but libvirt runs in own mount namespace. Nothing helps to workaround it. The only solution i have14:32
vbel is quite destructive to current design - to run libvirt and compute in one container14:32
SamYaplevbel: unfortuntely we arent going to be able to fix that14:33
SamYaplevbel: docker 1.10 _should_ have the code to allow that, but even then i dont know we will be able to implement that14:34
vbelSamYaple: yes, it depends on many other things like ansible14:34
SamYapleno its actually all a docker problem14:34
SamYapleso docker 1.10 will allow non-private mount namespaces, but that still requires you to mount the nfs stuff from the host, not the container14:35
SamYaplei dont think youll be able to do that14:35
vbelso the only option if any is to run compute/libvirt in one ... :(14:36
vbelno nfs14:36
SamYaplecorrect14:36
SamYapleif I am being truthful here I believe the only real option for Kolla is going to be Ceph14:37
vbelSamYaple: thanks for comments!14:38
pbourkeSamYaple: what version exactly of ansible are you using14:41
*** bradjones has joined #kolla14:42
*** bradjones has quit IRC14:42
*** bradjones has joined #kolla14:42
pbourkeor anyone else who has a working setup :)14:50
SamYaple# ansible --version14:51
SamYapleansible 1.9.414:51
SamYaple# pip freeze | grep docker-py14:51
SamYapledocker-py==1.5.014:51
SamYaple# docker version14:51
SamYaple.....14:51
SamYapleServer: Version:      1.8.214:51
vbel1.9.2 here14:53
SamYaplepbourke: does that help?14:56
pbourkeSamYaple: yeah thanks. though they are the same versions Im using15:01
pbourkewith ansible 1.9.4 Im getting:15:01
pbourkefatal: [localhost] => {'msg': 'ImportError: cannot import name is_executable', 'failed': True}15:01
pbourkedifferent error with 2.0.x15:02
SamYapleif yo uwere messing around with 2.0 your system is probably foobard15:02
pbourkesigh15:09
pbourkehonestly I think its a bug in ansible 1.9.415:09
pbourketrying from a venv15:09
SamYaplei use it....15:09
pbourkesame thing15:09
pbourkewith AIO?15:09
SamYaplemy guess is you are missing a dep15:09
*** mpetason has joined #kolla15:10
SamYaplepbourke: are you installing from source?15:10
pbourkeyes15:10
SamYapleoh you arent cloning the modules probably15:10
SamYapleare you inititing the subrepos?15:11
pbourkeyup15:11
SamYapleyou should just pip install it....15:11
SamYaplewhy are you installing from source?15:11
pbourkeI suppose this is the issue with baremetal, you can't be sure the env isn't contaminated15:11
pbourkedidn't know they'd released 1.9.4 to pip15:11
pbourkewill try that next15:11
sdakemorning15:11
sdakesamyaple sir15:12
sdakeslides15:12
sdakeprep for summit15:12
SamYapleyea :/15:12
sdakewednesday?15:12
sdake4 hour slot15:12
sdakecan you do?15:12
*** inc0 has joined #kolla15:12
SamYaplewait 4 hours right now?15:12
sdakewednesday15:12
sdakei am busy today15:12
SamYapleoh todays not wednesday15:12
SamYapleyea thats probably fine15:12
*** kjelly_ has joined #kolla15:12
sdakecan you tell me your preferred time since i know you jsut time shifted your day around15:13
sdakewe may also have another 4 hour slot on thursday as well15:13
SamYapleohhhhh pbourke i know what is going on i think15:13
sdakeit usually takes about 8 hours15:13
SamYaplepbourke: ansible and venvs are tricky15:13
SamYaplethey work until you try to use them :)15:13
pbourkeI had a feeling about that ;)15:13
SamYaplewhen ansible sshs it doesnt ssh _into_ a venv15:13
SamYapleso all the deps you install in tehre arent accessible15:14
pbourkesssh though I think it's working now15:14
pbourkena actually its not15:14
SamYapleyou can run it from a venv, but the deps must be on the host15:14
inc0wassup?15:14
pbourkemight have to nuke machine15:14
SamYaplepbourke: just do a new venv i think15:14
SamYaplemorning inc015:14
inc0howdy Sam15:14
inc0you are morning person again?15:15
inc0not nighly?15:15
SamYapleyea first shift15:15
inc0that's why it was so boring on irc all day long15:15
SamYapleoh so you want drama15:16
* SamYaple changes topic to "no lambda unless you are playing half-life"15:16
inc0we'll slowly become project which will only be active during US time15:17
SamYaplemmmm love build profiles15:18
*** dwalsh has joined #kolla15:19
kjelly_Well, I am not live in US time. I hope the project will not only be active during US time.15:20
SamYaplekjelly_: im always arund :)15:20
SamYaplearound even15:20
sdakekjelly_ i'm around lmost the time unless i'm  sick15:21
sdakeI have asthma, and kids, so when I get a cold I am out for the count15:21
sdakeand i get colds often because of the kids15:21
sdakeasthma + colds = way worse then healthy person + cold15:21
inc0right now there is little plague in Poland15:22
inc0of cold and sore throat15:22
sdakesamyaple can you tell me 2 4 hour slot times you like 1 wed 1 thur15:22
inc0first weeks of autumn...15:22
sdake10am-2pm?15:22
SamYaplesure15:23
sdakethanks i'll send an invite do you have a new email address?15:23
SamYaplei dont think i ever talked to you on the RAX one... so no15:24
inc0planning drinks guys?;)15:25
pbourkedo you guys use whatsapp?15:25
SamYapleno work :(15:25
inc0I used to, but not much any more15:26
sdakeinc0 we have drinks on the ptl on friday15:26
sdakeas long as the bill is under 1k ;)15:26
SamYaplewho is the ptl?15:26
sdakeaftre that you guys  are on your own :)15:26
pbourke:D15:26
* sdake wacks sam15:26
SamYaple:)15:26
inc0Sam you can be for one night if you want to buy us drinks15:26
sdakeyes!15:26
sdakei liek that plan inc015:27
SamYaplemake it 2 nights15:27
sdakesam yu can get drinks on thursday :)15:27
SamYapleim changing jobs and moving.... so ill buy a round. thats probably all i got15:27
inc0I'm eager to try out japanese whiskeys15:27
pbourkeis there a way to stop ansible cleaning up it's remote code15:27
sdakei'd like to get together for dinner if folks are interested thursday night15:27
pbourkeso when it fails you can see what it was trying to execute15:27
SamYaplepbourke: ANSIBLE_KEEP_REMOTE_FILES=1 ansible-playbook blah15:28
sdakeanyone interested int hat?15:28
pbourkeSamYaple: thank yaw15:28
pbourkesdake: yes15:28
SamYapleyea15:28
inc0int hat?15:28
sdakeit may be pay your own way tho15:28
inc0ah..15:28
SamYapleso good news15:28
SamYapleoverlayfs seems to work for building15:28
sdakebut i'll try to find someon place not off the hook bonkers expensive15:28
SamYaplewith docker 1.8.2 and kernel 3.1915:28
inc0what was the issue SamYaple ?15:28
sdakeit was fixed samyaple?15:28
SamYapleinc0: lots of issues15:29
inc0uhh15:29
SamYaplesdake: not completely, there are still kernel patches that need to land in kernel15:29
SamYaplebut apparentl i can build15:29
sdakeoh so its coming along?15:29
inc0sdake, streetfood and some cool japanese garden is always an option15:29
sdakei mean it will be working at some point?15:29
SamYaplesdake: its working for me right now15:29
SamYaplethere are just more known bugs15:29
SamYapleim just not hitting them aparrently15:29
sdakenice15:29
SamYapleor ubuntu backported them maybe15:30
SamYaplethats possible15:30
sdakesam can you build and push all the variants plz15:30
SamYapleunlikely :)15:30
SamYaplei dont have bandwidth for that now15:30
sdakeoh right job change15:30
sdakecan you buid lnad push ubuntu?15:30
SamYapleive got gigabit at new place,but im not setup15:30
inc0SamYaple, when do you move?15:30
sdakepbourke can you bild and push ol?15:31
SamYapleinc0: mid nov or later15:31
SamYaplebefore the end of the year15:31
pbourkesdake: yes15:31
inc0I see, I hope we'll get to have a drink in SA15:31
sdakequestion, how do we build for the docker registry?15:31
pbourkesdake: do you want it pushed to dockerhub?15:31
SamYaplewe probably will15:31
SamYaplesdake: what do you mean?15:31
sdakeyes push to docker hub all variants i  want - looking to distribute15:31
sdakewell there needs credentails to push to dockerhub15:31
SamYapleso?15:32
SamYapleoh you mean host does build.py do it15:32
sdakewhat is the build.py cli to push to dockerhub?15:32
*** jmccarthy has quit IRC15:32
sdakei'll build cento right now for source and binary15:32
SamYaplei dont use build.py for pushing to the hub since the hub can do it in parallel15:32
*** cloudnautique has quit IRC15:33
sdakedo you have a script to build for the docker hub then?15:33
*** dims__ has joined #kolla15:33
SamYapledocker images | awk '/kollaglue/ {print $1}' | xargs -P100 -n1 docker push15:33
SamYaplesomething like that15:33
SamYaplemake sure to put an rc tag on it until its been tested15:34
SamYaplethen retag15:34
SamYaplebtw, we need to talk about tagging15:34
sdakeok sort of lost ;)15:34
sdakewe hvae friday 2.5 hours for parking lot15:34
sdakethen drinking afterwards15:34
sdakewe can cover that in parking lot ok?15:34
sdakecontributor meetup on friday15:34
SamYapleso were going to wait to push?15:34
SamYapleim confused15:34
sdakei wantto push now if possible15:35
SamYapleso we should talk about tagging15:35
sdakei thought yuo wanted to have a bigger discussion about how to do it going forward15:35
SamYaplewell i mean are you just going to push with the "liberty" tag?15:35
SamYaplewhat happens when we push another?15:35
SamYapleliberty == latest for liberty15:35
SamYaplebut there should still be tags15:35
SamYapleliberty-115:35
SamYapleliberty-215:35
SamYapleliberty-315:35
*** dims_ has quit IRC15:36
sdakeliberty.015:36
sdakeliberty-1 is for milestones15:36
sdakewould be my recommendation15:36
SamYaplei dont think you can use .15:36
sdakeor liberty-releae.015:36
sdakeliberty-release-0?15:36
SamYaplebe more programatic? liberty-release-00015:37
SamYaplei doubt well ever push 99915:37
sdakewfm15:37
rhalliseywon't it just be liberty15:37
rhalliseystable-liberty15:37
SamYaplerhallisey: for the latest one, yes15:37
SamYaplebut we need to keep a tag for every image we ever push15:37
sdakeliberty-stable is good too15:37
SamYaplethats our value add15:37
rhalliseywhat do you mean by latest though15:37
rhalliseyI thought were wern't doing that anymore15:38
SamYapleas in most recent15:38
SamYaplewe arent15:38
sdakerhallisey i dont want stable-liberty but liberty-stable is good15:38
SamYaplei would also like the 1.0.0 tags, mayching our versioning15:39
SamYapleideally we can use any image with any playbook through a branch, but thats unlikely to be the case15:39
sdakeya i guess ill just create a new gpg key15:39
sdakesince my old one is fubared15:39
sdakebecasue of the upgrade to the intel nvme15:39
*** blahRus has joined #kolla15:41
*** shardy_ has joined #kolla15:41
pbourkesdake: just ping me once you sort the keys and I can push ol15:41
SamYaplepbourke: he is talking about for github15:41
SamYaplepbourke: whats your dockerhub uername15:41
sdakeif you need a dockerhub account pbourke let me knwo15:42
sdakeor added15:42
pbourkedockerhub username is 'brk3'15:42
SamYapleadded pbourke15:42
SamYapleyou can push15:42
*** shardy has quit IRC15:42
pbourkeit may have scrolled past me, do we want to standarise on build.py options for release builds15:42
SamYapleany other cores need access?15:42
rhalliseypretty sure I already have it15:43
SamYapleinc0 coolsvap ?15:43
SamYaplerhallisey: yea you do15:43
sdakeok so what the hell is the release naming plan then :)15:43
sdakeliberty-release-000?15:43
SamYaple+115:43
rhallisey^ that's from git eh?15:43
sdakeand the tag will be liberty-1.0.0 in git?15:44
SamYaplesdake: no15:44
SamYaplethe git tag is jsut 1.0.015:44
sdakeok15:44
SamYapleso we really need to talk about a process for this15:44
SamYaplebut we can fish bowl it15:44
rhalliseysorry if I'm behind here, but you want image tag to be liberty-release-000?15:44
SamYapleand retroactively fix15:44
SamYaplerhallisey: yes15:44
SamYapleit will have other tags as well15:45
sdakewe dont have fishbowl sessions for this15:45
sdakewe can cover on friday15:45
sdakebut i'd like images up before friday15:45
SamYapleimages can push with liberty-release-00015:45
pbourkeetherpad?15:45
rhalliseySamYaple, how often are we planning on building?15:45
SamYaplewe can add other tags later15:45
rhalliseyand pushing a new tag15:45
SamYaplerhallisey: i would say once a week. but itll be influnced by things like testing, tagging, security, etc15:45
pbourkehttps://etherpad.openstack.org/p/kolla-release-builds15:45
sdakelets etherpad guys15:46
*** shardy_ has quit IRC15:46
kjelly_How about iberty-release-XXXXX ? XXXXX is git commit id. only five char15:46
SamYaplekjelly_: theres not assurance we dont build two images from the same git commit15:46
*** shardy has joined #kolla15:47
inc0I should make dockerhub account at some point...I'll come back to you later15:47
sdakeinc0 creating dockerhub account takes 3 minutes15:47
sdakedo it now pelase so we can get it setup15:48
rhalliseySamYaple, I don't follow what you have15:48
SamYapledo we build images from head of stable?15:49
inc0SamYaple, inc0 it is;)15:49
SamYapleor tag?15:49
inc0I'd say head15:49
inc0or have multiple tags15:50
inc0latest, stable-liberty and such15:50
SamYapleinc0: if we build against head, how can we ensure pip installed kolla works15:50
inc0tags then?15:50
inc0and default tag will be stable?15:51
SamYaplewe can build against tags15:51
inc0I mean docker images tags15:51
inc0not github tags15:51
SamYapleim confused then15:51
SamYaplethe images we push cant be from head i dont think15:51
rhalliseySamYaple, got a question on 'liberty' tag.  When will we ever tag liberty-release-XXX if liberty is always latest15:51
SamYaplerhallisey: for not wanting to run the latest for whatever reason15:51
inc0guys can we discuss it tomorrow on meeting?15:51
SamYaplestill wanting to run the playbooks without new containers being used15:51
SamYaplelatest is borked15:52
SamYaplethis is the immutable thing we have15:52
rhalliseySamYaple, but how will that get built?  Everytime we build latest we also have to build say liberty-release-001.  Where 002 would be the latest15:53
SamYaplerhallisey: well we never build "latest" we would build liberty-release-00115:53
SamYapleonce that is pushed and tested then we update the latest tag15:53
rhalliseyok I think I understand now15:54
SamYapleif we are never building from the head of the branch, maybe a plain 'liberty' tag doesnt make any sense15:58
SamYaplemaybe just the version number15:58
kjelly_SamYaple: When user use image with latest tag, does the user know image with latest tag is liberty-release-001 now ?15:58
SamYaplekjelly_: no, they would only have teh sha. they could use that to find a specific tag if they wanted15:59
kjelly_SamYaple: Ok. So when user reoport bug, the user need to provide sha to let us find what images he use. Is that right?16:00
*** CBR09 has joined #kolla16:03
*** cloudnautique has joined #kolla16:05
*** cloudnautique has quit IRC16:05
*** cloudnautique has joined #kolla16:05
*** inc0 has quit IRC16:05
SamYaplekjelly_: correct16:10
SamYaplekjelly_: we probably need some template for them to fill out16:10
rhalliseythat is a good point..16:10
sdakeok guys i am waiting on the liberty release of rdo before tagging16:11
sdakeapevec is moving it to the top of his work queue16:11
sdakehe said today16:11
rhalliseycool16:11
sdakeapproximately 1 hour16:12
sdakeso samyaple you said something about tagging as a rc vs tagging as a relase once we tesst?16:12
sdakebut there are no directions in the ehterpad for that16:12
SamYapleits not needed if we only push up liberty-release-XXX16:12
SamYaplethat way we can test and repush if needed16:12
SamYapleuntil we update the other tags (1.0.0) we are fine16:13
*** unicell has joined #kolla16:13
*** gfidente has quit IRC16:13
*** gfidente has joined #kolla16:13
*** unicell1 has quit IRC16:14
sdakefor this rdo rpm repos change, we are violating the typical backport mechanism16:14
sdakeits going straight into the liberty branch16:14
SamYaplewhy16:14
SamYapleis it a patch only for liberty?16:15
sdakebecause we would hae to remove https://github.com/openstack/kolla/blob/master/docker/base/Dockerfile.j2#L53-L5616:15
sdakeand then revert that  removal16:15
sdakeyes only for liberty16:15
SamYaplethen its not a backport16:15
sdakeit makes the rpms liberty specific16:15
SamYaplethanks fine16:15
sdakeright16:15
SamYapleif its a backport we wont backport master16:15
sdakeyes its juts not a typical workflow16:15
SamYapleif its not then yea theres no option16:15
sdaketypically nothing should ever jsut jump into a branch without a backport16:16
SamYaplethats not true at all16:16
sdakebut this is our probaby only exception16:16
SamYapleit hasnt even been the only exception so far16:16
sdakethings shoudl go into master first if feasible16:16
SamYapleits far from it16:16
sdaketo avoid regressions16:16
SamYapleright but master changes, well have bugs to fix in liberty that dont apply to master16:16
sdakeya16:16
SamYapleif it applies to multiple branches it goes to master first16:17
sdakehopefpully they will be bugs in master too, or we would hae already backportedthem :)16:17
sdakeright we ar ein violent agreement :)16:17
SamYapleYEA!16:17
CBR09hi all16:19
CBR09I have a question16:20
CBR09openstack liberty was released16:20
sdakethis is the last bug for liberty https://bugs.launchpad.net/kolla/+bug/150812716:20
openstackLaunchpad bug 1508127 in kolla "Need a Liberty-specific repo for RDO" [Critical,Confirmed] - Assigned to Steven Dake (sdake)16:20
CBR09If I want build images from liberty-stable16:20
CBR09what I must do?16:20
sdakecbr i think i jumped the gun on that email16:20
sdakemy apologies16:20
sdakegive me about 1 hour please16:21
sdakethen checkout the liberty branch of kolla16:21
sdakeand use that16:21
sdakewe are also going to be buildling liberty for all the container base oses16:21
sdakeso you can pull directly from the registry16:21
sdakeSamYaple do you think we need to update liberty tags to pull liberty-release-000 for example?16:22
sdakein the ansible files16:22
SamYapleno they would pull '1.0.0'16:22
SamYapleand yes we should update that16:22
SamYapleill pop a patch16:22
sdakecan you get a patch in queue16:22
sdakethanks16:22
CBR09yea, thank sdake16:22
sdakeSamYaple please file a bug too or if you want ill file16:23
sdakeshall I file?16:23
SamYapleTrivialFix?16:23
SamYaplethis isnt a bug16:23
sdakeok tf is fine16:23
sdakethe repo thing isn'ta tv so i didn't tf tag it16:23
sdakebut this shoudl be16:24
sdakealthough please make the commit message good enough to understand what the change is about16:24
sdakethere isa  higher bar on trivialfix in the commit message16:24
SamYapleso we set the version anywhere?16:24
SamYapledo we set*16:25
sdakewe set it for the image tag "latest"16:25
sdakein the globals.yml I think?16:25
sdakeor somewhere else?16:25
SamYapleright but what about pbr and stuff16:25
*** exploreshaifali has joined #kolla16:25
sdakeversion 1.0.0 is in setup.cfg16:25
SamYaplefor pip and packaging16:25
sdakethats fixed16:25
SamYapleah ok16:25
sdakedouble check tho plz16:25
SamYaplewe should be setting those two at the same time16:25
CBR09sdake, but I want to know how to build images?, only use build.py?16:25
sdakecbr09 right16:26
sdakecbr09 but the images are not quite ready to be built yet16:26
kjelly_SamYaple: launchpad seems not to support template which let user use to report bug. Maybe we need to a document how to report bugs.16:26
sdakesamyaple so if your putting 1.0.0 in place of "latest"16:26
openstackgerritSam Yaple proposed openstack/kolla: Set version tag for Liberty  https://review.openstack.org/23767516:26
CBR09Why not?, I saw openstack liberty was release few day ago16:27
sdakedo we not want liberty in tthere?16:27
sdakecbr09 we hae 1 outstanding bug16:27
sdakewe are dependent upon rdo community16:27
SamYapleidk sdake16:27
sdakeif you are buliding ubuntu your fine16:27
SamYaple1.0.0-liberty?16:27
sdakesamyaple persoanlly i'd go for libeerety-1...0.016:27
sdakewow spelling!16:27
sdakeliberty-1.0.016:27
sdakeor 1.0.0-liberty16:27
SamYapleso we would have 1.0.0-liberty, 1.0.0-liberty-release-XXX, liberty-release-XXX ?16:28
SamYapleor should we just have 1.0.0-liberty, 1.0.0-liberty-release-XXX,16:28
sdakesecond option16:29
SamYapleagreed16:29
sdake[09:28:56]  <SamYaple>or should we just have 1.0.0-liberty, 1.0.0-liberty-release-XXX,16:29
SamYaplewe no16:29
SamYaplewe need all three16:29
SamYapledont we?16:29
SamYapleor is it not a ticking count for the entire branch anymore?16:29
SamYaplejust the one version?16:29
sdakeoh elt me think about that16:30
CBR09sdake: so, I just run ./build.py -b ubuntu -t source, it will build ubuntu with liberty-stable, is it right?16:30
sdakei think that gets more complex to manage16:30
sdakelets have a tick per 1.0.0 1.0.1 etc16:30
sdakeso resets to 0 each new release16:30
*** cloudnau_ has joined #kolla16:30
SamYaplesdake: maybe. we can right a little tool to query dockerhub for the next increment16:30
SamYaple1.0.0-liberty-release-00016:31
SamYaple1.0.0-liberty-release-00116:31
sdakethe problem is if liberty-1.0.0 comes out16:31
SamYaple1.0.1-liberty-release-00016:31
sdakeand liberty 1.0.1 comes out16:31
sdakethen if we have a global #, there is no wayt o keep the stuff in sync16:31
SamYaplewell the idea is we would no longer pump out versions for the 1.0.0 branch16:31
SamYaplebut still does the above number workf or you?16:31
sdakesamyaple could you restate which #s,s there are e so many :)16:32
*** cloudnautique has quit IRC16:32
SamYaplesdake: bottom of the etherpad16:32
sdakelet me check pad16:33
SamYaplesdake: i dont follow your question16:35
SamYapleif we push out a 1.0.2 we are not pushing any 1.0.1 anymore16:35
sdakeso each release retags with 1.0.z?16:35
sdakegot that16:35
SamYapleyea16:35
sdakeif we push 1.0.1-001 the n1.0.1-002, 1.0.1 gets tagged to 1.0.1-002 ?16:35
SamYapleyes16:36
sdakecool hwo do we do that - are there commands in the pad?16:36
sdakei dont know how to tag an existing dockerhub entry16:36
*** asalkeld_ has joined #kolla16:36
sdakehey asalkeld16:36
SamYapleoh well work on that16:36
SamYaplein not worried about that atm16:37
sdakeok so after summit we can figure that shit out16:37
sdakea script to do the job would be dandy16:37
SamYapleyea we can do that16:37
*** asalkeld has quit IRC16:37
sdakebtw, did folks see the schedule i sent to the ml16:38
sdakeand anyone displeased with what had to be trimmed based upon available space?16:38
sdakeif so, we hae 2.5 hours friday we have available for either parking lot or drinking (water responsibly of course:)16:38
openstackgerritSam Yaple proposed openstack/kolla: Set version tag for Liberty  https://review.openstack.org/23767516:38
sdakepbourke looks good for your ack if your willing16:40
sdakeso how do we do this initial build once we are ready since we dont have tagging sorted out?  just use --tag 1.0.0-liberty?16:41
*** achanda has joined #kolla16:41
SamYaple--tag 1.0.0-liberty-release-00016:41
SamYaplepnce that is validated as working we add another tag16:41
SamYapleif it doesnt work we repush with:16:41
SamYaple--tag 1.0.0-liberty-release-00116:41
sdakei see16:42
SamYaplei figure thats cleaner than -rc16:42
sdakehow do we add the validated tag16:42
*** jasonsb has quit IRC16:42
SamYapledockerhub ui is one way16:42
SamYaplebut we really need a script16:42
SamYaplemanual is pain in the rear16:42
sdakecan thee make a script16:43
SamYaplemaybe16:43
SamYapleprobably not until after summit16:43
SamYapleor during16:43
sdakeok well we will need to manually do it then16:43
SamYapleyea16:43
sdakeyo usay the dockerhub ui can do it?16:43
SamYapleyup16:43
SamYapleyou can add/remove tags16:43
sdakeso we have to find all 90 containers and tag them?16:44
* sdake groans16:44
SamYapleyea :(16:44
SamYapleyou could also retag locally and repush16:44
SamYapleit should go quicker, but not instant16:44
sdakeis it possible to easily script that?16:44
sdakesomethign hacky16:44
SamYapleyea i do it with a oneliner16:44
sdakejust to speed things up for everyone16:44
sdakecool!16:45
sdakeput in etherpad plz16:45
SamYaplethere bottom of the therpad sdake16:47
sdakegot it16:48
SamYaplereplace oldtag and nettag16:48
*** tummy has joined #kolla16:48
sdakeso quick question16:49
sdakeif we have 1.0.0-liberty-release-00016:49
sdakeand we release 1.0.16:49
sdake1.0.116:49
sdakewould it be 1.0.1-liberty-release-001?16:50
SamYapleno16:50
SamYaplelook at the list16:50
*** unicell has quit IRC16:50
sdakegot it line 58-6316:51
*** kjelly_ has quit IRC16:51
sdakeapevec is testing rpms now16:51
SamYapleansible is being dumb again :/16:51
*** sdake has quit IRC16:56
*** achanda has quit IRC17:00
SamYaplei really dont like ansible17:03
*** diga has joined #kolla17:03
SamYapleit violates so much DRY to use it...17:03
*** achanda has joined #kolla17:13
*** sdake has joined #kolla17:14
*** diga has quit IRC17:16
*** unicell has joined #kolla17:20
*** sdake_ has joined #kolla17:21
*** sdake has quit IRC17:23
sdake_http://ur1.ca/o49yp -> http://paste.fedoraproject.org/281564/4453618617:24
sdake_testing now17:25
SamYaplei was wrong17:26
SamYapleeverything build but kolla-ansible17:26
SamYaplewith overlayfs17:26
*** dims__ has quit IRC17:27
*** dims_ has joined #kolla17:28
*** dwalsh has quit IRC17:28
sdake_wierd kolla-ansible doesn't build17:36
SamYapleits because of the git install17:36
SamYaplepip is doing stupidsocket stuff17:36
sdake_SamYaple did your 1.0.0-liberty patch get acked?17:37
SamYaplei dont think so17:37
sdake_rhallisey can you ack that patch please17:37
SamYaplehttps://review.openstack.org/#/c/237675/17:38
sdake_SamYaple do you ahve to change any of the code in build.py to push to the docker registry17:38
sdake_I seem to recall in the past I had to change a flag about insecure/vs/secure17:39
*** kragniz has quit IRC17:39
SamYaplenot a local registry17:39
SamYapleprobaly the docker hub17:39
*** achanda has quit IRC17:39
sdake_ya i mean the docker hub17:39
SamYaplemaybe17:39
*** kragniz has joined #kolla17:39
SamYaplehaveny tried17:39
SamYapleprobably need to read the auth file17:39
sdake_the auth file is read by docker-py17:39
sdake_how do you push to the docker registry then?17:39
SamYapleis that a question17:39
sdake_no its a statement17:40
sdake_i am certain I have read the code17:40
sdake_but i am not sure about the secure flag17:40
sdake_or is that a question realting to how to pus hto docker hub?17:40
openstackgerritMerged openstack/kolla: Set version tag for Liberty  https://review.openstack.org/23767517:40
*** jpeeler has quit IRC17:41
*** cloudnau_ has quit IRC17:42
sdake_SamYaple my question was how did you push ubuntu for liberty-3 to the docker hub?17:42
sdake_not using ubild.py?17:42
*** jasonsb has joined #kolla17:42
SamYaplesdake_: docker push17:42
*** cloudnautique has joined #kolla17:43
SamYapledocker iamges | awk '/kollaglue/ {print $1}' | xargs -n1 -P100 docker push17:43
sdake_you pushed each iamge one y one?17:43
sdake_oh I see17:43
SamYaplesoemthign like that17:43
sdake_what is -P100?17:43
sdake_and n1?17:43
*** jpeeler has joined #kolla17:43
*** jpeeler has joined #kolla17:43
SamYapleparallel 10017:44
SamYaplebasically push them all at once17:44
*** dwalsh has joined #kolla17:44
sdake_can you geet that in thee pad so people know, I tend to ues build.py when I've done it in the past but had to hack the code base a bit17:44
* sdake_ hates generating gpg keys17:47
*** achanda has joined #kolla17:47
*** sdake_ is now known as sdake17:47
sdakeubuntu source keystone has had 116 pulls17:53
sdakethat was all rc317:53
sdakegpg key created again17:58
sdakedamn designate isn't buliding18:06
openstackgerritSteven Dake proposed openstack/kolla: Use the liberty release RDO RPMS  https://review.openstack.org/23772218:09
sdakerhallisey/samyaple/pbourke/jpeeler can i get acks on that please ^^18:09
rhalliseyroger18:10
*** achanda has quit IRC18:11
openstackgerritSteven Dake proposed openstack/kolla: Use the liberty release RDO RPMS  https://review.openstack.org/23772218:11
sdakeit has been tested btw18:11
*** gfidente is now known as gfidente|afk18:11
sdakemay have one more major bug18:12
sdakelooks like dont ack18:13
sdakemay not build from source18:13
SamYaplesdake: https://review.openstack.org/#/c/236938/18:15
SamYaplelets drop that in berfore yo utag18:15
SamYaplelooks like the last liberty patch18:15
sdakelet me read please18:15
*** jpeeler has quit IRC18:15
sdakebut likely :)18:15
SamYapleno blind obediance!18:15
*** jpeeler has joined #kolla18:15
sdakeanything else?18:17
SamYaplelooks like all in the queue for libery18:17
sdakeanything else needing backports that was missed?18:18
sdakeyou said you have  a tool to test for that18:18
SamYaplenot that had a flag18:18
SamYaple'tool'18:18
SamYapleit was a oneliner18:18
sdakegot it18:18
sdakeso if something got missed becaue of lack of flag, i'm ok with that18:18
SamYaplepretty much18:19
SamYaplei think we should have a potential-backport tag as well18:19
SamYapleso we dont miss things18:19
SamYaplewe can tag all patches we think might need a backport as well as ones we know need them18:19
openstackgerritMerged openstack/kolla: add "registry" flag to "tools/build.py"  https://review.openstack.org/23693818:20
sdakehow that is typiclly done is bakcport-potential in launchpad18:25
SamYaple?18:26
sdakeusing a launchpad tag18:26
sdakethat said I like the git based workflow we are using18:26
sdakei find it infintely more easy to track then launchpad\18:26
*** diogogmt has joined #kolla18:28
SamYapleso we are all on the same page, we need to switch to ansible 2.0 for mitaka18:28
openstackgerritSam Yaple proposed openstack/kolla: Automate setting up a cache tier  https://review.openstack.org/23675618:30
openstackgerritSam Yaple proposed openstack/kolla: Allow specifying erasure as the pool type  https://review.openstack.org/23675418:30
openstackgerritSam Yaple proposed openstack/kolla: Allow ceph pool names to be configurable  https://review.openstack.org/23675518:30
*** mpetason has quit IRC18:31
*** achanda has joined #kolla18:33
*** diogogmt has quit IRC18:34
*** mbound has quit IRC18:35
*** diogogmt has joined #kolla18:35
sdakeok guys I've got the final patch building both binary and source rdo of centos now18:36
sdakeI have doctor papoointment for about 1 hour then I will be back18:36
sdakeand then we will tag and start the building process18:36
sdakebbiaf :)18:36
*** achanda has quit IRC18:39
openstackgerritSam Yaple proposed openstack/kolla: Automate setting up a cache tier  https://review.openstack.org/23675618:39
openstackgerritSam Yaple proposed openstack/kolla: Allow specifying erasure as the pool type  https://review.openstack.org/23675418:39
openstackgerritSam Yaple proposed openstack/kolla: Allow ceph pool names to be configurable  https://review.openstack.org/23675518:39
*** diogogmt has quit IRC18:44
*** exploreshaifali has quit IRC18:44
*** diogogmt has joined #kolla18:45
*** sdake has quit IRC18:47
*** athomas has quit IRC18:47
*** pbourke_ has joined #kolla18:48
*** achanda has joined #kolla18:48
pbourke_https://www.oracle.com/corporate/pressrelease/oracle-openstack-4-oracle-linux-101915.html18:49
pbourke_\o/18:49
SamYaplepbourke_: you know alot about Kolla, you should apply there18:50
SamYaplepbourke_: how much as this been change from vanilla kolla?18:50
pbourke_SamYaple: very little really18:51
SamYaplecool18:51
pbourke_SamYaple: main change would be mysqlcluster instead of mariadb18:51
SamYaplethatll be good in the long run18:51
pbourke_kolla goes commercial, you guys are all now sell outs18:51
SamYaplewheres my money18:52
rhalliseylol18:52
SamYaplecall me what you will i gots to get paid18:52
pbourke_oh, and the cli18:53
pbourke_which we're v. interested in people looking at18:53
pbourke_source should be up very soon if not already18:53
openstackgerritSam Yaple proposed openstack/kolla: In gate functional testing  https://review.openstack.org/23399318:53
SamYaplepbourke_: bring to kolla :(18:53
SamYapleneed cli18:53
pbourke_we def will18:54
SamYapleok guys that gate patch can go in. i have to have this (and the backport) merge before we can actually get infra to give us new tests18:55
SamYaplevalidate it doesnt break existing and merge please :)18:56
bmacethe cli source should be up on oss.oracle.com imminently, but if you want to see something before that here are the cli docs: http://docs.oracle.com/cd/E64747_01/E64749/html/osusg-kollacli-commands.html19:01
*** shardy has quit IRC19:04
openstackgerritSam Yaple proposed openstack/kolla: In gate functional testing  https://review.openstack.org/23399319:05
*** shardy has joined #kolla19:06
*** thumpba has joined #kolla19:09
openstackgerritSam Yaple proposed openstack/kolla: In gate functional testing  https://review.openstack.org/23399319:15
*** achanda has quit IRC19:23
*** sdake has joined #kolla19:25
SamYaplebmace: pbourke_ yea you should make that in kolla....19:26
SamYapleneed those things bad19:26
*** daneyon has quit IRC19:28
bmaceSamYaple: that is definitely the plan! :)19:31
*** mbound has joined #kolla19:36
*** sdake has quit IRC19:40
*** mbound has quit IRC19:41
*** CBR09 has quit IRC19:44
*** sdake has joined #kolla19:51
sdakeyo folks19:53
sdakewhats up19:53
sdakemy computer failed while i was at dr office19:54
sdakeso hvae to rebuild again groan19:54
*** thumpba has quit IRC19:56
*** shardy has quit IRC19:56
*** shardy has joined #kolla19:58
*** tpot has joined #kolla20:01
*** daneyon has joined #kolla20:05
*** daneyon has quit IRC20:11
*** achanda has joined #kolla20:24
*** achanda has quit IRC20:25
openstackgerritSteven Dake proposed openstack/kolla: Increase Ceph RPM gpg key timeout to 90 seconds  https://review.openstack.org/23776820:28
sdakeplease ack ^^!!20:28
openstackgerritSteven Dake proposed openstack/kolla: Use the liberty release RDO RPMS  https://review.openstack.org/23772220:30
sdakeSamYaple jpeeler rhallisey pbourke can you folks ack the above20:30
SamYapleyou should point it to a mirror20:31
SamYapleceph.com goes down all the time20:31
SamYaplethats why i use a keyserver in ubuntu sdake20:31
sdakei was just following the directions20:31
sdakeis there a mirror?20:31
sdakeI didn't see a mirror in their documentation20:31
SamYapleall kinds of mirrors20:31
SamYapleits not there20:31
SamYaplenormal gpg mirrors20:32
SamYapleall over the place20:32
sdakei'd rather follow the docs as much as possible and if we relaly run into problems we can adjust in the future20:32
sdakethis close to release atleaste20:33
SamYaplewell this is the type of problem im talking about20:33
sdakeits just slow because they are using git for their key distribution20:33
SamYapleyes. most everyone keeps thier release keys there like that.20:34
SamYapleyou still use a keyserver20:34
sdakei am open to changing after release if we have some soak time20:34
sdakeid' like to stick to the docs for the short term if thats aok with you :)20:34
SamYapleits fine with me. it doesnt touch ubuntu20:35
sdakecool can you ack then :)20:35
sdaketia20:35
SamYaplewould never do that there because it is going to break20:35
SamYapleits been down for several days before :/20:35
sdakei can file a tech debt research bug if you like20:35
SamYaplei only care because i dont want to make this voting if you have that as an external dep20:36
sdakei htink in general we need to find solutions to these proboelms for hte voting gates20:36
sdakeoh we were thinking along the same lines20:36
SamYapleyea but its only centos that i dont want voting. i dont have these issues with ubuntu :)20:37
sdakei'm going to try to get mirrors going for all our external repos internally20:37
SamYapledocker is the big "we need a mirror" thing20:37
SamYapleor at least for ubuntu20:37
SamYaplethey have thier stuff together for the other mirrors20:37
sdakethe ptl changed for infra20:37
sdakeso i need to have a f2f discussion about if they can get some mirrors ssetup for our external kolla repos20:38
sdakewe have a 40 minute session on gating20:38
sdakeat summit as well20:38
SamYapleif we can get docker mirrored thats all we really need20:38
SamYaplethe delorean stuff is always going to be unstable20:38
SamYapleill have to see alot of improvement to make that gating20:39
SamYaplevoting*20:39
*** bkosick has joined #kolla20:42
SamYaplefyi sdake https://review.openstack.org/#/c/237745/20:43
sdakesamyaple good news, clarkb said infra would allow us to have mirrors on their gear20:47
*** achanda has joined #kolla20:47
sdakeif we did the puppet work to set up the mirrors20:47
SamYaplecool20:48
sdakeI dont know puppet but surely we can find someone to do that work20:48
SamYaplethatll fix the docker issue20:48
SamYaplewe already use the infra pip wheels20:48
SamYaplei suppose cloud-archive could be mirrored20:48
SamYaplethat would be it for ubuntu, docker and cloud-archive20:48
*** achanda has quit IRC20:53
*** bkosick has quit IRC20:56
*** jasonsb has quit IRC21:00
*** achanda has joined #kolla21:07
pbourke_SamYaple: do you really need to add a new profile for the gate21:11
pbourke_or could you use a combo of the existing ones21:12
SamYaplepbourke_: i could use a combo except i dont want an extra image we dont care about to break the gate21:12
SamYaplemongodb for example21:12
SamYaplethe deploy gate will be the only voting gates21:13
pbourke_what about 'default', could we just change that to match the gate?21:13
bmaceall the code is up on oss.oracle.com now.  for the cli that is here: https://oss.oracle.com/git/?p=openstack-kollacli.git;a=summary21:13
SamYaplepbourke_: i dont know why anyone cares about default to be honest, but it was explicitly asked to only have those that ansible deploys by default with no options21:14
SamYapleidk like to have a profile that is specific to the gate to avoid breakage21:14
SamYaplei dont want someone chaning default ad breaking the gate by accident21:14
pbourke_fair enough21:15
*** achanda has quit IRC21:15
pbourke_are the current failures related to the patch? if not I'll +221:17
SamYapleidk has the gate returned21:18
sdakeyo merge my patches!!21:18
pbourke_never!21:18
sdakehttps://review.openstack.org/237722 https://review.openstack.org/#/c/237768/21:18
SamYaplepbourke_: wait for the gate21:18
sdakerhallisey pbourke  ^^21:18
SamYapledont blind merge please. wait for the gate21:19
sdakeoh the gate hasn't finished yet?21:19
sdakeone of my patches wont build21:19
rhalliseyyes looking good.  I'll leave the +a until the gate21:19
SamYaplepbourke_: nah those failures are due to the ceph stuff21:19
SamYaplepbourke_: you can +2 the gate job if you want21:20
SamYaplepbourke_: https://review.openstack.org/#/c/23776821:22
SamYaplecan you remove your +a21:22
SamYapleneed to wait on the gate21:22
sdakeya sam is righ twe should be waiting for the gates21:23
sdakeespecially right prior to release21:23
sdakei'll rebase the rdo patch after the ceph patch is backported21:24
pbourke_done, but I thought if the gate passes it will merge, if not it wont?21:24
sdakepbourke our gates are non-voting21:24
SamYaple^21:24
sdakethey need to be voting for that behavior to happen21:24
sdakethey tell you something worked or didn't work21:24
sdakethey dont actually gate :(21:24
SamYaplelol pbourke_ your +a not +221:24
sdakeweek before summit and infra is overloaded ;-)21:25
sdakeon the plus side we think infra will now support the abiilty to mirror the stuff we need mirrored so we can have oting gates!21:28
pbourke_such as?21:29
SamYapleall the repos21:29
sdakeevery repo we install in the base image21:30
sdakepypi is already mirrored21:30
sdakebecause then we will hae access and control over the mirrors21:31
sdakeso if the gate fails we can fix the mirrors21:31
sdakethat will permit us to make the gate voting21:31
sdakewhich will be a huge deal21:31
pbourke_nice21:33
SamYaplespeaking of gate voting, this needs to be approved and backported for that to happen https://review.openstack.org/#/c/233993/21:33
sdakethat wwill essentially allow us to get rid of build regressions21:33
sdakewhich is one big step21:33
*** achanda has joined #kolla21:35
sdakeSamYaple https://review.openstack.org/#/c/233993/14/tests/test_build.py why remove the failure count?21:37
SamYaplesdake: I explained it21:38
sdakeoh i missed that21:38
sdakelet me see if i can find it in the patchset21:38
SamYaplehttps://review.openstack.org/#/c/233993/12/tests/test_build.py21:38
SamYaplei apparently explained it in a comment21:38
sdakegot it21:39
sdakewould you mind telling me what that unmanted image means?21:39
sdakeunmatched21:39
sdakedoes it mean something built that shoudln't have?21:40
SamYaplei means the regex ignored the image21:40
sdakeright ok your correct in your assessment then21:41
sdakeis this ready for +2 then even with the gates all red?21:41
sdakeotherwise patch looks good21:41
sdakejust not sure why gates are bustola21:41
SamYaplesdake: yea they are read for your ceph patch reasons and designate failing the gate21:42
SamYaplered*21:42
sdakegot it ok souns good then21:42
sdakehttps://review.openstack.org/#/c/233993/ needs another review folks21:43
sdakeone day the gates will vote - soon can't happen fast enough :)21:43
sdake(one day soon that is:)21:43
SamYaplesdake: its all borked!21:46
SamYaplehttps://review.openstack.org/#/c/237722/21:46
sdakeya21:47
sdakei just saw that21:47
*** achanda has quit IRC21:47
sdakethat means openstack infra is busted21:48
sdakesomething with zuul i think21:48
SamYaplebtw with our build gates ive noticed we see issue 3-4 days before they get talked about upstream21:48
SamYapleacross all the projects21:49
SamYaplewell see a nova issue days before it gets talked about21:49
SamYaplesame with designate just now21:49
sdakeya we will become the front line for quality control in openstack over time if  we make our gates reliable21:52
SamYapleit also means were likely to be fixing other projects perpetually21:54
*** dwalsh has quit IRC21:56
*** achanda has joined #kolla21:57
*** docaedo has joined #kolla21:59
sdakeok folks i dont know how to fix the gate - so we can either merge those two patches and backport them (and I've manually tested both of them)21:59
sdakeor we can stall our release/build until we can find someone to unbreak the gate22:00
SamYapleconsidering they are building now we can wait22:00
SamYaplei kicked of a recheck about 10 minutes ago22:00
sdakeoh they are registered now?22:01
sdakemaybe nodeepool went out toe lunch22:01
SamYaplethe jobs are running according to zuul22:01
*** achanda has quit IRC22:02
asalkeld_o/22:08
SamYaple\o22:09
sdakeyo asalkeld22:09
sdakedid that schedule help?22:09
sdakeasalkeld i added a session just for you and tripleo - third prty integration - hope you can make that one22:10
asalkeld_sdake: thanks, yip22:10
*** achanda has joined #kolla22:12
*** pbourke_ has quit IRC22:17
*** sdake has quit IRC22:18
*** sdake has joined #kolla22:18
SamYaplegreat22:23
SamYaplea nova bug introduced in rc3 :/22:23
sdakeas in bust?22:25
sdakei tested openstack friday night working great then :)22:26
SamYapleno22:26
SamYapleregression in ceph cloning of raw images22:26
sdakedoes that affect us or our demo?22:26
SamYaplewe can work around it22:27
SamYapleim getting a patch to nova now22:27
sdakegate failed22:30
sdakeubuntu gate22:30
sdakeand centos source22:30
sdakenova compute22:31
* sdake groans22:31
SamYaplesdake: that means ceph isnt working22:31
sdakelookign at the logs the ceph key was imported22:33
SamYaplebased on whats failing the only thing they have in common is ceph packages22:34
kfox1111so, which version is the kollaglue containers going to use? rdo snapshot of liberty?22:34
sdake2015-10-20 22:08:50.420 | INFO:kolla.cmd.build:nova-compute:[91mError unpacking rpm package python-requests-2.7.0-1.el7.noarch22:35
sdake2015-10-20 22:08:50.421 | INFO:kolla.cmd.build:nova-compute:[0m22:35
sdake2015-10-20 22:08:50.421 | INFO:kolla.cmd.build:nova-compute:22:35
sdake2015-10-20 22:08:50.421 | INFO:kolla.cmd.build:nova-compute:error: unpacking of archive failed on file /usr/lib/python2.7/site-packages/requests/packages/chardet: cpio: rename22:35
kfox1111oh. nm. looks like rdo does have a final release.22:35
sdakekfox1111 liberty branch has a patch up to stablize on a specific version22:36
sdakesamyaple it isn't ceph22:36
*** jongchoi has joined #kolla22:36
*** jongchoi has quit IRC22:36
sdakekfox1111 but its not merged yet because of gating issues22:37
kfox1111k.22:37
kfox1111thx.22:37
sdakesamyaple my patch fixes the issue22:37
sdakethere is another ceph issue22:37
sdakeSamYaple what is wrong here: http://logs.openstack.org/68/237768/1/check/gate-kolla-build-images-ubuntu-source/fa02a52/console.html#_2015-10-20_22_13_48_94022:38
sdakeis it designate?22:38
sdakewhy change the api in a stable branch a few days after the releaes22:39
* sdake growls22:39
sdakesamyaple i'm good with a merge on the ceph timer patch22:39
sdakethere is some other issue that needs addressing22:40
sdakesomething to do with installing python-requests.2.7.022:40
SamYapleoh yea python-requests gets pulled in by ceph22:40
sdakepip uninstall python-requests if from source then?22:41
sdakein nova-compute?22:41
sdakelet me file a bug22:41
* sdake UGGGGHS22:41
sdakesamyaple here is the link http://logs.openstack.org/68/237768/1/check/gate-kolla-build-images-centos-source/5d0286b/console.html#_2015-10-20_22_07_54_08222:43
openstackgerritMerged openstack/kolla: Increase Ceph RPM gpg key timeout to 90 seconds  https://review.openstack.org/23776822:43
sdakehttps://bugs.launchpad.net/kolla/+bug/150823622:44
openstackLaunchpad bug 1508236 in kolla "CentOS from source on Ceph fails to build nova-compute" [Critical,Confirmed] - Assigned to Steven Dake (sdake)22:44
openstackgerritMerged openstack/kolla: Use the liberty release RDO RPMS  https://review.openstack.org/23772222:44
sdakebrb22:44
openstackgerritSteven Dake proposed openstack/kolla: Increase Ceph RPM gpg key timeout to 90 seconds  https://review.openstack.org/23780022:47
*** sdake_ has joined #kolla22:48
*** sdake has quit IRC22:49
SamYaplesdake_: https://review.openstack.org/#/c/237799/22:51
SamYaplethat is the ceph issue22:51
sdake_looking22:51
SamYaplethat code only gets excersided in a few select cases22:52
SamYaplebasically only when the image type is raw22:52
*** tummy has quit IRC22:52
SamYapleso its unsuprising it wasnt caught to be honest :/22:52
sdake_doesn't qcow2 convert to raw?22:53
SamYapleyea but its not a CoW clone22:53
SamYapleif the image is qcow2 it actually downloads to the compute then reuploads to ceph22:53
SamYapleif its raw its a CoW clone, no additional sapce22:54
SamYapleoh you mean on upload?22:56
kfox1111I thought they had a patch in that would convert qcow to raw on ingest into glance?22:56
SamYapleno22:56
SamYaplethat would have to be a glance patch22:56
SamYaplebut either way thats unrelated to this bug22:57
kfox1111yeah. I thought kilo or liberty had that.22:57
kfox1111k.22:57
SamYapleif its raw in ceph, you cannot boot an instance22:57
SamYaplewell if its raw and you have CoW cloning enabled then you cannot boot an instance22:57
SamYaplethats the default soooo22:57
SamYapledo we know anyone on the nova team?22:58
SamYaplealright im going away for a bit22:59
sdake_samyaple what is this ERROR:__main__:openstack-base:openstack-base-archive: no such file or directory23:03
sdake_there is no openstack-base-archive file in the repo23:05
sdake_a patch that merged today23:06
sdake_or yesterday tahat is23:06
* sdake_ groans23:06
sdake_pbourke around??!!23:06
*** dolpher has joined #kolla23:09
SamYaplesdake_: what are you talkign about23:10
sdake_master is broken23:10
sdake_ERROR:__main__:openstack-base:Error'd with the following message23:10
sdake_ERROR:__main__:openstack-base:openstack-base-archive: no such file or directory23:10
sdake_[sdake@bigiron kolla]$ tools/build.py -t source nova-compute23:11
sdake_oh wait23:11
sdake_kolla-build.conf23:11
SamYapleyup23:11
sdake_in etc now23:11
sdake_that is probaby it23:11
SamYapleyou have an outdated one23:11
sdake_yup fixed thanks :)23:12
sdake_trying to fi this ceph from source problem23:12
sdake_so atleast our shit builds :(23:12
*** daneyon has joined #kolla23:12
sdake_daneyon what day do you depart for japan?23:13
daneyonSun evening... arrive Tues morning.23:13
sdake_I htink I like friday23:14
sdake_but not sure23:14
sdake_leave friday that is23:14
*** daneyon_ has joined #kolla23:34
*** daneyon has quit IRC23:37
sdake_bmace ping23:38
*** blahRus has quit IRC23:39
* asalkeld_ leaving tomorrow this time23:41
*** dims_ has quit IRC23:45
*** dims has joined #kolla23:46
*** cemason has quit IRC23:47
openstackgerritSteven Dake proposed openstack/kolla: Make Ceph install from Source on RPM  https://review.openstack.org/23781623:50
sdake_jpeeler rhallisey samyaple need an ack on that one ^23:50
sdake_https://review.openstack.org/#/c/237800/ needs an ack23:54
sdake_then i think we are good for release23:54
sdake_that last change also needs to be backported23:55
openstackgerritSteven Dake proposed openstack/kolla: Make Ceph install from Source on RPM  https://review.openstack.org/23781623:55
docaedoWondering if I'm doing something wrong - I've tried building the images locally a few times, and always seem to hang here:23:56
docaedoINFO:__main__:gnocchi-api:Removing intermediate container beb0f8a42ed823:56
docaedoINFO:__main__:gnocchi-api:Successfully built 80acc3067dfd23:56
docaedoINFO:__main__:gnocchi-api:Built23:56
docaedoDid this with kolla from trunk as well as stable/liberty23:56
SamYapledocaedo: its not hanging. its still building/pushing23:57
SamYapleit will crash if something breaks i assure you23:57
SamYaplei highly doubt anything is just hanging23:58
docaedoSamYaple: excellent :) I will be patient then and just let it be23:58
docaedoSamYaple: because you know, I thought everything with containers was just INSTANT!23:58
docaedoSamYaple: :)23:58
SamYaplethat can be improved in the scrpipt for more feedback if youre interested :)23:58
docaedosome indication that it's not stalled would not be bad, but I'm not going to nitpick, I'm really excited about the progress you've made23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!