*** salv-orl_ has joined #kolla | 00:01 | |
vhosakot | sdake: SamYaple: sbezverk: FYI, I have started working on making heka collect nova_libvirt logs... I got 75% working.. will push once I'm done | 00:03 |
---|---|---|
openstackgerrit | Merged openstack/kolla: Disable deprecated heat plugins. https://review.openstack.org/295078 | 00:03 |
vhosakot | sdake: SamYaple: sbezverk: giving heads up so there is no duplicattion of work :) | 00:03 |
sdake | vhosakot yup sbez is working on horion only | 00:04 |
SamYaple | vhosakot: sounds great | 00:04 |
*** salv-orlando has quit IRC | 00:04 | |
openstackgerrit | Sam Yaple proposed openstack/kolla: Disable deprecated heat plugins. https://review.openstack.org/295578 | 00:04 |
*** salv-orl_ has quit IRC | 00:04 | |
vhosakot | sdake: cool... i saw his patch set mounts kolla_logs when starting horizon container... is sbezverk working on making heka collect horiozon logs as well.. or, I can do it (I got control on heka now after some digging/hacking) | 00:05 |
vhosakot | sbezverk: may be it is a Q for you :) | 00:05 |
SamYaple | sdake: are you going to rereview https://review.openstack.org/#/c/295562/ ? otherwise we are still testing master code | 00:11 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: iscsi container with lvm2 support https://review.openstack.org/291285 | 00:11 |
SiRiuS_ | Do I need to file another bug&fix for the wi-fi issue for kolla-mesos ? | 00:12 |
sdake | docs dont need bugs | 00:12 |
SiRiuS_ | sdake, I'm talking about fixing the Vagrantfile, for vagrant deployments | 00:13 |
sbezverk | vhosakot shoot | 00:13 |
vhosakot | sbezverk: o/ | 00:13 |
SamYaple | sdake: branching commits dont need bugs | 00:13 |
sdake | SiRiuS_ oh right yes | 00:13 |
SamYaple | that is pointless overhead | 00:13 |
sdake | id like bugs in the branches | 00:13 |
SamYaple | that is pointless overhead | 00:14 |
sdake | when we release point releases people want a list of bugs | 00:14 |
SamYaple | this is not a bug. and thats what reno is for | 00:14 |
sdake | agree | 00:15 |
sdake | was just typing reno solves this | 00:15 |
sdake | but reno is not in mitaka | 00:15 |
SamYaple | im not filing a bug for this | 00:15 |
SamYaple | where was your bug for gitreview? | 00:15 |
SamYaple | bugs make no sense here | 00:15 |
sdake | which one are ou talking about sam | 00:15 |
SamYaple | the first commit to the branch | 00:15 |
sdake | no i mean yur commit | 00:15 |
sdake | which one is the problem | 00:15 |
SamYaple | literally no other prijects do this sdake | 00:16 |
sdake | which patch | 00:16 |
sdake | i filed a bug for the rdo chanage | 00:17 |
SamYaple | sdake: https://review.openstack.org/#/c/295562/ | 00:17 |
SamYaple | no other project files a bug for these things | 00:17 |
SamYaple | its crazy to submit people to that overhead | 00:17 |
sdake | i want backports to be painful ;) | 00:17 |
SamYaple | this isnt a backport | 00:18 |
sdake | if you want to use trivialfix go ahead, but please fill us in in the commit message with more detail | 00:18 |
SamYaple | what more detail do you want? this is a very straight forward patch | 00:19 |
sdake | SiRiuS_ has written the best commit message i've seen in 6 months ;) | 00:19 |
sdake | I wish all our commit mesages were like that | 00:19 |
SamYaple | i can find 50 like it that have less detail | 00:19 |
sdake | yes but as i just said i dont like that our commit messagese lack detail | 00:19 |
SamYaple | this needs no more detail | 00:19 |
sdake | This should be the first commit in stable/mitaka | 00:20 |
sdake | ^^ not suitable imo | 00:20 |
SamYaple | please lets follow how literally every other project handles branching | 00:20 |
SamYaple | oh i can remove it. youll have no body in the message | 00:20 |
sdake | something like "Change all master http urls to the release candidate urls | 00:20 |
sdake | would wfm | 00:20 |
SamYaple | thats not true though | 00:20 |
SamYaple | its not accurate | 00:20 |
sdake | can you make it accurate? | 00:21 |
SamYaple | yea sure. ill leave the title as is | 00:21 |
sdake | wfm | 00:21 |
ccesario | horizon image it was changed !? | 00:21 |
sdake | ccesario what do you mean | 00:21 |
openstackgerrit | Sam Yaple proposed openstack/kolla: Update version pins for mitaka https://review.openstack.org/295562 | 00:21 |
SamYaple | ccesario: you saw before we just branched stable/mitaka yes? | 00:21 |
ccesario | yes yes.... since two hours ago ... hehehe master branch | 00:22 |
ccesario | ahhhh horizon logs changes :) | 00:22 |
ccesario | time to rebuild :P | 00:23 |
SamYaple | sdake: come hell or high water we need to push a 2.0.0 tag | 00:23 |
SamYaple | should be better now that registry is fixed | 00:23 |
SamYaple | we can do it from a house | 00:23 |
sdake | yup now that i have gige both ways its easy to do so | 00:23 |
SamYaple | you can do centos-s* one, ill do ubuntu-source, sound like a plan? | 00:24 |
SamYaple | so remember we talked about versioning a while back, we push 2.0.0-1 and the ntest | 00:25 |
SamYaple | if it works we add addtional 2.0.0 tag | 00:25 |
SamYaple | if not the n2.0.0-2 | 00:25 |
SamYaple | right? | 00:25 |
*** aginwala has joined #kolla | 00:35 | |
*** ssurana has quit IRC | 00:37 | |
*** dwalsh has quit IRC | 00:38 | |
*** alisonh has quit IRC | 00:47 | |
sbezverk | can you ping me tomorrow I need to leave asap. | 00:48 |
sbezverk | vhosakot | 00:48 |
vhosakot | sbezverk: hi | 00:48 |
vhosakot | sbezverk: cool, lets talk tomorrow | 00:48 |
sdake | SamYaple sounds good | 00:49 |
sdake | i think whatever we do with pushing needs a script in the master repo | 00:50 |
sdake | so its consistently done | 00:50 |
SamYaple | well thats where teh automated builds come in | 00:50 |
SamYaple | we can have a script to trigger those | 00:51 |
SamYaple | that would work best IMO | 00:51 |
*** alisonh has joined #kolla | 00:51 | |
*** banix has joined #kolla | 00:57 | |
*** dims has joined #kolla | 00:57 | |
*** sdake has quit IRC | 01:06 | |
*** sdake has joined #kolla | 01:08 | |
*** salv-orlando has joined #kolla | 01:10 | |
*** Jeffrey4l__ has quit IRC | 01:11 | |
*** sdake_ has joined #kolla | 01:11 | |
openstackgerrit | Andrei-Lucian Șerb proposed openstack/kolla-mesos: Attach external NIC to a NAT-Network if on Wi-Fi https://review.openstack.org/295584 | 01:14 |
*** sdake has quit IRC | 01:14 | |
*** weiyu has joined #kolla | 01:18 | |
sdake_ | SamYaple re automated builds, docker doesn't have deps in its ubild system does it? | 01:18 |
SamYaple | deps how? | 01:19 |
SamYaple | we can trigger off of other build triggers | 01:19 |
sdake_ | as in build bse then openstack-base | 01:19 |
sdake_ | ok well that might be feasible but i don't want to try to tackle that right for2.0 | 01:19 |
sdake_ | i'd prefer something simple like build.py with a wrapper shell | 01:19 |
*** salv-orlando has quit IRC | 01:26 | |
*** salv-orlando has joined #kolla | 01:28 | |
*** banix has quit IRC | 01:30 | |
*** Liuqing has joined #kolla | 01:33 | |
*** aginwala has quit IRC | 01:35 | |
*** aginwala has joined #kolla | 01:35 | |
*** ccesario_ has joined #kolla | 01:36 | |
*** salv-orlando has quit IRC | 01:43 | |
SamYaple | mandre: mind acking https://review.openstack.org/#/c/295562/ ? | 01:43 |
SamYaple | mandre: we have a stable/mitaka now! | 01:44 |
mandre | hey SamYaple ;) | 01:44 |
SamYaple | nice gertty patch | 01:44 |
SamYaple | should be useful | 01:44 |
SamYaple | regexs checkd out | 01:45 |
mandre | yeah, strange nobody did it before | 01:46 |
mandre | did you generate using version_check.py? | 01:46 |
SamYaple | mandre: yes | 01:47 |
SamYaple | i fixed it all up to be dynamic! | 01:47 |
mandre | sweet | 01:47 |
SamYaple | the tool iteself still needs a facelift | 01:48 |
SamYaple | should be a super easy refactor though | 01:48 |
SamYaple | all the hard work is done | 01:48 |
SamYaple | its mostly just porper varibles without globals now | 01:48 |
mandre | someone proposed to pick the versions from https://github.com/openstack/releases/tree/master/deliverables | 01:49 |
SamYaple | yea i saw a bug on that | 01:49 |
mandre | let me check what you did | 01:49 |
SamYaple | not to stoked on that idea to be honest | 01:49 |
SamYaple | im parsing what we actually build | 01:49 |
*** vishwanathj has quit IRC | 01:50 | |
openstackgerrit | Merged openstack/kolla: Update version pins for mitaka https://review.openstack.org/295562 | 01:54 |
*** Marga_ has quit IRC | 01:55 | |
*** tfukushima has joined #kolla | 01:58 | |
mandre | the version checker will now always pick the latest available version, no? we can't stick to a given release anymore | 01:58 |
SamYaple | mandre: no | 01:58 |
SamYaple | it shouldnt | 01:58 |
SamYaple | unless i messed up the patch | 01:59 |
SamYaple | i added in major version parsing | 01:59 |
SamYaple | based on the series number listed in our configs | 01:59 |
mandre | that's what I'm looking at: https://github.com/openstack/kolla/commit/7982ff0c77d5eee4a7f694e5a05013b2d26b2d86 | 01:59 |
SamYaple | ah yea i bungled it mandre. let me add that back in (this got rebased around like 50 times) | 01:59 |
SamYaple | oh no its still there mandre | 02:00 |
SamYaple | mandre: https://github.com/openstack/kolla/commit/7982ff0c77d5eee4a7f694e5a05013b2d26b2d86#diff-faec603bcd498ca31853851ce0ac4084R51 | 02:00 |
*** aginwala has quit IRC | 02:02 | |
SamYaple | that line shows it will only look for matches within that series | 02:02 |
mandre | I see, we assume our local version have the correct major version number | 02:02 |
SamYaple | splits '8.0.0.0rc1' into '8' | 02:02 |
SamYaple | well, yea | 02:02 |
SamYaple | thats a safe assumption i think | 02:02 |
mandre | yeah, it's good enough | 02:02 |
mandre | won't we have issues with projects with independent release model, though? | 02:05 |
*** vishwanathj has joined #kolla | 02:05 | |
SamYaple | how so? | 02:06 |
SamYaple | like swift? | 02:06 |
mandre | yeah, if they release a major version in the middle of the cycle, the tool won't pick it | 02:08 |
mandre | but yeah... I guess we'll know about it | 02:08 |
SamYaple | hmm yea thats a good point | 02:09 |
SamYaple | but the question is _how_ robust do we want this tool, or is it good enough? | 02:09 |
SamYaple | i dont think anyone block good code, just code churn | 02:09 |
mandre | pulling versions from the releases repo, we don't have to think about it anymore | 02:11 |
mandre | just change the release name in each of our branches | 02:11 |
mandre | I think the tool is good enough now, it does the job | 02:12 |
*** jasonsb has joined #kolla | 02:15 | |
*** aginwala has joined #kolla | 02:15 | |
*** SiRiuS_ has quit IRC | 02:17 | |
*** iceyao has joined #kolla | 02:18 | |
*** unicell has quit IRC | 02:20 | |
*** dims has quit IRC | 02:28 | |
*** Marga_ has joined #kolla | 02:28 | |
*** rhallisey has quit IRC | 02:33 | |
*** Marga_ has quit IRC | 02:33 | |
*** salv-orlando has joined #kolla | 02:39 | |
*** aginwala has quit IRC | 02:44 | |
*** unicell has joined #kolla | 02:45 | |
*** iceyao has quit IRC | 02:45 | |
*** iceyao has joined #kolla | 02:46 | |
*** vishwana_ has joined #kolla | 02:47 | |
*** klint has joined #kolla | 02:48 | |
*** vishwana_ is now known as vishwanathj__ | 02:48 | |
*** salv-orlando has quit IRC | 02:50 | |
*** vishwanathj has quit IRC | 02:50 | |
*** tfukushima has quit IRC | 02:52 | |
*** vishwanathj__ is now known as vishwanathj | 02:53 | |
openstackgerrit | Sam Yaple proposed openstack/kolla: Install proper security libs https://review.openstack.org/295602 | 02:58 |
*** tfukushima has joined #kolla | 02:59 | |
*** ccesario_ has quit IRC | 03:00 | |
openstackgerrit | Vikram Hosakote proposed openstack/kolla: Make heka collect libvirtd.log in nova_libvirt container https://review.openstack.org/295604 | 03:06 |
*** iceyao has quit IRC | 03:06 | |
*** iceyao has joined #kolla | 03:06 | |
sdake_ | SamYaple is that problem with the tls thing a centos problem as well when building from source? | 03:07 |
*** salv-orlando has joined #kolla | 03:07 | |
sdake_ | if you dont know, coudl you put info on how to diagnose it | 03:07 |
sdake_ | so I can double check on my gear | 03:07 |
*** sdake_ is now known as sdake | 03:08 | |
SamYaple | sdake: no i checked centos gate logs | 03:08 |
SamYaple | its just a buildtime issue | 03:08 |
SamYaple | openstakc libs install the right versions | 03:08 |
SamYaple | but somethings get fetched before the security libs get installed | 03:09 |
vhosakot | sdake: SamYaple: patch set to Make heka collect libvirtd.log in nova_libvirt container https://review.openstack.org/295604... done and tested | 03:09 |
vhosakot | sdake: SamYaple: can be backported to Mitaka once merged | 03:09 |
sdake | who is this sdake: SamYaple person you speak of :) | 03:10 |
*** Marga_ has joined #kolla | 03:10 | |
sdake | its like one person ;) | 03:10 |
sdake | vhosakot looks good to me but sam did leave a note in the log about separating out libvirt | 03:10 |
sdake | which i think makes sense | 03:10 |
SamYaple | sdake: we...are....one.... | 03:10 |
vhosakot | ah, cool.... will put in separate container.. cool | 03:10 |
SamYaple | vhosakot: not container, just seperate folder | 03:10 |
*** vishwanathj is now known as vishwanathj_zzz | 03:10 | |
vhosakot | SamYaple: right right.. that's what I meant | 03:11 |
vhosakot | haha... how else can I multicast one message to two people in IRC... I use SamYaple: sdake: <blah> | 03:11 |
sdake | SamYaple apparently :) | 03:11 |
sdake | whatever works | 03:11 |
sdake | you can jsut say it in the channel | 03:11 |
sdake | and i'll red it when i get done with dinner | 03:12 |
sdake | everytime someone types my name my computer beeps | 03:12 |
vhosakot | cool | 03:12 |
vhosakot | sdake: can't believe Mitaka is history on Github | 03:12 |
sdake | but thanks :) | 03:12 |
sdake | how do you mean histroy | 03:12 |
sdake | vhosakot you have taken well to kolla | 03:12 |
sdake | need more cisco cats ;) | 03:13 |
vhosakot | I mean it shows up in the dropdown "Branch"... | 03:13 |
vhosakot | haha thanks... I'm just doing what I like most.. | 03:13 |
vhosakot | :) | 03:13 |
sdake | oh right - tags are history though branches aren't really history | 03:13 |
sdake | tags sshow up as releases | 03:13 |
vhosakot | yeah yeah I mean tags.. right | 03:14 |
sdake | pretty sure i'm going to tag rc2 this week rather then next | 03:14 |
vhosakot | Newest tag must be top/first... but the list is alphabetical.. and Mitaka is last after stable/Liberty | 03:14 |
sdake | to help tidy up the tracker | 03:14 |
*** Marga_ has quit IRC | 03:14 | |
*** mdnadeem has joined #kolla | 03:15 | |
sdake | i didn't hear complaining on the thread i sent out | 03:15 |
mdnadeem | @all: Can some one review it https://review.openstack.org/#/c/288248/ | 03:15 |
sdake | we are blocked from releasing mitaka as well because of rdo | 03:16 |
sdake | same deal as upstream tarballs | 03:16 |
SamYaple | and while we probably wont wait on cloud-archive... we od have to make sure cloud archive works | 03:16 |
*** ccesario_ has joined #kolla | 03:17 | |
sdake | mdnadeem i would review but i don't like necromancing reviews that I haven't been involved with the entire time | 03:17 |
sdake | but if needed I will do so | 03:17 |
sdake | i dont think people have been very active on the lvm iscsi review either | 03:17 |
*** unicell has quit IRC | 03:18 | |
*** unicell1 has joined #kolla | 03:18 | |
*** aginwala has joined #kolla | 03:19 | |
sdake | bbiaf finishing dinner | 03:19 |
SamYaple | sdake: we have been | 03:19 |
SamYaple | lots of activety | 03:19 |
*** phuongnh has joined #kolla | 03:21 | |
*** aginwala has quit IRC | 03:23 | |
*** salv-orlando has quit IRC | 03:24 | |
asalkeld | sdake: i have made https://github.com/openstack/kolla-mesos/tree/stable/mitaka and https://github.com/openstack/kolla-mesos/releases/tag/2.0.0.0rc1 | 03:24 |
*** coolsvap has joined #kolla | 03:27 | |
*** yuanying has quit IRC | 03:28 | |
*** ayoung has quit IRC | 03:29 | |
*** Marga_ has joined #kolla | 03:31 | |
*** Marga_ has quit IRC | 03:35 | |
*** yuanying has joined #kolla | 03:38 | |
*** tfukushima has quit IRC | 03:41 | |
*** tfukushima has joined #kolla | 03:42 | |
*** achanda has quit IRC | 03:43 | |
*** SamYaple is now known as contributed_this | 03:47 | |
*** contributed_this is now known as SamYaple | 03:48 | |
*** Marga_ has joined #kolla | 03:52 | |
*** ccesario_ has quit IRC | 03:53 | |
*** ccesario_ has joined #kolla | 03:55 | |
sdake | wars make one not great | 03:56 |
openstackgerrit | Sam Yaple proposed openstack/kolla: Install proper security libs https://review.openstack.org/295602 | 04:01 |
*** Marga_ has quit IRC | 04:01 | |
*** Marga_ has joined #kolla | 04:01 | |
sdake | SamYaple what do you mke of this http://logs.openstack.org/49/295549/1/check/gate-kolla-dsvm-deploy-centos-binary/9efb05e/console.html#_2016-03-21_22_56_15_963 | 04:03 |
sdake | this is from my introduction of the centos rdo binary | 04:04 |
*** yuanying has quit IRC | 04:04 | |
*** yuanying has joined #kolla | 04:06 | |
SamYaple | sdake: i think you need to merge it with you 295549 patch and squash them | 04:09 |
sdake | you mean the revert patch? | 04:09 |
SamYaple | yup | 04:09 |
sdake | that patch i linked has already merged i think | 04:09 |
SamYaple | the mitaka branch has newer stuff than master | 04:09 |
SamYaple | yea i think you just need to get that revert out of WIP | 04:09 |
SamYaple | i told you the keystone is bumped past the commit in question in centos7-mitaka | 04:10 |
SamYaple | i looked it up already | 04:10 |
openstackgerrit | Steven Dake proposed openstack/kolla: Revert "Install master's version of an RDO keystone" https://review.openstack.org/295552 | 04:12 |
*** weiyu has quit IRC | 04:15 | |
*** salv-orlando has joined #kolla | 04:23 | |
openstackgerrit | Vikram Hosakote proposed openstack/kolla: Make heka collect libvirtd.log in nova_libvirt container https://review.openstack.org/295604 | 04:27 |
*** salv-orlando has quit IRC | 04:30 | |
*** salv-orlando has joined #kolla | 04:32 | |
*** achanda has joined #kolla | 04:32 | |
*** tfukushima has quit IRC | 04:32 | |
*** daneyon_ has quit IRC | 04:42 | |
*** daneyon has joined #kolla | 04:43 | |
*** salv-orlando has quit IRC | 04:52 | |
*** vhosakot has quit IRC | 04:57 | |
*** daneyon has quit IRC | 04:57 | |
*** salv-orlando has joined #kolla | 04:59 | |
*** dave-mccowan has quit IRC | 05:03 | |
*** salv-orl_ has joined #kolla | 05:04 | |
*** salv-orl_ has quit IRC | 05:06 | |
sdake | SamYaple ping | 05:07 |
*** salv-orlando has quit IRC | 05:09 | |
*** tfukushima has joined #kolla | 05:14 | |
*** weiyu has joined #kolla | 05:34 | |
*** weiyu has quit IRC | 05:51 | |
*** achanda has quit IRC | 05:55 | |
*** aginwala has joined #kolla | 06:03 | |
*** salv-orlando has joined #kolla | 06:07 | |
*** weiyu has joined #kolla | 06:08 | |
*** salv-orlando has quit IRC | 06:24 | |
*** salv-orlando has joined #kolla | 06:35 | |
*** kjelly has joined #kolla | 06:36 | |
*** salv-orlando has quit IRC | 06:41 | |
*** coolsvap has quit IRC | 06:49 | |
*** coolsvap has joined #kolla | 06:49 | |
openstackgerrit | Merged openstack/kolla: Revert "Install master's version of an RDO keystone" https://review.openstack.org/295552 | 06:54 |
*** aginwala has quit IRC | 07:07 | |
sdake | bedtime | 07:11 |
sdake | later | 07:11 |
*** mikelk has joined #kolla | 07:11 | |
*** sdake has quit IRC | 07:29 | |
*** salv-orlando has joined #kolla | 07:46 | |
*** salv-orlando has quit IRC | 07:48 | |
*** Kennan has quit IRC | 07:53 | |
*** salv-orlando has joined #kolla | 07:53 | |
*** Kennan has joined #kolla | 07:53 | |
*** salv-orlando has quit IRC | 07:59 | |
*** salv-orlando has joined #kolla | 08:03 | |
*** stvnoyes has quit IRC | 08:05 | |
*** stvnoyes has joined #kolla | 08:06 | |
*** tfukushima has quit IRC | 08:11 | |
*** salv-orlando has quit IRC | 08:14 | |
*** salv-orlando has joined #kolla | 08:16 | |
*** tfukushima has joined #kolla | 08:16 | |
*** athomas has joined #kolla | 08:23 | |
*** salv-orlando has quit IRC | 08:25 | |
openstackgerrit | Kuo-tung Kao proposed openstack/kolla: add unit tests for build script https://review.openstack.org/290423 | 08:30 |
*** openstackgerrit has quit IRC | 08:33 | |
*** openstackgerrit has joined #kolla | 08:33 | |
*** jmccarthy has quit IRC | 08:48 | |
*** jmccarthy has joined #kolla | 08:49 | |
*** Serlex has joined #kolla | 08:59 | |
*** achanda has joined #kolla | 09:02 | |
*** mbound has joined #kolla | 09:02 | |
*** achanda has quit IRC | 09:02 | |
*** mgoddard has joined #kolla | 09:03 | |
*** kproskurin has joined #kolla | 09:03 | |
*** gfidente has joined #kolla | 09:05 | |
*** shardy has joined #kolla | 09:17 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Add Ubuntu binary build and deploy gate https://review.openstack.org/292930 | 09:19 |
*** salv-orlando has joined #kolla | 09:22 | |
*** ccesario_ has quit IRC | 09:29 | |
*** akwasnie has joined #kolla | 09:32 | |
*** athomas has quit IRC | 09:36 | |
*** Jeffrey4l has joined #kolla | 09:37 | |
*** salv-orlando has quit IRC | 09:39 | |
*** athomas has joined #kolla | 09:41 | |
*** kproskurin_ has joined #kolla | 09:46 | |
*** kproskurin has quit IRC | 09:48 | |
*** kproskurin_ is now known as kproskurin | 09:48 | |
*** dims has joined #kolla | 09:51 | |
*** akwasnie has quit IRC | 09:52 | |
*** asalkeld_ has joined #kolla | 09:56 | |
*** asalkeld has quit IRC | 09:56 | |
*** asalkeld_ is now known as asalkeld | 09:56 | |
*** Liuqing has quit IRC | 09:59 | |
*** iceyao has quit IRC | 10:00 | |
*** dims has quit IRC | 10:04 | |
*** dims has joined #kolla | 10:12 | |
*** pbourke has quit IRC | 10:14 | |
*** pbourke has joined #kolla | 10:15 | |
*** SiRiuS_ has joined #kolla | 10:23 | |
*** achanda has joined #kolla | 10:31 | |
*** achanda has quit IRC | 10:31 | |
*** kproskurin has quit IRC | 10:32 | |
*** salv-orlando has joined #kolla | 10:33 | |
*** weiyu has quit IRC | 10:41 | |
*** weiyu_ has joined #kolla | 10:43 | |
*** kproskurin has joined #kolla | 10:46 | |
*** weiyu_ has quit IRC | 10:48 | |
*** jtriley has joined #kolla | 10:52 | |
*** akwasnie has joined #kolla | 10:53 | |
*** weiyu has joined #kolla | 10:54 | |
*** jtriley has quit IRC | 10:57 | |
*** weiyu has quit IRC | 10:58 | |
akwasnie | SamYaple hi | 10:58 |
*** Liuqing has joined #kolla | 11:01 | |
*** weiyu_ has joined #kolla | 11:02 | |
*** TheBall has quit IRC | 11:03 | |
*** tfukushima has quit IRC | 11:03 | |
*** weiyu_ has quit IRC | 11:03 | |
*** dwalsh has joined #kolla | 11:03 | |
akwasnie | SamYaple: I did not get bored:) please ask everything you need:) Generally you should have kibana, elasticsearch and heka containers up and running - then you access kibana on port 5601, you should be able to create default index pattern in settings tab ( log-*, check index contains time-based events, do not check use events times, time-field name use Timestamp). After creating it you can discover logs (discover tab). If you can't see anythin | 11:07 |
*** Liuqing has quit IRC | 11:07 | |
*** weiyu_ has joined #kolla | 11:07 | |
*** Liuqing has joined #kolla | 11:08 | |
*** phuongnh has quit IRC | 11:10 | |
*** weiyu_ has quit IRC | 11:14 | |
*** TheBall has joined #kolla | 11:15 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: Changes horizon log location to kolla_logs volume https://review.openstack.org/295568 | 11:32 |
*** mlima has joined #kolla | 11:33 | |
*** TheBall is now known as The_Ball | 11:39 | |
*** iceyao has joined #kolla | 11:42 | |
*** dencaval has joined #kolla | 11:42 | |
SiRiuS_ | asalkeld, ping | 11:43 |
asalkeld | Hi SiRiuS_ | 11:47 |
* asalkeld typing on phone... | 11:47 | |
SiRiuS_ | asalkeld, I submitted a patch for a bug that was present in both kolla and kolla-mesos. | 11:48 |
asalkeld | Ok | 11:48 |
SiRiuS_ | asalkeld, The one for kolla was already merged | 11:48 |
SiRiuS_ | asalkeld, It's about the the wi-fi issues | 11:48 |
asalkeld | I'll review it in the morning nearly 10pm here | 11:48 |
SiRiuS_ | asalkeld, oh, ok :) | 11:49 |
asalkeld | Ask nihilifer if it's urgent | 11:49 |
asalkeld | He is in the EU | 11:49 |
SiRiuS_ | asalkeld, ok, thanks | 11:50 |
openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/kolla: Fix retrieving api_interface https://review.openstack.org/289241 | 11:56 |
*** rhallisey has joined #kolla | 11:57 | |
*** salv-orl_ has joined #kolla | 12:01 | |
*** salv-orlando has quit IRC | 12:05 | |
*** kjelly has quit IRC | 12:05 | |
openstackgerrit | Merged openstack/kolla: Disable deprecated heat plugins. https://review.openstack.org/295578 | 12:05 |
*** kjelly has joined #kolla | 12:06 | |
*** Liuqing has quit IRC | 12:09 | |
*** alyson_ has joined #kolla | 12:10 | |
*** Liuqing has joined #kolla | 12:11 | |
*** Liuqing has quit IRC | 12:14 | |
*** Liuqing has joined #kolla | 12:15 | |
*** dave-mccowan has joined #kolla | 12:22 | |
ccesario | morning! | 12:29 |
openstackgerrit | Paul Bourke proposed openstack/kolla: Check relevant logging mechanism in the gate https://review.openstack.org/295758 | 12:31 |
*** akwasnie has quit IRC | 12:36 | |
openstackgerrit | Kuo-tung Kao proposed openstack/kolla: add unit tests for build script https://review.openstack.org/290423 | 12:37 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: Changes horizon log location to kolla_logs volume https://review.openstack.org/295568 | 12:44 |
*** akwasnie has joined #kolla | 12:45 | |
*** mlima has quit IRC | 12:50 | |
*** sbezverk has quit IRC | 12:50 | |
*** sbezverk has joined #kolla | 12:50 | |
*** jtriley has joined #kolla | 12:53 | |
*** vhosakot has joined #kolla | 12:54 | |
*** jtriley has quit IRC | 12:59 | |
*** klint has quit IRC | 12:59 | |
*** dims_ has joined #kolla | 13:02 | |
*** dims has quit IRC | 13:02 | |
*** jtriley has joined #kolla | 13:04 | |
*** jtriley has quit IRC | 13:09 | |
*** ayoung has joined #kolla | 13:11 | |
SamYaple | akwasnie: its running, i just dont know how to use it is all | 13:12 |
SamYaple | akwasnie: i can wait for your talk if needed! | 13:12 |
*** chopmann has joined #kolla | 13:16 | |
openstackgerrit | Carlos Cesario proposed openstack/kolla: Added note about nested environment https://review.openstack.org/295389 | 13:21 |
openstackgerrit | Merged openstack/kolla: Make heka collect libvirtd.log in nova_libvirt container https://review.openstack.org/295604 | 13:22 |
vhosakot | ^^^ thanks for the reviews | 13:23 |
*** Jeffrey4l has quit IRC | 13:25 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: iscsi container with lvm2 support https://review.openstack.org/291285 | 13:25 |
SamYaple | so question for the channel. shouldnt keystone be logging to /var/log/kolla/KEYSTONE/* rather than /var/log/kolla/apache2? | 13:26 |
SamYaple | we have conflicts for this horizon service also using apache2 | 13:26 |
sbezverk | Good morning | 13:26 |
SamYaple | morning sbezverk | 13:27 |
sbezverk | SamYaple I addressed your comments, appreciate if you could check when you have time.. | 13:27 |
SamYaple | sbezverk: already done | 13:30 |
*** mlima has joined #kolla | 13:30 | |
sbezverk | SamYaple ok thank you, will bring back 'vi' ;-) | 13:32 |
SamYaple | oh i picked up on the 'i' | 13:33 |
vhosakot | SamYaple: yes, keystone log should go to /var/log/kolla/keystone.. | 13:34 |
vhosakot | SamYaple: horizon log can go into /var/log/kolla/horizon... | 13:34 |
*** kproskurin has quit IRC | 13:34 | |
vhosakot | that way, every service will have a separate directory and they won;t fight for a directory :) | 13:34 |
sbezverk | vhosakot hi | 13:35 |
SamYaple | vhosakot: i agree with that. can you file a bug for keystone and target it to series mitaka and newton so we can backport that before rc2 | 13:35 |
vhosakot | sbezverk: hi... | 13:35 |
SamYaple | if you can handle that task as well i would greatly appreciate it | 13:35 |
sbezverk | I think horizon change is failing because horizon is not enabled on gate | 13:35 |
sbezverk | so that heka config file does not get copied | 13:36 |
vhosakot | SamYaple: sure, I can... so, this bug is making heka collect keystone logs ? | 13:36 |
SamYaple | vhosakot: no its, "heka logs keystone to generic folder" | 13:36 |
SamYaple | target it at newton and mitaka | 13:36 |
vhosakot | ah, got it... will work on it.. cool | 13:36 |
vhosakot | sbezverk: SamYaple: should enable_horion be added to gate vm's globals.yml ? | 13:37 |
sbezverk | vhosakot would you agree with the reason for horizon gate failure then? | 13:37 |
vhosakot | sbezverk: don't know... still need to dig... | 13:38 |
SamYaple | vhosakot: sbezverk no | 13:38 |
vhosakot | why isn't the heka bootstrap container starting ? http://logs.openstack.org/68/295568/3/check/gate-kolla-dsvm-deploy-centos-binary/bd63a83/console.html#_2016-03-22_13_03_00_009 | 13:38 |
SamYaple | sbezverk: its failing because the horizon.toml wasnt copied over | 13:39 |
elemoine_ | there are keystone logs in /var/log/kolla/keystone and in /var/log/kolla/apache2/ | 13:39 |
elemoine_ | with different information | 13:40 |
vhosakot | sbezverk: I will dig the logs and let you know if I find anything | 13:40 |
SamYaple | elemoine_: we have apache2 for horizon also | 13:40 |
SamYaple | elemoine_: were going to collapse that info into one folder | 13:40 |
elemoine_ | IIRC the keystone apache logs are in keystone-specific files | 13:41 |
elemoine_ | SamYaple: https://github.com/openstack/kolla/blob/master/ansible/roles/keystone/templates/wsgi-keystone.conf.j2#L17 | 13:41 |
elemoine_ | the name of the log file is keystone-apache-public-access.log | 13:42 |
SamYaple | elemoine_: i didnt say they conflicted, but it doesnt make sense to seperate them | 13:42 |
SamYaple | horizon and keystone logs dont need to intermingle | 13:42 |
*** vhosakot has quit IRC | 13:44 | |
*** jtriley has joined #kolla | 13:44 | |
elemoine_ | why not separating them? what does not make sense in separating them? | 13:44 |
SamYaple | elemoine_: if i want to watch all the keystone logs, can i do that easily? | 13:45 |
SamYaple | tail -f *? | 13:45 |
SamYaple | thats how most ops i know do it | 13:45 |
SamYaple | sperating them and _then_ have horizon and keystone log to related folders its not really intutive | 13:45 |
SamYaple | it might make sense, if they were the same apache process... maybe | 13:46 |
SamYaple | but other wise there is no logical reason to group them | 13:46 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: [WIP] Fix OpenStack services registration https://review.openstack.org/291251 | 13:47 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Encode the ifname before passing to struct https://review.openstack.org/295829 | 13:47 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Fix string parameter in mesos-dns.conf https://review.openstack.org/295830 | 13:47 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Parse and render yaml files in the proper order https://review.openstack.org/295831 | 13:47 |
SamYaple | push those patches nihilifer | 13:47 |
nihilifer | ? | 13:48 |
SamYaple | i just got like 4 pings and it was all your patches | 13:49 |
SamYaple | i need to ignore openstackgerrit | 13:49 |
nihilifer | ah, sorry, but i'm doing that every day from months | 13:49 |
nihilifer | ;) | 13:49 |
Serlex | SamYaple, do you know if your bug #1520728 applies to multople services | 13:49 |
openstack | bug 1520728 in kolla newton "fatal: [openstack002] => One or more undefined variables: 'dict object' has no attribute 'stdout'" [Critical,Confirmed] https://launchpad.net/bugs/1520728 - Assigned to Sam Yaple (s8m) | 13:49 |
SamYaple | haha its ok nihilifer | 13:49 |
SamYaple | Serlex: let me look at it | 13:49 |
SamYaple | Serlex: it does. it applies to basically every service out there | 13:50 |
Serlex | My install fails at ' Creating Glance database]' 'dict object' has no attribute 'stdout' | 13:50 |
Serlex | oh ok | 13:50 |
SamYaple | Serlex: but that depends on your inventory | 13:50 |
SamYaple | what is your environtory? | 13:50 |
Serlex | AIO install on a virtualbox | 13:51 |
SamYaple | this shouldnt be happening to you then | 13:51 |
SamYaple | thats a multinode specific bug | 13:51 |
Serlex | ok thanks | 13:51 |
Serlex | kk | 13:52 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: Changes horizon log location to kolla_logs volume https://review.openstack.org/295568 | 13:54 |
sbezverk | SamYaple if I could I would prefer to keep cinder_targets volume name, because it clearly identifies what it is used for, with generic name "cinder" it is less obvious.. would you reconsider? | 13:57 |
*** spisarski has joined #kolla | 13:59 | |
*** mgoddard_ has joined #kolla | 13:59 | |
*** jtriley has quit IRC | 13:59 | |
SamYaple | sbezverk: but /var/lib/cinder its not _just_ for cinder_targets | 14:00 |
sbezverk | SamYaple ok | 14:02 |
ccesario | Does someone got error with mariadb deploy (master branch)!? I only had success decreasing the password size in /etc/kolla/passwords.yml .. from 41 chars to 38 chars | 14:02 |
*** mgoddard has quit IRC | 14:03 | |
SamYaple | ccesario: hmmm... no i have not see it | 14:03 |
ccesario | SamYaple, well... I'll clean up and re-test with default configs.... | 14:04 |
mlima | SamYaple, which service is deployed first, haproxy or mariadb? | 14:05 |
SamYaple | mlima: haproxy first | 14:05 |
mlima | hmm... | 14:06 |
SamYaple | whats up? | 14:06 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: iscsi container with lvm2 support https://review.openstack.org/291285 | 14:07 |
*** inc0 has joined #kolla | 14:07 | |
inc0 | good morning | 14:08 |
SamYaple | sbezverk: a few more comments. later today ill do a full review of the patchset again | 14:09 |
SamYaple | inc0: moring! | 14:09 |
*** achanda has joined #kolla | 14:09 | |
*** achanda has quit IRC | 14:10 | |
*** inc0 has quit IRC | 14:18 | |
*** dims_ has quit IRC | 14:19 | |
*** inc0 has joined #kolla | 14:20 | |
*** achanda has joined #kolla | 14:23 | |
*** jtriley has joined #kolla | 14:27 | |
*** jasonsb has quit IRC | 14:30 | |
*** jasonsb has joined #kolla | 14:31 | |
*** openstackgerrit has quit IRC | 14:33 | |
*** openstackgerrit has joined #kolla | 14:34 | |
ccesario | SamYaple, https://github.com/spunkzwy/kolla/commit/e2932d225501f3c924104b7fa84bba2eeca493a8 is it a valid solution for bug #1520728 ?? | 14:39 |
openstack | bug 1520728 in kolla newton "fatal: [openstack002] => One or more undefined variables: 'dict object' has no attribute 'stdout'" [Critical,Confirmed] https://launchpad.net/bugs/1520728 - Assigned to Sam Yaple (s8m) | 14:39 |
SamYaple | ccesario: no. deletegate too is needed | 14:39 |
SamYaple | ccesario: thats an ansible bug | 14:40 |
ccesario | hmmmm, right | 14:40 |
*** achanda has quit IRC | 14:43 | |
*** absubram has joined #kolla | 14:46 | |
openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/kolla: Fix building centos openstack-base https://review.openstack.org/295876 | 14:49 |
*** mgoddard_ has quit IRC | 14:55 | |
*** mgoddard has joined #kolla | 14:55 | |
*** inc0 has quit IRC | 14:58 | |
*** sdake has joined #kolla | 14:58 | |
sdake | morning | 14:58 |
SamYaple | morning sdake | 15:00 |
sdake | hey SamYaple | 15:00 |
*** JoseMello has joined #kolla | 15:01 | |
SamYaple | sdake: i think we need to change to series newton on launchpad to track buggs properly | 15:06 |
SamYaple | then we can properly target to newton or mitaka | 15:06 |
sdake | lemme wake up | 15:06 |
sdake | give me 10-15 mins | 15:06 |
SamYaple | :) | 15:06 |
*** iceyao has quit IRC | 15:07 | |
sdake | i went through and added a rc-packport-potential to easily track which bugs should be backported | 15:07 |
sdake | with the in-mitaka tag, we can verify the backports were actually done | 15:07 |
sdake | i'm not sure if that resolves the problem you raise, bucaue my brain is still booting | 15:07 |
sdake | and i dont know if I mentioned but I am cafeinee free except for dinner | 15:08 |
SamYaple | you did | 15:08 |
sdake | so it takes me a little whiel to gete going | 15:08 |
SamYaple | go drink some water and do some pushups | 15:08 |
SamYaple | this will still be here when you get back | 15:08 |
*** inc0 has joined #kolla | 15:10 | |
*** rmart04 has joined #kolla | 15:14 | |
*** achanda has joined #kolla | 15:17 | |
*** inc0 has quit IRC | 15:22 | |
*** inc0 has joined #kolla | 15:22 | |
openstackgerrit | Merged openstack/kolla: Check relevant logging mechanism in the gate https://review.openstack.org/295758 | 15:26 |
*** vishwanathj_zzz is now known as vishwanathj | 15:32 | |
sdake | sweet getting discussion gong on type:deployment | 15:37 |
sdake | SamYaple do you mean the focus of development to newton? | 15:38 |
sdake | if so, I think I agree | 15:38 |
SamYaple | sdake: there is an option in launchpad to switch to newton. i did it for mitaka | 15:38 |
sdake | even though I'd like people focused on Mitaka, I understand the launchpad reasoning you prposed there | 15:38 |
sdake | let me make the change and you can tell me if that is what you want | 15:39 |
SamYaple | well its more a bug thing | 15:39 |
sdake | is that what you mean | 15:40 |
*** Liuqing has quit IRC | 15:40 | |
sdake | sorry check out launchpad | 15:40 |
sdake | and see if it made the changey ou are after | 15:40 |
sdake | I dont htink we neeed to nominate bugs to multiple versions for backports - rcpackportpotential can get us there with in-mitaka | 15:41 |
sdake | we remove one tag and apply another when the backport is complete | 15:41 |
SamYaple | sdake: thats it | 15:41 |
SamYaple | yup | 15:41 |
SamYaple | lets not use commit tags for this | 15:41 |
SamYaple | we talked about this after liberty | 15:41 |
SamYaple | launchpad has this functionality | 15:41 |
SamYaple | sdake: see https://bugs.launchpad.net/kolla/+bug/1554724 | 15:42 |
openstack | Launchpad bug 1554724 in kolla mitaka ""journalctl" command in tools/deploy_aio.sh fails in gate on Ubuntu" [Undecided,In progress] - Assigned to Paul Bourke (pauldbourke) | 15:42 |
sdake | no not ommit tags | 15:44 |
sdake | bug tags | 15:44 |
sdake | commit tags didn't work | 15:44 |
*** dims has joined #kolla | 15:45 | |
sdake | i think that tracking you do there in that bug is overkill | 15:45 |
sdake | i played aroudn with launchpad for about 4 hours last night | 15:46 |
sdake | i think it makes sense if it affects two releases | 15:46 |
sdake | but for master to mitaka backportss overkill | 15:46 |
sdake | check out this page: | 15:47 |
SamYaple | those are two releases | 15:47 |
SamYaple | master is newton now | 15:47 |
SamYaple | the patch is merged in newton | 15:47 |
SamYaple | it is not merged in mitaka | 15:47 |
SamYaple | that tracking is how all other projects work | 15:47 |
sdake | https://bugs.launchpad.net/kolla/+bugs?field.tag=rc-backport-potential | 15:47 |
sdake | heat was starting to use rc-packport-potential when i departed that project | 15:48 |
sdake | I think other projects ue rc-packport-potential to handle thesse end of cycle things | 15:48 |
SamYaple | this is a bug though | 15:48 |
sdake | when asalkeld gets around lets ask him, i think he sorted that out | 15:48 |
sdake | rc-packport-potential = has potential to be backported from the rcs into the stable branch | 15:49 |
sdake | which is basically anything that isn't in stable atm that is in the tracker | 15:49 |
sdake | i'm totaly open to how to use the bug tracker better | 15:49 |
sdake | clearly what we are diong is suboptiaml at this time | 15:50 |
sdake | but other projects use tags to handle theseend of cycle things | 15:50 |
sdake | that way they can easily find them via the above search | 15:50 |
SamYaple | the branch tracking is how most projects do it. even oputside of kolla (aka how to launchpad) | 15:50 |
sdake | i started down that path originally but it seemed overly onerous | 15:50 |
sdake | because we are fixing bugs in rc2, not newton | 15:51 |
sdake | newton hsa already 30 bugs that are targeted for newton not for mitaka | 15:51 |
SamYaple | i dont think its ornerous, but its what we do long term anyway | 15:53 |
SamYaple | why have two methods? | 15:54 |
sdake | do you have an exmaple rc bug where nova or neutron does this? | 15:54 |
sdake | I just want to be consistent where possible with other projects | 15:54 |
sdake | and I can't imagine other projects putting themselves through this pain :) | 15:55 |
*** dims_ has joined #kolla | 15:55 | |
*** dims has quit IRC | 15:55 | |
sdake | a rc-backport-potential tag seems alot more lightweight | 15:55 |
sdake | after backporting, remove the tag - set to in-mitaka, done | 15:55 |
sdake | this could be distributed | 15:55 |
sdake | rather then single backporter | 15:55 |
sdake | here is a nova rc2 bug: https://bugs.launchpad.net/nova/+bug/1557585 | 15:58 |
openstack | Launchpad bug 1557585 in OpenStack Compute (nova) mitaka "Xenapi live-migration does not work at all now" [High,Fix committed] - Assigned to Bob Ball (bob-ball) | 15:58 |
sdake | (release of the 24th) | 15:58 |
sdake | they use something of what you propose | 15:59 |
sdake | but without the newton appilication | 15:59 |
sdake | the main issue is I don't want to muddy up the newton tracker with mitaka bugs | 15:59 |
SamYaple | yea sdake i dont have time to dig into code across projects | 15:59 |
SamYaple | but i dont see the need to introduce tagging when the branch thing is what well need to do log term though | 15:59 |
SamYaple | unless you plan on 100% managing all bugs yourself, most people are still grasping the branch tracking | 16:00 |
SamYaple | plus with branch tracking you get different status for each branch (in progress, fix released, etc) | 16:00 |
sdake | heat doens't even track rcs in their tracker | 16:01 |
sdake | nova uses only newton | 16:01 |
sdake | sorry only mitaka | 16:01 |
sdake | and not newton | 16:01 |
sdake | i get the value of separate tracking per bug | 16:01 |
sdake | I had planned (if you read my email) to 100% handle rc backports for mitaka | 16:02 |
SamYaple | these are bugs | 16:02 |
SamYaple | this is the process for bugs | 16:02 |
SamYaple | if you mean features that different | 16:02 |
sdake | no i mean bugs | 16:02 |
sdake | every project has a different process from what i can tell | 16:02 |
sdake | but nova doesn't track in newton - see above bug | 16:03 |
SamYaple | they havent retargeted | 16:03 |
SamYaple | this is how they do it though. or how they did it with the ceph bug i fixed | 16:03 |
sdake | you mean they haven't created a newton series? | 16:03 |
SamYaple | but either way, this is how launchpad is designed | 16:03 |
sdake | ok, so I'm open to naything that will make everyone's life easier | 16:04 |
sdake | perhaps we should have an agenda item with a 30 minute timebox on this topic at our next irc meeting | 16:04 |
sdake | which is tomorrow so its not like we have to wait a long time | 16:04 |
sdake | and see what the community wants tags or proposing a bug for a branch or both ;) | 16:05 |
sdake | what makes my life easiest is a rc-backport-potential tag, so the bug is not lost in the backporting process | 16:06 |
sdake | but obviously that single threads on me which is not good | 16:06 |
SamYaple | if you use branches properly they literally cannot be lost | 16:06 |
sdake | but i think it could be distributed as well | 16:06 |
sdake | thats the problem, using correctly | 16:06 |
SamYaple | same with tags though | 16:07 |
sdake | people don't triage bugs correctly as is | 16:07 |
SamYaple | as you said that single threads one person | 16:07 |
*** aginwala has joined #kolla | 16:07 | |
SamYaple | hence the need to stick with one way | 16:07 |
SamYaple | not two | 16:07 |
sdake | ok well lets discuss at tomorrows team meeting? | 16:07 |
sdake | i want what the team wants | 16:07 |
*** spisarski has quit IRC | 16:07 | |
SamYaple | sounds like a plan :) | 16:07 |
SamYaple | though we did already agree on branches | 16:07 |
sdake | not what serves me best ;) | 16:07 |
SamYaple | so that will need to be talked about | 16:07 |
*** spisarski has joined #kolla | 16:07 | |
SamYaple | again | 16:07 |
*** phuongnh has joined #kolla | 16:07 | |
sdake | culd you expand what we talked about already | 16:08 |
sdake | I don't have proper conotext there | 16:08 |
SamYaple | it was in a metting | 16:08 |
SamYaple | and you were there | 16:08 |
SamYaple | branches like im saying is what we went with | 16:08 |
SamYaple | instead of backport-potentila tags | 16:08 |
sdake | i'll also consult with ttx and dhellman and see what the general process they think should be used is | 16:11 |
*** aginwala has quit IRC | 16:13 | |
*** vhosakot has joined #kolla | 16:15 | |
*** dwalsh has quit IRC | 16:16 | |
*** dwalsh has joined #kolla | 16:17 | |
sdake | <dims_>sdake : Nova uses the backport potential tag i believe | 16:17 |
sdake | dhellman is out today but dims respnded | 16:17 |
sdake | SamYaple join openstcak-release | 16:17 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: Changes horizon log location to kolla_logs volume https://review.openstack.org/295568 | 16:17 |
*** aginwala has joined #kolla | 16:18 | |
*** dwalsh has quit IRC | 16:19 | |
*** dwalsh has joined #kolla | 16:19 | |
inc0 | soo...what's the result? | 16:20 |
SamYaple | idk but i do know nova does what i said https://bugs.launchpad.net/nova/+bug/1508230 | 16:21 |
openstack | Launchpad bug 1508230 in nova (Ubuntu Wily) "regression in cloning raw image type with ceph" [High,Fix committed] - Assigned to James Page (james-page) | 16:21 |
SamYaple | if its a bug needing a backport they do branches too | 16:21 |
inc0 | I'd suggest to wait for dhellman and do whatever he suggests | 16:21 |
*** sdake has quit IRC | 16:25 | |
*** daneyon has joined #kolla | 16:26 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: iscsi container with lvm2 support https://review.openstack.org/291285 | 16:28 |
*** sdake has joined #kolla | 16:29 | |
*** aginwala has quit IRC | 16:29 | |
*** Jeffrey4l has joined #kolla | 16:30 | |
*** aginwala has joined #kolla | 16:31 | |
*** chopmann has quit IRC | 16:32 | |
*** unicell1 has quit IRC | 16:33 | |
*** mikelk has quit IRC | 16:35 | |
*** dims_ has quit IRC | 16:46 | |
openstackgerrit | Benedikt Trefzer proposed openstack/kolla: Use debian repos for debian base docker image. https://review.openstack.org/288936 | 16:48 |
*** picar has joined #kolla | 16:48 | |
*** jasonsb has quit IRC | 16:48 | |
*** akwasnie has quit IRC | 17:01 | |
*** dims has joined #kolla | 17:02 | |
*** phuongnh has quit IRC | 17:08 | |
*** unicell has joined #kolla | 17:10 | |
*** haplo37 has joined #kolla | 17:11 | |
*** phuongnh has joined #kolla | 17:11 | |
*** dims has quit IRC | 17:13 | |
SamYaple | w00t mtu over 9000! | 17:15 |
SamYaple | got my kolla running with 9000 mtu since all the mtu bugs appear to be worked out in neutron for mitaka | 17:15 |
*** sdake_ has joined #kolla | 17:16 | |
*** sdake has quit IRC | 17:16 | |
vhosakot | nice.. jumbo frames! | 17:16 |
*** aginwala has quit IRC | 17:17 | |
*** aginwala has joined #kolla | 17:18 | |
*** aginwala has quit IRC | 17:20 | |
*** dwalsh has quit IRC | 17:27 | |
*** mbound has quit IRC | 17:27 | |
*** jtriley has quit IRC | 17:28 | |
*** Serlex has left #kolla | 17:28 | |
*** phuongnh has quit IRC | 17:32 | |
*** picar has quit IRC | 17:32 | |
*** mdnadeem has quit IRC | 17:32 | |
gmmaha | hi, could you kindly tell me hwo to restart the neutrin dicjer container? when i try docker restart ia m getting this error. http://paste.openstack.org/show/491490/ | 17:37 |
SamYaple | gmmaha: you should follow the quickstart guide about setting up shared mounts | 17:37 |
SamYaple | gmmaha: what distro? | 17:38 |
gmmaha | SamYaple: ubuntu 14.04 | 17:38 |
gmmaha | SamYaple: dont think i am using shared mounts? or should i be using them | 17:38 |
SamYaple | gmmaha: its a requirement | 17:38 |
SamYaple | its in the quickstart guide, but short answer is `mount --make-shared /run` on your hosts | 17:38 |
*** jtriley has joined #kolla | 17:39 | |
gmmaha | SamYaple: aah ok.. | 17:40 |
*** rmart04 has quit IRC | 17:40 | |
gmmaha | will check the quick start guide.. thansk | 17:40 |
gmmaha | thanks* | 17:40 |
mlima | someone can show any multinode inventory ready to deploy? | 17:44 |
SamYaple | mlima: sure | 17:45 |
SamYaple | mlima: http://yaple.net/2016/03/20/deploying-openstack-mitaka-with-kolla-docker-and-ansible/ | 17:45 |
SamYaple | posted there | 17:46 |
SamYaple | but its all service on 3 nodes, not split up | 17:46 |
mlima | SamYaple, multinode works if I split? | 17:47 |
SamYaple | mlima: yes, but there is that ansible bug | 17:48 |
SamYaple | im testing a hopeful workaround for some of it | 17:48 |
mlima | yeh, i have this bug now | 17:48 |
SamYaple | mlima: it was suggested that we reorder hosts, but i dont think anyone submitted a patch | 17:49 |
mlima | ok SamYaple, i'll try your approach | 17:50 |
mlima | Thank you | 17:50 |
SamYaple | mlima: its reodering hosts in site.yml, not inventory | 17:50 |
SamYaple | im trying to test this split multinode patch now | 17:51 |
mlima | i'll try this approach http://yaple.net/2016/03/20/deploying-openstack-mitaka-with-kolla-docker-and-ansible/ :) | 17:51 |
SamYaple | vhosakot: did you file a bug for keystone-lots-to-apache2? and are you working on the fix? | 17:53 |
vhosakot | SamYaple: no.. filing now... yes, I will work on it.. | 17:53 |
SamYaple | awesome cool just tracking it mentall | 17:54 |
SamYaple | mentally* | 17:54 |
vhosakot | SamYaple: cool, I was planning to submit a patch to reorder hosts in the multinode inventory as well.. are you working on it ? | 17:54 |
SamYaple | vhosakot: there is a patch in the queue for this | 17:55 |
SamYaple | im testing a reorder | 17:55 |
vhosakot | SamYaple: ah ok.. cool | 17:55 |
*** gfidente has quit IRC | 17:55 | |
SamYaple | it does _not_ fix the problem, only ansible 2.0 will | 17:55 |
SamYaple | but it might help the problem | 17:55 |
vhosakot | SamYaple: I will work on keystone logs then... | 17:55 |
vhosakot | SamYaple: right, it is a wrokaround ? | 17:55 |
SamYaple | more or lessa | 17:55 |
vhosakot | cool | 17:55 |
SamYaple | and there are still edge cases we cant fix | 17:55 |
vhosakot | SamYaple: i see | 17:55 |
sdake_ | vhosakot keystone logs has a wip already | 17:59 |
sdake_ | from sbezverk | 17:59 |
vhosakot | sdake_: I thought sbezverk is working on horizon.. right sbezverk ? | 17:59 |
SamYaple | sdake_: i think thats horizon | 17:59 |
sdake_ | oh right | 18:00 |
sdake_ | whts wrong with keystone | 18:00 |
sdake_ | it looks implemented to me in the repo | 18:00 |
SamYaple | its logging to two locations | 18:00 |
SamYaple | kolla/keystone and kolla/apache2 | 18:00 |
sdake_ | is there a bug for that? | 18:00 |
SamYaple | vhosakot: is filing one | 18:00 |
vhosakot | sdake_: yep, filing one... 5 mins | 18:00 |
sdake_ | vhosakot please lnk when done | 18:00 |
vhosakot | sure | 18:01 |
SamYaple | sdake_: mind if i do what you suggest in ML and you check to see if its what you want? | 18:01 |
sdake_ | SamYaple wfm | 18:01 |
SamYaple | cool | 18:01 |
sdake_ | it swhat ttx proposed i think ;) | 18:01 |
sdake_ | i dont care, i just want somethign that works :) | 18:01 |
sdake_ | as in i care, but i dont care how its done ;) | 18:01 |
SamYaple | yea its what i had purposed original, without the specifics of the branch targeting | 18:02 |
*** salv-orlando has joined #kolla | 18:02 | |
SamYaple | and the non-core tagging for rc potential | 18:02 |
SamYaple | i like that | 18:02 |
*** dwalsh has joined #kolla | 18:02 | |
*** coolsvap has quit IRC | 18:04 | |
SamYaple | sdake_: audrey got an ATC for the summit | 18:04 |
SamYaple | so htats cool | 18:04 |
sdake_ | nice | 18:04 |
sdake_ | my wife was too lazy to submit a patch ;) | 18:04 |
SamYaple | lol | 18:04 |
SamYaple | yea | 18:04 |
*** salv-orl_ has quit IRC | 18:05 | |
*** mlima has quit IRC | 18:09 | |
*** dencaval has quit IRC | 18:09 | |
*** akwasnie has joined #kolla | 18:10 | |
*** dwalsh has quit IRC | 18:11 | |
*** aginwala has joined #kolla | 18:11 | |
*** mlima has joined #kolla | 18:13 | |
*** phuongnh has joined #kolla | 18:13 | |
*** aginwala has quit IRC | 18:15 | |
*** dencaval has joined #kolla | 18:15 | |
*** aginwala has joined #kolla | 18:18 | |
*** mbound has joined #kolla | 18:20 | |
*** sdake_ is now known as sdake | 18:25 | |
*** shardy has quit IRC | 18:32 | |
*** Marga_ has quit IRC | 18:36 | |
vhosakot | SamYaple: I already see keystone.log at /var/log/kolla/keystone/keystone.log inside the keystone container and at /var/lib/docker/volumes/kolla_logs/_data/keystone/keystone.log on the host. So, what is the bug ? | 18:38 |
rhallisey | SamYaple, doing an attempt at multinode.. do I need the kolla_docker module on my nodes? | 18:38 |
SamYaple | vhosakot: apache2 in the keystone container | 18:38 |
SamYaple | rhallisey: no ansible copies it over | 18:38 |
SamYaple | rhallisey: just docker and docker-py | 18:39 |
vhosakot | SamYaple: yes, I see keystone-apache-*.log in /var/log/kolla/apache2/ in keystone container. Should they be moved to /var/log/kolla/keystone/ instead ? | 18:41 |
SamYaple | vhosakot: yes | 18:41 |
vhosakot | SamYaple: and, these keystone-apache-*.log files must also how up in /var/lib/docker/volumes/kolla_logs/_data/keystone/ on the host, right ? | 18:41 |
SamYaple | they will once you move them, yes | 18:41 |
vhosakot | SamYaple: yep, cool.. thanks for the info | 18:42 |
vhosakot | will file bug and start fixing | 18:42 |
*** aginwala has quit IRC | 18:43 | |
g3ek | hello, I have 2 files to transfert to the same container. How can I use the template.json.j2 to transfert two file to the same container? | 18:45 |
*** mbound has quit IRC | 18:46 | |
*** athomas has quit IRC | 18:46 | |
SamYaple | g3ek: at this time kolla has no way to transfer arbitrary files into the container without modifying repo files. if you want ot modify repo files, the strcuture is pretty clear https://github.com/openstack/kolla/blob/master/ansible/roles/glance/templates/glance-api.json.j2 | 18:48 |
SamYaple | source is on the host, dest is in the container | 18:48 |
vhosakot | SamYaple: https://bugs.launchpad.net/kolla/+bug/1560620 | 18:49 |
openstack | Launchpad bug 1560620 in kolla "Move keystone-apache-*.log files to /var/log/kolla/keystone directory in keystone container" [Undecided,In progress] - Assigned to Vikram Hosakote (vhosakot) | 18:49 |
*** chopmann has joined #kolla | 18:50 | |
*** akwasnie1 has joined #kolla | 18:53 | |
*** akwasnie has quit IRC | 18:53 | |
*** aginwala has joined #kolla | 18:55 | |
*** aginwala has quit IRC | 18:57 | |
*** aginwala has joined #kolla | 18:58 | |
sdake | g3ek curiousity mostly which files do you wish to transfer | 18:59 |
sdake | SamYaple looks right assuming vhosakot is going to do the cherrypick ;) | 18:59 |
SamYaple | sdake: cool. then this is what i had in mind. i like it | 19:00 |
vhosakot | sdake: cherry pick what ? the keywton log bug ? | 19:00 |
sdake | vhosakot yup | 19:01 |
sdake | to stable/liberty | 19:01 |
sdake | rather stable/mitaka | 19:01 |
vhosakot | sdake: yeah, I can cherry pick once it ismerged.. cool.. | 19:01 |
vhosakot | what about the libvirt.log patchet that was merged ? should it be backported / cherry picked to Mitaka ? | 19:01 |
SamYaple | vhosakot: i think it landed in mitaka | 19:02 |
*** Marga_ has joined #kolla | 19:02 | |
sdake | vhosakot any bug marked with rc-backport-potential needss a backport at present | 19:02 |
sdake | we may chane all that around depending on the outcome of the team meeting tomorrow | 19:02 |
vhosakot | SamYaple: ah ok.. was it (libvirt.log patch) merged before mitaka was branched ? I will check | 19:03 |
vhosakot | sdake: ah ok cool | 19:03 |
sbezverk | SamYaple thank you for cathcing that damn comma.. | 19:04 |
*** inc0 has quit IRC | 19:04 | |
vhosakot | pesky commas | 19:05 |
*** akwasnie1 has quit IRC | 19:05 | |
*** akwasnie has joined #kolla | 19:06 | |
SamYaple | sbezverk: happened to me in a different patchset | 19:07 |
*** achanda has quit IRC | 19:07 | |
g3ek | sdake: I'm dockerizing our Organisation portal (horizon like) into kolla. So i need to push two file /etc/portal.cfg and /etc/nginx/site-available/portal | 19:08 |
sdake | g3ek ya that is a totally new use case for us | 19:08 |
sdake | first time i've ever heard it mentioned | 19:09 |
sdake | and probably not something we would put in the general code base | 19:09 |
sdake | 'm not sure how it could be made generic either | 19:09 |
g3ek | we know, we need to do it for our own purpose. But we need to have ceilometer, barbican and some more service than you will be interested ^^ | 19:09 |
SamYaple | g3ek: if this is already a branch it should be _very_ easy to make your own json file like i posted for glance | 19:10 |
g3ek | sdake: shibbouleth (keystone federated) too | 19:10 |
SamYaple | does that make sense for yoU? | 19:10 |
SamYaple | g3ek: would love to see a well done federation implementation | 19:10 |
vhosakot | I see the libvirt.log patch set did not land in stable/mitaka... it landed it Newton... I see Mitaka still has old code (https://github.com/openstack/kolla/blob/stable/mitaka/ansible/roles/nova/templates/libvirtd.conf.j2#L5 should have /var/log/kolla/libvirt/libvirtd.log) | 19:10 |
*** inc0 has joined #kolla | 19:11 | |
g3ek | SamYaple, sdake : http://pastebin.com/Qs8qjNHA | 19:11 |
SamYaple | vhosakot: do you see the cherry-pick button? | 19:11 |
SamYaple | vhosakot: push that and do stable/mitaka | 19:11 |
sdake | g3ek there is a ceilometer review that is stalled that needs attention | 19:11 |
vhosakot | SamYaple: ah ok, let me do it... | 19:12 |
sdake | g3ek barbican is a dep of magnum so definately interested there | 19:12 |
openstackgerrit | Vikram Hosakote proposed openstack/kolla: Make heka collect libvirtd.log in nova_libvirt container https://review.openstack.org/296012 | 19:12 |
vhosakot | done... my first kolla cherry | 19:12 |
sdake | ya i do it manually | 19:12 |
sdake | but whatever works ;) | 19:12 |
g3ek | we already integrated shibbouleth and we are working on ceilometer (we need it now, so we will do our own) | 19:13 |
sdake | g3ek recommend taking over the stalled review | 19:14 |
sdake | its neary complete i htink | 19:14 |
sdake | whatis shibbouleth | 19:14 |
g3ek | sdake : will check an eye on it | 19:14 |
g3ek | sdake: to use federation on keystone | 19:14 |
SamYaple | we do not have HA mongodb or ceilometer | 19:14 |
g3ek | sdake: connect multiple cloud together | 19:15 |
sdake | g3ek https://review.openstack.org/#/c/226172/ | 19:15 |
g3ek | we are working on a HA mongodb | 19:15 |
SamYaple | g3ek: would love to see that work upstream in kolla! | 19:15 |
sdake | cool hope to see you share ;) | 19:15 |
sdake | if you have any questions about workflow or git usage feel free to ask | 19:16 |
*** achanda has joined #kolla | 19:16 | |
g3ek | we already speak a bit of that with the direction and they are willing to share with you. It is at our advantage to keep the mostly part of openstack to kolla and just plug our own role/docker to it to have our own kolla version. | 19:16 |
sdake | g3ek the model is people take kolla from upstream and produce downstream products from it | 19:17 |
sdake | its helpful to get all the common bits in upstream though so your rebases are not expensive :) | 19:18 |
sdake | else you could end with variance in the implementation and never be able to rebase | 19:18 |
sdake | and forever own your own fork | 19:18 |
g3ek | exactly | 19:18 |
sdake | which company arey ou at if i may ask g3ek | 19:18 |
g3ek | sdake: me and haplo37 are working for Ormuco : cloud.ormuco.com (still in beta tough) | 19:19 |
sdake | cool | 19:19 |
SamYaple | glad to have you. completely agree with what sdake said | 19:19 |
SamYaple | special sauce is cool if core is upstream :D | 19:19 |
g3ek | yep | 19:19 |
g3ek | Is their a procedure for : How to commit into kolla repo? I just need to create a pull request or their is more? | 19:21 |
sdake | g3ek there is more | 19:21 |
sdake | moment i'll find you link | 19:21 |
g3ek | ok cool | 19:21 |
sdake | g3ek http://docs.openstack.org/infra/manual/developers.html | 19:23 |
sdake | g3ek that covers the entire workflow from start to finish | 19:24 |
sdake | I'd recommend your email address and launchpad id and gerrit id all match - it makes things easier | 19:25 |
sdake | its not a requirement, but makes things easier | 19:25 |
g3ek | ok ^^ | 19:26 |
g3ek | thx steven | 19:26 |
vhosakot | g3ek: FYI, OpenStack does not use pull request on Github.. that link has info to clone, add fix, psuh review, ammend, etc... | 19:27 |
*** dwalsh has joined #kolla | 19:27 | |
sdake | g3ek it may look a little overwhelming at first, but once you get your accoutns setup its really alot easier to work with then git pull requests | 19:28 |
sdake | g3ek ify ou run into trobule setting up your enrionment, and are on a mac or windows desktop, I can screen share and debug you through the setup process | 19:29 |
sdake | or join #openstack-infra and have them debug | 19:29 |
sdake | g3ek if you are not a git pro, I am also happy to help teach you the basics | 19:29 |
vhosakot | I can help too with whatever is needed... feel free g3ek :) | 19:29 |
sdake | sbezverk didn't really know git all that well, and he wrote one of the most complex containers that have hit the repo ;) | 19:29 |
sdake | so I spend time teaching people git because we don't want the tools to get in the way if your committed :) | 19:30 |
vhosakot | sbezverk is a rockstar! | 19:30 |
sdake | the iscis patch rocks | 19:30 |
g3ek | sdake vhosakot : thx guys. I already know git : branch, pull, push, merge, rebase, checkout etc. I should be fine. Will read this how to tonight ^^ | 19:30 |
sdake | seriously hard work | 19:30 |
sdake | g3ek cool ya if you know how to use rebase and patch streams, your all set | 19:31 |
sdake | ok folks i'm going to get reno into master asap | 19:33 |
sdake | then work on heat doa bug | 19:33 |
sdake | i'd like some good reviews on reno when the work is done | 19:33 |
sdake | i'm basically gong to copy trove's implementation | 19:33 |
sdake | but we need to start it from the beginning | 19:33 |
sdake | which is this branch | 19:33 |
sdake | and unfortunately i've been too overloaded to prep a patch | 19:33 |
g3ek | the portal container I'm working on have separate network from openstack, have keepalived, haproxy, mongo (in sharding), redis, redis-sentinel. Give me headheck sometime | 19:34 |
sdake | vhosakot if your LFW we need heat working | 19:34 |
sdake | reno unforutnately is higher priority right at this present time | 19:34 |
vhosakot | well, I'm on keystone logs fix.... I have been following the heat DOA bug | 19:35 |
sdake | ok well thats next up to fix after keystone unless you want to do something else | 19:35 |
sdake | but if LFW thats what i'd recommend | 19:35 |
sdake | until I finish with reno, then i'll finish that up | 19:35 |
vhosakot | how about we attend a heat meeting and nail it with the heat cores... we need to know the delta between Lberty and Mitaka interms of domain id /trusts | 19:35 |
sdake | we have heat expertise in core team - asalkeld hass recent experience with heat | 19:36 |
sdake | and shardy can serve as a contact point | 19:36 |
sdake | the issue is trusts | 19:36 |
sdake | and configurign thedm properly | 19:36 |
vhosakot | sdake: cool, will pick up heat DOA bug afert keystone logs bug... | 19:36 |
sdake | one of the prolems is devstack configures the "old" way | 19:36 |
sdake | which is no bueno | 19:36 |
vhosakot | sdake: cool, will check with you and asalkeld heat experts | 19:36 |
sdake | i used to be a heat expert | 19:37 |
sdake | 2 years ago | 19:37 |
vhosakot | Mitaka Devstack configures Liberty heat ? | 19:37 |
sdake | but the code base has been rwritten 30 times since i last t ouched it | 19:37 |
sdake | vhosakot last i looked it configured the old way | 19:37 |
sdake | which is with adin_password | 19:37 |
sdake | or something | 19:37 |
sdake | i dont recall the details | 19:37 |
vhosakot | sdake: ah ok | 19:37 |
sdake | im going to look at that right after reno | 19:38 |
sdake | other then that and the architecture diagramming for the TA, I dont have much on my plate atm | 19:38 |
sbezverk | sdake vhosakot could you please review horizon patch, so I could get this off my to do list :-) https://review.openstack.org/#/c/295568/4 | 19:40 |
sdake | eating lucnh then have the VMT tag change to discuss in the tc meeting | 19:40 |
sdake | sbezverk can it wait a couple hours? | 19:41 |
sdake | unfortunately the change for vmt is at the end of the meeting | 19:41 |
sdake | but that might be good time for me to review your work | 19:41 |
vhosakot | sdake: I see heat already using "deferred_auth_method = trusts" in heat.conf https://github.com/openstack/kolla/blob/master/ansible/roles/heat/templates/heat.conf.j2#L15... the bug fix would be to use this field correctly in code... is this right ? | 19:41 |
SamYaple | vhosakot: yes if thats the issue | 19:42 |
sdake | vhosakot i honestly have no idea | 19:42 |
sbezverk | sdake sure thing | 19:42 |
sdake | i read theheat code some time ago, and they added a [trusts] section | 19:42 |
sdake | but devstack wasn't using it at the time | 19:42 |
vhosakot | sdake: ok... cool, let me dig more after keystone fix | 19:42 |
sdake | so had no idea what needed to go into it | 19:42 |
sdake | it also has some bad interaction with user-name | 19:42 |
sdake | which causes it to crater | 19:42 |
vhosakot | sbezverk: i like the green-ness of the gate in your patch set :) reviewing now... | 19:42 |
sdake | i spent 2-3 days on this at one point and then got distracted by omething else | 19:42 |
sbezverk | vhosakot it is amasing how much red one little comma could cause :-) | 19:43 |
vhosakot | sbezverk: comma can crash an airplane | 19:43 |
vhosakot | or a lock of it actually | 19:44 |
*** egonzalez has joined #kolla | 19:44 | |
sdake | ya us phone outage was caused by a missing brace in 1 milllion lines of c code ;) | 19:44 |
vhosakot | sbezverk: +1 | 19:46 |
sbezverk | vhosakot :-) | 19:50 |
vhosakot | sbezverk: np! | 19:50 |
mlima | bootstrap mariadb is broken? | 19:51 |
SamYaple | mlima: no | 19:51 |
SamYaple | i just ran it multinode minutes ago | 19:51 |
mlima | i have a timeout error now, in my aio deployment | 19:52 |
mlima | i'll ran it again | 19:53 |
openstackgerrit | Jeff Peeler proposed openstack/kolla: Remove ironic images from excluded list https://review.openstack.org/296033 | 19:53 |
sdake | mlima probably a vip problem | 19:55 |
sdake | did you reboot after a cleanup? | 19:55 |
mlima | no | 19:55 |
vhosakot | mlima: mariadb bootstrap is fine for me as well in AIO.. this morning's pull | 19:56 |
sdake | i recommend that - or SamYaple has a one iner which cleans up properly | 19:56 |
*** eandersson_ has joined #kolla | 19:56 | |
sdake | did yu cleanup mlima? | 19:56 |
mlima | yes sdake | 19:56 |
sdake | keepalived that is cleaned up doesn't get cleaned up | 19:56 |
mlima | i'll reboot | 19:56 |
sdake | it craters sometimes as a result | 19:57 |
mlima | ok | 19:57 |
mlima | thank you | 19:57 |
sdake | no gurantees | 19:57 |
*** chopmann has quit IRC | 19:57 | |
sdake | but would be my first debug suggestion | 19:57 |
mlima | no problem | 19:57 |
*** eandersson has quit IRC | 19:58 | |
*** salv-orlando has quit IRC | 19:58 | |
sdake | 70 new bluepritns | 19:58 |
* sdake groans | 19:58 | |
mlima | 70? wow | 19:58 |
sdake | inc0 ping re elasticsearchc upgrade | 20:00 |
sdake | this one slipped through the cracks | 20:00 |
sdake | https://blueprints.launchpad.net/kolla/+spec/upgrade-elasticsearch | 20:00 |
sdake | it didn't get targeted to a mliestone | 20:01 |
sdake | i've ninja added it to rc2 | 20:01 |
inc0 | duh I don't know if we make it | 20:02 |
sdake | inc0 how about rc3? | 20:02 |
inc0 | but that's not horrible | 20:02 |
sdake | rc3 = april 2nd | 20:02 |
inc0 | will be hard too, I'm pretty loaded now | 20:02 |
sdake | how about we find someone else to do it | 20:02 |
sdake | if you can write down the process | 20:03 |
inc0 | that'd work:) | 20:03 |
SamYaple | got a memcache bug with keystone | 20:03 |
inc0 | I don't know anything about it | 20:03 |
SamYaple | w00t | 20:03 |
sdake | inc0 i think Jeffrey4l is our man here | 20:03 |
sdake | hes working on magnum but i think magnum is just going to be doa entirely with mitaka because of an unpackaged barbican dependency | 20:03 |
sdake | unless it can be made to wor kwtihout barbican | 20:04 |
sdake | which I think it can | 20:04 |
inc0 | <3 hard dependency on barbican by magnum | 20:05 |
sdake | ya i know terrible | 20:07 |
sdake | i really fought that | 20:07 |
sdake | there is a developer only mode | 20:07 |
sdake | which allows a key filel store | 20:07 |
sdake | inc0 there is a bunch of popcorn on the openstack mailing list with [magnum] tag related to the barbican dep | 20:08 |
sdake | barbican argument "make it a hard dependency so people will deploy barbican" | 20:08 |
sdake | magnum argument "we dont want a hard dependency off barbican because it lowers adoptoin of magnum" | 20:08 |
inc0 | they do know that it doesn't work this way? | 20:08 |
inc0 | it's not that people will deploy barbican...people stop deploy magnum | 20:09 |
sdake | i dont know what they knwo or dont know | 20:09 |
inc0 | especially with all that fuzz magnum vs murano | 20:09 |
sdake | inc0 ya that is my assessment as well | 20:09 |
sdake | i dont even know what that fuzz is about | 20:09 |
inc0 | Murano guys says that they can replace magnum because they too deploy k8s | 20:09 |
sdake | with there 3 people that know how to actually do that ;) | 20:10 |
sdake | comopared to magnum community which hsa great diversity :) | 20:10 |
*** aginwala has quit IRC | 20:13 | |
SamYaple | vhosakot: sdake https://review.openstack.org/#/c/296012 | 20:15 |
*** egonzalez has quit IRC | 20:16 | |
vhosakot | SamYaple: elemoine yep, looking at it... I see nova.conf uses oslo.log, but nova_libvirt does not use nova.conf and it uses libvirtd.conf and libvirtd.conf does not have anything related to oslo | 20:17 |
vhosakot | elemoine: but, I did not see any error when I built and deployed heka container and I was also able to see the libvirt.log contents inside the heka container | 20:18 |
*** aginwala has joined #kolla | 20:18 | |
vhosakot | elemoine: how I can run the decoder with libvirt.log | 20:18 |
vhosakot | and this fix needs to be added to master (Newton) as well.. | 20:19 |
*** SiRiuS_ has quit IRC | 20:20 | |
sdake | bbiaf tc meeting | 20:21 |
SamYaple | ayoung: does keystone periodically spit out log_opt_values? | 20:22 |
SamYaple | or si that only done on process restart? | 20:22 |
elemoine_ | vhosakot: you have to look at Kibana and see if the libvirt logs are correctly parsed | 20:23 |
vhosakot | elemoine: ah ok... the "Copying over heka config files" task that copies heka-openstack.toml.j2 (that has filename = "lua_decoders/os_openstack_log.lua") did not fail... I will check kibana | 20:24 |
vhosakot | elemoine: how do I access kibana ? in a browser ? http://<VIP>:<kibana port> | 20:25 |
elemoine_ | os_opentack_log.lua just ignores the log if it cannot parse it | 20:25 |
vhosakot | elemoine: ah ok | 20:25 |
elemoine_ | you can look at the haproxy configuration file (haproxy.cfg) so know what URL to use to open Kibana | 20:27 |
elemoine_ | and yes, in your browser | 20:27 |
vhosakot | elemoine: so, I set enable_central_logging:"yes" in globals.yml, rebuild kibana and access http://<VIP>:5601... is this the right way to do it | 20:27 |
elemoine_ | yes | 20:28 |
elemoine_ | you will also need to build and start the ES container | 20:28 |
vhosakot | elemoine: ah ok... thanks! | 20:28 |
*** dtturner has joined #kolla | 20:29 | |
*** jmccarthy1 has joined #kolla | 20:31 | |
*** achanda has quit IRC | 20:34 | |
ayoung | SamYaple, that is new to me | 20:35 |
SamYaple | ayoung: well either my keystone is restarting (without the docker contaienr restarting, so apache is sileltly restarting it) or keystone spits out lot_opt_values randomly | 20:37 |
SamYaple | the first seems more likely | 20:37 |
ayoung | SamYaple, what are log_opt_values? | 20:37 |
SamYaple | ayoung: just the debug output of all the conf options | 20:37 |
SamYaple | normally like the first thing that shows up | 20:38 |
ayoung | SamYaple, how often is it happening? | 20:38 |
SamYaple | randomly, every 10 or so minutes | 20:38 |
SamYaple | no pattern | 20:38 |
*** aginwala has quit IRC | 20:38 | |
ayoung | SamYaple, I'm guessing it is from startup code. Maybe each 10 minutes Apache reaps processes and restarts them, and for some reason they are starting from the beginning instead of the normal fork point? | 20:39 |
ayoung | Actauly, I don;t know what the normal fork point would be | 20:40 |
ayoung | you probably just have logging turned up so you see what most peop;e don't | 20:40 |
ayoung | let me see on my tripleo deploy | 20:40 |
*** aginwala has joined #kolla | 20:41 | |
ayoung | SamYaple, this is in /var/log/keystone/keystone.log ? | 20:41 |
SamYaple | ayoung: yea | 20:41 |
ayoung | SamYaple, yeah, not seeing that in tripleo | 20:41 |
SamYaple | ayoung: it *could* be just spinning up new threads | 20:41 |
ayoung | SamYaple, its just the log options, or the whole startup mess | 20:41 |
SamYaple | whole startup it seems | 20:42 |
SamYaple | just started debugging when i pinged you | 20:42 |
ayoung | Yeah, then it is a process start. I'm guessing some sort of process pool setup issue | 20:43 |
*** mlima has quit IRC | 20:43 | |
SamYaple | ayoung: im going to roll it back to one thread and if that stays then ill agree | 20:43 |
SamYaple | i only noticed it when i started hammering keystone | 20:43 |
SamYaple | so its very likely a new thread | 20:43 |
ayoung | SamYaple, so my Keystone server is pretty quiet | 20:43 |
ayoung | Or new process more likely. What is the setup? | 20:44 |
SamYaple | i started asking for ~1000 tokens per second | 20:44 |
SamYaple | infrastructure? | 20:44 |
SamYaple | three node, mariadb+galera backend sql persistence driver | 20:44 |
SamYaple | with [cache] 3 memcache servers | 20:44 |
ayoung | I'm running WSGIDaemonProcess keystone_admin_11 display-name=keystone-admin group=keystone processes=1 threads=1 user=keystone | 20:44 |
SamYaple | lemme check | 20:44 |
ayoung | that is on the wsgi side. Not sure about the Apache config to go along with that | 20:45 |
SamYaple | WSGIDaemonProcess keystone-public processes=5 threads=1 user=keystone group=keystone display-name=%{GROUP} python-path=/var/lib/kolla/venv/lib/python2.7/site-packages | 20:45 |
SamYaple | thats what im running now | 20:45 |
sdake | ok our TA got merged into the governance repo | 20:46 |
sdake | \o/ | 20:46 |
SamYaple | ayoung: single process == single thread, like you have. hammering its ok. so im guessing it was spawning new processes | 20:49 |
ayoung | SamYaple, and probably reaping them and restarting every ten minutes | 20:49 |
ayoung | or x number of requests? | 20:50 |
SamYaple | ayoung: looking back through the logs i only see 5 dumps of the config. soooooooo i probably just happened to catch it at the wrong time and went into full-on ops mode | 20:50 |
SamYaple | it dont think it was even reaping | 20:51 |
ayoung | SamYaple, one per process | 20:51 |
SamYaple | yup | 20:51 |
ayoung | Good. I like it when I can explain things so that I understand. | 20:51 |
SamYaple | sure enough | 20:51 |
SamYaple | dave-mccowan: looking forward to that fernet implementation in newton! | 20:52 |
SamYaple | i must say. fernet seems really well thought out unlike some other plans openstack has seen | 20:53 |
*** Pierre_Carette has joined #kolla | 20:53 | |
*** akwasnie has quit IRC | 20:54 | |
SamYaple | sdake: hey got a question | 20:55 |
dave-mccowan | SamYaple +1 | 20:55 |
sdake | shoot | 20:55 |
SamYaple | so im playing with horizon after setting up my environment and I run into a snag...... | 20:55 |
SamYaple | i cant login | 20:55 |
*** salv-orlando has joined #kolla | 20:56 | |
SamYaple | i created a domain for me outside of the default domain (so v3) | 20:56 |
sdake | i can login as of lmy build yesterday | 20:56 |
SamYaple | but horizon default is domain logins are disabled | 20:56 |
SamYaple | or more accurately the domain login isnt shown | 20:56 |
SamYaple | its an option in horizon | 20:56 |
SamYaple | i think the defualt should be True | 20:56 |
SamYaple | normally this would be augment teritory, but we cant do that for horizon yet | 20:56 |
*** dtturner has quit IRC | 20:57 | |
sdake | so you need a domain field? | 20:57 |
SamYaple | ya | 20:57 |
sdake | i happen to know the horizon ptl | 20:57 |
SamYaple | https://github.com/openstack/horizon/blob/master/openstack_dashboard/local/local_settings.py.example#L65 | 20:58 |
SamYaple | no i mean its there already | 20:58 |
SamYaple | we dont have it set to true | 20:58 |
SamYaple | and no way to override | 20:58 |
SamYaple | for mitaka i mean | 20:58 |
sdake | oh i see | 20:58 |
sdake | so basically domain logins for horiozn dont work | 20:58 |
SamYaple | right | 20:58 |
SamYaple | which means as of right now my user cant log into horizon | 20:59 |
sdake | we can't set it to true? | 20:59 |
SamYaple | we can | 20:59 |
SamYaple | but that means typing in domain is required | 20:59 |
SamYaple | small trade off | 20:59 |
sdake | ya seems worth it | 20:59 |
SamYaple | ok ill throw up bug | 20:59 |
*** akwasnie has joined #kolla | 20:59 | |
sdake | ok sbezverk done with tc meeting | 21:00 |
SamYaple | https://bugs.launchpad.net/kolla/+bug/1560683 | 21:01 |
openstack | Launchpad bug 1560683 in kolla "domain users cannot log into horizon" [Critical,Triaged] - Assigned to Sam Yaple (s8m) | 21:01 |
sbezverk | sdake great, sooner I am done with horizon, sonner I can start something else ;-) | 21:02 |
openstackgerrit | Sam Yaple proposed openstack/kolla: Enable horizon domain logins https://review.openstack.org/296052 | 21:04 |
sdake | ok giveme linkes sbezverk | 21:04 |
sbezverk | sdake here you go: https://review.openstack.org/#/c/295568/ | 21:05 |
SamYaple | now the next thing in horizon is the logging sdake. we currently dump out DEBUG for all client logs, even if debug in openstack isnt turned on | 21:05 |
SamYaple | this noticably slows down horizon | 21:05 |
SamYaple | sdake: is that worth a fix in mitaka? | 21:06 |
sdake | SamYaple yes worth fixing | 21:07 |
sdake | i'd like the debug overrides to work | 21:07 |
sdake | seems like a medium priority bug | 21:07 |
sdake | my heory is any medium priority bugs that canbe fixed shoudl be fixed | 21:07 |
SamYaple | but is it rc candidate worth? | 21:07 |
SamYaple | or point release | 21:07 |
sdake | what we need is confirmation on the bugs in the triaged state | 21:07 |
sdake | good question | 21:08 |
sdake | maye we shoudl make high he bar for backports | 21:08 |
sdake | and medium the bar for a quick point releaes after 2.0.0 | 21:08 |
SamYaple | i mean it is noticable | 21:08 |
SamYaple | but is it enough | 21:08 |
sdake | one issue is people want either debug on or off | 21:09 |
sdake | across the system | 21:09 |
sdake | its one wayor the other | 21:09 |
sdake | so its inconsistent | 21:09 |
sdake | looks a little sloppy | 21:09 |
SamYaple | right and we can set this easily, but we dont currently | 21:09 |
sdake | so medium priority bug | 21:09 |
SamYaple | and _noooo_ one ever sees those logs | 21:09 |
SamYaple | its super rare | 21:09 |
*** dims has joined #kolla | 21:11 | |
*** haplo37 has quit IRC | 21:13 | |
openstackgerrit | Benedikt Trefzer proposed openstack/kolla: Use debian repos for debian base docker image https://review.openstack.org/288936 | 21:14 |
sdake | sbezverk the comment about whitespace changes can go in another time | 21:15 |
sdake | but the patch is missing the lua file | 21:15 |
openstackgerrit | Alicja Kwasniewska proposed openstack/kolla: Add Kibana Authentication https://review.openstack.org/296068 | 21:20 |
SamYaple | akwasnie: did haproxy auth nor work? | 21:20 |
sdake | akwasnie nice! | 21:21 |
sdake | akwasnie say, any chance you can do ugprades for elasticsearch? | 21:21 |
sdake | there is a blueprint that I assigned to jeffrey but he wasn't around to agree to it :) | 21:21 |
sdake | akwasnie https://blueprints.launchpad.net/kolla/+spec/upgrade-elasticsearch | 21:22 |
sdake | akwasnie targeted for mitaka | 21:22 |
akwasnie | SamYaple: I had already prepared nginx so sent it to review, in the meantime I can try haproxy | 21:23 |
akwasnie | sdake: when auth will be ready I can take upgrades for elasicsearch | 21:24 |
sdake | SamYaple fwiw i have tried out the new process myself nd it seems lightweight and straightforward | 21:24 |
sdake | akwasnie sounds good | 21:24 |
sdake | akwasnie put a -2 on your ereview for now | 21:24 |
sdake | until haproxxy is sorted | 21:24 |
sdake | if we can use haproxy i'd prefer that | 21:25 |
*** mlima has joined #kolla | 21:25 | |
sdake | i think everyone would prefer less components compared to more | 21:25 |
sdake | does ngingxx vs haproxy present any different sort of user experience? | 21:25 |
elemoine_ | I'm interested in reviewing this akwasnie | 21:25 |
akwasnie | sdake: ok, I will put -2, I have not tested haproxy for kibana auth yet | 21:26 |
SamYaple | sdake: should be just a normal http authbox that pops up | 21:26 |
SamYaple | for both | 21:26 |
SamYaple | but i dont know | 21:26 |
sdake | akwasnie ya the work is good, this will be our backup plan | 21:26 |
akwasnie | nginx has a popup box | 21:26 |
akwasnie | I tested it for centos and it works | 21:26 |
sdake | we probably need to revert elemoine_ 's change too to expose this on the external network | 21:26 |
akwasnie | have to test for ubuntu | 21:26 |
SamYaple | akwasnie: it *should* be the same thing for haproxy | 21:27 |
sdake | rather then test ubuntu just try out haproxy | 21:27 |
akwasnie | SamYample: will try | 21:27 |
akwasnie | sdake: ok | 21:27 |
sdake | if haproxy is bubkiss then do ubuntu test | 21:27 |
SamYaple | akwasnie: if we are doing more advanced things wed need nginx, like revo lists | 21:27 |
sdake | i am not super keen to add a contianer and role for something haproxy can do | 21:27 |
akwasnie | less components sounds better, will see if haproxy works | 21:28 |
sdake | akwasnie in the meantime i'll review | 21:28 |
akwasnie | thanks | 21:28 |
sdake | sbezverk re your patch the whitepsace change is something to keep in mind or the future | 21:28 |
sdake | sbezverk but i think you are missing a key lua file for horizon | 21:29 |
sdake | i'm not surehow enable central logging would wor without it | 21:29 |
akwasnie | SamYaple: did kibana work for you? | 21:30 |
sbezverk | sdake about your second comment of white spaces, it must be a glitch in gerrit as my source file has NO empty lines.. | 21:32 |
sdake | yes prior there was two spaes | 21:32 |
sdake | nwo there is one space | 21:32 |
sdake | you reminved a line | 21:32 |
sdake | spaces/lines | 21:32 |
sdake | if you just want to revert that line chnage entirely that would be best ;) | 21:33 |
sbezverk | sdake ok | 21:33 |
sdake | sbezverk make sure to click "done' on the review | 21:34 |
sdake | and click reply before submitting the new review | 21:34 |
sdake | so people knwo you addressed their comments | 21:34 |
*** jtriley has quit IRC | 21:34 | |
*** achanda has joined #kolla | 21:34 | |
*** akwasnie has left #kolla | 21:36 | |
*** JoseMello has quit IRC | 21:39 | |
*** ssurana has joined #kolla | 21:39 | |
*** achanda has quit IRC | 21:40 | |
*** aginwala has quit IRC | 21:42 | |
*** akwasnie_ has joined #kolla | 21:42 | |
*** akwasnie has joined #kolla | 21:44 | |
*** inc0 has quit IRC | 21:44 | |
*** openstackgerrit has quit IRC | 21:48 | |
*** openstackgerrit has joined #kolla | 21:49 | |
openstackgerrit | Benedikt Trefzer proposed openstack/kolla: Use debian repos for debian base docker image https://review.openstack.org/288936 | 21:51 |
*** aginwala has joined #kolla | 22:00 | |
*** mlima has quit IRC | 22:01 | |
vhosakot | SamYaple: elemoine sdake: my VM entered bad state.. need to cleanup/reboot.. I will have some status in tomorrow's meeting about how Kibana parses and displays libvirt.log or not.. | 22:04 |
sdake | you may need a lua paraser for libvirtt vhosakot | 22:05 |
sdake | look in the encoders directory | 22:06 |
vhosakot | sdake: yep, looking at docker/heka/plugins/decoders/os_openstack_log.lua... | 22:07 |
*** jtriley has joined #kolla | 22:07 | |
vhosakot | I read lua programming us used in video games.. and Angry Birds is written in lua | 22:08 |
elemoine_ | sdake +1 on reverting my haproxy kibana change | 22:16 |
sdake | vhosakot yes | 22:16 |
sdake | vhosakot when i played wow, all the addons were written in lua :) | 22:16 |
vhosakot | sdake: ah ok | 22:17 |
sdake | elemoine_ ya oonce we have authentication | 22:17 |
vhosakot | elemoine_: you recommend any lua programming tutorial for me ? I will add a parser to parse libvirt.log | 22:17 |
sbezverk | elemoine programming tutorial +1 | 22:18 |
sbezverk | need it for horizon | 22:18 |
sdake | vhosakot elemoine may already hae a parser written for virtlibd somewhere in the fuel codebases | 22:20 |
vhosakot | sdake: let me search fuel.. cool | 22:21 |
sdake | they have a whole lot of repos iirc | 22:21 |
sdake | elemoine may be able to find it faster | 22:21 |
sdake | since he works on that team orruns it | 22:21 |
*** achanda has joined #kolla | 22:21 | |
sdake | the fuel diags team | 22:21 |
vhosakot | cool.. will check with eel | 22:22 |
vhosakot | *elemoine_ | 22:22 |
*** jtriley has quit IRC | 22:25 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: Changes horizon log location to kolla_logs volume https://review.openstack.org/295568 | 22:26 |
*** jtriley has joined #kolla | 22:29 | |
*** dtturner has joined #kolla | 22:39 | |
*** achanda has quit IRC | 22:43 | |
*** ayoung has quit IRC | 22:43 | |
*** jtriley has quit IRC | 22:44 | |
*** spisarski has quit IRC | 22:45 | |
*** absubram has quit IRC | 22:47 | |
*** aginwala has quit IRC | 22:48 | |
*** vhosakot has quit IRC | 22:49 | |
*** jtriley has joined #kolla | 22:50 | |
sbezverk | is it a know issue, my deployment fails with this message: AnsibleUndefinedVariable: One or more undefined variables: 'keepalived_password' | 22:54 |
sbezverk | never mind | 22:56 |
*** unicell has quit IRC | 22:58 | |
*** aginwala has joined #kolla | 23:01 | |
*** dwalsh has quit IRC | 23:01 | |
SamYaple | akwasnie: i tried to reply before but you werent in channel. i could not get kibana to work, im 99.9% sure it was just user error | 23:07 |
*** jtriley has quit IRC | 23:10 | |
*** dims_ has joined #kolla | 23:12 | |
*** dims has quit IRC | 23:15 | |
*** dims has joined #kolla | 23:15 | |
*** dims_ has quit IRC | 23:18 | |
*** dims_ has joined #kolla | 23:19 | |
*** asalkeld_ has joined #kolla | 23:22 | |
*** achanda has joined #kolla | 23:22 | |
*** dims has quit IRC | 23:22 | |
*** Jeffrey4l has quit IRC | 23:23 | |
*** dims has joined #kolla | 23:23 | |
*** marmat has joined #kolla | 23:23 | |
*** dims_ has quit IRC | 23:25 | |
*** Pierre_Carette has quit IRC | 23:27 | |
*** mlima has joined #kolla | 23:33 | |
*** jtriley has joined #kolla | 23:41 | |
sbezverk | SamYaple ping | 23:45 |
SamYaple | sbezverk: pong | 23:46 |
sbezverk | SamYaple I see some strange heka behavior | 23:55 |
sbezverk | it is flapping generating swift related error in the log | 23:55 |
sbezverk | but I have swift disabled | 23:56 |
*** marmat has quit IRC | 23:56 | |
sbezverk | I clone the latest master to test again iscsi | 23:56 |
sbezverk | and now I see this strange condition.. | 23:56 |
mlima | SamYaple, where can i find some doc about kolla achitecture, deployment strategy ? | 23:57 |
sbezverk | SamYaple here is what I see in heka logs http://paste.openstack.org/show/491517/ | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!