Sunday, 2015-09-06

*** dimsum__ has joined #kolla00:00
*** vinkman has quit IRC00:12
*** vinkman has joined #kolla00:13
*** zhiwei has joined #kolla00:17
*** erkules_ has quit IRC00:59
openstackgerritSteven Dake proposed stackforge/kolla: WIP: Make heat stack-create work  https://review.openstack.org/22076501:26
*** erkules_ has joined #kolla01:32
*** weiyu has joined #kolla01:44
*** dayou has joined #kolla01:52
openstackgerritSteven Dake proposed stackforge/kolla: WIP: Make heat stack-create work  https://review.openstack.org/22076502:19
*** klint has joined #kolla02:46
*** dayou has quit IRC02:51
*** dimsum__ has quit IRC02:58
*** dayou has joined #kolla02:59
openstackgerritSteven Dake proposed stackforge/kolla: Make heat stack-create work  https://review.openstack.org/22076503:16
SamYaplepbourke: re dependacy that should run after role, yea we can do that03:28
SamYaplesdake: we dont registry v3 endpoints yet03:31
sdakei could be wrong about commit message - that second thing is reuqired - by code investigation03:32
sdakeotherwise plugin doesn't load propelry03:32
sdakei dont know how you ever got it to  work in your envrionment03:32
sdakei tried ubuntu images, didn't work for me03:33
sdakesay i cranked of the max pool size thing and glance registry is always having problems with the sql error03:33
sdakeany tips?03:33
sdakeonly happens 3 node03:33
*** banix has joined #kolla03:34
sdake4 hours spent reading code today - heat totally different then I remember it ;)03:34
*** dayou has quit IRC03:42
*** dayou has joined #kolla03:55
*** banix has quit IRC03:56
*** dimsum__ has joined #kolla03:59
*** dimsum__ has quit IRC04:06
*** weiyu has quit IRC04:21
*** weiyu has joined #kolla04:22
*** weiyu has quit IRC04:27
*** Haomeng has joined #kolla05:12
*** Haomeng|2 has quit IRC05:15
*** weiyu has joined #kolla05:19
*** weiyu has quit IRC05:35
*** weiyu_ has joined #kolla06:21
*** weiyu_ has quit IRC06:22
sdakelaunching 5 nova instances with 3 controller nodes takes 195 connections06:24
sdakedrops back down to 105 connections06:25
sdakemax for mysql is 150 - need to rais ethat06:26
*** Haomeng|2 has joined #kolla06:44
*** weiyu_ has joined #kolla06:45
*** Haomeng has quit IRC06:47
*** vinkman has quit IRC07:46
*** vinkman has joined #kolla07:56
*** vinkman has quit IRC08:21
*** sdake_ has joined #kolla08:51
*** sdake has quit IRC08:54
*** dayou has quit IRC09:04
sdake_samyaple that auth change to heat was merged in september 4th09:35
sdake_the patch was april 28th09:35
sdake_e43ef0ed0936b6eea08bb9d89a55547c33d2ed4a09:36
sdake_git commit09:36
*** zhiwei has quit IRC10:27
SamYaplesdake_: yea that I can believe10:36
SamYaplethat heat just came around and merged a breaking patch 2 days ago10:36
sdake_i am just going to use admin_password and admin_user for now, and file a tech debt bug10:37
sdake_if we get to it in rc1, so be it, but we have alot of higher priority things to sort out then a deprecation warning10:37
SamYapleugh that is a bad patch that was merged :/10:37
SamYaplehttps://review.openstack.org/#/c/220586/10:37
SamYaplethats not the proper way t ofail10:38
sdake_file a bug10:38
SamYapleim reopening that bug...10:38
sdake_wfm10:38
SamYaplethis doesnt need a new bug10:38
sdake_your right thats better10:38
SamYaplewhats better?10:39
SamYapleoh yea10:39
sdake_reopning the bug10:39
SamYapleyea10:39
SamYaplelaunchpad is bombing out on me10:39
sdake_fwiw patch looks correct to me10:40
sdake_but i am not a ansible rocket scientist10:40
SamYaplethere is a completely seperate task to check failures10:41
SamYaplethats not even how we doit _within_ this project10:41
SamYapleim not asking people to know new things, but we use 'failed_when' all over this project10:41
sdake_learning experience for all10:41
SamYapleyea10:41
sdake_i can get heat to launch 25 vms over 3 boxes in about 5 sconds10:45
SamYaplesounds about right10:50
sdake_[sdake@minime-01 ~]$ ./status10:54
sdake_Threads_connected 8510:54
sdake_Threads_running 110:54
sdake_[sdake@minime-01 ~]$10:54
SamYapleyea thats the threading config options im fixing for rc110:54
SamYapleright now we just use teh defaults10:54
SamYaplesometimes the default is 110:54
sdake_those are connections10:54
SamYaplesometimes it defaults to something saner10:54
sdake_to mariadb10:55
SamYapleim aware10:55
SamYaplethats pretty normal10:55
sdake_heat stack launch -> Threads_connected 21910:56
*** weiyu_ has quit IRC11:01
openstackgerritSteven Dake proposed stackforge/kolla: Make heat stack-create work  https://review.openstack.org/22076511:04
openstackgerritSteven Dake proposed stackforge/kolla: Permit larger database connection count  https://review.openstack.org/22080511:13
openstackgerritSteven Dake proposed stackforge/kolla: Revert "Fix rabbitmq part 2"  https://review.openstack.org/22080611:14
sdake_samyaple i ithink the sleep would work if it was variable per node11:15
sdake_but atm its sleep in one spot as one task11:15
sdake_so its still synchronized starting11:15
SamYaplesdake_: i dont think you understand the issue11:15
sdake_no i dont11:15
*** sdake_ is now known as sdake11:15
SamYaplethats not what would work11:15
sdakebut it still doesn't work ;)11:15
SamYapleit has to start synchronized11:16
sdakeinteresting didn't know that11:16
SamYaplewhyd you merge it then11:16
sdakei tested it11:16
sdakeit appeared to work11:16
sdakeit now does not appear to work11:16
sdakei have run over 30 deployments tonight eery time rabbitmq fails11:16
sdakewith a segfault11:16
sdakeonly multinode11:16
SamYaplesegfault is not caused by sleep11:17
SamYaplethats a completemy different issue11:17
SamYaplethe sleep does fix the actual race condition i see11:17
sdakethe problem i am having is rabbitmq crashes on startup11:17
sdakeisn't that this issue?11:17
SamYaplenope11:18
SamYapledocker is down so gate is down11:19
sdakefantastic11:19
* sdake wtb reliable infrastructure to count on11:19
SamYaplehey im not cool with changing the augment files11:20
SamYaplewe dont put things in there11:20
sdakei thought you said thts what you wante to do with that config option11:20
SamYapleno thats where the _deployer_ would put it11:20
SamYapleim not ok with setting htat options for the deployer in kolla11:20
sdakewhich, both?11:20
SamYapleno the template one is cool11:21
SamYapleno problem there11:21
SamYaplethe openstack option11:21
sdakelet me test, i guess we could document it11:21
sdakelemme testsee if its even necessary11:21
SamYaplewe have specficially been doing a stripped down config and i want to keep it that way11:21
sdakeagree i want thatas well11:21
sdakelet me test i'll get back to you11:22
openstackgerritSam Yaple proposed stackforge/kolla: Properly check failed status  https://review.openstack.org/22080811:22
*** dimsum__ has joined #kolla11:24
sdakesam can you sort out the network port thing11:25
sdakeor put a solution in the bug tracker so osmoene lse an sort ito ut11:25
sdakethere are sevearl quetions per day on it11:25
SamYapleugh fine11:25
sdaketia :)11:25
SamYapleill do the simply but not so cool fix11:25
SamYaplewe can make it better if needed later11:25
SamYapleits still clean11:26
sdakeas long as it works11:26
sdakekeep in mind we have years to make kolla perfect11:26
sdakebut it needs to work by 25th :)11:26
SamYapleyep11:26
SamYapleheat did a bad thing11:31
SamYapleits using a deprecated-this-cycle option as the only option11:31
SamYaplebad heat bad11:31
SamYaplethats actually a bug11:32
*** dimsum__ has quit IRC11:32
sdakeits not the only option11:33
sdakebut ya bunch of fial that change was11:33
SamYapleyou cant use the deprecated name11:33
SamYapleso it kinda is11:33
sdakethere was no name deprecated?11:33
SamYapleuser-name username11:34
sdakeoh that one11:34
SamYapleyea you cant do that11:34
sdakeya i know11:34
sdakei was meaning to file a bug on that - i have a log of it on one of my machines11:34
SamYaplei think its a bug because they are looking up the wrong values11:35
SamYapleadmin_password isn't a value provided by the password method11:36
SamYaplethats like really old school auth methond11:37
SamYaplethis is just straight up bad11:37
SamYaplehttps://github.com/openstack/heat/commit/e14a0895c1fe55b6ac34d6f4b9366359c2ebaab2 lines 155-159 should replease 173-17811:38
SamYaplereplace11:38
*** pbourke has quit IRC11:38
SamYaplewhy they fetch the vaules directly like that is beyond me11:38
SamYaplewhat a horrible way to implement a deprecation11:38
SamYapleby pointing to ancient optoins11:38
*** pbourke has joined #kolla11:38
sdakegood news - we dont need that override in database.conf to have a functional system11:39
SamYapleim aware11:39
SamYaplewe also dont need to screw iwth galera.cnf11:39
SamYaplebut im ok with that change if it helps centos11:39
sdakedefault is 15111:40
SamYaplei know11:40
sdakeif you go over tht, you get database full errors or something like that11:40
SamYapleim aware11:40
SamYaplehey why did you remove the trustee section?11:40
sdakebecause i filed a tech debt bug11:41
sdakeso someone else could look at it at a later time11:41
sdakewhen heat gets the code base working11:41
sdakei couldn't getit to work11:41
SamYapleim not ok with introducing the admin_user and admin_password optoins11:41
sdaketemporary sam11:41
SamYaplethose are old and busted options ive kept out since they are old and busted11:41
SamYapleso but them in your overrides11:41
SamYaple...11:41
sdakebut they are needed to make heat work11:41
SamYaplein your overrides11:41
SamYapleheat is not stable it doesnt get deployed by default11:42
sdakeanyting tht is neede to make it work out of the box, shuld be configed in11:42
SamYaplewe cant be tweaking the heat conf everyday to make it work11:42
SamYaplethis wil lnot stand until liberty or probably even the end of the week11:42
sdakeif somone comes and addresses the problem in a different wy fantstic11:43
sdakeif not, then we have a functional heat today11:43
sdakevs whenever omeone gets around to making  tht other option work11:43
sdakei spent hours trying11:43
SamYapleno11:43
SamYapleddue im not merging thos old options11:44
SamYapleif heat is broke upstream its broke upstream11:44
sdakejust work with me here sam, i really need kolla to be in solid shape rapidly11:44
SamYaplekolla is, heat is busted11:44
SamYapleif you want to include those in your overrides g ofor it11:44
sdakei get thta, but people will see "kolal doesn't deploy heat as it expects, its busted"11:45
sdakethat is how devstck deploys heat ffs11:45
SamYaplelisten i get what youre saying, but this is a heat bug11:45
SamYaplethis should be fixed in heat11:45
SamYaplewhich could easily be done btw11:46
sdakewe put workarounds in all the time for busted upstreams11:46
SamYapleif you want to _workaround_ the heat issue, thats exactly what i built the augment stuff for11:46
sdakethat is what depoyment tools do11:46
sdakeexplain to me the harm11:46
SamYapleits a slippery slope that i wont go down11:47
sdakeits two options in one file11:47
sdakehardly slippery11:47
SamYapleone optoin, hten two then we are merging options to fix everyones issues11:47
SamYaplethis is master, its always broken from upstream11:48
sdakelike murano and not having support for oslo as they shouold?11:48
SamYaplewhat about that? most services dont11:48
SamYaplethis is clearly a regression that was _just_ introduced in heat11:48
SamYaplestop trying ot make kolla fix heat11:48
SamYaplego fix heat11:48
sdakethis was ALREADY a feature of heat11:49
sdakeheta already let people overload that field with those values11:50
sdakewaht they did was deprecate that 2 days ago11:50
sdakethey didn't break anything11:50
SamYaplethat is absolutely not what happened here11:50
SamYaplethe deprecated option warning has nothing to do with this11:50
sdakesam go look at the last ptch for het i submitted, heat worked then, and it had these options11:50
sdakeand yu took them out and heat broke from that point forward11:50
SamYapleexcept you know it didnt11:51
SamYaplesince it worked11:51
SamYapleit wasnt until sept 4th that it worked11:51
SamYapleit was working before my weekend11:51
sdakeheat never worked for me - your verison11:51
sdakeweeks ago wasn't working11:51
sdakei said lets merge and fix down the road11:52
sdakethis is down teh road11:52
SamYaplewhats the issue with fixing it the none deprecated way now and not having this conversation again?11:52
SamYapleyou filed a techdebt bug to fix an issue and dont fix the issue?11:52
sdakei dont know how to fix it that way11:53
sdakeor god damnit sam i would have to keep you fr0om making stupid arguments with me11:53
SamYapleyoure the one that tries to merge dumb stuff like this. im agruing to keep it clean and do it right11:53
SamYaplelets do it right11:53
SamYaplethats my motto11:53
sdakehow long you been developing software sam?11:54
sdakeyou work with what is around you, not taking high road,s not putting ines in the sand11:54
sdakelines in the sand lead to the dark side11:54
SamYaplegod dammit dude. you wanted to merge that god damn source patch because you couldnt setup your environemnt. dont even give me that crap11:54
sdakeits called a workaround for a reason11:54
SamYapleso no11:54
SamYaplei dont accept that workaround11:54
sdakethat is in the past11:54
SamYapledo it right11:55
sdakeforget about that, that was clearly a mistake11:55
sdakethis is corret based upon code inspection11:55
SamYapleand this is now and when its done right ill tel lyou about this time _next_ time11:55
sdakesam i absolutely need master heat working right now11:56
sdakebecause as is its broken11:56
sdakeflat broken11:56
openstackgerritSteven Dake proposed stackforge/kolla: Permit larger database connection count  https://review.openstack.org/22080511:56
SamYapleyea because of a bug in _heat_11:57
sdakei dont agree its a bug12:00
sdakeget heat guys to agree to that - and i'll workaroound in conf files12:00
SamYapleor, like always,m ill not argue about deprecated options and do it right12:00
sdakeand i'll document it so people will have an out of the box experience that involves customizing to get a basic working installation12:00
sdakeit was deprecated 2 days ago dude12:01
SamYaplefor the love of god that is not whats happening here12:01
SamYapleah look at that. a non bad solution12:36
SamYaplewhat was that an hours worth of work12:36
SamYaplesdake: i responded in the heat patch one12:46
SamYapletry it out, works for me12:46
*** klint has quit IRC12:59
*** dimsum__ has joined #kolla13:05
*** sdake has quit IRC13:15
*** jtriley has joined #kolla14:07
*** banix has joined #kolla14:10
*** banix has quit IRC14:35
*** jtriley has quit IRC14:47
*** dimsum__ has quit IRC15:09
*** chandankumar has joined #kolla15:39
*** dimsum__ has joined #kolla16:09
*** jtriley has joined #kolla16:13
*** dimsum__ has quit IRC16:15
*** jtriley has quit IRC16:18
*** vinkman has joined #kolla17:07
*** vinkman has quit IRC17:24
*** daneyon has joined #kolla18:01
*** daneyon has quit IRC18:12
*** chandankumar has quit IRC18:13
*** jtriley has joined #kolla18:32
*** jtriley has quit IRC18:46
*** dimsum__ has joined #kolla18:57
*** dimsum__ has quit IRC19:02
openstackgerritMerged stackforge/kolla: Permit larger database connection count  https://review.openstack.org/22080519:04
openstackgerritMerged stackforge/kolla: Import not found for glance  https://review.openstack.org/22075619:05
*** vinkman has joined #kolla20:25
*** dimsum__ has joined #kolla20:29
*** dimsum__ has quit IRC20:35
*** jtriley has joined #kolla20:38
*** jtriley has quit IRC20:51
*** vbel1 has quit IRC21:40
*** vbel1 has joined #kolla21:40
*** dimsum__ has joined #kolla21:53
*** dimsum__ has quit IRC22:06
*** weiyu has joined #kolla22:32
*** weiyu has quit IRC22:59
*** jmccarthy has quit IRC23:20
*** jmccarthy has joined #kolla23:21
*** weiyu has joined #kolla23:25
*** dimsum__ has joined #kolla23:52
*** dimsum__ has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!