*** dimsum__ has joined #kolla | 00:00 | |
*** vinkman has quit IRC | 00:12 | |
*** vinkman has joined #kolla | 00:13 | |
*** zhiwei has joined #kolla | 00:17 | |
*** erkules_ has quit IRC | 00:59 | |
openstackgerrit | Steven Dake proposed stackforge/kolla: WIP: Make heat stack-create work https://review.openstack.org/220765 | 01:26 |
---|---|---|
*** erkules_ has joined #kolla | 01:32 | |
*** weiyu has joined #kolla | 01:44 | |
*** dayou has joined #kolla | 01:52 | |
openstackgerrit | Steven Dake proposed stackforge/kolla: WIP: Make heat stack-create work https://review.openstack.org/220765 | 02:19 |
*** klint has joined #kolla | 02:46 | |
*** dayou has quit IRC | 02:51 | |
*** dimsum__ has quit IRC | 02:58 | |
*** dayou has joined #kolla | 02:59 | |
openstackgerrit | Steven Dake proposed stackforge/kolla: Make heat stack-create work https://review.openstack.org/220765 | 03:16 |
SamYaple | pbourke: re dependacy that should run after role, yea we can do that | 03:28 |
SamYaple | sdake: we dont registry v3 endpoints yet | 03:31 |
sdake | i could be wrong about commit message - that second thing is reuqired - by code investigation | 03:32 |
sdake | otherwise plugin doesn't load propelry | 03:32 |
sdake | i dont know how you ever got it to work in your envrionment | 03:32 |
sdake | i tried ubuntu images, didn't work for me | 03:33 |
sdake | say i cranked of the max pool size thing and glance registry is always having problems with the sql error | 03:33 |
sdake | any tips? | 03:33 |
sdake | only happens 3 node | 03:33 |
*** banix has joined #kolla | 03:34 | |
sdake | 4 hours spent reading code today - heat totally different then I remember it ;) | 03:34 |
*** dayou has quit IRC | 03:42 | |
*** dayou has joined #kolla | 03:55 | |
*** banix has quit IRC | 03:56 | |
*** dimsum__ has joined #kolla | 03:59 | |
*** dimsum__ has quit IRC | 04:06 | |
*** weiyu has quit IRC | 04:21 | |
*** weiyu has joined #kolla | 04:22 | |
*** weiyu has quit IRC | 04:27 | |
*** Haomeng has joined #kolla | 05:12 | |
*** Haomeng|2 has quit IRC | 05:15 | |
*** weiyu has joined #kolla | 05:19 | |
*** weiyu has quit IRC | 05:35 | |
*** weiyu_ has joined #kolla | 06:21 | |
*** weiyu_ has quit IRC | 06:22 | |
sdake | launching 5 nova instances with 3 controller nodes takes 195 connections | 06:24 |
sdake | drops back down to 105 connections | 06:25 |
sdake | max for mysql is 150 - need to rais ethat | 06:26 |
*** Haomeng|2 has joined #kolla | 06:44 | |
*** weiyu_ has joined #kolla | 06:45 | |
*** Haomeng has quit IRC | 06:47 | |
*** vinkman has quit IRC | 07:46 | |
*** vinkman has joined #kolla | 07:56 | |
*** vinkman has quit IRC | 08:21 | |
*** sdake_ has joined #kolla | 08:51 | |
*** sdake has quit IRC | 08:54 | |
*** dayou has quit IRC | 09:04 | |
sdake_ | samyaple that auth change to heat was merged in september 4th | 09:35 |
sdake_ | the patch was april 28th | 09:35 |
sdake_ | e43ef0ed0936b6eea08bb9d89a55547c33d2ed4a | 09:36 |
sdake_ | git commit | 09:36 |
*** zhiwei has quit IRC | 10:27 | |
SamYaple | sdake_: yea that I can believe | 10:36 |
SamYaple | that heat just came around and merged a breaking patch 2 days ago | 10:36 |
sdake_ | i am just going to use admin_password and admin_user for now, and file a tech debt bug | 10:37 |
sdake_ | if we get to it in rc1, so be it, but we have alot of higher priority things to sort out then a deprecation warning | 10:37 |
SamYaple | ugh that is a bad patch that was merged :/ | 10:37 |
SamYaple | https://review.openstack.org/#/c/220586/ | 10:37 |
SamYaple | thats not the proper way t ofail | 10:38 |
sdake_ | file a bug | 10:38 |
SamYaple | im reopening that bug... | 10:38 |
sdake_ | wfm | 10:38 |
SamYaple | this doesnt need a new bug | 10:38 |
sdake_ | your right thats better | 10:38 |
SamYaple | whats better? | 10:39 |
SamYaple | oh yea | 10:39 |
sdake_ | reopning the bug | 10:39 |
SamYaple | yea | 10:39 |
SamYaple | launchpad is bombing out on me | 10:39 |
sdake_ | fwiw patch looks correct to me | 10:40 |
sdake_ | but i am not a ansible rocket scientist | 10:40 |
SamYaple | there is a completely seperate task to check failures | 10:41 |
SamYaple | thats not even how we doit _within_ this project | 10:41 |
SamYaple | im not asking people to know new things, but we use 'failed_when' all over this project | 10:41 |
sdake_ | learning experience for all | 10:41 |
SamYaple | yea | 10:41 |
sdake_ | i can get heat to launch 25 vms over 3 boxes in about 5 sconds | 10:45 |
SamYaple | sounds about right | 10:50 |
sdake_ | [sdake@minime-01 ~]$ ./status | 10:54 |
sdake_ | Threads_connected 85 | 10:54 |
sdake_ | Threads_running 1 | 10:54 |
sdake_ | [sdake@minime-01 ~]$ | 10:54 |
SamYaple | yea thats the threading config options im fixing for rc1 | 10:54 |
SamYaple | right now we just use teh defaults | 10:54 |
SamYaple | sometimes the default is 1 | 10:54 |
sdake_ | those are connections | 10:54 |
SamYaple | sometimes it defaults to something saner | 10:54 |
sdake_ | to mariadb | 10:55 |
SamYaple | im aware | 10:55 |
SamYaple | thats pretty normal | 10:55 |
sdake_ | heat stack launch -> Threads_connected 219 | 10:56 |
*** weiyu_ has quit IRC | 11:01 | |
openstackgerrit | Steven Dake proposed stackforge/kolla: Make heat stack-create work https://review.openstack.org/220765 | 11:04 |
openstackgerrit | Steven Dake proposed stackforge/kolla: Permit larger database connection count https://review.openstack.org/220805 | 11:13 |
openstackgerrit | Steven Dake proposed stackforge/kolla: Revert "Fix rabbitmq part 2" https://review.openstack.org/220806 | 11:14 |
sdake_ | samyaple i ithink the sleep would work if it was variable per node | 11:15 |
sdake_ | but atm its sleep in one spot as one task | 11:15 |
sdake_ | so its still synchronized starting | 11:15 |
SamYaple | sdake_: i dont think you understand the issue | 11:15 |
sdake_ | no i dont | 11:15 |
*** sdake_ is now known as sdake | 11:15 | |
SamYaple | thats not what would work | 11:15 |
sdake | but it still doesn't work ;) | 11:15 |
SamYaple | it has to start synchronized | 11:16 |
sdake | interesting didn't know that | 11:16 |
SamYaple | whyd you merge it then | 11:16 |
sdake | i tested it | 11:16 |
sdake | it appeared to work | 11:16 |
sdake | it now does not appear to work | 11:16 |
sdake | i have run over 30 deployments tonight eery time rabbitmq fails | 11:16 |
sdake | with a segfault | 11:16 |
sdake | only multinode | 11:16 |
SamYaple | segfault is not caused by sleep | 11:17 |
SamYaple | thats a completemy different issue | 11:17 |
SamYaple | the sleep does fix the actual race condition i see | 11:17 |
sdake | the problem i am having is rabbitmq crashes on startup | 11:17 |
sdake | isn't that this issue? | 11:17 |
SamYaple | nope | 11:18 |
SamYaple | docker is down so gate is down | 11:19 |
sdake | fantastic | 11:19 |
* sdake wtb reliable infrastructure to count on | 11:19 | |
SamYaple | hey im not cool with changing the augment files | 11:20 |
SamYaple | we dont put things in there | 11:20 |
sdake | i thought you said thts what you wante to do with that config option | 11:20 |
SamYaple | no thats where the _deployer_ would put it | 11:20 |
SamYaple | im not ok with setting htat options for the deployer in kolla | 11:20 |
sdake | which, both? | 11:20 |
SamYaple | no the template one is cool | 11:21 |
SamYaple | no problem there | 11:21 |
SamYaple | the openstack option | 11:21 |
sdake | let me test, i guess we could document it | 11:21 |
sdake | lemme testsee if its even necessary | 11:21 |
SamYaple | we have specficially been doing a stripped down config and i want to keep it that way | 11:21 |
sdake | agree i want thatas well | 11:21 |
sdake | let me test i'll get back to you | 11:22 |
openstackgerrit | Sam Yaple proposed stackforge/kolla: Properly check failed status https://review.openstack.org/220808 | 11:22 |
*** dimsum__ has joined #kolla | 11:24 | |
sdake | sam can you sort out the network port thing | 11:25 |
sdake | or put a solution in the bug tracker so osmoene lse an sort ito ut | 11:25 |
sdake | there are sevearl quetions per day on it | 11:25 |
SamYaple | ugh fine | 11:25 |
sdake | tia :) | 11:25 |
SamYaple | ill do the simply but not so cool fix | 11:25 |
SamYaple | we can make it better if needed later | 11:25 |
SamYaple | its still clean | 11:26 |
sdake | as long as it works | 11:26 |
sdake | keep in mind we have years to make kolla perfect | 11:26 |
sdake | but it needs to work by 25th :) | 11:26 |
SamYaple | yep | 11:26 |
SamYaple | heat did a bad thing | 11:31 |
SamYaple | its using a deprecated-this-cycle option as the only option | 11:31 |
SamYaple | bad heat bad | 11:31 |
SamYaple | thats actually a bug | 11:32 |
*** dimsum__ has quit IRC | 11:32 | |
sdake | its not the only option | 11:33 |
sdake | but ya bunch of fial that change was | 11:33 |
SamYaple | you cant use the deprecated name | 11:33 |
SamYaple | so it kinda is | 11:33 |
sdake | there was no name deprecated? | 11:33 |
SamYaple | user-name username | 11:34 |
sdake | oh that one | 11:34 |
SamYaple | yea you cant do that | 11:34 |
sdake | ya i know | 11:34 |
sdake | i was meaning to file a bug on that - i have a log of it on one of my machines | 11:34 |
SamYaple | i think its a bug because they are looking up the wrong values | 11:35 |
SamYaple | admin_password isn't a value provided by the password method | 11:36 |
SamYaple | thats like really old school auth methond | 11:37 |
SamYaple | this is just straight up bad | 11:37 |
SamYaple | https://github.com/openstack/heat/commit/e14a0895c1fe55b6ac34d6f4b9366359c2ebaab2 lines 155-159 should replease 173-178 | 11:38 |
SamYaple | replace | 11:38 |
*** pbourke has quit IRC | 11:38 | |
SamYaple | why they fetch the vaules directly like that is beyond me | 11:38 |
SamYaple | what a horrible way to implement a deprecation | 11:38 |
SamYaple | by pointing to ancient optoins | 11:38 |
*** pbourke has joined #kolla | 11:38 | |
sdake | good news - we dont need that override in database.conf to have a functional system | 11:39 |
SamYaple | im aware | 11:39 |
SamYaple | we also dont need to screw iwth galera.cnf | 11:39 |
SamYaple | but im ok with that change if it helps centos | 11:39 |
sdake | default is 151 | 11:40 |
SamYaple | i know | 11:40 |
sdake | if you go over tht, you get database full errors or something like that | 11:40 |
SamYaple | im aware | 11:40 |
SamYaple | hey why did you remove the trustee section? | 11:40 |
sdake | because i filed a tech debt bug | 11:41 |
sdake | so someone else could look at it at a later time | 11:41 |
sdake | when heat gets the code base working | 11:41 |
sdake | i couldn't getit to work | 11:41 |
SamYaple | im not ok with introducing the admin_user and admin_password optoins | 11:41 |
sdake | temporary sam | 11:41 |
SamYaple | those are old and busted options ive kept out since they are old and busted | 11:41 |
SamYaple | so but them in your overrides | 11:41 |
SamYaple | ... | 11:41 |
sdake | but they are needed to make heat work | 11:41 |
SamYaple | in your overrides | 11:41 |
SamYaple | heat is not stable it doesnt get deployed by default | 11:42 |
sdake | anyting tht is neede to make it work out of the box, shuld be configed in | 11:42 |
SamYaple | we cant be tweaking the heat conf everyday to make it work | 11:42 |
SamYaple | this wil lnot stand until liberty or probably even the end of the week | 11:42 |
sdake | if somone comes and addresses the problem in a different wy fantstic | 11:43 |
sdake | if not, then we have a functional heat today | 11:43 |
sdake | vs whenever omeone gets around to making tht other option work | 11:43 |
sdake | i spent hours trying | 11:43 |
SamYaple | no | 11:43 |
SamYaple | ddue im not merging thos old options | 11:44 |
SamYaple | if heat is broke upstream its broke upstream | 11:44 |
sdake | just work with me here sam, i really need kolla to be in solid shape rapidly | 11:44 |
SamYaple | kolla is, heat is busted | 11:44 |
SamYaple | if you want to include those in your overrides g ofor it | 11:44 |
sdake | i get thta, but people will see "kolal doesn't deploy heat as it expects, its busted" | 11:45 |
sdake | that is how devstck deploys heat ffs | 11:45 |
SamYaple | listen i get what youre saying, but this is a heat bug | 11:45 |
SamYaple | this should be fixed in heat | 11:45 |
SamYaple | which could easily be done btw | 11:46 |
sdake | we put workarounds in all the time for busted upstreams | 11:46 |
SamYaple | if you want to _workaround_ the heat issue, thats exactly what i built the augment stuff for | 11:46 |
sdake | that is what depoyment tools do | 11:46 |
sdake | explain to me the harm | 11:46 |
SamYaple | its a slippery slope that i wont go down | 11:47 |
sdake | its two options in one file | 11:47 |
sdake | hardly slippery | 11:47 |
SamYaple | one optoin, hten two then we are merging options to fix everyones issues | 11:47 |
SamYaple | this is master, its always broken from upstream | 11:48 |
sdake | like murano and not having support for oslo as they shouold? | 11:48 |
SamYaple | what about that? most services dont | 11:48 |
SamYaple | this is clearly a regression that was _just_ introduced in heat | 11:48 |
SamYaple | stop trying ot make kolla fix heat | 11:48 |
SamYaple | go fix heat | 11:48 |
sdake | this was ALREADY a feature of heat | 11:49 |
sdake | heta already let people overload that field with those values | 11:50 |
sdake | waht they did was deprecate that 2 days ago | 11:50 |
sdake | they didn't break anything | 11:50 |
SamYaple | that is absolutely not what happened here | 11:50 |
SamYaple | the deprecated option warning has nothing to do with this | 11:50 |
sdake | sam go look at the last ptch for het i submitted, heat worked then, and it had these options | 11:50 |
sdake | and yu took them out and heat broke from that point forward | 11:50 |
SamYaple | except you know it didnt | 11:51 |
SamYaple | since it worked | 11:51 |
SamYaple | it wasnt until sept 4th that it worked | 11:51 |
SamYaple | it was working before my weekend | 11:51 |
sdake | heat never worked for me - your verison | 11:51 |
sdake | weeks ago wasn't working | 11:51 |
sdake | i said lets merge and fix down the road | 11:52 |
sdake | this is down teh road | 11:52 |
SamYaple | whats the issue with fixing it the none deprecated way now and not having this conversation again? | 11:52 |
SamYaple | you filed a techdebt bug to fix an issue and dont fix the issue? | 11:52 |
sdake | i dont know how to fix it that way | 11:53 |
sdake | or god damnit sam i would have to keep you fr0om making stupid arguments with me | 11:53 |
SamYaple | youre the one that tries to merge dumb stuff like this. im agruing to keep it clean and do it right | 11:53 |
SamYaple | lets do it right | 11:53 |
SamYaple | thats my motto | 11:53 |
sdake | how long you been developing software sam? | 11:54 |
sdake | you work with what is around you, not taking high road,s not putting ines in the sand | 11:54 |
sdake | lines in the sand lead to the dark side | 11:54 |
SamYaple | god dammit dude. you wanted to merge that god damn source patch because you couldnt setup your environemnt. dont even give me that crap | 11:54 |
sdake | its called a workaround for a reason | 11:54 |
SamYaple | so no | 11:54 |
SamYaple | i dont accept that workaround | 11:54 |
sdake | that is in the past | 11:54 |
SamYaple | do it right | 11:55 |
sdake | forget about that, that was clearly a mistake | 11:55 |
sdake | this is corret based upon code inspection | 11:55 |
SamYaple | and this is now and when its done right ill tel lyou about this time _next_ time | 11:55 |
sdake | sam i absolutely need master heat working right now | 11:56 |
sdake | because as is its broken | 11:56 |
sdake | flat broken | 11:56 |
openstackgerrit | Steven Dake proposed stackforge/kolla: Permit larger database connection count https://review.openstack.org/220805 | 11:56 |
SamYaple | yea because of a bug in _heat_ | 11:57 |
sdake | i dont agree its a bug | 12:00 |
sdake | get heat guys to agree to that - and i'll workaroound in conf files | 12:00 |
SamYaple | or, like always,m ill not argue about deprecated options and do it right | 12:00 |
sdake | and i'll document it so people will have an out of the box experience that involves customizing to get a basic working installation | 12:00 |
sdake | it was deprecated 2 days ago dude | 12:01 |
SamYaple | for the love of god that is not whats happening here | 12:01 |
SamYaple | ah look at that. a non bad solution | 12:36 |
SamYaple | what was that an hours worth of work | 12:36 |
SamYaple | sdake: i responded in the heat patch one | 12:46 |
SamYaple | try it out, works for me | 12:46 |
*** klint has quit IRC | 12:59 | |
*** dimsum__ has joined #kolla | 13:05 | |
*** sdake has quit IRC | 13:15 | |
*** jtriley has joined #kolla | 14:07 | |
*** banix has joined #kolla | 14:10 | |
*** banix has quit IRC | 14:35 | |
*** jtriley has quit IRC | 14:47 | |
*** dimsum__ has quit IRC | 15:09 | |
*** chandankumar has joined #kolla | 15:39 | |
*** dimsum__ has joined #kolla | 16:09 | |
*** jtriley has joined #kolla | 16:13 | |
*** dimsum__ has quit IRC | 16:15 | |
*** jtriley has quit IRC | 16:18 | |
*** vinkman has joined #kolla | 17:07 | |
*** vinkman has quit IRC | 17:24 | |
*** daneyon has joined #kolla | 18:01 | |
*** daneyon has quit IRC | 18:12 | |
*** chandankumar has quit IRC | 18:13 | |
*** jtriley has joined #kolla | 18:32 | |
*** jtriley has quit IRC | 18:46 | |
*** dimsum__ has joined #kolla | 18:57 | |
*** dimsum__ has quit IRC | 19:02 | |
openstackgerrit | Merged stackforge/kolla: Permit larger database connection count https://review.openstack.org/220805 | 19:04 |
openstackgerrit | Merged stackforge/kolla: Import not found for glance https://review.openstack.org/220756 | 19:05 |
*** vinkman has joined #kolla | 20:25 | |
*** dimsum__ has joined #kolla | 20:29 | |
*** dimsum__ has quit IRC | 20:35 | |
*** jtriley has joined #kolla | 20:38 | |
*** jtriley has quit IRC | 20:51 | |
*** vbel1 has quit IRC | 21:40 | |
*** vbel1 has joined #kolla | 21:40 | |
*** dimsum__ has joined #kolla | 21:53 | |
*** dimsum__ has quit IRC | 22:06 | |
*** weiyu has joined #kolla | 22:32 | |
*** weiyu has quit IRC | 22:59 | |
*** jmccarthy has quit IRC | 23:20 | |
*** jmccarthy has joined #kolla | 23:21 | |
*** weiyu has joined #kolla | 23:25 | |
*** dimsum__ has joined #kolla | 23:52 | |
*** dimsum__ has quit IRC | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!