| *** yamamoto has joined #openstack-meeting-5 | 00:06 | |
| *** yamamoto has quit IRC | 00:11 | |
| *** mjturek has quit IRC | 00:14 | |
| *** slaweq has joined #openstack-meeting-5 | 00:17 | |
| *** slaweq has quit IRC | 00:21 | |
| *** yamamoto has joined #openstack-meeting-5 | 01:07 | |
| *** yamamoto has quit IRC | 01:13 | |
| *** yamahata has quit IRC | 01:29 | |
| *** pabelanger_ has joined #openstack-meeting-5 | 02:02 | |
| *** pabelanger has quit IRC | 02:03 | |
| *** pabelang- has joined #openstack-meeting-5 | 02:03 | |
| *** pabelang- is now known as pabelanger | 02:05 | |
| *** pabelanger_ has quit IRC | 02:06 | |
| *** yamamoto has joined #openstack-meeting-5 | 02:09 | |
| *** ricolin__ has joined #openstack-meeting-5 | 02:14 | |
| *** yamamoto has quit IRC | 02:15 | |
| *** yamamoto has joined #openstack-meeting-5 | 03:11 | |
| *** yamamoto has quit IRC | 03:16 | |
| *** jbryce_ has joined #openstack-meeting-5 | 04:03 | |
| *** jbryce has quit IRC | 04:03 | |
| *** mrhillsman has quit IRC | 04:03 | |
| *** jbryce_ is now known as jbryce | 04:03 | |
| *** mrhillsman has joined #openstack-meeting-5 | 04:04 | |
| *** yamamoto has joined #openstack-meeting-5 | 04:13 | |
| *** yamamoto has quit IRC | 04:18 | |
| *** markvoelker has quit IRC | 04:37 | |
| *** mrhillsman has quit IRC | 05:29 | |
| *** mrhillsman has joined #openstack-meeting-5 | 05:30 | |
| *** markvoelker has joined #openstack-meeting-5 | 05:38 | |
| *** yamamoto has joined #openstack-meeting-5 | 06:16 | |
| *** yamamoto has quit IRC | 06:22 | |
| *** ianychoi has joined #openstack-meeting-5 | 06:38 | |
| *** slaweq has joined #openstack-meeting-5 | 06:50 | |
| *** radeks has joined #openstack-meeting-5 | 06:56 | |
| *** yamamoto has joined #openstack-meeting-5 | 07:10 | |
| *** yamamoto has quit IRC | 07:14 | |
| *** yamamoto has joined #openstack-meeting-5 | 07:14 | |
| *** yamamoto_ has joined #openstack-meeting-5 | 07:39 | |
| *** yamamoto has quit IRC | 07:42 | |
| *** ianychoi has quit IRC | 08:04 | |
| *** ianychoi has joined #openstack-meeting-5 | 08:10 | |
| *** derekh has joined #openstack-meeting-5 | 08:32 | |
| *** yamamoto_ has quit IRC | 08:36 | |
| *** yamamoto has joined #openstack-meeting-5 | 08:37 | |
| *** ricolin__ has quit IRC | 09:23 | |
| *** hoangcx has joined #openstack-meeting-5 | 10:00 | |
| *** hoangcx has quit IRC | 10:41 | |
| *** hoangcx has joined #openstack-meeting-5 | 10:42 | |
| *** slaweq_ has joined #openstack-meeting-5 | 12:03 | |
| *** slaweq has quit IRC | 12:06 | |
| *** slaweq has joined #openstack-meeting-5 | 12:07 | |
| *** slaweq_ has quit IRC | 12:08 | |
| *** markvoelker has quit IRC | 12:25 | |
| *** yamamoto has quit IRC | 12:25 | |
| *** markvoelker has joined #openstack-meeting-5 | 12:25 | |
| *** yamamoto has joined #openstack-meeting-5 | 12:25 | |
| *** yamamoto has quit IRC | 12:26 | |
| *** yamamoto has joined #openstack-meeting-5 | 12:26 | |
| *** diman has joined #openstack-meeting-5 | 12:42 | |
| *** diman has quit IRC | 12:46 | |
| *** ianychoi_ has joined #openstack-meeting-5 | 13:07 | |
| *** ianychoi has quit IRC | 13:10 | |
| *** yamamoto has quit IRC | 13:39 | |
| *** yamamoto has joined #openstack-meeting-5 | 13:39 | |
| *** felipemonteiro has joined #openstack-meeting-5 | 13:42 | |
| *** yamamoto has quit IRC | 13:44 | |
| *** felipemonteiro_ has joined #openstack-meeting-5 | 13:46 | |
| *** felipemonteiro has quit IRC | 13:50 | |
| *** yamamoto has joined #openstack-meeting-5 | 14:01 | |
| *** hoangcx has quit IRC | 14:08 | |
| *** hoangcx has joined #openstack-meeting-5 | 14:08 | |
| *** hongbin_ has joined #openstack-meeting-5 | 14:10 | |
| *** alanmeadows has quit IRC | 14:11 | |
| *** alanmeadows has joined #openstack-meeting-5 | 14:12 | |
| *** felipemonteiro_ has quit IRC | 14:16 | |
| *** felipemonteiro__ has joined #openstack-meeting-5 | 14:16 | |
| *** cristicalin has joined #openstack-meeting-5 | 14:16 | |
| *** slaweq_ has joined #openstack-meeting-5 | 14:18 | |
| *** slaweq has quit IRC | 14:21 | |
| *** mjturek has joined #openstack-meeting-5 | 14:21 | |
| *** seaneagan has joined #openstack-meeting-5 | 14:38 | |
| *** gagehugo has joined #openstack-meeting-5 | 14:42 | |
| *** cristicalin has quit IRC | 14:48 | |
| *** cristicalin has joined #openstack-meeting-5 | 14:49 | |
| mattmceuen | #startmeeting openstack-helm | 15:00 |
|---|---|---|
| openstack | Meeting started Tue Apr 17 15:00:10 2018 UTC and is due to finish in 60 minutes. The chair is mattmceuen. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| *** openstack changes topic to " (Meeting topic: openstack-helm)" | 15:00 | |
| openstack | The meeting name has been set to 'openstack_helm' | 15:00 |
| mattmceuen | #topic rollcall | 15:00 |
| *** openstack changes topic to "rollcall (Meeting topic: openstack-helm)" | 15:00 | |
| cristicalin | o/ | 15:00 |
| mattmceuen | o/ cristi | 15:00 |
| jayahn | o/ | 15:00 |
| jayahn | I am back. :) | 15:01 |
| cristicalin | hey matt & all | 15:01 |
| mattmceuen | https://etherpad.openstack.org/p/openstack-helm-meeting-2018-04-17 <- agenda for today, please add things you'd like to discuss | 15:01 |
| srwilkers | o/ | 15:01 |
| mattmceuen | Hey jayahn! | 15:01 |
| lamt | o/ | 15:02 |
| jayahn | sorry, i was overwhelmed by some management crab (but important ones) | 15:02 |
| jayahn | crap | 15:02 |
| mattmceuen | I feel your pain man | 15:02 |
| mattmceuen | #topic Active/Passive MariaDB | 15:02 |
| *** openstack changes topic to "Active/Passive MariaDB (Meeting topic: openstack-helm)" | 15:02 | |
| srwilkers | you just gave me a proper name for the crab i just got tattooed on my arm jayahn | 15:03 |
| srwilkers | "management crab" | 15:03 |
| mattmceuen | +1 | 15:03 |
| jayahn | lol | 15:03 |
| mattmceuen | criticalin brought this up last time -- A/P MariaDB (not crabs) | 15:03 |
| *** diman has joined #openstack-meeting-5 | 15:03 | |
| mattmceuen | I don't think portdirect is able to join today unfortunately | 15:03 |
| mattmceuen | But he's planning on digging into MariaDB resiliency this week | 15:04 |
| cristicalin | hmm, that's gonna be kind of one-sided then | 15:04 |
| jayahn | including mariadb deadlock? | 15:04 |
| cristicalin | I've had a look on what he was saying about the ipvs implementation of services | 15:04 |
| mattmceuen | His plan is to fix Galera clustering -- we've had a PS out for quite a while but it hasn't gotten to mergability | 15:04 |
| cristicalin | but I don't think that's gonna help | 15:04 |
| cristicalin | jayahn, the deadlock is due to the random nature of the k8s services | 15:05 |
| mattmceuen | What is your concern w/ that approach cristicalin? | 15:05 |
| cristicalin | all writes need to land on the same node | 15:05 |
| cristicalin | we use haproxy in front but we don't run maria in k8s | 15:05 |
| jayahn | we also used haproxy in front at "legacy" openstack | 15:05 |
| cristicalin | we tried with proxysql but turned out to be too complicated | 15:05 |
| cristicalin | I like the oracle sql router approach which uses the db to elect the master | 15:06 |
| cristicalin | though I don't think it works with mariadb | 15:06 |
| cristicalin | also probably just an 8.0+ feature | 15:06 |
| portdirect | we need to scope where these deadlocks occur - as far as im aware only nova and heat suffer from the potential for deadlocks. Im exploring both ipvs (via keepalived) and a proxy approach | 15:07 |
| cristicalin | o/ portdirect | 15:07 |
| jayahn | o/ | 15:07 |
| cristicalin | actually neutron is the most affected by deadlocks | 15:07 |
| portdirect | o/ sorry snowed under today, so may be a bit terse ;) | 15:07 |
| cristicalin | nova is not so affected unless you throw a ton of workload at it | 15:07 |
| *** diman has quit IRC | 15:08 | |
| portdirect | well then - we need to get them all fixed :) | 15:08 |
| cristicalin | heat might have some convergence issues, though I haven't tested how far it breaks | 15:08 |
| portdirect | you can increment a counter and blow it up 100% of the time | 15:08 |
| * jayahn think prodirect is great english teacher. I just leanrd "snowed under" today. | 15:08 | |
| portdirect | currently im thinking that an ingress controller with a custom template may be the cleanest solution | 15:09 |
| *** felipemonteiro_ has joined #openstack-meeting-5 | 15:10 | |
| cristicalin | I'm not so familiar with using ingresses | 15:10 |
| cristicalin | we don't use them at all in our environments | 15:10 |
| portdirect | it would provide the same result as std a/p haproxy | 15:10 |
| portdirect | but use k8s for backend healthchecks | 15:10 |
| cristicalin | and what would the ing be based on ? | 15:11 |
| cristicalin | haproxy | 15:11 |
| portdirect | i think so | 15:11 |
| portdirect | nginx streams could work | 15:11 |
| portdirect | but i think haproxy seems the safest choice here | 15:12 |
| cristicalin | the most tested at least | 15:12 |
| portdirect | though I'd like to test both | 15:12 |
| cristicalin | I never used nginx in front of mysql | 15:12 |
| srwilkers | im less concerned about what's most tested, more concerned about what we can put up and see how it works | 15:12 |
| srwilkers | i agree with portdirect: would be nice to try both and see what works | 15:12 |
| *** felipemonteiro__ has quit IRC | 15:13 | |
| cristicalin | I'd be happy to ask our guys to help in testing | 15:14 |
| portdirect | cristicalin: that would be awesome | 15:15 |
| portdirect | soon as i get a wip up I'll add you and jay as reviewer | 15:15 |
| portdirect | s | 15:15 |
| mattmceuen | It may be helpful to spec this out to ensure the solution is understood (including alternate approaches like nginx vs haproxy) and what/how we're solving the deadlock issue -- i.e. list out the alternatives and why we arrived at what we think is an optimal solution? | 15:16 |
| jayahn | okay. I will ask our guys as well. | 15:16 |
| *** yamamoto has quit IRC | 15:17 | |
| mattmceuen | that said - I don't want to spin on a spec for long, as this is clearly functionality we all want in place as soon as possible :) | 15:17 |
| *** yamamoto has joined #openstack-meeting-5 | 15:17 | |
| *** gmmaha has joined #openstack-meeting-5 | 15:19 | |
| cristicalin | any interest to support alternative mysql implementations ? | 15:20 |
| cristicalin | like percona or oracle mysql | 15:20 |
| portdirect | cristicalin: yes | 15:21 |
| portdirect | I'm planning on adding a vitess chart when i find time | 15:21 |
| cristicalin | hmm, interesting, you mentioned that in the PTG | 15:22 |
| cristicalin | did you do any tests with vitess yet ? | 15:22 |
| *** yamahata has joined #openstack-meeting-5 | 15:22 | |
| portdirect | just very basic ones - but looks promising | 15:22 |
| mattmceuen | neat | 15:23 |
| mattmceuen | alright - anything else on the DB front? | 15:24 |
| *** wxy| has joined #openstack-meeting-5 | 15:25 | |
| mattmceuen | #topic LMA values | 15:25 |
| *** openstack changes topic to "LMA values (Meeting topic: openstack-helm)" | 15:25 | |
| mattmceuen | jayahn - I haven't dug into the link you sent yet, but it sounded like a good discussion to have here | 15:25 |
| mattmceuen | Quoting | 15:25 |
| mattmceuen | Example armada-manifests skt is using in CI - https://github.com/sktelecom-oslab/armada-manifests/blob/master/taco-ha-example.yaml | 15:26 |
| mattmceuen | srwilkers: "syslog gathering" is enabled in this manifest. what things we want to include upstream lma values? If not, do we want at least a documentation on some lma use cases? | 15:26 |
| jayahn | I just lost power in my computer.. typing on mobile. | 15:26 |
| mattmceuen | d'oh | 15:26 |
| mattmceuen | perfect timing :) | 15:26 |
| jayahn | my macbook does not act normal. | 15:27 |
| mattmceuen | jayahn we definitely need to document some basic LMA operations | 15:27 |
| srwilkers | i think getting the kubelet logs via syslog makes sense here. it's a suitable default in my eyes | 15:27 |
| srwilkers | im currently working on getting elasticsearch to play nice with the s3 api for radosgw -- wanting to get that sorted out so we can also provide some useful defaults or guidance on maintaining indices long term | 15:28 |
| jayahn | okay. furthermore, sungil has a question on preparing some reference vlaue sets besides default, something like fluent-bit only case. | 15:29 |
| jayahn | we think it will help others. but, question is how? documentation? gating? | 15:29 |
| mattmceuen | jayahn, would it make sense to propose the syslog gathering and any other good defaults as a PS to the fluent chart? Then we can discuss any issues around them as defaults and get 'em merged | 15:30 |
| srwilkers | documentation makes sense, and maybe explore having a place to put some reference overrides? | 15:30 |
| jayahn | srwilkers: yeap. that | 15:30 |
| jayahn | mattmceuen: sure | 15:30 |
| jayahn | I can type good on mobile. :) | 15:31 |
| mattmceuen | Agree -- there are many opportunities to add additional reference overrides | 15:32 |
| mattmceuen | This is flexible software after all :) | 15:32 |
| mattmceuen | #topic Vancouver | 15:33 |
| jayahn | documentation might be enough, but we concerns that it will outdated if there is no check running against thoes ovverides. | 15:33 |
| *** openstack changes topic to "Vancouver (Meeting topic: openstack-helm)" | 15:33 | |
| mattmceuen | d'oh I jumped the gun | 15:33 |
| mattmceuen | There needs to be a countdown for these topic changes | 15:33 |
| jayahn | that was just my last comment. :) | 15:34 |
| mattmceuen | #topic one-last-LMA | 15:34 |
| *** openstack changes topic to "one-last-LMA (Meeting topic: openstack-helm)" | 15:34 | |
| jayahn | I will back with PS, we can do more discussion next week | 15:34 |
| mattmceuen | can we gate them? :) | 15:34 |
| jayahn | not everyone for sure. :) | 15:34 |
| jayahn | so we did not have our answer in team discussion. | 15:35 |
| mattmceuen | what about experimental gating that gets done periodically | 15:35 |
| jayahn | probably possible | 15:35 |
| portdirect | Id really like to see lma leveraged in the gates | 15:35 |
| portdirect | Should be the best way to get logs out... rather than my shanky xargs crazyness | 15:36 |
| * mattmceuen FYI jayahn I don't think shanky is a word, ignore professor portdirect | 15:36 | |
| jayahn | i was googling.. again | 15:36 |
| portdirect | https://www.merriam-webster.com/dictionary/skanky | 15:37 |
| *** ricolin__ has joined #openstack-meeting-5 | 15:37 | |
| *** ricolin__ has quit IRC | 15:38 | |
| * jayahn I heard my team members were discussing how creative professor portdirct's english is. | 15:38 | |
| mattmceuen | distinctly not the same thing :) I'm sure we can invent a good software engineering for shanky, I'll add it to a future agenda item | 15:38 |
| mattmceuen | *term | 15:38 |
| *** ricolin has joined #openstack-meeting-5 | 15:38 | |
| mattmceuen | alright - going once | 15:38 |
| mattmceuen | going twice | 15:39 |
| mattmceuen | #topic Vancouver-for-reals | 15:39 |
| *** openstack changes topic to "Vancouver-for-reals (Meeting topic: openstack-helm)" | 15:39 | |
| mattmceuen | Jay you added this as a "future topic" so we don't have to have the full discussion today | 15:39 |
| jayahn | it was a teaser for the next week meeting. | 15:39 |
| portdirect | Do we have a spec for the vms yet jayahn ? | 15:39 |
| portdirect | As that really deterimes what we can do | 15:40 |
| jayahn | vms.. try to recall what it is.. (sorry).. | 15:40 |
| jayahn | pls help me. vms.. | 15:40 |
| portdirect | The Virtual machines that your going to provide for the workshop | 15:40 |
| jayahn | ah.. | 15:41 |
| jayahn | okay. I will prepare the spec for the next meeting. it can be two specs with / without lma. | 15:41 |
| mattmceuen | cool | 15:42 |
| mattmceuen | Thanks jayahn | 15:42 |
| mattmceuen | One more thing to whet our appetites -- FYI lots of OSH talks in vancouver :) https://www.openstack.org/summit/vancouver-2018/summit-schedule/global-search?t=openstack-helm | 15:43 |
| mattmceuen | #topic PS Needing Review | 15:44 |
| *** openstack changes topic to "PS Needing Review (Meeting topic: openstack-helm)" | 15:44 | |
| mattmceuen | https://review.openstack.org/#/c/498929/ | 15:44 |
| mattmceuen | ^ srwilkers would be really nice to get Tempest merged in! What additional review do *you* feel you need on this | 15:45 |
| srwilkers | just eyes on it really | 15:45 |
| mattmceuen | Cool. Please help with that team and give it a spin for yourself. Can't have too much testing :) | 15:46 |
| mattmceuen | What else guys | 15:46 |
| mattmceuen | Other PS that have been languishing? | 15:46 |
| mattmceuen | 3 | 15:47 |
| mattmceuen | 2 | 15:47 |
| mattmceuen | 1 | 15:47 |
| mattmceuen | #topic Roundtable | 15:47 |
| *** openstack changes topic to "Roundtable (Meeting topic: openstack-helm)" | 15:47 | |
| mattmceuen | Anything else on your minds in the world of OSH or otherwise? | 15:48 |
| mattmceuen | alright guys - I'll give you 10 mins back | 15:49 |
| mattmceuen | Thanks for time & efforts! | 15:50 |
| jayahn | thanks. | 15:50 |
| mattmceuen | #endmeeting | 15:50 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:50 | |
| openstack | Meeting ended Tue Apr 17 15:50:11 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:50 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_helm/2018/openstack_helm.2018-04-17-15.00.html | 15:50 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_helm/2018/openstack_helm.2018-04-17-15.00.txt | 15:50 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_helm/2018/openstack_helm.2018-04-17-15.00.log.html | 15:50 |
| cristicalin | bye | 15:50 |
| *** gagehugo has left #openstack-meeting-5 | 15:50 | |
| *** cristicalin has quit IRC | 15:50 | |
| *** benj_ has quit IRC | 16:13 | |
| *** benj_ has joined #openstack-meeting-5 | 16:15 | |
| *** gmmaha has left #openstack-meeting-5 | 16:21 | |
| *** yamamoto_ has joined #openstack-meeting-5 | 16:30 | |
| *** yamamoto has quit IRC | 16:33 | |
| *** ricolin has quit IRC | 16:45 | |
| *** yamahata has quit IRC | 16:48 | |
| *** derekh has quit IRC | 16:58 | |
| *** wxy| has quit IRC | 16:58 | |
| *** yamamoto_ has quit IRC | 17:15 | |
| *** yamamoto has joined #openstack-meeting-5 | 17:16 | |
| *** yamahata has joined #openstack-meeting-5 | 17:17 | |
| *** felipemonteiro_ has quit IRC | 18:38 | |
| *** felipemonteiro_ has joined #openstack-meeting-5 | 18:39 | |
| *** hongbin_ has quit IRC | 18:41 | |
| *** hongbin_ has joined #openstack-meeting-5 | 18:41 | |
| *** felipemonteiro has joined #openstack-meeting-5 | 18:48 | |
| *** felipemonteiro_ has quit IRC | 18:48 | |
| *** felipemonteiro_ has joined #openstack-meeting-5 | 18:49 | |
| *** felipemonteiro has quit IRC | 18:53 | |
| *** iyamahat has joined #openstack-meeting-5 | 19:17 | |
| *** iyamahat has quit IRC | 19:45 | |
| *** radeks has quit IRC | 19:53 | |
| *** yamamoto has quit IRC | 20:29 | |
| *** yamamoto has joined #openstack-meeting-5 | 20:30 | |
| *** yamamoto has quit IRC | 20:34 | |
| *** iyamahat has joined #openstack-meeting-5 | 20:39 | |
| *** slaweq_ has quit IRC | 21:48 | |
| *** slaweq has joined #openstack-meeting-5 | 21:48 | |
| *** yamamoto has joined #openstack-meeting-5 | 21:52 | |
| *** slaweq has quit IRC | 21:53 | |
| *** yamamoto has quit IRC | 21:58 | |
| *** felipemonteiro_ has quit IRC | 22:10 | |
| *** yamamoto has joined #openstack-meeting-5 | 22:15 | |
| *** yamamoto has quit IRC | 22:20 | |
| *** yamamoto has joined #openstack-meeting-5 | 22:35 | |
| *** yamamoto has quit IRC | 22:42 | |
| *** hongbin_ has quit IRC | 22:58 | |
| *** yamamoto has joined #openstack-meeting-5 | 22:58 | |
| *** yamamoto has quit IRC | 23:03 | |
| *** yamamoto has joined #openstack-meeting-5 | 23:19 | |
| *** yamamoto has quit IRC | 23:24 | |
| *** yamamoto has joined #openstack-meeting-5 | 23:40 | |
| *** hoangcx_ has joined #openstack-meeting-5 | 23:43 | |
| *** hoangcx has quit IRC | 23:44 | |
| *** yamamoto has quit IRC | 23:46 | |
| *** slaweq has joined #openstack-meeting-5 | 23:49 | |
| *** slaweq has quit IRC | 23:54 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!