| *** markvoelker has quit IRC | 00:19 | |
| *** markvoelker has joined #openstack-meeting-5 | 00:47 | |
| *** slaweq has joined #openstack-meeting-5 | 01:11 | |
| *** slaweq has quit IRC | 01:15 | |
| *** yamamoto has joined #openstack-meeting-5 | 01:20 | |
| *** yamamoto has quit IRC | 01:24 | |
| *** yamahata has quit IRC | 01:31 | |
| *** ricolin has joined #openstack-meeting-5 | 01:43 | |
| *** hoangcx has joined #openstack-meeting-5 | 01:58 | |
| *** hoangcx has left #openstack-meeting-5 | 01:59 | |
| *** slaweq has joined #openstack-meeting-5 | 02:11 | |
| *** slaweq has quit IRC | 02:16 | |
| *** yamahata has joined #openstack-meeting-5 | 02:57 | |
| *** roman_g has quit IRC | 03:18 | |
| *** hoangcx has joined #openstack-meeting-5 | 03:26 | |
| *** hoangcx has left #openstack-meeting-5 | 03:27 | |
| *** hoangcx has joined #openstack-meeting-5 | 03:52 | |
| *** jgu has joined #openstack-meeting-5 | 04:00 | |
| *** hoangcx has left #openstack-meeting-5 | 04:03 | |
| *** slaweq has joined #openstack-meeting-5 | 04:11 | |
| *** slaweq has quit IRC | 04:16 | |
| *** iyamahat has joined #openstack-meeting-5 | 04:57 | |
| *** slaweq has joined #openstack-meeting-5 | 05:11 | |
| *** slaweq has quit IRC | 05:15 | |
| *** jgu has quit IRC | 05:38 | |
| *** yamamoto has joined #openstack-meeting-5 | 05:46 | |
| *** yamamoto has quit IRC | 05:48 | |
| *** yamamoto has joined #openstack-meeting-5 | 05:56 | |
| *** yamamoto has quit IRC | 06:00 | |
| *** slaweq has joined #openstack-meeting-5 | 06:11 | |
| *** skazi has joined #openstack-meeting-5 | 06:16 | |
| *** slaweq has quit IRC | 06:16 | |
| *** yamahata has quit IRC | 06:43 | |
| *** yamahata has joined #openstack-meeting-5 | 06:43 | |
| *** slaweq has joined #openstack-meeting-5 | 07:11 | |
| *** slaweq has quit IRC | 07:12 | |
| *** slaweq has joined #openstack-meeting-5 | 07:16 | |
| *** markvoelker has quit IRC | 07:29 | |
| *** derekh has joined #openstack-meeting-5 | 08:07 | |
| *** roman_g has joined #openstack-meeting-5 | 08:07 | |
| *** skazi has quit IRC | 08:07 | |
| *** yamamoto has joined #openstack-meeting-5 | 08:09 | |
| *** yamamoto has quit IRC | 08:26 | |
| *** ricolin has quit IRC | 08:42 | |
| *** markvoelker has joined #openstack-meeting-5 | 09:33 | |
| *** mariusv has joined #openstack-meeting-5 | 09:45 | |
| *** markvoelker has quit IRC | 10:04 | |
| *** skazi has joined #openstack-meeting-5 | 10:51 | |
| *** markvoelker has joined #openstack-meeting-5 | 11:01 | |
| *** MarkBaker has joined #openstack-meeting-5 | 11:10 | |
| *** yamamoto_ has joined #openstack-meeting-5 | 11:14 | |
| *** MarkBaker has quit IRC | 11:16 | |
| *** yamamoto_ has quit IRC | 11:27 | |
| *** markvoelker has quit IRC | 11:34 | |
| *** markvoelker has joined #openstack-meeting-5 | 12:12 | |
| *** MarkBaker has joined #openstack-meeting-5 | 12:51 | |
| *** MarkBaker has quit IRC | 13:04 | |
| *** gema has joined #openstack-meeting-5 | 13:04 | |
| *** ianychoi has quit IRC | 13:08 | |
| *** ianychoi has joined #openstack-meeting-5 | 13:08 | |
| *** MarkBaker has joined #openstack-meeting-5 | 13:09 | |
| *** ricolin has joined #openstack-meeting-5 | 13:30 | |
| *** skazi has quit IRC | 13:37 | |
| *** sidney has joined #openstack-meeting-5 | 13:49 | |
| *** jgu has joined #openstack-meeting-5 | 13:52 | |
| *** jgu_ has joined #openstack-meeting-5 | 13:55 | |
| *** jgu has quit IRC | 13:58 | |
| *** sidney has quit IRC | 14:15 | |
| *** mjturek has joined #openstack-meeting-5 | 14:17 | |
| *** wxy| has joined #openstack-meeting-5 | 14:31 | |
| *** John_ has joined #openstack-meeting-5 | 14:39 | |
| *** John_ is now known as Guest59024 | 14:40 | |
| *** Guest59024 has quit IRC | 14:44 | |
| *** lemko[m] has joined #openstack-meeting-5 | 14:47 | |
| *** john_W has joined #openstack-meeting-5 | 14:51 | |
| *** gagehugo has joined #openstack-meeting-5 | 14:52 | |
| *** shawn_telkamp_at has joined #openstack-meeting-5 | 14:56 | |
| *** vadym has joined #openstack-meeting-5 | 14:57 | |
| *** hongbin has joined #openstack-meeting-5 | 15:00 | |
| roman_g | Meetinh time? | 15:00 |
|---|---|---|
| portdirect | apparently :) | 15:01 |
| mattmceuen | #startmeeting openstack-helm | 15:01 |
| openstack | Meeting started Tue Jul 24 15:01:33 2018 UTC and is due to finish in 60 minutes. The chair is mattmceuen. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:01 |
| *** openstack changes topic to " (Meeting topic: openstack-helm)" | 15:01 | |
| mattmceuen | #topic Rollcall | 15:01 |
| openstack | The meeting name has been set to 'openstack_helm' | 15:01 |
| *** openstack changes topic to "Rollcall (Meeting topic: openstack-helm)" | 15:01 | |
| mattmceuen | GM/GE all! | 15:01 |
| roman_g | =) | 15:01 |
| portdirect | o/ | 15:02 |
| srwilkers | o/ | 15:02 |
| jgu_ | good morning | 15:02 |
| vadym | hi | 15:02 |
| mattmceuen | Here's the agenda for our openstack-helm weekly team meeting https://etherpad.openstack.org/p/openstack-helm-meeting-2018-07-24 | 15:02 |
| mattmceuen | Please add anything you'd like to discuss today | 15:02 |
| rwellum | o/ | 15:03 |
| mattmceuen | #topic Use Case for external k8s cluster and Ceph Cluster | 15:03 |
| *** openstack changes topic to "Use Case for external k8s cluster and Ceph Cluster (Meeting topic: openstack-helm)" | 15:03 | |
| jgu_ | ah that's mine :-). We are exploring the use case that deploys OSH on an existing k8s cluster, and a separate ceph cluster (i.e., not as containers on the k8s). | 15:04 |
| jgu_ | Is there already some document for this use case or interest in the use case? | 15:04 |
| mattmceuen | Good news jgu_ -- every OSH deployment is on an existing k8s cluster :) | 15:04 |
| mattmceuen | It's a "bring your own kubernetes" model | 15:04 |
| jgu_ | stand corrected :-) | 15:04 |
| mattmceuen | So that part should be all good | 15:04 |
| jgu_ | yes, bring your k8s and ceph | 15:05 |
| mattmceuen | The external ceph cluster can be done as well | 15:05 |
| mattmceuen | As the response in the agenda mentions, our SKT teammates use Ceph that way - do we have any reference overrides for this that we can share? | 15:05 |
| portdirect | not currently afaik | 15:05 |
| rwellum | I've been trying this too - and have some steps - but can't really comment too much because I haven't successfully got it working | 15:06 |
| portdirect | it would be great if we could get that in | 15:06 |
| portdirect | as i know jayahn's team did a load of good work to support it | 15:06 |
| jgu_ | We have documented the steps to integrate with the external ceph cluster for PVC’s used by mariadb and rabbitmq etc. And currently working on configuring glance (and possibly same for cinder, swift) charts to use the external ceph. | 15:06 |
| mattmceuen | d'oh rwellum - one more reason we need good reference material for it. Are your probs with the Ceph cluster itself, or with plugging it into OSH? | 15:06 |
| jgu_ | if there's work already on it, we'd love to leverage/use that | 15:06 |
| srwilkers | i think the best way would be to get a WIP up at least that outlines what's resulted in success so far | 15:08 |
| srwilkers | that way we can get more eyes on it and collaborate on it | 15:08 |
| *** hongbin has quit IRC | 15:08 | |
| *** hongbin has joined #openstack-meeting-5 | 15:08 | |
| mattmceuen | ++ | 15:08 |
| mattmceuen | We can try to pull in everyone who has experience with it (rwellum, SKT folks, etc) to weigh in on review | 15:09 |
| jgu_ | we got the bring yoour own k8s cluster working to the extent that we can provision the charts, but helm testing fails because the openstack service can't be accessed off the k8s nodes w/o LB or proxy | 15:09 |
| jgu_ | sounds great to me. | 15:09 |
| jgu_ | we'd love to share what we have learnt so far | 15:10 |
| mattmceuen | I think adding a new doc in here would be really valuable: https://github.com/openstack/openstack-helm/tree/master/doc/source/install | 15:10 |
| mattmceuen | Thanks jgu_! | 15:10 |
| mattmceuen | We'll get it to 100% | 15:10 |
| *** sgrasley has joined #openstack-meeting-5 | 15:10 | |
| jgu_ | cool... where would we start? get a spec or story board ticket or a PS to the doc? | 15:11 |
| mattmceuen | Yep I can create a storyboard story for you (or feel free to create one if you don't want to wait :) ) | 15:11 |
| mattmceuen | For the doc itself, you could just copy one of the existing docs in the `install` folder and modify it | 15:11 |
| rwellum | +1 | 15:12 |
| jgu_ | will do | 15:12 |
| mattmceuen | Thanks man | 15:12 |
| mattmceuen | Anything else anyone would like to discuss around ceph? | 15:13 |
| mattmceuen | #topic Progress update on enabling Galera survive OSH cluster restart? | 15:14 |
| *** openstack changes topic to "Progress update on enabling Galera survive OSH cluster restart? (Meeting topic: openstack-helm)" | 15:14 | |
| mattmceuen | Pete says: Still in flight :( https://review.openstack.org/#/c/583986/, getting close though. | 15:14 |
| portdirect | yeah - I hope to have it out of wip this week | 15:14 |
| mattmceuen | Nice! | 15:14 |
| portdirect | got sidetracked with some prod issues :( | 15:15 |
| mattmceuen | pesky prod issues | 15:15 |
| vadym | thanks guys | 15:15 |
| mattmceuen | #topic PS needing review | 15:15 |
| *** openstack changes topic to "PS needing review (Meeting topic: openstack-helm)" | 15:15 | |
| mattmceuen | https://review.openstack.org/#/c/585039/ | 15:15 |
| mattmceuen | ^ srwilkers already on it - thanks Steve | 15:16 |
| mattmceuen | That'll be a good one for anyone new to the team to review | 15:16 |
| srwilkers | np | 15:16 |
| srwilkers | https://review.openstack.org/#/c/579022/ could use some eyes too | 15:16 |
| mattmceuen | Because portdirect is adding good docs to helm-toolkit | 15:17 |
| mattmceuen | Good educational opportunity! | 15:17 |
| portdirect | i'm even finding some 18 month old bugs :D | 15:17 |
| srwilkers | ive been working on making elasticsearch a bit smarter/more lean, and ^ would help it a little bit | 15:17 |
| portdirect | oh - a perfect segway | 15:18 |
| mattmceuen | yes srwilkers - thanks for bringing tha tone up | 15:18 |
| mattmceuen | *one | 15:18 |
| mattmceuen | #topic And now for something completely different | 15:18 |
| *** openstack changes topic to "And now for something completely different (Meeting topic: openstack-helm)" | 15:18 | |
| portdirect | would be great if we can get some eyes on this: https://review.openstack.org/#/c/582620 | 15:18 |
| portdirect | esp how we should get lma into this picture | 15:19 |
| portdirect | as both a method of reporting issues | 15:19 |
| portdirect | and `0 touch` probing | 15:19 |
| mattmceuen | +1 | 15:19 |
| srwilkers | hmm | 15:20 |
| mattmceuen | Getting good probes is really important and wide-ranging, this is a good one for a spec (and a good one to get lots of eyeballs on) | 15:20 |
| srwilkers | what'd you have in mind for 0 touch probing? | 15:21 |
| portdirect | as in saying `im ill` without effecting the pod | 15:22 |
| *** gmmaha has joined #openstack-meeting-5 | 15:22 | |
| portdirect | as this can sometimes have pretty disaterious effects on a cluster | 15:22 |
| portdirect | eg: if external DNS is down, we want to report this | 15:22 |
| portdirect | but not necessarily kill, or mark unready, the dns pod | 15:22 |
| portdirect | theres loads of other examples | 15:23 |
| mattmceuen | we should only whack pods when we're pretty certain whacking the pod will fix the issue, yes? | 15:23 |
| mattmceuen | light touch | 15:23 |
| portdirect | ^^ | 15:23 |
| portdirect | in many cases we know somthings wrong, but require `quantum computing` * to fix | 15:24 |
| portdirect | * the cheapest quantum computer avalible to most orgs is somone in ops | 15:24 |
| roman_g | could pod return status "not ready yet" in such cases? | 15:25 |
| srwilkers | okay, as long as we're including the ability to avoid marking pods as unready. having something like prometheus determine whether we can mark a pod as ready or not scares me a bit, as all it takes is a PVC filling up to cause prometheus to stop gathering metrics | 15:25 |
| srwilkers | and if prometheus was responsible for determining some part of readiness in that scenario, nothing is going to be ready | 15:25 |
| portdirect | roman_g: resuting not ready yet, can (and does) cause issues in itself | 15:25 |
| mattmceuen | I don't see anything around the lma probe (I'm going to go ahead and coin `logliness probe`) in the spec yet - wanting to add that in there, or separate portdirect? | 15:25 |
| portdirect | srwilkers: i think you getting the wrong end of the stick here | 15:25 |
| srwilkers | portdirect: i think so too. thats why i asked for clarification :) | 15:26 |
| portdirect | what im getting at is more that lma should be the 1st step of the heath reporting of a cluster | 15:26 |
| srwilkers | on that, we agree | 15:26 |
| portdirect | and then automatic and atomic operrations can come in | 15:26 |
| portdirect | ie - livelyness/readyness probes | 15:26 |
| portdirect | Im not proposing coupling lma with that | 15:27 |
| portdirect | but in a spec, we need to look at the holistic picture | 15:27 |
| mattmceuen | LMA is for manual resolution; probes are for automated resolution (pod whacking) -- we want to save the automation for when we're quite sure ahead of time that pod whacking is the resolution | 15:27 |
| mattmceuen | when it takes human intelligence to resolve we should rely on lma instead of probes | 15:28 |
| portdirect | even pulling a pod out of 'ready' is essentially a wack - as it drops its endpoints | 15:28 |
| srwilkers | just sounds like smarter and more granular alarming to me | 15:28 |
| mattmceuen | yes | 15:28 |
| portdirect | exactly :) | 15:28 |
| srwilkers | cool | 15:28 |
| mattmceuen | smarter and more granular alarming == `logliness probe` | 15:29 |
| * srwilkers cringes | 15:29 | |
| mattmceuen | I'm like a dog with a bone | 15:29 |
| mattmceuen | moving on | 15:29 |
| mattmceuen | #topic Roundtable | 15:29 |
| *** openstack changes topic to "Roundtable (Meeting topic: openstack-helm)" | 15:29 | |
| mattmceuen | Who else has good jokes | 15:29 |
| mattmceuen | Or other topics | 15:29 |
| srwilkers | this has stagnated a bit, but would like to figure out a path forward for this one: https://review.openstack.org/#/c/559417/ | 15:29 |
| srwilkers | as this makes it possible to take care of our indexes better, as without it our only option is to just delete them | 15:30 |
| mattmceuen | is the RGW S3 API now the default snapshotting approach with this change, Steve? | 15:31 |
| srwilkers | yep | 15:31 |
| mattmceuen | awesome | 15:32 |
| mattmceuen | what's the default snapshotting frequency? | 15:32 |
| srwilkers | that removes the pvc mechanism all together | 15:32 |
| srwilkers | default is to snapshot any indices older than one day, which is a bit often. but curator is configured entirely via the values in elasticsearch at the moment | 15:34 |
| mattmceuen | Oh I see -- Snapshot indices older than one day | 15:34 |
| srwilkers | yep | 15:34 |
| srwilkers | once we have something reliable to use for snapshot repositories, we can start exploring more sane defaults for curator, or at least exposing more options by default | 15:34 |
| mattmceuen | What's the process to restore from a snapshot? | 15:35 |
| srwilkers | elasticsearch exposes the ability to do so via its API | 15:35 |
| *** shawn_telkamp_at has quit IRC | 15:36 | |
| mattmceuen | Based on the S3 URL? | 15:36 |
| srwilkers | https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-snapshots.html | 15:36 |
| srwilkers | based on whatever repositories you have defined | 15:36 |
| mattmceuen | ah ok cool | 15:36 |
| mattmceuen | I'll give this a spin - thanks srwilkers | 15:37 |
| mattmceuen | Any other roundtable topics? | 15:37 |
| rwellum | PTG - any planning for discussions etc? | 15:37 |
| rwellum | I should be there btw | 15:37 |
| mattmceuen | That is quickly approaching isn't it | 15:37 |
| srwilkers | only plans ive made are which breweries i plan on drinking at | 15:37 |
| rwellum | +1 | 15:38 |
| srwilkers | (wynkoop has a 14% IPA) | 15:38 |
| srwilkers | just sayin | 15:38 |
| mattmceuen | we need to come up with some discussion topics soon, to keep srwilkers and rwellum from drinking too much | 15:38 |
| rwellum | Yeah last PTG was a complete blank - don't hang out with the Cinder folks... | 15:39 |
| mattmceuen | :D | 15:39 |
| srwilkers | drunken discussion is best discussion. we need to hit the balmer peak | 15:39 |
| *** felipemonteiro has joined #openstack-meeting-5 | 15:39 | |
| mattmceuen | We will have have highly focused and well-planned sessions with plenty of coffee, followed by responsible fun afterwards :) | 15:40 |
| * mattmceuen PSA complete | 15:40 | |
| srwilkers | this guy | 15:40 |
| mattmceuen | Alright guys :) | 15:40 |
| mattmceuen | Thanks for the discussion today - have a great week! | 15:40 |
| mattmceuen | #endmeeting | 15:41 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:41 | |
| openstack | Meeting ended Tue Jul 24 15:41:07 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:41 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_helm/2018/openstack_helm.2018-07-24-15.01.html | 15:41 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_helm/2018/openstack_helm.2018-07-24-15.01.txt | 15:41 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_helm/2018/openstack_helm.2018-07-24-15.01.log.html | 15:41 |
| *** gmmaha has left #openstack-meeting-5 | 15:41 | |
| *** gagehugo has left #openstack-meeting-5 | 15:43 | |
| *** MarkBaker has quit IRC | 15:45 | |
| john_W | hello | 15:46 |
| john_W | +! | 15:46 |
| john_W | +1 | 15:46 |
| *** john_W has quit IRC | 15:46 | |
| *** felipemonteiro_ has joined #openstack-meeting-5 | 15:54 | |
| *** felipemonteiro has quit IRC | 15:57 | |
| *** vadym has quit IRC | 15:59 | |
| *** ricolin has quit IRC | 16:39 | |
| *** jgu_ has quit IRC | 16:41 | |
| *** jgu has joined #openstack-meeting-5 | 16:46 | |
| *** derekh has quit IRC | 16:55 | |
| *** wxy| has quit IRC | 17:07 | |
| *** yamahata has quit IRC | 17:11 | |
| *** iyamahat has quit IRC | 17:13 | |
| *** slaweq has quit IRC | 17:16 | |
| *** iyamahat has joined #openstack-meeting-5 | 17:18 | |
| *** iyamahat_ has joined #openstack-meeting-5 | 17:25 | |
| *** mjturek_ has joined #openstack-meeting-5 | 17:28 | |
| *** mjturek has quit IRC | 17:29 | |
| *** iyamahat has quit IRC | 17:29 | |
| *** felipemonteiro__ has joined #openstack-meeting-5 | 17:33 | |
| *** felipemonteiro_ has quit IRC | 17:33 | |
| *** felipemonteiro_ has joined #openstack-meeting-5 | 17:42 | |
| *** yamahata has joined #openstack-meeting-5 | 17:43 | |
| *** felipemonteiro__ has quit IRC | 17:46 | |
| *** felipemonteiro__ has joined #openstack-meeting-5 | 17:47 | |
| *** felipemonteiro_ has quit IRC | 17:47 | |
| *** felipemonteiro__ has quit IRC | 17:51 | |
| *** mjturek_ is now known as mjturek | 17:51 | |
| *** gema has left #openstack-meeting-5 | 17:59 | |
| *** slaweq has joined #openstack-meeting-5 | 18:15 | |
| *** mjturek has quit IRC | 18:53 | |
| *** spiette has quit IRC | 19:40 | |
| *** spiette has joined #openstack-meeting-5 | 19:44 | |
| *** mjturek has joined #openstack-meeting-5 | 20:08 | |
| *** mjturek has quit IRC | 20:49 | |
| *** mjturek has joined #openstack-meeting-5 | 20:52 | |
| *** mjturek has quit IRC | 20:57 | |
| *** mjturek has joined #openstack-meeting-5 | 21:06 | |
| *** mjturek has quit IRC | 21:09 | |
| *** mjturek has joined #openstack-meeting-5 | 21:12 | |
| *** jgu has quit IRC | 21:12 | |
| *** slaweq has quit IRC | 21:30 | |
| *** jgu has joined #openstack-meeting-5 | 21:46 | |
| *** slaweq has joined #openstack-meeting-5 | 22:11 | |
| *** slaweq has quit IRC | 22:16 | |
| *** hongbin has quit IRC | 22:30 | |
| *** slaweq has joined #openstack-meeting-5 | 22:50 | |
| *** slaweq has quit IRC | 22:54 | |
| *** slaweq has joined #openstack-meeting-5 | 23:11 | |
| *** slaweq has quit IRC | 23:16 | |
| *** jgu has quit IRC | 23:21 | |
| *** mjturek has quit IRC | 23:54 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!