*** openstack has joined #openstack-meeting-5 | 00:18 | |
*** ChanServ sets mode: +o openstack | 00:18 | |
*** theyer has joined #openstack-meeting-5 | 00:21 | |
*** strigazi has joined #openstack-meeting-5 | 00:24 | |
*** zigo has joined #openstack-meeting-5 | 00:24 | |
*** theyer has quit IRC | 00:26 | |
*** markvoelker has quit IRC | 01:27 | |
*** zhipeng has joined #openstack-meeting-5 | 02:07 | |
*** eanylin_ has quit IRC | 02:11 | |
*** gomarivera has joined #openstack-meeting-5 | 02:23 | |
*** zhipeng has quit IRC | 02:26 | |
*** gomarivera has quit IRC | 02:58 | |
*** gomarivera has joined #openstack-meeting-5 | 03:01 | |
*** wxy has joined #openstack-meeting-5 | 03:11 | |
*** ricolin has joined #openstack-meeting-5 | 03:26 | |
*** markvoelker has joined #openstack-meeting-5 | 03:28 | |
*** eanylin_ has joined #openstack-meeting-5 | 03:39 | |
*** gomarivera has quit IRC | 03:48 | |
*** gomarivera has joined #openstack-meeting-5 | 03:49 | |
*** gomarivera has quit IRC | 04:29 | |
*** gomarivera has joined #openstack-meeting-5 | 04:30 | |
*** gomarivera has quit IRC | 04:33 | |
*** gomarivera has joined #openstack-meeting-5 | 04:33 | |
*** zenirc369 has joined #openstack-meeting-5 | 04:34 | |
*** makowals has quit IRC | 04:56 | |
*** makowals has joined #openstack-meeting-5 | 05:12 | |
*** gomarivera has quit IRC | 05:20 | |
*** gomarivera has joined #openstack-meeting-5 | 05:21 | |
*** gomarivera has quit IRC | 05:25 | |
*** f13o has quit IRC | 05:37 | |
*** markvoelker has quit IRC | 06:01 | |
*** LanceHaig has joined #openstack-meeting-5 | 06:08 | |
*** LanceHaig has joined #openstack-meeting-5 | 06:08 | |
*** kongwei has joined #openstack-meeting-5 | 07:02 | |
*** kongwei has quit IRC | 07:04 | |
*** f13o has joined #openstack-meeting-5 | 07:24 | |
*** ralonsoh has joined #openstack-meeting-5 | 07:50 | |
*** f13o has quit IRC | 08:02 | |
*** f13o has joined #openstack-meeting-5 | 08:17 | |
*** derekh has joined #openstack-meeting-5 | 08:32 | |
*** f13o has quit IRC | 09:07 | |
*** f13o has joined #openstack-meeting-5 | 09:18 | |
*** rarcea has joined #openstack-meeting-5 | 09:40 | |
*** gomarivera has joined #openstack-meeting-5 | 10:22 | |
*** gomarivera has quit IRC | 10:26 | |
*** amotoki has joined #openstack-meeting-5 | 11:18 | |
*** LanceHaig has quit IRC | 11:26 | |
*** gomarivera has joined #openstack-meeting-5 | 12:27 | |
*** f13o has quit IRC | 12:33 | |
*** LanceHaig has joined #openstack-meeting-5 | 12:35 | |
*** LanceHaig has quit IRC | 12:40 | |
*** gomarivera has quit IRC | 12:43 | |
*** f13o has joined #openstack-meeting-5 | 12:49 | |
*** gomarivera has joined #openstack-meeting-5 | 12:49 | |
*** gomarivera has quit IRC | 12:50 | |
*** zenirc369 has quit IRC | 12:56 | |
*** eanylin_ has quit IRC | 13:18 | |
*** jrist_ is now known as jrist | 13:31 | |
*** jrist has quit IRC | 13:31 | |
*** jrist has joined #openstack-meeting-5 | 13:31 | |
*** eanylin_ has joined #openstack-meeting-5 | 13:35 | |
*** gomarivera has joined #openstack-meeting-5 | 13:40 | |
*** gomarivera has quit IRC | 13:46 | |
*** f13o has quit IRC | 13:49 | |
*** lrensing has joined #openstack-meeting-5 | 14:02 | |
*** f13o has joined #openstack-meeting-5 | 14:02 | |
*** gomarivera has joined #openstack-meeting-5 | 14:02 | |
*** gomarivera has quit IRC | 14:04 | |
*** gomarivera has joined #openstack-meeting-5 | 14:04 | |
*** felipemonteiro has joined #openstack-meeting-5 | 14:09 | |
*** LanceHaig has joined #openstack-meeting-5 | 14:16 | |
*** LanceHaig has quit IRC | 14:16 | |
*** LanceHaig has joined #openstack-meeting-5 | 14:16 | |
*** f13o has quit IRC | 14:41 | |
*** felipemonteiro has quit IRC | 14:41 | |
*** felipemonteiro has joined #openstack-meeting-5 | 14:44 | |
*** markvoelker has joined #openstack-meeting-5 | 14:49 | |
*** f13o has joined #openstack-meeting-5 | 14:53 | |
*** srwilkers_ has joined #openstack-meeting-5 | 14:59 | |
*** alraddarla has joined #openstack-meeting-5 | 15:00 | |
* portdirect flicks boogers at srwilkers | 15:00 | |
alraddarla | real mature portdirect | 15:00 |
---|---|---|
srwilkers_ | #startmeeting openstack-helm | 15:00 |
openstack | Meeting started Tue Jun 20 15:00:47 2017 UTC and is due to finish in 60 minutes. The chair is srwilkers_. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
*** openstack changes topic to " (Meeting topic: openstack-helm)" | 15:00 | |
openstack | The meeting name has been set to 'openstack_helm' | 15:00 |
srwilkers_ | happy tuesday everyone | 15:01 |
portdirect | \o/ | 15:01 |
alraddarla | o/ | 15:01 |
srwilkers_ | we've got a few items on the agenda for today. can be found here: https://etherpad.openstack.org/p/openstack-helm-meeting-2017-06-20 | 15:01 |
dulek | o/ | 15:01 |
*** gomarivera has quit IRC | 15:01 | |
lrensing | o/ | 15:02 |
*** StaceyF has joined #openstack-meeting-5 | 15:02 | |
*** gomarivera has joined #openstack-meeting-5 | 15:02 | |
srwilkers_ | lets give it a minute or so to let others filter in | 15:02 |
*** gagehugo has joined #openstack-meeting-5 | 15:02 | |
srwilkers_ | then we can tackle these topics, and then open up for discussion afterwards | 15:02 |
*** zenirc369 has joined #openstack-meeting-5 | 15:02 | |
lamt | o/ | 15:03 |
* gagehugo lurks | 15:03 | |
v1k0d3n | o/ | 15:04 |
srwilkers_ | alright, lets go ahead and start tackling these then | 15:04 |
srwilkers_ | #topic Health Checks | 15:04 |
*** openstack changes topic to "Health Checks (Meeting topic: openstack-helm)" | 15:04 | |
srwilkers_ | portdirect, i think you raised this topic last week or this one -- cant recall | 15:04 |
srwilkers_ | youve got the floor | 15:04 |
*** renmak_ has joined #openstack-meeting-5 | 15:05 | |
portdirect | yeah - I ve got a few queries about these - as I'm not sure we want to be killing/restarting pods when comms with infra is broken - seems like a way to create a runaway train. but was wondering if dulek had thought of somthing id missed? | 15:06 |
* dulek is here to answer any questions about the patches. | 15:06 | |
portdirect | :) | 15:06 |
dulek | Right, that's something I was wondering about too. | 15:06 |
*** gomarivera has quit IRC | 15:06 | |
dulek | My intention with the patches is also to have some indication for the admin that pod is unhealthy. | 15:07 |
dulek | Also I can imagine a pod being rescheduled to another kubelet, which resolves the problem if it was caused by physical network failure. | 15:07 |
portdirect | yeah - though i can also see a transient problem causing the entire cluster to go down? | 15:08 |
*** f13o has quit IRC | 15:08 | |
dulek | Please note that in case of Neutron and Nova, healthchecks are based on nova service-list/neutron agent-list commands. I was hoping to do the same with the rest of the charts but it isn't always possible. | 15:08 |
dulek | portdirect: Pod restart when a transient failure occurred isn't really that bad thing IMO. | 15:09 |
portdirect | it is if they all restart simultaneously - thats gonna potentially put a huge load on your underlying services | 15:10 |
dulek | portdirect: Well, I cannot disagree with that. | 15:11 |
portdirect | but i get your point - would the visibility your aiming for not be better achived through a mechanism like centralised logging? | 15:11 |
dulek | portdirect: Though if your infra is suffering from transient failures, you should probably tweak liveness probe period. | 15:12 |
*** korzen has joined #openstack-meeting-5 | 15:12 | |
portdirect | the best thing about failure is it s like the Spanish Inquisition: https://www.youtube.com/watch?v=sAn7baRbhx4 | 15:13 |
dulek | portdirect: RabbitMQ or DB disconnections could be addressed through that, I'm not sure about monitoring "nova service-list" though. | 15:13 |
portdirect | srwilkers_: will the work your doing be able to monitor those things? | 15:14 |
srwilkers_ | portdirect, yeah. it should be able to. | 15:14 |
srwilkers_ | and once we actually get it into addons, we can start looking at specific exporters for prometheus and adjusting the rules as necessary | 15:14 |
portdirect | would you be able to work with dulek to get a list of the tings we'd need to monitor in a spec? | 15:15 |
srwilkers_ | sure, i can get that started today | 15:15 |
srwilkers_ | #action srwilkers: document appropriate monitoring targets with dulek | 15:16 |
portdirect | dulek: would that work for you? I suspect it would need a combination of your work and srwilkers_ to get all we need | 15:16 |
dulek | I'll be ending my office day just after the meeting, but I can definitely provide a list of alarms in logs/commands that we should look for. | 15:16 |
portdirect | awesome - cheers dude | 15:17 |
dulek | portdirect: Sure, I'll take a look at srwilkers_ work and see how we can use it. | 15:17 |
srwilkers_ | okay cool. think we can move on then? | 15:18 |
srwilkers_ | #topic Gating for Addons/Infra | 15:18 |
*** openstack changes topic to "Gating for Addons/Infra (Meeting topic: openstack-helm)" | 15:18 | |
srwilkers_ | so we've got openstack-helm-addons and openstack-helm-infra now, in addition to the primary repo | 15:18 |
srwilkers_ | portdirect, lamt and StaceyF have been tossing around ideas for gating the three repos in a way that makes sense in how the repositories are expected to be used | 15:19 |
srwilkers_ | the current idea is to explore zuul-cloner to see how we can run checks on the three repos without introducing any race conditions or overhead | 15:20 |
lamt | srwilkers_ -infra was created overnight, I will work to set up the linter gate there, also to clean up -addons | 15:20 |
*** f13o has joined #openstack-meeting-5 | 15:20 | |
srwilkers_ | lamt, awesome. i can help as well if you need. think that should be higher priority so we can start getting stuff out of the queue in addons | 15:21 |
srwilkers_ | theres already a bit backed up there | 15:21 |
lrensing | just for clarity, can we define where we draw the line for each of the repos? | 15:21 |
srwilkers_ | lamt, any other thoughts? | 15:21 |
lamt | lamt for now, either tarball, or gitclone, will need to play around with it | 15:22 |
srwilkers_ | lrensing, sure. the expectation is that infra is anything required to run the openstack services on top of. addons is anything ancillary that can be used in conjunction with them | 15:22 |
srwilkers_ | thats my view at any rate | 15:22 |
portdirect | ^^ ++ | 15:22 |
lrensing | sounds good :) | 15:22 |
srwilkers_ | lamt, awesome | 15:22 |
srwilkers_ | #action lamt to explore tarballs or gitclone for multi repo checks/gates | 15:23 |
portdirect | lamt: id like us to use git clone when not in infra - being able to run the gate scripts locally is pretty important :) | 15:23 |
lamt | the linter should work for -addons, please review it. will refine the node3 gate late | 15:23 |
lamt | portdirect sounds good | 15:23 |
portdirect | perhaps we should explore having an 'armada' check as well? | 15:25 |
portdirect | alanmeadows: ^? | 15:25 |
alanmeadows | it supports remote git urls and branch/tag targets | 15:25 |
alanmeadows | seems like the fit you're after | 15:25 |
alanmeadows | I have a working manifest for ~master at this point | 15:26 |
portdirect | nice - if we got an addtional 3 node check would you be able to submit a ps for it? | 15:26 |
alanmeadows | sure | 15:27 |
srwilkers_ | alanmeadows, portdirect: awesome :) | 15:28 |
portdirect | sounds good - I'll try and get that up today | 15:28 |
srwilkers_ | #action portdirect will look into 3 node check for armada check | 15:29 |
srwilkers_ | anything else on gating? | 15:29 |
*** f13o has quit IRC | 15:30 | |
portdirect | I'll be working with lrensing to get ceph running iin the gate today and start the road to dropping nfs :D | 15:30 |
srwilkers_ | portdirect, thatd be really awesome :) | 15:30 |
portdirect | we'll also have vms running in the gate soon - i just need to tidy up my ps | 15:30 |
portdirect | https://review.openstack.org/#/c/474960/ | 15:31 |
srwilkers_ | that's great. let's get some visibility on those when they're ready for review. would be nice to get those in for sure | 15:31 |
StaceyF | I put the 3rd party gate as a separate topic but can bring it up now? | 15:32 |
srwilkers_ | oh nice | 15:32 |
srwilkers_ | of course StaceyF, floors yours | 15:32 |
srwilkers_ | #topic Third Party Gate | 15:32 |
*** openstack changes topic to "Third Party Gate (Meeting topic: openstack-helm)" | 15:32 | |
StaceyF | It's currently just a skeleton job but we have Openstack Helm deployed on our CI lab and will be utilizing Jenkins plugins (openstack-cloud) to dynamically provision VMs to test OSH on PS / merge in Gerrit | 15:33 |
StaceyF | I'd like to get the go ahead to make it a non-voting 3rd party instead of the skipping once we've stabilized the Jenkins jobs | 15:34 |
*** zenirc369 has quit IRC | 15:34 | |
StaceyF | We will be putting the logs on an Apache server so they are accessible to see failures/success. | 15:35 |
srwilkers_ | StaceyF, hmm. im okay with it becoming a non-voting 3rd party gate, given the logs are publicly available | 15:35 |
StaceyF | srwilkers thanks | 15:37 |
srwilkers_ | portdirect, thoughts? | 15:37 |
portdirect | nice - will we be able to run rally properly inside the ATT gate? | 15:37 |
StaceyF | yes | 15:37 |
portdirect | srwilkers_: think this is pretty awesome :) | 15:37 |
srwilkers_ | alright cool. | 15:38 |
StaceyF | then I'll move forward and will provide status as it moves along | 15:39 |
srwilkers_ | StaceyF, great. keep us posted :) | 15:39 |
srwilkers_ | #topic Monasca-Helm (https://github.com/monasca/monasca-helm) | 15:40 |
*** openstack changes topic to "Monasca-Helm (https://github.com/monasca/monasca-helm) (Meeting topic: openstack-helm)" | 15:40 | |
srwilkers_ | i added this topic for jayahn as it was mentioned yesterday | 15:40 |
srwilkers_ | and he brought up possibly touching base with the monasca folks to see what their intentions are for it | 15:40 |
srwilkers_ | but im not sure if jayahn is present currently, so might want to follow up with him when i see him in the openstack-helm channel again. i know the time difference is pretty drastic | 15:41 |
portdirect | yeah - they have some interesting things going on over there - looks like a full stack in a single chart? | 15:41 |
srwilkers_ | portdirect, thats what it seems like at a glance | 15:42 |
srwilkers_ | i havent had a chance to play with it yet, but they're using monasca to grab cluster-level metrics i think and scraping prometheus endpoints | 15:42 |
portdirect | be good to chat to them for sure - you know what irc chan they in? | 15:42 |
srwilkers_ | i can dig it up and ask about it today | 15:42 |
srwilkers_ | either way, i think im going to fiddle with it and profile it versus prometheus to see what the differences are just for the sake of comparison | 15:43 |
srwilkers_ | #action srwilkers_ follow up with jayahn about monasca-helm | 15:44 |
srwilkers_ | #topic open discussion | 15:45 |
*** openstack changes topic to "open discussion (Meeting topic: openstack-helm)" | 15:45 | |
srwilkers_ | alright, that's all the topics we had in the etherpad for today | 15:45 |
srwilkers_ | id like to open the floor for any other concerns/topics that weren't on the agenda | 15:45 |
srwilkers_ | going once | 15:47 |
*** gomarivera has joined #openstack-meeting-5 | 15:47 | |
srwilkers_ | going twice? | 15:48 |
srwilkers_ | alright, going to give you all 10 minutes back | 15:49 |
srwilkers_ | #endmeeting | 15:49 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings" | 15:49 | |
openstack | Meeting ended Tue Jun 20 15:49:47 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:49 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_helm/2017/openstack_helm.2017-06-20-15.00.html | 15:49 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_helm/2017/openstack_helm.2017-06-20-15.00.txt | 15:49 |
openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_helm/2017/openstack_helm.2017-06-20-15.00.log.html | 15:49 |
*** alraddarla has left #openstack-meeting-5 | 15:49 | |
*** makowals has quit IRC | 16:05 | |
*** korzen has quit IRC | 16:08 | |
*** rarcea has quit IRC | 16:22 | |
*** gagehugo has left #openstack-meeting-5 | 16:24 | |
*** StaceyF has left #openstack-meeting-5 | 16:31 | |
*** iyamahat has joined #openstack-meeting-5 | 16:47 | |
*** yamahata_ has joined #openstack-meeting-5 | 16:48 | |
*** makowals has joined #openstack-meeting-5 | 16:50 | |
*** iyamahat has quit IRC | 16:51 | |
*** iyamahat has joined #openstack-meeting-5 | 16:51 | |
*** iyamahat has quit IRC | 16:51 | |
*** iyamahat has joined #openstack-meeting-5 | 16:52 | |
*** sshank has joined #openstack-meeting-5 | 16:52 | |
*** derekh has quit IRC | 16:56 | |
*** ralonsoh has quit IRC | 16:58 | |
*** renmak_ has quit IRC | 16:59 | |
*** makowals has quit IRC | 17:06 | |
*** felipemonteiro has quit IRC | 17:13 | |
*** makowals has joined #openstack-meeting-5 | 17:18 | |
*** iyamahat has quit IRC | 17:22 | |
*** iyamahat_ has joined #openstack-meeting-5 | 17:23 | |
*** amotoki is now known as amotoki_away | 17:23 | |
*** korzen has joined #openstack-meeting-5 | 17:30 | |
*** korzen has quit IRC | 17:38 | |
*** srwilkers_ has quit IRC | 17:43 | |
*** iyamahat__ has joined #openstack-meeting-5 | 17:48 | |
*** iyamahat_ has quit IRC | 17:50 | |
*** iyamahat__ has quit IRC | 18:02 | |
*** sshank has quit IRC | 18:36 | |
*** makowals has quit IRC | 18:44 | |
*** lrensing has left #openstack-meeting-5 | 18:47 | |
*** makowals has joined #openstack-meeting-5 | 19:19 | |
*** sshank has joined #openstack-meeting-5 | 19:28 | |
*** sshank has quit IRC | 19:31 | |
*** gomarivera has quit IRC | 19:36 | |
*** gomarivera has joined #openstack-meeting-5 | 19:36 | |
*** sshank has joined #openstack-meeting-5 | 19:40 | |
*** gomarivera has quit IRC | 19:41 | |
*** gomarivera has joined #openstack-meeting-5 | 19:53 | |
*** gomarivera has quit IRC | 19:53 | |
*** gomarivera has joined #openstack-meeting-5 | 19:54 | |
*** amotoki_away is now known as amotoki | 20:24 | |
*** amotoki is now known as amotoki_away | 20:33 | |
*** makowals has quit IRC | 20:52 | |
*** makowals has joined #openstack-meeting-5 | 21:14 | |
*** rarcea has joined #openstack-meeting-5 | 21:40 | |
*** markvoelker has quit IRC | 21:56 | |
*** markvoelker has joined #openstack-meeting-5 | 22:04 | |
*** sshank has quit IRC | 22:11 | |
*** openstack has joined #openstack-meeting-5 | 22:17 | |
*** ChanServ sets mode: +o openstack | 22:17 | |
*** jrist has quit IRC | 22:18 | |
*** jrist has joined #openstack-meeting-5 | 22:19 | |
*** jrist has quit IRC | 22:20 | |
*** jrist has joined #openstack-meeting-5 | 22:21 | |
*** gomarivera has joined #openstack-meeting-5 | 22:23 | |
*** gomarivera has quit IRC | 22:29 | |
*** sshank has joined #openstack-meeting-5 | 22:50 | |
*** gomarivera has joined #openstack-meeting-5 | 23:04 | |
*** gomarivera has quit IRC | 23:09 | |
*** sshank has quit IRC | 23:12 | |
*** sshank has joined #openstack-meeting-5 | 23:15 | |
*** makowals has joined #openstack-meeting-5 | 23:20 | |
*** gomarivera has joined #openstack-meeting-5 | 23:27 | |
*** gomarivera has quit IRC | 23:46 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!