Tuesday, 2018-04-10

*** yamamoto has quit IRC00:03
*** sshank has quit IRC00:13
*** mjturek has quit IRC00:19
*** slaweq has joined #openstack-meeting-501:03
*** slaweq has quit IRC01:08
*** yamahata has quit IRC01:53
*** ricolin has joined #openstack-meeting-502:29
*** yamamoto has joined #openstack-meeting-502:41
*** yamamoto has quit IRC02:45
*** slaweq has joined #openstack-meeting-503:04
*** slaweq has quit IRC03:09
*** ianychoi has quit IRC03:16
*** ianychoi has joined #openstack-meeting-503:20
*** ianychoi has quit IRC04:14
*** ianychoi has joined #openstack-meeting-504:16
*** radeks has joined #openstack-meeting-504:31
*** yamamoto has joined #openstack-meeting-505:08
*** yamahata has joined #openstack-meeting-505:10
*** yamamoto has quit IRC05:12
*** ianychoi has quit IRC05:47
*** ianychoi has joined #openstack-meeting-505:49
*** yamamoto has joined #openstack-meeting-506:37
*** slaweq has joined #openstack-meeting-506:47
*** slaweq has quit IRC06:53
*** slaweq has joined #openstack-meeting-506:56
*** yamamoto has quit IRC07:12
*** yamamoto has joined #openstack-meeting-507:14
*** yamamoto has quit IRC07:14
*** yamamoto has joined #openstack-meeting-507:15
*** yamamoto has quit IRC07:19
*** radeks has quit IRC07:21
*** radeks has joined #openstack-meeting-507:21
*** hoangcx_ has joined #openstack-meeting-508:19
*** hoangcx_ is now known as hoangcx08:20
*** hoangcx has quit IRC08:22
*** hoangcx_ has joined #openstack-meeting-508:22
*** hoangcx_ is now known as hoangcx08:22
*** hoangcx_ has joined #openstack-meeting-508:41
*** hoangcx has quit IRC08:43
*** radeks has quit IRC08:50
*** radeks has joined #openstack-meeting-508:50
*** yamamoto has joined #openstack-meeting-509:15
*** ricolin has quit IRC09:23
*** derekh has joined #openstack-meeting-509:30
*** yamamoto has quit IRC09:41
*** yamamoto has joined #openstack-meeting-509:41
*** hoangcx__ has joined #openstack-meeting-509:47
*** hoangcx_ has quit IRC09:52
*** hoangcx__ has quit IRC09:52
*** hoangcx_ has joined #openstack-meeting-509:55
*** hoangcx_ has quit IRC09:57
*** hoangcx has joined #openstack-meeting-509:57
*** MarkBaker has joined #openstack-meeting-509:58
*** radeks has quit IRC10:03
*** yamamoto has quit IRC10:17
*** yamamoto has joined #openstack-meeting-510:21
*** MarkBaker has quit IRC10:23
*** yamamoto has quit IRC10:27
*** yamamoto has joined #openstack-meeting-510:27
*** MarkBaker has joined #openstack-meeting-510:32
*** hoangcx_ has joined #openstack-meeting-510:36
*** hoangcx has quit IRC10:36
*** hoangcx_ is now known as hoangcx10:44
*** MarkBaker has quit IRC10:48
*** radeks has joined #openstack-meeting-510:49
*** hoangcx_ has joined #openstack-meeting-510:53
*** hoangcx has quit IRC10:57
*** yamamoto has quit IRC10:58
*** yamamoto has joined #openstack-meeting-511:00
*** yamamoto has quit IRC11:01
*** hoangcx has joined #openstack-meeting-511:07
*** hoangcx_ has quit IRC11:09
*** hoangcx_ has joined #openstack-meeting-511:28
*** hoangcx has quit IRC11:31
*** markvoelker has joined #openstack-meeting-511:40
*** yamamoto has joined #openstack-meeting-512:35
*** yamamoto has quit IRC12:41
*** yamamoto has joined #openstack-meeting-512:44
*** yamamoto has quit IRC12:57
*** radeks has quit IRC12:58
*** radeks has joined #openstack-meeting-512:58
*** mjturek has joined #openstack-meeting-513:01
*** hoangcx has joined #openstack-meeting-513:07
*** yamamoto has joined #openstack-meeting-513:07
*** hoangcx_ has quit IRC13:11
*** brutus333 has joined #openstack-meeting-513:13
*** yamamoto has quit IRC13:16
*** yamamoto has joined #openstack-meeting-513:20
*** yamamoto has quit IRC13:23
*** cristicalin has joined #openstack-meeting-513:42
*** cristicalin has quit IRC13:47
*** cristicalin has joined #openstack-meeting-513:47
*** hongbin has joined #openstack-meeting-513:50
*** serverascode has quit IRC13:50
*** serverascode has joined #openstack-meeting-513:51
*** yamamoto has joined #openstack-meeting-513:51
*** yamamoto has quit IRC13:54
*** annp_ has joined #openstack-meeting-513:59
*** yamamoto has joined #openstack-meeting-514:02
*** ianychoi has quit IRC14:02
*** ianychoi has joined #openstack-meeting-514:03
*** yamamoto has quit IRC14:05
brutus333Running neutron rally tests (included in helm test) on fresh OSH install give intermittent errors due to mysql "Deadlock: wsrep aborted transaction" error. Seems to be related to mysql service sending requests to all mariadb instances.14:05
brutus333Is this a known issue?14:06
*** yamamoto has joined #openstack-meeting-514:10
*** yamamoto has quit IRC14:13
*** markvoelker_ has joined #openstack-meeting-514:18
*** portdirect has quit IRC14:19
*** portdirect has joined #openstack-meeting-514:19
*** hoangcx has quit IRC14:19
*** hoangcx has joined #openstack-meeting-514:19
*** markvoelker has quit IRC14:21
*** beisner has quit IRC14:24
*** beisner has joined #openstack-meeting-514:25
*** alanmeadows has quit IRC14:26
*** alanmeadows has joined #openstack-meeting-514:27
*** jayahn has quit IRC14:27
*** jayahn has joined #openstack-meeting-514:27
*** powerds0111 has quit IRC14:28
*** powerds0111 has joined #openstack-meeting-514:28
*** lamt has quit IRC14:29
*** lamt has joined #openstack-meeting-514:29
*** lamt is now known as Guest2981014:29
*** seaneagan has joined #openstack-meeting-514:36
*** felipemonteiro has joined #openstack-meeting-514:36
*** markvoelker has joined #openstack-meeting-514:36
*** markvoelker_ has quit IRC14:39
*** yamamoto has joined #openstack-meeting-514:41
*** yamamoto has quit IRC14:41
*** markvoelker_ has joined #openstack-meeting-514:42
*** Guest29810 is now known as lamt14:42
*** markvoelker has quit IRC14:44
*** markvoelker has joined #openstack-meeting-514:46
*** yamamoto has joined #openstack-meeting-514:47
*** felipemonteiro_ has joined #openstack-meeting-514:47
*** markvoelker_ has quit IRC14:49
*** markvoelker_ has joined #openstack-meeting-514:49
*** d|k has joined #openstack-meeting-514:50
*** gagehugo has joined #openstack-meeting-514:50
*** felipemonteiro has quit IRC14:51
*** markvoelker has quit IRC14:53
*** markvoelker has joined #openstack-meeting-514:56
*** markvoelker_ has quit IRC14:58
*** wxy| has joined #openstack-meeting-515:00
*** gmmaha has joined #openstack-meeting-515:00
*** roman_g has joined #openstack-meeting-515:00
roman_gGood morning15:00
mattmceuen#startmeeting openstack-helm15:00
openstackMeeting started Tue Apr 10 15:00:44 2018 UTC and is due to finish in 60 minutes.  The chair is mattmceuen. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: openstack-helm)"15:00
openstackThe meeting name has been set to 'openstack_helm'15:00
mattmceuen#topic Rollcall15:00
*** openstack changes topic to "Rollcall (Meeting topic: openstack-helm)"15:00
mattmceuenHey roman_g!15:01
*** yamamoto has quit IRC15:01
srwilkerso/15:01
lamto/15:01
d|ko15:01
roman_go/15:01
*** annp_ has quit IRC15:01
gmmahao/15:01
rwellumo/15:01
mattmceuenhttps://etherpad.openstack.org/p/openstack-helm-meeting-2018-04-1015:01
*** yamamoto has joined #openstack-meeting-515:01
mattmceuenPlease add in all the burning topics, questions, etc you would like to discuss today15:02
roman_gI'm listening in. Mostly.15:03
mattmceuen#topic Multiline LMA functionality (srwilkers and jayahn)15:03
*** openstack changes topic to "Multiline LMA functionality (srwilkers and jayahn) (Meeting topic: openstack-helm)"15:03
mattmceuensrwilkers and jayahn -- anything left to discuss on this one or did you level set offline?15:03
srwilkersive been working towards something that works here15:05
srwilkersinitially, i thought using something like the journald logging driver would close the gap here.  after some digging though, using anything but the json-file logging driver results in a loss of the ability to query for logs via kubectl15:05
*** markvoelker_ has joined #openstack-meeting-515:05
srwilkerswhich is a regression15:05
portdirectthis makes me sad panda15:06
srwilkersportdirect: tres sad15:06
srwilkersthere are open issues in kubernetes that im watching for any updates, but seems the ability to use journald along with kubectl was removed when CRI was introduced15:07
mattmceuenwhat's the downside of json-file approach?15:07
srwilkersdownside of the json-file approach is that we need to define regex's for each log format we may encounter with osh/osh-infra15:07
srwilkersfluentbit will need a regex to identify the first line in a multiline entry (like stacktraces, etc)15:08
srwilkersjust requires some additional work on our end15:08
*** markvoelker_ has quit IRC15:08
mattmceuengotcha15:08
srwilkersthere was some work done a long time ago to try and address this (dulek started it forever ago) that we might be able to leverage as a base if necessary15:08
*** markvoelker has quit IRC15:09
srwilkersbut really, that's all ive got to say about it15:09
mattmceuenthanks srwilkers15:09
roman_gcan we stream logs to the network and capture/process them on separate logging host? kubectl is kinda not supposed to be used for digging into logs. Only for fast lookups.15:10
*** markvoelker has joined #openstack-meeting-515:10
roman_gI'm not very competent in the topic, you may ignore question ))15:10
*** icolwell has joined #openstack-meeting-515:10
*** markvoelker_ has joined #openstack-meeting-515:10
cristicalinroman_g, that's what fluenbit is doint actually15:10
srwilkersroman_g: thats the idea of having a centralized logging tool like fluentbit.15:11
cristicalinsrwilkers, does the journald driver account for multiline though ?15:11
*** renmak_ has joined #openstack-meeting-515:11
roman_gyes, journald works well with multiline logs15:11
srwilkerscristicalin: it seemed to handle it better in the initial work i was doing15:11
cristicalinas the stdout/err from containers still gets broken into multiple lines15:12
cristicalinso docker would still see multiple lines and not know they are from the same message15:12
cristicalinor you use openstack loggins to send to journald ?15:12
cristicalinon our end we force openstack log formatting and have looked into using a json formatter15:13
cristicalinworks nicely for openstack originated logs but goes into a recursive crash loop for things like sqlalchemy15:13
mattmceuenyikes15:14
*** markvoelker has quit IRC15:15
cristicalinhere's what we use now, ignore the consul-template bit http://paste.openstack.org/show/718845/15:15
mattmceuenJust curious cristicalin, what drove you guys to the journald approach?15:16
cristicalinmattmceuen, we don't use journald, just experimented with it15:17
cristicalinwe use json-file15:17
mattmceuenahh gotcha15:17
srwilkerscristicalin: neat.  will take a gander later today15:19
mattmceuensrwilkers do we have a good list of all the multiline formats we'll need to support regexes for?15:19
*** yamamoto has quit IRC15:19
mattmceuenand/or just address them as we run accross them?15:19
*** yamamoto has joined #openstack-meeting-515:19
srwilkersmattmceuen: not at the moment.  the openstack services would be the ones to tackle first, then can address the other ones bit by bit15:20
mattmceuenCool - sounds good to me, thanks15:20
mattmceuen#topic Storyboard for 1.0 integration items15:20
*** openstack changes topic to "Storyboard for 1.0 integration items (Meeting topic: openstack-helm)"15:20
mattmceuenAs you guys know, the Foundation is working to move most projects to use Storyboard instead of Launchpad this cycle15:21
mattmceuenAt the PTG we decided we would go with the flow here, rather than being a trailblazer or a laggard15:21
mattmceuenThat still means we should start planning for it and find the right time to migrate15:22
mattmceuenWe have our 1.0 requirements spec in progress: https://review.openstack.org/#/c/556325/15:22
mattmceuenThat will result in a lot of granular bits that need to be coordinated well and worked quickly across our entire team15:23
mattmceuenSo we can get to 1.0 :D15:23
mattmceuenI'm wondering, would it make sense to move to storyboard before we create all those work items, so we don't create them and then immediately migrate them from one system to another?15:23
rwellumHow is that related to storyboard? Or storyboard will be used to get to 1.0?15:24
mattmceuenstoryboard in this context is just a place to put the work - no direct tie in15:24
rwellumok15:24
*** hoangcx_ has joined #openstack-meeting-515:24
*** hoangcx__ has joined #openstack-meeting-515:25
*** hoangcx_ has quit IRC15:25
mattmceuenopinions welcome :)  If you're not familiar with storyboard yet, it's an openstack scope management tool created within openstack with openstack-like workflows and collaboration in mind15:26
mattmceuenhttps://wiki.openstack.org/wiki/StoryBoard15:26
*** yamamoto has quit IRC15:26
rwellumBe interesting to see which projects have converted over. I know I set it up for kolla, but we didn't go to town on it - mainly because bug-tracking seemed way off.15:26
cristicalinoctavia has added a few things on their storyboard but not much15:27
mattmceuenhttps://storyboard.openstack.org/#!/project_group/list15:27
mattmceuen^ projects that have migrated so far15:27
*** hoangcx has quit IRC15:27
rwellumCool.15:28
mattmceuenI think one thing that would be valuable would be for one of our team to do something of a deep dive into storyboard, see how other projects use it, and help guide OSH into using it well15:29
mattmceuenAnyone interested in taking that on?15:29
rwellumHas it been enabled for osh yet?15:29
rwellummattmceuen: be happy to take that on, seems like busy-work that could get me more involved in osh community15:30
mattmceuenSomehow an osh project was already created, it's a mystery... I think we'll just recreate it upon migration I think15:30
mattmceuenlol rwellum - that would be much appreciated and I think it'll actually be extremely valuable15:31
*** yamamoto has joined #openstack-meeting-515:31
rwellumnp15:31
mattmceuenI've gotten feedback from multiple folks that OSH would really benefit from a better-defined community roadmap15:31
mattmceuenAnd I think migrating to storyboard would be something of a fresh start15:31
*** marshallmargenau has joined #openstack-meeting-515:31
rwellum+115:32
rwellumAlthough you've just described all of OpenStack :)15:32
mattmceuenWell in that case, maybe we can define some good conventions that others can benefit from ;-)15:32
mattmceuenI have some things I will share with ya offline too to give more background15:33
rwellumTalking about roadmap - I did add a relevant topic to the etherpad.15:33
rwellumSure sounds good - I need to talk to you anyway :)15:33
*** hoangcx has joined #openstack-meeting-515:33
mattmceuennice -- let's segueway right into it, I just have one short thing for later15:33
mattmceuen#topic Support for other releases? Pike, Queens etc15:33
*** openstack changes topic to "Support for other releases? Pike, Queens etc (Meeting topic: openstack-helm)"15:33
portdirectwe do already15:34
roman_gNancy created storyboard for OSH15:34
portdirectbut still need to demonstrate upgrade in the gate i think before moving this into the repo15:34
portdirectas agreed at the ptg15:34
portdirect'the sugarcubes'15:34
mattmceuen'the sugarcubes'15:34
rwellumSo I am demoing osh to my company tomorrow - you're talking 60+ people, one of the things they are going to ask is releases, and upgrades.15:34
*** hoangcx__ has quit IRC15:34
rwellumSo that's good news portdirect15:35
portdirectI've been running master again recently...15:35
rwellumhttps://en.wikipedia.org/wiki/The_Sugarcubes ??15:35
portdirectalmost as cool15:36
portdirectI'm working on writing up the versioning spec for OSH15:36
*** renmak_ has quit IRC15:36
rwellumroman_g: cool, glad we know who did it - I'll look into it more.15:36
rwellumportdirect: great. Let me know if you need a guinea pig?15:36
portdirectand the simplest way to hash it out it was using sugar cubes on a desk15:36
mattmceuenI'm expecting diagrams of sugarcubes in the spec portdirect15:37
mattmceuenascii15:37
portdirectthere was also a teaspoon15:37
*** hoangcx_ has joined #openstack-meeting-515:37
portdirect(to represent upgrade paths)15:37
*** renmak_ has joined #openstack-meeting-515:37
*** renmak_ has quit IRC15:37
rwellumA nice cup of tea to represent falling into an upgrade whirlpool15:38
portdirectno!15:38
mattmceuenOur position overall rwellum is that we want to forge our way to the current release quickly, with gated upgrade support, and non-voting gates for master15:38
portdirectopenstack helm makes for nice calming tea15:38
portdirectthat may be drunk with the pinky out15:38
rwellum:)15:38
mattmceuenFeel free to share that with your crew and good luck with the presentation :)15:38
portdirect++15:39
rwellummattmceuen:+115:39
mattmceuenLast thing on the agenda:15:39
mattmceuen#topic IRC - Slack integration revisited15:39
*** openstack changes topic to "IRC - Slack integration revisited (Meeting topic: openstack-helm)"15:39
mattmceuenSo a few weeks ago we lamented the fact that Slack was removing its gateway for IRC (etc) integration15:40
*** hoangcx has quit IRC15:40
mattmceuenBelieveing our Slack-IRC integration would be SOL15:40
*** Romik has joined #openstack-meeting-515:40
mattmceuenI chatted with cw since then, and he says that the tooling we use for Slack-IRC integration should actually not be impacted by this, that it doesn't use that particular gateway15:40
mattmceuenSo that's excellent news :)15:41
mattmceuen#topic Reviews Needed15:41
*** openstack changes topic to "Reviews Needed (Meeting topic: openstack-helm)"15:41
*** yamamoto has quit IRC15:43
*** roman_g has quit IRC15:43
mattmceuenAnyone have any PS that they'd like to share to get some eyeballs on them?15:44
*** yamamoto has joined #openstack-meeting-515:44
srwilkersnot at the moment15:45
cristicalinactive/passive maria ?15:45
srwilkersactually15:45
srwilkerswouldnt mind some eyes on: https://review.openstack.org/#/c/498929/15:46
mattmceuenactive/passive maria - was chatting w/ portdirect on that and he may have a thought on how to simplify the approach and get it done fast.  Can we plan on that for a topic of discussion next meeting cristicalin?15:47
cristicalinyep, will try to make it15:47
mattmceuenawesome - thanks man15:48
cristicalinI'll ping portdirect later during the week as we are also looking into the problem15:48
*** renmak_ has joined #openstack-meeting-515:48
mattmceuenperfect15:49
mattmceuen#topic Roundtable15:49
*** openstack changes topic to "Roundtable (Meeting topic: openstack-helm)"15:49
mattmceuenopen discussion, anything else on your minds?15:49
mattmceuenAlright guys - good meeting, and have a good week!  See you in #openstack-helm15:51
mattmceuen#endmeeting15:51
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"15:51
openstackMeeting ended Tue Apr 10 15:51:11 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:51
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_helm/2018/openstack_helm.2018-04-10-15.00.html15:51
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_helm/2018/openstack_helm.2018-04-10-15.00.txt15:51
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_helm/2018/openstack_helm.2018-04-10-15.00.log.html15:51
RomikThank you.15:51
*** Romik is now known as romik_g15:51
*** romik_g is now known as roman_g15:51
*** gmmaha has left #openstack-meeting-515:52
*** cristicalin has quit IRC15:52
*** gagehugo has left #openstack-meeting-516:03
*** seaneagan has quit IRC16:10
*** yamamoto has quit IRC16:10
*** yamamoto has joined #openstack-meeting-516:10
*** felipemonteiro_ has quit IRC16:27
*** felipemonteiro_ has joined #openstack-meeting-516:27
*** yamamoto has quit IRC16:33
*** yamamoto has joined #openstack-meeting-516:34
*** renmak_ has quit IRC16:47
*** hoangcx_ is now known as hoangcx16:48
*** cristicalin has joined #openstack-meeting-516:49
*** felipemonteiro__ has joined #openstack-meeting-516:53
*** felipemonteiro_ has quit IRC16:57
*** yamamoto has quit IRC17:00
*** derekh has quit IRC17:02
*** wxy| has quit IRC17:05
*** yamamoto has joined #openstack-meeting-517:08
*** renmak_ has joined #openstack-meeting-517:11
*** yamamoto has quit IRC17:15
*** yamamoto has joined #openstack-meeting-517:15
*** cristicalin has quit IRC17:21
*** roman_g has quit IRC18:04
*** ianychoi has quit IRC18:22
*** ianychoi has joined #openstack-meeting-518:23
*** mjturek has quit IRC18:30
*** ianychoi has quit IRC18:41
*** ianychoi has joined #openstack-meeting-518:42
*** lunarlamp has quit IRC19:13
*** markvoelker_ has quit IRC19:41
*** markvoelker has joined #openstack-meeting-519:41
*** markvoelker has quit IRC19:45
*** lunarlamp has joined #openstack-meeting-519:48
*** markvoelker has joined #openstack-meeting-519:54
*** markvoelker_ has joined #openstack-meeting-520:17
*** markvoelker has quit IRC20:21
*** felipemonteiro__ has quit IRC20:56
*** renmak_ has quit IRC21:00
*** slaweq has quit IRC21:02
*** slaweq has joined #openstack-meeting-521:02
*** slaweq has quit IRC21:07
*** sshank has joined #openstack-meeting-521:08
*** yamamoto has quit IRC21:54
*** yamamoto has joined #openstack-meeting-521:54
*** sshank has quit IRC22:10
*** yamamoto has quit IRC22:35
*** renmak_ has joined #openstack-meeting-522:38
*** yamamoto has joined #openstack-meeting-522:39
*** yamamoto has quit IRC22:40
*** hongbin has quit IRC22:42
*** yamahata has quit IRC22:45
*** spiette has quit IRC22:57
*** slaweq has joined #openstack-meeting-523:03
*** slaweq has quit IRC23:08
*** radeks has quit IRC23:21
*** yamamoto has joined #openstack-meeting-523:40
*** hoangcx has quit IRC23:41
*** yamamoto has quit IRC23:46
*** iyamahat has joined #openstack-meeting-523:52

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!