Wednesday, 2015-03-18

*** dannywilson has quit IRC00:01
*** shwetaap has joined #openstack-meeting-400:02
*** shwetaap1 has joined #openstack-meeting-400:03
*** shwetaap has quit IRC00:07
*** banix has quit IRC00:12
*** markvoelker has quit IRC00:15
*** markvoelker has joined #openstack-meeting-400:32
*** watanabe_isao has joined #openstack-meeting-400:33
*** shwetaap1 has quit IRC00:34
*** banix has joined #openstack-meeting-400:43
*** rfolco has joined #openstack-meeting-400:46
*** ChuckC has quit IRC00:53
*** daneyon_ has joined #openstack-meeting-400:54
*** daneyon has quit IRC00:54
*** daneyon_ has quit IRC00:55
*** daneyon has joined #openstack-meeting-400:56
*** banix has quit IRC00:57
*** salv-orl_ has quit IRC01:04
*** ibiris is now known as ibiris_away01:09
*** Daisy_ has joined #openstack-meeting-401:28
*** s3wong_ has quit IRC01:40
*** banix has joined #openstack-meeting-401:43
*** ivar-laz_ has joined #openstack-meeting-401:55
*** VW_ has joined #openstack-meeting-401:56
*** Daisy__ has joined #openstack-meeting-401:58
*** ivar-lazzaro has quit IRC01:59
*** igordcard_ has quit IRC01:59
*** dims has quit IRC01:59
*** Daisy_ has quit IRC01:59
*** ivar-laz_ has quit IRC01:59
*** VW_ has quit IRC02:03
*** VW_ has joined #openstack-meeting-402:03
*** yamahata has quit IRC02:09
*** salv-orlando has joined #openstack-meeting-402:18
*** sdake__ has joined #openstack-meeting-402:21
*** VW_ has quit IRC02:23
*** sdake has quit IRC02:25
*** VW_ has joined #openstack-meeting-402:33
*** kfjohnson has joined #openstack-meeting-402:38
*** fnaval has quit IRC03:09
*** shwetaap has joined #openstack-meeting-403:10
*** eghobo has joined #openstack-meeting-403:24
*** banix has quit IRC03:25
*** salv-orlando has quit IRC03:29
*** Daisy__ has quit IRC03:33
*** sdake__ has quit IRC03:39
*** sdake has joined #openstack-meeting-403:41
*** sarob has joined #openstack-meeting-403:41
*** vishwanathj has joined #openstack-meeting-403:41
*** eghobo_ has joined #openstack-meeting-403:42
*** eghobo has quit IRC03:46
*** sarob has quit IRC03:47
*** rfolco has quit IRC03:53
*** jckasper has joined #openstack-meeting-403:56
*** eghobo has joined #openstack-meeting-403:56
*** eghobo_ has quit IRC03:57
*** ajmiller has joined #openstack-meeting-404:09
*** SumitNaiksatam has joined #openstack-meeting-404:17
*** eghobo has quit IRC04:27
*** salv-orlando has joined #openstack-meeting-404:28
*** jckasper has quit IRC04:45
*** ajmiller has quit IRC04:46
*** ajmiller has joined #openstack-meeting-404:46
*** VW_ has quit IRC04:47
*** VW_ has joined #openstack-meeting-404:48
*** VW__ has joined #openstack-meeting-404:48
*** dims has joined #openstack-meeting-404:52
*** VW_ has quit IRC04:53
*** VW__ has quit IRC04:57
*** dims has quit IRC04:57
*** Daisy_ has joined #openstack-meeting-404:57
*** VW_ has joined #openstack-meeting-404:58
*** VW__ has joined #openstack-meeting-404:58
*** VW__ has quit IRC04:59
*** VW_ has quit IRC05:02
*** yapeng has quit IRC05:11
*** sdake has quit IRC05:13
*** eghobo has joined #openstack-meeting-405:16
*** salv-orlando has quit IRC05:31
*** markvoelker has quit IRC05:33
*** shwetaap has quit IRC05:38
*** sarob has joined #openstack-meeting-405:43
*** sarob has quit IRC05:49
*** ibiris_away is now known as ibiris06:25
*** salv-orlando has joined #openstack-meeting-406:33
*** markvoelker has joined #openstack-meeting-406:33
*** markvoelker has quit IRC06:38
*** eghobo has quit IRC06:42
*** sarob has joined #openstack-meeting-406:45
*** sarob has quit IRC06:50
*** mestery has quit IRC06:58
*** numan has joined #openstack-meeting-407:00
*** bharath has quit IRC07:10
*** markvoelker has joined #openstack-meeting-407:17
*** pkoniszewski has joined #openstack-meeting-407:20
*** markvoelker has quit IRC07:21
*** salv-orlando has quit IRC07:33
*** salv-orlando has joined #openstack-meeting-407:42
*** sarob has joined #openstack-meeting-407:46
*** sarob has quit IRC07:51
*** bobmel has joined #openstack-meeting-408:00
*** belmoreira has joined #openstack-meeting-408:07
*** ibiris is now known as ibiris_away08:16
*** markvoelker has joined #openstack-meeting-408:18
*** markvoelker has quit IRC08:23
*** matrohon has joined #openstack-meeting-408:23
*** ibiris_away is now known as ibiris08:27
*** numan has quit IRC08:56
*** numan has joined #openstack-meeting-409:10
*** Daisy_ has quit IRC09:11
*** watanabe_isao has quit IRC09:18
*** markvoelker has joined #openstack-meeting-409:19
*** mfedosin has quit IRC09:21
*** markvoelker has quit IRC09:23
*** mfedosin has joined #openstack-meeting-409:26
*** numan has quit IRC09:35
*** dims_ has joined #openstack-meeting-409:43
*** numan has joined #openstack-meeting-409:48
*** bharath has joined #openstack-meeting-410:10
*** bharath has quit IRC10:15
*** markvoelker has joined #openstack-meeting-410:19
*** markvoelker has quit IRC10:24
*** mestery has joined #openstack-meeting-410:26
*** markvoelker has joined #openstack-meeting-411:20
*** markvoelker has quit IRC11:25
*** numan has quit IRC11:33
*** kobis has joined #openstack-meeting-411:33
*** VW_ has joined #openstack-meeting-411:41
*** sarob has joined #openstack-meeting-411:50
*** sarob has quit IRC11:55
*** VW_ has quit IRC11:57
*** Daisy_ has joined #openstack-meeting-411:58
*** david-lyle_afk is now known as david-lyle12:00
*** markvoelker has joined #openstack-meeting-412:02
*** shwetaap has joined #openstack-meeting-412:13
*** rfolco has joined #openstack-meeting-412:17
*** dims_ has quit IRC12:22
*** dims_ has joined #openstack-meeting-412:22
*** sdake has joined #openstack-meeting-412:23
*** ajmiller has quit IRC12:26
*** sdake_ has joined #openstack-meeting-412:37
*** Daisy__ has joined #openstack-meeting-412:39
*** sdake has quit IRC12:41
*** Daisy_ has quit IRC12:41
*** Daisy_ has joined #openstack-meeting-412:44
*** Daisy__ has quit IRC12:48
*** sarob has joined #openstack-meeting-412:51
*** VW_ has joined #openstack-meeting-412:54
*** salv-orlando has quit IRC12:56
*** sarob has quit IRC12:56
*** salv-orlando has joined #openstack-meeting-412:57
*** klamath has joined #openstack-meeting-413:02
*** klamath has quit IRC13:02
*** klamath has joined #openstack-meeting-413:03
*** banix has joined #openstack-meeting-413:06
*** banix has quit IRC13:07
*** Daisy_ has quit IRC13:08
*** jckasper has joined #openstack-meeting-413:27
*** ChuckC has joined #openstack-meeting-413:28
*** ibiris is now known as ibiris_away13:28
*** salv-orlando has quit IRC13:34
*** VW_ has quit IRC13:35
*** shwetaap has quit IRC13:36
*** ibiris_away is now known as ibiris13:39
*** VW_ has joined #openstack-meeting-413:41
*** shwetaap has joined #openstack-meeting-413:47
*** numan has joined #openstack-meeting-413:50
*** VW_ has quit IRC13:50
*** shwetaap has quit IRC13:51
*** sarob has joined #openstack-meeting-413:52
*** VW_ has joined #openstack-meeting-413:55
*** daneyon has quit IRC13:56
*** aventerav has joined #openstack-meeting-413:57
*** sarob has quit IRC13:57
*** sigmavirus24_awa is now known as sigmavirus2414:08
*** mfedosin has quit IRC14:13
*** VW_ has quit IRC14:13
*** mfedosin has joined #openstack-meeting-414:14
*** shwetaap has joined #openstack-meeting-414:22
*** mestery has quit IRC14:27
*** ajmiller has joined #openstack-meeting-414:34
*** VW_ has joined #openstack-meeting-414:43
*** daneyon has joined #openstack-meeting-414:46
*** daneyon_ has joined #openstack-meeting-414:52
*** sarob has joined #openstack-meeting-414:53
*** daneyon has quit IRC14:55
*** lennyb has joined #openstack-meeting-414:55
*** galstrom_zzz is now known as galstrom14:56
*** sarob has quit IRC14:58
*** patrickeast has joined #openstack-meeting-415:00
krtaylor#startmeeting third-party15:00
openstackMeeting started Wed Mar 18 15:00:29 2015 UTC and is due to finish in 60 minutes.  The chair is krtaylor. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: third-party)"15:00
openstackThe meeting name has been set to 'third_party'15:00
*** asselin_ has joined #openstack-meeting-415:00
krtayloranyone here for third party working group meeting?15:00
asselin_hi15:00
lennybHi15:00
krtaylorhi asselin_15:00
krtaylorhi lennyb15:00
mmedvedehello15:01
krtaylorhey mmedvede15:01
patrickeasthey15:01
wznoinskhi everyone15:01
krtaylorhi everybody15:01
krtaylorwe have a full agenda today15:02
krtaylor#link https://wiki.openstack.org/wiki/Meetings/ThirdParty#3.2F18.2F15_1500_UTC15:02
krtayloralso a quick announcement: this Saturday 21st is the gerrit os upgrade15:03
krtaylorand May 9th is the gerrit upgrade15:03
asselin_gerrit os upgrade --> new ip address15:04
krtaylorso there may be some service interruptions15:04
krtayloryes, there has been email sent out for details15:04
* krtaylor looks for link15:04
krtaylor#link http://lists.openstack.org/pipermail/openstack-dev/2015-February/056508.html15:05
krtaylorI havent seen anything newer15:05
krtaylorany other quick announcements?15:05
krtaylorok, on to agenda items15:06
krtaylor#topic Third-party CI documentation15:06
*** openstack changes topic to "Third-party CI documentation (Meeting topic: third-party)"15:06
krtaylorI am calling this one done for now15:07
krtaylorall outstanding patches have merged except one15:07
*** bobmel has quit IRC15:07
krtaylormmedvede, its your links patch15:07
mmedvedeoh15:07
*** bobmel has joined #openstack-meeting-415:07
mmedvedeneed to check on that15:08
krtaylorI feel that any other changes can happen after openstack-ci, downstream-puppet15:08
krtaylorany questions or comments on third party ci documentation?15:08
*** salv-orlando has joined #openstack-meeting-415:09
krtaylornext15:09
krtaylor#topic openstack-ci or downstream-puppet15:09
*** openstack changes topic to "openstack-ci or downstream-puppet (Meeting topic: third-party)"15:09
krtaylorasselin_, good progress here15:10
asselin_yes, TC approved the governance change yesterday15:10
krtaylorone of the project adds has merged15:10
krtayloryes, great news15:10
asselin_next we should be able to merge the project-config change & then we'll have a repo we can submit new changes to.15:11
asselin_I did put a few items in storyboard. Still need to populate more. This way those who want to work on it can take ownership of the different sections.15:12
*** pkoniszewski has quit IRC15:12
krtaylorasselin_, do you have a link handy?15:12
asselin_trying to find it...15:12
krtaylorhere is the patches:15:13
krtaylor#link https://review.openstack.org/#/q/topic:downstream-puppet,n,z15:13
krtaylorwith this being a focus item for infra, this will make quick progress15:13
asselin_#link https://storyboard.openstack.org/#!/story/200010115:14
krtaylorbut a good opportunity for working group folks to get involved again15:14
* krtaylor looks15:14
krtaylorasselin_, what do you need help with first15:14
asselin_I need to add more tasks.15:15
asselin_I will add one for each component mentioned in the spec.15:15
*** watanabe_isao has joined #openstack-meeting-415:15
krtaylorasselin_, then a few patches to prime the pump I presume15:15
asselin_yes, the log server one is probably the easiest. I have something up for that already, and will adjust it to fit the direction of the spec15:16
*** carl_baldwin has joined #openstack-meeting-415:16
*** salv-orlando has quit IRC15:17
krtaylorasselin_ thanks for all your work on this, it is really important to this group15:18
krtaylorok, any question for asselin_ ?15:18
krtaylornext topic then15:19
krtaylor#topic Repo for third party tools15:19
*** openstack changes topic to "Repo for third party tools (Meeting topic: third-party)"15:19
krtaylorthis has started with a set of links in the Third Party CI Working Group wiki page15:19
krtaylorwe (PowerKVMCI) are still getting approval to make our tools public15:20
krtaylornot expecting any problems, just have to get the appropriate checks15:20
*** watanabe_isao has quit IRC15:21
krtaylorI encourage everyone to put links to any tools that help them in their environment here15:21
krtaylor#link https://wiki.openstack.org/wiki/ThirdPartyCIWorkingGroup#Third_Party_CI_System_Tools_Index15:21
*** vishwanathj has quit IRC15:22
krtaylorthis is a repository for info that has been cluttering up the meeting page for a while, I need to move some of that info around at some point15:22
krtaylorthe plan is to gather up tools and see if we have enough mass to create a new project repo15:23
patrickeastseems like a good starting point15:23
krtaylormaybe along side the openstack-ci or in stackforge15:23
krtaylorwe can list early proof of concepts for monitoring dashboards there also15:24
krtaylorthat was more of an announcement to gather tools, but any questions on that?15:25
krtayloronward15:26
krtaylor#topic What to do with monitoring dashboard15:26
*** openstack changes topic to "What to do with monitoring dashboard (Meeting topic: third-party)"15:26
krtaylorso this spec has slowed to a stop15:26
*** ajmiller has quit IRC15:26
krtaylorpatrickeast, I like your view, mmedvede has brought that up behind our firewall15:27
mmedvedepatrickeast: it works :)15:27
patrickeastnice!15:27
patrickeasti have been swamped with other stuff so i haven't had any time to keep tinkering with it15:27
patrickeastall kinds of easy stuff to improve upon there15:28
mmedvedeeven the functionality it already has is very helpful15:28
krtaylorwith a few changes, it could be a worthy radar replacement15:28
krtayloryes, very nice to see our progress against jenkins quickly15:28
* asselin_ looks for link15:28
mmedvede#link https://github.com/patrick-east/scoreboard15:29
asselin_where's the link to the running version?15:29
krtaylorthanks mmedvede15:29
mmedvedeasselin_: I think it is down15:29
patrickeastoh uh15:29
patrickeastlemmie check15:29
mmedvedehttp://ec2-54-67-102-119.us-west-1.compute.amazonaws.com:5000/?project=openstack%2Fnova&user=&timeframe=2415:29
*** bobmel has quit IRC15:30
krtayloryeah, thats why we started one15:30
patrickeastah yea15:30
patrickeastits down15:30
mmedvedeI thought it was just a demo and not intended for everybody's use15:30
patrickeasti have one inside my firewall that i keep track of mainly15:30
*** ajmiller has joined #openstack-meeting-415:30
*** bobmel has joined #openstack-meeting-415:30
patrickeastyea exactly15:30
patrickeastneeds a more beefy server for general use15:30
asselin_ok I guess I'll set one up too :)15:30
krtaylorok, so back to the spec, abandon and mod scoreboard?15:31
krtaylormaybe we could get infra to spin up a vm to run it on?15:32
krtaylorsounds like  a new simplified spec is in order15:32
asselin_krtaylor, yes, on both15:32
patrickeastyea i liked what we had going in that spec15:32
patrickeastwe just added too much15:32
krtayloragreed, no it was useful work15:33
patrickeastbut there is also a demand for something now i think15:33
krtaylorbut it did boil the ocean15:33
*** kobis has quit IRC15:33
patrickeastsort of a stop gap solution, and a more long term solution15:33
krtaylorthere are some really good ideas there though15:33
asselin_patrickeast, +115:33
asselin_krtaylor, yes, and they should be put into v215:33
krtaylorok, I'll take an action to work with sweston and abandon that spec, start a new simplified one15:34
*** bobmel has quit IRC15:34
krtaylor#action krtaylor to migrate old dashboard spec to new simplified v215:34
krtaylorany other questions or comments on monitoring dashboard?15:35
krtaylorok then, on to one of my favorite parts of these meetings15:36
krtaylor#topic Highlighting Third-Party CI Service15:36
*** openstack changes topic to "Highlighting Third-Party CI Service (Meeting topic: third-party)"15:36
wznoinskhi15:36
krtaylorthis week we have wznoinsk to tell us about Intel Networking CI15:36
wznoinskfirst of all I need you to have a quick look at http://pastebin.com/972cE2mc15:37
krtaylorthanks wznoinsk, you have the floor15:37
*** banix has joined #openstack-meeting-415:37
wznoinskI'll be focusing on point 5. - workarounds using docker/containers in a CI system15:37
krtaylorwow, nice writeup15:38
wznoinskpastebin is a bit of background and some thoughts15:38
asselin_#link http://pastebin.com/972cE2mc15:38
wznoinsklong story short: we needed a CI system that will spin up fast without a need of farm of hosts/VMs, docker was a perfect solution to have a clean instances of operating system and quite performing compared to VMs15:39
wznoinskbecause you share kernel between the host and containers running on it there are a few things you may hit (regarding resources sharing etc - if more than one container needs access to hugepages for example)15:40
*** bobmel has joined #openstack-meeting-415:40
wznoinskwe had to allocate hugepages on the host because that's most probable way of getting the amount hugepages you've originally requested, allocating hugepages inside the containers wouldn't be guaranteed15:42
krtaylorwznoinsk, is the jenkins and other infra services running in a container also? different system?15:42
wznoinskjenkins is running on the baremetal, same containers are spawned on15:43
krtaylorwznoinsk, this is a really interesting setup15:44
wznoinskit's doable to have jenkins inside a container, so far we only be providing pip mirror (bandersnatch), apt/yum cache and docker registry (to keep CI images) in containers15:44
patrickeastyea this setup is really cool15:45
* patrickeast wonders if containers would make for easier FC testing15:45
* krtaylor notes the 5-7 min setup15:45
patrickeasthaha yea15:45
patrickeastthats pretty sweet15:46
wznoinskwhile it's possible to link containers using linux bridge/ovs on the same host I think for containers sitting on different baremetals you still need ssh etc.15:46
*** fnaval has joined #openstack-meeting-415:46
*** lennyb_ has joined #openstack-meeting-415:46
*** matrohon has quit IRC15:47
lennyb_wznoisnsk, are you running only tempest? What about https://github.com/intel-hw-ci/Intel-Openstack-Hardware-CI/tree/master/pci_testcases  and Rally test suite?15:48
wznoinskhttp://intel-openstack-ci-logs.ovh/networking-ci/refs/changes/95/158495/19/console.log.gz - 10mins stacking, http://intel-openstack-ci-logs.ovh/networking-ci/refs/changes/60/163860/5/console.log.gz - 12, 5-7mins was seen when the machine was a bit less busy15:48
wznoinsklennyb_: our guys that own PCI/SRIOV CI are doing PCI tests, networking is mainly ovs on intel's dpdk15:49
krtaylorwznoinsk, what is the main reasons for choosing a solution built on containers? speed?15:50
wznoinskwe don't have any custom tests for that one, we will for the (still to come) numa ci15:50
lennyb_thanks15:50
wznoinskkrtaylor: compared to VMs yes, and if you're talking about top notch hardware (nic?) features you may not have them inside VMs to test them15:51
*** sdake_ has quit IRC15:51
wznoinskcompared to barematal on the other hand - it's cleaner, the container has filesystem isolated from the host so devstack is no longer meesing with your operating system/pip packages15:52
*** mestery has joined #openstack-meeting-415:52
krtaylorwznoinsk, really nice summary, the pros/cons section will help others trying to make this same decision15:52
*** sdake has joined #openstack-meeting-415:52
wznoinskI should make a note that it's not a finished list - especially for the cons part ;-)15:53
krtaylorwznoinsk, what is a problem that stumped you for a while and how did you get around it?15:53
wznoinskI have feeling upstream ovs may not necessarily play well with network name spaces containers/docker is build around15:54
*** kobis has joined #openstack-meeting-415:54
wznoinskthe one above, still investigating why I'm having problems with vanilla ovs, after trying different setups and kernels I still didn't figure out the reason15:54
*** bobmel_ has joined #openstack-meeting-415:55
*** sarob has joined #openstack-meeting-415:55
krtaylorwznoinsk, have you scripted any tools to help with monitoring or deploying in this environment? any you'd want to share?15:56
*** SumitNaiksatam has quit IRC15:57
wznoinskthere are some examples in the pastebin as well but the bigger one I think was that docker/containers are still quite fresh to the world and there are some issues with these, you have to kill a container that is hanging there for too long for a reason that's not yet resolved in docker/lxc, you need to monitor resources on a lower level to react when one of the containers gets abusive about memory/other resources blocking other c15:57
*** salv-orl_ has joined #openstack-meeting-415:58
*** bobmel has quit IRC15:58
wznoinskI have a few nagios checks I'm using for hugepages, I need to write a few to monitor docker/jenkins behaviour/stuck builds15:58
krtaylorwe are close to time, any questions for wznoinsk ?15:59
*** vishwanathj has joined #openstack-meeting-415:59
wznoinsknot much to share at the moment but some nagios checks may land in your tools index eventually15:59
asselin_wznoinsk, thanks for sharing. very interesting setup.15:59
krtaylorexcellent, that would be a welcome addition15:59
wznoinskhappy to help if anyone's interested in containers, it still new to me so I may struggle to answer all questions but will do my best, i'm on IRC /whois wznoinsk16:00
mmedvedewznoinsk: that was great16:00
krtaylorwznoinsk, yes, thanks for sharing about your system, very interesting test environment16:00
*** sarob has quit IRC16:00
krtaylorthanks everybody, great meeting!16:00
wznoinskthanks16:00
krtaylor#endmeeting16:00
*** openstack changes topic to "OpenStack Meetings"16:00
openstackMeeting ended Wed Mar 18 16:00:46 2015 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/third_party/2015/third_party.2015-03-18-15.00.html16:00
*** bobmel has joined #openstack-meeting-416:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/third_party/2015/third_party.2015-03-18-15.00.txt16:00
openstackLog:            http://eavesdrop.openstack.org/meetings/third_party/2015/third_party.2015-03-18-15.00.log.html16:00
lennyb_Can I ask a short question related to CI in general ?16:01
krtaylorlennyb_, lets move to -infra channel16:01
*** yamahata has joined #openstack-meeting-416:02
*** lennyb has quit IRC16:03
*** asselin_ has quit IRC16:04
*** bobmel_ has quit IRC16:04
*** belmoreira has quit IRC16:07
*** ja- has joined #openstack-meeting-416:07
*** banix_ has joined #openstack-meeting-416:07
*** zz_ja has quit IRC16:09
*** banix has quit IRC16:10
*** banix__ has joined #openstack-meeting-416:10
*** ja| has joined #openstack-meeting-416:10
*** ja| is now known as zz_ja|16:10
*** banix_ has quit IRC16:12
*** ja- has quit IRC16:13
*** lennyb_ has quit IRC16:15
*** Swami has joined #openstack-meeting-416:16
*** vishwanathj has quit IRC16:17
*** vishwanathj has joined #openstack-meeting-416:19
*** vishwana_ has joined #openstack-meeting-416:36
*** vishwanathj has quit IRC16:40
*** vishwana_ has quit IRC16:41
*** sigmavirus24 is now known as sigmavirus24_awa16:42
*** ajmiller has quit IRC16:44
*** VW_ has quit IRC16:52
*** sarob has joined #openstack-meeting-416:56
*** sarob has quit IRC17:01
*** Salman_ has joined #openstack-meeting-417:03
*** ajmiller has joined #openstack-meeting-417:05
*** emagana has joined #openstack-meeting-417:06
*** sigmavirus24_awa is now known as sigmavirus2417:10
*** sbalukoff has quit IRC17:12
*** barrett has joined #openstack-meeting-417:15
*** salv-orl_ has quit IRC17:19
*** s3wong has joined #openstack-meeting-417:22
*** patrickeast has quit IRC17:23
*** salv-orlando has joined #openstack-meeting-417:25
*** sabari has joined #openstack-meeting-417:30
*** sabari has left #openstack-meeting-417:30
*** sdake_ has joined #openstack-meeting-417:31
*** barrett has quit IRC17:32
*** barrett1 has joined #openstack-meeting-417:33
*** sdake has quit IRC17:35
*** vishwanathj has joined #openstack-meeting-417:37
*** vishwanathj has quit IRC17:42
*** bobmel has quit IRC17:51
*** bobmel has joined #openstack-meeting-417:51
*** ChuckC has quit IRC17:51
*** ChuckC_ has joined #openstack-meeting-417:51
*** ChuckC_ is now known as ChuckC17:52
*** turnerg has joined #openstack-meeting-417:52
*** kobis has quit IRC17:55
*** bobmel has quit IRC17:56
*** sarob has joined #openstack-meeting-417:57
*** Salman_ has quit IRC17:59
*** sarob has quit IRC18:02
*** sdake has joined #openstack-meeting-418:04
*** sdake_ has quit IRC18:07
*** bobmel has joined #openstack-meeting-418:13
*** eghobo has joined #openstack-meeting-418:14
*** numan has quit IRC18:14
*** igordcard has quit IRC18:16
*** SumitNaiksatam has joined #openstack-meeting-418:18
*** SumitNaiksatam has left #openstack-meeting-418:22
*** VW_ has joined #openstack-meeting-418:22
*** SumitNaiksatam has joined #openstack-meeting-418:22
*** sbalukoff has joined #openstack-meeting-418:23
*** vishwanathj has joined #openstack-meeting-418:26
*** VW_ has quit IRC18:30
*** bobmel has quit IRC18:31
*** bobmel has joined #openstack-meeting-418:31
*** dannywilson has joined #openstack-meeting-418:35
*** bobmel has quit IRC18:36
*** galstrom is now known as galstrom_zzz18:51
*** sarob has joined #openstack-meeting-418:58
*** galstrom_zzz is now known as galstrom19:00
*** sarob has quit IRC19:03
*** jamiem has joined #openstack-meeting-419:05
*** emagana has quit IRC19:06
*** ivar-lazzaro has joined #openstack-meeting-419:07
*** emagana has joined #openstack-meeting-419:09
*** vishwana_ has joined #openstack-meeting-419:13
*** vishwanathj has quit IRC19:15
*** daneyon has joined #openstack-meeting-419:15
*** daneyon_ has quit IRC19:19
*** salv-orlando has quit IRC19:24
*** salv-orlando has joined #openstack-meeting-419:30
*** sballe has quit IRC19:37
*** krtaylor has quit IRC19:39
*** vishwana_ has quit IRC19:40
*** sballe has joined #openstack-meeting-419:41
*** rfolco has quit IRC19:41
*** krtaylor has joined #openstack-meeting-419:41
*** VW_ has joined #openstack-meeting-419:44
*** VW_ has quit IRC19:44
*** jamiem has left #openstack-meeting-419:45
*** bharath has joined #openstack-meeting-419:45
*** Nikolay_St has joined #openstack-meeting-419:51
*** VW_ has joined #openstack-meeting-419:52
*** VW_ has quit IRC19:52
*** sdake_ has joined #openstack-meeting-419:52
*** VW_ has joined #openstack-meeting-419:52
*** matrohon has joined #openstack-meeting-419:54
*** Rockyg has joined #openstack-meeting-419:54
*** zigo__ has joined #openstack-meeting-419:56
*** zigo has quit IRC19:56
*** sdake has quit IRC19:56
*** barclaac|2 has joined #openstack-meeting-419:57
*** sigmavirus24 is now known as sigmavirus24_awa19:57
*** sarob has joined #openstack-meeting-419:59
Nikolay_Sthi20:00
Nikolay_StLogWorkingGroup guys20:00
Nikolay_Stwho is in?20:00
Rockygo?20:00
*** bknudson has joined #openstack-meeting-420:00
Nikolay_Sto/20:00
*** mwang2 has joined #openstack-meeting-420:00
*** emagana has quit IRC20:01
Rockyg#start meeting Log_wg20:01
Rockyg#startmeeting Log_wg20:02
openstackMeeting started Wed Mar 18 20:02:00 2015 UTC and is due to finish in 60 minutes.  The chair is Rockyg. Information about MeetBot at http://wiki.debian.org/MeetBot.20:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.20:02
*** openstack changes topic to " (Meeting topic: Log_wg)"20:02
openstackThe meeting name has been set to 'log_wg'20:02
Nikolay_Stok, nice20:02
*** VW_ has quit IRC20:02
RockygWelcome, folks20:02
bknudsonhi20:02
Nikolay_Sto/20:02
*** sarob has quit IRC20:04
RockygAgenda got updated on the wiki page20:04
bknudsonlink?20:04
Rockyg#link https://wiki.openstack.org/wiki/Meetings/log-wg20:04
Rockyg#Topic Liasons -- intros and updates20:05
*** openstack changes topic to "Liasons -- intros and updates (Meeting topic: Log_wg)"20:05
Nikolay_Stnothing from my side on this topic20:06
bknudsonI'm going to add asking someone to sign up as keystone liaison to the keystone meeting next week.20:06
bknudsonif nobody else signs up it'll be me.20:06
bknudson(it'll be me)20:06
Rockyg#action bknudson will try to get someone as Keystone Liaison20:07
Rockygjohnthetubaguy is Nova, but has a scheduling conflict for the meetings20:07
RockygI have an action item from the first meeting to try and get signups.20:08
RockygShould we try for an Ops liaison, too?20:09
RockygSounds like we are ready for next topic20:10
Nikolay_StRockyg: what do you meand under Ops?20:10
Nikolay_St*mean20:10
* bknudson added topic to keystone meeting agenda.20:10
*** rfolco has joined #openstack-meeting-420:10
RockygNikolay_St:  Yes.  Someone to monitor and get Ops participation when needed20:11
RockygLet's move to next  topic20:12
Rockyg#topic review of action items20:12
*** openstack changes topic to "review of action items (Meeting topic: Log_wg)"20:12
RockygI'll start with mine from 3/4....Error code spec20:13
bknudsonis there a spec?20:14
RockygIt's within an hour of first draft submit to gerrit but I got a new laptop last fall and have to reinstall the apps to be able to do the git review from it20:14
RockygWorking through the process now, so should be able to submit either today or tomorrow20:14
* bknudson isn't sure why error code spec is in logging working group?20:14
bknudsonthought it would be api20:15
RockygOverall spec for error codes.  Error codes can be used for non-api stuff, too.20:15
RockygEvery error message should have an identifying code.20:15
bknudsonahh. we've got a system here that tags them in the po file.20:16
Rockygpo?20:16
bknudsonthe messages file20:16
RockygAh.20:16
bknudsonI don't know how well it works of if it's really used.20:17
Rockygalso, since they *should* be part of message header, they  get implemented in oslo.log as part of the message formatting20:17
bknudsonessentially generates an ID from the message text, or you can override it with a specific ID.20:17
RockygCan you put up a link to either that code or better a spec or blueprint?  It would be good to read up on it20:18
Rockygalso, I don't think every project has that20:18
bknudsonno project has it, it's in our product... so we don't have a spec or blueprint... although maybe we did think about upstreaming it at some point.20:19
bknudsonwill ask around.20:19
RockygCool.  It might end up useful as part of this effort20:19
Nikolay_StI agree with Rockyg20:20
Rockygjokke_  dhellmann and I had discussed a tool that would assign the number part of the error code and in the process, would take the description and put all in a database.  so we don't have duplicate codes and we always get a description20:21
*** sigmavirus24_awa is now known as sigmavirus2420:22
* bknudson is looking at the code now... (internal only)20:22
Rockyganyway, I'll post a message to the dev and ops mailing lists when I get the first rev into gerrit.  And everyone can review it20:22
Nikolay_StRockyg: sounds good20:23
RockygSecond AI I had was getting a cross project owner for the referrer ID spec.  It appeasrs that also got discussed last meeting.  can we get links to all the project specific specs posted here?20:24
Rockygjohnthetyubaguy wants to do some work in this area and I thought he might be a good owner for the xproject spec20:24
bknudsony, this tool that we have isn't really appropriate for how openstack does things. Packagers like us can use it.20:25
Nikolay_St#link http://specs.openstack.org/openstack/sahara-specs/specs/kilo/sahara-log-guidelines.html20:25
bknudsonbut, maybe it provides some ideas for how to do it in os.20:25
Rockygbknudson, that would be cool.  FYI the error codes on everything go back to mainframe and high performance compute vendors.  books of error codes and what they meant20:26
bknudsony, that's why we did it... we're old hands at this.20:26
RockygAlso cool.20:27
*** bharath has quit IRC20:27
RockygWe've got the link to the Sahara spec.  I think there's a cinder spec also.  I'll see what I can find on that one and add it to the LogworkingGroup page20:28
Nikolay_StRockyg: Sahara spec is on the page, also20:29
*** turnerg has quit IRC20:29
RockygYup.  Saw that.  Thanks!20:29
Nikolay_StI think we can go with my item from 3/1120:30
Nikolay_Stthe etherpad is here20:30
Nikolay_St#link https://etherpad.openstack.org/p/Logging-Improvements20:30
Rockygtyped faster than me;-)  Thanks20:30
* bknudson is looking forward to spec on message ids... will add folks here who are interested.20:30
Nikolay_Stas I said on previous meeting I still don't have enough time to contribute some *big* things for improvement20:31
Nikolay_Stjust some notices after logs refactoring20:31
Nikolay_StI hope that other Sahara guys who is involved in logging improvement logging could contribute before next meeting of LWG20:32
Nikolay_Stor I will contribute after I discuss some questions with them20:32
RockygThat's good stuff, though, and reviewing the xproject specs, or getting some project eyes on them will go a long way20:32
Rockygnikolay_St: is Sahara tagging log bugs?  If not, could you create a log tag ans start?20:34
*** bharath has joined #openstack-meeting-420:34
Nikolay_StRockyg: uhm... looks like I can't get the point :(20:35
Nikolay_StRockyg: I'm sure that we don't tag log bugs20:35
Nikolay_StRockyg: but can't get what you want me to do20:35
RockygIn launchpad, bugs filed against Sahara have tags.  If you know of bugs related to logging, just add the tag "log"20:35
RockygAlso, in the ehterpad you posted, Item 2, are bugs filed for either of the examples?20:36
*** jokke_ has joined #openstack-meeting-420:37
RockygAnd, is Sahara using oslo.log?20:38
jokke_,wi2520:38
jokke_sorry20:38
Nikolay_StRockyg: yeap, Sahara using oslo.log20:38
Nikolay_StRockyg: not yeat, have no time for this :( was busy with devstack artifacts20:39
Nikolay_StRockyg: will be back for logging before the end of the week20:39
RockygThat's OK.  But we need to get them filed soon after 3/23 so that Oslo can fix as many as possible so Sahara (and other projects') code can work properly20:40
*** daneyon has quit IRC20:42
RockygAlso, FYI for people interested in this stuff, Oslo has (or will have) a config option inglobal requirements text file to set logging to syslog format.  All projects using oslo.log will get the benefit of consistency20:42
Nikolay_StRockyg: it's not the *bug* related for oslo.log20:42
*** daneyon has joined #openstack-meeting-420:42
bknudsonI'm not sure whether the default oslo.log config is all that useful for real deployments...20:42
Nikolay_StRockyg: finally I get what you're talking about :)20:42
bknudsonthey probably need to use a logging.conf file20:43
Rockygbknudson:  good to know.20:43
bknudson#link https://review.openstack.org/#/c/164851/20:43
bknudsonoslo.log is handy for the default config that we run in the gate and during dev, but real deployments are probably going to want a file/syslog rather than stdout.20:44
bknudsonThe above link is an oslo.log spec that folks here might be interested in (add yourself)20:44
Rockygdoh.  Yeah!20:44
*** eghobo has quit IRC20:45
RockygOne of the aims with this group is at a minimum to get a decent syslog compliant config20:45
bknudsonI like that idea... would make oslo.log useful.20:46
bknudsonmore useful (sorry020:46
Rockygdhellmann and team says oslo.log is already set up to do that, it's a matter of setting up the config.20:47
Rockygalso, logging different levels to different files and dynamic changes to that20:47
bknudsonif it was just a switch --use-syslog or use_syslog=True that would be nice.20:47
bknudsonand also if it was tested in devstack would be bonus.20:47
RockygThat's what it is supposed to be.20:47
bknudsontested in gate.20:47
bknudson(if this is how we expect real deployments to operate)20:48
RockygWrite all these things down in the etherpad.  we can make specs or blueprints for them if they aren't in the code, and then they can be prioritized.20:48
bknudsony, we already have this option in keystone: http://git.openstack.org/cgit/openstack/keystone/tree/etc/keystone.conf.sample#n16520:49
bknudsonhave not tried it.20:49
RockygOK.  Let's get an update on jokke_ 's action item.20:49
bknudsondo we have an etherpad for these things already?20:50
RockygYes.  That's the same option that dhellmann wants to have in global so that everyone who uses oslo.log will automatically get syslog on the projects' errors20:50
jokke_No update ... will get chaser out there next week when we have got over this freeze panic across the border20:50
jokke_s20:50
Rockyg#link https://etherpad.openstack.org/p/Logging-Improvements20:50
bknudsonoh, thought that was just for sahara.20:51
Nikolay_Stbknudson: nope20:51
RockygI think it's more important to categorize the issues and improvements by log area than by project area.20:51
Nikolay_Stbknudson: it was create as a place to collect an information about all possibilities and projects20:52
RockygBut, we also have another etherpad for general notes.  Wait a sec...20:52
*** sdake has joined #openstack-meeting-420:52
Rockyg#link https://etherpad.openstack.org/p/Log-Working-Group20:53
RockygThat might be a good place to put xproject improvements20:53
bknudsonwhere do you want syslog logging?20:54
*** bharath has quit IRC20:54
bknudsonit's easy enough to move, so I'm not worried about it (bikeshedding)20:55
*** bharath has joined #openstack-meeting-420:55
RockygI think logging improvements is the place.  We can link to that etherpad from the WG one20:55
bknudsonok20:55
*** sdake_ has quit IRC20:56
RockygLet's move on20:57
Rockyg#topic relevant specs20:57
*** openstack changes topic to "relevant specs (Meeting topic: Log_wg)"20:57
bknudsonoops, should have waited.20:57
bknudson#link https://review.openstack.org/#/c/164851/20:57
RockygWe'll need to get as many of the project specific specs idenified as possible, including Oslo ;-)20:58
RockygThnaks bknudson20:58
bknudsonIf I was making changes in keystone to improve logging I'd just file bugs or just post the change.20:58
RockygWe should add those to either etherpad or wiki.  I'm thinking wiki.  we've got a spot for that on the wiki page already20:58
RockygWhen you file the bug(s) tag them with "log"20:59
RockygThat way we'll have a way to select for them across projects20:59
*** sarob has joined #openstack-meeting-421:00
*** daneyon has quit IRC21:00
bknudsonfind this one? https://bugs.launchpad.net/keystone/+bug/143219121:00
openstackLaunchpad bug 1432191 in Keystone "Logs useless debugging issue with external auth" [Low,In progress] - Assigned to Brant Knudson (blk-u)21:00
*** daneyon has joined #openstack-meeting-421:00
RockygThis is the kind of info the liaisons need to spread through project meetings21:01
RockygOoooh! look at that! a bug with a log tag!21:01
bknudsonthere's 2 now.21:02
jokke_:)21:03
bknudsonthe link to log bugs is too long, so just put it in the etherpad.21:03
*** Nikolay_St has quit IRC21:04
RockygI think I need to add the tag to the OpenStack over project21:04
*** Nikolay_St has joined #openstack-meeting-421:04
*** sarob has quit IRC21:05
Rockygbut if you do an advanced search, a fuel bug and a keystone bug turn up21:06
RockygThanks for the link.  Yeah, I'm hoping with tags, we can make the dashboard query a lot shorter.21:07
RockygOops.  I think we ran over.21:08
Rockyg#endmeeting21:08
*** openstack changes topic to "OpenStack Meetings"21:08
openstackMeeting ended Wed Mar 18 21:08:13 2015 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)21:08
openstackMinutes:        http://eavesdrop.openstack.org/meetings/log_wg/2015/log_wg.2015-03-18-20.02.html21:08
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/log_wg/2015/log_wg.2015-03-18-20.02.txt21:08
openstackLog:            http://eavesdrop.openstack.org/meetings/log_wg/2015/log_wg.2015-03-18-20.02.log.html21:08
*** jokke_ has left #openstack-meeting-421:08
Nikolay_Stthank guys21:08
Nikolay_Stbye!21:08
RockygBut no one else has this channel now.  If you have agenda items, go ahead and put them in the agenda.21:08
Nikolay_Sthm21:08
RockygAnd thanks everybody!!!@!!21:09
Nikolay_StI'm done for today :)21:09
RockygI thikn we may need to move this meeting earlier.21:09
bknudsonthanks.21:09
Nikolay_StRockyg: sounds good for me21:09
Nikolay_Stbut well21:10
Nikolay_StI need to go21:10
*** Nikolay_St has quit IRC21:10
RockygG'night!21:10
*** banix__ has quit IRC21:13
*** Swami has quit IRC21:17
*** ChuckC has quit IRC21:19
*** Swami has joined #openstack-meeting-421:27
*** Rockyg has quit IRC21:40
*** turnerg has joined #openstack-meeting-421:41
*** vishwanathj has joined #openstack-meeting-421:45
*** jckasper has quit IRC21:45
*** flaper87 has quit IRC21:50
*** turnerg has quit IRC21:50
*** aventerav has left #openstack-meeting-421:51
*** sigmavirus24 is now known as sigmavirus24_awa21:51
*** yamahata has quit IRC21:52
*** yamahata has joined #openstack-meeting-421:53
*** flaper87 has joined #openstack-meeting-421:53
*** matrohon has quit IRC21:54
*** klamath has quit IRC21:54
*** sarob has joined #openstack-meeting-421:58
*** Rockyg has joined #openstack-meeting-421:59
*** asselin_ has joined #openstack-meeting-422:00
*** bharath has quit IRC22:05
*** asselin_ has quit IRC22:05
*** shwetaap has quit IRC22:08
*** bknudson has quit IRC22:09
*** carl_baldwin has quit IRC22:11
*** Rockyg has quit IRC22:21
*** vishwanathj has quit IRC22:25
*** bharath has joined #openstack-meeting-422:27
*** barclaac has joined #openstack-meeting-422:32
*** barclaac|2 has quit IRC22:34
*** ajmiller_ has joined #openstack-meeting-422:36
*** galstrom is now known as galstrom_zzz22:37
*** daneyon_ has joined #openstack-meeting-422:38
*** s3wong has quit IRC22:38
*** ajmiller has quit IRC22:39
*** daneyon has quit IRC22:41
*** s3wong has joined #openstack-meeting-422:42
*** rolandchan has joined #openstack-meeting-422:52
*** Rockyg has joined #openstack-meeting-422:55
*** VW_ has joined #openstack-meeting-422:58
*** qwebirc25048 has joined #openstack-meeting-423:00
*** qwebirc25048 has quit IRC23:01
*** bharath_ has joined #openstack-meeting-423:01
*** bharath has quit IRC23:04
*** ajmiller_ is now known as ajmiller23:16
*** wojdev has joined #openstack-meeting-423:19
*** Swami has quit IRC23:22
*** daneyon_ has quit IRC23:27
*** daneyon has joined #openstack-meeting-423:28
*** dims__ has joined #openstack-meeting-423:29
*** wojdev has quit IRC23:32
*** watanabe_isao has joined #openstack-meeting-423:32
*** daneyon has quit IRC23:33
*** dims_ has quit IRC23:33
*** barclaac|2 has joined #openstack-meeting-423:43
*** barclaac has quit IRC23:47
*** galstrom_zzz is now known as galstrom23:54
*** ajmiller has quit IRC23:55
*** wojdev has joined #openstack-meeting-423:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!