Tuesday, 2019-08-20

*** markvoelker has quit IRC00:01
*** brinzhang has quit IRC00:12
*** brinzhang has joined #openstack-meeting00:13
*** mattw4 has quit IRC00:18
*** jamesmcarthur has quit IRC00:23
*** gyee has quit IRC00:36
*** altlogbot_3 has quit IRC00:46
*** altlogbot_0 has joined #openstack-meeting00:47
*** mhen has quit IRC01:08
*** igordc has quit IRC01:11
*** hongbin has joined #openstack-meeting01:24
*** dviroel_ has quit IRC01:42
*** markvoelker has joined #openstack-meeting01:51
*** markvoelker has quit IRC01:55
*** apetrich has quit IRC02:10
*** bobh has joined #openstack-meeting02:24
*** bobh has quit IRC02:26
*** ricolin has joined #openstack-meeting02:39
*** diablo_rojo has joined #openstack-meeting02:43
*** ykatabam has joined #openstack-meeting03:17
*** psachin has joined #openstack-meeting03:43
*** ykatabam has quit IRC03:48
*** ykatabam has joined #openstack-meeting03:50
*** hongbin has quit IRC03:51
*** moguimar has quit IRC03:55
*** moguimar has joined #openstack-meeting03:55
*** armax has quit IRC04:00
*** nitinuikey has joined #openstack-meeting04:11
*** ykatabam has quit IRC04:17
*** ykatabam has joined #openstack-meeting04:19
*** rbudden has quit IRC04:23
*** rbudden has joined #openstack-meeting04:23
*** rbudden has joined #openstack-meeting04:24
*** rbudden has quit IRC04:24
*** rbudden has joined #openstack-meeting04:25
*** rbudden has quit IRC04:30
*** nitinuikey has quit IRC04:41
*** ykatabam has quit IRC04:58
*** dkushwaha has joined #openstack-meeting05:08
*** janki has joined #openstack-meeting05:10
*** links has joined #openstack-meeting05:14
*** diablo_rojo has quit IRC05:27
*** links has quit IRC05:35
*** links has joined #openstack-meeting05:37
*** kopecmartin|off is now known as kopecmartin05:37
*** ekcs has quit IRC05:38
*** persia has quit IRC05:49
*** ykatabam has joined #openstack-meeting05:52
*** markvoelker has joined #openstack-meeting05:55
*** persia has joined #openstack-meeting06:00
*** persia has quit IRC06:03
*** persia has joined #openstack-meeting06:05
*** persia has quit IRC06:05
*** markvoelker has quit IRC06:05
*** persia has joined #openstack-meeting06:05
*** markvoelker has joined #openstack-meeting06:06
*** markvoelker has quit IRC06:10
*** ykatabam has quit IRC06:31
*** rcernin has quit IRC06:35
*** hyunsikyang has joined #openstack-meeting06:45
*** k-keiko has joined #openstack-meeting06:47
*** hongbin has joined #openstack-meeting06:52
*** hongbin has quit IRC06:56
*** trident has quit IRC07:16
*** trident has joined #openstack-meeting07:24
*** psachin has quit IRC07:25
*** joxyuki has joined #openstack-meeting07:29
*** ricolin has quit IRC07:39
*** ricolin has joined #openstack-meeting07:39
*** ianychoi has quit IRC07:46
*** ianychoi has joined #openstack-meeting07:47
*** ralonsoh has joined #openstack-meeting07:55
*** jraju__ has joined #openstack-meeting07:55
*** links has quit IRC07:56
*** ociuhandu has joined #openstack-meeting07:58
*** takahashi-tsc has joined #openstack-meeting07:59
*** ociuhandu has quit IRC07:59
*** ociuhandu has joined #openstack-meeting08:00
dkushwaha#startmeeting tacker08:02
openstackMeeting started Tue Aug 20 08:02:14 2019 UTC and is due to finish in 60 minutes.  The chair is dkushwaha. Information about MeetBot at http://wiki.debian.org/MeetBot.08:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.08:02
*** openstack changes topic to " (Meeting topic: tacker)"08:02
openstackThe meeting name has been set to 'tacker'08:02
dkushwaha#topic Roll Call08:02
*** openstack changes topic to "Roll Call (Meeting topic: tacker)"08:02
dkushwahawho is here for Tacker weekly meeting?08:02
*** nnsingh has joined #openstack-meeting08:03
dkushwahahi all08:04
*** nitinuikey has joined #openstack-meeting08:04
*** priteau has joined #openstack-meeting08:06
dkushwahahi hyunsikyang08:06
dkushwaha#chair joxyuki08:06
openstackCurrent chairs: dkushwaha joxyuki08:06
dkushwahajoxyuki, do you have something to discuss?08:07
*** nnsingh has quit IRC08:07
*** nnsingh42 has joined #openstack-meeting08:08
joxyukiVNF package spec was merged and niraj pushed couple of patches.08:08
joxyukikindly request you to review them.08:08
dkushwahajoxyuki, nice.08:09
dkushwahaI was on leave last whole week, so didn't check much, but have seen couple of WIP patches.08:09
dkushwaha#topic Open Discussion08:10
*** openstack changes topic to "Open Discussion (Meeting topic: tacker)"08:10
joxyukidkushwaha, posted a comment on https://review.opendev.org/#/c/666496/08:12
patchbotpatch 666496 - tacker - Adds support force delete for NS - 7 patch sets08:12
joxyukiwhat do you think about it?08:13
*** apetrich has joined #openstack-meeting08:13
dkushwahajoxyuki, not understand your comment08:16
dkushwahathere ns is {'ns': {'attributes': {'force': True}}}08:17
dkushwahaso  kwargs={'ns': {'ns': {'attributes': {'force': True}}}08:17
dkushwahawhy to delete manually08:17
*** panda has quit IRC08:18
joxyukidkushwaha, oh, sorry. I mean, "don't we need to set force_delete flag to mistral workflow created here?", otherwise, vnf deletion works without force flag.08:19
joxyukiSo, there is possibility that NS is forcely deleted but some VNFs are stucking.08:20
*** panda has joined #openstack-meeting08:20
joxyukiin this case, users can manually delete stucking VNFs with force flag.08:20
joxyukiBut are you expecting this opration?08:21
dkushwahajoxyuki, i think, I am passing it in expected way in line #923, but let me check it again08:23
joxyukicurrently force_delete flag is ignored in workflow of NS deletion. https://github.com/openstack/tacker/blob/master/tacker/nfvo/drivers/workflow/workflow_generator.py#L25508:23
*** tpatil has joined #openstack-meeting08:25
tpatilJust wanted to update about the vnf packages implementation progress08:26
*** e0ne has joined #openstack-meeting08:26
tpatilWe are writing the unit/functional tests now. Restful apis are implemented08:27
tpatilwe will update the existing patches by Thursday08:28
*** jamesmcarthur has joined #openstack-meeting08:28
tpatilIf you face any problems in setting up the env, please let us know. once the unit and functional tests are implemented, we will add the required documentation.08:29
tpatilthat's all I wanted to update here. Thank you.08:29
dkushwahajoxyuki, I got your point, and yes it seems issue.08:30
dkushwahajoxyuki, will update the patch.08:30
dkushwahathanks for your quick comment08:30
dkushwahatpatil, thanks for update. will review the patches08:31
tpatildkushwaha: Thanks08:31
dkushwahajoxyuki, Please review https://review.opendev.org/#/c/67340408:33
patchbotpatch 673404 - tacker - Make non-admin's VIM accessible for admin - 1 patch set08:33
joxyukigot it. I can do it tomorrow.08:33
dkushwahahyunsikyang, do you have some update from your side?08:34
dkushwahajoxyuki, thanks08:34
hyunsikyangI uploaded code as a WIP.08:34
hyunsikyangand I finished test. But I think,, I should  upload some test code08:35
hyunsikyangAnd I will uploade user guide for this spec soon seperately08:36
dkushwahahyunsikyang, yes, adding test cases with feature is the best practice. you can also put them in separate patch set08:36
dkushwahahyunsikyang, could you please share the link of your WIP patch(i think i missed it)08:38
patchbotpatch 674761 - tacker - [WIP] Adding Multi-Interface for Containerized VNF... - 6 patch sets08:39
dkushwahahyunsikyang, ok08:39
hyunsikyangyou're welcome08:40
dkushwahaDo we have something to discuss? otherwise we can close this meeting08:41
takahashi-tscOur activities update. Now we evaluate scaling action and faced issues that mgmt_driver does not work.08:41
patchbotpatch 576670 - tacker - when scale vnf , mgmt driver doesn't work - 4 patch sets08:42
takahashi-tscAbove patch progress is now stopping... We will take over or make new patch for fix it,08:42
dkushwahatakahashi-tsc, thanks for heading up for this fix08:45
dkushwahathis is the long pending work item from vnf-scaling BP https://blueprints.launchpad.net/tacker/+spec/vnf-scaling08:46
dkushwahaThanks Folks for joining this meeting.08:48
dkushwahaClosing this meeting now08:48
joxyukithanks folks08:49
*** dkushwaha_ has joined #openstack-meeting08:51
dkushwaha_it seems i lost my connection08:51
dkushwaha_takahashi-tsc, thanks for heading up for this fix08:51
dkushwaha_this is the long pending work item from vnf-scaling BP https://blueprints.launchpad.net/tacker/+spec/vnf-scaling08:52
takahashi-tscThis fix is needed for our actual use case. We start to develop and I think we make the patch by this weekend or next week.08:52
*** dkushwaha has quit IRC08:53
dkushwaha_takahashi-tsc, nice08:53
dkushwaha_Thanks Folks for joining this meeting.08:54
dkushwaha_Closing this meeting now08:54
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"08:54
openstackMeeting ended Tue Aug 20 08:54:42 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)08:54
openstackMinutes:        http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-08-20-08.02.html08:54
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-08-20-08.02.txt08:54
openstackLog:            http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-08-20-08.02.log.html08:54
*** tpatil has quit IRC08:55
*** takahashi-tsc has quit IRC08:55
*** k-keiko has quit IRC08:56
*** nitinuikey has quit IRC08:57
*** joxyuki has left #openstack-meeting08:57
*** jamesmcarthur has quit IRC08:57
*** jamesmcarthur has joined #openstack-meeting08:59
*** dkushwaha_ has quit IRC09:05
*** jchhatbar has joined #openstack-meeting09:06
*** jchhatbar has quit IRC09:06
*** jchhatbar has joined #openstack-meeting09:07
*** janki has quit IRC09:07
*** jchhatbar has quit IRC09:07
*** janki has joined #openstack-meeting09:08
*** jamesmcarthur has quit IRC09:08
*** jamesmcarthur has joined #openstack-meeting09:09
*** ociuhandu_ has joined #openstack-meeting09:15
*** rcernin has joined #openstack-meeting09:16
*** ociuhandu_ has quit IRC09:16
*** apetrich has quit IRC09:25
*** apetrich has joined #openstack-meeting09:28
*** jamesmcarthur has quit IRC09:41
*** ociuhandu has quit IRC09:54
*** yamamoto has quit IRC10:00
*** nnsingh42 has quit IRC10:08
*** jamesmcarthur has joined #openstack-meeting10:16
*** priteau has quit IRC10:18
*** jamesmcarthur has quit IRC10:23
*** yamamoto has joined #openstack-meeting10:23
*** ociuhandu has joined #openstack-meeting10:27
*** rcernin has quit IRC10:28
*** ociuhandu has quit IRC10:35
*** ykatabam has joined #openstack-meeting10:35
*** dosaboy has quit IRC10:42
*** bbowen has quit IRC10:42
*** jamesmcarthur has joined #openstack-meeting10:55
*** jamesmcarthur has quit IRC11:00
*** macz has joined #openstack-meeting11:04
*** tesseract has joined #openstack-meeting11:08
*** ociuhandu has joined #openstack-meeting11:08
*** ociuhandu has quit IRC11:09
*** macz has quit IRC11:09
*** ociuhandu has joined #openstack-meeting11:09
*** ykatabam has quit IRC11:21
*** carloss has joined #openstack-meeting11:25
*** dosaboy has joined #openstack-meeting11:28
*** ykatabam has joined #openstack-meeting11:29
*** markvoelker has joined #openstack-meeting11:35
*** jamesmcarthur has joined #openstack-meeting11:36
*** jamesmcarthur has quit IRC11:40
*** markvoelker has quit IRC11:40
*** jamesmcarthur has joined #openstack-meeting11:43
*** bbowen has joined #openstack-meeting11:44
*** ociuhandu has quit IRC11:54
*** ociuhandu has joined #openstack-meeting11:54
*** markvoelker has joined #openstack-meeting11:57
*** raildo has joined #openstack-meeting12:02
*** ociuhandu has quit IRC12:24
*** jamesmcarthur has quit IRC12:24
*** jamesmcarthur has joined #openstack-meeting12:25
*** rbudden has joined #openstack-meeting12:25
*** jamesmcarthur has quit IRC12:29
*** rbudden has quit IRC12:30
*** ykatabam has quit IRC12:33
*** dviroel_ has joined #openstack-meeting12:36
*** ykatabam has joined #openstack-meeting12:37
*** dviroel_ is now known as dviroel12:39
*** yamamoto has quit IRC12:47
*** jamesmcarthur has joined #openstack-meeting12:52
*** mriedem has joined #openstack-meeting12:53
*** ociuhandu has joined #openstack-meeting12:57
*** ociuhandu has quit IRC12:58
*** ociuhandu has joined #openstack-meeting12:58
*** yamamoto has joined #openstack-meeting13:00
*** rbudden has joined #openstack-meeting13:03
*** yamamoto has quit IRC13:04
*** yamamoto has joined #openstack-meeting13:05
*** ykatabam has quit IRC13:15
*** brinzhang has quit IRC13:21
*** enriquetaso has joined #openstack-meeting13:21
*** brinzhang has joined #openstack-meeting13:21
*** artom has quit IRC13:24
*** yamamoto has quit IRC13:28
*** artom has joined #openstack-meeting13:28
*** zhubx has quit IRC13:32
*** zhubx has joined #openstack-meeting13:33
*** lseki has joined #openstack-meeting13:39
*** zhubx has quit IRC13:40
*** zhubx has joined #openstack-meeting13:40
*** ociuhandu has quit IRC13:41
*** eharney has joined #openstack-meeting13:42
*** ociuhandu has joined #openstack-meeting13:46
*** ralonsoh has quit IRC13:48
*** ralonsoh has joined #openstack-meeting13:55
*** bobh has joined #openstack-meeting14:00
*** janki has quit IRC14:04
*** ricolin has quit IRC14:04
*** bbowen_ has joined #openstack-meeting14:05
*** bbowen has quit IRC14:05
*** liuyulong has joined #openstack-meeting14:06
*** bobh has quit IRC14:06
*** yamamoto has joined #openstack-meeting14:16
*** yamamoto has quit IRC14:16
*** yamamoto has joined #openstack-meeting14:18
*** cheng1 has quit IRC14:19
*** yamamoto has quit IRC14:20
*** yamamoto has joined #openstack-meeting14:21
*** cheng1 has joined #openstack-meeting14:21
*** yamamoto has quit IRC14:22
*** yamamoto has joined #openstack-meeting14:24
*** yamamoto has quit IRC14:35
*** yamamoto has joined #openstack-meeting14:44
*** zhubx has quit IRC14:48
*** zhubx has joined #openstack-meeting14:48
*** zhubx has quit IRC14:50
*** zhubx has joined #openstack-meeting14:51
*** jgriffith has quit IRC14:52
*** bbowen__ has joined #openstack-meeting14:52
*** jgriffith has joined #openstack-meeting14:52
*** artom has quit IRC14:54
*** bbowen_ has quit IRC14:54
*** openstack has joined #openstack-meeting14:59
*** ChanServ sets mode: +o openstack14:59
*** diablo_rojo has joined #openstack-meeting15:00
*** armax has joined #openstack-meeting15:03
*** mattw4 has joined #openstack-meeting15:07
*** electrofelix has joined #openstack-meeting15:11
*** yamamoto has quit IRC15:14
*** artom has joined #openstack-meeting15:23
*** zhubx has quit IRC15:29
*** baojg has joined #openstack-meeting15:36
*** baojg has quit IRC15:36
*** baojg has joined #openstack-meeting15:37
*** baojg has quit IRC15:37
*** baojg has joined #openstack-meeting15:38
*** baojg has quit IRC15:38
*** baojg has joined #openstack-meeting15:39
*** baojg has quit IRC15:40
*** gyee has joined #openstack-meeting15:45
*** macz has joined #openstack-meeting15:51
ralonsoh#startmeeting neutron_ci16:00
openstackMeeting started Tue Aug 20 16:00:11 2019 UTC and is due to finish in 60 minutes.  The chair is ralonsoh. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: neutron_ci)"16:00
openstackThe meeting name has been set to 'neutron_ci'16:00
ralonsohhello everyone16:00
ralonsohboth Miguel and Slawek are on PTO/other meetings16:00
ralonsohI'll need your help here today!16:00
ralonsohhi njohnston !16:01
njohnstonnot sure how many others are going to be here... :-)16:02
ralonsohMiguel asked me to do the meeting16:02
njohnstonbut I'll help however I can16:02
ralonsohok, let's go16:02
ralonsoh#link http://grafana.openstack.org/dashboard/db/neutron-failure-rate16:02
ralonsoh#topic Actions from previous meetings16:02
*** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)"16:02
ralonsohaccording to the log, Miguel should be debbging this16:03
ralonsoh#link https://bugs.launchpad.net/neutron/+bug/183844916:03
openstackLaunchpad bug 1838449 in neutron "Router migrations failing in the gate" [Medium,Confirmed] - Assigned to Miguel Lavalle (minsel)16:03
ralonsohI'll try to ping him this evening (for me) or tomorrow16:03
*** jamesmcarthur has quit IRC16:03
ralonsohnext topic16:03
ralonsoh#topic Stadium projects16:04
*** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)"16:04
ralonsohPython 3 migration16:04
ralonsoh#link https://etherpad.openstack.org/p/neutron_stadium_python3_status16:04
ralonsohnjohnston, any update?16:04
njohnstonso the last job for bagpipe merged16:04
njohnstonbut in the neutron team meeting amotoki said he would doublecheck other jobs16:04
njohnstonjust to make sure16:05
*** jamesmcarthur has joined #openstack-meeting16:05
ralonsohdid you delete it from the etherpad?16:05
njohnstonI believe I did that, but things might have changed in the intervening months, not sure16:05
njohnstonI'd like to leave it until amotoki is happy16:05
ralonsohwe can wait until the next week for the feedback from amotoki16:05
njohnstonI don't see either yamamoto or lajoskatona online16:06
njohnstonfor odl and midonet feedback (respectively)16:06
amotokinjohnston: AFAIK bagpipe tox.ini has some jobs with basepython as python27. that's what I would like to clean up.16:06
amotokiI will add info to the etherpad.16:06
njohnstonthank you very much amotoki16:06
ralonsohthanks amotoki !16:06
ralonsohso today no feedback from midonet or odl16:07
ralonsohok, I think we can move to tempest-plugins migration16:07
ralonsoh#link https://etherpad.openstack.org/p/neutron_stadium_move_to_tempest_plugin_repo16:07
njohnstonfwaas tempest plugin migration is done, three cheers for slaweq for pushing that over the finish line while I was distracted16:08
ralonsohwe have two pending patches16:08
*** mattw4 has quit IRC16:08
clarkbdid the midonet test jobs end up getting fixed? I noticed them because they were a large chunk of e-r failures for package installations16:08
ralonsohclarkb, I think midonet is still failing in the CI16:09
ralonsohI'll ping yamamoto16:09
ralonsohok so we have two patches16:09
ralonsoh#link https://review.openstack.org/#/c/65209916:09
patchbothttps://review.opendev.org/#/c/652099/ - neutron-tempest-plugin - Move neutron-dynamic-routing BGP tests from stadium - 32 patch sets16:09
ralonsohfor dynamic routing16:09
ralonsoh#link https://review.openstack.org/#/c/64937316:09
patchbothttps://review.opendev.org/#/c/649373/ - neutron-tempest-plugin - Migrate neutron-vpnaas tests to neutron-tempest-pl... - 6 patch sets16:09
ralonsohfor vpnaas16:10
njohnstonregarding midonet, I don't know if there was a successor to https://review.opendev.org/674313 after it was abandoned16:10
patchbotpatch 674313 - neutron - Fix networking-midonet CI job run on Neutron check... (ABANDONED) - 4 patch sets16:10
njohnstontidwellr: can you comment on the neutron-dynamic-routing change?16:11
tidwellrnjohnston: sure16:11
njohnstonthe vpnaas one has not been updated in 4 months so I think that is getting stale16:11
tidwellrfor some reason we are uncovering some race conditions that cause test failures16:12
ralonsohnjohnston, I would like to take care of the last one, but not this week16:12
ralonsohbut let's ping mlavalle for this, because he is the owner16:12
ralonsohok, something else in this topic (Stadium projects)?16:13
tidwellrthere are also some weird setup and tear down things going on with the neutron-dynamic-routing change. I've tried to avoid creating separate jobs to address this since that adds a lot of overhead, but that may be the best way forward for now16:13
ralonsohtidwellr, but what is still failing in this patch? https://review.opendev.org/#/c/65209916:14
patchbotpatch 652099 - neutron-tempest-plugin - Move neutron-dynamic-routing BGP tests from stadium - 32 patch sets16:14
tidwellrthese failures are related to those race conditions in the tests themselves16:15
ralonsohok, I see16:16
tidwellrthere is an auto-scheduling mechanism that the tests asserting unscheduling of BGP speakers don't account for16:16
tidwellrnot sure why it's an issue all of a sudden, we haven't had problems with this in the neutron-dynamic-routing jobs before16:17
tidwellrthe stars have aligned I suppose16:17
ralonsohas you said, the test execution ordering maybe16:17
*** markvoelker has quit IRC16:17
tidwellrthat wouldn't cause the things I'm seeing16:18
tidwellrthe test unschedules a BGP speaker and the auto-scheduler puts it back before the test gets to assert peering status if offline16:19
tidwellrthat's not related to test ordering, that's a problem with the tests themselves16:19
ralonsohyou are talking about https://logs.opendev.org/99/652099/32/check/neutron-tempest-plugin-dynamic-routing-bgp-basic/f5ab227/testr_results.html.gz16:19
tidwellrthat race condition is what is causing this failure16:20
ralonsohtidwellr, I'll try to take a look at this tomorrow morning16:21
tidwellrI think I can fix it,it involves changing the assertions made by the test16:21
tidwellrI've been on vacation and drowning in other things recently16:22
ralonsohno problem16:22
tidwellrbut I'm getting back on track this week so I can move this forward16:22
ralonsohthank you!16:22
ralonsohok, so no more agenda on this topic, let's move to the next one16:23
ralonsoh#topic Grafana16:23
*** openstack changes topic to "Grafana (Meeting topic: neutron_ci)"16:23
ralonsoh#link http://grafana.openstack.org/dashboard/db/neutron-failure-rate16:23
ralonsohI was on PTO last week16:23
ralonsohare you aware of something abnormal last week?16:24
njohnstonwow, has nothing run through the gate since Sunday?  That seems unlikely.16:24
ralonsohhmmm or we didn't merge anything or the jobs are stuck16:25
njohnstonlooks like the postgres periodic job is having an issue16:25
*** e0ne has quit IRC16:25
njohnstonalso I don't like how 25% to 50% is the new normal for the functional jobs these days16:26
njohnstonat least since 8/1616:26
ralonsohnjohnston, you are right, it's quite high16:26
njohnstonthe tox-cover job shows the same curve I believe16:27
ralonsohnjohnston, the functional failures are py2716:27
ralonsohnot py316:27
njohnstonso right now the neutron-functional-python27 job is at 38% fail but the py3 neutron-functional job is at 35%16:28
njohnstonso I disagree that this is py27-only16:28
ralonsohlet me see the historical of neutron patches and CI results16:29
ralonsohif I see a pattern there, I'll open a bug16:30
ralonsoh(sorry but I didn't review that in advance)16:30
ralonsohhow do I write an action??16:30
njohnstonnp, I didn't either (although I was surprised we were having a meeting)16:30
njohnstondo #action ralonsoh to do this and that16:30
ralonsoh#action ralonsoh to review the CI (functional tests), search for error patterns and open bugs if needed16:31
ralonsohnjohnston, do you have time today (or tomorrow) to take a look at the postgress-full errors?16:32
*** markvoelker has joined #openstack-meeting16:33
ralonsohok, let's move to the next topic then16:34
ralonsoh#topic fullstack/functional16:34
*** openstack changes topic to "fullstack/functional (Meeting topic: neutron_ci)"16:34
ralonsohthere is nothing in the agenda16:34
ralonsohdo you want to add something here?16:34
njohnstonI think we covered it already16:35
njohnstonI'll try to get a look at the postgres errors yes16:35
ralonsohnext topic then16:35
ralonsoh#topic Tempest/Scenario16:35
*** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)"16:35
njohnston#action njohnston to look at errors in the neutron-tempest-postgres-full periodic job16:35
ralonsohslawek opened a bug for nova last week16:35
ralonsoh#link https://bugs.launchpad.net/nova/+bug/183996116:35
openstackLaunchpad bug 1669468 in devstack "duplicate for #1839961 tempest.api.compute.servers.test_novnc.NoVNCConsoleTestJSON.test_novnc fails intermittently in neutron multinode nv job" [Medium,Fix released] - Assigned to melanie witt (melwitt)16:35
ralonsohlooks like this a duplicate of https://bugs.launchpad.net/devstack/+bug/166946816:36
openstackLaunchpad bug 1669468 in devstack "tempest.api.compute.servers.test_novnc.NoVNCConsoleTestJSON.test_novnc fails intermittently in neutron multinode nv job" [Medium,Fix released] - Assigned to melanie witt (melwitt)16:36
ralonsohand there is a patch merged16:36
ralonsoh#link https://review.opendev.org/#/c/675721/16:36
patchbotpatch 675721 - devstack - Set console server host/address in nova-cpu.conf f... (MERGED) - 4 patch sets16:36
ralonsohI'll comment this in slawek's patch16:36
njohnstonand multinode scenario failure are down to below 50% which is great16:37
ralonsohyou are better than me reviewing this grafana dashboard (I usually wait for slawek to send me the bugs hehehehe)16:38
njohnston:-) long years of ops experience16:38
ralonsohso, something else on the dashboard?16:39
njohnstonnothing from me16:39
ralonsohok, so last topic16:39
ralonsoh#topic Open discussion16:39
*** openstack changes topic to "Open discussion (Meeting topic: neutron_ci)"16:40
ralonsohI had a fantastic PTO!16:40
ralonsohlast week16:40
ralonsohthat's all from me16:40
njohnstoncongrats!  I had a fantastic one the week before.16:40
njohnstonSo you and I, neither of us is going to Shanghai, right?16:41
njohnstonI'll ping mlavalle again for arrangements for remote participation16:41
ralonsohyes, that will be very useful16:41
*** jraju__ has quit IRC16:41
njohnstonok that's all from me16:42
ralonsohok, sorry for being so newbie chairing this meeting, that's my first time16:42
ralonsohthank you all16:42
ralonsohsee you in #openstack-neutron16:42
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"16:42
openstackMeeting ended Tue Aug 20 16:42:43 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:42
openstackMinutes:        http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-08-20-16.00.html16:42
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-08-20-16.00.txt16:42
openstackLog:            http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-08-20-16.00.log.html16:42
*** armax has quit IRC16:51
*** ekcs has joined #openstack-meeting16:57
*** diablo_rojo has quit IRC16:58
*** diablo_rojo has joined #openstack-meeting16:59
*** jamesmcarthur has quit IRC17:04
*** gyee has quit IRC17:09
*** tesseract has quit IRC17:10
*** xenos76 has joined #openstack-meeting17:10
*** ociuhandu has quit IRC17:18
*** kopecmartin is now known as kopecmartin|off17:19
*** gyee has joined #openstack-meeting17:22
*** mattw4 has joined #openstack-meeting17:24
*** raildo has quit IRC17:25
*** ralonsoh has quit IRC17:28
*** raildo has joined #openstack-meeting17:32
*** boxiang has joined #openstack-meeting17:34
*** armax has joined #openstack-meeting17:36
*** enriquetaso has quit IRC17:37
*** jamesmcarthur has joined #openstack-meeting17:38
*** tesseract has joined #openstack-meeting17:45
*** enriquetaso has joined #openstack-meeting17:45
*** brinzhang_ has joined #openstack-meeting17:47
*** igordc has joined #openstack-meeting17:48
*** brinzhang has quit IRC17:50
*** jamesmcarthur has quit IRC18:05
*** jamesmcarthur has joined #openstack-meeting18:06
*** jamesmcarthur has quit IRC18:12
*** jamesmcarthur has joined #openstack-meeting18:13
*** markvoelker has quit IRC18:34
*** electrofelix has quit IRC18:35
*** enriquetaso has quit IRC18:51
*** enriquetaso has joined #openstack-meeting18:56
*** jamesmcarthur has quit IRC18:58
clarkbHello there. Anyone else here for the meeting?19:00
*** Shrews has joined #openstack-meeting19:01
clarkb#startmeeting infra19:01
*** patchbot has left #openstack-meeting19:01
openstackMeeting started Tue Aug 20 19:01:11 2019 UTC and is due to finish in 60 minutes.  The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot.19:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.19:01
*** openstack changes topic to " (Meeting topic: infra)"19:01
openstackThe meeting name has been set to 'infra'19:01
clarkb#link http://lists.openstack.org/pipermail/openstack-infra/2019-August/006452.html Our Agenda19:01
clarkbthank you ianw for running the meeting last week19:01
clarkb#topic Announcements19:02
*** openstack changes topic to "Announcements (Meeting topic: infra)"19:02
clarkbThis wasn't on the agenda but you have a handful of hours left to vote on the openstack U naming poll if you would like to do so before it ends19:02
clarkb#topic Actions from last meeting19:03
*** openstack changes topic to "Actions from last meeting (Meeting topic: infra)"19:03
clarkb#link http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-08-13-19.01.txt minutes from last meeting19:03
clarkbI didn't see any actions in the meeting notes19:03
clarkbianw: ^ anything to point out here before we move on?19:03
ianwno it was fairly quiet19:03
clarkb#topic Priority Efforts19:04
*** openstack changes topic to "Priority Efforts (Meeting topic: infra)"19:04
clarkb#topic OpenDev19:04
*** openstack changes topic to "OpenDev (Meeting topic: infra)"19:04
clarkbI've made some minor progress on having gitea timeout requests.19:04
clarkb#link https://github.com/cboylan/gitea/commit/d11d4dab34f769f3ba4589bb938a2dbd09ff8b3a19:05
clarkbIt turns out that gitea's http framework is not directly compatible with golang's http lib beacuse they use a context type that doesn't conform to the standard19:05
clarkbThey do drag along the underlying http stdlib request's context though so we can update that and get it to do things19:05
corvusoh "neat"19:06
clarkbHowever the http.TimeoutHandler is a bit more robust than what I have there and I'm not sure how much of that I can replicate within the macaron framework so this might get clunky (probably largely due to my lack of go knowledge)19:06
clarkbin any case that now builds and seems to work in the job we have. Next I need to exercise that it times out long requests as expected19:07
* diablo_rojo sneaks in late19:07
clarkbcorvus: ya my understanding of the correct way to implement that is to have a context type that implements the standard interface while adding the bits you want in addition to that19:08
clarkbcorvus: then you can use stdlib handlers like the timeout handler but also track application specific info19:08
clarkbinstead they track the request as an attribute of the context object and that request object has the standard matching context object19:08
clarkbI was also thinking that I might want to file an issue with them and share what I have so far and see if they can point me in a better direction if one exists19:09
clarkbany other opendev specific items to talk about before we move on?19:10
fungitoo bad github doesn't have a "wip" flag for pull requests19:10
corvusthe gitea folks use [wip] in the summary (much like we do)19:11
fungiahh, heh19:11
fungithen yeah, seeking their input with what you already have sounds like a great option19:12
clarkb#topic Update Config Management19:14
*** openstack changes topic to "Update Config Management (Meeting topic: infra)"19:14
clarkbcorvus: should we talk about the intermediate registry here?19:15
clarkbaiui the swift backend for the intermediate docker registry loses blobs19:15
clarkband then our jobs that rely on working docker images fail because tehy can't get the layer(s) they need19:15
corvusoh yeah19:15
corvuswe're seeing this even in moderate use of the intermediate registry19:16
corvusespecially if there's a patch series19:16
corvus(it could be happening with image promotion too, we may just not notice as much)19:16
corvusthe logical thing to do would be intensive debugging of the problem resulting in a patch to docker19:16
fungiso the registry itself is losing track of the swift objects? i'd be surprised if swift is losing those itself19:17
corvusafaict, the registry is inserting 0-byte objects in swift19:17
corvusno idea what's up with that19:17
corvusthe nice thing is it's easy to verify we're seeing the same problem (all zero byte objects have the same sha256sum value :)19:17
*** brinzhang_ has quit IRC19:18
corvusthere's a lot of things we would like the registry to do which it doesn't -- authentication only for writes, pass-through to dockerhub, support for pass-through to multiple registries...19:18
corvusso i'm seriously inclined to solve this by writing a new registry shadowing system from scratch19:19
clarkbI remember pulp saying they support docker image registries as one of their archives19:19
clarkb(that might be another option to look at)19:19
corvusooh, well remembered19:20
clarkbhttps://pulpproject.org/ for those that may not be familiar19:20
clarkbhttps://docs.pulpproject.org/plugins/crane/index.html is something pulp points at19:21
clarkbthat may be too simple for what we want though (crane not pulp)19:21
corvusyeah, we do need to write to it19:21
clarkbif anyone else knows of alternative options they are probably worth sharing. Like what does openshift run?19:22
corvusi believe we learned that running openshift container registry does require running it in openshift19:24
clarkbAlright we probably won't solve that problem in the meeting. But wanted to call it out as it seems like the kind of problem where someone might already know of a preexisting solution (surely we aren't the only people that want to run a docker registry that reliably serves data)19:25
corvusi mean, it'd be better for everyone if docker registry did support swift without flaws19:25
corvusbut my enthusiasm for fixing that bug without addressing all the other things is limited19:26
corvus(also, to be fair, i'm not sure we've eliminated the possibility that skopeo is to blame)19:27
corvus(it seems highly unlikely though)19:27
corvusi don't think the logging available is adequate19:27
*** jamesmcarthur has joined #openstack-meeting19:28
clarkbAnything else on this topic or should we moev on?19:29
clarkbsounds like that is it.19:30
clarkb#topic Storyboard19:30
*** openstack changes topic to "Storyboard (Meeting topic: infra)"19:30
clarkbdiablo_rojo: fungi: you were both distracted with meetings all last week, but anything to bring up re storyboard19:30
fungii got nuthin'19:31
diablo_rojoI remembered to bother mordred twice about db stuff but I don't think he had time to do anything yet19:32
diablo_rojomordred, shall I keep poking?19:32
*** e0ne has joined #openstack-meeting19:32
diablo_rojoI didn't have anything else19:32
clarkb#topic General Topics19:33
*** openstack changes topic to "General Topics (Meeting topic: infra)"19:33
clarkb#link https://etherpad.openstack.org/p/201808-infra-server-upgrades-and-cleanup19:33
clarkbjob logs are now in swift19:33
*** shadiakiki has joined #openstack-meeting19:33
clarkbI think that leaves tarballs on static.o.o ?19:34
clarkbcorvus had set up afs based tarballs.opendev.org19:34
fungiwell, it also leaves a bunch of our static sites content19:34
fungisecurity, governance, releases, and so on19:34
clarkbfungi: oh I thought that was all on files.openstack.org now19:34
clarkbDNS says I'm wrong19:34
fungigovernance.openstack.org is an alias for static.openstack.org.19:34
fungiet cetera19:34
fungialso we still have some logs on static.o.o until they age out19:35
clarkb/srv/static has ci  election  governance  logs  lost+found  mirror  old-docs-draft  old-pypi  release  release.new  releases  reviewday  security  service-types  sigs  specs  status  tarballs  tc  uc19:35
clarkbfungi: ya ~4 weeks iirc19:36
clarkbOne option is to upgrade the server with a much simpler lvm setup as we'll not need to worry about massive impact to job results19:36
clarkbor we can try to push that content onto files.o.o instead19:36
fungisome of those are dead (mirror, old-pypi, old-docs-draft, ...), some are just redirects (ci), some are mapped into subtrees of the same vhosts (governance, sigs, tc, uc)19:37
fungiso the list looks more daunting than it really is19:37
ianwi don't mind taking an action item to audit it all and report back with a list of work?19:37
fungialso, yeah, we can pvmove everything left onto a single volume, for starters, and then swap it for a smaller volume if we wanrt19:38
clarkbianw: that would be great19:38
fungithanks ianw!19:38
corvusalso, i think all the mechanicas are worked out, so moving them to afs probably wouldn't be too difficult19:38
corvusmechanics even19:38
clarkb#action ianw audit static.openstack.org webserver content and create a list of work to either get off the server or upgrade the server now that job logs are not hosted there (or won't be in 4 weeks)19:38
ianw++ that was what i thought when i had a quick poke a couple of weeks ago, but will take a more systematic look19:39
fungiright, the fiddly bits will be redirecting or mapping openstack tarballs since they're published without a namespace prefix, doing something akin to root-marker with stuff like the governance site which is published by stitching together multiple repos...19:39
clarkbThe other related item on this is getting wiki-dev working19:40
clarkbfungi: ^ I doubt you had much time for that last week. Anything to point out there?19:40
fungiianw: if you want to start by just tossing it all into an etherpad i'm happy to flag some stuff in the list too19:40
fungiyeah, there's some wiki-dev updates actually19:41
fungifirst, i've updated the cname for wiki-dev.openstack.org to point to the new wiki-dev03 server for ease of testing. it's not like the old one was in perfect shape either19:41
fungi(also because i got tired of editing my /etc/hosts on multiple clients)19:42
fungii thought openid was broken but it's actually working better than it did on the old wiki-dev0119:42
fungithe reason i didn't realize that is up in the top-right corner of https://wiki-dev.openstack.org/ the drop-down is doing language selection instead of login19:43
fungiso need to figure out how to get that to point to the right thing19:43
clarkboh a theming bug I guess?19:43
fungi#link https://wiki-dev.openstack.org/wiki/Special:OpenIDLogin19:43
fungiwell, so it may be related to the next thing19:43
fungi#link https://review.opendev.org/675713 Put image data in a parallel path to source code19:44
fungithe old wiki-dev deployment was puppeting the installation onto a cinder volume we'd attached19:44
fungiand then having mediawiki store its static content (image uploads and so on) into subtrees of that installation path19:45
ianwahh, was going to say i had a few broken images, so that fixes that?19:45
fungiwell, it's the first step in fixing it, yeah19:45
fungiwe were essentially mixing configuration-managed stuff with mw-managed stuff in the same tree19:45
fungiso with the proposed change i want mediawiki to start managing its persistent file content into a separate path (which we can put in a cinder volume) and not have to cart around crufy from configuration-managed bits previously on other machines19:47
clarkbsounds liek a great idea19:47
fungier, cruft19:47
fungii've already got the new volume in place and formatted/mounted19:47
fungion the new wiki-dev0319:47
fungiso once that change lands i'll rsync over the images tree and whatever else needs to go there19:47
fungiand that will allow us to completely blow away the config-managed stuff any time we want and redeploy without risking loss of precious files19:48
fungialso a related change...19:48
fungi#link https://review.opendev.org/675733 Update to 1.28.x branch19:49
fungiwe'd already manually upgraded production wiki.o.o to 1.2819:49
clarkbseems like config management should reflect that then19:49
fungiso this brings the wiki-dev configuration management in line with production19:49
fungiwhich also both need badly to be upgraded some more, but...19:50
*** mriedem has quit IRC19:50
clarkbas a timecheck we have about 10 minutes left and a few more items on the agenda. Anything else urgent on this subject before we move on?19:50
fungihaving -dev at least on the same version will facilitate that19:50
fungiyeah, we can move on19:50
fungianyway, reviews of those two changes most welcome19:50
clarkbWe been having flaky afs publishing from mirror-update.opendev.org19:50
clarkbianw it occured to me that that host may be running the bionic openafs build which we know is broken?19:50
clarkbianw: maybe the proper fix there is to install from our ppa if we haven't already?19:51
*** bbowen__ has quit IRC19:51
ianwit's worth checking but i think it is using the latest19:52
clarkbok for those that might not be aware we've had vos releases fail or run for weeks at a time resulting in slow updates to the rsync'd mirrors we have19:52
clarkbianw and I were working on it yesterday. I need to catch up on that after the meting19:52
ianwii  openafs-client                       1.8.3-1~bionic19:53
funginot the broken prerelease then19:53
clarkbrules that out then19:53
clarkbOther items really quickly:19:54
clarkb#link https://review.opendev.org/#/c/675537 New backup server19:54
ianwi think we keep an eye at this point; it might have been around the time i was restarting to get some audit data19:54
clarkbianw ^ has a new backup server ready to go if we can get reviews on that19:54
ianwyeah, just wanted eyes because it's non-regular semantics with that host keeping it out of ansible, as we discussed19:54
*** mriedem has joined #openstack-meeting19:54
clarkbianw also updated dib with what we think will fix limestone ipv4 issues19:54
clarkb#link https://review.opendev.org/#/c/677410/ DIB fix for limestone ipv4 issues19:54
ianwi can do a release and rebuild in a bit for that19:55
clarkbianw: note there was a tripleo job failing on that change19:55
clarkband apparently it was a known failure they had yet to fix19:55
clarkbwe might consider making that job non voting?19:55
ianwif it doesn't work, there are options but i think they'll require us updating how glean writes config in one way or another, comments in that change19:55
clarkbAnd finally feel free to start adding ideas for PTG topics on the etherpad19:56
clarkb#link https://etherpad.openstack.org/p/OpenDev-Shanghai-PTG-201919:56
ianw(other than, you know, intense debugging of legacy areas of networkmanager)19:56
clarkbI expect planning for that will start in earnest much closer to the event19:56
clarkbianw: it is odd that the bug has been around for so long too19:56
clarkbits clearly a fairly major problem they've had for a long time19:57
clarkbI guess if the kernel is manageing the interface NM doesn't want to step on its toes19:57
clarkb#topic Open Discussion19:57
*** openstack changes topic to "Open Discussion (Meeting topic: infra)"19:57
clarkbwe have about 2.5 minutes for anything else19:57
ianwspeaking of the afs thing before19:57
ianw#link https://review.opendev.org/#/q/status:open+topic:openafs-reccomends19:57
shadiakikio/  hey there. I had sent a few emails on the mailing list about server sizing19:58
ianwthat was related to us not installing the correct openafs packages on new servers19:58
clarkbshadiakiki: hello. I've been trying to keep up with responses (as has ianw looks like)19:59
shadiakikiJust want to ask if it's a subject that's of interest for you in terms of cost savings19:59
*** jamesmcarthur has quit IRC19:59
clarkbshadiakiki: as ianw pointed out I think we tend to end up undersizing servers more than we oversize them19:59
shadiakikiThanks Clark. You guys have been very responsive. It's fantastic19:59
ianwshadiakiki: hello! for mine, i'd say we're always open to contribution :)19:59
clarkbour gitea backends and zuul executors could all be bigger probably. Thinking out loud here, it might be moer useful for us to see where we should run larger instances20:00
ianwin this respect, i think that with our new trend towards containerising that might be the best place to start looking at this20:00
shadiakikiAwesome! I founded my startup a few weeks ago to solve the issue of sizing for large infra. It'll be great if I can communicate with you guys from time to time20:00
*** jamesmcarthur has joined #openstack-meeting20:00
clarkband we are at time20:01
clarkbThank you everyone20:01
fungiit's good to note that while we try to be careful and cost-wise in how we use donated server resources, we're also a very small team with limited time to invest in complex solutions if the return on investment is minor20:01
fungithanks clarkb!20:01
clarkbfeel free to continue discussion in #openstack-infra20:01
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"20:01
openstackMeeting ended Tue Aug 20 20:01:17 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)20:01
openstackMinutes:        http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-08-20-19.01.html20:01
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-08-20-19.01.txt20:01
openstackLog:            http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-08-20-19.01.log.html20:01
shadiakikiOk thanks guys!20:01
*** Shrews has left #openstack-meeting20:01
*** diablo_rojo has quit IRC20:10
*** markvoelker has joined #openstack-meeting20:15
*** markvoelker has quit IRC20:16
*** markvoelker has joined #openstack-meeting20:16
*** Lucas_Gray has joined #openstack-meeting20:16
*** boxiang has quit IRC20:21
*** zhubx has joined #openstack-meeting20:21
*** shadiakiki has quit IRC20:21
*** zhubx has quit IRC20:22
*** enriquetaso has quit IRC20:26
*** diablo_rojo has joined #openstack-meeting20:27
*** enriquetaso has joined #openstack-meeting20:35
*** jamesmcarthur has quit IRC20:40
*** jamesmcarthur_ has joined #openstack-meeting20:40
*** eharney has quit IRC20:40
*** jamesmcarthur_ has quit IRC20:47
*** e0ne has quit IRC20:50
*** martial has joined #openstack-meeting20:50
*** bbowen__ has joined #openstack-meeting20:51
*** jamesmcarthur has joined #openstack-meeting20:55
*** jamesmcarthur has quit IRC20:58
*** jamesmcarthur has joined #openstack-meeting20:58
martial#start-meeting Scientific-SIG21:01
martial#startmeeting Scientific-SIG21:01
openstackMeeting started Tue Aug 20 21:01:53 2019 UTC and is due to finish in 60 minutes.  The chair is martial. Information about MeetBot at http://wiki.debian.org/MeetBot.21:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.21:01
*** openstack changes topic to " (Meeting topic: Scientific-SIG)"21:01
openstackThe meeting name has been set to 'scientific_sig'21:01
martialHello and welcome to another session of the Scientific SIG meeting21:02
martialFew topics of conversation today as it has been a little quiet with the summer21:02
martialbut the plans of this conversation are simple: Shanghai meeting and PTG21:04
*** jamesmcarthur has quit IRC21:04
*** ykatabam has joined #openstack-meeting21:04
martialFYI, the Scientific SIG plans to meet in Shanghai, and to hold its usual two back to back meetings21:04
martialfirst being a conversations for everybody to discuss status and meet the community21:05
martialHi Bob21:05
martialsecond the lighting talk session21:05
martialwe will share a couple Etherpads in the near future to populate hose21:05
martialI will be among the people that will unfortunately not be in Shanghai21:06
martialbut Stig will and will guide the conversations efficiently as always21:07
martialOther set of information: the PTG will be happening right after the Summit21:07
martialonce again the Scientific SIG is planning to have 1/2 day to 1 day to discuss next steps21:08
martialIf you are going and are staying for the PTG, feel free to stop by and talk to the people present ;)21:09
*** ykatabam has quit IRC21:10
martialand on that, a small amount of content for Today's meeting, so I will open to AOB21:10
martialwell it is that time of the year :)21:20
martialThanks Bob for joining; on those good words, until next time21:20
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"21:20
openstackMeeting ended Tue Aug 20 21:20:48 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)21:20
openstackMinutes:        http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-08-20-21.01.html21:20
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-08-20-21.01.txt21:20
openstackLog:            http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-08-20-21.01.log.html21:20
*** markvoelker has quit IRC21:22
*** bnemec has quit IRC21:27
rbuddentake care21:27
*** diablo_rojo has quit IRC21:31
*** tesseract has quit IRC21:32
*** Lucas_Gray has quit IRC21:32
*** Lucas_Gray has joined #openstack-meeting21:33
*** markvoelker has joined #openstack-meeting21:35
*** armax has quit IRC21:35
*** yamamoto has joined #openstack-meeting21:38
*** raildo has quit IRC21:39
*** yamamoto has quit IRC21:39
*** markvoelker has quit IRC21:40
*** mattw4 has quit IRC21:43
*** mattw4 has joined #openstack-meeting21:51
*** ykatabam has joined #openstack-meeting21:58
*** rcernin has joined #openstack-meeting22:00
*** mattw4 has quit IRC22:02
*** trident has quit IRC22:02
*** Lucas_Gray has quit IRC22:04
*** mattw4 has joined #openstack-meeting22:07
*** markvoelker has joined #openstack-meeting22:10
*** trident has joined #openstack-meeting22:11
*** zbr has quit IRC22:14
*** markvoelker has quit IRC22:15
*** zbr has joined #openstack-meeting22:15
*** ykatabam has quit IRC22:18
*** carloss has quit IRC22:21
*** markvoelker has joined #openstack-meeting22:29
*** ekcs has quit IRC22:36
*** ykatabam has joined #openstack-meeting22:42
*** hyunsikyang__ has joined #openstack-meeting22:48
*** markvoelker has quit IRC22:48
*** hyunsikyang has quit IRC22:52
*** mattw4 has quit IRC23:03
*** mriedem has quit IRC23:05
*** xenos76 has quit IRC23:05
*** njohnston has quit IRC23:08
*** markvoelker has joined #openstack-meeting23:12
*** zbr has quit IRC23:22
*** markvoelker has quit IRC23:22
*** zbr has joined #openstack-meeting23:23
*** zaneb has quit IRC23:41
*** zaneb has joined #openstack-meeting23:41
*** macz has quit IRC23:48
*** martial has quit IRC23:50
*** brinzhang has joined #openstack-meeting23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!