| *** jamesmcarthur has quit IRC | 00:06 | |
| *** mmethot has joined #openstack-meeting | 00:40 | |
| *** markvoelker has joined #openstack-meeting | 00:46 | |
| *** markvoelker has quit IRC | 00:51 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:00 | |
| *** yamamoto has joined #openstack-meeting | 01:00 | |
| *** cheng1 has quit IRC | 01:05 | |
| *** yamamoto has quit IRC | 01:05 | |
| *** cheng1 has joined #openstack-meeting | 01:07 | |
| *** radeks has quit IRC | 01:15 | |
| *** jamesmcarthur has quit IRC | 01:17 | |
| *** dviroel has quit IRC | 01:31 | |
| *** hongbin has joined #openstack-meeting | 01:44 | |
| *** mhen has quit IRC | 01:50 | |
| *** yamamoto has joined #openstack-meeting | 02:01 | |
| *** apetrich has quit IRC | 02:10 | |
| *** larainema has joined #openstack-meeting | 02:12 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:17 | |
| *** bobh has joined #openstack-meeting | 02:25 | |
| *** jamesmcarthur has quit IRC | 02:27 | |
| *** bobh has quit IRC | 02:32 | |
| *** bobh has joined #openstack-meeting | 02:40 | |
| *** bobh has quit IRC | 02:47 | |
| *** hongbin has quit IRC | 03:26 | |
| *** hongbin has joined #openstack-meeting | 03:28 | |
| *** e0ne has joined #openstack-meeting | 03:47 | |
| *** ykatabam has quit IRC | 03:50 | |
| *** tpatil has joined #openstack-meeting | 04:00 | |
| *** ykatabam has joined #openstack-meeting | 04:18 | |
| *** hongbin has quit IRC | 04:29 | |
| *** tpatil has quit IRC | 04:30 | |
| *** jamesmcarthur has joined #openstack-meeting | 04:31 | |
| *** jamesmcarthur has quit IRC | 04:35 | |
| *** links has joined #openstack-meeting | 04:49 | |
| *** e0ne has quit IRC | 04:49 | |
| *** hongbin has joined #openstack-meeting | 04:49 | |
| *** hongbin has quit IRC | 04:49 | |
| *** e0ne has joined #openstack-meeting | 04:50 | |
| *** e0ne has quit IRC | 04:51 | |
| *** Luzi has joined #openstack-meeting | 04:59 | |
| *** Garyx has quit IRC | 05:07 | |
| *** e0ne has joined #openstack-meeting | 05:08 | |
| *** Garyx has joined #openstack-meeting | 05:09 | |
| *** yamamoto has quit IRC | 05:12 | |
| *** e0ne has quit IRC | 05:16 | |
| *** yamamoto has joined #openstack-meeting | 05:29 | |
| *** dmacpher_ has joined #openstack-meeting | 05:36 | |
| *** dmacpher has quit IRC | 05:39 | |
| *** jraju__ has joined #openstack-meeting | 05:42 | |
| *** links has quit IRC | 05:42 | |
| *** yamamoto has quit IRC | 05:50 | |
| *** ykatabam has quit IRC | 05:57 | |
| *** e0ne has joined #openstack-meeting | 06:00 | |
| *** e0ne has quit IRC | 06:03 | |
| *** e0ne has joined #openstack-meeting | 06:12 | |
| *** e0ne has quit IRC | 06:20 | |
| *** yamamoto has joined #openstack-meeting | 06:21 | |
| *** yamamoto has quit IRC | 06:25 | |
| *** radeks has joined #openstack-meeting | 06:31 | |
| *** yamamoto has joined #openstack-meeting | 06:32 | |
| *** keiko-k has joined #openstack-meeting | 06:49 | |
| *** aloga has joined #openstack-meeting | 06:55 | |
| *** tridde has quit IRC | 07:00 | |
| *** hyunsikyang has quit IRC | 07:02 | |
| *** pcaruana has joined #openstack-meeting | 07:06 | |
| *** tesseract has joined #openstack-meeting | 07:06 | |
| *** trident has joined #openstack-meeting | 07:09 | |
| *** keiko-k has quit IRC | 07:09 | |
| *** slaweq has joined #openstack-meeting | 07:09 | |
| *** keiko-k has joined #openstack-meeting | 07:13 | |
| *** rcernin has quit IRC | 07:23 | |
| *** kaisers has joined #openstack-meeting | 07:24 | |
| *** joxyuki has joined #openstack-meeting | 07:29 | |
| *** tpatil has joined #openstack-meeting | 07:37 | |
| *** jbadiapa has quit IRC | 07:40 | |
| *** hyunsikyang has joined #openstack-meeting | 07:41 | |
| *** kopecmartin|off is now known as kopecmartin | 07:44 | |
| *** priteau has joined #openstack-meeting | 07:47 | |
| *** dkushwaha has joined #openstack-meeting | 07:55 | |
| *** jbadiapa has joined #openstack-meeting | 07:56 | |
| *** keiko-k has quit IRC | 07:57 | |
| dkushwaha | #startmeeting tacker | 08:02 |
|---|---|---|
| openstack | Meeting started Tue Sep 3 08:02:17 2019 UTC and is due to finish in 60 minutes. The chair is dkushwaha. Information about MeetBot at http://wiki.debian.org/MeetBot. | 08:02 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 08:02 |
| *** openstack changes topic to " (Meeting topic: tacker)" | 08:02 | |
| openstack | The meeting name has been set to 'tacker' | 08:02 |
| *** nitinuikey has joined #openstack-meeting | 08:02 | |
| dkushwaha | #topic Roll Call | 08:02 |
| *** openstack changes topic to "Roll Call (Meeting topic: tacker)" | 08:02 | |
| tpatil | Hi | 08:02 |
| *** keiko-k has joined #openstack-meeting | 08:02 | |
| dkushwaha | tpatil, hello | 08:02 |
| *** rubasov has quit IRC | 08:04 | |
| dkushwaha | who is here for Tacker weekly meeting? | 08:04 |
| keiko-k | Hello | 08:04 |
| dkushwaha | hi keiko-k | 08:04 |
| *** rubasov has joined #openstack-meeting | 08:05 | |
| joxyuki | hi | 08:05 |
| *** links has joined #openstack-meeting | 08:05 | |
| dkushwaha | hello joxyuki | 08:05 |
| hyunsikyang | hi | 08:06 |
| *** jraju__ has quit IRC | 08:06 | |
| nitinuikey | hi | 08:06 |
| dkushwaha | hi all | 08:07 |
| dkushwaha | lets start.. | 08:08 |
| *** rubasov has quit IRC | 08:08 | |
| *** rubasov has joined #openstack-meeting | 08:08 | |
| dkushwaha | #topic announcement | 08:08 |
| *** openstack changes topic to "announcement (Meeting topic: tacker)" | 08:08 | |
| *** e0ne has joined #openstack-meeting | 08:09 | |
| dkushwaha | PTL nomination in progress. I had nominated again myself for U cycle | 08:09 |
| dkushwaha | #link http://lists.openstack.org/pipermail/openstack-discuss/2019-September/009005.html | 08:09 |
| joxyuki | great :) | 08:11 |
| dkushwaha | 2: We have around less than a month for Train cycle release | 08:11 |
| dkushwaha | #link https://releases.openstack.org/train/schedule.html | 08:11 |
| dkushwaha | we needs to hurry for our patches | 08:12 |
| dkushwaha | #chair joxyuki | 08:12 |
| openstack | Current chairs: dkushwaha joxyuki | 08:12 |
| dkushwaha | #topic BP | 08:12 |
| *** openstack changes topic to "BP (Meeting topic: tacker)" | 08:12 | |
| dkushwaha | tpatil, anything form you on VNF package.. | 08:13 |
| tpatil | Yes, uploaded a update specs and I have seen you have voted +2 on it | 08:13 |
| tpatil | about implementation, we have made major changes to the patches, we will push these patches by tomorrow. | 08:14 |
| *** ociuhandu has joined #openstack-meeting | 08:14 | |
| *** rubasov has quit IRC | 08:14 | |
| *** rubasov has joined #openstack-meeting | 08:14 | |
| dkushwaha | tpatil, nice | 08:14 |
| tpatil | python-tackerclient: moved the commands from python-openstackclient to tackerclient and currently working on writing the unit tests | 08:14 |
| tpatil | in the current python-tackerclient, there are no unit tests written for currently supports OSC commands | 08:15 |
| tpatil | added the framework and also using requests_mock here | 08:15 |
| tpatil | tackerclient: patches will be pushed by e.o.d tomorrow | 08:15 |
| dkushwaha | tpatil, sounds great. | 08:15 |
| tpatil | tosca-parser: patch is already up on the community gerrit. please review | 08:15 |
| tpatil | #link : https://review.opendev.org/#/c/675561/ | 08:16 |
| dkushwaha | tpatil, i will review it. | 08:18 |
| dkushwaha | It goes tough on tosca-parser side as it not under Tacker repo | 08:18 |
| dkushwaha | I will ping tosca-parser guys if they can be available | 08:18 |
| tpatil | I can understand. Niraj has already sent an mail to Bob asking to review the tosca-parser patch | 08:18 |
| tpatil | We will try to follow-up with Bob again | 08:19 |
| dkushwaha | tpatil, hmm, i also pinged him for some other patches, but seems no response | 08:19 |
| dkushwaha | tpatil, i think doc is missing still missing in package support patch. once client patch available could you please give some highlight, that how to test | 08:21 |
| tpatil | Sure, I will add the doc to explain how to setup and test vnf packages | 08:22 |
| dkushwaha | tpatil, thanks | 08:22 |
| dkushwaha | moving next.. | 08:23 |
| dkushwaha | #topic Gate Jobs | 08:23 |
| *** openstack changes topic to "Gate Jobs (Meeting topic: tacker)" | 08:24 | |
| dkushwaha | In functional test, I observed multiple jobs are failing randomly. I am working on them to fix | 08:25 |
| dkushwaha | My plan is to, 1: Fix current functional jobs. 2: Currently functional jobs are non-voting, we needs to make voting for project stability health | 08:26 |
| dkushwaha | working on the same | 08:26 |
| joxyuki | +1 :) | 08:27 |
| dkushwaha | moving next.. | 08:28 |
| dkushwaha | #topic multi-container support | 08:28 |
| *** openstack changes topic to "multi-container support (Meeting topic: tacker)" | 08:28 | |
| dkushwaha | hyunsikyang, anything form your side | 08:29 |
| hyunsikyang | I uploaded initial stage code first. I checked your review. | 08:30 |
| hyunsikyang | Thanks. | 08:30 |
| hyunsikyang | According to your comment, I will fix it. | 08:31 |
| dkushwaha | hyunsikyang, thanks | 08:32 |
| hyunsikyang | And about user guide, I will add my user guide to kubernetes VIM user guide. | 08:32 |
| dkushwaha | hyunsikyang, yea, I think it is not a good idea to have different doc for multi-interface, so it can be merged in existing one | 08:33 |
| *** rubasov has quit IRC | 08:33 | |
| hyunsikyang | OK | 08:34 |
| dkushwaha | moving next.. | 08:34 |
| dkushwaha | #topic Open Discussion | 08:35 |
| *** openstack changes topic to "Open Discussion (Meeting topic: tacker)" | 08:35 | |
| hyunsikyang | Can I ask a one thing? Is there any docs for making a testing code? | 08:36 |
| *** ralonsoh has joined #openstack-meeting | 08:37 | |
| dkushwaha | hyunsikyang, do you mean doc to add test cases? | 08:38 |
| hyunsikyang | yes:) | 08:38 |
| joxyuki | this is a guide of running unit test but not creating test. https://docs.openstack.org/project-team-guide/project-setup/python.html#running-python-unit-tests | 08:38 |
| hyunsikyang | Ah Thanks Jo:) | 08:38 |
| joxyuki | I do not know other. I learned from existing codes. | 08:39 |
| hyunsikyang | ok! thanks | 08:40 |
| *** tesseract has quit IRC | 08:40 | |
| dkushwaha | hyunsikyang, that docs is to run/debug existing test cases. But no doc about how to add test cases. you can check existing test cases and test case patches for your reference | 08:40 |
| hyunsikyang | ok:) | 08:40 |
| hyunsikyang | I will check other patches | 08:41 |
| dkushwaha | hyunsikyang, https://review.opendev.org/#/c/582487/ https://review.opendev.org/#/c/662171/ | 08:42 |
| dkushwaha | these patches will give some idea about adding FT and UTs | 08:43 |
| *** ociuhandu has quit IRC | 08:43 | |
| dkushwaha | rest you can ping me on Tacker channel for any help | 08:43 |
| dkushwaha | Do we have anything else to discuss? otherwise we can close this meeting | 08:45 |
| hyunsikyang | Ok thanks all:) | 08:48 |
| dkushwaha | Thanks Folks, Closing this meeting. Please keep helping on review part as well. | 08:50 |
| dkushwaha | #endmeeting | 08:50 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 08:50 | |
| openstack | Meeting ended Tue Sep 3 08:50:21 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 08:50 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-09-03-08.02.html | 08:50 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-09-03-08.02.txt | 08:50 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-09-03-08.02.log.html | 08:50 |
| *** tpatil has quit IRC | 08:54 | |
| *** rcernin has joined #openstack-meeting | 09:00 | |
| *** slaweq has quit IRC | 09:22 | |
| *** slaweq has joined #openstack-meeting | 09:23 | |
| *** brinzhang_ has joined #openstack-meeting | 09:24 | |
| *** brinzhang_ has quit IRC | 09:25 | |
| *** brinzhang_ has joined #openstack-meeting | 09:25 | |
| *** brinzhang has quit IRC | 09:27 | |
| *** apetrich has joined #openstack-meeting | 09:36 | |
| *** Zoup has joined #openstack-meeting | 09:48 | |
| *** Zoup has quit IRC | 09:55 | |
| *** yamamoto has quit IRC | 09:56 | |
| *** ianw has quit IRC | 10:00 | |
| *** ianw has joined #openstack-meeting | 10:08 | |
| *** artom has joined #openstack-meeting | 10:13 | |
| *** dviroel_ has joined #openstack-meeting | 10:21 | |
| *** keiko-k has quit IRC | 10:25 | |
| *** ianw has quit IRC | 10:27 | |
| *** ianw has joined #openstack-meeting | 10:28 | |
| *** ianw has quit IRC | 10:28 | |
| *** ianw has joined #openstack-meeting | 10:29 | |
| *** yamamoto has joined #openstack-meeting | 10:29 | |
| *** ianw has quit IRC | 10:34 | |
| *** yamamoto has quit IRC | 10:35 | |
| *** ianw has joined #openstack-meeting | 10:36 | |
| *** ociuhandu has joined #openstack-meeting | 10:37 | |
| *** ianw_ has joined #openstack-meeting | 10:41 | |
| *** ianw_ has quit IRC | 10:41 | |
| *** ianw_ has joined #openstack-meeting | 10:43 | |
| *** ianw_ has quit IRC | 10:44 | |
| *** ianw has quit IRC | 10:44 | |
| *** ianw has joined #openstack-meeting | 10:44 | |
| *** bbowen has quit IRC | 10:46 | |
| *** ianw has quit IRC | 10:46 | |
| *** ianw has joined #openstack-meeting | 10:50 | |
| *** ianw has quit IRC | 10:52 | |
| *** ianw has joined #openstack-meeting | 10:52 | |
| *** nitinuikey has quit IRC | 11:01 | |
| *** rubasov has joined #openstack-meeting | 11:04 | |
| *** markvoelker has joined #openstack-meeting | 11:09 | |
| *** shilpasd has joined #openstack-meeting | 11:14 | |
| *** markvoelker has quit IRC | 11:14 | |
| *** ociuhandu has quit IRC | 11:23 | |
| *** carloss has joined #openstack-meeting | 11:31 | |
| *** njohnston has joined #openstack-meeting | 11:34 | |
| *** Garyx has quit IRC | 11:38 | |
| *** Garyx has joined #openstack-meeting | 11:41 | |
| *** Garyx has quit IRC | 11:41 | |
| *** Garyx has joined #openstack-meeting | 11:41 | |
| *** ociuhandu has joined #openstack-meeting | 11:43 | |
| *** ociuhandu has quit IRC | 11:48 | |
| *** bbowen has joined #openstack-meeting | 11:51 | |
| *** ricolin_ has joined #openstack-meeting | 11:51 | |
| *** ociuhandu has joined #openstack-meeting | 11:52 | |
| *** ricolin has quit IRC | 11:54 | |
| *** bbowen_ has joined #openstack-meeting | 11:54 | |
| *** bbowen has quit IRC | 11:56 | |
| *** Lucas_Gray has joined #openstack-meeting | 12:01 | |
| *** larainema has quit IRC | 12:15 | |
| *** markvoelker has joined #openstack-meeting | 12:18 | |
| *** yamamoto has joined #openstack-meeting | 12:25 | |
| *** ociuhandu has quit IRC | 12:30 | |
| *** ociuhandu has joined #openstack-meeting | 12:30 | |
| *** dviroel_ has quit IRC | 12:31 | |
| *** ociuhandu has quit IRC | 12:31 | |
| *** ociuhandu_ has joined #openstack-meeting | 12:31 | |
| *** ociuhandu has joined #openstack-meeting | 12:32 | |
| *** Lucas_Gray has quit IRC | 12:32 | |
| *** Lucas_Gray has joined #openstack-meeting | 12:35 | |
| *** ociuhandu_ has quit IRC | 12:36 | |
| *** bbowen_ has quit IRC | 12:37 | |
| *** bbowen has joined #openstack-meeting | 12:39 | |
| *** dviroel_ has joined #openstack-meeting | 12:45 | |
| *** jamesmcarthur has joined #openstack-meeting | 12:46 | |
| *** dviroel_ is now known as dviroel | 12:47 | |
| *** redrobot has quit IRC | 12:55 | |
| *** dmsimard has quit IRC | 12:56 | |
| *** dmsimard has joined #openstack-meeting | 12:58 | |
| *** david-lyle has quit IRC | 13:02 | |
| *** dklyle has joined #openstack-meeting | 13:02 | |
| *** pcaruana has quit IRC | 13:03 | |
| *** ociuhandu has quit IRC | 13:21 | |
| *** ociuhandu has joined #openstack-meeting | 13:22 | |
| *** enriquetaso has joined #openstack-meeting | 13:23 | |
| *** ociuhandu has quit IRC | 13:28 | |
| *** ociuhandu has joined #openstack-meeting | 13:29 | |
| *** mriedem has joined #openstack-meeting | 13:29 | |
| *** Garyx has quit IRC | 13:30 | |
| *** cheng1 has quit IRC | 13:31 | |
| *** cheng1 has joined #openstack-meeting | 13:32 | |
| *** pcaruana has joined #openstack-meeting | 13:34 | |
| *** redrobot_ has joined #openstack-meeting | 13:36 | |
| *** redrobot_ is now known as redrobot | 13:37 | |
| *** cheng1 has quit IRC | 13:38 | |
| *** Luzi has quit IRC | 13:41 | |
| *** cheng1 has joined #openstack-meeting | 13:41 | |
| *** brinzhang_ has quit IRC | 13:46 | |
| *** brinzhang_ has joined #openstack-meeting | 13:46 | |
| *** pcaruana has quit IRC | 13:47 | |
| *** eharney has joined #openstack-meeting | 13:49 | |
| *** yamamoto has quit IRC | 13:55 | |
| *** yamamoto has joined #openstack-meeting | 13:59 | |
| *** pcaruana has joined #openstack-meeting | 13:59 | |
| *** Roamer` has joined #openstack-meeting | 14:00 | |
| *** Garyx has joined #openstack-meeting | 14:03 | |
| *** yamamoto has quit IRC | 14:04 | |
| *** pcaruana has quit IRC | 14:07 | |
| *** pcaruana has joined #openstack-meeting | 14:10 | |
| *** ociuhandu has quit IRC | 14:13 | |
| *** ociuhandu has joined #openstack-meeting | 14:17 | |
| *** links has quit IRC | 14:20 | |
| *** Lucas_Gray has quit IRC | 14:27 | |
| *** rcernin has quit IRC | 14:32 | |
| *** ociuhandu has quit IRC | 14:34 | |
| *** cheng1 has quit IRC | 14:35 | |
| *** ociuhandu has joined #openstack-meeting | 14:35 | |
| *** cheng1 has joined #openstack-meeting | 14:38 | |
| *** ociuhandu has quit IRC | 14:39 | |
| *** Garyx has quit IRC | 14:47 | |
| *** Garyx has joined #openstack-meeting | 14:52 | |
| *** links has joined #openstack-meeting | 14:55 | |
| *** ociuhandu has joined #openstack-meeting | 15:07 | |
| *** pcaruana has quit IRC | 15:27 | |
| *** ociuhandu has quit IRC | 15:43 | |
| *** ociuhandu has joined #openstack-meeting | 15:44 | |
| *** ociuhandu has quit IRC | 15:47 | |
| *** ociuhandu has joined #openstack-meeting | 15:47 | |
| *** dtrainor has quit IRC | 15:50 | |
| *** beekneemech is now known as bnemec | 15:51 | |
| slaweq | #startmeeting neutron_ci | 16:00 |
| openstack | Meeting started Tue Sep 3 16:00:06 2019 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| *** e0ne has quit IRC | 16:00 | |
| *** openstack changes topic to " (Meeting topic: neutron_ci)" | 16:00 | |
| openstack | The meeting name has been set to 'neutron_ci' | 16:00 |
| *** mlavalle has joined #openstack-meeting | 16:00 | |
| slaweq | welcome back after short break :) | 16:00 |
| mlavalle | thanks! | 16:00 |
| ralonsoh | hi | 16:00 |
| slaweq | lets wait 1 or 2 minutes for njohnston and others | 16:01 |
| bcafarel | o/ (though I will probably leave soon) | 16:01 |
| *** cheng1 has quit IRC | 16:02 | |
| slaweq | ok, let's start than | 16:02 |
| slaweq | first of all: Grafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:03 |
| slaweq | please open now that it will be ready later :) | 16:03 |
| slaweq | #topic Actions from previous meetings | 16:03 |
| *** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 16:03 | |
| slaweq | ralonsoh will continue working on error patterns and open bugs for functional tests | 16:03 |
| ralonsoh | yes, I found today something that could be an error | 16:03 |
| ralonsoh | related to pyroute2 | 16:03 |
| ralonsoh | tomorrow, reviewing the CI tests, I'll report an error if there is one | 16:04 |
| *** cheng1 has joined #openstack-meeting | 16:04 | |
| ralonsoh | no other patterns found this week | 16:04 |
| ralonsoh | just for information: the possible error is in test_get_devices_info_veth_different_namespaces | 16:05 |
| ralonsoh | that's all | 16:05 |
| slaweq | thx ralonsoh | 16:05 |
| slaweq | I also saw today 2 failures which I wanted to raise here but lets do it later in functional tests section | 16:05 |
| slaweq | next one: | 16:05 |
| slaweq | mlavalle will continue debugging https://bugs.launchpad.net/neutron/+bug/1838449 | 16:05 |
| openstack | Launchpad bug 1838449 in neutron "Router migrations failing in the gate" [Medium,Confirmed] - Assigned to Miguel Lavalle (minsel) | 16:05 |
| mlavalle | last night I left my latest comments here: https://bugs.launchpad.net/neutron/+bug/1838449 | 16:06 |
| *** macz has joined #openstack-meeting | 16:07 | |
| slaweq | mlavalle: so, based on Your comment, it looks that it could be introduced by https://review.opendev.org/#/c/597567, right? | 16:07 |
| slaweq | as it is some race condition in case when router is updated | 16:08 |
| mlavalle | well, not necessarilly that patch | 16:08 |
| mlavalle | there are other 2 patches that have touched the "ralted routers" code later | 16:08 |
| mlavalle | which I also mention in the bug | 16:08 |
| mlavalle | the naive solution would be for each test case in the test_magrations script to create its router in separate nets / subnets | 16:09 |
| mlavalle | that would fix our tests | 16:09 |
| mlavalle | but this is a real bug IMO | 16:10 |
| mlavalle | which we need to fix | 16:10 |
| mlavalle | right? | 16:10 |
| slaweq | so different routers from those tests are using same networks/subnets now? | 16:10 |
| bcafarel | and backport :) | 16:10 |
| mlavalle | I am assuming that | 16:11 |
| slaweq | isn't it that there is one migration "per test"? | 16:11 |
| slaweq | and then new network/subnet created per each test | 16:11 |
| mlavalle | well, if that is the case, the problem is even worst | 16:11 |
| mlavalle | why would the router under migration have related routers? | 16:12 |
| *** gyee has joined #openstack-meeting | 16:12 | |
| slaweq | but here: https://github.com/openstack/neutron-tempest-plugin/blob/master/neutron_tempest_plugin/scenario/test_migration.py#L124 it looks like every test has got own network and subnet | 16:13 |
| slaweq | IMO it's created here: https://github.com/openstack/neutron-tempest-plugin/blob/master/neutron_tempest_plugin/scenario/test_migration.py#L129 | 16:13 |
| slaweq | this method is defined here https://github.com/openstack/neutron-tempest-plugin/blob/d11f4ec31ab1cf7965671817f2733c362765ebb1/neutron_tempest_plugin/scenario/base.py#L173 | 16:14 |
| mlavalle | see my comment just before yours please ^^^^ | 16:14 |
| mlavalle | we agree | 16:14 |
| slaweq | yes, so it seems that it is "even worst" :) | 16:15 |
| mlavalle | I have a question that I want to confirm.... | 16:16 |
| slaweq | shoot | 16:16 |
| mlavalle | the related routers ids are sent to the L3 agent in the router update rpc message, right? | 16:17 |
| slaweq | yes (IIRC) | 16:18 |
| slaweq | but delete router should also be sent in such case to controller, no? | 16:18 |
| mlavalle | in other words, this line https://github.com/openstack/neutron/blob/master/neutron/agent/l3/agent.py#L720 | 16:18 |
| mlavalle | returns a non empty list, correct | 16:18 |
| mlavalle | in the case of a router migration, what is sent from the server to the agent is a router update | 16:19 |
| mlavalle | because we are not deleting the router | 16:19 |
| mlavalle | we are just setting admin_state_up to false | 16:20 |
| mlavalle | let's move on | 16:20 |
| mlavalle | I can test that locally | 16:20 |
| slaweq | but, according to Your paste: | 16:20 |
| slaweq | http://paste.openstack.org/show/769795/ | 16:21 |
| slaweq | router 2cd0c0f0-75ab-444c-afe1-be7c6a1a7702 was deleted on compute | 16:21 |
| slaweq | and was only updated on controller | 16:21 |
| slaweq | why? | 16:21 |
| mlavalle | yes, but that is the result of processing an update | 16:21 |
| mlavalle | an update message | 16:21 |
| mlavalle | not a delete message | 16:21 |
| slaweq | true | 16:22 |
| mlavalle | that I am 100% sure | 16:22 |
| mlavalle | the difference is that when the update message contains "related routers" updates | 16:23 |
| mlavalle | is is processed in a different manner | 16:23 |
| mlavalle | and therefore the router is not deleted locally in the agent | 16:23 |
| mlavalle | delete the router locally means removing the network space form that agent, even though the router still exists | 16:24 |
| slaweq | but what are related routers in such case? | 16:24 |
| mlavalle | that is excatly the conundrum :-) | 16:24 |
| slaweq | :) | 16:24 |
| mlavalle | why does the router under migration has related routers? | 16:25 |
| slaweq | maybe You should send patch with some additional debug logging to get that info later | 16:25 |
| *** ricolin_ has quit IRC | 16:25 | |
| mlavalle | that is exactly the plan | 16:25 |
| slaweq | ok | 16:25 |
| slaweq | #action mlavalle to continue investigating router migrations issue | 16:26 |
| slaweq | fine ^^? | 16:26 |
| mlavalle | yeap | 16:26 |
| slaweq | ok | 16:26 |
| slaweq | thx a lot mlavalle for working on this | 16:27 |
| slaweq | let's move on | 16:27 |
| mlavalle | :-) | 16:27 |
| *** kopecmartin is now known as kopecmartin|off | 16:27 | |
| slaweq | next action | 16:27 |
| slaweq | njohnston will get the new location for periodic jobs logs | 16:27 |
| njohnston | I did that at the end of the last meeting | 16:27 |
| njohnston | and then contacted the glance folks for their broken job that was affecting all postgresql | 16:27 |
| slaweq | njohnston: do You have link to those logs then? | 16:28 |
| slaweq | just to add it to CI meeting agenda for the future :) | 16:28 |
| njohnston | you can look here: http://zuul.openstack.org/builds?pipeline=periodic-stable&project=openstack%2Fneutron | 16:29 |
| njohnston | or in the buildsets view http://zuul.openstack.org/buildsets?project=openstack%2Fneutron&pipeline=periodic | 16:30 |
| *** ociuhandu_ has joined #openstack-meeting | 16:30 | |
| * mlavalle needs to step out 5 minutes | 16:31 | |
| mlavalle | brb | 16:31 |
| slaweq | thx a lot | 16:31 |
| slaweq | and thx a lot for taking care of broken postgresql job | 16:31 |
| slaweq | ok, let's move on to the next topic | 16:32 |
| slaweq | #topic Stadium projects | 16:32 |
| *** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)" | 16:32 | |
| slaweq | first | 16:32 |
| slaweq | Python 3 migration | 16:32 |
| slaweq | Stadium projects etherpad: https://etherpad.openstack.org/p/neutron_stadium_python3_status | 16:32 |
| slaweq | I saw today that we are in pretty good shape with networking-odl now thank to lajoskatona | 16:32 |
| slaweq | and we made some progress with networking-bagpipe | 16:32 |
| slaweq | so only "not touched" yet is networking-midonet | 16:33 |
| *** ociuhandu has quit IRC | 16:33 | |
| slaweq | anything else You want to add regarding to python 3 migration? | 16:33 |
| njohnston | No, I think that covers it, thanks! | 16:33 |
| slaweq | thx | 16:34 |
| slaweq | so next is | 16:34 |
| *** ociuhandu_ has quit IRC | 16:35 | |
| slaweq | tempest-plugins migration | 16:35 |
| slaweq | Etherpad: https://etherpad.openstack.org/p/neutron_stadium_move_to_tempest_plugin_repo | 16:35 |
| slaweq | any updates on this one? | 16:35 |
| *** dtrainor has joined #openstack-meeting | 16:36 | |
| njohnston | I don't have any; I don't see tidwellr and mlavalle is AFK, they are who I would look at for updates. | 16:36 |
| slaweq | njohnston: right | 16:36 |
| slaweq | so lets move on then | 16:36 |
| slaweq | #topic Grafana | 16:36 |
| *** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 16:36 | |
| slaweq | #link http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:36 |
| slaweq | I see that neutron-functional-python27 in gate queue was failing quite often last week | 16:38 |
| slaweq | was there any known problem with it? | 16:38 |
| slaweq | do You know? | 16:38 |
| ralonsoh | no sorry | 16:38 |
| slaweq | ok, maybe it wasn't any big problem as there was only few runs of this job then | 16:39 |
| slaweq | so it wasn't relatively many failures | 16:39 |
| * mlavalle is back | 16:39 | |
| *** yamamoto has joined #openstack-meeting | 16:39 | |
| slaweq | from other things I see that neutron-tempest-plugin-scenario-openvswitch in check queue is failing quite often | 16:40 |
| slaweq | any volunteer to check this job more deeply? | 16:40 |
| slaweq | if no, I will assign it to myself for this week | 16:41 |
| ralonsoh | I can take a look, but I don't know when | 16:41 |
| ralonsoh | I have a very busy agenda now | 16:41 |
| slaweq | ralonsoh: thx | 16:42 |
| slaweq | but if You are busy, I can take a look into this | 16:42 |
| slaweq | so I will assign it to myself | 16:42 |
| slaweq | to not overload You :) | 16:42 |
| slaweq | ok? | 16:42 |
| ralonsoh | thanks! | 16:42 |
| slaweq | #action slaweq to check reasons of failures of neutron-tempest-plugin-scenario-openvswitch job | 16:43 |
| slaweq | from other things which I noticed from grafana, neutron-functional-with-uwsgi high failure rate but it's non voting so no big problem (yet) | 16:43 |
| *** yamamoto has quit IRC | 16:43 | |
| slaweq | I hope we will be able to focus more on stabilizing uwsgi jobs in next cycle :) | 16:44 |
| njohnston | unit test failures look pretty high - 40% to 50% today | 16:44 |
| slaweq | njohnston: correct | 16:45 |
| slaweq | but again, please note that it's "just" 6 runs today | 16:45 |
| slaweq | so it don't have to big problem | 16:45 |
| njohnston | ok | 16:46 |
| njohnston | :-) | 16:46 |
| slaweq | and I think that I saw some patches with failures related to patch itself | 16:46 |
| slaweq | so lets keep an eye on it :) | 16:46 |
| slaweq | ok? | 16:46 |
| njohnston | sounds good. We'll have better data later - I see 10 neutron jobs in queue right now | 16:47 |
| slaweq | agree | 16:47 |
| njohnston | FYI for those that don't know, you can put "neutron" in http://zuul.openstack.org/status to see all neutron jobs | 16:47 |
| ralonsoh | btw, test_get_devices_info_veth_different_namespaces is a problem now | 16:48 |
| *** links has quit IRC | 16:48 | |
| ralonsoh | I see many CI jobs failing because of this | 16:48 |
| ralonsoh | do we have a new pyroute2 version? | 16:48 |
| slaweq | thx njohnston | 16:48 |
| slaweq | ok, so as ralonsoh started with it, let's move to next topic :) | 16:48 |
| slaweq | #topic fullstack/functional | 16:48 |
| *** openstack changes topic to "fullstack/functional (Meeting topic: neutron_ci)" | 16:49 | |
| ralonsoh | so yes, I need to check what is happening with this test | 16:49 |
| slaweq | and indeed I saw this test failing today also, first I though it is maybe related to the patch on which it was run | 16:49 |
| ralonsoh | I'm on it now | 16:49 |
| slaweq | but now it's clear it's some bigger issue | 16:49 |
| slaweq | two examples of failure: | 16:49 |
| slaweq | https://a23f52ac6d169d81429a-a52e23b005b6607e27c6770fa63e26fe.ssl.cf1.rackcdn.com/679462/1/gate/neutron-functional/6d6a4c1/testr_results.html.gz | 16:49 |
| slaweq | https://e33ddd780e29e3545bf9-6c7fec3fffbf24afb7394804bcdecfae.ssl.cf5.rackcdn.com/679399/6/check/neutron-functional/bc96527/testr_results.html.gz | 16:49 |
| ralonsoh | yes, at least is consistent | 16:50 |
| slaweq | ohh, so it's now failing 100% times? | 16:50 |
| ralonsoh | yes | 16:50 |
| slaweq | ralonsoh: will You report bug for it? | 16:50 |
| ralonsoh | yes | 16:51 |
| slaweq | thx | 16:51 |
| slaweq | #action ralonsoh to report bug and investigate failing test_get_devices_info_veth_different_namespaces functional test | 16:51 |
| slaweq | please set it as critical :) | 16:51 |
| ralonsoh | ok | 16:51 |
| slaweq | thx | 16:52 |
| slaweq | as I said before, I also saw 2 other failures in functional tests today | 16:52 |
| slaweq | 1. neutron.tests.functional.agent.test_firewall.FirewallTestCase.test_rule_ordering_correct | 16:52 |
| slaweq | https://019ab552bc17f89947ce-f1e24edd0ae51a8de312c1bf83189630.ssl.cf2.rackcdn.com/670177/7/check/neutron-functional-python27/74e7c20/testr_results.html.gz | 16:52 |
| slaweq | I saw it first time | 16:52 |
| slaweq | did You maybe got something similar before? | 16:53 |
| ralonsoh | no, first time | 16:53 |
| ralonsoh | ok, that's because we need https://review.opendev.org/#/c/679428/ | 16:53 |
| slaweq | ok, I will check tomorrow exactly if this failed test_rule_ordering_correct test wasn't related to patch on which it was running | 16:54 |
| *** dtrainor has quit IRC | 16:54 | |
| slaweq | #action slaweq to check reason of failure neutron.tests.functional.agent.test_firewall.FirewallTestCase.test_rule_ordering_correct | 16:54 |
| slaweq | ralonsoh: we need https://review.opendev.org/#/c/679428/ to fix issue with test_get_devices_info_veth_different_namespaces ? | 16:55 |
| slaweq | or for what? | 16:55 |
| ralonsoh | no no | 16:55 |
| ralonsoh | the last one, test_rule_ordering_correct | 16:55 |
| *** dtrainor has joined #openstack-meeting | 16:55 | |
| ralonsoh | the error in this test | 16:55 |
| ralonsoh | File "neutron/agent/linux/ip_lib.py", line 941, in list_namespace_pids | 16:55 |
| ralonsoh | return privileged.list_ns_pids(namespace) | 16:55 |
| slaweq | ahh, ok | 16:55 |
| slaweq | :) | 16:55 |
| slaweq | right | 16:56 |
| slaweq | mlavalle: njohnston: if You will have some time, please review https://review.opendev.org/#/c/679428/ :) | 16:56 |
| njohnston | slaweq ralonsoh: +2+w | 16:56 |
| ralonsoh | thanks! | 16:56 |
| slaweq | njohnston: thx :) | 16:56 |
| slaweq | You're fast | 16:56 |
| mlavalle | he is indded | 16:56 |
| slaweq | LOL | 16:57 |
| slaweq | ok, and the second failed test which I saw: | 16:57 |
| slaweq | neutron.tests.functional.agent.linux.test_keepalived.KeepalivedManagerTestCase.test_keepalived_spawns_conflicting_pid_vrrp_subprocess | 16:57 |
| slaweq | https://storage.bhs1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/logs_66/677166/11/check/neutron-functional-python27/864c837/testr_results.html.gz | 16:57 |
| slaweq | but I think I already saw something similar before | 16:57 |
| ralonsoh | same problem | 16:58 |
| slaweq | ahh, right | 16:58 |
| slaweq | different stack trace but there is list_ns_pids in it too :) | 16:58 |
| slaweq | ok, so we should be better in functinal tests with Your patch | 16:58 |
| slaweq | we are almost out of time | 16:59 |
| slaweq | so quickly, one last thing for today | 16:59 |
| slaweq | #topic Tempest/Scenario | 16:59 |
| *** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)" | 16:59 | |
| *** bbowen_ has joined #openstack-meeting | 16:59 | |
| slaweq | Recently I noticed that we are testing all jobs with MySQL 5.7 | 16:59 |
| slaweq | So I asked on ML about Mariadb: http://lists.openstack.org/pipermail/openstack-discuss/2019-August/008925.html | 16:59 |
| slaweq | And I will need to add periodic job with mariadb to Neutron | 16:59 |
| slaweq | are You ok with such job? | 16:59 |
| njohnston | +1 | 16:59 |
| ralonsoh | sure | 16:59 |
| slaweq | mlavalle? I hope You are fine too with such job :) | 17:00 |
| mlavalle | I'm ok | 17:00 |
| slaweq | #action slaweq to add mariadb periodic job | 17:00 |
| slaweq | thx | 17:00 |
| slaweq | so we are out of time now | 17:00 |
| ralonsoh | bye! | 17:00 |
| slaweq | thx for attending | 17:00 |
| mlavalle | o/ | 17:00 |
| slaweq | #endmeeting | 17:00 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 17:00 | |
| slaweq | o/ | 17:00 |
| openstack | Meeting ended Tue Sep 3 17:00:47 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-09-03-16.00.html | 17:00 |
| njohnston | o/ | 17:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-09-03-16.00.txt | 17:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-09-03-16.00.log.html | 17:00 |
| *** bbowen has quit IRC | 17:02 | |
| *** shilpasd has quit IRC | 17:02 | |
| *** ociuhandu has joined #openstack-meeting | 17:02 | |
| *** ociuhandu has quit IRC | 17:07 | |
| *** e0ne has joined #openstack-meeting | 17:12 | |
| *** enriquetaso has quit IRC | 17:13 | |
| *** mattw4 has joined #openstack-meeting | 17:21 | |
| *** e0ne has quit IRC | 17:23 | |
| *** e0ne has joined #openstack-meeting | 17:23 | |
| *** mattw4 has quit IRC | 17:29 | |
| *** pcaruana has joined #openstack-meeting | 17:29 | |
| *** e0ne has quit IRC | 17:30 | |
| *** artom has quit IRC | 17:31 | |
| *** artom has joined #openstack-meeting | 17:31 | |
| *** mattw4 has joined #openstack-meeting | 17:34 | |
| *** lseki has joined #openstack-meeting | 17:41 | |
| *** priteau has quit IRC | 17:43 | |
| *** brinzhang has joined #openstack-meeting | 17:45 | |
| *** brinzhang_ has quit IRC | 17:48 | |
| *** enriquetaso has joined #openstack-meeting | 18:01 | |
| *** markvoelker has quit IRC | 18:03 | |
| *** enriquetaso has quit IRC | 18:07 | |
| *** armax has joined #openstack-meeting | 18:08 | |
| *** enriquetaso has joined #openstack-meeting | 18:12 | |
| *** e0ne has joined #openstack-meeting | 18:15 | |
| *** jamesmcarthur has quit IRC | 18:19 | |
| *** markvoelker has joined #openstack-meeting | 18:20 | |
| *** markvoelker has quit IRC | 18:24 | |
| *** enriquetaso has quit IRC | 18:27 | |
| *** enriquetaso has joined #openstack-meeting | 18:28 | |
| *** bbowen__ has joined #openstack-meeting | 18:31 | |
| *** bbowen_ has quit IRC | 18:35 | |
| *** markvoelker has joined #openstack-meeting | 18:43 | |
| *** mlavalle has left #openstack-meeting | 18:46 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:47 | |
| *** Shrews has joined #openstack-meeting | 18:49 | |
| *** gyee has quit IRC | 18:53 | |
| *** AJaeger_ has joined #openstack-meeting | 18:56 | |
| clarkb | Anyone else here for the infra meeting? we'll get started in a few minutes | 18:59 |
| fungi | sure, why not ;) | 18:59 |
| clarkb | oh we hvae a fungi | 18:59 |
| corvus | clarkb: i won't be able to attend the meeting today, but should be back around tomorrow. i plan on writing up a report from the gerrit user summit and sending it out this week. we learned a lot about upgrading, developed closer ties with the gerrit community, and there's a lot of excitement around zuul. | 18:59 |
| clarkb | corvus: that is great to hear | 18:59 |
| * fungi is taking a quick break between completion of storm prep and start of evacuation prep | 19:00 | |
| clarkb | I don't think we'll have mordred today either | 19:00 |
| ianw | o/ | 19:00 |
| corvus | correct, i believe mordred is pto next 2 weeks | 19:00 |
| clarkb | #startmeeting infra | 19:01 |
| openstack | Meeting started Tue Sep 3 19:01:04 2019 UTC and is due to finish in 60 minutes. The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:01 |
| *** openstack changes topic to " (Meeting topic: infra)" | 19:01 | |
| openstack | The meeting name has been set to 'infra' | 19:01 |
| clarkb | #link http://lists.openstack.org/pipermail/openstack-infra/2019-September/006474.html | 19:01 |
| clarkb | #topic Announcements | 19:01 |
| *** openstack changes topic to "Announcements (Meeting topic: infra)" | 19:01 | |
| dmsimard | clarkb: added a last minute topic on the wiki. | 19:01 |
| AJaeger_ | o/ | 19:02 |
| clarkb | dmsimard: ok if we have time we can get to it | 19:02 |
| *** igordc has joined #openstack-meeting | 19:02 | |
| dmsimard | sure | 19:02 |
| clarkb | We are in openstack TC and PTL election period. If you would like to run for a position you have about ~4 hours left to nominate yourself | 19:02 |
| AJaeger_ | any nominations for Infra yet? | 19:02 |
| clarkb | I've nominated myself for Infra PTL. As noted in that change If I do get elected for the U cycle I'd like to plan for this to be my last cycle | 19:02 |
| AJaeger_ | thanks, clarkb ! | 19:03 |
| clarkb | AJaeger_: at least check just the one (myself) | 19:03 |
| *** AJaeger_ is now known as AJaeger | 19:03 | |
| clarkb | Given that I'd like to put effort into mentoring more team members and leaders in the group if there is interest | 19:03 |
| clarkb | please feel free to reach out if you have any interest in being more involved | 19:03 |
| clarkb | Other announcements: fungi I suppose we shouldn't count on your presence much the next few days? | 19:04 |
| *** jamesmcarthur has quit IRC | 19:04 | |
| fungi | probably not, no | 19:05 |
| fungi | i'll check in when i can | 19:05 |
| clarkb | fungi: let us know if you need help with stuff that is time sensitive | 19:05 |
| clarkb | #topic Actions from last meeting | 19:06 |
| *** openstack changes topic to "Actions from last meeting (Meeting topic: infra)" | 19:06 | |
| fungi | will do, but i'm mostly avoiding time-sensitive stuff ;) | 19:06 |
| clarkb | #link http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-08-27-19.01.txt minutes from last meeting | 19:06 |
| clarkb | fungi: good idea :) | 19:06 |
| clarkb | I see no actions from last meeting | 19:07 |
| *** gyee has joined #openstack-meeting | 19:07 | |
| clarkb | #topic Priority Efforts | 19:07 |
| *** openstack changes topic to "Priority Efforts (Meeting topic: infra)" | 19:07 | |
| clarkb | #topic OpenDev | 19:07 |
| *** openstack changes topic to "OpenDev (Meeting topic: infra)" | 19:07 | |
| clarkb | Yesterday we noticed that 4 of 8 gitea backends had stale gitconfig lockfiles which prevented gerrit git replication from happening | 19:08 |
| clarkb | thank you ianw for cleaning that up | 19:08 |
| clarkb | I think ianw tracked that back to poor IO performance based on journald complaints in dmesg at roughly the same time | 19:08 |
| clarkb | ianw: ^ anything to add to that? | 19:08 |
| clarkb | I've still not come up with a great way to work around that. Maybe we need to update gitea to clean up stale locks? | 19:09 |
| ianw | i just had a thought that maybe we should put some randomisation into the git gc cron job, i think they all kick off at the same time? | 19:09 |
| clarkb | they do kick off at the same time | 19:09 |
| fungi | yeah, maybe staggering them will help avoid a thundering herd on the storage backend | 19:11 |
| clarkb | seems like a reasonable thing to try | 19:11 |
| AJaeger | good idea | 19:11 |
| clarkb | ianw: do you want to write that chnage or should we find a volunteer? | 19:12 |
| ianw | clarkb: just doing it now :) | 19:12 |
| clarkb | great thanks | 19:12 |
| clarkb | Any other opendev business before we move on? | 19:12 |
| clarkb | #topic Update Config Management | 19:14 |
| *** openstack changes topic to "Update Config Management (Meeting topic: infra)" | 19:14 | |
| clarkb | We merged a bunch of changes from mordred to build gerrit images | 19:14 |
| Shrews | clarkb: he also put up this one: https://review.opendev.org/678428 | 19:15 |
| clarkb | #link https://review.opendev.org/#/q/status:open+(topic:gus2019+OR+topic:gerrit-images) Gerrit and docker related changes that need review | 19:15 |
| clarkb | Shrews: cool that should be captured by the query above | 19:16 |
| Shrews | yah | 19:16 |
| clarkb | Would be great if people can take some time to get through those as I think interesting and useful things were learned at the gerrit user summit | 19:16 |
| Shrews | any reason we haven't +Ad https://review.opendev.org/678413 yet? | 19:18 |
| clarkb | Shrews: fungi notes that it will need someone to restart gerrit | 19:18 |
| clarkb | I can probably work on that tomorrow | 19:19 |
| fungi | yeah, alternatively it could just happen as part of the rename maintenance? | 19:19 |
| *** jamesmcarthur has joined #openstack-meeting | 19:20 | |
| clarkb | probably best to make sure we don't break thing as ahead of time? | 19:21 |
| clarkb | just to reduce potential impacts during renames. I can likely work on that this week (today is weird as have school stuff with kids this afternoon) | 19:22 |
| clarkb | Anything else? if not we'll move on to storyboard | 19:23 |
| diablo_rojo_phon | Nothing currently. | 19:23 |
| clarkb | #topic Storyboard | 19:24 |
| *** openstack changes topic to "Storyboard (Meeting topic: infra)" | 19:24 | |
| clarkb | diablo_rojo_phon: says nothing to report :) | 19:24 |
| diablo_rojo_phon | I do. | 19:24 |
| fungi | i did get mysql slow query logging reestablished and whip up a refreshed analysis | 19:24 |
| diablo_rojo_phon | Oh cool. | 19:24 |
| clarkb | oh that was for last topic then? in any case go for it on storyboard | 19:24 |
| *** e0ne_ has joined #openstack-meeting | 19:24 | |
| fungi | #link http://files.openstack.org/user/fungi/storyboard/ | 19:24 |
| fungi | mentioned last week in #storyboard | 19:25 |
| *** ralonsoh has quit IRC | 19:25 | |
| fungi | now that i've worked out the process, i'm happy to do further updates for it we can compare | 19:25 |
| diablo_rojo_phon | fungi: I suppose I should commence asking mordred to take a look? | 19:25 |
| fungi | SotK also mentioned he might try to tease out some useful nuggets for ideas of what to improve | 19:26 |
| *** e0ne_ has quit IRC | 19:26 | |
| *** e0ne has quit IRC | 19:27 | |
| clarkb | diablo_rojo_phon: he is currently on vacation but imagine as soon as he is back bugging him would be great :) | 19:28 |
| clarkb | Anything else on storyboard? | 19:29 |
| diablo_rojo_phon | Will do! | 19:29 |
| diablo_rojo_phon | No I don't think so. | 19:29 |
| clarkb | #topic General Topics | 19:29 |
| *** openstack changes topic to "General Topics (Meeting topic: infra)" | 19:29 | |
| clarkb | #link https://etherpad.openstack.org/p/201808-infra-server-upgrades-and-cleanup | 19:30 |
| dmsimard | Need to pick up kids from school, if I'm not back we can talk about my topic in the infra channel | 19:30 |
| clarkb | dmsimard: ok | 19:30 |
| clarkb | first up is server upgrades | 19:30 |
| clarkb | fungi: ^ anything new to add re wiki? | 19:30 |
| fungi | not really, no | 19:30 |
| clarkb | Removing/replacing static.o.o is next | 19:31 |
| clarkb | #link https://etherpad.openstack.org/p/static-services | 19:31 |
| fungi | other community responsibilities have taken priority this past week. i hope to pick it back up soon (but welcome anyone who wants to help out with it too) | 19:31 |
| clarkb | ianw: ^ I tried to capture a todo list at the bottom of that document | 19:31 |
| clarkb | ianw: can you check if it is accurate and we can start to ask for volunteers? | 19:31 |
| ianw | oh sorry, yeah forgot to do that, will do | 19:32 |
| clarkb | thanks | 19:32 |
| clarkb | thanks | 19:32 |
| clarkb | silly keyboard | 19:32 |
| clarkb | Next up is AFS mirrors and debugging failures to vos release tem | 19:32 |
| clarkb | *them | 19:32 |
| clarkb | ianw: auristor mentioned rsync may be to blame (and possibly the switch from rsync on xenial to bionic?)) | 19:33 |
| clarkb | have we learned anything concrete yet and/or are there more changes for us to review? | 19:33 |
| ianw | i think fedora has locked itself again | 19:34 |
| ianw | the reason is takes forever to release now is still unclear ... | 19:34 |
| ianw | looking at the rysnc "-i" output, it does not do something like touch every single file | 19:34 |
| fungi | you ruled out metadata being modified i guess | 19:35 |
| ianw | but maybe updating the metadata on the upper directories is enough | 19:35 |
| ianw | to determine this i think we need to turn on file auditing on the servers again | 19:35 |
| ianw | #link https://lists.openafs.org/pipermail/openafs-info/2019-August/042861.html | 19:36 |
| ianw | the only follow up was basically that version mis-match of client/server shouldn't matter ... that really only leaves bionic rsync v xenial rsync i guess :/ | 19:37 |
| clarkb | at least we could rule out the version mismatch | 19:37 |
| ianw | i will keep poking so we can get it stable | 19:38 |
| clarkb | thanks | 19:38 |
| clarkb | Next up is pointing out the current plan to do project renames on September 16 | 19:38 |
| clarkb | I expect we'll do that about 7am Pacific time to get as early a start as possible? | 19:39 |
| clarkb | (assuming I'm helping could be earlier if others want to drive it) | 19:39 |
| clarkb | If you know of projects that need to be renamed they are highly encouraged to do that during this round of renames :) | 19:39 |
| AJaeger | we should sent out an announcement... | 19:40 |
| clarkb | AJaeger: good idea. I'm guessing your day is about done. I'll do that after the meeting | 19:40 |
| AJaeger | thanks, clarkb | 19:41 |
| clarkb | Next is PTG planning. I've been unable to spend time on this yet, but wanted to point out that it isn't too early for anyone to suggest topics | 19:42 |
| clarkb | #link https://etherpad.openstack.org/p/OpenDev-Shanghai-PTG-2019 Feel free to add PTG topics | 19:42 |
| clarkb | That was it for the agenda that I sent out yesterday. dmsimard are you back to talk about ara and swift hosted logs? | 19:43 |
| clarkb | if not we can pick up the conversation in the infra channel as you mentioned /me gives it a few minutes before openning the floor | 19:43 |
| fungi | we also tend to be pretty efficient at coming up with things to talk about or hack on at the ptg once we get into a room together | 19:46 |
| clarkb | #topic Open Discussion | 19:46 |
| *** openstack changes topic to "Open Discussion (Meeting topic: infra)" | 19:46 | |
| fungi | i like to treat the planning list as more of a resource to help jog our memories so we don't forget things we wanted to talk about | 19:47 |
| clarkb | We'll talk ara in the infra channel. Anything else before we call it a meeting | 19:47 |
| fungi | nothing on my end | 19:47 |
| clarkb | fungi: ++ ya its more about having good notes so that we can let the room move without spending a ton of time looking info up | 19:47 |
| fungi | agreed | 19:47 |
| clarkb | sounds like that is it | 19:51 |
| clarkb | thank you everyone. We'll end a bit early today | 19:51 |
| clarkb | #endmeeting | 19:51 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 19:51 | |
| openstack | Meeting ended Tue Sep 3 19:51:37 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 19:51 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-09-03-19.01.html | 19:51 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-09-03-19.01.txt | 19:51 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-09-03-19.01.log.html | 19:51 |
| fungi | thanks clarkb! | 19:51 |
| *** AJaeger has left #openstack-meeting | 19:53 | |
| *** Shrews has left #openstack-meeting | 19:53 | |
| *** pcaruana has quit IRC | 20:00 | |
| *** bbowen__ has quit IRC | 20:01 | |
| *** Lucas_Gray has joined #openstack-meeting | 20:14 | |
| *** slaweq has quit IRC | 20:17 | |
| *** dmacpher_ has quit IRC | 20:20 | |
| *** jamesmcarthur has quit IRC | 20:27 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:30 | |
| *** artom has quit IRC | 20:30 | |
| *** senrique_ has joined #openstack-meeting | 20:33 | |
| *** enriquetaso has quit IRC | 20:34 | |
| *** artom has joined #openstack-meeting | 20:36 | |
| *** radeks has quit IRC | 20:37 | |
| *** markvoelker has quit IRC | 20:45 | |
| *** Lucas_Gray has quit IRC | 20:46 | |
| *** Lucas_Gray has joined #openstack-meeting | 20:47 | |
| *** ociuhandu has joined #openstack-meeting | 20:48 | |
| *** Lucas_Gray has quit IRC | 20:50 | |
| *** rbudden has joined #openstack-meeting | 20:50 | |
| *** trident has quit IRC | 20:52 | |
| *** Lucas_Gray has joined #openstack-meeting | 20:52 | |
| *** jamesmcarthur has quit IRC | 20:53 | |
| *** janders has joined #openstack-meeting | 21:01 | |
| *** martial has joined #openstack-meeting | 21:01 | |
| janders | g'day | 21:01 |
| martial | hello | 21:01 |
| martial | #start-meeting Scientific-SIG | 21:02 |
| martial | (sigh I do this all the time :) ) | 21:02 |
| martial | #startmeeting Scientific-SIG | 21:02 |
| openstack | Meeting started Tue Sep 3 21:02:30 2019 UTC and is due to finish in 60 minutes. The chair is martial. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:02 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:02 |
| *** openstack changes topic to " (Meeting topic: Scientific-SIG)" | 21:02 | |
| openstack | The meeting name has been set to 'scientific_sig' | 21:02 |
| *** janders42 has joined #openstack-meeting | 21:02 | |
| martial | cute informal meeting today as well :) | 21:03 |
| janders42 | I'm making up the numbers by joining twice | 21:03 |
| janders42 | trying to get my mac to cooperate | 21:03 |
| *** trident has joined #openstack-meeting | 21:03 | |
| martial | janders & janders42 : good man ! | 21:04 |
| martial | I am nowadays using irccloud, simpler way to go online | 21:04 |
| janders42 | good idea - I should look at this, too | 21:05 |
| janders42 | what are you up to these days martial? | 21:05 |
| martial | trying to train some models for ML for a Yolo test | 21:05 |
| janders42 | I'm fighting our GPFS hardware, finally winning | 21:05 |
| janders42 | (looking up initial benchmark of what the kit is capable of) | 21:06 |
| janders42 | Run status group 0 (all jobs): READ: bw=36.1GiB/s (38.7GB/s), 4618MiB/s-4745MiB/s (4842MB/s-4976MB/s), io=800GiB (859GB), run=21579-22174msecRun status group 1 (all jobs): WRITE: bw=24.0GiB/s (26.8GB/s), 3194MiB/s-3224MiB/s (3349MB/s-3381MB/s), io=800GiB (859GB), run=31757-32057msec[root@s206 ~]# cat bw.fio# Do some important numbers on SSD drives | 21:06 |
| janders42 | , to gauge what kind of# performance you might get out of them.## Sequential read and write speeds are tested, these are expected to be# high. Random reads should also be fast, random writes are where crap# drives are usually separated from the good drives.## This uses a queue depth of 4. New SATA SSD's will support up to 32# in flight commands, so | 21:06 |
| janders42 | it may also be interesting to increase the queue# depth and compare. Note that most real-life usage will not see that# large of a queue depth, so 4 is more representative of normal use.#[global]bs=10Mioengine=libaioiodepth=32size=100gdirect=1runtime=60#directory=/mntfilename=/dev/md/stripenumjobs=8[seq-read]rw=readstonewall[seq-write]rw=writestone | 21:06 |
| janders42 | wall[root@s206 ~]# | 21:06 |
| janders42 | 39GB/s read, 27GB/s write per node | 21:06 |
| janders42 | there will be 6 | 21:06 |
| janders42 | with HDR200 | 21:07 |
| janders42 | so should be good | 21:07 |
| janders42 | this is evolution of our BeeGFS design - more balanced, non-blocking in terms of PCIe bandwidth | 21:07 |
| martial | that is quite good | 21:07 |
| janders42 | unfortunately the interconnect doesnt fully work yet, but I'll be at the DC later this morning hopefully getting it to work | 21:08 |
| janders42 | have you ever looked at k8s/GFPS integration? | 21:08 |
| janders42 | this is meant to be HPC OpenStack storage backend and HPC storage backend but I think there's some interesting work happening in k8s-gpfs space | 21:09 |
| *** bbowen has joined #openstack-meeting | 21:09 | |
| martial | I confess we have not had the need for now | 21:10 |
| martial | what are your reading recommendations on this topic? | 21:10 |
| janders42 | I think all I had was some internal email from IBM folks | 21:11 |
| janders42 | I hope to learn more about this in the coming months - and will report back | 21:11 |
| martial | that would indeed be useful | 21:12 |
| martial | maybe a small white paper on the subect? | 21:13 |
| *** b1airo has joined #openstack-meeting | 21:13 | |
| martial | #chair b1airo | 21:14 |
| openstack | Current chairs: b1airo martial | 21:14 |
| janders42 | if it will be possible to remote into Shanghai SIG meetup, I can give a lightning talk about GPFS as OpenStack and/or k8s backend | 21:14 |
| janders42 | hey Blair! | 21:14 |
| b1airo | o/ | 21:14 |
| b1airo | issues connecting today sorry | 21:14 |
| janders42 | another "interesting" thing I've come across lately is how Mellanox splitter cables work on some switches | 21:14 |
| b1airo | how goes it janders42 | 21:14 |
| martial | not sure if Stig will have that capability at the Scientific SIG meet in Shanghai but I hope so | 21:14 |
| b1airo | i'd be keen to see that lightning talk janders42 | 21:15 |
| janders42 | yeah that would be great! :) - unlikely I will be able to attend in person at this stage | 21:15 |
| martial | not sure if Blair will be there. I will not | 21:15 |
| martial | (Shanghai) | 21:15 |
| janders42 | I plugged a 50GE to 4x10gE cable into my mlnx-eth switch yesterday and enabled the splitter function on the port | 21:16 |
| janders42 | and the switch went "port eth1/29 reconfigured. Port eth1/30 reconfigured" | 21:16 |
| janders42 | erm... I did NOT want to touch port 30 - it's an uplink for an IPMI switch... | 21:16 |
| janders42 | boom | 21:17 |
| janders42 | another DC trip | 21:17 |
| janders42 | nice "feature" | 21:17 |
| janders42 | with some switches it is possible to use splitters and still use all of the ports | 21:17 |
| janders42 | with others - the above happens - connecting a splitter automagically kills off the port immediately below | 21:17 |
| *** rmcall has joined #openstack-meeting | 21:17 | |
| janders42 | oh well lesson learned | 21:17 |
| janders42 | hopefully will undo this later this morning | 21:18 |
| *** ociuhandu has quit IRC | 21:18 | |
| martial | or maybe you will lose your uplink ... <disconnect> | 21:18 |
| martial | (that's why we love technology :) ) | 21:19 |
| b1airo | no, i won't make it to Shanghai. already have a couple of trips before the end of the year and another to the States early Jan | 21:19 |
| martial | joining us in Denver ? | 21:20 |
| janders42 | Denver = SC? | 21:20 |
| b1airo | janders42: iirc that functionality is documented regarding the breakout ports | 21:20 |
| janders42 | yeah... @janders | 21:21 |
| janders42 | RTFM | 21:21 |
| janders42 | :D | 21:21 |
| janders42 | just quite counter-intuitive | 21:21 |
| martial | SC yes | 21:21 |
| b1airo | reconfiguring the port requires a full switchd restart and associated low-level changes, which interrupts all the way down to L2 i guess | 21:21 |
| b1airo | SC yes | 21:22 |
| janders42 | just looked at the calendar and SC19 and Kubecon clash | 21:22 |
| janders42 | I'm hoping to go to Kubecon | 21:22 |
| janders42 | otherwise would be happy to revisit Denver | 21:22 |
| janders42 | how long of a trip is it for you Blair to get to LAX? 14 hrs? Bit closer than from here I suppose.. | 21:22 |
| b1airo | yeah bit closer, just under 12 i think | 21:23 |
| janders42 | nice! | 21:23 |
| b1airo | usually try to fly via San Fran though | 21:24 |
| janders42 | yeah LAX can be hectic | 21:24 |
| janders42 | I quite like Dallas | 21:24 |
| janders42 | very smooth | 21:24 |
| janders42 | good stopover while heading to more central / eastern parts of the States | 21:24 |
| janders42 | not optimal for San Diego though - that'd be a LAX/SFO connection | 21:25 |
| martial | (like I said a very AOB meeting today ;) ) | 21:25 |
| janders42 | since Blair is here I will re-post the GPFS node benchmarks | 21:26 |
| b1airo | :-) | 21:26 |
| b1airo | yes please | 21:26 |
| janders42 | Run status group 0 (all jobs): READ: bw=36.1GiB/s (38.7GB/s), 4618MiB/s-4745MiB/s (4842MB/s-4976MB/s), io=800GiB (859GB), run=21579-22174msecRun status group 1 (all jobs): WRITE: bw=24.0GiB/s (26.8GB/s), 3194MiB/s-3224MiB/s (3349MB/s-3381MB/s), io=800GiB (859GB), run=31757-32057msec[root@s206 ~]# cat bw.fio# Do some important numbers on SSD drives | 21:26 |
| janders42 | , to gauge what kind of# performance you might get out of them.## Sequential read and write speeds are tested, these are expected to be# high. Random reads should also be fast, random writes are where crap# drives are usually separated from the good drives.## This uses a queue depth of 4. New SATA SSD's will support up to 32# in flight commands, so | 21:26 |
| janders42 | it may also be interesting to increase the queue# depth and compare. Note that most real-life usage will not see that# large of a queue depth, so 4 is more representative of normal use.#[global]bs=10Mioengine=libaioiodepth=32size=100gdirect=1runtime=60#directory=/mntfilename=/dev/md/stripenumjobs=8[seq-read]rw=readstonewall[seq-write]rw=writestone | 21:26 |
| janders42 | wall[root@s206 ~]# | 21:26 |
| janders42 | this is from a single node with 12NVMes - no GPFS yet | 21:26 |
| janders42 | but we did manage to get a 12NVMe non-blocking PCIe topology going | 21:26 |
| janders42 | 39GB/s read 27GB/s write | 21:26 |
| janders42 | we'll have six of those puppies on HDR200 so should be good | 21:27 |
| janders42 | but having said that I need to head off to the DC soon to bring this dropped out IPMI switch back on the network - otherwise I can't build the last node.,, | 21:27 |
| b1airo | would be interesting to see how those numbers change with different workload characteristics | 21:28 |
| janders42 | bad news is I haven't found any way whatsoever to build these through Ironic | 21:28 |
| *** rmcall has quit IRC | 21:28 | |
| janders42 | 14 drives per box booting thru UEFI from drives number 8 and 9 is too much of an ask | 21:28 |
| b1airo | but those look like big numbers for relatively low depth | 21:28 |
| janders42 | and these drives need to be SWRAID, too | 21:28 |
| janders42 | I think there's a fair bit of room for tweaking, this was just to prove that the topology is right | 21:29 |
| janders42 | it would be very interesting to see how the numbers stack up against our IO500 #4 BeeGFS cluster | 21:30 |
| b1airo | what's the GPFS plan with these? declusered raid? | 21:30 |
| janders42 | in the ten node challenge | 21:30 |
| janders42 | GPFS-EC | 21:30 |
| *** markvoelker has joined #openstack-meeting | 21:31 | |
| janders42 | though we will run 4 nodes of EC and 2 nodes of non-EC just to understand the impact (or lack of) of EC on throughput/latency | 21:31 |
| janders42 | for prod it will be all EC | 21:31 |
| janders42 | the idea behind this system is a mash up of Ceph style arch, RDMA transport and NVMes connected in a non-blocking fashion | 21:32 |
| janders42 | hoping to get the best of all these worlds | 21:32 |
| janders42 | so far the third bit looks like a "tick" | 21:32 |
| janders42 | these run much smoother than our BeeGFS nodes in the early days | 21:32 |
| janders42 | these do have some blocking which is causing all sorts of special effects if not handled carefully | 21:33 |
| janders42 | the new GPFSes have none | 21:33 |
| janders42 | which gets a little funny cause people hear this and ask me - so what's the difference between BeeGFS and GPFS, why do we need both? | 21:34 |
| janders42 | I used to say BeeGFS is a Ferrari and GPFS is a beefed up Ford Ranger | 21:34 |
| b1airo | ha! | 21:34 |
| janders42 | but it really comes to a Ferrari and Porsche Cayenne now really | 21:34 |
| *** markvoelker has quit IRC | 21:35 | |
| b1airo | i guess a lot of it comes down to the question of what happens when either a) the network goes tits up, and/or b) the power suddenly goes out from a node/rack/room | 21:35 |
| janders42 | all good questions | 21:35 |
| janders42 | and with BeeGFS I have a catch-all answer | 21:35 |
| janders42 | it's scratch | 21:35 |
| janders42 | it's not backed up | 21:35 |
| janders42 | if it goes it goes | 21:35 |
| b1airo | i.e., do you still have a working cluster tomorrow :-), and is there any data still on it | 21:35 |
| janders42 | GPFS on the other hand... ;) | 21:36 |
| b1airo | get out of jail free card ;-) | 21:36 |
| janders42 | if one was to go through a car crash, I recommend being in the Cayenne not the Ferrari | 21:36 |
| janders42 | let's put it this way | 21:36 |
| janders42 | but yeah it's an interesting little project | 21:37 |
| *** senrique_ has quit IRC | 21:37 | |
| janders42 | if it wasnt all the drama with HDR VPI firmware slipping and splitter cables giving us shit it would be up and running by now | 21:37 |
| janders42 | hopefully another month | 21:37 |
| janders42 | and on that note I better start getting ready to head out to the DC to fix that IPMI switch.. | 21:37 |
| janders42 | we got mlnx 1GE switches with Cumulus on them for IPMI | 21:38 |
| janders42 | I can't remember why | 21:38 |
| janders42 | they are funky, but it is soo distracting switching between mlnx-os and cumulus | 21:38 |
| janders42 | completely different philosophy and management style | 21:38 |
| janders42 | probably wouldnt get those again - just some braindead cisco like ones for IPMI | 21:38 |
| janders42 | MLNX-100GE and HDR ones are great to work with though | 21:39 |
| janders42 | (except the automatic shutdown of the other port when enabling splitters :) ) | 21:39 |
| b1airo | if you go Cumulus all the way then you can obviously get 1G switches too, but then bye bye IB | 21:39 |
| b1airo | i'm slightly distracted in another Zoom meeting now sorry | 21:40 |
| janders42 | no worries | 21:40 |
| janders42 | wrapping up here, too | 21:40 |
| janders42 | I hope I haven't bored you to death with my GPFS endeavours | 21:40 |
| b1airo | no, sounds fun! | 21:41 |
| janders42 | if you happen to have a cumulus-cisco cheat sheet I'd love that | 21:41 |
| janders42 | I wish I could just paste config snippets to Google Translate | 21:41 |
| janders42 | :D | 21:41 |
| martial | with that, should we move to AOB? :) | 21:44 |
| martial | If not, I will propose we adjourn Today's meeting | 21:45 |
| martial | see you all next week | 21:47 |
| martial | #endmeeting | 21:47 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 21:47 | |
| openstack | Meeting ended Tue Sep 3 21:47:21 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:47 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-09-03-21.02.html | 21:47 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-09-03-21.02.txt | 21:47 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-09-03-21.02.log.html | 21:47 |
| *** janders42 has quit IRC | 21:52 | |
| *** dtrainor has quit IRC | 22:04 | |
| *** dtrainor has joined #openstack-meeting | 22:04 | |
| *** mriedem has quit IRC | 22:10 | |
| *** Lucas_Gray has quit IRC | 22:12 | |
| *** Wryhder has joined #openstack-meeting | 22:12 | |
| *** Wryhder is now known as Lucas_Gray | 22:13 | |
| *** ociuhandu has joined #openstack-meeting | 22:30 | |
| *** ociuhandu has quit IRC | 22:35 | |
| *** senrique_ has joined #openstack-meeting | 22:45 | |
| *** armax has quit IRC | 22:48 | |
| *** diablo_rojo has joined #openstack-meeting | 22:56 | |
| *** Lucas_Gray has quit IRC | 22:56 | |
| *** rcernin has joined #openstack-meeting | 23:06 | |
| *** carloss has quit IRC | 23:18 | |
| *** macz has quit IRC | 23:41 | |
| *** armax has joined #openstack-meeting | 23:50 | |
| *** b1airo has quit IRC | 23:52 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!