| *** igordc has quit IRC | 00:06 | |
| *** slaweq has joined #openstack-meeting-3 | 00:11 | |
| *** slaweq has quit IRC | 00:15 | |
| *** slaweq has joined #openstack-meeting-3 | 01:11 | |
| *** slaweq has quit IRC | 01:15 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 01:17 | |
| *** jamesmcarthur has quit IRC | 01:39 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 01:51 | |
| *** yamamoto has joined #openstack-meeting-3 | 01:53 | |
| *** yamamoto has quit IRC | 01:53 | |
| *** yamamoto has joined #openstack-meeting-3 | 01:57 | |
| *** jamesmcarthur has quit IRC | 02:01 | |
| *** slaweq has joined #openstack-meeting-3 | 02:11 | |
| *** yamamoto has quit IRC | 02:15 | |
| *** slaweq has quit IRC | 02:16 | |
| *** yamamoto has joined #openstack-meeting-3 | 02:16 | |
| *** purplerbot has quit IRC | 02:34 | |
| *** purplerbot has joined #openstack-meeting-3 | 02:36 | |
| *** yamamoto has quit IRC | 02:38 | |
| *** yamamoto has joined #openstack-meeting-3 | 02:42 | |
| *** yamamoto has quit IRC | 02:43 | |
| *** yamamoto has joined #openstack-meeting-3 | 02:45 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 02:48 | |
| *** yamamoto has quit IRC | 02:49 | |
| *** hongbin has joined #openstack-meeting-3 | 02:53 | |
| *** slaweq has joined #openstack-meeting-3 | 03:11 | |
| *** slaweq has quit IRC | 03:16 | |
| *** yamamoto has joined #openstack-meeting-3 | 03:21 | |
| *** hongbin has quit IRC | 03:23 | |
| *** jamesmcarthur has quit IRC | 03:26 | |
| *** psachin has joined #openstack-meeting-3 | 03:35 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 03:48 | |
| *** slaweq has joined #openstack-meeting-3 | 04:11 | |
| *** slaweq has quit IRC | 04:16 | |
| *** yamamoto has quit IRC | 04:36 | |
| *** jamesmcarthur has quit IRC | 04:58 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 04:59 | |
| *** macz_ has quit IRC | 05:00 | |
| *** yamamoto has joined #openstack-meeting-3 | 05:07 | |
| *** jamesmcarthur has quit IRC | 05:07 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 05:10 | |
| *** slaweq has joined #openstack-meeting-3 | 05:11 | |
| *** yamamoto has quit IRC | 05:12 | |
| *** yamamoto has joined #openstack-meeting-3 | 05:15 | |
| *** slaweq has quit IRC | 05:16 | |
| *** jamesmcarthur has quit IRC | 05:22 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 05:28 | |
| *** jamesmcarthur has quit IRC | 05:32 | |
| *** links has joined #openstack-meeting-3 | 05:35 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 06:08 | |
| *** slaweq has joined #openstack-meeting-3 | 06:11 | |
| *** jamesmcarthur has quit IRC | 06:14 | |
| *** slaweq has quit IRC | 06:15 | |
| *** hongbin has joined #openstack-meeting-3 | 06:23 | |
| *** hongbin has quit IRC | 06:28 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 06:30 | |
| *** jamesmcarthur has quit IRC | 06:35 | |
| *** yamamoto has quit IRC | 06:39 | |
| *** yamamoto has joined #openstack-meeting-3 | 06:41 | |
| *** openstack has joined #openstack-meeting-3 | 07:19 | |
| *** ChanServ sets mode: +o openstack | 07:19 | |
| *** openstack has joined #openstack-meeting-3 | 07:43 | |
| *** ChanServ sets mode: +o openstack | 07:43 | |
| *** slaweq has joined #openstack-meeting-3 | 07:51 | |
| *** yamamoto has quit IRC | 08:18 | |
| *** links has quit IRC | 08:24 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 08:31 | |
| *** jamesmcarthur has quit IRC | 08:36 | |
| *** yamamoto has joined #openstack-meeting-3 | 08:53 | |
| *** ralonsoh has joined #openstack-meeting-3 | 08:54 | |
| *** yamamoto has quit IRC | 08:58 | |
| *** links has joined #openstack-meeting-3 | 09:01 | |
| *** yamamoto has joined #openstack-meeting-3 | 09:34 | |
| *** yamamoto has quit IRC | 09:37 | |
| *** e0ne has joined #openstack-meeting-3 | 09:41 | |
| *** yamamoto has joined #openstack-meeting-3 | 10:51 | |
| *** yamamoto has quit IRC | 10:52 | |
| *** slaweq has quit IRC | 11:06 | |
| *** yamamoto has joined #openstack-meeting-3 | 11:09 | |
| *** slaweq has joined #openstack-meeting-3 | 11:11 | |
| *** yamamoto has quit IRC | 11:13 | |
| *** slaweq has quit IRC | 11:32 | |
| *** slaweq has joined #openstack-meeting-3 | 11:34 | |
| *** raildo has joined #openstack-meeting-3 | 11:42 | |
| *** yamamoto has joined #openstack-meeting-3 | 11:59 | |
| *** yamamoto has quit IRC | 12:53 | |
| *** yamamoto has joined #openstack-meeting-3 | 13:15 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 13:17 | |
| *** liuyulong has joined #openstack-meeting-3 | 13:29 | |
| *** jamesmcarthur has quit IRC | 13:36 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 13:48 | |
| *** jamesmcarthur has quit IRC | 14:14 | |
| *** links has quit IRC | 14:18 | |
| *** slaweq has quit IRC | 14:27 | |
| *** slaweq has joined #openstack-meeting-3 | 14:30 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 14:32 | |
| *** jamesmcarthur_ has joined #openstack-meeting-3 | 14:33 | |
| *** jamesmcarthur has quit IRC | 14:36 | |
| *** yamamoto has quit IRC | 14:48 | |
| *** irclogbot_3 has quit IRC | 14:56 | |
| slaweq | #startmeeting neutron_ci | 15:00 |
|---|---|---|
| openstack | Meeting started Wed Feb 19 15:00:57 2020 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| *** openstack changes topic to " (Meeting topic: neutron_ci)" | 15:01 | |
| openstack | The meeting name has been set to 'neutron_ci' | 15:01 |
| ralonsoh | hi | 15:01 |
| njohnston | o/ | 15:01 |
| *** irclogbot_1 has joined #openstack-meeting-3 | 15:02 | |
| slaweq | ping bcafarel for CI meeting :) | 15:02 |
| bcafarel | o/ | 15:02 |
| slaweq | ok, so I think we can start | 15:02 |
| bcafarel | one day I will get used to this new chan :) | 15:02 |
| slaweq | Grafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 15:02 |
| slaweq | bcafarel: LOL | 15:02 |
| slaweq | then we will change it again :P | 15:02 |
| slaweq | #topic Actions from previous meetings | 15:03 |
| *** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 15:03 | |
| slaweq | first one: ralonsoh to check issues with unauthorized ping and ncat commands in functional tests | 15:03 |
| ralonsoh | a bit messy this week | 15:03 |
| ralonsoh | I pushed a patch and then reverted it | 15:03 |
| ralonsoh | I have also pushed a patch to mark ncat tests unstable | 15:04 |
| ralonsoh | I still don't know why rootwrap filters sometimes are valid and in other tests don't | 15:04 |
| ralonsoh | *aren't | 15:04 |
| ralonsoh | (that's all) | 15:05 |
| slaweq | but it's working for some tests and not working for other tests in same job? | 15:05 |
| slaweq | or in different jobs? | 15:05 |
| ralonsoh | same job | 15:06 |
| ralonsoh | and this is the worst scenario | 15:06 |
| ralonsoh | there is no reason for this | 15:06 |
| slaweq | when neutron-functional job was legacy zuulv2 job, it run tests with "sudo" | 15:08 |
| slaweq | sudo -H -u stack tox -e dsvm-functional | 15:08 |
| ralonsoh | but ncat is using the rootwrap command | 15:09 |
| ralonsoh | and the filter list | 15:09 |
| ralonsoh | (that's OK) | 15:09 |
| slaweq | ok, maybe it's some oslo.rootwrap bug than? | 15:09 |
| *** psachin has quit IRC | 15:09 | |
| slaweq | maybe we should ask someone from oslo team to take a look at such failed run? | 15:10 |
| slaweq | what do You think? | 15:10 |
| ralonsoh | I think so. mjozefcz detected that, during a small time, the filters were not present | 15:10 |
| ralonsoh | I'll ping oslo folks | 15:10 |
| slaweq | ralonsoh: thx | 15:10 |
| *** lpetrut has quit IRC | 15:11 | |
| slaweq | #action ralonsoh to talk with oslo people about our functional tests rootwrap issue | 15:11 |
| *** maciejjozefczyk has joined #openstack-meeting-3 | 15:12 | |
| slaweq | ok, next one | 15:12 |
| slaweq | slaweq to report issue with ssh timeout on dvr jobs and check logs there | 15:12 |
| slaweq | I reported bug here: https://bugs.launchpad.net/neutron/+bug/1863858 | 15:12 |
| openstack | Launchpad bug 1863858 in neutron "socket.timeout error in dvr CI jobs cause SSH issues" [Critical,Confirmed] | 15:12 |
| slaweq | and I looked at it a bit today | 15:12 |
| slaweq | From what I looked it seems that it's failing simply due to ssh timeout. So I guess there is some problem with FIP configuration but I don't know what exactly. | 15:12 |
| slaweq | as this started happening only few weeks ago, I checked what we merged recently | 15:13 |
| slaweq | and I found https://review.opendev.org/#/c/606385/ which seems suspicious for me | 15:13 |
| slaweq | but so far I don't have any strong evidence that this is the culprit of the issue | 15:13 |
| slaweq | I proposed revert of this patch https://review.opendev.org/#/c/708624/ just to recheck if couple of times and see if it will be better | 15:14 |
| slaweq | currently neutron-tempest-dvr job is failing pretty often due to this bug | 15:15 |
| slaweq | if we will not find anything to fix this issue in next few days, maybe we should temporary switch this job to be non-voting | 15:15 |
| slaweq | what do You think? | 15:15 |
| ralonsoh | but it's failing only one job | 15:15 |
| ralonsoh | one test | 15:16 |
| ralonsoh | test_resize_volume_backed_server_confirm | 15:16 |
| slaweq | no, I saw also other test failing | 15:16 |
| ralonsoh | ok | 15:16 |
| slaweq | like here: https://19574e4665a40f62095e-6b9500683e6a67d31c1bad572acf67ba.ssl.cf1.rackcdn.com/705982/6/check/neutron-tempest-dvr/8f3fbd0/testr_results.html | 15:16 |
| ralonsoh | ok, we can mark is as unstable for now (non-vonting) | 15:16 |
| ralonsoh | yes, I saw this too | 15:16 |
| slaweq | but that't true, it only happens in dvr job | 15:16 |
| bcafarel | https://review.opendev.org/#/c/606385/ seems "old" no? we have it since stein | 15:17 |
| slaweq | ahh, yes | 15:17 |
| slaweq | so it's not that patch for sure | 15:18 |
| slaweq | it was on my list of recent patches because it was recently merged to stein branch | 15:18 |
| slaweq | so there was comment in original patch in gerrit | 15:18 |
| slaweq | so, this isn't the culprit for sure :/ | 15:18 |
| slaweq | thx bcafarel for pointing this out | 15:18 |
| bcafarel | np :) | 15:18 |
| slaweq | I will try to reproduce this issue locally maybe this week | 15:19 |
| slaweq | #action slaweq to try to reproduce and debug neutron-tempest-dvr ssh issue | 15:19 |
| slaweq | ok, so that's all from my side about this issue | 15:20 |
| slaweq | next one | 15:20 |
| slaweq | ralonsoh to check periodic neutron-ovn-tempest-ovs-master-fedora job's failures | 15:21 |
| maciejjozefczyk | slaweq, thanks | 15:21 |
| ralonsoh | slaweq, I didn't have time for this one | 15:21 |
| ralonsoh | sorry | 15:21 |
| ralonsoh | (is still in my todo list) | 15:21 |
| slaweq | ralonsoh: no problem :) | 15:21 |
| slaweq | #action ralonsoh to check periodic neutron-ovn-tempest-ovs-master-fedora job's failures | 15:21 |
| slaweq | maciejjozefczyk: for what? :) | 15:21 |
| slaweq | ok, lets move on | 15:22 |
| slaweq | next topic | 15:22 |
| slaweq | #topic Stadium projects | 15:22 |
| *** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)" | 15:22 | |
| slaweq | standardize on zuul v3 | 15:23 |
| slaweq | there was only slow progress this week | 15:23 |
| slaweq | we almost merged patch for bagpipe, but some new bug blocked it in gate | 15:23 |
| slaweq | anything else regarding stadium project's ci? | 15:24 |
| njohnston | nope | 15:25 |
| njohnston | like you said, slow progress | 15:25 |
| slaweq | ok, so lets move on | 15:25 |
| slaweq | #topic Grafana | 15:25 |
| *** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 15:25 | |
| slaweq | #link http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 15:25 |
| slaweq | I think we have still the same problems there: | 15:27 |
| slaweq | 1. functional tests | 15:27 |
| slaweq | 2. neutron-tempest-dvr | 15:27 |
| slaweq | 3. grenade jobs | 15:27 |
| slaweq | other than that, I think it looks good | 15:27 |
| njohnston | agreed | 15:27 |
| slaweq | e.g. neutron-tempest-plugin jobs (voting ones) are on very low failure rates | 15:27 |
| slaweq | tempest jobs are fine too | 15:28 |
| slaweq | even fullstack jobs are pretty stable now | 15:28 |
| slaweq | and that conclusion was confirmed when I was looking at some specific failures today | 15:30 |
| slaweq | most of the times, it those repeat problems | 15:30 |
| slaweq | ok, but do You have anything else regarding grafana to add? | 15:30 |
| ralonsoh | no | 15:31 |
| njohnston | no | 15:31 |
| bcafarel | all good | 15:31 |
| slaweq | ok, so lets continue then | 15:32 |
| slaweq | #topic fullstack/functional | 15:32 |
| *** openstack changes topic to "fullstack/functional (Meeting topic: neutron_ci)" | 15:32 | |
| slaweq | as I said, I only found those issues with ncat and ping commands: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e30/705237/7/check/neutron-functional/e301c8d/testr_results.html | 15:32 |
| slaweq | and https://2a0154cb9a3e47bde3ed-4a9629bf7847ad9c8b03c9755148c549.ssl.cf1.rackcdn.com/705660/4/check/neutron-functional/2e5030b/testr_results.html | 15:33 |
| slaweq | ralonsoh: but shouldn't this issue with ping command be solved by https://review.opendev.org/#/c/707452/ ? | 15:33 |
| ralonsoh | IMO, this could be a similar problem to the ncat rootwrap one | 15:34 |
| slaweq | ahh, ok | 15:34 |
| ralonsoh | but of course, this patch modifies the ping commands and filters to match | 15:34 |
| ralonsoh | (regardless of a possible problem in oslo rootwrap) | 15:34 |
| slaweq | so if we will hopefully resolve rootwrap issue with ncat command, this one should be fine too | 15:34 |
| ralonsoh | probably | 15:34 |
| ralonsoh | but the patch, IMO, is legit | 15:35 |
| slaweq | ralonsoh: do You have list of tests which are using ping/ncat command and are failing due to that? | 15:35 |
| slaweq | maybe we could mark them as unstable for now if it's not many tests? | 15:36 |
| ralonsoh | no, I don't have this list | 15:36 |
| ralonsoh | what I did was find in the code any "ping" usage | 15:36 |
| ralonsoh | and I defined a uniformed way of calling this command | 15:36 |
| slaweq | ok, lets for now wait for help from oslo folks with that - maybe they will find root cause of the problem | 15:38 |
| slaweq | anything else related to functional/fullstack tests? | 15:38 |
| ralonsoh | yes | 15:38 |
| ralonsoh | https://bugs.launchpad.net/neutron/+bug/1828205/comments/4 | 15:39 |
| openstack | Launchpad bug 1828205 in neutron ""network-segment-ranges" doesn't return the project_id" [Medium,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 15:39 |
| ralonsoh | (sorry, this in tempest one) | 15:39 |
| slaweq | ralonsoh: no problem | 15:39 |
| slaweq | if we don't have anything else related to functional/fullstack we can move to the tempest topic now :) | 15:39 |
| slaweq | #topic Tempest/Scenario | 15:40 |
| *** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)" | 15:40 | |
| slaweq | and please continue | 15:40 |
| slaweq | :) | 15:40 |
| ralonsoh | thanks | 15:40 |
| ralonsoh | patch: https://review.opendev.org/#/c/707898/ | 15:40 |
| ralonsoh | please, take a look at c#4 | 15:40 |
| ralonsoh | not now, the comment is a bit long | 15:40 |
| ralonsoh | (that's all) | 15:40 |
| slaweq | ok, I will read it later today | 15:41 |
| slaweq | and this Your patch https://review.opendev.org/#/c/707898/ should hopefully resolve this mystery of missing project_id field, right? | 15:42 |
| ralonsoh | yes | 15:42 |
| slaweq | great :) | 15:42 |
| slaweq | at least one down :) | 15:43 |
| slaweq | thx ralonsoh | 15:43 |
| ralonsoh | this is due to the non finished tenant_id->project_id migration | 15:43 |
| ralonsoh | yw | 15:43 |
| bcafarel | he, it had been some time since last issue about that migration | 15:43 |
| slaweq | from other things, I pushed to tempest patch to increase timeout for tempest-ipv6-only job: https://review.opendev.org/708635 | 15:44 |
| slaweq | I hope that QA team will accept it :) | 15:45 |
| slaweq | if not I will reopen patch in neutron repo | 15:45 |
| slaweq | and last thing: | 15:45 |
| slaweq | I found one new, "interesting" failure: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d53/708009/4/check/tempest-ipv6-only/d53c891/testr_results.html | 15:46 |
| slaweq | did You saw such issues before? | 15:46 |
| ralonsoh | Details: {'type': 'RouterInUse', 'message': 'Router 86ed5e27-7dc9-4974-ac7c-4e2e1f0558f0 still has ports', 'detail': ''} | 15:46 |
| ralonsoh | yes, a couple of times | 15:46 |
| ralonsoh | the resource was not cleaned properly | 15:47 |
| slaweq | I don't think it's related to the patch on which it was run | 15:47 |
| ralonsoh | I don't think so | 15:47 |
| slaweq | ralonsoh: so it seems that it's tempest cleanup issue, right? | 15:47 |
| ralonsoh | I think so | 15:47 |
| slaweq | ok, so I will report it as a tempest bug | 15:48 |
| slaweq | #action slaweq to report tempest bug with routers cleanup | 15:48 |
| slaweq | and that's all from my side for today | 15:48 |
| slaweq | anything else regarding to scenario jobs? | 15:48 |
| bcafarel | I saw a few timeouts on tempest plugin runs in stable branches today, but may just be infra/slow node issue | 15:49 |
| bcafarel | rechecks in progress :) | 15:49 |
| bcafarel | it was mostly the designate job | 15:49 |
| slaweq | bcafarel: I saw some timeouts on designate job on master branch too | 15:50 |
| slaweq | but as it was timeout, I didn't check it more | 15:50 |
| slaweq | lets hope it's just slow nodes issue :) | 15:50 |
| bcafarel | fingers crossed | 15:51 |
| slaweq | :) | 15:51 |
| slaweq | bcafarel: I think You wanted to raise some other topic on this meeting too, right? | 15:51 |
| slaweq | #topic Open discussion | 15:51 |
| *** openstack changes topic to "Open discussion (Meeting topic: neutron_ci)" | 15:51 | |
| slaweq | if so, the floor is Yours :) | 15:51 |
| ralonsoh | nothing from me | 15:52 |
| bcafarel | There was https://bugs.launchpad.net/neutron/+bug/1863830 bug, but liuyulong updated it after my initial run - it was dup of ncat issue in the end | 15:52 |
| openstack | Launchpad bug 1863213 in neutron "duplicate for #1863830 Spawning of DHCP processes fail: invalid netcat options" [Undecided,New] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 15:52 |
| slaweq | ahh, ok | 15:53 |
| bcafarel | I just was not up to date on recent bugs :) (holidays have this effect) | 15:53 |
| slaweq | lucky You :P | 15:53 |
| bcafarel | and all good apart from that, glad to see stable branches back in working order | 15:53 |
| slaweq | ok, so I think we can finish a bit earlier today | 15:53 |
| slaweq | thx for attending | 15:54 |
| bcafarel | +1 :) | 15:54 |
| bcafarel | o/ | 15:54 |
| slaweq | #endmeeting | 15:54 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:54 | |
| openstack | Meeting ended Wed Feb 19 15:54:12 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:54 |
| slaweq | o/ | 15:54 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-02-19-15.00.html | 15:54 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-02-19-15.00.txt | 15:54 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-02-19-15.00.log.html | 15:54 |
| ralonsoh | bye | 15:54 |
| njohnston | o/ | 15:54 |
| *** liuyulong has quit IRC | 16:24 | |
| *** igordc has joined #openstack-meeting-3 | 16:59 | |
| *** igordc has quit IRC | 17:46 | |
| *** e0ne has quit IRC | 18:00 | |
| *** igordc has joined #openstack-meeting-3 | 18:22 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 18:39 | |
| *** jamesmcarthur_ has quit IRC | 18:41 | |
| *** ralonsoh has quit IRC | 18:52 | |
| *** maciejjozefczyk has quit IRC | 19:02 | |
| *** jamesmcarthur has quit IRC | 20:06 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 21:07 | |
| *** jamesmcarthur has quit IRC | 21:07 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 21:07 | |
| *** jamesmcarthur has quit IRC | 21:19 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 21:21 | |
| *** jamesmcarthur has quit IRC | 21:26 | |
| *** raildo has quit IRC | 21:28 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 21:56 | |
| *** jamesmcarthur has quit IRC | 21:58 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 21:58 | |
| *** jamesmcarthur_ has joined #openstack-meeting-3 | 22:09 | |
| *** jamesmcarthur has quit IRC | 22:13 | |
| *** slaweq has quit IRC | 22:29 | |
| *** jamesmcarthur_ has quit IRC | 23:32 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 23:33 | |
| *** jamesmcarthur has quit IRC | 23:39 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!