| *** tetsuro_ has quit IRC | 00:01 | |
| *** gyee has quit IRC | 00:06 | |
| *** Nel1x has joined #openstack-meeting | 00:09 | |
| *** zhurong has joined #openstack-meeting | 00:23 | |
| *** harlowja has quit IRC | 00:26 | |
| *** bobh has quit IRC | 00:28 | |
| *** longkb has joined #openstack-meeting | 00:37 | |
| *** tetsuro_ has joined #openstack-meeting | 00:44 | |
| *** ykatabam has quit IRC | 01:00 | |
| *** ykatabam has joined #openstack-meeting | 01:00 | |
| *** tetsuro_ has quit IRC | 01:01 | |
| *** hongbin has joined #openstack-meeting | 01:03 | |
| *** erlon has joined #openstack-meeting | 01:06 | |
| *** tetsuro_ has joined #openstack-meeting | 01:09 | |
| *** erlon has quit IRC | 01:13 | |
| *** mriedem has quit IRC | 01:15 | |
| *** erlon has joined #openstack-meeting | 01:26 | |
| *** zhurong has quit IRC | 01:26 | |
| *** tetsuro_ has quit IRC | 01:27 | |
| *** tetsuro_ has joined #openstack-meeting | 01:28 | |
| *** ricolin has joined #openstack-meeting | 01:29 | |
| *** tetsuro_ has quit IRC | 01:34 | |
| *** tetsuro_ has joined #openstack-meeting | 01:41 | |
| *** tetsuro_ has quit IRC | 01:44 | |
| *** tetsuro_ has joined #openstack-meeting | 01:53 | |
| *** naichuans has joined #openstack-meeting | 02:12 | |
| *** bobh has joined #openstack-meeting | 02:13 | |
| *** lbragstad has quit IRC | 02:18 | |
| *** tetsuro_ has quit IRC | 02:19 | |
| *** tetsuro_ has joined #openstack-meeting | 02:23 | |
| *** tetsuro_ has quit IRC | 02:26 | |
| *** bobh has quit IRC | 02:34 | |
| *** psachin has joined #openstack-meeting | 02:40 | |
| *** erlon has quit IRC | 02:45 | |
| *** tetsuro_ has joined #openstack-meeting | 02:50 | |
| *** tpatil has joined #openstack-meeting | 02:53 | |
| *** markstur_ has quit IRC | 02:53 | |
| *** tetsuro__ has joined #openstack-meeting | 02:53 | |
| *** tetsuro_ has quit IRC | 02:54 | |
| *** markstur has joined #openstack-meeting | 02:55 | |
| *** tetsuro__ has quit IRC | 02:59 | |
| *** markstur has quit IRC | 03:00 | |
| tpatil | #startmeeting Masakari | 03:01 |
|---|---|---|
| openstack | Meeting started Tue Aug 7 03:01:42 2018 UTC and is due to finish in 60 minutes. The chair is tpatil. Information about MeetBot at http://wiki.debian.org/MeetBot. | 03:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 03:01 |
| openstack | The meeting name has been set to 'masakari' | 03:01 |
| tpatil | Hi All | 03:01 |
| *** wanghao has joined #openstack-meeting | 03:02 | |
| tpatil | Will wait for 10 mins as some of them must be facing registration issue. If no one joins during this time, I will end this meeting. | 03:05 |
| *** samP has joined #openstack-meeting | 03:12 | |
| tpatil | Hi samP | 03:12 |
| tpatil | I have started the meeting | 03:12 |
| samP | tpatil: sorry Im late | 03:13 |
| tpatil | NP | 03:13 |
| tpatil | Please take the pilot seat | 03:13 |
| samP | tpatil: thanks, | 03:13 |
| samP | #topic Any critical bugs/patches | 03:13 |
| samP | I guess commands are not working for me :) | 03:14 |
| *** jhesketh_ is now known as jhesketh | 03:14 | |
| samP | Anyway, is there any patches or bugs need to discuss? | 03:14 |
| tpatil | #topic Any critical bugs/patches | 03:14 |
| samP | #link https://review.openstack.org/#/c/588157/ | 03:14 |
| tpatil | https://bugs.launchpad.net/masakari/+bug/1779752 | 03:15 |
| openstack | Launchpad bug 1779752 in masakari "masakari segment-list returns error (openstack queens)" [Critical,Confirmed] - Assigned to SamP (sampath-priyankara) | 03:15 |
| tpatil | Shilpa has proposed a patch to fix about issue in stable/queens | 03:15 |
| tpatil | s/about/above | 03:15 |
| samP | I tested this patch. LGTM | 03:16 |
| tpatil | it will work with openstacksdk >=0.11.0 | 03:16 |
| tpatil | but stable/queens also supports 0.9.19 and 0.10.0 | 03:16 |
| tpatil | so I have requested Shilpa to add a user friendly message if sdk version is above two and call sys.exit | 03:17 |
| samP | yep, that is the problem | 03:17 |
| tpatil | so users will be aware to use sdk >0.11.0 | 03:17 |
| tpatil | What is your opinion? | 03:17 |
| samP | tpatil: That means, users are force to use >0.11.0 | 03:18 |
| tpatil | yes | 03:18 |
| tpatil | or we can update requirements lower constraints to 0.11.0 | 03:18 |
| tpatil | in requirements project for stable/queens branch | 03:19 |
| samP | tpatil: updating the lower constraints to 0.11.0 seems a good idea. | 03:19 |
| tpatil | mee too | 03:19 |
| samP | In that case, we dont need to worry about lower versions. | 03:19 |
| tpatil | correct | 03:20 |
| samP | OK then, Let's give it a try with Shilpa's current patch. | 03:20 |
| samP | There is a very less chance that someone use python-masakariclient with sdk > 0.11.0. | 03:21 |
| samP | However, as OpenStack we must support all the versions as it is in requirement. | 03:21 |
| tpatil | I will request Shilpa to upload a patch to change the lower constraints in requirements project from 0.9.19 to 0.11.0 | 03:22 |
| tpatil | is it ok? | 03:22 |
| *** Nel1x has quit IRC | 03:22 | |
| samP | tpatil: sure, thanks. Let's submit the patch to raise the lower constraints to 0.11.0 | 03:22 |
| tpatil | ok, will do | 03:23 |
| samP | Thanks | 03:23 |
| tpatil | same issue is also there in masakari-monitors | 03:24 |
| tpatil | Shilpa will upload a patch soon to fix this issue in masakari-monitors | 03:25 |
| *** diablo_rojo has quit IRC | 03:25 | |
| samP | tpatil: thanks. not the master but the stable/queens right/ | 03:25 |
| tpatil | yes | 03:25 |
| tpatil | one observation, masakari-monitors is not using openstackclient but it's still present in requirements.txt | 03:25 |
| tpatil | we will fix this issue in master branch. Do you think it should be back ported to stable/queens branch as well? | 03:27 |
| samP | tpatil: seems like it. sure, we can backport this | 03:29 |
| tpatil | ok, will upload patches soon to fix this issue as well | 03:29 |
| tpatil | I will report a LP bug for this | 03:29 |
| samP | we have to release new version for stable/queens anyway. let's include this too | 03:30 |
| tpatil | it's trivial fix | 03:30 |
| samP | tpatil: thanks | 03:30 |
| tpatil | samP: Sure | 03:30 |
| samP | End of this week is the deadline for the RC1 tag and cut off the stable/rocky | 03:31 |
| tpatil | Recovery customization patch is up for review | 03:32 |
| *** niraj_singh has joined #openstack-meeting | 03:33 | |
| samP | tpatil: ah..yes. | 03:33 |
| tpatil | https://review.openstack.org/#/c/583127/ | 03:33 |
| tpatil | Pooja has fixed the unit tests issue and uploaded a new PS | 03:34 |
| samP | I will take a look again. | 03:34 |
| *** liuyulong has joined #openstack-meeting | 03:34 | |
| samP | Last time I look it was OK. wont take much time. | 03:34 |
| samP | Thanks for the reminder | 03:35 |
| samP | I will try to merge this before rc1. | 03:36 |
| tpatil | Yes, please | 03:36 |
| *** markstur has joined #openstack-meeting | 03:37 | |
| samP | End of this week, I will propose patches to release rc1 for masakari, masakari-monitors | 03:37 |
| samP | stable/rocky for masakari, masakari-monitors, masakari-dashboard | 03:37 |
| samP | And will release new version for masakari-dashboard | 03:38 |
| tpatil | Ok, Great | 03:39 |
| samP | And from next week, we will be able to work on master for Stein | 03:39 |
| *** tetsuro_ has joined #openstack-meeting | 03:39 | |
| samP | Any other issues to discuss? | 03:40 |
| tpatil | Any deadline to fix masakariclient and masakari-monitors issue in stable/queens? | 03:40 |
| *** janki has joined #openstack-meeting | 03:41 | |
| samP | No deadline, but sooner the better | 03:42 |
| *** markstur has quit IRC | 03:42 | |
| tpatil | yes, masakari-monitor and requirement patches will be uploaded soon, maybe by tomorrow | 03:43 |
| samP | And I have to announce the deprecation of python-masakariclient in Stein | 03:43 |
| samP | tpatil: sure, thanks. | 03:43 |
| tpatil | Is it possible to change IRC meeting time to it's original one? | 03:45 |
| tpatil | i.e. 1:00 JST -> 4:00 UTC | 03:46 |
| samP | tpatil: sure. I think we can change it back. or bring it 1h early, from 11:00-12:00? | 03:47 |
| *** tetsuro_ has quit IRC | 03:47 | |
| tpatil | Initially we had change IRC meeting timing in the hope that more people can join meeting. But I could see anyone join this meeting for last 1-2 months. | 03:47 |
| samP | tpatil: unfortunately, agree ;) | 03:48 |
| tpatil | It's better 1:00 - 2:00 P.M becoz India people can join during this time | 03:48 |
| *** tetsuro_ has joined #openstack-meeting | 03:48 | |
| samP | tpatil: great, then let's change it back | 03:48 |
| tpatil | Thank you | 03:49 |
| tpatil | Are you going to propose a patch to change meeting time? | 03:49 |
| samP | tpatil: sure I will | 03:49 |
| tpatil | Thanks | 03:50 |
| tpatil | Will this change be effective from next meeting? | 03:50 |
| tpatil | I guess after your patch is approved, it will be effective | 03:50 |
| samP | tpatil: Let's do it form next week meeting. If some one need to change it, let's consider it then | 03:51 |
| *** tetsuro_ has quit IRC | 03:51 | |
| tpatil | samP: Sure | 03:51 |
| samP | tpatil: yes, I can ask them to approve it asap | 03:51 |
| tpatil | Great!!! | 03:52 |
| samP | I think we can conduct this meeting in #openstack-masakari | 03:53 |
| tpatil | you mean weekly IRC meeting? | 03:53 |
| samP | tpatil: yes. | 03:53 |
| tpatil | That's great then, it won't conflict with other team meetings at all. | 03:54 |
| samP | bots are there. I need to try it. | 03:54 |
| samP | let me try it, and if it work I will propose to change the channel also. | 03:54 |
| tpatil | Sounds good | 03:55 |
| samP | #openstack-masakari channel is currently been logged, | 03:55 |
| tpatil | yes | 03:55 |
| samP | OK then, I will propose those changes | 03:55 |
| samP | Any other items to discuss, we have 5 mins left | 03:56 |
| tpatil | No | 03:56 |
| samP | tpatil: thanks | 03:56 |
| samP | Let's finish today's meeting then | 03:56 |
| samP | Thank you for your time | 03:56 |
| tpatil | Ok, I will end this meeting | 03:56 |
| tpatil | Thank you | 03:56 |
| tpatil | #endmeeting | 03:56 |
| openstack | Meeting ended Tue Aug 7 03:56:51 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 03:56 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-08-07-03.01.html | 03:56 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-08-07-03.01.txt | 03:56 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-08-07-03.01.log.html | 03:56 |
| samP | tpatil: thanks | 03:56 |
| *** jaypipes has quit IRC | 04:02 | |
| *** jaypipes has joined #openstack-meeting | 04:02 | |
| *** tpatil has quit IRC | 04:10 | |
| *** tetsuro_ has joined #openstack-meeting | 04:12 | |
| *** bdperkin has quit IRC | 04:14 | |
| *** hongbin has quit IRC | 04:15 | |
| *** markstur has joined #openstack-meeting | 04:18 | |
| *** markstur has quit IRC | 04:23 | |
| *** markstur has joined #openstack-meeting | 04:39 | |
| *** bdperkin has joined #openstack-meeting | 04:44 | |
| *** markstur has quit IRC | 04:44 | |
| *** e0ne has joined #openstack-meeting | 05:00 | |
| *** markstur has joined #openstack-meeting | 05:00 | |
| *** markstur has quit IRC | 05:05 | |
| *** tetsuro_ has quit IRC | 05:15 | |
| *** psachin has quit IRC | 05:18 | |
| *** markstur has joined #openstack-meeting | 05:21 | |
| *** tetsuro_ has joined #openstack-meeting | 05:22 | |
| *** psachin has joined #openstack-meeting | 05:25 | |
| *** markstur has quit IRC | 05:26 | |
| *** tetsuro_ has quit IRC | 05:27 | |
| *** cloudrancher has joined #openstack-meeting | 05:31 | |
| gmann | dhellmann: +1 | 05:42 |
| *** e0ne has quit IRC | 05:58 | |
| *** tetsuro_ has joined #openstack-meeting | 05:59 | |
| *** aagate has quit IRC | 06:01 | |
| *** apetrich has joined #openstack-meeting | 06:01 | |
| *** e0ne has joined #openstack-meeting | 06:02 | |
| *** tetsuro_ has quit IRC | 06:02 | |
| *** tetsuro_ has joined #openstack-meeting | 06:02 | |
| *** cloudrancher has quit IRC | 06:12 | |
| *** markstur has joined #openstack-meeting | 06:30 | |
| *** pcaruana has joined #openstack-meeting | 06:36 | |
| *** markstur has quit IRC | 06:36 | |
| *** tetsuro_ has quit IRC | 06:36 | |
| *** cloudrancher has joined #openstack-meeting | 06:49 | |
| *** markstur has joined #openstack-meeting | 06:52 | |
| *** cloudrancher has quit IRC | 06:52 | |
| *** markstur has quit IRC | 06:56 | |
| *** e0ne has quit IRC | 07:02 | |
| *** ykatabam has quit IRC | 07:19 | |
| *** wznoinsk has quit IRC | 07:27 | |
| *** wznoinsk has joined #openstack-meeting | 07:27 | |
| *** markstur has joined #openstack-meeting | 07:34 | |
| *** e0ne has joined #openstack-meeting | 07:35 | |
| *** markstur has quit IRC | 07:39 | |
| *** ahrechny has joined #openstack-meeting | 07:39 | |
| *** e0ne has quit IRC | 07:41 | |
| *** e0ne has joined #openstack-meeting | 07:52 | |
| *** e0ne has quit IRC | 07:53 | |
| *** apetrich has quit IRC | 07:56 | |
| *** yamamoto has joined #openstack-meeting | 08:00 | |
| *** akhil_jain has joined #openstack-meeting | 08:01 | |
| *** kopecmartin has joined #openstack-meeting | 08:03 | |
| *** ahrechny has left #openstack-meeting | 08:07 | |
| *** ahrechny has joined #openstack-meeting | 08:07 | |
| *** yamamoto has quit IRC | 08:07 | |
| *** phuoc has joined #openstack-meeting | 08:08 | |
| *** rcernin has quit IRC | 08:11 | |
| *** boden has joined #openstack-meeting | 08:14 | |
| *** markstur has joined #openstack-meeting | 08:17 | |
| *** ykatabam has joined #openstack-meeting | 08:17 | |
| *** boden has quit IRC | 08:19 | |
| *** markstur has quit IRC | 08:21 | |
| *** electrofelix has joined #openstack-meeting | 08:33 | |
| *** DaisukeHara has joined #openstack-meeting | 08:35 | |
| *** markstur has joined #openstack-meeting | 08:38 | |
| *** markstur has quit IRC | 08:43 | |
| *** ahrechny has quit IRC | 08:45 | |
| *** yamamoto has joined #openstack-meeting | 08:46 | |
| *** tetsuro_ has joined #openstack-meeting | 08:53 | |
| *** priteau has joined #openstack-meeting | 08:55 | |
| *** markstur has joined #openstack-meeting | 08:59 | |
| *** markstur has quit IRC | 09:04 | |
| *** yamamoto has quit IRC | 09:11 | |
| *** DaisukeHara has quit IRC | 09:15 | |
| *** markstur has joined #openstack-meeting | 09:21 | |
| *** markstur has quit IRC | 09:25 | |
| *** finucannot is now known as stephenfin | 09:30 | |
| *** wanghao has quit IRC | 09:32 | |
| *** ykatabam has quit IRC | 09:43 | |
| *** tetsuro_ has quit IRC | 09:45 | |
| *** tetsuro_ has joined #openstack-meeting | 09:45 | |
| *** niraj_singh has quit IRC | 09:50 | |
| *** tetsuro_ has quit IRC | 09:59 | |
| *** tetsuro has joined #openstack-meeting | 09:59 | |
| *** electrofelix has quit IRC | 10:18 | |
| *** tetsuro has quit IRC | 10:21 | |
| *** electrofelix has joined #openstack-meeting | 10:26 | |
| *** tetsuro has joined #openstack-meeting | 10:28 | |
| *** tetsuro has quit IRC | 10:28 | |
| *** liuyulong has quit IRC | 10:45 | |
| *** ricolin has quit IRC | 10:58 | |
| *** artom has joined #openstack-meeting | 11:11 | |
| *** slagle has joined #openstack-meeting | 11:39 | |
| *** apetrich has joined #openstack-meeting | 11:53 | |
| *** boden has joined #openstack-meeting | 11:56 | |
| *** erlon has joined #openstack-meeting | 11:56 | |
| *** boden has left #openstack-meeting | 11:58 | |
| *** raildo has joined #openstack-meeting | 12:02 | |
| *** raildo has quit IRC | 12:03 | |
| *** edmondsw has joined #openstack-meeting | 12:04 | |
| *** raildo has joined #openstack-meeting | 12:06 | |
| *** raildo has quit IRC | 12:07 | |
| *** tpsilva has joined #openstack-meeting | 12:07 | |
| *** raildo has joined #openstack-meeting | 12:15 | |
| *** e0ne has joined #openstack-meeting | 12:40 | |
| *** bollig has quit IRC | 12:50 | |
| *** cebruns_ has quit IRC | 12:50 | |
| *** weshay has quit IRC | 12:50 | |
| *** samP has quit IRC | 12:53 | |
| *** bobh has joined #openstack-meeting | 12:54 | |
| *** vgreen has joined #openstack-meeting | 12:58 | |
| *** dklyle has quit IRC | 12:59 | |
| *** janki has quit IRC | 13:03 | |
| *** janki has joined #openstack-meeting | 13:04 | |
| *** tssurya has joined #openstack-meeting | 13:07 | |
| *** lbragstad has joined #openstack-meeting | 13:11 | |
| *** longkb has quit IRC | 13:13 | |
| *** mriedem has joined #openstack-meeting | 13:16 | |
| *** chenyb4 has joined #openstack-meeting | 13:21 | |
| *** eharney has joined #openstack-meeting | 13:22 | |
| *** dustins has joined #openstack-meeting | 13:23 | |
| *** r-mibu has joined #openstack-meeting | 13:42 | |
| *** aagate has joined #openstack-meeting | 13:42 | |
| *** mjturek has joined #openstack-meeting | 13:43 | |
| *** chenyb4 has quit IRC | 13:44 | |
| *** psachin has quit IRC | 13:51 | |
| *** awaugama has joined #openstack-meeting | 14:05 | |
| *** jamesmcarthur has joined #openstack-meeting | 14:05 | |
| *** dklyle has joined #openstack-meeting | 14:33 | |
| *** longkb has joined #openstack-meeting | 14:35 | |
| *** hongbin has joined #openstack-meeting | 14:38 | |
| *** e0ne has quit IRC | 14:39 | |
| *** markstur has joined #openstack-meeting | 14:44 | |
| *** markstur has quit IRC | 14:49 | |
| *** priteau has quit IRC | 14:50 | |
| *** markstur has joined #openstack-meeting | 14:56 | |
| *** bobh has quit IRC | 14:56 | |
| *** lamt has joined #openstack-meeting | 15:02 | |
| *** longkb has quit IRC | 15:05 | |
| *** mriedem is now known as mriedem_afk | 15:06 | |
| *** pcaruana has quit IRC | 15:11 | |
| *** hemna_ has joined #openstack-meeting | 15:12 | |
| *** bobh has joined #openstack-meeting | 15:17 | |
| *** bobh has quit IRC | 15:17 | |
| *** markstur_ has joined #openstack-meeting | 15:18 | |
| *** markstur has quit IRC | 15:20 | |
| *** priteau has joined #openstack-meeting | 15:26 | |
| *** gyee has joined #openstack-meeting | 15:32 | |
| *** bobh has joined #openstack-meeting | 15:45 | |
| slaweq | #startmeeting neutron_ci | 16:00 |
| openstack | Meeting started Tue Aug 7 16:00:20 2018 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| openstack | The meeting name has been set to 'neutron_ci' | 16:00 |
| *** mlavalle has joined #openstack-meeting | 16:00 | |
| slaweq | hi | 16:00 |
| mlavalle | o/ | 16:00 |
| *** wxy|xiyuan has joined #openstack-meeting | 16:00 | |
| slaweq | hi mlavalle | 16:01 |
| slaweq | lets wait few minutes for others maybe | 16:01 |
| *** akhil_jain has left #openstack-meeting | 16:01 | |
| *** onovy has quit IRC | 16:01 | |
| mlavalle | did you throw a party during your home mancation? | 16:01 |
| slaweq | no, I didn't | 16:01 |
| mlavalle | LOL | 16:01 |
| *** armstrong has joined #openstack-meeting | 16:02 | |
| mlavalle | I wouldn't either. I live in perpetual fear of my wife | 16:02 |
| slaweq | but funny thing was, last week I told my wife about this term "mancation" and I explained here what it means | 16:02 |
| slaweq | she then asked me when she will be on "womencation" | 16:02 |
| slaweq | I told her that she is already (with kids) - she was a bit angry for me :D | 16:03 |
| mlavalle | LOL | 16:03 |
| slaweq | ok, I think we will start | 16:04 |
| slaweq | #topic Actions from previous meetings | 16:04 |
| slaweq | mlavalle to check dvr (dvr-ha) env and shelve/unshelve server | 16:04 |
| mlavalle | I did | 16:04 |
| mlavalle | Just filed this bug: https://bugs.launchpad.net/neutron/+bug/1785848 | 16:05 |
| openstack | Launchpad bug 1785848 in neutron "Neutron server producing tracebacks with 'L3RouterPlugin' object has no attribute 'is_distributed_router' when DVR is enabled" [Medium,New] - Assigned to Miguel Lavalle (minsel) | 16:05 |
| *** wxy|xiyuan has quit IRC | 16:05 | |
| mlavalle | In a nutshell, this patch https://review.openstack.org/#/c/579058 introduced a bug | 16:05 |
| *** r-mibu has quit IRC | 16:06 | |
| mlavalle | look at https://review.openstack.org/#/c/579058/3/neutron/db/l3_dvrscheduler_db.py@460 | 16:06 |
| slaweq | I noticed those errors in neutron logs this week and I wanted to ask about it later :) | 16:06 |
| mlavalle | it is trying to call is_distributed_router in the l3_plugin | 16:06 |
| slaweq | mlavalle: do You think we should do it for RC1 or it's not so important? | 16:06 |
| mlavalle | it is probably good is we fix it | 16:07 |
| slaweq | *do it => fix | 16:07 |
| mlavalle | I'll push a patch at the end of this meeting | 16:07 |
| mlavalle | let's see what haleyb thinks | 16:07 |
| slaweq | great | 16:07 |
| slaweq | thx | 16:07 |
| haleyb | hi | 16:07 |
| slaweq | hi haleyb | 16:07 |
| *** onovy has joined #openstack-meeting | 16:08 | |
| slaweq | ok, let's go to the next one then | 16:08 |
| slaweq | njohnston to tweak stable branches dashboards | 16:08 |
| slaweq | I don't know if he did anything about that this week | 16:08 |
| slaweq | let's check it next week, ok? | 16:09 |
| mlavalle | he is off today | 16:09 |
| mlavalle | and tomorrow as well | 16:09 |
| slaweq | yes, I know | 16:09 |
| mlavalle | I know because he came collecting debts late last week | 16:09 |
| mlavalle | I got an action item from him last meeting | 16:10 |
| *** mriedem_afk has quit IRC | 16:11 | |
| slaweq | so do You think we can move it to next week to check then? | 16:11 |
| mlavalle | you mean the stable dashboard? | 16:12 |
| slaweq | yes | 16:12 |
| mlavalle | yeah | 16:12 |
| slaweq | #action njohnston to tweak stable branches dashboards | 16:12 |
| slaweq | thx | 16:12 |
| slaweq | next one: | 16:12 |
| slaweq | slaweq to talk with infra about gaps in grafana graphs | 16:12 |
| slaweq | I did | 16:12 |
| slaweq | I talked with ianw, he explained me that it was like that all the time probably, maybe some setting changed during grafana upgrade and that’s why it’s visible now | 16:13 |
| slaweq | We can change nullPointMode to connected mode to make it „not visible” in dashboard config, but I don't know if we want to do that | 16:13 |
| slaweq | what You think? is it necessary to change? | 16:13 |
| *** jaypipes_ has joined #openstack-meeting | 16:16 | |
| mlavalle | Mhhh | 16:16 |
| mlavalle | I don't think it's worth it | 16:16 |
| mlavalle | if it's been there all the time, maybe we just should get used to it | 16:17 |
| *** jaypipes has quit IRC | 16:17 | |
| *** jaypipes_ has quit IRC | 16:17 | |
| *** e0ne has joined #openstack-meeting | 16:18 | |
| slaweq | exactly, that's it's what I think | 16:18 |
| slaweq | but wanted to ask You, as our boss ;) | 16:18 |
| mlavalle | I am just another contributor with some additional duties | 16:18 |
| slaweq | mlavalle: :) | 16:18 |
| *** armax has joined #openstack-meeting | 16:19 | |
| slaweq | ok, let's move on to the next one | 16:19 |
| slaweq | slaweq to report a bug with failing neutron.tests.functional.db.migrations functional tests | 16:19 |
| slaweq | I did it: https://bugs.launchpad.net/neutron/+bug/1784836 | 16:19 |
| openstack | Launchpad bug 1784836 in neutron "Functional tests from neutron.tests.functional.db.migrations fails randomly" [Medium,Confirmed] | 16:19 |
| slaweq | but it's not assigned to anybody yet | 16:19 |
| slaweq | next one: | 16:19 |
| slaweq | * slaweq to check tempest delete_resource method | 16:19 |
| slaweq | so I checked it and there is nothing to fix in tempest | 16:20 |
| slaweq | It was caused by very slow processing of DELETE network call by neutron: http://logs.openstack.org/01/584601/2/check/neutron-tempest-dvr/65f95f5/logs/tempest.txt.gz#_2018-07-27_22_42_11_577 | 16:20 |
| slaweq | Because of that client repeated the call after http_timeout but then network was already deleted by neutron (from first call) and that’s the issue. | 16:20 |
| slaweq | so we have sometimes very slow API - I know that njohnston was woring recently on some improvements for that | 16:20 |
| mlavalle | should we discuss this in the PTG? | 16:21 |
| slaweq | that's good idea | 16:22 |
| slaweq | it hits us in many tests and quite often from what I can see in different job's results | 16:22 |
| *** phuoc has left #openstack-meeting | 16:22 | |
| mlavalle | so I propose you add a topic to the etherpad and gather some data to disucss in Denver | 16:22 |
| slaweq | ok, I will do that | 16:22 |
| mlavalle | Thanks | 16:23 |
| slaweq | #action slaweq add data about slow API to etherpad for PTG | 16:23 |
| slaweq | so, next one | 16:23 |
| slaweq | * slaweq to check with infra if virt_type=kvm is possible in gate jobs | 16:23 |
| mlavalle | and you did | 16:23 |
| mlavalle | I think I reviewed a patch last week | 16:23 |
| slaweq | I again talked with ianw, clarkb and johnsom about it | 16:23 |
| slaweq | yes, I added patch to scenario jobs which uses zuulv3 syntax last week | 16:24 |
| slaweq | and also https://review.openstack.org/#/c/588465/ to use it in "legacy" jobs | 16:24 |
| johnsom | o/ | 16:24 |
| mlavalle | ahh cool | 16:25 |
| slaweq | as johnsom said they are using it for quite long time in octavia jobs and works fine | 16:25 |
| slaweq | hi johnsom :) | 16:25 |
| mlavalle | hey johnsom :-) | 16:25 |
| johnsom | Yeah, a kernel update to the nodepool images a few months back fixed the one issue we were seeing with guests crashing, otherwise it works great. | 16:26 |
| johnsom | Saves up to 50 minutes on some of our gates | 16:26 |
| mlavalle | wow, that's great | 16:26 |
| slaweq | yes, I saw for our linuxbridge scenario job something like 40 minutes speed up IIRC | 16:26 |
| slaweq | so should be better I hope | 16:26 |
| mlavalle | ++ | 16:26 |
| slaweq | ok, next one | 16:27 |
| slaweq | * slaweq to report a bug with tempest.scenario.test_security_groups_basic_ops.TestSecurityGroupsBasicOps.test_in_tenant_traffic | 16:27 |
| slaweq | Done: https://bugs.launchpad.net/neutron/+bug/1784837 | 16:27 |
| openstack | Launchpad bug 1784837 in neutron "Test tempest.scenario.test_security_groups_basic_ops.TestSecurityGroupsBasicOps.test_in_tenant_traffic fails in neutron-tempest-dvr-ha-multinode-full job" [Medium,Confirmed] | 16:27 |
| slaweq | next one: | 16:27 |
| slaweq | slaweq to send patch to add logging of console output in tests like tempest.scenario.test_security_groups_basic_ops.TestSecurityGroupsBasicOps.test_in_tenant_traffic | 16:27 |
| slaweq | Patch for tempest: https://review.openstack.org/#/c/588884/ merged today | 16:27 |
| slaweq | if I will find such issue again, we will be able maybe to check if vm was booted properly and how fast it was booted | 16:28 |
| slaweq | ok, and finally last one from last week: | 16:28 |
| mlavalle | cool | 16:28 |
| slaweq | * mlavalle will check with tc what jobs should be running with py3 | 16:28 |
| mlavalle | It's actually an ongoing conversation | 16:28 |
| *** electrofelix has quit IRC | 16:29 | |
| mlavalle | I am talking to smcginnis about it | 16:29 |
| mlavalle | as soon as I finish that conversation, I'll report back | 16:29 |
| slaweq | thx mlavalle | 16:29 |
| slaweq | we will be waiting then :) | 16:29 |
| mlavalle | that's the debt that njohnsgton collected ahead of time last week | 16:30 |
| slaweq | ahh, ok :) | 16:30 |
| slaweq | let's move on | 16:30 |
| slaweq | next topic | 16:30 |
| slaweq | #topic Grafana | 16:31 |
| slaweq | http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:31 |
| slaweq | and according to grafana I want to propose one small (maybe) improvement | 16:32 |
| slaweq | what You think about adding to graphs line with total number of tests | 16:32 |
| *** lbragstad[m] has quit IRC | 16:32 | |
| slaweq | then we could see e.g. for UT that there was 100% of failures but there were on e.g. 2 tests run and those 2 failed | 16:32 |
| *** jaypipes has joined #openstack-meeting | 16:33 | |
| slaweq | or graph with number of failed tests instead (or together) with % of failures | 16:33 |
| mlavalle | yeah, that's actually an excellent idea | 16:34 |
| mlavalle | because that way we can understand quickly whether we have a trend or just a few outliers failling | 16:34 |
| slaweq | exactly | 16:34 |
| slaweq | like now, e.g on UT graph it has spike to 100% but we don't know if it was one WIP patch rechecked few times or many patches failing with reason not related to change :) | 16:35 |
| slaweq | but which do You think would be better? number of failures together with percentage on same graph? | 16:36 |
| mlavalle | sounds good as a first step | 16:36 |
| mlavalle | we can experiment and tweak it as we learn more | 16:37 |
| slaweq | ok, I will then try to add something like that this week | 16:37 |
| slaweq | thx for blessing :) | 16:37 |
| mlavalle | thanks for improving our Grafana reporting :-) | 16:38 |
| slaweq | #action slaweq will add number of failures to graphana | 16:38 |
| slaweq | I'm trying to make my life easier just :P | 16:38 |
| *** imacdonn has quit IRC | 16:38 | |
| *** imacdonn has joined #openstack-meeting | 16:38 | |
| slaweq | speaking about graphana, there are some spikes there from last week in few jobs | 16:38 |
| slaweq | but I was trying to check and note failures during whole last week | 16:39 |
| slaweq | and I didn't found so many failures related to neutron, like it looks from graphs | 16:39 |
| slaweq | (that's why I had this idea of improving graphs) | 16:39 |
| mlavalle | yeap | 16:39 |
| mlavalle | it makes sense | 16:40 |
| slaweq | I saw that many patches were merged quite quickly during last week | 16:40 |
| mlavalle | that was my impression last week as well | 16:40 |
| slaweq | so maybe we can talk about some failures which I found | 16:40 |
| slaweq | let's first talk about voting jobs | 16:40 |
| slaweq | #topic Integrated tempest | 16:41 |
| slaweq | there were couple of errors which looks for me like slow neutron API or global timeouts (maybe also because of slow API) | 16:41 |
| slaweq | e.g.: | 16:41 |
| slaweq | * http://logs.openstack.org/80/585180/3/check/tempest-full/1f62b43/testr_results.html.gz | 16:42 |
| slaweq | * http://logs.openstack.org/31/585731/8/gate/tempest-full/ecac3d5/ | 16:42 |
| slaweq | * http://logs.openstack.org/59/585559/3/check/neutron-tempest-dvr/b4b7fda/job-output.txt.gz#_2018-08-01_08_45_22_477667 | 16:42 |
| slaweq | and one with timeout and "strange" exception: http://logs.openstack.org/80/585180/3/gate/tempest-full-py3/5d2fb38/testr_results.html.gz | 16:42 |
| slaweq | this last one looks for me like some race but I don't know between what this race could be | 16:44 |
| slaweq | I found it only once during last week | 16:44 |
| slaweq | did You saw it before? | 16:44 |
| mlavalle | nope | 16:44 |
| mlavalle | do you mean the HTTPSConnectionPool exception? | 16:44 |
| *** tssurya has quit IRC | 16:45 | |
| slaweq | no | 16:45 |
| slaweq | this one unfortunatelly is quite "common" | 16:45 |
| slaweq | I was asking about error in tearDownClass (tempest.api.network.test_ports.PortsIpV6TestJSON) | 16:46 |
| slaweq | in http://logs.openstack.org/80/585180/3/gate/tempest-full-py3/5d2fb38/testr_results.html.gz | 16:46 |
| mlavalle | that may be a faulty test | 16:47 |
| *** janki has quit IRC | 16:47 | |
| mlavalle | that is not cleaning up after itself | 16:47 |
| slaweq | but then it would be visible more often IMHO | 16:47 |
| slaweq | as it happens only once let's just be aware of this :) | 16:47 |
| slaweq | ok? | 16:47 |
| mlavalle | yeah | 16:48 |
| mlavalle | I would check anyways if something changed with the test anyways | 16:48 |
| mlavalle | but I see your point | 16:48 |
| slaweq | and those HTTPSConnectionPool exceptions is different issue | 16:50 |
| slaweq | looks e.g. on http://logs.openstack.org/80/585180/3/gate/tempest-full-py3/5d2fb38/controller/logs/screen-q-svc.txt.gz?level=INFO#_Aug_06_16_44_12_685397 | 16:50 |
| slaweq | POST took 80 seconds :/ | 16:50 |
| mlavalle | dang | 16:50 |
| slaweq | I will prepare more data like that to PTG etherpad | 16:50 |
| mlavalle | Great | 16:51 |
| slaweq | because I think it happens quite often | 16:51 |
| slaweq | other issues which I saw in those tempest integrated jobs weren't related to neutron - most often some errors with volumes | 16:52 |
| slaweq | so let's move on to next jobs | 16:52 |
| slaweq | #topic Fullstack | 16:52 |
| slaweq | I found again test * neutron.tests.fullstack.test_securitygroup.TestSecurityGroupsSameNetwork.test_securitygroup(linuxbridge-iptables) failing sometimes | 16:52 |
| slaweq | it was always linuxbridge scenario, never ovs from what I seen | 16:53 |
| slaweq | and I spotted it only once in neutron-fullstack job | 16:53 |
| slaweq | but at least 5 or sic times in neutron-fullstack-python35 | 16:53 |
| slaweq | py27: * http://logs.openstack.org/27/534227/16/check/neutron-fullstack/2a475f6/logs/testr_results.html.gz | 16:53 |
| slaweq | py35: * http://logs.openstack.org/27/534227/16/check/neutron-fullstack-python35/f9e25c1/logs/testr_results.html.gz | 16:54 |
| slaweq | so I don't know if that is only coincidence or something works differently in py35 and that trigger issue more often | 16:55 |
| slaweq | I will report new issue for that and try to investigate it | 16:55 |
| slaweq | fine for You? | 16:55 |
| mlavalle | yes | 16:56 |
| slaweq | #action slaweq to report new bug about fullstack test_securitygroup(linuxbridge-iptables) issue and investigate this | 16:56 |
| slaweq | from other jobs, I have list of failures in scenario jobs | 16:57 |
| slaweq | but it's mostly same issues like every week - many issues with shelve/unshelve, issues with volumes, some issues with FIP connectivity (randomly) | 16:58 |
| slaweq | but we don't have time to talk about them now I think | 16:58 |
| mlavalle | just two things then | 16:58 |
| slaweq | go on mlavalle | 16:58 |
| mlavalle | "part of what Doug is driving now is that everything should run using py3 except for those jobs explicitly testing py2" | 16:58 |
| mlavalle | quote from smcginnis guidance regarding py3 testing | 16:59 |
| mlavalle | and next week I will be in China, so I won't be able to attend this meeting | 16:59 |
| slaweq | any actions I should take on it next week? | 17:00 |
| slaweq | or we should just wait? | 17:00 |
| slaweq | ok, I think we are out of time now | 17:00 |
| slaweq | thx mlavale | 17:01 |
| slaweq | let's talk on neutron channel more | 17:01 |
| slaweq | #endmeeting | 17:01 |
| openstack | Meeting ended Tue Aug 7 17:01:17 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:01 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-08-07-16.00.html | 17:01 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-08-07-16.00.txt | 17:01 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-08-07-16.00.log.html | 17:01 |
| *** mlavalle has left #openstack-meeting | 17:02 | |
| *** armstrong has quit IRC | 17:02 | |
| *** jgriffith_pto is now known as jgriffith | 17:05 | |
| *** cloudrancher has joined #openstack-meeting | 17:09 | |
| *** kopecmartin has quit IRC | 17:13 | |
| *** dtrainor has quit IRC | 17:16 | |
| *** dtrainor has joined #openstack-meeting | 17:19 | |
| *** e0ne has quit IRC | 17:20 | |
| *** e0ne has joined #openstack-meeting | 17:21 | |
| *** e0ne has quit IRC | 17:22 | |
| *** cloudrancher has quit IRC | 17:22 | |
| *** ricolin has joined #openstack-meeting | 17:30 | |
| *** harlowja has joined #openstack-meeting | 17:31 | |
| *** harlowja has quit IRC | 17:43 | |
| *** markvoelker_ has quit IRC | 17:45 | |
| *** Leo_m has joined #openstack-meeting | 18:01 | |
| *** e0ne has joined #openstack-meeting | 18:04 | |
| *** Swami has joined #openstack-meeting | 18:12 | |
| *** AlanClark has joined #openstack-meeting | 18:21 | |
| *** bollig has joined #openstack-meeting | 18:25 | |
| *** bollig has left #openstack-meeting | 18:25 | |
| *** bollig has quit IRC | 18:25 | |
| *** bollig has joined #openstack-meeting | 18:25 | |
| *** ricolin has quit IRC | 18:27 | |
| *** apetrich has quit IRC | 18:35 | |
| *** Shrews has joined #openstack-meeting | 18:46 | |
| *** diablo_rojo has joined #openstack-meeting | 18:51 | |
| *** boden has joined #openstack-meeting | 18:54 | |
| *** boden has left #openstack-meeting | 18:54 | |
| *** jamesmcarthur has quit IRC | 18:58 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:59 | |
| *** sdatko has joined #openstack-meeting | 18:59 | |
| clarkb | Hello, anyone here for the infra meeting? | 18:59 |
| ianw | o/ | 18:59 |
| clarkb | we'll get started in a couple minutes | 18:59 |
| cmurphy | o/ | 19:00 |
| sdatko | hello o/ | 19:00 |
| Shrews | o/ | 19:00 |
| corvus | o/ | 19:00 |
| mordred | o/ | 19:01 |
| clarkb | #startmeeting infra | 19:01 |
| openstack | Meeting started Tue Aug 7 19:01:28 2018 UTC and is due to finish in 60 minutes. The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:01 |
| openstack | The meeting name has been set to 'infra' | 19:01 |
| *** bobh has quit IRC | 19:01 | |
| clarkb | #link https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting | 19:02 |
| clarkb | #topic Announcements | 19:02 |
| clarkb | hrm I guess bot isn't update topics right now (is it not oper?) | 19:02 |
| *** diablo_rojo has quit IRC | 19:02 | |
| *** ChanServ sets mode: +o openstack | 19:03 | |
| fungi | hopefully that helps | 19:03 |
| clarkb | PTG is coming up. If we have time at end of meeting we might brainstorm agenda a bit | 19:03 |
| fungi | [i already had to do that once last week] | 19:03 |
| fungi | [[might be something is breaking +O mode]] | 19:04 |
| clarkb | I'll also put out an ethercalc link to figure out when is a good night to have biergarten trip in denver | 19:04 |
| clarkb | fungi: possibly related to +r? | 19:04 |
| fungi | your guess is as good as mein | 19:04 |
| ianw | fungi: hrm, just rolled out changes to accessbot to mlock, that runs infrequently, i wonder if related | 19:05 |
| clarkb | #topic Actions from last meeting | 19:05 |
| *** openstack changes topic to "Actions from last meeting (Meeting topic: infra)" | 19:05 | |
| clarkb | #link http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-07-31-19.01.txt Minutes from last meeting | 19:05 |
| clarkb | No explicit actions recorded, but mordred has been hard at work getting ansible things going, cmurphy's puppet-4 stack is almost completely merged, and ianw's spec for letsencrypt has been updated | 19:06 |
| clarkb | Thank you everyone for pushing on that stuff | 19:06 |
| clarkb | #topic Specs approval | 19:06 |
| *** openstack changes topic to "Specs approval (Meeting topic: infra)" | 19:06 | |
| clarkb | ianw: how are we feeling about https://review.openstack.org/#/c/563849/ now? | 19:07 |
| * fungi has partially read, saw there was a new revision today | 19:08 | |
| clarkb | This is the 3rd party ci spec. I seem to recall we wanted to hold on it a bit, but not sure if that happened between now and last meeting or if that was last meeting | 19:08 |
| ianw | oh, i owed an update to that to focus on windmill, which i have failed to do | 19:08 |
| clarkb | ah ok | 19:08 |
| fungi | oh, wait, i was thinking of another spec | 19:08 |
| clarkb | in that case I won't propose we put it up for approval this week :) | 19:09 |
| fungi | missed that one too while on vacation but starred to catch up on | 19:09 |
| clarkb | fungi: thanks | 19:09 |
| clarkb | #topic Priority Efforts | 19:10 |
| *** openstack changes topic to "Priority Efforts (Meeting topic: infra)" | 19:10 | |
| clarkb | fungi: want to start with storyboard? | 19:10 |
| fungi | oh, hrm | 19:10 |
| * diablo_rojo_phon lurks | 19:10 | |
| clarkb | looks like search changes are happening? | 19:10 |
| diablo_rojo_phon | Yep :) fatema has been working on that | 19:11 |
| fungi | name-based project urls are finally working on storyboard.o.o | 19:11 |
| diablo_rojo_phon | Her internship is getting close to done though. | 19:11 |
| fungi | #link https://storyboard.openstack.org/#!/project/openstack-infra/storyboard Name-based project URLS! | 19:11 |
| diablo_rojo_phon | I thiiink she'll keep working on stuff but when school starts it will probably slow a bit. | 19:11 |
| diablo_rojo_phon | Woot woot! | 19:11 |
| fungi | there's a lengthy stack of webclient improvements SotK has up for review | 19:11 |
| clarkb | neat to both things. The name based urls will make a lot of people happy | 19:12 |
| diablo_rojo_phon | Yes it will. | 19:12 |
| corvus | i've seen changes to start updating readmes! very exciting! | 19:12 |
| clarkb | and I'm sure improved search will be welcomed by many as well | 19:12 |
| fungi | yeah, especially the ability to sort stories by status in search results | 19:12 |
| corvus | i'll celebrate by approving one of them now | 19:12 |
| clarkb | corvus: such productive celebration | 19:12 |
| fungi | (and there was much rejoicing) | 19:13 |
| diablo_rojo_phon | Awesome :) thanks corvus | 19:13 |
| diablo_rojo_phon | There are definitely a lot of patches with my +2 that just need one more | 19:13 |
| diablo_rojo_phon | Trying to get on top of all of that a bit more. | 19:14 |
| fungi | last week we performed our first project-group rename in sb | 19:14 |
| fungi | (it was a trivial update query changing a single row) | 19:14 |
| diablo_rojo_phon | But still :) | 19:14 |
| clarkb | fungi: this was the api-sig change? | 19:14 |
| fungi | yup. they has a project-group but thankfully project-groups (like most resources in sb) have integer ids and the names are just a mapping table | 19:15 |
| clarkb | ( I didn't realize that was the first case of that particular rename) | 19:15 |
| fungi | we've renamed lots of projects in sb but no project-groups before now | 19:15 |
| clarkb | other than needing reviews anything else before we move on? | 19:16 |
| fungi | nope, not that i can think of | 19:17 |
| fungi | i probably missed some stuff while i was travelling though | 19:17 |
| clarkb | Alright #2 priority effort is the config mgmt modernization. | 19:17 |
| cmurphy | o/ | 19:18 |
| fungi | i did see some of that going on but also wasn't able to follow super closely yet | 19:18 |
| clarkb | I approved the change to make this an official priority effort. We had mostly operated under that assumption anyway | 19:18 |
| clarkb | The big change in the last week is we now have a node bootstrapped by ansible only and is a replacement bastion host | 19:18 |
| *** bobh has joined #openstack-meeting | 19:18 | |
| * fungi will love to see the old puppetmaster instance finally go away | 19:19 | |
| clarkb | it is called bridge.openstack.org. The idea here was we needed a more modern bastion since trusty python is getting unhappy particularly with cryptography | 19:19 |
| clarkb | and we need to uprade anyway | 19:19 |
| clarkb | Eventually it will take over the triggering of puppet on remote nodes but it is not doing that quite yet | 19:19 |
| fungi | what was the story behind the name choice there? i'm sure there was one | 19:19 |
| mordred | clark suggested it and I just ran with it :) | 19:19 |
| fungi | it's a bridge from our old model to eventually just using zuul? | 19:19 |
| clarkb | fungi: monty asked for name ideas and I threw out a few and said I liked bridge the most | 19:19 |
| clarkb | fungi: more star trek bridge | 19:20 |
| mordred | yah. it's "the bridge" | 19:20 |
| fungi | aha | 19:20 |
| clarkb | but it fits that way too :) | 19:20 |
| corvus | patrick stewart is apparently going to reprise jean-luc in a new show. this is relevant information for this meeting. | 19:20 |
| mordred | I could use more reviews on that stack - I'm a little bit stalled at the moment needing to get the install_modules change landed | 19:20 |
| * fungi musters to his station | 19:20 | |
| ianw | should have changed the motd to "make it so" | 19:20 |
| clarkb | the big thing to be aware of at the moment is we need to double account hiera data changes on puppetmaster.o.o and brdige.o.o until bridge takes over the puppet triggering | 19:20 |
| mordred | and yes, that | 19:20 |
| mordred | I don't think we're too far away from being able to move triggering to bridge and decommission puppetmaster | 19:21 |
| clarkb | corvus: cautiously optomistic about that :) | 19:21 |
| corvus | also, you *are* allowed to call it "bilge" when things go wrong | 19:21 |
| mordred | oh - also, double-accounting any password info in /root too | 19:21 |
| corvus | mordred: maybe we could decide to just use bridge for root/passwords.gpg? | 19:21 |
| corvus | since that's just manual | 19:21 |
| clarkb | corvus: that is probably a good idea | 19:22 |
| mordred | yah. I'm fine with that | 19:22 |
| clarkb | maybe send a followup to the fyi email thread saying we are doing ^ | 19:22 |
| corvus | mordred: can you do one final sync, then move the old ones out of the way and replace with a README? | 19:22 |
| mordred | maybe let's set u-w on passwords.gpg on puppetmaster just to be sure ... o rthat | 19:22 |
| mordred | yes | 19:22 |
| corvus | ya, something like that :) | 19:22 |
| * mordred will do that | 19:22 | |
| clarkb | mordred: I'll also rebuild the rax dns venv on bridge so that ssl works | 19:23 |
| clarkb | (I hadn't done that on puppet master yet) | 19:23 |
| *** bobh has quit IRC | 19:23 | |
| *** mriedem has joined #openstack-meeting | 19:24 | |
| clarkb | Semi related are the set of changes at topic:puppet-4 | 19:24 |
| clarkb | I think I'm mostly up to date on my reviews there if someone else is willing tomake a followup pass through | 19:24 |
| clarkb | but the vast majority of those changes have been merged at this point | 19:24 |
| cmurphy | i think we're stuck on ask and ask-staging | 19:24 |
| cmurphy | since ask-staging seems to not exist right now | 19:24 |
| clarkb | oh right, ianw ^ is there a tl;dr for the status on ask-staging? | 19:24 |
| clarkb | (I think you had mentioned that there were some things) | 19:25 |
| ianw | oh, hrm ... so i think i was waiting on a change to get numerical hosts for it into puppet | 19:25 |
| ianw | and then probably got distracted | 19:25 |
| *** jamesmcarthur has quit IRC | 19:25 | |
| ianw | yes, https://review.openstack.org/#/c/558992/ | 19:26 |
| clarkb | ianw: ya I left a couple comments on that one last week when I was trying to get the future parser stuff going | 19:26 |
| clarkb | ianw: I think we need to set up the hiera groups in puppet for that (and then add hiera data) | 19:26 |
| clarkb | cmurphy: would it make sense to skip ask* for now and continue with another service or three? | 19:27 |
| cmurphy | clarkb: sure | 19:27 |
| ianw | i can do that, we really should look at getting ask.o.o updated and will need the staging host | 19:27 |
| clarkb | ianw: ++ | 19:27 |
| ianw | there's an email out there i sent when i investigated issues with ask.o.o | 19:28 |
| clarkb | I think we can do the puppet 4 parser work in parallel (on other services) and update ask | 19:28 |
| cmurphy | i've just been going through site.pp looking for candidates | 19:28 |
| cmurphy | i have a change to remove stackalytics.o.o since that seesm to not exist anymore https://review.openstack.org/585208 | 19:28 |
| clarkb | cmurphy: ethercalc, ehterpad, logstash-workers, elasticsearch, paste are favorites of mine fwiw. They tend to be straightforward | 19:28 |
| cmurphy | clarkb: ether* scare me because nodejs | 19:28 |
| fungi | storyboard-dev? | 19:29 |
| cmurphy | also there are a few in-flight beaker tests for ether* that i think are still unmerged | 19:29 |
| clarkb | cmurphy: we have etherpad-dev too but getting tests happy first is probably a good idea | 19:30 |
| cmurphy | fungi: storyboard-dev is good except it's slightly less dev than other -dev sites since some people are using it to trial storyboard | 19:30 |
| cmurphy | also i noticed that odsreg.o.o seems very sad | 19:30 |
| fungi | i thought we removed that | 19:30 |
| clarkb | I want to say we did | 19:31 |
| fungi | i need to follow up with ttx to find out if i missed deleting that after he said i could or something | 19:31 |
| cmurphy | it's still in site.pp | 19:31 |
| cmurphy | if it's not needed i'll propose a change to remove it | 19:31 |
| clarkb | and dns | 19:31 |
| clarkb | we should clean that up if possible | 19:31 |
| fungi | i'll take care of it | 19:31 |
| clarkb | thanks | 19:31 |
| fungi | after i check that it's really gone from the tenant too | 19:32 |
| *** e0ne has quit IRC | 19:32 | |
| clarkb | mordred: cmurphy: anything else we should be aware of with the changes that are happening? | 19:33 |
| cmurphy | nothing from me i think | 19:33 |
| *** apetrich has joined #openstack-meeting | 19:33 | |
| fungi | yeah, not finding odsreg in our tenant, so it's just puppet/dns i need to clean up i guess | 19:34 |
| clarkb | #topic General Topics | 19:34 |
| *** openstack changes topic to "General Topics (Meeting topic: infra)" | 19:34 | |
| clarkb | corvus: Swift logs is back on the agenda | 19:34 |
| corvus | we're very close to being able to switch | 19:35 |
| corvus | we need to land this change: | 19:35 |
| corvus | #link https://review.openstack.org/588383 Add severity info to logstash and filter out DEBUG lines | 19:36 |
| corvus | to the log processor | 19:36 |
| corvus | that should be compatible with the current system too, so is safe to land now | 19:36 |
| clarkb | I've reviewed it and has my +2. It should be forward and backward compatible | 19:36 |
| clarkb | yup | 19:36 |
| *** jamesmcarthur has joined #openstack-meeting | 19:36 | |
| corvus | then i can push up some test changes (to, say, devstack) so we can see how everything will look | 19:36 |
| corvus | then we should be able to switch | 19:37 |
| corvus | so, basically, now's the time to start talking about whether we want to, any concerns folks have, etc. | 19:37 |
| clarkb | corvus: we should clarify to openstack release team that this won't affect the releaes artifacts (all of that goes to tarballs still aiui) | 19:37 |
| clarkb | I'm surethey will be concered about it impacting the release (but its logs only shold be quite safe) | 19:37 |
| clarkb | corvus: is the plan to use vexxhost to start? | 19:38 |
| corvus | currently, it's only easy to use one provider. we can use vexxhost or ovh. i think we should be able to randomly pick one of the two in the near future if we want, but i haven't implemented that yet. | 19:38 |
| corvus | we *might* be able to extend it to support rax's not-swift. no promises. | 19:39 |
| corvus | those are the only things vaguely like swift that i believe we have access to at the moment. | 19:39 |
| mordred | ++ | 19:40 |
| corvus | there are definite downsides to this. severity filtering in the ui will be gone. we'll be storing plain text *and* htmlified logs. and tristanC apparently wanted to use os-loganalyze for some of the machine learning log stuff. | 19:40 |
| clarkb | we are trading complexity for reliability and retention | 19:41 |
| clarkb | I'm personally happy to use grep myself if I have to in return for having logs for longer period of time | 19:41 |
| corvus | that's how i look at it. and i'd like to look into implementing some of that complexity in javascript if we can. | 19:42 |
| clarkb | vim users, you can open http(s) urls directly in vim too. Quite useful for this stuff | 19:42 |
| clarkb | I'm sure emacs does similar | 19:42 |
| fungi | yeah, i expect some css/js magic would make it possible to filter in-browser (though the browser would still have to retrieve the full log first) | 19:42 |
| corvus | if we can't, maybe we should revisit the idea of a proxy. tobiash is running one anyway (for access control purposes), so we might want to revisit that. but at the moment at least, i feel like i'd like to try to avoid that. it's where we hit the wall last time we tried swift. | 19:43 |
| fungi | and the implementation gives us a durable url to the index for any given build? | 19:43 |
| corvus | fungi: yeah. https://object-storage-ca-ymq-1.vexxhost.net/swift/v1/86bbbcfa8ad043109d2d7af530225c72/logs_78/587178/1/check/tox-py35-on-zuul/1f46ccf/ is the latest test | 19:44 |
| clarkb | fungi: until the expiration happens and it is deleted. Couple that with zuul dashboard and you should be able to find builds reasonably well | 19:44 |
| corvus | oh, yeah, icons are still to-do. | 19:44 |
| mordred | I think it's a reasonable tradeoff | 19:44 |
| fungi | meh, icons ;) | 19:45 |
| mordred | especially given the cost to th eproject overall whenver logs.o.o goes south | 19:45 |
| clarkb | mordred: ya | 19:45 |
| clarkb | we have 15 minutes left, ok if we move on? Please go review the log processor change if you have some cycles | 19:45 |
| mordred | and I agree, we can always run a proxy in the future - OR we could just run a web service that does os-loganalyze/machine-learning like things that is not what we normally route people to for log viewing | 19:46 |
| corvus | yep. | 19:46 |
| corvus | sounds like folks want to move forward still. | 19:46 |
| mordred | clarkb: I already +A'd the processor change | 19:46 |
| clarkb | mordred: woot | 19:46 |
| corvus | let me know if you have concerns. or, you know, propose patches to fix them. :) | 19:46 |
| *** vgreen has quit IRC | 19:46 | |
| fungi | do we want a redirector of some sort (rather than a proxy) in case we need to move objects to another container or provider or something? or just plan to do phased transitions and consider the loss of that data an acceptable risk in such situations? | 19:46 |
| corvus | fungi: personally, i'd suggest never moving data | 19:47 |
| corvus | if we lose a provider holding logs, we lose those logs | 19:47 |
| clarkb | not all that different from the 30 day expiry on mega fs today | 19:48 |
| fungi | since we don't control those domains though, we have to assume domain name changes will never occur, and urls paths will never be rejiggered, right? | 19:48 |
| clarkb | fungi: yes, though I think that is sort of the point of those services. | 19:48 |
| fungi | wfm | 19:48 |
| corvus | the nice thing about not having a proxy (at least, in the current system) is that we no longer have a single hostname for logs. each log has its own url. a job that runs today may be stored in vexxhost. tomorrow in ovh. | 19:48 |
| clarkb | fungi: I would be surprised if they change those ever | 19:48 |
| corvus | so us changing log-storageprovider | 19:48 |
| corvus | gah | 19:48 |
| corvus | so us changing log-storage-providers is a non-event | 19:49 |
| fungi | yep, i'm fine with all that as long as we set expectations around it | 19:49 |
| fungi | still no guarantee of any particular retention in cases where we have to move off of a provider we were using | 19:49 |
| mordred | yup | 19:49 |
| fungi | (thinking ahead to a broadly distributed object storage future for logging) | 19:49 |
| mordred | mmm. broadly distributed | 19:50 |
| *** tobiash has joined #openstack-meeting | 19:50 | |
| corvus | fungi: yeah, we may want to not enable log storage on a provider until we have a reasonable expectation they'll stick around for 6 months :) | 19:50 |
| fungi | heh | 19:50 |
| fungi | good call! | 19:50 |
| clarkb | Really quickly, the winterscale naming thread hsa an update from jbryce with a proposal. Would appreciate all yall's feedback. I think we are also keeping it to that private thread we are on for now while some last details are sorted. | 19:50 |
| clarkb | feedback that has been provided so far is positive though. I am excited :) | 19:51 |
| mordred | ++ | 19:51 |
| corvus | yeah, hopefully we can make that public again soon, but it's good to know there's progress | 19:51 |
| * mordred is excited - and also excited to get to the point where we can talk about it publically | 19:51 | |
| clarkb | ++ | 19:51 |
| clarkb | #topic Open Discussion | 19:52 |
| *** openstack changes topic to "Open Discussion (Meeting topic: infra)" | 19:52 | |
| clarkb | Couple items from me that weren't quite proper agenda worthy: I am taking tomorrow off to go fishing and spend time with family. I expect that I will be properly afk. The other thing is PTG planning is quickly bubbling up to the top of my todo list | 19:52 |
| clarkb | I think the config management stuff is getting to the point where we should hav a good idea of what we can dig into in denver | 19:53 |
| clarkb | which is good | 19:53 |
| corvus | https://zuul-ci.org/users.html and http://superuser.openstack.org/articles/zuul-case-study-bmw/ are cool | 19:55 |
| tobiash | :) | 19:55 |
| fungi | as is https://www.podcastinit.com/zuul-with-monty-taylor-episode-172/ | 19:55 |
| corvus | well, except for that none of the links go to zuul-ci.org. i'll email them i guess :) | 19:55 |
| clarkb | corvus: dhellmann and I have been asked to start working on similar from an openstack perspective | 19:56 |
| clarkb | happy to inclue others if they are interested (maybe to review?) | 19:56 |
| corvus | cool! | 19:57 |
| *** jamesmcarthur has quit IRC | 19:57 | |
| *** jamesmcarthur has joined #openstack-meeting | 19:57 | |
| fungi | eek, yeah i see one nodepool link gong to our openstack deployment operational docs, and another going to a github mirror | 19:57 |
| clarkb | Alright we are basically at time and I have a leftover burger patty to turn into lunch | 19:58 |
| clarkb | Thank you everyone | 19:58 |
| *** jamesmcarthur_ has joined #openstack-meeting | 19:58 | |
| fungi | thanks clarkb! | 19:58 |
| clarkb | #endmeeting | 19:58 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 19:58 | |
| openstack | Meeting ended Tue Aug 7 19:58:58 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 19:58 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-08-07-19.01.html | 19:59 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-08-07-19.01.txt | 19:59 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-08-07-19.01.log.html | 19:59 |
| *** bobh has joined #openstack-meeting | 19:59 | |
| *** sdatko has left #openstack-meeting | 20:00 | |
| *** jamesmcarthur has quit IRC | 20:01 | |
| *** raildo has quit IRC | 20:02 | |
| *** raildo has joined #openstack-meeting | 20:07 | |
| *** tobiash has left #openstack-meeting | 20:08 | |
| *** raildo has quit IRC | 20:28 | |
| *** dustins has quit IRC | 20:30 | |
| *** dustins has joined #openstack-meeting | 20:36 | |
| *** AlanClark has quit IRC | 20:41 | |
| *** apetrich has quit IRC | 20:45 | |
| *** trandles has joined #openstack-meeting | 20:58 | |
| *** slaweq has quit IRC | 20:58 | |
| *** martial has joined #openstack-meeting | 21:04 | |
| martial | testing? | 21:05 |
| trandles | hello | 21:05 |
| trandles | meeting today? | 21:05 |
| martial | Hi Tim, is it just a few regulars today? | 21:06 |
| *** Shrews has left #openstack-meeting | 21:06 | |
| *** janders has joined #openstack-meeting | 21:07 | |
| janders | gday everyone | 21:07 |
| martial | Hi janders, any update on your presentation? | 21:08 |
| janders | :) what presentation? :) | 21:08 |
| martial | I must be confusing with something else then | 21:09 |
| martial | no stig or blair I guess? they are otherwise occupied I am sure and that is fine | 21:09 |
| janders | hope they are not fighting fires.. I missed last week's meeting after one of my colleagues accidentally connected two subnet managers which started killing each other. That hurt :( | 21:11 |
| trandles | might be just a few of us, not sure | 21:11 |
| trandles | I didn't see a meeting announcement email this week | 21:11 |
| janders | yeah looks like a small meeting | 21:11 |
| janders | we don't have an agenda set, right? do we spontaneously make one? :) | 21:12 |
| janders | have you guys had much exposure to placement api? | 21:15 |
| janders | I've been fighting some interesting placement issues this week | 21:15 |
| martial | I did not see an agenda or any announcement either, Blair and Stig are off, moving or otherwise | 21:17 |
| martial | we will keep it as a short meeting | 21:17 |
| martial | simple | 21:17 |
| martial | tim: I got contacted by a person that is also doing a Container on HPC BoF for SC18 | 21:18 |
| *** dustins has quit IRC | 21:18 | |
| martial | and that is not the person you introduced me to | 21:18 |
| trandles | martial: I'm not aware of that one... | 21:18 |
| trandles | unless it's a likely suspect | 21:18 |
| martial | not sure I must say | 21:19 |
| trandles | no worries | 21:19 |
| trandles | I suspect the organizers will be sending emails asking submissions to merge | 21:19 |
| martial | possible, we will see what happens | 21:20 |
| janders | do you guys know when the Summit Berlin organisers will start notifying those who submitted presentations about the selection outcomes? | 21:20 |
| martial | not sure but since you do not have one ;) | 21:21 |
| trandles | janders: I don't know but usually they publish that info. IIRC there was a mini draft schedule/agenda posted on FB in the past day or two | 21:21 |
| *** awaugama has quit IRC | 21:21 | |
| trandles | I'm guessing it was just confirmed keynotes | 21:21 |
| trandles | since I can't go to the Berlin Summit I haven't been paying much attention...too depressing to think about ;) | 21:22 |
| *** slaweq has joined #openstack-meeting | 21:23 | |
| janders | trandles: thanks, I will look around | 21:24 |
| *** edmondsw has quit IRC | 21:29 | |
| martial | same :) | 21:32 |
| martial | well it was a good meeting :) | 21:32 |
| martial | thanks team :) | 21:33 |
| bollig | short meeting | 21:33 |
| janders | thanks guys | 21:33 |
| janders | to answer my question: Dates to remember: August 13: Event schedule goes live | 21:34 |
| janders | we should know by the next meeting | 21:34 |
| janders | have a good day / night depending on where you are :) | 21:34 |
| trandles | sorry, I'm also on a conference call which I NEVER participate in, then I heard my name... | 21:35 |
| trandles | later all | 21:35 |
| martial | no worries Tim, short meetings are good too :) | 21:35 |
| *** trandles has quit IRC | 21:35 | |
| *** Leo_m has quit IRC | 21:40 | |
| *** jamesmcarthur_ has quit IRC | 21:41 | |
| *** Leo_m has joined #openstack-meeting | 21:46 | |
| *** Leo_m has quit IRC | 21:51 | |
| *** slagle has quit IRC | 21:56 | |
| *** Leo_m has joined #openstack-meeting | 21:57 | |
| *** priteau has quit IRC | 22:09 | |
| *** bobh has quit IRC | 22:12 | |
| *** janders has quit IRC | 22:12 | |
| *** beagles has quit IRC | 22:13 | |
| *** ykatabam has joined #openstack-meeting | 22:15 | |
| *** beagles has joined #openstack-meeting | 22:20 | |
| *** rcernin has joined #openstack-meeting | 22:20 | |
| *** strigazi has joined #openstack-meeting | 22:20 | |
| *** strigazi has quit IRC | 22:21 | |
| *** strigazi has joined #openstack-meeting | 22:21 | |
| *** strigazi has quit IRC | 22:27 | |
| *** strigazi has joined #openstack-meeting | 22:28 | |
| *** strigazi has quit IRC | 22:28 | |
| *** strigazi has joined #openstack-meeting | 22:29 | |
| *** strigazi has quit IRC | 22:32 | |
| *** strigazi has joined #openstack-meeting | 22:33 | |
| *** hongbin has quit IRC | 22:39 | |
| *** gothicmindfood has quit IRC | 22:42 | |
| *** edmondsw has joined #openstack-meeting | 22:54 | |
| *** edmondsw has quit IRC | 22:59 | |
| *** tpsilva has quit IRC | 23:12 | |
| *** priteau has joined #openstack-meeting | 23:16 | |
| *** Leo_m has quit IRC | 23:46 | |
| *** Swami has quit IRC | 23:46 | |
| *** Leo_m_ has joined #openstack-meeting | 23:46 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!