14:00:06 <gcb> #startmeeting oslo 14:00:07 <openstack> Meeting started Mon Jul 17 14:00:06 2017 UTC and is due to finish in 60 minutes. The chair is gcb. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:00:08 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 14:00:10 <openstack> The meeting name has been set to 'oslo' 14:00:15 <gcb> courtesy ping for amotoki, amrith, bknudson, bnemec, crushil, dansmith, dhellmann 14:00:16 <gcb> courtesy ping for dims, dougwig, e0ne, electrocucaracha, flaper87, garyk, gcb 14:00:16 <gcb> courtesy ping for GheRivero, haypo, jd__, jecarey, johnsom, jungleboyj, kgiusti 14:00:16 <gcb> courtesy ping for kragniz, lhx_, lifeless, lxsli, Nakato, ozamiatin, rbradfor 14:00:16 <gcb> courtesy ping for redrobot, rpodolyaka, sergmelikyan, sileht, spamaps, sreshetnyak, sreshetnyak 14:00:17 <gcb> courtesy ping for stevemar, therve, thinrichs, toabctl, viktors, zhiyan, zzzeek 14:01:02 <crushil> \o 14:01:30 <kgiusti> o/ 14:01:42 <jungleboyj> o/ 14:02:04 <gcb> Hello everyone \o/ 14:02:22 <gcb> #topic Red flags for/from liaisons 14:02:58 <gcb> Any red flags ? we'll fix them before our final releases this week 14:03:58 <jungleboyj> Ah, for Cinder, just to make people aware, we were having tooz related issues late last week. 14:04:37 <jungleboyj> Appeared there was an update there and then we started seeing threads die in the gate. 14:04:45 <gcb> jungleboyj, have it been fixed ? 14:04:58 <gcb> any bug link ? 14:05:12 <jungleboyj> So, we updated global requirements to not use the latest code and have a bug open to the tooz guys. 14:05:34 <jungleboyj> Just wanted to share here in case anyone else was seeing similar issues. Seemed like a relevant forum. 14:06:29 <gcb> a bug is appreciated, then we can figure out the root cause 14:06:32 <crushil> jungleboyj, So, what test suite was failing in cinder because of this? 14:06:48 <jungleboyj> It was random. Let me see if I can find the bug. 14:09:03 <jungleboyj> You can go on. It will take me a bit to find it here. 14:09:17 <gcb> jungleboyj, please file a bug or report the bug link, hope we can find the root cause before we release tooz 14:09:25 <gcb> #topic Releases for Pike 14:09:31 <jungleboyj> Will do. 14:09:56 <gcb> https://releases.openstack.org/pike/schedule.html#p-final-lib 14:10:21 <gcb> we should issue their final release during this week. That allows to give time for last-minute changes before feature freeze. 14:11:45 <gcb> I sent a email to let everyone focus on bug fix before this week. I plan to issue final releases on July 19, which gives us two days buffer to merge fix 14:12:20 <gcb> so please focus on bug fix these two days 14:13:29 <gcb> # topic PTL nomination for Queens 14:13:44 <gcb> #topic PTL nomination for Queens 14:14:44 <gcb> new cycle PTL selection will begin you can check the detailed schedule in https://review.openstack.org/#/c/481768/ 14:14:59 <gcb> I won't run for PTL for Queens, I'm still in the team, 14:15:30 <gcb> if someone will run for Oslo PTL, please talk to me, I would like to give some guidance as previous PTL did before 14:16:50 <bknudson> thanks for being the PTL this release 14:17:02 <jungleboyj> bknudson: ++ 14:17:07 <jungleboyj> Sorry to see you go. 14:17:58 <gcb> jungleboyj, I will still in the team, just it's time to rotate, let others lead the team :-) 14:18:12 <jungleboyj> Sounds good. 14:18:15 <gcb> thanks everyone, I still focus on oslo 14:20:01 <gcb> so oslo core reviews if you want to run for the PTL, feel free to reach me, I will give you some suggestions about PTL's daily work :-) 14:20:14 <gcb> #topic Open discussion 14:20:56 <jungleboyj> gcb: I found the bug I was talking about at the beginning of the meeting. 14:20:58 <jungleboyj> https://bugs.launchpad.net/cinder/+bug/1694509/ 14:20:59 <openstack> Launchpad bug 1694509 in tooz "eventlet errors and cannot switch to a different thread" [High,Confirmed] 14:21:31 <crushil> jungleboyj, So, is this cinder specific? 14:22:09 <gcb> jungleboyj, thanks, will reach our tooz expert jd_ to help figure out 14:22:11 <jungleboyj> I think there was discussion that we just the ones seeing it because we do have some gate tests that use tooz for locking. 14:22:37 <jungleboyj> crushil: So, not specific to Cinder, but we are the only ones seeing it. 14:22:47 <crushil> Ah, gotcha. I haven't seen it in Ironic yet 14:23:21 <jungleboyj> crushil: Yeah, we are the lucky ones. 14:23:30 <crushil> lol 14:23:43 <gcb> I saw jd_ added comments 6 hours ago 14:25:38 <jungleboyj> gcb: I saw that. 14:29:30 <gcb> etcd3 with gRPC doesn't work with eventlet monkey patch 14:30:15 <gcb> That's a know issue, I remember dims told me about that before 14:31:56 <dims> jungleboyj : mriedem was chasing it and filed this black list - https://review.openstack.org/#/c/484019/ on friday, waiting for him to confirm if that worked or not 14:34:15 <jungleboyj> dims: It appears to be working: http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22%2Fusr%2Flocal%2Flib%2Fpython2.7%2Fdist-packages%2Ftooz%2Fdrivers%2Fetcd3gw.py:113%20in%20acquire%5C%22%20AND%20tags:%5C%22screen-c-vol.txt%5C%22&from=7d 14:36:01 <gcb> dims: thanks 14:38:17 <dims> jungleboyj : gcb : so it's one of the merges in 1.57.4 that's causing the problem - http://logs.openstack.org/63/482063/5/check/gate-releases-tox-list-changes-ubuntu-xenial/aa9b94f/console.html.gz#_2017-07-10_19_30_08_083924 14:40:20 <gcb> 'Make sure Lock.heartbeat() returns True/False' or/and 'etcd3: replace custom lock code by more recent etcd3 lock code' 14:40:44 <jungleboyj> dims: That appears to be the problem. 14:41:10 <jungleboyj> On a related note, has anyone else seen devstack failing because etcd's checksum fails? 14:45:51 * jungleboyj hears crickets 14:48:16 <gcb> talking with jd_ at openstack-oslo, I copied the dialogue there, we can discuss the issue at openstack-oslo 14:48:34 <gcb> later 14:48:45 <jungleboyj> Ok. Sounds good. 14:49:06 <gcb> Let's move on if any other topic want to talk about :-) 14:49:30 <jungleboyj> Sure. 14:49:54 <gcb> please add topics in https://etherpad.openstack.org/p/oslo-ptg-queens 14:50:14 <gcb> then we can discuss them at the PTG 14:53:37 <gcb> okay, let end the meeting and continue discussion at openstack-oslo 14:53:44 <gcb> thanks everyone 14:53:57 <jungleboyj> Thanks! 14:54:07 <gcb> #endmeeting