14:00:06 #startmeeting oslo 14:00:07 Meeting started Mon Jul 17 14:00:06 2017 UTC and is due to finish in 60 minutes. The chair is gcb. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:00:08 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 14:00:10 The meeting name has been set to 'oslo' 14:00:15 courtesy ping for amotoki, amrith, bknudson, bnemec, crushil, dansmith, dhellmann 14:00:16 courtesy ping for dims, dougwig, e0ne, electrocucaracha, flaper87, garyk, gcb 14:00:16 courtesy ping for GheRivero, haypo, jd__, jecarey, johnsom, jungleboyj, kgiusti 14:00:16 courtesy ping for kragniz, lhx_, lifeless, lxsli, Nakato, ozamiatin, rbradfor 14:00:16 courtesy ping for redrobot, rpodolyaka, sergmelikyan, sileht, spamaps, sreshetnyak, sreshetnyak 14:00:17 courtesy ping for stevemar, therve, thinrichs, toabctl, viktors, zhiyan, zzzeek 14:01:02 \o 14:01:30 o/ 14:01:42 o/ 14:02:04 Hello everyone \o/ 14:02:22 #topic Red flags for/from liaisons 14:02:58 Any red flags ? we'll fix them before our final releases this week 14:03:58 Ah, for Cinder, just to make people aware, we were having tooz related issues late last week. 14:04:37 Appeared there was an update there and then we started seeing threads die in the gate. 14:04:45 jungleboyj, have it been fixed ? 14:04:58 any bug link ? 14:05:12 So, we updated global requirements to not use the latest code and have a bug open to the tooz guys. 14:05:34 Just wanted to share here in case anyone else was seeing similar issues. Seemed like a relevant forum. 14:06:29 a bug is appreciated, then we can figure out the root cause 14:06:32 jungleboyj, So, what test suite was failing in cinder because of this? 14:06:48 It was random. Let me see if I can find the bug. 14:09:03 You can go on. It will take me a bit to find it here. 14:09:17 jungleboyj, please file a bug or report the bug link, hope we can find the root cause before we release tooz 14:09:25 #topic Releases for Pike 14:09:31 Will do. 14:09:56 https://releases.openstack.org/pike/schedule.html#p-final-lib 14:10:21 we should issue their final release during this week. That allows to give time for last-minute changes before feature freeze. 14:11:45 I sent a email to let everyone focus on bug fix before this week. I plan to issue final releases on July 19, which gives us two days buffer to merge fix 14:12:20 so please focus on bug fix these two days 14:13:29 # topic PTL nomination for Queens 14:13:44 #topic PTL nomination for Queens 14:14:44 new cycle PTL selection will begin you can check the detailed schedule in https://review.openstack.org/#/c/481768/ 14:14:59 I won't run for PTL for Queens, I'm still in the team, 14:15:30 if someone will run for Oslo PTL, please talk to me, I would like to give some guidance as previous PTL did before 14:16:50 thanks for being the PTL this release 14:17:02 bknudson: ++ 14:17:07 Sorry to see you go. 14:17:58 jungleboyj, I will still in the team, just it's time to rotate, let others lead the team :-) 14:18:12 Sounds good. 14:18:15 thanks everyone, I still focus on oslo 14:20:01 so oslo core reviews if you want to run for the PTL, feel free to reach me, I will give you some suggestions about PTL's daily work :-) 14:20:14 #topic Open discussion 14:20:56 gcb: I found the bug I was talking about at the beginning of the meeting. 14:20:58 https://bugs.launchpad.net/cinder/+bug/1694509/ 14:20:59 Launchpad bug 1694509 in tooz "eventlet errors and cannot switch to a different thread" [High,Confirmed] 14:21:31 jungleboyj, So, is this cinder specific? 14:22:09 jungleboyj, thanks, will reach our tooz expert jd_ to help figure out 14:22:11 I think there was discussion that we just the ones seeing it because we do have some gate tests that use tooz for locking. 14:22:37 crushil: So, not specific to Cinder, but we are the only ones seeing it. 14:22:47 Ah, gotcha. I haven't seen it in Ironic yet 14:23:21 crushil: Yeah, we are the lucky ones. 14:23:30 lol 14:23:43 I saw jd_ added comments 6 hours ago 14:25:38 gcb: I saw that. 14:29:30 etcd3 with gRPC doesn't work with eventlet monkey patch 14:30:15 That's a know issue, I remember dims told me about that before 14:31:56 jungleboyj : mriedem was chasing it and filed this black list - https://review.openstack.org/#/c/484019/ on friday, waiting for him to confirm if that worked or not 14:34:15 dims: It appears to be working: http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22%2Fusr%2Flocal%2Flib%2Fpython2.7%2Fdist-packages%2Ftooz%2Fdrivers%2Fetcd3gw.py:113%20in%20acquire%5C%22%20AND%20tags:%5C%22screen-c-vol.txt%5C%22&from=7d 14:36:01 dims: thanks 14:38:17 jungleboyj : gcb : so it's one of the merges in 1.57.4 that's causing the problem - http://logs.openstack.org/63/482063/5/check/gate-releases-tox-list-changes-ubuntu-xenial/aa9b94f/console.html.gz#_2017-07-10_19_30_08_083924 14:40:20 'Make sure Lock.heartbeat() returns True/False' or/and 'etcd3: replace custom lock code by more recent etcd3 lock code' 14:40:44 dims: That appears to be the problem. 14:41:10 On a related note, has anyone else seen devstack failing because etcd's checksum fails? 14:45:51 * jungleboyj hears crickets 14:48:16 talking with jd_ at openstack-oslo, I copied the dialogue there, we can discuss the issue at openstack-oslo 14:48:34 later 14:48:45 Ok. Sounds good. 14:49:06 Let's move on if any other topic want to talk about :-) 14:49:30 Sure. 14:49:54 please add topics in https://etherpad.openstack.org/p/oslo-ptg-queens 14:50:14 then we can discuss them at the PTG 14:53:37 okay, let end the meeting and continue discussion at openstack-oslo 14:53:44 thanks everyone 14:53:57 Thanks! 14:54:07 #endmeeting