15:01:46 #startmeeting oslo 15:01:47 Meeting started Mon Apr 22 15:01:46 2019 UTC and is due to finish in 60 minutes. The chair is bnemec. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:01:48 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:01:50 The meeting name has been set to 'oslo' 15:02:09 courtesy ping for amotoki, amrith, ansmith, bnemec, dims, dougwig, e0ne 15:02:09 courtesy ping for electrocucaracha, garyk, gcb, haypo, hberaud, jd__, johnsom 15:02:09 courtesy ping for jungleboyj, kgiusti, kragniz, lhx_, moguimar, njohnston, raildo 15:02:09 courtesy ping for redrobot, sileht, sreshetnyak, stephenfin, stevemar, therve, thinrichs 15:02:09 courtesy ping for toabctl, zhiyan, zxy, zzzeek 15:02:11 To be added or removed from the ping list, please submit a patch to http://git.openstack.org/cgit/openstack/oslo.tools/tree/ping_me.py 15:02:12 Merged openstack/oslo.log master: Added cmdline information into fluentFormatter event message https://review.opendev.org/648393 15:02:21 #link https://wiki.openstack.org/wiki/Meetings/Oslo#Agenda_for_Next_Meeting 15:02:27 o/ 15:02:29 O/ 15:02:45 o/ 15:02:45 o/ 15:04:24 #topic Red flags for/from liaisons 15:04:51 Nothing from Cinder. 15:04:58 No red flags. 15:05:01 o/ 15:05:02 Nothing much on our side. I never did do releases last week so there shouldn't be much new going on. 15:05:31 I guess the one exception would be the issue Nova is investigating, but it's not clear what caused the breakage. 15:05:37 #link https://bugs.launchpad.net/nova/+bug/1825435 15:05:38 Launchpad bug 1825435 in OpenStack Compute (nova) "TestRPC unit tests intermittently fail with "'>' not supported between instances of 'NoneType' and 'datetime.datetime'" - maybe due to "Fatal Python error: Cannot recover from stack overflow."" [High,Confirmed] 15:06:07 It doesn't appear to be an Oslo problem, but investigation is ongoing. 15:06:28 If you're seeing stack overflows when looking up oslo.config values then you may be hitting that too. 15:07:04 #topic Releases 15:07:24 I will go do them right away after the meeting. 15:07:32 They didn't get done last week because reasons. :-) 15:07:58 +1 15:08:38 #topic Action items from last meeting 15:08:45 "stephenfin (or any other core) to review https://review.openstack.org/#/c/633053/" 15:08:51 Done. Thanks, Stephen. 15:09:00 And that was it. 15:09:34 #topic Project Update 15:09:55 I started working on the slides last week. If you have anything you want covered let me know ASAP. 15:10:28 You can find a list of topics that I've included already at https://etherpad.openstack.org/p/oslo-train-topics 15:11:13 That's also the place to add any PTG topics you want discussed. I'll be trying to come up with a tentative schedule this week. 15:11:35 I expect it will change once we start actually having discussions, but it will be a place to start. 15:13:26 #topic Weekly Wayward Review 15:13:29 #link https://review.opendev.org/#/c/638248/ 15:14:36 bnemec's home for wayward reviews! 15:15:22 Much like every parent with a 25 year old still living at home, my goal is for them to move out as soon as possible. ;-) 15:15:41 :D 15:15:46 Unfortunately I'm not sure we have any other cores in the meeting this week. :-/ 15:16:09 bnemec: I will take a look ^^ 15:16:35 Oh, hey ansmith_ :-) 15:16:53 I only looked for o/'s above the first topic. :-) 15:17:09 #action ansmith_ to review https://review.opendev.org/#/c/638248 15:17:33 Thanks 15:17:35 #topic Open discussion 15:17:47 Anything else? 15:17:55 In oslo.messaging, why can't we requeue when using the RPCServer? It appears to auto-ack always. 15:18:31 johnsom: yeah the re-queue api only applies to notifications 15:19:08 johnsom: I supposed nobody has asked for that for rpc (until now :) 15:19:16 That is what I saw as well. I was just wondering why we don't have the same option with the RPCs. 15:19:45 johnsom: pre-dates my knowledgebase... anyone else? 15:20:46 No idea. I suspect that pre-dates anyone who is still working on oslo.messaging. 15:21:16 We could take a look at the git blame for the code and see if there's anything in the commit message about it being applicable only to notifications. 15:21:25 Ok, if there isn't a reason it might be something I will be looking into. I think we can use that functionality on Octavia. Can't commit that I'm going to do it yet however. 15:22:12 Sounds good. 15:22:13 johnsom: let me know if you need any help 15:22:32 and speaking of messaging: http://lists.openstack.org/pipermail/openstack-discuss/2019-April/005305.html 15:22:33 It's entirely possible this is one of those things where someone scratched their itch and didn't care if it worked for notifications. 15:22:35 kgiusti Thanks 15:23:39 TL;DR some folks are experiencing weird connection failures to rabbitmq 15:23:42 Oh, eventlet. 15:23:59 bingo! 15:24:05 Right? That was the thread where eventlet wasn't playing nicesly with WSGI. 15:24:08 *nicely 15:24:42 I wonder if we should add that to the eventlet best practices doc. 15:24:49 "Don't mix eventlet and WSGI" 15:25:01 It's basically combining multiple concurrency mechanisms. 15:25:08 yep - michele is investigating reports in mistral and perhaps ironic... 15:25:21 Which I realize doesn't solve the immediate problem(s). 15:25:45 I'm surprised no one ran into this before. I think Nova was doing this back in Rocky too. 15:26:22 I'll keep an eye on it. 15:26:54 Cool. If there's anything I can do to help let me know. 15:27:00 johnsom, kgiusti: regarding re-queue, i believe difference is that with rpc, message is ack'ed prior to dispatch where with notify, message ack follows dispatch 15:27:21 It sounded like Michele was investigating so I decided to leave it in his capable hands. :-) 15:27:40 Indeed 15:28:19 So I guess that's another red flag. 15:28:24 ansmith_: good point - ack on rcv.... never liked that 15:28:24 * bnemec blames the long weekend 15:28:36 ansmith_ Not sure I follow (not that familiar with the oslo messaging code yet). 15:28:49 This is the offending code I think: https://github.com/openstack/oslo.messaging/blob/master/oslo_messaging/rpc/server.py#L159 15:28:56 #link https://github.com/openstack/oslo.messaging/blob/master/oslo_messaging/rpc/server.py#L159 15:29:18 johnsom: that's it. 15:30:02 Interesting that the TODO says we should remove that... 15:30:18 It seems like the endpoint should be able to return requeue like in notifications. 15:30:59 johnsom: the return value from the rpc handler is application data which is sent back in the reply 15:31:51 Okay, let's continue this discussion, but I'm going to end the meeting if no one else has anything that needs attention. 15:31:53 johnsom: the client rpc api is essentially a function call. We'd need to add a new behavior - perhaps have the handler throw a new type of exception 15:31:55 We aren't sending data back, but yes, that could complicate things 15:32:08 Oh, and there will be no meeting next week due to Summit/PTG. 15:32:22 #action bnemec to send email about meeting cancellation. 15:32:50 I may cancel the meeting after too since it will be the first day back. 15:34:33 Okay, I think that's it. 15:34:52 Thanks for joining everyone! See some of you next week. 15:34:56 #endmeeting