*** sboyron has quit IRC | 00:07 | |
*** rcernin has quit IRC | 01:37 | |
*** rcernin has joined #openstack-oslo | 01:39 | |
*** rcernin has quit IRC | 02:36 | |
*** iurygregory|pto has quit IRC | 03:01 | |
*** rcernin has joined #openstack-oslo | 03:06 | |
openstackgerrit | likui proposed openstack/oslo.limit master: add py38 matedata https://review.opendev.org/c/openstack/oslo.limit/+/765044 | 05:19 |
---|---|---|
*** rcernin has quit IRC | 05:43 | |
*** rcernin has joined #openstack-oslo | 05:55 | |
*** hamalq has quit IRC | 06:17 | |
*** hamalq has joined #openstack-oslo | 06:18 | |
openstackgerrit | likui proposed openstack/oslo.context master: Replace deprecated UPPER_CONSTRAINTS_FILE variable https://review.opendev.org/c/openstack/oslo.context/+/765062 | 06:35 |
*** sboyron has joined #openstack-oslo | 06:42 | |
*** brinzhang0 has joined #openstack-oslo | 06:46 | |
*** brinzhang_ has quit IRC | 06:49 | |
*** sboyron has quit IRC | 06:55 | |
*** zzzeek has quit IRC | 07:13 | |
*** zzzeek has joined #openstack-oslo | 07:14 | |
*** brinzhang_ has joined #openstack-oslo | 07:32 | |
*** brinzhang0 has quit IRC | 07:35 | |
*** rcernin has quit IRC | 07:38 | |
*** rcernin has joined #openstack-oslo | 07:44 | |
*** rcernin has quit IRC | 07:48 | |
*** rcernin has joined #openstack-oslo | 08:01 | |
*** sboyron has joined #openstack-oslo | 08:05 | |
*** rcernin has quit IRC | 08:16 | |
*** rpittau|afk is now known as rpittau | 08:28 | |
*** rcernin has joined #openstack-oslo | 08:32 | |
*** rcernin has quit IRC | 08:46 | |
*** tkajinam has quit IRC | 08:49 | |
*** tosky has joined #openstack-oslo | 09:05 | |
*** rcernin has joined #openstack-oslo | 09:42 | |
*** rcernin has quit IRC | 09:42 | |
*** dtantsur|afk is now known as dtantsur | 11:19 | |
*** raildo has joined #openstack-oslo | 11:50 | |
*** brinzhang_ has quit IRC | 11:52 | |
*** brinzhang_ has joined #openstack-oslo | 11:52 | |
*** iurygregory has joined #openstack-oslo | 12:03 | |
*** geguileo has joined #openstack-oslo | 12:11 | |
*** dtantsur is now known as dtantsur|brb | 12:31 | |
*** hamalq has quit IRC | 13:01 | |
*** Luzi has joined #openstack-oslo | 13:03 | |
*** hamalq has joined #openstack-oslo | 13:05 | |
hberaud | damani: FYI https://review.opendev.org/c/openstack/releases/+/765133 | 13:34 |
damani | hberaud, i will check | 13:34 |
hberaud | thanks | 13:34 |
hberaud | bnemec, moguimar, stephenfin: Please can you take a look => https://review.opendev.org/c/openstack/oslo.messaging/+/764776 | 13:42 |
*** dtantsur|brb is now known as dtantsur | 13:46 | |
stephenfin | sure | 13:48 |
hberaud | thx | 13:48 |
*** lbragstad has quit IRC | 13:50 | |
*** Luzi has quit IRC | 13:51 | |
*** lbragstad has joined #openstack-oslo | 13:55 | |
*** raildo has quit IRC | 14:19 | |
*** raildo has joined #openstack-oslo | 14:27 | |
*** redrobot has quit IRC | 16:11 | |
*** brinzhang0 has joined #openstack-oslo | 16:14 | |
*** brinzhang_ has quit IRC | 16:16 | |
*** Guest18921 has joined #openstack-oslo | 16:58 | |
*** Guest18921 is now known as redrobot | 17:01 | |
mnaser | hi oslo team | 17:04 |
*** rpittau is now known as rpittau|afk | 17:04 | |
mnaser | has anyone ever ran into an issue with oslo.messaging having _a lot_ of stale threads? | 17:05 |
mnaser | running magnum-api as 'magnum-api' where it forks out into 1 process per request seems to have no issues | 17:05 |
mnaser | but running it inside uwsgi leads to a lot of threads slowly leaking | 17:05 |
mnaser | and eventually hitting an error where you cant start any more threads | 17:05 |
mnaser | what sucks is i cant troubleshoot this inside GMR | 17:06 |
mnaser | because cant run that uwsgi | 17:06 |
mnaser | and the issue doesn't exist inside magnum-api directly (though i do see some zombie processes at times) | 17:06 |
hberaud | mnaser: o/ it looks like to something that we already have experienced downstream | 17:16 |
hberaud | lemme grab some links | 17:16 |
hberaud | mnaser: I think this one is more or less relevant for your needs => https://bugzilla.redhat.com/show_bug.cgi?id=1711794 | 17:22 |
openstack | bugzilla.redhat.com bug 1711794 in openstack-tripleo-heat-templates "[OSP15][deployment] AMQP heartbeat thread missing heartbeats when running under nova_api" [High,Closed: notabug] - Assigned to mschuppe | 17:22 |
hberaud | Also notice that this combo can introduce issues within a monkey patched environment => httpd + the MPM prefork engine + uwsgi | 17:26 |
hberaud | #eventlet | 17:26 |
hberaud | mnaser: and for another more or less related example also you can take a look to => https://github.com/openstack/oslo.messaging/commit/22f240b82fffbd62be8568a7d0d3369134596ace | 17:28 |
hberaud | hopefully that would help you | 17:28 |
mnaser | hberaud: in our case actually magnum is pretty busy, it never goes 'idle' :( | 17:32 |
mnaser | because http health checks are constantly pinging it | 17:32 |
mnaser | 3 haproxy's that check it non stop so there's almost always non-stop requests | 17:33 |
mnaser | im now wondering if this is somewhat related -- https://github.com/openstack/magnum/blob/master/magnum/common/context.py#L130-L150 | 17:33 |
mnaser | i see this https://github.com/openstack/magnum/blob/f0dec728e78bcb3851b1a484b73bfe567b3c1fc9/magnum/common/rpc_service.py#L54-L57 so i also wonder if that is related | 17:34 |
hberaud | mnaser: notice that also we currently have an issue with our rpc server replies => https://review.opendev.org/c/openstack/oslo.messaging/+/764776 | 17:35 |
mnaser | https://github.com/openstack/magnum/blob/master/magnum/service/periodic.py#L205-L210 maybe its unrelated to oslo.messaging and magnum doing stuff | 17:39 |
*** camelCaser has joined #openstack-oslo | 17:48 | |
*** dtantsur is now known as dtantsur|afk | 18:47 | |
*** iurygregory has quit IRC | 19:29 | |
*** brinzhang_ has joined #openstack-oslo | 20:58 | |
*** brinzhang0 has quit IRC | 21:01 | |
*** iurygregory has joined #openstack-oslo | 21:28 | |
*** raildo has quit IRC | 21:40 | |
*** sboyron has quit IRC | 21:43 | |
*** rcernin has joined #openstack-oslo | 22:34 | |
*** tkajinam has joined #openstack-oslo | 23:00 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!