*** dims__ has joined #openstack-oslo | 00:04 | |
*** dims_ has joined #openstack-oslo | 00:05 | |
*** dims__ has quit IRC | 00:09 | |
*** bknudson has joined #openstack-oslo | 00:12 | |
*** sputnik13 has quit IRC | 00:13 | |
*** sdake has joined #openstack-oslo | 00:20 | |
*** sdake_ has quit IRC | 00:24 | |
*** thingee has joined #openstack-oslo | 00:44 | |
openstackgerrit | Joshua Harlow proposed openstack/taskflow: Add working eventlet py3.3 and py3.4 version (WIP) https://review.openstack.org/174665 | 00:44 |
---|---|---|
*** achanda has quit IRC | 00:51 | |
*** achanda has joined #openstack-oslo | 00:59 | |
openstackgerrit | Sachi King proposed openstack/oslo-specs: graduate-oslo-service https://review.openstack.org/142659 | 01:05 |
*** jecarey has joined #openstack-oslo | 01:25 | |
openstackgerrit | Tiantian Gao proposed openstack/oslo.messaging: Rabbit: Fix message ttl not work https://review.openstack.org/174240 | 01:36 |
openstackgerrit | Merged openstack-dev/pbr: Ignore non-release related tags https://review.openstack.org/142144 | 01:43 |
*** harlowja is now known as harlowja_away | 01:47 | |
*** dims_ has quit IRC | 01:54 | |
*** achanda has quit IRC | 02:20 | |
*** achanda has joined #openstack-oslo | 02:22 | |
*** liusheng has joined #openstack-oslo | 02:46 | |
*** jecarey has quit IRC | 02:47 | |
*** achanda has quit IRC | 02:49 | |
*** sputnik13 has joined #openstack-oslo | 02:53 | |
*** yamahata has quit IRC | 02:56 | |
openstackgerrit | Merged openstack/cliff: Uncap library requirements for liberty https://review.openstack.org/174488 | 03:05 |
*** liusheng has quit IRC | 03:07 | |
*** liusheng has joined #openstack-oslo | 03:07 | |
*** crc32 has joined #openstack-oslo | 03:20 | |
*** achanda has joined #openstack-oslo | 03:20 | |
*** sdake_ has joined #openstack-oslo | 03:34 | |
*** sdake has quit IRC | 03:38 | |
*** achanda has quit IRC | 03:52 | |
*** sputnik13 has quit IRC | 03:53 | |
*** jungleboyj has joined #openstack-oslo | 04:04 | |
*** achanda has joined #openstack-oslo | 04:07 | |
*** achanda has quit IRC | 04:11 | |
*** arnaud___ has joined #openstack-oslo | 04:15 | |
*** thingee has quit IRC | 04:15 | |
*** achanda has joined #openstack-oslo | 04:16 | |
*** achanda has quit IRC | 04:18 | |
*** achanda has joined #openstack-oslo | 04:21 | |
*** achanda has quit IRC | 04:29 | |
*** BrianShang_ has quit IRC | 04:38 | |
*** crc32 has quit IRC | 04:38 | |
*** crc32 has joined #openstack-oslo | 04:38 | |
*** BrianShang has joined #openstack-oslo | 04:39 | |
*** achanda has joined #openstack-oslo | 04:42 | |
*** crc32 has quit IRC | 04:45 | |
*** sputnik13 has joined #openstack-oslo | 05:09 | |
*** sputnik13 has quit IRC | 05:11 | |
*** crc32 has joined #openstack-oslo | 05:15 | |
*** arnaud___ has quit IRC | 05:20 | |
*** openstackgerrit has quit IRC | 05:21 | |
*** openstackgerrit has joined #openstack-oslo | 05:21 | |
*** stevemar has joined #openstack-oslo | 05:21 | |
*** harlowja_at_home has joined #openstack-oslo | 05:31 | |
*** stevemar has quit IRC | 05:32 | |
*** stevemar has joined #openstack-oslo | 05:33 | |
*** rushiagr_away is now known as rushiagr | 05:38 | |
*** inc0 has joined #openstack-oslo | 05:42 | |
*** stevemar has quit IRC | 06:12 | |
*** harlowja_at_home has quit IRC | 06:18 | |
*** sreshetnyak has joined #openstack-oslo | 06:30 | |
*** bnemec has quit IRC | 06:32 | |
openstackgerrit | Merged openstack/taskflow: Have reset state handlers go through a shared list https://review.openstack.org/167389 | 06:33 |
*** yamahata has joined #openstack-oslo | 06:38 | |
*** Kennan2 has quit IRC | 06:41 | |
*** Kennan has joined #openstack-oslo | 06:42 | |
*** dulek has joined #openstack-oslo | 06:48 | |
*** achanda has quit IRC | 06:53 | |
*** achanda has joined #openstack-oslo | 06:56 | |
*** sdake has joined #openstack-oslo | 07:06 | |
*** e0ne has joined #openstack-oslo | 07:08 | |
*** jaosorior has joined #openstack-oslo | 07:09 | |
*** sdake_ has quit IRC | 07:09 | |
*** amotoki has quit IRC | 07:18 | |
*** haypo has joined #openstack-oslo | 07:18 | |
*** svasheka has quit IRC | 07:21 | |
*** e0ne has quit IRC | 07:23 | |
*** e0ne has joined #openstack-oslo | 07:28 | |
*** viktors has quit IRC | 07:28 | |
*** achanda has quit IRC | 07:29 | |
*** alexpilotti has joined #openstack-oslo | 07:30 | |
*** andreykurilin__ has joined #openstack-oslo | 07:32 | |
*** achanda_ has joined #openstack-oslo | 07:32 | |
*** dims__ has joined #openstack-oslo | 07:33 | |
haypo | hello | 07:34 |
*** yamahata has quit IRC | 07:34 | |
*** dims__ has quit IRC | 07:38 | |
*** achanda_ has quit IRC | 07:40 | |
haypo | is it possible to add gates to projects on stackforge? | 07:42 |
haypo | i'm working on sqlachemy-migrate and i don't see any gate at | 07:42 |
haypo | <mriedem> so i guess i'm not sure where instance_extra is used later for formatting | 07:42 |
haypo | oops | 07:43 |
haypo | at https://review.openstack.org/#/c/174735/ | 07:43 |
haypo | (copy/paste failure) | 07:43 |
*** ndipanov has quit IRC | 07:44 | |
haypo | hum, i don't understand the complain about sqlachemy-migrate: "tox -e py34" pass | 07:47 |
*** BrianShang has quit IRC | 07:51 | |
*** andreykurilin___ has joined #openstack-oslo | 07:53 | |
*** andreykurilin__ has quit IRC | 07:53 | |
*** BrianShang has joined #openstack-oslo | 07:53 | |
*** e0ne has quit IRC | 07:57 | |
*** e0ne has joined #openstack-oslo | 08:01 | |
*** rushiagr is now known as rushiagr_away | 08:04 | |
*** achanda has joined #openstack-oslo | 08:06 | |
*** e0ne has quit IRC | 08:09 | |
*** e0ne has joined #openstack-oslo | 08:14 | |
*** e0ne has quit IRC | 08:18 | |
*** achanda has quit IRC | 08:20 | |
*** achanda_ has joined #openstack-oslo | 08:22 | |
*** e0ne has joined #openstack-oslo | 08:22 | |
*** crc32 has quit IRC | 08:23 | |
*** sdake has quit IRC | 08:28 | |
*** achanda_ has quit IRC | 08:35 | |
*** ndipanov has joined #openstack-oslo | 08:40 | |
*** e0ne has quit IRC | 08:42 | |
*** andreykurilin___ has quit IRC | 08:43 | |
*** e0ne has joined #openstack-oslo | 08:46 | |
*** pcaruana has joined #openstack-oslo | 08:50 | |
*** e0ne has quit IRC | 08:51 | |
*** e0ne has joined #openstack-oslo | 08:53 | |
*** e0ne has quit IRC | 09:00 | |
*** arnaud___ has joined #openstack-oslo | 09:03 | |
*** e0ne has joined #openstack-oslo | 09:04 | |
haypo | "is it possible to add gates to projects on stackforge?" nevermind, there are already gates :) | 09:06 |
*** e0ne has quit IRC | 09:09 | |
*** rushiagr_away is now known as rushiagr | 09:10 | |
*** ihrachyshka has joined #openstack-oslo | 09:16 | |
*** sreshetnyak has quit IRC | 09:21 | |
*** arnaud___ has quit IRC | 09:33 | |
*** jamielennox is now known as jamielennox|away | 09:49 | |
*** e0ne has joined #openstack-oslo | 09:50 | |
*** inc0_ has joined #openstack-oslo | 09:57 | |
*** inc0 has quit IRC | 09:59 | |
*** cdent has joined #openstack-oslo | 10:01 | |
*** bogdando has quit IRC | 10:07 | |
*** ozamiatin has quit IRC | 10:08 | |
*** sreshetnyak has joined #openstack-oslo | 10:08 | |
*** enikanorov_ has quit IRC | 10:09 | |
*** sputnik13 has joined #openstack-oslo | 10:12 | |
*** cdent has quit IRC | 10:12 | |
*** cdent has joined #openstack-oslo | 10:13 | |
*** enikanorov_ has joined #openstack-oslo | 10:15 | |
*** ozamiatin_ has joined #openstack-oslo | 10:15 | |
*** sputnik13 has quit IRC | 10:15 | |
*** bogdando has joined #openstack-oslo | 10:30 | |
*** inc0_ has quit IRC | 10:31 | |
*** inc0_ has joined #openstack-oslo | 10:31 | |
*** e0ne is now known as e0ne_ | 10:38 | |
*** e0ne_ is now known as e0ne | 10:42 | |
*** ozamiatin_ has quit IRC | 10:43 | |
openstackgerrit | Merged openstack/oslotest: Uncap library requirements for liberty https://review.openstack.org/174520 | 10:57 |
*** dulek_ has joined #openstack-oslo | 10:59 | |
*** inc0_ has quit IRC | 11:01 | |
*** inc0 has joined #openstack-oslo | 11:01 | |
*** dulek has quit IRC | 11:02 | |
*** dims__ has joined #openstack-oslo | 11:02 | |
*** inc0 has quit IRC | 11:04 | |
*** inc0 has joined #openstack-oslo | 11:04 | |
*** sreshetnyak has quit IRC | 11:09 | |
*** inc0 has quit IRC | 11:11 | |
*** inc0 has joined #openstack-oslo | 11:12 | |
*** inc0 has quit IRC | 11:19 | |
*** inc0_ has joined #openstack-oslo | 11:19 | |
*** arnaud___ has joined #openstack-oslo | 11:22 | |
*** inc0_ has quit IRC | 11:28 | |
*** arnaud___ has quit IRC | 11:29 | |
*** inc0 has joined #openstack-oslo | 11:33 | |
*** prad has quit IRC | 11:36 | |
*** dulek_ has quit IRC | 11:46 | |
*** dulek has joined #openstack-oslo | 11:49 | |
*** inc0 has quit IRC | 11:51 | |
*** prad has joined #openstack-oslo | 11:51 | |
*** inc0 has joined #openstack-oslo | 11:51 | |
*** prad has quit IRC | 11:54 | |
*** cdent has quit IRC | 11:55 | |
sdague | hmmm... with a fresh devstack, oslo.messaging 1.8.1 I'm getting this heartbeat error over and over and over again | 11:55 |
*** e0ne is now known as e0ne_ | 11:58 | |
sdague | 2015-04-17 07:58:50.030 ERROR oslo_messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds. | 11:58 |
*** inc0 has quit IRC | 12:00 | |
*** cdent has joined #openstack-oslo | 12:01 | |
sdague | sileht: you about? because something has happened, and now 0 services work because they go into heartbeat loops and fail | 12:03 |
*** ozamiatin_ has joined #openstack-oslo | 12:06 | |
sileht | sdague, you are the second person to report that | 12:06 |
sdague | sileht: is there already a bug? | 12:06 |
sileht | a bug report have been opened | 12:06 |
sdague | sileht: ok, yeh this seems to be happening 100% of the time on my new devstack | 12:07 |
sileht | sdague, https://bugs.launchpad.net/oslo.messaging/+bug/1436769 | 12:07 |
openstack | Launchpad bug 1436769 in oslo.messaging "ConnectionError: Too many heartbeats missed" [Undecided,Confirmed] | 12:07 |
sdague | so in my case, this is basically happening every second on every API service | 12:07 |
sdague | and effectively 0 messages are getting across the rpc bus | 12:08 |
sdague | possibly because this is storming it | 12:08 |
*** e0ne_ has quit IRC | 12:08 | |
sileht | sdague, ubuntu or fedora ? | 12:09 |
sdague | ubuntu | 12:09 |
sdague | 14.04 | 12:09 |
*** e0ne has joined #openstack-oslo | 12:10 | |
* sileht tries to find a difference with its devstack | 12:10 | |
sileht | sdague, this occurs just after the stack have been started or you have started to boot or something | 12:11 |
sdague | sileht: I was trying to figure out why the stack was taking so long | 12:11 |
sdague | lots of commands were hanging | 12:11 |
sdague | and it turns out this was why, all the api services were in permaloops trying to heartbeat/fail with rabbit | 12:12 |
sdague | rabbit looks up, and was burned down to the ground before I started | 12:12 |
*** bknudson has quit IRC | 12:15 | |
sdague | I'm trying to force downgrade to 1.8.0 and see if that helps | 12:15 |
sileht | sdague, that should help the latest heartbeat patch that enable it come in 1.8.1 | 12:18 |
sileht | sdague, or you can disable it by using a timeout of 0 | 12:18 |
*** kgiusti has joined #openstack-oslo | 12:19 | |
*** dulek has quit IRC | 12:19 | |
sdague | ok, so... https://bugs.launchpad.net/oslo.messaging/+bug/1436769 isn't actually my bug, but I see what's happening there. There was another use of the n-cert service that was not anticipated during devstack start. | 12:19 |
openstack | Launchpad bug 1436769 in oslo.messaging "ConnectionError: Too many heartbeats missed" [Undecided,Confirmed] | 12:19 |
*** dulek has joined #openstack-oslo | 12:22 | |
sdague | so, I don't have a narrow reproduce case for the heartbeat loop | 12:24 |
sdague | but it looks like if it gets into a loop, you're done | 12:24 |
sdague | it just starts storming | 12:25 |
sdague | and not reconnecting correctly | 12:25 |
*** sreshetnyak has joined #openstack-oslo | 12:25 | |
*** arnaud___ has joined #openstack-oslo | 12:26 | |
sdague | oh, never mind https://bugs.launchpad.net/oslo.messaging/+bug/143676 is my bug, there is a different one on the mailing list that I'm fixing now though | 12:26 |
openstack | Launchpad bug 143676 in Zope 2 "RestrictedPython sensitive to line endings in Python 2.4" [Medium,Fix released] - Assigned to ChrisW (chris-simplistix) | 12:26 |
sdague | https://bugs.launchpad.net/oslo.messaging/+bug/1436769 | 12:26 |
openstack | Launchpad bug 1436769 in oslo.messaging "ConnectionError: Too many heartbeats missed" [Undecided,Confirmed] | 12:26 |
sdague | stupid truncation of paste :) | 12:26 |
sdague | it looks like quite a few people are hitting this in various ways | 12:27 |
sdague | maybe heartbeats should be off by default until the reason why is figured out? | 12:28 |
openstackgerrit | Merged openstack/oslo.log: Uncap library requirements for liberty https://review.openstack.org/174510 | 12:28 |
openstackgerrit | Merged openstack/oslo.context: Uncap library requirements for liberty https://review.openstack.org/174502 | 12:30 |
*** arnaud___ has quit IRC | 12:30 | |
sileht | sdague, Perhaps we should do that, the most annoying bug I have discovered is: https://bugs.launchpad.net/oslo.messaging/+bug/1436788 | 12:30 |
openstack | Launchpad bug 1436788 in oslo.messaging "rabbitmq heartbeat failures don't reset connections" [Undecided,Triaged] | 12:31 |
openstackgerrit | Merged openstack/oslo.policy: Uncap library requirements for liberty https://review.openstack.org/174515 | 12:31 |
sileht | sdague, this is a socket timeout that kombu doesn't allow us to set | 12:31 |
sdague | right, there was something at the ops summit about the fact that pika is the prefered library from the rabbit folks | 12:31 |
sileht | sdague, yeah pika allow to set all timeouts | 12:32 |
sileht | sdague, I have not yet taken the times to discus with kombu folks, I have just opened the bug for now | 12:32 |
openstackgerrit | Merged openstack/oslo.messaging: Uncap library requirements for liberty https://review.openstack.org/174512 | 12:33 |
openstackgerrit | Merged openstack/oslo.i18n: Uncap library requirements for liberty https://review.openstack.org/174509 | 12:33 |
sdague | yeh, 1.8.1 is reproducing this for me 100% of the time now | 12:34 |
*** cdent has quit IRC | 12:34 | |
openstackgerrit | Merged openstack/oslo.utils: Uncap library requirements for liberty https://review.openstack.org/174521 | 12:34 |
sdague | I've got a system looping like this atm, anything useful I can dump out of it for you? | 12:34 |
sdague | to help narrow the bug | 12:34 |
openstackgerrit | Merged openstack/oslo.db: Uncap library requirements for liberty https://review.openstack.org/174504 | 12:35 |
*** cdent has joined #openstack-oslo | 12:35 | |
openstackgerrit | Merged openstack/oslo.versionedobjects: Uncap library requirements for liberty https://review.openstack.org/174522 | 12:35 |
*** bknudson has joined #openstack-oslo | 12:36 | |
sileht | sdague, you run devstack in kvm/virtual/.... ? | 12:36 |
sdague | this is on real hardware | 12:36 |
sileht | sdague, ok | 12:36 |
openstackgerrit | Merged openstack/oslo.middleware: Uncap library requirements for liberty https://review.openstack.org/174513 | 12:36 |
sileht | sdague, perhaps a pip freeze output to ensure I have the same deps to start | 12:36 |
sileht | I just recreated a devstack and everything works :( | 12:37 |
sdague | yeh, I think it's not a 100% fail, but I think if you find yourself in this loop for timing reasons, then you are done | 12:37 |
sdague | and never can recover | 12:38 |
*** jaypipes has joined #openstack-oslo | 12:38 | |
sdague | sileht: http://paste.openstack.org/show/204454/ is my pip freeze | 12:39 |
sileht | sdague, thanks | 12:40 |
openstackgerrit | Merged openstack/debtcollector: Uncap library requirements for liberty https://review.openstack.org/174491 | 12:41 |
*** cdent has quit IRC | 12:41 | |
sdague | getting another cup of coffee, back in 5. Let me know if there is anything else that would be useful to dump here to get to the bottom of this, happy to spend the next hour extracting things from this environment before I force back to 1.8.0 to verify a nova fix | 12:41 |
*** cdent has joined #openstack-oslo | 12:41 | |
openstackgerrit | Merged openstack/oslo.config: Uncap library requirements for liberty https://review.openstack.org/174494 | 12:43 |
sileht | sdague, I have found the issue: https://github.com/celery/py-amqp/issues/6 | 12:43 |
sileht | sdague, I have amqp 1.4 and you 1.3 | 12:43 |
*** gordc has joined #openstack-oslo | 12:44 | |
*** stpierre has joined #openstack-oslo | 12:44 | |
sileht | sdague, so disable heartbeat ? or raise requirement ? | 12:45 |
sdague | sileht: let me see if forcing that up fixes it here | 12:47 |
sdague | ok, nova-conductor remains in the loop after I kill and start, so I should be able to try an inline upgrade and see if it recovers | 12:48 |
sdague | forcing in 1.4.0 seems to have made it recover | 12:50 |
sdague | I'd do another ./clean.sh && ./stack.sh | 12:50 |
sdague | but it seems like lifting up that requirement is probably in order then | 12:51 |
sdague | as that seems needed for the heartbeat code to be reliable | 12:51 |
sdague | I don't know, what's your opinion of the risk of finding other issues here? | 12:52 |
*** sreshetnyak has quit IRC | 12:52 | |
sileht | sdague, heartbeat or not, the really complains that if something bad occurs on the communication between oslo.msg and rabbit, we never want to wait the the system tcp timeout to discover it | 12:55 |
sileht | sdague, many people think that implementing heartbeat was fixing the issue | 12:56 |
sileht | sdague, but that not true, to really fix that we have to be able the set timeout on socket | 12:56 |
sileht | sdague, and THEN use heartbeat to use very long timeout | 12:56 |
sdague | ok, that's fair | 12:57 |
sdague | so what's your opinion on the safest option for the kilo release to keep regressions to a minimum? | 12:57 |
sileht | sdague, but kombu doesn't allow us to do that on the socket used for write | 12:57 |
sdague | should we bump the requirement? | 12:57 |
sdague | or turn off hearbeats by default? | 12:57 |
sileht | perhaps turn off hearbeats because the read timeout is still forced to a maximun of 1sec to ensure we detect connection lost on read | 12:58 |
sdague | sileht: ok, so that would be a 1.8.2 with the default behavior changed? | 12:59 |
sileht | on write, heartbeat or not, we can still have issue, if the packet that fail to transfert is the heartbeat one | 12:59 |
*** inc0 has joined #openstack-oslo | 12:59 | |
sileht | sdague, but on the other side ops really really want this feature | 13:00 |
sileht | sdague, even it's not yet perfect yet | 13:00 |
sdague | well, they can turn it back on | 13:00 |
sileht | true | 13:00 |
sdague | call it experimental because there are known issues, which is why it defaults off | 13:00 |
sdague | but explain how it can be enabled if people want to try it | 13:00 |
sileht | sdague, that soon reasonable | 13:01 |
sileht | sdague, I will proposed a patch and see other core dev opinion | 13:01 |
sileht | s/soon/sound | 13:01 |
sdague | sileht: ok, great, thank you | 13:02 |
sileht | sdague, thanks for your help and testing | 13:03 |
sdague | no problem, happy to help | 13:04 |
*** sreshetnyak has joined #openstack-oslo | 13:08 | |
*** cdent has quit IRC | 13:23 | |
*** rushiagr is now known as rushiagr_away | 13:23 | |
*** jungleboyj has quit IRC | 13:25 | |
*** ozamiatin_ has quit IRC | 13:25 | |
*** mriedem has joined #openstack-oslo | 13:26 | |
*** jecarey has joined #openstack-oslo | 13:32 | |
*** dulek has quit IRC | 13:33 | |
sdague | sileht: ok, just to final confirm, after upgrading to amqp 1.4.0 ... ./clean.sh && ./stack.sh, and I'm not seeing the heartbeating errors in my environment any more. So it might be worth honestly doing *both* things, both turning off the heartbeating by default, and raising the requirement, so that if you turn it on it's more likely to work | 13:34 |
*** prad has joined #openstack-oslo | 13:35 | |
sileht | sdague, of course the requirement need to be raised at least on master | 13:35 |
*** dansmith is now known as superdan | 13:35 | |
sileht | ls | 13:35 |
sileht | oups | 13:35 |
sdague | I'd raise it on stable/kilo as well so that 1.8.2 could have it raised | 13:36 |
*** pblaho_ has quit IRC | 13:37 | |
sileht | sdague, I'm thinking of something else, amqp is not a oslo.messaging requirement but a kombu one | 13:38 |
sileht | sdague, that ok to add requirement just to fix bug ? | 13:38 |
sdague | sileht: yeh, I think so | 13:39 |
sdague | we should try to rope ttx into this conversation | 13:39 |
sdague | because this impacts the whole release, and I'd like his opinions | 13:40 |
*** pblaho has joined #openstack-oslo | 13:41 | |
*** dulek has joined #openstack-oslo | 13:42 | |
*** sigmavirus24_awa is now known as sigmavirus24 | 13:45 | |
*** inc0 has quit IRC | 13:47 | |
*** pblaho has quit IRC | 13:49 | |
*** pblaho has joined #openstack-oslo | 13:51 | |
*** jaypipes is now known as leakypipes | 13:59 | |
openstackgerrit | Ihar Hrachyshka proposed openstack/oslo.config: Enforce alphabetic loading order for --config-dir contents https://review.openstack.org/174883 | 14:02 |
*** bnemec has joined #openstack-oslo | 14:03 | |
*** mriedem has quit IRC | 14:03 | |
*** mriedem has joined #openstack-oslo | 14:06 | |
*** rushiagr_away is now known as rushiagr | 14:08 | |
*** cdent has joined #openstack-oslo | 14:09 | |
*** e0ne is now known as e0ne_ | 14:11 | |
*** sdake has joined #openstack-oslo | 14:12 | |
*** e0ne_ is now known as e0ne | 14:13 | |
dims__ | sileht: ping me please when you file the oslo.messaging and requirements reviews? | 14:15 |
*** arnaud___ has joined #openstack-oslo | 14:15 | |
dims__ | sileht: let me know if you want me to do those | 14:17 |
*** inc0 has joined #openstack-oslo | 14:19 | |
*** arnaud___ has quit IRC | 14:20 | |
*** ozamiatin has joined #openstack-oslo | 14:24 | |
*** sreshetnyak has quit IRC | 14:24 | |
*** alexpilotti has quit IRC | 14:27 | |
*** sreshetnyak has joined #openstack-oslo | 14:29 | |
*** dims__ has quit IRC | 14:33 | |
*** sreshetnyak has quit IRC | 14:33 | |
*** zz_jgrimm is now known as jgrimm | 14:34 | |
*** stevemar has joined #openstack-oslo | 14:37 | |
*** sreshetnyak has joined #openstack-oslo | 14:38 | |
*** mtanino has joined #openstack-oslo | 14:41 | |
*** sdake_ has joined #openstack-oslo | 14:47 | |
*** sdake has quit IRC | 14:50 | |
*** sreshetnyak has quit IRC | 14:51 | |
openstackgerrit | Merged openstack/oslo.concurrency: Uncap library requirements for liberty https://review.openstack.org/174486 | 14:51 |
openstackgerrit | Merged openstack/oslo.rootwrap: Uncap library requirements for liberty https://review.openstack.org/174516 | 14:52 |
*** sreshetnyak has joined #openstack-oslo | 14:55 | |
*** prad has quit IRC | 14:57 | |
*** prad has joined #openstack-oslo | 15:01 | |
*** yamahata has joined #openstack-oslo | 15:01 | |
*** dims__ has joined #openstack-oslo | 15:04 | |
*** zzzeek has joined #openstack-oslo | 15:08 | |
*** inc0 has quit IRC | 15:19 | |
*** harlowja_at_home has joined #openstack-oslo | 15:19 | |
*** dims__ has quit IRC | 15:22 | |
harlowja_at_home | haypo, yt | 15:22 |
harlowja_at_home | have u seen any kind of weird issue in 3.4 where not even using eventlet, but importing it, causes thread locks to not work? | 15:23 |
harlowja_at_home | one of the taskflow examples with 3.4 + eventlet (although not even using eventlet) triggers it | 15:24 |
harlowja_at_home | http://logs.openstack.org/65/174665/1/check/gate-taskflow-python34/70bf225/console.html mainly | 15:24 |
*** ozamiatin has quit IRC | 15:26 | |
harlowja_at_home | *its weird cause that example doesn't even use eventlet ... | 15:26 |
haypo | harlowja_at_home, yes, i saw a lot of bugs with threading, but they *should* be fixed in eventlet 0.17.3 | 15:28 |
harlowja_at_home | hmmm | 15:28 |
harlowja_at_home | thats the version i was using | 15:28 |
haypo | harlowja_at_home, do you have a same script to reproduce your issue? | 15:28 |
harlowja_at_home | not yet, gonna try to get one there | 15:29 |
*** sreshetnyak has quit IRC | 15:29 | |
harlowja_at_home | haypo, an example out from that example http://paste.openstack.org/show/204479/ | 15:30 |
harlowja_at_home | u'll notice https://github.com/openstack/taskflow/blob/master/taskflow/examples/jobboard_produce_consume_colors.py#L128 and https://github.com/openstack/taskflow/blob/master/taskflow/examples/jobboard_produce_consume_colors.py#L149 occur | 15:30 |
haypo | harlowja_at_home, i spent a lot of time trying to understand _wait_for_tstate_lock() especially how to handle it in eventlet | 15:31 |
*** arnaud___ has joined #openstack-oslo | 15:31 | |
harlowja_at_home | :-/ | 15:31 |
harlowja_at_home | in that output u'll see | 15:31 |
harlowja_at_home | P-1: started | 15:31 |
harlowja_at_home | P-2: started | 15:31 |
harlowja_at_home | P-3: started | 15:31 |
harlowja_at_home | W-1: started | 15:31 |
harlowja_at_home | W-2: started | 15:31 |
harlowja_at_home | W-3: started | 15:31 |
harlowja_at_home | W-4: started | 15:31 |
harlowja_at_home | W-5: started | 15:31 |
haypo | harlowja_at_home, _wait_for_tstate_lock() is a new lock introduced in python 3.4 to fix a corner case bug | 15:31 |
haypo | harlowja_at_home, the lock is released by a C function which is not called in eventlet, since eventlet uses green threads not native threads | 15:31 |
harlowja_at_home | and correspnding finished 'output' for all of those, but they still don't correctly join -/ | 15:31 |
haypo | harlowja_at_home, my fix is to hack each Thread instance to release this lock | 15:32 |
harlowja_at_home | https://github.com/openstack/taskflow/blob/master/taskflow/examples/jobboard_produce_consume_colors.py#L164 (the join part) | 15:32 |
harlowja_at_home | hmmm | 15:32 |
harlowja_at_home | haypo, the weird part is that the example doesn't even use eventlet (although it might get imported but not used) | 15:32 |
harlowja_at_home | so if i pip uninstall eventlet, problem goes away | 15:33 |
harlowja_at_home | otherwise its ok | 15:33 |
harlowja_at_home | *otherwise its not ok i mean | 15:33 |
haypo | harlowja_at_home, be careful, your eyes will bleed https://github.com/eventlet/eventlet/blob/master/eventlet/green/thread.py#L46 | 15:33 |
haypo | harlowja_at_home, you may check that you enter in the hack (that thread._bootstrap_inner is patched) | 15:33 |
harlowja_at_home | would it be patched even if eventlet isn't getting used? | 15:34 |
haypo | harlowja_at_home, call eventlet.is_monkey_patched('thread') to check if monkey-patch is enabled | 15:34 |
harlowja_at_home | checking | 15:34 |
haypo | harlowja_at_home, or put a breaking in eventlet.patcher.monkey_patch() | 15:34 |
*** arnaud___ has quit IRC | 15:35 | |
harlowja_at_home | so nope, doesn't seem patched | 15:36 |
harlowja_at_home | weird stuff, lol | 15:37 |
haypo | harlowja_at_home, weird, yes | 15:37 |
haypo | harlowja_at_home, maybe it's a real bug in your code :) | 15:37 |
haypo | harlowja_at_home, as i said, python 3.4 changed thread.join() | 15:38 |
harlowja_at_home | i'm not so sure about that, seeing as what gets printed out to stdout showing my code is finishing, but then everything is locking up around the join() call | 15:38 |
harlowja_at_home | maybe join is broken, lol | 15:39 |
haypo | harlowja_at_home, but if you only get the bug when eventlet is installed, it's more likely an eventlet bug | 15:39 |
harlowja_at_home | ya, but that's weird, what in eventlet has those kind of side-effects, when things aren't even monkey patching themself in | 15:40 |
harlowja_at_home | pretty easy to try it also; checkout taskflow, pip install the existing requirements, install eventlet, then run | 15:42 |
harlowja_at_home | $ python taskflow/examples/jobboard_produce_consume_colors.py | 15:42 |
harlowja_at_home | reliably doesn't ever join | 15:42 |
harlowja_at_home | remove eventlet, then reliably does join... | 15:42 |
harlowja_at_home | ^ weird | 15:42 |
*** joesavak has joined #openstack-oslo | 15:43 | |
openstackgerrit | Mehdi Abaakouk proposed openstack/oslo.messaging: Disable and mark heartbeat as experimental https://review.openstack.org/174929 | 15:43 |
openstackgerrit | Merged openstack/tooz: Uncap library requirements for liberty https://review.openstack.org/174549 | 15:45 |
openstackgerrit | Merged openstack/stevedore: Uncap library requirements for liberty https://review.openstack.org/174547 | 15:45 |
*** sreshetnyak has joined #openstack-oslo | 15:47 | |
*** enikanorov__ has joined #openstack-oslo | 15:48 | |
openstackgerrit | Merged openstack/oslo.serialization: Uncap library requirements for liberty https://review.openstack.org/174518 | 15:50 |
openstackgerrit | Merged openstack/taskflow: Uncap library requirements for liberty https://review.openstack.org/174548 | 15:50 |
*** tsekiyama has joined #openstack-oslo | 15:51 | |
*** enikanorov_ has quit IRC | 15:51 | |
openstackgerrit | Mehdi Abaakouk proposed openstack/oslo.messaging: Disable and mark heartbeat as experimental https://review.openstack.org/174929 | 15:51 |
openstackgerrit | Merged openstack/oslo.vmware: Uncap library requirements for liberty https://review.openstack.org/174523 | 15:52 |
openstackgerrit | Mehdi Abaakouk proposed openstack/oslo.messaging: Disable and mark heartbeat as experimental https://review.openstack.org/174929 | 15:54 |
*** jsavak has joined #openstack-oslo | 15:55 | |
*** browne has joined #openstack-oslo | 15:55 | |
*** dulek has quit IRC | 15:58 | |
*** joesavak has quit IRC | 15:59 | |
*** kbyrne has quit IRC | 16:00 | |
*** arnaud___ has joined #openstack-oslo | 16:04 | |
*** yamahata has quit IRC | 16:08 | |
*** harlowja_at_home has quit IRC | 16:09 | |
*** pcaruana has quit IRC | 16:10 | |
*** e0ne has quit IRC | 16:12 | |
*** salv-orl_ has quit IRC | 16:19 | |
*** mriedem1 has joined #openstack-oslo | 16:19 | |
*** subscope has joined #openstack-oslo | 16:20 | |
*** mriedem has quit IRC | 16:21 | |
*** haypo has quit IRC | 16:23 | |
*** salv-orlando has joined #openstack-oslo | 16:24 | |
*** dims__ has joined #openstack-oslo | 16:24 | |
*** yamahata has joined #openstack-oslo | 16:31 | |
*** arnaud___ has quit IRC | 16:34 | |
*** sdake has joined #openstack-oslo | 16:35 | |
*** mdbooth has quit IRC | 16:37 | |
*** sdake_ has quit IRC | 16:39 | |
*** mdbooth has joined #openstack-oslo | 16:44 | |
*** dims__ is now known as dimsum__ | 16:50 | |
*** pblaho has quit IRC | 16:54 | |
*** ihrachyshka has quit IRC | 17:00 | |
*** sreshetnyak has quit IRC | 17:00 | |
*** prad has quit IRC | 17:02 | |
*** sreshetnyak has joined #openstack-oslo | 17:02 | |
*** prad has joined #openstack-oslo | 17:05 | |
*** salv-orlando has quit IRC | 17:06 | |
*** prad has quit IRC | 17:06 | |
*** sreshetnyak has quit IRC | 17:09 | |
*** prad has joined #openstack-oslo | 17:09 | |
*** sreshetnyak has joined #openstack-oslo | 17:11 | |
*** russellb has quit IRC | 17:14 | |
*** harlowja_away is now known as harlowja | 17:17 | |
*** russellb has joined #openstack-oslo | 17:17 | |
*** sreshetnyak has quit IRC | 17:22 | |
*** inc0 has joined #openstack-oslo | 17:24 | |
*** russellb has quit IRC | 17:25 | |
*** inc0 has quit IRC | 17:25 | |
*** russellb has joined #openstack-oslo | 17:29 | |
*** salv-orlando has joined #openstack-oslo | 17:29 | |
*** arnaud___ has joined #openstack-oslo | 17:35 | |
*** e0ne has joined #openstack-oslo | 17:37 | |
*** mriedem1 is now known as mriedem | 17:38 | |
*** arnaud___ has quit IRC | 17:40 | |
*** prad has quit IRC | 17:45 | |
*** e0ne is now known as e0ne_ | 17:45 | |
*** prad has joined #openstack-oslo | 17:46 | |
*** achanda has joined #openstack-oslo | 17:48 | |
*** e0ne_ is now known as e0ne | 17:52 | |
*** jaosorior has quit IRC | 17:52 | |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/oslo.utils: Allow deprecated decorator to specify no plan for removal https://review.openstack.org/170461 | 17:55 |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/oslo.utils: Add Kilo release name to versionutils https://review.openstack.org/170462 | 17:55 |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/oslo.utils: Enhance versionutils.deprecated to work with classes https://review.openstack.org/170463 | 17:55 |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/oslo.utils: Remove code that moved to oslo.i18n https://review.openstack.org/170464 | 17:56 |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/oslo.utils: Remove oslo.log code and clean up versionutils API https://review.openstack.org/170465 | 17:56 |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/oslo.utils: Switch from oslo.config to oslo_config https://review.openstack.org/170466 | 17:56 |
*** AAzza_afk has joined #openstack-oslo | 17:56 | |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/oslo.utils: Expose opts entry point for version_utils https://review.openstack.org/170467 | 17:56 |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/oslo.utils: Add liberty release name to versionutils https://review.openstack.org/170468 | 17:57 |
*** e0ne is now known as e0ne_ | 17:57 | |
*** AAzzal has joined #openstack-oslo | 17:58 | |
*** AAzza has quit IRC | 17:59 | |
*** AAzzal is now known as AAzza | 17:59 | |
*** AAzza_afk has quit IRC | 18:02 | |
openstackgerrit | Merged openstack/oslo-incubator: Revert "Revert "Optimization of waiting subprocesses in ProcessLauncher"" https://review.openstack.org/174365 | 18:07 |
harlowja | revert revert revert revert of revert | 18:08 |
harlowja | lol | 18:08 |
*** leakypipes has quit IRC | 18:25 | |
*** rushiagr is now known as rushiagr_away | 18:26 | |
*** andreykurilin__ has joined #openstack-oslo | 18:29 | |
*** jungleboyj has joined #openstack-oslo | 18:29 | |
*** e0ne_ is now known as e0ne | 18:30 | |
*** jungleboyj has quit IRC | 18:36 | |
*** cdent has quit IRC | 18:36 | |
harlowja | anyone around with a 3.4 environment | 18:39 |
harlowja | wanna see if this locks up for u | 18:39 |
*** achanda has quit IRC | 18:46 | |
*** jungleboyj has joined #openstack-oslo | 18:51 | |
harlowja | dimsum__ can u try https://github.com/eventlet/eventlet/issues/230 | 18:52 |
harlowja | if u get some time | 18:52 |
harlowja | its something that imho we're gonna hit more :-P | 18:52 |
harlowja | just want to make sure that freezes up for others :-P | 18:52 |
harlowja | ^ nothing special ... | 18:52 |
*** achanda has joined #openstack-oslo | 18:56 | |
*** salv-orlando has quit IRC | 18:57 | |
*** e0ne has quit IRC | 18:58 | |
*** jungleboyj has quit IRC | 19:00 | |
openstackgerrit | Merged openstack/oslo.serialization: Expose base msgpack exceptions so users don't need to import https://review.openstack.org/174553 | 19:04 |
openstackgerrit | Merged openstack/oslo.serialization: Add docstring(s) to handler registry(s) https://review.openstack.org/173089 | 19:10 |
openstackgerrit | Merged openstack/oslo.serialization: More docstring cleanups/tweaks https://review.openstack.org/173095 | 19:10 |
*** jungleboyj has joined #openstack-oslo | 19:13 | |
bnemec | harlowja: Also seeing that hang here. | 19:18 |
harlowja | durn | 19:19 |
harlowja | someone here on a mac tried it, didn't see it | 19:19 |
harlowja | suck | 19:19 |
harlowja | something weird | 19:19 |
*** jungleboyj has quit IRC | 19:19 | |
bnemec | I'm on f21, with eventlet installed in a 3.4 venv. | 19:19 |
harlowja | kk | 19:19 |
harlowja | i'll note that in PR (trying on a few systems) | 19:20 |
bnemec | Maybe worth noting that I did not see the hang in a py2 venv. | 19:20 |
dimsum__ | harlowja: y give me a few | 19:20 |
harlowja | ya | 19:20 |
harlowja | bnemec something weird with the import machinery that eventlet maybe(?) is messing with | 19:20 |
harlowja | even though eventlet isn't being used anywhere... | 19:21 |
bnemec | harlowja: I wouldn't even want to speculate. :-) | 19:21 |
harlowja | haha | 19:21 |
harlowja | ya | 19:21 |
harlowja | accept eventlet into your heart bnemec | 19:21 |
harlowja | lol | 19:21 |
bnemec | I've accepted that sometimes I just don't understand eventlet. ;-) | 19:22 |
*** bnemec is now known as beekneemech | 19:22 | |
* beekneemech notices that it's Friday | 19:22 | |
harlowja | ha | 19:23 |
*** arnaud___ has joined #openstack-oslo | 19:24 | |
harlowja | alright, added note/comment to PR about systems that have seen this | 19:27 |
harlowja | let's see what happens, no idea whats going on there, eventlet is weird (and I totally didn't expect weird import time side-effects) | 19:27 |
*** ajo has quit IRC | 19:28 | |
beekneemech | And here we thought all the hidden landmines were in the monkey patching. | 19:28 |
*** ajo has joined #openstack-oslo | 19:28 | |
*** ajo has quit IRC | 19:28 | |
harlowja | :-/ | 19:28 |
dimsum__ | harlowja: so Ubuntu 14.04.2 LTS + python3.4 i can see the same issue | 19:28 |
dimsum__ | trying on mac now | 19:28 |
harlowja | dimsum__ thx, tried it on my 14.04 box i have laying around also | 19:28 |
*** arnaud___ has quit IRC | 19:29 | |
harlowja | weird stuff, ha | 19:29 |
dimsum__ | harlowja: i can see it on mac as well | 19:30 |
dimsum__ | Python 3.4.3 | 19:30 |
harlowja | kk, can u add that to PR, coworker here said he didn't see it on his mac (oddly) | 19:30 |
harlowja | guess i could try it on my mac, ha | 19:30 |
*** yamahata has quit IRC | 19:31 | |
harlowja | the only maybe weird thing is the following | 19:33 |
harlowja | importing eventlet imports eventlet.convenience which imports eventlet.green.socket which imports eventlet.support.greendns which starts to monkey around with things... | 19:34 |
harlowja | but not sure | 19:34 |
harlowja | https://github.com/eventlet/eventlet/blob/master/eventlet/green/socket.py#L9 (whatever all this stuff is...) | 19:34 |
harlowja | but who knows, could be something else, lol | 19:34 |
* harlowja was hoping eventlet didn't patch things until u asked it to, lol | 19:36 | |
*** stevemar has quit IRC | 19:40 | |
*** stevemar2 has joined #openstack-oslo | 19:40 | |
*** subscope has quit IRC | 19:40 | |
*** ozialien has joined #openstack-oslo | 19:41 | |
openstackgerrit | Merged openstack/oslo.utils: Allow deprecated decorator to specify no plan for removal https://review.openstack.org/170461 | 19:44 |
*** salv-orlando has joined #openstack-oslo | 19:49 | |
*** achanda has quit IRC | 19:50 | |
dimsum__ | harlowja: fix this line | 19:52 |
dimsum__ | harlowja: https://github.com/eventlet/eventlet/blob/master/eventlet/hubs/__init__.py#L9 | 19:52 |
dimsum__ | harlowja: instead of patcher.original('threading') do patcher.original('threadingxxxxxxxx') | 19:52 |
dimsum__ | and it works fine :) | 19:52 |
dimsum__ | so the original method is doing something funny | 19:53 |
dimsum__ | if already_patched in patcher.py is empty, it should just bail out with sys.modules.get(modname) | 19:55 |
dimsum__ | if you ask me | 19:55 |
openstackgerrit | Merged openstack/oslo.utils: Add Kilo release name to versionutils https://review.openstack.org/170462 | 20:03 |
*** ozamiatin has joined #openstack-oslo | 20:08 | |
*** ozamiatin has quit IRC | 20:09 | |
openstackgerrit | Merged openstack/oslo.utils: Enhance versionutils.deprecated to work with classes https://review.openstack.org/170463 | 20:11 |
openstackgerrit | Merged openstack/oslo.utils: Remove code that moved to oslo.i18n https://review.openstack.org/170464 | 20:12 |
openstackgerrit | Merged openstack/oslo.utils: Remove oslo.log code and clean up versionutils API https://review.openstack.org/170465 | 20:12 |
*** ndipanov has quit IRC | 20:13 | |
*** stevemar2 is now known as stevemar | 20:15 | |
openstackgerrit | Merged openstack/oslo.utils: Switch from oslo.config to oslo_config https://review.openstack.org/170466 | 20:18 |
openstackgerrit | Merged openstack/oslo.utils: Expose opts entry point for version_utils https://review.openstack.org/170467 | 20:18 |
openstackgerrit | Merged openstack/oslo.utils: Add liberty release name to versionutils https://review.openstack.org/170468 | 20:18 |
*** kgiusti has left #openstack-oslo | 20:21 | |
*** openstackgerrit has quit IRC | 20:22 | |
*** openstackgerrit has joined #openstack-oslo | 20:22 | |
harlowja | dimsum__ weird | 20:24 |
dimsum__ | saw my diff? | 20:24 |
harlowja | ya, seems to make sense | 20:25 |
*** achanda has joined #openstack-oslo | 20:27 | |
*** andreykurilin___ has joined #openstack-oslo | 20:28 | |
*** andreykurilin__ has quit IRC | 20:29 | |
harlowja | let's see what eventlet devs think i guess | 20:29 |
*** kgiusti has joined #openstack-oslo | 20:31 | |
*** kgiusti has left #openstack-oslo | 20:39 | |
openstackgerrit | Victor Stinner proposed openstack/oslo.concurrency: Add binary parameter to execute and ssh_execute https://review.openstack.org/171710 | 20:43 |
openstackgerrit | Victor Stinner proposed openstack/oslo.concurrency: Port processutils to Python 3 https://review.openstack.org/146984 | 20:43 |
*** stpierre has quit IRC | 20:44 | |
*** sdake_ has joined #openstack-oslo | 20:56 | |
openstackgerrit | Joshua Harlow proposed openstack/tooz: Use oslo.serialization msgpackutils https://review.openstack.org/173058 | 20:59 |
*** sdake has quit IRC | 20:59 | |
-openstackstatus- NOTICE: Gerrit will be unavailable between 22:00 and 23:59 UTC for project renames and a database update. | 21:05 | |
*** mriedem has quit IRC | 21:07 | |
openstackgerrit | Joshua Harlow proposed openstack/taskflow: Add ability to use tooz to find and advertise workers https://review.openstack.org/151495 | 21:10 |
*** arnaud___ has joined #openstack-oslo | 21:13 | |
*** ozialien has quit IRC | 21:16 | |
*** arnaud___ has quit IRC | 21:17 | |
*** shardy has quit IRC | 21:20 | |
*** openstackgerrit has quit IRC | 21:23 | |
*** openstackgerrit has joined #openstack-oslo | 21:23 | |
*** sdake has joined #openstack-oslo | 21:25 | |
*** stevemar has quit IRC | 21:29 | |
*** sdake_ has quit IRC | 21:29 | |
*** ozialien has joined #openstack-oslo | 21:37 | |
*** bknudson has quit IRC | 21:44 | |
*** jamielennox|away is now known as jamielennox | 21:48 | |
*** gordc has quit IRC | 21:54 | |
openstackgerrit | Victor Stinner proposed openstack/oslo.concurrency: Add binary parameter to execute and ssh_execute https://review.openstack.org/171710 | 22:02 |
openstackgerrit | Victor Stinner proposed openstack/oslo.concurrency: Port processutils to Python 3 https://review.openstack.org/146984 | 22:02 |
*** jsavak has quit IRC | 22:02 | |
*** jecarey has quit IRC | 22:04 | |
-openstackstatus- NOTICE: Gerrit is unavailable until 23:59 UTC for project renames and a database update. | 22:05 | |
-openstackstatus- NOTICE: Gerrit is unavailable until 23:59 UTC for project renames and a database update. | 22:08 | |
*** ChanServ changes topic to "Gerrit is unavailable until 23:59 UTC for project renames and a database update." | 22:08 | |
*** sigmavirus24 is now known as sigmavirus24_awa | 22:13 | |
*** andreykurilin___ has quit IRC | 22:13 | |
*** jgrimm is now known as zz_jgrimm | 22:20 | |
*** sdake_ has joined #openstack-oslo | 22:24 | |
*** sdake has quit IRC | 22:27 | |
*** sdake has joined #openstack-oslo | 22:46 | |
*** sdake_ has quit IRC | 22:50 | |
openstackgerrit | Victor Stinner proposed openstack/oslo.concurrency: Add binary parameter to execute and ssh_execute https://review.openstack.org/171710 | 22:51 |
openstackgerrit | Victor Stinner proposed openstack/oslo.concurrency: Port processutils to Python 3 https://review.openstack.org/146984 | 22:51 |
*** achanda has quit IRC | 22:54 | |
*** achanda has joined #openstack-oslo | 22:56 | |
*** arnaud___ has joined #openstack-oslo | 23:02 | |
*** ChanServ changes topic to "#openstack-oslo" | 23:05 | |
-openstackstatus- NOTICE: Gerrit is available again. | 23:05 | |
*** arnaud___ has quit IRC | 23:06 | |
*** achanda has quit IRC | 23:11 | |
*** sdake_ has joined #openstack-oslo | 23:14 | |
*** achanda has joined #openstack-oslo | 23:15 | |
*** sdake has quit IRC | 23:17 | |
*** zzzeek has quit IRC | 23:23 | |
*** jamielennox is now known as jamielennox|away | 23:30 | |
*** sdake has joined #openstack-oslo | 23:32 | |
*** zzzeek has joined #openstack-oslo | 23:33 | |
*** sdake_ has quit IRC | 23:36 | |
*** flaper87 has quit IRC | 23:38 | |
*** zzzeek has quit IRC | 23:55 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!