*** bobh has joined #openstack-mistral | 00:11 | |
*** catintheroof has quit IRC | 00:34 | |
*** bobh has quit IRC | 00:52 | |
*** bobh has joined #openstack-mistral | 00:55 | |
*** jamielennox is now known as jamielennox|away | 01:02 | |
*** bobh has quit IRC | 01:08 | |
*** gongysh has joined #openstack-mistral | 01:15 | |
*** jamielennox|away is now known as jamielennox | 01:16 | |
*** gongysh has quit IRC | 01:59 | |
*** zhurong has joined #openstack-mistral | 02:04 | |
*** thrash is now known as thrash|g0ne | 02:06 | |
*** gongysh has joined #openstack-mistral | 02:48 | |
openstackgerrit | Lingxian Kong proposed openstack/mistral master: Role based resource access control - update executions https://review.openstack.org/451160 | 03:30 |
---|---|---|
openstackgerrit | Lingxian Kong proposed openstack/mistral master: Role based resource access control - update executions https://review.openstack.org/451160 | 03:33 |
*** zhurong has quit IRC | 05:54 | |
*** jamielennox is now known as jamielennox|away | 06:10 | |
*** jaosorior has joined #openstack-mistral | 06:14 | |
*** jamielennox|away is now known as jamielennox | 06:25 | |
*** apetrich has quit IRC | 06:35 | |
*** apetrich has joined #openstack-mistral | 06:35 | |
*** jamielennox is now known as jamielennox|away | 06:50 | |
*** jkilpatr has quit IRC | 06:53 | |
*** jamielennox|away is now known as jamielennox | 06:57 | |
*** gongysh has quit IRC | 07:01 | |
*** amoralej|off is now known as amoralej | 07:24 | |
*** zhurong has joined #openstack-mistral | 07:34 | |
*** gongysh has joined #openstack-mistral | 07:35 | |
openstackgerrit | Istvan Imre proposed openstack/mistral master: Dynamic workflow name evaluation. https://review.openstack.org/434106 | 07:49 |
*** shardy has joined #openstack-mistral | 08:03 | |
*** jamielennox is now known as jamielennox|away | 08:17 | |
openstackgerrit | Merged openstack/mistral master: Updated from global requirements https://review.openstack.org/451023 | 08:43 |
openstackgerrit | Lingxian Kong proposed openstack/mistral master: Role based resource access control - update executions https://review.openstack.org/451160 | 08:57 |
openstackgerrit | Lingxian Kong proposed openstack/mistral master: Role based resource access control - delete executions https://review.openstack.org/451255 | 08:57 |
*** gongysh has quit IRC | 09:02 | |
openstackgerrit | Merged openstack/python-mistralclient master: Remove log translations https://review.openstack.org/448068 | 10:00 |
thrash|g0ne | rakhmerov: In case you hadn't seen this yet: https://review.openstack.org/#/c/450853/1 | 10:22 |
*** thrash|g0ne is now known as thrash | 10:22 | |
thrash | rakhmerov: It needs work :) | 10:22 |
rakhmerov | thrash: yes, thanks, I've seen it and replied ) | 10:24 |
thrash | rakhmerov: haha... Guess I should have refreshed. :D | 10:27 |
rakhmerov | ok :) | 10:39 |
rakhmerov | d0ugal: can you pls have a look at https://review.openstack.org/#/c/449525/ ? | 10:40 |
rakhmerov | it's been on review for long.. | 10:40 |
d0ugal | 5 days isn't long :P | 10:42 |
* d0ugal looks | 10:42 | |
*** jkilpatr has joined #openstack-mistral | 11:02 | |
*** jkilpatr has quit IRC | 11:07 | |
*** jkilpatr has joined #openstack-mistral | 11:07 | |
openstackgerrit | Anastasia Kuznetsova proposed openstack/mistral master: Fix work of task() without task name within on-clause cases https://review.openstack.org/451340 | 11:23 |
*** zhurong has quit IRC | 11:34 | |
*** amoralej is now known as amoralej|lunch | 11:56 | |
thrash | d0ugal: so.. looked at this again: https://bugs.launchpad.net/tripleo/+bug/1644803 very strange. I think the workflow and the rest of the logic is correct. This looks more like a mistral bug to me. | 12:04 |
openstack | Launchpad bug 1644803 in tripleo "openstack overcloud node import fails badly if no glance images are registered yet" [Medium,Triaged] - Assigned to Brad P. Crochet (brad-9) | 12:04 |
thrash | d0ugal: I bounced rabbitmq and mistral, ran it, and it worked. I got the expected error message back. | 12:05 |
*** chlong has quit IRC | 12:05 | |
thrash | d0ugal: But then I ran it again, and got the hang again. | 12:05 |
thrash | d0ugal: I will continue to look at it. It's odd to say the least. | 12:06 |
d0ugal | thrash: interesting. | 12:24 |
d0ugal | thrash: I did report it a while ago, so maybe things have changed. | 12:24 |
d0ugal | thrash: is the error the same? | 12:24 |
thrash | d0ugal: well... It worked. Once. | 12:24 |
d0ugal | :) | 12:24 |
thrash | d0ugal: but the other times, the client just hangs there waiting. | 12:25 |
*** dprince has joined #openstack-mistral | 12:26 | |
d0ugal | thrash: hangling clients usually means nothing has been sent to zaqar | 12:26 |
thrash | d0ugal: yeah... I can certainly see Mistral sending it, but there's a bunch of timeout messages in the logs... | 12:27 |
thrash | d0ugal: I'm rebuilding to try again. I'll get some more specific message when/if I see it again. | 12:27 |
d0ugal | thrash: right, zaqar does seem to fall over quite often - that does concern me. | 12:28 |
thrash | d0ugal: I haven't seen this happen on other commands... Why just this one? | 12:28 |
d0ugal | thrash: Not sure, I've seen zaqar problems in other actions. | 12:30 |
d0ugal | s/actions/workflows/ | 12:30 |
thrash | d0ugal: yeah... strange. | 12:31 |
d0ugal | thrash: but the problem you are describing doesn't really match the error I added to the bug :) | 12:31 |
d0ugal | Which seems like a fairly simple value error | 12:31 |
thrash | d0ugal: you are right... Your report stated it stayed in a RUNNING state. That's clearly not happening to me. | 12:31 |
thrash | It's going to ERROR as it should | 12:32 |
thrash | d0ugal: Nothing is left RUNNING | 12:32 |
d0ugal | thrash: that might have been because this change hadn't landed: https://github.com/openstack/tripleo-common/commit/0aee2ceb3ca2b26e5271f357b68deca912668f89 | 12:33 |
d0ugal | Returning exceptions objects causes Mistral (it might be fixed now in Mistral too) to fall over | 12:33 |
thrash | d0ugal: Hmm... That should be there. | 12:34 |
thrash | I will check that its there when it's done building | 12:34 |
thrash | d0ugal: Oh. I see what you were saying. | 12:35 |
thrash | d0ugal: So, your initial bug is probably no longer valid. But I may have another lol | 12:35 |
d0ugal | \o/ and /o\ | 12:35 |
*** fultonj has joined #openstack-mistral | 12:36 | |
*** fultonj has quit IRC | 12:47 | |
*** fultonj has joined #openstack-mistral | 12:48 | |
openstackgerrit | Merged openstack/mistral master: Add missing schema validation and unit tests for 'publish-on-error' https://review.openstack.org/449525 | 13:04 |
openstackgerrit | Brad P. Crochet proposed openstack/mistral-specs master: Adding securing sensitive data spec https://review.openstack.org/450853 | 13:10 |
*** bobh has joined #openstack-mistral | 13:14 | |
*** amoralej|lunch is now known as amoralej | 13:17 | |
*** zhurong has joined #openstack-mistral | 13:22 | |
*** toure|biab is now known as toure | 13:23 | |
thrash | d0ugal: new install, I haven't done anything, and getting this: 2017-03-29 13:26:11.245 8902 DEBUG oslo.messaging._drivers.impl_rabbit [-] Timed out waiting for RPC response: Timeout while waiting on RPC response - topic: "<unknown>", RPC method: "<unknown>" info: "<unknown>" _raise_timeout /usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py:1054 | 13:26 |
*** catintheroof has joined #openstack-mistral | 13:30 | |
*** jpich has joined #openstack-mistral | 13:34 | |
*** jaosorior has quit IRC | 13:38 | |
*** chlong has joined #openstack-mistral | 13:40 | |
*** catintheroof has quit IRC | 13:41 | |
thrash | d0ugal: oh... and that's in both the engine.log and executor.log | 13:42 |
d0ugal | thrash: Yeah, I see that everywhere | 13:43 |
d0ugal | thrash: No idea why, it seems to have started fairly recently | 13:43 |
*** jaosorior has joined #openstack-mistral | 13:43 | |
d0ugal | I looked into it briefly but wasn't really sure what to do | 13:43 |
thrash | d0ugal: perhaps new version of oslo messaging from global reqs? | 13:44 |
d0ugal | thrash: Yeah, sounds likely. | 13:44 |
thrash | d0ugal: oslo.log was updated in latest | 13:44 |
thrash | d0ugal: aha... https://github.com/openstack/mistral/commit/4e5cb24c2f75afb07b533739e38f25a18ff0de1c | 13:45 |
thrash | so there was an update. | 13:45 |
thrash | let me see if what changed betwee 5.14 and 5.19 | 13:46 |
d0ugal | 14 days roughly matches up with how long I feel like I have been seeing it too | 13:46 |
*** jrist has quit IRC | 13:55 | |
*** jrist has joined #openstack-mistral | 13:57 | |
*** zhurong_ has joined #openstack-mistral | 14:07 | |
*** zhurong has quit IRC | 14:07 | |
*** zhurong_ has quit IRC | 14:18 | |
*** tuan__ has joined #openstack-mistral | 14:55 | |
tuan__ | Hi guys | 14:55 |
tuan__ | hope someone still out there | 14:55 |
tuan__ | i just think about the use case of running a long wf | 14:56 |
tuan__ | and then the token is expired | 14:56 |
tuan__ | and how does user re-run that wf if it fails since token is expire | 14:56 |
*** bobh has quit IRC | 14:56 | |
tuan__ | do we need to implement the mechanism to refresh token | 14:57 |
*** jistr is now known as jistr|mtg | 15:01 | |
*** bobh has joined #openstack-mistral | 15:06 | |
*** bobh has quit IRC | 15:06 | |
*** bobh has joined #openstack-mistral | 15:07 | |
d0ugal | tuan__: yes, we do :) | 15:09 |
d0ugal | tuan__: I think there is a bug for it somewhere | 15:09 |
d0ugal | tuan__: at the moment, we (tripleo) just make sure out workflows are shorter than 4 hours | 15:10 |
tuan__ | perfect | 15:10 |
d0ugal | but it is something I want to improve later | 15:10 |
tuan__ | yeah, actually i have created a snippet for this refreshing | 15:10 |
d0ugal | oh cool | 15:10 |
tuan__ | well, so i will create a new bug report for it in mistral | 15:11 |
*** bobh has quit IRC | 15:11 | |
d0ugal | tuan__: https://bugs.launchpad.net/mistral/+bug/1595084 | 15:11 |
openstack | Launchpad bug 1595084 in Mistral "Workflow execution lifespan is limited by auth token expire time" [High,Confirmed] | 15:11 |
tuan__ | okay i got it | 15:13 |
therve | tuan__, FWIW that is a "solved" problem in heat, you can find inspiration there | 15:13 |
d0ugal | yup, I think shardy explained how heat does it in a comment on that bug. | 15:13 |
d0ugal | https://bugs.launchpad.net/mistral/+bug/1595084/comments/6 | 15:14 |
openstack | Launchpad bug 1595084 in Mistral "Workflow execution lifespan is limited by auth token expire time" [High,Confirmed] | 15:14 |
tuan__ | oh, i have checked that | 15:15 |
tuan__ | it seems like if we follow it | 15:16 |
tuan__ | we probably have to change in every component which mistral triggers | 15:16 |
tuan__ | what about we just refresh the token from client side | 15:16 |
tuan__ | not from server side as heat does | 15:17 |
*** bobh has joined #openstack-mistral | 15:43 | |
*** d0ugal has quit IRC | 16:17 | |
*** tuan__ has quit IRC | 16:29 | |
*** tuan has joined #openstack-mistral | 16:32 | |
*** shardy has quit IRC | 16:35 | |
*** tuan has quit IRC | 16:35 | |
*** tuan_ has joined #openstack-mistral | 16:38 | |
*** d0ugal has joined #openstack-mistral | 16:39 | |
*** d0ugal has quit IRC | 16:43 | |
*** jistr|mtg is now known as jistr | 16:47 | |
*** shardy has joined #openstack-mistral | 16:52 | |
*** chlong has quit IRC | 17:03 | |
*** jpich has quit IRC | 17:24 | |
*** tuan_ has quit IRC | 17:45 | |
*** bobh has quit IRC | 17:53 | |
*** vishwanathj has joined #openstack-mistral | 17:58 | |
*** chlong has joined #openstack-mistral | 17:58 | |
*** amoralej is now known as amoralej|off | 18:07 | |
*** chlong has quit IRC | 18:07 | |
*** rbrady is now known as rbrady-afk | 18:12 | |
*** toure is now known as toure|afk | 18:20 | |
*** chlong has joined #openstack-mistral | 18:21 | |
*** chlong has quit IRC | 18:34 | |
*** chlong has joined #openstack-mistral | 18:49 | |
*** bobh has joined #openstack-mistral | 18:49 | |
*** openstackgerrit has quit IRC | 19:33 | |
*** jamielennox|away is now known as jamielennox | 19:33 | |
*** chlong has quit IRC | 19:34 | |
*** toure|afk is now known as toure | 19:45 | |
*** d0ugal has joined #openstack-mistral | 19:50 | |
*** dprince has quit IRC | 19:55 | |
*** d0ugal has quit IRC | 20:00 | |
*** rbrady-afk is now known as rbrady | 21:36 | |
*** ruhe has quit IRC | 21:44 | |
*** ruhe has joined #openstack-mistral | 21:49 | |
*** shardy has quit IRC | 21:50 | |
*** bobh has quit IRC | 21:58 | |
*** jamielennox is now known as jamielennox|away | 22:09 | |
*** jamielennox|away is now known as jamielennox | 22:12 | |
*** rbrady is now known as rbrady-afk | 22:44 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!