*** jeckersb_gone is now known as jeckersb | 00:02 | |
*** harlowja has joined #openstack-oslo | 00:09 | |
*** ozamiatin_ has quit IRC | 00:10 | |
*** EinstCrazy has joined #openstack-oslo | 00:13 | |
*** zz_dimtruck is now known as dimtruck | 00:15 | |
*** EinstCrazy has quit IRC | 00:24 | |
*** zqfan_AFK has joined #openstack-oslo | 00:26 | |
*** dimtruck is now known as zz_dimtruck | 00:27 | |
*** zz_dimtruck is now known as dimtruck | 00:29 | |
*** dims has quit IRC | 00:29 | |
*** zqfan_AFK is now known as zqfan | 00:30 | |
*** pratikmallya has joined #openstack-oslo | 00:42 | |
*** dimtruck is now known as zz_dimtruck | 00:43 | |
*** rcernin has quit IRC | 00:50 | |
*** EinstCrazy has joined #openstack-oslo | 00:53 | |
openstackgerrit | Joshua Harlow proposed openstack/taskflow: Allow for alterations in decider 'area of influence' https://review.openstack.org/246051 | 01:00 |
---|---|---|
openstackgerrit | Sachi King proposed openstack-dev/pbr: Handle markers to support sdist on pip < 6 https://review.openstack.org/253289 | 01:01 |
*** dguitarbite has joined #openstack-oslo | 01:02 | |
openstackgerrit | Joshua Harlow proposed openstack/taskflow: Some additional logging https://review.openstack.org/258746 | 01:16 |
openstackgerrit | Joshua Harlow proposed openstack/taskflow: Some additional engine logging https://review.openstack.org/258746 | 01:23 |
openstackgerrit | Joshua Harlow proposed openstack/taskflow: Some additional engine logging https://review.openstack.org/258746 | 01:25 |
*** zhiyan has quit IRC | 01:25 | |
openstackgerrit | Boris Pavlovic proposed openstack/oslo-specs: OSprofiler cross service & project profiling https://review.openstack.org/103825 | 01:27 |
*** zhiyan has joined #openstack-oslo | 01:28 | |
openstackgerrit | Joshua Harlow proposed openstack/taskflow: Allow for alterations in decider 'area of influence' https://review.openstack.org/246051 | 01:31 |
openstackgerrit | Joshua Harlow proposed openstack/taskflow: Some additional engine logging https://review.openstack.org/258746 | 01:32 |
*** ozamiatin_ has joined #openstack-oslo | 01:42 | |
openstackgerrit | Joshua Harlow proposed openstack/taskflow: Start rename of BLATHER -> TRACE https://review.openstack.org/258752 | 01:48 |
*** mriedem has joined #openstack-oslo | 01:48 | |
*** mtanino has joined #openstack-oslo | 01:59 | |
*** amotoki has joined #openstack-oslo | 02:03 | |
*** amotoki_ has joined #openstack-oslo | 02:05 | |
*** amotoki has quit IRC | 02:09 | |
*** browne has quit IRC | 02:12 | |
*** yamamoto has joined #openstack-oslo | 02:14 | |
*** yamahata has quit IRC | 02:19 | |
openstackgerrit | Vilobh Meshram proposed openstack/tooz: Add Consul Driver https://review.openstack.org/245362 | 02:23 |
*** sputnik13 has quit IRC | 02:32 | |
*** yamamoto has quit IRC | 02:33 | |
*** droyal has quit IRC | 02:37 | |
*** dguitarbite has quit IRC | 02:40 | |
*** dguitarbite has joined #openstack-oslo | 02:41 | |
*** gcb has joined #openstack-oslo | 02:44 | |
*** droyal has joined #openstack-oslo | 02:48 | |
*** vilobhmm11 has quit IRC | 02:55 | |
*** droyal has quit IRC | 02:56 | |
*** amotoki_ has quit IRC | 02:57 | |
*** harlowja has quit IRC | 02:58 | |
*** ozamiatin_ has quit IRC | 03:02 | |
openstackgerrit | Merged openstack/oslo.middleware: Updated from global requirements https://review.openstack.org/258102 | 03:07 |
openstackgerrit | Merged openstack/oslo.policy: Pass environment variables of proxy to tox https://review.openstack.org/257126 | 03:12 |
*** browne has joined #openstack-oslo | 03:13 | |
*** mriedem has quit IRC | 03:13 | |
*** yamamoto has joined #openstack-oslo | 03:15 | |
*** jecarey has quit IRC | 03:15 | |
*** jamielennox is now known as jamielennox|away | 03:26 | |
*** links has joined #openstack-oslo | 03:28 | |
*** droyal has joined #openstack-oslo | 03:29 | |
*** jamielennox|away is now known as jamielennox | 03:31 | |
*** droyal has quit IRC | 03:38 | |
*** amotoki has joined #openstack-oslo | 03:47 | |
*** amotoki has quit IRC | 03:50 | |
*** amotoki has joined #openstack-oslo | 03:56 | |
*** amotoki_ has joined #openstack-oslo | 04:02 | |
*** amotoki has quit IRC | 04:05 | |
*** droyal has joined #openstack-oslo | 04:05 | |
*** dguitarbite has quit IRC | 04:08 | |
*** vilobhmm11 has joined #openstack-oslo | 04:12 | |
*** jecarey has joined #openstack-oslo | 04:15 | |
*** pratikmallya has quit IRC | 04:16 | |
*** jeckersb is now known as jeckersb_gone | 04:16 | |
*** jecarey has quit IRC | 04:20 | |
*** mriedem has joined #openstack-oslo | 04:32 | |
*** jecarey has joined #openstack-oslo | 04:36 | |
*** Nakato has quit IRC | 04:51 | |
*** Nakato has joined #openstack-oslo | 04:51 | |
*** gcb has quit IRC | 04:52 | |
*** boris-42_ has quit IRC | 04:53 | |
*** gus has quit IRC | 05:04 | |
*** mtreinish has quit IRC | 05:08 | |
*** jecarey has quit IRC | 05:09 | |
*** mtreinish has joined #openstack-oslo | 05:17 | |
*** mtanino has quit IRC | 05:30 | |
*** gus has joined #openstack-oslo | 05:49 | |
*** vilobhmm11 has quit IRC | 05:50 | |
*** vilobhmm11 has joined #openstack-oslo | 05:51 | |
*** vilobhmm11 has quit IRC | 05:55 | |
openstackgerrit | Akira YOSHIYAMA proposed openstack/oslo.policy: Add string format rendering to RoleCheck.__call__() https://review.openstack.org/258808 | 05:56 |
*** vilobhmm11 has joined #openstack-oslo | 05:58 | |
*** harlowja_at_home has joined #openstack-oslo | 06:01 | |
*** harlowja_still_a has joined #openstack-oslo | 06:05 | |
*** harlowja_at_home has quit IRC | 06:08 | |
*** davidlenwell has quit IRC | 06:12 | |
*** davidlenwell has joined #openstack-oslo | 06:14 | |
*** pratikmallya has joined #openstack-oslo | 06:32 | |
openstackgerrit | Joshua Harlow proposed openstack/taskflow: Some additional engine logging https://review.openstack.org/258746 | 06:33 |
*** vilobhmm11 has quit IRC | 07:10 | |
openstackgerrit | javeme proposed openstack/oslo.vmware: isoformat instead of deprecated timeutils.strtime https://review.openstack.org/258842 | 07:14 |
*** tobe has joined #openstack-oslo | 07:27 | |
*** deray has joined #openstack-oslo | 07:44 | |
*** harlowja_still_a has quit IRC | 08:03 | |
*** browne has quit IRC | 08:15 | |
*** shardy has joined #openstack-oslo | 08:22 | |
*** e0ne has joined #openstack-oslo | 08:23 | |
*** rcernin has joined #openstack-oslo | 08:26 | |
*** markus_z has joined #openstack-oslo | 08:27 | |
openstackgerrit | Ann Kamyshnikova proposed openstack/oslo.db: Fix comparison of Variant and other type in compare_type https://review.openstack.org/258478 | 08:35 |
*** pratikmallya has quit IRC | 08:38 | |
*** e0ne has quit IRC | 08:38 | |
*** e0ne has joined #openstack-oslo | 08:40 | |
*** rcernin has quit IRC | 08:40 | |
*** rcernin has joined #openstack-oslo | 08:41 | |
*** mkovacik has joined #openstack-oslo | 08:52 | |
*** e0ne has quit IRC | 08:53 | |
openstackgerrit | javeme proposed openstack/oslo.vmware: isoformat instead of deprecated timeutils.strtime https://review.openstack.org/258842 | 08:59 |
openstackgerrit | Kseniya Tychkova proposed openstack/oslo.policy: Support RBAC with LDAP in oslo.policy https://review.openstack.org/244059 | 09:03 |
*** amotoki_ has quit IRC | 09:06 | |
*** ozamiatin_ has joined #openstack-oslo | 09:09 | |
*** ndipanov has joined #openstack-oslo | 09:09 | |
*** yassine__ has joined #openstack-oslo | 09:13 | |
*** zigo has quit IRC | 09:25 | |
*** zigo_ has joined #openstack-oslo | 09:26 | |
*** ozamiatin_ has quit IRC | 09:27 | |
*** salv-orlando has joined #openstack-oslo | 09:28 | |
*** mkovacik has quit IRC | 09:30 | |
*** amotoki has joined #openstack-oslo | 09:33 | |
*** tobe has quit IRC | 09:38 | |
*** pratikmallya has joined #openstack-oslo | 09:39 | |
*** tobe has joined #openstack-oslo | 09:40 | |
*** tobe has quit IRC | 09:41 | |
*** tobe has joined #openstack-oslo | 09:41 | |
*** pratikmallya has quit IRC | 09:43 | |
*** amotoki has quit IRC | 09:44 | |
*** tobe has quit IRC | 09:46 | |
*** openstackgerrit has quit IRC | 09:47 | |
*** openstackgerrit has joined #openstack-oslo | 09:47 | |
*** cdent has joined #openstack-oslo | 09:51 | |
*** e0ne has joined #openstack-oslo | 09:55 | |
*** mhickey has joined #openstack-oslo | 09:55 | |
*** binarin has quit IRC | 10:03 | |
*** ihrachys has joined #openstack-oslo | 10:03 | |
*** e0ne has quit IRC | 10:05 | |
*** binarin has joined #openstack-oslo | 10:07 | |
*** shakamunyi has quit IRC | 10:20 | |
*** shakamunyi has joined #openstack-oslo | 10:21 | |
*** superflyy has quit IRC | 10:21 | |
*** barra204 has joined #openstack-oslo | 10:21 | |
*** ihrachys has quit IRC | 10:21 | |
*** ihrachys has joined #openstack-oslo | 10:22 | |
*** ihrachys has quit IRC | 10:23 | |
*** ihrachys has joined #openstack-oslo | 10:24 | |
*** cdent has quit IRC | 10:27 | |
*** cdent has joined #openstack-oslo | 10:29 | |
*** cdent has quit IRC | 10:39 | |
*** cdent has joined #openstack-oslo | 10:41 | |
*** e0ne has joined #openstack-oslo | 10:43 | |
*** EinstCrazy has quit IRC | 10:48 | |
*** yamahata has joined #openstack-oslo | 10:48 | |
*** dims has joined #openstack-oslo | 11:07 | |
*** lucas-dinner is now known as lucasagomes | 11:07 | |
*** salv-orlando has quit IRC | 11:08 | |
*** mkovacik has joined #openstack-oslo | 11:09 | |
*** salv-orlando has joined #openstack-oslo | 11:11 | |
*** EinstCrazy has joined #openstack-oslo | 11:11 | |
*** salv-orlando has quit IRC | 11:12 | |
*** salv-orlando has joined #openstack-oslo | 11:12 | |
*** deray has quit IRC | 11:13 | |
*** salv-orl_ has joined #openstack-oslo | 11:15 | |
*** yamahata has quit IRC | 11:18 | |
*** salv-orlando has quit IRC | 11:18 | |
*** BG_Patrick has joined #openstack-oslo | 11:21 | |
*** BG_Patrick has left #openstack-oslo | 11:21 | |
*** _amrith_ is now known as amrith | 11:23 | |
*** yamamoto has quit IRC | 11:42 | |
*** rcernin has quit IRC | 12:00 | |
*** rcernin has joined #openstack-oslo | 12:15 | |
*** yamamoto has joined #openstack-oslo | 12:23 | |
*** jaypipes has joined #openstack-oslo | 12:26 | |
*** pratikmallya has joined #openstack-oslo | 12:41 | |
*** amotoki has joined #openstack-oslo | 12:43 | |
*** amotoki has quit IRC | 12:46 | |
*** pratikmallya has quit IRC | 12:46 | |
*** jecarey has joined #openstack-oslo | 12:55 | |
*** links has quit IRC | 12:58 | |
*** jecarey has quit IRC | 13:00 | |
*** salv-orl_ has quit IRC | 13:04 | |
*** yamamoto has quit IRC | 13:08 | |
*** salv-orlando has joined #openstack-oslo | 13:09 | |
*** fultonj has joined #openstack-oslo | 13:16 | |
*** gordc has joined #openstack-oslo | 13:19 | |
*** yamamoto has joined #openstack-oslo | 13:20 | |
openstackgerrit | Kseniya Tychkova proposed openstack/oslo.policy: Support RBAC with LDAP in oslo.policy https://review.openstack.org/244059 | 13:21 |
*** rcernin has quit IRC | 13:21 | |
*** kgiusti has joined #openstack-oslo | 13:22 | |
openstackgerrit | Vladislav Kuzmin proposed openstack/oslo.log: Add ability to specify the log_config_append option in yaml format https://review.openstack.org/259000 | 13:23 |
*** pradk has joined #openstack-oslo | 13:31 | |
*** links has joined #openstack-oslo | 13:33 | |
*** amrith is now known as _amrith_ | 13:37 | |
*** sigmavirus24_awa is now known as sigmavirus24 | 13:39 | |
*** yamamoto has quit IRC | 13:46 | |
*** yamamoto has joined #openstack-oslo | 13:50 | |
*** fultonj has left #openstack-oslo | 13:53 | |
*** rlrossit has joined #openstack-oslo | 14:12 | |
*** jeckersb_gone is now known as jeckersb | 14:13 | |
*** lucasagomes is now known as lucas-hungry | 14:17 | |
*** cprmrf has joined #openstack-oslo | 14:22 | |
*** cprmrf__ has joined #openstack-oslo | 14:26 | |
*** cprmrf has quit IRC | 14:29 | |
*** pradk has quit IRC | 14:41 | |
*** pradk has joined #openstack-oslo | 14:41 | |
*** ChuckC has joined #openstack-oslo | 14:42 | |
*** yamamoto has quit IRC | 14:46 | |
*** yamamoto has joined #openstack-oslo | 14:46 | |
*** bogdando has quit IRC | 14:55 | |
*** rohit_ has joined #openstack-oslo | 15:04 | |
*** _amrith_ is now known as amrith | 15:10 | |
*** jeckersb is now known as jeckersb_gone | 15:10 | |
*** pratikmallya has joined #openstack-oslo | 15:12 | |
*** lucas-hungry is now known as lucasagomes | 15:13 | |
*** jeckersb_gone is now known as jeckersb | 15:16 | |
*** bogdando has joined #openstack-oslo | 15:20 | |
*** mtanino has joined #openstack-oslo | 15:36 | |
openstackgerrit | Chris St. Pierre proposed openstack/oslo.log: Add ISO8601/RFC3339 timestamp to ContextFormatter https://review.openstack.org/256584 | 15:36 |
*** mhorban has joined #openstack-oslo | 15:45 | |
*** mhickey has quit IRC | 15:47 | |
*** links has quit IRC | 15:50 | |
*** mriedem has quit IRC | 15:50 | |
*** pratikmallya has quit IRC | 15:50 | |
openstackgerrit | Oleksii Zamiatin proposed openstack/oslo.messaging: (WIP) [zmq] Heartbeat implementation https://review.openstack.org/257346 | 15:50 |
*** david-lyle_ has joined #openstack-oslo | 15:55 | |
*** david-lyle_ has quit IRC | 15:57 | |
*** david-lyle has quit IRC | 15:59 | |
*** ChuckC has quit IRC | 15:59 | |
*** mhickey has joined #openstack-oslo | 16:00 | |
*** david-lyle has joined #openstack-oslo | 16:05 | |
*** yassine__ has quit IRC | 16:06 | |
*** yassine__ has joined #openstack-oslo | 16:07 | |
openstackgerrit | Boris Pavlovic proposed openstack/oslo-specs: OSprofiler cross service & project profiling https://review.openstack.org/103825 | 16:09 |
*** mhickey has quit IRC | 16:10 | |
*** jecarey has joined #openstack-oslo | 16:10 | |
*** yamahata has joined #openstack-oslo | 16:10 | |
*** boris-42_ has joined #openstack-oslo | 16:12 | |
*** ihrachys has quit IRC | 16:12 | |
*** markus_z has quit IRC | 16:22 | |
*** yamamoto has quit IRC | 16:26 | |
*** pratikmallya has joined #openstack-oslo | 16:26 | |
*** pratikma_ has joined #openstack-oslo | 16:27 | |
*** pratikmallya has quit IRC | 16:30 | |
*** browne has joined #openstack-oslo | 16:38 | |
-openstackstatus- NOTICE: Zuul is moving in very slow motion since roughly 13:30 UTC; the Infra team is investigating. | 16:43 | |
*** mkovacik has quit IRC | 16:47 | |
*** yassine__ has quit IRC | 16:53 | |
*** ihrachys has joined #openstack-oslo | 16:59 | |
*** pkholkin has quit IRC | 17:09 | |
openstackgerrit | Joshua Harlow proposed openstack/tooz: Add programatic introspection of drivers characteristic(s) https://review.openstack.org/240681 | 17:11 |
*** salv-orl_ has joined #openstack-oslo | 17:15 | |
*** salv-orlando has quit IRC | 17:18 | |
*** yamahata has quit IRC | 17:22 | |
*** rlrossit has quit IRC | 17:32 | |
*** cprmrf__ has quit IRC | 17:41 | |
*** shardy has quit IRC | 17:43 | |
*** yamahata has joined #openstack-oslo | 17:48 | |
*** e0ne has quit IRC | 17:53 | |
openstackgerrit | Merged openstack/oslo.config: Remove warning for option type not a ConfigType https://review.openstack.org/256594 | 18:02 |
openstackgerrit | Merged openstack/oslo.messaging: Removes MANIFEST.in as it is not needed explicitely by PBR https://review.openstack.org/255731 | 18:02 |
openstackgerrit | Merged openstack/oslo.utils: Fix DeprecationWarning when call method delta_seconds https://review.openstack.org/258265 | 18:02 |
openstackgerrit | Merged openstack/oslo.utils: Add missing doc index for imageutils and fnmatch https://review.openstack.org/257203 | 18:02 |
*** ndipanov has quit IRC | 18:03 | |
openstackgerrit | Merged openstack/tooz: Add noted driver weaknesses onto the drivers docs https://review.openstack.org/258186 | 18:03 |
*** pkholkin has joined #openstack-oslo | 18:04 | |
openstackgerrit | Boris Pavlovic proposed openstack/oslo-specs: OSprofiler cross service & project profiling https://review.openstack.org/103825 | 18:04 |
*** sputnik13 has joined #openstack-oslo | 18:05 | |
*** browne has quit IRC | 18:09 | |
*** cdent has quit IRC | 18:10 | |
*** pkholkin has quit IRC | 18:11 | |
*** ihrachys has quit IRC | 18:12 | |
*** ihrachys has joined #openstack-oslo | 18:13 | |
*** vilobhmm11 has joined #openstack-oslo | 18:13 | |
*** harlowja has joined #openstack-oslo | 18:27 | |
*** devananda has quit IRC | 18:36 | |
*** mkovacik has joined #openstack-oslo | 18:37 | |
*** e0ne has joined #openstack-oslo | 18:46 | |
*** cdent has joined #openstack-oslo | 18:48 | |
harlowja | lifeless if u get some time someday can u give your super-awesome inputs on https://review.openstack.org/#/c/240681/ :) | 18:52 |
harlowja | i'd appreciate that ;) | 18:52 |
*** devananda has joined #openstack-oslo | 18:53 | |
*** browne has joined #openstack-oslo | 18:55 | |
lifeless | harlowja: I have to do dims extras thing first :/ this week, man. a write off | 18:58 |
harlowja | :) | 19:01 |
harlowja | np | 19:01 |
*** cprmrf has joined #openstack-oslo | 19:07 | |
openstackgerrit | Vilobh Meshram proposed openstack/tooz: Add Consul Driver https://review.openstack.org/245362 | 19:07 |
openstackgerrit | Joshua Harlow proposed openstack/tooz: Make all locks operate the same when fetched from different coordinators https://review.openstack.org/252115 | 19:07 |
*** ihrachys has quit IRC | 19:09 | |
dims | lifeless : yay thanks! | 19:24 |
*** gordc has quit IRC | 19:26 | |
openstackgerrit | Merged openstack/oslo.vmware: Overwrite VMwareDriverException message https://review.openstack.org/258266 | 19:30 |
*** e0ne has quit IRC | 19:34 | |
*** cdent has quit IRC | 19:40 | |
*** ozamiatin_ has joined #openstack-oslo | 19:42 | |
mkovacik | harlowja, hi, can I bother you a bit ;) | 19:54 |
harlowja | mkovacik sureee | 19:54 |
harlowja | where do we begin! | 19:55 |
harlowja | lol | 19:55 |
mkovacik | great :) | 19:55 |
mkovacik | uff, not quite sure | 19:55 |
harlowja | :) | 19:55 |
*** jeckersb is now known as jeckersb_gone | 19:55 | |
mkovacik | harlowja, how would you suggest to best incorporate the state transitions I need with task flow? | 19:55 |
mkovacik | I mean with the loops and external events ant timeouts/retries... | 19:56 |
harlowja | so the loops stuff i think can be handled if we dare | 19:56 |
harlowja | the timeouts and retries and stuff i still sorta don't understand why they are external :-P | 19:57 |
*** lucasagomes is now known as lucas-dinner | 19:57 | |
harlowja | maybe let me throw an idea out :-P | 19:57 |
mkovacik | ok | 19:57 |
harlowja | correct me if i'm wrong here | 19:57 |
harlowja | but introspection is basically a workflow of a bunch of steps right | 19:57 |
mkovacik | true | 19:57 |
*** jecarey_ has joined #openstack-oslo | 19:58 | |
harlowja | and the desire is to make some part of that workflow async and some part of it not | 19:59 |
harlowja | but for now let's consider it as a sync workflow, that basically gets processed by a worker somewhere | 20:00 |
harlowja | that worker goes through steps Starting -> Waiting -> Processing -> Finishing -> Finished right? | 20:00 |
harlowja | from a simplistic view thats the steps its doing for each workflow | 20:00 |
*** salv-orl_ has quit IRC | 20:01 | |
*** jecarey_ has quit IRC | 20:01 | |
*** jecarey_ has joined #openstack-oslo | 20:01 | |
harlowja | (thats the steps each worker would be doing) | 20:01 |
*** jecarey has quit IRC | 20:01 | |
mkovacik | harlowja, the Waiting state requires the bare metal node to confirm by a Continue event | 20:01 |
harlowja | ok | 20:02 |
mkovacik | then the rest of the steps can proceed | 20:02 |
harlowja | Starting -> Waiting_For_Confirm -> Processing -> Finishing -> Finished | 20:02 |
harlowja | like ^ right | 20:02 |
harlowja | ? | 20:02 |
mkovacik | yeah | 20:02 |
harlowja | so let's consider the thing here ((Starting -> Waiting_For_Confirm -> Processing -> Finishing -> Finished), the node to do it on), lets give that a name | 20:04 |
harlowja | for usefulness, workflow+node seems good | 20:04 |
mkovacik | right, or introspection job for a node_id | 20:05 |
harlowja | sure | 20:05 |
*** cdent has joined #openstack-oslo | 20:06 | |
harlowja | so the majority of complexity of the rest of that spec then becomes how to make that workflow 100% async in a way that works out | 20:06 |
mkovacik | ok | 20:07 |
harlowja | when i start to wonder if perhaps u just treat 1 worker as owning that workflow (and progressing through it) would that be much simpler (and more likely to work out) | 20:08 |
harlowja | now if that 1 worker crashes, thats ok, another worker can pick it back up and start it up | 20:08 |
harlowja | *this is pretty much what taskflow specializes in | 20:08 |
harlowja | the HA Worker in that spec is basically the equivalent of http://docs.openstack.org/developer/taskflow/conductors.html | 20:09 |
harlowja | and the introspection job for a node_id named above is basically http://docs.openstack.org/developer/taskflow/jobs.html | 20:10 |
harlowja | the difference is that taskflow's concept is 1 'conductor' (HA worker) owns/tracks the whole workflow until it completes | 20:11 |
mkovacik | ok | 20:11 |
mkovacik | so if it is possible to route the continue request to that worker, it could be a flow | 20:11 |
mkovacik | (or cancel request ) | 20:12 |
harlowja | so we'd have to work on that, but yes, depending on how those requests arrive and from where | 20:12 |
harlowja | basically those are just job cancel and job continue generic concepts | 20:13 |
harlowja | just have to figure out how to plumb them in | 20:13 |
mkovacik | ideally that would be without handling the state outside of taskflow | 20:13 |
harlowja | right | 20:13 |
harlowja | this also imho has the benefit of cleanly seperating the job and execution/scheduliing transitions from the workflow transitions | 20:15 |
harlowja | that spec has merged them all together a little (for better or worse) | 20:15 |
harlowja | in that the workflow transitions are really (Starting -> Waiting_For_Confirm -> Processing -> Finishing -> Finished) | 20:15 |
harlowja | and then it also has to merge the handling of sigint and all that (which are app level concerns) | 20:16 |
mkovacik | ... yeah, that would stem from the fact I wanted to maintain the state decentralised but execute 1 transition per worker... | 20:17 |
harlowja | right | 20:17 |
harlowja | which i totally get, its very very decentralized | 20:17 |
harlowja | for better or worse :) | 20:17 |
mkovacik | heh :) | 20:17 |
mkovacik | where's the emphasise I wonder ;) | 20:18 |
harlowja | but i then start to wonder if it should go to 1 ha worker (conductor), 1 workflow and then scale out that way | 20:18 |
harlowja | 1 ha worker (conductor), N workflows (threads...) | 20:18 |
harlowja | complete decomposition of all things vs decomposition at the 'introspection job for a node_id' level | 20:19 |
harlowja | i personally think decomposition at the 'introspection job for a node_id' level will be easier to thing about, but i get the other approach to | 20:19 |
harlowja | *think about | 20:19 |
mkovacik | ideally, there would be some interleaving, because of the continue call takes ~10 minutes to arrive | 20:19 |
harlowja | right | 20:20 |
mkovacik | quite a lot for a worker to get partitioned | 20:20 |
mkovacik | or to do nothing but sleep | 20:20 |
harlowja | which is why i think we can probably not to hard do that interleaving | 20:20 |
harlowja | with a simple addition to taskflow to say drop a job into 'waiting' state until well it gets signaled to be ready again | 20:21 |
harlowja | *taskflow job concept | 20:21 |
harlowja | i'm pretty sure others want a similar concept :-P | 20:21 |
mkovacik | or canceled | 20:21 |
mkovacik | 100*100% sure | 20:21 |
harlowja | ya, | 20:21 |
harlowja | lol | 20:21 |
harlowja | 1million% sure | 20:21 |
harlowja | ha | 20:21 |
harlowja | soooo that's some stuff to think about imho | 20:22 |
harlowja | the ultimate decision is the inspector folks (which includes u) | 20:22 |
harlowja | i like the interleving at job level + a continue addition | 20:23 |
mkovacik | same here | 20:23 |
harlowja | but i get the desire to do full decomposition of all the things | 20:23 |
harlowja | ^ its an interesting thing to try (full on decompsition of all the things) | 20:23 |
harlowja | although i'm not sure i would want to debug it :-P | 20:23 |
harlowja | ^ such a thing probably needs a whole new way of debugging, ha | 20:24 |
harlowja | *distributed debugger ftw, ha | 20:24 |
harlowja | anyways, there u go :) | 20:24 |
harlowja | my 3 cents, ha | 20:25 |
mkovacik | i guess you don't have anything like that debugger hidden around ;) | 20:25 |
harlowja | mkovacik if u jump in #openstack-state-management u can poke others that are using that job concept and all the rest of these to | 20:25 |
mkovacik | thanks a lot, much appreciate all the input | 20:25 |
harlowja | rackspace folks, some openstack projects are using this thing (and they would probably like that continue/wait thing, ha) | 20:25 |
harlowja | *if u want to know how it has worked out for folks | 20:25 |
harlowja | *not all of them are in this channel | 20:26 |
mkovacik | I sure do | 20:26 |
*** jeckersb_gone is now known as jeckersb | 20:26 | |
harlowja | cools | 20:26 |
*** e0ne has joined #openstack-oslo | 20:27 | |
harlowja | hopefully all of this made some sense btw :-P | 20:27 |
harlowja | ha | 20:27 |
mkovacik | harlowja, thanks a lot, really great to have someone to read through the spec and talk about it | 20:27 |
mkovacik | yeah | 20:27 |
mkovacik | it did :D | 20:27 |
mkovacik | I had one more concern, but forgotten about it :D | 20:27 |
harlowja | :) | 20:28 |
harlowja | well when u remember, let me know, ha | 20:28 |
mkovacik | I'll try to remember, thanks again | 20:28 |
harlowja | np | 20:28 |
mkovacik | ah, got it now, exclusivity of the bare metal node; up-to-single worker can perform the introspection, I guess holding locks for 10 mins isn't cool | 20:31 |
mkovacik | harlowja, ^ | 20:32 |
harlowja | so this is basically needing a lock around (Starting -> Waiting_For_Confirm -> Processing -> Finishing -> Finished) | 20:32 |
harlowja | ? | 20:32 |
mkovacik | yes | 20:33 |
mkovacik | it does | 20:33 |
*** fhermeni has joined #openstack-oslo | 20:33 | |
harlowja | so is that good or bad? | 20:33 |
*** regXboi has joined #openstack-oslo | 20:33 | |
fhermeni | hi there | 20:33 |
harlowja | mkovacik i guess if one is needed, then hold it :-P | 20:33 |
harlowja | if thats 10 minutes, then i guess so bet it :-/ | 20:33 |
harlowja | *so be it | 20:33 |
harlowja | fhermeni yo | 20:33 |
harlowja | mkovacik the lock could be released after Starting and reacquired at Processing | 20:34 |
mkovacik | harlowja, the locks just have to be there no matter what :) yeah, no other way I guess. | 20:34 |
harlowja | if u gotta lock it, then i guess u gotta lock it, ha | 20:34 |
*** pratikma_ is now known as pratikmallya | 20:35 | |
mkovacik | won't work, with releasing in the middle, race condition with other worker | 20:35 |
harlowja | k | 20:35 |
mkovacik | well, locks are inevitable | 20:35 |
harlowja | so if a job is worked on by only one worker at a time | 20:35 |
harlowja | 1 ha worker/conductor | 20:35 |
harlowja | then well the job itself is the lock | 20:35 |
harlowja | *owning the job is the lock | 20:35 |
harlowja | which is pretty much what the api @ http://docs.openstack.org/developer/taskflow/jobs.html#taskflow.jobs.base.JobBoard.claim does | 20:36 |
mkovacik | so the user can't request 2 parallel introspections for same node? | 20:36 |
*** regXboi has quit IRC | 20:37 | |
harlowja | depends on how jobs are formed, each job has a name, the name becomes the primary thing u can only have 1 of | 20:37 |
harlowja | formed/posted | 20:37 |
harlowja | http://docs.openstack.org/developer/taskflow/jobs.html#taskflow.jobs.base.JobBoard.post | 20:37 |
harlowja | so u could make that name the node name, and then it wouldn't be able to have 2 jobs at once | 20:38 |
harlowja | or u could make it something else and then allow 2+ parallel to happen | 20:38 |
harlowja | ^ which would then require other locking somewhere else | 20:38 |
harlowja | *something else like a random uuid() | 20:40 |
mkovacik | harlowja, that seems to be the key, naming it with the node_id, I definitely need some time to process this | 20:40 |
harlowja | np | 20:40 |
harlowja | your brain buffer is full :-P | 20:40 |
harlowja | ha | 20:40 |
harlowja | that happens to me sometimes, ha | 20:40 |
mkovacik | harlowja, thanks a lot for filling my brain buffer :D | 20:40 |
harlowja | lol | 20:40 |
harlowja | hahaha | 20:40 |
harlowja | np | 20:40 |
openstackgerrit | Joshua Harlow proposed openstack/tooz: Spice up the driver summary/info page https://review.openstack.org/258630 | 20:47 |
*** gordc has joined #openstack-oslo | 20:48 | |
harlowja | fhermeni vilobhmm11 if u haven't met (more super-scheduling coauthors) | 20:50 |
harlowja | super super | 20:50 |
fhermeni | hi vilobhmm11 | 20:50 |
fhermeni | vilobhmm11: I just replied to your point by a comment. When I browse nova issue tracker I see a lot of bugs that seem to be related to eventual consistency issues | 20:52 |
*** jecarey_ has quit IRC | 20:52 | |
vilobhmm11 | fhermeni : hello! thanks harlowja for the introduction | 20:54 |
harlowja | :) | 20:54 |
vilobhmm11 | fhermeni : cool if you have an etherpad with the link to all those bugs | 20:54 |
*** cprmrf__ has joined #openstack-oslo | 20:54 | |
*** jecarey has joined #openstack-oslo | 20:54 | |
vilobhmm11 | fhermeni : should be good to add as a reference in the spec IMHO and that should be helpful to jot down current scheduling issues | 20:55 |
fhermeni | vilobhmm11: of course I don’t have one. I browsed them a day because I want to study some kind of bugs but that stopped there | 20:56 |
*** cprmrf has quit IRC | 20:56 | |
vilobhmm11 | fhermeni : will get back to you comment by eod | 20:56 |
fhermeni | vilobhmm11: from what I read, the current issues look more related to implementation bugs and a few unconsistencies (like manual operation that may or may no bypass a scheduler) | 20:57 |
fhermeni | vilobhmm11: so they seem not to be solvable through the spec | 20:57 |
fhermeni | harlowja: you said nova initially relied on a central view ? | 20:58 |
harlowja | fhermeni time before time | 20:58 |
harlowja | there was only one project :-P | 20:59 |
harlowja | well sorry 2 | 20:59 |
harlowja | swift and nova | 20:59 |
harlowja | so at that point nova did know about all of its things | 20:59 |
fhermeni | harlowja: ok. Indeed it is not surprising to have scalability as an issue | 20:59 |
harlowja | scalability from many different aspects was i think why nova started to split also | 21:00 |
fhermeni | harlowja: I speak a bit with cdupont from watcher today | 21:00 |
harlowja | cool | 21:00 |
fhermeni | harlowja: he proposed kind of a spec for their watcher. Basically a copy/paste of BtrPlace | 21:00 |
harlowja | interesting | 21:01 |
fhermeni | harlowja: I will try to attend their next wednesday meeting to talk to them about our initiative more directly | 21:01 |
vilobhmm11 | fhermeni : BtrPlace whats that ? | 21:01 |
harlowja | sounds like u will have more convserations with watcher people :-P | 21:01 |
harlowja | vilobhmm11 http://www.btrplace.org/ | 21:01 |
harlowja | butterplace | 21:02 |
harlowja | or betterplace (idk) | 21:02 |
harlowja | ha | 21:02 |
vilobhmm11 | cools | 21:02 |
harlowja | depends on how u want to pronouce it, ha | 21:02 |
fhermeni | harlowja: the thing is that a few of them (the whole create-net team) work with me inside the EU project DC4Cities: http://www.dc4cities.eu/en/ | 21:02 |
harlowja | ah | 21:02 |
harlowja | cool | 21:02 |
fhermeni | harlowja: better ;) | 21:02 |
harlowja | :) | 21:02 |
*** amrith is now known as _amrith_ | 21:03 | |
fhermeni | harlowja: and I will be a reviewer of a Phd. between b com the startup behind watcher and Inria Rennes | 21:03 |
* harlowja was thinking about a butter castle, ha | 21:03 | |
fhermeni | harlowja: :D | 21:03 |
harlowja | fhermeni cools, nice nice | 21:03 |
*** salv-orl_ has joined #openstack-oslo | 21:06 | |
openstackgerrit | Joshua Harlow proposed openstack/tooz: Spice up the driver summary/info page https://review.openstack.org/258630 | 21:06 |
fhermeni | harlowja: so, back to the spec. It seems to me that if we put the storage layer aside, there is enough to discuss with other project-schedulers to see what they already support and check if the spec is then complete enough | 21:06 |
harlowja | agreed | 21:06 |
harlowja | the earlier we start trying to see how others feel about this the better | 21:07 |
fhermeni | harlowja: as I said earlier, « You’re the gu y" | 21:07 |
fhermeni | harlowja: :D | 21:07 |
harlowja | maybe once vilobhmm11 finishes out his little analysis section we can try to disperse this outwards | 21:07 |
harlowja | fhermeni haha | 21:07 |
fhermeni | harlowja: k | 21:07 |
fhermeni | harlowja: aside, for fun, I will try to write a spec parser to feed btrplace. like a « conceptual proof of concept » CPOC | 21:08 |
harlowja | ?? | 21:09 |
harlowja | btrplace requires feeding? | 21:09 |
harlowja | lol | 21:09 |
fhermeni | harlowja: http://www.btrplace.org/play/ but with the spec as input instead of my DSL | 21:09 |
harlowja | ah | 21:10 |
harlowja | neat | 21:10 |
harlowja | is all that client side? | 21:11 |
fhermeni | just the solution computation is made on a server | 21:11 |
harlowja | k | 21:11 |
harlowja | neat | 21:12 |
fhermeni | harlowja: I made that during a project review :D. The benefit to come at a review without having to say a word :D | 21:12 |
vilobhmm11 | harlowja : sure.. | 21:12 |
harlowja | fhermeni ya, i'm trying to figure out the grammar ha | 21:13 |
harlowja | then i'll calculate pi with that, ha | 21:13 |
harlowja | haha | 21:13 |
*** kgiusti has quit IRC | 21:23 | |
*** mkovacik has quit IRC | 21:32 | |
*** browne has quit IRC | 21:36 | |
*** haypo has left #openstack-oslo | 21:40 | |
*** browne has joined #openstack-oslo | 21:41 | |
dims | harlowja : other oslo cores, please vote - https://review.openstack.org/#/c/259169/ | 21:43 |
*** gordc has quit IRC | 21:57 | |
*** jecarey has quit IRC | 22:04 | |
*** jecarey has joined #openstack-oslo | 22:04 | |
*** jecarey has quit IRC | 22:04 | |
*** jecarey has joined #openstack-oslo | 22:05 | |
*** jecarey has quit IRC | 22:05 | |
*** alejandrito has joined #openstack-oslo | 22:32 | |
*** wusWWW has joined #openstack-oslo | 22:34 | |
wusWWW | @all: Hi all, not sure whether this is the right place to ask ... can anyone shed some light on internalization on the comment in the yaml file? | 22:36 |
*** rohit_ has quit IRC | 22:41 | |
openstackgerrit | Joshua Harlow proposed openstack/tooz: Add basic file content schema validation https://review.openstack.org/259206 | 22:41 |
*** rohit_ has joined #openstack-oslo | 22:43 | |
*** e0ne has quit IRC | 22:47 | |
*** pradk has quit IRC | 22:53 | |
openstackgerrit | Joshua Harlow proposed openstack/taskflow: Some additional engine logging https://review.openstack.org/258746 | 23:02 |
*** cprmrf__ has quit IRC | 23:13 | |
*** fhermeni has quit IRC | 23:14 | |
openstackgerrit | Lianhao Lu proposed openstack/oslo.log: Set keystoneauth default log level to WARN https://review.openstack.org/259218 | 23:23 |
*** jaypipes has quit IRC | 23:47 | |
*** pratikmallya has quit IRC | 23:51 | |
*** cdent has quit IRC | 23:53 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!