mathiasb | tdasilva: great! | 00:13 |
---|---|---|
*** itlinux has quit IRC | 00:17 | |
*** vikram has quit IRC | 00:40 | |
*** ukaynar has joined #openstack-swift | 00:45 | |
kota_ | morning | 00:51 |
kota_ | timburke: nice to see that isa_l_rs_cauchy dlean | 00:52 |
kota_ | clean | 00:52 |
*** kiennt has joined #openstack-swift | 00:57 | |
*** itlinux has joined #openstack-swift | 01:01 | |
*** vinsh has quit IRC | 01:28 | |
*** frank_young has joined #openstack-swift | 01:30 | |
*** frank_young has quit IRC | 01:30 | |
*** frank_young has joined #openstack-swift | 01:30 | |
*** vinsh has joined #openstack-swift | 01:32 | |
*** itlinux has quit IRC | 01:49 | |
*** vint_bra has joined #openstack-swift | 01:49 | |
*** itlinux has joined #openstack-swift | 02:04 | |
*** cschwede has joined #openstack-swift | 02:55 | |
*** ChanServ sets mode: +v cschwede | 02:55 | |
*** vint_bra has quit IRC | 02:57 | |
*** cschwede_ has quit IRC | 02:57 | |
*** Sukhdev has joined #openstack-swift | 03:14 | |
*** xrb_ has joined #openstack-swift | 03:23 | |
*** xrb has quit IRC | 03:26 | |
*** gkadam has joined #openstack-swift | 03:48 | |
*** hoonetorg has joined #openstack-swift | 04:32 | |
*** SkyRocknRoll has joined #openstack-swift | 04:36 | |
*** SkyRocknRoll has quit IRC | 04:43 | |
*** psachin has joined #openstack-swift | 04:49 | |
*** rcernin has quit IRC | 05:22 | |
*** Sukhdev has quit IRC | 05:26 | |
*** ukaynar has quit IRC | 05:30 | |
*** rcernin has joined #openstack-swift | 05:36 | |
*** cshastri has joined #openstack-swift | 05:41 | |
*** kiennt has quit IRC | 05:44 | |
*** kiennt has joined #openstack-swift | 06:03 | |
*** klrmn has quit IRC | 06:06 | |
*** geaaru has joined #openstack-swift | 06:09 | |
*** ChubYann has quit IRC | 06:15 | |
*** psachin has quit IRC | 06:16 | |
*** sgundur1 has quit IRC | 06:35 | |
*** links has joined #openstack-swift | 06:37 | |
*** sgundur| has quit IRC | 06:38 | |
*** rcernin has quit IRC | 06:58 | |
*** rcernin has joined #openstack-swift | 06:58 | |
*** sgundur has quit IRC | 07:08 | |
*** ntata has quit IRC | 07:08 | |
*** mmotiani has quit IRC | 07:08 | |
*** psachin has joined #openstack-swift | 07:13 | |
*** tesseract has joined #openstack-swift | 07:16 | |
*** abhitechie has joined #openstack-swift | 07:23 | |
xrb_ | good morning | 07:26 |
*** itlinux has quit IRC | 07:26 | |
xrb_ | is there a way to make a env['wsgi.input'] seekable (from a Swift middleware)? | 07:33 |
xrb_ | (I am relying on a lib which performs a seek) | 07:34 |
acoles | good morning | 07:42 |
openstackgerrit | Hangdong Zhang proposed openstack/python-swiftclient master: Update the documentation link for doc migration https://review.openstack.org/486029 | 07:44 |
kota_ | acoles: morning | 07:55 |
acoles | kota_: thanks for more review | 08:07 |
acoles | kota_: how was the openstack tokyo event? | 08:07 |
kota_ | acoles: it was good and in fact, it's 2days event so im still on | 08:09 |
kota_ | acoles: and sorry i'm still under consideration for that patch | 08:12 |
acoles | kota_: NP I can see that you and timburke would both prefer a different encapsulation | 08:13 |
xrb_ | (re seekable body, found it, just call req.make_body_seekable() :) ) | 08:14 |
acoles | tdasilva: re patch 485569 let me know if you think I should make the s/rebalance/reconstruction/ changes you pointed out - I'm happy to do it but holding off because it was the text I inherited from object-server.conf-sample. | 08:21 |
patchbot | https://review.openstack.org/#/c/485569/ - swift - Add reconstructor section to deployment guide | 08:21 |
acoles | I am going to continue looking at patch 478416 first today | 08:23 |
patchbot | https://review.openstack.org/#/c/478416/ - swift - Add multiple worker processes strategy to reconstr... | 08:23 |
*** kiennt has quit IRC | 09:53 | |
*** geaaru_ has joined #openstack-swift | 09:58 | |
*** geaaru has quit IRC | 10:01 | |
*** abhinavtechie has joined #openstack-swift | 10:04 | |
*** abhitechie has quit IRC | 10:04 | |
*** abhinavtechie has quit IRC | 10:11 | |
*** abhitechie has joined #openstack-swift | 10:11 | |
*** abhitechie has quit IRC | 10:42 | |
*** abhitechie has joined #openstack-swift | 10:43 | |
*** abhitechie has quit IRC | 10:50 | |
*** murphy has joined #openstack-swift | 11:00 | |
*** abhitechie has joined #openstack-swift | 11:00 | |
*** ^andrea^ has joined #openstack-swift | 11:03 | |
*** abhitechie has quit IRC | 11:04 | |
*** abhitechie has joined #openstack-swift | 11:07 | |
*** hieulq has quit IRC | 11:09 | |
*** abhitechie has quit IRC | 11:10 | |
*** abhitechie has joined #openstack-swift | 11:11 | |
*** abhitechie has quit IRC | 11:17 | |
*** murphy has quit IRC | 11:25 | |
*** abhitechie has joined #openstack-swift | 11:30 | |
*** murphy has joined #openstack-swift | 11:37 | |
*** murphy has quit IRC | 11:56 | |
*** gkadam has quit IRC | 12:29 | |
*** abhitechie has quit IRC | 13:02 | |
*** abhitechie has joined #openstack-swift | 13:14 | |
*** abhitechie has quit IRC | 13:16 | |
*** catintheroof has joined #openstack-swift | 13:25 | |
*** catinthe_ has joined #openstack-swift | 13:26 | |
*** catintheroof has quit IRC | 13:30 | |
*** vint_bra has joined #openstack-swift | 13:33 | |
*** lucasxu has joined #openstack-swift | 13:37 | |
*** links has quit IRC | 13:43 | |
tdasilva | acoles: good morning | 14:01 |
acoles | tdasilva: o/ | 14:01 |
tdasilva | acoles: +A'd both | 14:01 |
tdasilva | I think rebalance is fine | 14:02 |
acoles | tdasilva: great! thanks. that means we can document reconstructor_workers in patch 478416 :) | 14:02 |
patchbot | https://review.openstack.org/#/c/478416/ - swift - Add multiple worker processes strategy to reconstr... | 14:02 |
tdasilva | acoles: will try to take a look at that patch | 14:03 |
acoles | tdasilva: that would be great. I have a few fixes that I will be pushing over later today. | 14:04 |
*** psachin has quit IRC | 14:06 | |
*** frank_young has quit IRC | 14:09 | |
*** SkyRocknRoll has joined #openstack-swift | 14:27 | |
*** frank_young has joined #openstack-swift | 14:35 | |
*** cshastri has quit IRC | 14:44 | |
xrb_ | what is the best practice to do this: in a Swift middleware, I would like to fire another request against Swift (e.g. to save some derived data when e.g. doing a PUT). | 14:47 |
xrb_ | In addition to using an eventlet.posthooks (for async post processing), what is the best way to fire a request to Swift? Directly with an HTTP lib (like requests) or is there a shortcut? | 14:47 |
tdasilva | xrb_: take a look and copy and versioning middleware | 14:48 |
tdasilva | slo, dlo, bulk, i think they all fire off requests | 14:49 |
tdasilva | xrb_: the gotchas are typically whether that request should be auth'd again or not and also making sure to close connections on failures | 14:50 |
xrb_ | tdasilva: nice.. will check them.. thx! | 14:54 |
*** hoonetorg has quit IRC | 15:05 | |
*** itlinux has joined #openstack-swift | 15:11 | |
*** rcernin has quit IRC | 15:14 | |
*** SkyRocknRoll has quit IRC | 15:25 | |
*** SkyRocknRoll has joined #openstack-swift | 15:26 | |
clayg | timburke: acoles: not immediately clear to me why max_devices_per_worker should obviously change from background to foreground execution (iff you use override devices) - but my heads not really in the game. | 15:36 |
clayg | All the other nits and stuff seem like obvious improvements- thanks for taking up the torch. | 15:37 |
acoles | clayg: max_devices_per_worker should be calculated based on the number of devices being reconstructed, which may be fewer than all_local_devices if override devices are passed in ? | 15:40 |
openstackgerrit | Alistair Coles proposed openstack/swift master: fixup for get_worker_args https://review.openstack.org/486167 | 15:43 |
acoles | clayg: something like this ^^ ? | 15:44 |
acoles | clayg: but, you're on vacation! | 15:44 |
*** ukaynar has joined #openstack-swift | 15:48 | |
* clayg shrugs | 15:59 | |
clayg | So if I have 24 devs and workers 12 in my conf. How many devs do my workers get when I override with 4 devs? I'm not sure what's easiest for ops. | 16:00 |
*** itlinux has quit IRC | 16:03 | |
notmyname | good morning | 16:12 |
timburke | good morning | 16:14 |
acoles | clayg: I think you get 12 workers. The first 4 having one dev each. The rest get no override_devices which I think means they reconstruct all devices. | 16:19 |
acoles | is that right?!? I've been staring at this so long | 16:20 |
clayg | Lol. My intention was workers still get 2 devs - so only two workers. A worker with no devs is super wrong 🙂 | 16:21 |
acoles | with the change I proposed you'd get 4 workers with one dev each. but without overrides you'd have 12 workers with 2 devs each. | 16:21 |
clayg | So it sounds like y'all are all over it. | 16:21 |
clayg | I'll go back to vacation. | 16:21 |
acoles | clayg: right, that was what just dawned on me - is the goal to have same #devs per worker with or without overrides? - seems like if you are using overrides to empty some devices you might like it using as many 'somewhat-uniformly-loaded' workers as possible, but yeah I can see that conflicts with achieving uniform load w.r.t. the background all devices daemon. | 16:23 |
acoles | clayg: sit back, grab a beer, soak up the sun, we'll try do something sane :) | 16:24 |
*** cschwede has quit IRC | 16:25 | |
*** itlinux has joined #openstack-swift | 16:29 | |
*** JimCheung has joined #openstack-swift | 16:31 | |
*** itlinux has quit IRC | 16:31 | |
notmyname | xrb_: oh hi | 16:43 |
*** xrb has joined #openstack-swift | 16:58 | |
xrb | regarding using eventlet.posthooks in a middleware: do I need to activate smth in order for them to be executed? (e.g. in proxy-server.conf) | 17:02 |
notmyname | smth? | 17:02 |
xrb | Like an option in the proxy server config file... | 17:04 |
xrb | Playing with them, but currently not executed.. | 17:04 |
notmyname | when are you installing the posthool | 17:05 |
notmyname | *posthook | 17:05 |
-openstackstatus- NOTICE: Restarting Gerrit for our weekly memory leak cleanup. | 17:06 | |
xrb | Like here, in the __call__ method: https://github.com/rovanleeuwen/informant-old/blob/master/informant/middleware.py | 17:07 |
*** ukaynar has quit IRC | 17:07 | |
*** klrmn has joined #openstack-swift | 17:11 | |
notmyname | that looks right. but you're not seeing the hook called? | 17:12 |
*** xrb has quit IRC | 17:12 | |
*** xrb has joined #openstack-swift | 17:12 | |
*** gkadam has joined #openstack-swift | 17:12 | |
xrb | Will check again on Monday to be sure.. | 17:13 |
*** xrb has quit IRC | 17:16 | |
*** ukaynar has joined #openstack-swift | 17:19 | |
*** SkyRocknRoll has quit IRC | 17:21 | |
openstackgerrit | Merged openstack/swift master: Add reconstructor section to deployment guide https://review.openstack.org/485569 | 17:22 |
openstackgerrit | Merged openstack/swift master: Add more structure to the deployment guide https://review.openstack.org/485570 | 17:24 |
acoles | yay | 17:24 |
*** xrb has joined #openstack-swift | 17:27 | |
*** xrb has quit IRC | 17:30 | |
*** SkyRocknRoll has joined #openstack-swift | 17:36 | |
acoles | timburke: once patch 485569 makes it to gerrit I'll rebase the multi proc reconstructor patches | 17:40 |
patchbot | https://review.openstack.org/#/c/485569/ - swift - Add reconstructor section to deployment guide (MERGED) | 17:40 |
acoles | ugh s/gerrit/github/ | 17:46 |
*** Sukhdev has joined #openstack-swift | 17:48 | |
*** ukaynar has quit IRC | 17:58 | |
*** ukaynar_ has joined #openstack-swift | 18:02 | |
openstackgerrit | Tim Burke proposed openstack/swift master: WIP: Move listing formatting out to proxy middleware https://review.openstack.org/449394 | 18:05 |
openstackgerrit | John Dickinson proposed openstack/python-swiftclient master: merged openstack-manuals content with existing content https://review.openstack.org/486189 | 18:09 |
timburke | notmyname: on ^^, do we want/need it before the release? | 18:11 |
notmyname | timburke: the docs change? | 18:12 |
timburke | ya | 18:12 |
notmyname | yes we do | 18:12 |
timburke | k | 18:12 |
notmyname | here's the story with that one | 18:12 |
notmyname | (and I'm waiting on the docs build to look at it) | 18:12 |
notmyname | there's only one file in openstack-manuals that needs to "move" to swiftclient docs | 18:13 |
notmyname | but we already have/had the same sort of content in swiftclient | 18:13 |
notmyname | which is good, but of course they aren't the same | 18:13 |
notmyname | and one is not obviously better than the other IMO | 18:13 |
notmyname | but parts of each are obviously better than the other IMO | 18:13 |
notmyname | so I went through the -manuals one and grabbed the good parts and merged that with what's existing in swiftclient | 18:14 |
notmyname | ...and of course the diff view in gerrit is rather terrible for reflecting that | 18:15 |
notmyname | here, this is better (ie using newer git diff algorithm) https://gist.github.com/notmyname/4f15f014ece2501dcc79fffc8e819a9c | 18:16 |
notmyname | timburke: ^ | 18:16 |
notmyname | it's not perfect, but at least it's not "added a bunch! deleted a bunch!" | 18:17 |
notmyname | hmm... that one may actually be worse. | 18:17 |
timburke | yeah, i think no matter what, it's going to take a bit to digest the diff | 18:18 |
timburke | hopefully having the existing and newly-built docs side-by-side will be a little easier? | 18:19 |
notmyname | to create it, I had a copy of the file from -manuals open and the client file open. I went through the -manuals as a source, and move over blocks of lines to the existing docs | 18:19 |
timburke | don't get me wronge, i think it's great that we're doing it and i have no doubt you picked the best parts of both. but i've got other things i need to review first... | 18:19 |
notmyname | `git diff` doesn't seem to understand how I created it ;-) | 18:19 |
notmyname | I'm hoping to land all the docs migration stuff this afternoon (in part with the idea of, "done with cross-project thing, we'll improve it as we go") | 18:20 |
notmyname | but also because the docs migrations stuff must be in pike, and the die date for a pike release of swiftclient is wednesday or soemthing (ie this release that we're doing now) | 18:21 |
notmyname | ... and I'll rebase the authors/changelog patches on top of the docs migration ones after they land | 18:21 |
notmyname | ...and the few other patches we're waiting on | 18:22 |
*** frank_young has quit IRC | 18:29 | |
*** frank_young has joined #openstack-swift | 18:39 | |
-openstackstatus- NOTICE: docs.o.o is currently broken, we're investigating | 18:40 | |
*** SkyRocknRoll has quit IRC | 18:41 | |
*** frank_young has quit IRC | 18:43 | |
*** gkadam has quit IRC | 18:44 | |
*** JimCheung has quit IRC | 18:50 | |
*** JimCheung has joined #openstack-swift | 19:06 | |
openstackgerrit | Alistair Coles proposed openstack/swift master: fixup for get_worker_args https://review.openstack.org/486167 | 19:06 |
openstackgerrit | Alistair Coles proposed openstack/swift master: Add multiple worker processes strategy to reconstructor https://review.openstack.org/478416 | 19:06 |
openstackgerrit | Alistair Coles proposed openstack/swift master: fixup make run_once in a worker process dump to recon https://review.openstack.org/486205 | 19:06 |
*** tonanhngo has joined #openstack-swift | 19:07 | |
*** JimCheung has quit IRC | 19:10 | |
*** ChubYann has joined #openstack-swift | 19:17 | |
acoles | timburke: I'm done for now ^^ | 19:22 |
acoles | timburke: please squash whatever you see fit, thanks | 19:22 |
timburke | acoles: thanks! will do | 19:26 |
acoles | timburke: BTW I think i figured how to get the override devices scenario to spread over workers in similar way to all devices, as I think clayg intended, in get_worker_args() - added some comments so it should be obvious. That's in patch 486167. | 19:28 |
patchbot | https://review.openstack.org/#/c/486167/ - swift - fixup for get_worker_args | 19:28 |
*** catinthe_ has quit IRC | 19:58 | |
*** saint_ has quit IRC | 20:01 | |
notmyname | timburke: http://docs-draft.openstack.org/89/486189/1/check/gate-python-swiftclient-docs-ubuntu-xenial/b72c0fe//doc/build/html/cli.html lgtm | 20:04 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements https://review.openstack.org/88736 | 20:05 |
*** JimCheung has joined #openstack-swift | 20:07 | |
*** JimCheung has quit IRC | 20:11 | |
*** MVenesio has quit IRC | 20:30 | |
*** JimCheung has joined #openstack-swift | 20:46 | |
*** ukaynar_ has quit IRC | 20:58 | |
*** ukaynar has joined #openstack-swift | 21:01 | |
openstackgerrit | Alistair Coles proposed openstack/swift master: Ring rebalance respects co-builders' last_part_moves https://review.openstack.org/477000 | 21:13 |
openstackgerrit | Alistair Coles proposed openstack/swift master: Ring rebalance respects co-builders' last_part_moves https://review.openstack.org/477000 | 21:20 |
*** frank_young has joined #openstack-swift | 21:21 | |
*** frank_young has quit IRC | 21:26 | |
acoles | kota_: timburke: ^^ I hope that's closer, it's late here and I have tired eyes so hope I haven't missed anything. thanks for your suggestions. | 21:27 |
acoles | kota_: FYI I am out on Monday, back Tuesday | 21:27 |
openstackgerrit | Merged openstack/swift master: Replace dict.iteritems with six.iteritems https://review.openstack.org/341988 | 21:37 |
openstackgerrit | Alistair Coles proposed openstack/swift master: fixup make run_once in a worker process dump to recon https://review.openstack.org/486205 | 21:40 |
*** lucasxu has quit IRC | 21:51 | |
*** MVenesio has joined #openstack-swift | 22:12 | |
*** MVenesio has quit IRC | 22:12 | |
*** Sukhdev has quit IRC | 22:17 | |
*** frank_young has joined #openstack-swift | 22:20 | |
*** JimCheung has quit IRC | 22:23 | |
*** frank_young has quit IRC | 22:24 | |
*** tesseract has quit IRC | 22:25 | |
*** vint_bra has quit IRC | 22:26 | |
*** JimCheung has joined #openstack-swift | 22:42 | |
*** ukaynar has quit IRC | 22:43 | |
*** MVenesio has joined #openstack-swift | 22:57 | |
*** MVenesio has quit IRC | 22:58 | |
openstackgerrit | Merged openstack/swift master: moved install guide and removed tox env definition https://review.openstack.org/481714 | 23:21 |
*** frank_young has joined #openstack-swift | 23:38 | |
*** frank_young has quit IRC | 23:43 | |
*** JimCheung has quit IRC | 23:47 | |
*** catintheroof has joined #openstack-swift | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!