Friday, 2017-07-21

mathiasbtdasilva: great!00:13
*** itlinux has quit IRC00:17
*** vikram has quit IRC00:40
*** ukaynar has joined #openstack-swift00:45
kota_morning00:51
kota_timburke: nice to see that isa_l_rs_cauchy dlean00:52
kota_clean00:52
*** kiennt has joined #openstack-swift00:57
*** itlinux has joined #openstack-swift01:01
*** vinsh has quit IRC01:28
*** frank_young has joined #openstack-swift01:30
*** frank_young has quit IRC01:30
*** frank_young has joined #openstack-swift01:30
*** vinsh has joined #openstack-swift01:32
*** itlinux has quit IRC01:49
*** vint_bra has joined #openstack-swift01:49
*** itlinux has joined #openstack-swift02:04
*** cschwede has joined #openstack-swift02:55
*** ChanServ sets mode: +v cschwede02:55
*** vint_bra has quit IRC02:57
*** cschwede_ has quit IRC02:57
*** Sukhdev has joined #openstack-swift03:14
*** xrb_ has joined #openstack-swift03:23
*** xrb has quit IRC03:26
*** gkadam has joined #openstack-swift03:48
*** hoonetorg has joined #openstack-swift04:32
*** SkyRocknRoll has joined #openstack-swift04:36
*** SkyRocknRoll has quit IRC04:43
*** psachin has joined #openstack-swift04:49
*** rcernin has quit IRC05:22
*** Sukhdev has quit IRC05:26
*** ukaynar has quit IRC05:30
*** rcernin has joined #openstack-swift05:36
*** cshastri has joined #openstack-swift05:41
*** kiennt has quit IRC05:44
*** kiennt has joined #openstack-swift06:03
*** klrmn has quit IRC06:06
*** geaaru has joined #openstack-swift06:09
*** ChubYann has quit IRC06:15
*** psachin has quit IRC06:16
*** sgundur1 has quit IRC06:35
*** links has joined #openstack-swift06:37
*** sgundur| has quit IRC06:38
*** rcernin has quit IRC06:58
*** rcernin has joined #openstack-swift06:58
*** sgundur has quit IRC07:08
*** ntata has quit IRC07:08
*** mmotiani has quit IRC07:08
*** psachin has joined #openstack-swift07:13
*** tesseract has joined #openstack-swift07:16
*** abhitechie has joined #openstack-swift07:23
xrb_good morning07:26
*** itlinux has quit IRC07:26
xrb_is there a way to make a env['wsgi.input'] seekable (from a Swift middleware)?07:33
xrb_(I am relying on a lib which performs a seek)07:34
acolesgood morning07:42
openstackgerritHangdong Zhang proposed openstack/python-swiftclient master: Update the documentation link for doc migration  https://review.openstack.org/48602907:44
kota_acoles: morning07:55
acoleskota_: thanks for more review08:07
acoleskota_: how was the openstack tokyo event?08:07
kota_acoles: it was good and in fact, it's 2days event so im still on08:09
kota_acoles: and sorry i'm still under consideration for that patch08:12
acoleskota_: NP I can see that you and timburke would both prefer a different encapsulation08:13
xrb_(re seekable body, found it, just call req.make_body_seekable() :) )08:14
acolestdasilva: re patch 485569 let me know if you think I should make the s/rebalance/reconstruction/ changes you pointed out - I'm happy to do it but holding off because it was the text I inherited from object-server.conf-sample.08:21
patchbothttps://review.openstack.org/#/c/485569/ - swift - Add reconstructor section to deployment guide08:21
acolesI am going to continue looking at patch 478416 first today08:23
patchbothttps://review.openstack.org/#/c/478416/ - swift - Add multiple worker processes strategy to reconstr...08:23
*** kiennt has quit IRC09:53
*** geaaru_ has joined #openstack-swift09:58
*** geaaru has quit IRC10:01
*** abhinavtechie has joined #openstack-swift10:04
*** abhitechie has quit IRC10:04
*** abhinavtechie has quit IRC10:11
*** abhitechie has joined #openstack-swift10:11
*** abhitechie has quit IRC10:42
*** abhitechie has joined #openstack-swift10:43
*** abhitechie has quit IRC10:50
*** murphy has joined #openstack-swift11:00
*** abhitechie has joined #openstack-swift11:00
*** ^andrea^ has joined #openstack-swift11:03
*** abhitechie has quit IRC11:04
*** abhitechie has joined #openstack-swift11:07
*** hieulq has quit IRC11:09
*** abhitechie has quit IRC11:10
*** abhitechie has joined #openstack-swift11:11
*** abhitechie has quit IRC11:17
*** murphy has quit IRC11:25
*** abhitechie has joined #openstack-swift11:30
*** murphy has joined #openstack-swift11:37
*** murphy has quit IRC11:56
*** gkadam has quit IRC12:29
*** abhitechie has quit IRC13:02
*** abhitechie has joined #openstack-swift13:14
*** abhitechie has quit IRC13:16
*** catintheroof has joined #openstack-swift13:25
*** catinthe_ has joined #openstack-swift13:26
*** catintheroof has quit IRC13:30
*** vint_bra has joined #openstack-swift13:33
*** lucasxu has joined #openstack-swift13:37
*** links has quit IRC13:43
tdasilvaacoles: good morning14:01
acolestdasilva: o/14:01
tdasilvaacoles: +A'd both14:01
tdasilvaI think rebalance is fine14:02
acolestdasilva: great! thanks. that means we can document reconstructor_workers in patch 478416 :)14:02
patchbothttps://review.openstack.org/#/c/478416/ - swift - Add multiple worker processes strategy to reconstr...14:02
tdasilvaacoles: will try to take a look at that patch14:03
acolestdasilva: that would be great. I have a few fixes that I will be pushing over later today.14:04
*** psachin has quit IRC14:06
*** frank_young has quit IRC14:09
*** SkyRocknRoll has joined #openstack-swift14:27
*** frank_young has joined #openstack-swift14:35
*** cshastri has quit IRC14:44
xrb_what is the best practice to do this: in a Swift middleware, I would like to fire another request against Swift (e.g. to save some derived data when e.g. doing a PUT).14:47
xrb_In addition to using an eventlet.posthooks (for async post processing), what is the best way to fire a request to Swift? Directly with an HTTP lib (like requests) or is there a shortcut?14:47
tdasilvaxrb_: take a look and copy and versioning middleware14:48
tdasilvaslo, dlo, bulk, i think they all fire off requests14:49
tdasilvaxrb_: the gotchas are typically whether that request should be auth'd again or not and also making sure to close connections on failures14:50
xrb_tdasilva: nice.. will check them.. thx!14:54
*** hoonetorg has quit IRC15:05
*** itlinux has joined #openstack-swift15:11
*** rcernin has quit IRC15:14
*** SkyRocknRoll has quit IRC15:25
*** SkyRocknRoll has joined #openstack-swift15:26
claygtimburke: acoles: not immediately clear to me why max_devices_per_worker should obviously change from background to foreground execution (iff you use override devices) - but my heads not really in the game.15:36
claygAll the other nits and stuff seem like obvious improvements- thanks for taking up the torch.15:37
acolesclayg: max_devices_per_worker should be calculated based on the number of devices being reconstructed, which may be fewer than all_local_devices if override devices are passed in ?15:40
openstackgerritAlistair Coles proposed openstack/swift master: fixup for get_worker_args  https://review.openstack.org/48616715:43
acolesclayg: something like this ^^ ?15:44
acolesclayg: but, you're on vacation!15:44
*** ukaynar has joined #openstack-swift15:48
* clayg shrugs15:59
claygSo if I have 24 devs and workers 12 in my conf. How many devs do my workers get when I override with 4 devs?  I'm not sure what's easiest for ops.16:00
*** itlinux has quit IRC16:03
notmynamegood morning16:12
timburkegood morning16:14
acolesclayg: I think you get 12 workers. The first 4 having one dev each. The rest get no override_devices which I think means they reconstruct all devices.16:19
acolesis that right?!? I've been staring at this so long16:20
claygLol. My intention was workers still get 2 devs - so only two workers. A worker with no devs is super wrong 🙂16:21
acoleswith the change I proposed you'd get 4 workers with one dev each. but without overrides you'd have 12 workers with 2 devs each.16:21
claygSo it sounds like y'all are all over it.16:21
claygI'll go back to vacation.16:21
acolesclayg: right, that was what just dawned on me - is the goal to have same #devs per worker with or without overrides? - seems like if you are using overrides to empty some devices you might like it using as many 'somewhat-uniformly-loaded' workers as possible, but yeah I can see that conflicts with achieving uniform load w.r.t. the background all devices daemon.16:23
acolesclayg: sit back, grab a beer, soak up the sun, we'll try do something sane :)16:24
*** cschwede has quit IRC16:25
*** itlinux has joined #openstack-swift16:29
*** JimCheung has joined #openstack-swift16:31
*** itlinux has quit IRC16:31
notmynamexrb_: oh hi16:43
*** xrb has joined #openstack-swift16:58
xrbregarding using eventlet.posthooks in a middleware: do I need to activate smth in order for them to be executed? (e.g. in proxy-server.conf)17:02
notmynamesmth?17:02
xrbLike an option in the proxy server config file...17:04
xrbPlaying with them, but currently not executed..17:04
notmynamewhen are you installing the posthool17:05
notmyname*posthook17:05
-openstackstatus- NOTICE: Restarting Gerrit for our weekly memory leak cleanup.17:06
xrbLike here, in the __call__ method: https://github.com/rovanleeuwen/informant-old/blob/master/informant/middleware.py17:07
*** ukaynar has quit IRC17:07
*** klrmn has joined #openstack-swift17:11
notmynamethat looks right. but you're not seeing the hook called?17:12
*** xrb has quit IRC17:12
*** xrb has joined #openstack-swift17:12
*** gkadam has joined #openstack-swift17:12
xrbWill check again on Monday to be sure..17:13
*** xrb has quit IRC17:16
*** ukaynar has joined #openstack-swift17:19
*** SkyRocknRoll has quit IRC17:21
openstackgerritMerged openstack/swift master: Add reconstructor section to deployment guide  https://review.openstack.org/48556917:22
openstackgerritMerged openstack/swift master: Add more structure to the deployment guide  https://review.openstack.org/48557017:24
acolesyay17:24
*** xrb has joined #openstack-swift17:27
*** xrb has quit IRC17:30
*** SkyRocknRoll has joined #openstack-swift17:36
acolestimburke: once patch 485569 makes it to gerrit I'll rebase the multi proc reconstructor patches17:40
patchbothttps://review.openstack.org/#/c/485569/ - swift - Add reconstructor section to deployment guide (MERGED)17:40
acolesugh s/gerrit/github/17:46
*** Sukhdev has joined #openstack-swift17:48
*** ukaynar has quit IRC17:58
*** ukaynar_ has joined #openstack-swift18:02
openstackgerritTim Burke proposed openstack/swift master: WIP: Move listing formatting out to proxy middleware  https://review.openstack.org/44939418:05
openstackgerritJohn Dickinson proposed openstack/python-swiftclient master: merged openstack-manuals content with existing content  https://review.openstack.org/48618918:09
timburkenotmyname: on ^^, do we want/need it before the release?18:11
notmynametimburke: the docs change?18:12
timburkeya18:12
notmynameyes we do18:12
timburkek18:12
notmynamehere's the story with that one18:12
notmyname(and I'm waiting on the docs build to look at it)18:12
notmynamethere's only one file in openstack-manuals that needs to "move" to swiftclient docs18:13
notmynamebut we already have/had the same sort of content in swiftclient18:13
notmynamewhich is good, but of course they aren't the same18:13
notmynameand one is not obviously better than the other IMO18:13
notmynamebut parts of each are obviously better than the other IMO18:13
notmynameso I went through the -manuals one and grabbed the good parts and merged that with what's existing in swiftclient18:14
notmyname...and of course the diff view in gerrit is rather terrible for reflecting that18:15
notmynamehere, this is better (ie using newer git diff algorithm) https://gist.github.com/notmyname/4f15f014ece2501dcc79fffc8e819a9c18:16
notmynametimburke: ^18:16
notmynameit's not perfect, but at least it's not "added a bunch! deleted a bunch!"18:17
notmynamehmm... that one may actually be worse.18:17
timburkeyeah, i think no matter what, it's going to take a bit to digest the diff18:18
timburkehopefully having the existing and newly-built docs side-by-side will be a little easier?18:19
notmynameto create it, I had a copy of the file from -manuals open and the client file open. I went through the -manuals as a source, and move over blocks of lines to the existing docs18:19
timburkedon't get me wronge, i think it's great that we're doing it and i have no doubt you picked the best parts of both. but i've got other things i need to review first...18:19
notmyname`git diff` doesn't seem to understand how I created it ;-)18:19
notmynameI'm hoping to land all the docs migration stuff this afternoon (in part with the idea of, "done with cross-project thing, we'll improve it as we go")18:20
notmynamebut also because the docs migrations stuff must be in pike, and the die date for a pike release of swiftclient is wednesday or soemthing (ie this release that we're doing now)18:21
notmyname... and I'll rebase the authors/changelog patches on top of the docs migration ones after they land18:21
notmyname...and the few other patches we're waiting on18:22
*** frank_young has quit IRC18:29
*** frank_young has joined #openstack-swift18:39
-openstackstatus- NOTICE: docs.o.o is currently broken, we're investigating18:40
*** SkyRocknRoll has quit IRC18:41
*** frank_young has quit IRC18:43
*** gkadam has quit IRC18:44
*** JimCheung has quit IRC18:50
*** JimCheung has joined #openstack-swift19:06
openstackgerritAlistair Coles proposed openstack/swift master: fixup for get_worker_args  https://review.openstack.org/48616719:06
openstackgerritAlistair Coles proposed openstack/swift master: Add multiple worker processes strategy to reconstructor  https://review.openstack.org/47841619:06
openstackgerritAlistair Coles proposed openstack/swift master: fixup make run_once in a worker process dump to recon  https://review.openstack.org/48620519:06
*** tonanhngo has joined #openstack-swift19:07
*** JimCheung has quit IRC19:10
*** ChubYann has joined #openstack-swift19:17
acolestimburke: I'm done for now ^^19:22
acolestimburke: please squash whatever you see fit, thanks19:22
timburkeacoles: thanks! will do19:26
acolestimburke: BTW I think i figured how to get the override devices scenario to spread over workers in similar way to all devices, as I think clayg intended, in get_worker_args() - added some comments so it should be obvious. That's in patch 486167.19:28
patchbothttps://review.openstack.org/#/c/486167/ - swift - fixup for get_worker_args19:28
*** catinthe_ has quit IRC19:58
*** saint_ has quit IRC20:01
notmynametimburke: http://docs-draft.openstack.org/89/486189/1/check/gate-python-swiftclient-docs-ubuntu-xenial/b72c0fe//doc/build/html/cli.html lgtm20:04
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873620:05
*** JimCheung has joined #openstack-swift20:07
*** JimCheung has quit IRC20:11
*** MVenesio has quit IRC20:30
*** JimCheung has joined #openstack-swift20:46
*** ukaynar_ has quit IRC20:58
*** ukaynar has joined #openstack-swift21:01
openstackgerritAlistair Coles proposed openstack/swift master: Ring rebalance respects co-builders' last_part_moves  https://review.openstack.org/47700021:13
openstackgerritAlistair Coles proposed openstack/swift master: Ring rebalance respects co-builders' last_part_moves  https://review.openstack.org/47700021:20
*** frank_young has joined #openstack-swift21:21
*** frank_young has quit IRC21:26
acoleskota_: timburke: ^^ I hope that's closer, it's late here and I have tired eyes so hope I haven't missed anything. thanks for your suggestions.21:27
acoleskota_: FYI I am out on Monday, back Tuesday21:27
openstackgerritMerged openstack/swift master: Replace dict.iteritems with six.iteritems  https://review.openstack.org/34198821:37
openstackgerritAlistair Coles proposed openstack/swift master: fixup make run_once in a worker process dump to recon  https://review.openstack.org/48620521:40
*** lucasxu has quit IRC21:51
*** MVenesio has joined #openstack-swift22:12
*** MVenesio has quit IRC22:12
*** Sukhdev has quit IRC22:17
*** frank_young has joined #openstack-swift22:20
*** JimCheung has quit IRC22:23
*** frank_young has quit IRC22:24
*** tesseract has quit IRC22:25
*** vint_bra has quit IRC22:26
*** JimCheung has joined #openstack-swift22:42
*** ukaynar has quit IRC22:43
*** MVenesio has joined #openstack-swift22:57
*** MVenesio has quit IRC22:58
openstackgerritMerged openstack/swift master: moved install guide and removed tox env definition  https://review.openstack.org/48171423:21
*** frank_young has joined #openstack-swift23:38
*** frank_young has quit IRC23:43
*** JimCheung has quit IRC23:47
*** catintheroof has joined #openstack-swift23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!