Wednesday, 2017-02-15

*** dmorita has quit IRC00:02
*** jamielennox_ has joined #openstack-swift00:02
*** jamielennox_ is now known as jamielennox00:06
*** klamath has quit IRC00:13
*** catintheroof has quit IRC00:29
kota_good morning00:47
*** dmorita has joined #openstack-swift00:57
MooingLemurgoedemorgen01:06
*** gatuus has quit IRC01:07
kota_jrichli, clayg: AFAIK, the prob tests doens't expect to work on non-default config (not only reconstructor thing, i mean)01:25
kota_and we already have some probe tests for non-default config https://github.com/openstack/swift/blob/master/test/probe/test_account_reaper.py#L155-L19501:25
kota_w/ modification of config file01:26
kota_jrichli, clayg: thinking of that, if the probe tests found the non-default value in the running, skips or warnings seems good to me, probably a bunch of test goes to fail01:26
kota_jrichli, clayg: and even if they're using default config (i.e. handoff_only = False), the better thing i think is run a (new) handoffs_onlly mode probe tests with config modification.01:28
*** dmorita has quit IRC01:38
kota_and thanks jrichli for writing unit tests!01:42
*** dmorita has joined #openstack-swift01:48
*** dmorita has quit IRC01:48
mattoliveraukota_: morning (sorry been busy away from IRC).01:55
kota_mattoliverau: good morning!01:55
*** sams-gleb has joined #openstack-swift01:56
*** sams-gleb has quit IRC02:00
*** openstackgerrit has joined #openstack-swift02:04
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Follow up on reconstructor handoffs_only  https://review.openstack.org/43401802:04
charzkota_ and mattoliverau good morning02:15
kota_charz: o/02:15
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Follow up on reconstructor handoffs_only  https://review.openstack.org/43401802:22
mattoliveraucharz: morning02:23
jrichlihello kota_ ! just a heads up - I am about to make a comment on handoffs_only pointing to  your follow-up and +2 +A the change.02:28
kota_jrichli: maybe i should reload the page?02:28
jrichlii haven't done it yet - i will in a moment02:29
*** JimCheung has quit IRC02:29
kota_jrichli: I'm just about to finish up the review with comments and +2 +A02:29
jrichliah, ok!02:29
kota_racing :D02:29
jrichligreat, i see you have this handled.  I will take a break then :-)02:30
*** dmorita has joined #openstack-swift02:34
*** dmorita has quit IRC02:34
*** dmorita has joined #openstack-swift02:35
kota_jrichli: done ;-)02:37
kota_jrichli: and hopefully you like https://review.openstack.org/#/c/43401802:37
patchbotpatch 434018 - swift - Follow up on reconstructor handoffs_only02:37
kota_and I have to start to rebase my ec duplication on the reconstructor change :\02:37
*** tqtran has quit IRC02:45
openstackgerritMatthew Oliver proposed openstack/swift master: Add container sharding to Swift containers  https://review.openstack.org/42390602:47
mattoliverau^^ that just includes v 0.1 of the documentation. Putting is somewhere as I have some coworkers who are going to read through it and correct my Australian (bad) english02:48
*** bkopilov has quit IRC02:56
*** bkopilov_ has quit IRC02:57
*** sanchitmalhotra has quit IRC02:59
*** sanchitmalhotra has joined #openstack-swift03:01
*** robcresswell_ has joined #openstack-swift03:04
*** nottrobin_ has joined #openstack-swift03:05
*** janonymous_ has joined #openstack-swift03:06
*** tonyb_ has joined #openstack-swift03:06
*** dmellado_ has joined #openstack-swift03:06
*** serverascode_ has joined #openstack-swift03:06
*** _d34dh0r53_ has joined #openstack-swift03:06
*** sudorandom_ has joined #openstack-swift03:06
*** clayg_ has joined #openstack-swift03:06
*** ChanServ sets mode: +v clayg_03:06
*** pdardeau_ has joined #openstack-swift03:06
*** remix_auei has joined #openstack-swift03:06
*** jarbod__ has joined #openstack-swift03:06
*** mmmucky_ has joined #openstack-swift03:07
*** tmoreira_ has joined #openstack-swift03:07
*** alpha_ori has quit IRC03:07
*** sudorandom has quit IRC03:07
*** cppforlife_ has quit IRC03:07
*** dmellado has quit IRC03:07
*** serverascode has quit IRC03:07
*** nottrobin has quit IRC03:07
*** Tahvok has quit IRC03:07
*** janonymous has quit IRC03:07
*** calebb has quit IRC03:07
*** tmoreira has quit IRC03:07
*** tonyb has quit IRC03:07
*** robcresswell has quit IRC03:07
*** pdardeau has quit IRC03:07
*** mmmucky has quit IRC03:07
*** mlanner has quit IRC03:07
*** clayg has quit IRC03:07
*** jarbod has quit IRC03:07
*** etienneme has quit IRC03:07
*** remix_tj has quit IRC03:07
*** ahale has quit IRC03:07
*** d34dh0r53 has quit IRC03:07
*** sudorandom_ is now known as sudorandom03:07
*** mlanner_ has joined #openstack-swift03:07
*** mlanner_ is now known as mlanner03:07
*** alpha_ori has joined #openstack-swift03:08
*** etienneme has joined #openstack-swift03:08
*** Tahvok has joined #openstack-swift03:08
*** calebb has joined #openstack-swift03:08
*** ahale has joined #openstack-swift03:09
*** robcresswell_ is now known as robcresswell03:09
*** dmorita has quit IRC03:09
*** janonymous_ is now known as janonymous03:09
*** nottrobin_ is now known as nottrobin03:11
*** serverascode_ is now known as serverascode03:18
*** JimCheung has joined #openstack-swift03:20
*** tonyb_ is now known as tonyb03:21
*** JimCheung has quit IRC03:25
*** mmmucky_ is now known as mmmucky03:39
*** mmotiani has joined #openstack-swift03:42
*** Jeffrey4l_ has quit IRC03:43
*** Jeffrey4l_ has joined #openstack-swift03:43
*** cshastri has joined #openstack-swift03:53
mahaticgood morning03:54
openstackgerritMerged openstack/swift master: Deprecate broken handoffs_first in favor of handoffs_only  https://review.openstack.org/42549303:54
mahatickota_: sorry I couldn't get to your comments on EC duplication yesterday - other than just a glance. will try to reproduce a test maybe on one of the comments03:55
mahaticnotmyname: thanks for the follow-on mail on the Outreachy one!03:55
*** sams-gleb has joined #openstack-swift03:58
*** sanchitmalhotra has quit IRC04:01
*** sanchitmalhotra has joined #openstack-swift04:01
*** sams-gleb has quit IRC04:04
notmynamegood evening04:16
notmynamemahatic: np :-)04:16
*** bkopilov_ has joined #openstack-swift04:17
notmynameyay https://review.openstack.org/#/c/425493/ landed. thanks jrichli and kota_04:18
patchbotpatch 425493 - swift - Deprecate broken handoffs_first in favor of handof... (MERGED)04:18
*** bkopilov has joined #openstack-swift04:19
*** klrmn1 has quit IRC04:20
notmynameI'm finishing up the authors/changelog patch04:25
notmynameI think it's pretty safe to say that what's on master right now is what will be in the release. neither increasing sharding ( cschwede_) nor ec frag replication ( kota_) will be in the ocata release04:26
*** links has joined #openstack-swift04:34
*** cppforlife_ has joined #openstack-swift05:01
kota_mahatic: good morning05:03
kota_notmyname: you're welcome for the path 425493 landed05:04
*** caiobrentano has joined #openstack-swift05:12
*** caiobrentano_ has quit IRC05:14
kota_mahatic: if you need help on that, please feel free to poke me. I am able to stay online today05:20
*** rickyrem has joined #openstack-swift05:29
mahatickota_: sure, thanks05:34
mahatickota_: https://review.openstack.org/#/c/219165/56/swift/obj/reconstructor.py@825 - Here I was referring to a possibility of duplicates in "ordered_fis" list"05:37
patchbotpatch 219165 - swift - EC Fragment Duplication - Foundational Global EC C...05:37
mahatickota_: for eg: is it possible to have a stub_hashes like this - http://paste.openstack.org/show/598934/ over here in this test https://review.openstack.org/#/c/219165/57/test/unit/obj/test_reconstructor.py@176705:38
patchbotpatch 219165 - swift - EC Fragment Duplication - Foundational Global EC C...05:38
*** rickyrem has quit IRC05:42
mahaticFor data like this - http://paste.openstack.org/show/598936/, I believe my fis will be [0,1,2,1,0,2] not in that order specifically..but it will still have duplicates. Unless this gets filtered out somewhere?05:42
* mahatic brb05:43
*** tqtran has joined #openstack-swift05:44
*** tqtran has quit IRC05:49
kota_back, sorry, I was asked about small things from my collegue.05:49
kota_mahatic: probably, you find good point but I'm still not reach out the state.05:52
kota_mahatic: let me make sure the thougt05:54
kota_mahatic: looking at http://paste.openstack.org/show/598936/05:55
kota_it looks like each device has only 1 fragment, right?05:55
openstackgerritJohn Dickinson proposed openstack/swift master: 2.13.0 authors/changelog updates  https://review.openstack.org/43408105:56
notmynamethere's the first draft of the 2.13 changelog05:56
kota_and a reconstuct job should be for each (device, policy, partition)05:56
notmynamekota_: mahatic: cschwede_: mattoliverau: I'd definitely appreciate a quick check of it while I'm sleeping :-)05:56
kota_so it will be 6 jobs05:56
mattoliveraunotmyname: sure thing05:57
kota_mahatic: not a 6 items in ordered_fis in a job... right?05:57
notmynamedoh! I didn't pick up the handoffs_first -> handoffs_only patch05:57
kota_notmyname: will do05:57
notmynamemahatic: kota_: thanks (but let me get that last patch referenced--new patch set in a few minutes)05:58
* kota_ is thinking the notmyname's response is for mattoliverau05:59
notmynameoh yeah. thanks kota_06:00
notmynamem+<tab> :-)06:00
kota_notmyname: i know ;-)06:00
notmynamekota_: I'm sure that's *never* happened to you06:00
mattoliveraushould I change my nick to start with something unicode, so I'm the only complete ;P06:01
*** sams-gleb has joined #openstack-swift06:01
notmynamethat would be a fantastic way to get nobody to talk to you ;-)06:01
kota_notmyname: i just open the link, do we need to add release note anymore?06:01
notmynamekota_: yeah, there will be a later patch set for that (after the one I'm working on)06:02
kota_notmyname: ok, gotcha, thanks06:02
notmynameI want to get the words right, then I'll do the translation to yaml06:02
notmynameand, as is proper, every time I mention yaml, I must also mention that yaml is terrible and has 69 ways to declare a multi-line string and requires a turing-complete parser to parse06:03
notmyname;-)06:03
kota_kk06:03
mattoliveraunotmyname: lol, you should have an irc bot that says that triggered on yaml ;)06:05
notmynamemattoliverau: yes!06:05
notmynamemattoliverau: or actually not. that sounds like making IRC more like slack ;-)06:05
mattoliveraulol06:05
mahaticsorry was away, reading backlog06:05
*** sams-gleb has quit IRC06:06
notmynameslack's advantages over IRC: (1) blinding white background you can't change (2) clippy has been renamed to "slackbot" and will helpfully past animated gifs in your chat window06:06
kota_mahatic: np06:06
mattoliveraunotmyname: sounds awesome, but we all know the new awesome is matrix, which has a slack and irc bridge06:07
notmynamemattoliverau: what is the matrix? (I"m assuming I can't be told; I can only be shown)06:08
notmynamemattoliverau: I've not heard of this thing06:08
notmynameI used the slack/IRC bridge for a little bit. until it started dropping messages06:08
mattoliverauits the slack, but opensource and end to end encryption (like signal).06:09
notmynamesounds like somethng the sales team will never buy in to ;-)06:09
mattoliveraulol06:09
mattoliveraucsmart has been playing with it, so he's the man who can answer all your matrix questions.. but not what pill to take06:10
notmynameslack == IRC that a sales team will actually use. (this is why they're valued at a brazillion dollars or something)06:10
mattoliverausorry, had to add some kind of matrix joke06:10
notmynameI will not ne taking pills that csmart offers06:10
notmynameagain06:10
mahatickota_: I could be wrong. Could you tell me what this list "ordered_fis" might have in here - https://review.openstack.org/#/c/219165/56/swift/obj/reconstructor.py@81606:10
patchbotpatch 219165 - swift - EC Fragment Duplication - Foundational Global EC C...06:10
csmartnotmyname: lol06:10
kota_mahatic: with http://paste.openstack.org/show/598934/, if i understand correctly, the ordered_fis will be  [(frag_index, 2), ] because fi == None will be ignored previous for-loop.06:10
mattoliverauahh, well for matrix you could just use riot.im, and it works as a bouncer too.06:11
mattoliveraulol06:11
mahatickota_: for a 2+1*2 setup06:12
csmartmatrix.org is open, distributed, federated next-gen messaging platform06:12
openstackgerritMatthew Oliver proposed openstack/swift master: Add container sharding to Swift containers  https://review.openstack.org/42390606:12
csmartWhich in my opinion is what the world needs, not slack06:12
mahaticnotmyname: sure thing. A quick look shows a big red thing which indicates extra space ;)06:12
kota_it looks like the ordrered_fis are a list of tuples which includes (count, suffix)06:13
csmartriot.im is a front end to matrix.org06:13
notmynamemahatic: ah yes. that part is just indicating my terribleness06:13
kota_ah not a [(frag_index, 2), ] but [(2, frag_index), ]06:13
mahatickota_: it's a tuple of (count, fi)06:13
mattoliverau^^ csmart that's a version that has mcarden's improvments. you can now go fix my english as well ;)06:14
kota_but i just now find the count is never used anywhere even in older code.06:14
csmartmattoliverau: rgr 👍06:14
kota_what we need looks just fragment_index in the suffix.06:14
mahaticnotmyname: lol06:15
notmynamemattoliverau: mcarden == crash?06:15
mattoliverauyup06:15
mattoliveraunotmyname: I don't know why he didn't try and get crash as an IRC nick, I assume it was taken :)06:15
notmynamemattoliverau: it's very confusing when I only see you once per year and you use different names all the time (/cc csmart)06:15
mahatickota_: right. and I mean fragment_index would end up with duplicates (if I didn't misread). And I'm trying to know if it's ok06:15
csmartnotmyname: yep, crash06:16
kota_no mahatic, the data source (i.e. data_fi_to_suffixes) is a dict06:16
kota_strictly speaking, data_fi_to_suffixes = defaultdict(list)06:16
kota_so the key should not be duplicate06:16
mahatickey is len(suffix)06:17
kota_no?06:17
mahaticsorry key is suffix06:17
kota_ data_fi_to_suffixes[fi].append(suffix)06:17
kota_no, the key *should be* fi06:17
openstackgerritJohn Dickinson proposed openstack/swift master: 2.13.0 authors/changelog updates  https://review.openstack.org/43408106:17
kota_fragment index06:17
notmynamemattoliverau: kota_: mahatic: ok there's the new version. thanks for your eyes06:17
kota_notmyname: oh, probably the new version includes my nits in the gerrit draft comment ;-)06:18
kota_it's only white space in a line though06:18
notmynamemattoliverau: kota_: mahatic: the first three sections are all a Big Deal in the terms of release notes. an upgrade warning, a warning about data loss, and a deprecation issue. so I tried to group/order them appropriately, but please let me know if you have other suggestions06:19
notmynamekota_: oh yeah. I fixed that (if it's the one that mahatic mentioned)06:19
*** dmorita has joined #openstack-swift06:20
*** pcaruana has joined #openstack-swift06:20
mahaticnotmyname: ack. kota_ ok, I'm looking. you're right about fi being key. I need to recheck and reaffirm with a test :) but looks like you added an assert in the newer patchset06:21
kota_mahatic: yeah, the assertion is for the check the build job report nodes only ec_duplication_factor nodes in the sync to list ;-)06:26
openstackgerritKota Tsuyuzaki proposed openstack/swift master: EC Fragment Duplication - Foundational Global EC Cluster Support  https://review.openstack.org/21916506:27
kota_just rebased (merge conflict resolved)06:27
kota_oops, I had said a rebased comment on patch set 56 but the newest is 5806:28
*** Jeffrey4l__ has joined #openstack-swift06:30
mattoliverauwow, ok so that documentation has taken alot longer then expected. but at least for the rest of the week I can focus on patches and reviews. Time to look at the state of the part power increase again.06:32
mattoliverauoh and the change log06:32
*** psachin has joined #openstack-swift06:32
*** Jeffrey4l_ has quit IRC06:34
*** dja has quit IRC06:38
*** tonanhngo has quit IRC06:40
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Optimize ec duplication and its md5 hashing  https://review.openstack.org/42167306:40
kota_rebased06:40
*** abqkawi1000_ has quit IRC06:59
*** rcernin has joined #openstack-swift07:07
*** psachin has quit IRC07:13
*** silor has joined #openstack-swift07:22
*** ChubYann has quit IRC07:26
*** silor has quit IRC07:28
*** tesseract has joined #openstack-swift07:31
*** tqtran has joined #openstack-swift07:46
*** sams-gleb has joined #openstack-swift07:49
*** tqtran has quit IRC07:50
openstackgerritMerged openstack/liberasurecode master: ISA-L: free matrix on exit  https://review.openstack.org/43181208:01
*** dmorita has quit IRC08:08
*** rledisez has joined #openstack-swift08:10
*** amoralej|off is now known as amoralej08:12
*** dmorita has joined #openstack-swift08:21
openstackgerritBéla Vancsics proposed openstack/swift master: Use more specific asserts in tests  https://review.openstack.org/43413208:22
kota_oh...what?08:23
kota_timburke: do you notice test/liberasurecode_test is not a binary but it looks like a script08:24
kota_timburke: probably that is a reason we cannot pick up the memory leak in the isa-l exit08:24
*** abhishekk has joined #openstack-swift08:24
*** abhishekk has left #openstack-swift08:24
kota_maybe it was affected from something at automake08:24
*** dmorita has quit IRC08:25
*** cbartz has joined #openstack-swift08:27
*** geaaru has joined #openstack-swift08:32
*** links has quit IRC08:36
*** oshritf has joined #openstack-swift08:43
*** kei_yama has quit IRC08:45
*** links has joined #openstack-swift08:52
openstackgerritBéla Vancsics proposed openstack/swift master: Use more specific asserts in tests  https://review.openstack.org/43413208:57
openstackgerritKota Tsuyuzaki proposed openstack/liberasurecode master: WIP: Fix valgrind-check to use actual binary  https://review.openstack.org/43416209:19
*** psachin has joined #openstack-swift09:21
*** links has quit IRC09:26
*** dmorita has joined #openstack-swift09:28
*** dmorita_ has joined #openstack-swift09:30
*** dmorita has quit IRC09:33
*** dmorita_ has quit IRC09:39
*** dmorita has joined #openstack-swift09:39
*** links has joined #openstack-swift09:42
*** jordanP has joined #openstack-swift09:54
*** remix_auei is now known as remix_tj10:20
openstackgerritKota Tsuyuzaki proposed openstack/liberasurecode master: WIP: Fix valgrind-check to use actual binary  https://review.openstack.org/43416210:20
*** sams-gle_ has joined #openstack-swift10:26
*** silor has joined #openstack-swift10:26
*** sams-gleb has quit IRC10:28
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873610:28
openstackgerritKota Tsuyuzaki proposed openstack/liberasurecode master: WIP: Fix valgrind-check to use actual binary  https://review.openstack.org/43416210:33
*** mvk has quit IRC10:43
*** silor has quit IRC11:01
*** sams-gle_ has quit IRC11:13
*** sams-gleb has joined #openstack-swift11:13
*** mvk has joined #openstack-swift11:15
*** sams-gleb has quit IRC11:17
*** gabor_antal has quit IRC11:22
*** Jeffrey4l__ is now known as Jeffrey4l11:22
*** gabor_antal_ has joined #openstack-swift11:22
*** sams-gleb has joined #openstack-swift11:57
*** bkopilov_ has quit IRC12:13
*** bkopilov has quit IRC12:13
*** catintheroof has joined #openstack-swift12:36
*** klamath has joined #openstack-swift13:27
*** klamath has quit IRC13:30
*** klamath has joined #openstack-swift13:30
*** JimCheung has joined #openstack-swift13:31
*** JimCheung has quit IRC13:35
*** bkopilov_ has joined #openstack-swift13:45
*** bkopilov has joined #openstack-swift13:47
*** tongli has joined #openstack-swift13:54
*** amoralej is now known as amoralej|lunch13:56
*** ma91 has joined #openstack-swift14:02
ma91Does anybody know, does Swift client work if I use Keystone + Keycloak?14:02
*** _JZ_ has joined #openstack-swift14:06
*** cshastri has quit IRC14:07
*** mvk has quit IRC14:25
*** amoralej|lunch is now known as amoralej14:27
*** dmellado_ is now known as dmellado14:27
*** links has quit IRC14:31
*** btorch_ has joined #openstack-swift14:34
*** chlong has quit IRC14:37
*** mvk has joined #openstack-swift14:39
*** tongli has quit IRC14:40
*** sams-gleb has quit IRC14:54
*** dmorita has quit IRC14:59
*** dmorita has joined #openstack-swift15:00
*** dmorita has quit IRC15:04
*** mvk has quit IRC15:07
*** sams-gleb has joined #openstack-swift15:12
*** mvk has joined #openstack-swift15:19
*** silor has joined #openstack-swift15:23
*** oshritf has quit IRC15:24
*** gatuus has joined #openstack-swift15:30
*** dmorita has joined #openstack-swift15:31
*** silor1 has joined #openstack-swift15:32
*** silor has quit IRC15:33
*** silor1 is now known as silor15:33
*** ma91 has quit IRC15:34
*** dmorita has quit IRC15:36
*** gabor_antal_ is now known as gabor_antal15:46
*** ma9 has joined #openstack-swift15:52
cbartzcschwede_: Currently, with the systemd services shipped by RDO (like swift-proxy-server) it is not possible to use the reload  command (offered by swift-init for example), which is a little bit  annoying. Are their intentions to support the reload command?15:58
*** psachin has quit IRC15:58
*** dmorita has joined #openstack-swift16:03
*** chlong has joined #openstack-swift16:03
*** klrmn has joined #openstack-swift16:06
*** dmorita has quit IRC16:08
*** mvk has quit IRC16:08
*** gatuus has quit IRC16:15
*** ma9 has quit IRC16:18
*** ma9 has joined #openstack-swift16:21
cschwede_cbartz: well, swift-init reload proxy-server will not really reload the proxy config only, but actually does a restart in the background?16:22
*** gatuus has joined #openstack-swift16:23
cbartzcschwede_:  Yes. You are right. In principle its a graceful restart. Now, I see that reload for systemd is only a config reload.16:24
cschwede_cbartz: you can define reloads in systemd services using the ExecReload setting in the service definition, but that won't help in this case...16:26
cschwede_cbartz: and then there is systemctl daemon-reload, which actually reloads systemd's own config16:26
cschwede_cbartz: ie if you changed a systemd service config16:26
cbartzcschwede_: Yes, I see. Thats a little bit annoying, because one has to wait until there are no more requests within a proxy, before a restart is possible. A graceful restart like with swift-init proxy reload would be nice.16:28
*** dmorita has joined #openstack-swift16:35
*** silor has quit IRC16:38
*** silor1 has joined #openstack-swift16:38
*** chsc has joined #openstack-swift16:38
*** chsc has joined #openstack-swift16:38
*** dmorita has quit IRC16:39
*** silor1 is now known as silor16:40
*** oshritf has joined #openstack-swift16:41
*** rcernin has quit IRC16:43
*** yuan has joined #openstack-swift16:45
*** silor1 has joined #openstack-swift16:46
*** silor has quit IRC16:47
*** silor1 is now known as silor16:47
yuanHi all, I have a question about swift object deletion behavior.  If a delete a already deleted object 204 or 404 should return16:48
yuanand if I delete a non-existent object, 204 or 404 should return16:48
rledisezcbartz, cschwede_: i'm thinking also about this systemd stuff. maybe using the socket proxy of systemd would be nice. systemd listen on network and pass the socket to the processes. it could help getting zero downtime reload. i'm not systemd expert yet, but i'll have to learn soon as we will start upgrading our OS16:49
rledisezrelated: does anybody use swift-init to manage processes in production?16:50
cschwede_cbartz, rledisez: https://bugzilla.redhat.com/show_bug.cgi?id=142261416:52
openstackbugzilla.redhat.com bug 1422614 in openstack-swift "Enable graceful reloading of Swift services" [Unspecified,New] - Assigned to zaitcev16:52
*** tqtran has joined #openstack-swift16:55
*** tesseract has quit IRC16:58
rledisezcschwede_: to be clear, this is not what i call graceful reloading because there is a downtime (between the stop and the start of the processes). we use since few years a patched version of swift with so_reuseport so we have real zero downtime. i tried to upstream it but i failed (mainly because of a lack of time): https://review.openstack.org/#/c/137659/16:59
patchbotpatch 137659 - swift - Support of the Linux socket option SO_REUSEPORT (ABANDONED)16:59
*** dmorita has joined #openstack-swift17:00
cschwede_rledisez: ah, yes, i remember - you had something different in mind17:01
rledisezpersonal opinion: i don't think swift must provide a process manager (swift-ini). it is the job of the distribution to do that (systemd, sysv, supervisor, whatever...). Swift should just integrate well with major processes managers (aka systemd today :))17:01
*** ma9 has left #openstack-swift17:02
*** jordanP has quit IRC17:04
*** dmorita has quit IRC17:05
*** mvk has joined #openstack-swift17:07
*** klrmn has quit IRC17:08
cbartzcschwede_: Many thanks for the bug report!17:10
*** tqtran has quit IRC17:11
*** oshritf has quit IRC17:12
notmynamegood morning17:14
notmynamerledisez: you're going to ATL next week for the PTG, right?17:14
caiobrentanoyuan: I think it should return 40417:15
*** d0ugal has quit IRC17:16
*** JimCheung has joined #openstack-swift17:16
rlediseznotmyname: good morning. yes, i'll be here (with some code and bench ;))17:16
notmynamerledisez: great!17:16
rledisezi'm arriving tuesday afternoon so i'll be present frmo wednzsday to friday17:17
notmynamegood to know17:17
notmynametdasilva: mahatic: mattoliverau: thanks for comments on the changelog. I'll update that ASAP and push a new patch set (likely also with the yaml stuff too)17:18
tdasilvanotmyname: ack17:19
*** cbartz has quit IRC17:21
*** JimCheung has quit IRC17:21
*** chlong has quit IRC17:24
*** JimCheung has joined #openstack-swift17:26
*** d0ugal has joined #openstack-swift17:30
*** d0ugal has quit IRC17:30
*** d0ugal has joined #openstack-swift17:30
*** rledisez has quit IRC17:30
*** dmorita has joined #openstack-swift17:33
*** dmorita has quit IRC17:37
*** d0ugal has quit IRC17:42
openstackgerritJohn Dickinson proposed openstack/swift master: 2.13.0 authors/changelog updates  https://review.openstack.org/43408117:44
notmynameupdated without the yaml files yet (I have a meeting in 15 minutes and won't finish that before the meeting, so wanted to push up the fixes)17:44
timburkekota_: i did notice -- wasn't sure how to try to fix it though http://eavesdrop.openstack.org/irclogs/%23openstack-swift/%23openstack-swift.2017-02-13.log.html#t2017-02-13T21:48:4417:46
*** mmotiani_ has joined #openstack-swift17:51
*** dmorita has joined #openstack-swift17:52
*** NM has joined #openstack-swift17:54
*** dmorita has quit IRC17:57
timburkeyuan: i'm not sure i saw a question -- but yes, you can expect either a 204 or a 404 on an object DELETE. during normal operation, it will be a 204 if the object previously existed and a 404 if the object either never existed or was previously deleted -- there isn't a good way as a client to distinguish between the two18:01
yuanthanks18:03
timburke(i have some memory that the object server will send an X-Timestamp header if it was previously deleted, or no header otherwise, but that seems to not make it back to the client)18:03
timburkein the presence of failures, you may get a 204 on a previously deleted object -- if, for example, the first delete was recorded on a handoff, and the second found the primary that didn't receive the previous delete18:05
*** JimCheung has quit IRC18:05
*** JimCheung has joined #openstack-swift18:06
*** klrmn has joined #openstack-swift18:11
*** tonanhngo has joined #openstack-swift18:12
*** tqtran has joined #openstack-swift18:13
*** jamielennox is now known as jamielennox|away18:13
*** tonanhngo has quit IRC18:16
*** tonanhngo has joined #openstack-swift18:16
*** tqtran has quit IRC18:17
*** tonanhngo has quit IRC18:21
*** dmorita has joined #openstack-swift18:24
*** dmorita has quit IRC18:29
*** tqtran has joined #openstack-swift18:31
openstackgerritGábor Antal proposed openstack/swift master: Use more specific asserts in test/unit/obj tests  https://review.openstack.org/34283018:35
*** yuan has quit IRC18:37
*** tonanhngo has joined #openstack-swift18:43
*** tonanhngo has quit IRC18:48
*** tonanhngo has joined #openstack-swift18:48
*** tonanhngo has quit IRC18:53
*** dmorita has joined #openstack-swift18:56
*** tnovacik has joined #openstack-swift18:57
*** mmotiani_ has quit IRC19:00
*** dmorita has quit IRC19:01
*** mmotiani_ has joined #openstack-swift19:02
*** pcaruana has quit IRC19:03
*** mmotiani_ has quit IRC19:13
*** geaaru has quit IRC19:15
*** dmorita has joined #openstack-swift19:27
*** tonanhngo has joined #openstack-swift19:29
*** mmotiani_ has joined #openstack-swift19:30
*** mmotiani_ has quit IRC19:30
*** dmorita has quit IRC19:32
*** tonanhngo has quit IRC19:34
*** tonanhngo has joined #openstack-swift19:36
*** chlong has joined #openstack-swift19:36
*** tonanhngo has quit IRC19:40
*** perm has joined #openstack-swift19:41
*** tonanhngo has joined #openstack-swift19:42
*** tonanhngo has quit IRC19:47
*** tonanhngo has joined #openstack-swift19:48
*** chlong has quit IRC19:51
*** tonanhngo has quit IRC19:52
*** amoralej is now known as amoralej|off19:57
*** mmotiani_ has joined #openstack-swift19:59
*** dmorita has joined #openstack-swift19:59
*** tonanhngo has joined #openstack-swift20:00
*** oshritf has joined #openstack-swift20:03
*** dmorita has quit IRC20:04
*** tonanhngo has quit IRC20:05
*** acoles has joined #openstack-swift20:05
*** ChanServ sets mode: +v acoles20:05
*** joeljwright has quit IRC20:05
*** tonanhngo has joined #openstack-swift20:06
*** JimCheung has quit IRC20:06
*** JimCheung has joined #openstack-swift20:07
*** joeljwright has joined #openstack-swift20:09
*** ChanServ sets mode: +v joeljwright20:09
*** tonanhngo has quit IRC20:10
*** tonanhngo has joined #openstack-swift20:12
*** ChubYann has joined #openstack-swift20:16
*** tonanhngo has quit IRC20:17
*** acoles has left #openstack-swift20:17
*** tonanhngo has joined #openstack-swift20:18
*** tonanhngo has quit IRC20:23
*** acoles_ is now known as acoles20:24
*** JimCheung has quit IRC20:28
*** dmorita has joined #openstack-swift20:31
*** dmorita has quit IRC20:36
*** jerrygb has joined #openstack-swift20:36
*** jamielennox|away is now known as jamielennox20:36
*** NM has quit IRC20:40
*** tonanhngo has joined #openstack-swift20:41
*** tonanhngo_ has joined #openstack-swift20:43
*** JimCheung has joined #openstack-swift20:44
*** caiobrentano has quit IRC20:44
*** tonanhngo has quit IRC20:45
*** JimCheung has quit IRC20:49
notmynamemeeting in #openstack-meeting in a few minutes20:56
mattoliverauMorning20:57
*** tnovacik has quit IRC20:57
-openstackstatus- NOTICE: We're currently battling an increase in log volume which isn't leaving sufficient space for new jobs to upload logs and results in POST_FAILURE in those cases; recheck if necessary but keep spurious rebasing and rechecking to a minimum until we're in the clear.20:57
openstackgerritTim Burke proposed openstack/liberasurecode master: Fix memory leaks in liberasurecode_test  https://review.openstack.org/43451320:58
kota_morningg20:58
timburkekota_: ^^20:59
mattoliveraukota_: morning20:59
kota_timburke: nice!20:59
timburkefeel free to squash it in; luckily, most of the leaks were due to bad test code (as best i can tell)20:59
kota_mattoliverau: o/20:59
kota_timburke: great work!20:59
timburkekota_: thanks for figuring out how to get valgrind to test what we wanted it to test. i still don't entirely understand it, but i guess it works? seems better than --trace-children=yes which (OMM) complained about a bunch of problems in bash, sed, gcc...21:01
kota_timburke: ah, it sounds an option, --trac-childrean21:02
*** dmorita has joined #openstack-swift21:03
timburkeyeah, option to valgrind to have it *also* look at child processes. got noisy real fast21:03
kota_k, i'll try it21:04
*** silor has quit IRC21:05
*** dmorita has quit IRC21:07
*** mkaminski has joined #openstack-swift21:12
*** clayg_ is now known as clayg21:16
*** m_kazuhiro has joined #openstack-swift21:30
openstackgerritTim Burke proposed openstack/liberasurecode master: Fix memory leaks in liberasurecode_test  https://review.openstack.org/43451321:30
*** JimCheung has joined #openstack-swift21:33
*** Jeffrey4l has quit IRC21:34
*** dmorita has joined #openstack-swift21:35
*** Jeffrey4l has joined #openstack-swift21:35
kota_timburke: great, your fix got much less definitely lost from older one but unfortunately it looks like a few place to leak the mem remaining21:36
kota_http://logs.openstack.org/13/434513/2/check/gate-liberasurecode-unit/17ca93d/console.html#_2017-02-15_21_33_44_17695321:37
*** JimCheung has quit IRC21:38
*** dmorita has quit IRC21:39
mattoliverauclayg: storyboard will hopefully be the launchpad replacement one day, some projects (new ones I think) already use it. I thought it died ages ago, but turns out it's still a thing22:01
notmynamei've looked at storyboard before. it's very different than LP22:02
notmynamebut yeah, the plan, as I've heard it, is that storyboard will be the new thing for everything22:02
tdasilvai guess OVH guys should talk to iQiyi guys: https://www.openstack.org/summit/boston-2017/vote-for-speakers#/1746522:02
*** mmotiani_ has quit IRC22:02
notmynamethe release goals like py35 and wsgi will be important for us to be represented in22:02
tdasilvathat looks interesting22:03
notmynametdasilva: what?! different storage layout on top of hummingbird?!22:03
*** perm has quit IRC22:03
*** oshritf has quit IRC22:04
*** sams-gleb has quit IRC22:05
claygthat's awsome22:05
notmynamehow are these goal rooms supposed to be organized? from the etherpads, it looks like there's not much there22:05
notmynametdasilva: do you know?22:06
tdasilvagoal rooms?22:06
*** joeljwright has quit IRC22:06
*** dmorita has joined #openstack-swift22:06
notmynametdasilva: the py35 and wsgi one. for the TC goals22:06
tdasilvanotmyname: sorry, not sure what you are talking about22:06
tdasilvalink?22:06
notmynamehttps://etherpad.openstack.org/p/ptg-pike-python35 and https://etherpad.openstack.org/p/ptg-pike-wsgi22:07
claygHow to implement a background garbage collector to reclaim deleted spaces <- that part is a hozer22:07
*** sams-gleb has joined #openstack-swift22:07
tdasilvaclayg lots of cool talks!22:08
tdasilvaclayg: looks like you and notmyname have competing talks ?? :)22:08
notmynamewe do?22:09
tdasilvaidk, they sounded similar, but i only read really quick22:10
tdasilvahttps://www.openstack.org/summit/boston-2017/vote-for-speakers#/1828622:10
tdasilvahttps://www.openstack.org/summit/boston-2017/vote-for-speakers#/1849022:10
notmynameI asked about the goal rooms next week in #openstack-dev22:10
*** dmorita has quit IRC22:11
notmynametdasilva: hmm...I'll have to look back at my notes22:11
notmynametdasilva: I suspect there may have been some miscommunication ;-)22:11
sgundurnotmyname, r u referring to this wsgi ? - https://governance.openstack.org/tc/goals/pike/deploy-api-in-wsgi.html22:12
sgunduror a new item ?22:12
notmynameyep22:12
notmynamewell that's the tc goal. so there's a PTG room for it22:13
notmynamehere https://etherpad.openstack.org/p/ptg-pike-wsgi22:13
sgundurnotmyname, I was looking into that; but thought we (Swift) already complies to it22:13
notmynamebut the etherpad doesn't really give any info22:13
notmynamesgundur: yeah, i think swift is likely already ok on the front22:13
claygnotmyname: i that is mostly going to end up being devstack work22:13
notmynamesgundur: but I've been surprised before by what I think swift is good with vis-a-vis openstack and what other people in openstack think about that ;-)22:14
clayglike I'm sure whoever acctaully tries to pick that up is going to find "swift is different" and there's gunna be some hubub we could avoid maybe if we test/fix the current devstack deployment22:14
sgundurnotmyname, do we need to come up with some write up or something like this - http://docs.openstack.org/developer/keystone/apache-httpd.html and link it on that governance page ?22:14
clayge.g. when we looked it - it seemed like it tried to do the storage nodes - which we could be bad22:14
notmynamesgundur: like https://docs.openstack.org/developer/swift/apache_deployment_guide.html ? ;-)22:14
jrichlii still dont understand how to know where to go on monday.  i have a list of rooms, and a list of etherpads.  i have no mappings between them.  correct?22:14
notmynamejrichli: correct!22:15
sgundurnotmyname, yep saw that earlier today! thanks :)22:15
notmynameclayg: yes.22:15
claygnotmyname: our docs make the same mistake -> For an account service create /var/www/swift/account-server.wsgi:22:15
notmynameour docs were written before we broke that on storage nodes. (doesn't make it right, but that's why)22:16
claygright of course - i'm opening the bug22:16
notmynameclayg: thanks22:16
sgundurnotmyname, even that TC page mentions Swift as one of the projects already deploying devstack with API with WSGI;22:16
sgundurso I am confused, abt the work left to do !22:17
notmynamesgundur: well, it depends on what they mean about "wsgi". we already produce wsgi apps. however, some other words seem to indicate what they really want is to run behind apache and mod_wsgi22:17
sgundurnotmyname, yes that's right. apache + mod_wsgi ; nginx + uwsgi22:19
*** m_kazuhiro has quit IRC22:19
claygsgundur: there's code in devstack that says it does it - everyone is pretty sure it doesn't work22:22
claygbut *I've* never tested it?22:22
sgundurclayg, thanks22:23
sgundurclayg, havn't been using devstack; will look for this22:24
claygI think it *used* to work probably - but I think maybe it regressed and no one noticed - we think the proxy still supports mod_wsgi deployment - and the storage nodes will not into the mid term future22:24
sgundurclayg, by testing you mean we test the REST api calls using some tool like - gabbit ? or different ?22:25
*** JimCheung has joined #openstack-swift22:26
claygi mean like spin up a devstack node twiddle the bits that should make swift deployed behind mod_wsgi - verify it is - and that you can still talk to swift22:26
*** NM has joined #openstack-swift22:26
claygif you can put and get data out of swift through an apache front end the rest of the stuff will probably work to22:27
sgundurclayg, that's helpful. thanks for explaining :)22:28
*** JimCheung has quit IRC22:31
claygsgundur: basically this bug https://bugs.launchpad.net/swift/+bug/166515622:32
openstackLaunchpad bug 1665156 in OpenStack Object Storage (swift) "apache docs should be proxy only" [Undecided,New]22:32
claygsgundur: step 1) try to figure out how to devstack apache + swift 2) fix it 3) fix docs to reflect a working state22:33
notmynamesgundur: I hoping you're asking cause you'll be able to work on it? yeah? yeah!?! yeah!!22:33
claygthen at some point *probably* someone will do something in the gate and the chance of future regression goes down significantly22:33
sgundurclayg, yep; thanks22:33
sgundurclayg, step 0 - install devstack ;)22:34
*** acoles is now known as acoles_22:35
*** acoles_ is now known as acoles22:35
claygsgundur: right there with you bro!  If you're at the PTG come find me on Monday - i'm going to be swift+devstack *master* by wednesday!22:35
claygacoles: you here or not?22:35
clayg:p22:35
acolesclayg: IDK22:36
sgundurclayg, lol :)22:36
timburkekota_: yep, down to one last leak. the odd thing is that we *do* call liberasurecode_encode_cleanup in test_get_fragment_partition, so i guess some backend isn't doing the right thing for its hook there? https://github.com/openstack/liberasurecode/blob/master/test/liberasurecode_test.c#L90722:37
timburkeat least, i *think* i'm reading that failure correctly22:37
*** JimCheung has joined #openstack-swift22:38
*** dmorita has joined #openstack-swift22:38
kota_Will take a look, now finding breakfast, timburk22:39
timburke(also worth noting: that's one last leak *in the gate* -- i have no doubt that there are other leaks scattered about, and i've in fact had to remove my libJerasure.so so i don't get overwhelmed with errors)22:39
*** dmorita has quit IRC22:43
*** sams-gleb has quit IRC22:47
*** sams-gleb has joined #openstack-swift22:47
*** sams-gleb has quit IRC22:52
*** mmotiani_ has joined #openstack-swift22:53
*** mkaminski has quit IRC22:57
*** mmotiani_ has quit IRC22:57
*** catintheroof has quit IRC23:00
*** m_kazuhiro has joined #openstack-swift23:01
*** m_kazuhiro has quit IRC23:01
*** mmotiani_ has joined #openstack-swift23:02
*** JimCheung has quit IRC23:05
*** _d34dh0r53_ is now known as d34dh0r5323:09
*** dmorita has joined #openstack-swift23:10
claygtimburke: kvm supports aarch64 virtualization23:10
*** dmorita has quit IRC23:14
*** dmorita has joined #openstack-swift23:20
*** NM1 has joined #openstack-swift23:25
*** JimCheung has joined #openstack-swift23:27
*** NM has quit IRC23:27
*** _JZ_ has quit IRC23:28
*** kei_yama has joined #openstack-swift23:29
*** acoles is now known as acoles_23:30
*** acoles_ is now known as acoles23:32
*** JimCheung has quit IRC23:32
*** mmotiani_ has quit IRC23:33
*** dja has joined #openstack-swift23:36
*** chsc has quit IRC23:37
*** NM1 has quit IRC23:37
*** sams-gleb has joined #openstack-swift23:50
*** klamath has quit IRC23:51
*** jerrygb_ has joined #openstack-swift23:52
*** jerrygb has quit IRC23:53
*** mmotiani_ has joined #openstack-swift23:56
*** sams-gleb has quit IRC23:56
*** dmorita has quit IRC23:58
*** jerrygb_ has quit IRC23:59
*** jerrygb has joined #openstack-swift23:59
openstackgerritTim Burke proposed openstack/liberasurecode master: Fix memory leaks in liberasurecode_test  https://review.openstack.org/43451323:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!