Thursday, 2016-11-10

kota_indeed00:00
kota_notmyname: from the experience, i'd like to vote humming bird into swift upstream repo :/00:01
notmynamekota_: yes!!00:01
notmynamethis is exactly why I've been advocating for that. we'll see what happens00:02
kota_separate repo is ofenly my frusration in pyeclib/liberasurecode/swift3 etc...00:02
kota_oftenly00:02
notmyname*commonly00:02
*** david_c has quit IRC00:02
timburkeor just "often"00:02
kota_thanks teaher00:02
kota_teacher00:02
*** clu_ has quit IRC00:05
*** clu_ has joined #openstack-swift00:06
* kota_ is going to offline for going to his office, will be back in 1 or 2 hours00:07
*** klamath has quit IRC00:13
*** StraubTW has quit IRC00:13
*** david_c has joined #openstack-swift00:18
*** chlong has joined #openstack-swift00:23
*** diogogmt has quit IRC00:23
*** asettle has joined #openstack-swift00:31
*** asettle has quit IRC00:35
*** vint_bra has quit IRC00:45
*** jerrygb has quit IRC00:48
*** jerrygb has joined #openstack-swift00:49
*** jerrygb has quit IRC00:49
*** jerrygb has joined #openstack-swift00:49
mattoliverausorry I missed the meeting this morning, the wife and I have managed to get food poisoning, and lets just say the last day or so hasn't been pleasent. Still feel like crap so not working today either, I hope to be back at it tomorrow.00:58
*** vint_bra has joined #openstack-swift01:12
*** StraubTW has joined #openstack-swift01:14
claygmattoliverau: get well soon - don't forget ptg tickets!01:15
*** tsg has quit IRC01:16
*** diogogmt has joined #openstack-swift01:17
*** StraubTW has quit IRC01:19
claygnotmyname: thanks for doing that release thing hommie!01:21
notmynameclayg: I hope you're unblocked. I want to continue to figure out the rest of it tomorrow01:25
claygnotmyname: yah i'm good - i'm testing bro ;)01:28
*** vint_bra has quit IRC01:38
*** asettle has joined #openstack-swift02:00
*** asettle has quit IRC02:05
charz_morning02:05
jrichlimattoliverau: I hope that you both feel better soon02:09
*** klrmn has quit IRC02:13
*** david_c has quit IRC02:17
*** abalfour has quit IRC02:20
*** abalfour has joined #openstack-swift02:20
*** clu_ has quit IRC02:40
*** tsg has joined #openstack-swift02:49
openstackgerritCheng Li proposed openstack/swift: prevent object-server from start if no devices  https://review.openstack.org/39591102:53
*** StraubTW has joined #openstack-swift02:54
*** klrmn has joined #openstack-swift03:13
*** klrmn has quit IRC03:25
*** asettle has joined #openstack-swift03:31
*** winggundamth has quit IRC03:31
*** jerrygb has quit IRC03:33
*** asettle has quit IRC03:35
*** klrmn has joined #openstack-swift03:40
*** takashi has joined #openstack-swift03:48
*** klrmn has quit IRC03:51
*** klrmn has joined #openstack-swift03:54
openstackgerritKota Tsuyuzaki proposed openstack/liberasurecode: ISA-L Cauchy support  https://review.openstack.org/39326304:06
*** StraubTW has quit IRC04:06
*** dikonoor has joined #openstack-swift04:07
*** chlong has quit IRC04:13
*** dmorita has quit IRC04:14
*** dmorita has joined #openstack-swift04:16
*** dmorita has quit IRC04:19
openstackgerritKota Tsuyuzaki proposed openstack/pyeclib: ISA-L Cauchy support  https://review.openstack.org/39327604:19
*** links has joined #openstack-swift04:23
*** klrmn has quit IRC04:27
*** jerrygb has joined #openstack-swift04:34
*** jerrygb has quit IRC04:39
kota_tdasilva, notmyname: As I thought, the bindep deosn't work for the dependency management if we built the binary from source, https://gist.github.com/bloodeagle40234/fd81c65c0ee9bb2513ed00e78a23899b04:44
kota_tdasilva, notmyname: probably the bindep refers the package repo (e.g. apt, yum) version04:45
* kota_ is going to try his idea, hard-coded dependency limitation which may be painful needle for devstack gate04:47
*** dmorita has joined #openstack-swift04:56
*** dmorita has quit IRC04:58
*** dmorita has joined #openstack-swift04:59
mahaticmattoliverau: get well soon05:00
*** dikonoor has quit IRC05:08
*** SkyRocknRoll has joined #openstack-swift05:31
kota_mattolivearu: please take care of yourself05:46
*** dmorita has quit IRC05:49
*** dmorita has joined #openstack-swift05:50
*** dmorita has quit IRC05:54
*** dmorita has joined #openstack-swift05:58
*** dfflanders has quit IRC05:59
charz_mattoliverau: sorry to hear that, hope you fell better soon.06:05
*** dmorita has quit IRC06:06
*** dmorita has joined #openstack-swift06:06
*** StraubTW has joined #openstack-swift06:07
*** dmorita has quit IRC06:08
*** dmorita has joined #openstack-swift06:08
*** ChubYann has quit IRC06:09
charz_s/fell/fell06:10
charz_s/fell/feel06:10
*** StraubTW has quit IRC06:12
*** asettle has joined #openstack-swift06:16
*** rcernin has joined #openstack-swift06:17
*** asettle has quit IRC06:21
*** dikonoor has joined #openstack-swift06:23
openstackgerritKota Tsuyuzaki proposed openstack/liberasurecode: Need to bump the version to 1.3.0 also erasurecode_version.h  https://review.openstack.org/39596606:30
kota_notmyname: i noticed we should bump the header version in liberasurecode too. sorry i forgot it in this morning.06:33
notmynamekota_: ah? so another point release for liberasurecode?06:33
*** jerrygb has joined #openstack-swift06:35
kota_notmyname: not sure if we need to make another release point but the change in the erasurecode_version.h is need for pyeclib to know which liberasurecode version is used06:35
zaitcevalready tagged?06:35
zaitcevcan you do git push -f --tags?06:36
notmynamekota_: ah, I see. sorry about that. now I know for next time06:37
notmynamezaitcev: not sure, but I don't think that's the right answer anyway06:37
notmynamewe can do a simple 1.3.106:37
zaitcevooooooh, that's actually superb. It now matches pyeclib06:38
zaitcevyou can pretend that it was planned06:38
notmynameheh. except we'll be releasing pyeclib, too, right? to use the 1.3.1 of liberasurecode06:38
notmynamehmm...I wonder if this would be a convenient opportunity to combine them06:39
zaitcevOh, right. In RDO it's all in RPM spec, so I don't really need to bump python-pyeclib, as long as it's compatible with the new liberasurecode.06:39
notmynametrue, but you *really* want the new liberasurecode to avoid bad things. the dependency version bump is IMO our way of saying "do it now or else"06:40
notmynamezaitcev: but if you've got a better way, especially from the perspective of the distro packager, on what to do, I'm all ears06:41
openstackgerritKota Tsuyuzaki proposed openstack/liberasurecode: Prepare version bump to 1.3.1  https://review.openstack.org/39596606:41
kota_notmyname: addressed to 1.3.1 for the header change.06:42
*** jerrygb has quit IRC06:42
kota_do we need changlog? i don't think for the qucik release...06:42
openstackgerritJohn Dickinson proposed openstack/liberasurecode: Version bump to 1.3.1  https://review.openstack.org/39596606:44
notmynamekota_: yeah. I'd like to push over it, though06:44
notmynameyeah, that06:44
notmynamekota_: I pushed over with the changelog. look ok?06:45
notmynamekota_: if so, land it and I'll tag it06:45
kota_notmyname: looks good06:45
notmynamekota_: ok. do the honors (+2/+A)06:46
kota_notmyname: thanks for working on your late night.06:50
notmynamekota_: click the button, and i'll be able to go to bed ;-)06:50
notmynameI'm glad you found this and we'll be able to get it finished quickly :-)06:51
*** pcaruana has joined #openstack-swift06:51
kota_done06:51
notmynamethanks. should merge in ~5 minutes06:52
openstackgerritMerged openstack/liberasurecode: Version bump to 1.3.1  https://review.openstack.org/39596606:55
notmynamedone. 1.3.1 tag is upstream now06:56
*** rcernin has quit IRC06:56
notmynamekota_: thank you very much for your work on getting the EC issue fixed06:56
*** rcernin has joined #openstack-swift06:56
kota_notmyname: you're welcom :-) and not finished yet ;-)06:57
notmynameyou're doing good work06:58
notmynamebut i'm finished for today. good night :-)06:58
*** chlong has joined #openstack-swift06:58
kota_notmyname: have a good sleep06:58
*** dmorita has quit IRC06:59
*** dmorita has joined #openstack-swift07:00
*** sams-gleb has joined #openstack-swift07:02
*** sams-gleb has quit IRC07:02
*** sams-gleb has joined #openstack-swift07:02
*** dmorita has quit IRC07:04
*** dmorita has joined #openstack-swift07:04
*** chlong has quit IRC07:09
*** dmorita has quit IRC07:18
*** tesseract has joined #openstack-swift07:20
*** tesseract is now known as Guest4021607:20
*** dmorita has joined #openstack-swift07:21
*** oshritf has joined #openstack-swift07:23
*** dmorita has quit IRC07:26
*** oshritf has quit IRC07:26
*** oshritf has joined #openstack-swift07:27
*** oshritf has quit IRC07:30
*** sams-gleb has quit IRC07:35
*** sams-gleb has joined #openstack-swift07:35
*** oshritf has joined #openstack-swift07:36
*** sams-gleb has quit IRC07:40
*** asettle has joined #openstack-swift07:47
*** openstackgerrit has quit IRC07:48
*** openstackgerrit has joined #openstack-swift07:48
*** oshritf has quit IRC07:49
*** oshritf has joined #openstack-swift07:51
*** asettle has quit IRC07:52
*** sams-gleb has joined #openstack-swift07:52
*** SkyRocknRoll has quit IRC07:52
*** sams-gleb has quit IRC07:54
*** cbartz has joined #openstack-swift07:58
*** oshritf has quit IRC07:59
*** SkyRocknRoll has joined #openstack-swift08:04
openstackgerritKota Tsuyuzaki proposed openstack/pyeclib: Make hard-coded dependency for liberasurecode>=1.3.1  https://review.openstack.org/39599808:06
kota_hmm... I'm realizing patch 395998 may be bad way.08:06
patchbothttps://review.openstack.org/#/c/395998/ - pyeclib - Make hard-coded dependency for liberasurecode>=1.3.108:06
kota_because it seems too painful to manage.08:07
kota_however, right now we need to build liberasurecode from source to use the newest.08:07
kota_to track the master or github tags, we need a few of hard-coded things but it cannot be detected in the packager maintainance which is used in gerrit gate vm's08:09
kota_from source and patches (fast?) vs waiting packagers (slow? not slow? not sure)08:10
*** oshritf has joined #openstack-swift08:11
kota_and the last item is whether we need to consider user overwritten binary built from source over the packager's :/08:11
kota_too complex dependency management :'(08:12
*** tsg has quit IRC08:12
*** tsg has joined #openstack-swift08:12
*** sams-gleb has joined #openstack-swift08:13
*** rledisez has joined #openstack-swift08:13
*** oshritf has quit IRC08:14
*** oshritf has joined #openstack-swift08:17
*** oshritf has quit IRC08:21
*** amoralej|off is now known as amoralej08:26
*** acoles_ is now known as acoles08:35
*** oshritf has joined #openstack-swift08:38
*** jerrygb has joined #openstack-swift08:38
*** geaaru has joined #openstack-swift08:39
acoleshi kota08:43
kota_hi acoles08:43
*** jerrygb has quit IRC08:44
acoleskota_: looks like you're doing great work08:44
*** jordanP has joined #openstack-swift08:44
kota_acoles: thank you08:44
kota_acoles: but sorry i couldn't have enough time to think of admin6's auditor renamer problem.08:45
acolesnotmyname: clayg cschwede (I just glanced over scrollback...) we don't have any gating test job using EC policy AFAIK. We have the community CI job using EC. If we could add an EC policy to in process tests then it would be easy to drop in another in process gate jon configured to use EC, jrichli put some framework in to config in process tests for the encryption job.08:46
acoleskota_: NP I could not find any explanation in code. maybe was two auditor processes??08:48
kota_acoles: maybe??08:50
kota_acoles: and sounds great to add EC policy testing to the gate anyway.08:50
acolesntata: were you looking into oslo.config for swift? I have been discussing some ideas with lxsli who knows a bit about oslo.config, see https://etherpad.openstack.org/p/swift_oslo-config08:51
*** geaaru has quit IRC09:06
*** oshritf has quit IRC09:15
*** geaaru has joined #openstack-swift09:20
*** oshritf has joined #openstack-swift09:20
*** oshritf has quit IRC09:26
*** asettle has joined #openstack-swift09:37
*** geaaru has quit IRC09:41
*** pcaruana has quit IRC09:49
*** geaaru has joined #openstack-swift09:55
*** pcaruana has joined #openstack-swift10:01
*** oshritf has joined #openstack-swift10:06
*** oshritf has quit IRC10:06
*** StraubTW has joined #openstack-swift10:09
*** StraubTW has quit IRC10:15
*** dikonoor has quit IRC10:16
openstackgerritAlistair Coles proposed openstack/swift: WIP read conf options from alternate ini file  https://review.openstack.org/39608910:40
*** mvk has quit IRC10:40
*** jerrygb has joined #openstack-swift10:40
*** jerrygb has quit IRC10:45
mahaticacoles: ^ nice start!10:45
*** kei_yama has quit IRC10:46
acolesmahatic: hi. fyi https://etherpad.openstack.org/p/swift_oslo-config10:46
* acoles afk for a while10:46
mahaticacoles: thanks10:47
*** dikonoor has joined #openstack-swift11:19
*** smatzek has joined #openstack-swift11:23
*** mvk has joined #openstack-swift11:24
*** jerrygb has joined #openstack-swift11:25
*** SkyRocknRoll has quit IRC11:38
*** qwertyco has joined #openstack-swift11:42
*** qwertyco has quit IRC11:42
*** qwertyco has joined #openstack-swift11:42
*** chlong has joined #openstack-swift11:43
*** chlong has quit IRC11:44
*** dikonoor has quit IRC11:49
*** _JZ_ has joined #openstack-swift12:01
*** dikonoor has joined #openstack-swift12:05
*** vint_bra has joined #openstack-swift12:14
*** qwertyco has quit IRC12:22
*** bkopilov has quit IRC12:31
*** Guess456787654 has joined #openstack-swift12:35
*** vint_bra has quit IRC12:51
*** takashi has quit IRC13:01
*** catintheroof has joined #openstack-swift13:08
*** amoralej is now known as amoralej|lunch13:30
*** jerrygb has quit IRC13:35
*** jerrygb has joined #openstack-swift13:36
*** jerrygb has quit IRC13:40
*** vint_bra has joined #openstack-swift13:42
*** jerrygb has joined #openstack-swift13:47
*** silor has joined #openstack-swift13:54
openstackgerritKota Tsuyuzaki proposed openstack/pyeclib: Make hard-coded dependency for liberasurecode>=1.3.1  https://review.openstack.org/39599813:56
openstackgerritAlexis Lee proposed openstack/swift: WIP PoC to add oslo-config-generator to Swift  https://review.openstack.org/39620813:56
kota_hmmm... it looks like we are back to those days how to install liberasurecode from source in the gate. But it may be worse way?14:00
*** silor1 has joined #openstack-swift14:01
*** silor has quit IRC14:03
*** silor1 is now known as silor14:03
*** amoralej|lunch is now known as amoralej14:05
*** StraubTW has joined #openstack-swift14:09
openstackgerritKota Tsuyuzaki proposed openstack/pyeclib: Make hard-coded dependency for liberasurecode>=1.3.1  https://review.openstack.org/39599814:11
openstackgerritAlistair Coles proposed openstack/swift: Refactor container sync stats reporting  https://review.openstack.org/39509414:12
acolesjrichli: ^^ thx for review, also I found some more places where self.cs could be used to remove some lines14:13
*** jerrygb has quit IRC14:19
*** dmorita has joined #openstack-swift14:19
*** sams-gleb has quit IRC14:23
*** sams-gleb has joined #openstack-swift14:23
*** smatzek has quit IRC14:23
*** dmorita has quit IRC14:24
*** klamath has joined #openstack-swift14:27
*** sams-gleb has quit IRC14:28
*** SkyRocknRoll has joined #openstack-swift14:29
*** links has quit IRC14:31
*** sams-gleb has joined #openstack-swift14:43
*** dikonoor has quit IRC14:49
*** tsg has quit IRC14:57
*** gabor_antal has joined #openstack-swift14:58
*** acoles is now known as acoles_15:01
*** mvk has quit IRC15:01
*** diogogmt has quit IRC15:07
*** smatzek has joined #openstack-swift15:11
*** mvk has joined #openstack-swift15:14
*** SkyRocknRoll has quit IRC15:27
*** tsg has joined #openstack-swift15:29
*** jerrygb has joined #openstack-swift15:31
*** jerrygb has quit IRC15:31
notmynameacoles_: lxsli: very interesting on the config stuff. I'll look at it more later today15:31
*** jerrygb has joined #openstack-swift15:32
*** jerrygb has quit IRC15:39
openstackgerritAlexis Lee proposed openstack/swift: WIP PoC to add oslo-config-generator to Swift  https://review.openstack.org/39620815:42
openstackgerritAlexis Lee proposed openstack/swift: WIP PoC to add oslo-config-generator to Swift  https://review.openstack.org/39620815:43
*** vint_bra1 has joined #openstack-swift15:46
*** vint_bra has quit IRC15:46
*** SkyRocknRoll has joined #openstack-swift15:56
*** Guest40216 has quit IRC15:56
*** diogogmt has joined #openstack-swift15:58
*** klrmn has joined #openstack-swift16:00
*** stradling has joined #openstack-swift16:08
*** links has joined #openstack-swift16:09
*** sgundur_ has joined #openstack-swift16:09
*** rcernin has quit IRC16:11
*** sgundur_ has quit IRC16:16
*** acoles_ is now known as acoles16:17
*** stradling has quit IRC16:21
openstackgerritAlistair Coles proposed openstack/swift: Add process level concurrency to container sync  https://review.openstack.org/21009916:22
acolesjrichli: rebased onto the stats refactor ^^ but no other changes16:24
jrichliacoles: great!  I'll check it out.  thx!16:25
*** silor has quit IRC16:27
*** acoles is now known as acoles_16:31
*** rcernin has joined #openstack-swift16:32
*** mvk has quit IRC16:32
*** eranrom has quit IRC16:33
*** links has quit IRC16:37
*** StraubTW_ has joined #openstack-swift16:44
*** catinthe_ has joined #openstack-swift16:45
*** dikonoor has joined #openstack-swift16:45
*** catintheroof has quit IRC16:46
*** StraubTW has quit IRC16:47
*** tongli has joined #openstack-swift16:51
notmynamegood morning16:53
notmynamethe ML thread "Embracing new languages in OpenStack" is getting interesting. I really like a lot of what cdent has been advocating for.16:53
*** tsg_ has joined #openstack-swift16:59
*** tsg has quit IRC17:00
notmynametimur: I think it would be great if you could add some links to your current work on https://bugs.launchpad.net/swift/+bug/131909717:05
openstackLaunchpad bug 1319097 in OpenStack Object Storage (swift) "Filter results when querying a container" [Wishlist,New] - Assigned to Christian Hugo (christianhugo)17:05
*** cbartz has left #openstack-swift17:12
*** asettle has quit IRC17:16
*** rledisez has quit IRC17:19
*** jordanP has quit IRC17:21
*** david_c_ has joined #openstack-swift17:25
*** tsg__ has joined #openstack-swift17:29
*** tsg_ has quit IRC17:30
*** _JZ_ has quit IRC17:32
*** tsg__ has quit IRC17:35
claygliberasure 1.3.*1* - what happened!?17:40
*** dikonoor has quit IRC17:41
notmynameclayg: we forgot to bump the #defines in the code to say 1.3.017:41
*** acoles_ is now known as acoles17:42
*** _JZ_ has joined #openstack-swift17:43
claygyup - scrollback explains all17:43
claygacoles: no gate ec jobs!?17:44
acolesclayg: not afaict17:44
acolesjust the community cluster job17:44
*** tsg__ has joined #openstack-swift17:45
*** _JZ_ has quit IRC17:46
acolesnotmyname: lxsli and I discussed a bit the single conf file vs multiple swift conf files issue, only really as far as identifying it as an issue17:47
notmynameacoles: ok17:47
*** dmorita has joined #openstack-swift17:48
acoleshaving more than one instance of the same service on the same node is perhaps quite different from the norm e.g. multiple object server instances with differing configs17:48
acolesas well as different conf files for different service types17:49
*** tsg__ has left #openstack-swift17:50
acolesre. auto generated conf files... my hope is that one "win" would be reducing the maintenance of conf options (some of them are documented in four places, with a good chance that >0 are therefore not up to date!)17:50
acolesbut like you I like having a sample conf in the repo tree17:50
acoles(just like a changelog...)17:50
acolesnotmyname: ^^17:51
notmynameyeah, I get the concern about having more than one and getting out of date17:51
notmynameI think it's totally reasonable to be able to generate docs for defined config options. but I'd kinda like to have static sample configs too17:52
acolesyup17:52
*** sgundur_ has joined #openstack-swift17:53
acolesit's also another step to do in a good review - run the doc generator, compile html maybe and check all looks good.17:53
acolesquestion is if we had something like this, could it replace the tables in the deployment guide?? http://docs.openstack.org/developer/nova/sample_config.html17:54
notmynamehmm...inline of a config file doesn't seem an obvious better choice than http://docs.openstack.org/developer/swift/deployment_guide.html#object-server-configuration17:56
*** sgundur_ has quit IRC17:56
*** sgundur_ has joined #openstack-swift17:57
acolesagree, I'm hoping that oslo config might generate something prettier than a sample conf file, i.e. tabulated, but IDK17:57
notmynameacoles: did you learn anything about the bootstrapping problem?18:00
zaitcevnotmyname: Interesting thread indeed.18:00
*** SkyRocknRoll has quit IRC18:01
*** LZ has joined #openstack-swift18:01
*** LZ has quit IRC18:02
acolesnotmyname: yes, spent yesterday afternoon discussing it with lxsli, latest thoughts are on the etherpad. So, the key realisation is that wsgi loader is the bootstrapper - we already have it! the wsgi loader already passes each middleware a dict of opts which the middleware can use to create an oslo configopts instance with its option schema checking magic. And we could (if wanted) teach the wsgi loader to read opts from a18:07
acoles regular ini file (like all other oslo configured projects) and merge those with the dict it passes to each middleware. See patch 396089.18:07
patchbothttps://review.openstack.org/#/c/396089/ - swift - WIP read conf options from alternate ini file18:07
timburke88 page-downs. that's a big config file!18:07
acolestimburke: rotate your monitor 90 degrees, you may get to down to ~50 ;)18:08
timburkei'm not rotating my 4k. i think that may require duct tape18:09
acolesnotmyname: so IF you want an ini conf that is separate from your paste ini, then we know how do do that and be backwards compatible.18:09
acolestimburke: now I'm jealous18:09
*** Renich has joined #openstack-swift18:28
*** jamielennox|away is now known as jamielennox18:37
*** ChubYann has joined #openstack-swift18:53
zaitcevso we have liberasurecode 1.3.1 and not picked upt https://review.openstack.org/#/c/386890/ ;_;18:55
patchbotpatch 386890 - liberasurecode - Beautify fill_buffer()18:55
*** sgundur_ has quit IRC18:56
*** amoralej is now known as amoralej|off18:58
*** geaaru has quit IRC19:01
timburkeoh, hey! i have commit bits there now!19:02
notmynameacoles: intesting19:03
*** asettle has joined #openstack-swift19:07
openstackgerritMerged openstack/liberasurecode: Beautify fill_buffer()  https://review.openstack.org/38689019:07
*** asettle has quit IRC19:09
*** asettle has joined #openstack-swift19:09
*** asettle has quit IRC19:14
notmynametdasilva: http://lists.openstack.org/pipermail/openstack-dev/2016-November/107133.html19:37
notmynameif my assumption is correct, I'm concerned that it's only the stuff in the left column that is counted towards "cross-project"19:38
notmynamewell, that's the case anyway (cross-project vs inter-project)19:38
claygtimburke: zaitcev: what's the biggest size_t we ever use?  are we counting on integer overflow instead of explicit modulo?19:39
notmynamebut that "cross-project" proposals would have to be gated by a small group19:39
timburkeclayg: yeah, stuffing a too-large number into a char does the '% 256' for us19:40
zaitcevclayg: Since it's unsigned, overflows are probably harmless, as long as you expect them to happen... E.g. know they can wrap your address space.19:40
zaitcevoh, the fill_buff19:40
claygtimburke: oh kay - I guess I sort of thought it was bad form to "ignore/use" overflow like (and it's *much* bigger than 256 right?) that w/o sort of owning it (a comment or something) - i guess I just need to get used to modern c19:42
zaitcevThat one relies on truncation, yes. But I have to admit, I didn't want to get too ashamed and I created a test program that ran old and new code side by side and compared that fill remains the same. Even though it does not really matter how you fill, the fill values aren't used for anything.19:42
zaitcevNote that it's a kind of fibonacchi fill, not sequential. No idea why, maybe a bug in the original :-)19:43
*** jerrygb has joined #openstack-swift19:43
zaitcevI have this book https://www.amazon.com/Hackers-Delight-Henry-Warren-Jr/dp/0201914654/19:44
*** openstackgerrit has quit IRC19:48
*** openstackgerrit has joined #openstack-swift19:49
tdasilvanotmyname: thanks for the email, hopefully there will be some clarification19:57
*** cppforlife_ has quit IRC20:00
*** cppforlife_ has joined #openstack-swift20:03
*** mgagne has joined #openstack-swift20:07
claygzaitcev: the original never had values > 256 - the new will go up to unsigned int - unless we never created like... idk 128K buffers?20:08
zaitcevyeah but it's properly clipped20:08
zaitcevby assignment20:08
*** sgundur_ has joined #openstack-swift20:09
claygoh wow, unsigned ints or sorta big on modern hadware :P more like > 4GiB ;P20:10
zaitcevThis will work on anything, even sparc20:11
claygi'm sure it will "work" - you know - i guess I just don't know what the buffer is used for :P20:11
claygthe % 256 seemed to hint maybe thought something like ascii/char/byte buffer or something20:12
zaitcevIt's just garbage, to make sure spurious zero-fill or spurious use are caught20:12
zaitcevThe best is to fill it with some pseudo-random noise, maybe plus-and-mult.20:13
mgagneis there a way to make swift-init work for humans (not upstart or init scripts) if swift binaries aren't in the default PATH (without having to update PATH in .bashrc) ?20:13
claygoh, but there's the whole fibonacci thing - i really don't know what size_t will overflow!  fascinating20:13
claygmgagne: not really - it uses subprocess - which uses os.execvp20:16
mgagneok, so there is no known way to override PATH or whatever in swift.conf20:16
claygmgagne: not currently - but it seems like there is possibly a reasonable use-case there20:17
mgagneright, will figure out a way to do it for now, maybe updating PATH in /etc/environment20:18
claygmgagne: some of the work I'm doing to support the transistion to hummingbird will have swift-init finding /etc/swift/<service>.conf[.d] and parsing that before forking the implementation script/binary20:18
mgagne=)20:18
claygit's possible that + ntata's work to make the /etc/swift root configurable via some kind of env could lead to swift_dir = and swift_bin = sorta of config options20:18
claygor idk, something else20:19
claygi don't acctually need to do a swift_bin kind of thing - i'm just choosing which binary to load based on the config option - my point was there may at some point be infrastructure that would make plubming for that trivial assuming there was use-case for a swift_dir20:19
claygwhat's so bad about updating PATH ;)20:19
*** gyee has joined #openstack-swift20:27
openstackgerritPete Zaitcev proposed openstack/swift: Add dist-collect and dist: target  https://review.openstack.org/39639420:32
zaitcevI update PYTHONPATH20:33
zaitcevsometimes20:33
mgagneclayg: someone has to manage the config =)20:34
*** Guess456787654 has quit IRC20:34
*** rcernin has quit IRC20:36
*** acoles is now known as acoles_20:36
claygzaitcev: how does that help find the binaries?20:36
mgagnewill create symlinks in usr/bin for convenience for now20:36
claygmgagne: yeah sure or that - but if you have root anyways - why not just install there?20:37
mgagnebuilding custom packages with dh-virtualenv20:37
zaitcevclayg: it collects the source, which I need to build the binaries, because Fedora/RDO/RHOS buildroots/containers do not have networking and thus cannot use git. And we want signed tarballs from a trusted source anyway.20:37
mgagneinitial goal was to isolate the install in /opt/openstack/swift so I can stage an update and flip a symlink20:38
zaitcevclayg: The etherpad says "current thinking is that nobody expects tarballs of go source code". Precisely because of that thinking, I had to set about making my own tarballs.20:38
zaitcevmgagne: That is very interesting! I never did that, just upgraded node by node. Stop services, "dnf update", swift-init main start, swift-init rest start, go to next node. Nobody ever notices there was an upgrade going on.20:41
claygmgagne: oic - interesting20:41
mgagneit's not an original idea, rackspace is/was using this method years ago20:41
*** sams-gleb has quit IRC20:46
*** sams-gleb has joined #openstack-swift20:47
*** sams-gleb has quit IRC20:48
*** sgundur_ has quit IRC20:53
*** gyee has quit IRC20:54
*** clu_ has joined #openstack-swift20:54
openstackgerritMerged openstack/python-swiftclient: 3.2.0 release notes  https://review.openstack.org/39576821:20
*** smatzek has quit IRC21:21
*** gyee has joined #openstack-swift21:32
*** Jeffrey4l has quit IRC21:33
openstackgerritTim Burke proposed openstack/swift: adding reno sphinx tree  https://review.openstack.org/38138221:34
*** sgundur_ has joined #openstack-swift21:34
*** vint_bra1 has left #openstack-swift21:37
*** sgundur__ has joined #openstack-swift21:46
*** sgundur_ has quit IRC21:48
claygzaitcev: so is the problem you're trying to solve with dist-collect is that python setup.py sdist isn't puttig the golang code in the source tarball?21:48
zaitcevclayg: It does, and in fact I use that currently. But I need the dependencies too.21:49
claygzaitcev: I don't understand who is saying that nobody (developers? packagers? deployers?) expects tarballs of go source code21:49
zaitcevBecause I can't run go get when building21:49
claygi thought the expectation was that you would buildrequres the golang-XXX-devel; which would install into GOPATH and then the `go get` would not be required?21:50
clayghttps://fedoraproject.org/wiki/PackagingDrafts/Go#Packaging_a_binary <- sorta looking at this21:50
claygor http://pkg-go.alioth.debian.org/packaging.html21:51
claygdepending on your posion21:51
zaitcevI need to experiment with that BuildRequires: golang(github.com/owner/project) one day.21:52
zaitcevHopefuly then we can abandon that dist-collect thing.21:58
*** catinthe_ has quit IRC21:59
notmynameFYI swiftclient release request https://review.openstack.org/#/c/396418/21:59
patchbotpatch 396418 - releases - 3.2.0 swiftclient release21:59
*** smatzek has joined #openstack-swift22:01
*** smatzek has quit IRC22:02
claygzaitcev: yes, let's hope!22:02
mattoliveraumorning22:03
timburkemattoliverau: feeling better?22:14
*** tongli has quit IRC22:17
*** jerrygb_ has joined #openstack-swift22:21
*** jerrygb has quit IRC22:24
*** jerrygb has joined #openstack-swift22:25
*** jerrygb_ has quit IRC22:26
timurnotmyname: good idea. Once I wrap up the current work items at work, I'll submit a review to pull in what SwiftStack is doing for metadata search into Swift, to at least get some discussion going around it22:26
notmynametimur: thanks22:26
*** jerrygb_ has joined #openstack-swift22:27
openstackgerritDrew Balfour proposed openstack/swift: add byteorder information and logic to ring files  https://review.openstack.org/39523722:28
*** jerrygb has quit IRC22:30
*** jerrygb_ has quit IRC22:31
notmynameabalfour: heh. for some reason your comment on that patch made me laugh. "got way more complicated that originally thought" :-)22:32
*** Renich has quit IRC22:33
abalfouryeah... once I started doing things like this:22:33
abalfour       fmt = '>H' if sys.byteorder == 'little' else '<H'22:33
abalfour       dev_len = len(ring_dict['devs'])22:33
abalfour       byteswapped_dev_len = struct.unpack(fmt, struct.pack('=H', dev_len-1))[0]22:33
abalfourI figured I should step back from the edge.22:34
claygwhoa22:34
*** mvk has joined #openstack-swift22:34
abalfourbyteswap the length of the array and check to see if that value appears in the serialized version, and make sure nothing bigger does, and ... yeah.22:35
*** mmotiani2 has joined #openstack-swift22:38
*** mmotiani2 has quit IRC22:39
*** abalfour has quit IRC22:41
openstackgerritMerged openstack/swift: adding reno sphinx tree  https://review.openstack.org/38138223:00
*** catintheroof has joined #openstack-swift23:05
*** sgundur__ has quit IRC23:06
*** catintheroof has quit IRC23:09
*** catintheroof has joined #openstack-swift23:17
*** klamath has quit IRC23:27
mattoliverautimburke: feeling much better. Having my first coffee in a few days.. and its amazing :)23:29
*** StraubTW_ has quit IRC23:31
*** Jeffrey4l has joined #openstack-swift23:31
*** Guess456787654 has joined #openstack-swift23:33
*** diogogmt has quit IRC23:33
*** kei_yama has joined #openstack-swift23:34
*** diogogmt has joined #openstack-swift23:43
*** Guess456787654 has quit IRC23:48
timburkeapply last [shuffle WTF!? "\"Sorry, what was that?\"" "\"Re-write me in Go.\""]23:55
patchbotSorry, what was that?23:55
notmynameDo not taunt happy fun patchbot23:58
*** Guess456787654 has joined #openstack-swift23:58
timburkebut it's so fun to do!23:59
*** Guess456787654 has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!