Friday, 2017-03-10

*** NM has quit IRC00:00
*** Guest59433 has joined #openstack-swift00:09
*** catintheroof has quit IRC00:29
*** catintheroof has joined #openstack-swift00:30
*** catintheroof has quit IRC00:30
*** Guest59433 has quit IRC00:36
*** jamielennox is now known as jamielennox|away00:36
*** jamielennox|away is now known as jamielennox00:37
*** catintheroof has joined #openstack-swift00:42
tone_zGood morning! :)00:52
mattoliverautone_z: morning00:55
tone_zmattoliverau: morning :)00:56
*** zhurong has joined #openstack-swift00:56
*** vint_bra has quit IRC00:57
tone_zmattoliverau: good evening :-)00:58
mattoliverautone_z: well it's almost 12pm here so maybe almost good afternoon really00:58
tone_zoh :)00:59
*** m_kazuhiro has joined #openstack-swift01:04
m_kazuhirogood morning.01:04
mattoliveraum_kazuhiro: morning01:10
m_kazuhiromattoliverau: morning!01:19
kota_good morning01:30
openstackgerritgengchc2 proposed openstack/python-swiftclient master: Removes unnecessary utf-8 coding for python-swiftclient  https://review.openstack.org/41488101:36
*** sams-gleb has joined #openstack-swift02:01
*** sams-gleb has quit IRC02:05
*** pxwang_ has quit IRC02:16
*** dja has quit IRC02:17
*** dja has joined #openstack-swift02:19
*** dschultz has quit IRC02:27
*** klrmn has quit IRC02:28
mattoliveraukota_: morning02:30
*** vint_bra has joined #openstack-swift02:33
kota_mattoliverau: o/02:35
*** winggundamth has joined #openstack-swift02:56
*** vint_bra has quit IRC02:57
charz_clayg: RE: community cluster for https://review.openstack.org/#/c/39078102:59
patchbotpatch 390781 - swift - Replace replication_one_per_device by custom count02:59
charz_clayg: I saw some function tests failed due to time issue between nodes, likes ` AssertionError: 1489033835.30948 not greater than 1489033835.311847`.03:03
charz_It just a tiny timedelta (0.002). And I try to keep node synced in 1 seconds, but it seems like can't solve the problem.03:05
charz_It's not always happen.03:05
*** asettle has quit IRC03:07
*** andymccr has quit IRC03:08
charz_maybe someone has some ideas?03:08
*** lespaul has joined #openstack-swift03:26
*** dmorita has quit IRC03:28
*** dmorita has joined #openstack-swift03:28
*** dmorita has quit IRC03:30
*** lespaul has quit IRC03:37
*** links has joined #openstack-swift03:38
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873603:40
*** catintheroof has quit IRC03:57
*** catintheroof has joined #openstack-swift03:58
*** catintheroof has quit IRC03:59
*** sams-gleb has joined #openstack-swift04:03
*** m_kazuhiro has quit IRC04:06
*** sams-gleb has quit IRC04:07
*** gkadam has joined #openstack-swift04:22
openstackgerritMerged openstack/swift master: Support EC policy for in process functional tests  https://review.openstack.org/44274904:38
*** psachin has joined #openstack-swift04:42
*** janonymous has quit IRC04:54
*** Mujahid has joined #openstack-swift04:56
jrichlitimburke, clayg: I am trying to determine the best way to add tests when fixing https://bugs.launchpad.net/swift/+bug/165724604:57
openstackLaunchpad bug 1657246 in OpenStack Object Storage (swift) "Proxy logs wrong request method when validating SLO segments" [Critical,Confirmed] - Assigned to Janie Richling (jrichli)04:57
jrichliFor unit testing, maybe just add a mw to the right and verify that the orig_req_method is correct when it is called for the different request types?04:58
jrichliIf we want to go even farther, have that mw make a sub-request, and then invoke the real proxy_logging.log_request by having the real proxy_logging involved as well04:58
jrichlibut that seems more involved.  I don't think we have an example of verifying log output in functional tests, do we?04:58
*** dja has quit IRC05:23
*** mahatic_ has quit IRC05:24
*** adriant has quit IRC05:41
*** JimCheung has joined #openstack-swift05:50
*** JimCheung has quit IRC05:54
openstackgerritMerged openstack/pyeclib master: Add Phazr.IO libphazr backend support  https://review.openstack.org/44078106:03
*** sams-gleb has joined #openstack-swift06:05
*** sams-gleb has quit IRC06:10
mattoliverau^^ cool nice one peeps.06:16
*** mahatic has joined #openstack-swift06:31
*** janonymous has joined #openstack-swift06:34
*** rcernin has joined #openstack-swift06:35
mahaticmattoliverau: off for the day? or still around?06:42
*** dmorita has joined #openstack-swift07:03
*** hseipp has joined #openstack-swift07:04
*** dmorita has quit IRC07:08
mattoliverauOff doing baby routine, so pretty much off for the day, but kinda around :)07:21
*** PavelK has joined #openstack-swift07:26
*** tesseract has joined #openstack-swift07:42
mahaticmattoliverau: ah :) no problem, just wanted clarification on your comment on 439572. Can do it later as well07:46
*** sams-gleb has joined #openstack-swift07:49
*** ChubYann has quit IRC07:51
*** geaaru has joined #openstack-swift07:55
openstackgerritgengchc2 proposed openstack/swift master: Handle readfp deprecation for swift  https://review.openstack.org/44414408:12
*** mccabedo has joined #openstack-swift08:18
*** dja has joined #openstack-swift08:27
*** dja has quit IRC08:35
openstackgerritgengchc2 proposed openstack/swift-bench master: Handle readfp deprecation for swift-bench  https://review.openstack.org/44415508:35
*** bkopilov has quit IRC08:36
openstackgerritRomain LE DISEZ proposed openstack/swift master: Permit to bind object-server on replication_port  https://review.openstack.org/33786108:46
*** amoralej|off is now known as amoralej08:51
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Small fixes for ec duplciation  https://review.openstack.org/43886208:55
acolesnotmyname: jrichli ROFL re p- topics ! There is a reason, but it's lost in history. One day I may switch to q- ;)08:58
* acoles is kinda nervous that jrichli *notices* these things :P08:59
acolesmattoliverau: re patch 442749, thanks for +A, that'll be great if you are able to propose a new gate job, add me as reviewer. I'm not sure whether the jenkins VM will spit out a load of liberasurecode warnings (old version) or worse, so make it non-voting and let's see.09:05
patchbothttps://review.openstack.org/#/c/442749/ - swift - Support EC policy for in process functional tests (MERGED)09:05
acolesmattoliverau: I know clayg is working on getting gate to use newer liberasurecode09:06
acolesmattoliverau: BTW, have a great weekend :)09:06
kota_acoles: o/ just pushed a new patch set for patch 43886209:07
patchbothttps://review.openstack.org/#/c/438862/ - swift - Small fixes for ec duplciation09:07
kota_acoles: and i found, perhaps, you should update .mailmap to address current your e-mail address?09:08
kota_acoles: I saw gmail in the gerrit but the mail_map in the swift master looks different (probably stale ones), maybe?09:09
acoleskota_: I saw the new patch, and that md5 optimisation landed :)09:10
acoleskota_: notmyname told me he'd fix the mailmap ;) thanks for the reminder09:11
acoleskota_: apart from composite rings, and the duplication follow up patches, are there any other global EC related patches?09:12
kota_acoles: yeah, thanks for reviews all, the reason i found the mail address is because I was looking for your new e-mail address to add the co-authored-by line.09:12
kota_and Test Cleanup I have now.09:14
kota_acoles:^^09:14
kota_the patch, https://review.openstack.org/#/c/440466/09:15
patchbotpatch 440466 - swift - TestObjectController refactoring09:15
kota_Both effective node election and cross region reconstruction are not yet pushed (still need to think more for me)09:16
acolesoh yes, the test refactor. we need to pick the best time to merge that to try to avoid conflicts with the other follow up patches. I'll take a look, maybe it is ok right now we have the optimisation patch done.09:16
acoleskota_: ok, I have been thinking about "node election" a little...if you mean selecting the best nodes when getting, and when putting, to a composite ring09:17
kota_ah, and patch 440936 is realted to 44046609:17
patchbothttps://review.openstack.org/#/c/440936/ - swift - Fix (un)patch_policies09:17
acolesgot it.09:18
kota_440466 is only for replace/moves the structure of Mixins, and then 440936 is for removing unnecessary unpatch_policies09:18
acolesI'm glad you kept those separate :)09:19
kota_acoles: yeah, to be easy for reviews is much important I learned in the ec_duplication patch ;-)09:19
*** tone_z has quit IRC09:22
kota_acoles: for "node election", if you have good idea for that, it's super cool because actually I've not yet reach a good idea how to setup the call back with a few changes...09:23
kota_current call back can be updated by the result of get_responses but the ec_duplciation need both before/after the first get_response tries.09:24
*** janonymous has quit IRC09:24
acoleskota_: yep. I will think some more on that topic.09:27
acoleskota_: also, in the PUT path, I am wondering how we guarantee (in event of failed backend connection) that handoff frags go to handoff nodes in the desired region/ring?09:29
acolesprimary nodes have indexes so we can map frags to them, then lack list prioritises which missing frags to PUT, but the node iter produces handoff nodes and how do we know where each handoff is in global cluster? do we need to know?09:30
kota_acoles: good point09:31
acoleskota_: at this moment in time, I need to get up to speed on your ring zipper patch, plus think some more. I'm sure we'll figure it out :)09:32
kota_I added that to my task list "what we should think of" now.09:32
kota_yeah09:32
kota_acoles: how do you feel the clay's suggestion on the ring zipper? add new command 'zip' to buider vs making a new ring-zipper binary, i mean09:34
acoleskota_: I haven't got that far yet :)09:34
acoleskota_: from your comment ^^ alone, it sounds reasonable, but I should review the patch today09:35
kota_acoles: ok, you can look at the comments how clayg is thinking at the patch in the gerrit.09:35
kota_acoles: yeah, i think the basic routine in the current pach can be used for both ways but it affects the interface for users (in paticular operators)09:36
kota_so now I'm carefully thinking of that while fixising some existing patches :P09:36
acoleskota_: you are *busy*!09:37
kota_:P it's fun!09:37
acolesjrichli: it crossed my mind to support ec+encryption in process tests, but felt like that would be a separate next step. in this case I don't think there would be any interactions or conflicts between the loaders, so in principle accepting a list of loaders might be sufficient.09:38
acoleskota_: "better busy than bored"09:39
kota_true09:39
acolesjrichli: but as you say, we'd need to be careful not to get some inconsistent config. that said, this is not a general plugin mechanism, we write this code.09:40
*** donagh_ has joined #openstack-swift09:41
*** mccabedo has quit IRC09:41
acolesntata: jrichli mentioned you on this patch - does your experience match what I report there? https://review.openstack.org/44316209:43
patchbotpatch 443162 - swift - Document SAIO rsync service setup for ubuntu 1609:43
*** dmorita has joined #openstack-swift09:44
*** dmorita has quit IRC09:49
*** andymccr has joined #openstack-swift10:03
*** asettle has joined #openstack-swift10:03
*** kjz has joined #openstack-swift10:09
*** zhurong has quit IRC10:10
*** openstackgerrit has quit IRC10:33
*** openstackgerrit has joined #openstack-swift10:50
openstackgerritAlistair Coles proposed openstack/swift master: Update .mailmap  https://review.openstack.org/44421310:50
acoleskota_: notmyname ^^10:51
*** kei_yama has quit IRC10:51
openstackgerritRomain LE DISEZ proposed openstack/swift master: Permit to bind object-server on replication_port  https://review.openstack.org/33786110:55
kota_acoles: that mailmap change looks good to me, I confirmed git shortlog identify you as a person. In the master I can find you twice with current e-mail and the old one.11:05
kota_acoles: i think i can add +2 +A for that by only myself review?11:05
kota_single +2 I mean11:06
acoleskota_: you are asking me to give you permission to +A my own patch? :D11:06
acoleskota_: I think you can do that. notmyname can correct us later if we are wrong.11:07
kota_acoles: sure, just for confirmation11:07
kota_done11:08
acoleskota_: thanks! have a great weekend11:09
kota_acoles: thanks too, just preparing to leave my office ;-)11:09
kota_acoles: and have a nice weekend too11:09
*** vint_bra has joined #openstack-swift11:15
Mujahidwhile running openstack container create mycontainer getting following error: openstack container create mycontainer11:15
MujahidPassword:11:15
MujahidDiscovering versions from the identity service failed when creating the password plugin. Attempting to determine version from URL.11:15
MujahidSSL exception connecting to https://9.3.89.178:5000/v3/auth/tokens: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590)11:15
*** oshritf has joined #openstack-swift11:16
*** Mujahid has quit IRC11:24
*** links has quit IRC11:37
*** links has joined #openstack-swift11:54
*** NM has joined #openstack-swift11:57
*** vint_bra has quit IRC12:00
*** SkyRocknRoll has joined #openstack-swift12:03
*** donagh_ has quit IRC12:07
*** dmorita has joined #openstack-swift12:07
*** donagh_ has joined #openstack-swift12:11
*** dmorita has quit IRC12:12
*** dmorita_ has joined #openstack-swift12:12
*** dmorita has joined #openstack-swift12:13
*** dmorita_ has quit IRC12:13
*** sileht has quit IRC12:17
*** dmorita has quit IRC12:18
*** sileht has joined #openstack-swift12:18
*** sileht has quit IRC12:18
*** sileht has joined #openstack-swift12:18
acolesMujahid: you left ... but that error looks like it is from openstack client's interaction with keystone (on port 5000) before it even attempts to make a request to swift12:19
*** catintheroof has joined #openstack-swift12:34
*** dmorita has joined #openstack-swift12:35
*** dmorita has quit IRC12:40
*** gkadam has quit IRC12:44
*** acoles_ has joined #openstack-swift12:45
*** ChanServ sets mode: +v acoles_12:45
*** sams-gleb has quit IRC12:51
*** SkyRocknRoll has quit IRC12:52
*** sileht has quit IRC13:03
*** sileht has joined #openstack-swift13:03
*** sileht has quit IRC13:03
*** sileht has joined #openstack-swift13:03
*** sileht has quit IRC13:08
*** sileht has joined #openstack-swift13:08
*** sileht has quit IRC13:08
*** sileht has joined #openstack-swift13:10
openstackgerritAlistair Coles proposed openstack/swift master: Small fixes for ec duplication  https://review.openstack.org/43886213:10
openstackgerritAlistair Coles proposed openstack/swift master: Include received frag_index in reconstructor log warnings  https://review.openstack.org/44428113:10
*** kjz has left #openstack-swift13:11
*** winggundamth has quit IRC13:12
*** links has quit IRC13:17
*** vint_bra has joined #openstack-swift13:19
*** sams-gleb has joined #openstack-swift13:20
*** vint_bra has quit IRC13:21
*** disaster has joined #openstack-swift13:22
disasterhi! am i suppose to use specific ACL to put on tempurl? or configure something more than generate the url with "swift tempurl PUT 60 url key" and upload with curl --upload-file file url13:25
*** links has joined #openstack-swift13:31
*** ujjain has quit IRC13:39
*** links has quit IRC13:39
openstackgerritMerged openstack/swift master: Update .mailmap  https://review.openstack.org/44421313:48
*** ujjain has joined #openstack-swift13:50
*** ujjain has joined #openstack-swift13:50
rledisezdisaster: you don't need ACL.14:01
rledisezfirst, setting a key on your container :14:01
rledisezcurl -X POST -H "X-Container-Meta-Temp-URL-Key: a_secret_key" -H 'X-Auth-Token: ****' https://example.com/v1/AUTH_3e649efb369040259d5c118fb8fefe7e/container14:01
rledisezsecond, generating the tempurl:14:01
rledisezswift tempurl PUT 60 /v1/AUTH_3e649efb369040259d5c118fb8fefe7e/container/tempurl_object a_secret_key14:01
rledisezthird, use the tempurl (in the next 60 seconds)14:01
rledisezcurl -X PUT -T my_file "https://example.com/v1/AUTH_3e649efb369040259d5c118fb8fefe7e/container/tempurl_object?temp_url_sig=d2fb476ebe175f46277ead09f72e3ad78f2b879e&temp_url_expires=1489154271"14:01
disasterrledisez: i come back in 5mn to tell you if it work14:03
disasterrledisez: container need to be public?14:06
rledisezno14:06
*** McMurlock1 has joined #openstack-swift14:12
disasterrledisez: i'm sorry but i don't find out what is x-auth-token14:13
rledisezit's the authentication token you got from keystone14:15
rledisezdisaster: if you don't know how to get a token, you can set the meta with the swift client14:16
rledisezyou will just need project, user, password14:16
rledisezor run a simple command with swift client, with --debug flag, you'll see the token in the debug logs14:17
*** PavelK has quit IRC14:21
*** amoralej is now known as amoralej|lunch14:21
*** gkadam has joined #openstack-swift14:24
*** dmorita has joined #openstack-swift14:25
*** dmorita has quit IRC14:30
disasterrledisez: 401 unauthorized: Temp URL invalid14:30
tdasilvadisaster: if you testing with curl, make sure you have the " around, i always forget and get that error14:32
patchbotError: No closing quotation14:32
disastertdasilva: i try with and without both error14:34
disasterrledisez: when u generate the tempurl you put tempurl_object what is this?14:37
rledisezdisaster: the name of the object you want your tempurl to point to14:39
disasterrledisez: ok that's the point i have to define the name before upload? I can't send in full container?14:40
*** silor has joined #openstack-swift14:44
disasterrledisez: thank you it work14:44
rledisezdisaster: for container, you want to used prefix based tempurl :14:46
rledisezswift tempurl --prefix-based PUT 60 /v1/AUTH_3e649efb369040259d5c118fb8fefe7e/container/ a_secret_key14:46
rledisezi never tried it yet14:46
disasterrledisez: ok i try it14:47
disasterno such option: --prefix-based14:48
*** _gleblanc has quit IRC14:50
*** glb has joined #openstack-swift14:51
*** silor1 has joined #openstack-swift14:51
*** silor has quit IRC14:52
*** silor1 is now known as silor14:52
rledisezdisaster: upgrade your swift client, it's a recent feature14:53
disasterrledisez: is it in stable release?14:54
tdasilvadisaster: yes, it's in ocata: https://github.com/openstack/python-swiftclient/commits/stable/ocata14:54
*** glb has quit IRC14:56
*** glb has joined #openstack-swift14:56
disastertdasilva: probably not in apt cause he don't want upgrade14:56
rlediseztdasilva: did you already use it? prefix-based works for a GET, but i can't make a PUT request. is it normal?14:56
*** sams-gleb has quit IRC14:57
*** dmorita has joined #openstack-swift14:58
*** sams-gleb has joined #openstack-swift14:58
tdasilvarledisez: played with it a while back, don't remember the specifics (I thought it would work with PUT), let me test....14:58
tdasilvatoo bad cbartz is not around...14:58
rlediseztdasilva: ignore, it works. i probaly mixed up some commands :)14:58
tdasilvaok14:58
disasterso i have to install this from custom package thank you for the help15:00
*** catintheroof has quit IRC15:00
disastera last thing, is it possible to put kind of checksum in upload? Just to get an error for corrupt send and send again?15:01
*** catintheroof has joined #openstack-swift15:01
tdasilvadisaster: not sure about deb. packages, but there are rpm packages already available for rhel based platforms15:01
*** dmorita has quit IRC15:02
tdasilvaonovy: do you package swift client too?15:02
*** sams-gleb has quit IRC15:02
rledisezdisaster: set a header "Etag" with the md5 of the file you're uploading as value15:04
rledisezcurl ... -H 'Etag: b6d81b360a5672d80c27430f39153e2c'15:04
disasterrledisez: that's wonderful thank you15:09
openstackgerritAlistair Coles proposed openstack/swift master: Test EC chunk_transformer with larger input chunks  https://review.openstack.org/44210815:10
openstackgerritAlistair Coles proposed openstack/swift master: Small fixes for ec duplication  https://review.openstack.org/43886215:10
*** gkadam has quit IRC15:11
*** NM has quit IRC15:14
*** chlong_ has joined #openstack-swift15:14
*** sams-gleb has joined #openstack-swift15:17
onovytdasilva: yep15:19
tdasilvaonovy: cool! was just checking, didn't know if it was you or somebody else...15:20
disastertdasilva: i have the 1:2.3.1-1+deb8u1 version seems quite old no?15:20
*** dmorita has joined #openstack-swift15:21
onovyok15:23
notmynamegood morning. I'm taking today off. ping me if you need something, but I might not respond right away15:24
*** dmorita has quit IRC15:25
disastertdasilva: wow my version is from 2014 if i understand the github correctly15:36
tdasilvadisaster: what does 'swift --version' tell you?15:37
disaster2.3.115:37
*** chsc has joined #openstack-swift15:39
*** chsc has joined #openstack-swift15:39
tdasilvadisaster: yep, definitely worth an update if you can...15:39
disastertdasilva: i install python-swiftclient but i see a python3-swiftclient15:39
*** amoralej|lunch is now known as amoralej15:39
*** oshritf has quit IRC15:41
disastertdasilva: i'm on ovh mirror and ftp.debian.org but he don't want to upgrade the swiftclient15:42
disasteronovy: which version am i suppose to have on debian stable?15:42
onovycurrent stable/jessie?15:43
disasteronovy: yes15:43
onovy1:2.3.1-1+deb8u1 or from jessie-backports 1:3.0.0-3~bpo8+115:43
disasteronovy: ho ok so it's from 201415:44
*** vint_bra has joined #openstack-swift15:44
*** vint_bra has quit IRC15:45
disasteronovy: i saw a python3-swiftclient is he more up to date?15:45
onovysame version15:47
disasteronovy: ok thank you15:51
*** rcernin has quit IRC15:59
*** chsc has quit IRC16:00
disastertdasilva: as i'm not a real system admin i think i will stay with the old version to avoid any problem ^^16:09
*** klrmn has joined #openstack-swift16:10
*** gabor_antal has quit IRC16:13
*** zackf has joined #openstack-swift16:13
zackfAnyone have any tips on how to get swift-dispersion-populate to look at a custom cacert?16:14
*** chlong_ has quit IRC16:19
timburkegood morning16:26
*** Mujahid has joined #openstack-swift16:38
*** dims_ has quit IRC16:45
*** dmorita has joined #openstack-swift16:46
*** joeljwright has joined #openstack-swift16:49
*** ChanServ sets mode: +v joeljwright16:49
*** disaster has quit IRC16:53
*** logan_ has joined #openstack-swift16:56
*** logan_ is now known as Guest2958916:57
*** dmorita has quit IRC16:57
zackfHmm, ok, looks like i found out the answer, it doesn't seem possible to have swift-dispersion-populate work with a custome cafile16:57
*** logan- has quit IRC16:59
*** Guest29589 is now known as logan-17:03
*** catintheroof has quit IRC17:07
*** klrmn has quit IRC17:07
*** catintheroof has joined #openstack-swift17:08
*** McMurlock1 has quit IRC17:21
*** dmorita has joined #openstack-swift17:21
*** dmorita has quit IRC17:22
*** dmorita_ has joined #openstack-swift17:22
*** vint_bra has joined #openstack-swift17:29
*** SkyRocknRoll has joined #openstack-swift17:33
*** JimCheung has joined #openstack-swift17:40
*** chsc has joined #openstack-swift17:43
*** chsc has joined #openstack-swift17:43
*** psachin has quit IRC17:48
*** Mujahid has quit IRC17:58
*** klrmn has joined #openstack-swift18:01
*** cbartz has joined #openstack-swift18:20
*** cbartz has quit IRC18:26
openstackgerritTim Burke proposed openstack/swift master: More port number cleanup  https://review.openstack.org/44444818:28
timburkewe should probably consider backporting ^^ and https://review.openstack.org/#/c/440694/ as far back as newton...18:31
patchbotpatch 440694 - swift - Fix port ranges in install guide (MERGED)18:31
*** cbartz has joined #openstack-swift18:36
*** vint_bra has quit IRC18:57
*** cbartz has left #openstack-swift19:05
*** joeljwright has quit IRC19:06
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873619:15
*** acoles_ has quit IRC19:23
*** silor has quit IRC19:38
*** joeljwright has joined #openstack-swift19:38
*** ChanServ sets mode: +v joeljwright19:38
*** chlong_ has joined #openstack-swift19:42
*** dims has joined #openstack-swift19:49
*** ChubYann has joined #openstack-swift20:08
*** hseipp has quit IRC20:24
*** zul is now known as zulVacation20:37
*** amoralej is now known as amoralej|off20:44
*** SkyRocknRoll has quit IRC21:00
ntatahello there! Has anyone tried to distribute swift services across multiple nodes inside of a multinode devstack setup?21:08
ntataby distributing swift services, I mean deploying "s-proxy" on one node and "s-account", "s-container", "s-object" on the other nodes in the context of 2 node devstack setup21:10
timburkentata: i seem to recall cschwede looking into it for rolling-upgrade testing21:12
ntatatimburke, yes, I'm trying to review some of the grenade tests and see if I can fill gaps.21:13
timburkei think the patch was https://review.openstack.org/#/c/304465/ ?21:14
patchbotpatch 304465 - openstack-infra/devstack-gate - Use subnodes for Swift storage nodes in a multinod...21:14
ntatathere are two reviews that are kind of alternative approaches. I'm trying to understand both of them https://review.openstack.org/#/c/411982/ and https://review.openstack.org/#/c/411980/1021:15
patchbotpatch 411982 - openstack-infra/project-config - Swift experimental multinode grenade job21:15
patchbotpatch 411980 - openstack-infra/devstack-gate - Enable Swift multinode grenade testing21:15
ntataa general process of testing rolling upgrades is to upgrade services bottom up i.e. upgrade storage services (a/c/o) and then upgrade proxy21:16
ntatathinking along those lines,  we need to have devstack split services across multiple nodes at the gate when its trying to test rolling upgrade using grenade..21:18
ntatawhich means, I need to make devstack-vm-gate.sh script prepare two separate sets of localrc that deploy swift services across multiple nodes21:20
ntataI'm trying to think out loud here so who ever is getting the context I'm building, can chime in and correct me if I'm wrong21:20
ntataI meant cschwede's one approach and other approach is the patch sets I pasted21:22
ntataI looked around for some material on how to deploy multinode devstack and found this - https://docs.openstack.org/developer/devstack/guides/multinode-lab.html21:22
ntatabut even this lab installs all of swift on one node.. I'm trying to think is there a current way to split swift services across node?21:25
timburkei think as long as you still configure the rings properly (and i think that's what the SWIFT_STORAGE_IPS var is for?), its fine if things are *installed* on both, just so long as you only *start* services on the nodes that you want -- and then the changes to features.yaml seem to handle that part?21:31
timburkei'm not real familiar with which versions get installed where/when with the grenade/multi-node tests though21:34
*** Jeffrey4l__ has joined #openstack-swift21:35
*** Jeffrey4l_ has quit IRC21:35
ntatawell, that's a good point. I never thought of *not starting* services on a node (sometimes, I need to ask question sooner than exploring by myself)!21:36
ntataThanks timburke, I'll try that out.. I was looking at STORAGE_IPS but wasn't really thinking I could play with it21:36
claygtimburke: how'd you get a bee in your bonnet about default port documentation?  You think the *docs* need backporting?  Is there some publishing on the internet that somehow gets built from stable branches?21:48
timburkeclayg: apparently: https://docs.openstack.org/project-install-guide/object-storage/newton/initial-rings.html21:49
timburkethese just came up from the swift bug mailer. they're like 10 minute fixes where leaving them around makes us all look bad21:50
claygtimburke: speak for youself - i look amazing21:51
timburke(notice that https://docs.openstack.org/project-install-guide/object-storage/draft/initial-rings.html has the fixes from 440694)21:52
timburkeclayg: amazing -- for publishing crappy, misleading docs?21:52
timburkei'm not saying docs absolutely must be spectacular -- just that they shouldn't lie to you, and when someone points out that they're lying, we should fix them21:54
claygtimburke: I'm not sure what to say - I still use 600X ports on like all my deployments - i guess if the docs were crappy and misleading that's a bummer for whoever uses them which is maybe not zero people?21:54
claygyeah... there's definately broke things that need fixing - here here21:55
timburkeat least two in the past 10 days -- https://bugs.launchpad.net/swift/+bug/1669389 and https://bugs.launchpad.net/swift/+bug/167189621:56
openstackLaunchpad bug 1669389 in OpenStack Object Storage (swift) "Wrong ports in swift documentation" [Undecided,Fix released]21:56
openstackLaunchpad bug 1671896 in OpenStack Object Storage (swift) "Install and configure the storage nodes for Ubuntu and Debian in Installation Guide for Object Storage Service: Ports Are Inconsistent and Incorrect Based on Later Steps in Process" [Undecided,Confirmed] - Assigned to Tim Burke (1-tim-z)21:56
claygtimburke: that report a bug link is amazing!21:59
timburkeright? it's great! so i want to encourage people to use it by being responsive22:00
claygso going back to my initial questions - "a couple of bugs came through my inbox" "yeah we need to back port to fix the published stable docs"22:00
timburkeyup.22:00
claygcoolio - did you already purpose the backports for notmyname?22:00
timburkenot yet22:00
claygtimburke: so I guess fixing these ports is next?  https://docs.openstack.org/project-install-guide/object-storage/draft/storage-install-ubuntu-debian.html22:03
timburkeclayg: k, proposed cherry-picks for the one that landed; will hold off on the follow-up until it's on master22:03
clayg... in the configs I mean?22:04
notmynametimburke: ack22:04
claygI mean the honest truth I've never tried to go through those docs?22:04
claygI have no idea if they build a good cluster or now?22:04
claygI noticed they don't say "use rsync module per disk" - so that's wrong22:04
claygdo they say servers-per-port?22:04
claygdo they get into monitoring?22:04
timburkeclayg: no idea. but i *do know* the port numbers are wrong, and they'll be fixed with https://review.openstack.org/#/c/444448/22:05
patchbotpatch 444448 - swift - More port number cleanup22:05
claygI just don't feel like I have good grasp on the *audience* of those docs - their use-case - the customer - what is the best way to help them?  what is the thing they need most?  I *guess* those guys need the ports to match the rdo packages... I wonder what ports ubuntu's default configs use... opensuse?22:06
claygmaybe they should just use the ports that are in docs for those configs?22:06
clayg"wrong"?  I mean as long as they are internally consistent they're not "wrong"?22:07
timburkewell, they're certainly inconsistent *now*. take a look at https://docs.openstack.org/project-install-guide/object-storage/draft/initial-rings.html22:08
clayg"there's no point in trying - better to be part of the problem -- @clayg"22:10
claygrofl22:10
claygso maybe fix draft before backporting?  I have no idea.  Maybe i'm sorry I asked!  :P22:10
timburkemaybe everyone was happy using the old ports before i went and did that (unwittingly) partial fix. but it seems better to try to bring them in line with our example configs etc. than leave subtle landmines scattered about22:11
claygI can't think of anything helpful to contribute :'(22:13
claygheheh - so... pretty much normal for ME! lol22:14
timburkeclayg: go +2/+A https://review.openstack.org/#/c/444448/ ! that's helping!22:14
patchbotpatch 444448 - swift - More port number cleanup22:14
openstackgerritMerged openstack/swift master: Add another failing test for 412 logging  https://review.openstack.org/44395422:15
*** joeljwright has quit IRC22:17
timburkeclayg: thank you :-)22:19
claygtimburke: maybe next time I should just start with "timburke: I can see you're rage patching - what can I do to help?"22:19
* timburke is not actually in a rage; he's just learned that there's only one way to talk to clayg, and that's with an energy that's comparable to what clayg normally outputs *every day*22:20
timburkeit must be exhausting to be clayg22:20
claygtry and keep up people22:21
*** chlong_ has quit IRC22:21
*** catintheroof has quit IRC22:23
*** sams-gleb has quit IRC22:24
*** dja has joined #openstack-swift22:35
*** dja has quit IRC22:56
*** dja has joined #openstack-swift23:09
*** tesseract has quit IRC23:29
openstackgerritMerged openstack/swift master: More port number cleanup  https://review.openstack.org/44444823:32
*** chsc has quit IRC23:39
*** chsc has joined #openstack-swift23:53
*** chsc has joined #openstack-swift23:53
*** chsc has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!