Wednesday, 2019-03-13

*** gyee has quit IRC00:30
renichSo, I've been trying to pinpoint where ssbench decides to use /v3/tokens and can't find it.00:39
zaitcev_keystoneclient does it, I think. Although maybe it's swiftclient. And the algorithm is absurdly complicated and was updated several times.00:53
zaitcev_Instead of letting swiftclient to default to legacy, they always try to make it default to "current" keystone. So it was v2 for a few years, then v3. But they want old configurations continue working when someone updates. So, the code tries to guess who old the Keystone is, mostly by looking at the endpoint path.00:55
zaitcev_Of course it backfires.00:56
*** tkajinam_ has joined #openstack-swift00:58
*** tkajinam has quit IRC01:01
renichzaitcev_: OK... no idea where to fix that... man, this is hard...01:02
zaitcev_renich: "``ssbench-master`` supports all the same authentication arguments, with similar semantics, as `python-swiftclient`_'s command-line tool, ``swift``."01:05
zaitcev_sounds like it should be trivial, just give it -V 2 and done01:06
renichzaitcev_: yes, but it doesn't work when I want to use v3 auth01:08
renichzaitcev_: and, since I am using Rocky, I have no v201:08
zaitcev_renich, I don't know what "yes, but" is about it. If -V is provided, there's no automatic discovery anymore, so just give it the right -A and it should be there. Well, maybe /tokens appended at the worst, but probably not even that. Still does not work?01:10
renichzaitcev_: let me try01:10
renichzaitcev_: http://paste.openstack.org/show/747667/01:13
renichIt's trying to find http://localhost:5000/v3/tokens and that endpoint doesn't exist. It has to be /v3/auth/tokens01:14
zaitcev_Well then use -A http://localhost:5000/v3/auth - does that work?01:18
renichOK, will try01:19
renichzaitcev_:  I got this:  2019-03-13 01:32:29,407:DEBUG:Making authentication request to http://localhost:5000/v3/auth/v2.0/tokens01:33
renichI mean, it tries authentication in that endpoint.01:33
zaitcev_well, the client is not what's converting the args these days, so maybe it needs --os-auth-version=301:35
zaitcev_holy shit01:36
zaitcev_ssbench bundles its own client01:36
zaitcev_which does not support v3 period01:37
renichzaitcev_: yep.01:38
zaitcev_https://github.com/swiftstack/ssbench/blob/master/ssbench/swift_client.py#L29601:38
renichzaitcev_: is there a way to re-enable v2 in rocky?01:38
renichzaitcev_: or, maybe, I can tweak that file?01:39
renichadd v3 support or something?01:39
zaitcev_Well, the bundled client looks like a clean clone of the normal client, so it should be trivial to hack over.01:39
* renich isn't a python wizard, btw01:39
zaitcev_rm ssbench/swift_client.py seems like a good first step ... :-)01:39
renichlol01:39
zaitcev_no, really01:39
zaitcev_then when you run it, you see where imports are01:40
renichI, actually, am importing the native client (notmyname helped me do that)01:40
zaitcev_oh01:40
renich#import ssbench.swift_client as client01:40
renichfrom swiftclient import client01:40
renichAnd I had to hardcode some timeouts01:40
zaitcev_In that case, did --os-auth-version help?01:40
renichlet me see. I am using -V 301:40
renichssbench-master: error: unrecognized arguments: --os-auth-version 301:41
renichI will have to add it to line 327 in ssbench-master, right?01:42
zaitcev_weird. Seems like it should work... https://github.com/swiftstack/ssbench/blob/master/bin/ssbench-master#L32901:43
zaitcev_I suppose one can do  ST_AUTH_VERSION=3 ssbench-master and see what happens01:44
renichOK, let me try01:45
renichIt's trying /v3/tokens still. It should try /v3/auth/tokens. Making authentication request to http://localhost:5000/v3/tokens01:46
zaitcev_But this is with ST_AUTH=http://localhost:5000/v3/auth , right?01:46
zaitcev_And you need to remove those additional command line arguments, just incase, if you use the variables.01:47
*** kei-ichi has joined #openstack-swift02:09
*** psachin has joined #openstack-swift03:03
*** renich has quit IRC03:14
*** renich has joined #openstack-swift03:31
openstackgerritMatthew Oliver proposed openstack/swift master: Allow multple keystoneauths in the pipeline  https://review.openstack.org/59397703:35
mattoliverauJust a rebase03:35
*** itlinux has quit IRC03:41
*** kei-ichi has quit IRC04:00
*** mahatic has joined #openstack-swift04:44
*** ChanServ sets mode: +v mahatic04:44
kota_oh, multiple keystoneauth05:25
* kota_ found a typo "multple" -> "multiple"05:25
zaitcev_heh05:26
*** zaitcev_ is now known as zaitcev05:26
openstackgerritMatthew Oliver proposed openstack/swift master: Add a basic partition diffing tool  https://review.openstack.org/53946605:41
mattoliveraukota_: ta :)05:41
mattoliverau^ these are some old patches I thought I'd rebase while waiting for a cloud to build :)05:42
mattoliverauThis last one I'm looking at making sure it's py3 compatible. Which it is mostly. But failed to open up rings in py3.. but otherwise works. I.e you can compare builders. Just not rings to rings or rings to builders.05:43
*** pcaruana has joined #openstack-swift06:19
*** e0ne has joined #openstack-swift06:40
*** tonyb is now known as tonyb_gone07:20
*** tonyb_gone is now known as tonyb07:21
*** mikecmpb_ has quit IRC07:31
*** e0ne has quit IRC07:31
*** gkadam has joined #openstack-swift07:48
*** hseipp has joined #openstack-swift07:48
*** e0ne has joined #openstack-swift07:51
*** rcernin has quit IRC08:09
*** ccamacho has joined #openstack-swift08:23
*** e0ne has quit IRC08:36
alecuyerkota_:  sorry for the late reply, I was pulled to other things this week. I don't know what "dsvm" is, I will check and read your patch08:59
kota_alecuyer: o/09:00
kota_dsvm is the shorter term of DevStack Virtual Machine09:00
kota_then, the dsvm has been used for testing to keystone authentication for Swift.09:01
kota_tempest also runs... maybe?09:01
alecuyerkota_:  Thanks. I'll read the job logs to see what runs09:02
*** mikecmpbll has joined #openstack-swift09:03
kota_alecuyer: thx09:03
kota_the benefit of the patch is to make the dsvm gate appears on feature/losf branch09:03
kota_that was missed even it runs on the master.09:03
alecuyerOh I see, ok09:04
alecuyerI see a few "tempest" lines in job-output.txt but not sure it ran09:07
alecuyerhttp://logs.openstack.org/45/642645/11/check/swift-dsvm-functional/6a0046d/job-output.txt.gz#_2019-03-12_09_22_02_790285 | TASK [Link post-devstack tempest.log]09:07
alecuyerhttp://logs.openstack.org/45/642645/11/check/swift-dsvm-functional/6a0046d/job-output.txt.gz#_2019-03-12_09_22_02_851628 | controller | skipping: Conditional result was False09:07
*** kukacz has quit IRC09:15
*** kukacz has joined #openstack-swift09:17
kota_let me check09:19
kota_alecuyer: it looks like no tempest runs against to the swift in the dsvm, http://logs.openstack.org/45/642645/11/check/swift-dsvm-functional/6a0046d/testr_results.html.gz09:21
kota_it looks just to use dsvm to setup swift + keystone environment09:21
*** tkajinam__ has joined #openstack-swift09:22
*** FlorianFa has joined #openstack-swift09:23
kota_tools/playbooks/dsvm/run.yaml calls only swift functional tests so that I'm not assume tempest runs in the dir.09:23
*** tkajinam_ has quit IRC09:25
kota_I think it's same with the Swift master, I'm not sure if it's nice or not but probably we don't have to worry about that "We may ought to have tempest in the losf branch" because if we need it, absolutely we need the gate on both the master and the feature/losf branch.09:25
*** mikecmpbll has quit IRC09:35
alecuyerkota_:  thanks for the explanation. Something else I have to check, is the functests setup, I don't think they run with the losf diskfile (the default diskfile being the regular diskfile)09:36
kota_alecuyer: yes. that's what I'd like to go next :)09:36
kota_not yet started tho09:37
kota_probably, we could have 1. create setup package of golang code in the functional gate, then, 2. enable losf diskfile as the backend for functional test config.09:38
kota_probably it's a new gate job other than current jobs.09:38
alecuyeryes, for 2. we also need to start the index server ervice09:39
alecuyers09:39
kota_yes it is.09:39
kota_those are the next thing we have to do in the losf branch.09:40
alecuyerok09:41
kota_after we setup the gate jobs, we could be able to change some internal design because the robust gate job keeps "we don't break anything in the Swift API level"09:41
kota_that's my idea.09:42
alecuyerYes that sounds good. Im not sure how to add that new job, but if there is anything I can do, let me know. (I intended to keep working on the grpc/http change, as soon as I can)09:44
kota_thx alecuyer, the entry point is https://github.com/openstack/swift/blob/master/.zuul.yaml09:45
kota_that's the definition of the gate jobs09:45
kota_the jobs are listed https://github.com/openstack/swift/blob/master/.zuul.yaml#L376-L41409:46
kota_then, each item is detailed in the yaml09:46
kota_some of items uses extra ansible playbook to setup the environment in the vm. the playbooks are gathered in the https://github.com/openstack/swift/tree/master/tools/playbooks09:47
alecuyerI see ! thanks a lot for these pointers, I'm reading09:48
kota_alecuyer: my pleasure ;)09:49
*** admin6 has joined #openstack-swift09:57
*** gkadam_ has joined #openstack-swift11:24
*** gkadam has quit IRC11:25
*** e0ne has joined #openstack-swift11:36
*** ybunker has joined #openstack-swift12:22
*** ybunker has quit IRC12:35
*** ybunker has joined #openstack-swift12:38
*** e0ne has quit IRC13:05
*** hseipp has quit IRC13:18
*** gkadam_ has quit IRC14:02
*** irclogbot_2 has quit IRC14:09
*** e0ne has joined #openstack-swift14:10
*** irclogbot_2 has joined #openstack-swift14:13
*** irclogbot_2 has quit IRC14:25
*** irclogbot_2 has joined #openstack-swift14:28
*** psachin has quit IRC15:07
*** irclogbot_2 has quit IRC15:36
*** irclogbot_2 has joined #openstack-swift15:40
*** irclogbot_2 has quit IRC15:49
*** irclogbot_2 has joined #openstack-swift15:52
*** irclogbot_2 has quit IRC15:52
*** irclogbot_2 has joined #openstack-swift15:57
*** ybunker has quit IRC16:14
notmynamegood morning16:24
*** gyee has joined #openstack-swift16:25
*** FlorianFa has quit IRC16:41
*** FlorianFa has joined #openstack-swift16:54
*** e0ne has quit IRC17:01
*** gyee has quit IRC17:20
*** gyee has joined #openstack-swift17:20
*** gerardgine has joined #openstack-swift17:21
*** ccamacho has quit IRC17:29
openstackgerritMerged openstack/swift feature/losf: Enable swift-dsvm-functional tests at losf feature branch  https://review.openstack.org/64264517:34
notmynameyay!17:34
*** gerardgine has quit IRC17:39
renichzaitcev: hey man, thanks for all the help yesterday. I had to suddenly leave (was late for a gig), but many thanks.17:53
*** ianychoi has quit IRC17:55
*** pcaruana has quit IRC18:29
*** gerardgine has joined #openstack-swift18:34
openstackgerritJohn Dickinson proposed openstack/swift master: crediting contributors to the un-landed hummingbird branch  https://review.openstack.org/64313418:41
notmynametimburke: ^^ thoughts?18:41
notmynametimburke: FWIW, there are a few other authors file updates that will need to happen before the next release tag. I'll work with you on that18:42
*** gmann is now known as gmann_afk18:48
timburkenotmyname, makes sense to me18:49
notmynametimburke: I have not checked other branches (and there's the obvious gap of contributors only referenced via the commit message body), but those other branches, AFAIK, all ended up landing on master18:51
*** e0ne has joined #openstack-swift19:01
zaitcevI still have patch or maybe two outstanding for hummingbird. Some absurdly obvious bugs.19:16
*** gerardgine has quit IRC19:23
openstackgerritTim Burke proposed openstack/swift master: Get functional/tests.py running under py3  https://review.openstack.org/64252019:38
*** gerardgine has joined #openstack-swift19:58
*** ggine has joined #openstack-swift20:03
tdasilvaooohhh, time change20:03
tdasilvawas trying to figure out why nobody had shown up yet for meeting20:04
*** gerardgine has quit IRC20:04
*** ggine has quit IRC20:06
*** gerardgine has joined #openstack-swift20:09
notmynamedoh! sorry about that20:11
notmynamemeeting is in 38 minutes at 2100utc (which doesn't change twice a year)20:12
notmynamepersonally, I set meetings like that for either iceland or ghana because they're both utc+0 with no daylight savings time change. (ie if you're calendar app doesn't support setting utc... *grrr* google)20:13
tdasilvanotmyname: it does, the meeting in the calendar does show it correctly, i just had not looked at it yet today20:17
notmynameheh, ok :-)20:17
notmynameTBH, I looked down at my clock and had a mild panic that I'd missed it!20:17
tdasilvaHa!20:22
*** gerardgine has quit IRC20:25
*** gerardgine has joined #openstack-swift20:31
*** e0ne has quit IRC20:38
*** alexlecuyer has joined #openstack-swift20:39
*** gmann_afk is now known as gmann20:41
*** e0ne has joined #openstack-swift20:41
*** e0ne has quit IRC20:45
mattoliverauMorning20:55
mattoliveraunotmyname Google calendar has a utc time one now. So no more Iceland :)20:56
mattoliverau*timezone20:56
tdasilvanice20:56
notmynamemattoliverau: oh nice20:57
kota_morning20:57
kota_oh, day light saving20:58
notmynamekota_: mattoliverau: have your countries changed yet?20:58
* kota_ is wondering how mobile alarm works in the time change20:58
notmynameI see 6am for japan and 8am for australia20:59
kota_notmyname: no day light saving exist in Japan. Always same time for a year20:59
notmynameah. how enlightened :-)20:59
notmynameIIRC I think EU (or UK) changes to daylight savings in a few weeks21:00
mattoliverauNot until April21:00
notmynameanyway, the meeting is now21:00
notmynamemattoliverau: (that's just a few weeks from now)21:00
mattoliverauYeah, then it moves back an hour.21:00
notmynamezaitcev: rledisez: timburke: tdasilva: meeting ping21:00
mattoliverauSo earlier meeting :(21:01
mattoliverauBut used to it now :)21:01
*** gerardgine has quit IRC21:43
notmynametimburke: FWIW, I was assuming I'd pass off meeting chairing after the release is cut21:47
timburkei could also start chairing next meeting if you like. either way21:48
timburkew/e21:48
notmynametimburke: and also that you and I would take an hour or two next week to go over some logistics stuff (gerrit groups, launchpad, irc flags, irc bot, gerrit dashboards, community dashboards, etc)21:48
timburkeoh yeah, speaking of releases -- i'd rather like to get https://review.openstack.org/#/c/636501/ landed and tag a pyeclib release, if only so i can run `tox -e py27` in my new dev env and have it actually work...21:51
patchbotpatch 636501 - pyeclib - Try harder to find liberasurecode - 8 patch sets21:51
timburkei'll probably still need to do some hacking around upper-constraints (since we're past the library freeze, i don't expect the new pyeclib to get picked up until the train cycle starts), but i already have to do that for eventlet21:52
*** rcernin has joined #openstack-swift21:57
*** gerardgine has joined #openstack-swift21:58
*** gerardgine has quit IRC22:14
*** gerardgine has joined #openstack-swift22:27
*** lifeless has quit IRC22:27
*** lifeless has joined #openstack-swift22:27
*** alexlecuyer has quit IRC22:37
*** gerardgine has quit IRC23:00
*** gerardgine has joined #openstack-swift23:01
*** ianychoi has joined #openstack-swift23:06
openstackgerritTim Burke proposed openstack/swift master: Get functional/tests.py running under py3  https://review.openstack.org/64252023:06
openstackgerritTim Burke proposed openstack/swift master: Add non-voting py37 unit test job  https://review.openstack.org/64318323:20
openstackgerritTim Burke proposed openstack/swift master: Get functional/tests.py running under py3  https://review.openstack.org/64252023:23
*** renich has quit IRC23:24
openstackgerritMerged openstack/swift master: crediting contributors to the un-landed hummingbird branch  https://review.openstack.org/64313423:25
openstackgerritTim Burke proposed openstack/swift master: Fix py35 unit test job  https://review.openstack.org/64318423:30
*** gerardgine has quit IRC23:32
timburkeso, ^^^ is kinda important... in retrospect, i guess having all our unit test jobs inherit from openstack-tox-py27 maybe isn't the greatest? idk23:33
*** gerardgine has joined #openstack-swift23:35
openstackgerritTim Burke proposed openstack/swift master: Add non-voting py37 unit test job  https://review.openstack.org/64318323:45
timburkei still don't expect ^^^ to pass or anything (pretty sure we'll need at least https://review.openstack.org/#/c/638019/ to land first), but i figure it'll be good to see the failures23:47
patchbotpatch 638019 - swift - Clean up how we walk through ranges in ECAppIter - 1 patch set23:47

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!