Wednesday, 2016-09-07

*** tqtran has quit IRC00:06
*** Suyi_ has quit IRC00:08
claygnotmyname: RE: EC reconstruction - I think you're correct to recognize the tradeoff related to rebuild having a disproportionate read heavy workload (compared to replicated, where it's always 1:1 and it's a local only read)00:11
claygbut I'm not sure how much you can take away from it - as with replicated objects the sweet spit is probably 10M-100M and so naturally 90% of object is either <4M or >600M00:12
claygunless their *lo'd00:12
clayg... but as far as prioritization - the problem at hand is optomizing rebalance not rebuild/repair - rebuild/repair is mostly uncommon *enough* that it mostly needs to be correct - capacity growth resulting in rebalance OTOH happens frequently enough that it acctually needs to be more efficient/faster00:17
*** mingyu_ has joined #openstack-swift00:24
*** mingyu has quit IRC00:26
openstackgerritTimur Alperovich proposed openstack/swift: Fix error handling in proxy/controllers/base.py.  https://review.openstack.org/36642500:34
*** mingyu_ has quit IRC00:35
timurnotmyname: ^^ patch to address the unit test warnings. I'm still investigating though, as I'm not sure how we get into a situation where the header is None and how to keep track of the size when we end up with ranges like "bytes=0-"00:36
*** mingyu has joined #openstack-swift00:36
*** diogogmt has joined #openstack-swift00:37
*** mingyu has quit IRC00:37
*** arnoldchen has joined #openstack-swift00:44
*** Jeffrey4l has joined #openstack-swift00:47
*** arnoldchen has quit IRC00:49
*** dmorita_ has quit IRC00:52
*** m_kazuhiro has joined #openstack-swift01:00
*** dmorita has joined #openstack-swift01:02
kota_good morning01:23
*** arnoldchen has joined #openstack-swift01:26
csmart\o01:26
*** arnoldchen has quit IRC01:30
mattoliveraukota_, csmart: o/01:34
*** takashi_ has joined #openstack-swift01:36
*** arnoldchen has joined #openstack-swift01:36
zhengyinmattoliverau, kota_, csmart:good morning01:37
mattoliverauzhengyin: o/01:41
charzkota_: mattoliverau zhengyin o/01:52
mattoliveraucharz: o/01:58
kota_charz, zhengyin, mattolivearu: o/02:09
openstackgerritMerged openstack/swift: Added missing manpages for all cli tools  https://review.openstack.org/35518702:11
csmartzhengyin: \o02:15
*** asettle has joined #openstack-swift02:15
csmartmattoliverau: o/02:15
csmartcsmart: \o/02:15
*** asettle has quit IRC02:20
*** dmorita has quit IRC02:23
*** dmorita has joined #openstack-swift02:30
*** dmorita has quit IRC02:35
*** mingyu has joined #openstack-swift02:53
*** mingyu has quit IRC03:02
*** tongli has quit IRC03:03
*** mingyu has joined #openstack-swift03:05
claygmattoliverau: oh maybe my tox env is old or something then?03:06
*** bkeller` has quit IRC03:07
*** psachin has joined #openstack-swift03:26
*** _JZ_ has joined #openstack-swift03:29
*** wuhg has joined #openstack-swift03:31
*** links has joined #openstack-swift03:45
openstackgerritKota Tsuyuzaki proposed openstack/pyeclib: Ref count for dict item should be Py_DECREF  https://review.openstack.org/34406603:52
*** chsc has joined #openstack-swift03:56
*** chsc has quit IRC04:02
mattoliverauclayg: maybe, but in that case ours both is, and I know I deleted mine before I ran tox.04:04
*** klrmn has quit IRC04:07
*** mingyu has quit IRC04:09
jith_acoles: thanks04:24
*** arnoldchen has quit IRC04:26
*** arnoldchen has joined #openstack-swift04:26
*** _JZ_ has quit IRC04:29
*** jrichli has quit IRC04:30
*** mingyu has joined #openstack-swift04:40
*** SkyRocknRoll has joined #openstack-swift04:44
*** bkopilov_ has joined #openstack-swift04:50
*** Jeffrey4l_ has joined #openstack-swift05:00
notmynamemattoliverau: just got an acceptance letter for LCA!05:01
mattoliveraunotmyname: \o/05:01
mattoliveraunotmyname: does that mean you'll be joining me the Tas?05:01
notmynamevery likely so05:01
*** mingyu has quit IRC05:02
mattoliverau\o/ - we'll need to find some boat to ride :P05:03
*** Jeffrey4l has quit IRC05:04
*** ChubYann has quit IRC05:12
*** openstackgerrit has quit IRC05:18
*** mingyu has joined #openstack-swift05:18
*** openstackgerrit has joined #openstack-swift05:19
*** SkyRocknRoll has quit IRC05:21
openstackgerritKota Tsuyuzaki proposed openstack/pyeclib: Correct fragment size handling  https://review.openstack.org/34105405:27
*** chsc has joined #openstack-swift05:27
*** ppai has joined #openstack-swift05:28
*** McMurlock1 has joined #openstack-swift05:28
*** arnoldchen has quit IRC05:28
openstackgerritKota Tsuyuzaki proposed openstack/pyeclib: Fix arg k, m to be required  https://review.openstack.org/34058605:28
*** arnoldchen has joined #openstack-swift05:28
*** arnoldchen has quit IRC05:33
mahaticclayg: thanks for your comments on patch 346865. There was a holiday at India, looking at them now.05:35
patchbothttps://review.openstack.org/#/c/346865/ - swift - Delete old tombstones05:35
*** mingyu has quit IRC05:36
openstackgerritKota Tsuyuzaki proposed openstack/pyeclib: Fix arg k, m to be required  https://review.openstack.org/34058605:36
*** chsc has quit IRC05:37
openstackgerritKota Tsuyuzaki proposed openstack/pyeclib: Correct fragment size handling  https://review.openstack.org/34105405:40
*** wuhg has quit IRC05:41
openstackgerritMerged openstack/pyeclib: Fix arg k, m to be required  https://review.openstack.org/34058605:41
*** SkyRocknRoll has joined #openstack-swift05:45
openstackgerritKota Tsuyuzaki proposed openstack/pyeclib: Correct fragment size handling  https://review.openstack.org/34105405:46
*** McMurlock1 has quit IRC05:50
*** mingyu has joined #openstack-swift05:56
*** mingyu has quit IRC05:58
*** jith_ has quit IRC06:08
*** ttrumm has joined #openstack-swift06:12
*** arnoldchen has joined #openstack-swift06:22
openstackgerritzheng yin proposed openstack/swift: simple log information  https://review.openstack.org/34872406:26
*** hseipp has joined #openstack-swift06:29
*** ttrumm_ has joined #openstack-swift06:30
*** ttrumm has quit IRC06:32
*** pcaruana has joined #openstack-swift06:34
*** bkeller` has joined #openstack-swift06:40
*** ningliu has joined #openstack-swift06:41
*** ober37 has joined #openstack-swift06:42
*** jrichli has joined #openstack-swift06:43
*** stevemar has joined #openstack-swift06:44
*** mminesh has joined #openstack-swift06:44
*** silor has joined #openstack-swift06:55
*** asettle has joined #openstack-swift07:00
*** dmorita has joined #openstack-swift07:01
*** tesseract- has joined #openstack-swift07:02
*** dmorita_ has joined #openstack-swift07:05
*** dmorita has quit IRC07:06
*** dmorita_ has quit IRC07:09
openstackgerritNguyen Phuong An proposed openstack/swift: [api-ref] Stop supporting os-api-ref 1.0.0  https://review.openstack.org/36653807:11
openstackgerritKota Tsuyuzaki proposed openstack/swift: Add functional tests for new versioned_write mode  https://review.openstack.org/36093307:11
*** rledisez has joined #openstack-swift07:20
*** gnupyx has joined #openstack-swift07:25
openstackgerritNguyen Phuong An proposed openstack/swift: [api-ref] Remove temporary block in conf.py  https://review.openstack.org/36653807:31
*** sams-gleb has joined #openstack-swift07:31
*** kodoku has quit IRC07:51
*** kodoku has joined #openstack-swift07:51
*** miniman has joined #openstack-swift07:51
*** asettle has quit IRC07:56
openstackgerritChristian Schwede proposed openstack/swift: api-ref: fix more header definitions  https://review.openstack.org/36656908:01
*** asettle has joined #openstack-swift08:02
*** csmart has quit IRC08:05
*** mvk has quit IRC08:07
*** csmart has joined #openstack-swift08:07
*** mvk has joined #openstack-swift08:08
openstackgerritDavanum Srinivas (dims) proposed openstack/swift: [WIP] Testing latest u-c  https://review.openstack.org/31844108:10
*** oshritf_ has joined #openstack-swift08:10
*** oshritf has quit IRC08:11
*** joeljwright has joined #openstack-swift08:12
*** ChanServ sets mode: +v joeljwright08:12
*** dmorita has joined #openstack-swift08:16
*** dmorita has quit IRC08:21
*** ttrumm_ has quit IRC08:22
*** oxinabox has joined #openstack-swift08:27
oxinaboxSo I am working on a Julia package for Swift. (Right now it wraps python swiftclient). I am thinking about how I am going to integration test it.08:28
oxinaboxI want to integration test it on travis-ci, because I am really not sure that I have things corrent, so don't want to just unit-test with mocks.08:29
oxinaboxSo right now I am thinking about testing against a container on my own swift service, using encrypted enviroment variables to set the various settings, which is a thing travis-ci supports.08:31
oxinaboxBut there is a number of problems with binding it up to my personal swift service. 1. I am basically paying for it (I have a fairly small allocation as part of a research computing grid, which I have to apply for)08:32
oxinabox2. If i change my password for the service (which I am moderately likely to do), I have to go and edit the `.travis.yml` config.08:33
*** openstackgerrit has quit IRC08:34
oxinaboxI guess my ideal solution, would be to find service that offers free short term swift containers. So I can not have it on my personal account.08:34
*** openstackgerrit has joined #openstack-swift08:34
oxinaboxThoughts?08:38
*** ttrumm has joined #openstack-swift08:44
*** ppai has quit IRC08:47
*** links has quit IRC08:53
*** psachin has quit IRC08:54
*** links has joined #openstack-swift08:55
*** psachin has joined #openstack-swift08:55
openstackgerritlokesh s proposed openstack/swift: Py3: Fixes eventlet ImportError: No module named urllib2  https://review.openstack.org/34827209:00
*** acoles_ is now known as acoles09:01
*** ppai has joined #openstack-swift09:02
*** dmorita has joined #openstack-swift09:12
*** mvk has quit IRC09:12
*** dmorita has quit IRC09:16
*** dmorita has joined #openstack-swift09:33
*** dmorita has quit IRC09:37
*** mvk has joined #openstack-swift09:41
*** wuhg has joined #openstack-swift09:49
*** hoonetorg has quit IRC09:58
*** ksameersrk has joined #openstack-swift10:02
ksameersrkHello, I am working on some swift, I wanted to know if there is proper documentation of Data flow (like flow chart or notes). There is just brief information on README.rst on github.com/openstack/swift10:05
ksameersrkThanks10:05
joeljwrightksameersrk: have you looked here: http://docs.openstack.org/developer/swift/10:06
*** ttrumm has quit IRC10:06
*** takashi_ has quit IRC10:08
ksameersrkjoeljwright: Yeah, I had been to this page. I could find much. Like I wanted the info about data flow in source code. Eg : Application class -> ObjectController etc10:09
ksameersrkThanks for the link though10:09
cnfhi, can anyone help me debug "proxy-server: Deferring reject downstream" in my swift-proxy logs?10:17
*** ttrumm has joined #openstack-swift10:22
*** ksameersrk has quit IRC10:24
*** ttrumm has quit IRC10:30
*** psachin has quit IRC10:33
*** arnoldchen has quit IRC10:33
*** ttrumm has joined #openstack-swift10:34
*** arnoldchen has joined #openstack-swift10:34
*** arnoldchen has quit IRC10:39
*** ppai has quit IRC10:46
*** ttrumm_ has joined #openstack-swift10:54
*** dmorita has joined #openstack-swift10:55
*** ttrumm has quit IRC10:57
acolescnf: "Deferring reject downstream" is emitted by the authtoken middleware usually when an invalid token is detected and indicates that rather than immediately rejecting the request, authtoken is deferring to any other auth middleware that might chose to allow the request.10:58
*** dmorita has quit IRC10:59
*** ppai has joined #openstack-swift10:59
acolescnf: you'll see it if your attempting to auth with a bad token, or if you are using tempurl or some other auth mechanism that doesn't require a valid token10:59
*** psachin has joined #openstack-swift11:02
*** ttrumm_ has quit IRC11:23
openstackgerritzheng yin proposed openstack/swift: Add test cases in the common/test_db  https://review.openstack.org/36668911:28
*** ttrumm has joined #openstack-swift11:33
openstackgerritzheng yin proposed openstack/swift: Add test cases in the common/test_db  https://review.openstack.org/36668911:33
openstackgerritChristian Schwede proposed openstack/swift: api-ref: fix more header definitions  https://review.openstack.org/36656911:35
*** cdelatte has joined #openstack-swift11:38
*** ttrumm has quit IRC11:38
*** ttrumm has joined #openstack-swift11:40
cnfacoles right... and what does that mean?11:49
cnfi set up keystone and swift and horizon following the installation docs11:49
cnfacoles is it a bad configuration in swift? or horizon? or in keystone?11:53
*** torgomatic has quit IRC12:01
*** ppai has quit IRC12:02
*** links has quit IRC12:04
*** chlong has joined #openstack-swift12:05
cnfhmm12:10
*** links has joined #openstack-swift12:16
*** beat8 has joined #openstack-swift12:17
*** ppai has joined #openstack-swift12:17
beat8Hi Guys! Need some support. I'm trying to benchmark swift cluster and got 1 issue which i can't explain: i'm hammering cluster with GET requests to random files, everything is ok but i've got periodical 5 seconds freezes on proxy-server.12:22
*** tongli has joined #openstack-swift12:22
*** ppai has quit IRC12:22
*** hoonetorg has joined #openstack-swift12:23
*** mingyu has joined #openstack-swift12:31
*** arnoldchen has joined #openstack-swift12:35
*** arnoldchen has quit IRC12:40
*** MVenesio has joined #openstack-swift12:47
*** MVenesio has quit IRC12:47
*** klamath has joined #openstack-swift12:49
*** klamath has quit IRC12:50
*** klamath has joined #openstack-swift12:51
*** wuhg has quit IRC12:51
*** m_kazuhiro has quit IRC12:54
*** dmorita has joined #openstack-swift12:55
*** dmorita has quit IRC13:00
*** sbezverk has quit IRC13:10
*** links has quit IRC13:12
*** asettle has quit IRC13:12
*** asettle has joined #openstack-swift13:13
*** donagh has joined #openstack-swift13:14
*** kodoku has quit IRC13:14
donaghacoles: looking at your comments about ACLs in https://review.openstack.org/#/c/354767 I'm wondering how little I can get away with13:15
patchbotpatch 354767 - swift - Corrections for the API specifications in api-ref13:15
donaghThe commit message mentions that ACL is for a follow-up patch. I didn't want to delay this patch to get a "definitive" ACL description done13:16
*** mingyu has quit IRC13:17
acolescnf: if you are seeing that log message AND all your requests are failing with 401 or 403 status code then it is likely you have a config mistake and that the authtoken middleware in swift may be unable to validate tokens with the keystone service, so check the authtoken config options. you could also attempt to verify those options by directly making a request to keystone using the same options you have for authtoken, pe13:18
acolesrhaps using openstackclient - I'm afraid i don't have a pointer to an example of doing that.13:18
*** mingyu has joined #openstack-swift13:18
cnfacoles i have no idea what to do with that information13:19
*** StraubTW has joined #openstack-swift13:20
acolesdonagh: my thought was that we don't seem to have a comprehensive description of the ACL syntax anywhere in the docs, and that would be a good thing to have. Your patch adds some but not all. I'm unsure whether adding it all in the API ref is best (under container PUT and POST) or whether we might create a new doc, or improve an existing doc, and then link to it from api ref?13:22
*** mingyu has quit IRC13:22
acolesdonagh: the latter leaves you with very little to do in your patch!13:22
acolesdonagh: the latter is probably best done separately13:23
acolescnf: ok, simpler answer - it is probably worth carefully checking your config for any mistakes13:24
donaghacoles: I'm going to punt a bit. I pulled that text from somewhere. But on re-read, I'm not sure I can stand over it.13:25
acolesdonagh: your patch already fixes a ton of stuff so I think punting on that part is acceptable :)13:25
donaghI agree an ACL description is missing. A Glance team member was complaining about this to be the other day.13:25
donaghHowever, I'll defer that to a later patch13:25
donaghthanks13:26
cnfacoles I have, several times now13:26
cnfi don;t know enough to know what to look for13:27
acolesdonagh: ok. if you write it i'll promise to review ;)13:27
cnfi'm on -keystone as well, and i keep bouncing around13:27
acolescnf: what client are you using to issue request to swift?13:34
cnfhorizon, and openstack cli13:35
cnfhorizon is not working13:35
acolesdoes an openstack cli request to swift work?13:35
*** ttrumm has quit IRC13:35
*** ttrumm has joined #openstack-swift13:36
*** arnoldchen has joined #openstack-swift13:37
*** ttrumm has quit IRC13:41
*** arnoldchen has quit IRC13:41
*** jrichli__ has joined #openstack-swift13:55
*** ChanServ sets mode: +v jrichli13:56
*** rcernin has joined #openstack-swift13:57
*** jrichli__ has quit IRC14:00
notmynamegood morning14:02
*** chsc has joined #openstack-swift14:02
*** chsc has joined #openstack-swift14:02
notmynameoxinabox: interesting question. I don't know any provider that has a free, time-limited swift cluster. instead most simply charge for what you use. so if you add and then delete data, you end up paying hardly anything at all14:03
*** zul_ has joined #openstack-swift14:05
*** gnupyx has quit IRC14:10
*** andymccr_ has joined #openstack-swift14:10
cnfacoles work etc is asking for my attention, and i have found some problems with keystone etc as well14:13
cnfacoles i'm going to take care of that, and then get back to this14:13
notmynameso watch the video on http://www.vizrt.com/products/viz_one/ and then read http://www.vizrt.com/news/newsgrid/50476/Seamless_scaling_with_media_storage_from_Vizrt_and_SwiftStack14:15
notmynameit's a pretty cool new place where swift is being used14:15
*** diogogmt has quit IRC14:17
*** zul_ has quit IRC14:20
*** asettle has quit IRC14:20
*** klamath has quit IRC14:20
*** oshritf_ has quit IRC14:20
*** SkyRocknRoll has quit IRC14:20
*** andymccr has quit IRC14:20
*** bkopilov has quit IRC14:20
*** darrenc has quit IRC14:20
*** ejat has quit IRC14:20
*** dmorita has joined #openstack-swift14:24
*** _JZ_ has joined #openstack-swift14:26
cnfacoles ok, i'm back ^^;14:26
openstackgerritDonagh McCabe proposed openstack/swift: Corrections for the API specifications in api-ref  https://review.openstack.org/35476714:26
cnfacoles how do i do an openstack cli request to swift?14:27
*** andymccr_ is now known as andymccr14:28
*** dmorita has quit IRC14:28
openstackgerritAlistair Coles proposed openstack/swift: Make container sync copy SLO manifests  https://review.openstack.org/34849514:30
acolesdonagh: ^^ needed a rebase14:30
cnfopenstack container list gives me forbidden14:32
acolescnf: ah, based on your previous answer I thought you were already using openstack cli. something like '$ openstack --os-username=tester --os-project-name=test --os-password=testing --os-identity-api-version=3 --os-auth-url=http://<keystone ip>:5000 object store account show'14:38
acolescnf obviously substituting your credentials14:38
*** arnoldchen has joined #openstack-swift14:38
*** klamath has joined #openstack-swift14:39
cnfacoles that gives me Forbidden 40314:40
*** beat8 has quit IRC14:40
cnfproxy-server: - - 07/Sep/2016/14/39/57 HEAD /v1/314e7e971f3a49129406c148cb7dd9d4 HTTP/1.0 204 - Swift - - - - txd6ace5964ee0460382ccd-0057d026bd - 0.0069 RL -  1473259197.011152983 1473259197.018053055 - proxy-server: 192.168.13.153 192.168.13.153 07/Sep/2016/14/39/57 HEAD /v1/314e7e971f3a49129406c148cb7dd9d4 HTTP/1.0 403 - python-openstackclient%214:40
cnf0keystoneaut h1/2.4.1%20python-requests/2.9.1%20CPython/2.7.6 7c586d567ef442f3... - - - txd6ace5964ee0460382ccd-0057d026bd - 0.4116 - - 1473259197.007029057 1473259197.418 595076 -14:40
cnfin the logs14:40
*** zul_ has joined #openstack-swift14:42
*** asettle has joined #openstack-swift14:42
*** oshritf_ has joined #openstack-swift14:42
*** bkopilov has joined #openstack-swift14:42
*** darrenc has joined #openstack-swift14:42
*** ejat has joined #openstack-swift14:42
*** arnoldchen has quit IRC14:42
*** hoonetorg has quit IRC14:43
acolescnf: are you able to paste your /etc/swift/proxy-server.conf somewhere like http://paste.openstack.org/ ? just the authoken and keystoneauth sections would suffice. redact any passwords!14:46
cnfha, it's a test setup with the most silly passwords, anyway14:46
acoles:)14:46
cnfacoles http://paste.openstack.org/show/567493/14:48
openstackgerritTravis McPeak proposed openstack/swift: Updating Bandit config file  https://review.openstack.org/36506514:53
*** hoonetorg has joined #openstack-swift14:56
cnfacoles nothing stupid there?14:57
cnfalso14:58
cnfpipeline = catch_errors healthcheck cache authtoken proxy-logging proxy-server14:58
cnfworks14:58
cnfpipeline = catch_errors gatekeeper healthcheck proxy-logging cache container_sync bulk ratelimit authtoken keystoneauth container-quotas account-quotas slo dl o versioned_writes proxy-logging proxy-server14:58
cnfdoesn't14:58
cnfthe space between dl and o is apaste error, btw14:59
acolescnf: no but the url your request is using does not appear as I would expect which suggests that the swift endpoints in keystone are not correctly configured. your request uses /v1/314e7e971f3a49129406c148cb7dd9d4, it should be /v1/AUTH_314e7e971f3a49129406c148cb7dd9d415:00
cnfhmm15:00
acolescnf: the AUTH_ prefix is used by default in swift keystoneauth to distinguish from any another auth system namespace, so it expects a url of form /v1/AUTH_<project_id>15:01
cnfhttp://paste.openstack.org/show/567495/15:01
acolescnf: I'm just looking for a doc that describes how to config the endpoint, it requires a magic syntax for keystone15:01
cnfok15:01
cnfI followed http://docs.openstack.org/mitaka/install-guide-ubuntu/swift.html15:02
cnfbut that has led me astray before15:02
cnfhmm, and it seems i did a wrong copy paste there15:03
cnfacoles nice catch, let me fix that15:03
acolescnf: ok that's close -> http://paste.openstack.org/show/567495/ but you need AUTH_ before %(tenant_id)s15:04
*** diogogmt has joined #openstack-swift15:04
cnfacoles but not for admin, right?15:04
*** klrmn has joined #openstack-swift15:05
acolescnf: hmm, looks that way, and I only have it for public and internal on my test setup15:06
*** chsc has quit IRC15:06
cnfhmm, interesting15:06
acolescnf: here's mine http://paste.openstack.org/show/567497/15:06
cnfacoles what doc are you looking at?15:06
cnfok, thanks15:07
acolescnf: from your link, http://docs.openstack.org/mitaka/install-guide-ubuntu/swift-controller-install.html ->Prerequisites->step 315:07
cnfright15:08
cnfok, now i am just unauthorized15:09
cnfhttp://paste.openstack.org/show/567499/ is where I am now15:10
cnfit's a step :P15:10
cnfok, with admin token it works15:11
cnfadmin user it doesn't15:12
*** sams-gleb has quit IRC15:12
cnfi don't quite understand keystone permissions, i think15:13
*** diogogmt has quit IRC15:15
cnfhmm15:16
cnfyeah, os token works, admin user doesn't15:16
cnfis that something i set wrong in keystone?15:17
*** diogogmt has joined #openstack-swift15:19
*** SkyRocknRoll has joined #openstack-swift15:22
openstackgerritMohit Motiani proposed openstack/swift: Add regions in ring-builder.py  https://review.openstack.org/35062515:23
cnfhmm, wt?15:26
acolescnf using the credential from your authtoken section (http://paste.openstack.org/show/567493/) can you reproduce this command...'http://paste.openstack.org/show/567510/'15:26
acolescnf: in other words, do your authtoken config credentials actually work with keystone?15:27
acolescnf: I can reproduce your log errors if I mess with my authtoken options, but that may be coincidental15:28
cnfacoles what is your pipeline?15:29
cnfand no, I can not15:30
cnfacoles i can get that output with the OS_TOKEN set15:30
cnfbut not with admin or swift login15:30
acolescnf: catch_errors healthcheck proxy-logging cache tempurl formpost ratelimit list-endpoints container_sync authtoken keystone\15:30
acolesauth staticweb container-quotas account-quotas slo dlo versioned_writes proxy-logging proxy-server15:30
patchbot(auth takes no argument) -- Tries to authenticate you using network services. If you get no reply, it means you are not authenticated to the network services.15:30
cnfno, i can with admin15:30
cnfjust not with swift15:30
cnfhmm15:31
cnfhold on, let me reset my pipeline = setting15:32
acolescnf: oh, and always restart the proxy-server after changing any config15:32
cnfso my proxy-server.conf has15:33
cnfpipeline = catch_errors gatekeeper healthcheck proxy-logging cache container_sync bulk ratelimit authtoken keystoneauth container-quotas account-quotas slo dlo versioned_writes proxy-logging proxy-server15:33
cnfacoles i am running it manually, so yeah, i do :P15:33
cnfok, so15:33
cnfwith admin login, I can run your command15:33
cnfwith swift user, I can not15:33
cnfso i made a booboo in keystone15:34
acolescnf so for your settings something like 'openstack --os-auth-url=http://keystone:5000 --os-identity-api-version=3 --os-username=swift --os-user-domain-name=default --os-project-name=service --os-project-domain-name=default --os-password=passpass catalog show swift' should work15:34
acolescnf: note *-domain-name vs *-domain-id in my pasted example15:35
acolescnf: because in your authtoken options you use *-domain-name=default15:36
cnfacoles it works, i had the wrong project15:37
acolescnf: it used to be that the 'default' domain name in keystone has ID=default, but I heard it was changed so that the ID is no longer default but maybe the name is 'default' and the ID is randomly chosen15:37
cnfyeah, my id is a random string, and the name is 'default'15:37
acolescnf: ok! so your project is not service?15:38
*** hoonetorg has quit IRC15:38
cnfit is, i had it set to admin15:38
cnfok, and horizon suddenly works as well15:39
cnfdamn, I don't know what change was important >,<15:39
acolesoic. interesting, so you confirm what I heard about the defaul domain name/id.15:39
cnfyes15:39
*** arnoldchen has joined #openstack-swift15:39
cnfacoles http://paste.openstack.org/show/567567/15:40
acolescnf: authtoken->project_name=admin was likely a problem, plus you needed the AUTH_ prefix in the endpoint spec.15:41
*** chlong has quit IRC15:41
cnfyeah, but the project name was on my cli15:41
cnfnot in horizon15:41
*** mingyu has joined #openstack-swift15:41
cnfbut i think the end point spec is probably what did it15:41
cnfthanks!15:41
acolescnf: np. good luck!15:42
cnfopenstack stuff is really hard to debug without a LOT of knowledge15:42
* acoles thinks a swift/keystone troubleshooting doc would be useful15:42
*** hoonetorg has joined #openstack-swift15:42
cnfindeed!15:43
cnfok, so next, i'm going to try and do really stupid stuff with swift15:43
*** arnoldchen has quit IRC15:44
cnfi'm trying to set up a single node, S3 compatible object store with swift15:44
cnfi need to learn openstack for $dayjob, and I find it helpful to try stupid things on my home lab to get the hang of things15:46
*** ppai has joined #openstack-swift15:49
acolescnf: I won't be able to offer much help with S3 compatibility but you can try in #openstack-swift3 or ask in here15:49
acolescnf: oops, its #swift315:50
timburkeyep :-) i was about to correct you15:50
cnfP15:50
timburkewe made the channel before the stackforge -> openstack change15:50
acolescnf: timburke ^^ knows everything :P15:50
cnfacoles I will, thanks!15:51
* timburke hides15:51
acoleshehe15:51
cnfi'm hoping a single node Swift setup won't be too insane15:51
acolescnf: not at all, we use it for dev - http://docs.openstack.org/developer/swift/development_saio.html15:52
*** silor has quit IRC15:52
cnfacoles cool15:53
cnfi do plan to run some actual stuff on it15:53
acolescnf: also http://docs.openstack.org/developer/swift/associated_projects.html#developer-tools15:53
cnfI have a ZFS NAS at home, i'd like to share Swift / S3 compatible space from15:54
*** psachin has quit IRC15:54
cnfok, next problem is with nova ^^;15:59
cnfbut meh, that'll be for tomorrow16:00
*** pcaruana has quit IRC16:01
notmynamegood morning (again)16:02
ntataGood Morning16:06
ntatathere's this exception being thrown and ignored when running unit tests against the current master16:07
ntataException AttributeError: AttributeError("'NoneType' object has no attribute 'replace'",) in <generator object _get_response_parts_iter at 0x7f6c3edf2f50> ignored16:07
notmynamentata: yeah, timur proposed a patch to fix that yesterday. I'm hoping to look at it today16:08
ntataLooks like it's originating from ./test/unit/obj/test_expirer.py:301:                         "'str' object has no attribute 'get_account_info'")16:08
ntatanotmyname, oh okay.. Thanks! :)16:08
notmynamehttps://review.openstack.org/#/c/366425/16:08
patchbotpatch 366425 - swift - Fix error handling in proxy/controllers/base.py.16:08
notmynamentata: could you take a look at that patch and see if it fixes it on your box?16:09
ntatayeah sure!16:09
*** tesseract- has quit IRC16:09
notmynamethanks16:10
*** tqtran has joined #openstack-swift16:11
*** klrmn has quit IRC16:13
*** tqtran has quit IRC16:20
notmynameFYI http://lists.openstack.org/pipermail/openstack-dev/2016-September/103115.html16:21
notmynameand I'll put this on the agenda for today's meeting. to discuss what, if anything, we want to do16:21
openstackgerritTravis McPeak proposed openstack/swift: Updating Bandit config file  https://review.openstack.org/36506516:25
*** mingyu has quit IRC16:25
notmynamena<tab><tab>.... where's nadeem?16:26
*** dmorita has joined #openstack-swift16:26
*** rledisez has quit IRC16:29
*** dmorita has quit IRC16:30
*** dmorita has joined #openstack-swift16:30
notmynametimur: (ntata) patch 366425 seems to fix the exception printing in my saio when running unit tests. I haven't looked at the code though16:36
patchbothttps://review.openstack.org/#/c/366425/ - swift - Fix error handling in proxy/controllers/base.py.16:36
*** baojg has joined #openstack-swift16:38
*** ChubYann has joined #openstack-swift16:42
*** diogogmt has quit IRC16:46
notmynamentata: how's looking at oslo.config going?16:47
*** hseipp has quit IRC16:52
openstackgerritAlistair Coles proposed openstack/swift: Add troubleshooting tips to keystoneauth docs  https://review.openstack.org/36686816:56
*** nikivi has joined #openstack-swift17:04
notmynameacoles: that looks really useful :-)17:09
*** SkyRocknRoll has quit IRC17:09
acolesnotmyname: I hope so :) I'm sure there are other tips in our collective knowledge17:13
notmynamewriting them down seems like such a better idea than "log into IRC during UK daylight hours and find acoles" ;-)17:13
*** links has joined #openstack-swift17:14
*** klrmn has joined #openstack-swift17:17
tdasilvanotmyname: says you ;)17:21
timburkewell sure, he's on the west coast and doesn't want to wake up early :-P17:21
*** mvk has quit IRC17:21
*** baojg has quit IRC17:22
notmynamenote the "...and find acoles" part ;-)17:22
*** baojg has joined #openstack-swift17:22
notmynameI'm totally ok if someone wants to ask acoles questions about keystone17:23
*** Suyi_ has joined #openstack-swift17:28
*** asettle has quit IRC17:28
*** links has quit IRC17:29
*** chsc has joined #openstack-swift17:31
*** chsc has joined #openstack-swift17:31
openstackgerritThiago da Silva proposed openstack/swift: add missing partition directory to example  https://review.openstack.org/36688417:32
*** nadeem_ has joined #openstack-swift17:34
notmynamenadeem_: so https://review.openstack.org/#/c/364075/ has landed... what's the next step?17:40
patchbotpatch 364075 - swift (feature/hummingbird) - go: move REPCONN and REPLICATE call from object se... (MERGED)17:40
nadeem_I am reviewing https://review.openstack.org/#/c/365849/17:40
patchbotpatch 365849 - swift (feature/hummingbird) - go: fix replicator policy bugs / big refactor17:40
nadeem_which is a big replication refactor17:41
*** arnoldchen has joined #openstack-swift17:41
nadeem_notmyname ^17:41
notmynameok, thanks17:42
notmynamelooks like that's a good place to get more eyes, then17:42
nadeem_yep17:42
notmynameclayg: FYI ^17:43
nadeem_once we have these bugs/refactor taken care of...we can discuss next steps.17:43
claygwat?17:44
claygoh is that rebo's refactor?17:45
nadeem_yep17:45
notmynameclayg: just FYI on current tip-of-the-spear for golang17:45
claygi was looking at it and got distracted by golang unittesting17:45
claygnotmyname: thanks boss!17:45
nadeem_gotta love golang unittesting :P17:45
*** arnoldchen has quit IRC17:45
claygnadeem_: no, no you do not17:46
clayg;)17:46
claygtimburke: looks like your py3 http header parsing bug is gunna get commited?  http://bugs.python.org/issue2223317:59
portanteclayg: cschwede, others, question about object server disk concurrency17:59
*** diogogmt has joined #openstack-swift17:59
claygwhere is torgomatic when you need him :\18:02
notmynameclayg: he just walked into a meeting with ed, i think18:02
notmynamewas at my desk about 5 minutes ago18:02
claygis my irc client acting up then? I don't think torg<tab> has ever not worked before!?18:03
notmynameyikes. same here18:03
notmynamewe should tease him mercilessly for not being around18:03
notmynameand my that I mean "ask him to turn on his bouncer again"18:04
notmynames/my/by/18:04
*** joeljwright has quit IRC18:07
claygmattoliverau: holy crap!  https://www.sqlite.org/lang_attach.html  <- from sqlite ML - you can tie two databases together so you can inserting into kind of statements?  pretty wild18:08
claygmattoliverau: if it's significantly quicker to bulk insert into the handoff db's this way (vs deserializing and reinserting the rows) it may be worth the complexity - or maybe it's just something to play with and optomize later if needed18:09
notmynamethat is cool18:09
*** sams-gleb has joined #openstack-swift18:12
openstackgerritAlistair Coles proposed openstack/swift: Add process level concurrency to container sync  https://review.openstack.org/21009918:13
*** acoles is now known as acoles_18:14
*** sams-gleb has quit IRC18:17
*** arnoldchen has joined #openstack-swift18:24
openstackgerritMerged openstack/swift: Add regions in ring-builder.py  https://review.openstack.org/35062518:24
*** arnoldchen has quit IRC18:25
*** arnoldchen has joined #openstack-swift18:25
*** zul has quit IRC18:27
timurnotmyname: great. I'll address yours and Sam's comments shortly18:30
*** torgomatic has joined #openstack-swift18:33
*** ChanServ sets mode: +v torgomatic18:33
*** baojg has quit IRC18:34
*** nikivi has quit IRC18:42
claygtimburke: why does this page get under my skin so -> https://review.openstack.org/#/q/topic:cleancode+AND+status:merged18:54
claygtimburke: is it just cause the lack of H302 means it is forever busy work?  Do I really think that importing objects is equally clear compared to only importing modules?18:55
*** zul_ has quit IRC18:55
*** StraubTW has left #openstack-swift19:02
*** ukaynar has joined #openstack-swift19:06
*** zul has joined #openstack-swift19:12
torgomaticthe nice thing about that is that when either the module name or the object name changes, you get a large diff that's guaranteed to conflict with other in-flight patches19:14
torgomaticour current, inferior model allows for objects to move to different modules without much fuss19:15
claygtorgomatic: so you're saying I'm just happy living in my wallow?19:18
claygwait... did portante not ask his question?19:18
*** rcernin has quit IRC19:21
portante:)19:22
openstackgerritNandini Tata proposed openstack/swift: Add man page for swift.conf  https://review.openstack.org/35309719:23
*** mvk has joined #openstack-swift19:29
*** zul_ has joined #openstack-swift19:31
*** tqtran has joined #openstack-swift19:32
tdasilvaportante: now i'm curious19:38
openstackgerritThiago da Silva proposed openstack/swift: Let object-info find files in a given directory  https://review.openstack.org/18925819:56
claygtdasilva: he was probably just trying to point out that torgomatic's bouncer rebooted - and the most round-a-bout way he could think of to do that was to pretend that he had a io/concurrency question ;)19:59
openstackgerritThiago da Silva proposed openstack/swift: Symlink implementation.  https://review.openstack.org/23216220:02
portante;)20:02
*** ppai has quit IRC20:02
*** openstackgerrit has quit IRC20:04
*** openstackgerrit has joined #openstack-swift20:04
*** ukaynar has quit IRC20:15
*** takashi has quit IRC20:20
mattoliveraumorning20:26
cschwedeportante: the tension increases! you’re on to something?20:27
mattoliverauclayg: cool, once I'm more awake I'll have a read :)20:28
openstackgerritMerged openstack/swift: add missing partition directory to example  https://review.openstack.org/36688420:29
notmynamemattoliverau: either my clock is slow, or you're up earlier than normal for the meeting20:30
notmynamemattoliverau: oh wait. you have a young kid now. carry on20:31
*** cebruns__ is now known as cebruns20:33
*** nikivi has joined #openstack-swift20:39
*** asettle has joined #openstack-swift20:40
mattoliveraunotmyname: lol, yup that's it exactly. When you want to sleep a little more that's when the baby decides it's time to wake up :)20:48
openstackgerritNandini Tata proposed openstack/python-swiftclient: Fixed inconsistent positional arguments naming  https://review.openstack.org/36622720:50
*** m_kazuhiro has joined #openstack-swift20:53
*** nikivi has quit IRC20:55
kota_good morning20:55
notmynameteam meeting in 3 minutes in #openstack-meeting20:57
*** acoles_ is now known as acoles20:58
notmynamemeeting time21:00
*** joeljwright has joined #openstack-swift21:01
*** ChanServ sets mode: +v joeljwright21:01
timuroh, boo. I did not realize that drafts are disabled in the openstack gerrit "[remote rejected] HEAD -> refs/drafts/master (draft workflow is disabled)" :(21:12
notmynameI think a normal patch with workflow-1 is what's recommended now21:13
timuryep, found the official openstack documentation for that21:13
timurI was going to be sneaky and use a draft to make it easy for me to get a change into the swift-all-in-one thing21:14
clarkbya the reason for that is the abstraction is leaky. You can make a draft patchset after a non draft patchset for example and then that breaks all sorts of assumptions about trees of git commits21:18
clarkbwe decided rather than constantly debugging draft issues we would just turn them off and have a different review state21:18
clarkbalso a lot of people think drafts are actually private but you can fetch them from the git repos directly21:18
timurclarkb: thanks for the backstory on what happened there. I used them at a prior gig and was sad the feature was missing, but it's not a big deal21:21
clarkbya it is pretty trivial to watch the event stream and look for holes in the change numbers for new cahnges since gerrit makes them a sequence. Then its trivial to go and fetch the ref directly. At the same time people thought they were truly private and it wasn't a fun time21:22
*** geaaru has joined #openstack-swift21:38
*** asettle has quit IRC21:43
*** ChanServ sets mode: +v tdasilva21:47
openstackgerritTimur Alperovich proposed openstack/swift: Fix error handling in proxy/controllers/base.py.  https://review.openstack.org/36642521:48
*** nadeem_ has quit IRC22:00
notmynamecsmart: looks like I'll come visit you in january22:00
claygtorgomatic: did you have a thing for the meeting?22:00
csmart\o/22:00
torgomaticclayg: no, I had just hoped aloud that it'd be a short one :)22:01
csmartnotmyname: Hobart?22:01
notmynameyep22:01
csmartsweet.. I'm still trying to work Barcelona, but not looking promising at this stage :-(22:01
mattoliveraucsmart: at least LCA is easier to get too22:02
csmartmattoliverau: yeah, and if notmyname will be there, well hell, I hardly _need_ to go to Barcelona ;-)22:02
claygjoeljwright: so does everything that a TLO needs from container metadata and such just piggy back on means that exist for SLO's?22:02
notmynamecsmart: lol22:03
csmartharder to catch the train from Melbourne to Hobart though22:03
csmartwe could try22:03
notmynamecsmart: you don't have a tunnel?22:03
mattoliveraunope, but there is a boat22:03
mattoliverau!22:03
mattoliverauSpirit of Tasmania22:03
csmartnotmyname: we try to not keep tasmania all that connected to the mainland, criminals you know22:03
csmartwe even cut their internet connection22:04
csmartand power, I think they're still running on diesel atm22:04
csmart:-)22:04
notmynamecsmart: from what I hear, that wouldn't do much to change the normal state of things (cutting the internet connection)22:04
portanteokay, what is the now recommended way to get proper disk concurrency with an object server?22:04
portantethreads per disk I believe is out now, right?22:04
portanteup and coming is butterfly, the go rewrite of the object server22:05
portantebut that it not quite in play yet22:05
csmartnotmyname: lol that's pretty true, although last time in Hobart we were at the Uni, so that had nice Internet22:05
ntatanotmyname, so, I missed both your pings this morning. **blame my znc bouncer** ; anyway, yes, I tested my SAIO with timur's patch 366425 and all is well :)22:06
patchbothttps://review.openstack.org/#/c/366425/ - swift - Fix error handling in proxy/controllers/base.py.22:06
notmynamentata: great22:06
portanteso clayg, torgomatic, cschwede, tdasilva, others, to get proper concurrency, do I set workers to N, where N is the number of disks I have, and max_clients lower than 1024?22:06
mattoliverauportante: servers_per_port.22:06
mattoliverauwell that helps with slow disks, so makes the server more performant22:07
portantemattoliverau: thanks22:07
notmynameportante: yeah, servers_per_port, and identify each drive in the ring with a differnet port number22:07
* portante goes and reads about servers_per_port ...22:07
notmynameportante: then set servers_per_port to 2 3 or 422:07
portantethanks22:07
portantecschwede, tdasilva, do we document that in triple-o deployments?22:08
joeljwrightnotmyname: you previously expressed interest in the tar middleware as a reverse of bulk upload22:09
notmynamejoeljwright: that sounds like something I'd be interested in22:09
claygahale_: did you ever file a bug on quarantining paths like this -> /srv/node/d8/objects/48059/afd/2eeef28e1d869af3695ec1840d36eafd/1347488008.83489.data/76e66cb1350921594ffe62403dc9f73e ???22:09
notmyname(yes, I rememer)22:09
joeljwrightwould love comments on this patch: https://review.openstack.org/#/c/365371/22:10
patchbotpatch 365371 - swift - WIP: Add Tar Large Object Middleware22:10
joeljwrightit's very much an adaptation of SLO22:10
joeljwrightbut streams tars22:10
tdasilvaportante: not yet, but we should ;)22:10
portantegot any plans for that?22:10
portante;)22:10
notmynamejoeljwright: oh! (unrelated to patches) did you see that swift[stack] is the new default backend for vizrt? pretty cool use case that you'd likely be familiar with :-)22:10
joeljwrightnotmyname: yeah I saw you mention that22:11
joeljwrightvery cool :)22:11
tdasilvaportante: yeah, cschwede has a long list of swift changes to tripleo and I will add a note about double checking that specific one. I think he has it on his list, but he is gone for the day now...so I will double check with him later22:11
notmynamedo you use vizrt at sohonet?22:11
* mattoliverau is off to find some breakfast22:12
joeljwrightNo, I can't say we do22:12
joeljwrightI had to look it up22:12
*** chlong has joined #openstack-swift22:12
portantetdasilva: thanks!22:13
notmynamefunny story: as soon as I say "release coming up" in a meeting, all of you pm me with your patches to review to be included in the release ;-)22:16
csmartlol22:17
csmartnotmyname: &> release steward22:17
notmynameheh22:18
notmyname(for the record, keep letting me know about patches. there's a ton of great stuff in progress)22:18
joeljwright:)22:23
*** acoles is now known as acoles_22:24
claygnotmyname: you should reminder everyone that a release is *always* coming up!22:25
openstackgerritTim Burke proposed openstack/swift: Store SLO Etag and size in sysmeta  https://review.openstack.org/34753822:32
notmynameclayg: we can pick a SHA *at any time*. could be right now!22:33
*** m_kazuhiro has quit IRC22:35
*** geaaru has quit IRC22:37
*** klamath has quit IRC22:39
*** klamath has joined #openstack-swift22:40
*** asettle has joined #openstack-swift22:44
*** asettle has quit IRC22:49
*** klamath has quit IRC22:49
notmynameok, time to go by the tshirt shop to look at the first proof22:49
joeljwrightenjoy!22:49
*** joeljwright has quit IRC22:50
*** itlinux has joined #openstack-swift22:58
*** itlinux has quit IRC23:10
*** chsc has quit IRC23:15
*** diogogmt has quit IRC23:24
*** kei_yama has joined #openstack-swift23:24
*** asettle has joined #openstack-swift23:45
openstackgerritMerged openstack/swift: Fix error handling in proxy/controllers/base.py.  https://review.openstack.org/36642523:49
*** asettle has quit IRC23:51
*** Suyi_ has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!