| *** mwheckmann has joined #openstack-swift | 00:21 | |
| *** vpc has joined #openstack-swift | 00:55 | |
| vpc | {"error": {"message": "The request you have made requires authentication.", "code": 401, "title": "Unauthorized"}} | 00:56 |
|---|---|---|
| vpc | hi | 00:57 |
| vpc | anyone? | 00:57 |
| vpc | {"error": {"message": "The request you have made requires authentication.", "code": 401, "title": "Unauthorized"}} | 00:57 |
| *** mwheckmann has quit IRC | 00:58 | |
| *** gyee has quit IRC | 01:02 | |
| kota_ | good morning | 01:06 |
| vpc | goodmorning | 01:06 |
| vpc | +mattoliverau can help | 01:06 |
| vpc | +kota can help? | 01:06 |
| mattoliverau | kota_: morning | 01:07 |
| vpc | +mattoliverau can help me? | 01:07 |
| mattoliverau | vpc: that says it didn't authenticate | 01:07 |
| mattoliverau | but don't know what your doing :) | 01:07 |
| kota_ | mattoliverau: hello | 01:07 |
| vpc | here wait | 01:07 |
| kota_ | vpc: what's up? | 01:07 |
| mattoliverau | kota_: how's the new baby and your wife doing? | 01:08 |
| vpc | kindly see this | 01:09 |
| vpc | http://paste.openstack.org/show/723865/ | 01:09 |
| vpc | +kota and +mattoliverau | 01:09 |
| vpc | im deploying this on kolla https://github.com/stmuraka/OpenStackSwift-OpenWhisk/tree/master/OpenStackSwift/Webhook | 01:09 |
| kota_ | mattoliverau: well so far. my new one has been coming much earlier than we expected so it's a bit smaller than standard size. | 01:10 |
| vpc | Congrats +kota | 01:10 |
| kota_ | but no problem found so far, so it seems fine luckly | 01:10 |
| kota_ | vpc: thx | 01:10 |
| mattoliverau | kota_: ahh, ok. so long as he/she is healthy :) | 01:10 |
| vpc | kindly check please http://paste.openstack.org/show/723865/ | 01:10 |
| kota_ | mattoliverau: boy ;) | 01:11 |
| kota_ | vpc: looking | 01:11 |
| vpc | do i need to paste my whole proxy-server.conf? | 01:11 |
| mattoliverau | vpc: you've set up keystone but using the default tempauth users | 01:11 |
| mattoliverau | in curl | 01:11 |
| mattoliverau | you need to use the user you've set up in keystone | 01:12 |
| vpc | what command should i execute? | 01:12 |
| vpc | okay wait | 01:12 |
| vpc | how about the storage account? | 01:12 |
| kota_ | could you curl against to http://107.105.135.163:8080/auth/v1.0 ? | 01:12 |
| vpc | same error sir 401 | 01:13 |
| kota_ | vpc:^^ | 01:13 |
| kota_ | mattoliverau: oh yeah, the response seems like to be made from keystone | 01:13 |
| mattoliverau | if you want to use tempauth (the test user) then you need to replace the authtoken keystonemiddlware middlewares with tempauth. But only do that if this is a test system. otherwise, you need to go create the users in keystone, and then need to auth with keystone to get the token to use to talk to swift | 01:14 |
| *** mwheckmann has joined #openstack-swift | 01:14 | |
| kota_ | and authtoken, keystoneauth is prior to tempauth. | 01:14 |
| vpc | i just added the tempauth in my proxy-server.conf | 01:14 |
| kota_ | or using sort of delay_auth_decision. | 01:14 |
| vpc | this is my whole proxy-server | 01:14 |
| vpc | http://paste.openstack.org/show/723866/ | 01:15 |
| mattoliverau | yeah or that | 01:15 |
| vpc | im following this guide +mattoliverau and +kota https://github.com/stmuraka/OpenStackSwift-OpenWhisk/tree/master/OpenStackSwift/Webhook | 01:15 |
| kota_ | vpc: https://github.com/openstack/swift/blob/master/etc/proxy-server.conf-sample#L391 | 01:15 |
| vpc | curl -v -H 'X-Storage-User: admin:swift' \ -H 'X-Storage-Pass: aaa768aiyGLGc695XlhfLKgzJic1CzuqeICHC4XA' \ http://107.105.135.163:8080/v1.0 | 01:15 |
| kota_ | OpenWhisk! | 01:16 |
| vpc | should i need to delete keystoneauth? | 01:16 |
| vpc | im using kolla btw | 01:16 |
| vpc | i just add the webhook in pipeline and tempauth | 01:16 |
| vpc | added* | 01:16 |
| mattoliverau | that is currently set up to use keystone as your authentication. So you either need to use that, or put tempauth in the pipeline | 01:16 |
| vpc | what is the exact command if i use keystone auth sir +mattoliverau based on my proxy-server.conf? | 01:17 |
| mattoliverau | does the webhook need to be at the end of the pipeline? | 01:17 |
| vpc | yes sir +mattoliverau as per here | 01:18 |
| vpc | Add 'webhook' to the pipeline entry under [pipeline:main] | 01:18 |
| kota_ | vpc: the readme of OpenWhisk pointed out http://swift.api.server:8080/auth/v1.0 anyway | 01:18 |
| kota_ | mattoliverau: it looks before 2nd proxy-logging | 01:18 |
| mattoliverau | yeah, but usually placing it in the right place in the pipeline is important. | 01:19 |
| mattoliverau | ie. you should move tempauth to just after keystone (I think) | 01:19 |
| vpc | wait | 01:20 |
| kota_ | vpc: ah, your configuration is missing both 1st and 2nd proxy-logging that might make you into fog. | 01:20 |
| mattoliverau | yeah, kolla is doing weird things | 01:20 |
| kota_ | the expected order is sort of https://github.com/openstack/swift/blob/master/etc/proxy-server.conf-sample#L97 | 01:21 |
| vpc | wait i will configure it | 01:21 |
| kota_ | okay, you don't have to hurry up. sorry. | 01:22 |
| mattoliverau | also, you haven't defined any reseller prefixes, so keystone and tempauth will default to AUTH.. which also might cause an issue. | 01:23 |
| vpc | im sorry it's the default of kolla but i will add it wait | 01:23 |
| mattoliverau | if you don't want to talk to keystone for the moment, you can just replace the 2 keystone middlewares with tempauth and see if it works. _or_ just set up a keystone user, project etc, and use that to test instead | 01:24 |
| vpc | the tempauth where should i place? in pipeline | 01:25 |
| kota_ | and if you want to use both keystone and tempauth, set individual reseller_prefix, then set delay_auth_decision=True. | 01:25 |
| kota_ | if you want to get a token with test:tester testing defined in tempauth section, yes you should set tempauth in your pipeline. | 01:26 |
| kota_ | the place should be just after keystoneauth or before. | 01:26 |
| kota_ | it looks current position of tempauth is too right. that should be before some functionarities like slo. | 01:27 |
| vpc | +kota reseller_prefix = AUTH? | 01:29 |
| mattoliverau | if you want to use keystone, you'd auth to get the token doing something like: http://paste.openstack.org/show/723870/ | 01:29 |
| mattoliverau | but of course you need to setup a user and a project in keystone. | 01:29 |
| kota_ | vpc: that's default for both tempauth and keystone | 01:29 |
| vpc | can i use my admin account? | 01:30 |
| mattoliverau | vpc: they will both try and use AUTH, so you need to use something different for one of them. I suggest in tempauth, as otherwise you might need to go modify the keystone endpoint if you end up using keystone later. | 01:30 |
| mattoliverau | which admin account? | 01:30 |
| kota_ | if you change that like KEYSTONEAUTH or TEMPAUTH, the auth middleware will only be effective for the prefix. | 01:30 |
| vpc | the first account created | 01:31 |
| vpc | here | 01:31 |
| vpc | export OS_USERNAME=admin | 01:31 |
| kota_ | sounds... progressed? | 01:31 |
| *** mvenesio has quit IRC | 01:32 | |
| mattoliverau | vpc: if by admin account you mean keystone admin account, then so long as they're a member of a project and are apart of the admin, _member_ or ResellerAdmin roles in keystone | 01:32 |
| vpc | yes the keystone admin account | 01:32 |
| mattoliverau | then you can give it a go :) | 01:33 |
| * mattoliverau needs to go to lunch, wife is calling, bbs. | 01:33 | |
| vpc | i need to edit the curl command? | 01:33 |
| mattoliverau | yup. just use -H "X-Auth-Token: <token>" | 01:33 |
| vpc | token equal to what sir? | 01:34 |
| vpc | last | 01:34 |
| vpc | before you go | 01:34 |
| mattoliverau | and use the url as the storage url you got from the command | 01:34 |
| mattoliverau | what did swift auth say | 01:34 |
| mattoliverau | it should have given you a token and a storageurl. | 01:34 |
| vpc | wait sir | 01:34 |
| vpc | I pmed you sir matto | 01:35 |
| *** bkopilov has quit IRC | 01:42 | |
| kota_ | it looks like we get progressed at PUT+POST patch? I saw some subscription from gerrit but not sure how it goes on. | 01:54 |
| openstackgerrit | Kota Tsuyuzaki proposed openstack/swift master: Add ceph-s3 test non-voting job https://review.openstack.org/564700 | 01:57 |
| *** mwheckmann has quit IRC | 02:00 | |
| kota_ | ok, the original PUT+POST is still in gerrit https://wiki.openstack.org/wiki/Swift/PriorityReviews but acoles has been doing something to make it simple and testing | 02:00 |
| *** germs has quit IRC | 02:05 | |
| *** germs has joined #openstack-swift | 02:05 | |
| *** germs has quit IRC | 02:05 | |
| *** germs has joined #openstack-swift | 02:05 | |
| *** lifeless_ has quit IRC | 02:15 | |
| *** germs has quit IRC | 02:16 | |
| *** germs has joined #openstack-swift | 02:17 | |
| *** germs has quit IRC | 02:17 | |
| *** germs has joined #openstack-swift | 02:17 | |
| *** ianychoi_ has quit IRC | 02:27 | |
| *** ianychoi has joined #openstack-swift | 02:30 | |
| *** psachin has joined #openstack-swift | 02:43 | |
| *** bkopilov has joined #openstack-swift | 03:05 | |
| openstackgerrit | Merged openstack/swift master: Fix common/test_utils.py on Python 3.5.4+ https://review.openstack.org/570457 | 03:15 |
| *** lifeless has joined #openstack-swift | 03:18 | |
| *** links has joined #openstack-swift | 03:23 | |
| *** jungleboyj has quit IRC | 03:41 | |
| *** samueldmq has quit IRC | 03:43 | |
| *** fyx has quit IRC | 03:44 | |
| *** clayg has quit IRC | 03:44 | |
| *** beisner has quit IRC | 03:44 | |
| *** kei_yama has quit IRC | 03:45 | |
| *** jungleboyj has joined #openstack-swift | 03:45 | |
| *** clayg has joined #openstack-swift | 03:46 | |
| *** ChanServ sets mode: +v clayg | 03:46 | |
| *** fyx has joined #openstack-swift | 03:46 | |
| *** samueldmq has joined #openstack-swift | 03:46 | |
| *** beisner has joined #openstack-swift | 03:46 | |
| *** zhongjun_ has quit IRC | 03:48 | |
| *** spsurya has quit IRC | 03:49 | |
| *** portdirect has quit IRC | 03:50 | |
| *** nottrobin has quit IRC | 03:50 | |
| *** jungleboyj has quit IRC | 03:50 | |
| *** hogepodge has quit IRC | 03:50 | |
| *** DuncanT has quit IRC | 03:51 | |
| *** samueldmq has quit IRC | 03:51 | |
| *** clayg has quit IRC | 03:51 | |
| *** beisner has quit IRC | 03:51 | |
| *** fyx has quit IRC | 03:51 | |
| *** lxkong has quit IRC | 03:51 | |
| *** AndyWojo has quit IRC | 03:52 | |
| *** serverascode has quit IRC | 03:52 | |
| *** vpc has quit IRC | 03:57 | |
| *** kei_yama has joined #openstack-swift | 04:02 | |
| *** germs has quit IRC | 04:06 | |
| *** armaan has quit IRC | 04:16 | |
| *** armaan has joined #openstack-swift | 04:17 | |
| *** openstack has joined #openstack-swift | 04:31 | |
| *** ChanServ sets mode: +o openstack | 04:31 | |
| *** bharath1234 has joined #openstack-swift | 04:47 | |
| *** kei_yama has quit IRC | 04:49 | |
| *** lifeless_ has joined #openstack-swift | 04:54 | |
| *** lifeless has quit IRC | 04:55 | |
| *** hoonetorg has quit IRC | 05:09 | |
| *** hoonetorg has joined #openstack-swift | 05:10 | |
| *** zhongjun_ has joined #openstack-swift | 05:22 | |
| *** AndyWojo has joined #openstack-swift | 05:23 | |
| *** DuncanT has joined #openstack-swift | 05:23 | |
| *** bharath1234 has quit IRC | 05:23 | |
| *** lxkong has joined #openstack-swift | 05:24 | |
| *** clayg has joined #openstack-swift | 05:28 | |
| *** ChanServ sets mode: +v clayg | 05:28 | |
| *** serverascode has joined #openstack-swift | 05:28 | |
| *** nottrobin has joined #openstack-swift | 05:32 | |
| *** kei_yama has joined #openstack-swift | 05:34 | |
| *** bharath1234 has joined #openstack-swift | 05:42 | |
| *** fyx has joined #openstack-swift | 05:43 | |
| *** cshastri has joined #openstack-swift | 05:43 | |
| *** beisner has joined #openstack-swift | 05:45 | |
| *** spsurya has joined #openstack-swift | 05:47 | |
| *** beisner has quit IRC | 05:51 | |
| *** fyx has quit IRC | 05:51 | |
| *** beisner has joined #openstack-swift | 05:51 | |
| *** cshastri has quit IRC | 05:54 | |
| *** clayg has quit IRC | 05:55 | |
| *** beisner has quit IRC | 05:56 | |
| *** AndyWojo has quit IRC | 05:57 | |
| *** zhongjun_ has quit IRC | 05:57 | |
| *** spsurya has quit IRC | 05:57 | |
| *** lxkong has quit IRC | 05:58 | |
| *** nottrobin has quit IRC | 05:58 | |
| *** serverascode has quit IRC | 05:58 | |
| *** DuncanT has quit IRC | 05:59 | |
| *** cshastri has joined #openstack-swift | 06:10 | |
| *** beisner has joined #openstack-swift | 06:10 | |
| *** clayg has joined #openstack-swift | 06:13 | |
| *** ChanServ sets mode: +v clayg | 06:13 | |
| *** fyx has joined #openstack-swift | 06:16 | |
| *** samueldmq has joined #openstack-swift | 06:19 | |
| *** AndyWojo has joined #openstack-swift | 06:19 | |
| *** DuncanT has joined #openstack-swift | 06:21 | |
| *** portdirect has joined #openstack-swift | 06:21 | |
| *** lxkong has joined #openstack-swift | 06:21 | |
| *** portdirect has quit IRC | 06:21 | |
| *** portdirect has joined #openstack-swift | 06:21 | |
| *** lxkong has quit IRC | 06:22 | |
| *** lxkong has joined #openstack-swift | 06:22 | |
| *** serverascode has joined #openstack-swift | 06:22 | |
| *** nottrobin has joined #openstack-swift | 06:22 | |
| *** jungleboyj has joined #openstack-swift | 06:23 | |
| *** zhongjun_ has joined #openstack-swift | 06:23 | |
| *** d34dh0r53 has quit IRC | 06:24 | |
| *** d34dh0r53 has joined #openstack-swift | 06:24 | |
| *** serverascode has quit IRC | 06:26 | |
| *** spsurya has joined #openstack-swift | 06:26 | |
| *** serverascode has joined #openstack-swift | 06:27 | |
| *** serverascode has quit IRC | 06:29 | |
| *** serverascode has joined #openstack-swift | 06:30 | |
| *** hseipp has joined #openstack-swift | 06:38 | |
| *** prasen has joined #openstack-swift | 06:45 | |
| *** hogepodge has joined #openstack-swift | 07:00 | |
| *** cshastri has quit IRC | 07:00 | |
| *** tesseract has joined #openstack-swift | 07:04 | |
| *** geaaru has joined #openstack-swift | 07:16 | |
| *** bharath1234 has quit IRC | 07:18 | |
| *** cshastri has joined #openstack-swift | 07:19 | |
| *** cbartz has joined #openstack-swift | 07:33 | |
| *** ccamacho has joined #openstack-swift | 07:43 | |
| acoles | good morning | 07:48 |
| acoles | kota_: yes, any PUT+POST patch you see from me is just follow up to zaitcev's great work | 07:48 |
| kota_ | good morning acoles o/ | 07:48 |
| acoles | kota_: congratulations | 07:48 |
| kota_ | acoles: thank you very match! | 07:49 |
| kota_ | much | 07:49 |
| acoles | kota_: are you getting sleep? | 07:49 |
| kota_ | depending on the day :P | 07:50 |
| kota_ | my wife and boy has come to my home so i have to care everything... | 07:51 |
| *** gkadam has joined #openstack-swift | 07:56 | |
| *** armaan has quit IRC | 08:03 | |
| *** rcernin has quit IRC | 08:03 | |
| *** jistr is now known as jistr|mtg | 08:07 | |
| *** pcaruana has joined #openstack-swift | 08:11 | |
| *** armaan has joined #openstack-swift | 08:18 | |
| acoles | kota_: sounds like a busy time - good luck! | 08:21 |
| *** armaan has quit IRC | 08:35 | |
| *** armaan has joined #openstack-swift | 08:35 | |
| *** bharath1234 has joined #openstack-swift | 08:37 | |
| *** bharath1234 has quit IRC | 08:44 | |
| *** bharath1234 has joined #openstack-swift | 08:44 | |
| *** spsurya has quit IRC | 08:46 | |
| *** armaan has quit IRC | 08:46 | |
| *** armaan has joined #openstack-swift | 08:47 | |
| *** kei_yama has quit IRC | 08:53 | |
| *** rcernin has joined #openstack-swift | 08:54 | |
| *** vpc has joined #openstack-swift | 08:56 | |
| vpc | hi +mattoliverau | 08:56 |
| vpc | hi +kota_ | 08:56 |
| vpc | hi | 09:11 |
| *** jistr|mtg is now known as jistr | 09:12 | |
| vpc | hi | 09:13 |
| vpc | jistr | 09:13 |
| vpc | anyone | 09:13 |
| openstackgerrit | Alistair Coles proposed openstack/swift master: Fix test_wsgi.py tests failing with eventlet <=0.18.4 https://review.openstack.org/576800 | 09:25 |
| openstackgerrit | Alistair Coles proposed openstack/swift master: Use valid eventlet logger method https://review.openstack.org/576801 | 09:25 |
| acoles | bharath1234: fixes for the bug you found re. older eventlet versions ^^ | 09:26 |
| *** lifeless_ has quit IRC | 09:27 | |
| *** lifeless has joined #openstack-swift | 09:29 | |
| vpc | +acoles can help me | 09:29 |
| acoles | vpc: I can try | 09:29 |
| vpc | ImportError: No module named webhook | 09:31 |
| vpc | when i add webhook piple and py | 09:31 |
| acoles | vpc: could you paste a traceback using http://paste.openstack.org/ ? | 09:35 |
| openstackgerrit | Alistair Coles proposed openstack/swift master: Fix the example webhook middleware https://review.openstack.org/576808 | 09:50 |
| acoles | vpc: if you are trying to use the example middleware from https://docs.openstack.org/swift/latest/development_middleware.html#creating-your-own-middleware then you may need p 576808 | 09:52 |
| patchbot | https://review.openstack.org/#/c/576808/ - swift - Fix the example webhook middleware | 09:52 |
| *** armaan has quit IRC | 09:52 | |
| *** armaan has joined #openstack-swift | 09:53 | |
| *** bkopilov has quit IRC | 09:54 | |
| *** rcernin has quit IRC | 09:56 | |
| vpc | +acoles proxy-server.conf | 10:01 |
| vpc | http://paste.openstack.org/show/723907/ | 10:01 |
| vpc | im using this guide | 10:01 |
| vpc | plus the webhook.py | 10:02 |
| vpc | https://github.com/stmuraka/OpenStackSwift-OpenWhisk/tree/master/OpenStackSwift/Webhook | 10:02 |
| vpc | logs +acoles http://paste.openstack.org/show/723908/ | 10:02 |
| bharath1234 | acoles: The mock has been changed if I am right? The mock now returns a tuple instead of a string? | 10:09 |
| acoles | vpc: that should work, but looks like you are running in a virtualenv so make sure the webhook.py is available in that environment. activate the venv and try 'python -c 'import swift.common.middleware.webhook' | 10:10 |
| bharath1234 | acoles: and is it normal for the probe tests to take a long time? | 10:10 |
| acoles | bharath1234: correct, the test setting up the mock was not ocmpatible with older eventlet versions | 10:10 |
| acoles | compatible* | 10:10 |
| acoles | bharath1234: yes, probe tests take 10's of minutes on my laptop | 10:11 |
| bharath1234 | acoles: Thats great to know! about the fix and probe tests | 10:11 |
| acoles | bharath1234: also, probe tests delete existing data - only run probe tests on a test cluster! | 10:12 |
| bharath1234 | acoles: could you share your system config and how you are running openstack swift on your system? I would like to know how other people are working about with swift | 10:12 |
| acoles | bharath1234: do you mean my development setup, or for production? | 10:14 |
| bharath1234 | acoles:development setup :D | 10:16 |
| acoles | bharath1234: I use pycharm on mac for coding. For functional and probe tests I use SAIO on ubuntu VMs. I tend to also run the tox unit tests on those VMs too. If I need to test using keystone auth I have a keystone service running on a VM. | 10:22 |
| acoles | bharath1234: other devs I know use vagrant SAIO, I have also used runway at times, see https://docs.openstack.org/swift/latest/associated_projects.html#developer-tools | 10:22 |
| remix_tj | i use vagrant ansible saio by tdasilva: https://github.com/thiagodasilva/ansible-saio/ | 10:24 |
| *** armaan has quit IRC | 10:25 | |
| *** armaan has joined #openstack-swift | 10:25 | |
| *** silor has joined #openstack-swift | 10:36 | |
| *** silor has quit IRC | 10:46 | |
| bharath1234 | acoles:thanks! what about your system configuration? amount of RAM,processor etc? | 10:46 |
| *** armaan has quit IRC | 10:46 | |
| bharath1234 | remix_tj: any advantages of vagrant SAIO over running it on ubuntu vm? | 10:47 |
| *** armaan has joined #openstack-swift | 10:47 | |
| acoles | macbook pro 2015 with 16GB | 10:47 |
| remix_tj | bharath1234: it's one click start :-) | 11:07 |
| *** bkopilov has joined #openstack-swift | 11:10 | |
| *** bharath1234 has quit IRC | 11:12 | |
| *** cshastri has quit IRC | 11:30 | |
| *** spsurya has joined #openstack-swift | 11:43 | |
| *** armaan_ has joined #openstack-swift | 11:47 | |
| *** armaan has quit IRC | 11:47 | |
| *** cshastri has joined #openstack-swift | 11:55 | |
| *** germs has joined #openstack-swift | 12:09 | |
| *** germs has quit IRC | 12:14 | |
| *** edausq has quit IRC | 12:17 | |
| *** edausq has joined #openstack-swift | 12:17 | |
| *** edausq has joined #openstack-swift | 12:17 | |
| *** zhongjun_ has quit IRC | 12:29 | |
| *** cshastri has quit IRC | 12:48 | |
| *** mwheckmann has joined #openstack-swift | 12:53 | |
| *** cshastri has joined #openstack-swift | 12:58 | |
| openstackgerrit | Luigi Toscano proposed openstack/python-swiftclient master: Make OS_AUTH_URL work in DevStack by default https://review.openstack.org/473930 | 13:25 |
| *** bharath1234 has joined #openstack-swift | 13:29 | |
| *** armaan_ has quit IRC | 13:34 | |
| *** armaan has joined #openstack-swift | 13:35 | |
| zaitcev | kota_: do you have a link? I don't see any PUT+POST updates from you, sorry. | 13:39 |
| *** PsionTheory has joined #openstack-swift | 13:49 | |
| *** armaan has quit IRC | 13:57 | |
| *** armaan has joined #openstack-swift | 13:57 | |
| *** germs has joined #openstack-swift | 14:10 | |
| *** germs has quit IRC | 14:10 | |
| *** germs has joined #openstack-swift | 14:10 | |
| *** cshastri has quit IRC | 14:12 | |
| *** germs has quit IRC | 14:16 | |
| *** bharath1234 has quit IRC | 14:23 | |
| *** bharath1234 has joined #openstack-swift | 14:24 | |
| *** armaan has quit IRC | 14:26 | |
| *** cshastri has joined #openstack-swift | 14:26 | |
| *** armaan has joined #openstack-swift | 14:26 | |
| *** vpc_ has joined #openstack-swift | 14:34 | |
| vpc_ | Hi | 14:35 |
| vpc_ | No module name webhook | 14:35 |
| vpc_ | I add webhook.py plus webhook in pipeline | 14:35 |
| *** vpc_ has quit IRC | 14:40 | |
| *** cshastri has quit IRC | 14:43 | |
| *** vpc_ has joined #openstack-swift | 15:10 | |
| vpc_ | hi | 15:10 |
| vpc_ | anyone can help me | 15:10 |
| vpc_ | no module name webhook | 15:10 |
| vpc_ | i added webhook in pipeline | 15:10 |
| vpc_ | +acloes | 15:11 |
| vpc_ | +acoles just got home :( | 15:11 |
| *** bharath1234 has quit IRC | 15:12 | |
| vpc_ | +mattoliverau | 15:14 |
| vpc_ | +kota_ | 15:14 |
| acoles | vpc_: did you see my earlier post ? .. vpc: that should work, but looks like you are running in a virtualenv so make sure the webhook.py is available in that environment. activate the venv and try 'python -c 'import swift.common.middleware.webhook' | 15:15 |
| vpc_ | im sorry acoles | 15:15 |
| vpc_ | i just got home today | 15:15 |
| vpc_ | i leave my office when you reply ;( | 15:16 |
| *** germs has joined #openstack-swift | 15:16 | |
| *** germs has quit IRC | 15:16 | |
| *** germs has joined #openstack-swift | 15:16 | |
| vpc_ | im using kolla containers | 15:16 |
| vpc_ | add i exec to proxy_server container then add the webhook.py | 15:16 |
| *** germs has quit IRC | 15:16 | |
| vpc_ | +acoles im not using virtualenv | 15:17 |
| acoles | ok, well for some reason the webhook module isn't being picked up, so you could try getting into your container and check you can import it in python | 15:19 |
| *** germs has joined #openstack-swift | 15:19 | |
| *** germs has quit IRC | 15:19 | |
| *** germs has joined #openstack-swift | 15:19 | |
| vpc_ | did you see the sample code for webhook.py that i send earlier? | 15:20 |
| vpc_ | https://github.com/stmuraka/OpenStackSwift-OpenWhisk/tree/master/OpenWhisk here? | 15:20 |
| *** mwheckmann has quit IRC | 15:22 | |
| acoles | vpc_: yes but the problem you have here http://paste.openstack.org/show/723908/ is that the module is not being found | 15:23 |
| vpc_ | i see thats why my container always restarting | 15:23 |
| vpc_ | what should i need to do? | 15:24 |
| vpc_ | is my proxy-server.conf right? | 15:24 |
| vpc_ | the one i send earlier | 15:24 |
| acoles | proxy server conf looked correct. you need to debug why the webhook module is not being found. I am suggesting you start by trying to import it in a python shell in the container. | 15:26 |
| vpc_ | i will try tomorrow this command python -c 'import swift.common.middleware.webhook | 15:26 |
| *** armaan has quit IRC | 15:26 | |
| *** armaan has joined #openstack-swift | 15:27 | |
| *** PsionTheory has quit IRC | 15:27 | |
| acoles | +1 and if that fails you need to figure out why, because that is likely to be why swift proxy server is failing to start | 15:27 |
| vpc_ | it is okay to have tempauth plus keystoneauth? | 15:29 |
| acoles | yes if they have different reseller prefixes | 15:29 |
| vpc_ | i think i dont havfe reseller prefixes there | 15:30 |
| *** gkadam has quit IRC | 15:30 | |
| vpc_ | http://paste.openstack.org/show/723907/ | 15:31 |
| tdasilva | do docs list any limits on the number of containers a cluster can have? | 15:34 |
| *** armaan has quit IRC | 15:35 | |
| *** mwheckmann has joined #openstack-swift | 15:38 | |
| clayg | torgomatic_: patch 564646 looks pretty cool! | 15:40 |
| patchbot | https://review.openstack.org/#/c/564646/ - swift - Refactor replicators' statistics | 15:40 |
| clayg | nice cleanup | 15:40 |
| *** links has quit IRC | 15:41 | |
| *** cbartz has quit IRC | 15:45 | |
| *** mwheckmann has quit IRC | 15:49 | |
| notmyname | good morning | 16:00 |
| *** gyee has joined #openstack-swift | 16:21 | |
| *** hseipp has quit IRC | 16:22 | |
| *** silor has joined #openstack-swift | 16:34 | |
| *** tesseract has quit IRC | 16:34 | |
| notmyname | tdasilva: I want to propose my "docker test target" stuff to swift. it's some various docker config files and some ansible playbooks | 16:37 |
| notmyname | what would you think about renaming the exising "playbooks" directory to something else? | 16:38 |
| notmyname | something like ... IDK. "setup_examples"? "deployment"? what do you think? | 16:39 |
| notmyname | initially, I'd keep the existing probetests and saio stuff there and just add mine | 16:40 |
| notmyname | but there is likely some opportunity for consolidation. most obvious to me is in dependency installation | 16:40 |
| notmyname | we've got an existing examples directory. and tools. hmm... and etc is just sample configs | 16:42 |
| notmyname | I'm less worried about the etc directory, but maybe that's just historical bias because it's been around longest | 16:42 |
| notmyname | but it seems like there's some opportunity for consolidation | 16:42 |
| notmyname | how about this: move the existing "playbooks" directory underneath the existing "tools" dir. then rename playbooks to "probetest_setup". Then I add my stuff as a sibling dir to that under tools | 16:45 |
| timburke | good morning | 16:45 |
| notmyname | so, patch 1: reorg existing stuff. patch 2: propose my new stuff. patch 3 (later): consolidate playbooks | 16:46 |
| patchbot | https://review.openstack.org/#/c/1/ - openstack-infra/system-config - Add puppet module for ssh that installs an sshd_co... (MERGED) | 16:46 |
| patchbot | No data found for patch 2 | 16:46 |
| patchbot | No data found for patch 3 | 16:46 |
| notmyname | thanks patchbot | 16:46 |
| *** armaan has joined #openstack-swift | 16:49 | |
| *** armaan has quit IRC | 16:51 | |
| openstackgerrit | Tim Burke proposed openstack/swift master: Change PUT bucket conflict error https://review.openstack.org/575829 | 16:52 |
| *** armaan has joined #openstack-swift | 16:57 | |
| *** mwheckmann has joined #openstack-swift | 17:11 | |
| *** silor has quit IRC | 17:17 | |
| *** spsurya has quit IRC | 17:23 | |
| *** bharath1234 has joined #openstack-swift | 17:28 | |
| tdasilva | notmyname: looking | 17:32 |
| notmyname | link to the stuff I want to merge in https://github.com/notmyname/alpine_swift | 17:34 |
| *** psachin has quit IRC | 17:34 | |
| notmyname | I ran into an issue with how docker expects things to be organized, btu i'm working through it | 17:34 |
| bharath1234 | A lot of my functional tests are failing. i am able to use curl and communicate with the containers just fine. But the functional tests are failing. | 17:36 |
| bharath1234 | I am getting response errors | 17:36 |
| *** links has joined #openstack-swift | 17:37 | |
| bharath1234 | test.functional.swift_test_client.ResponseError: 404: 'Not Found' ('POST' '/v1/AUTH_test/%E0%A4%80%E8%94%89%EF%84%91%E5%98%85%E3%9C%83%E9%90%8C%EB%8C%8B%E0%A4%83%EB%8C%8E%E2%98%83%E9%90%8B%E8%94%8A%EF%84%92%E0%A4%82%ED%88%8E') txid=tx844f07cfe3ca42d3a737f-005b2a8e34 | 17:37 |
| bharath1234 | is the exact error. Sorry for the gibberish. I am unable to find anything on google | 17:38 |
| *** links has quit IRC | 17:39 | |
| tdasilva | notmyname: can you share more about alpine_swift? what is it? what's the goal? just curious... | 17:39 |
| tdasilva | also, how's it different that runway? | 17:39 |
| *** links has joined #openstack-swift | 17:39 | |
| tdasilva | s/that/than | 17:40 |
| tdasilva | notmyname: anyway, i think renaming playbooks and making it more generally consumable is a good diea | 18:01 |
| notmyname | sorry, in a meeting... give me a few more minutes | 18:02 |
| notmyname | tdasilva: ok. meeting done | 18:05 |
| notmyname | the point of alpine-swift is to make a dockerized test target that uses swift itself for setup | 18:06 |
| notmyname | ie using swift's own requirements/bindep/configs for setting things up instead of duplicating it into the docker file or a docker launch script or anything like that | 18:06 |
| notmyname | eventually I hope that we'll be able to use this pattern for dockerized swift services to do stuff like upgrade (mixed-version cluster) testing | 18:07 |
| timburke | bharath1234: does it seem to be mainly the UTF8 functional tests that are failing? i.e., all of the paths involve some long url-quoted bits like '%E0%A4%80'? | 18:09 |
| timburke | what version of eventlet do you have installed? `pip freeze | grep eventlet` | 18:09 |
| timburke | https://bugs.launchpad.net/swift/+bug/1769749 for some context on that last question | 18:10 |
| openstack | Launchpad bug 1769749 in OpenStack Object Storage (swift) "eventlet 0.23.0 breaks swift's unicode handling" [Undecided,Confirmed] | 18:10 |
| timburke | (though the failures from that seem to be more 500s/503s...) | 18:11 |
| *** links has quit IRC | 18:11 | |
| *** links has joined #openstack-swift | 18:12 | |
| *** silor has joined #openstack-swift | 18:13 | |
| tdasilva | notmyname: ack, cool | 18:13 |
| *** links has quit IRC | 18:14 | |
| openstackgerrit | Merged openstack/swift master: Fix the example webhook middleware https://review.openstack.org/576808 | 18:23 |
| openstackgerrit | Merged openstack/swift master: Fix test_wsgi.py tests failing with eventlet <=0.18.4 https://review.openstack.org/576800 | 18:23 |
| *** itlinux has joined #openstack-swift | 18:27 | |
| *** geaaru has quit IRC | 18:29 | |
| timburke | torgomatic_: the time-box on swift.common.utils.LRUCache is just to make sure that we don't cache a stale response indefinitely, yeah? there's nothing to proactively purge data that should have timed out? | 18:30 |
| *** germs has quit IRC | 18:30 | |
| *** germs has joined #openstack-swift | 18:30 | |
| *** germs has quit IRC | 18:30 | |
| timburke | (thinking about it in the context of keys for encryption, so actually purging them after a set amount of time would be rather nice...) | 18:31 |
| *** germs has joined #openstack-swift | 18:31 | |
| *** germs has quit IRC | 18:31 | |
| *** germs has joined #openstack-swift | 18:31 | |
| torgomatic_ | timburke: the purge isn't there, but there's some code (look for KeyError) to make it appear that timed-out values were purged | 18:32 |
| bharath1234 | i have the latest version of eventlet | 18:32 |
| bharath1234 | timburke:yup all the errors are the same | 18:33 |
| bharath1234 | timburke: in the sense,they are all ResponseErrors | 18:34 |
| timburke | bharath1234: so, 0.23.0? that's definitely known to cause troubles... fwiw, i had 0.22.1 installed before i started looking at acoles's p 576800 and p 576801 | 18:34 |
| patchbot | https://review.openstack.org/#/c/576800/ - swift - Fix test_wsgi.py tests failing with eventlet <=0.18.4 (MERGED) | 18:34 |
| patchbot | https://review.openstack.org/#/c/576801/ - swift - Use valid eventlet logger method | 18:34 |
| bharath1234 | i have eventlet 0.22.1 | 18:35 |
| bharath1234 | i had to update eventlet to pass the unit tests | 18:35 |
| timburke | good! that should work... so why doesn't it? :-( | 18:35 |
| timburke | try grepping the logs for one of the transaction ids that failed | 18:36 |
| timburke | tx844f07cfe3ca42d3a737f-005b2a8e34 for example | 18:36 |
| *** ianychoi has quit IRC | 18:36 | |
| openstackgerrit | Tim Burke proposed openstack/swift master: Include '-' in multipart ETags https://review.openstack.org/575860 | 18:42 |
| openstackgerrit | Merged openstack/swift master: Use valid eventlet logger method https://review.openstack.org/576801 | 18:48 |
| timburke | torgomatic_: mind looking at https://review.openstack.org/#/c/337960/ while you're thinking about SLOs and ETags? there was a design decision in https://review.openstack.org/#/c/575860/ that kinda assumed the older patch would end up landing... | 18:50 |
| patchbot | patch 337960 - swift - Send correct SLO ETag for container updates | 18:50 |
| patchbot | patch 575860 - swift - Include '-' in multipart ETags | 18:50 |
| torgomatic_ | looking | 18:51 |
| timburke | thanks | 18:53 |
| torgomatic_ | timburke: as an alternate, why not do the quoting entirely in s3api? that way, you don't have to change what's going into the container DBs and you don't have to worry about pre-patch SLOs | 18:56 |
| bharath1234 | timburke : i ll run the transaction tests a couple of more times. If the errors persist, i ll get back to you | 19:00 |
| *** lifeless has quit IRC | 19:00 | |
| bharath1234 | functional* | 19:00 |
| torgomatic_ | or maybe I've misunderstood... so before, the container listing had the hash of the on-disk SLO manifest, which is useless to clients, but after patch 337960, the container listings would have a thing that matches the ETag you'd see on HEAD/GET of the manifest, yes? | 19:00 |
| patchbot | https://review.openstack.org/#/c/337960/ - swift - Send correct SLO ETag for container updates | 19:00 |
| torgomatic_ | I guess the quoted/not-quoted thing propagating to containers seems kind of gross to me, but putting the manifest's client-facing ETag in the container listing seems good | 19:01 |
| timburke | yes. and in the s3api patch, i've codified that for new multipart uploads, too (in the X-Object-Sysmeta-Container-Update-Override-Etag header) | 19:01 |
| timburke | quoted/not-quoted is still valuable in listings, though! as a client, the quotes give you an indication that the object is an SLO -- much like how S3 clients can look at the etag from listings and know whether the object is a MU | 19:03 |
| timburke | hence the third case in https://review.openstack.org/#/c/575860/3/swift/common/middleware/s3api/controllers/bucket.py | 19:05 |
| patchbot | patch 575860 - swift - Include '-' in multipart ETags | 19:05 |
| torgomatic_ | timburke: sounds like a good argument; let me think about it for a few minutes | 19:12 |
| timburke | of course. fwiw, i think timur's been interested in having that knowledge, too... though he's still going to need to cope with legacy data :-( | 19:13 |
| torgomatic_ | yeah, there's no escaping legacy data when you're only shipping code and not deploying it yourself. if we had the ability to run migration scripts on all existing clusters, we could clean it up, but we don't. | 19:14 |
| timburke | which, as i recall, was clayg's argument *against* the slo patch... but (hopefully) the number of new slos that will be written with a *useful* container etag is orders of magnitude larger than the number of slos already written... | 19:15 |
| clayg | I just questioned the logic of "it's useful to clients" - because to me it sounded like "it's a wart that will forever bite clients" - unless we just had a new thing... like a finalized-large-object or something | 19:18 |
| clayg | "not perfect but consistent" is better than "not perfect and inconsitent" ??? maybe? I could be wrong. | 19:19 |
| openstackgerrit | Tim Burke proposed openstack/swift master: Include '-' in multipart ETags https://review.openstack.org/575860 | 19:20 |
| timburke | clayg: the trouble i've got now, is that i can't even get to consistent if i want to fix S3 bucket listings... | 19:20 |
| timburke | without which, s3cmd (at least) is doomed to think that all MUs have changed and should be re-downloaded/uploaded | 19:21 |
| clayg | Add flag to SLO in listing and do a HEAD? | 19:26 |
| timburke | eh? a HEAD on every included object during listings? surely i'm misunderstanding something... | 19:29 |
| *** Deknos has joined #openstack-swift | 19:39 | |
| openstackgerrit | Tim Burke proposed openstack/swift master: Resolve TODO's in test/probe/test_sharder.py https://review.openstack.org/571209 | 19:43 |
| *** armaan has quit IRC | 19:46 | |
| *** lifeless has joined #openstack-swift | 19:49 | |
| *** Deknos has quit IRC | 19:52 | |
| *** silor has quit IRC | 19:54 | |
| clayg | timburke: that's what clients that need this information from the swift api would have todo today right? seems reasonable for s3api to do it for them if it works better with their client tools. | 20:05 |
| timburke | ...so we have to do up to 1,000 object HEADs to finally return a listing? that's gonna suck! | 20:10 |
| timburke | we tolerate that sort of a thing during SLO uploads since it's done relatively infrequently -- but i want my listings to be snappy! | 20:10 |
| clayg | why? are s3 listings snappy? maybe truncate the listing if you do "enough" HEADs? | 20:18 |
| notmyname | I think the only agenda item for today's meeting is talking about https://review.openstack.org/#/c/427911/. please let me know if there's something else | 20:40 |
| patchbot | patch 427911 - swift - Replace MIME with PUT+POST for EC and Encryption | 20:40 |
| *** pcaruana has quit IRC | 20:41 | |
| kota_ | hello | 20:57 |
| mattoliverau | o/ | 20:59 |
| notmyname | swift team meeting time in #openstack-meeting | 20:59 |
| notmyname | clayg: acoles: zaitcev: tdasilva: cschwede: rledisez: kota_: torgomatic_: mattoliverau: meeting ping | 21:00 |
| *** rledisez has quit IRC | 21:24 | |
| *** alecuyer has quit IRC | 21:26 | |
| *** bharath1234 has quit IRC | 21:26 | |
| notmyname | kota_: I hope you enjoying your time with your new baby | 21:34 |
| notmyname | I was glad to read that everyone is well | 21:34 |
| kota_ | notmyname: thx! | 21:34 |
| clayg | tdasilva: aw man... grpc/http2 everything on the backend... man, it's appealing... | 21:35 |
| timburke | kota_: congratulations! | 21:35 |
| * kota_ is interested in the PUT+POST discussion but with the reason, i'm being offline for now. I'll read the irc log to follow the conversation. | 21:35 | |
| tdasilva | kota_: congratulations! | 21:36 |
| kota_ | timburke: thanks :D | 21:36 |
| clayg | acoles: so I are you going to say ... expect-100 continue with a "i am ready for your v2 request" in the response headers? | 21:36 |
| kota_ | oh, I'm really glad with many congrats :) | 21:36 |
| clayg | the... "response" headers - it's more like the continue headers? | 21:36 |
| kota_ | tdasilva: ;) | 21:36 |
| clayg | kota_: way to replicate buddy! | 21:37 |
| acoles | clayg: that was my fist idea but it was pointed out that headers with a 100 response are not widely supported | 21:37 |
| acoles | first* | 21:37 |
| clayg | acoles: oh... yeah... that does sound like something I would say | 21:38 |
| clayg | acoles: i'm a fuddy-duddy like that (just ask timburke) | 21:38 |
| acoles | clayg: you'd be the fourth person to point it out then :) | 21:38 |
| clayg | acoles: so what was the next intuative leap then? (since I've now caught up with 3-days-ago-acoles) | 21:38 |
| * clayg wonders if acoles means I'd be the 4th person to point out I'm a fuddy-duddy | 21:39 | |
| notmyname | mattoliverau: tdasilva: does this make sense? https://gist.github.com/notmyname/31cb48a74efc6bcdfb139a09bfe5bd76 | 21:42 |
| acoles | clayg: send all the headers we send now for MIME, plus some 'requires-version' header. An old backend will send the 100 response *with headers*, so we know its old and continue with MIME. A new backend will ignore the mime-related headers and send a 100 with no headers. The bit I haven't got a great solution for is a *really old* backend that doesn't know about mime so just returns a 100. We can prevent it finalizing an | 21:42 |
| acoles | object by sending a bogus etag at start and real etag in the POST...so it would get an etag mismatch. | 21:42 |
| notmyname | mattoliverau: tdasilva: hmm... I put it in gerrit to see what it does to the py3 jobs. not sure if those use the "test" selector or not | 21:43 |
| notmyname | (seems like it does in .zuul.yaml) | 21:44 |
| acoles | TBH I'm not sure what happens to day if you run an EC policy with a pre-EC backend, i.e. what is the failure mode | 21:44 |
| openstackgerrit | John Dickinson proposed openstack/swift master: specify test selector with py3 packages in bindep https://review.openstack.org/576993 | 21:44 |
| acoles | clayg: I'm pleased to learn that fuddy-duddy is not just a britishism! | 21:46 |
| *** lifeless has quit IRC | 21:46 | |
| *** lifeless has joined #openstack-swift | 21:47 | |
| acoles | FWIW I think I prefer the new verbs idea to the path mangling | 21:50 |
| clayg | acoles: ok, that all sounds reasoable | 21:51 |
| clayg | maybe it would be useful to understand the failure mode with super old object servers | 21:52 |
| tdasilva | notmyname: yeah, not sure about the test selector either, but will keep an eye on zuul for that patch | 21:52 |
| *** itlinux has quit IRC | 21:52 | |
| acoles | clayg: I'll write it up tomorrow, and try to research how really old servers behave | 21:52 |
| clayg | or maybe it would be useful to say "if your storage back-end is 2+ yrs old try upgrading to some intermediate releaes first, or you know ... shutting down your cluster for a little bit" | 21:52 |
| acoles | i.e. aka 'fuddy-duddy object servers' | 21:52 |
| clayg | acoles: ROFL | 21:53 |
| acoles | X-Backend-Fuddy-Duddy | 21:53 |
| clayg | acoles: so one thing I think I like about that is the "new" object servers won't *require* the the mime headers to ignore them? | 21:53 |
| clayg | like you can also just talk the new hawtness to new object servers directly? they don't fallback into some dumb mode because they think they might be getting a request from an old proxy? | 21:54 |
| acoles | clayg: no because they'd get a new header with 'requires-version' so would know the proxy is new | 21:55 |
| acoles | so one day the proxy could stop sending the mime headers but you'd have to know there were no mime-only backends | 21:55 |
| *** mwheckmann has quit IRC | 21:56 | |
| acoles | clayg: I'm going to bed. I'll start an etherpad tomorrow. | 21:58 |
| acoles | goodnight | 21:58 |
| * clayg hugs | 21:58 | |
| * acoles no kisses | 21:58 | |
| *** rcernin has joined #openstack-swift | 22:10 | |
| timburke | huh. different versions of py2 git different values for the expression len(u'\U0001f338') | 22:28 |
| timburke | give* | 22:28 |
| timburke | ...which also means that different versions of python give different results for swift.common.constraints.check_utf8(b'\xf0\x9f\x8c\xb8') | 22:31 |
| *** vpc_ has quit IRC | 22:31 | |
| notmyname | timburke: it's times like this where words don't suffice. I'd use emojis, but I'm not sure they'd render properly (depending, of course, on what version of python is runnign somehwere) | 22:32 |
| *** rcernin has quit IRC | 22:50 | |
| openstackgerrit | Samuel Merritt proposed openstack/swift master: Emit periodic stats from account and container replicators https://review.openstack.org/564875 | 23:15 |
| *** alecuyer has joined #openstack-swift | 23:16 | |
| torgomatic_ | timburke: how's that? I see the length thing with narrow/wide pythons, but how's that change the output of check_utf8? | 23:17 |
| *** rledisez has joined #openstack-swift | 23:17 | |
| *** kei_yama has joined #openstack-swift | 23:17 | |
| timburke | torgomatic_: https://github.com/openstack/swift/commit/331b142 -- if len(u'\U0001f338') then when we iterate through the decoded codepoints, we get two surrogates and return False | 23:32 |
| *** rcernin has joined #openstack-swift | 23:43 | |
| mattoliverau | morning | 23:46 |
| openstackgerrit | Merged openstack/swift master: Resolve TODO's in test/probe/test_sharder.py https://review.openstack.org/571209 | 23:48 |
| torgomatic_ | timburke: you mean if len(...) == 2 ? | 23:51 |
| openstackgerrit | Tim Burke proposed openstack/swift master: Add py36 testenv https://review.openstack.org/577013 | 23:52 |
| openstackgerrit | Tim Burke proposed openstack/swift master: py3: Port common/constraints https://review.openstack.org/577014 | 23:52 |
| openstackgerrit | Tim Burke proposed openstack/swift master: py3: Port common/swob https://review.openstack.org/577015 | 23:52 |
| timburke | yeah | 23:52 |
| *** mwheckmann has joined #openstack-swift | 23:57 | |
| torgomatic_ | timburke: yeah, and I don't think py3 will even utf-8-decode a thing with surrogates in it anyway (i.e. a wtf-8 string) | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!