openstackgerrit | Samuel Merritt proposed a change to openstack/swift: Refactor object PUT to make EC easier to add https://review.openstack.org/114084 | 00:01 |
---|---|---|
*** nosnos has joined #openstack-swift | 00:11 | |
openstackgerrit | A change was merged to openstack/swift: Add POST and DELETE to tempurl default methods https://review.openstack.org/106466 | 00:30 |
*** addnull has joined #openstack-swift | 00:40 | |
*** tdasilva has quit IRC | 00:46 | |
*** nosnos has quit IRC | 00:46 | |
*** shri has quit IRC | 00:51 | |
*** Krast has quit IRC | 01:17 | |
*** Krast has joined #openstack-swift | 01:17 | |
*** addnull has quit IRC | 01:37 | |
*** nosnos has joined #openstack-swift | 01:38 | |
*** tsg has joined #openstack-swift | 01:48 | |
*** tgohad has quit IRC | 01:48 | |
*** addnull has joined #openstack-swift | 01:53 | |
*** haomaiw__ has quit IRC | 01:53 | |
*** haomaiwang has joined #openstack-swift | 01:53 | |
*** nexusz99 has joined #openstack-swift | 02:09 | |
mattoliverau | notmyname: are you still around? | 02:31 |
*** haomaiw__ has joined #openstack-swift | 02:40 | |
*** haomaiwang has quit IRC | 02:44 | |
*** tongli has quit IRC | 03:06 | |
*** nosnos has quit IRC | 03:32 | |
*** jyoti-ranjan has joined #openstack-swift | 03:34 | |
*** mkerrin has quit IRC | 03:43 | |
*** nexusz99_ has joined #openstack-swift | 03:48 | |
*** addnull_ has joined #openstack-swift | 03:48 | |
*** mkerrin has joined #openstack-swift | 03:50 | |
*** dmsimard_away has quit IRC | 03:52 | |
*** joearnold has quit IRC | 03:52 | |
*** bgmccollum has quit IRC | 03:52 | |
*** charz has quit IRC | 03:52 | |
*** nexusz99 has quit IRC | 03:52 | |
*** mordred has quit IRC | 03:52 | |
*** CybergeekDK has quit IRC | 03:52 | |
*** addnull has quit IRC | 03:52 | |
*** jroll has quit IRC | 03:52 | |
*** infotection has quit IRC | 03:52 | |
*** CybergeekDK has joined #openstack-swift | 03:52 | |
*** bgmccollum has joined #openstack-swift | 03:52 | |
*** joearnold has joined #openstack-swift | 03:53 | |
*** charz has joined #openstack-swift | 03:53 | |
*** dmsimard_away has joined #openstack-swift | 03:53 | |
*** infotect- has joined #openstack-swift | 03:53 | |
*** mordred has joined #openstack-swift | 03:53 | |
*** dmsimard_away is now known as dmsimard | 03:54 | |
*** gyee has quit IRC | 03:54 | |
*** jroll has joined #openstack-swift | 03:54 | |
*** mkerrin has quit IRC | 03:55 | |
*** nosnos has joined #openstack-swift | 04:01 | |
*** bgmccollum_ has joined #openstack-swift | 04:06 | |
*** joearnold_ has joined #openstack-swift | 04:07 | |
*** bgmccollum has quit IRC | 04:07 | |
*** joearnold has quit IRC | 04:07 | |
*** CybergeekDK has quit IRC | 04:07 | |
*** joearnold_ is now known as joearnold | 04:07 | |
*** CybergeekDK has joined #openstack-swift | 04:07 | |
*** zaitcev has quit IRC | 04:22 | |
*** jyoti-ranjan has quit IRC | 04:24 | |
*** nexusz99_ has quit IRC | 04:28 | |
*** Midnightmyth has joined #openstack-swift | 04:40 | |
*** kota_ has joined #openstack-swift | 04:43 | |
*** ppai has joined #openstack-swift | 04:45 | |
*** chandankumar has joined #openstack-swift | 04:51 | |
*** ZBhatti has joined #openstack-swift | 04:55 | |
openstackgerrit | Matthew Oliver proposed a change to openstack/swift: Treat 404s as 200 on object delete in proxy https://review.openstack.org/114120 | 04:56 |
*** jyoti-ranjan has joined #openstack-swift | 05:00 | |
*** Midnightmyth has quit IRC | 05:03 | |
*** mkerrin has joined #openstack-swift | 05:08 | |
*** kopparam has joined #openstack-swift | 05:12 | |
*** kopparam has quit IRC | 05:13 | |
*** mkerrin has quit IRC | 05:13 | |
*** kopparam has joined #openstack-swift | 05:13 | |
*** akp has quit IRC | 05:13 | |
*** akp has joined #openstack-swift | 05:14 | |
*** mahati has joined #openstack-swift | 05:19 | |
*** haomaiw__ has quit IRC | 05:31 | |
*** haomaiwang has joined #openstack-swift | 05:31 | |
*** chandankumar has quit IRC | 05:40 | |
*** haomai___ has joined #openstack-swift | 05:42 | |
*** haomaiwang has quit IRC | 05:46 | |
*** ppai has quit IRC | 05:48 | |
*** mkerrin has joined #openstack-swift | 05:50 | |
*** chandankumar has joined #openstack-swift | 06:02 | |
*** ttrumm has joined #openstack-swift | 06:02 | |
*** mkerrin has quit IRC | 06:02 | |
*** ppai has joined #openstack-swift | 06:03 | |
*** ttrumm_ has joined #openstack-swift | 06:03 | |
*** ttrumm has quit IRC | 06:07 | |
*** mkerrin has joined #openstack-swift | 06:11 | |
*** tsg has quit IRC | 06:13 | |
openstackgerrit | Matthew Oliver proposed a change to openstack/swift: Treat 404s as 200 on object delete in proxy https://review.openstack.org/114120 | 06:15 |
openstackgerrit | Matthew Oliver proposed a change to openstack/swift: Treat 404s as 204 on object delete in proxy https://review.openstack.org/114120 | 06:17 |
*** k4n0 has joined #openstack-swift | 06:30 | |
*** ppai has quit IRC | 06:36 | |
*** bvandenh has joined #openstack-swift | 06:49 | |
*** ppai has joined #openstack-swift | 06:49 | |
*** madhuri has joined #openstack-swift | 06:57 | |
madhuri | Hi can any one tell me what is the significance of "used_source_etag"? | 06:58 |
*** addnull_ is now known as addnull | 07:00 | |
*** kopparam has quit IRC | 07:00 | |
*** haomai___ has quit IRC | 07:12 | |
*** haomaiwang has joined #openstack-swift | 07:12 | |
*** haomaiw__ has joined #openstack-swift | 07:15 | |
*** haomaiwang has quit IRC | 07:18 | |
*** mkerrin has quit IRC | 07:22 | |
*** occup4nt has joined #openstack-swift | 07:24 | |
*** ppai has quit IRC | 07:27 | |
*** occupant has quit IRC | 07:27 | |
*** occupwnt has joined #openstack-swift | 07:28 | |
*** mkerrin has joined #openstack-swift | 07:30 | |
*** occup4nt has quit IRC | 07:31 | |
*** occupant has joined #openstack-swift | 07:32 | |
*** occupwnt has quit IRC | 07:34 | |
*** ppai has joined #openstack-swift | 07:44 | |
*** mahati has quit IRC | 07:44 | |
*** occup4nt has joined #openstack-swift | 07:46 | |
*** occupant has quit IRC | 07:49 | |
*** occupwnt has joined #openstack-swift | 07:49 | |
*** ppai has quit IRC | 07:49 | |
*** mrsnivvel has joined #openstack-swift | 07:51 | |
*** occup4nt has quit IRC | 07:52 | |
*** ppai has joined #openstack-swift | 07:53 | |
*** mrsnivvel has left #openstack-swift | 07:53 | |
*** kopparam has joined #openstack-swift | 07:54 | |
*** occupant has joined #openstack-swift | 07:56 | |
*** homegrown has quit IRC | 07:56 | |
*** occupwnt has quit IRC | 07:56 | |
*** kopparam has quit IRC | 07:58 | |
*** occup4nt has joined #openstack-swift | 08:00 | |
*** occupwnt has joined #openstack-swift | 08:01 | |
*** occupant has quit IRC | 08:02 | |
*** occup4nt has quit IRC | 08:04 | |
*** haomaiw__ has quit IRC | 08:04 | |
*** haomaiwang has joined #openstack-swift | 08:05 | |
*** ppai has quit IRC | 08:07 | |
*** mkollaro has joined #openstack-swift | 08:10 | |
*** haomai___ has joined #openstack-swift | 08:11 | |
*** haomaiwang has quit IRC | 08:14 | |
*** kopparam has joined #openstack-swift | 08:15 | |
*** jyoti-ranjan has quit IRC | 08:19 | |
*** ppai has joined #openstack-swift | 08:20 | |
*** foexle has joined #openstack-swift | 08:22 | |
*** jyoti-ranjan2 has joined #openstack-swift | 08:23 | |
*** joeljwright has joined #openstack-swift | 08:25 | |
*** ppai has quit IRC | 08:26 | |
*** sts_ is now known as sts | 08:30 | |
sts | /wc/ | 08:31 |
*** sts has left #openstack-swift | 08:31 | |
*** ppai has joined #openstack-swift | 08:39 | |
*** leopoldj has joined #openstack-swift | 08:48 | |
*** kopparam has quit IRC | 09:08 | |
*** kopparam has joined #openstack-swift | 09:09 | |
*** haomai___ has quit IRC | 09:11 | |
*** haomaiwa_ has joined #openstack-swift | 09:11 | |
*** jyoti-ranjan2 has quit IRC | 09:11 | |
*** kopparam has quit IRC | 09:13 | |
acoles | portante: so that line has changed since i did setup! there was no 'tr'. sounds like you have it sorted but FWIW my lib/keystone: http://git.io/WEjv4w | 09:23 |
*** ppai has quit IRC | 09:29 | |
*** jyoti-ranjan has joined #openstack-swift | 09:30 | |
*** kota_ has quit IRC | 09:36 | |
*** kopparam has joined #openstack-swift | 09:49 | |
*** nosnos has quit IRC | 10:16 | |
*** chandankumar has quit IRC | 10:19 | |
goodes | good morning | 10:22 |
*** haomaiw__ has joined #openstack-swift | 10:24 | |
*** haomaiwa_ has quit IRC | 10:27 | |
*** chandankumar has joined #openstack-swift | 10:31 | |
*** stevie99 has joined #openstack-swift | 10:38 | |
*** haomaiw__ has quit IRC | 10:50 | |
*** haomaiwang has joined #openstack-swift | 10:51 | |
*** bvandenh has quit IRC | 11:00 | |
portante | acoles: yes, at least my full setup works. | 11:05 |
portante | thanks | 11:06 |
portante | so can you share how to get my devstack to use my other swift instances in my SAIO's? | 11:06 |
*** bvandenh has joined #openstack-swift | 11:06 | |
acoles | portante: yes. sec | 11:07 |
acoles | portante: that'll be this link https://wiki.openstack.org/wiki/Swift/DevstackSetupForKeystoneV3#Creating_endpoint_for_SAIO_VM_in_keystone | 11:07 |
*** jyoti-ranjan has quit IRC | 11:08 | |
acoles | portante: do you have openstackclient working? | 11:08 |
portante | acoles: have not taken that step yet, but will be today. :) | 11:13 |
acoles | portante: you have the notion of a swift service in the devstack kesytone by default (assuming you configured swift to run in your devstack as per that wiki page) | 11:15 |
acoles | portante: you need to add your SAIO as an endpoint for that service | 11:16 |
acoles | so its not too much work - if you can authenticate and talk to the devstack swift, then you'll use same auth credentials to talk to your SAIO swift once its set as an endpoint | 11:17 |
acoles | endpoint can be added to keystone using the keystoneclient cli or openstack client, but to set up user/project in a non-default domain you will need openstackclient | 11:19 |
acoles | ...then follow the instructions on that wiki - first to add domain/project/user to exercise the v 3 features, then to add your own SAIO as endpoint and point your SAIO to the devstack keystone. | 11:21 |
acoles | portante: ping me if you need more | 11:22 |
*** leopoldj has quit IRC | 11:29 | |
*** kopparam has quit IRC | 11:30 | |
openstackgerrit | A change was merged to openstack/swift: Catch permissions errors when writing StatsD packets https://review.openstack.org/113180 | 11:30 |
*** Krast has quit IRC | 11:31 | |
*** tongli has joined #openstack-swift | 11:36 | |
portante | acoles: thanks! | 11:47 |
*** kopparam has joined #openstack-swift | 11:51 | |
*** addnull has quit IRC | 12:03 | |
*** infotect- has quit IRC | 12:04 | |
*** kopparam has quit IRC | 12:04 | |
*** infotection has joined #openstack-swift | 12:10 | |
*** stevie99 has quit IRC | 12:22 | |
*** tdasilva has joined #openstack-swift | 12:30 | |
*** bvandenh has quit IRC | 12:31 | |
*** jyoti-ranjan has joined #openstack-swift | 12:37 | |
openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 12:40 |
*** bvandenh has joined #openstack-swift | 12:41 | |
openstackgerrit | Salvatore Pinto proposed a change to openstack/swift: Add Keystone URI to 401 responces https://review.openstack.org/113577 | 12:44 |
*** jyoti-ranjan has quit IRC | 13:09 | |
*** nshaikh has quit IRC | 13:20 | |
*** annegentle_ has joined #openstack-swift | 13:35 | |
*** annegentle has quit IRC | 13:35 | |
*** bill_az_ has joined #openstack-swift | 13:39 | |
*** tsg has joined #openstack-swift | 13:43 | |
portante | acoles: still there? | 13:59 |
acoles | portante: yup | 13:59 |
portante | I was able to list the endpoints with, openstack --os-url http://devstack-0-perf44:5000/v3 --os-identity-api-version 3 --os-token=azertytoken endpoint list | 13:59 |
portante | but I get the following error when I try to create a new region | 14:00 |
acoles | good! | 14:00 |
*** bvandenh has quit IRC | 14:00 | |
acoles | not good | 14:00 |
portante | --publicurl is required | 14:00 |
acoles | ok rings a bell, hang on | 14:00 |
acoles | portante: i think the command line syntax may have changed (mea culpa for not checking) see https://wiki.openstack.org/wiki/OpenStackClient/Commands#endpoint | 14:02 |
acoles | looks like publicurl is now flagged rather than positional | 14:02 |
portante | yes, and when I changed that, then I get ... | 14:02 |
portante | "openstack No service with a type, name or ID of 'object-store' exists" | 14:03 |
portante | so I am guessing that should be "swift" | 14:03 |
portante | that does not work either | 14:04 |
acoles | if you do openstack service list what do you see - swift, object-store ? | 14:04 |
portante | service name: swift, service type, object-store | 14:05 |
portante | there are three listed, admin, public, internal | 14:05 |
portante | acoles: maybe I have to specify all three urls? | 14:06 |
*** jyoti-ranjan has joined #openstack-swift | 14:07 | |
*** astellwag has quit IRC | 14:07 | |
peluse | portante: have to run my daughter to school but when I get back we can compare notes if you want, mine still works | 14:08 |
acoles | maybe, but that doc shows only public being required. could you try passing the service ID rather than type (listed by openstack service list)? | 14:08 |
portante | sure | 14:09 |
portante | thanks | 14:09 |
acoles | portante: i'll update my openstackclient to reproduce | 14:10 |
*** xianghuihui has joined #openstack-swift | 14:10 | |
portante | k, thanks | 14:10 |
*** astellwag has joined #openstack-swift | 14:13 | |
*** ttrumm_ has quit IRC | 14:24 | |
*** dmsimard is now known as dmsimard_away | 14:30 | |
*** dmsimard_away is now known as dmsimard | 14:30 | |
*** tsg has quit IRC | 14:38 | |
*** k4n0 has quit IRC | 14:45 | |
*** nshaikh has joined #openstack-swift | 14:45 | |
*** foexle has quit IRC | 14:45 | |
*** kenhui has joined #openstack-swift | 14:47 | |
*** aerwin has joined #openstack-swift | 14:50 | |
peluse | portante: I'm back now, here's some sample output from my working v3 setup if it helps: https://gist.github.com/peluse/10939316 | 14:57 |
* portante looks ... | 14:57 | |
*** nshaikh has quit IRC | 14:59 | |
portante | peluse: so what environment variables do you have set for the keystone service-list command to work? | 15:01 |
acoles | portante: peluse: been in dependency hell! but i think my openstackclient is up to date - openstack --version -> openstack 0.4.0.78 | 15:02 |
portante | I have 0.4.0 | 15:02 |
portante | acoles: ^^^ | 15:02 |
peluse | portante: export OS_TENANT_NAME=service | 15:04 |
peluse | export OS_USERNAME=swift | 15:04 |
peluse | export OS_PASSWORD=intel123 | 15:04 |
peluse | export OS_AUTH_URL=http://controller:35357/v2.0 | 15:04 |
acoles | portante: i get usage: openstack endpoint create [-h] [-f {shell,table,value}] [-c COLUMN] | 15:04 |
acoles | [--max-width <integer>] [--variable VARIABLE] | 15:04 |
acoles | [--prefix PREFIX] [--region <region>] | 15:04 |
acoles | [--enable | --disable] | 15:04 |
acoles | <service> <interface> <url> | 15:04 |
portante | k thx, peluse | 15:04 |
peluse | portante: and my ver is openstack 0.4.0.78 | 15:04 |
portante | oy | 15:04 |
portante | gotta update | 15:04 |
acoles | i.e. it does NOT like --publicurl ? but you see different | 15:04 |
portante | hmmm | 15:05 |
peluse | nd I don't use --publicurl on any of my cmd lines for testing this... | 15:06 |
acoles | i can generate portante's error but only by passing bogus service type: "No service with a type, name or ID of 'banana' exists" | 15:07 |
*** kevinc_ has joined #openstack-swift | 15:08 | |
acoles | 'object-store' works fine, ther service ID works fine, 'swift' doesn't work | 15:08 |
*** zaitcev has joined #openstack-swift | 15:09 | |
*** ChanServ sets mode: +v zaitcev | 15:09 | |
*** tsg has joined #openstack-swift | 15:09 | |
openstackgerrit | A change was merged to openstack/python-swiftclient: Clean up raw policy stats in account stat https://review.openstack.org/110929 | 15:11 |
*** joeljwright has quit IRC | 15:15 | |
*** __lgw4__ has joined #openstack-swift | 15:16 | |
portante | acoles, peluse: so I am using the openstack command on my devstack | 15:20 |
portante | could that be the problem? | 15:20 |
peluse | portante: I went the non-devstack route so not sure but I wouldn't think so | 15:21 |
*** IRTermite has quit IRC | 15:24 | |
*** IRTermite has joined #openstack-swift | 15:24 | |
*** peterbusque has joined #openstack-swift | 15:24 | |
acoles | portante: on my devstack i have openstackclient 0.3.1.40 | 15:25 |
acoles | and i see same cli requirements | 15:25 |
*** peterbusque has left #openstack-swift | 15:25 | |
portante | hmm, openstackclient is the same as python-openstackclient repo, and provides the openstack command, right? | 15:29 |
portante | acoles: ^^^ | 15:30 |
peluse | portante: yup | 15:30 |
acoles | pretty sure. to be more precise, on my devstack openstack --version returns 0.3.1.40 | 15:30 |
peluse | at least that's what I thought :) | 15:30 |
*** tong_ has joined #openstack-swift | 15:31 | |
portante | seems funny to use a different openstackclient version than the one that comes with a devstack | 15:33 |
acoles | portante: yeah. so back to your original error, did you try using the service id with the --public-url fomr of the command? | 15:39 |
portante | well, no, I am trying to work with the 0.4.0 openstack client, as I cannot seem to install the latest openstackclient on my other Fedora VM ... | 15:39 |
*** tongli has quit IRC | 15:40 | |
*** omame has quit IRC | 15:40 | |
* acoles is probably getting confused | 15:42 | |
*** omame has joined #openstack-swift | 15:42 | |
acoles | can you use 'endpoint create --public-url http://saio:8080/v1 <service id> | 15:43 |
portante | okay, I think I have worked this out, was able to use the 0.4.0 client to create public, internal and admin interface | 15:43 |
acoles | yay! | 15:43 |
portante | I did it by first using all environment variables for --os-url, identity version, token, until I had a plain command line like: | 15:44 |
portante | opentack endpoint list | 15:44 |
portante | openstack endpoint create --region SAIO_0_Region object-store internal 'http://saio-0-perf44:8080/v1/AUTH_$(tenant_id)s' | 15:44 |
portante | that works with this | 15:45 |
portante | I don't know why this is that different from what you have here: https://wiki.openstack.org/wiki/Swift/DevstackSetupForKeystoneV3#Creating_endpoint_for_SAIO_VM_in_keystone | 15:46 |
acoles | yeah, i am perplexed! | 15:47 |
peluse | interesting, I just used keystone to create my endpoints... | 15:47 |
acoles | and does 'openstack endpoint list' show your SAIO_)_Region endpoints? | 15:48 |
peluse | yes | 15:49 |
portante | yes, I now have the default RegionOne end ponts for the swift instance in the devstack environment, and the two regions I created for my two SAIOs | 15:49 |
portante | acoles: peluse: heading out for a ride, will continue with all this when I get back. | 15:51 |
acoles | ok, so hopefully you can continue with the steps on the wiki, to config your saio-0-perf44 to use devstack keystone | 15:51 |
portante | thanks for helping me out | 15:51 |
portante | yes, hopefully | 15:51 |
acoles | portante: no problem. | 15:52 |
*** Midnightmyth has joined #openstack-swift | 15:55 | |
notmyname | good morning | 16:27 |
goodes | notmyname: good morning | 16:32 |
notmyname | what's the news from (my) overnight? | 16:32 |
*** mkollaro1 has joined #openstack-swift | 16:35 | |
*** mkollaro has quit IRC | 16:35 | |
acoles | notmyname: morning. news is that portante's openstackclient is different to mine :( but we're getting there i hope. | 16:39 |
*** chandankumar has quit IRC | 16:46 | |
*** pconstantine has quit IRC | 16:54 | |
*** chandankumar has joined #openstack-swift | 17:02 | |
*** pberis has joined #openstack-swift | 17:04 | |
*** pconstantine has joined #openstack-swift | 17:09 | |
*** pberis has quit IRC | 17:10 | |
*** pberis has joined #openstack-swift | 17:12 | |
peluse | and different still from the one I used :) | 17:19 |
*** Midnightmyth has quit IRC | 17:20 | |
*** shri has joined #openstack-swift | 17:21 | |
*** pconstantine has quit IRC | 17:43 | |
notmyname | hmmm..what is this policy constraints middleware? | 17:52 |
zaitcev | we discussed it in the meeting yesterday and you ask it now? | 17:55 |
zaitcev | I haven't looked it though | 17:55 |
notmyname | I've slept since then! | 17:57 |
notmyname | I'm looking at it now | 17:57 |
zaitcev | Okay. I don't understand why it should be a middleware, but we've got a bunch of core features implemented so, like DLO. | 17:58 |
notmyname | tdasilva: ping | 17:58 |
notmyname | tdasilva: we're talking about your code :-) | 17:59 |
*** pconstantine has joined #openstack-swift | 17:59 | |
notmyname | I can understand per-policy constraints | 17:59 |
*** Midnightmyth has joined #openstack-swift | 18:00 | |
notmyname | tdasilva: my initial impressing is that a "mem_constraints" middleware seems unnecessary. | 18:03 |
notmyname | setting the env callback (swift.constraints) seems an interesting way to solve it, too | 18:03 |
notmyname | but I'd like to see not "here's the default one in constraints.py and then I had an override in this other middleware" but rather just one way. that is, do it all in a middleware or do it all in the module (eg pulled from the config) | 18:05 |
notmyname | tdasilva: did you consider allowing the storage policies sections in swift.conf to set constraints? eg set the default max object size to X, but in storage policy 36 set it to Y | 18:06 |
zaitcev | my thought too - at least from sysadmin's perspective | 18:08 |
notmyname | tdasilva doesn't seem to be active online right now. I'll copy/paste these comments into gerrit | 18:08 |
*** erlon has quit IRC | 18:10 | |
*** jyoti-ranjan has quit IRC | 18:11 | |
*** annegentle has joined #openstack-swift | 18:13 | |
*** acoles is now known as acoles_away | 18:17 | |
*** chandankumar has quit IRC | 18:22 | |
*** annegentle has quit IRC | 18:26 | |
portante | zaitcev, notmyname: one advantage to the middleware side is that if you pull the middleware, you pull the constraints | 18:26 |
*** kevinc_ has quit IRC | 18:27 | |
notmyname | portante: or if you deprecate the policy, same. but this time all of the policy config is in one place, not two | 18:27 |
portante | by adding them to swift.conf, you have the potential to cause a screw up of swift.conf for other things | 18:27 |
notmyname | using middleware and they can screw up the proxy server config file ;-) | 18:28 |
portante | hmmm, I can see that, too. | 18:29 |
notmyname | portante: I'm mostly just trying to push and giving you a hard time. you're certainly not wrong. and middleware is certainly one way to solve this problem. personally, I think doing it all in swift.conf is better. I just haven't been convinced on the middleware side yet :-) | 18:30 |
portante | so doing it in swift.conf means more mechanism to implement which is not there, were with middleware the mechanism is already in place | 18:31 |
portante | but the down side seems to be the two locations for policy information | 18:31 |
notmyname | now that is true. it would probably take a little more code refactoring to ensure that the constraints are checked per policy. probably would need something like passing the req to the constraints or even setting up a callback in the proxy server | 18:32 |
notmyname | but it seems that the current patch does do some of that anyway (set up the callback). granted, it's probably less code this way. | 18:32 |
portante | the second problem is that for ALL requests, we have to add this check for which set of constraints to use, but with middleware we only pay for that on the ones that need it | 18:33 |
notmyname | not really. the middleware is still evalauted for every request. it just wouldn't set the callback for some of them | 18:33 |
notmyname | right? | 18:33 |
portante | yes, if you enable that policy | 18:33 |
portante | if you don't use that policy, you don't pay | 18:33 |
portante | so somebody who does not use swift-on-file does not need to pay for the check overhead | 18:34 |
portante | the concern in a slow creep of drag on all requests | 18:34 |
notmyname | I'm imagining something very early in the proxy server where it might set a swift.constraints callback (or something) based on the info in the request | 18:34 |
portante | but maybe that should be solved later | 18:34 |
portante | possibly dove tailed with other checks at the time, so perhaps | 18:35 |
portante | okay | 18:35 |
notmyname | well, my thought is that there would be one mechanism for every constraints check. that is, don't use the "normal" module and maybe a middleware | 18:35 |
notmyname | just use one or the other (or some third way) | 18:35 |
portante | sure | 18:35 |
notmyname | less options, less code paths, less complexity (but maybe more refactoring initially) | 18:35 |
portante | perhaps | 18:36 |
notmyname | anyway, I'm just commenting on the code. tdasilva is actually writing it :-) | 18:36 |
portante | might be worth the unfront effort for the reduced complexity | 18:36 |
notmyname | and my calendar just told me I have a lunch meeting in 10 minutes | 18:36 |
notmyname | so I gotta run | 18:36 |
portante | cya | 18:36 |
notmyname | but thanks very much for the discussion :-) | 18:36 |
portante | welcome | 18:36 |
notmyname | helps me figure out what I want too :-) | 18:36 |
zaitcev | useful to articulate | 18:36 |
notmyname | indeed | 18:37 |
* portante plows ahead with keystone v3 ... | 18:40 | |
*** occupwnt is now known as occupant | 18:43 | |
* tdasilva needs to learn to set tdasilva away :) | 18:50 | |
tdasilva | catching up now | 18:51 |
*** NM has joined #openstack-swift | 18:51 | |
*** jyoti-ranjan has joined #openstack-swift | 18:55 | |
*** acoles_away is now known as acoles | 18:58 | |
*** jyoti-ranjan has quit IRC | 19:00 | |
acoles | portante: i'm packing cases but will keep an eye on channel so ping if you have question | 19:01 |
portante | acoles: thanks, almost there... | 19:04 |
portante | just verified my SAIO is properly functional with master, now to change the config to use V3 auth | 19:05 |
portante | acoles: no module named keystonemiddleware.auth_token | 19:15 |
portante | hmmm | 19:15 |
portante | shouldn't that be keystoneclient.middleware.auth_token? | 19:16 |
openstackgerrit | David Goetz proposed a change to openstack/swift: Sleep for longer at a time in lock_path. https://review.openstack.org/113317 | 19:16 |
acoles | portante: recent change, auth_token got moved to its own project keystonemiddleware. keystoneclient.middleware.auth_token should still work | 19:17 |
portante | oh, already I am passe | 19:17 |
portante | just put me out to pasture | 19:17 |
acoles | whichever, you will need it installed on your SAIO | 19:18 |
acoles | no. its crazy. i think keystonemiddleware imports from keystoneclient!! | 19:19 |
portante | oy | 19:19 |
portante | okay, that worked, at least the proxy server is now started | 19:20 |
peluse | portante: yeah, I went though that too | 19:20 |
acoles | cool | 19:20 |
*** kenhui has quit IRC | 19:21 | |
openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/python-swiftclient: Updated from global requirements https://review.openstack.org/89250 | 19:22 |
portante | acoles: okay, so I have your patches installed on my client node | 19:26 |
portante | now to see if I can't get the client to work ... | 19:28 |
acoles | portante: remember that if using v3 credentials to put -V 3 on swift command line and the auth-url ends /v3 | 19:30 |
*** miqui has quit IRC | 19:33 | |
portante | acoles: thanks! | 19:38 |
*** kevinc_ has joined #openstack-swift | 19:38 | |
*** miqui has joined #openstack-swift | 19:40 | |
*** ryao is now known as gentoofan | 19:42 | |
*** gentoofan is now known as ryao | 19:43 | |
tdasilva | notmyname, zaitcev, portante, I posted some comments there on the patch. Thanks for looking at this... | 19:54 |
zaitcev | tdasilva: any time, but I haven't looked properly yet, sorry. Fixing up Kodiak's crash right now. | 19:54 |
tdasilva | zaitcev, no problem :) | 19:57 |
*** aerwin has quit IRC | 19:59 | |
openstackgerrit | Pete Zaitcev proposed a change to openstack/python-swiftclient: Fix crash when downloading a pseudo-directory https://review.openstack.org/112139 | 20:01 |
portante | acoles: using your keystone-v3-setup.sh script I get a 409 from keystone | 20:17 |
*** peterbusque has joined #openstack-swift | 20:17 | |
acoles | portante: do you get message with it? could just be conflict trying to create admin role because it already exists i.e. not a problem | 20:19 |
acoles | portante: openstack [user|project|domain] list will show if user u1, project p1 were created in domain d1 | 20:21 |
*** peterbusque has quit IRC | 20:21 | |
portante | acoles: checking ... | 20:28 |
portante | acoles: all three exist, yeah! | 20:29 |
portante | do I win a gum ball? | 20:30 |
acoles | portante: one gum ball each | 20:31 |
portante | nuice | 20:31 |
portante | nice | 20:31 |
* portante goes to get some | 20:31 | |
portante | okay now, can I configure the swiftclient functional tests to use this setup? | 20:31 |
peluse | tdasilva: Wrt the middleware patch, why did you go that route? I asked myself that while reviewing and the answer I came up with was becuase it allowed per policy contraint enforcement via new code w/o affecting the core code base. | 20:32 |
peluse | tdsilva: Given something like a different back-end that can be confiured w/o code changes I figured that kind of extensibility would be nice. I dunno, off base? | 20:32 |
acoles | portante: they pull in from test.conf but see tests/sample.conf | 20:33 |
acoles | portante: i tend to run them on my saio so have an /etc/swift/test.conf sat there already | 20:34 |
peluse | acoles: wtf,I didn't get any gumballs?? :) | 20:34 |
tdasilva | peluse: the main driver is that for swiftonfile it was not sufficient to just have different values for the existing constraints. For example, have a different size of max_object_name_length | 20:35 |
acoles | peluse: what can i say? i'll bring the to boston | 20:35 |
acoles | them | 20:35 |
notmyname | tdasilva: I have thoughts on that. want me to respond here or in gerrit (..just got back from lunch) | 20:36 |
tdasilva | humm...would gerrit be ok? i need to step away again...driving to boston now to see mark seger's talk at the openstack-boston meetup | 20:37 |
notmyname | tdasilva: sure :-) | 20:37 |
portante | acoles, I can't get the example to list the container I think I created | 20:38 |
acoles | portante: which example are you trying? | 20:39 |
portante | bottom of this page | 20:39 |
portante | https://wiki.openstack.org/wiki/Swift/DevstackSetupForKeystoneV3 | 20:39 |
portante | well, it was the bottom, just before the SAIO setup | 20:42 |
acoles | ok, with you - the example using openstackclient to list the container or using swift? | 20:44 |
portante | openstackclient | 20:44 |
acoles | swift worked? | 20:44 |
acoles | ie example before that last one | 20:45 |
portante | ah, I see, it is not using the regions I setup | 20:45 |
portante | so I have to specify the region on the swift client command line | 20:45 |
portante | I think I left that off | 20:45 |
acoles | yes. --os-region <wotever> | 20:46 |
portante | okay, sec | 20:46 |
portante | how do admins use this? | 20:46 |
portante | I cannot get over how complicated and involved all this is | 20:46 |
portante | what have we engineered? | 20:46 |
acoles | lots of gumballs | 20:46 |
*** tsg has quit IRC | 20:47 | |
notmyname | y'all are working on keystone integration? is that the "complicated and involved" thing? | 20:47 |
acoles | those examples were for swift running in devstack, so only one region. right at the bottom of that wiki is example with --os-region to select the endpoint for your saio | 20:47 |
acoles | notmyname: keystone disintegration | 20:48 |
acoles | ;) | 20:48 |
notmyname | acoles: :-) | 20:48 |
notmyname | acoles: thanks for working late at night on it | 20:49 |
*** LarsN has left #openstack-swift | 20:49 | |
acoles | notmyname: k. i have 7 hours before i leave the internet behind for a while :) | 20:49 |
portante | acoles, I'll suffer through the rest of this to see if I can verify | 20:50 |
notmyname | acoles: wow. that's a rough vacation. leaving work I get. leaving the internet. that's a serious commitment in today's world ;-) | 20:51 |
acoles | portante: so what you have when swift authenticates with keystone it is now returning a token plus catalog with two swift endpoints - one in the devstack Region and one in the region you setup for your saio | 20:51 |
* notmyname will stop distracting now | 20:52 | |
acoles | portante: swift will choose the first one it parses unless you pass in --os-region (thats not new behavior) | 20:52 |
acoles | portante: we#re just using the region here to integrate in your saio, nothing to do with v 3 | 20:54 |
acoles | notmyname: i exaggerate ;) | 20:55 |
portante | okay, I am going to try that now ... | 20:56 |
portante | okay, acoles, got the python swift client to use the right region and have the newly created container show up | 21:02 |
portante | but how do I get the openstack client to do the same, or do we not care and declare victory here? | 21:02 |
* acoles secretly doesn't care | 21:03 | |
acoles | portante: thats a great question !) let me take a look... | 21:03 |
* portante won't tell anybody | 21:03 | |
*** Midnightmyth has quit IRC | 21:04 | |
acoles | btw i'd say 'more gumballs' but peluse will get jealous | 21:04 |
portante | he better keep up! | 21:04 |
portante | okay, can't run the python-swiftclient functional tests, says "ImportError: No module named testrepository", end of the day, though another problem to solve tomorrow. | 21:09 |
portante | acoles: thanks for your help and guidance | 21:09 |
acoles | portante: hmm, not seen that one. ok, thanks for sticking with it. If the patch needs any straightforward changes please feel free to push over in my absence and i'm sure peluse & cschwede_ would review again | 21:12 |
*** __lgw4__ has quit IRC | 21:13 | |
*** tsg has joined #openstack-swift | 21:15 | |
acoles | portante: might just need a 'pip install -r test-requirements.txt' | 21:17 |
acoles | cschwede_ might be able to help re swiftclient functional tests^^ ? | 21:17 |
*** mkollaro1 has quit IRC | 21:19 | |
peluse | acoles: so stupid question (maybe), I don't need to worry about the fact that I only used the default region, regionOne, in my testing right? | 21:23 |
*** tongli has joined #openstack-swift | 21:23 | |
*** mwstorer has joined #openstack-swift | 21:24 | |
*** tong_ has quit IRC | 21:26 | |
acoles | peluse: nope. portante wanted to test against his own saio, thats why we did the region thing. | 21:26 |
peluse | phew :) | 21:30 |
acoles | peluse: but you only get gumballs for using regions ;) | 21:31 |
peluse | sheeeeit | 21:31 |
acoles | no, seriously, the region stuff has nothing to do with the v3 stuff. | 21:31 |
peluse | yeah, that's what I thought so wanted to make sure I wasn't totally missing the forrest for the tress | 21:32 |
peluse | hey, I read that 'reverify no bug' isn't supported anymore and that w/reverify we have to supply a bug # - is that the case? Anyone know? | 21:34 |
*** annegentle has joined #openstack-swift | 21:35 | |
acoles | peluse: i have a vague memory i read that | 21:35 |
peluse | acoles: yeah, its on https://wiki.openstack.org/wiki/GerritJenkinsGit and I ask because tsg has a patch that just keeps getting kicked back and we're sorta at the point of trying a comment like "yeah, recheck or reverify - whatever you need to do just do it" | 21:37 |
notmyname | peluse: yes, that's the case. however, since all things go in to the check queue first, it's possible to "recheck no bug" and it will actually still make it all the way through the gate queue | 21:39 |
*** annegentle has quit IRC | 21:39 | |
peluse | torgomatic: might be that I've had too much cold medicine today but man your PUT patch is making my head spin :) Will try to step through a few of the parts that aren't adding up for me but may have to pick your brain a bit... | 21:40 |
peluse | notmyname: cool, thanks. that's what I've been using when I know for sure its not something in the patch (well, as for sure as can be) | 21:40 |
tsg | notmyname: any ideas why the TestProfileMiddleware keep failing though? | 21:40 |
torgomatic | peluse: don't blame the medicine, it's entirely possible I goofed it up hard :) | 21:40 |
tsg | notmyname: I haven't been able to reproduce it locally at all | 21:40 |
peluse | tsg: ditto, runs fine for me locally too and its has passed a few times on Jenkins, seems like the pass rate is like 1 in 10 though | 21:41 |
notmyname | tsg: which patch? | 21:41 |
tsg | view.openstack.org/#/c/103644 | 21:41 |
tsg | review.openstack.org/#/c/103644 | 21:41 |
tsg | the EC policy patch | 21:41 |
tsg | notmyname: it has passed the check a few times .. but then it fails in verify | 21:42 |
peluse | is there an echo in here? | 21:42 |
notmyname | ah, interesting | 21:42 |
tsg | peluse, "echo"? :) | 21:43 |
notmyname | ok, so somethign on the swift unit tests is somethign that needs to be investigated on our end and fixed. there's a very low false negative rate there (granted, this still could be a false negative) | 21:43 |
peluse | yeah, looks like it just passed the check | 21:44 |
tsg | notmyname: I ran the profile test about 100 times in a row today, passes every single time | 21:44 |
tsg | notmyname: looking for ideas to try | 21:44 |
peluse | tsg: if it fails verify and you don't have time to dig in (instrument, fully unserstand the failing test) let me know and I'll look at it too | 21:44 |
notmyname | tsg: hmm...jsut for fun, run the xprofile middleware on your saio and then run `swift-bench --saio` against it. a while back I saw that fail (but didn't have time to look in to it). but maybe there is a system load issue or something else | 21:45 |
notmyname | where "I saw that fail" == swift started spewing tracebacks in the logs for every request | 21:46 |
tsg | notmyname: system load is what I was thinking as well | 21:46 |
*** openstackgerrit has quit IRC | 21:46 | |
tsg | notmyname: does the py27 gate job run in ubuntu 12.04 env? | 21:47 |
notmyname | tsg: I think they upgraded them to trusty | 21:47 |
tsg | ok .. let me set up a Trusty SAIO just to be sure | 21:47 |
*** openstackgerrit has joined #openstack-swift | 21:48 | |
peluse | tsg: I've got one ready to go, I'll fire it up too and let you know | 21:49 |
*** acoles is now known as acoles_away | 21:49 | |
tsg | cool, thanks peluse | 21:49 |
peluse | tsg: oops, I lied its not ready to go. Not as "trusty" as I thought :) Will still give a whirl too though so we have 2 data points | 21:51 |
tsg | :) ok | 21:51 |
*** annegentle has joined #openstack-swift | 21:54 | |
*** jergerber has joined #openstack-swift | 21:57 | |
notmyname | FYI DefCore is recommending to the BoD that Swift isn't a designated section of OpenStack. that is, swift's code does not matter when determining trademark protection for the openstack brand | 22:01 |
notmyname | http://lists.openstack.org/pipermail/defcore-committee/2014-August/000281.html | 22:01 |
notmyname | IOW, the proposal means that you can use any codebase or commercial product you want, as long as it claims "swift API support" and that's perfectly ok for OpenStack trademark usage | 22:02 |
*** annegentle has quit IRC | 22:10 | |
*** NM has quit IRC | 22:17 | |
*** kevinc_ has quit IRC | 22:18 | |
mattoliverau | Morning | 22:19 |
*** kevinc_ has joined #openstack-swift | 22:20 | |
*** kevinc_ has quit IRC | 22:21 | |
*** kevinc_ has joined #openstack-swift | 22:21 | |
notmyname | mattoliverau: hi | 22:21 |
*** dmsimard is now known as dmsimard_away | 22:29 | |
peluse | tsg: ran the unit tests for test_xprofile.py 100x on trusty SAIO, no issues here | 22:40 |
tsg | peluse: same experience here, can you also try to load the machine with swift-bench | 22:41 |
tsg | peluse: trying now myself also .. just had a long chat with yuan on the trailer patch and eventlet changes | 22:42 |
*** annegentle has joined #openstack-swift | 23:05 | |
tsg | peluse: even with swift-bench, no failures over 100 runs | 23:06 |
tsg | peluse, notmyname: the ec policy patch passed both check and gate today! | 23:09 |
tsg | https://jenkins04.openstack.org/job/gate-swift-python27/1037/ | 23:09 |
tsg | just when we were to get it to fail .. :) | 23:09 |
*** annegentle has quit IRC | 23:10 | |
peluse | yeah, I almost had it root caused over here :) | 23:22 |
peluse | tsg: you mean the common failing test passed right? looks like its still in the gate with that one success but several others still running (that could fail for non-swift reason). Hope I didn't just jinx it | 23:23 |
*** marcusvrn has quit IRC | 23:41 | |
tsg | peluse: yeah I realized :( so far so good | 23:42 |
*** kevinc_ has quit IRC | 23:47 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!