openstackgerrit | Tim Burke proposed openstack/swift master: Add pipeline modification test for previously-recommended pipelines https://review.openstack.org/532360 | 00:00 |
---|---|---|
timburke | whoops -- included a swiftstack tag accidentally | 00:01 |
openstackgerrit | Tim Burke proposed openstack/swift master: Add pipeline modification test for previously-recommended pipelines https://review.openstack.org/532360 | 00:10 |
timburke | ...which in turn caused me to think there was an extra change in pipelines... | 00:10 |
*** kei_yama has quit IRC | 00:11 | |
*** JimCheung has quit IRC | 00:19 | |
*** JimCheung has joined #openstack-swift | 00:20 | |
*** vint_bra has joined #openstack-swift | 00:25 | |
openstackgerrit | Samuel Merritt proposed openstack/swift master: proxy: make the right number of container updates https://review.openstack.org/531527 | 00:34 |
openstackgerrit | Samuel Merritt proposed openstack/swift master: Limit object-expirer queue updates on object DELETE, PUT, POST https://review.openstack.org/532342 | 00:34 |
*** andymccr has quit IRC | 00:36 | |
*** andymccr has joined #openstack-swift | 00:40 | |
notmyname | kota_: would you have a chance to look at https://review.openstack.org/#/c/365371/ today (or soon)? | 00:42 |
patchbot | patch 365371 - swift - Add support for data segments to SLO and Segmented... | 00:42 |
*** corvus has quit IRC | 00:44 | |
*** tovin07_ has joined #openstack-swift | 00:44 | |
*** andymccr has quit IRC | 00:51 | |
*** JimCheung has quit IRC | 00:54 | |
*** JimCheung has joined #openstack-swift | 00:54 | |
*** andymccr has joined #openstack-swift | 00:55 | |
*** JimCheung has quit IRC | 00:58 | |
*** awkwardpenguin has joined #openstack-swift | 01:07 | |
*** awkwardpenguin has quit IRC | 01:11 | |
kota_ | notmyname: will do today | 01:13 |
*** fishbone_ has joined #openstack-swift | 01:24 | |
*** JimCheung has joined #openstack-swift | 01:26 | |
*** JimCheung has quit IRC | 01:30 | |
fishbone_ | hello all, can anyone help me, I'm receiving an error on the proxy server Unable to validate token: Identity server rejected authorization necessary to fetch token data | 01:36 |
fishbone_ | Identity response: {"error": {"message": "The request you have made requires authentication.", "code": 401, "title": "Unauthorized"}} | 01:36 |
fishbone_ | X.X.X.X X.X.X.X 10/Jan/2018/01/33/38 HEAD /v1/AUTH_75e4b7c8c5b8484daf7da7b249dc53aa HTTP/1.0 503 | 01:37 |
fishbone_ | the X ip address is incorrect, I do not see a directive for setting the proxy server IP | 01:37 |
fishbone_ | I think that's where my issue lies | 01:37 |
fishbone_ | I did set the bind host directive but it doesn't change this error | 01:37 |
*** d0ugal has quit IRC | 01:43 | |
*** m_kazuhiro has joined #openstack-swift | 01:50 | |
m_kazuhiro | good morning | 01:50 |
mattoliverau | m_kazuhiro: morning | 01:53 |
mattoliverau | fishbone_: what authentication are you using? keystone? if so check your keystone log, looks like an auth problem. | 01:54 |
m_kazuhiro | mattoliverau: morning! Thank you for your +2 to my internal client patch. | 01:54 |
mattoliverau | m_kazuhiro: no problem. plan to look closer at the general task queue today. But been caught up in non swift stuff this morning at work. | 01:54 |
m_kazuhiro | mattoliverau: ok! | 01:55 |
*** two_tired has joined #openstack-swift | 01:58 | |
fishbone_ | thanks +mattoliverau for your reply the error i get is Authorization failed. The request you have made requires authentication. from 192.168.1.31: Unauthorized: The request you have made requires authentication. | 02:01 |
fishbone_ | I wonder if my proxy server auth settings are icorrect | 02:01 |
*** d0ugal has joined #openstack-swift | 02:01 | |
mattoliverau | fishbone_: could be. hard to say. Are you using keystone for authentication? | 02:02 |
fishbone_ | +mattoliverau: I followed documentation, do I need to specify the auth version in the conf file? | 02:02 |
fishbone_ | +mattoliverau: yes it is keystone | 02:02 |
fishbone_ | that was the keystone log that pulled that last error | 02:02 |
*** two_tired has quit IRC | 02:02 | |
*** vint_bra has quit IRC | 02:04 | |
mattoliverau | oh ok. Then you at least pointing to keystone. Is the user your using a member of any of the operator_roles you defined in the proxy.conf (in keystone). | 02:05 |
mattoliverau | *proxy-server.conf | 02:05 |
mattoliverau | let me rephrase that. In the Swift proxy-server.conf you defined operator_roles that match to keystone roles. Is your user a member of one of those roles in keystone? | 02:08 |
fishbone_ | +mattoliverau: ahh I see, I will verify that right away | 02:09 |
fishbone_ | +mattoliverau: thanks a lot I overlooked adding the role, although now it's saying that it cannot find the project named service, which is there | 02:22 |
*** jeblair has joined #openstack-swift | 02:24 | |
fishbone_ | +mattoliverau: my apologies, I cleared that error, now I am getting Account HEAD failed: http://controller:8080/v1/AUTH_75e4b7c8c5b8484daf7da7b249dc53aa 400 Bad Request | 02:28 |
*** two_tired has joined #openstack-swift | 02:32 | |
*** two_tired has quit IRC | 02:36 | |
*** two_tired has joined #openstack-swift | 02:38 | |
mattoliverau | fishbone_: have you set | 02:58 |
mattoliverau | account_autocreate = true in swift-proxy.conf? | 02:58 |
fishbone_ | +mattoliverau: Yes that is set to true | 03:02 |
*** awkwardpenguin has joined #openstack-swift | 03:09 | |
*** awkwardpenguin has quit IRC | 03:14 | |
fishbone_ | +mattoliverau: might it be this? account-replicator: Skipping /dev/vdb as it is not mounted | 03:22 |
fishbone_ | I've been ignoring those errors as the drives are clearly mounted and acessible via the storage nodes | 03:23 |
fishbone_ | but I am getting those errors for all drives | 03:23 |
openstackgerrit | Samuel Merritt proposed openstack/swift master: Limit object-expirer queue updates on object DELETE, PUT, POST https://review.openstack.org/532342 | 03:29 |
openstackgerrit | Samuel Merritt proposed openstack/swift master: Don't make async_pendings during object expiration https://review.openstack.org/532383 | 03:29 |
*** jistr has quit IRC | 03:31 | |
mattoliverau | fishbone_: ok, any errors in your account-server log? | 03:38 |
fishbone_ | +mattoliverau I didn't know there was one, I've been using syslog, where would I find that log? | 03:39 |
mattoliverau | fishbone_: depends where you set it up. if the proxy is syslogging so shouhld the account-server. | 03:39 |
mattoliverau | also, it's you said its skipping /dev/vdb.. that sounds like your pointing to actauly devices, not a devices mount point in your rings. | 03:40 |
*** jeblair has joined #openstack-swift | 03:40 | |
mattoliverau | So you should mount all your devices somethere say, /mnt/vdb /mnt/vdc etc.. the devices mounted with xfs. | 03:41 |
mattoliverau | then your rings should point at these locations. ie. your devices in config files would (in this example) be /mnt and your devices in the ring could be named vdb (path from devices). | 03:42 |
mattoliverau | also make sure the swift user (or whatever user your running the swift daemons as) has access/permissions on these mount points | 03:43 |
mattoliverau | fishbone_: ^ | 03:43 |
fishbone_ | ah yes +mattoliverau, the only errors I see are the mount errors, I see the devices mounted in /srv/node as per documentation | 03:43 |
mattoliverau | cool | 03:43 |
mattoliverau | just double checking :) | 03:44 |
fishbone_ | +mattolivera: thanks, I have a snippet of my errors here: http://paste.openstack.org/show/641850/ | 03:44 |
fishbone_ | +mattolivera: I even tried remounting them and rebooting but those errors show, I ignored them because the mounts are accessible as far as I can see | 03:45 |
fishbone_ | +mattolivera, also yes they do have full permissions set | 03:52 |
mattoliverau | fishbone_: any chance you can show me your account ring? paste.o.o the output of 'swift-ring-builder /etc/swift/account.builder | 03:53 |
mattoliverau | or whatever the path to your account builder is | 03:53 |
fishbone_ | +mattoliverau sure http://paste.openstack.org/show/641865/ thanks for all of your help | 03:59 |
fishbone_ | +mattoliverau: I followed the openstack documentation on this and it mentioned to pull the gz files from the proxy and replicate them to the storage nodes, did I have to do that for the .builder files as well? | 04:00 |
mattoliverau | fishbone_: no you don't have to. but when you edit your rings, you'll edit the builder files and then generate rings so back em up :) | 04:00 |
mattoliverau | fishbone_: ok so you've pointed directly to the devices in the account ring. what is the 'devices' in your account-server.conf? | 04:01 |
fishbone_ | +mattoliverau: ahh, I see that now | 04:02 |
fishbone_ | In the conf it is /srv/node | 04:02 |
mattoliverau | it seems your object ring is correct. so just a mistake there I suspect | 04:02 |
mattoliverau | cool, do mount points I assume are vdb and xdc under /srv/node which means in your ring you just need to point to vdb vdc. | 04:03 |
fishbone_ | +mattoliverau, hmmm, it seems I pointed to /srv/node in the mount point itself and all config files, any reason why the ring would point to /dev/ ? | 04:04 |
mattoliverau | it shouldn't | 04:04 |
mattoliverau | unless you told it to when putting adding the device | 04:04 |
mattoliverau | what does your object.builder say? | 04:04 |
fishbone_ | +mattoliverau, that one omits the /dev/ prefix, maybe I made a mistake creating the account.builder, I will try to recreate it | 04:06 |
fishbone_ | +mattoliverau: thanks for everything, I will let you know if this works out, it seems like it will | 04:07 |
mattoliverau | fishbone_: please do and good luck. Have fun with Swift and if you are still stuck just ask :) | 04:08 |
mattoliverau | fishbone_: oh, and which documentation where you using (in case creating the account ring is incorrect there)? | 04:09 |
fishbone_ | +mattoliverau: I m using from the opnestack website https://docs.openstack.org/swift/pike/install/initial-rings.html I checked my bash history, I definitely fat fingered this one the docs are solid | 04:10 |
mattoliverau | sweet, good to know :) | 04:11 |
*** jeblair has joined #openstack-swift | 04:12 | |
fishbone_ | +mattoliverau: all works now, thanks again! | 04:19 |
mattoliverau | fishbone_: awesome! | 04:22 |
*** jeblair has quit IRC | 04:24 | |
*** JimCheung has joined #openstack-swift | 04:28 | |
*** JimCheung has quit IRC | 04:32 | |
*** m_kazuhiro_ has joined #openstack-swift | 04:33 | |
*** fishbone_ has quit IRC | 04:36 | |
*** m_kazuhiro has quit IRC | 04:36 | |
*** links has joined #openstack-swift | 04:37 | |
*** itlinux has quit IRC | 04:39 | |
*** links has quit IRC | 04:40 | |
*** links has joined #openstack-swift | 04:46 | |
*** two_tired has quit IRC | 05:00 | |
*** hoonetorg has quit IRC | 05:00 | |
*** awkwardpenguin has joined #openstack-swift | 05:11 | |
*** hoonetorg has joined #openstack-swift | 05:14 | |
*** jeblair has joined #openstack-swift | 05:14 | |
*** awkwardpenguin has quit IRC | 05:16 | |
*** jeblair has quit IRC | 05:20 | |
*** jeblair has joined #openstack-swift | 05:21 | |
*** jeblair is now known as corvus | 05:21 | |
*** gyee has quit IRC | 05:36 | |
*** psachin has joined #openstack-swift | 05:40 | |
*** pcaruana has joined #openstack-swift | 06:27 | |
*** pcaruana has quit IRC | 06:33 | |
*** pcaruana has joined #openstack-swift | 06:34 | |
*** awkwardpenguin has joined #openstack-swift | 06:37 | |
*** awkwardpenguin has quit IRC | 06:42 | |
*** nakagawamsa has joined #openstack-swift | 06:44 | |
*** awkwardpenguin has joined #openstack-swift | 07:00 | |
*** awkwardpenguin has quit IRC | 07:06 | |
*** rcernin has quit IRC | 07:15 | |
*** m_kazuhiro_ has quit IRC | 07:24 | |
*** m_kazuhiro has joined #openstack-swift | 07:24 | |
*** armaan has joined #openstack-swift | 07:30 | |
*** m_kazuhiro has quit IRC | 07:35 | |
*** threestrands has quit IRC | 07:36 | |
*** hoonetorg has quit IRC | 07:50 | |
*** gkadam has joined #openstack-swift | 08:04 | |
*** hoonetorg has joined #openstack-swift | 08:07 | |
*** hseipp has joined #openstack-swift | 08:12 | |
*** tesseract has joined #openstack-swift | 08:14 | |
*** geaaru has joined #openstack-swift | 08:25 | |
*** kei_yama has joined #openstack-swift | 08:30 | |
*** cshastri has joined #openstack-swift | 08:34 | |
*** ianychoi has quit IRC | 08:35 | |
*** hseipp has quit IRC | 08:47 | |
*** hseipp has joined #openstack-swift | 08:49 | |
*** kei_yama has quit IRC | 08:52 | |
*** cbartz has joined #openstack-swift | 08:56 | |
*** jistr has joined #openstack-swift | 08:57 | |
*** awkwardpenguin has joined #openstack-swift | 09:02 | |
*** awkwardpenguin has quit IRC | 09:07 | |
*** tovin07_ has quit IRC | 09:32 | |
acoles | good morning | 09:38 |
*** threestrands has joined #openstack-swift | 10:21 | |
openstackgerrit | Christian Schwede proposed openstack/swift master: Fix exception raise in swift-ring-builder on empty rings https://review.openstack.org/532482 | 10:25 |
openstackgerrit | Christian Schwede proposed openstack/swift master: Change exit code when displaying empty rings https://review.openstack.org/532484 | 10:36 |
*** zaitcev_ has joined #openstack-swift | 10:49 | |
*** ChanServ sets mode: +v zaitcev_ | 10:49 | |
*** zaitcev has quit IRC | 10:53 | |
*** awkwardpenguin has joined #openstack-swift | 11:04 | |
*** awkwardpenguin has quit IRC | 11:09 | |
openstackgerrit | Kazuhiro MIYAHARA proposed openstack/swift master: WIP: Update object expirer to use general task queue system https://review.openstack.org/517389 | 11:15 |
*** vint_bra has joined #openstack-swift | 11:17 | |
kota_ | good morning acoles | 11:30 |
acoles | kota_: o/ | 11:30 |
kota_ | and then, it's time to leave my office ;) | 11:30 |
acoles | kota_: goodnight :) | 11:30 |
*** armaan has quit IRC | 11:33 | |
*** armaan has joined #openstack-swift | 11:33 | |
*** armaan has quit IRC | 11:34 | |
*** armaan has joined #openstack-swift | 11:34 | |
*** d0ugal has quit IRC | 11:39 | |
*** vint_bra has quit IRC | 11:43 | |
*** m_kazuhiro has joined #openstack-swift | 11:53 | |
*** m_kazuhiro has quit IRC | 11:55 | |
*** d0ugal has joined #openstack-swift | 11:57 | |
*** links has quit IRC | 12:58 | |
*** hseipp has quit IRC | 13:01 | |
*** awkwardpenguin has joined #openstack-swift | 13:06 | |
*** awkwardpenguin has quit IRC | 13:11 | |
*** mvk has quit IRC | 13:14 | |
*** awkwardpenguin has joined #openstack-swift | 13:46 | |
*** awkwardpenguin has quit IRC | 13:54 | |
*** awkwardpenguin has joined #openstack-swift | 13:57 | |
*** armaan has quit IRC | 14:00 | |
*** armaan has joined #openstack-swift | 14:01 | |
*** mvk has joined #openstack-swift | 14:22 | |
openstackgerrit | Thiago da Silva proposed openstack/swift feature/s3api: WIP: merge func tests https://review.openstack.org/532545 | 14:48 |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Test that all object methods get shard container update headers https://review.openstack.org/532549 | 14:55 |
tdasilva | mathiasb: hello, wondering if you have tested swift+barbican integration recently... | 14:56 |
-openstackstatus- NOTICE: Gerrit is being restarted due to slowness and to apply kernel patches | 14:59 | |
*** openstackgerrit has quit IRC | 15:01 | |
*** ianychoi has joined #openstack-swift | 15:14 | |
mathiasb | tdasilva: hi! I ran some tests with devstack against the pike stable branches in november, but nothing more recent than that | 15:21 |
*** aluria has quit IRC | 15:22 | |
*** aluria has joined #openstack-swift | 15:22 | |
*** psachin has quit IRC | 15:22 | |
tdasilva | mathiasb: ack, trying to deploy now and i'm running into some errors. I *think* castellan might have broken their api but i could be wrong, investigating... | 15:24 |
tdasilva | mathiasb: i'm looking at this change: https://github.com/openstack/castellan/commit/17e8b29067e93dbe5f13d0d18e62b06fcd148d3f | 15:24 |
tdasilva | but i guess you would have run into this problem with pike... | 15:25 |
mathiasb | hm, that does somehow ring a bell | 15:30 |
mathiasb | I'll try to set up my dev env from scratch and see what happens | 15:31 |
tdasilva | mathiasb: cool, thanks! I tried making a change here https://github.com/openstack/swift/blob/master/swift/common/middleware/crypto/kms_keymaster.py#L61 | 15:32 |
tdasilva | to pass auth_endpoint as part of the context | 15:32 |
tdasilva | but now i'm running into some other issue that resembles this https://bugs.launchpad.net/swift/+bug/1662473 :/ | 15:33 |
openstack | Launchpad bug 1662473 in OpenStack Object Storage (swift) "get internal error when try authenticate by keystone. " [Undecided,Invalid] | 15:33 |
tdasilva | so i'm still digging... | 15:33 |
notmyname | good morning | 15:34 |
notmyname | cschwede: I put https://bugs.launchpad.net/swift/+bug/1742417 on the meeting agenda for today | 15:42 |
openstack | Launchpad bug 1742417 in OpenStack Object Storage (swift) "swift-ring-builder exit code changed from 0 to 1 for empty rings" [Undecided,New] | 15:42 |
*** awkwardpenguin has quit IRC | 15:52 | |
*** awkwardpenguin has joined #openstack-swift | 15:54 | |
*** awkwardpenguin has quit IRC | 15:56 | |
cschwede | notmyname: alright, thx! I'll try to join the meeting then :) | 15:59 |
notmyname | cschwede: ok. I'll cover that one first, then, since it will be late for you | 15:59 |
cschwede | notmyname: :D thanks! | 15:59 |
*** awkwardpenguin has joined #openstack-swift | 16:00 | |
*** itlinux has joined #openstack-swift | 16:09 | |
* tdasilva is wondering why there's a object-store and object-storage path in the api docs: https://developer.openstack.org/api-ref/ | 16:17 | |
notmyname | tdasilva: oh weird. looks like maybe something changed about 6 months ago? last time the object-storage was updated | 16:19 |
notmyname | interesting. there's also a "shared-file-systems" and "shared-file-system" with the same dates | 16:20 |
tdasilva | notmyname: yeah, noticed that too... | 16:21 |
*** armaan has quit IRC | 16:27 | |
*** armaan has joined #openstack-swift | 16:28 | |
*** armaan has quit IRC | 16:28 | |
*** armaan has joined #openstack-swift | 16:28 | |
notmyname | tdasilva: ok. there's at least an answer :-) | 16:39 |
tdasilva | notmyname: yeah, probably a typo in some automation procedure | 16:40 |
*** d0ugal has quit IRC | 16:46 | |
*** awkwardpenguin has quit IRC | 16:50 | |
*** clarkb has quit IRC | 16:53 | |
*** gyee has joined #openstack-swift | 16:54 | |
clayg | did cschwede get his ring-builder error code sorted? | 17:07 |
*** hseipp has joined #openstack-swift | 17:09 | |
*** pcaruana has quit IRC | 17:11 | |
*** saint_ has joined #openstack-swift | 17:11 | |
*** awkwardpenguin has joined #openstack-swift | 17:12 | |
zaitcev_ | clayg: I just put -1 to it, but I may be deeply ignorant about the intent of the current code | 17:16 |
zaitcev_ | I mean the one where you catch that exception | 17:16 |
zaitcev_ | Er, where you catch _other_ exceptions, throw RingEmpty exception, catch that one again | 17:17 |
*** JimCheung has joined #openstack-swift | 17:17 | |
clayg | zaitcev_: too bad, seemed the regression would indeed be unfortunate/unintentional/problematic... hopefully we can get it sussed out - thanks for looking at! | 17:17 |
zaitcev_ | I think the problem is that things like Tripple-O run the builder thoughtlessly in order to display the current ring status even if it's empty, and then your whole cloud deployment blows up because builder exits with an error. | 17:18 |
zaitcev_ | But that is merely my deduction, I don't know why cschwede needed that fix. | 17:19 |
* zaitcev_ puts his Sherlock hat on | 17:19 | |
*** awkwardpenguin has quit IRC | 17:22 | |
*** cbartz has quit IRC | 17:23 | |
*** awkwardpenguin has joined #openstack-swift | 17:29 | |
*** openstackgerrit has joined #openstack-swift | 17:34 | |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Add includes method to ShardRange https://review.openstack.org/530901 | 17:34 |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: fixes for sharding/shrinking races https://review.openstack.org/529931 | 17:34 |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Re-introduce shard range updates to root after shard has sharded https://review.openstack.org/530902 | 17:34 |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Add copy method to ShardRange https://review.openstack.org/531486 | 17:34 |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Define entries of shard range db row in one place https://review.openstack.org/531487 | 17:34 |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Add state and state_timestamp to ShardRange https://review.openstack.org/531488 | 17:34 |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Set shard range state during sharding https://review.openstack.org/531489 | 17:34 |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Fix container listing while in sharding state https://review.openstack.org/532308 | 17:34 |
*** itlinux has quit IRC | 17:35 | |
clayg | wait... did we not merge mattoliverau 's fix for this yet? | 17:40 |
*** awkwardpenguin has quit IRC | 17:40 | |
clayg | patch 530839 ZuuuuuUUUUUUUULLLLL!!! | 17:41 |
patchbot | https://review.openstack.org/#/c/530839/ - swift - Show devices marked as deleted on empty rings | 17:41 |
*** itlinux has joined #openstack-swift | 17:41 | |
clayg | ^ cschwede zaitcev_ I think this change gets things going in the right direction | 17:42 |
*** awkwardpenguin has joined #openstack-swift | 17:45 | |
*** gkadam has quit IRC | 17:47 | |
*** armaan has quit IRC | 17:47 | |
*** armaan has joined #openstack-swift | 17:48 | |
*** cshastri has quit IRC | 17:51 | |
timburke | sooo muuuch faaaiiiil | 17:52 |
timburke | what in the world is *this* about? http://logs.openstack.org/84/532484/1/check/openstack-tox-pep8/b4a463c/job-output.txt.gz#_2018-01-10_10_44_22_787199 | 17:52 |
acoles | p 532484 | 17:55 |
patchbot | https://review.openstack.org/#/c/532484/ - swift - Change exit code when displaying empty rings | 17:55 |
timburke | > TASK [tox : Run tox without tests] | 17:56 |
timburke | > pep8: skipped tests | 17:56 |
timburke | > congratulations :) | 17:56 |
timburke | i didn't know that smiley could be so... sarcastic | 17:57 |
acoles | timburke: lol. it should have tongue in cheek | 17:57 |
acoles | timburke: reminds me of the performance review line 'this employee succeeds at everything they attempt' | 18:02 |
*** chsc has joined #openstack-swift | 18:02 | |
timburke | huh. apparently it's *supposed* to do that? http://logs.openstack.org/47/531447/2/check/swift-tox-py27/4e7a7c7/job-output.txt.gz#_2018-01-09_19_32_08_331823 for example passed just fine | 18:07 |
timburke | i guess the real trouble is the MODULE FAILURE at http://logs.openstack.org/84/532484/1/check/openstack-tox-pep8/b4a463c/job-output.txt.gz#_2018-01-10_10_44_55_523679 | 18:08 |
timburke | i have *no idea* where ARA found this, but apparently the trouble is "RuntimeError: pip python module is required" | 18:09 |
timburke | or, was? looks like at least *some* recently-enqueued jobs are on track to pass | 18:10 |
*** geaaru has quit IRC | 18:15 | |
*** awkwardpenguin has quit IRC | 18:16 | |
*** awkwardpenguin has joined #openstack-swift | 18:19 | |
*** openstack has joined #openstack-swift | 18:31 | |
*** ChanServ sets mode: +o openstack | 18:31 | |
openstackgerrit | Samuel Merritt proposed openstack/swift master: Fix object POST of X-Delete-At with skewed clocks https://review.openstack.org/532595 | 18:35 |
*** tesseract has quit IRC | 18:36 | |
*** awkwardpenguin has quit IRC | 18:55 | |
*** mvk has quit IRC | 18:57 | |
openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: WIP Don't attempt to merge root and shard listings in proxy https://review.openstack.org/532604 | 19:00 |
*** mvk has joined #openstack-swift | 19:33 | |
openstackgerrit | Christian Schwede proposed openstack/swift master: Change exit code when displaying empty rings https://review.openstack.org/532484 | 19:50 |
cschwede | clayg, timburke, zaitcev_: thx for the pointers re swift-ring-builder return code/exception fixes - i abandoned one of my proposals and rebased the other one on top of Matts patch | 19:53 |
timburke | so much interest in ring-builder usability lately! it's great! | 19:54 |
zaitcev_ | cschwede: I only wanted you to have a look if it's reasonable to return error where we crashed before. Like timburke mentioned that was accidentally undefined. If clayg et al like 0 everywhere, I am fine with that. | 19:54 |
zaitcev_ | enthropy grows where you throw information away by returning the same thing for different situations | 19:55 |
zaitcev_ | kinda | 19:55 |
timburke | especially in light of mattoliverau's change so you can see the devices that were removed, i feel like 0 is fair | 19:57 |
acoles | mattoliverau: timburke: re ^^ I have been thinking about simplifying listings-while-sharding rather than taking on fixing the merge logic in the proxy, notes here https://etherpad.openstack.org/p/deep-container-listing | 19:57 |
acoles | cc clayg ^ | 19:57 |
*** awkwardpenguin has joined #openstack-swift | 20:00 | |
acoles | mattoliverau: when I say simplify I mean start with simpler and work towards full feature | 20:01 |
acoles | which I'm hoping will help my small brain grok and the simpler system and make it really robust before we add more complex pieces back in | 20:02 |
acoles | cc torgomatic https://etherpad.openstack.org/p/deep-container-listing | 20:07 |
*** awkwardpenguin has quit IRC | 20:09 | |
*** m_kazuhiro has joined #openstack-swift | 20:41 | |
m_kazuhiro | good morning | 20:42 |
*** joeljwright has joined #openstack-swift | 20:44 | |
*** ChanServ sets mode: +v joeljwright | 20:44 | |
*** Jeffrey4l has quit IRC | 20:52 | |
kota_ | morning | 20:53 |
m_kazuhiro | kota_: mornning | 20:55 |
kota_ | m_kazuhiro: hi | 20:56 |
clayg | torgomatic: patch 532595 seems less critical than a fix to not create async_pendings to update the expiring_objects queue when the expirer expires an object?! | 20:59 |
patchbot | https://review.openstack.org/#/c/532595/ - swift - Fix object POST of X-Delete-At with skewed clocks | 20:59 |
clayg | torgomatic: unless you already fixed that too | 20:59 |
mattoliverau | morning | 20:59 |
notmyname | swift team meeting time in #openstack-meeting | 21:00 |
mattoliverau | acoles: I'll give the etherpad another read today | 21:00 |
mathiasb | tdasilva: with devstack pike, swift master, and castellan==0.7.0 it seems to work | 21:00 |
tdasilva | mathiasb: one sec | 21:01 |
mathiasb | tdasilva: but with e.g., the newest castellan I do see some errors (not the same one(s) as you though I think) | 21:01 |
tdasilva | mathiasb: ah ok | 21:01 |
tdasilva | i was about to check which castellan I was running | 21:02 |
tdasilva | mathiasb: curious what errors you are running into | 21:02 |
*** Jeffrey4l has joined #openstack-swift | 21:03 | |
mathiasb | ERROR castellan KeyManagerError: Key manager error: 'NoneType' object has no attribute 'find' | 21:04 |
tdasilva | mathiasb: yeah, that was the original error i ran into... | 21:04 |
mathiasb | ah ok, so at least we're probably reproducing the same issue | 21:05 |
tdasilva | mathiasb: or at least similar one | 21:05 |
tdasilva | mathiasb: and I tracked that down to castellan trying to deprecate something, but actually breaking it | 21:05 |
tdasilva | mathiasb: i think it's this change: https://github.com/openstack/castellan/commit/17e8b29067e93dbe5f13d0d18e62b06fcd148d3f | 21:06 |
tdasilva | especifically here: https://github.com/openstack/castellan/commit/17e8b29067e93dbe5f13d0d18e62b06fcd148d3f#diff-fcc75db260ca67948ab5bab26daf7eeeL137 | 21:07 |
*** zaitcev_ is now known as zaitcev | 21:12 | |
tdasilva | mathiasb: wondering if you could test out a fix I had and see if you run into another problem i'm now running into?? | 21:15 |
torgomatic | clayg: I already fixed that too :) see patch 532383 | 21:16 |
patchbot | https://review.openstack.org/#/c/532383/ - swift - Don't make async_pendings during object expiration | 21:16 |
clayg | *phew* | 21:16 |
mathiasb | tdasilva: of course! | 21:16 |
clayg | ok, you're just scraping the bottom of the barrel now - you can't fix ALL the things :P | 21:16 |
tdasilva | mathiasb: one sec | 21:17 |
tdasilva | mathiasb: https://paste.fedoraproject.org/paste/sW4eUx4oRnsr9bvYoDYaIA | 21:19 |
mathiasb | tdasilva: yes, if I also add 'auth_endpoint = http://<keystone_host>/identity' to the [kms_keymaster] section in the proxy conf then it works! | 21:28 |
tdasilva | mathiasb: without code changes? | 21:29 |
mathiasb | tdasilva: with you patch | 21:29 |
mathiasb | let me try without.. | 21:29 |
tdasilva | ah ok | 21:30 |
tdasilva | mathiasb: can you also tell me what requests and urllib3 package versions you are running? | 21:30 |
mathiasb | no, without the patch I still get the same error | 21:30 |
mathiasb | tdasilva: requests==2.18.2, urllib3==1.22 | 21:31 |
tdasilva | mathiasb: ah, interesting...with those versions i'm running into an issue similar to this: https://bugs.launchpad.net/swift/+bug/1662473 | 21:34 |
openstack | Launchpad bug 1662473 in OpenStack Object Storage (swift) "get internal error when try authenticate by keystone. " [Undecided,Invalid] | 21:34 |
*** awkwardpenguin has joined #openstack-swift | 21:34 | |
mathiasb | tdasilva: ouch! I am not seeing that | 21:39 |
*** awkwardpenguin has quit IRC | 21:39 | |
*** pcaruana has joined #openstack-swift | 21:42 | |
*** pcaruana has quit IRC | 21:43 | |
*** m_kazuhiro has quit IRC | 21:45 | |
*** dr_gogeta86 has quit IRC | 21:47 | |
*** alecuyer has quit IRC | 21:47 | |
*** rledisez has quit IRC | 21:47 | |
*** armaan has quit IRC | 21:48 | |
*** alecuyer has joined #openstack-swift | 21:51 | |
*** rledisez has joined #openstack-swift | 21:52 | |
*** threestrands_ has joined #openstack-swift | 21:52 | |
*** threestrands_ has quit IRC | 21:52 | |
*** threestrands_ has joined #openstack-swift | 21:52 | |
*** threestrands_ has quit IRC | 21:53 | |
*** threestrands_ has joined #openstack-swift | 21:53 | |
*** threestrands_ has quit IRC | 21:53 | |
*** threestrands_ has joined #openstack-swift | 21:53 | |
*** threestrands has quit IRC | 21:54 | |
clayg | torgomatic: are you around? I'm having problems with the probe test on patch 532383 | 21:56 |
patchbot | https://review.openstack.org/#/c/532383/ - swift - Don't make async_pendings during object expiration | 21:56 |
*** joeljwright has quit IRC | 21:56 | |
notmyname | clayg: he had to step out for a bit. may be back online later this afternoon | 21:57 |
*** armaan has joined #openstack-swift | 22:00 | |
*** awkwardpenguin has joined #openstack-swift | 22:04 | |
zaitcev | I do think that CORS is a supremely annoying specification. | 22:05 |
openstackgerrit | Tim Burke proposed openstack/swift master: Change exit code when displaying empty rings https://review.openstack.org/532484 | 22:08 |
*** rcernin has joined #openstack-swift | 22:11 | |
timburke | it's messy... and if i tried to do it in python, in func tests that we can actually run in the gate, i'd be forever wondering whether we were actually implementing it right. so, use a Real Browser instead | 22:12 |
clayg | timburke: sounds exhausting - i would have given up ages ago I think ;) | 22:13 |
timburke | after sufficient bitching and moaning and eventually you start to get pointed in the direction of good ideas :-) | 22:15 |
timburke | not *great* ideas (i still don't like that i won't be able to add this to the gate in any sensible way :-/), but tenable ones, and things that are somewhat useful | 22:16 |
mattoliverau | timburke: step 1, find a way to really test it. Step 2.. n, make it better. You're working on the most important first step :) | 22:21 |
*** corvus is now known as jeblair | 22:21 | |
*** jeblair is now known as corvus | 22:22 | |
-openstackstatus- NOTICE: The zuul system is being restarted to apply security updates and will be offline for several minutes. It will be restarted and changes re-equeued; changes approved during the downtime will need to be rechecked or re-approved. | 22:24 | |
*** threestrands_ has quit IRC | 22:41 | |
*** threestrands has joined #openstack-swift | 22:55 | |
*** threestrands has quit IRC | 22:55 | |
*** threestrands has joined #openstack-swift | 22:55 | |
*** threestrands has quit IRC | 23:11 | |
*** awkwardpenguin has quit IRC | 23:18 | |
*** threestrands has joined #openstack-swift | 23:20 | |
*** kei_yama has joined #openstack-swift | 23:31 | |
*** chsc has quit IRC | 23:44 | |
openstackgerrit | Clay Gerrard proposed openstack/swift master: Let recon-cron work with conf.d https://review.openstack.org/532696 | 23:53 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!