*** gouthamr has joined #openstack-manila | 00:19 | |
*** wes_dillingham has joined #openstack-manila | 00:46 | |
*** masuberu has joined #openstack-manila | 01:00 | |
*** masber has quit IRC | 01:04 | |
*** junboli has joined #openstack-manila | 01:17 | |
*** kaisers_ has joined #openstack-manila | 01:26 | |
*** kaisers has quit IRC | 01:29 | |
*** masber has joined #openstack-manila | 01:44 | |
*** masuberu has quit IRC | 01:47 | |
*** markstur has quit IRC | 01:56 | |
*** zhiguo has joined #openstack-manila | 02:05 | |
*** masber has quit IRC | 02:19 | |
*** openstackgerrit has joined #openstack-manila | 02:53 | |
openstackgerrit | Merged openstack/manila-specs master: Add count info in /shares and /shares/detail response https://review.openstack.org/501934 | 02:53 |
---|---|---|
openstackgerrit | zhiguo.li proposed openstack/python-manilaclient master: List Share Network: Implement /v2/{tenant_id}/share-networks/detail https://review.openstack.org/511376 | 02:54 |
*** gouthamr has quit IRC | 02:57 | |
*** sapcc-bot1 has joined #openstack-manila | 03:09 | |
*** sapcc-bot has quit IRC | 03:12 | |
*** toabctl has quit IRC | 03:14 | |
openstackgerrit | zhiguo.li proposed openstack/manila master: Fix NoneType error when 'access_mapping' is None https://review.openstack.org/504296 | 03:21 |
*** toabctl has joined #openstack-manila | 03:21 | |
*** arnewiebalck has quit IRC | 04:14 | |
*** zhiguo has quit IRC | 04:36 | |
*** wes_dillingham has quit IRC | 04:40 | |
*** arnewiebalck_ has joined #openstack-manila | 04:49 | |
*** sage__ has quit IRC | 05:15 | |
*** masber has joined #openstack-manila | 05:15 | |
*** sage__ has joined #openstack-manila | 05:16 | |
*** masuberu has joined #openstack-manila | 05:17 | |
*** masber has quit IRC | 05:19 | |
*** hoonetorg has quit IRC | 06:09 | |
*** jprovazn has joined #openstack-manila | 06:09 | |
*** hoonetorg has joined #openstack-manila | 06:25 | |
openstackgerrit | Merged openstack/python-manilaclient master: Add MAPRFS protocol in create help https://review.openstack.org/507454 | 06:32 |
*** kaisers has joined #openstack-manila | 06:41 | |
*** kaisers_ has quit IRC | 06:42 | |
*** zhiguo has joined #openstack-manila | 06:45 | |
*** arnewiebalck_ has quit IRC | 06:51 | |
*** pcaruana has joined #openstack-manila | 06:55 | |
*** markstur has joined #openstack-manila | 07:02 | |
*** markstur has quit IRC | 07:06 | |
masuberu | good afternoon, I got manila installed a couple of days ago and got my first share already setup | 07:10 |
masuberu | now I wanted to extend the share so I first updated my quota and then ran manila extend but the operation ended with an error | 07:11 |
masuberu | I can't find anything in the logs, what can I do? | 07:11 |
masuberu | so the status of the share right now is "extending_error" | 07:12 |
zhongjun | masuberu: Did you open the debug log level? | 07:13 |
zhongjun | masuberu: What is your backend driver? | 07:13 |
zhongjun | masuberu: You could use reset-state command to reset your share status to 'available', then extend again and see what happens. | 07:16 |
masuberu | zhongjun, NFS and ceph as a backend storage | 07:20 |
masuberu | ok, let me reset the status and try again | 07:20 |
masuberu | zhongjun, same issue | 07:23 |
masuberu | zhongjun, yes I did enable the debug logs | 07:23 |
masuberu | so which log file should I be looking at? | 07:23 |
zhongjun | masuberu: you still can not find anything in the logs? | 07:23 |
openstackgerrit | junbo.li proposed openstack/manila master: [Api-ref] update parameters for share types api https://review.openstack.org/506546 | 07:24 |
masuberu | yes I found it | 07:25 |
masuberu | zhongjun, http://paste.openstack.org/raw/624055/ | 07:25 |
zhongjun | masuberu: It looks like we have a bug in translate_volume_exception | 07:38 |
masuberu | ok | 07:39 |
masuberu | zhongjun, are a manila developer? | 07:42 |
zhongjun | masuberu: but it is not the reason of the extend share fail | 07:48 |
zhongjun | masuberu: yes | 07:49 |
masuberu | zhongjun, is has also broken the share, now my vms can't access it now | 07:49 |
zhongjun | masuberu: What's your manila version | 07:49 |
masuberu | zhongjun, 1.17.2 | 07:49 |
masuberu | zhongjun, look the storage folder which is a shared drive http://paste.openstack.org/raw/624056/ | 07:51 |
zhongjun | masuberu: your vms can access before? | 07:52 |
masuberu | zhongjun, yes, that is why I decided to expand the share, because I saw it was running short of space | 07:53 |
*** gcb has quit IRC | 07:55 | |
zhongjun | masuberu: https://github.com/openstack/manila/blob/master/manila/share/drivers/generic.py#L642 | 07:57 |
zhongjun | masuberu: We will umount volume, _detach_volume before we extend volume. So if the extend volume operation is failure, the share is broke | 07:59 |
masuberu | I see | 08:00 |
masuberu | but I umount it and then mount it back | 08:00 |
masuberu | and now it is empty | 08:00 |
zhongjun | you mount it back manually? | 08:02 |
masuberu | zhongjun, sorry it doesn't let me mount it | 08:06 |
masuberu | mount.nfs: access denied by server while mounting 10.254.0.7:/shares/share-b582a372-e82b-49b2-87ff-e8054dd7db05 | 08:06 |
masuberu | zhongjun, yes I mount it manually | 08:06 |
zhongjun | masuberu: It looks like you need to find the real reason about why extend share is fail in https://github.com/openstack/manila/blob/master/manila/volume/cinder.py#L331 | 08:07 |
zhongjun | masuberu: in your environment | 08:08 |
masuberu | oh | 08:08 |
masuberu | ok | 08:08 |
masuberu | ERROR cinder.volume.api [req-357fbd99-f1e3-476f-9f1f-e2443e082459 - - - - -] Quota exceeded for 67512ed5765f425fba4277a28b36adb3, tried to extend volume by 1000G, (1000G of 1000G already consumed). | 08:08 |
masuberu | this may be the real issue then | 08:09 |
zhongjun | masuberu: We used the cinder interface to extend the volume. | 08:09 |
zhongjun | masuberu: okay, then you find it. | 08:09 |
masuberu | ok, sorry I miss this | 08:10 |
masuberu | *missed | 08:10 |
zhongjun | masuberu: :) It is ok | 08:11 |
masuberu | I am not sure if I understand what is happening, so cinder complains about the quota saying that the limit is 1000G and I am already consuming it | 08:12 |
masuberu | but openstack quota show says I have 30000 gigabytes | 08:12 |
zhongjun | masuberu: you have 30000 gigabytes in 67512ed5765f425fba4277a28b36adb3 project? | 08:14 |
masuberu | no | 08:14 |
masuberu | only 1000 gigabytes | 08:15 |
zhongjun | masuberu: It would be better to check the db table | 08:15 |
masuberu | ok | 08:15 |
masuberu | let me check | 08:15 |
masuberu | zhongjun, so you mean I have to check mariadb --> nova schema and quota_usage table? | 08:26 |
masuberu | is that right? | 08:26 |
*** AlexeyAbashkin has joined #openstack-manila | 08:28 | |
masuberu | oh ok sorry, cinder schema also has a quota table with the gigabytes field | 08:28 |
zhongjun | masuberu: yes, cinder schema itself | 08:28 |
*** gcb has joined #openstack-manila | 08:28 | |
masuberu | zhongjun, could you please help to understand this http://paste.openstack.org/show/624057/? | 08:35 |
masuberu | I don't understand why cinder quota_usage shows 5000 for the admin project but openstack quota show says 30000 | 08:36 |
zhongjun | masuberu: There are two projects | 08:36 |
masuberu | yes but I login as admin | 08:36 |
masuberu | the other project is for "service" | 08:38 |
zhongjun | masuberu: you use manila to create a cinder volume. Could you check your volume db about what project the volume belong to | 08:40 |
zhongjun | masuberu: volume table in cinder schema | 08:41 |
masuberu | ok | 08:41 |
zhongjun | masuberu: you can check your manila.conf | 08:42 |
zhongjun | masuberu: there are some options about cinder in cinder node | 08:42 |
zhongjun | masuberu: The default project name is set to service " project_name = service" | 08:43 |
masuberu | yes you are right so the manila volume belongs tot he service project with id 67512ed5765f425fba4277a28b36adb3 | 08:43 |
masuberu | and according to cinder quota that project has maximum of 1000 which matches the cinder error message when I tried to extend the volume using manila | 08:44 |
zhongjun | masuberu: yes | 08:44 |
masuberu | so manila is using the service project to create volumes | 08:45 |
masuberu | ok i understand now | 08:45 |
zhongjun | masuberu: good | 08:45 |
masuberu | thank you | 08:45 |
zhongjun | masuberu: you are welcome | 08:45 |
*** dsariel has joined #openstack-manila | 08:49 | |
masuberu | zhongjun, so can I change this settings so manila will use the quota from the same user creating the shares instead of service? | 08:50 |
openstackgerrit | Raissa Sarmento proposed openstack/manila master: Migrating legacy jobs https://review.openstack.org/512559 | 09:15 |
*** lpetrut has joined #openstack-manila | 09:29 | |
*** junboli has quit IRC | 09:33 | |
*** ganso has joined #openstack-manila | 09:48 | |
*** vivsoni has quit IRC | 09:53 | |
*** vivsoni has joined #openstack-manila | 09:53 | |
*** markstur has joined #openstack-manila | 10:38 | |
*** markstur has quit IRC | 10:43 | |
*** wes_dillingham has joined #openstack-manila | 10:48 | |
masuberu | zhongjun, ok, I have expanded the share but now it says mount.nfs: access denied by server while mounting 10.254.0.7:/shares/share-b582a372-e82b-49b2-87ff-e8054dd7db05 | 10:56 |
*** wes_dillingham has quit IRC | 10:56 | |
masuberu | but access has been allowed as I get this when I run manila allow-access ERROR: Share access ip:192.168.1.108 exists. | 10:57 |
zhongjun | masuberu: yeah, you could change this setting, but we usually don't do that, we want to distinguish the tenant between admin and service | 11:05 |
zhongjun | masuberu: You could remove it and then added it | 11:05 |
masuberu | ok | 11:06 |
masuberu | so what happened then, the tenant of the share has changed from admin to service? | 11:06 |
masuberu | ? | 11:07 |
masuberu | zhongjun, sorry do you mean remove the share? | 11:08 |
masuberu | am I going to loose data? | 11:09 |
zhongjun | masuberu: no, just access ? | 11:09 |
masuberu | ok ok | 11:10 |
*** tpsilva has joined #openstack-manila | 11:16 | |
*** AlexeyAbashkin has quit IRC | 11:24 | |
*** AlexeyAbashkin has joined #openstack-manila | 11:26 | |
*** zhiguo has quit IRC | 11:42 | |
*** AlexeyAbashkin has quit IRC | 11:51 | |
*** eharney has joined #openstack-manila | 11:52 | |
*** AlexeyAbashkin has joined #openstack-manila | 11:55 | |
*** catintheroof has joined #openstack-manila | 12:27 | |
*** catintheroof has quit IRC | 12:42 | |
*** catintheroof has joined #openstack-manila | 12:51 | |
*** catintheroof has quit IRC | 12:53 | |
*** zhiguo has joined #openstack-manila | 12:57 | |
*** wes_dillingham has joined #openstack-manila | 12:58 | |
*** dustins has joined #openstack-manila | 13:02 | |
*** xyang1 has joined #openstack-manila | 13:54 | |
*** markstur has joined #openstack-manila | 13:57 | |
*** markstur has quit IRC | 14:01 | |
*** gouthamr has joined #openstack-manila | 14:20 | |
*** zhiguo has quit IRC | 14:35 | |
*** markstur has joined #openstack-manila | 15:00 | |
*** dsariel has quit IRC | 15:05 | |
*** MVenesio has joined #openstack-manila | 15:21 | |
gouthamr | wonder if the Cinder ChangeID on this change: https://review.openstack.org/#/c/509152/ is messing up the CI for Generic and NetApp drivers | 15:49 |
gouthamr | very weird, complains of a conflicting configuration option in the cinder tempest plugin and manila | 15:50 |
gouthamr | http://logs.openstack.org/52/509152/8/check/legacy-manila-tempest-dsvm-mysql-generic/d3455e2/job-output.txt.gz#_2017-10-14_19_17_12_493833 | 15:51 |
openstackgerrit | Goutham Pacha Ravi proposed openstack/manila-image-elements master: DNM https://review.openstack.org/513430 | 15:58 |
gouthamr | ^ i thought we recently concluded that the image is being tested from build in the job... so just testing again | 15:59 |
bswartz | zhongjun: what didn't get updated? | 16:00 |
tbarron | gouthamr: well I hope I'm wrong! | 16:00 |
tbarron | dustins: that was quite productive I think, all hail the bug czar! | 16:01 |
dustins | woooo | 16:01 |
bswartz | zhongjun: according to http://tarballs.openstack.org/manila-image-elements/images/ the last image was updated 2017-9-27 | 16:01 |
bswartz | that looks accurate | 16:01 |
zhongjun | I asked infra guys, they check their environment, he said we build the right image, but translate image to tarball link if fail | 16:01 |
dustins | Still a lot more to do, but we're getting there! | 16:01 |
zhongjun | s/if /is | 16:01 |
gouthamr | tbarron: this was added just for building on the gate, and moving the image built to the public_html directory so it can be downloaded from the slave node itself: https://github.com/openstack/manila-image-elements/blob/master/tools/gate/build-images | 16:02 |
zhongjun | bswartz: Then he update it for us manually | 16:02 |
gouthamr | zhongjun: ouch, that kinda could explain what's going on :P | 16:02 |
bswartz | interesting | 16:02 |
bswartz | I observed it working very shortly after we forced a rebuild, and I presumed the automated upload worked | 16:03 |
bswartz | if there's another issue that needs fixing, we should capture that and file another bug | 16:03 |
bswartz | +1 all hail the bug czar | 16:03 |
tbarron | gouthamr: maybe I mis-read the logs then. | 16:03 |
zhongjun | bswartz: Acutally, yeah, it is not the automated upload work | 16:03 |
zhongjun | bswartz: The automated upload work have some problem, but he didn't know why 300MB image will changed to 230MB image after translate | 16:05 |
*** ianychoi has quit IRC | 16:06 | |
openstackgerrit | Alexander Pugachev proposed openstack/python-manilaclient master: Increase code coverage https://review.openstack.org/513433 | 16:07 |
*** ianychoi has joined #openstack-manila | 16:07 | |
*** lpetrut has quit IRC | 16:07 | |
tbarron | gouthamr: when your new image is built I'll look at the logs again. Hopefully we'll see that it's checking the image from this local webserver and I was hallucinating. | 16:10 |
*** dustins_ has joined #openstack-manila | 16:17 | |
*** pcaruana has quit IRC | 16:18 | |
gouthamr | tbarron: i was scouring through older logs, funnily all the log files are deleted, the folders aren't :P | 16:20 |
tbarron | gouthamr: nice (not) | 16:21 |
*** MVenesio has quit IRC | 16:21 | |
*** dustins has quit IRC | 16:27 | |
*** lpetrut has joined #openstack-manila | 16:43 | |
*** AlexeyAbashkin has quit IRC | 16:46 | |
*** lpetrut has quit IRC | 16:57 | |
*** lpetrut has joined #openstack-manila | 17:10 | |
*** MVenesio has joined #openstack-manila | 17:58 | |
*** chenying has quit IRC | 18:13 | |
*** chenying has joined #openstack-manila | 18:13 | |
*** AlexeyAbashkin has joined #openstack-manila | 18:19 | |
*** AlexeyAbashkin has quit IRC | 18:23 | |
*** lpetrut has quit IRC | 18:24 | |
*** markstur has quit IRC | 18:34 | |
gouthamr | tbarron bswartz: http://logs.openstack.org/30/513430/1/check/legacy-manila-tempest-dsvm-generic-scenario-custom-image/dd0355d/job-output.txt.gz#_2017-10-19_17_54_56_470503 | 18:41 |
bswartz | gouthamr tbarron: http://logs.openstack.org/30/513430/1/check/legacy-manila-tempest-dsvm-generic-scenario-custom-image/dd0355d/logs/devstacklog.txt.gz#_2017-10-19_18_16_12_141 | 18:45 |
gouthamr | this one? http://logs.openstack.org/30/513430/1/check/legacy-manila-tempest-dsvm-generic-scenario-custom-image/dd0355d/logs/devstacklog.txt.gz#_2017-10-19_17_55_14_489 | 18:45 |
gouthamr | o.O | 18:45 |
bswartz | just sayin, it appears to not work as intended | 18:46 |
bswartz | IDK what the bug is, but the evidence points to a bug | 18:46 |
*** arnewiebalck_ has joined #openstack-manila | 18:49 | |
gouthamr | +1 | 18:49 |
gouthamr | wait, the MANILA_SERVICE_IMAGE_URL is being set in post-test-hook | 18:50 |
gouthamr | pre_test_hook* | 18:51 |
bswartz | too early or too late? | 18:51 |
gouthamr | before the drivers are started... | 18:51 |
bswartz | needs to be set before the devstack plugin runs | 18:52 |
bswartz | because the devstack plugin is what installs the service image | 18:52 |
bswartz | so it should be in local.conf | 18:52 |
gouthamr | you're right... however, something in the image build's failed too | 18:54 |
bswartz | I think that's what zhongjun was alluding to | 18:54 |
gouthamr | sh: 1: debootstrap: not found | 18:54 |
bswartz | in the meeting before lunch | 18:54 |
bswartz | >_< | 18:54 |
bswartz | sudo apt-get -y install debootstrap | 18:55 |
*** MVenesio has quit IRC | 19:07 | |
gouthamr | so that's mentioned in bindep.txt, and perhaps that needs some tinkering with ZuulV3? | 19:09 |
gouthamr | we don't have a bindep tox environment though | 19:12 |
*** AlexeyAbashkin has joined #openstack-manila | 19:17 | |
*** AlexeyAbashkin has quit IRC | 19:21 | |
*** lpetrut has joined #openstack-manila | 19:44 | |
*** dsariel has joined #openstack-manila | 19:56 | |
*** jprovazn has quit IRC | 20:00 | |
*** kaisers has quit IRC | 20:01 | |
*** wes_dillingham has quit IRC | 20:04 | |
*** kaisers has joined #openstack-manila | 20:11 | |
*** kaisers has quit IRC | 20:15 | |
*** AlexeyAbashkin has joined #openstack-manila | 20:17 | |
*** dsariel has quit IRC | 20:17 | |
*** AlexeyAbashkin has quit IRC | 20:21 | |
*** markstur has joined #openstack-manila | 20:26 | |
openstackgerrit | Merged openstack/manila master: doc: move stuff from contributor to admin https://review.openstack.org/508157 | 20:32 |
*** AlexeyAbashkin has joined #openstack-manila | 20:38 | |
*** AlexeyAbashkin has quit IRC | 20:42 | |
*** AlexeyAbashkin has joined #openstack-manila | 20:59 | |
*** AlexeyAbashkin has quit IRC | 21:03 | |
*** arnewiebalck_ has quit IRC | 21:04 | |
*** gouthamr has quit IRC | 21:15 | |
*** lpetrut has quit IRC | 21:39 | |
*** tpsilva has quit IRC | 21:42 | |
*** xyang1 has quit IRC | 21:47 | |
*** wes_dillingham has joined #openstack-manila | 21:56 | |
openstackgerrit | Victoria Martinez de la Cruz proposed openstack/manila master: CentOS share node install docs https://review.openstack.org/512895 | 22:01 |
*** dustins_ has quit IRC | 22:01 | |
*** kaisers has joined #openstack-manila | 22:12 | |
*** kaisers has quit IRC | 22:16 | |
*** drico_ has quit IRC | 22:21 | |
*** drico_ has joined #openstack-manila | 22:27 | |
*** drico_ has quit IRC | 22:41 | |
*** drico_ has joined #openstack-manila | 22:47 | |
*** wes_dillingham has quit IRC | 23:15 | |
*** AlexeyAbashkin has joined #openstack-manila | 23:16 | |
*** AlexeyAbashkin has quit IRC | 23:21 | |
*** wes_dillingham has joined #openstack-manila | 23:26 | |
openstackgerrit | Merged openstack/puppet-manila master: Prepare for Queens Milestone 1 https://review.openstack.org/512832 | 23:38 |
*** AlexeyAbashkin has joined #openstack-manila | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!