*** The_Ball has quit IRC | 00:00 | |
*** alexpilotti has joined #openstack-cinder | 00:11 | |
*** lprice has joined #openstack-cinder | 00:11 | |
*** alexpilotti has quit IRC | 00:12 | |
*** cknight has joined #openstack-cinder | 00:14 | |
*** esker has joined #openstack-cinder | 00:15 | |
*** esker has quit IRC | 00:16 | |
*** esker has joined #openstack-cinder | 00:17 | |
*** chlong has joined #openstack-cinder | 00:19 | |
*** scottda has quit IRC | 00:25 | |
*** laughterwym has joined #openstack-cinder | 00:33 | |
*** laughterwym has quit IRC | 00:40 | |
*** laughterwym has joined #openstack-cinder | 00:42 | |
*** takashi has joined #openstack-cinder | 00:55 | |
*** cheneydc has joined #openstack-cinder | 00:56 | |
*** iceyao_ has joined #openstack-cinder | 01:00 | |
*** itlinux has quit IRC | 01:08 | |
*** itlinux has joined #openstack-cinder | 01:18 | |
*** itlinux has quit IRC | 01:23 | |
*** itlinux has joined #openstack-cinder | 01:25 | |
*** jamielennox is now known as jamielennox|away | 01:26 | |
*** itlinux has quit IRC | 01:26 | |
*** jamielennox|away is now known as jamielennox | 01:28 | |
*** bswartz has quit IRC | 01:28 | |
*** zhenguo_ has joined #openstack-cinder | 01:31 | |
*** itlinux has joined #openstack-cinder | 01:35 | |
*** IlyaG has joined #openstack-cinder | 01:38 | |
*** IlyaG has quit IRC | 01:40 | |
*** salv-orlando has joined #openstack-cinder | 01:43 | |
*** sdague has quit IRC | 01:47 | |
*** EinstCrazy has joined #openstack-cinder | 01:48 | |
*** salv-orlando has quit IRC | 01:51 | |
*** Julien-zte has joined #openstack-cinder | 01:51 | |
*** IlyaG has joined #openstack-cinder | 01:52 | |
*** raunak has quit IRC | 01:53 | |
*** chlong has quit IRC | 01:56 | |
*** EinstCrazy has quit IRC | 02:03 | |
*** itlinux has quit IRC | 02:04 | |
*** EinstCrazy has joined #openstack-cinder | 02:04 | |
*** itlinux has joined #openstack-cinder | 02:05 | |
*** cknight has quit IRC | 02:06 | |
*** itlinux has quit IRC | 02:10 | |
*** houming has joined #openstack-cinder | 02:13 | |
*** dave-mccowan has joined #openstack-cinder | 02:20 | |
*** Lee1092 has joined #openstack-cinder | 02:25 | |
*** EinstCrazy has quit IRC | 02:26 | |
*** EinstCrazy has joined #openstack-cinder | 02:28 | |
*** bswartz has joined #openstack-cinder | 02:33 | |
*** EinstCrazy has quit IRC | 02:34 | |
*** EinstCrazy has joined #openstack-cinder | 02:36 | |
*** raunak has joined #openstack-cinder | 02:39 | |
*** EinstCra_ has joined #openstack-cinder | 02:40 | |
*** IlyaG has quit IRC | 02:41 | |
*** EinstCrazy has quit IRC | 02:43 | |
openstackgerrit | zhongjun proposed openstack/cinder-specs: Cinder volume rollback snapshot https://review.openstack.org/316537 | 02:58 |
---|---|---|
*** yangyapeng has joined #openstack-cinder | 02:58 | |
*** itlinux has joined #openstack-cinder | 03:03 | |
*** jamielennox is now known as jamielennox|away | 03:06 | |
openstackgerrit | zhongjun proposed openstack/cinder-specs: Cinder volume rollback snapshot https://review.openstack.org/316540 | 03:09 |
*** raunak has quit IRC | 03:11 | |
*** harlowja_at_home has joined #openstack-cinder | 03:16 | |
*** sgotliv has joined #openstack-cinder | 03:21 | |
*** raunak has joined #openstack-cinder | 03:22 | |
*** bardia has joined #openstack-cinder | 03:22 | |
openstackgerrit | zhongjun proposed openstack/cinder-specs: Cinder volume rollback snapshot https://review.openstack.org/316540 | 03:26 |
*** bardia has quit IRC | 03:28 | |
*** bardia has joined #openstack-cinder | 03:28 | |
*** jamielennox|away is now known as jamielennox | 03:36 | |
*** ducttape_ has joined #openstack-cinder | 03:38 | |
*** bardia has quit IRC | 03:40 | |
*** links has joined #openstack-cinder | 03:49 | |
*** zhongjun_ has quit IRC | 03:53 | |
*** zhongjun_ has joined #openstack-cinder | 03:53 | |
openstackgerrit | zhongjun proposed openstack/cinder-specs: Cinder volume rollback snapshot https://review.openstack.org/316540 | 03:57 |
*** IlyaG has joined #openstack-cinder | 03:59 | |
*** ducttape_ has quit IRC | 04:02 | |
*** ducttape_ has joined #openstack-cinder | 04:02 | |
*** ducttape_ has quit IRC | 04:07 | |
*** Julien-zte has quit IRC | 04:08 | |
*** IlyaG has quit IRC | 04:14 | |
*** Poornima has joined #openstack-cinder | 04:30 | |
*** apoorvad has joined #openstack-cinder | 04:36 | |
*** salv-orlando has joined #openstack-cinder | 04:36 | |
*** Julien-zte has joined #openstack-cinder | 04:44 | |
*** salv-orlando has quit IRC | 04:45 | |
*** harlowja_at_home has quit IRC | 04:50 | |
*** apoorvad has quit IRC | 04:52 | |
*** mtanino has quit IRC | 04:58 | |
*** laughter_ has joined #openstack-cinder | 05:11 | |
*** laughterwym has quit IRC | 05:15 | |
*** lpetrut has joined #openstack-cinder | 05:20 | |
*** savihou has joined #openstack-cinder | 05:26 | |
*** suyash has joined #openstack-cinder | 05:28 | |
*** suyash has quit IRC | 05:28 | |
*** rcernin has joined #openstack-cinder | 05:38 | |
*** laughter_ has quit IRC | 05:43 | |
*** GB21 has joined #openstack-cinder | 05:43 | |
*** laughterwym has joined #openstack-cinder | 05:43 | |
*** itzdilip has joined #openstack-cinder | 05:54 | |
*** liverpooler has joined #openstack-cinder | 05:55 | |
*** salv-orlando has joined #openstack-cinder | 06:02 | |
*** salv-orlando has quit IRC | 06:08 | |
*** Julien-zte has quit IRC | 06:11 | |
openstackgerrit | Sheel Rana proposed openstack/cinder: Updated volume, version, limit, metadata API-ref https://review.openstack.org/316587 | 06:11 |
*** sheel has joined #openstack-cinder | 06:12 | |
*** lpetrut has quit IRC | 06:20 | |
*** salv-orlando has joined #openstack-cinder | 06:25 | |
openstackgerrit | Kushal Wathore proposed openstack/cinder: Add unit tests in cinder component for HPE drivers https://review.openstack.org/313992 | 06:39 |
*** GB21 has quit IRC | 07:03 | |
*** raunak has quit IRC | 07:16 | |
*** GB21 has joined #openstack-cinder | 07:19 | |
*** lpetrut has joined #openstack-cinder | 07:32 | |
*** GB21 has quit IRC | 07:35 | |
*** aarefiev has quit IRC | 07:43 | |
*** vnogin has quit IRC | 07:43 | |
*** vnogin has joined #openstack-cinder | 07:45 | |
*** laughterwym has quit IRC | 07:48 | |
*** laughterwym has joined #openstack-cinder | 07:49 | |
*** GB21 has joined #openstack-cinder | 07:52 | |
*** kongwei has joined #openstack-cinder | 07:58 | |
*** laughterwym has quit IRC | 07:58 | |
*** lennyb has joined #openstack-cinder | 07:58 | |
*** laughterwym has joined #openstack-cinder | 07:58 | |
*** laughter_ has joined #openstack-cinder | 07:59 | |
*** zzzeek has quit IRC | 08:00 | |
*** iceyao has joined #openstack-cinder | 08:00 | |
*** iceyao_ has quit IRC | 08:00 | |
*** zzzeek has joined #openstack-cinder | 08:00 | |
*** lpetrut has quit IRC | 08:01 | |
*** laughterwym has quit IRC | 08:03 | |
*** GB21 has quit IRC | 08:03 | |
*** salv-orlando has quit IRC | 08:11 | |
*** markvoelker has joined #openstack-cinder | 08:15 | |
*** GB21 has joined #openstack-cinder | 08:16 | |
*** laughterwym has joined #openstack-cinder | 08:17 | |
*** laughter_ has quit IRC | 08:20 | |
*** markvoelker has quit IRC | 08:23 | |
*** markvoelker has joined #openstack-cinder | 08:24 | |
*** e0ne has joined #openstack-cinder | 08:25 | |
*** dosaboy has quit IRC | 08:26 | |
*** yangyapeng has quit IRC | 08:28 | |
*** yangyapeng has joined #openstack-cinder | 08:30 | |
*** jistr has joined #openstack-cinder | 08:30 | |
openstackgerrit | Kushal Wathore proposed openstack/cinder: Add unit tests in cinder component for 3PAR driver https://review.openstack.org/315376 | 08:31 |
*** laughter_ has joined #openstack-cinder | 08:33 | |
*** laughterwym has quit IRC | 08:36 | |
*** dosaboy has joined #openstack-cinder | 08:36 | |
*** Poornima has quit IRC | 08:37 | |
*** partner has joined #openstack-cinder | 08:41 | |
*** Poornima has joined #openstack-cinder | 08:47 | |
openstackgerrit | Yatin Kumbhare proposed openstack/cinder: Use check_string_length from oslo_utils https://review.openstack.org/315358 | 08:49 |
*** sgotliv_ has joined #openstack-cinder | 08:49 | |
*** sgotliv has quit IRC | 08:52 | |
*** laughter_ has quit IRC | 08:53 | |
*** laughterwym has joined #openstack-cinder | 08:53 | |
*** yhayashi has quit IRC | 08:53 | |
*** zzzeek has quit IRC | 08:56 | |
*** caspinol has joined #openstack-cinder | 08:56 | |
*** laughterwym has quit IRC | 08:57 | |
*** zzzeek has joined #openstack-cinder | 08:58 | |
*** takashi has quit IRC | 08:59 | |
*** yuriy_n17 has joined #openstack-cinder | 09:11 | |
*** lpetrut has joined #openstack-cinder | 09:27 | |
*** mvk has quit IRC | 09:28 | |
*** iceyao has quit IRC | 09:32 | |
*** lpetrut1 has joined #openstack-cinder | 09:33 | |
*** lpetrut has quit IRC | 09:34 | |
*** lpetrut1 is now known as lpetrut | 09:34 | |
savihou | DuncanT: Thanks for the feedback on https://review.openstack.org/#/c/263026/ , the issue you identified was indeed a rebase issue. | 09:37 |
*** caspinol has quit IRC | 09:38 | |
DuncanT | savihou: Glad to hear it was something simple. | 09:39 |
savihou | DuncanT: :) , May I bother you with a final review ? just to make sure I didn't missed anything ? | 09:40 |
DuncanT | Yes, I'll get back to it today | 09:40 |
partner | hi, an unfortunate finding, nova-compute and glusterfs mounts are under same systemd cgroup so restarting nova for config changes kills all the volume mounts. using centos 7 and kilo, can someone point me towards some fixes or instructions to address the issues, thanks! found a quite fresh similar bug: 1530860 | 09:42 |
openstack | bug 1530860 in OpenStack Compute (nova) "Nova service restart disconnects Quobyte volumes on systemd systems" [Undecided,In progress] https://launchpad.net/bugs/1530860 - Assigned to Silvan Kaiser (2-silvan) | 09:42 |
*** kongwei has quit IRC | 09:44 | |
partner | perhaps switching to libgfapi? | 09:49 |
savihou | DuncanT: Thank you!! | 09:50 |
*** caspinol has joined #openstack-cinder | 09:52 | |
*** mvk has joined #openstack-cinder | 09:57 | |
*** cheneydc has quit IRC | 10:00 | |
*** laughterwym has joined #openstack-cinder | 10:09 | |
openstackgerrit | Petrut Lucian proposed openstack/os-brick: Ensure that the base connector is platform independent https://review.openstack.org/312999 | 10:09 |
*** yangyapeng has quit IRC | 10:10 | |
openstackgerrit | Merged openstack/cinder: Failback will enable the host that has been frozen https://review.openstack.org/312334 | 10:10 |
*** laughterwym has quit IRC | 10:13 | |
*** sdague has joined #openstack-cinder | 10:18 | |
*** GB21 has quit IRC | 10:20 | |
*** lennyb has quit IRC | 10:32 | |
*** GB21 has joined #openstack-cinder | 10:33 | |
*** caspinol has quit IRC | 10:33 | |
*** salv-orlando has joined #openstack-cinder | 10:34 | |
*** EinstCra_ has quit IRC | 10:36 | |
*** salv-orlando has quit IRC | 10:39 | |
*** caspinol has joined #openstack-cinder | 10:46 | |
*** salv-orlando has joined #openstack-cinder | 10:48 | |
*** caspinol has quit IRC | 10:49 | |
*** gcb has joined #openstack-cinder | 10:57 | |
*** sbezverk has quit IRC | 11:04 | |
*** markvoelker has quit IRC | 11:06 | |
*** avishay has joined #openstack-cinder | 11:08 | |
*** krtaylor has quit IRC | 11:10 | |
*** _fortis has quit IRC | 11:13 | |
*** GB21 has quit IRC | 11:24 | |
*** krtaylor has joined #openstack-cinder | 11:24 | |
*** salv-orlando has quit IRC | 11:27 | |
openstackgerrit | Matan Sabag proposed openstack/cinder: Manage/unmanage snapshot in ScaleIO driver Add support for manage/unmanage snapshot in the ScaleIO driver. https://review.openstack.org/316742 | 11:30 |
*** tpsilva has joined #openstack-cinder | 11:31 | |
*** salv-orlando has joined #openstack-cinder | 11:35 | |
*** GB21 has joined #openstack-cinder | 11:37 | |
*** lprice has quit IRC | 11:38 | |
*** jwcroppe_ has joined #openstack-cinder | 11:47 | |
*** jwcropp__ has joined #openstack-cinder | 11:49 | |
*** jwcroppe has quit IRC | 11:50 | |
*** jwcroppe_ has quit IRC | 11:52 | |
*** sdake has joined #openstack-cinder | 11:55 | |
*** mtanino has joined #openstack-cinder | 11:57 | |
*** raildo-afk is now known as raildo | 12:06 | |
*** liverpooler has quit IRC | 12:07 | |
*** markvoelker has joined #openstack-cinder | 12:08 | |
*** sdake has quit IRC | 12:10 | |
*** ducttape_ has joined #openstack-cinder | 12:11 | |
*** markvoelker has quit IRC | 12:13 | |
*** yangyapeng has joined #openstack-cinder | 12:14 | |
*** diogogmt has quit IRC | 12:15 | |
*** GB21 has quit IRC | 12:20 | |
*** diogogmt has joined #openstack-cinder | 12:20 | |
*** caspinol has joined #openstack-cinder | 12:22 | |
caspinol | Hello, are user problems allowed in here or is this just a dev channel? | 12:24 |
*** ducttape_ has quit IRC | 12:29 | |
*** diogogmt has quit IRC | 12:29 | |
caspinol | ok, so i have problem with volume migration in cinder 7.0.1. In the logs i can see that the migration was scheduled but it never takes place and there is no ERROR or any other type of output in logs after that | 12:31 |
caspinol | when i try migration in Horizon i only get a notification that it failed | 12:31 |
caspinol | but again no entry in the logs as to why it failed | 12:32 |
*** edmondsw has joined #openstack-cinder | 12:32 | |
*** diogogmt has joined #openstack-cinder | 12:34 | |
caspinol | would anybody have any tips on how to troubleshoot it? | 12:35 |
caspinol | also all the other operations like creating/deleteing are working without problem | 12:39 |
*** julim has joined #openstack-cinder | 12:40 | |
*** laughterwym has joined #openstack-cinder | 12:40 | |
dulek | caspinol: Try looking for TRACEBACK instead of ERROR. Also if Horizon informs you of that, then you probably need to look in c-api logs. | 12:40 |
*** Poornima has quit IRC | 12:42 | |
caspinol | thanks for reply dulek | 12:42 |
caspinol | By traceback you mean looking for actual python exception? | 12:43 |
caspinol | if yes then there is none unfortunately | 12:43 |
*** akerr has joined #openstack-cinder | 12:43 | |
dulek | caspinol: Hm. Or maybe your request is getting lost between c-sch and c-vol? | 12:44 |
caspinol | This issue is really weird as i was able to fix most of issues with my openstack deploynment from the logs | 12:44 |
dulek | caspinol: Check out RabbitMQ queues for non-received mesages. | 12:44 |
caspinol | but this one is really weird one | 12:44 |
dulek | caspinol: In logs of which component you see your request last? | 12:45 |
dulek | caspinol: cinder-scheduler? | 12:45 |
caspinol | very well, let me look at the rabbit stuff | 12:45 |
caspinol | dulek: let me doublecheck | 12:45 |
*** scottda has joined #openstack-cinder | 12:45 | |
avishay | caspinol: do you have two instances of c-vol? did you check the logs of both? | 12:45 |
*** akerr_ has joined #openstack-cinder | 12:46 | |
*** laughterwym has quit IRC | 12:46 | |
*** laughterwym has joined #openstack-cinder | 12:46 | |
*** timcl has joined #openstack-cinder | 12:49 | |
*** akerr has quit IRC | 12:49 | |
caspinol | so last INFO log entry is in cinder-api, and its a action post request, followed by a DEBUG in cinder-api "Action-body : { os-migrate-volume..." | 12:50 |
caspinol | and that is followed by DEBUG in sch-api returning "Filtered [host 'OS-Compute02@lvm#LVM': free_capacity_gb: 7776.49, pools: None, host 'OS-Compute01@lvm#LVM': free_capacity_gb: 7797.49, pools: None] _get_weighted_candidates /usr/lib/python2.7/site-packages/cinder/scheduler/filter_scheduler.py:310 " | 12:52 |
caspinol | and that is all | 12:53 |
*** links has quit IRC | 12:55 | |
e0ne | hi. can anybody help me with https://review.openstack.org/#/c/287938/, please? I don't see any errors, only NOT_REGISTERED jobs | 12:56 |
e0ne | oops, wrong channel | 12:56 |
*** houming has quit IRC | 12:58 | |
*** markvoelker has joined #openstack-cinder | 13:00 | |
akerr_ | e0ne: i'd just do a recheck. NOT_REGISTERED means jenkins doesn't know about the required node type for that job. Usually due to the nodes being redefined and an initial one not having been built by nodepool yet. Should clear up on its own | 13:03 |
e0ne | akerr_: thanks | 13:03 |
akerr_ | e0ne: if it persists may want to ping infra about it though | 13:04 |
*** markvoelker has quit IRC | 13:04 | |
e0ne | akerr_: sure, I'll do | 13:04 |
*** markvoelker has joined #openstack-cinder | 13:04 | |
openstackgerrit | Matan Sabag proposed openstack/cinder: ScaleIO actual volume size model update https://review.openstack.org/316811 | 13:05 |
*** porrua has joined #openstack-cinder | 13:05 | |
*** xyang1 has joined #openstack-cinder | 13:06 | |
*** akerr_ is now known as akerr | 13:06 | |
*** mtanino has quit IRC | 13:08 | |
openstackgerrit | Matan Sabag proposed openstack/cinder: ScaleIO actual volume size model update https://review.openstack.org/316811 | 13:08 |
caspinol | avishay: hi, yes i just did actually. And on the c-vol node2 I can see that a new lv is created, the content is dd'ed over from c-vol node1 and then deleted. | 13:14 |
caspinol | but does not show any error or reason why it deletes the LV | 13:14 |
*** Julien-zte has joined #openstack-cinder | 13:17 | |
*** dustins has joined #openstack-cinder | 13:17 | |
*** eharney has quit IRC | 13:18 | |
scottda | smcginnis: Hi. When was the last time we released a version of cinderclient? | 13:28 |
*** markvoelker has quit IRC | 13:28 | |
*** darosale has joined #openstack-cinder | 13:29 | |
*** bill_az has joined #openstack-cinder | 13:31 | |
smcginnis | scottda: Just before Mitaka client freeze. | 13:33 |
smcginnis | scottda: I haven't looked lately, but we probably have enough in there to do another release. | 13:34 |
*** diablo_rojo has joined #openstack-cinder | 13:34 | |
smcginnis | scottda: I can get that queued up today. | 13:34 |
*** esker has quit IRC | 13:34 | |
smcginnis | I should probably take a look at os-brick as well while I'm at it. | 13:34 |
scottda | smcginnis: Thanks. We probably do...I also see the tagged version in devstack is 1.6.0 | 13:34 |
*** cknight has joined #openstack-cinder | 13:35 | |
scottda | We are definitely behind in cinderclient release notes. They only go up to 1.4.0 | 13:35 |
*** eharney has joined #openstack-cinder | 13:35 | |
smcginnis | scottda: We have reno now in cinderclient. | 13:36 |
smcginnis | scottda: Maybe there's a publishing job we need to update, or that page needs to change. | 13:36 |
scottda | smcginnis: Yeah, I'm not sure what, but the docs are a bit stale, and release notes in the repo are not current. | 13:37 |
scottda | http://docs.openstack.org/developer/python-cinderclient/#master | 13:37 |
smcginnis | scottda: Yeah, that should probably point to here now: http://docs.openstack.org/releasenotes/python-cinderclient/mitaka.html | 13:38 |
scottda | smcginnis: So that tagging always confuses me, and "git tag -l" just shows the tag numbers. Do you know when 1.6 tag was created? and how to figure that out? | 13:39 |
scottda | smcginnis: I see support in the cinderclient for 'delete --cascade' for instance, on master and it was merged in January, but it is not on Devstack cinderclient v 1.6 | 13:40 |
smcginnis | scottda: Not sure the best/correct way. I usually have just looked at when I requested the release. :) | 13:40 |
smcginnis | Hmm, that's odd. | 13:40 |
smcginnis | scottda: It was definitely after January, so that should be in there then. | 13:40 |
smcginnis | Pro tip - don't try to stack on a machine where you're running apache to serve a local apt mirror. :/ | 13:41 |
smcginnis | Or pip mirror | 13:41 |
scottda | haha | 13:42 |
smcginnis | scottda: I won't tell how many times I tried, it failed, and I wondered why apache had stopped. | 13:42 |
smcginnis | Ah Monday's. :) | 13:42 |
*** edmondsw has quit IRC | 13:43 | |
scottda | smcginnis: FYI support for --cascade, git log shows Jan 7 date ccacc338a5 | 13:45 |
*** sheel has quit IRC | 13:45 | |
smcginnis | scottda: Maybe a bug in there that it's not showing up? | 13:45 |
scottda | smcginnis: Nope. If I run master, I get support for cascade. But released version 1.6 (on devstack) doesn't have it. | 13:47 |
scottda | and it's not on stable/mitaka branch | 13:48 |
*** ducttape_ has joined #openstack-cinder | 13:49 | |
*** cknight has quit IRC | 13:49 | |
*** mriedem has joined #openstack-cinder | 13:49 | |
eharney | scottda: try "git tag --contains ccacc338a5" | 13:51 |
*** martyturner has joined #openstack-cinder | 13:51 | |
scottda | smcginnis: That returns nothing for me | 13:54 |
*** mtanino has joined #openstack-cinder | 13:54 | |
eharney | right, so it's not in any release yet | 13:54 |
eharney | scottda: the merge commit a330ff is the first commit after 1.6 | 13:56 |
*** martyturner has quit IRC | 13:56 | |
*** zzzeek has quit IRC | 13:56 | |
scottda | eharney: OK, thanks. | 13:57 |
*** ametts has joined #openstack-cinder | 13:57 | |
*** zzzeek has joined #openstack-cinder | 13:58 | |
*** jgregor has joined #openstack-cinder | 13:59 | |
*** diogogmt has quit IRC | 14:02 | |
*** eharney has quit IRC | 14:05 | |
*** dustins has quit IRC | 14:06 | |
openstackgerrit | Alex Meade proposed openstack/python-cinderclient: Add pagination support for Messages https://review.openstack.org/315769 | 14:07 |
*** sdake has joined #openstack-cinder | 14:08 | |
*** jungleboyj has joined #openstack-cinder | 14:09 | |
*** dustins has joined #openstack-cinder | 14:10 | |
*** cknight has joined #openstack-cinder | 14:10 | |
*** baumann has joined #openstack-cinder | 14:11 | |
*** links has joined #openstack-cinder | 14:15 | |
*** avishay has quit IRC | 14:20 | |
*** wxy has quit IRC | 14:20 | |
*** esker has joined #openstack-cinder | 14:20 | |
*** cbader has joined #openstack-cinder | 14:20 | |
*** esker has quit IRC | 14:20 | |
*** eharney has joined #openstack-cinder | 14:21 | |
*** esker has joined #openstack-cinder | 14:21 | |
*** markvoelker has joined #openstack-cinder | 14:25 | |
*** diablo_rojo has quit IRC | 14:26 | |
*** kfarr has joined #openstack-cinder | 14:26 | |
*** markvoelker has quit IRC | 14:30 | |
*** crose has joined #openstack-cinder | 14:31 | |
*** avishay has joined #openstack-cinder | 14:34 | |
*** edmondsw has joined #openstack-cinder | 14:35 | |
*** rajinir has joined #openstack-cinder | 14:37 | |
*** crose has quit IRC | 14:38 | |
*** karthikp has joined #openstack-cinder | 14:39 | |
*** kfarr has quit IRC | 14:42 | |
*** smcginnis has quit IRC | 14:42 | |
*** kfarr has joined #openstack-cinder | 14:43 | |
*** Yogi1 has joined #openstack-cinder | 14:44 | |
*** salv-orlando has quit IRC | 14:49 | |
*** lprice has joined #openstack-cinder | 14:49 | |
*** jdurgin1 has joined #openstack-cinder | 14:49 | |
*** salv-orlando has joined #openstack-cinder | 14:50 | |
*** aleksey0 has joined #openstack-cinder | 14:53 | |
*** merooney has joined #openstack-cinder | 14:53 | |
openstackgerrit | Eric Harney proposed openstack/cinder: Fix up RPC cleanup process https://review.openstack.org/316895 | 14:53 |
*** aleksey0 is now known as alekseyruban | 14:53 | |
*** merooney has quit IRC | 14:54 | |
*** diablo_rojo has joined #openstack-cinder | 14:55 | |
dulek | jgriffith: Hi, my teammates are playing with SolidFire backend connected to OS deployment in Kilo version. They use Ceph as Glance backend. Is there a way to prevent double copying when booting from volume? | 14:55 |
dulek | jgriffith: Right now this is copying image out of Ceph and then into volume on SF backend. | 14:55 |
dulek | jgriffith: Image cache got in in Liberty, so they cannot use that to speed it up. | 14:56 |
*** superdan is now known as dansmith | 14:56 | |
jgriffith | dulek: SolidFire driver has a cache that was added I believe in Kilo | 14:56 |
jgriffith | dulek: lemme verify :) | 14:56 |
dulek | jgriffith: That's the one: https://blueprints.launchpad.net/cinder/+spec/implement-solidfire-cloneimage | 14:56 |
jgriffith | dulek: ahh.. yeah | 14:56 |
jgriffith | dulek: I thought you meant the "general" one | 14:56 |
jgriffith | dulek: so I think I have a Kilo backport somewhere | 14:57 |
jgriffith | dulek: that's the only option really | 14:57 |
e0ne | dulek: AFAIK, this issue is related not only to SolidFire driver | 14:57 |
dulek | jgriffith: The general one implemented by patrickeast? | 14:57 |
jgriffith | e0ne: correct | 14:57 |
*** liverpooler has joined #openstack-cinder | 14:57 | |
jgriffith | dulek: yes, that's the general impl, but I do have a backport of the SolidFire version that we did for some customers | 14:58 |
*** Julien-zte has quit IRC | 14:58 | |
dulek | jgriffith: Wait, so that's not working in Kilo: https://review.openstack.org/#/c/142859/16/cinder/volume/drivers/solidfire.py ? | 14:58 |
*** smcginnis has joined #openstack-cinder | 14:58 | |
*** ChanServ sets mode: +o smcginnis | 14:58 | |
jgriffith | dulek: Oh, sorry | 14:59 |
*** merooney has joined #openstack-cinder | 14:59 | |
jgriffith | dulek: Kilo yes | 14:59 |
*** Julien-zte has joined #openstack-cinder | 14:59 | |
jgriffith | dulek: backports for Juno :) | 14:59 |
*** arch-nemesis has joined #openstack-cinder | 15:00 | |
*** diogogmt has joined #openstack-cinder | 15:00 | |
jgriffith | dulek: the SolidFire specific one was added in Kilo and yes, that should work | 15:00 |
*** esker has quit IRC | 15:00 | |
dulek | jgriffith: Okay, I'll point guys to that snippet so they can review configuration and codepaths to see if images are cached. | 15:00 |
dulek | jgriffith: Thanks! | 15:00 |
jgriffith | dulek: sure, let me know if they run into problems | 15:00 |
*** julim has quit IRC | 15:01 | |
*** itlinux has quit IRC | 15:02 | |
*** julim has joined #openstack-cinder | 15:03 | |
*** bluex has quit IRC | 15:03 | |
*** Julien-zte has quit IRC | 15:04 | |
alekseyruban | Hi guys. I encountered an issue when tried to run tempest test_shelve_volume_backed_instance test. The first run works fine but after that other runs hang for a while and I get an error in c-vol screen. Some uncought exception in privsep client channel. Can you help me? | 15:05 |
*** mmotiani_ has quit IRC | 15:05 | |
*** ntpttr- has joined #openstack-cinder | 15:05 | |
alekseyruban | he exception is: | 15:05 |
alekseyruban | Exception in thread privsep_reader: | 15:06 |
alekseyruban | Traceback (most recent call last): | 15:06 |
alekseyruban | File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner | 15:06 |
alekseyruban | self.run() | 15:06 |
alekseyruban | File "/usr/lib/python2.7/threading.py", line 763, in run | 15:06 |
alekseyruban | self.__target(*self.__args, **self.__kwargs) | 15:06 |
alekseyruban | File "/usr/local/lib/python2.7/dist-packages/oslo_privsep/comm.py", line 127, in _reader_main | 15:06 |
alekseyruban | for msg in reader: | 15:06 |
alekseyruban | File "/usr/local/lib/python2.7/dist-packages/six.py", line 558, in next | 15:06 |
alekseyruban | return type(self).__next__(self) | 15:06 |
alekseyruban | File "/usr/local/lib/python2.7/dist-packages/oslo_privsep/comm.py", line 78, in next | 15:06 |
alekseyruban | buf = self.readsock.recv(4096) | 15:06 |
alekseyruban | File "/usr/local/lib/python2.7/dist-packages/eventlet/greenio/base.py", line 349, in recv | 15:06 |
alekseyruban | return self._recv_loop(self.fd.recv, bufsize, flags) | 15:06 |
*** bluex has joined #openstack-cinder | 15:06 | |
*** avishay has quit IRC | 15:07 | |
alekseyruban | Also volume status becomes to be downloading | 15:08 |
*** crose has joined #openstack-cinder | 15:08 | |
*** gouthamr has joined #openstack-cinder | 15:09 | |
jgriffith | alekseyruban: sadly I haven't quite figured out privsep yet | 15:09 |
jgriffith | alekseyruban: I think hemna was working with Gus on that? | 15:09 |
jgriffith | alekseyruban: he may have some insight, otherwise I'd have to try and duplicate the failure | 15:10 |
jgriffith | alekseyruban: are you using the LVM driver? | 15:10 |
alekseyruban | Nexenta iSCSI for NexentaStor4 | 15:10 |
*** mmotiani_ has joined #openstack-cinder | 15:10 | |
alekseyruban | It strated to happen a month ago | 15:10 |
*** merooney has quit IRC | 15:11 | |
*** haplo37 has joined #openstack-cinder | 15:11 | |
jgriffith | alekseyruban: sounds like maybe you had a rootwrap cmd that didn't get copied over? | 15:11 |
*** lennyb has joined #openstack-cinder | 15:11 | |
jgriffith | alekseyruban: or doesn't work quite right any more? | 15:11 |
*** buhman has joined #openstack-cinder | 15:11 | |
alekseyruban | jgriffith: we didn't touch the driver. It stopped working. Also out nedge driver has the same problem | 15:12 |
jgriffith | alekseyruban: right, that's what I'm saying... one of the changes to do the conversion may have left your driver behind | 15:13 |
jgriffith | alekseyruban: see what I mean? | 15:13 |
jgriffith | alekseyruban: do you have a full trace of the failure? | 15:13 |
*** jwcroppe has joined #openstack-cinder | 15:14 | |
jgriffith | alekseyruban: like something here maybe? | 15:14 |
jgriffith | alekseyruban: I don't know how... but worth looking at | 15:14 |
*** Swanson has quit IRC | 15:14 | |
jgriffith | alekseyruban: oh... wati, that's just a comment change | 15:15 |
alekseyruban | It's the full. There is no any exception in the log. And it happens suddenly. It can be working some time and then fell down | 15:15 |
alekseyruban | It's the full. There is no any exception in the log. And it happens suddenly. It can be working some time and then falls down | 15:15 |
jgriffith | alekseyruban: hmm... that's rather disappointing | 15:15 |
jgriffith | alekseyruban: might have better luck pinging the privsep experts... maybe in oslo? | 15:15 |
jgriffith | alekseyruban: hemna is still a good starting point as I think his brick code is where that's getting picked up | 15:16 |
*** jwcropp__ has quit IRC | 15:16 | |
*** jwcroppe_ has joined #openstack-cinder | 15:17 | |
*** Swanson has joined #openstack-cinder | 15:17 | |
*** eantyshev has joined #openstack-cinder | 15:17 | |
*** itlinux has joined #openstack-cinder | 15:18 | |
*** avishay has joined #openstack-cinder | 15:19 | |
*** jwcroppe has quit IRC | 15:19 | |
alekseyruban | jgriffith: thanks. I'll try oslo | 15:20 |
*** alekseyruban has quit IRC | 15:21 | |
*** xinli has joined #openstack-cinder | 15:24 | |
*** karthikp has quit IRC | 15:28 | |
*** iceyao has joined #openstack-cinder | 15:30 | |
*** savihou has quit IRC | 15:30 | |
*** kamsz has joined #openstack-cinder | 15:31 | |
*** esker has joined #openstack-cinder | 15:31 | |
*** esker has quit IRC | 15:31 | |
*** esker has joined #openstack-cinder | 15:32 | |
*** leeantho has joined #openstack-cinder | 15:33 | |
*** harlowja_at_home has joined #openstack-cinder | 15:34 | |
*** lcurtis has joined #openstack-cinder | 15:36 | |
*** kmartin has joined #openstack-cinder | 15:38 | |
yuriy_n17 | jgriffith: Hi! Very sorry for disturbing. Please review https://review.openstack.org/#/c/314482/ whenever you have free time. | 15:40 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/cinder: Updated from global requirements https://review.openstack.org/316343 | 15:43 |
*** dustins_ has joined #openstack-cinder | 15:44 | |
*** esker has quit IRC | 15:44 | |
jgriffith | yuriy_n17: that looks great | 15:44 |
jgriffith | yuriy_n17: might be worth adding a unit test | 15:44 |
jgriffith | yuriy_n17: would you mind doing that? | 15:45 |
jgriffith | I'll +2/A it if you do | 15:45 |
jgriffith | yuriy_n17: meh | 15:45 |
jgriffith | yuriy_n17: never mind | 15:45 |
*** dustins has quit IRC | 15:46 | |
*** dillaman has joined #openstack-cinder | 15:46 | |
yuriy_n17 | jgriffith: Thank you ever so much. Sorry for disturbing. | 15:47 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/cinder: Updated from global requirements https://review.openstack.org/316343 | 15:55 |
*** sheel has joined #openstack-cinder | 15:56 | |
*** fernnest has joined #openstack-cinder | 15:57 | |
*** fernnest_ has joined #openstack-cinder | 15:57 | |
sheel | jungleboyj: hi | 15:58 |
jungleboyj | sheel: Hi. | 15:58 |
*** jwcroppe_ has quit IRC | 15:59 | |
sheel | jungleboyj: regarding backporting of https://review.openstack.org/#/c/316353/1 | 15:59 |
*** jwcroppe has joined #openstack-cinder | 15:59 | |
sheel | jungleboyj: actually we want to remove xml API from API ref in newton as same is removed from cinder API.. | 15:59 |
sheel | jungleboyj: but it is not possible to remove this from newton untill unless we backport API-ref in mitaka | 15:59 |
sheel | jungleboyj: so plan was like | 16:00 |
sheel | 1. Implement it with xml in newton. | 16:00 |
sheel | 2. Backport to mitaka. | 16:00 |
sheel | 3. Remove XML api from Newton. | 16:00 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/os-brick: Updated from global requirements https://review.openstack.org/316953 | 16:00 |
*** adrianofr has joined #openstack-cinder | 16:01 | |
*** rlrossit has joined #openstack-cinder | 16:02 | |
*** jwcroppe_ has joined #openstack-cinder | 16:02 | |
*** julim has quit IRC | 16:04 | |
*** jwcroppe has quit IRC | 16:04 | |
*** savihou has joined #openstack-cinder | 16:05 | |
*** julim has joined #openstack-cinder | 16:06 | |
*** earlephilhower has quit IRC | 16:06 | |
sheel | jungleboyj: are you convinced? ;) | 16:07 |
jungleboyj | smcginnis: ^^^ Have you been involved in the work that sheel is talking about? | 16:08 |
*** timcl has quit IRC | 16:08 | |
*** raunak has joined #openstack-cinder | 16:09 | |
jgriffith | sheel: did you see this? | 16:09 |
jgriffith | http://lists.openstack.org/pipermail/openstack-dev/2016-May/095077.html | 16:09 |
sheel | jgriffith: yep..I am going to update accordingly | 16:09 |
jgriffith | sheel: k, cool | 16:09 |
sheel | jgriffith: sean dague update me about it | 16:09 |
jgriffith | sheel: ahh... excellent | 16:09 |
sheel | jgriffith: thanks | 16:10 |
sheel | dulek: hey.. you back.. | 16:10 |
jgriffith | sheel: hehe... ok, I see the conversation in the comments :) | 16:10 |
sheel | jgriffith: ;) | 16:11 |
sheel | dulek: congratulations... good luck for new role.. | 16:11 |
sheel | jgriffith: still a lot of things to clear from API-ref | 16:12 |
sheel | jgriffith: too big thing to cover.. | 16:12 |
jgriffith | sheel: yeah... honestly you could almost consider the lack of api-ref as a bug :) | 16:12 |
sheel | jgriffith: targetting one resource (all APIs) a day.. | 16:12 |
jgriffith | sheel: that's pretty ambitious | 16:12 |
sheel | jgriffith: hope i will get support from reviewers...(I always get :)) | 16:13 |
* sheel finds it quite boring to implement API-ref... | 16:14 | |
sheel | need motivation to complete it... :) | 16:14 |
mtanino | but it will help admin and users, I hope! | 16:14 |
sheel | mtanino: yep for sure... | 16:15 |
* sheel mtanino: you can refer one at https://review.openstack.org/#/c/316587/ | 16:15 | |
*** salv-orl_ has joined #openstack-cinder | 16:15 | |
*** Simonsen has joined #openstack-cinder | 16:16 | |
*** laughterwym has quit IRC | 16:16 | |
jungleboyj | sheel: Ok, I guess I was not aware that this would require a backport to Mitaka. I will pull my -2 off and stay out of the way. | 16:16 |
openstackgerrit | Karthik Prabhu Vinod proposed openstack/cinder: Add ServiceTopic & ServiceDisabledReason Enum https://review.openstack.org/313179 | 16:16 |
*** laughterwym has joined #openstack-cinder | 16:17 | |
mtanino | sheel: wow, large patch... | 16:17 |
sheel | jungleboyj: yes please...but please review once i am done with cleaning | 16:17 |
sheel | jungleboyj: i will remind you ... | 16:17 |
*** jwcroppe has joined #openstack-cinder | 16:17 | |
sheel | mtanino: yes... I have other 2000 LOC in my vm which is cleaned for current API ref... going to come in next 2 days... ;) | 16:18 |
*** salv-orlando has quit IRC | 16:18 | |
*** jwcroppe_ has quit IRC | 16:21 | |
*** laughterwym has quit IRC | 16:21 | |
*** julim has quit IRC | 16:23 | |
openstackgerrit | Adriano Freires Rosso proposed openstack/cinder: HNAS drivers refactoring https://review.openstack.org/285469 | 16:25 |
openstackgerrit | Adriano Freires Rosso proposed openstack/cinder: Deprecating XML config file https://review.openstack.org/294076 | 16:25 |
*** e0ne has quit IRC | 16:25 | |
*** lpetrut has quit IRC | 16:27 | |
*** merooney has joined #openstack-cinder | 16:30 | |
*** Apoorva has joined #openstack-cinder | 16:30 | |
*** darosale has quit IRC | 16:31 | |
*** julim has joined #openstack-cinder | 16:34 | |
*** caspinol has quit IRC | 16:35 | |
*** lprice has quit IRC | 16:35 | |
*** savihou has quit IRC | 16:40 | |
*** IlyaG has joined #openstack-cinder | 16:41 | |
*** savihou has joined #openstack-cinder | 16:41 | |
*** The_Ball has joined #openstack-cinder | 16:45 | |
eharney | guitarzan: do you have a full log from https://bugs.launchpad.net/cinder/+bug/1582306 ? | 16:46 |
openstack | Launchpad bug 1582306 in Cinder "test_retype_volume_migration_failed "Notifier count incorrect"" [Undecided,New] | 16:46 |
*** merooney has quit IRC | 16:47 | |
*** links has quit IRC | 16:47 | |
*** timcl has joined #openstack-cinder | 16:48 | |
xinli | xyang1: two items 1) the patch # 307451 https://review.openstack.org/#/c/307451, the Flashsystem driver owner reviewed code and also Flashsystem CI passed. 2) for 268283, I fixed partial code, but I have one question, does cinder bd maintain the cgsnapshot status or the driver code will update it aftter the delete_cgsnapshots() completes? | 16:49 |
dulek | sheel: Thanks! :) | 16:53 |
*** merooney has joined #openstack-cinder | 16:53 | |
*** harlowja_at_home has quit IRC | 16:53 | |
*** IlyaG has quit IRC | 16:54 | |
*** jgregor has quit IRC | 16:55 | |
openstackgerrit | Kendall Nelson proposed openstack/cinder: Add SnapshotStatus enum field https://review.openstack.org/284825 | 16:56 |
openstackgerrit | Eric Harney proposed openstack/cinder: Tests: Use unique volume IDs in backup tests https://review.openstack.org/316993 | 16:57 |
*** baumann has quit IRC | 16:57 | |
*** cknight has quit IRC | 16:58 | |
*** cknight has joined #openstack-cinder | 16:58 | |
xyang1 | xinli: driver return status and manager will update db based on what driver returns | 16:59 |
*** diablo_rojo1 has joined #openstack-cinder | 17:00 | |
*** jistr has quit IRC | 17:02 | |
*** alkhodos has joined #openstack-cinder | 17:04 | |
*** jungleboyj has quit IRC | 17:05 | |
*** cknight1 has joined #openstack-cinder | 17:05 | |
*** diablo_rojo has quit IRC | 17:05 | |
*** merooney has quit IRC | 17:05 | |
*** cknight has quit IRC | 17:07 | |
alkhodos | Hi everyone. Does anyone else have issues with creating iSCSI volumes from images or maybe know why this happens? When I try to do so it can either create successfully or just hang in "downloading" state forever, and it seems completely random. | 17:07 |
smcginnis | alkhodos: There was someone here earlier having privsep issues with Nexenta, | 17:08 |
smcginnis | alkhodos: Sounds kind of similar. | 17:08 |
smcginnis | alkhodos: Do you see any traceback errors in the logs? | 17:08 |
alkhodos | @smcginnis: I am from Nexenta too :) I only see traceback in warnings, but they are there in successful creations too | 17:09 |
smcginnis | alkhodos: Yep, I knew, just wasn't sure if you were actually hitting the same thing. :) | 17:10 |
smcginnis | alkhodos: Sounds different. | 17:10 |
alkhodos | @smcginnis: well it is related to privsep | 17:10 |
*** jdurgin1 has quit IRC | 17:10 | |
alkhodos | @smcginnis: but I just can't even think of how to debug this anymore | 17:10 |
alkhodos | @smcginnis: since it can go 5 times success and then 5 times hang | 17:11 |
smcginnis | alkhodos: Do you know where things are hanging? | 17:11 |
openstackgerrit | Kendall Nelson proposed openstack/cinder: Add VolumeAttachStatus Enum https://review.openstack.org/290885 | 17:11 |
*** diablo_rojo1 has quit IRC | 17:11 | |
*** avishay has quit IRC | 17:12 | |
*** david-lyle_ has quit IRC | 17:12 | |
*** david-lyle has joined #openstack-cinder | 17:13 | |
alkhodos | here is what I have in log http://paste.openstack.org/show/497246/ After this it just stops responding. | 17:14 |
*** esker has joined #openstack-cinder | 17:14 | |
*** esker has quit IRC | 17:14 | |
ildikov | thingee: hi | 17:14 |
*** esker has joined #openstack-cinder | 17:14 | |
ildikov | thingee: sorry, I gave it up on Friday by the time you pinged | 17:15 |
ildikov | thingee: my question is basically that which channel to use for the Cinder-Nova meeting we're having for a short while now, I got lost in the mail thread | 17:15 |
smcginnis | alkhodos: Hmm, looks like it successfully reads and returns the contents of /etc/isci/iniatorname.iscsi | 17:16 |
hemna | hey what's up | 17:20 |
smcginnis | alkhodos: Check the memory consumption next time it hangs. | 17:20 |
hemna | smcginnis, alkhodos attach issues ? | 17:20 |
smcginnis | hemna: Occasionally stuck with "Downloading" status. | 17:20 |
alkhodos | hemna: not really, attach goes fine | 17:21 |
smcginnis | hemna: Am I missing something? This looks like infinite recursion: https://github.com/openstack/os-brick/blob/6d71d55caf50d56ee23f314c1fa1e3fed1626c4d/os_brick/initiator/connector.py#L147 | 17:21 |
hemna | heh no | 17:21 |
hemna | the connector is the class | 17:22 |
hemna | not the function in the file called connector.py | 17:22 |
hemna | https://github.com/openstack/os-brick/blob/6d71d55caf50d56ee23f314c1fa1e3fed1626c4d/os_brick/initiator/connector.py#L141 | 17:22 |
smcginnis | Ah, I see. | 17:22 |
hemna | we give every connector class a chance now to report any initiator information | 17:22 |
hemna | alkhodos, are you using an unreleased os-brick ? | 17:23 |
hemna | from master ? | 17:23 |
guitarzan | eharney: that one isn't me, sorry | 17:23 |
alkhodos | hemna: it's the same on master and stable/mitaka | 17:24 |
hemna | the latest released 1.3.0 os-brick doesn't have privsep yet | 17:24 |
*** dims_ has joined #openstack-cinder | 17:25 | |
alkhodos | hemna: where can I check os-brick ver? | 17:26 |
*** dims has quit IRC | 17:26 | |
hemna | pip freeze |grep os-brick | 17:27 |
eharney | guitarzan: whoops, i knew that :) | 17:27 |
*** jungleboyj has joined #openstack-cinder | 17:28 | |
guitarzan | you've got a patch anyway :) | 17:29 |
*** enriquetaso has joined #openstack-cinder | 17:29 | |
alkhodos | $ pip freeze |grep os-brick -e git://git.openstack.org/openstack/os-brick.git@934cdef509ca324b14f4ea5269524e48e924ce09#egg=os_brick | 17:29 |
xinli | geguileo: I fixed all the issue which you mentioned in code review patch # 268283, but I stll have one question regarding the CG snapshot status update. The link: https://review.openstack.org/#/c/268283/6/cinder/volume/drivers/ibm/gpfs.py | 17:30 |
hemna | alkhodos, ok that's a non released version | 17:30 |
hemna | probably from master is my guess | 17:30 |
alkhodos | hemna: turns out I had this in my local.conf; LIBS_FROM_GIT=os-brick | 17:31 |
*** lprice has joined #openstack-cinder | 17:31 | |
alkhodos | hemna: don't remember why already... | 17:31 |
alkhodos | hemna: probably the reason | 17:31 |
hemna | well | 17:31 |
hemna | so.... | 17:31 |
*** suyash has joined #openstack-cinder | 17:31 | |
hemna | it would still be nice to find out where you are hanging | 17:31 |
hemna | if it is a bug in brick, we need to find it :) | 17:31 |
hemna | so you can remove the existing install | 17:32 |
hemna | and install from pip | 17:32 |
hemna | and see if the issue goes away | 17:32 |
hemna | if it does, then install from git again... | 17:32 |
hemna | please :) | 17:32 |
alkhodos | hemna: I'm already in progress of installing fresh devstack without that line :) | 17:32 |
*** esker has quit IRC | 17:33 | |
*** mvk has quit IRC | 17:33 | |
smcginnis | alkhodos: Good to have it there for testing against os-brick before it's released. But probably don't want to run that way otherwise. ;) | 17:33 |
*** baumann has joined #openstack-cinder | 17:33 | |
smcginnis | So it does look there's an issue there. | 17:33 |
alkhodos | hemna: @smcginnis: thanks for your help, will update with my results :) | 17:33 |
hemna | ok cool | 17:33 |
smcginnis | We probably do need to figure out what's going on before we release a new os-brick. | 17:34 |
*** jungleboyj has quit IRC | 17:34 | |
hemna | if the volume has attached | 17:34 |
hemna | then brick was done | 17:34 |
hemna | alkhodos, can you post the log in pastebin? | 17:34 |
hemna | I'd like to see them | 17:34 |
alkhodos | hemna: ye sure, which logs do u need? | 17:34 |
alkhodos | hemna: just the c-vol? | 17:35 |
hemna | c-vol | 17:35 |
hemna | this was from a copy image to volume ? | 17:35 |
hemna | if so, then all the logs are in c-vol | 17:36 |
alkhodos | hemna: yes, copy image to vol. Here is the full log from start of create till it hangs http://paste.openstack.org/show/497250/ | 17:38 |
hemna | thanks | 17:39 |
hemna | ok | 17:39 |
hemna | so those privesep WARNINGS aren't really warnings | 17:39 |
hemna | I think those should be changed to DEBUG | 17:39 |
hemna | WARNING oslo.privsep.daemon [-] privsep log: CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.005s | 17:40 |
hemna | 0 return = success | 17:40 |
hemna | fwiw, that doesn't look like the complete log | 17:41 |
hemna | that's only the front side of the attach process | 17:41 |
hemna | attach process is basically this: | 17:41 |
hemna | 1) collect initiator information | 17:41 |
hemna | 2) call driver to attach (initialize_connection) | 17:41 |
hemna | 3) discover volume attachment | 17:41 |
hemna | that log only got to the end of part 1 | 17:41 |
*** merooney has joined #openstack-cinder | 17:42 | |
alkhodos | hemna: here is what goes after that http://paste.openstack.org/show/497252/ | 17:42 |
alkhodos | just the status checks | 17:43 |
hemna | hrmm | 17:44 |
hemna | that's not good | 17:45 |
hemna | we should see it trying other connectors | 17:46 |
hemna | https://github.com/openstack/os-brick/blob/master/os_brick/initiator/connector.py#L145 | 17:46 |
*** mriedem is now known as mriedem_afk | 17:46 | |
alkhodos | hemna: that is what I can't understand, sometimes it does and sometime it just stops here | 17:47 |
*** rcernin has quit IRC | 17:47 | |
*** diablo_rojo has joined #openstack-cinder | 17:51 | |
*** e0ne has joined #openstack-cinder | 17:52 | |
hemna | alkhodos, do you still have the VM with that setup ? | 17:54 |
openstackgerrit | Vasanthi Thirumalai proposed openstack/cinder: Violin Memory ISCSI storage for 7000 series AFA https://review.openstack.org/269796 | 17:55 |
alkhodos | hemna: yes | 17:55 |
hemna | alkhodos, https://gist.github.com/2f74696645f6d2cea9c34570af9c45a3 | 18:00 |
hemna | apply that and re-run the test | 18:00 |
hemna | see if you can reproduce it | 18:00 |
hemna | that should output some more debugging along the process of building the connector. | 18:01 |
hemna | we'll see if it gets out of that function or hangs. | 18:01 |
*** bardia has joined #openstack-cinder | 18:02 | |
*** rlrossit has quit IRC | 18:03 | |
*** dustins_ has quit IRC | 18:05 | |
*** kfarr has quit IRC | 18:05 | |
*** dustins has joined #openstack-cinder | 18:05 | |
*** julim has quit IRC | 18:07 | |
*** dustins has quit IRC | 18:07 | |
*** dustins has joined #openstack-cinder | 18:08 | |
*** julim has joined #openstack-cinder | 18:08 | |
*** delattec has joined #openstack-cinder | 18:09 | |
*** yangyapeng has quit IRC | 18:10 | |
*** cdelatte has quit IRC | 18:12 | |
*** merooney has quit IRC | 18:13 | |
*** jungleboyj has joined #openstack-cinder | 18:13 | |
*** delatte has joined #openstack-cinder | 18:14 | |
*** IlyaG has joined #openstack-cinder | 18:16 | |
*** laughterwym has joined #openstack-cinder | 18:17 | |
*** delattec has quit IRC | 18:17 | |
*** merooney has joined #openstack-cinder | 18:20 | |
*** aleksey2 has joined #openstack-cinder | 18:21 | |
*** aleksey2 has quit IRC | 18:21 | |
*** aleksey4 has joined #openstack-cinder | 18:22 | |
*** laughterwym has quit IRC | 18:22 | |
*** aleksey4 is now known as alekseyruban | 18:22 | |
*** savihou has quit IRC | 18:26 | |
*** kfarr has joined #openstack-cinder | 18:26 | |
*** e0ne has quit IRC | 18:28 | |
*** e0ne has joined #openstack-cinder | 18:31 | |
*** diablo_rojo has quit IRC | 18:32 | |
*** diablo_rojo has joined #openstack-cinder | 18:32 | |
*** baumann1 has joined #openstack-cinder | 18:33 | |
*** baumann has quit IRC | 18:33 | |
*** baumann has joined #openstack-cinder | 18:33 | |
alkhodos | hemna: funny thing - I'm not able to reproduce the issue after I added additional debugging | 18:34 |
hemna | hrmm | 18:34 |
hemna | comment out the debugging ? | 18:35 |
hemna | wth | 18:35 |
*** e0ne has quit IRC | 18:35 | |
*** IlyaG has quit IRC | 18:36 | |
*** baumann1 has quit IRC | 18:37 | |
*** jgregor has joined #openstack-cinder | 18:39 | |
*** lpetrut has joined #openstack-cinder | 18:40 | |
*** jgregor has quit IRC | 18:40 | |
*** merooney has quit IRC | 18:40 | |
*** krtaylor has quit IRC | 18:44 | |
*** mriedem_afk is now known as mriedem | 18:44 | |
*** yangyapeng has joined #openstack-cinder | 18:46 | |
*** merooney has joined #openstack-cinder | 18:47 | |
openstackgerrit | Walter A. Boring IV (hemna) proposed openstack/os-brick: Add support for processutils.execute https://review.openstack.org/309201 | 18:48 |
*** iceyao has quit IRC | 18:49 | |
*** kamsz has quit IRC | 18:54 | |
*** kamsz has joined #openstack-cinder | 18:54 | |
*** angela-s has joined #openstack-cinder | 18:58 | |
*** edmondsw has quit IRC | 19:02 | |
alkhodos | hemna: http://paste.openstack.org/show/497257/ | 19:06 |
*** salv-orl_ has quit IRC | 19:07 | |
openstackgerrit | Eric Harney proposed openstack/cinder: Tests: Use unique volume IDs in backup tests https://review.openstack.org/316993 | 19:09 |
openstackgerrit | Eric Harney proposed openstack/cinder: Tests: Use mock for notifier tests https://review.openstack.org/317055 | 19:09 |
openstackgerrit | Kendall Nelson proposed openstack/os-brick: WIP: Splitting Out Connectors from connector.py :WIP https://review.openstack.org/307974 | 19:13 |
xinli | xyang1: I reviewed your code review comments. yes, I didn't modify the code in flashSystem FC, the component owner still insists that I should add the version updated in order to make consistent. this is his answer: Yes, we have to make all history on the same page. | 19:14 |
xinli | Best Wishes, | 19:14 |
xinli | Edwin Wang 王杨鸣 | 19:14 |
*** merooney has quit IRC | 19:16 | |
openstackgerrit | Helen Walsh proposed openstack/cinder: EMC VMAX - locking SG for concurrent threads https://review.openstack.org/317057 | 19:17 |
*** arch-nemesis has quit IRC | 19:17 | |
*** merooney has joined #openstack-cinder | 19:20 | |
*** merooney has quit IRC | 19:20 | |
*** raunak has quit IRC | 19:21 | |
*** merooney has joined #openstack-cinder | 19:21 | |
*** caspinol has joined #openstack-cinder | 19:22 | |
openstackgerrit | Helen Walsh proposed openstack/cinder: EMC VMAX - iSCSI Multipath support https://review.openstack.org/317060 | 19:23 |
openstackgerrit | Angela Smith proposed openstack/cinder: Fix Brcd zone driver initiator zone update https://review.openstack.org/317061 | 19:24 |
*** lpetrut has quit IRC | 19:24 | |
openstackgerrit | Sean McGinnis proposed openstack/cinder: Add sample config file to cinder docs https://review.openstack.org/314220 | 19:27 |
*** diablo_rojo has quit IRC | 19:29 | |
*** Simonsen has quit IRC | 19:30 | |
*** caspinol has quit IRC | 19:30 | |
*** Lee1092 has quit IRC | 19:32 | |
*** Simonsen has joined #openstack-cinder | 19:34 | |
openstackgerrit | Merged openstack/os-brick: Updated from global requirements https://review.openstack.org/316953 | 19:36 |
*** e0ne has joined #openstack-cinder | 19:38 | |
hemna | alkhodos, still looks like it's stuck ? | 19:38 |
*** Simonsen_ has joined #openstack-cinder | 19:39 | |
openstackgerrit | Sean McGinnis proposed openstack/cinder: Add driver interface checks https://review.openstack.org/297140 | 19:39 |
*** e0ne has quit IRC | 19:40 | |
*** Simonsen has quit IRC | 19:41 | |
openstackgerrit | Xinli Guan proposed openstack/cinder: IBM FlashSystem: Cleanup host resource leaking https://review.openstack.org/307451 | 19:42 |
*** rcernin has joined #openstack-cinder | 19:43 | |
*** edmondsw has joined #openstack-cinder | 19:44 | |
*** sheel has quit IRC | 19:45 | |
*** kfarr has quit IRC | 19:48 | |
*** kfarr has joined #openstack-cinder | 19:53 | |
*** jgregor has joined #openstack-cinder | 19:54 | |
*** caspinol has joined #openstack-cinder | 19:55 | |
*** merooney has quit IRC | 19:58 | |
*** karthikp has joined #openstack-cinder | 20:04 | |
openstackgerrit | Eric Harney proposed openstack/cinder: Tests: Don't attempt connection for Coho driver init https://review.openstack.org/317071 | 20:05 |
*** diablo_rojo has joined #openstack-cinder | 20:05 | |
*** raunak has joined #openstack-cinder | 20:07 | |
*** krtaylor has joined #openstack-cinder | 20:08 | |
xyang1 | xinli: hi, just stating that this is for iscsi in history sounds good to me | 20:12 |
*** cknight1 has quit IRC | 20:12 | |
*** caspinol has quit IRC | 20:13 | |
*** xingyang has joined #openstack-cinder | 20:16 | |
*** salv-orlando has joined #openstack-cinder | 20:17 | |
xinli | smcginnis: I uploaded a PatchSet for IBM FlashSystem, but Gerrit throws error message that HGST Solution CI syaing the code could not be megred. https://review.openstack.org/#/c/307451/ Do you have any suggestion to debug? | 20:17 |
smcginnis | xinli: That is an issue with the HGST CI system. You don't need to worry about that. | 20:18 |
*** caspinol has joined #openstack-cinder | 20:21 | |
*** avishay has joined #openstack-cinder | 20:22 | |
xingyang | smcginnis, jungleboyj, hemna: we returned size in model_update in create_volume in scaleio driver for the 8GB issue discussed at the summit: https://review.openstack.org/#/c/316811/ | 20:24 |
xingyang | smcginnis, jungleboyj, hemna: but it could not pass CI. There is a check in the API that blocks creating a volume from snapshot if volume size is smaller than source: https://github.com/openstack/cinder/blob/master/cinder/volume/flows/api/create_volume.py#L146 | 20:25 |
smcginnis | xingyang: SHoot, didn't think of that. | 20:25 |
jungleboyj | OOps. | 20:25 |
smcginnis | So maybe no easy fix on that one. :/ | 20:25 |
xingyang | smcginnis, jungleboyj: more complicated than we thought:( | 20:26 |
jungleboyj | xingyang: :-( | 20:26 |
smcginnis | I think we'll have to add the mechanism for drivers to report back their size allocation units, then on things like requesting a volume from snapshot we can see that even though they are requesting 1 they will get 8. | 20:26 |
eharney | wouldn't returning back a different size cause the quotas to be broken anyway? | 20:27 |
xingyang | smcginnis: tempest will try to create 1GB volumes, so even with that we still could not pass tempest | 20:27 |
openstackgerrit | Eric Harney proposed openstack/cinder: Move CG unit tests to test_cg.py https://review.openstack.org/315736 | 20:28 |
xingyang | eharney: this was the temp solution we agreed at the summit | 20:28 |
openstackgerrit | Angela Smith proposed openstack/cinder: Fix Brcd zone driver initiator zone update https://review.openstack.org/317061 | 20:28 |
eharney | xingyang: it may be a broken temp solution | 20:28 |
*** mriedem is now known as mriedem_away | 20:28 | |
smcginnis | xingyang: Does tempest check the returned size? | 20:28 |
xingyang | smcginnis: no | 20:28 |
eharney | just because people agreed doesn't make it all correct | 20:28 |
*** caspinol has quit IRC | 20:29 | |
smcginnis | :) | 20:29 |
xingyang | smcginnis: I think if you don’t pass a size, 1 is the default:) | 20:29 |
smcginnis | xingyang: Yep | 20:29 |
smcginnis | xingyang: So we would definitely have to build in awareness to API calls and defaults that allocation unit would need to be taken into account. | 20:30 |
*** ericksonsantos has quit IRC | 20:30 | |
xingyang | smcginnis: right | 20:30 |
*** krtaylor has quit IRC | 20:32 | |
*** raildo is now known as raildo-afk | 20:33 | |
*** raildo-afk is now known as raildo | 20:33 | |
jungleboyj | smcginnis: ++ | 20:33 |
*** avishay has quit IRC | 20:33 | |
*** ericksonsantos has joined #openstack-cinder | 20:34 | |
*** sdake has quit IRC | 20:37 | |
*** sdake has joined #openstack-cinder | 20:37 | |
*** savihou has joined #openstack-cinder | 20:40 | |
*** xingyang has quit IRC | 20:41 | |
*** xingyang has joined #openstack-cinder | 20:41 | |
*** ericksonsantos has quit IRC | 20:41 | |
*** liverpooler has quit IRC | 20:42 | |
*** ericksonsantos has joined #openstack-cinder | 20:42 | |
*** Simonsen_ has quit IRC | 20:46 | |
*** mriedem_away is now known as mriedem | 20:46 | |
*** liverpooler has joined #openstack-cinder | 20:46 | |
eharney | fwiw the summit etherpad seems to say "Not a good idea to hack around this." w.r.t. quota issues. | 20:47 |
jungleboyj | eharney: Confirmed. :-) | 20:47 |
xingyang | eharney: yes, we didn’t have a solution for the quota issue | 20:48 |
xingyang | eharney: we asked whether we could return model_update as a partial solution and people were ok at the summit | 20:48 |
xingyang | eharney: it turns out this does not work either | 20:48 |
xingyang | eharney: so unless someone has another idea, we’ll wait for the complete solution | 20:49 |
*** CIA has quit IRC | 20:51 | |
*** Yogi1 has quit IRC | 20:51 | |
*** angela-s has quit IRC | 20:52 | |
*** porrua has quit IRC | 20:52 | |
*** gouthamr has quit IRC | 20:54 | |
*** julim has quit IRC | 20:55 | |
*** eharney has quit IRC | 20:57 | |
openstackgerrit | Merged openstack/cinder: VMware: Reduce volume creation time https://review.openstack.org/296934 | 21:06 |
*** timcl has quit IRC | 21:08 | |
*** xingyang has quit IRC | 21:10 | |
*** haplo37 has quit IRC | 21:11 | |
*** diablo_rojo has quit IRC | 21:11 | |
*** xingyang has joined #openstack-cinder | 21:11 | |
alkhodos | hemna: sorry, was afk. Yes, after a bunch of successful creations, started to hang again. Btw using stable brick helped | 21:12 |
*** savihou has quit IRC | 21:12 | |
*** savihou has joined #openstack-cinder | 21:12 | |
*** sgotliv_ has quit IRC | 21:13 | |
*** savihou has quit IRC | 21:14 | |
*** savihou has joined #openstack-cinder | 21:15 | |
*** jungleboyj has quit IRC | 21:16 | |
*** savihou has quit IRC | 21:19 | |
*** caspinol has joined #openstack-cinder | 21:21 | |
*** jgregor has quit IRC | 21:22 | |
*** raildo is now known as raildo-afk | 21:22 | |
*** enriquetaso has quit IRC | 21:29 | |
*** crose has quit IRC | 21:29 | |
hemna | os-brick 1.3.0 fix the problem ? | 21:30 |
*** gouthamr has joined #openstack-cinder | 21:32 | |
*** baumann has left #openstack-cinder | 21:32 | |
*** gouthamr_ has joined #openstack-cinder | 21:33 | |
jgriffith | xingyang: smcginnis just FYI, that's a long running *bug* that's been debated forever (create different size from snap) ask guitarzan about it :) | 21:34 |
jgriffith | xingyang: smcginnis one thing you can look at is resize on your own in the driver after the call | 21:34 |
*** xingyang has quit IRC | 21:34 | |
jgriffith | xingyang: smcginnis but the quota thing is going to be the thorn in your side | 21:35 |
hemna | yah we puked over that on Friday at the summit | 21:35 |
hemna | updating the quota might fail...sadness | 21:35 |
*** merooney has joined #openstack-cinder | 21:36 | |
*** merooney has quit IRC | 21:36 | |
*** xingyang has joined #openstack-cinder | 21:36 | |
*** gouthamr has quit IRC | 21:37 | |
xingyang | jgriffith: hi, the problem we have is scaleio can only create volume of size that is in 8GB multiples. so we try to address it temporarily by returning the real size in create volume | 21:39 |
hemna | why would the create from snap fail? | 21:40 |
hemna | I'm slow today | 21:40 |
xingyang | jgriffith: but then it could not pass tempest because tempest tries to create a volume of 1GB from a snapshot of 8GB | 21:40 |
hemna | because the tempest test is hard coded at 1G ? | 21:41 |
hemna | and doesn't use the snapshot size ? | 21:41 |
xingyang | hemna: so after we return the round up size of 8, the db is updated, a snapshot is created as 8 , but tempest always tries to create 1 GB volume from snap | 21:41 |
hemna | can't we change the tempest test to use the size of the snapshot ? | 21:41 |
hemna | unless we want to catch this particular failure in the test that's running. | 21:42 |
xingyang | hemna: it fails in api verfication | 21:42 |
*** enriquetaso has joined #openstack-cinder | 21:42 | |
xingyang | hemna: we check in api to see if volume size is not smaller than the source snapshot size | 21:42 |
hemna | yah I get that | 21:43 |
hemna | which is a valid failure | 21:43 |
xingyang | hemna: so you said we should change the tempest test? | 21:43 |
hemna | what I'm suggesting is, does it make sense to change the tempest test itself | 21:43 |
hemna | to create a volume with a size that is from the snapshot | 21:43 |
hemna | instead of a hard coded 1G value ? | 21:43 |
patrickeast | seems like it makes the most sense | 21:43 |
xingyang | hemna: sure, we could try that | 21:44 |
hemna | unless, the purpose of the test is to intentionally find this case :P | 21:44 |
*** karthikp has quit IRC | 21:44 | |
patrickeast | haha | 21:44 |
xingyang | hemna: :) | 21:44 |
hemna | xingyang, do you have the url to the review w/ the failure ? | 21:46 |
hemna | which tempest test pukes ? | 21:46 |
*** xingyang has quit IRC | 21:47 | |
*** xingyang has joined #openstack-cinder | 21:48 | |
xingyang | https://review.openstack.org/#/c/316811/2 | 21:48 |
*** kfarr has quit IRC | 21:49 | |
xingyang | hemna: Details: {u'code': 400, u'message': u"Invalid input received: Volume size '1'GB cannot be smaller than the snapshot size 8GB. They must be >= original | 21:49 |
hemna | tempest/scenario/test_volume_boot_pattern.py | 21:50 |
*** dustins has quit IRC | 21:50 | |
xingyang | hemna: if I’m not mistaken, the test does not pass in a size. by default the size is 1 if not passed in | 21:51 |
*** mriedem has quit IRC | 21:52 | |
hemna | yah it's not using a size at all | 21:52 |
hemna | https://github.com/openstack/tempest/blob/master/tempest/scenario/test_volume_boot_pattern.py#L103 | 21:52 |
hemna | https://github.com/openstack/tempest/blob/master/tempest/scenario/manager.py#L271-L272 | 21:53 |
hemna | so it only adds size if it's passed in. | 21:53 |
hemna | python-cinderclient requires a size on create | 21:55 |
xingyang | hemna: there is a default size of 1 here: https://github.com/openstack/tempest/blob/master/tempest/services/volume/base/base_volumes_client.py#L30 | 21:55 |
xingyang | hemna: https://github.com/openstack/tempest/blob/master/tempest/services/volume/base/base_volumes_client.py#L80 | 21:56 |
hemna | ah default_volume_size | 21:56 |
hemna | so.... | 21:56 |
hemna | I don't think it's unreasonable in this case to pull the size out of the snapshot | 21:57 |
hemna | and pass it | 21:57 |
*** markvoelker has joined #openstack-cinder | 21:57 | |
*** edmondsw has quit IRC | 21:58 | |
hemna | https://github.com/openstack/tempest/blob/master/tempest/scenario/test_volume_boot_pattern.py#L103 | 21:58 |
*** xingyang has quit IRC | 21:58 | |
jgriffith | hemna: You mean the parent volume's size? | 21:58 |
hemna | have to pull the snapshot and then get the size | 21:59 |
jgriffith | hemna: snapshots don't have a "size" | 21:59 |
hemna | sure | 21:59 |
*** xingyang has joined #openstack-cinder | 21:59 | |
xingyang | hemna: sure. I think there are probably a few other tests too that have the same issues. | 21:59 |
jgriffith | xingyang: +1 | 21:59 |
jgriffith | xingyang: I think there are some far reaching side effects if you do that | 22:00 |
hemna | the error suggests that the snapshot does have a size | 22:00 |
hemna | the wording at least | 22:00 |
*** jwcroppe has quit IRC | 22:00 | |
jgriffith | hemna: https://github.com/openstack/cinder/blob/master/cinder/db/sqlalchemy/models.py#L452 | 22:00 |
hemna | https://github.com/openstack/cinder/blob/master/cinder/db/sqlalchemy/models.py#L472 | 22:00 |
hemna | that one ? | 22:01 |
*** markvoelker has quit IRC | 22:01 | |
jgriffith | hemna: so should I just paste the same link for a 3'rd time :) | 22:01 |
*** markvoelker has joined #openstack-cinder | 22:01 | |
hemna | I must be missing something | 22:01 |
hemna | sorry | 22:01 |
jgriffith | hemna: that's the parent volume size | 22:02 |
hemna | that snapshot object shows it has a volume_size col. | 22:02 |
xingyang | jgriffith: so the volume_size is 8, but tempest tries to create a 1GB volume from that snapshot | 22:02 |
jgriffith | hemna: the size of the volume you took a snapshot of at the time | 22:02 |
hemna | yah yah | 22:02 |
jgriffith | xingyang: yeah, I hear ya | 22:02 |
hemna | ok cool. :) | 22:02 |
jgriffith | I wouldn't change tempest | 22:02 |
jgriffith | I'd change Cinder | 22:02 |
jgriffith | rather than use the default size of 1G for create from snap.. it should use volume_size of snap | 22:03 |
hemna | shouldn't the snapshot.volume_size be 8 in this case? | 22:03 |
jgriffith | hemna: yes, and I think xingyang just mentioned that it is | 22:03 |
jgriffith | xingyang: correct? | 22:03 |
hemna | jgriffith, well tempest is basically hard coding that size to 1g | 22:03 |
jgriffith | xingyang: if it's not then there's another crappy bug to be fixed | 22:03 |
hemna | by using the tempest volumes_client default_volume_size | 22:03 |
hemna | which is a tempest'ism | 22:03 |
xingyang | jgriffith: I think tempest uses 1 by default | 22:03 |
jgriffith | no, we're talking about create from snapshot | 22:04 |
jgriffith | that's different | 22:04 |
hemna | https://github.com/openstack/tempest/blob/master/tempest/services/volume/base/base_volumes_client.py#L33 | 22:04 |
hemna | jgriffith, correct, we are talking about create from snap | 22:04 |
hemna | that eventually boils down to a create_volume call | 22:04 |
jgriffith | let me try this again.... | 22:04 |
hemna | with the tempest client | 22:04 |
hemna | which defaults to https://github.com/openstack/tempest/blob/master/tempest/services/volume/base/base_volumes_client.py#L33 | 22:04 |
jgriffith | so there are two things that cause trouble here... | 22:05 |
jgriffith | 1. we use the same create flow for create from snap | 22:05 |
jgriffith | so yes, it uses that default value | 22:05 |
jgriffith | 2. Cinder then gets the call and says "hey, I can't do this... the snap needs 8Gig to be restored to" | 22:05 |
jgriffith | What I'm saying is that Cinder, should be intelligent enough to figure out how to gracefully resolve that | 22:06 |
jgriffith | IMO it should take either None for size in that case OR take >= volume_size | 22:06 |
hemna | but anyone can ask cinder to create a volume from a snap, and provide an incorrect size | 22:07 |
hemna | which is a valid failure | 22:07 |
*** xingyang has quit IRC | 22:07 | |
hemna | which I believe is the case here with the tempest test. | 22:07 |
jgriffith | hemna: yep, you're correct | 22:07 |
hemna | so None for a size would be better than a default of 1 | 22:07 |
jgriffith | the intent of that test is actually that "everything" is just always 1G | 22:07 |
jgriffith | hemna: so yes, that's where I was going. Modify Cinder to accept none for create --snapshot-id | 22:08 |
jgriffith | which means, whatever it's supposed to be based on volume_size in the snapshot object | 22:08 |
jgriffith | THEN | 22:08 |
hemna | wouldn't that require us to change the tempest default_volume_size to None then ? | 22:08 |
hemna | for this to pass ? | 22:08 |
jgriffith | modify create-snapshot in tempest appropriately | 22:08 |
jgriffith | BUT!!! | 22:08 |
hemna | ah yah | 22:08 |
hemna | ok | 22:08 |
jgriffith | what I'd like to know is how you're passing anything in Tempest now | 22:08 |
*** xingyang has joined #openstack-cinder | 22:09 | |
jgriffith | because you're obviously lying to Tempest when you say "create 1" | 22:09 |
jgriffith | You're creating an 8G volume | 22:09 |
hemna | well, scaleio driver can't do a 1g Volume | 22:09 |
jgriffith | hemna: I'm aware | 22:09 |
hemna | it's doing a model update after create_volume | 22:09 |
jgriffith | hemna: and qutoas mean nothing :( | 22:10 |
alkhodos | hemna: yes, using released brick solved the issue | 22:10 |
hemna | alkhodos, ok...boo! and yeah! at the same time. | 22:10 |
jgriffith | all I'm saying is I'm not a fan of just "lieing" about things | 22:10 |
hemna | and by lying, you mean the model update? | 22:10 |
jgriffith | but I guess that's up to Scale-IO support to deal with | 22:10 |
alkhodos | hemna: still I couldn | 22:10 |
alkhodos | couldn't figure out why it failed | 22:11 |
hemna | alkhodos, does that fail every create volume from image call ? | 22:11 |
jgriffith | just tell your users they have to create things in 8Gig increments | 22:11 |
jgriffith | otherwise it fails | 22:11 |
alkhodos | hemna: not every, that's my biggest concern | 22:11 |
jgriffith | OR make a conf option for Cinder if you must | 22:11 |
jgriffith | and have it do it at the API layer | 22:11 |
xingyang | jgriffith: but tempest doesn’t create 8GB, it create 1GB:) we try to pass the tempest test | 22:11 |
alkhodos | hemna: sometimes they fail, sometimes they succeed. The exact same cmd | 22:12 |
jgriffith | but my point is this work of hacking up all these little corners of the Cinder code is nothing but trouble | 22:12 |
jgriffith | xingyang: yes... so what i'm saying is change Cinder | 22:12 |
jgriffith | xingyang: in the case of Cinder and ScaleIO set var that says "minimum size = 8" | 22:12 |
hemna | xingyang, yah but tempest is 'dumb' in the respect that it thinks it should default to 1G and there is never a difference between what it asks cinder to create and what cinder creates. | 22:12 |
jgriffith | then every time a call comes in to create at API layer it checks that | 22:13 |
jgriffith | and does a moulus on it | 22:13 |
jgriffith | rounds it up or whatever | 22:13 |
jgriffith | then just passes the "correct size" all the way through the flow | 22:13 |
hemna | jgriffith, a customer scheduler filter maybe ? | 22:13 |
hemna | custom | 22:13 |
jgriffith | rather than this crazy monkeying around that's guaranteed to come back and bight someone in the butt some day | 22:13 |
jgriffith | hemna: well, not even that | 22:14 |
hemna | one of my suggestions in the summit was to just fail in the driver | 22:14 |
hemna | if it wasn't a mod 8 | 22:14 |
jgriffith | hemna: I mean literally set a default-size in the config and adjust before it even gets to cinder.volume.api | 22:14 |
xingyang | jgriffith: we still need to change the default_volume_size in tempest from 1 to None? | 22:14 |
*** salv-orl_ has joined #openstack-cinder | 22:14 | |
jgriffith | xingyang: not really :) | 22:14 |
jgriffith | xingyang: because if you have this set on your config in your ci system it gets the call... says "nope, 1 isn't valid... bump it up" | 22:15 |
jgriffith | xingyang: here, let me show you... gimmie a minute | 22:15 |
xingyang | jgriffith: thanks! | 22:15 |
jgriffith | of course I don't know where the hell to change it... V1, V2 or V3 | 22:16 |
jgriffith | sigh | 22:16 |
xingyang | :) | 22:16 |
xingyang | I assume we can only change in v3 now | 22:17 |
*** salv-orlando has quit IRC | 22:18 | |
Swanson | "bight"? | 22:18 |
jgriffith | https://gist.github.com/j-griffith/3d89e31a49cc5686586f1369c6aa5451 | 22:19 |
jgriffith | xingyang: that only works if you make that a global setting | 22:19 |
xingyang | jgriffith: sure | 22:20 |
jgriffith | xingyang: in which case as hemna pointed out you can have a filter.... fail if it's not mod 8 | 22:20 |
jgriffith | xingyang: but in either case, for snapshots, it's easy to just add the same auto-set/adjust in the file I just referenced for snapshots | 22:21 |
xingyang | jgriffith: so if we do a mod 8 there instead of min size, what do you think? | 22:22 |
xingyang | jgriffith: a formula in cinder.conf | 22:22 |
*** ducttape_ has quit IRC | 22:22 | |
jgriffith | https://gist.github.com/j-griffith/0755dcda222473e810ac16e8d49c6367 | 22:23 |
jgriffith | xingyang: so yeah, a min value in cinder.conf is what i was thinking. That second gist solves the snapshot problem IMO | 22:24 |
jgriffith | and that could be something like "auto_correct_create_from_snapshot_size=8" or something longer maybe :) | 22:24 |
jgriffith | xingyang: that would preserve the test, make overriding things explicit so there's no magic | 22:25 |
xingyang | jgriffith: sure, this sounds good | 22:25 |
jgriffith | xingyang: would make quotas just *work* the way they're supposed to, and negate any funny business with model updates etc | 22:25 |
jgriffith | xingyang: it's not as clean on a regular create, I'd have to think about that a bit (because of multi-backend) | 22:26 |
xingyang | jgriffith: so for snapshot, we can do a mod 8, but you don’t suggest mod 8 in the first place? | 22:26 |
jgriffith | xingyang: yeah, so that's the problem in the first case, multi-backend | 22:26 |
jgriffith | or maybe you say "DONT RUN SCALEIO IN MULTI_BACKEND CONFIG" | 22:26 |
jgriffith | wait, no | 22:27 |
jgriffith | can't do that :) | 22:27 |
xingyang | jgriffith: ? | 22:27 |
xingyang | jgriffith: which part? | 22:27 |
jgriffith | nothing, thinking out loud :) | 22:27 |
*** tpsilva has quit IRC | 22:27 | |
jgriffith | so create-from-snapshot or create-from-volume I think is pretty safe and that suggestion works well | 22:27 |
jgriffith | for create-raw it's tricky though | 22:27 |
jgriffith | say they have an LVM backend and a ScaleIO backend..... | 22:28 |
jgriffith | We shouldn't force the LVM volumes to 8Gig | 22:28 |
xingyang | jgriffith: that’s true | 22:28 |
jgriffith | and we don't know where the create is going until it's too late | 22:28 |
jgriffith | You could deal with it via types, but that's not 100% | 22:29 |
xingyang | jgriffith: if we can have the config work for each backend, then we can do it? | 22:29 |
jgriffith | xingyang: how would you do that? | 22:29 |
jgriffith | I don't think that's possible at this layer | 22:29 |
jgriffith | Unless you require the type.. in which case that's cool | 22:29 |
xingyang | jgriffith: I mean if the config is at per backend level, so that will be different for each backend? | 22:29 |
jgriffith | and to be clear, type with a volume_backend_name in it | 22:29 |
jgriffith | xingyang: no, you can't do that at the API | 22:30 |
jgriffith | xingyang: you don't necessarily know which backend it's going to be scheduled on | 22:30 |
*** Julien-zte has joined #openstack-cinder | 22:30 | |
jgriffith | you don't have enough info yet | 22:30 |
xingyang | jgriffith: you are right | 22:30 |
jgriffith | xingyang: so I think I mentioned before... it kinda sucks but; | 22:31 |
jgriffith | what you should probably do is set a stats report from your driver that says "min-vol-size=8" | 22:31 |
jgriffith | and then the filter scheduler as is should disqualify you for anything that isn't a multipe of 8Gig | 22:31 |
jgriffith | IMHO that's the only really correct way to do this | 22:32 |
xingyang | jgriffith: but that will not help us pass the tempest test. we still need the change you suggested in API | 22:32 |
jgriffith | You do that in conjunction with the v2/volumes.py changes I mentioned above for snaps and clones | 22:32 |
jgriffith | yeah, that's a tough one :) | 22:33 |
jgriffith | I'm saying you do both of those things... I can't fix the default size in tempest, you could certainly make that configurable in your CI system... in fact I think it already is | 22:33 |
*** cknight has joined #openstack-cinder | 22:34 | |
xingyang | jgriffith: we’ll try what you suggested in your git. that should get us pass tempest and quota should be right too | 22:34 |
jgriffith | xingyang: yeah, do something like that for snapshots and clones | 22:34 |
xingyang | jgriffith: is the default size in tempest configurable? I didn’t know about that, I’ll check | 22:35 |
jgriffith | xingyang: I am not sure if it is right now or not, BUT that's much more pallatable than "lieing" about things or disabling the test IMHO | 22:35 |
jgriffith | xingyang: and I think it's relatively easy to do | 22:36 |
jgriffith | xingyang: and YES it's already configurable in tempest | 22:37 |
xingyang | jgriffith: Is it? | 22:37 |
xingyang | jgriffith: default_volume_size? | 22:37 |
jgriffith | xingyang: which solves your problem anyway | 22:37 |
jgriffith | xingyang: https://github.com/openstack/tempest/blob/master/tempest/clients.py#L570 | 22:37 |
*** lprice has quit IRC | 22:37 | |
xingyang | jgriffith: awesome! that will be the quickest fix:) | 22:38 |
jgriffith | xingyang: yeah, and the most correct :) | 22:38 |
jgriffith | xingyang: and it means you don't have to "lie" :) | 22:38 |
xingyang | jgriffith: we’ll change that in tempest.conf. thanks! | 22:38 |
jgriffith | xingyang: lemme know how it goes | 22:38 |
*** ajnouri has quit IRC | 22:38 | |
xingyang | jgriffith: sure:) | 22:39 |
*** ametts has quit IRC | 22:41 | |
*** xingyang has quit IRC | 22:41 | |
*** sdague has quit IRC | 22:50 | |
*** xinli has quit IRC | 22:52 | |
*** kongwei has joined #openstack-cinder | 22:56 | |
*** ajnouri has joined #openstack-cinder | 22:56 | |
*** kongwei has quit IRC | 23:00 | |
*** xingyang has joined #openstack-cinder | 23:01 | |
*** xingyang has quit IRC | 23:02 | |
*** cknight has quit IRC | 23:05 | |
*** markvoelker has quit IRC | 23:06 | |
*** rcernin has quit IRC | 23:08 | |
*** xyang1 has quit IRC | 23:11 | |
*** bardia has quit IRC | 23:16 | |
*** bardia has joined #openstack-cinder | 23:17 | |
*** caspinol has quit IRC | 23:17 | |
*** laughterwym has joined #openstack-cinder | 23:18 | |
*** laughterwym has quit IRC | 23:22 | |
*** IlyaG has joined #openstack-cinder | 23:25 | |
*** lcurtis has quit IRC | 23:25 | |
*** diogogmt has quit IRC | 23:29 | |
*** IlyaG has quit IRC | 23:31 | |
*** adrianofr has quit IRC | 23:32 | |
*** jamielennox is now known as jamielennox|away | 23:51 | |
*** yhayashi has joined #openstack-cinder | 23:51 | |
*** yhayashi has quit IRC | 23:53 | |
*** Julien-zte has quit IRC | 23:57 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!