*** sapd_ has joined #openstack-cinder | 00:00 | |
*** _pewp_ has joined #openstack-cinder | 00:01 | |
*** namnh has quit IRC | 00:03 | |
*** namnh has joined #openstack-cinder | 00:07 | |
*** wanghao_ has joined #openstack-cinder | 00:08 | |
*** salv-orlando has joined #openstack-cinder | 00:09 | |
*** wanghao has quit IRC | 00:10 | |
*** salv-orlando has quit IRC | 00:13 | |
*** namnh has quit IRC | 00:19 | |
*** namnh has joined #openstack-cinder | 00:20 | |
*** namnh has quit IRC | 00:24 | |
*** liverpooler has quit IRC | 00:26 | |
*** namnh has joined #openstack-cinder | 00:28 | |
*** namnh_ has joined #openstack-cinder | 00:32 | |
*** felipemonteiro_ has quit IRC | 00:32 | |
*** namnh_ has quit IRC | 00:32 | |
*** dave-mccowan has quit IRC | 00:32 | |
*** namnh has quit IRC | 00:33 | |
*** wanghao_ has quit IRC | 00:44 | |
*** wanghao has joined #openstack-cinder | 00:44 | |
*** wanghao has quit IRC | 00:45 | |
*** wanghao has joined #openstack-cinder | 00:46 | |
*** yangyapeng has joined #openstack-cinder | 00:51 | |
*** yangyapeng has quit IRC | 00:55 | |
*** wanghao_ has joined #openstack-cinder | 00:57 | |
*** wanghao has quit IRC | 00:57 | |
*** Dinesh_Bhor has joined #openstack-cinder | 00:57 | |
*** junboli has joined #openstack-cinder | 00:58 | |
*** andreas_s has joined #openstack-cinder | 01:01 | |
*** andreas_s has quit IRC | 01:05 | |
*** melwitt has quit IRC | 01:10 | |
*** zhaochao has joined #openstack-cinder | 01:11 | |
*** yangyapeng has joined #openstack-cinder | 01:11 | |
*** wanghao has joined #openstack-cinder | 01:13 | |
*** yangyapeng has quit IRC | 01:16 | |
*** wanghao_ has quit IRC | 01:16 | |
*** yangyapeng has joined #openstack-cinder | 01:18 | |
*** Dinesh_Bhor has quit IRC | 01:21 | |
*** _dalgaaf has quit IRC | 01:29 | |
*** Dinesh_Bhor has joined #openstack-cinder | 01:29 | |
*** liverpooler has joined #openstack-cinder | 01:30 | |
*** Dinesh_Bhor has quit IRC | 01:30 | |
*** Dinesh_Bhor has joined #openstack-cinder | 01:30 | |
*** dalgaaf has joined #openstack-cinder | 01:31 | |
*** Dinesh_Bhor has quit IRC | 01:33 | |
*** salv-orlando has joined #openstack-cinder | 01:33 | |
*** derekjhyang has joined #openstack-cinder | 01:36 | |
*** salv-orlando has quit IRC | 01:39 | |
*** felipemonteiro_ has joined #openstack-cinder | 01:40 | |
*** namnh has joined #openstack-cinder | 01:43 | |
*** melwitt has joined #openstack-cinder | 01:56 | |
*** melwitt is now known as Guest94306 | 01:56 | |
*** Guest94306 is now known as jgwentworth | 01:58 | |
*** jgwentworth is now known as melwitt | 02:01 | |
*** gcb has joined #openstack-cinder | 02:04 | |
*** harlowja has quit IRC | 02:10 | |
*** Dinesh_Bhor has joined #openstack-cinder | 02:11 | |
*** moshele has joined #openstack-cinder | 02:18 | |
*** felipemonteiro_ has quit IRC | 02:18 | |
*** Dinesh_Bhor has quit IRC | 02:18 | |
*** kaisers__ has joined #openstack-cinder | 02:19 | |
*** Dinesh_Bhor has joined #openstack-cinder | 02:20 | |
*** kaisers_ has quit IRC | 02:22 | |
*** Dinesh_Bhor has quit IRC | 02:34 | |
*** Dinesh_Bhor has joined #openstack-cinder | 02:36 | |
*** Dinesh_Bhor has quit IRC | 02:39 | |
*** Dinesh_Bhor has joined #openstack-cinder | 02:40 | |
*** Dinesh_Bhor has quit IRC | 02:46 | |
*** edmondsw has joined #openstack-cinder | 02:54 | |
*** edmondsw has quit IRC | 02:58 | |
*** dave-mccowan has joined #openstack-cinder | 02:58 | |
*** Dinesh_Bhor has joined #openstack-cinder | 02:59 | |
*** zhurong has joined #openstack-cinder | 03:03 | |
*** moshele has quit IRC | 03:12 | |
*** psachin has joined #openstack-cinder | 03:25 | |
*** uberjay has quit IRC | 03:28 | |
*** uberjay has joined #openstack-cinder | 03:29 | |
*** moshele has joined #openstack-cinder | 03:31 | |
*** sumitshatwara has quit IRC | 03:33 | |
*** wanghao has quit IRC | 03:34 | |
*** wanghao has joined #openstack-cinder | 03:35 | |
*** salv-orlando has joined #openstack-cinder | 03:36 | |
*** salv-orlando has quit IRC | 03:41 | |
*** uberjay has quit IRC | 03:43 | |
*** uberjay has joined #openstack-cinder | 03:45 | |
*** uberjay has quit IRC | 03:47 | |
*** uberjay has joined #openstack-cinder | 03:47 | |
*** hoangcx has quit IRC | 03:50 | |
*** daidv has quit IRC | 03:50 | |
*** daidv has joined #openstack-cinder | 03:50 | |
*** hoangcx has joined #openstack-cinder | 03:50 | |
*** dave-mccowan has quit IRC | 03:52 | |
*** moshele has quit IRC | 03:56 | |
*** abhishekk has joined #openstack-cinder | 03:57 | |
*** zhurong has quit IRC | 04:05 | |
*** mylu has quit IRC | 04:09 | |
*** links has joined #openstack-cinder | 04:10 | |
*** markstur has quit IRC | 04:12 | |
*** harlowja has joined #openstack-cinder | 04:21 | |
*** mylu has joined #openstack-cinder | 04:21 | |
*** harlowja has quit IRC | 04:26 | |
*** harlowja has joined #openstack-cinder | 04:26 | |
*** harlowja has quit IRC | 04:27 | |
*** salv-orlando has joined #openstack-cinder | 04:37 | |
*** pgadiya has joined #openstack-cinder | 04:38 | |
*** salv-orlando has quit IRC | 04:42 | |
*** edmondsw has joined #openstack-cinder | 04:42 | |
*** andreas_s has joined #openstack-cinder | 04:45 | |
*** edmondsw has quit IRC | 04:46 | |
*** moshele has joined #openstack-cinder | 04:46 | |
*** andreas_s has quit IRC | 04:49 | |
*** Dinesh_Bhor has quit IRC | 04:54 | |
*** Dinesh_Bhor has joined #openstack-cinder | 04:57 | |
*** Dinesh_Bhor has quit IRC | 05:01 | |
*** Dinesh_Bhor has joined #openstack-cinder | 05:03 | |
*** mylu_ has joined #openstack-cinder | 05:06 | |
*** mylu has quit IRC | 05:08 | |
nikeshm | erlon_ : hi | 05:36 |
---|---|---|
*** salv-orlando has joined #openstack-cinder | 05:38 | |
*** adisky__ has joined #openstack-cinder | 05:38 | |
*** zhurong has joined #openstack-cinder | 05:41 | |
*** salv-orlando has quit IRC | 05:43 | |
*** kaisers__ has quit IRC | 05:45 | |
*** caisan_ has joined #openstack-cinder | 05:47 | |
*** gkadam has joined #openstack-cinder | 05:52 | |
*** kaisers_ has joined #openstack-cinder | 05:56 | |
*** salv-orlando has joined #openstack-cinder | 05:59 | |
*** Dinesh_Bhor has quit IRC | 05:59 | |
*** Dinesh_Bhor has joined #openstack-cinder | 06:00 | |
*** jappleii__ has quit IRC | 06:01 | |
*** caisan has joined #openstack-cinder | 06:02 | |
*** caisan_ has quit IRC | 06:05 | |
*** Dinesh_Bhor has quit IRC | 06:08 | |
nikeshm | hi | 06:08 |
nikeshm | any patch for deprecating options suggested by https://review.openstack.org/#/c/534854 | 06:09 |
*** Dinesh_Bhor has joined #openstack-cinder | 06:11 | |
*** mylu_ has quit IRC | 06:16 | |
*** Dinesh_Bhor has quit IRC | 06:24 | |
*** pgadiya has quit IRC | 06:27 | |
*** caisan_ has joined #openstack-cinder | 06:28 | |
*** edmondsw has joined #openstack-cinder | 06:30 | |
*** caisan has quit IRC | 06:30 | |
*** pgadiya has joined #openstack-cinder | 06:33 | |
*** AlexeyAbashkin has joined #openstack-cinder | 06:33 | |
*** izombie has joined #openstack-cinder | 06:34 | |
*** edmondsw has quit IRC | 06:34 | |
*** AlexeyAbashkin has quit IRC | 06:37 | |
*** pgadiya has quit IRC | 06:41 | |
*** pgadiya has joined #openstack-cinder | 06:41 | |
*** Dinesh_Bhor has joined #openstack-cinder | 06:43 | |
*** fnordahl has quit IRC | 06:44 | |
amito | can one more core (other than smcginnis) please take a look at https://review.openstack.org/#/c/536778/ ? it's pending a +2 and workflow for some time now. thanks. | 06:44 |
*** fnordahl has joined #openstack-cinder | 06:46 | |
*** caisan has joined #openstack-cinder | 06:56 | |
*** zhurong has quit IRC | 06:58 | |
*** caisan_ has quit IRC | 06:59 | |
*** zhurong has joined #openstack-cinder | 07:02 | |
*** wolsen has quit IRC | 07:09 | |
*** pcaruana has joined #openstack-cinder | 07:10 | |
*** wolsen has joined #openstack-cinder | 07:11 | |
*** andreas_s has joined #openstack-cinder | 07:17 | |
*** caisan_ has joined #openstack-cinder | 07:21 | |
*** caisan has quit IRC | 07:24 | |
*** kaisers_ has quit IRC | 07:28 | |
*** sticker has joined #openstack-cinder | 07:30 | |
*** salv-orlando has quit IRC | 07:36 | |
*** e0ne has joined #openstack-cinder | 07:36 | |
*** salv-orlando has joined #openstack-cinder | 07:36 | |
openstackgerrit | Jeremy Zhang proposed openstack/python-cinderclient master: Add api_version wraps for group snapshot list in v3/shell.py https://review.openstack.org/539124 | 07:38 |
*** salv-orlando has quit IRC | 07:41 | |
*** AlexeyAbashkin has joined #openstack-cinder | 07:41 | |
*** kaisers_ has joined #openstack-cinder | 07:42 | |
*** AlexeyAbashkin has quit IRC | 07:46 | |
*** caisan has joined #openstack-cinder | 07:47 | |
*** alexchadin has joined #openstack-cinder | 07:49 | |
*** AlexeyAbashkin has joined #openstack-cinder | 07:50 | |
*** caisan_ has quit IRC | 07:51 | |
*** wanghao_ has joined #openstack-cinder | 07:58 | |
*** salv-orlando has joined #openstack-cinder | 07:59 | |
*** josecastroleon has joined #openstack-cinder | 08:00 | |
*** wanghao has quit IRC | 08:01 | |
*** Dinesh_Bhor has quit IRC | 08:05 | |
*** caisan_ has joined #openstack-cinder | 08:13 | |
*** izombie has quit IRC | 08:14 | |
*** kaisers_ has quit IRC | 08:15 | |
*** caisan has quit IRC | 08:16 | |
*** Dinesh_Bhor has joined #openstack-cinder | 08:16 | |
*** stakeda has quit IRC | 08:16 | |
*** tesseract has joined #openstack-cinder | 08:17 | |
*** Dinesh_Bhor has quit IRC | 08:18 | |
*** edmondsw has joined #openstack-cinder | 08:18 | |
*** Dinesh_Bhor has joined #openstack-cinder | 08:19 | |
*** armaan_ has quit IRC | 08:19 | |
*** Dinesh_Bhor has quit IRC | 08:19 | |
*** armaan has joined #openstack-cinder | 08:19 | |
*** edmondsw has quit IRC | 08:23 | |
*** lkuchlan has joined #openstack-cinder | 08:29 | |
*** caisan has joined #openstack-cinder | 08:29 | |
*** bkopilov has joined #openstack-cinder | 08:29 | |
openstackgerrit | Shunei Shiono proposed openstack/cinder master: Update NEC driver configuration reference for Queens https://review.openstack.org/539141 | 08:30 |
*** caisan_ has quit IRC | 08:33 | |
*** AlexeyAbashkin has quit IRC | 08:35 | |
*** Dinesh_Bhor has joined #openstack-cinder | 08:36 | |
*** Dinesh_Bhor has quit IRC | 08:38 | |
openstackgerrit | TommyLike proposed openstack/cinder master: Add 'list_volume' in Group show&list API Doc https://review.openstack.org/539145 | 08:38 |
*** AlexeyAbashkin has joined #openstack-cinder | 08:38 | |
*** AlexeyAbashkin has quit IRC | 08:41 | |
*** AlexeyAbashkin has joined #openstack-cinder | 08:42 | |
*** dklyle has joined #openstack-cinder | 08:43 | |
*** david-lyle has quit IRC | 08:44 | |
*** Dinesh_Bhor has joined #openstack-cinder | 08:45 | |
*** s-shiono has quit IRC | 08:45 | |
*** andreas_s has quit IRC | 08:50 | |
*** lennyb has quit IRC | 08:50 | |
*** andreas_s has joined #openstack-cinder | 08:50 | |
*** wanghao_ has quit IRC | 08:56 | |
openstackgerrit | TommyLike proposed openstack/cinder master: Update document for worker cleanup API https://review.openstack.org/539152 | 08:57 |
*** wanghao has joined #openstack-cinder | 08:57 | |
*** Dinesh_Bhor has quit IRC | 08:58 | |
*** vivsoni has quit IRC | 09:00 | |
*** vivsoni_ has joined #openstack-cinder | 09:00 | |
*** Dinesh_Bhor has joined #openstack-cinder | 09:01 | |
*** Miouge has joined #openstack-cinder | 09:01 | |
Miouge | Does cinder RBD driver support EC pool with Luminous? | 09:02 |
Miouge | Ceph doc says “rbd create --size 1G --data-pool ec_pool replicated_pool/image_name”, but there is only a “rbd_pool” setting in cinder.conf, no rbd_data_pool setting :( | 09:03 |
*** Dinesh_Bhor has quit IRC | 09:04 | |
*** kaisers_ has joined #openstack-cinder | 09:04 | |
*** wanghao_ has joined #openstack-cinder | 09:04 | |
*** Dinesh_Bhor has joined #openstack-cinder | 09:05 | |
*** lkuchlan has quit IRC | 09:05 | |
*** lkuchlan has joined #openstack-cinder | 09:07 | |
*** wanghao has quit IRC | 09:08 | |
*** lkuchlan has quit IRC | 09:11 | |
openstackgerrit | TommyLike proposed openstack/cinder master: Add 'metadata' in backup detail&show API document https://review.openstack.org/539156 | 09:13 |
*** salv-orlando has quit IRC | 09:17 | |
openstackgerrit | liuyamin proposed openstack/cinder master: Use constants for cinder-backup and cinder-schedule https://review.openstack.org/534181 | 09:18 |
*** salv-orlando has joined #openstack-cinder | 09:18 | |
*** salv-orlando has quit IRC | 09:23 | |
*** mvk has quit IRC | 09:29 | |
*** andreas_s_ has joined #openstack-cinder | 09:31 | |
*** caisan_ has joined #openstack-cinder | 09:33 | |
*** lennyb has joined #openstack-cinder | 09:34 | |
*** Dinesh_Bhor has quit IRC | 09:35 | |
*** andreas_s has quit IRC | 09:35 | |
*** caisan has quit IRC | 09:35 | |
openstackgerrit | TommyLike proposed openstack/cinder master: Update document for worker cleanup API https://review.openstack.org/539152 | 09:40 |
*** lkuchlan has joined #openstack-cinder | 09:40 | |
*** aydintd has joined #openstack-cinder | 09:43 | |
*** aydintd has quit IRC | 09:44 | |
*** itlinux has joined #openstack-cinder | 09:51 | |
*** hoangcx has quit IRC | 09:51 | |
*** namnh has quit IRC | 09:51 | |
*** daidv has quit IRC | 09:51 | |
*** daidv has joined #openstack-cinder | 09:51 | |
*** hoangcx has joined #openstack-cinder | 09:51 | |
*** namnh has joined #openstack-cinder | 09:51 | |
*** mvk has joined #openstack-cinder | 09:58 | |
*** josecastroleon has quit IRC | 09:58 | |
*** armaan has quit IRC | 09:59 | |
*** caisan has joined #openstack-cinder | 09:59 | |
erlon_ | nikeshm, tpsilva is compiling a list with all drivers that are broken and should be fixed | 10:01 |
*** zhurong has quit IRC | 10:02 | |
*** itlinux has quit IRC | 10:02 | |
*** caisan_ has quit IRC | 10:02 | |
*** caisan has quit IRC | 10:03 | |
*** caisan has joined #openstack-cinder | 10:03 | |
*** pgadiya has quit IRC | 10:03 | |
*** wanghao_ has quit IRC | 10:04 | |
nikeshm | erlon_ : just pinged u for the email u sent | 10:05 |
nikeshm | Deprecation of Kaminario and Pure automatic calculation for max_over_subscription_ratio | 10:06 |
*** edmondsw has joined #openstack-cinder | 10:06 | |
*** itlinux has joined #openstack-cinder | 10:07 | |
*** armaan has joined #openstack-cinder | 10:08 | |
erlon_ | nikeshm, ow, right, thanks for reaching, so, you are the maintainer os kaminario right? | 10:09 |
nikeshm | erlon_ | 10:10 |
nikeshm | yes | 10:10 |
*** edmondsw has quit IRC | 10:10 | |
*** lpetrut has joined #openstack-cinder | 10:12 | |
*** edmondsw has joined #openstack-cinder | 10:12 | |
*** edmondsw has quit IRC | 10:12 | |
erlon_ | nikeshm, so, you just need to set the deprecation flag on the auto_calc_max_oversubscription_ratio option, then when queens is closed, you can remove the option, and leave only this: https://github.com/openstack/cinder/blob/f98c9da944b46875cdec91cf4c0c28ce89e1ac6a/cinder/volume/drivers/kaminario/kaminario_common.py#L806-L807 | 10:14 |
*** jessewu has quit IRC | 10:14 | |
erlon_ | nikeshm, then, if the used set max_over_subscription_ratio = auto, the scheduler will use this formula: https://github.com/openstack/cinder/blob/f98c9da944b46875cdec91cf4c0c28ce89e1ac6a/cinder/utils.py#L1091-L1097 | 10:16 |
erlon_ | nikeshm, which has the same behaviour as the one in your driver | 10:17 |
*** pgadiya has joined #openstack-cinder | 10:21 | |
*** caisan has quit IRC | 10:21 | |
nikeshm | erlon_ : this formula is used by our engineering team provisioned_vol / float(cap.total - cap.free) | 10:24 |
nikeshm | which looks different from 1 + (provisioned_capacity_gb/( total_capacity_gb - free_capacity_gb + 1)) | 10:25 |
nikeshm | where 'provisioned_capacity_gb': provisioned_vol / units.Mi | 10:26 |
*** sumitshatwara has joined #openstack-cinder | 10:29 | |
*** alexchadin has quit IRC | 10:30 | |
erlon_ | nikeshm, yes, its a bit different, that's is to avoid critical points when 'total_capacity_gb - free_capacity_gb' == 0 and when (provisioned_capacity_gb/( total_capacity_gb - free_capacity_gb + 1)) < 1 | 10:31 |
*** salv-orlando has joined #openstack-cinder | 10:31 | |
*** alexchadin has joined #openstack-cinder | 10:31 | |
*** dave-mccowan has joined #openstack-cinder | 10:32 | |
nikeshm | erlon_ : ok i will discuss with team once | 10:33 |
*** andreas_s has joined #openstack-cinder | 10:33 | |
nikeshm | is it mandatory to deprecate in queens | 10:33 |
*** pgadiya has quit IRC | 10:33 | |
erlon_ | nikeshm, provisioned_capacity_gb is usually has at least 2 degrees of magnitude than 1, which is irrelevant | 10:33 |
*** bhagyashri_s has joined #openstack-cinder | 10:34 | |
*** pooja-jadhav has joined #openstack-cinder | 10:34 | |
erlon_ | nikeshm, I simulated the behaviour of kaminario's formula, pure's and other proposal, in the end, what will matter is, how long (considering the free space) will the schedule allow a volume to be schedule | 10:34 |
*** nsingh has joined #openstack-cinder | 10:34 | |
erlon_ | and they all have the same bevaiour and similar limits | 10:35 |
nikeshm | erlon_ : ok | 10:35 |
*** andreas_s_ has quit IRC | 10:36 | |
*** niraj_singh has quit IRC | 10:36 | |
*** pooja_jadhav has quit IRC | 10:37 | |
*** bhagyashris has quit IRC | 10:37 | |
erlon_ | nikeshm, https://docs.google.com/spreadsheets/d/1wpNg-80YkHyrQqSWk120znkKRMOg1xJB8va12-L_vso/edit?usp=sharing | 10:37 |
*** wanghao has joined #openstack-cinder | 10:37 | |
erlon_ | nikeshm, simulations, see that yours and pure has a division by zero | 10:38 |
*** mvk has quit IRC | 10:39 | |
*** itlinux has quit IRC | 10:41 | |
*** wanghao has quit IRC | 10:41 | |
*** ganso has joined #openstack-cinder | 10:43 | |
nikeshm | erlon_: total capacity in ur sheet is 1 GB | 10:43 |
*** tpsilva has joined #openstack-cinder | 10:43 | |
nikeshm | erlon_ : is it correct | 10:43 |
erlon_ | nikeshm, yep sorry, it uses brazillian conventions with takes '.' -> ',' | 10:45 |
*** itlinux has joined #openstack-cinder | 10:46 | |
erlon_ | geguileo, should see this as well ^ | 10:46 |
geguileo | erlon_: what's up? | 10:46 |
*** itlinux has quit IRC | 10:46 | |
erlon_ | geguileo, hey, this is the simulations I did related the automatic mosr calculations | 10:46 |
*** alexchadin has quit IRC | 10:47 | |
*** alexchadin has joined #openstack-cinder | 10:49 | |
geguileo | erlon_: nice! | 10:49 |
geguileo | it even has nice colors XD | 10:50 |
*** AlexeyAbashkin has quit IRC | 10:50 | |
*** AlexeyAbashkin has joined #openstack-cinder | 10:51 | |
*** mvk has joined #openstack-cinder | 10:51 | |
*** wanghao has joined #openstack-cinder | 10:52 | |
*** armaan has quit IRC | 10:52 | |
nikeshm | erlon_ : when is this case useful (provisioned_capacity_gb/( total_capacity_gb - free_capacity_gb + 1)) < 1 | 10:52 |
*** armaan has joined #openstack-cinder | 10:53 | |
nikeshm | erlon_ : sorry i got the point | 10:53 |
erlon_ | geguileo, changing the page, I was debugging a error in our CI yesterday, and reach to os-brick connect_volume. I notice that the multipath is taking a way that does not connects to the portal before trying to show the current connections | 10:53 |
geguileo | erlon_: that's always been the case | 10:54 |
erlon_ | geguileo, not sure that was something that changed recently or is the expected behaviour | 10:54 |
geguileo | erlon_: you have to check first if you are already connected | 10:54 |
geguileo | erlon_: it's always been like that | 10:54 |
geguileo | erlon_: if you connect LUN 1 first and you are not connected that check will fail and you'll do the connection | 10:55 |
geguileo | erlon_: if you connect to LUN 2 later you'll see that you already have the connection and just proceed to do the scanning | 10:55 |
geguileo | erlon_: it's the same for single and multipathed connections | 10:55 |
*** andreas_s_ has joined #openstack-cinder | 10:55 | |
erlon_ | but in this case brick is not retrying | 10:56 |
*** AlexeyAbashkin has quit IRC | 10:56 | |
erlon_ | http://paste.openstack.org/show/657973/ | 10:56 |
nikeshm | erlon_ : is the simulation covered for (provisioned_capacity_gb/( total_capacity_gb - free_capacity_gb + 1)) < 1 | 10:56 |
erlon_ | geguileo, these are the command flows, unyil the last test (from image) everything was ok | 10:56 |
erlon_ | nikeshm, you mean without the '1' in the formula? 1 + (prov ...) | 10:57 |
geguileo | erlon_: there are a loooooot of ways connections could go wrong, and they are not necessarily os-brick issues | 10:57 |
geguileo | erlon_: and the commands without DEBUG logs are not that usuful I'm afraid | 10:58 |
*** andreas_s has quit IRC | 10:58 | |
*** junboli has quit IRC | 10:59 | |
openstackgerrit | Gorka Eguileor proposed openstack/cinder-specs master: Update Provisioning Improvements https://review.openstack.org/538271 | 10:59 |
*** abhishekk has quit IRC | 11:00 | |
erlon_ | geguileo, hmm, the commands without debug are much easier to follow, at least for me. The thing is, when Cinder is trying to connect, in the 'from image' case, it does not log onto the portal neither scans | 11:01 |
erlon_ | geguileo, so, iscsiadm -m node --op show -p 10.250.118.21:3260 will obviously fail | 11:01 |
erlon_ | If I scan manually and run the same command on cinder it works | 11:01 |
*** alexchadin has quit IRC | 11:02 | |
geguileo | erlon_: you say the show obviously fails because you have no attached volume, right? | 11:02 |
*** alexchadin has joined #openstack-cinder | 11:03 | |
*** alexchadin has quit IRC | 11:03 | |
*** alexchadin has joined #openstack-cinder | 11:03 | |
erlon_ | geguileo, yes, this is the first time cinder is trying to attach, and it should do something else before | 11:03 |
*** alexchadin has quit IRC | 11:04 | |
*** alexchadin has joined #openstack-cinder | 11:04 | |
*** alexchadin has quit IRC | 11:04 | |
*** namnh has quit IRC | 11:05 | |
*** alexchadin has joined #openstack-cinder | 11:05 | |
*** alexchadin has quit IRC | 11:05 | |
*** lkuchlan has quit IRC | 11:05 | |
*** alexchadin has joined #openstack-cinder | 11:06 | |
*** alexchadin has quit IRC | 11:06 | |
geguileo | erlon_: there's something missing from that sequence you sent me | 11:07 |
geguileo | erlon_: that's why logs are better XD | 11:07 |
*** bkopilov has quit IRC | 11:08 | |
openstackgerrit | Sam Wan proposed openstack/os-brick master: Sanity check before referring 'initiator_target_map' https://review.openstack.org/539184 | 11:12 |
*** andreas_s_ has quit IRC | 11:19 | |
*** andreas_s has joined #openstack-cinder | 11:20 | |
*** mvenesio has joined #openstack-cinder | 11:20 | |
*** AlexeyAbashkin has joined #openstack-cinder | 11:22 | |
erlon_ | erlon_, ahhrg, ok, ill try to reproduce that later and will gather the full logs | 11:22 |
openstackgerrit | Lucian Petrut proposed openstack/cinder master: Update Windows docs https://review.openstack.org/538313 | 11:29 |
*** salv-orlando has quit IRC | 11:32 | |
*** salv-orlando has joined #openstack-cinder | 11:32 | |
*** armaan has quit IRC | 11:35 | |
*** armaan has joined #openstack-cinder | 11:35 | |
*** salv-orlando has quit IRC | 11:37 | |
*** andreas_s has quit IRC | 11:47 | |
*** andreas_s has joined #openstack-cinder | 11:47 | |
*** alexchadin has joined #openstack-cinder | 11:49 | |
*** AlexeyAbashkin has quit IRC | 11:51 | |
*** AlexeyAbashkin has joined #openstack-cinder | 11:52 | |
*** itlinux has joined #openstack-cinder | 11:54 | |
*** itlinux has quit IRC | 12:00 | |
*** itlinux has joined #openstack-cinder | 12:01 | |
*** sticker has quit IRC | 12:06 | |
*** edmondsw has joined #openstack-cinder | 12:08 | |
*** zhurong has joined #openstack-cinder | 12:12 | |
*** alexchadin has quit IRC | 12:17 | |
*** itlinux has quit IRC | 12:18 | |
*** alexchadin has joined #openstack-cinder | 12:18 | |
*** itlinux has joined #openstack-cinder | 12:18 | |
*** lkuchlan has joined #openstack-cinder | 12:19 | |
*** alexchadin has quit IRC | 12:22 | |
*** alexchadin has joined #openstack-cinder | 12:22 | |
*** bkopilov has joined #openstack-cinder | 12:25 | |
*** itlinux has quit IRC | 12:26 | |
geguileo | erlon_: don't do it for me, I mean, I'm not really interested in going through more logs (that's most of what I do lately), I only offer if it helps you XD | 12:36 |
erlon_ | geguileo, well, sometime we ill need to solve that multipath problem, just needed some direction to see if my findings were correct. When we schedule a internal task here to thoroughly investigate we can talk again with more details about it | 12:44 |
geguileo | erlon_: if you reproduce and have logs I can see if it's a bug or what is it, and if it's a bug I'll probably go and fix it ;-) | 12:45 |
erlon_ | geguileo, great! thanks! | 12:47 |
*** tobasco has quit IRC | 12:49 | |
*** links has quit IRC | 12:49 | |
*** edmondsw_ has joined #openstack-cinder | 12:49 | |
*** tobasco has joined #openstack-cinder | 12:50 | |
*** edmondsw has quit IRC | 12:51 | |
*** salv-orlando has joined #openstack-cinder | 12:52 | |
openstackgerrit | Erlon R. Cruz proposed openstack/cinder master: Updates overprovisioning dev-ref https://review.openstack.org/538989 | 12:52 |
*** gcb has quit IRC | 12:56 | |
*** edmondsw_ has quit IRC | 12:58 | |
*** edmondsw has joined #openstack-cinder | 13:00 | |
*** abishop has joined #openstack-cinder | 13:01 | |
*** zhurong_ has joined #openstack-cinder | 13:03 | |
*** salv-orl_ has joined #openstack-cinder | 13:13 | |
openstackgerrit | Lucian Petrut proposed openstack/cinder master: Update Windows docs https://review.openstack.org/538313 | 13:13 |
*** caisan has joined #openstack-cinder | 13:16 | |
*** salv-orlando has quit IRC | 13:16 | |
*** zhurong has quit IRC | 13:17 | |
*** hemna_ has joined #openstack-cinder | 13:18 | |
*** zhurong_ has quit IRC | 13:19 | |
_pewp_ | hemna_ ( *՞ਊ՞*)ノ | 13:19 |
*** zhurong has joined #openstack-cinder | 13:19 | |
*** zhurong has quit IRC | 13:20 | |
*** alexchadin has quit IRC | 13:21 | |
*** chenying_ has quit IRC | 13:21 | |
*** sshatwar_ has joined #openstack-cinder | 13:22 | |
*** sumitshatwara has quit IRC | 13:25 | |
*** lhx_ has joined #openstack-cinder | 13:25 | |
openstackgerrit | Vivek Soni proposed openstack/cinder master: 3PAR: Fixed setting of sync_period value https://review.openstack.org/539208 | 13:29 |
*** yangyapeng has quit IRC | 13:30 | |
*** yangyapeng has joined #openstack-cinder | 13:30 | |
openstackgerrit | Erlon R. Cruz proposed openstack/cinder master: Updates overprovisioning dev-ref https://review.openstack.org/538989 | 13:34 |
*** moshele has quit IRC | 13:34 | |
*** yangyapeng has quit IRC | 13:35 | |
*** dave-mccowan has quit IRC | 13:37 | |
amito | erlon_: hi, sup? any idea if zuul gate is still stuck / busy? we have a patch with +1 on workflow that has been stuck for a few hours now - https://review.openstack.org/#/c/536778/ | 13:37 |
*** caisan has quit IRC | 13:39 | |
*** izombie has joined #openstack-cinder | 13:39 | |
*** caisan has joined #openstack-cinder | 13:40 | |
-openstackstatus- NOTICE: Our ubuntu-xenial images (used for e.g. unit tests and devstack) are currently failing to install any packages, restrain from *recheck* or *approve* until the issue has been investigated and fixed. | 13:42 | |
*** links has joined #openstack-cinder | 13:44 | |
*** alexchadin has joined #openstack-cinder | 13:52 | |
openstackgerrit | Vivek Soni proposed openstack/cinder master: 3PAR: Fixed sync period updation in rcg https://review.openstack.org/539208 | 13:54 |
*** alexchadin has quit IRC | 13:55 | |
*** izombie has quit IRC | 13:55 | |
*** alexchadin has joined #openstack-cinder | 13:56 | |
*** psachin has quit IRC | 13:57 | |
*** alexchadin has quit IRC | 14:00 | |
*** yangyapeng has joined #openstack-cinder | 14:01 | |
*** abhishekk has joined #openstack-cinder | 14:06 | |
jdillaman | Miouge: you can use cinder multi-backend w/ different Ceph users per backend to achieve the desired effect | 14:08 |
Miouge | jdillaman: Yes, that is the plan: several cinder backends with different Ceph pools, but one of the pools is an Erasure Coded pool. RBD metadata needs to be stored on a replicated pool while the RBD data is in a EC pool. So there are 2 pool names to pass: metadata pool and data pool. I do not see how to configure that in cinder. | 14:11 |
jdillaman | For the "client.XYZ" user used for the EC backend, just add a section in your ceph.conf to override the config option for data pool | 14:12 |
*** dustins has joined #openstack-cinder | 14:12 | |
jdillaman | Miouge: a la https://pastebin.com/d5VuEwL8 | 14:13 |
Miouge | jdillaman: oh I see what you mean. Clever! This config in ceph.conf is required only on cinder-volume or also in nova-compute nodes? | 14:15 |
jdillaman | Miouge: only on the cinder hosts | 14:16 |
Miouge | jdillaman: in your example “cinder_ex” is the rbd_user for the EC ciner backend right? | 14:18 |
Miouge | s/ciner/cinder | 14:18 |
jdillaman | Miouge: yes -- a specific Cinder user for a specific multi-backend | 14:19 |
Miouge | OK, then nova-compute/libvirt/librbd is able to find out the data-pool from the metadata in the rbd_pool. I’ll try this setup. Thanks jdillaman | 14:24 |
jdillaman | Miouge: correct -- the data pool is only needed during the image creation | 14:24 |
jdillaman | Miouge: once the image is created, its data pool is recorded in the image header | 14:25 |
*** derekjhyang has quit IRC | 14:26 | |
*** AlexeyAbashkin has quit IRC | 14:26 | |
*** AlexeyAbashkin has joined #openstack-cinder | 14:27 | |
*** dklyle has quit IRC | 14:29 | |
*** alexchadin has joined #openstack-cinder | 14:30 | |
*** caisan has quit IRC | 14:37 | |
Miouge | jdillaman: I see that python-librbd has support for data_pool on the create() method. Is there any interrest in adding that in the cinder driver? Maybe something I can try to add. | 14:38 |
*** abhishekk has quit IRC | 14:39 | |
jdillaman | Certainly wouldn't hurt. I think it would be a nice-to-have addition for the RBD drivers in OpenStack | 14:39 |
*** eharney has joined #openstack-cinder | 14:44 | |
openstackgerrit | Kushal Wathore proposed openstack/cinder master: 3PAR: fix cloning issue in create group from source. https://review.openstack.org/539225 | 14:45 |
*** csaikia has joined #openstack-cinder | 14:45 | |
*** dave-mccowan has joined #openstack-cinder | 14:55 | |
openstackgerrit | Mayur Indalkar proposed openstack/cinder master: Implementation of Cinder driver over ISCSI for Veritas Access https://review.openstack.org/539230 | 14:55 |
*** r-daneel has joined #openstack-cinder | 14:57 | |
erlon_ | amito, gate has been facing some slowliness these last week. My patch toke 26h to merge after workflow+1 | 14:59 |
*** kwathore has joined #openstack-cinder | 15:01 | |
amito | erlon_: oh, bah... thanks. | 15:01 |
openstackgerrit | Eric Harney proposed openstack/cinder master: bump pylint to recent version https://review.openstack.org/509755 | 15:02 |
amito | erlon_: isn't Zuul supposed to comment anyway after setting workflow +1 though? | 15:03 |
erlon_ | amito, it will but only after run the gate tests | 15:04 |
amito | erlon_, there is usually a comment stating that it is about to start gate tests or something of the sort... | 15:05 |
*** lhx_ has quit IRC | 15:05 | |
erlon_ | amito, ow yes, that is. but the tests will take a looong time to start | 15:05 |
*** links has quit IRC | 15:05 | |
*** lhx_ has joined #openstack-cinder | 15:05 | |
erlon_ | amito, http://zuul.openstack.org/ | 15:05 |
erlon_ | you can see you patch in the line here | 15:05 |
*** alexchadin has quit IRC | 15:05 | |
erlon_ | waiting time is being about 20h | 15:06 |
*** andreas_s has quit IRC | 15:10 | |
*** andreas_s has joined #openstack-cinder | 15:11 | |
*** gkadam has quit IRC | 15:14 | |
*** zhongjun has quit IRC | 15:18 | |
openstackgerrit | Erlon R. Cruz proposed openstack/cinder master: Updates overprovisioning dev-ref https://review.openstack.org/538989 | 15:18 |
openstackgerrit | Erlon R. Cruz proposed openstack/cinder master: Updates overprovisioning dev-ref https://review.openstack.org/538989 | 15:19 |
*** esker has joined #openstack-cinder | 15:24 | |
*** crushil has joined #openstack-cinder | 15:26 | |
*** andreas_s has quit IRC | 15:29 | |
*** andreas_s has joined #openstack-cinder | 15:30 | |
*** gcb has joined #openstack-cinder | 15:31 | |
*** eharney has quit IRC | 15:32 | |
*** itlinux has joined #openstack-cinder | 15:37 | |
*** izombie has joined #openstack-cinder | 15:37 | |
*** andreas_s has quit IRC | 15:40 | |
*** zhaochao has quit IRC | 15:41 | |
*** itlinux has quit IRC | 15:42 | |
*** andreas_s has joined #openstack-cinder | 15:45 | |
*** pchavva has joined #openstack-cinder | 15:46 | |
*** felipemonteiro__ has joined #openstack-cinder | 15:47 | |
*** eharney has joined #openstack-cinder | 15:47 | |
*** AlexeyAbashkin has quit IRC | 15:50 | |
*** AlexeyAbashkin has joined #openstack-cinder | 15:50 | |
*** esker has quit IRC | 15:52 | |
*** AlexeyAbashkin has quit IRC | 15:55 | |
*** AlexeyAbashkin has joined #openstack-cinder | 15:55 | |
*** david-lyle has joined #openstack-cinder | 15:57 | |
*** itlinux has joined #openstack-cinder | 15:57 | |
*** felipemonteiro has joined #openstack-cinder | 15:58 | |
*** andreas_s has quit IRC | 15:59 | |
*** andreas_s has joined #openstack-cinder | 16:01 | |
*** felipemonteiro__ has quit IRC | 16:01 | |
*** alexchadin has joined #openstack-cinder | 16:03 | |
*** markstur has joined #openstack-cinder | 16:03 | |
*** armaan has quit IRC | 16:04 | |
*** andreas_s has quit IRC | 16:05 | |
*** markstur_ has joined #openstack-cinder | 16:05 | |
*** andreas_s has joined #openstack-cinder | 16:06 | |
*** markstur has quit IRC | 16:08 | |
*** e0ne has quit IRC | 16:12 | |
*** lkuchlan has quit IRC | 16:18 | |
*** kaisers_ has quit IRC | 16:29 | |
*** chandankumar is now known as chkumar|off | 16:30 | |
*** david-lyle has quit IRC | 16:34 | |
*** alexchadin has quit IRC | 16:35 | |
*** AlexeyAbashkin has quit IRC | 16:38 | |
*** andreas_s has quit IRC | 16:40 | |
*** andreas_s has joined #openstack-cinder | 16:44 | |
*** lhx_ has quit IRC | 16:45 | |
*** david-lyle has joined #openstack-cinder | 16:47 | |
*** david-lyle has quit IRC | 16:48 | |
*** david-lyle has joined #openstack-cinder | 16:49 | |
*** andreas_s has quit IRC | 16:53 | |
*** andreas_s has joined #openstack-cinder | 16:54 | |
*** gkadam has joined #openstack-cinder | 16:58 | |
*** kaisers_ has joined #openstack-cinder | 16:59 | |
*** gcb has quit IRC | 17:00 | |
*** andreas_s has quit IRC | 17:00 | |
*** erlon_ has quit IRC | 17:03 | |
*** mvk has quit IRC | 17:10 | |
*** crose has joined #openstack-cinder | 17:12 | |
*** felipemonteiro has quit IRC | 17:14 | |
*** felipemonteiro__ has joined #openstack-cinder | 17:14 | |
Swanson | Where are timeouts for rest calls set? Dumb question, I'm sure, but I have a REST call that is taking 3 minutes to fail. Seems excessive. | 17:17 |
*** diablo_rojo has quit IRC | 17:23 | |
*** csaikia has quit IRC | 17:26 | |
*** csaikia has joined #openstack-cinder | 17:26 | |
*** AlexeyAbashkin has joined #openstack-cinder | 17:29 | |
smcginnis | Swanson: I think it's a parameter to the requests call, IIRC. | 17:35 |
*** izombie has quit IRC | 17:35 | |
Swanson | smcginnis, It doesn't appear to be part of the session. So I presume it is on each call... | 17:35 |
patrickeast | smcginnis: Swanson : yea its something you have to pass in on each one | 17:35 |
patrickeast | might be some global config to change the default | 17:36 |
*** markvoelker has joined #openstack-cinder | 17:36 | |
Swanson | patrickeast, Thanks. Looking into that now. | 17:38 |
*** prateek has joined #openstack-cinder | 17:40 | |
*** tesseract has quit IRC | 17:46 | |
*** felipemonteiro has joined #openstack-cinder | 17:49 | |
*** felipemonteiro__ has quit IRC | 17:51 | |
*** alexchadin has joined #openstack-cinder | 17:58 | |
Swanson | Not sure why this has bumped up to 3 minute timeouts for this customer but I think I'm just going to add timeouts to the individual posts and whatnot.. | 17:58 |
hemna_ | some calls are synch calls afaik | 18:01 |
hemna_ | vs. async | 18:01 |
*** david-lyle has quit IRC | 18:13 | |
openstackgerrit | Lucian Petrut proposed openstack/cinder master: Update Windows docs https://review.openstack.org/538313 | 18:15 |
*** diablo_rojo has joined #openstack-cinder | 18:16 | |
*** lpetrut has quit IRC | 18:25 | |
*** prateek has quit IRC | 18:26 | |
*** alexchadin has quit IRC | 18:27 | |
*** itlinux has quit IRC | 18:36 | |
*** alexchadin has joined #openstack-cinder | 18:38 | |
*** salv-orl_ has quit IRC | 18:39 | |
*** salv-orlando has joined #openstack-cinder | 18:39 | |
*** alexchadin has quit IRC | 18:41 | |
*** armaan has joined #openstack-cinder | 18:43 | |
*** salv-orlando has quit IRC | 18:44 | |
*** AlexeyAbashkin has quit IRC | 18:46 | |
*** moshele has joined #openstack-cinder | 18:53 | |
*** armaan has quit IRC | 18:58 | |
*** ircuser-1 has quit IRC | 19:00 | |
*** armaan has joined #openstack-cinder | 19:00 | |
*** kaisers_ has quit IRC | 19:09 | |
*** kaisers_ has joined #openstack-cinder | 19:09 | |
*** alexchadin has joined #openstack-cinder | 19:09 | |
*** alexchadin has quit IRC | 19:11 | |
*** adisky__ has quit IRC | 19:12 | |
*** harlowja has joined #openstack-cinder | 19:17 | |
*** ayoung has joined #openstack-cinder | 19:20 | |
*** armaan has quit IRC | 19:21 | |
ayoung | smcginnis, or anyone who might know: if I try to make a volume bootable, and it fails (why is a different story for now) I can't quite figure out how to free up the volume. It is still attached, but to an instance that does not exists, and I can't (as a normal user) change that state. | 19:22 |
ayoung | b5d7ec69-772b-4969-ad6c-438e06ef202c | cfme_volume | in-use | 80 | Attached to c54316f8-2b6f-4f33-bfcb-25b62cc7cbf3 on /dev/vda | 19:22 |
ayoung | and openstack server remove volume 21b801c3-fab3-4845-b395-b61eb40ae643 279d37ed-16f1-42b9-8cc1-543be3b41332 | 19:23 |
ayoung | No server with a name or ID of '21b801c3-fab3-4845-b395-b61eb40ae643' exists. | 19:23 |
*** armaan has joined #openstack-cinder | 19:23 | |
ayoung | openstack volume set --state error b5d7ec69-772b-4969-ad6c-438e06ef202c | 19:23 |
ayoung | Failed to set volume state: Policy doesn't allow volume_extension:volume_admin_actions:reset_status to be performed. (HTTP 403) (Request-ID: req-c9706c71-12f3-4648-9084-a7cd3e41f36d) | 19:23 |
ayoung | One or more of the set operations failed | 19:23 |
ayoung | is there any reason not to change that policy, and make it so a _member_ can perform reset_status? | 19:24 |
eharney | the primary reason is that it would allow users to set things into inconsistent states, we'd need a less dangerous/more limited reset command if we wanted to users to access it, i think | 19:26 |
ayoung | eharney, yeah, but that can't work for existing deploys | 19:29 |
ayoung | eharney, what would be the worst that could happen? A user could corrupt a device already attached to a server? | 19:30 |
hemna_ | so....thoughts on lvmetad ? | 19:30 |
hemna_ | enable or not? | 19:30 |
eharney | ayoung: not sure really, a lot of messy things could likely happen inside of cinder | 19:30 |
ayoung | eharney, like, say a user changes the state of an attached drive, makes it available, and then another user attaches it to another server? | 19:32 |
eharney | ayoung: yes | 19:32 |
ayoung | nova would have two servers attached to the same device, and corruption of an epic scale? | 19:32 |
ayoung | eharney, right now, there is a bunch of internet posts about fixing the problem I am seeing by hacking the CInder MySQL instance | 19:33 |
ayoung | that is arguably just as bad or badder | 19:34 |
ayoung | maybe badderest | 19:34 |
ayoung | I tried to create a volume from a glance image. The image requires a disk larger than the largest flavor provides, so I made it 80 GB. And then booted the Nova server using that volume. That boot failed, and I can't delete or re-attached the image. | 19:35 |
ayoung | Its kimndof a sad failure mode | 19:35 |
eharney | IMO the answer is to redesign things to not have numerous "an error occurred and now you're stuck in bad state X" traps all over Cinder that require reset operations | 19:35 |
smcginnis | ayoung: Looks like that first command is failing due to using the wrong arguments of osc. | 19:35 |
eharney | i started sketching out a plan for how to do this a bit ago, maybe i should pick it up again... | 19:35 |
smcginnis | ayoung: For a boot from volume server, I beleive you will need to delete the server first. | 19:36 |
ayoung | smcginnis, yep, but once the server is deleted, the volume is wedged | 19:36 |
ayoung | can't change its state | 19:36 |
smcginnis | ayoung: So the server is deleted and gone, but the volume still shows attached? | 19:36 |
ayoung | yep | 19:36 |
ayoung | this is an older deploy, probably OSP10 or 11, which maps to Newton or Ocata, I think | 19:37 |
smcginnis | OK, then you need to reset status of the volume. | 19:38 |
smcginnis | But like eharney said, it's risky to allow that for all users. | 19:38 |
ayoung | right...but this is a situation that the average user could inflict on himself...I am a pretty average user. Maybe below average. | 19:38 |
smcginnis | ayoung: Well, _normally_ they shouldn't get in this state, but sounds like there is some other error that got you here. | 19:39 |
ayoung | smcginnis, right so when I booted the volume, I got this error: Build of instance 21b801c3-fab3-4845-b395-b61eb40ae643 aborted: Block Device Mapping is Invalid. | 19:40 |
ayoung | I created the volume using the os_volume ansible module from an image. It might be that the image was bad. | 19:40 |
ayoung | os_volume: | 19:41 |
ayoung | state: present | 19:41 |
ayoung | cloud: "{{ cloudname }}" | 19:41 |
ayoung | size: 81 | 19:41 |
ayoung | display_name: cfme_volume_2 | 19:41 |
ayoung | image: cfme-rhos-5.8.1.5-1 | 19:41 |
ayoung | doesn't seem crazy. and it seems like the only way to boot this image, as the image is pretty big: | 19:41 |
ayoung | obviously, I could ask for a larger flavor to be created, too | 19:41 |
smcginnis | Yeah, that's all fine. You can boot an instance from a volume. But if this was done through nova, and nova failed to boot the instance and decided to delete the instance without detaching the volume, then that's the root of the problem. | 19:42 |
ayoung | so I called "delete server" | 19:42 |
smcginnis | Just saying, theoretically if things are working right, the need to administratively override the volume status should be pretty low. | 19:43 |
ayoung | It would not let me detach the volume first, as it was the root volume | 19:43 |
*** alexchadin has joined #openstack-cinder | 19:43 | |
*** lpetrut has joined #openstack-cinder | 19:43 | |
ayoung | I'm trying to not just solve the problem, but come up with a general solution that can be applied when I am not here...or the only other admin for this cluster who is not available at the moment. | 19:44 |
hemna_ | anyone have a devstack up with an lvm backend configured? | 19:46 |
ayoung | smcginnis, you are saying that the problem is Nova did not set the volume status when deleting the server? | 19:46 |
hemna_ | I can't create a volume from an lvm snap | 19:46 |
hemna_ | device-mapper: reload ioctl on (254:23) failed: No data available | 19:46 |
smcginnis | ayoung: Just a guess, but I think the problem now is you deleted the server, but the osc command you are trying to run is through the server interface. | 19:47 |
hemna_ | I get that from the lvchange command | 19:47 |
smcginnis | hemna_: Is the snap activated? | 19:47 |
ayoung | smcginnis, but when I delete a server, normally you would expect it to change the volume state, regardless of what state the server is in, right? | 19:47 |
hemna_ | "activated" ? | 19:47 |
hemna_ | I created an lvm volumed, then snapped it, then trying to create a new vol from the snap | 19:48 |
smcginnis | ayoung: Yes, I would. | 19:48 |
*** david-lyle has joined #openstack-cinder | 19:51 | |
*** pcaruana has quit IRC | 19:52 | |
ayoung | smcginnis, https://bugs.launchpad.net/nova/+bug/1404867 | 19:53 |
openstack | Launchpad bug 1404867 in OpenStack Compute (nova) "Volume remains in-use status, if instance booted from volume is deleted in error state" [Medium,In progress] - Assigned to melanie witt (melwitt) | 19:53 |
smcginnis | Oh man, 2015. | 19:54 |
ayoung | smcginnis, and melwitt is on it, still. | 19:54 |
smcginnis | Looks like every fix got reverted. | 19:55 |
melwitt | I just rebased that patch yesterday :P | 19:55 |
hemna_ | the lvchange had -a in it to activate it | 19:55 |
smcginnis | melwitt: Third (or fourth) times a charm? :) | 19:55 |
melwitt | yeah, back in the day, mistakes in the patch kept breaking the gate, specifically only the postgres job | 19:55 |
hemna_ | err -ay | 19:56 |
ayoung | melwitt, its ok, I am once again on the hook for Bug 968696 and that was opened in 2012 | 19:56 |
openstack | bug 968696 in OpenStack Identity (keystone) ""admin"-ness not properly scoped" [High,In progress] https://launchpad.net/bugs/968696 - Assigned to Adam Young (ayoung) | 19:56 |
melwitt | hah | 19:56 |
smcginnis | :) | 19:56 |
ayoung | melwitt, In your humble opinion, is this backportable? | 19:57 |
melwitt | ayoung: yes, it's backportable but not 100% straightforward because of differences in how volumes worked in the past. and I don't think it would be backported upstream because of the relatively low severity of the bug | 19:59 |
ayoung | melwitt, fair enough. Its just annoying that a user can, easily, get into a situation which requires an admin to get them out of. | 20:02 |
ayoung | And even if your fix goes it, I don't get to use it until we have a downstream version. | 20:03 |
*** alexchadin has quit IRC | 20:03 | |
melwitt | ayoung: yeah, agreed. I will ask if we can backport it upstream but regardless I'll be backporting it downstream | 20:03 |
ayoung | ++ | 20:03 |
smcginnis | ayoung: What version did you say you are running? | 20:03 |
ayoung | smcginnis, I'm not 100% certain. I think RH OSP 11, which would be Ocata | 20:04 |
ayoung | anyway I can tell as an end user? | 20:04 |
*** mvk has joined #openstack-cinder | 20:04 | |
melwitt | my bug is from liberty -_- | 20:05 |
smcginnis | ayoung: Probably could only backport to Pike at this point, and unless it merges in the next couple weeks, probably only can backport to stable/queens by that point. | 20:05 |
ayoung | ++ | 20:05 |
smcginnis | melwitt: Speaking of sagas, what ever happened to the bug about not checking host storage availability for boot from volume instances? Did that one ever get resolved? | 20:06 |
melwitt | smcginnis: you mean the root_gb=0 thing? not yet, the temporary stop-gap patches have been refused since resource providers work is supposed to solve the issue properly (with shared storage modeling). and the problem is super latent, it's always been that way. we're looking toward rocky for that now | 20:08 |
smcginnis | melwitt: Yep, that one. Cool, hopefully that works out in Rocky. | 20:09 |
smcginnis | melwitt: I know I've been pinged about that several times. | 20:09 |
melwitt | ++ | 20:10 |
openstackgerrit | Eric Harney proposed openstack/cinder master: Rename lio job to lio-barbican https://review.openstack.org/539306 | 20:10 |
*** felipemonteiro has quit IRC | 20:15 | |
*** felipemonteiro__ has joined #openstack-cinder | 20:15 | |
ayoung | smcginnis, so...back to the dangerous thing...I realize that changing the status via that API really just changes the database table. Thast in turn is used to determine what actions are legal for a given volume. From the CInder side, it it possible to "yank" a volume from Nova, so that it is no longer available? | 20:25 |
ayoung | a "safe" way from the cinder perspective? | 20:29 |
*** lpetrut has quit IRC | 20:35 | |
*** lpetrut has joined #openstack-cinder | 20:40 | |
*** e0ne has joined #openstack-cinder | 20:42 | |
Swanson | Got one, a second +2 out there? https://review.openstack.org/#/c/538314/ | 20:47 |
*** diablo_rojo has quit IRC | 20:48 | |
*** KeithMnemonic has joined #openstack-cinder | 20:50 | |
openstackgerrit | Tom Swanson proposed openstack/cinder master: DellEMC SC: Added timeout to REST calls https://review.openstack.org/539318 | 20:54 |
*** e0ne has quit IRC | 20:55 | |
smcginnis | ayoung: Sorry, was in a meeting. | 20:55 |
smcginnis | ayoung: So the storage is probably exported to the compute host. | 20:56 |
smcginnis | ayoung: Deleting the volume should get rid of that. | 20:56 |
ayoung | smcginnis, No need to apologize. I am aware of how much an interruption and IRC question can be. | 20:56 |
smcginnis | ayoung: It should be safe as far as yanking it from the compute host. | 20:56 |
smcginnis | ayoung: Haha, yep, no worries. :) | 20:56 |
ayoung | smcginnis, but I can't delete the volume in the state...which is, I assume, a check on the user from pulling out their own plug. However, would that be safer than allowing them to update the state? | 20:57 |
smcginnis | ayoung: Linux is pretty good about block devices going away, unlike some operating systems. | 20:57 |
smcginnis | ayoung: There's some cleanup that should be done, but I believe next time a volume is attached it should mostly clean itself up. | 20:57 |
smcginnis | ayoung: Yeah, you're going to have to update state, then delete. | 20:57 |
ayoung | so let me put my keystone hat on for a moment | 20:57 |
ayoung | say I want to make my cluser as self maintaining as possible | 20:58 |
ayoung | and I don't want people asking for cluster admins to clean up their mess | 20:58 |
ayoung | I want a "smart storage person" on a project that can do more than just the basics | 20:58 |
ayoung | I was thinking that we should have a role that is not-quite-admin | 20:58 |
smcginnis | ayoung: Unfortunately with failures like this, I think the only way to make it self-serve is to give the users more power than you probably want to. | 20:58 |
ayoung | project-manager or something. So the question is what power to give to project-manager so that they can clean up their project, but not negatively affect other projects | 20:59 |
smcginnis | ayoung: Project admin I think has been brought up before. I like that idea, but not sure how many years it will take to get there. :] | 20:59 |
ayoung | smcginnis, its been 6 years thus far, what are another 1/2 dozen? | 20:59 |
smcginnis | Hehe | 21:00 |
* smcginnis has a sad cry | 21:00 | |
ayoung | smcginnis, one of my goals is to get some proof-of-concept deployments out there to iron out the real world issues with these | 21:00 |
ayoung | I recently switched from Software Engineer to solutions architect in order to talk more with customers so that these discussions would have the weight of real world pain behind them | 21:00 |
smcginnis | ayoung: ++ awesome | 21:01 |
smcginnis | ayoung: A noble reason to go to the dark(ish) side. :) | 21:01 |
ayoung | smcginnis, so, our team has a cloud for running demos, and this is where I wedged things | 21:01 |
smcginnis | ayoung: I think we need more of that. Feedback on real pain points would definitely be welcome. | 21:01 |
ayoung | I'm sure I will eventually get the "keys to the kingdom" for this cluster, but right now I am enjoying being a _member_ and keeping track of the ways I can mess things up | 21:02 |
smcginnis | Not sure how to best address this pain point, other than getting that fix in nova, but if we can do something in Cinder to make that better without compromising other use cases, then I'm all for it. | 21:02 |
ayoung | smcginnis, question on the root error: is there a timeout problem when booting from a volume? I had an 80GB volume, and that seems to be why the server boot failed | 21:03 |
ayoung | some artivcles seem to say that I need to expand a timeout to let it succeed | 21:03 |
ayoung | https://ask.openstack.org/en/question/62636/instance-creation-fails-block-device-mapping/ for example | 21:03 |
smcginnis | ayoung: I wouldn't think so. It should discover the new block device like any other new volume, then the instance *should* be able to boot from it almost like a local ephemeral disk. | 21:04 |
smcginnis | Oh! | 21:04 |
smcginnis | There is a timeout issue when having the volume created through the nova API calls. | 21:04 |
smcginnis | So if you tell Nova to create a new instance and to create a volume for it, sometimes it takes too long for nova to proxy those calls to cinder and everything to complete in time for it to succeed within the default window. | 21:05 |
smcginnis | So in those cases it does need to be increased. | 21:05 |
ayoung | not what I am dfoing here though | 21:05 |
ayoung | I am trying to use an existing volume: | 21:05 |
smcginnis | ayoung: Yeah, if you pre-create the volume, then tell Nova to boot from it, that shouldn't be an issue here. | 21:05 |
smcginnis | And really is the preferable, though less streamlines, workflow. | 21:05 |
ayoung | got the same error reported in one of the comments: Block Device Mapping is Invalid: | 21:05 |
smcginnis | It's kind of a catch all I think when the nova instance isn't able to find or use the block device I think. | 21:06 |
ayoung | smcginnis, what would happen if the original image were bogus? The one I used to create the volume in the first call? | 21:07 |
ayoung | is there any validation done? | 21:07 |
smcginnis | IIRC, there is basic md5 hash verification. | 21:09 |
smcginnis | ayoung: There is a proposal to add support for image signing. | 21:09 |
ayoung | Meh...that would not do much. If someone uploads a bogus image, they would still end up here | 21:10 |
smcginnis | ayoung: But that's just the download step. There's nothing that verifies dd'ing the image to the volume didn't hit corruption as at that point I think it would have to reread the entire volume. | 21:10 |
smcginnis | And yeah, nothing to say that the original image wasn't junk in the first place. | 21:10 |
*** felipemonteiro has joined #openstack-cinder | 21:10 | |
smcginnis | You can create an image of a non-bootable volume and create a bootable volume from it. | 21:11 |
ayoung | right, of course | 21:11 |
ayoung | a very important workflow, too | 21:11 |
*** diablo_rojo_phon has left #openstack-cinder | 21:12 | |
*** pchavva has quit IRC | 21:13 | |
*** felipemonteiro__ has quit IRC | 21:13 | |
*** lpetrut has quit IRC | 21:19 | |
*** eharney_ has joined #openstack-cinder | 21:21 | |
Swanson | Dumb multiattach question. If I get a force-detach (nontype connector) I'm whacking ALL attachments, right? | 21:22 |
smcginnis | Swanson: Correct. | 21:23 |
smcginnis | Swanson: I believe we went through things, and the manager will not send a None connector down to the driver otherwise. | 21:23 |
*** eharney has quit IRC | 21:23 | |
*** eharney_ is now known as eharney | 21:23 | |
Swanson | smcginnis, This is bogus? https://git.openstack.org/cgit/openstack/cinder-specs/tree/specs/queens/enable-multiattach.rst#n142 | 21:24 |
Swanson | Maybe I should look at the impl and not the spec(l). | 21:24 |
smcginnis | No habla ingles. | 21:25 |
ildikov | smcginnis: I guess we could do a better job with docs as usual... | 21:25 |
smcginnis | Always seems to be the case. | 21:26 |
ildikov | Swanson: the spec is always just an indication on what we might want to achieve :) | 21:26 |
Swanson | You spelled "is" wrong. | 21:26 |
*** moshele has quit IRC | 21:26 | |
smcginnis | ildikov: Feel free to slap him. | 21:26 |
ildikov | smcginnis: I have a high threshold :) | 21:27 |
smcginnis | ildikov: Feel free to slap him anyway. :) | 21:27 |
Swanson | Anyone have the review link for this in their pocket? | 21:27 |
Swanson | Ah, there it is. | 21:28 |
ildikov | smcginnis: ah, so you want me to do the dirty work for you? | 21:28 |
ildikov | :) | 21:28 |
smcginnis | They know my face there. :) | 21:28 |
ildikov | lol | 21:29 |
*** eharney has quit IRC | 21:30 | |
Swanson | Soooo.... set shared_targets to True and then test that multiple attachments actually work? Spiffy. | 21:32 |
ildikov | I think shared_targets is True if not set specifically to False | 21:33 |
Swanson | That seems nuts. | 21:35 |
Swanson | I get it. | 21:37 |
Swanson | So, don't set dick and just see if it works? | 21:37 |
*** eharney has joined #openstack-cinder | 21:39 | |
*** threestrands has joined #openstack-cinder | 21:40 | |
*** kaisers_ has quit IRC | 21:44 | |
*** kaisers_ has joined #openstack-cinder | 21:44 | |
*** armaan has quit IRC | 21:46 | |
ildikov | Swanson: set it to True, it can't go wrong | 21:46 |
*** armaan has joined #openstack-cinder | 21:47 | |
*** mvenesio has quit IRC | 21:53 | |
*** dustins has quit IRC | 21:54 | |
*** mvenesio has joined #openstack-cinder | 21:54 | |
*** felipemonteiro has quit IRC | 21:57 | |
*** eharney has quit IRC | 21:57 | |
*** felipemonteiro has joined #openstack-cinder | 21:57 | |
*** mvenesio has quit IRC | 21:58 | |
*** mylu has joined #openstack-cinder | 21:59 | |
*** crose has quit IRC | 22:02 | |
jgriffith | Swanson: why do you insist on making all the simple things so difficult :) | 22:03 |
jgriffith | Swanson: you sir are a grinder :) | 22:03 |
Swanson | jgriffith, We'll see how simple this is. We'll see! | 22:04 |
jgriffith | hehe | 22:04 |
jgriffith | Swanson: you just need to lower your standards | 22:04 |
jgriffith | Swanson: when you set the bar as low as I do things are *awesome* :) | 22:05 |
smcginnis | I've seen what he eats for lunch. Trust me, his standards are pretty low. | 22:05 |
jgriffith | ha! | 22:05 |
jgriffith | Pickled Pigs Feet? | 22:05 |
jgriffith | Good ol PPF | 22:05 |
jgriffith | mmmmmmmmm | 22:05 |
smcginnis | *hurl* | 22:05 |
jgriffith | some greens on the side | 22:05 |
Swanson | Had a sandwich from the machine today. I'm not sure what meat is gray (other than Arbys) but I'll say this, it wasn't great. | 22:06 |
jgriffith | Swanson: Ok, I stand corrected; anybody eating a sandwich from a machine has their bar set low enough | 22:09 |
*** edmondsw has quit IRC | 22:11 | |
*** edmondsw has joined #openstack-cinder | 22:12 | |
openstackgerrit | Alan Bishop proposed openstack/cinder master: Fix how backups handle encryption key IDs https://review.openstack.org/537462 | 22:13 |
*** salv-orlando has joined #openstack-cinder | 22:14 | |
*** edmondsw has quit IRC | 22:17 | |
*** abishop has quit IRC | 22:17 | |
Swanson | jgriffith, I've had worse. These are actually better than they used to be. Back before the health department shut the vendor down for 6 months or so. | 22:17 |
*** rcernin has quit IRC | 22:18 | |
*** tpsilva has quit IRC | 22:22 | |
*** felipemonteiro__ has joined #openstack-cinder | 22:27 | |
jgriffith | Swanson: Ha!! | 22:28 |
*** csaikia has quit IRC | 22:29 | |
*** csaikia has joined #openstack-cinder | 22:29 | |
*** felipemonteiro has quit IRC | 22:31 | |
*** diablo_rojo has joined #openstack-cinder | 22:36 | |
*** hemna_ has quit IRC | 22:45 | |
*** itlinux has joined #openstack-cinder | 22:48 | |
ildikov | I'm so glad it's not meal time here for a while :) | 22:49 |
smcginnis | :) | 22:51 |
ildikov | jgriffith: well, if he messes things up now we still have a little time to fix, so why not? | 22:51 |
smcginnis | Go to bed ildikov! | 22:51 |
*** rcernin has joined #openstack-cinder | 22:52 | |
*** itlinux has quit IRC | 22:52 | |
* ildikov has a sad kid face now | 22:52 | |
jgriffith | haha | 22:53 |
*** sticker has joined #openstack-cinder | 22:53 | |
ildikov | smcginnis: I won't be able to sleep anyway... | 22:53 |
smcginnis | Jet lagged again? | 22:54 |
*** csaikia has quit IRC | 22:54 | |
ildikov | smcginnis: I would drop the 'again' part :) | 22:54 |
ildikov | smcginnis: I don't have a time zone anymore, but sadly the accountant and the chiropractor do... | 22:55 |
smcginnis | ildikov: You should be able to fall asleep at any time of the day now. :) | 22:56 |
ildikov | jgriffith: BTW, did you get anywhere with debugging that swap volume issue? | 22:56 |
ildikov | jgriffith: I thought to at least re-run it on the gate, but it's been dying ever since hence I switched to patience... | 22:57 |
jgriffith | ildikov: I did not | 22:57 |
*** andreas_s has joined #openstack-cinder | 22:58 | |
ildikov | smcginnis: yeah, well, sleeping was never my strong suit, I'm way better at daydreaming which I'm practicing day and night now | 22:58 |
ildikov | jgriffith: then we're on the same page at least :) | 22:59 |
ildikov | jgriffith: I will look into it when I can, I just wanted to know whether you might have some new hints on that one | 22:59 |
jgriffith | ildikov: I couldn't get it to fail and moved on | 23:00 |
jgriffith | added the logging so the gate job that fails might give us some more insight | 23:00 |
*** mriedem is now known as mriedem_afk | 23:02 | |
*** andreas_s has quit IRC | 23:02 | |
Swanson | Huh. Multipath on unbuntu seems less than awesome. | 23:02 |
jgriffith | s/ubuntu//g | 23:02 |
Swanson | Yeah, that. | 23:03 |
*** dave-mccowan has quit IRC | 23:03 | |
Swanson | Always best to wait until the end of the cycle to revisit everything. | 23:03 |
ildikov | jgriffith: fair enough | 23:07 |
*** gnufied has quit IRC | 23:07 | |
ildikov | jgriffith: I saw the logging, hence I thought to rerun the tests, but the gate is under heavy load, so I thought to wait a little with that | 23:07 |
ildikov | jgriffith: but wasn't sure whether you ever got this to fail or not, that's why I asked | 23:08 |
*** salv-orlando has quit IRC | 23:21 | |
*** salv-orlando has joined #openstack-cinder | 23:22 | |
*** salv-orlando has quit IRC | 23:26 | |
*** armaan has quit IRC | 23:45 | |
*** stakeda has joined #openstack-cinder | 23:49 | |
*** ganso has quit IRC | 23:53 | |
*** rcernin has quit IRC | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!