Saturday, 2025-10-18

opendevreviewRose Kimondo proposed openstack/manila master: Doc for deferred share/snapshot deletion  https://review.opendev.org/c/openstack/manila/+/96416102:05
opendevreviewRose Kimondo proposed openstack/manila master: Doc for deferred share/snapshot deletion  https://review.opendev.org/c/openstack/manila/+/96416102:42
mohsen_https://www.irccloud.com/pastebin/8UVm9IJt/07:03
mohsen_Hi friends.07:07
mohsen_I have an issue when installing manila.07:07
mohsen_when I try to install manila using kolla-ansible with cephfs native driver and dhss = false, the manila_share container is unhealthy, even though it can connect to the ceph backend successfully as logged in the manila_share container:07:07
mohsen_INFO manila.share.drivers.cephfs.driver [None req-4a245522-0459-420d-8be8-92f9f19b518d - - - - - -] [CEPHFS1] Ceph client connection complete.07:07
mohsen_the issue is that once it registers cephfsnative backend as a share service in the manila database, it cannot update its state in the database and it shows:07:07
mohsen_openstack share service list07:07
mohsen_+----+------------------+----------------------------+------+---------+-------+----------------------------+-----------------+07:07
mohsen_| ID | Binary           | Host                       | Zone | Status  | State | Updated At                 | Disabled Reason |07:07
mohsen_+----+------------------+----------------------------+------+---------+-------+----------------------------+-----------------+07:07
mohsen_|  1 | manila-data      | controller01               | nova | enabled | up    | 2025-10-18T06:59:15.147804 | None            |07:07
mohsen_|  2 | manila-scheduler | controller01               | nova | enabled | up    | 2025-10-18T06:59:17.268280 | None            |07:07
mohsen_|  3 | manila-share     | controller01@cephfsnative1 | nova | enabled | up    | None                       | None            |07:07
mohsen_+----+------------------+----------------------------+------+---------+-------+----------------------------+-----------------+07:07
mohsen_its "Updated At" column shows None, which means it couldn't update its state properly. when creating a share using cephfs type, I get the following error in manila_scheduler:07:07
mohsen_ WARNING manila.scheduler.host_manager [None req-781c0b10-68df-45e1-9da2-88024443fe31 f8e503ad2c134bee9a1ea8b75bdbfbfd d4954b315a50489392398e38372ad06d - - - -] Share service is down. (host: controller01@cephfsnative1).07:07
mohsen_ERROR manila.scheduler.manager [None req-781c0b10-68df-45e1-9da2-88024443fe31 f8e503ad2c134bee9a1ea8b75bdbfbfd d4954b315a50489392398e38372ad06d - - - -] Failed to schedule create_share: There are no hosts to fulfill this provisioning request. Are share backend services down?: manila.exception.WillNotSchedule: There are no hosts to fulfill this provisioning request. Are share backend services down?07:07
mohsen_I appreciate your help in advance.07:07
gouthamrmohsen_: few things to try: are there any more logs in the manila-share service - perhaps enable debug logging. have you tried re-starting the manila-share container? Try "openstack share pool list --detail" 07:11
mohsen_gouthamr: yes. this is the error log in manila_share service:07:21
mohsen_2025-10-18 05:11:02.028 7 CRITICAL manila [None req-e790be77-d3be-40d7-9f26-f47d8b53e821 - - - - - -] Unhandled error: manila.exception.ServiceNotFound: Service None could not be found.07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila Traceback (most recent call last):07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila   File "/var/lib/kolla/venv/bin/manila-share", line 7, in <module>07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila     sys.exit(main())07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila   File "/var/lib/kolla/venv/lib/python3.10/site-packages/manila/cmd/share.py", line 64, in main07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila     launcher.wait()07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila   File "/var/lib/kolla/venv/lib/python3.10/site-packages/oslo_service/service.py", line 693, in wait07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila     self.stop()07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila   File "/var/lib/kolla/venv/lib/python3.10/site-packages/oslo_service/service.py", line 702, in stop07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila     service.stop()07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila   File "/var/lib/kolla/venv/lib/python3.10/site-packages/manila/service.py", line 257, in stop07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila     db.service_update(context.get_admin_context(),07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila   File "/var/lib/kolla/venv/lib/python3.10/site-packages/manila/db/api.py", line 136, in service_update07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila     return IMPL.service_update(context, service_id, values)07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila   File "/var/lib/kolla/venv/lib/python3.10/site-packages/manila/db/sqlalchemy/api.py", line 148, in wrapper07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila     return f(*args, **kwargs)07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila   File "/var/lib/kolla/venv/lib/python3.10/site-packages/manila/db/sqlalchemy/api.py", line 247, in wrapper07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila     return f(context, *args, **kwargs)07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila   File "/var/lib/kolla/venv/lib/python3.10/site-packages/oslo_db/api.py", line 144, in wrapper07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila     with excutils.save_and_reraise_exception() as ectxt:07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila   File "/var/lib/kolla/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila     self.force_reraise()07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila   File "/var/lib/kolla/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila     raise self.value07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila   File "/var/lib/kolla/venv/lib/python3.10/site-packages/oslo_db/api.py", line 142, in wrapper07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila     return f(*args, **kwargs)07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila   File "/var/lib/kolla/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila     return fn(*args, **kwargs)07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila   File "/var/lib/kolla/venv/lib/python3.10/site-packages/manila/db/sqlalchemy/api.py", line 686, in service_update07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila     service_ref = _service_get(context, service_id)07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila   File "/var/lib/kolla/venv/lib/python3.10/site-packages/manila/db/sqlalchemy/api.py", line 148, in wrapper07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila     return f(*args, **kwargs)07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila   File "/var/lib/kolla/venv/lib/python3.10/site-packages/manila/db/sqlalchemy/api.py", line 562, in _service_get07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila     raise exception.ServiceNotFound(service_id=service_id)07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila manila.exception.ServiceNotFound: Service None could not be found.07:21
mohsen_2025-10-18 05:11:02.028 7 ERROR manila07:21
mohsen_2025-10-18 05:11:04.242 8 INFO oslo_service.periodic_task [-] Skipping periodic task update_share_usage_size because it is disabled07:21
mohsen_2025-10-18 05:11:04.304 8 INFO oslo_service.service [None req-c88253c4-fb55-41c4-b990-327389bcc9f1 - - - - - -] Starting 1 workers07:21
mohsen_2025-10-18 05:11:04.317 17 INFO manila.service [-] Starting manila-share node (version 18.3.1)07:21
mohsen_2025-10-18 05:11:04.843 17 INFO manila.share.drivers.cephfs.driver [None req-de3fd87e-1c1c-4998-a3e0-23d43702ca5b - - - - - -] [CEPHFS1] Ceph client found, connecting...07:21
mohsen_2025-10-18 05:11:04.872 17 INFO manila.share.drivers.cephfs.driver [None req-de3fd87e-1c1c-4998-a3e0-23d43702ca5b - - - - - -] [CEPHFS1] Ceph client connection complete.07:21
mohsen_I restarted manila_share container a couple of times but nothing happend. 07:21
mohsen_The output of "openstack share pool list --detail" was empty.07:21
opendevreviewDenver Baraka proposed openstack/python-manilaclient master: Fix neutron validation in share network creation  https://review.opendev.org/c/openstack/python-manilaclient/+/96435015:15
gouthamrmohsen_: hmm, strange. think we see this occur in the CI.. could you file a bug? https://bugs.launchpad.net/manila16:17
gouthamrmohsen_: to work around this, try changing something about the backend - perhaps the backend configuration section name, and restart the manila-share container again. This should cause the process to register as a new service16:21
opendevreviewWarren Jeffs proposed openstack/manila master: update to use openstack cli, not legacy manila cli  https://review.opendev.org/c/openstack/manila/+/96435219:43
opendevreviewWarren Jeffs proposed openstack/manila master: update to use openstack cli, not legacy manila cli  https://review.opendev.org/c/openstack/manila/+/96435219:51
opendevreviewMarco Wehrhahn proposed openstack/manila master: WIP added list share snapshots schema and validation  https://review.opendev.org/c/openstack/manila/+/96435522:00
opendevreviewMerged openstack/manila master: update to use openstack cli, not legacy manila cli  https://review.opendev.org/c/openstack/manila/+/96435223:37

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!