| opendevreview | Rose Kimondo proposed openstack/manila master: Doc for deferred share/snapshot deletion https://review.opendev.org/c/openstack/manila/+/964161 | 02:05 |
|---|---|---|
| opendevreview | Rose Kimondo proposed openstack/manila master: Doc for deferred share/snapshot deletion https://review.opendev.org/c/openstack/manila/+/964161 | 02:42 |
| mohsen_ | https://www.irccloud.com/pastebin/8UVm9IJt/ | 07:03 |
| mohsen_ | Hi friends. | 07:07 |
| mohsen_ | I have an issue when installing manila. | 07:07 |
| mohsen_ | when I try to install manila using kolla-ansible with cephfs native driver and dhss = false, the manila_share container is unhealthy, even though it can connect to the ceph backend successfully as logged in the manila_share container: | 07:07 |
| mohsen_ | INFO manila.share.drivers.cephfs.driver [None req-4a245522-0459-420d-8be8-92f9f19b518d - - - - - -] [CEPHFS1] Ceph client connection complete. | 07:07 |
| mohsen_ | the issue is that once it registers cephfsnative backend as a share service in the manila database, it cannot update its state in the database and it shows: | 07:07 |
| mohsen_ | openstack share service list | 07:07 |
| mohsen_ | +----+------------------+----------------------------+------+---------+-------+----------------------------+-----------------+ | 07:07 |
| mohsen_ | | ID | Binary | Host | Zone | Status | State | Updated At | Disabled Reason | | 07:07 |
| mohsen_ | +----+------------------+----------------------------+------+---------+-------+----------------------------+-----------------+ | 07:07 |
| mohsen_ | | 1 | manila-data | controller01 | nova | enabled | up | 2025-10-18T06:59:15.147804 | None | | 07:07 |
| mohsen_ | | 2 | manila-scheduler | controller01 | nova | enabled | up | 2025-10-18T06:59:17.268280 | None | | 07:07 |
| mohsen_ | | 3 | manila-share | controller01@cephfsnative1 | nova | enabled | up | None | None | | 07:07 |
| mohsen_ | +----+------------------+----------------------------+------+---------+-------+----------------------------+-----------------+ | 07:07 |
| mohsen_ | its "Updated At" column shows None, which means it couldn't update its state properly. when creating a share using cephfs type, I get the following error in manila_scheduler: | 07:07 |
| mohsen_ | WARNING manila.scheduler.host_manager [None req-781c0b10-68df-45e1-9da2-88024443fe31 f8e503ad2c134bee9a1ea8b75bdbfbfd d4954b315a50489392398e38372ad06d - - - -] Share service is down. (host: controller01@cephfsnative1). | 07:07 |
| mohsen_ | ERROR manila.scheduler.manager [None req-781c0b10-68df-45e1-9da2-88024443fe31 f8e503ad2c134bee9a1ea8b75bdbfbfd d4954b315a50489392398e38372ad06d - - - -] Failed to schedule create_share: There are no hosts to fulfill this provisioning request. Are share backend services down?: manila.exception.WillNotSchedule: There are no hosts to fulfill this provisioning request. Are share backend services down? | 07:07 |
| mohsen_ | I appreciate your help in advance. | 07:07 |
| gouthamr | mohsen_: few things to try: are there any more logs in the manila-share service - perhaps enable debug logging. have you tried re-starting the manila-share container? Try "openstack share pool list --detail" | 07:11 |
| mohsen_ | gouthamr: yes. this is the error log in manila_share service: | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 CRITICAL manila [None req-e790be77-d3be-40d7-9f26-f47d8b53e821 - - - - - -] Unhandled error: manila.exception.ServiceNotFound: Service None could not be found. | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila Traceback (most recent call last): | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila File "/var/lib/kolla/venv/bin/manila-share", line 7, in <module> | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila sys.exit(main()) | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila File "/var/lib/kolla/venv/lib/python3.10/site-packages/manila/cmd/share.py", line 64, in main | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila launcher.wait() | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila File "/var/lib/kolla/venv/lib/python3.10/site-packages/oslo_service/service.py", line 693, in wait | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila self.stop() | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila File "/var/lib/kolla/venv/lib/python3.10/site-packages/oslo_service/service.py", line 702, in stop | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila service.stop() | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila File "/var/lib/kolla/venv/lib/python3.10/site-packages/manila/service.py", line 257, in stop | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila db.service_update(context.get_admin_context(), | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila File "/var/lib/kolla/venv/lib/python3.10/site-packages/manila/db/api.py", line 136, in service_update | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila return IMPL.service_update(context, service_id, values) | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila File "/var/lib/kolla/venv/lib/python3.10/site-packages/manila/db/sqlalchemy/api.py", line 148, in wrapper | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila return f(*args, **kwargs) | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila File "/var/lib/kolla/venv/lib/python3.10/site-packages/manila/db/sqlalchemy/api.py", line 247, in wrapper | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila return f(context, *args, **kwargs) | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila File "/var/lib/kolla/venv/lib/python3.10/site-packages/oslo_db/api.py", line 144, in wrapper | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila with excutils.save_and_reraise_exception() as ectxt: | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila File "/var/lib/kolla/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__ | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila self.force_reraise() | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila File "/var/lib/kolla/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila raise self.value | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila File "/var/lib/kolla/venv/lib/python3.10/site-packages/oslo_db/api.py", line 142, in wrapper | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila return f(*args, **kwargs) | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila File "/var/lib/kolla/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 998, in wrapper | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila return fn(*args, **kwargs) | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila File "/var/lib/kolla/venv/lib/python3.10/site-packages/manila/db/sqlalchemy/api.py", line 686, in service_update | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila service_ref = _service_get(context, service_id) | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila File "/var/lib/kolla/venv/lib/python3.10/site-packages/manila/db/sqlalchemy/api.py", line 148, in wrapper | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila return f(*args, **kwargs) | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila File "/var/lib/kolla/venv/lib/python3.10/site-packages/manila/db/sqlalchemy/api.py", line 562, in _service_get | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila raise exception.ServiceNotFound(service_id=service_id) | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila manila.exception.ServiceNotFound: Service None could not be found. | 07:21 |
| mohsen_ | 2025-10-18 05:11:02.028 7 ERROR manila | 07:21 |
| mohsen_ | 2025-10-18 05:11:04.242 8 INFO oslo_service.periodic_task [-] Skipping periodic task update_share_usage_size because it is disabled | 07:21 |
| mohsen_ | 2025-10-18 05:11:04.304 8 INFO oslo_service.service [None req-c88253c4-fb55-41c4-b990-327389bcc9f1 - - - - - -] Starting 1 workers | 07:21 |
| mohsen_ | 2025-10-18 05:11:04.317 17 INFO manila.service [-] Starting manila-share node (version 18.3.1) | 07:21 |
| mohsen_ | 2025-10-18 05:11:04.843 17 INFO manila.share.drivers.cephfs.driver [None req-de3fd87e-1c1c-4998-a3e0-23d43702ca5b - - - - - -] [CEPHFS1] Ceph client found, connecting... | 07:21 |
| mohsen_ | 2025-10-18 05:11:04.872 17 INFO manila.share.drivers.cephfs.driver [None req-de3fd87e-1c1c-4998-a3e0-23d43702ca5b - - - - - -] [CEPHFS1] Ceph client connection complete. | 07:21 |
| mohsen_ | I restarted manila_share container a couple of times but nothing happend. | 07:21 |
| mohsen_ | The output of "openstack share pool list --detail" was empty. | 07:21 |
| opendevreview | Denver Baraka proposed openstack/python-manilaclient master: Fix neutron validation in share network creation https://review.opendev.org/c/openstack/python-manilaclient/+/964350 | 15:15 |
| gouthamr | mohsen_: hmm, strange. think we see this occur in the CI.. could you file a bug? https://bugs.launchpad.net/manila | 16:17 |
| gouthamr | mohsen_: to work around this, try changing something about the backend - perhaps the backend configuration section name, and restart the manila-share container again. This should cause the process to register as a new service | 16:21 |
| opendevreview | Warren Jeffs proposed openstack/manila master: update to use openstack cli, not legacy manila cli https://review.opendev.org/c/openstack/manila/+/964352 | 19:43 |
| opendevreview | Warren Jeffs proposed openstack/manila master: update to use openstack cli, not legacy manila cli https://review.opendev.org/c/openstack/manila/+/964352 | 19:51 |
| opendevreview | Marco Wehrhahn proposed openstack/manila master: WIP added list share snapshots schema and validation https://review.opendev.org/c/openstack/manila/+/964355 | 22:00 |
| opendevreview | Merged openstack/manila master: update to use openstack cli, not legacy manila cli https://review.opendev.org/c/openstack/manila/+/964352 | 23:37 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!