opendevreview | Neil Hanlon proposed openstack/openstack-ansible-rabbitmq_server master: bump rabbitmq and erlang to latest available https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/884782 | 00:57 |
---|---|---|
opendevreview | Neil Hanlon proposed openstack/openstack-ansible-rabbitmq_server master: Use el/9 repo urls instead of el/8 since a repo is available for it https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/884719 | 00:58 |
admin1 | \o | 10:12 |
jrosser | noonedeadpunk: looks like those glance/uwsgi queue full thing I asked about yesterday might be related to uploading large (for us) images, about 20G in this case | 11:47 |
noonedeadpunk | chunking fills in queues? | 11:48 |
noonedeadpunk | and you ceph as a backend with uwsgi? | 11:48 |
jrosser | yes | 11:49 |
jrosser | not exactly sure what is happening as the root cause but it does match up pretty exactly with some large image uploads | 11:49 |
jrosser | and the worst bit is is leaves the glance service broken but the LB thinks it’s fine | 11:50 |
* noonedeadpunk disabled uwsgi for glance long-long ago | 11:56 | |
noonedeadpunk | Probably worth investing time and fixing glance... But don't have time/prio for that :( | 11:57 |
jrosser | kind of related, it was a giant image because someone was trying to do a windows vm - do you have any experience with this? | 11:59 |
jrosser | like not sure if virtio-scsi will ever work for windows, for example | 12:00 |
noonedeadpunk | Well, we do have cephfs mounted in couple of places to handle Windows images | 12:18 |
noonedeadpunk | As 20gb is quite small one... We have 200+ from time to time | 12:18 |
noonedeadpunk | (Ie with MSSQL) | 12:18 |
noonedeadpunk | right now we don't use virtio-scsi to be frank. I wanted to enable once, but then was stopped by stor folks who said that there could be some issues related to performance on some scale. Wasn't verifying that - it could be irrelevant, but had not time to argue... | 12:20 |
noonedeadpunk | but iirc, virtio-iscsi should work.. As windows still need virtio drivers to be installed in the image explicitly | 12:21 |
noonedeadpunk | as well as Cloudbase-Init | 12:21 |
noonedeadpunk | Not sure though if cloudbase is going to continue it's support, as they've quit from penstack projects lately | 12:22 |
damiandabrowski | I successfully used windows with virtio-scsi some time ago but noonedeadpunk was right, i had to install virtio drivers | 12:40 |
noonedeadpunk | you have to install them regardless of scsi, kinda. or well. You can ofc workaround by providing net card and not using virtio for FS either, so I managed to launch windows without virtio drivers, but performance was .... sad | 13:06 |
*** dviroel_ is now known as dviroel | 20:49 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!