*** brinzhang has joined #openstack-kolla | 00:35 | |
*** williampiv has quit IRC | 00:56 | |
*** wuchunyang has joined #openstack-kolla | 01:00 | |
r3ap3r | I feel like I'm almost to the finish line with this Openstack setup. I can create everything except storage related items. When I try to upload an image from Horizon or by using `openstack image create` it sits there for about 20 mins or so and then times out? I've looked at both Ceph and Glance related logs during my upload attempts and I don't really see anything that points to a particular issue? If I look in | 01:20 |
---|---|---|
r3ap3r | Ceph, a new image gets created in the `images` pool with the appropriate size of what I'm uploading to Openstack. I see HAproxy querying `glance_api` and Glance doing its thing. I get a timeout error `Failed to store image ea72c38a-485c-4cb7-a42d-67f6299a5f89 Store Exception timed out: socket.timeout: timed out`. Then it just repeats three errors over and over again. I'm not sure where to go at this point. It | 01:20 |
r3ap3r | just seems like it is timing out and not really giving me anything to go on. Maybe I'm missing a log somewhere in the process? Has anyone experienced this and wouldn't mind giving me a nudge? Thanks in advance. | 01:20 |
*** wuchunyang has quit IRC | 01:30 | |
*** wuchunyang has joined #openstack-kolla | 01:55 | |
*** wuchunyang has quit IRC | 02:25 | |
*** zzzeek has quit IRC | 02:40 | |
*** zzzeek has joined #openstack-kolla | 02:41 | |
*** zzzeek has quit IRC | 02:50 | |
*** zzzeek has joined #openstack-kolla | 02:52 | |
*** williampiv has joined #openstack-kolla | 02:56 | |
*** dave-mccowan has quit IRC | 03:47 | |
*** skramaja has joined #openstack-kolla | 04:11 | |
mnasiadka | r3ap3r: how big is the image? | 04:16 |
*** evrardjp has quit IRC | 04:33 | |
*** evrardjp has joined #openstack-kolla | 04:33 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Add healthchecks option to kolla_docker https://review.opendev.org/743958 | 04:35 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services https://review.opendev.org/676389 | 04:37 |
*** brinzhang_ has joined #openstack-kolla | 04:37 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services https://review.opendev.org/676389 | 04:40 |
*** brinzhang has quit IRC | 04:41 | |
*** williampiv has quit IRC | 05:21 | |
*** skramaja has quit IRC | 05:29 | |
*** skramaja has joined #openstack-kolla | 05:29 | |
*** abdysn has joined #openstack-kolla | 05:30 | |
*** recyclehero has quit IRC | 05:35 | |
*** recyclehero has joined #openstack-kolla | 05:35 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Add missing heat deps for deb-binary https://review.opendev.org/753944 | 05:38 |
*** shyamb has joined #openstack-kolla | 05:40 | |
*** cah_link has joined #openstack-kolla | 06:02 | |
openstackgerrit | Merged openstack/kayobe master: CI: Fix kayobe-tox-molecule job https://review.opendev.org/753791 | 06:19 |
yoctozepto | r3ap3r: it sounds like glance could not reach osds? | 06:27 |
*** vishalmanchanda has joined #openstack-kolla | 06:30 | |
*** shyamb has quit IRC | 06:51 | |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/ussuri: Fix default mode in haproxy_single_service_split https://review.opendev.org/753954 | 06:55 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/train: Fix default mode in haproxy_single_service_split https://review.opendev.org/753955 | 06:55 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/stein: Fix default mode in haproxy_single_service_split https://review.opendev.org/753956 | 06:55 |
*** shyamb has joined #openstack-kolla | 07:11 | |
*** also_stingrayza has joined #openstack-kolla | 07:18 | |
*** stingrayza has quit IRC | 07:19 | |
mnasiadka | yoctozepto: that was my second question :) | 07:26 |
*** shyam89 has joined #openstack-kolla | 07:27 | |
*** shyamb has quit IRC | 07:30 | |
yoctozepto | seems bifrost is failing us again | 07:32 |
*** zzzeek has quit IRC | 07:33 | |
yoctozepto | testing that in https://review.opendev.org/753962 | 07:34 |
patchbot | patch 753962 - bifrost - [DNM] Run jobs in CI - 1 patch set | 07:34 |
yoctozepto | (either it fails too or it is not well tested) | 07:34 |
*** born2bake has joined #openstack-kolla | 07:34 | |
*** zzzeek has joined #openstack-kolla | 07:36 | |
yoctozepto | 5 possible suspects https://review.opendev.org/#/q/project:openstack/bifrost+status:merged+branch:master+after:2020-09-23 | 07:37 |
yoctozepto | down to 2 suspects | 07:38 |
yoctozepto | https://review.opendev.org/#/c/752473/ | 07:38 |
patchbot | patch 752473 - bifrost - Ensure that repositories are owned by the running ... (MERGED) - 2 patch sets | 07:38 |
yoctozepto | https://review.opendev.org/#/c/752466/ | 07:38 |
patchbot | patch 752466 - bifrost - Move CLI validation to bifrost-keystone-client-config (MERGED) - 3 patch sets | 07:38 |
yoctozepto | (as these 2 missed the kolla in testing) | 07:38 |
yoctozepto | boils down to https://review.opendev.org/752466 | 07:39 |
patchbot | patch 752466 - bifrost - Move CLI validation to bifrost-keystone-client-config (MERGED) - 3 patch sets | 07:39 |
*** dougsz has joined #openstack-kolla | 07:40 | |
mgoddard | morning | 07:41 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Add healthchecks option to kolla_docker https://review.opendev.org/743958 | 07:45 |
*** bengates has joined #openstack-kolla | 07:56 | |
*** shyam89 has quit IRC | 07:57 | |
openstackgerrit | Merged openstack/kayobe master: Docker registry basic auth https://review.opendev.org/738856 | 08:00 |
openstackgerrit | Merged openstack/kayobe master: docs: Move development section under contributor guide https://review.opendev.org/752513 | 08:00 |
*** zzzeek has quit IRC | 08:01 | |
*** zzzeek has joined #openstack-kolla | 08:01 | |
*** jbadiapa has joined #openstack-kolla | 08:02 | |
*** k_mouza has joined #openstack-kolla | 08:09 | |
*** shyamb has joined #openstack-kolla | 08:17 | |
*** e0ne has joined #openstack-kolla | 08:17 | |
recyclehero | hi kolla | 08:41 |
recyclehero | I promise I will ask this 1 Q and be off to real deployment | 08:41 |
recyclehero | lets assume I have deployed the AIO inventory. after lunching 10 instances I will change the inventory to multinode and cinder machanism to NFS. how does the mariadb and instances volumes get transferred? | 08:43 |
*** jovial[m] has quit IRC | 08:46 | |
recyclehero | is it done with "kolla-ansible -i INVENTORY" | 08:46 |
recyclehero | ? | 08:46 |
*** k_mouza has quit IRC | 08:49 | |
recyclehero | *"kolla-ansible -i INVENTORY reconfigure" | 08:50 |
*** k_mouza has joined #openstack-kolla | 08:50 | |
* recyclehero scared | 08:51 | |
*** jovial[m] has joined #openstack-kolla | 08:53 | |
yoctozepto | recyclehero: they don't get "transferred"; they will stay where they are | 09:02 |
*** Abdallahyas has joined #openstack-kolla | 09:13 | |
*** abdysn has quit IRC | 09:14 | |
recyclehero | so for volumes they stay where they are and for mariadb they get synced with the one that stay in the same place with glera, right? | 09:14 |
recyclehero | but the new volumes get created in the nfs space | 09:14 |
*** kevko has joined #openstack-kolla | 09:17 | |
*** also_stingrayza is now known as stingrayza | 09:20 | |
*** shyam89 has joined #openstack-kolla | 09:25 | |
*** LinPeiWen has quit IRC | 09:26 | |
*** LinPeiWen has joined #openstack-kolla | 09:26 | |
*** shyamb has quit IRC | 09:26 | |
*** jaicaa has quit IRC | 09:27 | |
openstackgerrit | Merged openstack/kayobe master: Performance: Parallelise Kolla Ansible host vars generation https://review.opendev.org/745354 | 09:27 |
*** abdysn has joined #openstack-kolla | 09:32 | |
*** Abdallahyas has quit IRC | 09:35 | |
*** jovial[m] has quit IRC | 09:38 | |
openstackgerrit | Merged openstack/kolla-ansible master: Bump minimum Ansible version to 2.9 https://review.opendev.org/753776 | 09:40 |
*** jovial[m] has joined #openstack-kolla | 09:51 | |
openstackgerrit | Mark Goddard proposed openstack/kayobe stable/ussuri: Performance: Parallelise Kolla Ansible host vars generation https://review.opendev.org/754053 | 09:54 |
openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Bump Ansible version range to 2.9 - 2.9 https://review.opendev.org/754054 | 09:55 |
*** zzzeek has quit IRC | 09:57 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Add healthchecks option to kolla_docker https://review.opendev.org/743958 | 09:59 |
*** zzzeek has joined #openstack-kolla | 10:00 | |
*** jaicaa has joined #openstack-kolla | 10:02 | |
openstackgerrit | Merged openstack/kolla-ansible master: Allow setting container_proxy per service https://review.opendev.org/753246 | 10:05 |
openstackgerrit | Merged openstack/kolla stable/ussuri: Release note for using stable sources https://review.opendev.org/752682 | 10:05 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Add healthchecks option to kolla_docker https://review.opendev.org/743958 | 10:09 |
openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Remove unneeded doc requirements in molecule tox env https://review.opendev.org/754060 | 10:13 |
*** shyam89 has quit IRC | 10:16 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Add healthchecks option to kolla_docker https://review.opendev.org/743958 | 10:16 |
*** gfidente has joined #openstack-kolla | 10:22 | |
*** kevko has quit IRC | 10:23 | |
*** dougsz has quit IRC | 10:26 | |
openstackgerrit | Merged openstack/kayobe master: Add missing barbican.conf support https://review.opendev.org/752900 | 10:28 |
openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: Performance: Parallelise Kolla Ansible host vars generation https://review.opendev.org/754064 | 10:40 |
*** JamesBenson has joined #openstack-kolla | 11:06 | |
*** JamesBenson has quit IRC | 11:06 | |
*** JamesBenson has joined #openstack-kolla | 11:06 | |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: Introduce 'kolla_infra_install_type' variable https://review.opendev.org/706982 | 11:11 |
openstackgerrit | Merged openstack/kayobe master: Remove unneeded doc requirements in molecule tox env https://review.opendev.org/754060 | 11:23 |
mgoddard | are we aware of this issue in Debian CI: Nova requires QEMU version 4.0.0 or greater. | 11:26 |
hrw | shit | 11:30 |
mnasiadka | mgoddard, yoctozepto: Can we merge this? https://review.opendev.org/#/c/749632/3 - I'm fed up with waiting for pool drain after keepalived VIP moves somewhere else :) | 11:31 |
patchbot | patch 749632 - kolla-ansible - Reduce the use of SQLAlchemy connection pooling - 3 patch sets | 11:31 |
yoctozepto | mgoddard: not seen it yet | 11:31 |
r3ap3r | mnasiadka: I'm testing with Cirros so ~16MBs. Starting small before going any larger. | 11:32 |
mnasiadka | r3ap3r: so it really seems like glance can't connect to your OSDs | 11:32 |
r3ap3r | yoctozepto: ok, I will look into that. I do have Proxmox successfully using Ceph although the setup is completely different for that. | 11:33 |
r3ap3r | Thanks guys for the nudge, I'll let you know if I find anything. :) | 11:34 |
*** kevko has joined #openstack-kolla | 11:42 | |
*** shyamb has joined #openstack-kolla | 11:47 | |
*** priteau has joined #openstack-kolla | 12:00 | |
*** zzzeek has quit IRC | 12:09 | |
openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/ussuri: CI: Fix kayobe-tox-molecule job https://review.opendev.org/754075 | 12:11 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services https://review.opendev.org/676389 | 12:11 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services https://review.opendev.org/676389 | 12:11 |
*** zzzeek has joined #openstack-kolla | 12:12 | |
openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Performance: avoid set_fact in Kolla Ansible host vars https://review.opendev.org/745569 | 12:16 |
openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Performance: avoid set_fact in Kolla Ansible host vars https://review.opendev.org/745569 | 12:17 |
*** shyamb has quit IRC | 12:21 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services https://review.opendev.org/676389 | 12:28 |
*** zzzeek has quit IRC | 12:40 | |
*** zzzeek has joined #openstack-kolla | 12:42 | |
*** Abdallahyas has joined #openstack-kolla | 12:47 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Add healthchecks option to kolla_docker https://review.opendev.org/743958 | 12:48 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services https://review.opendev.org/676389 | 12:48 |
openstackgerrit | Mark Goddard proposed openstack/kayobe stable/train: CI: Fix kayobe-tox-molecule job https://review.opendev.org/754082 | 12:50 |
*** abdysn has quit IRC | 12:50 | |
openstackgerrit | Pierre Riteau proposed openstack/kayobe stable/train: CI: Fix kayobe-tox-molecule job https://review.opendev.org/754082 | 12:52 |
*** recyclehero has quit IRC | 12:56 | |
*** recyclehero has joined #openstack-kolla | 12:56 | |
*** skramaja has quit IRC | 12:58 | |
*** skramaja has joined #openstack-kolla | 12:59 | |
*** priteau has quit IRC | 13:02 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: WIP: Fix keystone-startup.sh https://review.opendev.org/754085 | 13:17 |
*** priteau has joined #openstack-kolla | 13:21 | |
*** wuchunyang has joined #openstack-kolla | 13:21 | |
*** also_stingrayza has joined #openstack-kolla | 13:33 | |
*** stingrayza has quit IRC | 13:33 | |
*** priteau has quit IRC | 13:33 | |
openstackgerrit | Merged openstack/kayobe stable/train: CI: Fix kayobe-tox-molecule job https://review.opendev.org/754082 | 13:42 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Fix keystone-startup.sh https://review.opendev.org/754085 | 13:44 |
*** TrevorV has joined #openstack-kolla | 13:46 | |
openstackgerrit | Merged openstack/kayobe stable/ussuri: CI: Fix kayobe-tox-molecule job https://review.opendev.org/754075 | 13:49 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla master: Add missing heat deps for deb-binary https://review.opendev.org/753944 | 13:52 |
*** cah_link has quit IRC | 13:52 | |
*** recyclehero has quit IRC | 13:57 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Add healthchecks option to kolla_docker https://review.opendev.org/743958 | 13:58 |
*** recyclehero has joined #openstack-kolla | 14:04 | |
*** dave-mccowan has joined #openstack-kolla | 14:30 | |
*** shyamb has joined #openstack-kolla | 14:31 | |
*** dave-mccowan has quit IRC | 14:34 | |
*** shyam89 has joined #openstack-kolla | 14:39 | |
*** shyamb has quit IRC | 14:42 | |
*** shyam89 has quit IRC | 14:45 | |
*** k_mouza has quit IRC | 14:59 | |
openstackgerrit | Merged openstack/kolla-ansible master: CI: add magnum scenario, also covering octavia https://review.opendev.org/652030 | 15:01 |
*** k_mouza has joined #openstack-kolla | 15:06 | |
*** dciabrin has quit IRC | 15:11 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services https://review.opendev.org/676389 | 15:19 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services https://review.opendev.org/676389 | 15:22 |
*** k_mouza has quit IRC | 15:27 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Use Docker healthchecks for core services https://review.opendev.org/676389 | 15:29 |
*** k_mouza has joined #openstack-kolla | 15:37 | |
*** k_mouza has quit IRC | 15:37 | |
*** k_mouza has joined #openstack-kolla | 15:37 | |
*** wuchunyang has quit IRC | 15:44 | |
*** e0ne has quit IRC | 15:50 | |
*** ozzzo has quit IRC | 15:50 | |
*** Abdallahyas has quit IRC | 15:56 | |
*** bengates has quit IRC | 15:56 | |
*** priteau has joined #openstack-kolla | 15:59 | |
*** kevko has quit IRC | 16:05 | |
*** shyamb has joined #openstack-kolla | 16:05 | |
mloza | hello, I'm hitting the following bug https://bugs.launchpad.net/keystone/+bug/1895723. I have 3x control nodes, if that matters. Is there a workaround? | 16:06 |
openstack | Launchpad bug 1895723 in kolla-ansible "Keystone is restarting due to stale primary key" [High,In progress] - Assigned to Michal Nasiadka (mnasiadka) | 16:06 |
*** shyamb has quit IRC | 16:06 | |
mnasiadka | mloza: patch is underway, check the bottom of bug report | 16:07 |
mnasiadka | Just apply it locally | 16:07 |
mloza | mnasiadka: sounds good | 16:13 |
*** ozzzo has joined #openstack-kolla | 16:14 | |
*** k_mouza has quit IRC | 16:15 | |
*** k_mouza has joined #openstack-kolla | 16:22 | |
*** k_mouza has quit IRC | 16:46 | |
*** gfidente has quit IRC | 17:07 | |
openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Add support for encrypting Ironic API https://review.opendev.org/751543 | 17:09 |
*** skramaja has quit IRC | 17:33 | |
openstackgerrit | Ning Yao proposed openstack/kolla-ansible master: unify the wsgi logfile name https://review.opendev.org/730191 | 17:56 |
*** recyclehero has quit IRC | 18:36 | |
*** hamzaachi has joined #openstack-kolla | 18:40 | |
*** hamzaachi has quit IRC | 18:40 | |
*** recyclehero has joined #openstack-kolla | 18:43 | |
*** priteau has quit IRC | 18:58 | |
*** openstackgerrit has quit IRC | 19:14 | |
*** recyclehero has quit IRC | 19:30 | |
*** TrevorV has quit IRC | 19:35 | |
*** zzzeek has quit IRC | 20:12 | |
*** zzzeek has joined #openstack-kolla | 20:14 | |
*** JamesBenson has quit IRC | 20:14 | |
*** zzzeek has quit IRC | 20:18 | |
*** zzzeek has joined #openstack-kolla | 20:20 | |
*** born2bake has quit IRC | 20:22 | |
*** zzzeek has quit IRC | 20:25 | |
*** zzzeek has joined #openstack-kolla | 20:26 | |
*** zzzeek has quit IRC | 20:30 | |
*** zzzeek has joined #openstack-kolla | 20:33 | |
*** zzzeek has quit IRC | 20:43 | |
*** zzzeek has joined #openstack-kolla | 20:46 | |
*** zzzeek has quit IRC | 20:51 | |
*** zzzeek has joined #openstack-kolla | 20:53 | |
*** recyclehero has joined #openstack-kolla | 22:17 | |
*** zzzeek has quit IRC | 22:24 | |
*** zzzeek has joined #openstack-kolla | 22:25 | |
*** vishalmanchanda has quit IRC | 22:39 | |
*** zzzeek has quit IRC | 22:44 | |
*** zzzeek has joined #openstack-kolla | 22:46 | |
*** zzzeek has quit IRC | 23:43 | |
*** zzzeek has joined #openstack-kolla | 23:45 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!