Monday, 2020-06-01

« Sunday, 2020-05-31 Index Tuesday, 2020-06-02 »
*** cshen has joined #openstack-ansible00:16
*** tosky has quit IRC00:20
*** cshen has quit IRC00:52
*** cshen has joined #openstack-ansible01:19
*** cshen has quit IRC01:23
dmsimardrandom insight into the top 50 longest playbooks and tasks: http://paste.openstack.org/show/794186/01:58
*** alanmeadows_ has joined #openstack-ansible02:20
*** Adri2000 has quit IRC02:28
*** alanmeadows has quit IRC02:28
*** brad[] has quit IRC02:28
*** alanmeadows_ is now known as alanmeadows02:28
*** fridtjof[m] has quit IRC02:33
*** masterpe has quit IRC02:33
*** cshen has joined #openstack-ansible03:20
*** fridtjof[m] has joined #openstack-ansible03:21
*** masterpe has joined #openstack-ansible03:21
*** cshen has quit IRC03:24
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-ansible04:33
*** cshen has joined #openstack-ansible04:45
*** cshen has quit IRC05:48
*** pcaruana has joined #openstack-ansible07:14
*** yolanda has joined #openstack-ansible07:19
*** tosky has joined #openstack-ansible07:28
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: WIP - Add Ubuntu Focal support  https://review.opendev.org/72359707:29
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: WIP - Add Ubuntu Focal support  https://review.opendev.org/72359708:00
*** ansmith has quit IRC08:02
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: WIP - Add Ubuntu Focal support  https://review.opendev.org/72359708:06
*** cshen has joined #openstack-ansible08:17
*** cshen has quit IRC08:21
jrossernoonedeadpunk: i have a held node on the focal lxc job if you're interested in taking a look as well09:02
jrosserannoyingly container3 seems to be working http://paste.openstack.org/show/794196/09:10
*** jbadiapa has joined #openstack-ansible09:23
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Rewrite CI provided apt sources to be http instead of https on focal  https://review.opendev.org/73212309:30
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: WIP - Add Ubuntu Focal support  https://review.opendev.org/72359709:32
*** gshippey has joined #openstack-ansible10:22
noonedeadpunkjrosser: if you still didn't handle that I'm pretty interested too:)10:45
jrossernoonedeadpunk: also no focal packages for galera 10.4.12 :(10:46
jrosserlets hope they make 10.4.14 soon10:47
noonedeadpunkyeah, they have focal for 10.4.14....10:48
noonedeadpunknot sure if it works though http://hasky.askmonty.org/archive/10.4/build-33006/kvm-deb-focal-amd64/10:49
jrosseroh whats that?10:49
noonedeadpunkit's their daily builds10:49
jrosseroh ok10:50
jrosseri got a focal metal CI job pass earlier10:50
noonedeadpunkactually there's already focal for 10.4.13 but it;s buggy10:50
jrosseri'm just rerunning the lxc_container_create job in this held node with -vvvv on ansible cli10:51
noonedeadpunkbtw, patch for branching https://review.opendev.org/#/c/729295/10:52
noonedeadpunkwould be great to set some + on it I think:)10:52
noonedeadpunkmnaser: I guess your vote is even expected there10:53
*** rgogunskiy has joined #openstack-ansible10:57
jrossernoonedeadpunk: so i added this patch to ensure that the containers are contactable before anything else happens after they restart https://review.opendev.org/#/c/732013/4/handlers/main.yml10:59
jrosserand for the one(s) that fail it does this over and over again until the timeout is reached http://paste.openstack.org/show/794201/11:00
*** faizy98 has joined #openstack-ansible11:01
noonedeadpunkhm... but you say it's reachable?11:08
*** AJaeger has left #openstack-ansible11:10
*** also_stingrayza is now known as stingrayza11:11
jrosseri'm not getting very far with this - lets put your key on too11:14
* jrosser forgets link to that11:14
noonedeadpunkah, https://launchpad.net/~noonedeadpunk/+sshkeys11:23
*** rh-jelabarre has joined #openstack-ansible12:02
jrossernoonedeadpunk: looking at the debug for the focal stuff, i was a bit surprised to see to sftp/scp the file into the container12:11
jrosseri was wondering here https://github.com/openstack/openstack-ansible-plugins/blob/master/connection/ssh.py#L53012:11
noonedeadpunkyeah12:11
jrosserwhy it doesnt just 'cp' the file if the target is localhost12:11
noonedeadpunkI also started looking into connection thing12:12
jrosserbecasue there is like giant overhead there12:12
noonedeadpunkas it tries to ssh on container and fails12:12
*** cshen has joined #openstack-ansible12:12
jrosseri checked the [localhost] thing, too, and thats OK12:12
jrosseri copied the scp line from the log and tried something similar and that was OK12:13
jrosserbut one thing i didnt check is if the controlpersist socket was working12:13
*** cshen has quit IRC12:17
*** mgariepy has joined #openstack-ansible12:28
mgariepygood morning everyone12:31
*** arkan has joined #openstack-ansible12:31
arkanHi guys, I'm running "openstack-ansible setup-openstack.yml" and on task TASK [os_nova : Preserve original configuration file(s)] I received this error https://pastebin.com/ZWzZbv0a12:34
*** arkan has quit IRC12:35
*** arkan has joined #openstack-ansible12:35
arkanI was disconnected, I will re-paste12:35
arkanHi guys, I'm running "openstack-ansible setup-openstack.yml" and on task TASK [os_nova : Preserve original configuration file(s)] I received this error https://pastebin.com/ZWzZbv0a12:35
jrossernoonedeadpunk: so the error on focal happens right after this https://github.com/openstack/openstack-ansible-lxc_container_create/blob/master/handlers/main.yml#L19-L4912:40
*** rh-jlabarre has joined #openstack-ansible12:40
jrosserlxc-stop followed by lxc-start of the same container12:40
*** rh-jlabarre has quit IRC12:41
jrosserand then from http://paste.openstack.org/show/794201/ we have "dd: failed to open '/proc/120203/root/tmp/ansible-tmp-1591008657.2951758-120317-178325462922841/AnsiballZ_ping.py': No such file or directory"12:41
*** rh-jlabarre has joined #openstack-ansible12:41
noonedeadpunkbtw, I've found one issue with libvirt, like having 500k of log files in /var/log/libvirt/qemu/ despite having logrotate...12:41
jrosseri am wondering if the directory /tmp/ansible-tmp-1591008657.2951758-120317-178325462922841 is lost during the restart12:42
noonedeadpunk(it's totall offtop from focal)12:42
jrosserif i create /tmp/foo then stop/start a container then we lose /tmp/foo12:43
*** mgariepy has quit IRC12:43
jrosseri wonder if changing remote_tmp to somewhere persistent would make any difference12:46
*** mgariepy has joined #openstack-ansible12:47
jrossernoonedeadpunk: i'm going to re-run tests in the held focal vm if thats ok?12:56
noonedeadpunkyep, sure12:57
noonedeadpunkIm looking through stdout in less at the moment12:57
noonedeadpunkthe thing about setting remote_tmp is that always only one container fails13:02
openstackgerritOpenStack Release Bot proposed openstack/ansible-hardening stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73217613:06
openstackgerritOpenStack Release Bot proposed openstack/ansible-hardening stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73217713:06
openstackgerritOpenStack Release Bot proposed openstack/ansible-hardening master: Update master for stable/ussuri  https://review.opendev.org/73217813:06
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-atos-hsm stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73217913:06
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-python_venv_build stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73218013:06
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-python_venv_build stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73218113:06
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-python_venv_build master: Update master for stable/ussuri  https://review.opendev.org/73218213:07
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-systemd_mount stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73218613:07
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-systemd_mount stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73218713:07
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-systemd_mount master: Update master for stable/ussuri  https://review.opendev.org/73218813:07
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-systemd_networkd stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73218913:07
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-systemd_networkd stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73219013:07
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-systemd_networkd master: Update master for stable/ussuri  https://review.opendev.org/73219113:07
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-systemd_service stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73219213:07
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-systemd_service stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73219313:07
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-systemd_service master: Update master for stable/ussuri  https://review.opendev.org/73219413:07
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-thales-hsm stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73219513:08
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-uwsgi stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73219613:08
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-uwsgi stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73219713:08
openstackgerritOpenStack Release Bot proposed openstack/ansible-role-uwsgi master: Update master for stable/ussuri  https://review.opendev.org/73219813:08
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-apt_package_pinning stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73219913:08
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-apt_package_pinning stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73220013:08
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-apt_package_pinning master: Update master for stable/ussuri  https://review.opendev.org/73220113:08
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-ceph_client stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73220213:08
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-ceph_client stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73220313:08
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-ceph_client master: Update master for stable/ussuri  https://review.opendev.org/73220413:08
jamesdentongood morning13:08
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-galera_client stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73220513:09
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-galera_client stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73220613:09
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-galera_client master: Update master for stable/ussuri  https://review.opendev.org/73220713:09
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-galera_server stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73220813:09
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-galera_server stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73220913:09
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-galera_server master: Update master for stable/ussuri  https://review.opendev.org/73221013:09
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-haproxy_server stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73221113:09
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-haproxy_server stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73221213:09
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-haproxy_server master: Update master for stable/ussuri  https://review.opendev.org/73221313:09
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-lxc_container_create stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73221413:09
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-lxc_container_create stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73221513:09
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-lxc_container_create master: Update master for stable/ussuri  https://review.opendev.org/73221613:09
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-lxc_hosts stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73221713:10
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-lxc_hosts stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73221813:10
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-lxc_hosts master: Update master for stable/ussuri  https://review.opendev.org/73221913:10
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-memcached_server stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73222013:10
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-memcached_server stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73222113:10
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-memcached_server master: Update master for stable/ussuri  https://review.opendev.org/73222213:10
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-nspawn_container_create stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73222313:10
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-nspawn_container_create stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73222413:10
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-nspawn_container_create master: Update master for stable/ussuri  https://review.opendev.org/73222513:10
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-nspawn_hosts stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73222613:10
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-nspawn_hosts stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73222713:10
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-nspawn_hosts master: Update master for stable/ussuri  https://review.opendev.org/73222813:10
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-openstack_hosts stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73222913:11
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-openstack_hosts stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73223013:11
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-openstack_hosts master: Update master for stable/ussuri  https://review.opendev.org/73223113:11
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-openstack_openrc stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73223213:11
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-openstack_openrc stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73223313:11
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-openstack_openrc master: Update master for stable/ussuri  https://review.opendev.org/73223413:11
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-ops stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73223513:11
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-ops stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73223613:11
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_aodh stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73223713:11
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_aodh stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73223813:11
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_aodh master: Update master for stable/ussuri  https://review.opendev.org/73223913:11
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_barbican stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73224013:12
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_barbican stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73224113:12
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_barbican master: Update master for stable/ussuri  https://review.opendev.org/73224213:12
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_blazar stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73224313:12
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_blazar stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73224413:12
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_blazar master: Update master for stable/ussuri  https://review.opendev.org/73224513:12
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_ceilometer stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73224613:12
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_ceilometer stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73224713:12
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_ceilometer master: Update master for stable/ussuri  https://review.opendev.org/73224813:12
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_cinder stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73224913:12
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_cinder stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73225013:12
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_cinder master: Update master for stable/ussuri  https://review.opendev.org/73225113:12
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_cloudkitty stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73225213:13
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_cloudkitty stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73225313:13
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_cloudkitty master: Update master for stable/ussuri  https://review.opendev.org/73225413:13
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_congress stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73225513:13
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_congress stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73225613:13
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_congress master: Update master for stable/ussuri  https://review.opendev.org/73225713:13
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_designate stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73225813:13
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_designate stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73225913:13
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_designate master: Update master for stable/ussuri  https://review.opendev.org/73226013:13
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_glance stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73226113:13
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_glance stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73226213:13
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_glance master: Update master for stable/ussuri  https://review.opendev.org/73226313:13
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_gnocchi stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73226413:14
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_gnocchi stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73226513:14
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_gnocchi master: Update master for stable/ussuri  https://review.opendev.org/73226613:14
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_heat stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73226713:14
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_heat stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73226813:14
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_heat master: Update master for stable/ussuri  https://review.opendev.org/73226913:14
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_horizon stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73227013:14
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_horizon stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73227113:14
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_horizon master: Update master for stable/ussuri  https://review.opendev.org/73227213:14
*** arxcruz is now known as arxcruz|qa_room13:14
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_ironic stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73227313:14
jrossernoonedeadpunk: on a sample of one run setting remote_tmp to /var/tmp worked for all containers, i'm just running it again13:14
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_ironic stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73227413:14
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_ironic master: Update master for stable/ussuri  https://review.opendev.org/73227513:15
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_keystone stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73227613:15
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_keystone stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73227713:15
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_keystone master: Update master for stable/ussuri  https://review.opendev.org/73227813:15
noonedeadpunkthat's interesting13:15
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_magnum stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73227913:15
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_magnum stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73228013:15
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_magnum master: Update master for stable/ussuri  https://review.opendev.org/73228113:15
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_manila stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73228213:15
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_manila stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73228313:15
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_manila master: Update master for stable/ussuri  https://review.opendev.org/73228413:15
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_masakari stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73228513:15
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_masakari stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73228613:16
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_masakari master: Update master for stable/ussuri  https://review.opendev.org/73228713:16
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_mistral stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73228813:16
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_mistral stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73228913:16
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_mistral master: Update master for stable/ussuri  https://review.opendev.org/73229013:16
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_murano stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73229113:16
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_murano stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73229213:16
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_murano master: Update master for stable/ussuri  https://review.opendev.org/73229313:16
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_neutron stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73229413:16
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_neutron stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73229513:16
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_neutron master: Update master for stable/ussuri  https://review.opendev.org/73229613:16
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_nova stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73229713:17
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_nova stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73229813:17
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_nova master: Update master for stable/ussuri  https://review.opendev.org/73229913:17
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_octavia stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73230013:17
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_octavia stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73230113:17
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_octavia master: Update master for stable/ussuri  https://review.opendev.org/73230213:17
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_panko stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73230313:17
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_panko stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73230413:17
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_panko master: Update master for stable/ussuri  https://review.opendev.org/73230513:17
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_placement stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73230613:17
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_placement stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73230713:17
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_placement master: Update master for stable/ussuri  https://review.opendev.org/73230813:17
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_rally stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73230913:17
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_rally stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73231013:18
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_rally master: Update master for stable/ussuri  https://review.opendev.org/73231113:18
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_sahara stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73231213:18
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_sahara stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73231313:18
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_sahara master: Update master for stable/ussuri  https://review.opendev.org/73231413:18
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_swift stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73231513:18
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_swift stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73231613:18
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_swift master: Update master for stable/ussuri  https://review.opendev.org/73231713:18
jrossernoonedeadpunk: and a second time all ok :)13:18
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_tacker stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73231813:18
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_tacker stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73231913:18
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_tacker master: Update master for stable/ussuri  https://review.opendev.org/73232013:18
jrosseri wish i understood what was going on13:18
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_tempest stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73232113:19
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_tempest stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73232213:19
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_tempest master: Update master for stable/ussuri  https://review.opendev.org/73232313:19
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_trove stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73232413:19
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_trove stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73232513:19
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_trove master: Update master for stable/ussuri  https://review.opendev.org/73232613:19
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_zun stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73232713:19
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_zun stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73232813:19
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-os_zun master: Update master for stable/ussuri  https://review.opendev.org/73233013:19
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-plugins stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73233113:19
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-plugins stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73233213:19
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-plugins master: Update master for stable/ussuri  https://review.opendev.org/73233313:19
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-rabbitmq_server stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73233413:20
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-rabbitmq_server stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73233513:20
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-rabbitmq_server master: Update master for stable/ussuri  https://review.opendev.org/73233613:20
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-tests master: DNM - test moving ansible remote_tmp to /var/tmp  https://review.opendev.org/73233713:20
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-repo_server stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73233813:20
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-repo_server stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73233913:20
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-repo_server master: Update master for stable/ussuri  https://review.opendev.org/73234013:20
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-rsyslog_client stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73234113:20
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-rsyslog_client stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73234213:20
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-rsyslog_client master: Update master for stable/ussuri  https://review.opendev.org/73234313:20
noonedeadpunkjrosser: this behaviour is totally strange13:20
noonedeadpunkbut if it works....13:20
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-rsyslog_server stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73234413:20
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-rsyslog_server stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73234513:20
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-rsyslog_server master: Update master for stable/ussuri  https://review.opendev.org/73234613:21
jrosseri've made a test patch, lets see what happens13:21
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-tests stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73234713:21
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-tests stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73234813:21
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: Add functional tests for ubuntu focal  https://review.opendev.org/73125113:21
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible-tests master: Update master for stable/ussuri  https://review.opendev.org/73234913:21
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73235013:21
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73235113:22
openstackgerritOpenStack Release Bot proposed openstack/openstack-ansible master: Update master for stable/ussuri  https://review.opendev.org/73235213:22
mnasernoonedeadpunk: you're release liaison so all yours :)13:22
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-ceph_client stable/ussuri: Updated from OpenStack Ansible Tests  https://review.opendev.org/73235713:30
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-galera_client stable/ussuri: Updated from OpenStack Ansible Tests  https://review.opendev.org/73235813:30
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_magnum stable/ussuri: Updated from OpenStack Ansible Tests  https://review.opendev.org/73235913:32
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_manila stable/ussuri: Updated from OpenStack Ansible Tests  https://review.opendev.org/73236013:32
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-hardening stable/ussuri: Updated from OpenStack Ansible Tests  https://review.opendev.org/73236213:33
*** arkan has quit IRC13:35
*** markvoelker has joined #openstack-ansible13:39
*** pcaruana has quit IRC13:44
*** pcaruana has joined #openstack-ansible13:45
*** pcaruana has quit IRC13:49
*** pcaruana has joined #openstack-ansible13:50
*** d34dh0r53 has joined #openstack-ansible13:57
openstackgerritMerged openstack/openstack-ansible-os_manila master: Update master for stable/ussuri  https://review.opendev.org/73228413:59
*** d34dh0r53 has quit IRC13:59
*** d34dh0r53 has joined #openstack-ansible14:00
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Update master for stable/ussuri  https://review.opendev.org/73227214:01
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Update master for stable/ussuri  https://review.opendev.org/73221614:01
openstackgerritMerged openstack/openstack-ansible-os_gnocchi master: Update master for stable/ussuri  https://review.opendev.org/73226614:01
openstackgerritMerged openstack/openstack-ansible-os_congress master: Update master for stable/ussuri  https://review.opendev.org/73225714:01
openstackgerritMerged openstack/openstack-ansible-os_ironic master: Update master for stable/ussuri  https://review.opendev.org/73227514:01
openstackgerritMerged openstack/openstack-ansible-os_murano master: Update master for stable/ussuri  https://review.opendev.org/73229314:02
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Update master for stable/ussuri  https://review.opendev.org/73227814:03
openstackgerritMerged openstack/openstack-ansible-os_heat master: Update master for stable/ussuri  https://review.opendev.org/73226914:04
openstackgerritMerged openstack/openstack-ansible-os_cloudkitty master: Update master for stable/ussuri  https://review.opendev.org/73225414:04
openstackgerritMerged openstack/openstack-ansible-os_designate master: Update master for stable/ussuri  https://review.opendev.org/73226014:05
openstackgerritMerged openstack/openstack-ansible-os_barbican master: Update master for stable/ussuri  https://review.opendev.org/73224214:05
openstackgerritMerged openstack/openstack-ansible-os_aodh master: Update master for stable/ussuri  https://review.opendev.org/73223914:06
openstackgerritMerged openstack/openstack-ansible-galera_server master: Update master for stable/ussuri  https://review.opendev.org/73221014:07
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-galera_server master: WIP Centos-8 support  https://review.opendev.org/72472114:08
openstackgerritMerged openstack/openstack-ansible-os_glance master: Update master for stable/ussuri  https://review.opendev.org/73226314:09
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_masakari master: Update master for stable/ussuri  https://review.opendev.org/73228714:09
openstackgerritMerged openstack/ansible-role-uwsgi master: Update master for stable/ussuri  https://review.opendev.org/73219814:12
*** cshen has joined #openstack-ansible14:12
openstackgerritMerged openstack/openstack-ansible-rsyslog_client master: Update master for stable/ussuri  https://review.opendev.org/73234314:14
openstackgerritMerged openstack/openstack-ansible-rsyslog_server master: Update master for stable/ussuri  https://review.opendev.org/73234614:14
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Update master for stable/ussuri  https://review.opendev.org/73232314:15
*** cshen has quit IRC14:17
openstackgerritMerged openstack/openstack-ansible-os_trove master: Update master for stable/ussuri  https://review.opendev.org/73232614:17
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Update master for stable/ussuri  https://review.opendev.org/73222814:17
openstackgerritMerged openstack/openstack-ansible-repo_server master: Update master for stable/ussuri  https://review.opendev.org/73234014:19
openstackgerritMerged openstack/ansible-hardening master: Update master for stable/ussuri  https://review.opendev.org/73217814:19
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Update master for stable/ussuri  https://review.opendev.org/73233614:19
openstackgerritMerged openstack/openstack-ansible-os_zun master: Update master for stable/ussuri  https://review.opendev.org/73233014:19
openstackgerritMerged openstack/openstack-ansible-nspawn_container_create master: Update master for stable/ussuri  https://review.opendev.org/73222514:19
openstackgerritMerged openstack/ansible-role-systemd_mount master: Update master for stable/ussuri  https://review.opendev.org/73218814:19
openstackgerritMerged openstack/openstack-ansible-memcached_server master: Update master for stable/ussuri  https://review.opendev.org/73222214:19
openstackgerritMerged openstack/ansible-role-systemd_networkd master: Update master for stable/ussuri  https://review.opendev.org/73219114:19
openstackgerritMerged openstack/ansible-role-python_venv_build master: Update master for stable/ussuri  https://review.opendev.org/73218214:20
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Update master for stable/ussuri  https://review.opendev.org/73229614:20
openstackgerritMerged openstack/openstack-ansible-galera_client master: Update master for stable/ussuri  https://review.opendev.org/73220714:20
openstackgerritMerged openstack/openstack-ansible-tests master: Update master for stable/ussuri  https://review.opendev.org/73234914:20
openstackgerritMerged openstack/openstack-ansible-openstack_openrc master: Update master for stable/ussuri  https://review.opendev.org/73223414:20
openstackgerritMerged openstack/openstack-ansible-os_blazar master: Update master for stable/ussuri  https://review.opendev.org/73224514:20
openstackgerritMerged openstack/ansible-role-systemd_service master: Update master for stable/ussuri  https://review.opendev.org/73219414:20
openstackgerritMerged openstack/openstack-ansible-ceph_client master: Update master for stable/ussuri  https://review.opendev.org/73220414:21
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Update master for stable/ussuri  https://review.opendev.org/73223114:22
openstackgerritMerged openstack/openstack-ansible-os_ceilometer master: Update master for stable/ussuri  https://review.opendev.org/73224814:22
openstackgerritMerged openstack/openstack-ansible-os_placement master: Update master for stable/ussuri  https://review.opendev.org/73230814:22
openstackgerritMerged openstack/openstack-ansible-plugins master: Update master for stable/ussuri  https://review.opendev.org/73233314:22
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Update master for stable/ussuri  https://review.opendev.org/73225114:22
openstackgerritMerged openstack/openstack-ansible-os_panko master: Update master for stable/ussuri  https://review.opendev.org/73230514:23
openstackgerritMerged openstack/openstack-ansible master: Update master for stable/ussuri  https://review.opendev.org/73235214:23
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Update master for stable/ussuri  https://review.opendev.org/73231414:23
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning master: Update master for stable/ussuri  https://review.opendev.org/73220114:23
openstackgerritMerged openstack/openstack-ansible-os_nova master: Update master for stable/ussuri  https://review.opendev.org/73229914:23
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Update master for stable/ussuri  https://review.opendev.org/73221914:24
openstackgerritMerged openstack/openstack-ansible-os_tacker master: Update master for stable/ussuri  https://review.opendev.org/73232014:24
openstackgerritMerged openstack/openstack-ansible-os_magnum master: Update master for stable/ussuri  https://review.opendev.org/73228114:24
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Update master for stable/ussuri  https://review.opendev.org/73221314:25
openstackgerritMerged openstack/openstack-ansible-os_mistral master: Update master for stable/ussuri  https://review.opendev.org/73229014:25
openstackgerritMerged openstack/openstack-ansible-os_keystone stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73227614:25
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Update master for stable/ussuri  https://review.opendev.org/73230214:26
openstackgerritMerged openstack/openstack-ansible-os_swift master: Update master for stable/ussuri  https://review.opendev.org/73231714:27
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73229414:27
openstackgerritMerged openstack/openstack-ansible-os_rally master: Update master for stable/ussuri  https://review.opendev.org/73231114:27
openstackgerritMerged openstack/openstack-ansible-rsyslog_client stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73234114:28
openstackgerritMerged openstack/openstack-ansible-repo_server stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73233814:30
openstackgerritMerged openstack/openstack-ansible-os_gnocchi stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73226414:31
openstackgerritMerged openstack/openstack-ansible stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73235014:31
openstackgerritMerged openstack/openstack-ansible-tests stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73234714:32
openstackgerritMerged openstack/openstack-ansible-os_cinder stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73224914:33
openstackgerritMerged openstack/openstack-ansible-os_mistral stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73228814:33
openstackgerritMerged openstack/openstack-ansible-os_rally stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73230914:33
openstackgerritMerged openstack/openstack-ansible stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73235114:34
openstackgerritMerged openstack/openstack-ansible-os_octavia stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73230014:34
openstackgerritMerged openstack/openstack-ansible-os_placement stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73230614:34
openstackgerritMerged openstack/openstack-ansible-os_ceilometer stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73224614:35
openstackgerritMerged openstack/openstack-ansible-os_panko stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73230314:36
openstackgerritMerged openstack/openstack-ansible-os_magnum stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73227914:36
openstackgerritMerged openstack/openstack-ansible-nspawn_container_create stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73222314:36
openstackgerritMerged openstack/openstack-ansible-lxc_container_create stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73221414:36
openstackgerritMerged openstack/openstack-ansible-os_aodh stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73223714:36
openstackgerritMerged openstack/openstack-ansible-plugins stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73233114:37
openstackgerritMerged openstack/openstack-ansible-rsyslog_server stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73234414:37
openstackgerritMerged openstack/openstack-ansible-os_glance stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73226114:37
openstackgerritMerged openstack/openstack-ansible-os_designate stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73225814:37
openstackgerritMerged openstack/openstack-ansible-os_nova stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73229714:37
openstackgerritMerged openstack/openstack-ansible-os_cloudkitty stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73225214:37
openstackgerritMerged openstack/openstack-ansible-os_ironic stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73227314:37
openstackgerritMerged openstack/openstack-ansible-os_masakari stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73228514:37
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73233414:38
openstackgerritMerged openstack/openstack-ansible-os_tacker stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73231814:38
openstackgerritMerged openstack/openstack-ansible-ops stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73223514:39
openstackgerritMerged openstack/openstack-ansible-os_swift stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73231514:39
openstackgerritMerged openstack/openstack-ansible-os_congress stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73225514:39
openstackgerritMerged openstack/openstack-ansible-memcached_server stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73222014:39
openstackgerritMerged openstack/openstack-ansible-os_horizon stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73227014:40
openstackgerritMerged openstack/ansible-hardening stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73217614:40
openstackgerritMerged openstack/openstack-ansible-os_blazar stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73224314:40
openstackgerritMerged openstack/openstack-ansible-os_heat stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73226714:40
openstackgerritMerged openstack/openstack-ansible-os_sahara stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73231214:40
openstackgerritMerged openstack/openstack-ansible-openstack_openrc stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73223214:40
openstackgerritMerged openstack/openstack-ansible-openstack_hosts stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73222914:40
openstackgerritMerged openstack/openstack-ansible-os_barbican stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73224014:41
openstackgerritMerged openstack/openstack-ansible-os_zun stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73232714:41
openstackgerritMerged openstack/openstack-ansible-os_trove stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73232414:41
openstackgerritMerged openstack/openstack-ansible-os_masakari master: Update master for stable/ussuri  https://review.opendev.org/73228714:43
jrossernoonedeadpunk: it gets further with remote_tmp in /var/tmp but still fails oddly http://paste.openstack.org/show/794208/14:46
*** pcaruana has quit IRC14:49
*** pcaruana has joined #openstack-ansible14:49
noonedeadpunko_O14:50
jrosseragain it blows up with something related to /tmp14:55
jrosserdirectly after a container start/stop, this time in the functional test rather than the lxc_container_create role14:55
noonedeadpunkI really wonder if it's because we place tmp via proc14:57
noonedeadpunkin the connection plugin14:57
*** rh-jelabarre has quit IRC14:57
*** spatel has joined #openstack-ansible15:06
*** rgogunskiy has quit IRC15:22
*** theintern has joined #openstack-ansible15:44
*** Adri2000 has joined #openstack-ansible15:45
*** brad[] has joined #openstack-ansible15:47
*** gyee has joined #openstack-ansible15:57
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Ensure container connectivity is working after a restart  https://review.opendev.org/73201316:05
jrossernoonedeadpunk: i have it passing locally now reliably16:07
openstackgerritMerged openstack/ansible-role-atos-hsm stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73217916:07
openstackgerritMerged openstack/ansible-role-systemd_service stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73219216:07
openstackgerritMerged openstack/ansible-role-uwsgi stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73219616:07
jrosseri wonder if there is a race confidition with systemd-tmpfiles-setup.service16:07
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73219916:07
jrossercontainer stop/start and at some point at the liking of systemd /tmp gets cleaned out16:07
openstackgerritMerged openstack/openstack-ansible-galera_server stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73220816:08
jrosserbut we are straight in with an ansible task trying to use /tmp16:08
openstackgerritMerged openstack/ansible-role-thales-hsm stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73219516:08
noonedeadpunkI think this might be the change introduced for lxc 4 - cleaning up of tmp during container restart16:09
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73222616:09
openstackgerritMerged openstack/openstack-ansible-ceph_client stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73220216:09
openstackgerritMerged openstack/ansible-role-systemd_mount stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73218616:09
openstackgerritMerged openstack/openstack-ansible-galera_client stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73220516:10
openstackgerritMerged openstack/openstack-ansible-haproxy_server stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73221116:10
jrosseri've looked on a bionic host and it's pretty much the same for hosts16:10
openstackgerritMerged openstack/openstack-ansible-os_manila stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73228216:10
openstackgerritMerged openstack/openstack-ansible-lxc_hosts stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73221716:10
noonedeadpunkalso I was thinking about if this is true only while trying to access through /proc like we do with connection plugin16:10
jrosseri should look in a bionic lxc container and see what that does16:10
jrosseri'm not sure tbh16:10
jrosserit's not really an lxc thing i think16:10
openstackgerritMerged openstack/ansible-role-systemd_networkd stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73218916:11
noonedeadpunkand btw, shouldn't ansible to place modules to tmp after container reboot?16:11
noonedeadpunklike during task execution?16:11
jrosserit's all in 'man systemd-tmpfiles'16:11
jrosserwell yes16:12
jrosseri wonder if ansible places some files16:12
jrosserand we are somehow unlucky on focal that is before the systemd-tmpfiles has executed16:12
*** cshen has joined #openstack-ansible16:13
jrosserthat would explain how it looks like a race condition, it was different ones of container1,2,3 when it was failing inside lxc_container_create16:13
jrosserthe functional test failing was always container3 becasue that was the only one restarted16:13
noonedeadpunkso we enter it too fast before it finished startup things?16:13
jrossercould be yes16:13
noonedeadpunk(including running systemd16:13
jrosserthats my theory, not easy to test that though16:14
noonedeadpunkthat sounds pretty reasonable...16:14
jrosserperhaps if it can connect and start to execute, then /tmp gets cleared, thats when you get "FATAL" type of error which is different from just a normal task 'failed'16:16
openstackgerritMerged openstack/openstack-ansible-os_murano stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73229116:17
noonedeadpunkif it's the case, than we should wait for container to be up in different way and really check that all things are up before starting real task execution16:18
*** cshen has quit IRC16:18
noonedeadpunkbut can't think about what we could check for16:18
jrossersystemctl status systemd-tmpfiles-setup.service tells you if it's finished16:19
jrosserand we kind of can't use any ansible :)16:19
noonedeadpunkwe can use raw actually16:19
jrosserthough systemd-tmpfiles-setup.service can also *create* files16:19
noonedeadpunkbut we're supposed to wait for it code=exited?16:21
*** theintern has quit IRC16:21
jrosserwe are, yes, so dropping a file with it isnt good enough16:22
jrosserseems we are not the only ones https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=91491016:25
openstackDebian bug 914910 in open-vm-tools "race condition between open-vm-tools and systemd-tmpfiles-setup" [Normal,Fixed]16:25
noonedeadpunkso we can probably really execute grep as raw command16:25
noonedeadpunkand wait for it to exit with rc016:25
noonedeadpunkyeah, looks exactly the same16:26
jrosseror we can add a systemd unit which depends on systemd-tmpfiles-setup.service which just drops a "ready" file16:27
jrosserperhaps simpler raw+grep16:27
noonedeadpunkand if suggestions are correct, it should be probably as reliable16:28
noonedeadpunkbut dropping file might be good idea, despite more complicated...16:28
noonedeadpunkbut then we will need to check for this file...16:29
noonedeadpunkand also drop it once we find it16:29
noonedeadpunktbh grep seems too simplier in case we sure, that systemd-tmpfiles-setup is finished once it's status is exited16:31
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Ensure container connectivity is working after a restart  https://review.opendev.org/73201316:38
jrosserooooh so close https://review.opendev.org/#/c/731251/1216:39
jrosserit's definatly a race, that failed becasue of the facts gathering before the "wait for connectivity" task16:40
jrossernoonedeadpunk: do you have code for the raw command?16:40
noonedeadpunkno, but can create pretty fast I think16:42
noonedeadpunklike we have it here https://opendev.org/openstack/openstack-ansible/src/branch/master/playbooks/openstack-hosts-setup.yml#L27-L4016:42
jrosseri'm not really happy with this patch https://review.opendev.org/#/c/732013/16:43
jrosserthough it seems to be working16:43
jrossermaybe it just adds extra delay and we get lucky16:43
noonedeadpunkI think that's probably what happens...16:43
jrosserbecasue why should wait_for_connection: work when the others fail, that makes no sense16:43
noonedeadpunkhighly likely16:43
jrosserit's just a loop around ansible ping:16:44
jrosserif you want to stick a couple of tasks into 732013, go ahead16:44
*** NewJorg has quit IRC16:50
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-lxc_container_create master: Ensure container connectivity is working after a restart  https://review.opendev.org/73201316:50
*** NewJorg has joined #openstack-ansible16:52
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-lxc_container_create master: Ensure container connectivity is working after a restart  https://review.opendev.org/73201316:52
jrossernoonedeadpunk: i think exactly the same code needs to go in test-containers-functional.yml16:53
jrosserit does a stop/start in there too, just before my "wait for connection" edit16:54
*** also_stingrayza has joined #openstack-ansible17:03
*** stingrayza has quit IRC17:06
*** arkan has joined #openstack-ansible17:16
*** tosky has quit IRC17:19
*** donnyd_ has joined #openstack-ansible17:28
noonedeadpunkok, so it passed as well17:28
noonedeadpunkI wasn't sure it works so decided to start from somewhere :p17:28
noonedeadpunkbut job fails completely with another issue now:(17:29
noonedeadpunkhttps://zuul.opendev.org/t/openstack/build/03a52576dc6f4f529727a936f96f1021/log/job-output.txt#330117:30
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-lxc_container_create master: Ensure container connectivity is working after a restart  https://review.opendev.org/73201317:32
spotzPingable for reviews17:39
*** arkan has quit IRC17:52
jrossernoonedeadpunk: it's a handler, missing the listne17:55
jrosserlisten17:55
noonedeadpunkargh17:55
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Ensure container connectivity is working after a restart  https://review.opendev.org/73201317:55
jrosserthat should do it17:55
openstackgerritMerged openstack/ansible-role-python_venv_build stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73218017:55
noonedeadpunkyeah17:55
jrosserso this is the one to watch https://review.opendev.org/#/c/731251/17:56
jrosserif this passes then i'll get rid of all the other hacks like using /var/tmp17:57
noonedeadpunkjrosser: so, what do we think about galera? :p https://review.opendev.org/#/c/717830/17:57
noonedeadpunkexcept it's missing focal...17:57
jrosseri say we merge it then bump to .14 for focal17:57
jrosseri assume they are working on that ASAP given .13 is basically broken17:58
noonedeadpunk++17:58
noonedeadpunkit depends on how critical they think this bug is17:59
*** arkan has joined #openstack-ansible18:04
noonedeadpunkspotz: https://review.opendev.org/#/c/732019/ would be great to get vote :)18:05
spotznoonedeadpunk: Pulling it up18:06
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/stein: Bump SHAs for stable/stein  https://review.opendev.org/73201818:06
noonedeadpunkand actually https://review.opendev.org/#/c/73206418:07
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Start Victoria cycle  https://review.opendev.org/72927418:08
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Start Victoria cycle  https://review.opendev.org/72927418:11
arkan/etc/nova/rootwrap18:12
arkan/etc/nova/api-paste.ini18:12
*** cshen has joined #openstack-ansible18:13
arkanHi guys, I have strange thing, while I was installing OS at this stage "openstack-ansible setup-hosts.yml", I got error say that "compute" node does not find files at /etc/nova/rootwrap and /etc/nova/api-past.ini18:13
noonedeadpunkcan you paste error?18:14
arkanthen I've deleted the directory /etc/nova from "compute" and re-run "openstack-ansible setup-openstack.yml"18:14
jrossernoonedeadpunk: nice http://paste.openstack.org/show/794215/18:14
noonedeadpunkso it's kinda 2 seconds gap18:15
noonedeadpunkexactly what I saw locally18:15
arkansorry I've I meant in my first sentence openstack-ansible setup-openstack.yml not openstack-ansible setup-hosts.yml18:15
arkanthen after I've deleted the /etc/nova and rerun openstack-ansible setup-openstack.yml, it created /etc/nova with some files but also it lacks these two files /etc/nova/rootwrap and /etc/nova/api-paste.ini18:16
noonedeadpunkprobably we could set like 5 retries, but whatever18:16
arkanthen I went to controller node and copied18:17
arkan/proc/9444/root/etc/nova/rootwrap.conf18:17
arkan/proc/9444/root/etc/nova/api-paste.ini18:17
arkanafter that, I rerun openstack-ansible setup-openstack.yml18:17
*** cshen has quit IRC18:17
arkanthen the scrip has finished without any error18:17
arkanthen I could log in into Horizon18:18
arkanI can see all the services UP18:18
arkanbut I can not create image18:18
noonedeadpunkglance is resposible for images18:19
noonedeadpunkyou should check it's logs and service status18:19
arkannoonedeadpunk: from Horizon ? or utility container ?18:20
*** sshnaidm is now known as sshnaidm|afk18:20
noonedeadpunkfrom glance container18:20
noonedeadpunkservice is glance-api18:20
arkanI can see that there are 2 queued images inside Horizon18:20
openstackgerritMerged openstack/openstack-ansible-os_swift stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73231618:21
openstackgerritMerged openstack/openstack-ansible-os_sahara stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73231318:22
arkannoonedeadpunk: these are the logs inside /var/log18:23
arkanalternatives.log  apt  btmp  dpkg.log  lastlog  python_venv_build.log  tallylog  wtmp18:23
arkanwhich one to check?18:23
openstackgerritMerged openstack/openstack-ansible-ceph_client stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73220318:23
noonedeadpunkI think they're written to journald18:23
openstackgerritMerged openstack/openstack-ansible-repo_server stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73233918:24
arkanok18:24
noonedeadpunkso you need kinda journalctl -f -u glance-api18:24
openstackgerritMerged openstack/openstack-ansible-os_nova stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73229818:24
noonedeadpunk(or without -f - it's for follow)18:24
openstackgerritMerged openstack/openstack-ansible-rsyslog_client stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73234218:24
openstackgerritMerged openstack/openstack-ansible-os_placement stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73230718:26
arkannoonedeadpunk: this is the log using journalctl -xe18:26
arkanhttps://pastebin.com/h21jEQ6e18:26
openstackgerritMerged openstack/openstack-ansible-os_horizon stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73227118:26
openstackgerritMerged openstack/openstack-ansible-os_ceilometer stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73224718:27
openstackgerritMerged openstack/openstack-ansible-rsyslog_server stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73234518:27
openstackgerritMerged openstack/openstack-ansible-haproxy_server stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73221218:27
noonedeadpunkarkan: I think you cut it a bit, but not seeing any problems there anyway...18:27
openstackgerritMerged openstack/openstack-ansible-os_blazar stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73224418:27
noonedeadpunkDo you upload images with horizon?18:27
openstackgerritMerged openstack/openstack-ansible-os_rally stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73231018:27
openstackgerritMerged openstack/openstack-ansible-os_murano stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73229218:27
arkanyes, I've uploaded18:27
openstackgerritMerged openstack/openstack-ansible-lxc_hosts stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73221818:27
arkanfrom Horizon I uploaded cirros18:27
openstackgerritMerged openstack/openstack-ansible-openstack_hosts stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73223018:27
openstackgerritMerged openstack/openstack-ansible-galera_client stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73220618:28
openstackgerritMerged openstack/ansible-role-uwsgi stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73219718:28
openstackgerritMerged openstack/openstack-ansible-os_trove stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73232518:28
openstackgerritMerged openstack/openstack-ansible-os_heat stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73226818:28
noonedeadpunkarkan: and it's scheduled for upload?18:28
openstackgerritMerged openstack/openstack-ansible-os_congress stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73225618:28
openstackgerritMerged openstack/openstack-ansible-memcached_server stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73222118:28
noonedeadpunkarkan: what do you use as a backend for images? ceph?18:29
arkannoonedeadpunk: I'm inside Compute->Images.  Status: Queued18:29
openstackgerritMerged openstack/openstack-ansible-os_manila stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73228318:29
arkanI have ceph18:29
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: Add functional tests for ubuntu focal  https://review.opendev.org/73125118:29
arkan6 osd are running18:29
openstackgerritMerged openstack/openstack-ansible-openstack_openrc stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73223318:30
openstackgerritMerged openstack/openstack-ansible-os_panko stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73230418:30
noonedeadpunkI guess you've reloaded horizon page? (as it's not updated automatically for images)18:30
arkanI've reloaded now18:30
openstackgerritMerged openstack/openstack-ansible-nspawn_container_create stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73222418:30
arkanit's the same18:30
noonedeadpunkglance so lacks normal logging....18:31
openstackgerritMerged openstack/openstack-ansible-os_designate stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73225918:31
openstackgerritMerged openstack/openstack-ansible-os_ironic stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73227418:31
openstackgerritMerged openstack/openstack-ansible-os_octavia stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73230118:31
openstackgerritMerged openstack/openstack-ansible-os_gnocchi stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73226518:31
openstackgerritMerged openstack/openstack-ansible-os_aodh stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73223818:31
openstackgerritMerged openstack/openstack-ansible-os_cinder stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73225018:32
openstackgerritMerged openstack/openstack-ansible-ops stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73223618:33
arkannoonedeadpunk: I don't know why I can not see /var/log/lastlog18:33
openstackgerritMerged openstack/openstack-ansible-os_masakari stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73228618:33
arkanwhen I try it with "cat" notthing happen18:33
openstackgerritMerged openstack/openstack-ansible-os_barbican stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73224118:33
arkanit has 286k18:33
openstackgerritMerged openstack/openstack-ansible-os_mistral stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73228918:33
openstackgerritMerged openstack/openstack-ansible-os_tacker stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73231918:33
noonedeadpunklastlog has binary format isn't it?'18:34
openstackgerritMerged openstack/openstack-ansible-os_magnum stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73228018:34
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73220018:34
arkanI don't know I could not read it18:35
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Wait for systemd-tmpfiles-setup service to complete after container restart   https://review.opendev.org/73201318:35
openstackgerritMerged openstack/openstack-ansible-plugins stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73233218:35
*** masterpe has quit IRC18:35
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Wait for systemd-tmpfiles-setup service to complete after container restart   https://review.opendev.org/73201318:36
openstackgerritMerged openstack/ansible-role-systemd_mount stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73218718:37
arkannoonedeadpunk: this is my user_variables.yml https://pastebin.com/jfCXxtV718:37
arkannoonedeadpunk: and this is my openstack_user_config.yml https://pastebin.com/zReNSsrP18:38
openstackgerritMerged openstack/ansible-role-systemd_networkd stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73219018:38
openstackgerritMerged openstack/openstack-ansible-lxc_container_create stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73221518:38
*** also_stingrayza is now known as stingrayza18:38
noonedeadpunkok, so glance-images pool in ceph exists and glance user has required priviliges (in ceph)?18:38
arkannoonedeadpunk: my ceph osds are sitting in compute node 172.29.236.1518:39
arkannoonedeadpunk: and I can access my ceph webpage locally, and the health is showing green HEALTH_OK18:39
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73233518:40
noonedeadpunkwhat about ceph osd lspools?18:40
arkanI've created 3 pools, cinder-volumes, cinder-backups, glance-images, and ephemeral-vms18:40
noonedeadpunkok18:40
arkanand I've used ceph auth to create keyrings for them and I specified the pools18:41
noonedeadpunkwhat about `ceph auth get client.glance`?18:41
arkanand these pools are mentioned in my config files18:41
arkanyes I have it18:41
*** fridtjof[m] has quit IRC18:41
arkanexported keyring for client.glance18:42
arkan[client.glance]18:42
arkankey = AQA64dNeyhV5KRAAcerxlpu44KUINL2RyAAT6g==18:42
arkancaps mgr = "profile rbd pool=glance-images"18:42
arkancaps mon = "profile rbd"18:42
arkancaps osd = "profile rbd pool=glance-images"18:42
noonedeadpunkok, it's missing smth...18:42
openstackgerritMerged openstack/ansible-hardening stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73217718:43
arkan:)) greate18:43
arkannoonedeadpunk: it sounds good18:43
*** masterpe has joined #openstack-ansible18:44
arkannoonedeadpunk: I found the info from this page https://docs.ceph.com/docs/nautilus/rbd/rbd-openstack/?highlight=openstack18:44
noonedeadpunkis should have osd 'allow class-read object_prefix rbd_children, allow rwx pool=glance-images"18:44
openstackgerritMerged openstack/ansible-role-python_venv_build stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73218118:44
arkannoonedeadpunk: what should I do, recreate them ?18:45
*** masterpe has quit IRC18:45
noonedeadpunkor  osd 'allow class-read object_prefix rbd_children, profile rbd pool=glance-images"18:45
arkancan I recreate them, and refresh the page, I don't what to do after that18:46
arkanshould I restart the containers after that ?18:46
openstackgerritMerged openstack/ansible-role-systemd_service stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73219318:46
noonedeadpunkyou can use ceph auth caps to edit priviliges18:46
noonedeadpunkhttps://docs.ceph.com/docs/mimic/rados/operations/user-management/#modify-user-capabilities18:46
noonedeadpunkand try to restart glance and try to create new upload18:47
arkanok18:47
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73222718:50
arkannoonedeadpunk: I updated client.glance auth, then I restarted glance container18:53
arkanthen I tried to upload the image from horizon, and it said, "Unable to create image."18:54
noonedeadpunkhuh18:54
noonedeadpunkwhats in log?18:54
arkanone moment..18:54
arkanhttp://paste.openstack.org/show/794217/18:57
arkanI need to find a way to copy it completly18:57
*** maaritamm has joined #openstack-ansible18:59
openstackgerritMerged openstack/openstack-ansible-galera_server stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73220919:04
*** arxcruz|qa_room is now known as arxcruz19:07
arkannoonedeadpunk: After upload to backend, deletion of staged image data has failed because it cannot be found at /tmp/staging//e824a8e1-1df1-4772-9a4d-9071808ddc9319:10
arkanmaybe something is not ok with my compute node19:11
arkanbecause in the stage "openstack-ansible setup-openstack.yml", I've copied /etc/nova/rootwrap and /etc/nova/api-paste.ini manually, because the installation was failing19:12
*** masterpe has joined #openstack-ansible19:20
noonedeadpunkso glance has nothing to do with nova19:24
arkanok19:24
noonedeadpunkbut this error is ok in case it raised for previous tries of upload19:25
arkanhum19:27
arkanIt created the image by using the cli19:27
arkanopenstack image create "cirros"   --file cirros-0.5.1-x86_64-disk.img   --disk-format qcow2 --container-format bare   --public19:27
arkannow I can see the image in Horizon19:27
arkanbut I can not created from Horizon19:27
arkanbut I can not create it from Horizon19:28
arkanI can see on ceph now, the glance-image pool has updated19:29
arkanand ceph health now WARN (POOL_APP_NOT_ENABLED: application not enabled on 1 pool)19:30
arkanbut the image is created and it is active on Horizon19:30
arkanonly from cli19:30
arkanonly from cli I could create the image19:30
jrosser the ceph application is just a hint to ceph if the pool is to be used for rbd or object storage. it doesn’t break anything if you don’t set that yet19:31
arkanjrosser: thanks for the info19:32
arkanhahah19:35
arkannoonedeadpunk: I've solved the issue19:35
arkanthere is a file inside horizon container19:36
arkanetc/horizon/local_settings.py19:36
mgariepyjrosser, noonedeadpunk don't you guys have issues with chrony ?19:36
arkanI changed HORIZON_IMAGES_UPLOAD_MODE = 'direct' to HORIZON_IMAGES_UPLOAD_MODE = 'remote'19:36
arkanand the issue was solved19:37
noonedeadpunknot really.19:37
arkanI restarted the container, and uploaded the image, and it worked19:37
jrosserarkan: you should find the proper override for that19:37
noonedeadpunkLike it wasn't enabled on boot, but it's just another story...19:37
mgariepybecause with the config pulled from ansible-hardening, they start with offline, which needs to be put online for the system to work after.19:37
jrosserarkan: else it will be removed if you run the horizon playbook again19:38
arkanwhat to do ?19:38
noonedeadpunkmgariepy: so I have this for force sync https://gist.github.com/noonedeadpunk/67fb5474f17b09009cd6884f71d4e77719:38
arkani saw this https://bugs.launchpad.net/openstack-ansible/+bug/173072219:38
openstackLaunchpad bug 1730722 in openstack-ansible "Pike Horizon Image Create Fails" [Undecided,Expired]19:38
mgariepyjrosser, do you have issues ?19:39
jrosserI’d have to look if we disable the andible-hardening chrony setup completely19:40
jrosserwe have a mix of ntp and ptp so that all gets dealt with outside OSA19:40
mgariepyk19:41
jrosserI know we had some issue with it undoing config we’d already laid down19:41
arkanjrosser: I can see this option inside /etc/ansible/roles/os_horizon/defaults/main.yml19:41
arkanjrosser: horizon_images_upload_mode: direct19:41
arkanshould I change it to 'remote' ?19:42
arkanso whenever I run the playbook, it will not reset it19:42
noonedeadpunkbtw I'm pretty sure "remote" in not valid value19:42
jrosseryou set the variable to the value you want in /etc/openstack_deploy/user_variables.yml19:42
noonedeadpunkit can be either direct or legacy19:43
jrosseradding things there is the proper way to override the ansible role defaults19:43
noonedeadpunkhttps://docs.openstack.org/horizon/latest/configuration/settings.html#horizon-images-upload-mode19:43
arkannoonedeadpunk: I don't know but I set it in the container and I succeeded to upload the image19:43
jrosserarkan: you can set it to any string19:43
arkanjrosser: yes, I can added inside user_variables.yml19:44
jrosserbut the horizon documentation will tell you what is valid19:44
arkannoonedeadpunk: but why 'direct' does not allow to upload the image from horizon?19:45
jrossernoonedeadpunk: it’s worked https://review.opendev.org/#/c/731251/19:46
noonedeadpunkarkan: probably it's because of incorrect cors setting19:46
arkanin the doc says that it bypass Horizon web server19:46
arkanjust to be sure and sleep today without nightmare for what I've done. When I got errors in the installation that the files could be found, I've created them from /proc/9444/root/etc/nova/rootwrap.conf and /proc/9444/root/etc/nova/api-paste.ini19:48
jrossermaybe we should backport the systemd-tmpfiles-setup thing to the stable branches too19:48
arkanand put them into /etc/nova/rootwrap.conf and /etc/nova/api-paste.ini into the "compute" node19:48
arkanis this ok ?19:49
jrosserarkan: that shouldn’t be necessary19:49
arkanbecause I've tried a lot to rerun the playbook, and I always got the same errors19:49
jrosserwe can look at that some more another time19:50
arkanso I stared searching /openstack/log/ansible-logging/ansible.log until I found these paths19:50
arkananyway if everything is working then I'm so happy after about more than 7 days of trying to install OpensStack :)))19:51
jrosseryou are installing from source, bit distro packages?19:51
*** fridtjof[m] has joined #openstack-ansible19:51
jrosser*not distro19:51
*** maaritamm has quit IRC19:51
arkanI started from here https://docs.openstack.org/project-deploy-guide/openstack-ansible/train/deploymenthost.html19:52
arkanand I installed Ceph separately with ceph-ansible19:52
*** maaritamm has joined #openstack-ansible19:52
arkanthen I used as inspiration https://docs.openstack.org/openstack-ansible/train/user/prod/example.html19:53
jrossercool - we have a big meeting for OSA PTG tomorrow so it may be a bit quiet here19:53
jrosserbut like I say you should not have to copy those files around, there’s something wrong somewhere19:54
noonedeadpunkor loud :p19:54
jrosseroh right - we do it here? :)19:54
*** maaritamm has quit IRC19:55
noonedeadpunkwe might use channel for sending stuff linke links... or may use zoom chat for this19:55
arkanalso this was a big help https://www.openstackfaq.com/openstack-ansible-ceph/19:55
jrossercan we merge https://review.opendev.org/#/c/732013/19:56
jrosserand https://review.opendev.org/#/c/731251/19:57
arkanguys thanks a lot for you help, you are awesome19:57
jrosserno worries :)19:57
noonedeadpunkand it's still fails on the same weird pythion thing https://zuul.opendev.org/t/openstack/build/e2b0f7f6591745c88ec753c30457e140/log/job-output.txt#334319:57
jrosserhmm? what have I missed?19:58
noonedeadpunkit's from https://review.opendev.org/#/c/73201319:59
noonedeadpunkfor focal19:59
jrosseroh the first patch needs the second19:59
jrosserand it’s lxc hosts<>create circularness19:59
noonedeadpunkah19:59
jrosserlxc_hosts uses the jobs from lxc_container_create, just for added fun20:00
jrosseror the other way, it’s been a long day :)20:00
openstackgerritMerged openstack/openstack-ansible-galera_client stable/ussuri: Updated from OpenStack Ansible Tests  https://review.opendev.org/73235820:01
jrosserthe second one being all green is proving the first one is good, basically20:01
noonedeadpunkyeah, can't agree more. I think tomorrow will be even more "long"20:01
jrosserso really now galera is the blocker for focal, that ought to be all that’s left20:02
*** gshippey has quit IRC20:04
*** maaritamm has joined #openstack-ansible20:07
*** cshen has joined #openstack-ansible20:13
*** cshen has quit IRC20:18
noonedeadpunkbad news20:23
noonedeadpunkThe planned date for 10.4.14 is July 24th20:23
noonedeadpunkso we should focus on centos 8 :p20:25
openstackgerritMerged openstack/openstack-ansible-os_magnum stable/ussuri: Updated from OpenStack Ansible Tests  https://review.opendev.org/73235920:30
jrosser8-O July 24th!20:35
*** owalsh has quit IRC20:38
openstackgerritMerged openstack/openstack-ansible-ceph_client stable/ussuri: Updated from OpenStack Ansible Tests  https://review.opendev.org/73235720:48
openstackgerritMerged openstack/openstack-ansible stable/train: Bump SHAs for stable/train  https://review.opendev.org/73201920:48
*** owalsh has joined #openstack-ansible20:56
*** maaritamm has quit IRC21:11
*** markvoelker has quit IRC21:12
*** arkan has quit IRC21:52
*** spatel has quit IRC22:08
*** rh-jlabarre has quit IRC22:17
*** rh-jlabarre has joined #openstack-ansible22:18
openstackgerritMerged openstack/openstack-ansible-os_tempest stable/ussuri: Update .gitreview for stable/ussuri  https://review.opendev.org/73232122:19
openstackgerritMerged openstack/openstack-ansible-os_tempest stable/ussuri: Update TOX_CONSTRAINTS_FILE for stable/ussuri  https://review.opendev.org/73232222:19
*** tosky has joined #openstack-ansible22:32
*** NewJorg has quit IRC23:04
*** openstacking_123 has joined #openstack-ansible23:39
openstacking_123Anyone seeing this issue on train deployments23:39
openstacking_123Failed to discover available identity versions when contacting http://10.25.0.11:5000/v3. Attempting to parse version from URL.23:39
openstacking_123Unable to establish connection to http://10.25.0.11:5000/v3/auth/tokens: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',))23:39
openstacking_123I notice this error when doing syntax check23:40
openstacking_123openstack-ansible setup-infrastructure.yml --syntax-check23:40
openstacking_123 Error while finding module specification for 'ara.setup.callback_plugins'23:40
« Sunday, 2020-05-31 Index Tuesday, 2020-06-02 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!