Friday, 2022-01-14

*** mazzy50988129294 is now known as mazzy509881292901:29
*** EugenMayer3 is now known as EugenMayer04:05
yoctozeptopriteau: hmm, k-a CI does not look affected07:28
fricklerno ping, no pain ;)07:51
yoctozeptolol07:51
yoctozeptosecurity by unavailability07:51
yoctozeptomayhaps the images got built after the last k-a CI job run07:52
yoctozeptowell, s/built/set-to-be-used07:53
fricklerthis broke our deployment, since we use our custom copy of group_vars/all.yml, is that just our fault or should stable backports maybe be more conservative? https://review.opendev.org/c/openstack/kolla-ansible/+/82401908:14
fricklerAn exception occurred during task execution. To see the full traceback, use -vvv. The error was: ansible.errors.AnsibleUndefinedVariable: {{ rabbitmq_prometheus_port }}: 'rabbitmq_pr08:15
fricklerometheus_port' is undefined08:15
priteauyoctozepto: It is affecting kolla through the multi-node-managed-addressing role08:28
fricklerpriteau: yoctozepto: I just saw the same, that's part of the infra setup even and not kolla specific. should be the same for k-a multinode jobs08:56
fricklerah, no, this is k-a even. maybe do a become as workaround here? https://opendev.org/openstack/kolla-ansible/src/branch/master/roles/multi-node-managed-addressing/tasks/main.yml#L68-L7208:58
* frickler proposes a patch for testing this08:58
opendevreviewDr. Jens Harbott proposed openstack/kolla-ansible master: Use become for ping on c8s  https://review.opendev.org/c/openstack/kolla-ansible/+/82468109:00
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Add Rocky Linux support as Host OS  https://review.opendev.org/c/openstack/kolla-ansible/+/81510411:05
mgoddardfrickler: why would you use a custom copy of group_vars/all.yml? that's what globals.yml is for11:14
opendevreviewMerged openstack/kolla stable/ussuri: [CI] Stop testing non-stream CentOS  https://review.opendev.org/c/openstack/kolla/+/82385511:39
opendevreviewMerged openstack/kolla stable/train: [CI] Stop testing non-stream CentOS  https://review.opendev.org/c/openstack/kolla/+/82386211:39
opendevreviewMerged openstack/kolla stable/victoria: [CI] Stop testing non-stream CentOS  https://review.opendev.org/c/openstack/kolla/+/82355711:39
opendevreviewIvan Halomi proposed openstack/kolla-ansible master: Systemd container control PoC  https://review.opendev.org/c/openstack/kolla-ansible/+/81672411:53
dtantsurhey folks, we're seeing retry limits in the bifrost job: https://aeed1e6fd32f487b15b7-8ff305a045ea105f4906486adfb49654.ssl.cf2.rackcdn.com/824700/1/check/kolla-ansible-centos8s-source-bifrost/e9ef8af/job-output.txt12:57
hrwbtw - both binary and source images using yoga centos/ubuntu packages build fine13:01
opendevreviewStig Telfer proposed openstack/kolla-ansible master: Fix post-config of OVS for manila-share servers  https://review.opendev.org/c/openstack/kolla-ansible/+/82470713:11
fricklermgoddard: yeah, this is some weird stuff I don't still understand myself. maybe christian had a reason to build things that way, maybe it should be improved. but it seems you share my first impression, that's good ;)13:13
fricklerdtantsur: centos has decided that ping is too dangerous, so they broke everyone. https://review.opendev.org/c/openstack/kolla-ansible/+/824681 is an attempt to work around it, but needs further fixing by someone who cares about centos13:16
dtantsurack13:16
opendevreviewJakub Darmach proposed openstack/kayobe master: Support for untemplated dirs in kolla config  https://review.opendev.org/c/openstack/kayobe/+/82456513:25
priteauI see, kolla-ansible deploy is failing too13:40
priteauTASK [loadbalancer : Checking if kolla_internal_vip_address and kolla_external_vip_address are not pingable from any node] ***13:41
opendevreviewJakub Darmach proposed openstack/kayobe master: Support for untemplated dirs in kolla config  https://review.opendev.org/c/openstack/kayobe/+/82456513:43
opendevreviewPierre Riteau proposed openstack/kolla-ansible master: Fix permission denied errors with ping on c8s  https://review.opendev.org/c/openstack/kolla-ansible/+/82468113:48
spatelyoctozepto morning 14:08
spatelwhen i am running kolla-ansible -i /etc/kolla/multinode deploy -t nova-cell --limit 192.168.75.144 14:10
spatelits throwing nasty error during Gather Facts 14:11
spatelhttps://paste.opendev.org/show/812118/14:14
spatelI have couple of nodes down in pool does that error related to that?14:15
spatelnoticed this error always come when it try this   ok: [192.168.75.144 -> localhost] => (item=localhost) 14:16
mgoddardspatel: all nodes in the inventory must be up. Remove from the inventory if not14:20
spateloh! 14:20
spatellet me try that then mgoddard 14:21
spatelmgoddard also my OVN controller specially NB db, what is the best way to bring it back?  destroy container and redeploy?14:23
spatelis there any easy way to tell ansible to ignore down nodes because i have range variable in inventory and trying to remove few nodes between range is required create new one - 192.168.75.[176:185]14:30
mgoddardspatel: split the range into multiple14:40
spateljust did 14:42
spatelcreated individual entries, i have 100s of nodes :(14:43
spatelre-running play14:43
mgoddardsuggest using their names rather than IPs then...14:44
mnasiadkaor use a dynamic inventory script, that checks their ,,liveliness'' ;-)14:49
spatelmgoddard you are correct :) 14:49
spatelerror gone as soon as dead node removed 14:49
spatelnow time to fix OVN which is other beast to handle 14:50
spatelhow do i restart quickly service on all container like ovn nb14:52
opendevreviewBuddhika Sanjeewa proposed openstack/kolla-ansible master: Deploy Zun with Cinder Ceph support  https://review.opendev.org/c/openstack/kolla-ansible/+/82472215:02
opendevreviewBuddhika Sanjeewa proposed openstack/kolla-ansible master: Deploy Zun with Cinder Ceph support  https://review.opendev.org/c/openstack/kolla-ansible/+/82472215:03
opendevreviewBuddhika Sanjeewa proposed openstack/kolla-ansible master: Deploy Zun with Cinder Ceph support  https://review.opendev.org/c/openstack/kolla-ansible/+/82472215:05
opendevreviewBuddhika Sanjeewa proposed openstack/kolla-ansible master: Deploy Zun with Cinder Ceph support  https://review.opendev.org/c/openstack/kolla-ansible/+/82472215:12
JohnBWe are (still) deploying our OpenStack environment via kayobe. We are finaly at the last state. But this fails. This happens in 'kayobe overcloud post configure' on `TASK [ironic-inspector-rules : Ensure introspection rules exist]`. It gives us an 'Acces denied by policy'.15:29
JohnBWhat are we missing here?15:29
opendevreviewAndrey Kurilin proposed openstack/kolla-ansible stable/xena: Add logrotate to libvirt service  https://review.opendev.org/c/openstack/kolla-ansible/+/82472815:39
yoctozeptolet's deprecate centos support, /me had enough ;-)15:43
spatelyoctozepto i am running CentOS Stream release 8 does that means my life in danger ?15:48
priteauhttps://imgflip.com/i/619lnl15:49
fricklerpriteau: lol15:52
opendevreviewBuddhika Sanjeewa proposed openstack/kolla-ansible master: Deploy Zun with Cinder Ceph support  https://review.opendev.org/c/openstack/kolla-ansible/+/82472215:58
spatellol15:59
opendevreviewBuddhika Sanjeewa proposed openstack/kolla-ansible master: Deploy Zun with Cinder Ceph support  https://review.opendev.org/c/openstack/kolla-ansible/+/82472216:00
spateldo you think i should switch it to ubuntu ? 16:00
spatelnot sure how long centos-8 will be supported16:00
admin1spatel, switch to ubuntu :) 16:09
admin1like the definitive statement .. 16:09
spatelwe have go live in few days :D16:09
admin1rebuilding takes 1/2 a day :) 16:10
admin1pxe reinstall takes 1/2 a day 16:10
admin1you are up in 1 day :) 16:10
spatelhttps://docs.openstack.org/kolla-ansible/train/user/centos8.html16:20
spatelDoes kolla has official announcement which i can use to change my customer mind :)16:22
opendevreviewBuddhika Sanjeewa proposed openstack/kolla-ansible master: Deploy Zun with Cinder Ceph support  https://review.opendev.org/c/openstack/kolla-ansible/+/82472216:25
mnasiadkayoctozepto: or move to RockyLinux ;)17:10
mnasiadka(but yes, that involves deprecating)17:10
*** hrww is now known as hrw17:42
spatelyoctozepto is rocky ready for kolla19:54

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!