Monday, 2022-12-05

opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Implement OVN inventory changes and deploy by default  https://review.opendev.org/c/openstack/openstack-ansible/+/86292408:29
noonedeadpunkmornings09:19
damiandabrowskihi!09:20
noonedeadpunkI messed with ovn patches through weekends and still don't really like logic we put in there09:20
noonedeadpunkmost part I don't like is condition when we think ovn is not used09:21
noonedeadpunkNow writing that I think I should have added a variable for bootstrap role like _is_ovn_used and use it elsewhere in the code09:22
noonedeadpunkWill wait for CI to finish to see results and will do that09:22
jrossergood morning10:29
Adri2000hello, am I right saying that `log_hosts` can safely be removed in a Xena deployment, using Ubuntu and systemd-journal-remote?10:53
Adri2000(and the corresponding rsyslog containers can safely be destroyed)10:54
noonedeadpunkAdri2000: yup, pretty much10:55
Adri2000thanks!10:57
*** dviroel|afk is now known as dviroel11:05
admin1\o11:15
noonedeadpunko/11:29
*** frenzy_friday is now known as frenzy_friday|food12:40
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Implement OVN inventory changes and deploy by default  https://review.opendev.org/c/openstack/openstack-ansible/+/86292413:07
*** arxcruz is now known as arx|202313:08
admin1is there a good rescue image (os ) for openstack .. that kind of boots directly without login/pass for rescue ? 15:30
spateladmin1 why and for what purpose ? and what kind of OS Unix or windows?15:54
spatelnoonedeadpunk damiandabrowski I hit the same bug you guys hit - https://bugs.launchpad.net/nova/+bug/199867115:55
spatelafter doing mysql -e "update nova.services set version = 57 where deleted = 0;" it fixed my issue 15:55
spatelI did upgrade from W -> X15:56
admin1unix 15:58
admin1occationally people have their centos/ubuntu vms stuck .. needing fsck .. or needing a root pass change 15:58
admin1rescue sometimes work, sometimes get stuck , sometimes get kernel crash 15:58
*** dviroel is now known as dviroel|lunch16:00
jrosseryou can use system rescue cd for this16:04
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Implement OVN inventory changes and deploy by default  https://review.opendev.org/c/openstack/openstack-ansible/+/86292416:04
noonedeadpunkspatel: fwiw nova team does know about that and their position was "as designed" last time I talked about this case16:05
noonedeadpunkOr well, from W->X?16:05
noonedeadpunkHuh16:05
spatelYes from Wallaby to Xena 16:06
noonedeadpunkadmin1: https://www.system-rescue.org/ ?16:06
spatelI believe Nova team has patch for Victoria 16:06
noonedeadpunkyeah. what jrosser said actually :D16:06
spatelhttps://bugs.launchpad.net/nova/+bug/190354516:06
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Implement OVN inventory changes and deploy by default  https://review.opendev.org/c/openstack/openstack-ansible/+/86292416:08
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Implement OVN inventory changes and deploy by default  https://review.opendev.org/c/openstack/openstack-ansible/+/86292416:09
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Implement OVN inventory changes and deploy by default  https://review.opendev.org/c/openstack/openstack-ansible/+/86292416:11
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Implement OVN inventory changes and deploy by default  https://review.opendev.org/c/openstack/openstack-ansible/+/86292416:11
noonedeadpunkI should stop using gerrit editor....16:11
jamesdentonit sure is handy, though16:12
spateljrosser did you see my last week mesg, related SSH CA -  https://paste.opendev.org/show/bcJBKFO0A7RqikDs6Idc/16:19
jrosseryes but really only helpful with some debugging16:19
spatelI don't know what went wrong but somehow setup-hosts.yml didn't do what it should do 16:19
spateli will see if i can pick logs or try to reproduce in lab16:20
jrosserthis file is created in setup-hosts /etc/openstack_deploy/ssh_keypairs/OpenStack-Ansible-SSH-Signing-Key16:20
jrosserthere is no conditionals, it should just happen16:20
jrosserunless you do wierdness with --limit?16:20
jrossersee how it must run against 'localhost' https://github.com/openstack/openstack-ansible/blob/master/playbooks/certificate-ssh-authority.yml#L1616:22
*** frenzy_friday|food is now known as frenzy_friday16:24
spatelhmm! did run all manual steps directed here - https://docs.openstack.org/openstack-ansible/yoga/admin/upgrades/major-upgrades.html16:29
spatellike - openstack-ansible setup-hosts.yml --limit '!galera_all:!rabbitmq_all' -e package_state=latest16:29
jrosserspatel: unfortunatley..... https://review.opendev.org/c/openstack/openstack-ansible/+/86646016:40
BobZopenstack /msg NickServ IDENTIFY !QAZ@WSX1qaz2wsx16:48
*** dviroel|lunch is now known as dviroel16:51
spateljrosser :) 16:54
spateljrosser noonedeadpunk should we also mention about nova bug related (mysql -e "update nova.services set version = 57 where deleted = 0;") in upgrade notes. I was luck i ask in advance but may be someone can struggle 16:55
jrosseri don't think that is affecting us though?16:56
mgariepydid you ran the query before or when it failed to start ?16:56
mgariepyit's to skip a release..16:56
spatelin my nova table i noticed version was 56 in wallaby release os openstack 16:57
spatellet me check in one more cloud which i didn't upgrade yet16:58
spatelhttps://paste.opendev.org/show/bTWxebh0Dtgj16nLiCRu/17:00
spatelYes its 56 before upgrade and even after upgrade it was 56 until i bump to 57 by hand 17:00
damiandabrowskispatel: there are 2 separate things, let me describe it17:00
damiandabrowski1. nova(at least till Zed) did not support skipping versions, you may try to play with https://docs.openstack.org/nova/latest/configuration/config.html#upgrade-levels but i think it's out of scope for OSA documentation17:02
damiandabrowski2. there was some bug in nova which made things even worse when skipping openstack release, but I don't remember the details. IIRC Dmitriy said it should be fixed now 17:04
spateldamiandabrowski oh! so there is a knob for it to play - upgrade_levels=auto 17:11
spatelIn my cluster couple of machine was down because of HW failure do you think because of that i had this version mis-match happened. 17:12
spatelJust guessing.. 17:12
*** dviroel is now known as dviroel|afk17:52
-opendevstatus- NOTICE: The lists.opendev.org and lists.zuul-ci.org sites will be offline briefly for migration to a new server20:00
BobZAnnapolisHey folks - am trying to use openstack-ansible YOGA  to install Ceilometer and am encountering the following error #bvp83hX01xQgYX2gIDfd - looks like the systemd-python packages located at https://pypi.org/simple/systemd-python/ don't meet what ceilometer needs :-( thoughts on successful workarounds would be appreciated, tia21:15
BobZAnnapolishttps://paste.openstack.org/raw/bvp83hX01xQgYX2gIDfd/ 21:16
jrosserBobZAnnapolis: does the wheel build log from the repo server give any more information?21:41
jrosserto me it looks like one of the tools needed to build systemd-python is missing21:44
BobZAnnapolisjrosser : thanks for the response, lemme go check21:49
*** dviroel|afk is now known as dviroel22:01

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!