Thursday, 2021-09-23

*** anbanerj|ruck is now known as frenzy_friday07:08
*** rpittau|afk is now known as rpittau07:30
noonedeadpunkjrosser: we need to do smth with zun and katacontainers feature. Because seems like kata has discontinued deb packages for kata>1.12 at all07:48
noonedeadpunkalternatives are either snap or download/unpack/symlink releases from https://github.com/kata-containers/kata-containers/releases07:51
noonedeadpunkboth suck kind of07:53
jrosseri would be quite worried about running virt type stuff thats installed as a snap08:41
yasemindhi, I use stable/victoria (22.1.0) version at OSA, I want to change magnum service version to stable/wallaby. I changed magnum version to wallaby in repo-packeges file and os-magnum role to stable/wallaby. After I run openstack-ansible os-magnum-install.yml command, it gave an error like https://paste.opendev.org/show/809530/  and these are python08:44
yasemindvenv logs-> https://paste.opendev.org/show/809529/ . Is there anything to do,  which I missed ?08:44
jrosseri don't think you can change the version of a role to wallaby and expect that to work on a victoria deployment08:50
jrosseryou will have better chances just updating the magnum version in repo-packages and using the victoria version of the ansible role08:50
yasemindthanks jrosser I tired and it worked 09:00
thelounge05Hmm just realized you can give neutron bridge mappings in addition to interface mappings. https://docs.openstack.org/neutron/latest/configuration/linuxbridge-agent.html#linux-bridge09:52
thelounge05dont think "bridge_mappings" variable is implemented in OSA though09:52
thelounge05has anyone tried this?09:52
thelounge05relevant OSA part: https://github.com/openstack/openstack-ansible-os_neutron/blob/master/templates/plugins/ml2/linuxbridge_agent.ini.j209:53
*** thelounge05 is now known as fresta09:56
*** fresta is now known as Guest75509:57
*** Guest755 is now known as fresta09:59
admin1if we provide ssl cert, is "openstack-ansible certificate-authority.yml"  still required ? or does rabbitmq also uses the provided certs 09:59
jonheradding a new compute-node on wallaby, running os-nova-install.yml with "--tags nova-key --limit nova_compute" errors out with "Group nova does not exist". the group is only created on "nova-group" tag12:18
jonhershoud nova-key and nova-user be added here? https://github.com/openstack/openstack-ansible-os_nova/blob/stable/wallaby/tasks/nova_pre_install.yml#L2212:19
jonherfor now i just ran with --tags nova-group   before running with nova-key as the documentation for adding a new node suggests, but since the group should be created first we should either have users run the nova-group first then nova-key, or change so that it includes the group from user creation12:22
jonher^ ignore the above, seems like there are some local changes causing that12:36
spatelnoonedeadpunk question related upgrade, during upgrade if i don't want to touch ceph then any easy way to ignore that?13:19
noonedeadpunkyou will need to touch ceph-client side anyway13:21
spatelceph-client are compute right?13:21
spatelall i am trying to do is not touch storage part and just upgrade openstack only13:21
noonedeadpunknot only - also cinder and glance13:22
spatelthat is ok but i don't want to upgrade ceph :)13:22
noonedeadpunkif you use run_uograde script - there's no easy way13:22
noonedeadpunkbut if you run manually - just don't run playbooks13:22
spateli had bad days in past with ceph so trying to do less impact in production13:22
spatelgood idea.. i can remove all ceph hooks from setup-openstack.yml 13:23
spatelofc manual upgrade one by one.. i am not going to do all in single shot  13:23
noonedeadpunkjonher: well eventually, you run with `--tags nova-key` with second run after setup-openstack is finished13:25
noonedeadpunkThen group and everything should be already in place and everything you need is to distribute keys13:25
noonedeadpunkbtw we also have a script nowadays:) https://opendev.org/openstack/openstack-ansible/src/branch/master/scripts/add-compute.sh#L33-L3713:26
jonherit worked out and compute node is added13:26
noonedeadpunkand you can define PRE_OSA_TASKS and POST_OSA_TASKS env vars if needed13:26
mgariepythe client part and the server part in ceph are not too picky (you can have older clients and it will continue to work)13:53
noonedeadpunkor newer clients as well13:53
spatelnoonedeadpunk why this command always break at TASK [Clone git repos (parallel) ?  ${SCRIPTS_PATH}/bootstrap-ansible.sh14:12
spatelis there any good solution to make it clean ?14:12
noonedeadpunkdunno. need to look at specific example14:13
spateli always go and change depth to 100 to just make it work 14:13
spatelTASK [Clone git repos (with git)] is clean so should i ignore that error 14:14
spatelThis snippet failing - https://paste.opendev.org/show/809535/14:15
spatelcan i ignore that RED error because ? noonedeadpunk 14:16
spatelMay be this is the issue role_clone_default_depth 14:18
noonedeadpunkum, and don't you have shallow_since yet for ceph-ansible?14:18
spatelwhat is that?14:18
noonedeadpunkhttps://opendev.org/openstack/openstack-ansible/src/branch/stable/wallaby/ansible-role-requirements.yml#L28114:18
spatelwhere should i put it ?14:18
noonedeadpunkbecause if it's about depth - this should have fixed it14:19
spateli do have shallow_since: '2021-09-08' 14:20
spateli am upgrading V to W 14:20
spatelstill getting error even after shallow_since:14:20
noonedeadpunkany output of failed parallel clone?14:20
spatelQuestion, is it safe to ignore or i should do something to fix it?14:20
spatellet me send you14:20
noonedeadpunkit's safe to ignore if Clone git repos (with git) is ok14:21
spatelgit is all Green 14:21
noonedeadpunkdamn... then we have some bug there I don't see....14:21
spatelnoonedeadpunk here is the full error - https://paste.opendev.org/show/809536/14:23
spateli don't know why do we need two method to pull repo? why don't we just remove it 14:23
noonedeadpunk'fatal: error in object: unshallow 24a62dc18613e732faade80efcf8c3408b0ecf68\nfatal: the remote end hung up unexpectedly' huh14:24
noonedeadpunkbecause old one is 10 times slower14:25
spatelClone git repos (with git) is slow ?14:25
noonedeadpunkyep14:25
noonedeadpunkbut parallel seems still buggy...14:25
spateli didn't see that.. it took 2 min around to finish it 14:25
spatel2 minute doesn't matter :) 14:25
noonedeadpunkyou was upgrading from where to where?14:26
spatelV to @ 14:26
spatelV to W14:26
noonedeadpunkstab/ev or ?14:26
spatel22.1.2 to 23.1.1 14:26
noonedeadpunkaha14:26
spatelany issue?14:26
noonedeadpunklet me try to reproduce14:26
spatelyou can test that out but i am going to ignore and continue my upgrade hope no more bug :) 14:26
noonedeadpunkeventually if we fail new method we just fallback to old one.14:27
spatelnoonedeadpunk is ceph_all valid group name?14:36
spatelplanning to so --limit '!ceph_all'14:37
noonedeadpunknever used ceph-ansible in prod14:37
spatelwhat do you use?14:37
noonedeadpunkused ceph-deploy or manual setup14:37
spatelhmm 14:38
noonedeadpunkI'm scary of running ansible against ceph, but it's just me:)14:38
noonedeadpunkwe actually use nowadays ceph-ansible but it's in use by differeent team14:38
spateloh okay14:39
noonedeadpunkbased on https://opendev.org/openstack/openstack-ansible/src/branch/master/inventory/env.d/ceph.yml ceph_all is valid thing14:40
spateli have 200 compute nodes it will take hell of time to upgrade openstack :(14:40
spatel+1 thanks14:40
noonedeadpunkbut I think it might fail14:40
admin1ceph-ansible works good  noonedeadpunk  .. and you can import existing ceph ansible, decouple it from osa and then you can manage them independently 14:41
spatelnoonedeadpunk do you guys upgrade openstack in ever release in production?14:41
noonedeadpunkadmin1: yeah we manage it independently14:41
noonedeadpunkspatel: limiting without ceph_all will most likely fail on ceph-client14:41
noonedeadpunkin case you use ceph-mon to get ceph.conf14:42
noonedeadpunkbecause you might be not able to run there... but not 100% sure14:42
spatelhmm why it will fail ?14:42
spatelcurrently running setup-host across my cloud14:43
noonedeadpunkI'm not sure if this limit will avoid this from running or not https://opendev.org/openstack/openstack-ansible-ceph_client/src/branch/master/tasks/ceph_get_keyrings_from_mons.yml#L2614:44
spateli will run on single node to check before running across the world 14:45
noonedeadpunkhm... parallel git clone hasn't failed for me....15:01
noonedeadpunkso, I bootstrapped 22.1.2, then checkout to 23.1.1, bootstrapped, Clone git repos (parallel) not failed....15:13
spatelhmmm 15:25
noonedeadpunkwell, I can imagine things fail when tree of roles is not clean....15:37
noonedeadpunkwill check that...15:37
spatelcool 15:40
spatelany idea how do i remove ovs config option? i want to remove vhost-sock-dir but not able to find command 15:40
spatelovs-vsctl clear Open_vSwitch . other_config:vhost-sock-dir 15:40
spatelclear didnt work15:41
spatelthis works - ovs-vsctl remove Open_vSwitch . other_config vhost-sock-dir vhost_sock15:43
*** rpittau is now known as rpittau|afk16:02
dmsimardFYI, this is going to be my last reminder about it because I don't mean to spam but AnsibleFest and Ansible Contributor Summit are next week and there is still time to sign up -- it's free and virtual: https://www.ansible.com/ansiblefest && https://www.eventbrite.com/e/ansible-contributor-summit-202109-tickets-16766495539518:39

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!