Thursday, 2021-08-05

*** rpittau|afk is now known as rpittau07:47
mgoddard#hashtag07:50
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/wallaby: Fix nova deployment failure when rabbitmq is disabled  https://review.opendev.org/c/openstack/kolla-ansible/+/80355408:24
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/victoria: Do not run timesync checks on deployment host  https://review.opendev.org/c/openstack/kolla-ansible/+/80355508:24
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/victoria: Fix freezed spice console in horizon  https://review.opendev.org/c/openstack/kolla-ansible/+/80355608:25
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/ussuri: Fix freezed spice console in horizon  https://review.opendev.org/c/openstack/kolla-ansible/+/80355708:25
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/victoria: Fix nova deployment failure when rabbitmq is disabled  https://review.opendev.org/c/openstack/kolla-ansible/+/80355808:27
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/ussuri: Fix nova deployment failure when rabbitmq is disabled  https://review.opendev.org/c/openstack/kolla-ansible/+/80355908:27
opendevreviewVerification of a change to openstack/kayobe master failed: Remove references to resolv.conf workaround  https://review.opendev.org/c/openstack/kayobe/+/80345909:46
kevkohi o/10:09
kevkois there a way to build xy images in binary and for example one in source ..in one batch (i mean kolla build ....)10:10
shyambHi10:37
shyambI want to get all eligible candidates of regular expression string. For ex: this string: 'compute[01:10].trilio.demo'10:37
shyambcandidates should be a list of string - ['compute01.trilio.demo', 'compute02.trilio.demo',...,'compute10.trilio.demo' ]10:38
shyambDoes python re module supports this?10:38
shyambI am not able to find suitable function to do this10:38
opendevreviewVerification of a change to openstack/kolla-ansible master failed: Check config when checking the containers  https://review.opendev.org/c/openstack/kolla-ansible/+/77324610:44
ug_egonI upgraded a (test) cluster from train to wallaby. Seems mostly fine but nova conductor is complaining: ERROR nova nova.exception.TooOldComputeService: Current Nova version does not support computes older than Victoria but the minimum compute service level in your system is 40 and the oldest supported service level is 52. Is that expected?11:21
kevkoug_egon: yeah, it is because kolla-ansible support only +1 version11:26
kevkoyou jumped +3 11:27
kevkofrom stein to ussuri it was OK because nova was RPC compatible ..11:27
kevkoyou had to upgrade at least victoria11:27
ug_egonOK, i see11:27
kevkoi was testing upgrade from ussuri -> wallaby and found this also ..11:28
ug_egonso the db migrations don't work all the way?11:28
kevkoif you upgrade placement and nova to victoria ..then all to wallaby ..it will be ok 11:28
ug_egonOK, thanks!11:30
kevkoug_egon: but I am not sure it this will be working if you have already upgraded 11:31
ug_egonWell, as it is just a test system, i could test ;-)11:32
kevkooh, then it will be working, I am sure11:32
kevkoug_egon: btw, could you restart all nova components on controllers ? 11:32
ug_egonyes... will do11:37
ug_egonkevko Restarting all nova components (or all components) does not seem to have an effect.11:49
kevkoug_egon: i thought .. :/11:49
kevkoug_egon: i would like to see how it can be fixed manually 11:50
kevkoug_egon: but didn't have to time to investigate11:50
kevkoyoctozepto: mgoddard: on some different environment (not openstack, not kolla) where OS is Ubuntu, it happened very annoying thing to us - security patch was released for docker package ..and Ubuntu OS's unattended upgrades downloaded and installed docker package which includes also restart docker service .. I think this should be forbidden in kolla-bootstrap ..or configurable .. that's dangerous i think ..what do you mean ? 12:00
kevko(because I've already checked if kolla-ansible do something with unattended upgrades on Ubuntu - and it doesn't )12:01
yoctozeptokevko: yeah, we can advise against unattended upgrades; and for all kinds of docker upgrades (attended too), I use live-restore in docker config to avoid the mega bounce12:02
yoctozeptothough beware becasue it is quirky; docker seems not to track properly all resources it has12:02
yoctozeptoI really root for podman support implementation12:03
kevkoyoctozepto: but is it enough to advise somewhere in documentation ? or add some if ubuntu && unattended_updates == 'False': place some apt config which disabling it on host and otherwise ?12:04
kevkoyoctozepto: podman +1 12:11
kevkoyoctozepto: btw, do you have 5 minutes just to reply in https://review.opendev.org/c/openstack/kolla/+/802685 ? Thanks 12:11
luk4sAfternoon all. I have noticed a problem with the use of symlinks in the kayobe environments kolla configs and was about to log an issue and submit a fix, but realised that there is already work happening on merging of the kolla configs.12:17
luk4sThis will most likely make the symlink issue irrelevant.12:18
yoctozeptokevko: some unattended upgrades are fine; e.g., keeping sshd in perfect shape is nice12:19
priteauluk4s: could still be useful for the current release12:21
yoctozeptokevko: just defaulting all kolla/system/service users to /var/lib/<service> makes sense to me; but do we need overrides? I thought /var/lib/<service> is the default for system users12:21
luk4sWhat's the best course of action here - shall I wait for the kolla configs merge work to complete and re-visit the issue then?12:21
priteauluk4s: I would say share details on a new storyboard report12:21
priteauhttps://storyboard.openstack.org/#!/project/openstack/kayobe12:21
luk4spriteau, thanks - I proceed then (and and the issue to the storyboard).12:23
yoctozeptokevko: replied to you here and on both changes; open to questions12:27
kevkoyoctozepto: replied also :) 12:29
yoctozeptokevko: ok; I don't think it makes much sense to create the tcpdump user anyway; no idea what's it for; we aren't using tcpdump as a service12:31
yoctozeptokill it with fire; create all important users12:31
kevkoyoctozepto: hmm, I think this is needed somewhere in masakari ..let me find it 12:32
kevkoor hacluster12:32
yoctozeptokevko: masakari calls tcpdump but it's not a service; it calls it as root12:34
yoctozeptomasakari-hostmonitor to be exact12:34
kevkoyoctozepto: yeah, sure, but tcpdump package is creating tcpdump user ..12:34
kevkohttps://github.com/openstack/masakari-monitors/blob/fe85b8debbd39de15e10e1c042f98fd771b3cfde/masakarimonitors/hostmonitor/host_handler/handle_host.py#L14912:34
kevkoso, if kolla's idea is create all users before package creates the user .. then it should be included in users ..as that user will be in system anyway12:36
yoctozeptoyeah, I am aware, but we can ignore it; the packages might decide to install new users that we don't use - we don't care12:37
yoctozeptohonestly, what's that user even for12:38
yoctozeptoah, the tcpdump binary drops to its perms to avoid running as full root12:39
kevkoyoctozepto: well, we should care in general..because actually that is issue with hacluster .. because hacluster user was not defined in kolla image .. package was installed in base and also in openstack-base ..but with different UID ..12:39
yoctozeptowell, the uid of that user is super irrelevant12:39
yoctozeptokevko: yes, but that's a different thing and that thing we want to fix12:40
yoctozeptomeh, tcpdump only really relies on the fact this user will have almost no access to filesystem12:40
yoctozeptoignore it, really12:40
kevkoyoctozepto: ok, what messagebus ? 12:41
kevkoi've just added what found in diff ..12:41
yoctozeptoignore too I guess, we are not running messagebus; I would assume some library pulls in some common stuff that creates this user12:41
kevkoroger that 12:42
ug_egonkevko: i can get servers to boot if i do a 'update services set version=52 where version=40;' on the nova DB. Nova does not like this though () . I'll destroy the test cluster and start fresh.12:55
kevkowill be better ..12:55
opendevreviewMichal Arbet proposed openstack/kolla master: Config: Set default home to /var/lib/{user}  https://review.opendev.org/c/openstack/kolla/+/80268512:59
opendevreviewMichal Arbet proposed openstack/kolla master: base/deb: bump 'system' groups limit beyond Kolla ones  https://review.opendev.org/c/openstack/kolla/+/80267612:59
opendevreviewMichal Arbet proposed openstack/kolla master: Add some system users to fix user uid inconsistencies  https://review.opendev.org/c/openstack/kolla/+/80267112:59
opendevreviewMichal Arbet proposed openstack/kolla master: base/deb: bump 'system' groups limit beyond Kolla ones  https://review.opendev.org/c/openstack/kolla/+/80267613:03
opendevreviewMichal Arbet proposed openstack/kolla master: Add some system users to fix user uid inconsistencies  https://review.opendev.org/c/openstack/kolla/+/80267113:03
opendevreviewRadosław Piliszek proposed openstack/kolla master: base/deb: bump 'system' groups limit beyond Kolla ones  https://review.opendev.org/c/openstack/kolla/+/80267613:51
opendevreviewRadosław Piliszek proposed openstack/kolla master: Add some system users to fix user uid inconsistencies  https://review.opendev.org/c/openstack/kolla/+/80267113:51
yoctozeptokevko: I untangled the deps ^ this stack should fix the issue13:51
yoctozeptojust need a few tweaks at the base level13:51
yoctozeptohashtags worky (hashtag:"partof-bugfix" OR  hashtag:"bugfix") (status:open OR status:merged)13:54
yoctozepto~> https://review.opendev.org/q/(hashtag:%2522partof-bugfix%2522+OR++hashtag:%2522bugfix%2522)+(status:open+OR+status:merged)13:54
yoctozeptonow need to standardise13:55
yoctozeptobut I see a potential here13:55
kevkoyoctozepto: now i don't understand your comment ..14:01
kevkoyoctozepto: you said you have no problem with default value /var/lib/service ..and now saying complicated without flexibility ? 14:01
kevkoyoctozepto: wait a minute ..have to reboot14:02
kevkohere14:04
yoctozeptokevko: you add some steps to allow for configuration but not enough when you can just feed it in the command directly14:08
yoctozeptoI will propose what I meant14:09
kevkook ..14:09
opendevreviewRadosław Piliszek proposed openstack/kolla master: Config: Set default home to /var/lib/{user}  https://review.opendev.org/c/openstack/kolla/+/80268514:10
yoctozeptokevko: clear now? :-)14:10
yoctozeptoI really think this is just making the default explicit14:11
kevkoaaaaa14:12
kevko:D 14:12
opendevreviewRadosław Piliszek proposed openstack/kolla master: Config: Set default home to /var/lib/{user}  https://review.opendev.org/c/openstack/kolla/+/80268514:12
yoctozeptoupdated commit message14:12
yoctozeptowe can merge this; this is independent and functionally noop14:13
kevkohmm, how can I write unit test ? 14:14
yoctozeptohmm, good question; there should be some already14:15
kevkohonestly, I'm not good in it :D ..so I always trying to retrace some existing 14:15
kevkobut didn't find something for user 14:15
yoctozeptohmm14:16
yoctozeptolet me check14:16
yoctozeptoyup, there are none14:21
yoctozeptoso I can forgive you not writing the unit tests14:22
yoctozeptowhat else did I want there?14:22
yoctozeptoprobably a reno14:22
kevkoyeah14:25
kevkolet me do it 14:25
opendevreviewMerged openstack/kolla-ansible stable/wallaby: Do not run timesync checks on deployment host  https://review.opendev.org/c/openstack/kolla-ansible/+/79758414:37
opendevreviewMichal Arbet proposed openstack/kolla master: Config: allow to set group for user  https://review.opendev.org/c/openstack/kolla/+/80266314:50
opendevreviewMichal Arbet proposed openstack/kolla master: base/deb: bump 'system' groups limit beyond Kolla ones  https://review.opendev.org/c/openstack/kolla/+/80267614:50
opendevreviewMichal Arbet proposed openstack/kolla master: Add some system users to fix user uid inconsistencies  https://review.opendev.org/c/openstack/kolla/+/80267114:50
opendevreviewMichal Arbet proposed openstack/kolla master: Config: Set default home to /var/lib/{user}  https://review.opendev.org/c/openstack/kolla/+/80268514:50
kevkoyoctozepto: did I miss something ? 14:50
yoctozeptokevko: what do you mean?14:53
kevkoyoctozepto: reno added, added partial-bug and closes-bug to commits ..can u check 14:54
yoctozeptokevko: 2x +2, 2x -114:56
yoctozeptoperfectly balanced14:56
kevko:D 14:57
opendevreviewRadosław Piliszek proposed openstack/kolla master: Avoid the use of --force in groupadd  https://review.opendev.org/c/openstack/kolla/+/80361715:00
yoctozeptokevko: anyhow, TIL: https://review.opendev.org/c/openstack/kolla/+/80361715:01
yoctozeptothis will need a rebase on your patches but I pushed not to forget already15:01
opendevreviewMichal Arbet proposed openstack/kolla master: Add some system users to fix user uid inconsistencies  https://review.opendev.org/c/openstack/kolla/+/80267115:05
opendevreviewMichal Arbet proposed openstack/kolla master: Config: Set default home to /var/lib/{user}  https://review.opendev.org/c/openstack/kolla/+/80268515:05
opendevreviewMichal Arbet proposed openstack/kolla master: Avoid the use of --force in groupadd  https://review.opendev.org/c/openstack/kolla/+/80361715:05
kevkoyoctozepto: done, reno added ..15:05
opendevreviewMichal Arbet proposed openstack/kolla master: Config: Set default home to /var/lib/{user}  https://review.opendev.org/c/openstack/kolla/+/80268515:07
opendevreviewMichal Arbet proposed openstack/kolla master: Avoid the use of --force in groupadd  https://review.opendev.org/c/openstack/kolla/+/80361715:07
kevkoyoctozepto: groupadd: GID '65534' already exists << :D :D 15:35
yoctozeptokevko: interesting, where do we have it?15:35
yoctozeptoso we had a hidden bug15:35
kevkoyoctozepto: FROM quay.io/centos/centos:stream8  << 15:35
kevkoyoctozepto: for example https://zuul.opendev.org/t/openstack/build/e182b72ac9fb4f079255b14e85fb4557/log/kolla/build/000_FAILED_base.log 15:35
yoctozeptoducking mongodb15:36
yoctozeptomeh, we had a bug15:36
kevko:D 15:36
kevkoyoctozepto: why there is a comment ? # unused user (mongodb dropped), it should be removed from kolla no ? 15:38
kevkoit will small gap in uids sequence ..but it doesn't matter i guess15:39
yoctozeptokevko: we can reset the gid too15:41
yoctozeptoit is probably some cult value15:41
yoctozeptobecause it overlaps with the nobody user15:41
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Use native fluent-logger instead of tail  https://review.opendev.org/c/openstack/kolla-ansible/+/75577515:50
opendevreviewVerification of a change to openstack/kolla-ansible stable/ussuri failed: watcher: add missing become for copying configs  https://review.opendev.org/c/openstack/kolla-ansible/+/80328915:51
kevkoyoctozepto: hmm, can't it be a problem  15:56
kevko?15:56
yoctozeptokevko: dropping is fine15:57
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Use native fluent-logger instead of tail  https://review.opendev.org/c/openstack/kolla-ansible/+/75577515:58
* yoctozepto off16:02
opendevreviewMerged openstack/kayobe master: Remove references to resolv.conf workaround  https://review.opendev.org/c/openstack/kayobe/+/80345916:04
luk4spriteau, https://storyboard.openstack.org/#!/story/200910216:41
*** rpittau is now known as rpittau|afk16:41
luk4sLet me know if its worth pursuing the fix16:42
opendevreviewVerification of a change to openstack/kolla-ansible master failed: Check config when checking the containers  https://review.opendev.org/c/openstack/kolla-ansible/+/77324616:44
opendevreviewScott Shambarger proposed openstack/kolla master: monasca-thresh: Allow topology check and removal in storm  https://review.opendev.org/c/openstack/kolla/+/79275116:51
opendevreviewPiotr Parczewski proposed openstack/kolla master: Remove Prometheus v1 image  https://review.opendev.org/c/openstack/kolla/+/80363617:51
opendevreviewPiotr Parczewski proposed openstack/kolla-ansible master: Remove support for Prometheus v1  https://review.opendev.org/c/openstack/kolla-ansible/+/80364419:04
opendevreviewPiotr Parczewski proposed openstack/kolla-ansible master: Remove support for Prometheus v1  https://review.opendev.org/c/openstack/kolla-ansible/+/80364419:07
parallaxdopamine shots19:16
yoctozeptoalways :-)19:19
opendevreviewSeena Fallah proposed openstack/kolla-ansible master: tools/kolla-ansible: make configdir as an optional argument  https://review.opendev.org/c/openstack/kolla-ansible/+/80364820:02
opendevreviewVerification of a change to openstack/kolla-ansible master failed: Check config when checking the containers  https://review.opendev.org/c/openstack/kolla-ansible/+/77324620:03
-opendevstatus- NOTICE: The Gerrit service on review.opendev.org is going down for a quick restart to adjust its database connection configuration, and should return to service momentarily20:03
opendevreviewMerged openstack/kolla-ansible master: Check config when checking the containers  https://review.opendev.org/c/openstack/kolla-ansible/+/77324621:01

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!