Monday, 2019-10-21

*** nicolasbock has joined #openstack-ansible00:26
*** nicolasbock1 has joined #openstack-ansible00:26
*** nicolasbock has quit IRC00:30
*** nicolasbock1 is now known as nicolasbock00:30
*** born2bake has quit IRC00:31
*** cshen has joined #openstack-ansible00:36
*** cshen has quit IRC00:40
*** d34dh0r53 has quit IRC00:51
*** cloudnull has quit IRC00:52
snadgeis there a way to override the download location for the EPEL repository?00:58
snadgeif it uses the default download.fedoraproject.org .. it could end up using one of very many mirrors, which is difficult to whitelist00:59
*** nurdie has quit IRC01:05
*** hamzy_ has quit IRC01:33
*** nurdie has joined #openstack-ansible01:39
*** nurdie has quit IRC01:44
*** nurdie has joined #openstack-ansible02:13
*** nurdie has quit IRC02:18
*** nurdie has joined #openstack-ansible02:22
*** grumbert has quit IRC02:23
*** spsurya has joined #openstack-ansible02:32
*** nurdie has quit IRC03:13
*** nurdie has joined #openstack-ansible03:13
*** nurdie has quit IRC03:18
*** radeks has joined #openstack-ansible03:19
*** nicolasbock has quit IRC03:23
*** radeks has quit IRC03:59
snadgeim getting lxc containers failed to start.. but it doesn't appear to be overwriting the log files in /var/log/lxc04:18
snadgeis there a way to reset the lxc container state.. without blowing everything away and starting again04:18
snadgelxc-destroy -n seems to do the job04:21
*** cshen has joined #openstack-ansible04:40
*** cshen has quit IRC04:45
*** cshen has joined #openstack-ansible04:56
*** cshen has quit IRC05:01
*** dave-mccowan has quit IRC05:08
*** jhesketh has quit IRC05:11
*** markvoelker has joined #openstack-ansible05:21
*** markvoelker has quit IRC05:26
jrossersnadge: there is a playbook for destroying containers and their associated data06:27
jrosserhttps://github.com/openstack/openstack-ansible/blob/master/playbooks/lxc-containers-destroy.yml06:28
snadgei'll check that out.. my next problem is.. the bootstrap aio takes care of creating all the network interfaces etc.. in particular br-mgmt06:30
snadgeim just trying to go one step beyond that very basic configuration, and have 5 physical vms that I want to do an install on, but only really the management or primary interface needs to work06:30
jrosserfor the yum repo thing, the internet suggests “In the files in /etc/yum.repo.d/*.repo , use baseurl instead of mirrorlist.”06:31
snadgeyeah the problem is the EPEL repo is added by ansible during the setup hosts playbook06:33
snadgethat was something i was going to look at, as well.. to see if a config can override that, for the moment i just edited the file immediately after it gets deployed, and before it installs from it06:34
jrosserthe ansible module appears to understand mirrorlist/baseurl https://docs.ansible.com/ansible/latest/modules/yum_repository_module.html06:35
jrossertbh my systems are pretty much entirely Ubuntu, if you have chance to try out some of those yum_repository options we could make a patch06:36
jrosserfor going beyond an AIO to multiple VM it’s now up to you how you want the networking to be06:37
jrosserthe only requirement is that the necessary br-* bridges exist when the config is done06:37
jrossercould be done with multiple interfaces / vlans / whatever you like06:38
jrossersnadge: look here https://github.com/openstack/openstack-ansible-openstack_hosts/blob/master/tasks/openstack_hosts_configure_yum.yml#L7306:40
jrosserif you find where openstack_hosts_package_repos is defined, and you want to get rid of any mirrorlist setup, override that variable with just the fields that you want06:42
jrosserwell that’s not epel - but you get the idea06:44
snadgeexcellent.. yeah.. my AIO example uses ubuntu 18.04, but production was RHEL 7, but will likely be Centos 7, unless there's a reason to go newer06:49
*** ianychoi has quit IRC06:51
*** jbadiapa has joined #openstack-ansible06:52
*** ianychoi has joined #openstack-ansible06:54
*** gokhani has joined #openstack-ansible07:01
snadgei've made a note of that, and will sort it out tomorrow. thanks :)  (yay AU timezone)07:02
*** jbadiapa has quit IRC07:08
*** tosky has joined #openstack-ansible07:14
*** pcaruana has joined #openstack-ansible07:16
*** jbadiapa has joined #openstack-ansible07:21
*** miloa has joined #openstack-ansible07:29
*** cshen has joined #openstack-ansible07:29
miloaMorning07:29
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: [WIP] Centos-8 support  https://review.opendev.org/68962907:42
openstackgerritBernd Mueller proposed openstack/ansible-hardening master: changed disable dccp conf for preventing kernel messages  https://review.opendev.org/68968207:43
openstackgerritBernd Mueller proposed openstack/ansible-hardening master: changed disable dccp conf for preventing kernel messages  https://review.opendev.org/68968207:48
*** rpittau|afk is now known as rpittau07:51
*** lkoranda has joined #openstack-ansible07:56
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: [WIP] Centos-8 support  https://review.opendev.org/68962907:59
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible master: Imported Translations from Zanata  https://review.opendev.org/68968408:02
*** lkoranda_ has joined #openstack-ansible08:04
*** lkoranda has quit IRC08:06
*** DanyC has joined #openstack-ansible08:08
*** DanyC has quit IRC08:10
*** tosky_ has joined #openstack-ansible08:15
*** tosky_ has quit IRC08:15
*** tosky_ has joined #openstack-ansible08:15
*** tosky is now known as Guest3964008:16
*** tosky_ is now known as tosky08:16
*** DanyC has joined #openstack-ansible08:23
*** electrofelix has joined #openstack-ansible08:35
ebbexanyone else running into problems building networking-calico on the repo_containers? something about a mismatch between versions 3.8.4 and 3.9.208:36
*** vesper has joined #openstack-ansible08:40
*** vesper11 has quit IRC08:40
*** hamzy_ has joined #openstack-ansible08:41
CeeMacmorning08:42
jrosserebbex: sort of - i see a load of our CI jobs are broken with exactly the same thing08:53
*** kopecmartin has joined #openstack-ansible09:01
jrosserebbex: which branch are you deploying?09:01
taccoshort question regarding the secret_uuid. Do i have to UUID decode the key from the keyring or can i just generate "something" random ?09:05
taccobut first of all good morning everyone09:05
taccos/decode/encode/09:11
*** lkoranda has joined #openstack-ansible09:16
*** lkoranda_ has quit IRC09:16
ebbexjrosser: rocky. I've worked around it by going into networking-calico and running "git tag --annotate -m "Calico v3.9.2" --force 3.9.2"09:35
ebbexif you run "git describe" in the dir it reports back 3.8.4 but "git tag" reports a bunch of versions/tags after that release.09:36
*** openstackgerrit has quit IRC09:37
noonedeadpunkmornings09:44
noonedeadpunkoh, that doesn't look good... https://zuul.opendev.org/t/openstack/build/95c59b998d2947ebac4fd08cafe1400b/log/logs/openstack/aio1_repo_container-9cf59a00/repo/wheel_build.log.txt.gz#16209:48
noonedeadpunkso looks like we have broken rocky and queens09:52
jrossernoonedeadpunk: i think we use master version of networking-calico everywhere09:57
noonedeadpunkyep, that's true. but there's no change since last release in terms of sha...09:58
noonedeadpunkBut I guess new tags were added09:59
noonedeadpunkas 3.8.4 and 3.9.2 are made on the same commit09:59
noonedeadpunk(as well as all tags in between)10:01
miloanoonedeadpunk: Hi, I saw your comment on Change 671762, I will check Logan comments asap, but i am actually very busy, sorry. :)10:04
noonedeadpunkmiloa: yep, sure:) thanks:)10:04
noonedeadpunkwe may backport this into train later10:05
jrossernoonedeadpunk: is this the one which needs mnaser vote https://review.opendev.org/#/c/686573/ ?10:06
noonedeadpunkactually, that one will require it https://review.opendev.org/#/c/686581/ But if he's not agree with 686573, than updating 686581 has not so much sense10:08
noonedeadpunkebbex: yeah, our gates are also complaining about it... The things is that 3.8.4 and 3.9.2 are made against the same commit...10:10
jrossernoonedeadpunk: i wonder if that is just a mistake - those tags all being at the same point10:16
jrosserit looks very very strange indeed10:16
*** lkoranda_ has joined #openstack-ansible10:17
*** lkoranda has quit IRC10:19
ebbexWell, even if you check out master, you'll get an error on a version mismatch between 3.9.2 and 3.8.4, because it's looking at git to verify some version. Did they do something wrong in the tagging process?10:24
ebbex(setup.py that is.)10:24
*** lkoranda_ has quit IRC10:24
jrosserfrom a git point of view nothing stops you attaching as many tags to a particular revision as you like10:25
ebbexwhy does git describe"10:25
ebbexwhy does "git describe" return 3.8.4 on master though?10:25
jrosserwell, thats the thing, i guess a tag is just that, a tag, it doesnt convey any meaning as far as git is concerned10:26
jrosserand i expect that pbr is making an assumption that there is only one tag10:27
ebbexi force updated the tag to 3.9.2 and everything worked as normal. (I don't know if 'annotate' is/was important in that step.)10:28
jrosserebbex: by a bit of random experimenting here whichever tag was last modified seems to be the one returned by git describe when there are several at the same position in the history10:31
noonedeadpunkmaybe we should point to tag at this point instead of sha?10:32
noonedeadpunkat least for the calico10:32
jrosseri'm not sure if that will help, becasue the stack trace comes from inside pbr?10:32
ebbexIs this the bug we're experiencing? https://bugs.launchpad.net/pbr/+bug/145399610:38
openstackLaunchpad bug 1453996 in PBR "multiple tags of the same commit have non-deterministic results" [High,Triaged]10:38
jrosserit looks very much like it10:40
ebbexIt's been a known issue for ~4 years, still not solved. Yikes.10:42
jrosseryou can sort of show when the tags were updated10:43
jrossergit log --tags --simplify-by-decoration --pretty="format:%ai %d"10:43
jrosserbut there still seems to be an inner ordering of all of the ones at HEAD10:44
*** lkoranda has joined #openstack-ansible10:51
noonedeadpunkhm, interestingly how they had created tags https://opendev.org/openstack/releases/src/branch/master/deliverables/_independent/networking-calico.yaml10:57
ebbexI updated the pbr bug-report, any of you wanna chime in on it?11:00
*** openstackgerrit has joined #openstack-ansible11:01
openstackgerritMerged openstack/openstack-ansible master: Imported Translations from Zanata  https://review.opendev.org/68968411:01
*** lkoranda has quit IRC11:07
*** markvoelker has joined #openstack-ansible11:10
*** trident has quit IRC11:11
*** trident has joined #openstack-ansible11:15
*** markvoelker has quit IRC11:16
noonedeadpunkI guess we should run update-alternatives to set default python now...11:17
openstackgerritBernd Mueller proposed openstack/ansible-hardening master: changed disable dccp conf for preventing kernel messages  https://review.opendev.org/68968211:18
noonedeadpunkIn terms of "/bin/sh: /usr/bin/python: No such file or directory" https://openstack.fortnebula.com:13808/v1/AUTH_e8fd161dc34c421a979a9e6421f823e9/zuul_opendev_logs_ad3/689629/10/check/openstack-ansible-deploy-aio_metal-centos-8/ad37079/job-output.txt11:18
*** goldyfruit has quit IRC11:26
*** lkoranda has joined #openstack-ansible11:33
*** strobelight has joined #openstack-ansible11:48
*** mgariepy has joined #openstack-ansible11:51
*** markvoelker has joined #openstack-ansible11:59
jrossernoonedeadpunk: heres what update-alternatives says on centos-8 http://paste.openstack.org/show/785356/12:00
noonedeadpunklol /usr/libexec/no-python12:00
jrosserwhich is "echo "Run: man unversioned-python""12:01
noonedeadpunkmaybe we can do smth like "update-alternatives --install /usr/bin/python python /usr/bin/python3.6"?12:02
jrosseri did locally just hack that to python3 where that job failed12:02
jrosserthere was a fairly long discussion about this on the ML recently12:02
noonedeadpunkoh, I've missed it12:03
jrosserhere http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010146.html12:04
*** kopecmartin has quit IRC12:05
*** kopecmartin has joined #openstack-ansible12:06
*** nicolasbock has joined #openstack-ansible12:13
selvakumarnmsHi All , can you please help me in how to configure HA proxy & keepalived for the openstack controller nodes? Is there any sample inventory I can refer? do let me know.12:15
jrosserselvakumarnms: there are a few reference examples in the openstack-ansible repo, like this for the config https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.prod.example12:19
jrosserand this for the user_variables.yml https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/user_variables.yml.prod.example12:20
selvakumarnmscan we have two  haproxy_hosts? also can it be different than shared-infra_hosts or os-infra-hosts?12:20
jrosserbut it is almost certain that you need to customise these for your environment12:20
jrosseryes it is, in fact I have dedicated haproxy nodes in my environment12:20
selvakumarnmsthanks #jrosser12:20
jrosserselvakumarnms: in the example config the haproxy nodes are here https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.prod.example#L105-L11112:23
jrosserbut you can define them to be a different set of hosts if you need to12:23
selvakumarnmsthanks jrosser I will refer and configure. 172.29.236.12 is the container ip I have to give or host physical ips?12:25
jrossereverything you see in openstack_user_config like that is physical host IP12:26
jrosserthe container IP are allocated dynamically by the openstack-ansible dynamic inventory script12:26
jrosserto keep things simple the reference configs also assmune that the openstack management network is the one that use also use for your deploy host and to ssh to the physical servers12:27
selvakumarnmsokay cool.12:27
jrosserbut again openstack-ansible doesnt require that, and if you want a specific network for the bare metal that is also possible12:28
selvakumarnmsI am using physical host for deploying openstack.   what is vip IP do I need to give? unused IP from the physical hosts?12:29
selvakumarnmsI mean internal vip or external vip12:30
jrosserthe internal VIP should be one of the addresses out of the 'used_ips' range for the openstack management network12:30
jrosserthe external one is up to you as you need to provide your own external network12:30
selvakumarnmsso basically unused ip address?12:33
jrosserin fact exactly like this https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.prod.example#L1412:33
jrosserselvakumarnms: which one, the internal or external?12:33
selvakumarnmsinternal12:34
selvakumarnmsthanks again for the rerference link12:34
jrosserit should be one from this range (or equivalent in your environment) https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.prod.example#L812:34
jrosserthose ip are reserved for the bare metal hosts mgmt interface IP12:34
jrosserand also for whatever routers/gateways physical networking equipment you may need12:35
jrosserthe rest of the IP outside the reserved range are allocated randomly to containers by openstack-ansible12:35
selvakumarnmsok got it. How to specify other used IPs(physical hosts) from the same network in the inventory? can I also mention in used_ips?12:40
jrosserdo you have a dedicated subnet for this?12:41
noonedeadpunkjrosser: ebbex logan- seems like calico is generaly broken now http://paste.openstack.org/show/785357/12:42
selvakumarnmsyes for example I have another hosts also in the same subnet. so I dont want to take away that ip by openstack-ansible12:42
jrosserso you should specify everything that you don't want OSA to touch in used_ips12:42
arxcruzodyssey4me: https://github.com/ansible/ansible-lint/issues/59512:43
noonedeadpunkI'm really wondering how did they made these tags...12:44
selvakumarnmsok thanks jrosser for your help12:44
jrosserselvakumarnms: i would recommend having a good block of addresses available, even for a modest lab /24 felt a bit small for mgmt network12:46
selvakumarnmsyes I do agree12:46
jrossernoonedeadpunk: i am wondering if networking-calico is still an official openstack deliverable12:47
noonedeadpunkhm, I guess that everything under https://opendev.org/openstack/ should use deliverables?12:47
jrosserit doesnt seem to be here https://opendev.org/openstack/governance/src/branch/master/reference/projects.yaml12:48
noonedeadpunkthat's true. I just don't know the way of managing repos under openstack without releases12:49
jrossernoonedeadpunk: https://review.opendev.org/#/c/659337/4/RELEASING.md12:50
*** DanyC has quit IRC12:52
jrosserlooks like they have some kind of independant release process there12:55
noonedeadpunkYep, but still don't undertand it... As I'd dropped some tags from it...13:01
noonedeadpunkSubmitted bug report https://bugs.launchpad.net/networking-calico/+bug/1849110.13:01
openstackLaunchpad bug 1849110 in networking-calico "Tagging several versions on a single commit breaks installation" [Undecided,New]13:01
noonedeadpunklogan-: I can recall that you had some slack channel of calico folks? Can you reach them regarding ^?13:01
noonedeadpunkAs I guess master is also broken13:02
jrosserbecasue the repo build works differently i think we will only see that on the neutron role?13:02
noonedeadpunkI guess yes13:03
noonedeadpunkI mean that I didn't check neutron role, but yes - we wouldn't see it anywhere else13:04
noonedeadpunkmnaser: can you kindly check https://review.opendev.org/#/c/689145/ as it should do db migration for placement?13:14
*** DanyC has joined #openstack-ansible13:14
*** strobelight_ has joined #openstack-ansible13:15
*** strobelight is now known as Guest7678413:15
*** strobelight_ is now known as strobelight13:16
*** lkoranda has quit IRC13:17
*** Guest76784 has quit IRC13:18
*** lkoranda has joined #openstack-ansible13:19
*** lkoranda has quit IRC13:23
*** michielp has quit IRC13:25
*** dave-mccowan has joined #openstack-ansible13:28
*** lkoranda_ has joined #openstack-ansible13:28
*** nurdie has joined #openstack-ansible13:28
*** goldyfruit has joined #openstack-ansible13:32
*** lkoranda has joined #openstack-ansible13:32
*** nurdie has quit IRC13:33
*** lkoranda_ has quit IRC13:34
*** hamzaachi has joined #openstack-ansible13:36
noonedeadpunkfolks, can someone review https://review.opendev.org/#/c/679245/ one more time?13:50
noonedeadpunkoh, for the first time:)13:51
jrosserhmm 6 weeks ago13:52
jrosserthe logs are gone :)13:52
openstackgerritkourosh vivan proposed openstack/openstack-ansible-lxc_hosts stable/stein: Add Centos GPG key custom url  https://review.opendev.org/68910313:53
*** cshen has quit IRC14:11
*** ianychoi has quit IRC14:21
*** dmsimard1 is now known as dmsimard14:26
*** spatel has joined #openstack-ansible14:28
*** ianychoi has joined #openstack-ansible14:29
*** nurdie has joined #openstack-ansible14:35
*** nurdie_ has joined #openstack-ansible14:38
*** nurdie has quit IRC14:40
*** macz has joined #openstack-ansible14:54
*** lkoranda has quit IRC14:56
*** goldyfruit has quit IRC15:08
*** goldyfruit has joined #openstack-ansible15:08
*** goldyfruit has quit IRC15:09
*** nurdie_ is now known as nurdie15:09
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_manila master: PDF Documentation Build tox target  https://review.opendev.org/68982015:25
*** trident has quit IRC15:29
mgariepythe logs from the last run are gone, but the logs from aug 29 are not.. that's kinda weird (https://review.opendev.org/#/c/679245/)15:32
*** trident has joined #openstack-ansible15:32
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_manila master: service_setup: refactor service setup to a single file  https://review.opendev.org/68982415:35
noonedeadpunkyep, let's recheck15:35
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add cloudkitty and zun to a-r-r  https://review.opendev.org/68982815:39
*** ianychoi has quit IRC15:43
*** ianychoi has joined #openstack-ansible15:44
*** markvoelker has quit IRC15:46
*** markvoelker has joined #openstack-ansible15:49
*** nurdie has quit IRC15:54
*** nurdie has joined #openstack-ansible15:58
noonedeadpunkrgh, cirros again fails...16:03
*** mgariepy has quit IRC16:06
logan-noonedeadpunk: yep, i'll ping on their slack, i did test out making a new commit and tag and it seemed to make pbr happy again, so it seems like it'll be pretty easy to fix that up16:08
jrossernoonedeadpunk: i was thinking about that patch again for cirros16:08
jrosserand it might be nicer if we use stat in the os_tempest role to check if it is already downloaded16:08
jrosseri wasnt too happy that my patch overrode the os_tempest defaults in a slightly not obvious way for CI tests16:09
*** hamzaachi has quit IRC16:09
*** mgariepy has joined #openstack-ansible16:10
noonedeadpunkyep, that's exactly what I've tried to do, but faced with some probem in it.16:11
noonedeadpunkbut more porblem is that your method will copy image on local filesystem when it can be omited.16:11
jrosserand i think the uri module will check the SHA too which is loads of IO for no reason16:12
*** hamzaachi has joined #openstack-ansible16:13
*** hamzaachi has quit IRC16:18
*** markvoelker has quit IRC16:23
*** nurdie has quit IRC16:24
*** nicolasbock has quit IRC16:26
noonedeadpunkjrosser: so I wanted to do smth like this http://paste.openstack.org/show/785372/ in https://opendev.org/openstack/openstack-ansible-os_tempest/src/branch/master/tasks/tempest_resources.yml#L32 but I finished up that I don't know how to map the stat result to tempest_imagesall in all...16:30
noonedeadpunkand I'm not sure if list order is smth I can rely on16:30
noonedeadpunkto map results by their index16:31
*** macz has quit IRC16:31
*** macz has joined #openstack-ansible16:31
jrossernoonedeadpunk: probably with_together loop?16:32
noonedeadpunkand another option to use block/recover there16:32
noonedeadpunkyeah, maybe, but I'm not sure how good this idea is... It.s actually mapping by id inside list16:34
noonedeadpunkand another option was to use another block with rescue16:34
noonedeadpunkbut this will require 2 using 2 blocks and 2 delegates instead of 116:35
noonedeadpunkjust to do smth like try/except16:36
noonedeadpunkoh, there's always which is kinda finally I guess16:36
*** spsurya has quit IRC16:40
*** nurdie has joined #openstack-ansible16:45
noonedeadpunklol16:45
noonedeadpunkhttps://opendev.org/openstack/openstack-ansible/src/branch/master/tests/roles/bootstrap-host/templates/user_variables.aio.yml.j2#L216-L22716:46
*** nurdie has quit IRC16:49
noonedeadpunkso, generaly, real file download shouldn't occur...16:51
noonedeadpunk"if a checksum is passed to this parameter, and the file exist under the dest location, the destination_checksum would be calculated, and if checksum equals destination_checksum, the file download would be skipped"16:51
*** electrofelix has quit IRC16:56
*** miloa has quit IRC16:56
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_tempest master: Don't download image when it's already there  https://review.opendev.org/68984316:59
noonedeadpunkwondering if it will work... ^16:59
*** DanyC has quit IRC17:02
*** markvoelker has joined #openstack-ansible17:04
*** KeithMnemonic has joined #openstack-ansible17:05
*** nicolasbock has joined #openstack-ansible17:17
*** hamzaachi has joined #openstack-ansible17:28
*** hamzaachi has quit IRC17:29
bjoerntHey it seems OSA is not really suitable for 100% baremetal deployments as per https://bugs.launchpad.net/openstack-ansible/+bug/1847395. What is the feeling around this, should this be a option or we better to remove the support for baremetal entirely17:32
openstackLaunchpad bug 1847395 in openstack-ansible "Nova/Neutron Playbook run on baremetal disables keystone service" [Undecided,New]17:32
*** weifan has joined #openstack-ansible17:41
*** weifan has quit IRC17:41
*** weifan has joined #openstack-ansible17:41
*** weifan has quit IRC17:46
*** nurdie has joined #openstack-ansible17:46
jrosserbjoernt: there was a ton of effort put into bare metal co-installability during the last cycle17:46
bjoernttrain ?17:46
jrosserand there are real clouds running OSA on bare metal today, perhaps needing a large bunch of config overrides to achieve that17:47
jrosserbjoernt: yes but not addressing the specific thing you make a bug about though17:47
jrosseryou will see that the CI jobs for bare metal don’t include all components because this work is not yet complete17:48
bjoerntyes I have one engineer looking at that problem because there are cross roles issues between apache2, nginx-full and light17:49
bjoerntone role does turnoff /remove the package from the other17:49
jrosserfederation makes that complicated currently afaik17:50
*** tosky has quit IRC17:50
ThiagoCMCI can't wait to try OSA Train! Sorry about the buzz... I'm excited... lol17:50
*** weifan has joined #openstack-ansible17:53
cjloadersaw this similar thing in stein, had to manually rerun playbooks to keep services from going down17:55
cjloaderbjoernt:17:55
bjoerntyeah its an aspect of not all roles using the same wsgi service due to many reasons17:55
*** prometheanfire has quit IRC17:56
jrosserwell like I say the aio_metal scenario currently avoids these issues by removing components17:57
jrosserso extra work is needed to make that more complete17:57
*** prometheanfire has joined #openstack-ansible17:57
cjloaderso what you're saying is its not fully tested?17:58
bjoerntI check train and if there are still similar issues then I add a warning that those problems are known before making deployment choices17:59
jrossertrain is no different17:59
jrosserthere are a bunch of extra knobs to twiddle for what ports things bind to18:00
jrosserwhich is part of the story18:00
jrosserbut imho if you want to do a metal deployment with the same slickness that you can do lxc today, then a bunch of extra work needs contributing18:01
*** shananigans has joined #openstack-ansible18:06
jrosserbjoernt: noonedeadpunk and I have been slowly chipping away at the bare metal use case last cycle18:10
*** weifan has quit IRC18:10
jrosserbut there is still work to do so if you have effort to help complete that it would be great to accelerate it18:10
bjoerntYeah thats fine and appreciated perhaps we start thinking about a some docs what feature or what configuration is considered stable/tested to make those things more obvious18:12
*** canori01 has quit IRC18:13
*** weifan has joined #openstack-ansible18:14
*** weifan has quit IRC18:23
*** int-0x21 has joined #openstack-ansible18:27
*** weifan has joined #openstack-ansible18:31
*** goldyfruit has joined #openstack-ansible18:43
*** kopecmartin is now known as kopecmartin|off18:50
*** goldenfri has joined #openstack-ansible18:53
*** weifan has quit IRC18:55
*** DanyC has joined #openstack-ansible18:59
*** weifan has joined #openstack-ansible19:02
*** spatel has quit IRC19:04
*** weifan has quit IRC19:12
*** CeeMac has quit IRC19:15
*** weifan has joined #openstack-ansible19:17
*** DanyC_ has joined #openstack-ansible19:18
*** starborn has joined #openstack-ansible19:18
*** DanyC has quit IRC19:18
*** DanyC has joined #openstack-ansible19:19
*** weifan has quit IRC19:22
*** DanyC_ has quit IRC19:23
*** aedc has quit IRC19:26
*** gyee has joined #openstack-ansible19:29
*** DanyC has quit IRC19:30
*** weifan has joined #openstack-ansible19:33
*** schwicht has joined #openstack-ansible19:39
*** aedc has joined #openstack-ansible19:43
openstackgerritMerged openstack/openstack-ansible-os_manila master: PDF Documentation Build tox target  https://review.opendev.org/68982019:47
*** weifan has quit IRC19:59
openstackgerritMerged openstack/ansible-hardening master: changed disable dccp conf for preventing kernel messages  https://review.opendev.org/68968220:07
*** spatel has joined #openstack-ansible20:08
*** markvoelker has quit IRC20:11
*** markvoelker has joined #openstack-ansible20:12
*** weifan has joined #openstack-ansible20:14
*** weifan has quit IRC20:15
*** pcaruana has quit IRC20:16
*** weifan has joined #openstack-ansible20:29
*** shananigans has quit IRC20:32
*** dave-mccowan has quit IRC20:47
*** spatel has quit IRC20:51
*** nurdie_ has joined #openstack-ansible20:57
*** starborn has quit IRC20:58
openstackgerritMerged openstack/openstack-ansible-os_placement master: Add nova to placement DB migration  https://review.opendev.org/68914520:59
*** nurdie_ has quit IRC20:59
*** nurdie has quit IRC21:00
*** goldyfruit has quit IRC21:01
*** jralbert has joined #openstack-ansible21:10
*** tosky has joined #openstack-ansible21:10
jralbertI think this change breaks repo usage for CentOS/RedHat folks: https://review.opendev.org/#/c/608636/21:11
*** schwicht has quit IRC21:11
*** dave-mccowan has joined #openstack-ansible21:11
jralbertThe change to the lineinfile invocation against yum.conf specifies quotes around the url which the preceding release did not create, so the directive to remove the line "succeeds" but removes nothing, and the proxy line remains in place21:12
jralbertAs a result, when following the upgrade procedure, the apt-cacher-ng service is removed but the containers are all still configured to use it21:12
jralbertThe result is play failures in the galera upgrade step, and the first affected galera node being brought down and not brought back up21:13
jralbertThe regexp for the lineinfile invocation either needs to omit the quotes, or allow them to be an optional requirement if we really do believe some installations would have had them21:14
jralbertDo folks generally agree? If so I can propose a change21:14
*** DanyC has joined #openstack-ansible21:18
jrosserjralbert: looks like the ' got changed for " in the lineinfile21:24
*** markvoelker has quit IRC21:25
jrosserif you could test a fix and make a patch that would be great21:25
jralbert@jrosser the line as created by the queens installer includes no quotes, single or double21:25
jralbertAnd it's even worse than that: the decision to remove the caching service also misses that the percona yum repos also specify the proxy line21:26
jralbertso the galera upgrade is completely hosed, and it turns out the upgrade play goes ahead and actually removes the package before it establishes that a new one can be installed21:26
jrosseri really meant the ' vs " in the lineinfile tast21:26
jrosser*task21:26
jralbertThe single quotes in the pre-change version were for Ansible's benefit; the changed version moves to the heredoc syntax, and therefore doesn't need them, but the quotes are also moved to surround just the url21:29
jralbertIt's possible (likely?) that this issue will also apply to DNF-using hosts, though I don't have an installation to test that on21:30
jrosserwell please do make a patch, particularly if you are in a position to have somewhere to test it out21:33
*** goldyfruit has joined #openstack-ansible21:38
*** nurdie has joined #openstack-ansible21:40
*** DanyC has quit IRC21:43
*** DanyC has joined #openstack-ansible21:44
*** nurdie has quit IRC21:45
*** schwicht has joined #openstack-ansible22:00
*** goldyfruit has quit IRC22:01
*** dave-mccowan has quit IRC22:03
*** schwicht has quit IRC22:05
*** schwicht has joined #openstack-ansible22:06
*** openstackgerrit has quit IRC22:07
*** openstackgerrit has joined #openstack-ansible22:11
openstackgerritMerged openstack/openstack-ansible stable/stein: Bump SHAs for stable/stein  https://review.opendev.org/68965322:11
*** jhesketh has joined #openstack-ansible22:12
*** dave-mccowan has joined #openstack-ansible22:14
*** hwoarang has quit IRC22:19
*** hwoarang has joined #openstack-ansible22:20
*** schwicht has quit IRC22:37
*** nicolasbock has quit IRC22:45
*** weifan has quit IRC22:50
*** weifan has joined #openstack-ansible22:51
*** weifan has quit IRC22:54
*** macz has quit IRC22:54
*** macz has joined #openstack-ansible22:55
*** ianychoi has quit IRC23:00
*** ianychoi has joined #openstack-ansible23:00
*** weifan has joined #openstack-ansible23:03
*** DanyC has quit IRC23:05
redkriegHas anyone seen a case where a single hypervisor gets a "BadStatusLine" error when reaching out to the placement api?  I've done a complete reinstall and my playbooks have not changed from my other regions.  This is the only hypervisor in the region with the issue: http://paste.openstack.org/show/785456/23:08
*** ianychoi has quit IRC23:24
*** ianychoi has joined #openstack-ansible23:26
*** markvoelker has joined #openstack-ansible23:26
*** markvoelker has quit IRC23:30
*** tosky has quit IRC23:32
*** weifan has quit IRC23:57
*** weifan has joined #openstack-ansible23:57
*** weifan has quit IRC23:58
*** weifan has joined #openstack-ansible23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!