Monday, 2019-01-07

*** cshen has quit IRC00:05
*** cshen has joined #openstack-ansible00:11
*** cshen has quit IRC00:16
*** cshen has joined #openstack-ansible00:16
*** cshen has quit IRC00:21
*** cshen has joined #openstack-ansible00:25
*** mathlin_ has joined #openstack-ansible00:35
*** cshen has quit IRC00:41
*** dcdamien has quit IRC00:54
*** mathlin_ has quit IRC01:09
*** cshen has joined #openstack-ansible01:10
*** chason has joined #openstack-ansible01:19
*** cshen has quit IRC01:24
*** hwoarang_ has joined #openstack-ansible01:33
*** hwoarang has quit IRC01:34
*** mathlin_ has joined #openstack-ansible01:59
*** cshen has joined #openstack-ansible02:21
*** cshen has quit IRC02:26
*** mathlin_ has quit IRC02:33
*** shyamb has joined #openstack-ansible02:37
*** mathlin_ has joined #openstack-ansible02:56
openstackgerritinspurericzhang proposed openstack/openstack-ansible-specs master: [Trivial Fix] dumplicate words was deleted in developer-docs.rst  https://review.openstack.org/62884003:03
*** ArchiFleKs has quit IRC03:04
*** ArchiFleKs has joined #openstack-ansible03:06
*** hwoarang has joined #openstack-ansible03:10
*** hwoarang_ has quit IRC03:12
*** shyamb has quit IRC03:15
*** shyamb has joined #openstack-ansible03:16
*** cshen has joined #openstack-ansible03:19
*** cshen has quit IRC03:25
*** mathlin_ has quit IRC03:30
openstackgerritMerged openstack/openstack-ansible-specs master: [Trivial Fix] dumplicate words was deleted in developer-docs.rst  https://review.openstack.org/62884003:51
*** mathlin_ has joined #openstack-ansible03:53
*** shyamb has quit IRC04:18
*** shyamb has joined #openstack-ansible04:21
*** mathlin_ has quit IRC04:27
*** shyamb has quit IRC04:30
*** udesale has joined #openstack-ansible04:33
*** cshen has joined #openstack-ansible04:40
*** cshen has quit IRC04:45
*** mathlin_ has joined #openstack-ansible04:50
*** cshen has joined #openstack-ansible05:05
*** cshen has quit IRC05:12
*** cshen has joined #openstack-ansible05:15
*** cshen has quit IRC05:20
*** radeks_ has joined #openstack-ansible05:21
*** radeks_ has quit IRC05:22
*** radeks_ has joined #openstack-ansible05:22
*** mathlin_ has quit IRC05:24
*** cshen has joined #openstack-ansible05:39
*** shyamb has joined #openstack-ansible05:40
*** shyamb has quit IRC05:48
*** cshen has quit IRC05:50
*** cshen has joined #openstack-ansible05:52
*** cshen has quit IRC06:00
*** hwoarang_ has joined #openstack-ansible06:02
*** hwoarang has quit IRC06:03
*** cshen has joined #openstack-ansible06:03
*** shyamb has joined #openstack-ansible06:05
*** cshen has quit IRC06:09
*** mathlin_ has joined #openstack-ansible06:13
*** mathlin_ has quit IRC06:47
*** mathlin_ has joined #openstack-ansible07:10
*** DanyC has quit IRC07:17
*** kopecmartin|off is now known as kopecmartin07:21
*** cshen has joined #openstack-ansible07:30
*** mathlin_ has quit IRC07:45
*** tosky has joined #openstack-ansible07:45
*** shyamb has quit IRC07:50
*** mathlin_ has joined #openstack-ansible08:07
*** pcaruana has joined #openstack-ansible08:14
*** jawad_axd has joined #openstack-ansible08:21
*** pcaruana has quit IRC08:24
jawad_axdHi all, I have openstack-ansible setup and Tenant user is unable to change its password from horizon, while it works fine from cli. Although, admin user can change password from horizon. It should be a small change somewhere,Any suggestions ?08:32
*** cshen has quit IRC08:34
*** mathlin_ has quit IRC08:42
fnpanichi08:43
*** pcaruana has joined #openstack-ansible08:46
*** shyamb has joined #openstack-ansible08:53
*** cshen has joined #openstack-ansible08:55
*** thuydang has joined #openstack-ansible08:56
odyssey4memnaser using fluentd sounds nice - I wonder if it'd be possible to store the raw logs in logstash, then process them asynchronously with logstash afterwards to extract anything useful08:59
odyssey4meMorning everyone - I hope y'all had a great seasonal break, like I did. :)09:00
chandankumarodyssey4me: \o/ & Happy New year :-)09:00
*** cshen has quit IRC09:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Ensure that control plane hosts are also updated correctly  https://review.openstack.org/62589809:04
jrossero/ morning09:04
*** mathlin_ has joined #openstack-ansible09:05
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Publish readable journal files in the gate  https://review.openstack.org/62589509:05
*** cshen has joined #openstack-ansible09:13
*** shyamb has quit IRC09:14
*** shyamb has joined #openstack-ansible09:16
*** cshen has quit IRC09:18
*** DanyC has joined #openstack-ansible09:22
*** cshen has joined #openstack-ansible09:23
*** dcdamien has joined #openstack-ansible09:28
*** cshen has quit IRC09:28
*** shardy has joined #openstack-ansible09:31
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Update Ansible to 2.5.14  https://review.openstack.org/62640409:31
*** mathlin_ has quit IRC09:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Update all SHAs for 18.1.3  https://review.openstack.org/62707909:44
*** shyamb has quit IRC09:44
*** shyamb has joined #openstack-ansible09:44
dcdamienmorning09:53
dcdamienodyssey4me: any ideas what's wrong with tempest on centos? http://logs.openstack.org/85/628785/2/check/openstack-ansible-functional-distro_install-centos-7/4466fe6/logs/ara-report/result/effd0e9e-6dfc-4a72-8b56-223d22c6a3af/09:55
odyssey4medcdamien yeah, is that from a role test - it would seem that the right plugin is not included to make it test anything, so it fails because there are no tests that match09:56
odyssey4mechandankumar is there a package for the designate & barbican plugins in RDO?09:57
odyssey4me(tempest plugins)09:57
chandankumarodyssey4me: yes09:57
chandankumarodyssey4me: let me fetch the list09:57
odyssey4mechandankumar thanks -we'll need to have those added to the list in https://github.com/openstack/openstack-ansible-os_tempest/blob/master/vars/redhat-7.yml#L27-L3509:58
chandankumarodyssey4me: https://github.com/rdo-packages/tempest-distgit/blob/rpm-master/openstack-tempest.spec#L13709:58
chandankumarodyssey4me: I will do that09:58
odyssey4megreat, thanks09:58
*** mathlin_ has joined #openstack-ansible10:02
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Bump rabbitmq_server SHA to include upgrade fix  https://review.openstack.org/62807310:02
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Updated tempest plugin pkgs list for Red Hat distros  https://review.openstack.org/62892610:03
chandankumarodyssey4me: please have a look at above review if any supported service in OSA missing here so that I can add it ^^10:04
chandankumarodyssey4me: regarding subunit issue https://github.com/mtreinish/stestr/issues/21010:04
chandankumarit was the default behavior of stestr so we are implementing somehting tempest last --subunit for tempest side10:05
odyssey4mechandankumar perhaps just compare it against https://github.com/openstack/openstack-ansible-os_tempest/blob/master/vars/main.yml#L23 and add any that are there but not in the package list?10:05
chandankumarodyssey4me: sure10:06
fnpanichi will the proxy changes make it into 18.1.2?10:16
openstackgerritDamian Cikowski (dcdamien) proposed openstack/openstack-ansible-os_designate master: Set project that owns managed resources  https://review.openstack.org/62878510:23
*** arxcruz|brb is now known as arxcruz10:35
*** mathlin_ has quit IRC10:35
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Added support for installing python-tempestconf from git  https://review.openstack.org/62590410:47
*** shyamb has quit IRC10:48
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Updated tempest plugin pkgs list for Red Hat distros  https://review.openstack.org/62892610:51
chandankumarodyssey4me: for cloudkitty, bgvpn and nova-lxd packages are not available in RDO10:51
chandankumarodyssey4me: I am not sure about https://review.openstack.org/#/c/628926/2/vars/redhat-7.yml@4310:51
odyssey4mechandankumar nova-lxd is understandable, and can be left out given that lxd is not available on anything other than ubuntu10:52
odyssey4meI guess with the others just leave them - I was hoping to just get as much coverage as possible10:52
chandankumarodyssey4me: is it tempest_service_available_networking_fwaas or tempest_service_available_neutron-fwaas?10:53
odyssey4mechandankumar you'd have to add whatever it is into defaults, because it doesn't currently exist - but I think underscores are better for var names10:53
*** udesale has quit IRC10:54
openstackgerritMerged openstack/openstack-ansible stable/rocky: Update horizon role SHA  https://review.openstack.org/62785110:55
*** mathlin_ has joined #openstack-ansible10:58
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Synced tempest plugins names and services  https://review.openstack.org/62892611:08
chandankumarodyssey4me: ^^ Done11:08
*** pcaruana has quit IRC11:11
*** pcaruana has joined #openstack-ansible11:16
odyssey4mefnpanic I don't think that absolutely everything has been ported back and merged yet - let's take a peek11:17
odyssey4mefnpanic yeah, I haven't back ported https://review.openstack.org/625312 yet because the rocky implementation differs to the master one, and I needed more time to get that done11:19
odyssey4meI'll try and get it done asap.11:19
*** cshen has joined #openstack-ansible11:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_client master: Revert "cleanup: don't update_cache when adding a new repo"  https://review.openstack.org/62893311:28
*** cshen has quit IRC11:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_client master: Revert "cleanup: don't update_cache when adding a new repo"  https://review.openstack.org/62893311:30
*** cshen has joined #openstack-ansible11:30
*** mathlin_ has quit IRC11:32
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Update all SHAs for 18.1.3  https://review.openstack.org/62707911:35
*** shyamb has joined #openstack-ansible11:35
*** cshen has quit IRC11:36
*** cshen has joined #openstack-ansible11:40
*** cshen has quit IRC11:45
*** ansmith_ has quit IRC12:01
chandankumarodyssey4me: https://review.openstack.org/623187 https://review.openstack.org/628610 and https://review.openstack.org/628182 are good to go, please have a look thanks :-)12:03
openstackgerritMerged openstack/openstack-ansible-os_neutron master: cleanup: remove unnecessary package installations  https://review.openstack.org/62779112:16
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Synced tempest plugins names and services  https://review.openstack.org/62892612:16
odyssey4mechandankumar question in https://review.openstack.org/#/c/623187/29/zuul.d/jobs.yaml12:21
*** mathlin has joined #openstack-ansible12:22
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Use tempest_tempestconf_profile for handling named args  https://review.openstack.org/62318712:26
chandankumarodyssey4me: sorry It was a left over fixed it now12:26
*** cshen has joined #openstack-ansible12:30
*** cshen has quit IRC12:35
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: Minimise distro packages installed into the lxc image  https://review.openstack.org/61307812:44
guilhermesphey odyssey4me ! thanks for your comment in https://review.openstack.org/#/c/628182/8 :) The idea here was to change the workspace path in rocky to be prepared for stein, that would be /root/workspace for example12:44
guilhermesphere is a patch https://review.openstack.org/#/c/627782/4 that motivated this12:44
chandankumarodyssey4me: regarding this https://review.openstack.org/#/c/628926/4/defaults/main.yml@16612:45
guilhermespit is still getting errors but after that task that was breaking. Maybe the next error now has to do with the modification you suggested12:45
chandankumarodyssey4me: since those are not used anywhere will i remove tempest_plugins git url linked for unused projects?12:46
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Synced tempest plugins names and services  https://review.openstack.org/62892612:48
jamesdentonmornin12:51
*** evrardjp has joined #openstack-ansible12:54
*** mathlin has quit IRC12:56
*** evrardjp has quit IRC12:59
*** shyamb has quit IRC12:59
*** evrardjp has joined #openstack-ansible12:59
evrardjphello13:00
*** dcdamien has quit IRC13:03
*** jhesketh has quit IRC13:05
*** jhesketh has joined #openstack-ansible13:06
*** shyamb has joined #openstack-ansible13:06
*** kaiokmo has joined #openstack-ansible13:09
kaiokmomorning osa o/13:11
evrardjphello kaiokmo13:12
kaiokmohey evrardjp13:13
evrardjphappy new year :)13:14
kaiokmohappy new year for you too :)13:14
kaiokmohope you enjoyed holidays13:15
*** mathlin has joined #openstack-ansible13:19
evrardjplikewise :)13:21
mnaserhi everyone13:22
mnaserodyssey4me: btw, i'd like you to have a look at this -- https://review.openstack.org/#/c/628718/13:22
mnaserif it's a valid thing we're gonna have to go back and do a mass patch fixing all of them, unfortunately13:22
mnaserbut that's okay13:22
jrosserwhy dow we have nspawn vars in the lxc container role? https://github.com/openstack/openstack-ansible-lxc_container_create/commit/25478e9b4e8eaf7db05bb87356e6e317638fdd6613:24
mnaserjrosser: that was probably a miscopy13:25
mnaserwe've been kinda maintaining this syncing of lxc/nspawn roles13:25
jrosserthey're undefined, fairly obviously13:25
jrosserhttp://logs.openstack.org/78/613078/19/check/openstack-ansible-lxc-btrfs-centos-7/15f7a6b/job-output.txt.gz#_2019-01-07_13_01_07_38898613:25
*** cshen has joined #openstack-ansible13:25
mnaserhow come now its breaking?13:25
jrosseri'm not totally sure13:26
*** thuydang has quit IRC13:26
jrosserwell, i guess the COW filesystems aren't exercised that much13:27
mnaseri think they have tests in check13:27
*** cshen has quit IRC13:30
*** dave-mccowan has joined #openstack-ansible13:31
*** ygk_12345 has joined #openstack-ansible13:32
ygk_12345ai all13:32
ygk_12345Hi all13:32
ygk_12345in OSA install, where should I restart the keystone service after makinh changes in the keystone container ?13:32
ygk_12345i dont find any apache2 service in keystone containner13:32
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Synced tempest plugins names and services  https://review.openstack.org/62892613:32
openstackgerritMerged openstack/openstack-ansible stable/rocky: Update Ansible to 2.5.14  https://review.openstack.org/62640413:33
*** mkuf has quit IRC13:34
odyssey4mechandankumar no, don't remove the plugins - the var is not used any where, but the plugins are13:35
chandankumarodyssey4me: ack, fixed in the above patch, thanks :-)13:36
jrosserygk_12345: something along the lines of systemctl restart keystone-wsgi-public.service13:36
*** udesale has joined #openstack-ansible13:36
*** mkuf has joined #openstack-ansible13:36
odyssey4meygk_12345 it's nginx by default, not apache13:37
odyssey4meygk_12345 but if you changed something in keystone, then you'll want to restart uwsgi, not nginx13:37
ygk_12345odyssey4me: hwre r the log files for keystone ?13:38
odyssey4mejrosser oops, that's my bad - didn't spot that13:39
ygk_12345odyssey4me: *where13:39
odyssey4meygk_12345 /var/log/keystone for some - it depends what you're looking for, and which branch13:39
ygk_12345odyssey4me: i dont find /n var log in ubntu 1813:40
odyssey4memnaser ah yeah, https://review.openstack.org/628718 is right - although that only matters for role tests which are the only things using developer mode... I'm hoping to eliminate developer mode entirely within thenext two months13:41
*** ansmith has joined #openstack-ansible13:41
mnaserodyssey4me: i'm using developer mode to deploy small environments in a really simple way, but yeah, evenutally just have a set of constraints in the role would be 10/1013:41
mnaserhttps://review.openstack.org/#/c/628747/ was something that was a bit annoyin13:41
jrosserygk_12345: on ubuntu18/rocky try journalctl -u keystone-wsgi-public.service13:42
ygk_12345jrosser: ok thanks13:42
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Use tempest_cloud_name for setting cloudname  https://review.openstack.org/62861013:42
odyssey4memnaser well, basically the plan is to have all deployments be developer mode - with a repo container only being used if there's one in the inventory... but I'm still working out some kinks13:42
odyssey4memnaser FYI https://review.openstack.org/62893313:43
mnaserodyssey4me: +2 oops, my bad :(13:44
mnaserodyssey4me: i support that tbh, i've been hacking around using the roles outside of OSA and your work has made it immensely easier13:44
odyssey4memnaser yeah, no worries - at least with that merged the comments are in place to prevent that happening again13:44
*** deployer2 has quit IRC13:48
evrardjpygk_12345: you probably shouldn't change the containers directly but use role overrides instead :)13:49
chandankumarodyssey4me: mnaser something just happened penstack-ansible-linters openstack-ansible-linters : ERROR Unable to find playbook /var/lib/zuul/builds/7f2b1c2b907c463c8204d0229373bb97/trusted/project_0/git.openstack.org/openstack-infra/project-config/playbooks/base/post-ssh.yaml13:51
odyssey4mechandankumar yep, see #openstack-infra - it's a zuul issue13:51
mnaserchandankumar: should be fixed now.. i believe13:52
* chandankumar rechecks the patch13:52
*** mathlin has quit IRC13:52
chandankumarmnaser: evrardjp it is good to go https://review.openstack.org/#/c/623187/13:54
chandankumarodyssey4me: do we a migration job from rocky to stein where we can test os_tempest stuff?14:04
odyssey4mechandankumar there is a periodic - see http://zuul.openstack.org/builds?project=openstack%2Fopenstack-ansible&pipeline=periodic - but I'm working on getting those into the check/gate queue... although that will take some time because we need to get the timing down far enough to make it workable14:05
chandankumarodyssey4me: great, thanks :-)14:06
*** irclogbot_0 has quit IRC14:14
*** mathlin has joined #openstack-ansible14:16
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Use the inventory to enable/disable services by default  https://review.openstack.org/62897914:17
odyssey4mejrosser are you working up a patch for the issues in https://review.openstack.org/#/c/568430/1/tasks/lxc_container_create_cow.yml ?14:21
*** ansmith has quit IRC14:22
jrosserodyssey4me: i don't have one in progress just now, no14:22
odyssey4mejrosser ok, I'll work one up quickly14:22
jrossergreat, thanks14:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create master: Correct variable names for qgroup/quota limit tasks  https://review.openstack.org/62898214:25
*** shyamb has quit IRC14:28
*** ansmith has joined #openstack-ansible14:29
*** irclogbot_0 has joined #openstack-ansible14:39
*** ygk_12345 has quit IRC14:41
*** dcdamien has joined #openstack-ansible14:43
*** cshen has joined #openstack-ansible14:45
*** jawad_axd has quit IRC14:46
*** jawad_axd has joined #openstack-ansible14:46
*** dcdamien has quit IRC14:48
*** jawad_axd has quit IRC14:49
*** cshen has quit IRC14:50
*** mathlin has quit IRC14:50
*** thuydang has joined #openstack-ansible14:54
odyssey4memnaser ansmith I've posed a question/suggestion in https://review.openstack.org/#/c/604107/10/templates/nova.conf.j215:02
*** mattt has joined #openstack-ansible15:05
*** irclogbot_0 has quit IRC15:06
mnaserodyssey4me: added a comment there too15:07
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create master: Correct variable names for qgroup/quota limit tasks  https://review.openstack.org/62898215:07
*** cshen has joined #openstack-ansible15:10
*** mathlin has joined #openstack-ansible15:13
*** irclogbot_0 has joined #openstack-ansible15:14
*** cshen has quit IRC15:15
mnaserodyssey4me: should we go back to using import_tasks ?15:15
mnaserso tags start working again..15:16
openstackgerritMerged openstack/openstack-ansible-galera_client master: Revert "cleanup: don't update_cache when adding a new repo"  https://review.openstack.org/62893315:16
odyssey4memnaser include_tasks should be used when there is a conditional for the include - import_tasks should be used when there is no condition or any other form of dynamic inclusion15:16
mnaserodyssey4me: okay, that makes a lot of sense.15:16
odyssey4meand in some cases, like where we need tags to work for subtasks, we should do import_tasks... but that should be sparingly implemented because all our tags should be in main only15:17
odyssey4memnaser I did https://review.openstack.org/614329 but there's an issue there which I haven't had a chance to work out15:19
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Synced tempest plugins names and services  https://review.openstack.org/62892615:19
mnaserodyssey4me: heh that was the very role that i just tried and it didnt work15:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/ansible-hardening master: Switch to using import_tasks for static inclusion  https://review.openstack.org/61432915:20
chandankumarodyssey4me: just small typo ^^ in above temepst plugin patch15:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Use the inventory to enable/disable services by default  https://review.openstack.org/62897915:21
odyssey4mechandankumar ah, good catch - thanks15:21
*** openstackgerrit has quit IRC15:22
*** openstackgerrit has joined #openstack-ansible15:22
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Use tempest_cloud_name for setting cloudname  https://review.openstack.org/62861015:22
odyssey4memnaser jrosser if you have a gap to peek at https://review.openstack.org/624773 that'd be nice15:23
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Use tempest_tempestconf_profile for handling named args  https://review.openstack.org/62318715:23
chandankumararxcruz: /o\ ^^15:23
arxcruz:)15:24
dmsimardbtw, tagged ara 0.16.2 for release. No new features -- addresses warnings and a deprecation notice.15:34
odyssey4methanks for the heads-up dmsimard15:35
odyssey4meand HNY!15:35
dmsimardmnaser, odyssey4me: which reminds me -- I raised a concern about moving logs to swift in openstack-infra the other day15:35
dmsimardswitching to swift also means going back to html reports15:35
odyssey4medmsimard yeah, unless a web server is put in front of the swift store15:36
dmsimardfrom openstack's zuul's perspective, this will be handled by the ara-report zuul-jobs role (it's just a var to go from database to html)15:36
dmsimardThe part I mostly worry about is performance (we need to generate all those files *and* upload them)15:37
odyssey4medmsimard perhaps another method would be to upload the database, then drop a task onto a message queue and have the generation and upload of the generated report happen asynchronously15:38
cloudnullmornings15:39
dmsimardodyssey4me: tbh I'm trying to hurry up with 1.0 -- I have a solution on paper for a similar database approach but in all likelihood it won't be ready in time15:40
dmsimard1.0 makes this both easier and harder at the same time :)15:41
*** thuydang has quit IRC15:45
spotzhey15:47
*** mathlin has quit IRC15:47
*** rodolof has quit IRC15:47
*** rodolof has joined #openstack-ansible15:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Only enable oslo notifications when appropriate  https://review.openstack.org/62900515:55
openstackgerritMichael Vollman proposed openstack/openstack-ansible-tests master: Adding manila role tests and vars  https://review.openstack.org/61205515:57
openstackgerritMichael Vollman proposed openstack/openstack-ansible-os_manila master: Basic working os_manila role  https://review.openstack.org/61193016:00
jenglischhm. how should an operator handle openstack-ansible operating system package updates?16:02
jenglische.g. centos 7.5 -> 7.6 or 18.04 -> 18.04.1 or even single packages16:02
odyssey4mejenglisch generally speaking, make sure you've got your own mirror to ensure that you control when new updated packages come into the env16:06
odyssey4mejenglisch then ensure you're up to the latest release of OSA before doing the package updates16:06
odyssey4mefor a major/minor revision change, monitor the discussions here and bugs in launchpad to see if anyone's picked up any issues - and make sure you run something in a test env first16:07
jenglischis there any playbook which runs "yum upgrade" or "apt-get dist-upgrade" ?16:08
evrardjpjenglisch: that looks like a one liner without a playbook though :)16:09
*** mathlin has joined #openstack-ansible16:10
*** macza has joined #openstack-ansible16:11
jenglischyep it is, however is running setup-hosts.yml a good idea afterwards ? or somehow a documented workflow which is tested by CI / used by others?16:12
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Only enable oslo notifications when appropriate  https://review.openstack.org/62900516:13
*** kopecmartin is now known as kopecmartin|off16:13
jrossercloudnull: https://github.com/openstack/openstack-ansible-nspawn_container_create/blob/master/defaults/main.yml#L72-L73 vs. https://github.com/openstack/openstack-ansible-lxc_container_create/blob/master/defaults/main.yml#L196-L197 note the difference in var names ...._machine_....16:14
jrosserwhich way should that really be?16:14
odyssey4mejenglisch it kinda depends what changed in the upgrade, and so far no-one has documented any best practises as far as I know16:14
cloudnullin lxc the "machine" marker was to indicate that its used for machinectl, in nspawn machinectl is assumed given its the only backend16:20
cloudnulljrosser ^16:20
jrosserso some of that has made it's way into the lcx role too16:21
jrosserlxc16:21
*** pcaruana has quit IRC16:21
cloudnull:/16:21
cloudnullits possible i was a bad person16:21
jrosserthis could have been fixed two ways..... https://review.openstack.org/#/c/628982/1/tasks/lxc_container_create_cow.yml@4816:22
jrossereither in those tasks there or in the defaults - now i'm not sure which the right way is16:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/ansible-hardening master: Switch to using import_tasks for static inclusion  https://review.openstack.org/61432916:24
*** hamzaachi has joined #openstack-ansible16:25
*** jawad_axd has joined #openstack-ansible16:38
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Spice console doesn't work on aarch64+kvm.  https://review.openstack.org/62659316:38
chandankumarcloudnull: jrosser mnaser https://review.openstack.org/#/c/628610/ is good to go16:40
*** udesale has quit IRC16:40
*** mathlin has quit IRC16:44
odyssey4mejrosser cloudnull I think given that in nspawn the machinectl back-end is assumed, but 'machine' part of the var name is not relevant - so https://review.openstack.org/628982 is doing the right thing for lxc_hosts16:45
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Synced tempest plugins names and services  https://review.openstack.org/62892616:45
openstackgerritMatthew Thode proposed openstack/openstack-ansible-os_ironic master: DNM testing gate  https://review.openstack.org/62901416:46
jrosserodyssey4me: also given lxc backing store can be either "machinectl", "btrfs", is this right? https://github.com/openstack/openstack-ansible-lxc_container_create/blob/master/tasks/lxc_container_create_cow.yml#L6016:48
prometheanfiremachinectl requires btrfs iirc16:49
*** jawad_axd has quit IRC16:50
jrosseroh sure but you can set the backing store var to btrfs16:50
jrosserin which case are a set of ..._machine_... vars meant to be applied if the var name is indicating they are for the machinectl backend16:50
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Use the inventory to enable/disable services by default  https://review.openstack.org/62897916:50
cloudnulljrosser odyssey4me the machinectl uses btrfs so maybe we should just drop the "machine" from the var?16:52
odyssey4mejrosser yes, because https://github.com/openstack/openstack-ansible-lxc_container_create/blob/master/tasks/lxc_container_create.yml#L37 will cater for the machinectl back-end, while btrfs is recognised as a cow back-end16:53
odyssey4mejrosser lxc_container_create_{btrfs,overlayfs,zfs}.yml all are symlinks to lxc_container_create_cow.yml, whereas lxc_container_create_machinectl.yml is a different task file16:57
odyssey4methe machinectl task file uses the machinectl teplate, which atumagically does the cow implementation... whereas all the others use the lxc cli to do a cow container16:58
jrosseri think i was being a bit overpedantic about the _machine_ in the var name implying machinectl16:58
jrosserwhen actually its for all the btrfs things16:59
odyssey4meoh, I see what you mean now16:59
jrosserso if anything it should be _btrfs_16:59
jrosserwhich is then confuing for machinectl :)16:59
odyssey4meyeah, probably - I can change that up if you like for the lxc_hosts role16:59
jrosseri think doing whatever results in the leas confusing var name is good - but as just evidenced im really not sure what that is!17:00
odyssey4meI don't think it matters that there's consistency with the nspawn_hosts role because the implementations are quite different.17:00
jrosseryeah, perhaps we just remove _machine_ in the lxc var names and add a note to the defaults to say they apply to anything using btrfs storage17:01
odyssey4mejrosser ok, will do17:01
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone master: Cleanup files and templates using smart sources  https://review.openstack.org/58896017:10
*** cshen has joined #openstack-ansible17:11
chandankumarodyssey4me: jrosser Hey17:12
chandankumarodyssey4me: jrosser currently os_tempest is runned by root user https://github.com/openstack/openstack-ansible-os_tempest/blob/master/tasks/tempest_post_install.yml#L2117:12
chandankumarodyssey4me: jrosser is it necessary to run always as a root user can we switch to something different user who has root privliages?17:13
chandankumarodyssey4me: but there is a twist how to add under /etc/shadows in order to give root privilages17:15
chandankumar?17:15
*** cshen has quit IRC17:16
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create master: Resolve btrfs backing store variable inconsistency  https://review.openstack.org/62898217:18
odyssey4mechandankumar I don't think the role requires root - we just run it that way in tests. You can defined it to run in another way through a different playbook.17:19
chandankumarodyssey4me: so in playbook, we need a user who has root privilages which can install packages and create  respective directories like who has permission to access /opt directores17:21
chandankumarodyssey4me: https://github.com/openstack/openstack-ansible-os_tempest/blob/7e6e614ff035c428fa34384169da7dfc00ccb103/tasks/tempest_install_source.yml#L2417:21
mnaserthat'll do it17:22
mnaserplus installing packages in python_venv_build17:22
chandankumarodyssey4me: currently I am expermienting to run os_Tempest in devstack and tripleo ci so asked17:22
chandankumarmnaser: does python_venv_build takes cares of py3 stuff?17:23
mnaserchandankumar: hm, i don't think its bound to a specific python version17:24
mnaserit just ... does things17:24
mnaserspeaking of which, odyssey4me, https://review.openstack.org/#/c/627784/ thoughts?17:25
*** DanyC has quit IRC17:25
chandankumarmnaser: odyssey4me I will try py3 stuff on python_venv_build and let us know :-)17:26
mnaserwonderful17:26
*** hamzaachi has quit IRC17:30
*** macza has quit IRC17:33
*** mathlin has joined #openstack-ansible17:33
*** markvoelker has joined #openstack-ansible17:33
*** markvoelker has quit IRC17:34
chandankumarhttp://logs.openstack.org/26/628926/8/check/openstack-ansible-functional-centos-7/fec2d75/job-output.txt.gz#_2019-01-07_17_29_52_85580617:39
chandankumarmirror timedout17:39
chandankumarI think we seriously needs a mirror manager for the synced mirrors on openstack infra mirror17:39
jrosserthats actually a 404 not found rather than timeout?17:40
jrosseri've seen that a *lot* recently and was wondering if it was limited to the limestone mirror17:41
chandankumarjrosser: yes 404 error17:41
odyssey4mechandankumar the role tests actually execute as non-root, with sudo priveleges, already - so if you have a playbook with 'user: foo' and 'become: true' then it will connect as the non root user and use sudo for all task execution17:42
odyssey4mejrosser https://review.openstack.org/#/c/628982/3 better?17:44
*** gyee has joined #openstack-ansible17:45
jrosseryes thats nicer17:45
*** macza has joined #openstack-ansible17:47
*** DanyC has joined #openstack-ansible17:48
*** DanyC has quit IRC17:53
openstackgerritMohammed Naser proposed openstack/ansible-hardening master: cleanup: use updated conditionals  https://review.openstack.org/62902217:56
openstackgerritMohammed Naser proposed openstack/ansible-hardening master: cleanup: allow running specific tags  https://review.openstack.org/62902317:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/ansible-hardening master: Switch to using import_tasks for static inclusion  https://review.openstack.org/61432917:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/ansible-hardening master: Switch to using import_tasks for static inclusion  https://review.openstack.org/61432918:03
odyssey4mejrosser chandankumar that's not an infra mirror - that's a reverse proxy to the upstream mirrors18:06
*** mathlin has quit IRC18:07
mnaserok18:08
mnaserthose 404s shouldn't be happening18:08
mnaserhttps://github.com/openstack/openstack-ansible-tests/blob/master/common-tasks/test-set-nodepool-vars.yml#L44-L5518:08
mnaserare we missing a variable here somewhere?18:08
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/ansible-hardening master: Switch to using import_tasks for static inclusion  https://review.openstack.org/61432918:08
odyssey4meI'm out for the night folks. Chat again tomorrow.18:11
mnasergood night odyssey4me :)18:14
jrossermnaser: it feels like the 404 package is a dep of something else we install18:16
mnaserit'd be nice if ansible18:17
mnaseractually printed newlines18:17
mnaseras newlines.18:17
jrosserYeah I was just boggling at the ara output18:17
mnaserthey all seem to be consistently configured on http://mirror.regionone.limestone.openstack.org:8080/rdo/centos7/a4/4b/a44b7fc6344c56410b94f2e69ef07fd4b48abb6a_b72eb3dd for that run18:18
mnaserhttp://logs.openstack.org/26/628926/8/check/openstack-ansible-functional-centos-7/fec2d75/logs/redhat-rpm-repolist-tempest1.txt.txt.gz and co18:18
dmsimardo/18:21
jrosserI guess as we know the hash of the repo it could be added to a hand rolled vm and see what goes installing the same packages18:21
dmsimardwhat repo are you actually using ?18:21
dmsimardAre you pinning to a specific hash ? or link ?18:22
dmsimardlike current-passed-ci or something18:22
jrosserdmsimard: this https://github.com/openstack/openstack-ansible-tests/blob/master/common-tasks/test-set-nodepool-vars.yml#L44-L5518:23
jrosser(I think) /me defers to mnaser for checking that18:23
mnaserdmsimard: we do the download-the-repo-file-and-copy-the-hash-and-then-add-that-as-a-repo-to-avoid-broken-cache trik18:24
mnasertrick18:24
*** nicolasbock has joined #openstack-ansible18:24
dmsimardmnaser: sounds about right18:25
mnaserdmsimard: but we're still getting 404s18:25
dmsimardit's not a matter of cache, fwiw18:25
mnaserorly18:25
dmsimardSince the symlinks move in time (as part of the promotion process), you could have jobs landing half of their execution on a different repo because the symlink changes18:25
dmsimardthat's why it's important to resolve the hash18:26
dmsimardsince the hash will never change18:26
dmsimardI'll try and understand why you're getting 404's18:26
*** mgariepy has quit IRC18:35
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Use tempest_cloud_name for setting cloudname  https://review.openstack.org/62861018:36
dmsimardbased on http://logs.openstack.org/26/628926/8/check/openstack-ansible-functional-centos-7/fec2d75/logs/ara-report/result/f84f0c97-d4d7-416b-8972-b3abcaa08833/18:38
dmsimardIt fails to retrieve http://mirror.regionone.limestone.openstack.org:8080/rdo/centos7/a4/4b/a44b7fc6344c56410b94f2e69ef07fd4b48abb6a_b72eb3dd/python2-glanceclient-2.15.0-0.20181226110746.c4c92ec.el7.noarch.rpm18:38
dmsimardIn that repository, python2-glanceclient is actually 2.14, not 2.1518:38
dmsimardi.e, this works: http://mirror.regionone.limestone.openstack.org:8080/rdo/centos7/a4/4b/a44b7fc6344c56410b94f2e69ef07fd4b48abb6a_b72eb3dd/python2-glanceclient-2.14.0-0.20181102161221.93636d6.el7.noarch.rpm18:38
dmsimardI set up that specific repository, did a yum install of python2-glanceclient and it properly installed 2.1418:39
dmsimardI wonder where the 2.15 comes from ?18:39
dmsimardFWIW, that specific repository appears to be a bit old -- it was built a month ago18:40
*** cshen has joined #openstack-ansible18:40
*** mathlin has joined #openstack-ansible18:40
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone master: Cleanup files and templates using smart sources  https://review.openstack.org/58896018:40
dmsimardpuppet-passed-ci is pointing to a repository that was updated today right now18:42
dmsimardhttps://trunk.rdoproject.org/centos7-master/puppet-passed-ci/?C=M;O=D18:42
dmsimardmnaser: ^ I'm confused18:42
mnaserdmsimard: but we always resolve the hash18:43
mnaserdmsimard: its what we do here https://github.com/openstack/openstack-ansible-tests/blob/master/common-tasks/test-set-nodepool-vars.yml#L44-L5518:43
dmsimardmnaser: the package that fails to download is actually located in the right repo18:43
dmsimardI mean18:43
dmsimardhttps://trunk.rdoproject.org/centos7-master/puppet-passed-ci/python2-glanceclient-2.15.0-0.20181226110746.c4c92ec.el7.noarch.rpm18:43
mnaseroh holy on18:43
mnaserhold on18:43
mnaserwhat if18:43
mnaserNODEPOOL_RDO_PROXY is caching the delorean.repo ?18:44
mnaserrdo_dlrn=`curl --silent ${NODEPOOL_RDO_PROXY}/${DLRN_BASE}/delorean.repo | grep baseurl | cut -d= -f2`18:44
dmsimardthat's a possibility18:44
mnaserbut we're hitting a cached record18:44
dmsimardlet me see18:44
mnaserhttp://mirror.regionone.limestone.openstack.org:8080/rdo/centos7-master/puppet-passed-ci/delorean.repo18:45
mnaserpoints to https://trunk.rdoproject.org/centos7/90/44/9044841473d3c9a4c70882bfb5ca59f89cf7afa0_6dde040f18:45
mnaserwhich seems to be pretty new18:45
dmsimardyeah that looks ok18:45
*** cshen has quit IRC18:45
mnaseris it possible that delorean.repo is getting cached during promotion time? i dunno it's so strange to me18:45
dmsimardmnaser: http://logs.openstack.org/26/628926/8/check/openstack-ansible-functional-centos-7/fec2d75/logs/ara-report/result/fd68c556-12ed-4096-9d07-697951a4b3cf/ looks like it sets up the right repo URL too.18:48
dmsimardWhy is yum hitting some outdated repo then ?18:48
mnaserdmsimard: http://logs.openstack.org/26/628926/8/check/openstack-ansible-functional-centos-7/fec2d75/logs/18:48
mnaseryou can check the redhat-rpm-repolist-* files too18:49
mnaserthose even show the right repo18:49
dmsimardmnaser: ok I found something, moving to -infra18:51
*** mgariepy has joined #openstack-ansible18:53
openstackgerritMerged openstack/openstack-ansible-tests master: Revert "Set OpenSUSE jobs to non-voting"  https://review.openstack.org/62660218:55
nsmedscan someone point me  to where log rotation rules (specifically for mariadb) are configured? looking in `openstack-ansible-galera_server` right now but haven't found so far19:02
*** tosky has quit IRC19:05
*** shardy has quit IRC19:24
*** shardy has joined #openstack-ansible19:25
*** DanyC has joined #openstack-ansible19:33
*** cshen has joined #openstack-ansible19:45
*** cshen has quit IRC19:55
*** cshen has joined #openstack-ansible19:57
*** cshen has quit IRC20:02
*** cshen has joined #openstack-ansible20:03
*** cshen has quit IRC20:11
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Resolve btrfs backing store variable inconsistency  https://review.openstack.org/62898220:17
*** cshen has joined #openstack-ansible20:19
jrossernsmeds: is this what you are looking for? https://github.com/openstack/openstack-ansible/blob/master/playbooks/galera-install.yml#L61-L6920:19
openstackgerritMerged openstack/openstack-ansible stable/rocky: Bump rabbitmq_server SHA to include upgrade fix  https://review.openstack.org/62807320:19
*** DanyC has quit IRC20:19
nsmedsjrosser: yep, thank you. (wasn't aware of https://docs.openstack.org/openstack-ansible-rsyslog_client/latest/)20:23
*** DanyC has joined #openstack-ansible20:23
*** Daemoen has joined #openstack-ansible20:25
nsmedsenabled wsrep debug logging on mariadb, producing 2GB per day lmao... need more aggressive log rotation20:26
nsmedsappreciate it20:26
*** cshen has quit IRC20:27
*** DanyC has quit IRC20:28
*** radeks_ has quit IRC20:56
openstackgerritMerged openstack/openstack-ansible-os_swift master: Remove unnecessary package install duplication  https://review.openstack.org/61434221:05
*** strobelight has joined #openstack-ansible21:24
openstackgerritMerged openstack/openstack-ansible stable/rocky: Publish readable journal files in the gate  https://review.openstack.org/62589521:39
openstackgerritMerged openstack/openstack-ansible stable/rocky: Update all SHAs for 18.1.3  https://review.openstack.org/62707921:40
openstackgerritMichael Vollman proposed openstack/openstack-ansible-os_manila master: Basic working os_manila role  https://review.openstack.org/61193021:44
*** hamzaachi has joined #openstack-ansible21:49
openstackgerritMohammed Naser proposed openstack/ansible-hardening master: ntp: fix pool options  https://review.openstack.org/62905521:59
*** ansmith has quit IRC22:00
*** cshen has joined #openstack-ansible22:10
*** hamzaachi has quit IRC22:17
*** cshen has quit IRC22:19
*** strobelight has quit IRC22:37
*** mathlin has quit IRC22:37
*** tosky has joined #openstack-ansible22:52
*** mathlin has joined #openstack-ansible23:14
*** ianychoi has quit IRC23:21
-openstackstatus- NOTICE: The Etherpad service at https://etherpad.openstack.org/ has been offline since 23:22 UTC due to a hypervisor issue in our service provider, but should hopefully return to service shortly.23:48
*** tosky has quit IRC23:48
*** mathlin has quit IRC23:48
*** dave-mccowan has quit IRC23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!