Tuesday, 2019-12-10

*** owalsh has quit IRC00:03
*** owalsh has joined #openstack-ansible00:03
*** owalsh_ has joined #openstack-ansible00:05
*** owalsh has quit IRC00:08
*** gyee has quit IRC00:24
*** dave-mccowan has joined #openstack-ansible00:29
*** gshippey has quit IRC00:29
*** dave-mccowan has quit IRC00:33
*** sshnaidm is now known as sshnaidm|afk00:35
*** logan- has joined #openstack-ansible00:56
*** DanyC has quit IRC01:04
*** goldyfruit_ has joined #openstack-ansible01:09
*** goldyfruit_ has quit IRC01:43
*** nicolasbock has quit IRC02:10
*** vesper11 has quit IRC02:45
*** tridde has joined #openstack-ansible02:45
*** tacco has quit IRC02:45
*** trident has quit IRC02:46
*** vesper11 has joined #openstack-ansible02:46
*** nicolasbock has joined #openstack-ansible04:02
*** udesale has joined #openstack-ansible04:41
*** nicolasbock has quit IRC04:46
*** raukadah is now known as chkumar|ruck05:23
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/train: Drop pip-conf-removal task  https://review.opendev.org/69814306:08
snadgejrosser: pleased with my progress today.. adding the forward to br-vlan fixed that tempest router ping issue.. then i had pages of errors about cirros user not being able to connect via ssh, so i fixed a stupid networking issue.. re-ran the same playbook without rewinding.. and now it passes 113 tests and fails one with some kind of authentication06:20
snadgeissue06:20
snadgeill leave my laptop on again.. and hopefully i can have a look at it again this evening when I get home (remotely)06:20
*** elenalindq has joined #openstack-ansible06:30
*** jbadiapa has joined #openstack-ansible07:28
*** cshen has joined #openstack-ansible07:35
cshenmorning07:36
*** pcaruana has joined #openstack-ansible07:39
*** DanyC has joined #openstack-ansible07:41
*** DanyC has quit IRC07:46
*** rgogunskiy has joined #openstack-ansible08:03
jrossermorning08:10
*** sum12 has quit IRC08:11
*** tosky has joined #openstack-ansible08:11
*** rgogunskiy has quit IRC08:14
*** DanyC has joined #openstack-ansible08:16
*** DanyC has quit IRC08:20
*** rpittau|afk is now known as rpittau08:41
*** sshnaidm|afk is now known as sshnaidm08:58
*** spsurya has joined #openstack-ansible09:25
*** jbadiapa has quit IRC09:34
*** jbadiapa has joined #openstack-ansible09:35
*** owalsh_ is now known as owalsh09:37
*** sum12 has joined #openstack-ansible09:45
*** gshippey has joined #openstack-ansible10:01
*** DanyC has joined #openstack-ansible10:21
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/train: Pass neutron_service_region to service_setup tasks  https://review.opendev.org/69798610:33
*** rgogunskiy has joined #openstack-ansible11:07
*** DanyC has quit IRC11:09
*** rgogunskiy has quit IRC11:11
*** DanyC has joined #openstack-ansible11:15
noonedeadpunkjrosser: elenalindq so I've reproduced placement role failure during  migration on my sandbox. Will try to resolve it11:33
jrossernoonedeadpunk: what was it?11:36
*** cshen has quit IRC11:37
noonedeadpunkDon't know yet - investigating. Just said that it's reproducable, so I've made a snapshot and will be trying11:37
jrossercool, thanks for looking at that some more11:38
elenalindqnoonedeadpunk: Cool, thank you for letting me know!11:48
*** cshen has joined #openstack-ansible11:53
*** nicolasbock has joined #openstack-ansible12:00
*** udesale has quit IRC12:01
admin0if I am stuck in this setup during an upgrade: TASK [Wait for mariadb port 3306 to be available] --what is a manual fix ?   kill all connectiosn to port 3306 and free it myself ?12:07
*** ansmith has quit IRC12:09
*** owalsh has quit IRC12:14
*** spsurya has quit IRC12:35
gshippey@noonedeadpunk how did you reproduce it? I tried doing a clean stein to train AIO upgrade and that migrated successfully. Also looking forwards to your findings!12:35
noonedeadpunkI think I've created several resource before upgrade12:36
*** DanyC has quit IRC12:42
*** owalsh has joined #openstack-ansible12:46
cshenadmin0: check galera cluster status?12:51
chkumar|rucknoonedeadpunk: Hello12:56
chkumar|rucknoonedeadpunk: in OSA side, do we run ironic tempest plugin tests?12:56
noonedeadpunkchkumar|ruck: if believe https://41f20bb6fcc3b51b6beb-be962f8d1bfd597641c44b519bb0e366.ssl.cf2.rackcdn.com/697709/1/check/openstack-ansible-upgrade-aio_metal-ubuntu-bionic/0a6882e/logs/openstack/aio1-utility/stestr_results.html we're not13:03
noonedeadpunkoh, it's for upgrade task13:04
noonedeadpunkbut for regular job we also don't https://568c801131c11d2e6f30-2b79ea6090d3c48285acc3cfbb85b963.ssl.cf5.rackcdn.com/697709/1/check/openstack-ansible-deploy-aio_metal-debian-stable/b25f19e/logs/openstack/aio1-utility/stestr_results.html13:05
*** owalsh has quit IRC13:08
*** schwicht has joined #openstack-ansible13:08
*** owalsh has joined #openstack-ansible13:08
openstackgerritSagi Shnaidman proposed openstack/ansible-config_template master: Add interpreter shebang to config_template.py  https://review.opendev.org/69823513:10
sshnaidmEmilienM, try to depend on that ^^13:11
*** schwicht has quit IRC13:13
*** DanyC has joined #openstack-ansible13:13
*** schwicht has joined #openstack-ansible13:14
jrossersshnaidm: see the comments on https://review.opendev.org/#/c/698059/13:15
sshnaidmjrosser, oh, dup.. EmilienM you have it there from cloudnull ^^13:25
noonedeadpunksshnaidm: I think cloudnull already posted https://review.opendev.org/#/c/698059/113:26
sshnaidmnoonedeadpunk, yep, abandoning mine13:27
* noonedeadpunk needs to drink some coffe13:27
*** ansmith has joined #openstack-ansible13:28
*** owalsh has quit IRC13:29
EmilienMsshnaidm: but using python3 won't work on centos713:31
jrosserwhy does this error happen? there’s not really a description of that in the patch to add the shebang so I’m kinda -113:32
sshnaidmEmilienM, mm.. yeah, right13:32
*** jbadiapa has quit IRC13:33
sshnaidmEmilienM, you can try Kevins patch  https://review.opendev.org/#/c/698059/13:33
EmilienMsshnaidm: doing now13:34
sshnaidmjrosser, afaics it happens when calling config_template module13:34
chkumar|rucknoonedeadpunk: cool,13:35
*** owalsh has joined #openstack-ansible13:35
*** goldyfruit_ has joined #openstack-ansible13:37
chkumar|rucknoonedeadpunk: I am going to convert these commands https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_1b6/697992/4/check/tripleo-ci-centos-7-scenario012-standalone/1b63cb8/logs/undercloud/home/zuul/tempest.log.txt.gz into ansible tasks on os_tempest side13:37
noonedeadpunkchkumar|ruck: what we usually do - creating service vars file like https://opendev.org/openstack/openstack-ansible/src/branch/master/tests/roles/bootstrap-host/templates/user_variables_barbican.yml.j2#L18-L1913:38
chkumar|rucknoonedeadpunk: yes, but we need to create few resources for running ironic tempest tests13:39
noonedeadpunkah, ok then13:40
chkumar|rucksame goes with octavia I talked with mnaser during ptg, now it's time to get it done13:40
*** goldyfruit___ has joined #openstack-ansible13:41
*** goldyfruit_ has quit IRC13:44
sshnaidmEmilienM, worth to try -vvv to see which module is executed13:47
*** schwicht has quit IRC13:49
*** jbadiapa has joined #openstack-ansible13:59
*** schwicht has joined #openstack-ansible14:16
*** schwicht has quit IRC14:19
noonedeadpunkjrosser: gshippey so it looks like mysqldump is absent despite including galera_client role as mariadb-client-core-10.3 do not include mysqldump...14:20
noonedeadpunkonly mariadb-client-10.3 include it14:20
jrosserI thought we changed that....14:21
gshippeyhttps://review.opendev.org/#/c/696886/14:22
jrosseroh maybe it only merged 4 days ago so the sha bumps have missed it on train branch14:23
noonedeadpunkso https://opendev.org/openstack/openstack-ansible-galera_client/src/branch/stable/train/vars/debian.yml#L21 seems to be mariadb-client-10.3 but ansile tries to install mariadb-client-core-10.314:23
noonedeadpunkjrosser: no, I have it on board14:24
noonedeadpunkoh14:24
noonedeadpunkwait14:24
noonedeadpunkyes, we need bump:)14:25
*** tacco has joined #openstack-ansible14:26
*** chkumar|ruck is now known as raukadah14:26
taccohey there.. have a short question.. tryed.. monasca in between but already wiped it from ansible and certain configs as same as from facts and inventory..14:26
taccobut.. designate isn't able to build because of some kind of dead beef inside14:27
noonedeadpunkjrosser: gshippeydo we want to revert https://review.opendev.org/#/c/695396/2 ?14:27
taccohttp://paste.openstack.org/show/787372/14:27
taccoany ide?14:27
taccoidea?14:27
taccoabout the pool still have some issues with formating.. but i think i can provide a patch at the end of this week.14:27
jrosser noonedeadpunk is that the one from master to revert?14:31
noonedeadpunkyeah14:32
* jrosser mobile phone browser :(14:32
jrosserit’s not clear14:32
jrosserI think the change brings all the distro into line installing the same stuff14:32
jrosserso uniformity vs minimal install really14:33
noonedeadpunkso 3 patches left in osa-train, so I think I can create bump for the last rc and rebase on top of them14:35
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/train: Make upgrade script respect OSA_CONFIG_DIR  https://review.opendev.org/69826214:36
*** pcaruana has quit IRC14:36
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/train: Drop pip-conf-removal task  https://review.opendev.org/69814314:37
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/train: Make upgrade script respect OSA_CONFIG_DIR  https://review.opendev.org/69826214:37
noonedeadpunkelenalindq: try applying https://review.opendev.org/#/c/696886/ - this will be included in train release14:39
elenalindqThank you, noonedeadpunk. I'm adding Octavia LBaaS  now and when done, I will ugprade and use this fix.14:40
noonedeadpunkthanks to gshippey for the fix:)14:41
*** lbragsta_ has joined #openstack-ansible14:59
*** pcaruana has joined #openstack-ansible15:01
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/train: Bump SHAs for stable/train  https://review.opendev.org/69826615:03
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/train: Bump SHAs for stable/train  https://review.opendev.org/69826615:03
cjloadermorning15:21
cjloaderhow close to release?15:21
noonedeadpunkcjloader: need to merge bump:) (and everything under bump)15:25
cjloadernice15:26
cjloaderso close?15:26
noonedeadpunkActually it's high time we released15:30
noonedeadpunkso I hope that it is close15:30
noonedeadpunkand nothing will raise in the meanwhile15:31
*** lbragsta_ has quit IRC15:36
*** mgariepy has quit IRC15:37
*** lbragsta_ has joined #openstack-ansible15:37
*** mgariepy has joined #openstack-ansible15:40
*** eglute has joined #openstack-ansible15:44
*** cshen has quit IRC15:53
*** lbragsta_ has quit IRC15:55
*** goldyfruit_ has joined #openstack-ansible15:57
*** goldyfruit___ has quit IRC16:00
noonedeadpunk#startmeeting openstack_ansible_meeting16:01
openstackMeeting started Tue Dec 10 16:01:01 2019 UTC and is due to finish in 60 minutes.  The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot.16:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:01
*** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)"16:01
openstackThe meeting name has been set to 'openstack_ansible_meeting'16:01
guilhermespo/16:01
noonedeadpunk#topic office hours16:01
*** openstack changes topic to "office hours (Meeting topic: openstack_ansible_meeting)"16:01
gshippeyo/16:01
raukadah\o/16:01
noonedeadpunkso from my side I think we're ready for releasing and actually we _must_ release16:02
noonedeadpunkjust few things left to merge and I've already placed a bump on top of them16:03
noonedeadpunkIF anyone has any objections or not addressed issues it's better to say them loud now :)16:03
guilhermesphum so we need that 4 patches merged then16:03
noonedeadpunkactualy 5 (1 is cherry-picked while master is not merged16:06
noonedeadpunkIF you think we should drop off some out of the process (not to wait for it) - we can do that16:07
guilhermespi think we can drop off for now https://review.opendev.org/#/c/698262/ if is not crucial16:11
*** jftalta has joined #openstack-ansible16:11
noonedeadpunkyou mean that we can offer ppl to do upgrades without using upgrade script?16:13
noonedeadpunkLike if they use non-standart directories?16:14
mnaseri think guilhermesp means that the OSA_CONFIG_DIR stuff is an extra16:14
mnaseri know we use it but the change is trivial so probably doesnt hurt that much, unless its really a pita to merge then we can drop it16:14
guilhermespyep16:14
mnaserepel timing out has hurt centos i guess16:15
noonedeadpunkYeah16:15
mnaserdoes infra have an epel mirror?16:15
noonedeadpunkBut this happened to several patches16:15
noonedeadpunkI think they did...16:15
mnaserhttp://mirror.sjc1.vexxhost.openstack.org/epel/16:16
mnaserthey do16:16
mnaseri think we use it?16:16
mnaseri think the problem here is the fact the GPG key is being downloaded from the internes16:16
mnaserintarwebs16:16
mnaserwe should install this key locally16:17
mnaseri can submit a patch for this..16:17
noonedeadpunkthat would be nice I think16:19
noonedeadpunkOk, one more thing I'd love to hear opinion about is https://review.opendev.org/#/c/697830/ I dropped it from osa-train topic as this is pretty crucial patch16:20
noonedeadpunkAnd I didn't have a chance to do some testing (with several control nodes) against master and train, but on rocky and stein one failed memcached still brings problems and latency16:21
openstackgerritMohammed Naser proposed openstack/openstack-ansible-repo_server master: epel: use vendored gpg keys  https://review.opendev.org/69829016:26
mnasernoonedeadpunk: yeah, i think this is somethign we need more testing on, its a pretty fundamental change, some OSA users use an external LB too16:26
noonedeadpunkactually it's pretty overridable now, so this can be moved to some docs instead of changing default behaviour16:28
mnaserid be ok with that16:32
noonedeadpunkI think we should do https://review.opendev.org/698290 in some other way, as there's a folk who's using some another repo and was using centos_epel_key and  centos_epel_mirror to override stuff across all roles16:35
*** gyee has joined #openstack-ansible16:37
*** goldyfruit___ has joined #openstack-ansible16:41
*** goldyfruit_ has quit IRC16:44
mnasernoonedeadpunk: wanna leave a review there?16:51
noonedeadpunkyeah, will do:)16:52
noonedeadpunkjust what to think about what better solution to offer instead:)16:53
cjloadero/16:54
cjloadersorry late16:54
raukadahnoonedeadpunk: jrosser mnaser https://review.opendev.org/#/c/698134/ packstack review might be useful for OSA17:00
mnaserraukadah: yay el8 pkgs?17:01
raukadahmnaser: yes17:01
noonedeadpunkcool!17:01
raukadahmnaser: not complete yet, but half baked might be useful17:01
noonedeadpunk#endmeeting17:01
*** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: http://bit.ly/2xA1eZC"17:01
raukadahwith dlrn url17:01
openstackMeeting ended Tue Dec 10 17:01:38 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:01
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-12-10-16.01.html17:01
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-12-10-16.01.txt17:01
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-12-10-16.01.log.html17:01
*** jftalta has quit IRC17:13
*** tosky has quit IRC17:27
*** rpittau is now known as rpittau|afk17:29
*** AR2018 has joined #openstack-ansible17:37
*** AR2018 has quit IRC17:39
noonedeadpunkjrosser: gshippey mgariepy can I ask you to review these patches? https://review.opendev.org/#/q/topic:osa-train+status:open17:43
noonedeadpunklogan-: \o/ thanks:)17:45
logan-:) np.. hows it going?17:47
noonedeadpunkfinally close to release:) but generally totally fine17:48
*** sshnaidm is now known as sshnaidm|afk17:50
openstackgerritMerged openstack/ansible-role-python_venv_build master: Replace ostempest job with plain tripleo standalone  https://review.opendev.org/69797417:50
*** DanyC_ has joined #openstack-ansible18:22
*** goldyfruit_ has joined #openstack-ansible18:22
*** DanyC_ has quit IRC18:23
*** goldyfruit___ has quit IRC18:25
*** DanyC has quit IRC18:26
*** elenalindq has quit IRC18:39
*** kopecmartin is now known as kopecmartin|off18:41
*** schwicht has joined #openstack-ansible19:30
*** spatel has joined #openstack-ansible19:33
*** ansmith_ has joined #openstack-ansible20:00
*** ansmith has quit IRC20:03
*** rgogunskiy has joined #openstack-ansible20:16
*** pcaruana has quit IRC20:16
*** rgogunskiy has quit IRC20:20
*** ansmith_ has quit IRC20:20
*** ansmith_ has joined #openstack-ansible20:21
*** ansmith_ has quit IRC20:36
*** jcosmao has joined #openstack-ansible20:40
*** jcosmao has left #openstack-ansible20:40
*** jcosmao has joined #openstack-ansible20:42
*** ansmith has joined #openstack-ansible20:45
*** ansmith has quit IRC21:18
*** tasker has joined #openstack-ansible21:21
taskerI'm trying to deploy Rocky using OSA 18.1.7 and am running into LXC issues with "/usr/bin/python: not found". regenerating the lxc cache ( rm -rf /var/cache/lxc/download ) on the "lxc_host" isn't helping and is about all the aid I've found on the internet. surely someone else is having this problem.21:22
taskerlxc host OS is Ubuntu 18.04.3 LTS21:24
taskerso is the eventual OS made for the container.21:24
*** goldyfruit_ has quit IRC21:24
taskerI feel like I'm bumping into 18.04's removal of python2 by default due to its EOL in January.21:25
taskerI've looked in the release notes for OSA 18 and find nothing nor have I seen anything in the "stable/rocky" _git log_ .21:26
*** goldyfruit_ has joined #openstack-ansible21:30
taskerand--of course--without changing anything nor warning, one of my containers deploys with python2 installed as /usr/bin/python.21:33
*** wpp has quit IRC21:43
*** wpp has joined #openstack-ansible21:52
*** spatel has quit IRC22:09
*** nicolasbock has quit IRC22:12
openstackgerritMerged openstack/openstack-ansible stable/train: Set neutron_service_region in group_vars  https://review.opendev.org/69798122:27
*** elenalindq has joined #openstack-ansible22:31
jrossertasker: rocky is still fully python2, as is Stein22:43
jrosserwe only merged anything to do with changing to python 3 for Train22:43
openstackgerritMerged openstack/openstack-ansible stable/train: Drop pip-conf-removal task  https://review.opendev.org/69814322:48
taskerjrosser: thanks! turns out that the trouble host didn't have an /etc/network/interfaces file to initiate the lxcbr0 device. this prevented the containers from accessing the internet to download needed packages.22:58
taskerby adding an /etc/network/interfaces file referencing /etc/network/interfaces.d/* and starting the lxcbr0 interface the containers are able to get /usr/bin/python.22:59
*** ansmith has joined #openstack-ansible23:07
taskeri also deleted all existing containers using containers-lxc-destroy.yaml and deleted the LXC cache on the host at /var/cache/lxc/download23:07
*** goldyfruit_ has quit IRC23:30
*** schwicht has quit IRC23:36
*** schwicht has joined #openstack-ansible23:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!