Thursday, 2020-05-14

*** jamesdenton has joined #openstack-ansible01:17
*** jamesdenton has quit IRC01:22
*** jamesdenton has joined #openstack-ansible01:24
*** itandops has quit IRC02:28
*** gyee has quit IRC02:38
*** mmethot_ has joined #openstack-ansible03:54
*** mmethot has quit IRC03:56
*** schwicht has quit IRC04:06
*** schwicht has joined #openstack-ansible04:14
*** evrardjp has quit IRC04:36
*** evrardjp has joined #openstack-ansible04:36
*** KeithMnemonic has quit IRC05:14
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Bump ansible version to 2.9.9  https://review.opendev.org/72792505:28
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-tests master: Update ansible to 2.9.9  https://review.opendev.org/72792605:30
*** udesale has joined #openstack-ansible05:30
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Update Magnum fedora image name  https://review.opendev.org/72774905:50
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_manila master: Ansible 'skipped' is a test not a filter  https://review.opendev.org/72774305:56
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-rsyslog_server master: [ussuri][goal] Updates for python 2.7 drop  https://review.opendev.org/71068005:59
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-rsyslog_server master: Updated from OpenStack Ansible Tests  https://review.opendev.org/70951905:59
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-plugins master: Ansible 'changed' is a test not a filter  https://review.opendev.org/72793206:02
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-plugins master: Updated from OpenStack Ansible Tests  https://review.opendev.org/72733406:03
*** CeeMac has joined #openstack-ansible06:16
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-galera_server master: [WIP] combine galera client role into galera_server  https://review.opendev.org/72590306:20
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_octavia master: Replace usage of deprecated os_*_facts ansible modules  https://review.opendev.org/72793406:31
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_trove master: Replace usage of deprecated os_*_facts ansible modules  https://review.opendev.org/72793906:36
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_swift master: Replace usage of deprecated os_*_facts ansible modules  https://review.opendev.org/72794006:37
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_designate master: Replace usage of deprecated os_*_facts ansible modules  https://review.opendev.org/72794106:39
noonedeadpunkjrosser: have any thoughts on https://review.opendev.org/#/c/726228/ and topic overall?06:45
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-lxc_container_create master: Use lxc-3 syntax for tests  https://review.opendev.org/66523806:54
chandankumarjroll, noonedeadpunk morning06:59
chandankumarjrosser, morning06:59
chandankumarjroll, sorry06:59
noonedeadpunko/06:59
noonedeadpunkthey should get used to I think :p06:59
chandankumarjrosser, I was trying to trigger octavia test here https://review.opendev.org/727856 but it is not working06:59
chandankumarnoonedeadpunk, hehe06:59
chandankumarhere is the series https://review.opendev.org/#/q/topic:octavia_ostempest+(status:open+OR+status:merged)07:00
noonedeadpunkchandankumar: yeah as you need to do that in integrated repo07:00
chandankumarthe same is working on tripleo side07:00
noonedeadpunklike https://opendev.org/openstack/openstack-ansible/src/branch/master/tests/roles/bootstrap-host/templates/user_variables_manila.yml.j207:00
chandankumarnoonedeadpunk, integrated repo means openstack-ansible or opestack-ansible-tests07:00
chandankumarnoonedeadpunk, Ah interesting07:01
chandankumar, let me do that07:01
noonedeadpunkso just put another template and add it to the list https://opendev.org/openstack/openstack-ansible/src/branch/master/tests/roles/bootstrap-host/tasks/prepare_aio_config.yml#L15807:02
noonedeadpunkvariables you mentioned are for functional tests which were ran by tox which is almost not the case nowadays07:03
*** fghaas has joined #openstack-ansible07:16
jrosserchandankumar: it is quite possible we already are running octavia tests07:17
jrossernoonedeadpunk: good morning!07:17
jrossermany many things getting fixed - this is good07:17
chandankumarjrosser, I grepped for octavia tests but not found07:19
openstackgerritChandan Kumar (raukadah) proposed openstack/openstack-ansible master: Enable octavia tempest tests  https://review.opendev.org/72794907:19
jrosseryes i'm just taking a look now07:19
jrosserheres the tempest log from a recently merged patch to os_octavia, and yes it doesnt run any octavia tests there07:20
jrosserhttps://zuul.opendev.org/t/openstack/build/83d38a71b7894617abc30749c2c234b7/log/logs/openstack/aio1-utility/tempest_run.log.txt07:20
openstackgerritChandan Kumar (raukadah) proposed openstack/openstack-ansible-os_octavia master: [WIP] enable octavia tempest tests  https://review.opendev.org/72785607:21
chandankumarjrosser, noonedeadpunk https://review.opendev.org/727949 and https://review.opendev.org/727856 will trigger octavia tests or I am still missing something07:21
chandankumaror I need to enable octavia somewhere in metal jobs?07:22
jrosserfrom osa side we already enable the octavia tempest plugin https://zuul.opendev.org/t/openstack/build/83d38a71b7894617abc30749c2c234b7/log/job-output.txt#1595907:22
jrosserchandankumar: a couple of things - i don't think the condition for creating the network is needed in os_tempest for us https://review.opendev.org/#/c/727854/07:23
jrosserneutron is always present when testing octavia07:23
chandankumarjrosser, but when I enable neutron it create public and private networks both07:24
chandankumarfor octavia we need only public network07:24
jrosserah ok, does it cause issues if the private network gets created there, or you just want to keep things as minimal as needed?07:25
jrosserthen the question about triggering octavia tests in the openstack-ansible integrated repo is here https://github.com/openstack/openstack-ansible/blob/master/zuul.d/playbooks/pre-gate-scenario.yml#L39-L4207:26
chandankumarjrosser, yes I want to keep it minimal as much as posible07:26
jrosserwe create a veriable called "scenario" and the zuul pre-job generates the senario string and will add "octavia" if the test is running for os_octavia role07:26
noonedeadpunkchandankumar: placed some comments07:26
jrosserso that should just all happen for you07:27
chandankumarjrosser, let me do one more testing in TQ side, rethink on my public and private network hypothesis07:27
jrossersure, no worries - tbh this feels quite close on the OSA side, just needs the tests enabling i think07:28
noonedeadpunkchandankumar: so actually https://review.opendev.org/#/c/727856/ is not needed as patch - we can still use it as noop patch07:29
chandankumarnoonedeadpunk, yes, we can make it as a noop patch07:29
jrossernoonedeadpunk: i was thinking that a bunch of roles we still carry old functional tests - i guess this is an example of it07:29
noonedeadpunkyeah, was thinking about cleaning that up as well07:30
jrossersome we still use, like keystone and neutron have functional + integrated07:30
jrosserbut a big bunch are now integrated only07:30
noonedeadpunkbut probably need to leave that for V as well...07:31
jrosseryep, oh did you see i found another magnum thing - they have a default flavor name now in the tempest plugin07:31
*** tosky has joined #openstack-ansible07:31
noonedeadpunkActually we use linters checks locally everywhre07:31
noonedeadpunkbut we can use integrated now as well even for it07:32
*** rpittau|afk is now known as rpittau07:33
noonedeadpunkjrosser: no, I didn't....07:33
noonedeadpunkbut see now07:33
noonedeadpunkSo you set master_flavor_id, does it also need flavor_id for pods?07:34
jrossererr :) maybe07:35
jrosseroh i see flavor_id vs master_flavor_id07:36
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Update Magnum fedora image name  https://review.opendev.org/72774907:36
jrosseryeah thats going to break07:36
noonedeadpunkoh, I didn't check ci lol07:37
jrosserthis is like errrrr what? https://opendev.org/openstack/magnum-tempest-plugin/src/branch/master/magnum_tempest_plugin/config.py#L6707:37
jrosserhow are you supposed to know the uuid....07:37
noonedeadpunkyou can set it while creating flavor07:38
noonedeadpunkdisregrd07:38
*** dpaclt has joined #openstack-ansible07:38
noonedeadpunkI mixed with flavor lol07:38
jrossermaybe it's a magical field which will take name or uuid07:39
noonedeadpunkIt doesn't look like it tbh... but who knows07:44
*** born2bake has joined #openstack-ansible08:49
*** sshnaidm|afk is now known as sshnaidm09:11
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_trove master: Replace usage of deprecated os_*_facts ansible modules  https://review.opendev.org/72793909:25
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_designate master: Replace usage of deprecated os_*_facts ansible modules  https://review.opendev.org/72794109:26
openstackgerritMerged openstack/openstack-ansible-plugins master: Ansible 'changed' is a test not a filter  https://review.opendev.org/72793209:28
openstackgerritMerged openstack/openstack-ansible-plugins master: Updated from OpenStack Ansible Tests  https://review.opendev.org/72733409:29
*** amalrajgenocidex has joined #openstack-ansible09:36
amalrajgenocidexHi, Is openstack-ansible Ussuri stable on ubuntu at the moment?09:37
amalrajgenocidexI was going for a new deployment and wanted to decide the version to use09:37
jrosseramalrajgenocidex: the core openstack components for Ussuri are just released09:57
jrosserbut deployment tooling is in a difficult spot because they have to validate that the official Ussuri release is working with that deployment, and that takes some time09:59
jrosseropenstack-ansible and other deployment tools make their release later than the core components09:59
amalrajgenocidexjrosser  Thank you. I will go with train then :)10:02
*** rpittau is now known as rpittau|bbl10:18
noonedeadpunkspotz: jrosser so, really would love to hear thoughs about https://review.opendev.org/#/c/726228/ as it's our U blocker tbh...10:28
noonedeadpunkwe really need to branch and don't want to backport all this stuff later...10:29
noonedeadpunkOr maybe we should backport?10:29
*** viks____ has joined #openstack-ansible10:30
*** fghaas has left #openstack-ansible10:33
chandankumarjrosser, https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_05a/727856/2/check/openstack-ansible-deploy-aio_metal-centos-7/05a1800/logs/openstack/aio1-utility/tempest_run.log.txt10:33
noonedeadpunkyeah, look like temepst runs octavia tests lol10:34
chandankumaryesh but it failed10:35
noonedeadpunkalso in https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_05a/727856/2/check/openstack-ansible-deploy-aio_metal-centos-7/05a1800/logs/host/octavia-housekeeping.service.journal-09-01-33.log.txt Flow 'octavia-create-amphora-flow': octavia.common.exceptions.ComputeBuildException: Failed to build compute instance due to: Invalid key_name provided. (HTTP 400)10:37
noonedeadpunkYeah and see policy warnings in api10:39
noonedeadpunkbut I don't see that we provide policy... I think we expect them to be benerated by octavia..10:41
noonedeadpunkbtw, I think we should probably bother regarding moving policies.json to be yaml instead....10:42
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Use lxc-3 syntax for tests  https://review.opendev.org/66523810:50
openstackgerritMerged openstack/ansible-role-systemd_networkd master: Do not use deprecated ansible 'bare' variables  https://review.opendev.org/72710510:55
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Small syntax update  https://review.opendev.org/66541811:00
*** dpaclt has quit IRC11:05
openstackgerritMerged openstack/openstack-ansible master: Install python3 instead of python2 during host bootstrapping.  https://review.opendev.org/72327611:07
*** dpaclt has joined #openstack-ansible11:13
openstackgerritMerged openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests  https://review.opendev.org/72732711:18
*** dpaclt has quit IRC11:37
*** udesale has quit IRC11:44
*** udesale has joined #openstack-ansible11:58
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: [WIP] Resolve issue with undefined facts while running with tags  https://review.opendev.org/72805212:04
noonedeadpunkjrosser: have a minute for discussion of ^ ?12:04
*** udesale_ has joined #openstack-ansible12:04
noonedeadpunklike having several options to resolve this thing, so'd better ask if you ok with this one or I need to do try another ones before changing all playbooks12:05
noonedeadpunkso as alternative to setting `always` tag on upper play we can use this https://opendev.org/openstack/openstack-ansible/src/branch/master/playbooks/containers-nspawn-create.yml#L16-L18 or this https://opendev.org/openstack/openstack-ansible/src/branch/master/playbooks/ceph-rgw-install.yml#L28-L37 way12:06
noonedeadpunkjust want to pick one and follow it wherever possible12:07
* jrosser meetings :(12:08
jrosseri'll be about an hour12:09
noonedeadpunksure12:09
*** rpittau|bbl is now known as rpittau12:15
*** rh-jelabarre has joined #openstack-ansible12:22
*** amalrajgenocidex has quit IRC12:22
*** jbadiapa has joined #openstack-ansible12:25
spotznoonedeadpunk: looking13:00
spotznoonedeadpunk: So technically the last patch is mine so unless it's minor like a typo I usually don't review. But I can if you want or you can by the same thought it's my patch13:01
noonedeadpunkspotz: I'm totally fine with your edit:)13:04
noonedeadpunkbut I'm kinda laways feel unconfident in such cases when to vote or not13:05
spotzOk I'll throw a vote up if you've read it13:08
spotzOk voted, if jrosser or no one else votes by the end of the day lets workflow it13:09
chandankumarjrosser, hello13:10
chandankumarjrosser, https://31f867d906c85b3d450a-9945c6e94a1b9feee2753a6244e7fd57.ssl.cf2.rackcdn.com/726752/8/check/tripleo-ci-centos-8-scenario010-standalone/7081ef6/job-output.txt13:10
chandankumarjrosser, if we enable neutron private network creation fails  ConflictException: 409: Client Error for url: http://192.168.24.1:9696/v2.0/networks.json, Unable to create the network. The tunnel ID 1 is in use.13:10
guilhermespspotz: noonedeadpunk will take a look in a bit too at this topic13:10
spotzThanks guilhermesp13:11
guilhermespit seems fine to me, however i have a tittle question: do we want to keep "contribute" and "contributing" here? https://review.opendev.org/#/c/726228/5/doc/source/contributor/index.rst13:20
noonedeadpunkthat's damn good question13:20
noonedeadpunkLike we have to have contributing stuck to the template13:20
noonedeadpunkwhile contribute is wider and better imo...13:20
noonedeadpunks/stuck/stick/'13:21
spotzI questioned that mentally myself but 2 different docs13:21
noonedeadpunkYeah... Like at first I was trying to adjust contributing but like data there by template is taken from at least 3 different docs...13:22
noonedeadpunkand dunno if combining them is good idea considering their size...13:23
jamesdentongood morning13:26
guilhermesphum i see... yeah but i guess taking the guidelines , i'd vote to remove that line from index :P13:26
noonedeadpunkany suggestions where to place it's content?13:29
noonedeadpunkmaybe we can swap them in the list and it will look more logically13:30
noonedeadpunklike place contributing.rst the first one. Like - So you want to contribute, then onboarding, bug handling, etc13:31
noonedeadpunkeventually we have too much contrubutor docs already for this template13:32
noonedeadpunkI'd rather do not inlcude that new contributing.rst into the tree lol13:34
noonedeadpunkbut then error raises so not an option13:34
guilhermespoh noonedeadpunk i see your point...13:37
guilhermespim not seeing the  benefits of swapping them into the list.. and we do need contributing as well, i'd say for us to keep as is, unless someone else has a good idea about it13:40
noonedeadpunkI don't ;(13:41
*** KeithMnemonic has joined #openstack-ansible13:43
guilhermespbut yeah, in general the patch looks good, do we want more eyes on it or let's just start merging?13:44
noonedeadpunkmaybe jrosser have some thoughs13:45
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_trove master: Replace usage of deprecated os_*_facts ansible modules  https://review.opendev.org/72793913:46
jrosserhello13:46
* jrosser unmeetings13:46
noonedeadpunkguilhermesp: as once this is merged we have https://review.opendev.org/#/q/topic:project-ptl-and-contrib-docs+(status:open)+owner:noonedeadpunk@ya.ru for review :p13:47
jrosserchandankumar: i think this has set the tunnel id to 1, so that could be overridden becasue I guess that in the tripleo deploy something else has already used tunnel_id=1?13:49
jrosserchandankumar: https://github.com/openstack/openstack-ansible-os_tempest/blob/master/defaults/main.yml#L12113:49
jrossernoonedeadpunk: what do we need to look at? just had 5hrs meetings so not sure which way is up right now13:50
guilhermespnoonedeadpunk: yep sure, just ping me if i dont see here13:50
noonedeadpunkjrosser: at the moment we were discussing https://review.opendev.org/#/c/726228/ and how ugly having contributing.rst and contribute.rst13:51
noonedeadpunksecond thing I'll ask later:)13:51
mgariepymorning everyone13:52
mgariepyqq, centos8 stuff, does it need to be backported to train ?13:52
mgariepyor only u would be good enough ?13:53
noonedeadpunkmgariepy: it needs :(((13:53
mgariepyhmm, forget that. it's not much more work.. as we need a release that is able to do both..13:53
noonedeadpunkas only train has 7 and 8 rdo packages13:53
noonedeadpunkso this will be kinda migratrion release13:54
mgariepyfor lxc part, there is a repo for lxc3 on centos7 and 8.13:55
mgariepylxc2 is only for centos6 and 7.13:55
noonedeadpunkso for 8 we should use lxc3. for centos7 not sure it matters13:56
mgariepyi guess we don;t need to bother with migration of lxc2>lxc3 since we can stick with lxc2. for 7.13:56
noonedeadpunkwe can probably leave it as is to have less work on our hands13:56
mgariepycentos need full re-install afaik.13:56
jrossernoonedeadpunk: contribute and contributing is ugly to have both13:56
noonedeadpunkjrosser: totally agree but out of thoughts....13:56
noonedeadpunkLike including all of our contribute docs into the one contributing.rst would be as ugly as having both13:57
jrosseris this becasue the community goal mandates a particular filename? i saw this right at the start and thought it was unfortunate13:57
noonedeadpunkYep, they require specific name and specific template to be used13:57
mgariepymaster is U right now ?13:58
noonedeadpunk`There exists project specific information about contribution to that project in each project’s documentation in the form of a doc/source/contributor/contributing.rst following the template in the cookiecutter repo [3].`13:58
noonedeadpunkmgariepy: yep13:58
mgariepyfor how long ?13:58
mgariepydo we have an eta ?13:58
jrossernoonedeadpunk: i guess it depends on the intent - like if no projects have contributor guidelines then adding them is cool, just that we happened to have pretty good ones just in a filename a chouple of chars different13:58
noonedeadpunkwant to branch asap tbh13:59
mgariepyok13:59
noonedeadpunkBut it won't be too much hard to backport stuff to U14:02
mgariepyyep indeed.14:02
mgariepydoes it worth it to put the effort on centos ?14:03
mgariepyis there a lot of ppl using centos that we know of ?14:06
noonedeadpunkYeah14:06
noonedeadpunkThere're pretty much ppl on centos14:06
mgariepyk14:08
akahatjrosser, o/14:08
jrosserakahat: hello14:08
akahatjrosser, need to talk about this review: https://review.opendev.org/#/c/720705/14:09
akahatjrosser, i'm still unclear what exactly breaking.14:09
noonedeadpunkopenstack-ansible-os_ironic role14:09
noonedeadpunkakahat: https://review.opendev.org/#/c/727067/14:10
akahatnoonedeadpunk, okay.14:11
akahatjohanssone, noonedeadpunk suggestions?14:11
akahatjohanssone, please ignore :)14:13
akahatjrosser, ^14:13
jrosserakahat: you saw that i made a depends-on patch for the openstack-ansible ironic tests? https://review.opendev.org/#/c/727067/14:13
johanssoneakahat: Kind of figured :). No worries.14:14
akahatjrosser, yes. I saw it. And it's network conflicts.14:14
akahat:)14:14
jrosseri did this to demonstrate that you patch makes a bunch of assumptions that are valid for the tripleo deployment, but not for the openstack-ansible one14:14
jrosserso as i was saying to chandankumar in out meeting on tuesday we should take care to only include things in os_tempest that absolutely need to be there14:15
jrosserjust one example, your test is assuming OVS, ours is assuming linuxbridge, so we must abstract that out as a minimum14:16
jrosserand i think that there is a more wide question for me, is it right that the tempest role is responsible for setting up the environment for ironic? i a a bit uncomfortable with that becasue it feels like part of the deployment, not part of the test runner14:17
akahatjrosser, got your point. So what you suggest.. what exactly i do here?14:22
jrosserin the openstack-ansible case specific resources like images and networks for special stuff like trove, octavia and ironic are internal to the deployment of those components, not in the tempest role14:25
jrosserbecaue the cloud operator would need the ironic provisioning network regardless of running tempest or not14:25
jrosserbut unfortunately i have no idea how these things are handled in tripleo to be able to comment on how things work there14:26
akahatjrosser, okay. thanks for the clarity. :)14:31
noonedeadpunkalso I think that we need make os_tempest to be able to run against not only CI but also prod deployments, like in cases when ppl want just to have tempest to check their deployemnt integrity14:32
akahatthat makes seance.14:34
noonedeadpunkjrosser: we need to come up with smth regarding https://review.opendev.org/#/c/726228/  - like I'm very open to advices14:46
jrosser:(14:47
jrossernoonedeadpunk: is it all the patches you are concerned about, or that one specifically?14:50
noonedeadpunklike the rest of that topic ore okeyinsh probably - just having link to contributing.rst.14:50
jrosseri just looked at os_glance and that seems like a good tidy up14:51
jrosserpoint to the integrated repo contributor guide and delete a load of stuff14:51
noonedeadpunkjrosser: yeah, they're probably ok. Maybe to minimalistinc, but that's tempalte:)14:52
noonedeadpunkalso wanted to talks about https://review.opendev.org/#/c/728052/14:52
noonedeadpunkLike I've just started workig and decided to talk about approach14:53
jrosserso i just looked at the docs preview https://6fff890ed033289a8522-64990ae6344a6a389f4859507c11a876.ssl.cf2.rackcdn.com/726228/5/check/openstack-tox-docs/eddfb53/docs/14:53
jrosserwhere even is the contributor guide :) ?14:53
noonedeadpunkalternative ways to do this are here  https://opendev.org/openstack/openstack-ansible/src/branch/master/playbooks/containers-nspawn-create.yml#L16-L18 or this https://opendev.org/openstack/openstack-ansible/src/branch/master/playbooks/ceph-rgw-install.yml#L28-L37\14:53
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-lxc_hosts master: [WIP] centos-8 support  https://review.opendev.org/72810814:54
noonedeadpunkjrosser: oh... I've placed it in Developer Documentation14:54
noonedeadpunkreally, we can probably move it to upper level?14:54
jrosserwell that is actually developer stuff14:54
jrosserbut we could have that other new page, the more generic one at the top level14:54
*** evrardjp has quit IRC14:55
jrosserthis one https://review.opendev.org/#/c/726228/5/doc/source/contributor/contributing.rst14:55
noonedeadpunkyeah, nice idea14:55
jrosserthen i think that makes some sense14:55
noonedeadpunkok, cool!14:55
*** fresta has quit IRC14:56
jrosserit should appear in the clue box top left with "user guide" "operations guide" ...14:56
jrosser*blue box14:56
*** evrardjp has joined #openstack-ansible14:56
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Enable plugin install and removal from mirrors  https://review.opendev.org/72811014:59
*** cp- has quit IRC15:02
*** gyee has joined #openstack-ansible15:04
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: [ussuri][goal] Update contributor documentation  https://review.opendev.org/72622815:05
mgariepydmsimard, do you have a workaround for this ? 2020-05-14 15:01:38.636254 | centos-8 | ERROR: ara 0.16.7 has requirement SQLAlchemy<1.3.0, but you'll have sqlalchemy 1.3.16 which is incompatible.15:05
mgariepyfrom : https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_8b1/728108/1/check/openstack-ansible-functional-centos-8/8b15aec/job-output.txt15:06
mgariepydo we need a old version of ara ?15:06
dmsimardmgariepy: it could probably be unpinned ? https://github.com/ansible-community/ara/blob/acf7769f00de59c2d388409af62ccaa030b7bfc5/requirements.txt#L5-L715:06
mgariepynoonedeadpunk, jrosser ?15:07
dmsimardI haven't tested 0.16 on centos-8 tbh15:07
*** cp- has joined #openstack-ansible15:07
mgariepywhy not install a newer release ?15:08
noonedeadpunkthats tough question lol15:08
jrossermgariepy: noonedeadpunk and I hold great affection for the old version :)15:08
noonedeadpunkwe can probably go on if centos 8 requires it15:08
noonedeadpunkbut yes)15:08
jrosserdmsimard: sorry about liking the old version so much :))15:08
noonedeadpunkI still like old one more lol15:08
mgariepylol15:09
*** fresta has joined #openstack-ansible15:09
dmsimardmgariepy: it's been tested in various ways like https://review.opendev.org/#/c/682587/ , https://review.opendev.org/#/c/696634/ and https://review.opendev.org/#/c/682962/15:09
dmsimardsorry about the new UI :( lol15:09
jrosserit's no criticism btw - i use it all the time and it's awesome15:09
dmsimardjrosser: no offense taken15:10
noonedeadpunkactually last version I saw was much better - at least it was usable15:10
noonedeadpunkLike having playbooks names, having reverse sorting15:10
*** fresta has quit IRC15:11
dmsimardhttps://api.demo.recordsansible.org/?name=&path=openstack-ansible&label=15:11
dmsimardthere's no search in the static html version though15:11
noonedeadpunkyeah:(15:12
*** fresta has joined #openstack-ansible15:12
noonedeadpunkLike I've missed what forced you to move to static version?15:12
dmsimardwhen openstack-infra moved logs to swift15:13
dmsimardwe lost the ability to dynamically render ansible.sqlite files off of a central log server15:13
noonedeadpunkoh, sorry, I meant more about design change between <1 and after 115:14
dmsimardtwo things, 1.x was re-written from scratch in django (0.x was flask) and 1.x doesn't require additional javascript dependencies15:15
dmsimardinstalling 0.x pulled in like 50 dependencies, 1.x pulls in like 5 :)15:15
dmsimardthere's ara-web for javascript persons but it's still very WIP and doesn't get much contributions15:15
dmsimardhttps://web.demo.recordsansible.org/ (it's not very pretty)15:16
dmsimardI am /not/ a javascript person15:17
noonedeadpunkyeah, I can totally get your point15:18
noonedeadpunkI can hardly do anything when it comes to UI as well...15:18
jrossernoonedeadpunk: docs look good - slight funny formatting with the link to lauchpad https://6ea4468309ffe2c3ce04-f26b85fb61fdc96fdf90ad547deeb51e.ssl.cf5.rackcdn.com/726228/6/check/openstack-tox-docs/19b4426/docs/contributor/contributing.html15:27
jrosserbut other than that i think we should call that done15:28
jrosserthen you want to talk about https://review.opendev.org/#/c/728052/ ?15:29
noonedeadpunkeventually they have it set as a list as well https://opendev.org/openstack/cookiecutter/raw/branch/master/%7b%7bcookiecutter.repo_name%7d%7d/doc/source/contributor/contributing.rst15:29
noonedeadpunkjrosser: yep15:30
jrosserok i think we call the docs done - too many hurting brain cells15:31
*** spatel has joined #openstack-ansible15:31
noonedeadpunkso regarding https://review.opendev.org/#/c/728052/15:31
noonedeadpunkthere are several ways to implement that15:31
noonedeadpunkas it takes literally each playbook we have I think I need to discuss it first15:32
noonedeadpunkbefore continuing15:32
spateljamesdenton: are you around?15:33
noonedeadpunkjrosser: I stopped at some point so to check if I don't miss smth while selecting an approach and can continue15:34
noonedeadpunkso option 1 - use 'always' tag for the play. Then facts are gathered and role is run with it's own tag (if provided). The downside that this will include pre-steps and post steps also "always" I think15:36
noonedeadpunkmaybe I should to mark all pre steps with role tag as well...15:36
noonedeadpunksecond option we have here https://opendev.org/openstack/openstack-ansible/src/branch/master/playbooks/containers-nspawn-create.yml#L16-L1815:37
noonedeadpunkso we do extra play which aims only to gather facts against hosts we're going run the role15:37
*** andrelf has joined #openstack-ansible15:37
noonedeadpunkand the third one is here https://opendev.org/openstack/openstack-ansible/src/branch/master/playbooks/ceph-rgw-install.yml#L28-L37 which eventually do setup in pre-step (dunno why but not liking that way)15:38
noonedeadpunkbut maybe second option is really better....15:39
*** dpaclt has joined #openstack-ansible15:45
*** fresta has quit IRC15:52
*** fresta has joined #openstack-ansible15:53
jrossernoonedeadpunk: i read the ansible issue there, and that is a big mess15:53
noonedeadpunkit was resolved in another one, but the idea is that ansible fixed "issue" when facts gathering was made even for play with specific tags15:54
noonedeadpunkthere's a bucnh of issues submitted regardign this topic15:55
jrosserand then on the question of if pre-tasks should be "always" thats also important, quite often required setup is in the pre_taskss15:55
noonedeadpunkhttps://github.com/ansible/ansible/issues/57529#issuecomment-50088676015:55
noonedeadpunkso if we go the way I started then I can just remove always tag from pre-task (as it's already present on upper level) and set like "cinder" tag on tasks without always15:57
noonedeadpunkto preserve behaviour15:57
noonedeadpunknot sure it's corect at the moment15:58
*** rpittau is now known as rpittau|afk16:01
jrosserwht does this do then https://review.opendev.org/#/c/728052/1/playbooks/containers-lxc-host.yml16:02
noonedeadpunkyeah, that does what I was talking about)16:03
jrosser"always gather facts when osa_gather_facts is true"16:03
*** gregwork has joined #openstack-ansible16:03
noonedeadpunkI mean I'm not sure that cureently we don't miss a tag somewhere16:04
jrosseri'm certain16:04
jrossergshippey looks very worried every time i suggest using --limit when doing upgrades16:04
noonedeadpunkSo if I'll do that it will preserve behaviour and solve our issue with facts gathering16:04
jrosserit's similar danger that something may go wrong becasue of misplaced tags16:05
noonedeadpunklimit is ok) but --tag should concern lol16:05
jrosser--limit without localhost or some other host you forgot in the list will go wrong16:05
noonedeadpunkah, yes, that's true16:06
noonedeadpunkbut it's more predictable lol16:06
noonedeadpunkthan just willing to update glance configs)16:06
jrosserthis looks understandable https://review.opendev.org/#/c/728052/1/playbooks/containers-lxc-host.yml16:07
noonedeadpunkso like https://opendev.org/openstack/openstack-ansible/src/branch/master/playbooks/containers-nspawn-create.yml#L16-L18 seems eathier to implement but looks not so plain16:07
jrosserthough are pre-tasks then "always" ?16:07
noonedeadpunkif pre-tasks are without tag then always16:08
noonedeadpunkotherwise - only with the matching tag16:08
jrosserso in that file it is not really useful to have the lxc-hosts tag?16:09
jrosserif we consider rsyslog-client to be legacy and should be deleted then it's on all the tasks16:10
jamesdentonspatel whats up?16:10
noonedeadpunkthe thing I found kind of broken is that while using tag lxc_hosts-install https://opendev.org/openstack/openstack-ansible-lxc_hosts/src/branch/master/tasks/main.yml#L59 it won't include any of pre-tasks16:10
jrosseroh well is that using tags as a shortcut instead of calling that playbook only16:11
noonedeadpunkSo I was considering tags as running only some specific part of the playbook16:11
noonedeadpunklike we do have <service>-config to adjust configuration and restart services without running python_venv_build, adding rabbitmq, etc16:12
spateljamesdenton: soon i am going to build 200 compute cloud so thinking to use openvswitch and i have no idea if openvswitch can scale that level16:12
jamesdentonsure it can16:13
spatelI really need to get DPDK because SRIOV isn't fun at all (specially in NUMA )16:13
noonedeadpunkbut if we're talking about lxc-hosts - yes, I think it's just for shortcut16:13
jamesdentoni would refrain from deploying DVR16:13
spatelDVR is very complex :(16:13
jamesdentonDPDK will still be NUMA sensitive, too16:13
noonedeadpunklike you run setup-hosts.yml --tags lxc-hosts and this will launch only containers creation or smth16:14
spatelbut DPDK support bonding on host and security group16:14
jamesdentoni would lab that out before doing a 200 node deployment16:15
jamesdentonjust to make sure you get a) the performance you're looking for and b) the components you want working (i.e. openvswitch firewall) don't have caveats16:15
spateljamesdenton: i am only worried about some kind of unknown bugs :(16:16
spateljamesdenton: i will do labbing before final deployment16:17
jamesdentonwell, i can yell you there are some known bugs with openvswitch firewall and dvr deployments today (even if DVR routers are not configured). but, they're being worked on. i'm curious to see how you get on with that configuration (dpdk, bonds, etc). keep us posted16:19
*** sshnaidm is now known as sshnaidm|afk16:21
spateljamesdenton: sure, i will16:22
spatelIn currently most standard deployment are 3 node controller, can i go with 5 node, any issue there (i don't think so but incase anyone disagree with me)16:24
jrosserspatel: if you think you are at the point of needing to scale out the controllers you could consider splitting them into API servers and rabbit/galera/memcached instead of just make 5 of each16:26
noonedeadpunkjrosser: oh... https://review.opendev.org/#/c/728052/1/playbooks/containers-lxc-host.yml is not working for pre tasks16:26
noonedeadpunkso they're still always16:27
jrossernoonedeadpunk: i think whats difficult here is that we have a tags setup that comes from when ansible worked differently16:27
jrosserand it just seems that the rules have changed16:27
noonedeadpunkyep, that is true16:28
*** udesale has quit IRC16:28
*** udesale_ has quit IRC16:28
jrosseri think what people really care about is the 'just do config'16:28
*** andrelf has quit IRC16:28
spateljrosser: you are saying make 3 node for API and 3 other node for rabbit/mysql/memcached (so total 6 nodes)16:28
noonedeadpunkat least that's what I care :p16:28
jrosserspatel: you can make it however you want :) but you must have a reason to want 5 instead of 3?16:29
jrosserand you've kind of got two choices, just make everything horizontally wider or start separating things away from each other if you're exceeding the capacity of one controller16:30
jrosserdepends on your motivation for needing to do it16:30
jamesdenton:thumbsup:16:30
spateljrosser: my problem is we don't know when company say we need to launch new product and now we need capacity so lets add 500 more compute nodes in cluster that point i don't want to do re-engineering (so want to keep controller plane strong enough)16:30
spatelcurrently i am running 400 compute nodes with 3 controller with lots of tweaking on timers etc.. to make things happy :(16:31
*** evrardjp has quit IRC16:33
*** evrardjp has joined #openstack-ansible16:33
noonedeadpunkjrosser: ok, thanks for discussion, I understood that I really made a mistake16:34
spatelI think i would go with 6 nodes plan that would be good to keep rabbitMQ outside of API plane.16:34
jrossernoonedeadpunk: i'm not really having very much clarity about what the right answer is unfortunately :(16:34
jrosserbut, anything that can make simpler is good - and if we have tags that don't work there is an argument to remove them16:35
jrosserthen we can re-add specific things for "config only" when we understand better16:35
jrosserspatel: really it depends on your application and rate of churn, sounds like you have optimised rabbit a lot so you could move that aside, and if you spend a lot of CPU on neutron agents for the control plane you can also move that away too16:37
jrosser*L3 stuff i mean16:37
spatelI am using vlan base provider so i don't have any virtual routers etc.. but i have noticed neutron and rabbitmq are big time CPU eater (mysql really doing nothing in my case)16:38
spateljrosser: look at my CPU load after tuning rabbitmq/neutron - https://imgur.com/a/grRttjH16:40
jrosserthen maybe there is your answer - dedicated nodes for rabbitmq would benefit your workload16:40
jrosserand release CPU time on the controller for other things16:40
spatel++16:41
spateljrosser: any advantage to use metal for rabbitmq instead of LXC ?16:48
openstackgerritMerged openstack/openstack-ansible master: Increase disk size for manila service VM during tests  https://review.opendev.org/72782717:10
noonedeadpunkwhat are healthcheck-* playbooks o_O17:17
noonedeadpunkit looks like early implementation of tempest lol17:18
jrosseri think it's tempestless deployment sanity check17:20
jrosserevrardjp did that i think17:20
* noonedeadpunk wondering if anybody use them17:20
noonedeadpunkI see17:20
noonedeadpunkJust the first time I did so close look through all of our playbooks17:21
evrardjpprobably no one17:23
evrardjpbut that should be removed from the docs :p17:24
noonedeadpunkis it even in docs?:)17:24
evrardjpthough it helped me quite a few times for people having problem on this channel: Just run these playbooks, report to me what's the output17:24
evrardjpI think it was17:24
noonedeadpunkI wasn't going to drop them I was just surprised having them lol17:24
evrardjpnot sure what the current state though :p17:24
evrardjphow are folks doing in here?17:25
evrardjpis everything okay for you?17:25
*** andrelf has joined #openstack-ansible17:25
evrardjpnoonedeadpunk: oh you do whatever you want with them, I don't really have a stake in that game anymore :D17:25
* noonedeadpunk totally failed releasing17:25
evrardjpit's hard to keep up when you have thousand of things to do :)17:26
noonedeadpunklike we should have been branched17:26
noonedeadpunkbut generally pretty fine:)17:26
noonedeadpunkexhausted because of all these covid limitations, you know)17:26
*** yolanda has quit IRC17:28
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Only restart rsyslog when it is installed  https://review.opendev.org/72785117:36
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Resolve issue with undefined facts while running with tags  https://review.opendev.org/72805217:53
noonedeadpunkjrosser: that's what I get from this tag thing ^17:53
noonedeadpunkguilhermesp: spotz +w for https://review.opendev.org/#/c/726228/ ?:)17:56
spotznoonedeadpunk: done17:57
noonedeadpunkthanks)17:57
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/ansible-hardening master: WIP Centos-8 support  https://review.opendev.org/70946018:00
guilhermespcool col noonedeadpunk looking18:07
guilhermespgood it seems spotz alraedy +w :P18:07
noonedeadpunkyeah:)18:07
noonedeadpunksorry for disturbing:)18:07
spotz:) Hey when I'm pinged and awake I try to be quick:)18:08
guilhermespno worries at all. i guess we have then a lot of review for roles18:08
noonedeadpunkReally appreciated :)18:08
noonedeadpunkjrosser: can you recall what we've decided with lsync on centos8? Seems just commenting out for now? https://review.opendev.org/#/c/709532/3/vars/redhat-8.yml18:09
*** andrelf has quit IRC18:15
openstackgerritMerged openstack/openstack-ansible master: [ussuri][goal] Update contributor documentation  https://review.opendev.org/72622818:15
noonedeadpunkok, so contributing page is live:) https://docs.openstack.org/openstack-ansible/latest/contributor/contributing.html18:21
noonedeadpunkwe can look through https://review.opendev.org/#/q/topic:project-ptl-and-contrib-docs+(status:open) now:)18:21
jrossernoonedeadpunk: I looked at iSync and found a method to use centos 7 epel for just lsync, on centos 818:29
mgariepy(╯°□°)╯︵ ┻━┻ el8..18:29
jrosserargh *lsync not iSync18:29
noonedeadpunkxD18:29
* jrosser blames iPhone18:29
noonedeadpunkI just tested build from soure and it worked as well...18:30
mgariepyof course it work, it's not the reason for removing it ! :P haha18:31
jrosserhttps://www.liquidweb.com/kb/how-to-sync-two-centos-8-servers-using-file-replication/18:31
noonedeadpunkAH I read it today:)18:31
jrossernoonedeadpunk: I also built it from source :)18:31
jrosserthe build was easy and as the repo server needs a tool chain anyway it’s not so bad18:32
noonedeadpunkusing epel7 is too hacky I think...18:32
noonedeadpunklike may break thing later18:33
* jrosser didn’t get to look at galera role again18:35
jrossertoday has evaporated in meetings18:35
*** dpaclt has quit IRC18:36
openstackgerritChandan Kumar (raukadah) proposed openstack/openstack-ansible master: Enable octavia tempest tests  https://review.opendev.org/72794918:40
openstackgerritChandan Kumar (raukadah) proposed openstack/openstack-ansible master: Enable octavia tempest tests  https://review.opendev.org/72794918:41
openstackgerritChandan Kumar (raukadah) proposed openstack/openstack-ansible-os_octavia master: [WIP] enable octavia tempest tests  https://review.opendev.org/72785618:42
mgariepyalso, no btrfs on centos8.19:03
noonedeadpunkseems it's easiers to name what is present19:04
mgariepylol19:04
mgariepythe list would be shorter for sure,\19:04
*** NewJorg has quit IRC19:04
mgariepynot fun at all19:05
*** NewJorg has joined #openstack-ansible19:10
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-tests master: [WIP] centos8  https://review.opendev.org/72825919:12
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-lxc_hosts master: [WIP] centos-8 support  https://review.opendev.org/72810819:13
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-lxc_hosts master: [WIP] centos-8 support  https://review.opendev.org/72810819:14
mgariepyat the speed i progress i doubt i'll have it done before the end of the year.19:21
noonedeadpunkActually I think basic source roles should work nicely19:21
mgariepylol19:22
noonedeadpunkAnd I'll also try to help a bitwith that19:22
mgariepyyou think..19:22
mgariepylol19:22
noonedeadpunkAh, yeah, distro packages....19:22
mgariepyi'd like to have lxc so can test stuff more quickly.19:22
noonedeadpunkI pray lol19:22
mgariepyin the 12 lines of patches i made today, i had like 4-5 roadblock19:23
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-repo_server master: WIP Centos-8 support  https://review.opendev.org/70953219:23
noonedeadpunkthat is annoying19:23
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: [WIP] Centos-8 support  https://review.opendev.org/68962919:27
noonedeadpunkok, so the last time for metal we were stuck on galera https://zuul.opendev.org/t/openstack/build/897deaaccb324348a6251aaa8a675ff1/log/job-output.txt#1213019:28
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-tests master: [WIP] centos8  https://review.opendev.org/72825919:30
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-galera_server master: WIP Centos-8 support  https://review.opendev.org/72472119:51
mgariepyyep galera was not working. my patch doesn't apply anymore. but the galera-4 stuff was in it.19:58
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/ansible-hardening master: Remove ⌘ symbol from docs  https://review.opendev.org/72827819:58
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-repo_server master: WIP Centos-8 support  https://review.opendev.org/70953220:02
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: [WIP] Centos-8 support  https://review.opendev.org/68962920:03
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-galera_server master: WIP Centos-8 support  https://review.opendev.org/72472120:11
noonedeadpunkmgariepy: I dropped depends-on for galera patch as it was in conflict because of that20:13
noonedeadpunklike anyway galera bump to 10.4 is known to be broken at the moment because of the client20:14
jrossernoonedeadpunk: i am probably not going to be able to look at the galera role combining till next week20:25
jrosseri think there is just maybe a silly error of some kind in the role20:25
jrosserbut the tests are still trying to use galera_client and i didnt have time to take that out20:26
jrossernot stopping using galera_client is the biggest thing to fix next20:26
noonedeadpunkok, got it. will try to look at it tomorrow20:29
jrosseralso mnaser guilhermesp there are a bunch of small patches for deprecations and bug fixes to review if you’ve got a moment20:32
guilhermespsure thing jrosser i will take a look today20:47
*** born2bake has quit IRC21:24
*** spatel has quit IRC21:33
openstackgerritMerged openstack/openstack-ansible-tests master: Update ansible to 2.9.9  https://review.opendev.org/72792622:12
*** jbadiapa has quit IRC22:25
*** tosky has quit IRC23:05
*** schwicht has quit IRC23:06
openstackgerritMerged openstack/openstack-ansible-os_rally master: Cleanup after repo_build and pip_install retirement  https://review.opendev.org/72741423:11
*** schwicht has joined #openstack-ansible23:15
openstackgerritMerged openstack/openstack-ansible master: Bump ansible version to 2.9.9  https://review.opendev.org/72792523:53

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!