Wednesday, 2020-06-10

*** cshen has joined #openstack-ansible00:44
*** cshen has quit IRC00:49
*** watersj has quit IRC01:05
*** jawad_axd has joined #openstack-ansible01:12
*** threestrands has joined #openstack-ansible01:19
*** jawad_axd has quit IRC01:45
*** rh-jelabarre has quit IRC01:58
*** cshen has joined #openstack-ansible02:02
*** cshen has quit IRC02:07
*** cshen has joined #openstack-ansible04:03
*** cshen has quit IRC04:07
*** dpaclt has joined #openstack-ansible04:11
*** jcath has joined #openstack-ansible04:19
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-ansible04:33
*** jawad_axd has joined #openstack-ansible04:48
*** udesale has joined #openstack-ansible04:56
*** cheng1 has quit IRC06:00
*** cheng1 has joined #openstack-ansible06:02
*** djhankb has quit IRC06:08
*** jeh has quit IRC06:10
*** vesper has quit IRC06:18
*** LuckyClover has quit IRC06:18
*** vesper11 has joined #openstack-ansible06:18
*** cheng1 has quit IRC06:25
*** cheng1 has joined #openstack-ansible06:28
openstackgerritCarlos Augusto da Silva Martins proposed openstack/openstack-ansible-os_horizon stable/stein: Add drop_down_choices to Horizon  https://review.opendev.org/73475306:36
*** jeh has joined #openstack-ansible06:43
*** cheng1 has quit IRC07:02
*** cheng1 has joined #openstack-ansible07:04
*** cshen has joined #openstack-ansible07:07
openstackgerritJonathan Rosser proposed openstack/ansible-role-systemd_service master: Revert "Build out the PrivateNetwork function for services"  https://review.opendev.org/73459807:19
*** rpittau|afk is now known as rpittau07:21
*** tosky has joined #openstack-ansible07:29
*** itandops has joined #openstack-ansible07:34
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Remove git repo haproxy backend  https://review.opendev.org/73458708:13
jannoI'd appreciate if someone can comment on my task before commiting it: https://pastebin.com/E1S0UicZ08:14
jannoespecially with regard to disabled Cinder services08:14
jannoIs it necessary to take them into account?08:15
jannoAre they a thing in production environments?08:15
*** kaiokmo has joined #openstack-ansible08:18
* noonedeadpunk missing context08:18
noonedeadpunkeventually you may push a patch to gerrit, it's like a nicer place to leave reviews:)08:19
noonedeadpunkyou can modify it easily afterwards08:19
jannoalright08:19
noonedeadpunkalso I can say I have disabled cinder service...08:20
noonedeadpunkBut rly not sure I got what problem we're trying to eliminate here....08:21
jannoI had the problem during the upgrade from 19.0.1 to 19.1.1 that one cinder-service was down. The upgrade therefore failed during db online_data_migrations with some unspecific error08:24
noonedeadpunkok, and how does this task would resolve it?08:25
jannoand afair jrosser suggested that a check if all cinder services are available before doing the migrations makes sense08:25
noonedeadpunkSo the thing is that it can be pre-upgrade check08:26
jannoit just does a check if all services are up. if not it fails08:26
noonedeadpunkSo all depends on what you're going to patch08:26
jannotasks/cinder_db_sync.yml08:26
jrosseryeah we have a fair few people who get in trouble with cinder migrations, and it's really unobvious that you need all the cinder-volume services to be up08:26
jrosserthe error message is totally unhelpful and you end up with a traceback in the log i think, and little clue about why it's breaking08:27
jannoI'd add the task as first task to tasks/cinder_db_sync.yml08:27
jannoa check before upgrading would not have helped in my case because the failed service was caused by the upgrade08:28
noonedeadpunkI think then we need assert or smth to display a valid error here08:29
jrosserthis would also need to be robust to whatever happens during a fresh install too08:29
noonedeadpunkand eventually, we need online_data_migrations only during major upgrades08:29
jrosserjanno: looking back through my notes when we encoutered similar things at upgrade, disabling the broken backend services was not enough to make the db migrarion work08:30
jrosserthey had to either be deleted or fixed before you could proceed08:31
noonedeadpunk+08:31
jrosseralso, good morning all :)08:32
noonedeadpunk\o/08:32
jannoin this case this check would be sufficient. but yes, you are right, I don't yet know how it behaves during fresh install08:32
jrosserjanno: easiest thing so to make a patch and push it to gerrit, that will all get tested08:34
noonedeadpunkI'd add at least conditions the same as for online_data_migrations task and run_once08:36
noonedeadpunkor smth08:36
noonedeadpunk(just to run this task just once)08:37
jrosseri tried to put a bit more details in https://etherpad.opendev.org/p/openstack-ansible-ussuri08:40
jannothis is already the case, because import_tasks: cinder_db_sync.yml is bound to the conditions08:43
jannoI'll push it in a second08:43
noonedeadpunkyeah, ok, youre right08:43
noonedeadpunkanyway I guess https://opendev.org/openstack/openstack-ansible-os_cinder/src/branch/master/tasks/cinder_db_sync.yml#L26-L28 needed?08:43
jannomight make sense08:45
noonedeadpunkAlso would be cool to do this with 2 tasks - first your one, which would check and register, and second like this https://opendev.org/openstack/openstack-ansible-os_cinder/src/branch/master/tasks/main.yml#L28-L3108:47
noonedeadpunkwhich would show valid error message with some kind of explanations why we fail and what to do08:47
jrossernoonedeadpunk: i was giving myself a bit of a break from the focal work, looks like upgrades are broken08:49
jrosserdid you think that was to do with apt-pinning in galera?08:49
noonedeadpunkT-U upgrades?08:50
noonedeadpunkok, we didn't merge https://review.opendev.org/#/c/733301/...08:53
noonedeadpunkReally need to look why functional tests randomly fail08:53
noonedeadpunk(in terms what to check to really wait for cluster sync completition status)08:53
jrosserupgrades on master, yes, like here https://review.opendev.org/#/c/732123/08:54
jrosseroh right yes i see.... wonder whats wrong with all those ssl jobs.....08:55
noonedeadpunk"var/lib/mysql: found previous version 10.3\r\nFailed to stop mysql.service: Unit mysql.service not loaded.\r\n'systemctl stop mysql' returned 5\r\nThere is a MySQL server running, but we failed in our attempts to stop it."08:56
noonedeadpunkSo it's not pinning but really just the process of mariadb upgrade fails...08:56
noonedeadpunkSo we kind of check for wsrep_incoming_addresses in https://review.opendev.org/#/c/733301/1/tests/test-galera-server-functional.yml and sometimes it's ok, and sometimes it's not enough...08:57
jannoI am already re-writing the task08:57
*** poopcat has quit IRC09:03
jannoI'll test it again first before pushing it09:06
*** poopcat has joined #openstack-ansible09:09
*** jbadiapa has joined #openstack-ansible09:10
*** spatel has joined #openstack-ansible09:13
*** spatel has quit IRC09:18
jannonext try, not tested yet: https://pastebin.com/masLb1fq09:20
noonedeadpunkjanno: oh....09:24
noonedeadpunkmaybe we can just use block and rescue?09:24
jcathhello, jrosser. I try to test aio deployment of OSA today, when I go to apply setup_openstack.yml now, it reports "misspelled module name" when proceed to service_setup.yml of keystone. I found that module name in yml is openstack.cloud.os_keystone_domain, something like that, but at sub-dir under  /opt/ansible-runtime, i see this path: /opt/ansible-runtime/lib/python3.6/site-packages/ansible/modules/cloud/openstack, it seems the name's order is09:25
jcathreversed?09:25
noonedeadpunkSo in case online_data_migrations fails we go to rescue, check for service list and display reasonable mesaage?09:25
noonedeadpunkSo we do like try\except09:25
jrosserjcath: you are using master?09:25
noonedeadpunkIf we don't catch error with online migrations - we get rid of another task09:26
jcathyes, I think. I just git clone the openstack-ansible, and following the quickref of aio09:26
jcathbootstrap-ansible, bootstrap-aio ....09:26
jrosserjcath: i would recommend that you use either the stable/train, or a specific tag from the train branch09:26
jannonoonedeadpunk: I'm not sure if broken cinder services can be the only reason for the task to fail.09:27
jcathoh, i c.09:27
jannonoonedeadpunk: if there is another reason it might be misleading09:27
jrosserjcath: master is where we are working on the Victoria release, Ussuri branch is currently a release candidate and not finished, so Train is currently the best choice09:28
jcathtry now... thanks, jrosser09:28
noonedeadpunkjanno: so we can do smth like that http://paste.openstack.org/show/794555/09:28
noonedeadpunkyes, this might be not the only reason.09:28
jcathhow about stein, my last deployment with packstack is stein, is there much difference between stein/train?09:29
noonedeadpunkso we can probably add another fail task there with `when: failed_cinder_services.rc == 1`09:29
noonedeadpunkand some general messae that migrations are failed while all services are up09:30
jannohttp://paste.openstack.org/show/794556/09:35
noonedeadpunkI think it's perfect now - as we really cover our issue with untrivial failure09:36
noonedeadpunkAlso we can probably try to start down services as step 2 afterwards or figure ou some another workaround09:37
jannoBefore testing I need to re-install my test cluster. Should I wait with pushing until I tested it locally or shall I push now?09:37
noonedeadpunkI'd say push it09:37
noonedeadpunkand will see in CI what happens :)09:37
noonedeadpunkI just missed when section, hope it's still there :p)09:38
*** amalrajgenocidex has joined #openstack-ansible09:55
amalrajgenocidexI was deploying magnum and encountered below bug. It exists in all stable/train and ussuri. Is there any fix for it?09:56
amalrajgenocidexhttps://storyboard.openstack.org/#!/story/2007591#comment-15923509:56
amalrajgenocidexTrying to label master node with node-role.kubernetes.io/master=""09:57
amalrajgenocidexk8s-calico-coreos-3dljpm3zmgow-master-0 --patch '{"metadata": {"labels": {"node-role.kubernetes.io/master": ""}}}'09:57
openstackgerritJan Marquardt proposed openstack/openstack-ansible-os_cinder master: Added checks for failed cinder services  https://review.opendev.org/73477809:59
jannodamn10:00
jannobecome and become_user in "Perform online data migrations" is redundant10:01
noonedeadpunkjust edit patch, do git add .; git commit --amend; git review10:03
noonedeadpunk(if you need an edit ofc)10:03
openstackgerritJan Marquardt proposed openstack/openstack-ansible-os_cinder master: Added checks for failed cinder services  https://review.opendev.org/73477810:03
*** cshen has quit IRC10:03
noonedeadpunkand delete trailing whitespaces :p10:04
openstackgerritJan Marquardt proposed openstack/openstack-ansible-os_cinder master: Added checks for failed cinder services  https://review.opendev.org/73477810:05
jannobetter? :P10:06
noonedeadpunkyep:)10:08
*** sshnaidm|afk is now known as sshnaidm10:14
jrosseramalrajgenocidex: that is a bug in magnum rather than openstack-ansible i think?10:18
*** rpittau is now known as rpittau|bbl10:19
jrosseramalrajgenocidex: it seems they are working on a patch for that from the storyboard link10:20
jrosseronce that merges into magnum and is backported to the branch you want OSA can deploy that for you10:20
*** cshen has joined #openstack-ansible10:55
amalrajgenocidexThanks jrosser . I will wait for the bug fix then :(  (y)11:05
*** cshen has quit IRC11:07
*** watersj has joined #openstack-ansible11:12
*** threestrands has quit IRC11:16
*** zigo has quit IRC11:41
*** amalrajgenocidex has quit IRC11:41
openstackgerritamolkahat proposed openstack/openstack-ansible-os_tempest master: Added tempest ironic resources setup.  https://review.opendev.org/72070511:44
jannothere have been two failed Zuul checks for my commit, but they look unrelated11:45
*** zigo has joined #openstack-ansible11:55
*** rh-jelabarre has joined #openstack-ansible11:57
*** rpittau|bbl is now known as rpittau12:05
*** cshen has joined #openstack-ansible12:18
openstackgerritSagi Shnaidman proposed openstack/openstack-ansible-os_tempest master: Use ansible openstack collection  https://review.opendev.org/71863912:29
*** itandops_ has joined #openstack-ansible12:30
mgariepymorning everyone12:32
*** itandops has quit IRC12:34
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible master: Remove /usr/bin/python on bionic for CI jobs  https://review.opendev.org/73147612:51
jannowhen doing fresh install, I, now and then, stumble across missing openstacksdk messages: http://paste.openstack.org/show/794564/12:52
jannoI know how to fix this, but I am wondering if this is an unknown issue or is it fixed in newer versions? I am currently installing 19.0.1, but I saw this during upgrade from Stein to Train as well12:54
*** udesale_ has joined #openstack-ansible12:54
mgariepyhow are the gate check prioritized to start ? are they starting depending on the time they take to complete or its somewhat random when the job is scheduled ?12:55
*** udesale has quit IRC12:57
*** d34dh0r53 has quit IRC13:01
*** d34dh0r53 has joined #openstack-ansible13:07
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_horizon master: Compile mod-wsgi module for CentOS 7  https://review.opendev.org/73460813:07
noonedeadpunkjrosser: have you looked closer on upgrade jobs stuff?13:07
noonedeadpunkas was going to look at it13:07
jrosserno, i've not looked at that today13:09
mgariepyjrosser, the depends on for the auto stuff seems to fix the bionic metal check on https://review.opendev.org/73147613:12
jrosserjanno: the tasks you paste there are delegated to a service setup host?13:12
jrosseroh err you have 10.10.10.3 and 10.10.10.1 there, do those addresses make sense?13:12
jrossermgariepy: do you think we need both? i.e 'auto' will still prefer /usr/bin/python(2) if it's present?13:12
* jrosser slightly losing the plot with this :)13:13
mgariepyauto will prefer python3 is present for bionic13:14
mgariepyi think13:14
jannojrosser: yes, they are delegated to a service setup host13:14
jrosserjanno: have you also set the python interpreter for the service setup host?13:15
mgariepythe auto will take the config in the base.yml file https://github.com/ansible/ansible/blob/stable-2.9/lib/ansible/config/base.yml#L1435-L145013:15
*** d34dh0r53 has quit IRC13:15
jrosserjanno: i have a patch not yet merged to make this the default btw https://review.opendev.org/#/c/733854/13:15
mgariepylet me look at the code once more13:16
jannojrosser: no, I don't set openstack_service_setup_host_python_interpreter13:17
jrossermgariepy: i think what i mean is that your patch is passing for metal/bionic on it's own https://review.opendev.org/#/c/734672/13:17
jrosserso mine is probably not needed13:17
jrosserjanno: i think that is quite possibly the issue, openstacksdk will be installed into the utility venv in the utility host, not into the host python13:18
openstackgerritCarlos Augusto da Silva Martins proposed openstack/openstack-ansible-os_horizon stable/stein: Horizon configuration to support domains dropdown  https://review.opendev.org/73483413:20
mgariepyhttps://github.com/ansible/ansible/blob/stable-2.9/lib/ansible/executor/interpreter_discovery.py#L19213:23
mgariepyso, if the exac version for the distro is not there ie: centos7, it will take the config from centos6, dito for ubuntu versions.13:23
mgariepyso indeed we should not need to remove python from the CI.13:24
*** cheng1 has quit IRC13:31
*** cshen has quit IRC13:35
*** cheng1 has joined #openstack-ansible13:36
*** cshen has joined #openstack-ansible13:44
*** cshen has quit IRC13:45
*** jawad_axd has quit IRC13:47
*** cheng1 has quit IRC13:50
*** cheng1 has joined #openstack-ansible13:52
*** udesale_ has quit IRC14:10
*** sshnaidm is now known as sshnaidm|bbl14:23
*** cheng1 has quit IRC14:38
*** cheng1 has joined #openstack-ansible14:41
*** also_stingrayza has joined #openstack-ansible14:44
*** stingrayza has quit IRC14:48
*** cheng1 has quit IRC15:29
*** cheng1 has joined #openstack-ansible15:33
johnsomHi OSA folks! We are getting some reports of folks installing Train with OSA getting a non-Train version of octavia-dashboard. Looking at the SHA in https://github.com/openstack/openstack-ansible/blob/stable/train/playbooks/defaults/repo_packages/openstack_services.yml#L309 I can't find that SHA in octavia-dashboard (or anywhere really). This looks like some sort of automated script set this.15:43
johnsomCan someone point me to where this script lives?15:43
johnsomI'm trying to figure out where that SHA came from.15:43
johnsomMy guess is that this SHA is bogus and people are ending up with the master branch version.15:44
noonedeadpunkoh....15:44
noonedeadpunkBut this sha is eventually the latest commit for stable/train? https://opendev.org/openstack/octavia-dashboard/commits/branch/stable/train15:45
noonedeadpunkSo https://opendev.org/openstack/octavia-dashboard/commit/74044687e0ef5b74853258a0f9ce2be7320e88f0 is valid link15:46
johnsomOh, now that is strange, I re-checked it out and found it.15:47
johnsomNevermind then, I will still look into this. It's odd as the code for the error they are getting is only in Ussuri and newer.15:48
noonedeadpunkbut....15:49
johnsomHmm, that is so odd. The search on github still doesn't find that sha.15:49
noonedeadpunkI think I know what the issue is15:49
johnsomAh, I am all ears15:49
noonedeadpunklet me just check the idea...15:50
noonedeadpunkyeah....15:50
johnsomBTW, this has been reported here: https://bugs.launchpad.net/openstack-ansible/+bug/188187415:51
openstackLaunchpad bug 1881874 in octavia-dashboard (Ubuntu) "Unable to launch Loadbalancer from Horizon Dashboard " [Undecided,Incomplete]15:51
noonedeadpunkWas just looking at it today :)15:52
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_horizon master: Add octavia version to constraints  https://review.opendev.org/73488115:53
noonedeadpunkjohnsom: ^15:53
*** gyee has joined #openstack-ansible15:54
johnsomnoonedeadpunk Ah, interesting. Thanks!15:54
noonedeadpunkwe just missed it:(15:54
noonedeadpunkdpaclt: I guess you was facing this issue15:55
*** rpittau is now known as rpittau|afk16:07
openstackgerritamolkahat proposed openstack/openstack-ansible-os_tempest master: Added tempest ironic resources setup.  https://review.opendev.org/72070516:08
*** cheng1 has quit IRC16:08
*** cheng1 has joined #openstack-ansible16:09
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Convert host and container journal collection to python  https://review.opendev.org/73488316:11
noonedeadpunkfound issue with upgrade jobs...16:15
*** maharg101 has quit IRC16:19
*** maharg101 has joined #openstack-ansible16:26
jrosseroh excellent16:28
noonedeadpunkin terms of glera, unfortunatelly16:29
noonedeadpunk(not how to make them use current patches and depends-on unfortunatelly)16:29
* noonedeadpunk should fix jobs itelfs as well...16:30
openstackgerritJames Denton proposed openstack/openstack-ansible-os_ironic master: WIP - Add support for uefi booting  https://review.opendev.org/73488616:31
*** gyee has quit IRC16:42
dpacltnoonedeadpunk yeah i was facing issue with stable/train and i just upgraded octavia alone to ussuri and the issue was fixed16:50
dpacltAnd yeah i raised the bug and also mentioned it in storyboard too16:50
dpacltNot exactly with stable/train  but with branch 20.1.1 as i was unable to deploy with stable/train OSA at that time16:51
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible master: auto-detect interpreter.  https://review.opendev.org/73467216:52
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-galera_server master: Fix Mariadb 10.3 -> 10.4 upgrade path  https://review.opendev.org/73488816:53
*** jcath has quit IRC16:53
noonedeadpunkdpaclt: eventually using tags even recommended way...16:54
noonedeadpunkand that patch should fix horizon octavia dashboard16:54
noonedeadpunkhttps://review.opendev.org/73488116:54
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible master: auto-detect interpreter.  https://review.opendev.org/73467216:54
dpacltnoonedeadpunk so this https://review.opendev.org/734881  should fix octavia dashboard in train ?16:55
noonedeadpunkI hope it should16:56
noonedeadpunkIt would be the same for train16:56
dpacltohh ok Thanks16:59
*** gyee has joined #openstack-ansible17:08
jrosserneed another vote on this https://review.opendev.org/#/c/732064/ to unblock stein17:11
mgariepylooking17:11
jrossercool thanks17:12
mgariepydone :) haha17:12
mgariepywasn't that hard to review17:12
mgariepyjrosser, how do we change the interpreter patch for debian only ?17:14
mgariepycan we do | omit for the interpreter var ?17:14
jrosserwhich one?17:14
mgariepythe one you did for 20.0417:14
mgariepywould probably need it for debian17:15
mgariepyhttps://review.opendev.org/#/c/733948/17:15
jrosserthe decision about which interpreter to use is here https://review.opendev.org/#/c/733948/17/test-ansible-functional.sh17:16
mgariepyi like the auto one, but for debian it's not going to get a backport on 2.917:16
mgariepyhttps://review.opendev.org/#/c/733948/17/test-prepare-containers.yml can we do omit here ?17:17
jrosserso yesterday i mentioned a hybrid approach17:17
jrosserin my patch you could do auto17:17
jrosserexcept for debian where we set it specifically17:17
jrosserso just change the logic in test-ansible-functional.sh to be that17:18
jrosseromit only works on module parameters17:18
mgariepyok17:19
jrossersort of like this maybe http://paste.openstack.org/show/794594/17:19
mgariepyok i'll modify your patch to test that.17:20
jrosserhopefully we can use the auto keyword anywhere we like17:21
mgariepyi dont think it's possible17:21
mgariepyinterpreter_python can be auto in either ENV or default section of ansible.cfg17:22
jrosseri was thinking we could either template ansible.cfg, or carry a python3 specific ansible.cfg17:22
mgariepyYou can still set ansible_python_interpreter to a specific path at any variable level (for example, in host_vars, in vars files, in playbooks, etc.). Setting a specific path completely disables automatic interpreter discovery; Ansible always uses the path specified.17:22
jrosseri think there is a step somewhere that symlinks ansible.cfg to the right place17:22
jrossermgariepy: maybe you can do something here to just write the value we want into ansible.cfg? https://github.com/openstack/openstack-ansible-tests/blob/master/test-ansible-env-prep.sh#L248-L25817:24
mgariepywow. the doc is really confixung17:24
mgariepyhttps://docs.ansible.com/ansible/latest/reference_appendices/config.html#envvar-ANSIBLE_PYTHON_INTERPRETER17:25
mgariepyi'll do some tests i guess.17:25
*** jbadiapa has quit IRC17:30
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Convert host and container journal collection to python  https://review.opendev.org/73488317:33
*** dpaclt has quit IRC17:37
*** sshnaidm|bbl is now known as sshnaidm17:40
noonedeadpunkjrosser: I'm a bit stuck with galera..... trying to find what's was first chicken or egg....17:43
mgariepyprobably the chicken17:44
noonedeadpunkSo the thing is, that when we run https://opendev.org/openstack/openstack-ansible-galera_server/src/branch/master/tasks/galera_install_apt.yml#L81 it drops galera-server package17:44
noonedeadpunkwhich is needed here https://opendev.org/openstack/openstack-ansible-galera_server/src/branch/master/tasks/galera_server_upgrade_pre.yml#L2217:45
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible master: auto-detect interpreter.  https://review.opendev.org/73467217:49
*** cheng1 has quit IRC17:50
*** cheng1 has joined #openstack-ansible17:50
jrosserwhy does installing packages remove them?17:53
noonedeadpunkDependencies? http://paste.openstack.org/show/794595/17:53
noonedeadpunkwe're installing 10.4 client over 10.3...17:54
noonedeadpunkIt updates mariadb-common which depends on server....17:54
noonedeadpunk*on which server depends17:54
mgariepywould probably need to do the client and server pkg at the same time ?17:55
noonedeadpunkSo when we check for the service it already do not exist, so we don;'t stop it and fail during new package isntallation:(17:55
noonedeadpunkso we don't run galera_client part against galera hosts?17:56
noonedeadpunkhm, yeah, that's interesting17:56
mgariepyjrosser, do you mind if i merge your patch in mine ?18:00
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-galera_server master: Fix Mariadb 10.3 -> 10.4 upgrade path  https://review.opendev.org/73488818:00
jrossermgariepy: sure go for it18:00
noonedeadpunkjrosser: https://review.opendev.org/#/c/734608/ worked for me in sandbox18:04
noonedeadpunkhttps://199.204.45.225/18:04
noonedeadpunkmmmm18:05
jrosserindeed mmmmm18:05
noonedeadpunkIt's more like network stuff:)18:06
noonedeadpunkor oom...18:06
*** jbadiapa has joined #openstack-ansible18:06
jrosserhow does that work?18:08
jrosseris it a binary shipped as a pip module or does it build it?18:08
noonedeadpunkIt builds it18:08
noonedeadpunkand then provides path to it18:08
noonedeadpunkthat's why we need httpd-devel....18:09
noonedeadpunkcan go another patch and try to replace with uwsgi18:09
noonedeadpunk(it was just easier so strated from it)18:09
jrosserdepends if we see a need to switch to uwsgi, like if there is benefit from changing things18:10
noonedeadpunk(restored vm access and put your keys for centos user on it)18:11
noonedeadpunkjust in case18:11
noonedeadpunkregarding benefit... maybe it will be more about unification... but a bit scared about like proxying things to uwsgi...18:12
noonedeadpunkall headers and stuff...18:12
noonedeadpunkOk, will try uwsgi option as well then and we'll have options to choose from18:13
jrosserit's always been a bit surprising the apache/nginx dual operation for keystone18:15
noonedeadpunkbut don't really see anything wrong with building that bodule... It's build with apx, so it takes seconds to finish build18:15
jrosserif it's working, and we drop it anyway at some point with centos-8 coming on, it's not too bad18:15
noonedeadpunkfor centos8 we're gonna build lsyncd :p18:16
jrosserswings/roundabouts :)18:16
jrosseri spent some time today messing with the log collection18:17
jrosserturns out its been too long since i did python18:17
noonedeadpunkoh, I miss that part also nowadays... Need some hands on osome py stuff as well...18:19
jrosseri just diregarded making it py2/318:19
jrosserneed to address that as it's not going to work on centos718:19
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-tests master: auto-detect interpreter  https://review.opendev.org/73467618:20
noonedeadpunkah, let's gonna drop it once get centos8...18:20
noonedeadpunkso whatever18:20
noonedeadpunkbtw https://review.opendev.org/#/c/734888/ - upgrade worked on another sandbox now, but wonderign what about functional tests...18:21
jrosseroh yes the "when is the cluster ready" problem18:22
jrosseri was thinking maybe we should install container 1,2,3 with serial=118:23
jrosserperhaps it's just not good bringing the entire cluster up all at the same time18:23
* noonedeadpunk goes to ask mariadb folks18:23
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-tests master: auto-detect interpreter  https://review.opendev.org/73467618:24
noonedeadpunkbut we do up start cluster with 1 container and then 2 others join it iirc18:24
noonedeadpunkso it's not actually all at the same time...18:24
jrossermgariepy: test-ansible-env-prep.sh is called from test-ansible-functional.sh, do we need to set those vars in both places?18:25
noonedeadpunkwe can actually wait until wsrep_cluster_size == 318:26
mgariepyho..18:26
mgariepyno i guess.18:26
mgariepyi was just trying to be clever haha18:26
mgariepybut failed miserably..18:26
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-tests master: auto-detect interpreter  https://review.opendev.org/73467618:27
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-tests master: auto-detect interpreter  https://review.opendev.org/73467618:29
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-galera_server master: Use temporary repository for MariaDB 10.4.14 for Ubuntu focal  https://review.opendev.org/73394618:32
mgariepyhmm how do you get rid of the merge conflict ?18:33
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-tests master: auto-detect interpreter  https://review.opendev.org/73467618:34
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-tests master: auto-detect interpreter  https://review.opendev.org/73467618:52
*** sshnaidm is now known as sshnaidm|afk19:05
openstackgerritMerged openstack/openstack-ansible stable/stein: Rewrite CI provided apt sources to be http instead of https on bionic  https://review.opendev.org/73206419:43
*** cheng1 has quit IRC19:48
*** cheng1 has joined #openstack-ansible19:49
*** cheng1 has quit IRC20:43
*** cheng1 has joined #openstack-ansible20:44
*** spatel has joined #openstack-ansible21:03
*** maharg101 has quit IRC21:08
*** maharg101 has joined #openstack-ansible21:11
*** spatel has quit IRC21:32
*** kaiokmo has quit IRC21:35
*** krah has quit IRC21:42
*** krah has joined #openstack-ansible21:45
*** threestrands has joined #openstack-ansible21:55
*** spatel has joined #openstack-ansible21:56
*** rh-jelabarre has quit IRC22:10
*** spatel has quit IRC22:34
*** itandops_ has quit IRC22:51
*** djhankb has joined #openstack-ansible23:02
*** tosky has quit IRC23:15
*** cheng1 has quit IRC23:57
*** cheng1 has joined #openstack-ansible23:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!