Wednesday, 2021-03-24

*** tosky has quit IRC00:09
*** macz_ has joined #openstack-ansible00:42
*** macz_ has quit IRC00:47
*** schwicht has joined #openstack-ansible01:09
*** rh-jelabarre has quit IRC02:05
*** evrardjp has quit IRC03:33
*** evrardjp has joined #openstack-ansible03:33
*** gshippey has quit IRC04:10
*** jamesdenton has quit IRC04:30
*** jamesden_ has joined #openstack-ansible04:30
*** macz_ has joined #openstack-ansible04:41
*** macz_ has quit IRC04:46
*** jamesden_ has quit IRC04:55
*** jamesdenton has joined #openstack-ansible04:55
*** macz_ has joined #openstack-ansible05:02
*** macz_ has quit IRC05:06
*** jamesdenton has quit IRC05:32
*** jamesdenton has joined #openstack-ansible05:41
*** jamesdenton has quit IRC05:52
*** jamesdenton has joined #openstack-ansible05:53
*** gokhani has joined #openstack-ansible06:03
*** zbr|rover has quit IRC06:08
*** zbr|rover has joined #openstack-ansible06:10
*** miloa has joined #openstack-ansible06:26
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Remove support for nspawn containers.  https://review.opendev.org/c/openstack/openstack-ansible/+/78256906:39
*** snapdeal has joined #openstack-ansible06:44
snapdealHi Team, I need to changed the default keystone admin user from 'admin' to something else.. is this possible which file and variable to be tweaked for this ?06:45
*** yasemind has joined #openstack-ansible07:02
jrossersnapdeal: for a new deployment you would override the variable keystone_admin_user_name07:22
jrossernot sure if it is possible for an existing deployment to change that, you'd have to experiment07:22
*** shyamb has joined #openstack-ansible07:22
jonheri'm looking at posting a git review for cloudkitty role to fixup the playbook with the issues mentioned here the last 2 days, i used the role without this line https://opendev.org/openstack/openstack-ansible-os_cloudkitty/src/branch/master/extras/os-cloudkitty-install.yml#L23 and i don't see any other OSA project with that key set, i'm just not sure why it's there for this role07:26
jonherthe commit of that line is 2 years old so could very well be replaced by one of the generic var_includes: https://opendev.org/openstack/openstack-ansible-os_cloudkitty/commit/1ab9470007427fc3f5fcae9e3aeea4cfbdb6324907:28
*** shyamb has quit IRC07:28
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799607:28
*** shyamb has joined #openstack-ansible07:29
*** kleini has quit IRC07:29
jrosserjonher: that is indeed very old code from when the repo server used to work differently07:30
jrosserthe glance role is sometimes considered the 'reference' for how things should be07:31
jrosserjonher: ideally you could make a commit to openstack-ansible adding the proper cloudkitty playbook into the playbooks directory https://github.com/openstack/openstack-ansible/tree/master/playbooks07:33
jonherok good to know, thanks for confirming that's the old way of doing it, it's hard enough to wrap my head around the current way OSA works :) but getting better hang of it for each day and each problem that arises07:33
jonheryeah, my plan was yo update the cloudkitty repo first, then ask in here how much of cloudkitty i could add to the main OSA repo07:33
jonherinventory / haproxy for example07:33
jrosserwell, the trouble is at the moment the os_cloudkitty repo CI tests are spectacularly out of date07:34
jonheri see07:34
jrosserso it's a bit of a call to make between just overhauling that (part of which is adding the cloudkitty playbook to openstack-ansible), or perhaps spending effort fixing the os_cloudkitty tests which are not so useful in themselves07:35
jrosserif you've already done whats needed to understand getting cloudkitty to work in a deployment, then thats actually the most of whats needed to fix everything up properly07:36
jonherhttp://paste.openstack.org/show/803854/07:37
jonherthat's what i have in my local instance, basically including cloudkitty in all the different parts that seems to be required to make the AIO deploy07:37
jrosserok, well thats excellent, as the CI tests are basically == AIO07:38
*** schwicht has quit IRC07:39
jonhercloudkitty_engine_container should probably not be in inventory (i think?) it's not targeted/mentioned in my inventory/env.d/cloudkitty.yml07:39
jrosserimho the first thing to do is just wrap that all up as a patch and push it to gerrit07:39
jonheri'm not sure about that part07:39
jonheryep07:39
jonherso it's the inventory part i should doublecheck. then the secrets part i added afterwards so need to check in a clean deployment if secrets are automatically generated for any key in etc/openstack_deploy/user_secrets.yml07:41
jonherthen it should be ok for a git review if the diff looks like it makes sense07:41
jonhershould probably look at bumping from "container_release: trusty" though07:42
jonherlooks like i have a few actionpoints then, i'll work on those07:43
*** shyam89 has joined #openstack-ansible07:44
*** shyamb has quit IRC07:47
*** shyam89 has quit IRC07:49
noonedeadpunkmornings07:50
jonhermorning07:52
*** luksky has joined #openstack-ansible07:55
jrosserjonher: theres an example here of how we added deployment of senlin https://github.com/openstack/openstack-ansible/commit/3214d6fbc3d834563c92fc0c78e0bd258724f09a07:59
jrosserthat will be very similar07:59
*** miloa has quit IRC08:12
*** andrewbonney has joined #openstack-ansible08:12
*** rpittau|afk is now known as rpittau08:19
ebbexjrosser: https://review.opendev.org/c/openstack/openstack-ansible-tests/+/781197 Should we fix pip_install and try getting this to pass for queens/rocky?08:25
*** snapdeal has quit IRC08:25
jrosserebbex: if it looks easy yes, the tripleo people were trying to merge a patch for os_tempest on those older branches which is why i was looking at that08:28
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in playbooks  https://review.opendev.org/c/openstack/openstack-ansible/+/77799608:35
*** gokhani has quit IRC08:36
*** gokhani has joined #openstack-ansible08:40
*** tosky has joined #openstack-ansible08:41
ebbexthe pip_install role has been retired, (prohibited by Gerrit: not permitted: create change on refs/heads/stable/rocky)08:54
ebbexCan we get super-cow powers for occasions such as this, or is it a lost cause?08:55
jrosseri think that must be game over now08:56
jrosserit may be possible to place a patch elsewhere to override the variable with the get-pip URL in it?08:57
ebbexYeah, we just need to override pip_upstream_url/pip_fallback_url08:58
ebbexi'll give that a go :)08:59
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use the cached copy of the u-c file from the repo server  https://review.opendev.org/c/openstack/openstack-ansible/+/77452308:59
*** macz_ has joined #openstack-ansible09:04
*** macz_ has quit IRC09:09
openstackgerritEbbex proposed openstack/openstack-ansible-tests stable/queens: Update get-pip url  https://review.opendev.org/c/openstack/openstack-ansible-tests/+/78119709:11
*** shyamb has joined #openstack-ansible09:41
openstackgerritMerged openstack/openstack-ansible-memcached_server master: Remove templates to unsupported operating systems  https://review.opendev.org/c/openstack/openstack-ansible-memcached_server/+/78207709:59
noonedeadpunkok, we need to stop testing buster for master at this point...10:16
noonedeadpunkhttps://zuul.opendev.org/t/openstack/build/38a5670e3ca845dea14521c0e9748e04/log/logs/host/nova-compute.service.journal-13-38-29.log.txt#1317010:17
jrosseris that a nova change intented to land in W?10:19
noonedeadpunkyep10:19
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump SHAs for master  https://review.opendev.org/c/openstack/openstack-ansible/+/78043410:20
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Set buster jobs to NV  https://review.opendev.org/c/openstack/openstack-ansible/+/78268110:31
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump SHAs for master  https://review.opendev.org/c/openstack/openstack-ansible/+/78043410:31
noonedeadpunkSO I guess we would need to backport bullseye  support to V. I really hope, there won't be much to do10:34
*** shyamb has quit IRC10:46
*** shyamb has joined #openstack-ansible10:55
noonedeadpunkjrosser: do you have any thoughts regarding https://opendev.org/openstack/tripleo-heat-templates/commit/600f9b20311b7bf15a9956de8009d53af60e97e5 ?11:02
noonedeadpunkas Ive just faced that and it was not really trivial to find out...11:02
noonedeadpunkI'm thinking if we can/should do some defaults there...11:02
*** mgariepy has quit IRC11:03
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Updated from OpenStack Ansible Tests  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/78206411:24
*** shyamb has quit IRC11:37
jrossernoonedeadpunk: there may be a patch for something like that11:39
jrossernoonedeadpunk: this is a similar need to change libvirt defaults https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/46170511:40
*** macz_ has joined #openstack-ansible11:41
*** macz_ has quit IRC11:45
*** d34dh0r53 has quit IRC11:55
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_designate master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_designate/+/78089611:56
*** mgariepy has joined #openstack-ansible11:57
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_barbican master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_barbican/+/78085911:57
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_sahara master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_sahara/+/78231011:59
*** d34dh0r53 has joined #openstack-ansible11:59
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78231411:59
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_panko master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_panko/+/78228512:01
*** macz_ has joined #openstack-ansible12:01
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Use the cached copy of the u-c file from the repo server  https://review.opendev.org/c/openstack/openstack-ansible/+/77452312:02
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/78228412:02
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_manila master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_manila/+/78224412:03
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_mistral master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_mistral/+/78154212:06
*** macz_ has quit IRC12:06
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_magnum master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/78153812:06
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_glance master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/78074912:06
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_cloudkitty master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_cloudkitty/+/78087412:10
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_cinder master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/78086912:12
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_aodh master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_aodh/+/78084412:12
*** sshnaidm|off is now known as sshnaidm12:13
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_heat master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_heat/+/78151612:13
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_masakari master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/78154112:14
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/78153712:14
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_ironic master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/78151912:14
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_neutron master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/78227812:15
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_senlin master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_senlin/+/78230912:17
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_tacker master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_tacker/+/78231312:18
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_sahara master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_sahara/+/78231012:19
*** rh-jelabarre has joined #openstack-ansible12:20
*** shyamb has joined #openstack-ansible12:23
*** owalsh has quit IRC12:32
openstackgerritEbbex proposed openstack/openstack-ansible-rabbitmq_server stable/queens: Update package urls for 'install_method: file'  https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/78270712:44
*** spatel_ has joined #openstack-ansible12:59
*** spatel_ is now known as spatel12:59
*** shyamb has quit IRC13:02
*** macz_ has joined #openstack-ansible13:03
*** macz_ has quit IRC13:08
openstackgerritEbbex proposed openstack/openstack-ansible-tests stable/queens: Update get-pip url  https://review.opendev.org/c/openstack/openstack-ansible-tests/+/78119713:12
*** jamesdenton has quit IRC13:13
*** jamesdenton has joined #openstack-ansible13:13
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Set buster jobs to NV  https://review.opendev.org/c/openstack/openstack-ansible/+/78268113:18
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump SHAs for master  https://review.opendev.org/c/openstack/openstack-ansible/+/78043413:19
jrosserebbex: is this similar to your rabbitmq patch for stein? https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/78233413:36
jrosseroh! ignore me, you're looking at queens13:36
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/78228613:38
openstackgerritEbbex proposed openstack/openstack-ansible-tests stable/queens: Update get-pip url  https://review.opendev.org/c/openstack/openstack-ansible-tests/+/78119713:39
openstackgerritAdrien Cunin proposed openstack/openstack-ansible-ops master: Fixed venvs pattern to be more specific  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/78275014:04
*** spatel has quit IRC14:12
*** spatel_ has joined #openstack-ansible14:14
*** spatel_ is now known as spatel14:14
*** juanoterocas has joined #openstack-ansible14:14
spatelnoonedeadpunk is this something transit issue? - https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/77224514:15
spatelcan i recheck this job?14:15
openstackgerritAdrien Cunin proposed openstack/openstack-ansible-ops master: Removed task to cleanup venv tgz  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/78275614:15
noonedeadpunkspatel: yep, you can14:20
spatelok14:20
noonedeadpunkthat's the issue https://656129f4adff35088518-c39e8636195a8a58924c560773952ce4.ssl.cf1.rackcdn.com/772245/5/gate/openstack-ansible-deploy-aio_ovn_lxc-ubuntu-focal2/e491fb6/logs/ara-report/results/3237.html14:20
spatelnoonedeadpunk how does gate job will start here? - https://review.opendev.org/c/openstack/openstack-ansible/+/77738414:21
spateljrosser noonedeadpunk could you please give your votes here if it looks good - https://review.opendev.org/c/openstack/openstack-ansible-os_senlin/+/77729614:23
jrossernothing is merging at all in senlin right now14:24
jrossereverything is broken until this lands Correct python egg name for senlin source install14:24
noonedeadpunk777384 is so unlucky (14:24
jrossergshippey has spent more time looking at the galera stuff14:25
jrosserbut still no good answer for the upgrades14:25
jrosserlots of fail still due to focal/mariadb14:26
noonedeadpunkI saw she found one thing, but that wasn't it yeah (14:26
spateljrosser hmm can point me where we stuck on python egg stuff14:26
jrosserspatel: https://review.opendev.org/c/openstack/openstack-ansible-os_senlin/+/77087814:26
noonedeadpunkit's not only focal, centos also14:26
jrosserbut that cant merge until this one merges first https://review.opendev.org/c/openstack/openstack-ansible/+/77738414:27
noonedeadpunkoh, no, centos is kind of different https://9fbac5da3285d010dbde-5d2dcdb741ad3a1c2dead08c61afa51e.ssl.cf5.rackcdn.com/782376/2/check/openstack-ansible-deploy-aio_lxc-centos-8/c59d21d/logs/ara-report/results/2118.html14:27
spateljrosser thanks14:28
*** owalsh has joined #openstack-ansible14:29
jonherfocal mariadb issues, is it the same as what i'm seeing or something else? during galera-install/Create galera users:  [ERROR] [FATAL] InnoDB: Semaphore wait has lasted > 600 seconds. We intentionally crash the server because it appears to be hung.14:38
jrosserjonher: try restarting the service - does it then come back?14:41
jrosserbut yes thats exactly the point it seems to wedge up14:41
jonherit does not i'm afraid, tried that as well as re-creatin the container 2 times14:41
jrosserhttps://jira.mariadb.org/browse/MDEV-2482914:41
jrosserit is a massive PITA and seriously hurting our ability to land patches right now14:42
jrosserjonher: as a workaround you could try just edit the version locally to 10.5.9 and see if that helps at all14:42
jonhersure, gonna lookup the override var for that14:44
jonherok got it, will try14:45
jonheryes that worked :) thanks for the tip/link15:06
jrossercool15:06
*** macz_ has joined #openstack-ansible15:09
*** gokhani has quit IRC15:09
*** macz_ has quit IRC15:09
*** macz_ has joined #openstack-ansible15:10
openstackgerritEbbex proposed openstack/openstack-ansible-tests stable/queens: Update get-pip url  https://review.opendev.org/c/openstack/openstack-ansible-tests/+/78119715:12
openstackgerritMerged openstack/openstack-ansible-ops master: Removed task to cleanup venv tgz  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/78275615:30
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova master: Fix usage of tags  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/78279615:43
noonedeadpunkdoh, calico is broken for neutron :(15:49
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump SHAs for master  https://review.opendev.org/c/openstack/openstack-ansible/+/78043415:52
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_neutron master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/78227815:52
openstackgerritEbbex proposed openstack/openstack-ansible-tests stable/rocky: Update get-pip url  https://review.opendev.org/c/openstack/openstack-ansible-tests/+/78279915:55
noonedeadpunkand why upgrade is broken for the bump....15:56
openstackgerritEbbex proposed openstack/openstack-ansible-rabbitmq_server stable/queens: Update package urls for 'install_method: file'  https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/78270716:14
*** mgariepy has quit IRC16:21
*** gyee has joined #openstack-ansible16:23
*** spatel has quit IRC16:37
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: [dnm]  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78281416:37
*** spatel_ has joined #openstack-ansible16:41
*** spatel_ is now known as spatel16:41
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_senlin master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_senlin/+/78230916:43
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_tacker master: [goal] Deprecate the JSON formatted policy file  https://review.opendev.org/c/openstack/openstack-ansible-os_tacker/+/78231316:46
*** masterpe has quit IRC16:48
jonherTASK [python_venv_build : Build wheels for the packages to be installed into the venv] "stderr": "WARNING: gnocchi 4.4.0 does not provide the extra 'false'      that's something i sure didn't expect16:51
*** masterpe has joined #openstack-ansible16:52
jonher"error: error in setup.cfg: command 'build_py' has no such option 'pre_hook.build_config'"16:53
LowKeyHi, I'm having an issue with gnocchi and ceilometer , anyone know what the caused of this error ? http://paste.openstack.org/show/803874/16:54
jonheri'd take a guess that your gnocchi instance is not alive and well or not currently online in your Loadbalancer since you see a 502 bad gateway16:56
noonedeadpunkjonher: tha's smth I was fighting with17:01
jonheroh ok17:01
noonedeadpunkwith https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/781513 but it's still broken with new pip resolver17:01
noonedeadpunk(in case you're running master)17:02
jonheri am17:02
noonedeadpunkSo I thin kwhat we should do is to take requirements from extras https://github.com/gnocchixyz/gnocchi/blob/stable/4.4/setup.cfg#L54 and make gnocchi_pip_packages extendable by them17:03
LowKeyjonher: gnocchi instance is alive and also on haproxy. I can access to port 8041 over telnet17:03
noonedeadpunkis publisher valid then...17:05
*** mgariepy has joined #openstack-ansible17:06
noonedeadpunkis /etc/ceilometer/pipeline.yaml present and has content?17:08
noonedeadpunkand can you curl 8041 ?17:09
LowKeyhold on17:10
noonedeadpunkjonher: will try to patch it tomorrow in the morning17:11
jonhercool, i'm just trying to understand now why it broke and what your tried to do in your patch17:12
LowKeynoonedeadpunk: here : http://paste.openstack.org/show/Bs7vyCxX9AU8sUyCNWMt/17:13
noonedeadpunkjonher: it broke since we've switched pip resolver. and gnocchi is kind of uniq, since we need to install it as gnocchi[keystone,mysql,ceph] so that it handled dependencies with setup.cfg itself17:15
jonheri see, thanks for the explanation, a lot to dig into here17:16
noonedeadpunkbut we had 2 issues in the current code: 1. there's no option like file. so I tried to workaround that and drop empty records from the list if any (which is default)17:16
noonedeadpunk2. we're missing parents atm for {{ gnocchi_storage_driver == 'ceph' | ternary(...) }} (should be `(gnocchi_storage_driver == 'ceph') | ternary(..)` - that's why you see "false"17:17
noonedeadpunkbut even given these 2 things are fixed, seems we still can't have both `#egg=gnocchi` and `gnocchi` in requirements...17:18
noonedeadpunkunless smth has changed with even newer new pip (havent tested that yet)17:18
noonedeadpunkI'm wondering if that's caused by `gnocchi://?filter_project=service&archive_policy=test_policy`17:20
noonedeadpunkas I only tried to have `gnocchi://`17:20
noonedeadpunkbut still I doubt that would cause 502...17:20
noonedeadpunksorry, last 3 were to LowKey17:21
LowKeyhmm , i'm currently following guide from fleio, for enabling the metrics.., but ok, will try to remove it17:22
noonedeadpunkoh17:22
noonedeadpunkI know they're running osa internally. at least were17:22
noonedeadpunkand it was working for them...17:23
LowKeyor maybe my gnocchi installation was wrong ?17:23
*** rpittau is now known as rpittau|afk17:24
noonedeadpunkcan you curl gnocchi endpoint?17:25
noonedeadpunkbtw try both public and internal one17:26
LowKeynoonedeadpunk: here http://paste.openstack.org/show/803878/ , not sure with the output, this my first time install..17:29
noonedeadpunkok. and `openstack metric archive-policy list`?17:33
LowKeyhere http://paste.openstack.org/show/803879/17:35
spatelfolks, I have one compute node went down and all VM was running on it on Ceph storage so how do i move all these VM to other compute nodes?17:35
spatelDoes evacuate will work here?17:35
noonedeadpunknova host evacuate?17:35
spatellet me try17:36
spatellast time it failed so let me give it a try again17:36
noonedeadpunkeventually I'd say masakari :) but it issues evacuate as well17:36
noonedeadpunkLowKey: hm, looks pretty valid17:39
LowKeynoonedeadpunk: yeahh.. hmm17:39
spatelnoonedeadpunk i am using horizon GUI to do evacuate HOST17:40
noonedeadpunkum... that worked back then for me, but I ususally just use cli (when not havin masakari)17:40
spatelwhat command do you use ?17:41
spateli don't have masakarai17:41
noonedeadpunkhttps://docs.openstack.org/nova/train/admin/evacuate.html17:41
LowKeyspatel: you running public cloud ?17:41
spatelno private cloud17:42
noonedeadpunk`nova host-evacuate --target_host TARGET_HOST FAILED_HOST`17:42
noonedeadpunkwithout `--target_host TARGET_HOST` scheduler will choose17:42
spatelFAILED_HOST going to be my dead node right?17:43
jonheryep17:43
noonedeadpunkLowKey: oh, and does haproxy URL for these 502?17:44
noonedeadpunk*haproxy logs URL17:44
noonedeadpunkjust wondering what ceilometer tries to reach17:44
LowKeysorry, where i can see haproxy logs url ?17:44
noonedeadpunkin haproxy log there must be some details about these 502 errors, which may contain URL that was asked17:45
noonedeadpunk(just regular logfile in /var/log/haproxy iirc17:45
LowKeyin controller svr, i dont have /var/log/haproxy , or i can check on /var/log/syslog ?17:49
noonedeadpunkmight be journalctl....17:49
spatelnoonedeadpunk thank you! that works17:52
LowKeyok, yes, on journal i can see a lot of haproxy flooding and this was from gnocchi container , here : http://paste.openstack.org/show/803880/17:52
noonedeadpunkit's galera?:)17:53
LowKeyspatel: cool.. , will take note that command as well.. :D17:53
LowKeynoonedeadpunk: yeah... galera hmm17:54
noonedeadpunkLowKey: you can eventually check specific time of errors with from http://paste.openstack.org/show/803874/17:54
noonedeadpunkand grep by 503 additionally17:54
noonedeadpunk*502 sorry!17:54
LowKeyoh ok17:54
*** jamesdenton has quit IRC18:04
*** jamesdenton has joined #openstack-ansible18:05
*** juanoterocas has quit IRC18:10
*** andrewbonney has quit IRC18:12
openstackgerritJonathan Herlin proposed openstack/openstack-ansible-os_cloudkitty master: Fix wsgi_venv path for cloudkitty-api  https://review.opendev.org/c/openstack/openstack-ansible-os_cloudkitty/+/78283718:18
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Retry on creating trove network  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/78281418:19
*** dwilde has joined #openstack-ansible18:34
openstackgerritEbbex proposed openstack/openstack-ansible-rabbitmq_server stable/queens: Update package urls for 'install_method: file'  https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/78270718:45
*** dwilde has quit IRC19:01
*** dwilde has joined #openstack-ansible19:01
openstackgerritEbbex proposed openstack/openstack-ansible-tests stable/rocky: Update get-pip url  https://review.opendev.org/c/openstack/openstack-ansible-tests/+/78279919:02
*** sshnaidm is now known as sshnaidm|afk19:12
*** dwilde has quit IRC19:40
*** juanoterocas has joined #openstack-ansible19:48
*** dwilde has joined #openstack-ansible19:49
*** admin0 has joined #openstack-ansible20:19
*** yasemind has quit IRC20:24
*** jamesdenton has quit IRC20:52
*** jamesden_ has joined #openstack-ansible20:52
openstackgerritMerged openstack/openstack-ansible-tests stable/queens: Update get-pip url  https://review.opendev.org/c/openstack/openstack-ansible-tests/+/78119720:54
*** jamesden_ has quit IRC21:25
*** jamesdenton has joined #openstack-ansible21:25
*** spatel has quit IRC21:54
*** klamath_atx has quit IRC21:56
*** klamath_atx has joined #openstack-ansible22:00
*** juanoterocas has quit IRC22:12
*** rodolof has quit IRC22:32
*** macz_ has quit IRC23:15
*** jamesdenton has quit IRC23:32
*** jamesdenton has joined #openstack-ansible23:34
*** gyee has quit IRC23:35
*** Underknowledge has quit IRC23:40
*** Underknowledge has joined #openstack-ansible23:51
*** Underknowledge has quit IRC23:54
*** Underknowledge has joined #openstack-ansible23:54
*** Underknowledge has quit IRC23:59
*** Underknowledge has joined #openstack-ansible23:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!