*** tosky has quit IRC | 00:09 | |
*** macz_ has joined #openstack-ansible | 00:42 | |
*** macz_ has quit IRC | 00:47 | |
*** schwicht has joined #openstack-ansible | 01:09 | |
*** rh-jelabarre has quit IRC | 02:05 | |
*** evrardjp has quit IRC | 03:33 | |
*** evrardjp has joined #openstack-ansible | 03:33 | |
*** gshippey has quit IRC | 04:10 | |
*** jamesdenton has quit IRC | 04:30 | |
*** jamesden_ has joined #openstack-ansible | 04:30 | |
*** macz_ has joined #openstack-ansible | 04:41 | |
*** macz_ has quit IRC | 04:46 | |
*** jamesden_ has quit IRC | 04:55 | |
*** jamesdenton has joined #openstack-ansible | 04:55 | |
*** macz_ has joined #openstack-ansible | 05:02 | |
*** macz_ has quit IRC | 05:06 | |
*** jamesdenton has quit IRC | 05:32 | |
*** jamesdenton has joined #openstack-ansible | 05:41 | |
*** jamesdenton has quit IRC | 05:52 | |
*** jamesdenton has joined #openstack-ansible | 05:53 | |
*** gokhani has joined #openstack-ansible | 06:03 | |
*** zbr|rover has quit IRC | 06:08 | |
*** zbr|rover has joined #openstack-ansible | 06:10 | |
*** miloa has joined #openstack-ansible | 06:26 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Remove support for nspawn containers. https://review.opendev.org/c/openstack/openstack-ansible/+/782569 | 06:39 |
---|---|---|
*** snapdeal has joined #openstack-ansible | 06:44 | |
snapdeal | Hi Team, I need to changed the default keystone admin user from 'admin' to something else.. is this possible which file and variable to be tweaked for this ? | 06:45 |
*** yasemind has joined #openstack-ansible | 07:02 | |
jrosser | snapdeal: for a new deployment you would override the variable keystone_admin_user_name | 07:22 |
jrosser | not sure if it is possible for an existing deployment to change that, you'd have to experiment | 07:22 |
*** shyamb has joined #openstack-ansible | 07:22 | |
jonher | i'm looking at posting a git review for cloudkitty role to fixup the playbook with the issues mentioned here the last 2 days, i used the role without this line https://opendev.org/openstack/openstack-ansible-os_cloudkitty/src/branch/master/extras/os-cloudkitty-install.yml#L23 and i don't see any other OSA project with that key set, i'm just not sure why it's there for this role | 07:26 |
jonher | the commit of that line is 2 years old so could very well be replaced by one of the generic var_includes: https://opendev.org/openstack/openstack-ansible-os_cloudkitty/commit/1ab9470007427fc3f5fcae9e3aeea4cfbdb63249 | 07:28 |
*** shyamb has quit IRC | 07:28 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in playbooks https://review.opendev.org/c/openstack/openstack-ansible/+/777996 | 07:28 |
*** shyamb has joined #openstack-ansible | 07:29 | |
*** kleini has quit IRC | 07:29 | |
jrosser | jonher: that is indeed very old code from when the repo server used to work differently | 07:30 |
jrosser | the glance role is sometimes considered the 'reference' for how things should be | 07:31 |
jrosser | jonher: ideally you could make a commit to openstack-ansible adding the proper cloudkitty playbook into the playbooks directory https://github.com/openstack/openstack-ansible/tree/master/playbooks | 07:33 |
jonher | ok good to know, thanks for confirming that's the old way of doing it, it's hard enough to wrap my head around the current way OSA works :) but getting better hang of it for each day and each problem that arises | 07:33 |
jonher | yeah, my plan was yo update the cloudkitty repo first, then ask in here how much of cloudkitty i could add to the main OSA repo | 07:33 |
jonher | inventory / haproxy for example | 07:33 |
jrosser | well, the trouble is at the moment the os_cloudkitty repo CI tests are spectacularly out of date | 07:34 |
jonher | i see | 07:34 |
jrosser | so it's a bit of a call to make between just overhauling that (part of which is adding the cloudkitty playbook to openstack-ansible), or perhaps spending effort fixing the os_cloudkitty tests which are not so useful in themselves | 07:35 |
jrosser | if you've already done whats needed to understand getting cloudkitty to work in a deployment, then thats actually the most of whats needed to fix everything up properly | 07:36 |
jonher | http://paste.openstack.org/show/803854/ | 07:37 |
jonher | that's what i have in my local instance, basically including cloudkitty in all the different parts that seems to be required to make the AIO deploy | 07:37 |
jrosser | ok, well thats excellent, as the CI tests are basically == AIO | 07:38 |
*** schwicht has quit IRC | 07:39 | |
jonher | cloudkitty_engine_container should probably not be in inventory (i think?) it's not targeted/mentioned in my inventory/env.d/cloudkitty.yml | 07:39 |
jrosser | imho the first thing to do is just wrap that all up as a patch and push it to gerrit | 07:39 |
jonher | i'm not sure about that part | 07:39 |
jonher | yep | 07:39 |
jonher | so it's the inventory part i should doublecheck. then the secrets part i added afterwards so need to check in a clean deployment if secrets are automatically generated for any key in etc/openstack_deploy/user_secrets.yml | 07:41 |
jonher | then it should be ok for a git review if the diff looks like it makes sense | 07:41 |
jonher | should probably look at bumping from "container_release: trusty" though | 07:42 |
jonher | looks like i have a few actionpoints then, i'll work on those | 07:43 |
*** shyam89 has joined #openstack-ansible | 07:44 | |
*** shyamb has quit IRC | 07:47 | |
*** shyam89 has quit IRC | 07:49 | |
noonedeadpunk | mornings | 07:50 |
jonher | morning | 07:52 |
*** luksky has joined #openstack-ansible | 07:55 | |
jrosser | jonher: theres an example here of how we added deployment of senlin https://github.com/openstack/openstack-ansible/commit/3214d6fbc3d834563c92fc0c78e0bd258724f09a | 07:59 |
jrosser | that will be very similar | 07:59 |
*** miloa has quit IRC | 08:12 | |
*** andrewbonney has joined #openstack-ansible | 08:12 | |
*** rpittau|afk is now known as rpittau | 08:19 | |
ebbex | jrosser: https://review.opendev.org/c/openstack/openstack-ansible-tests/+/781197 Should we fix pip_install and try getting this to pass for queens/rocky? | 08:25 |
*** snapdeal has quit IRC | 08:25 | |
jrosser | ebbex: if it looks easy yes, the tripleo people were trying to merge a patch for os_tempest on those older branches which is why i was looking at that | 08:28 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Use ansible_facts[] instead of fact variables in playbooks https://review.opendev.org/c/openstack/openstack-ansible/+/777996 | 08:35 |
*** gokhani has quit IRC | 08:36 | |
*** gokhani has joined #openstack-ansible | 08:40 | |
*** tosky has joined #openstack-ansible | 08:41 | |
ebbex | the pip_install role has been retired, (prohibited by Gerrit: not permitted: create change on refs/heads/stable/rocky) | 08:54 |
ebbex | Can we get super-cow powers for occasions such as this, or is it a lost cause? | 08:55 |
jrosser | i think that must be game over now | 08:56 |
jrosser | it may be possible to place a patch elsewhere to override the variable with the get-pip URL in it? | 08:57 |
ebbex | Yeah, we just need to override pip_upstream_url/pip_fallback_url | 08:58 |
ebbex | i'll give that a go :) | 08:59 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Use the cached copy of the u-c file from the repo server https://review.opendev.org/c/openstack/openstack-ansible/+/774523 | 08:59 |
*** macz_ has joined #openstack-ansible | 09:04 | |
*** macz_ has quit IRC | 09:09 | |
openstackgerrit | Ebbex proposed openstack/openstack-ansible-tests stable/queens: Update get-pip url https://review.opendev.org/c/openstack/openstack-ansible-tests/+/781197 | 09:11 |
*** shyamb has joined #openstack-ansible | 09:41 | |
openstackgerrit | Merged openstack/openstack-ansible-memcached_server master: Remove templates to unsupported operating systems https://review.opendev.org/c/openstack/openstack-ansible-memcached_server/+/782077 | 09:59 |
noonedeadpunk | ok, we need to stop testing buster for master at this point... | 10:16 |
noonedeadpunk | https://zuul.opendev.org/t/openstack/build/38a5670e3ca845dea14521c0e9748e04/log/logs/host/nova-compute.service.journal-13-38-29.log.txt#13170 | 10:17 |
jrosser | is that a nova change intented to land in W? | 10:19 |
noonedeadpunk | yep | 10:19 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump SHAs for master https://review.opendev.org/c/openstack/openstack-ansible/+/780434 | 10:20 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Set buster jobs to NV https://review.opendev.org/c/openstack/openstack-ansible/+/782681 | 10:31 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump SHAs for master https://review.opendev.org/c/openstack/openstack-ansible/+/780434 | 10:31 |
noonedeadpunk | SO I guess we would need to backport bullseye support to V. I really hope, there won't be much to do | 10:34 |
*** shyamb has quit IRC | 10:46 | |
*** shyamb has joined #openstack-ansible | 10:55 | |
noonedeadpunk | jrosser: do you have any thoughts regarding https://opendev.org/openstack/tripleo-heat-templates/commit/600f9b20311b7bf15a9956de8009d53af60e97e5 ? | 11:02 |
noonedeadpunk | as Ive just faced that and it was not really trivial to find out... | 11:02 |
noonedeadpunk | I'm thinking if we can/should do some defaults there... | 11:02 |
*** mgariepy has quit IRC | 11:03 | |
openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Updated from OpenStack Ansible Tests https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/782064 | 11:24 |
*** shyamb has quit IRC | 11:37 | |
jrosser | noonedeadpunk: there may be a patch for something like that | 11:39 |
jrosser | noonedeadpunk: this is a similar need to change libvirt defaults https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/461705 | 11:40 |
*** macz_ has joined #openstack-ansible | 11:41 | |
*** macz_ has quit IRC | 11:45 | |
*** d34dh0r53 has quit IRC | 11:55 | |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_designate master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_designate/+/780896 | 11:56 |
*** mgariepy has joined #openstack-ansible | 11:57 | |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_barbican master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_barbican/+/780859 | 11:57 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_sahara master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_sahara/+/782310 | 11:59 |
*** d34dh0r53 has joined #openstack-ansible | 11:59 | |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/782314 | 11:59 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_panko master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_panko/+/782285 | 12:01 |
*** macz_ has joined #openstack-ansible | 12:01 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Use the cached copy of the u-c file from the repo server https://review.opendev.org/c/openstack/openstack-ansible/+/774523 | 12:02 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/782284 | 12:02 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_manila master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_manila/+/782244 | 12:03 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_mistral master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_mistral/+/781542 | 12:06 |
*** macz_ has quit IRC | 12:06 | |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_magnum master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/781538 | 12:06 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_glance master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/780749 | 12:06 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_cloudkitty master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_cloudkitty/+/780874 | 12:10 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_cinder master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_cinder/+/780869 | 12:12 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_aodh master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_aodh/+/780844 | 12:12 |
*** sshnaidm|off is now known as sshnaidm | 12:13 | |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_heat master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_heat/+/781516 | 12:13 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_masakari master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/781541 | 12:14 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_keystone master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/781537 | 12:14 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_ironic master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/781519 | 12:14 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_neutron master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/782278 | 12:15 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_senlin master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_senlin/+/782309 | 12:17 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_tacker master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_tacker/+/782313 | 12:18 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_sahara master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_sahara/+/782310 | 12:19 |
*** rh-jelabarre has joined #openstack-ansible | 12:20 | |
*** shyamb has joined #openstack-ansible | 12:23 | |
*** owalsh has quit IRC | 12:32 | |
openstackgerrit | Ebbex proposed openstack/openstack-ansible-rabbitmq_server stable/queens: Update package urls for 'install_method: file' https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/782707 | 12:44 |
*** spatel_ has joined #openstack-ansible | 12:59 | |
*** spatel_ is now known as spatel | 12:59 | |
*** shyamb has quit IRC | 13:02 | |
*** macz_ has joined #openstack-ansible | 13:03 | |
*** macz_ has quit IRC | 13:08 | |
openstackgerrit | Ebbex proposed openstack/openstack-ansible-tests stable/queens: Update get-pip url https://review.opendev.org/c/openstack/openstack-ansible-tests/+/781197 | 13:12 |
*** jamesdenton has quit IRC | 13:13 | |
*** jamesdenton has joined #openstack-ansible | 13:13 | |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Set buster jobs to NV https://review.opendev.org/c/openstack/openstack-ansible/+/782681 | 13:18 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump SHAs for master https://review.opendev.org/c/openstack/openstack-ansible/+/780434 | 13:19 |
jrosser | ebbex: is this similar to your rabbitmq patch for stein? https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/782334 | 13:36 |
jrosser | oh! ignore me, you're looking at queens | 13:36 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/782286 | 13:38 |
openstackgerrit | Ebbex proposed openstack/openstack-ansible-tests stable/queens: Update get-pip url https://review.opendev.org/c/openstack/openstack-ansible-tests/+/781197 | 13:39 |
openstackgerrit | Adrien Cunin proposed openstack/openstack-ansible-ops master: Fixed venvs pattern to be more specific https://review.opendev.org/c/openstack/openstack-ansible-ops/+/782750 | 14:04 |
*** spatel has quit IRC | 14:12 | |
*** spatel_ has joined #openstack-ansible | 14:14 | |
*** spatel_ is now known as spatel | 14:14 | |
*** juanoterocas has joined #openstack-ansible | 14:14 | |
spatel | noonedeadpunk is this something transit issue? - https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/772245 | 14:15 |
spatel | can i recheck this job? | 14:15 |
openstackgerrit | Adrien Cunin proposed openstack/openstack-ansible-ops master: Removed task to cleanup venv tgz https://review.opendev.org/c/openstack/openstack-ansible-ops/+/782756 | 14:15 |
noonedeadpunk | spatel: yep, you can | 14:20 |
spatel | ok | 14:20 |
noonedeadpunk | that's the issue https://656129f4adff35088518-c39e8636195a8a58924c560773952ce4.ssl.cf1.rackcdn.com/772245/5/gate/openstack-ansible-deploy-aio_ovn_lxc-ubuntu-focal2/e491fb6/logs/ara-report/results/3237.html | 14:20 |
spatel | noonedeadpunk how does gate job will start here? - https://review.opendev.org/c/openstack/openstack-ansible/+/777384 | 14:21 |
spatel | jrosser noonedeadpunk could you please give your votes here if it looks good - https://review.opendev.org/c/openstack/openstack-ansible-os_senlin/+/777296 | 14:23 |
jrosser | nothing is merging at all in senlin right now | 14:24 |
jrosser | everything is broken until this lands Correct python egg name for senlin source install | 14:24 |
noonedeadpunk | 777384 is so unlucky ( | 14:24 |
jrosser | gshippey has spent more time looking at the galera stuff | 14:25 |
jrosser | but still no good answer for the upgrades | 14:25 |
jrosser | lots of fail still due to focal/mariadb | 14:26 |
noonedeadpunk | I saw she found one thing, but that wasn't it yeah ( | 14:26 |
spatel | jrosser hmm can point me where we stuck on python egg stuff | 14:26 |
jrosser | spatel: https://review.opendev.org/c/openstack/openstack-ansible-os_senlin/+/770878 | 14:26 |
noonedeadpunk | it's not only focal, centos also | 14:26 |
jrosser | but that cant merge until this one merges first https://review.opendev.org/c/openstack/openstack-ansible/+/777384 | 14:27 |
noonedeadpunk | oh, no, centos is kind of different https://9fbac5da3285d010dbde-5d2dcdb741ad3a1c2dead08c61afa51e.ssl.cf5.rackcdn.com/782376/2/check/openstack-ansible-deploy-aio_lxc-centos-8/c59d21d/logs/ara-report/results/2118.html | 14:27 |
spatel | jrosser thanks | 14:28 |
*** owalsh has joined #openstack-ansible | 14:29 | |
jonher | focal mariadb issues, is it the same as what i'm seeing or something else? during galera-install/Create galera users: [ERROR] [FATAL] InnoDB: Semaphore wait has lasted > 600 seconds. We intentionally crash the server because it appears to be hung. | 14:38 |
jrosser | jonher: try restarting the service - does it then come back? | 14:41 |
jrosser | but yes thats exactly the point it seems to wedge up | 14:41 |
jonher | it does not i'm afraid, tried that as well as re-creatin the container 2 times | 14:41 |
jrosser | https://jira.mariadb.org/browse/MDEV-24829 | 14:41 |
jrosser | it is a massive PITA and seriously hurting our ability to land patches right now | 14:42 |
jrosser | jonher: as a workaround you could try just edit the version locally to 10.5.9 and see if that helps at all | 14:42 |
jonher | sure, gonna lookup the override var for that | 14:44 |
jonher | ok got it, will try | 14:45 |
jonher | yes that worked :) thanks for the tip/link | 15:06 |
jrosser | cool | 15:06 |
*** macz_ has joined #openstack-ansible | 15:09 | |
*** gokhani has quit IRC | 15:09 | |
*** macz_ has quit IRC | 15:09 | |
*** macz_ has joined #openstack-ansible | 15:10 | |
openstackgerrit | Ebbex proposed openstack/openstack-ansible-tests stable/queens: Update get-pip url https://review.opendev.org/c/openstack/openstack-ansible-tests/+/781197 | 15:12 |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Removed task to cleanup venv tgz https://review.opendev.org/c/openstack/openstack-ansible-ops/+/782756 | 15:30 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova master: Fix usage of tags https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/782796 | 15:43 |
noonedeadpunk | doh, calico is broken for neutron :( | 15:49 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Bump SHAs for master https://review.opendev.org/c/openstack/openstack-ansible/+/780434 | 15:52 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_neutron master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/782278 | 15:52 |
openstackgerrit | Ebbex proposed openstack/openstack-ansible-tests stable/rocky: Update get-pip url https://review.opendev.org/c/openstack/openstack-ansible-tests/+/782799 | 15:55 |
noonedeadpunk | and why upgrade is broken for the bump.... | 15:56 |
openstackgerrit | Ebbex proposed openstack/openstack-ansible-rabbitmq_server stable/queens: Update package urls for 'install_method: file' https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/782707 | 16:14 |
*** mgariepy has quit IRC | 16:21 | |
*** gyee has joined #openstack-ansible | 16:23 | |
*** spatel has quit IRC | 16:37 | |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: [dnm] https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/782814 | 16:37 |
*** spatel_ has joined #openstack-ansible | 16:41 | |
*** spatel_ is now known as spatel | 16:41 | |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_senlin master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_senlin/+/782309 | 16:43 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_tacker master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_tacker/+/782313 | 16:46 |
*** masterpe has quit IRC | 16:48 | |
jonher | TASK [python_venv_build : Build wheels for the packages to be installed into the venv] "stderr": "WARNING: gnocchi 4.4.0 does not provide the extra 'false' that's something i sure didn't expect | 16:51 |
*** masterpe has joined #openstack-ansible | 16:52 | |
jonher | "error: error in setup.cfg: command 'build_py' has no such option 'pre_hook.build_config'" | 16:53 |
LowKey | Hi, I'm having an issue with gnocchi and ceilometer , anyone know what the caused of this error ? http://paste.openstack.org/show/803874/ | 16:54 |
jonher | i'd take a guess that your gnocchi instance is not alive and well or not currently online in your Loadbalancer since you see a 502 bad gateway | 16:56 |
noonedeadpunk | jonher: tha's smth I was fighting with | 17:01 |
jonher | oh ok | 17:01 |
noonedeadpunk | with https://review.opendev.org/c/openstack/openstack-ansible-os_gnocchi/+/781513 but it's still broken with new pip resolver | 17:01 |
noonedeadpunk | (in case you're running master) | 17:02 |
jonher | i am | 17:02 |
noonedeadpunk | So I thin kwhat we should do is to take requirements from extras https://github.com/gnocchixyz/gnocchi/blob/stable/4.4/setup.cfg#L54 and make gnocchi_pip_packages extendable by them | 17:03 |
LowKey | jonher: gnocchi instance is alive and also on haproxy. I can access to port 8041 over telnet | 17:03 |
noonedeadpunk | is publisher valid then... | 17:05 |
*** mgariepy has joined #openstack-ansible | 17:06 | |
noonedeadpunk | is /etc/ceilometer/pipeline.yaml present and has content? | 17:08 |
noonedeadpunk | and can you curl 8041 ? | 17:09 |
LowKey | hold on | 17:10 |
noonedeadpunk | jonher: will try to patch it tomorrow in the morning | 17:11 |
jonher | cool, i'm just trying to understand now why it broke and what your tried to do in your patch | 17:12 |
LowKey | noonedeadpunk: here : http://paste.openstack.org/show/Bs7vyCxX9AU8sUyCNWMt/ | 17:13 |
noonedeadpunk | jonher: it broke since we've switched pip resolver. and gnocchi is kind of uniq, since we need to install it as gnocchi[keystone,mysql,ceph] so that it handled dependencies with setup.cfg itself | 17:15 |
jonher | i see, thanks for the explanation, a lot to dig into here | 17:16 |
noonedeadpunk | but we had 2 issues in the current code: 1. there's no option like file. so I tried to workaround that and drop empty records from the list if any (which is default) | 17:16 |
noonedeadpunk | 2. we're missing parents atm for {{ gnocchi_storage_driver == 'ceph' | ternary(...) }} (should be `(gnocchi_storage_driver == 'ceph') | ternary(..)` - that's why you see "false" | 17:17 |
noonedeadpunk | but even given these 2 things are fixed, seems we still can't have both `#egg=gnocchi` and `gnocchi` in requirements... | 17:18 |
noonedeadpunk | unless smth has changed with even newer new pip (havent tested that yet) | 17:18 |
noonedeadpunk | I'm wondering if that's caused by `gnocchi://?filter_project=service&archive_policy=test_policy` | 17:20 |
noonedeadpunk | as I only tried to have `gnocchi://` | 17:20 |
noonedeadpunk | but still I doubt that would cause 502... | 17:20 |
noonedeadpunk | sorry, last 3 were to LowKey | 17:21 |
LowKey | hmm , i'm currently following guide from fleio, for enabling the metrics.., but ok, will try to remove it | 17:22 |
noonedeadpunk | oh | 17:22 |
noonedeadpunk | I know they're running osa internally. at least were | 17:22 |
noonedeadpunk | and it was working for them... | 17:23 |
LowKey | or maybe my gnocchi installation was wrong ? | 17:23 |
*** rpittau is now known as rpittau|afk | 17:24 | |
noonedeadpunk | can you curl gnocchi endpoint? | 17:25 |
noonedeadpunk | btw try both public and internal one | 17:26 |
LowKey | noonedeadpunk: here http://paste.openstack.org/show/803878/ , not sure with the output, this my first time install.. | 17:29 |
noonedeadpunk | ok. and `openstack metric archive-policy list`? | 17:33 |
LowKey | here http://paste.openstack.org/show/803879/ | 17:35 |
spatel | folks, I have one compute node went down and all VM was running on it on Ceph storage so how do i move all these VM to other compute nodes? | 17:35 |
spatel | Does evacuate will work here? | 17:35 |
noonedeadpunk | nova host evacuate? | 17:35 |
spatel | let me try | 17:36 |
spatel | last time it failed so let me give it a try again | 17:36 |
noonedeadpunk | eventually I'd say masakari :) but it issues evacuate as well | 17:36 |
noonedeadpunk | LowKey: hm, looks pretty valid | 17:39 |
LowKey | noonedeadpunk: yeahh.. hmm | 17:39 |
spatel | noonedeadpunk i am using horizon GUI to do evacuate HOST | 17:40 |
noonedeadpunk | um... that worked back then for me, but I ususally just use cli (when not havin masakari) | 17:40 |
spatel | what command do you use ? | 17:41 |
spatel | i don't have masakarai | 17:41 |
noonedeadpunk | https://docs.openstack.org/nova/train/admin/evacuate.html | 17:41 |
LowKey | spatel: you running public cloud ? | 17:41 |
spatel | no private cloud | 17:42 |
noonedeadpunk | `nova host-evacuate --target_host TARGET_HOST FAILED_HOST` | 17:42 |
noonedeadpunk | without `--target_host TARGET_HOST` scheduler will choose | 17:42 |
spatel | FAILED_HOST going to be my dead node right? | 17:43 |
jonher | yep | 17:43 |
noonedeadpunk | LowKey: oh, and does haproxy URL for these 502? | 17:44 |
noonedeadpunk | *haproxy logs URL | 17:44 |
noonedeadpunk | just wondering what ceilometer tries to reach | 17:44 |
LowKey | sorry, where i can see haproxy logs url ? | 17:44 |
noonedeadpunk | in haproxy log there must be some details about these 502 errors, which may contain URL that was asked | 17:45 |
noonedeadpunk | (just regular logfile in /var/log/haproxy iirc | 17:45 |
LowKey | in controller svr, i dont have /var/log/haproxy , or i can check on /var/log/syslog ? | 17:49 |
noonedeadpunk | might be journalctl.... | 17:49 |
spatel | noonedeadpunk thank you! that works | 17:52 |
LowKey | ok, yes, on journal i can see a lot of haproxy flooding and this was from gnocchi container , here : http://paste.openstack.org/show/803880/ | 17:52 |
noonedeadpunk | it's galera?:) | 17:53 |
LowKey | spatel: cool.. , will take note that command as well.. :D | 17:53 |
LowKey | noonedeadpunk: yeah... galera hmm | 17:54 |
noonedeadpunk | LowKey: you can eventually check specific time of errors with from http://paste.openstack.org/show/803874/ | 17:54 |
noonedeadpunk | and grep by 503 additionally | 17:54 |
noonedeadpunk | *502 sorry! | 17:54 |
LowKey | oh ok | 17:54 |
*** jamesdenton has quit IRC | 18:04 | |
*** jamesdenton has joined #openstack-ansible | 18:05 | |
*** juanoterocas has quit IRC | 18:10 | |
*** andrewbonney has quit IRC | 18:12 | |
openstackgerrit | Jonathan Herlin proposed openstack/openstack-ansible-os_cloudkitty master: Fix wsgi_venv path for cloudkitty-api https://review.opendev.org/c/openstack/openstack-ansible-os_cloudkitty/+/782837 | 18:18 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Retry on creating trove network https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/782814 | 18:19 |
*** dwilde has joined #openstack-ansible | 18:34 | |
openstackgerrit | Ebbex proposed openstack/openstack-ansible-rabbitmq_server stable/queens: Update package urls for 'install_method: file' https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/782707 | 18:45 |
*** dwilde has quit IRC | 19:01 | |
*** dwilde has joined #openstack-ansible | 19:01 | |
openstackgerrit | Ebbex proposed openstack/openstack-ansible-tests stable/rocky: Update get-pip url https://review.opendev.org/c/openstack/openstack-ansible-tests/+/782799 | 19:02 |
*** sshnaidm is now known as sshnaidm|afk | 19:12 | |
*** dwilde has quit IRC | 19:40 | |
*** juanoterocas has joined #openstack-ansible | 19:48 | |
*** dwilde has joined #openstack-ansible | 19:49 | |
*** admin0 has joined #openstack-ansible | 20:19 | |
*** yasemind has quit IRC | 20:24 | |
*** jamesdenton has quit IRC | 20:52 | |
*** jamesden_ has joined #openstack-ansible | 20:52 | |
openstackgerrit | Merged openstack/openstack-ansible-tests stable/queens: Update get-pip url https://review.opendev.org/c/openstack/openstack-ansible-tests/+/781197 | 20:54 |
*** jamesden_ has quit IRC | 21:25 | |
*** jamesdenton has joined #openstack-ansible | 21:25 | |
*** spatel has quit IRC | 21:54 | |
*** klamath_atx has quit IRC | 21:56 | |
*** klamath_atx has joined #openstack-ansible | 22:00 | |
*** juanoterocas has quit IRC | 22:12 | |
*** rodolof has quit IRC | 22:32 | |
*** macz_ has quit IRC | 23:15 | |
*** jamesdenton has quit IRC | 23:32 | |
*** jamesdenton has joined #openstack-ansible | 23:34 | |
*** gyee has quit IRC | 23:35 | |
*** Underknowledge has quit IRC | 23:40 | |
*** Underknowledge has joined #openstack-ansible | 23:51 | |
*** Underknowledge has quit IRC | 23:54 | |
*** Underknowledge has joined #openstack-ansible | 23:54 | |
*** Underknowledge has quit IRC | 23:59 | |
*** Underknowledge has joined #openstack-ansible | 23:59 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!