*** tosky has quit IRC | 00:07 | |
*** macz has quit IRC | 00:08 | |
openstackgerrit | Merged openstack/openstack-ansible-os_keystone stable/train: Standardize on nginx-extras https://review.opendev.org/693903 | 00:15 |
---|---|---|
openstackgerrit | Merged openstack/openstack-ansible-os_keystone stable/train: Add possibility to overwrite public repo https://review.opendev.org/693757 | 00:35 |
*** goldyfruit has joined #openstack-ansible | 00:39 | |
openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Remove deprecated filters https://review.opendev.org/694798 | 00:44 |
*** weshay_ has joined #openstack-ansible | 00:48 | |
*** redrobot has quit IRC | 01:07 | |
*** gyee has quit IRC | 01:29 | |
*** goldyfruit has quit IRC | 01:43 | |
*** goldyfruit has joined #openstack-ansible | 02:41 | |
openstackgerrit | Merged openstack/openstack-ansible-os_barbican master: Replace git.openstack.org with opendev.org https://review.opendev.org/694280 | 03:15 |
*** nurdie has joined #openstack-ansible | 03:42 | |
openstackgerrit | Merged openstack/openstack-ansible-os_tacker master: Replace git.openstack.org with opendev.org https://review.opendev.org/694358 | 03:46 |
*** nurdie has quit IRC | 03:46 | |
openstackgerrit | Merged openstack/openstack-ansible-os_mistral master: Replace git.openstack.org with opendev.org https://review.opendev.org/694320 | 03:50 |
*** goldyfruit has quit IRC | 04:00 | |
*** macz has joined #openstack-ansible | 04:04 | |
*** macz has quit IRC | 04:09 | |
*** errr has quit IRC | 05:16 | |
*** pcaruana has joined #openstack-ansible | 05:43 | |
*** openstackstatus has joined #openstack-ansible | 06:08 | |
*** ChanServ sets mode: +v openstackstatus | 06:08 | |
*** errr has joined #openstack-ansible | 06:46 | |
*** mcarden has quit IRC | 06:49 | |
*** mensis has joined #openstack-ansible | 06:52 | |
*** mensis has quit IRC | 06:53 | |
*** mensis has joined #openstack-ansible | 06:54 | |
*** pcaruana has quit IRC | 06:56 | |
*** udesale has joined #openstack-ansible | 07:06 | |
openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_swift master: Replace git.openstack.org with opendev.org https://review.opendev.org/694914 | 07:28 |
openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-repo_build master: Replace git.openstack.org with opendev.org https://review.opendev.org/694916 | 07:30 |
openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-plugins master: Replace git.openstack.org with opendev.org https://review.opendev.org/694917 | 07:32 |
openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_horizon master: Replace git.openstack.org with opendev.org https://review.opendev.org/694924 | 07:46 |
*** cshen has joined #openstack-ansible | 07:54 | |
*** ivve has joined #openstack-ansible | 08:17 | |
openstackgerrit | ShangXiao proposed openstack/openstack-ansible-ceph_client master: Fix a typo in yml file https://review.opendev.org/694936 | 08:24 |
*** tosky has joined #openstack-ansible | 08:26 | |
openstackgerrit | ShangXiao proposed openstack/openstack-ansible-os_cloudkitty master: Fix a typo in yaml file https://review.opendev.org/694939 | 08:30 |
*** pcaruana has joined #openstack-ansible | 08:36 | |
*** luksky has joined #openstack-ansible | 08:42 | |
openstackgerrit | ShangXiao proposed openstack/openstack-ansible-galera_client master: Fix a type in yml file https://review.opendev.org/694947 | 08:49 |
mensis | Hello, i'm trying to install ELK Stack with openstack-ansible-ops but after installation elasticsearch does not work properly. After some time it throws java.lang.OutOfMemoryError and elasticsearch service fails. I was getting this error after installation but i tried to install again and right now i'm getting the error during installation , then installation fails. I'm using OpenStack stein distribution and trying to install elk_metrics_7x from m | 08:52 |
mensis | aster branch of openstack-ansible-ops. Any suggestions? | 08:52 |
mensis | Here is the log; http://paste.openstack.org/show/786326/ | 08:53 |
*** DanyC has joined #openstack-ansible | 09:02 | |
*** DanyC has joined #openstack-ansible | 09:02 | |
*** DanyC has quit IRC | 09:03 | |
*** DanyC has joined #openstack-ansible | 09:05 | |
*** rpittau|afk is now known as rpittau | 09:08 | |
jrosser | mensis: does it actually run out of memory? there are limits defined for the java heap size which are roughly 1/2 1/3 1/4 of the host memory size and elasticsearch will try to use it | 09:10 |
jrosser | it also fails if that amount of free memory is not available | 09:10 |
jrosser | mensis: here is how the java heap size requirement is calculated http://codesearch.openstack.org/?q=elastic_heap_size_default | 09:22 |
*** nurdie has joined #openstack-ansible | 09:43 | |
*** nurdie has quit IRC | 09:47 | |
*** DanyC has quit IRC | 09:51 | |
*** sshnaidm|afk is now known as sshnaidm|ruck | 10:10 | |
*** DanyC has joined #openstack-ansible | 10:15 | |
mensis | jrosser: i've checked jvm.options file in elasticsearch_container and my heap size is 30GB, also i'm monitoring memory usage with "top" and "free -m" command, i see that i have 650GB free memory | 10:23 |
jrosser | wow that is a lot of RAM. are you sure thats not including swap? | 10:24 |
mensis | Yes, i am. But the cpu usage of elasticsearch's java process goes between %500 and %1000 | 10:26 |
openstackgerrit | kourosh vivan proposed openstack/openstack-ansible-os_tempest master: Fix stackwiz venv pip install args https://review.opendev.org/694979 | 10:29 |
*** ansmith has joined #openstack-ansible | 10:32 | |
*** ansmith_ has quit IRC | 10:33 | |
jrosser | mensis: the cpu usage can be very large. i'd suggest disabling any beats you have installed and first get the elk/logstash to deploy cleanly and without trouble | 10:43 |
jrosser | i am seeing about 10G/node steady state on mine | 10:44 |
mensis | Ok, thanks. I increased the index limit of metricbeat by the way and didn't solve the problem. I'll comment out the beat installation playbooks and try again | 11:01 |
*** kvivan_ has joined #openstack-ansible | 11:10 | |
*** udesale has quit IRC | 11:17 | |
jrosser | you can use an ansible ad-hoc command and the 'service' module to disable them all | 11:53 |
*** ansmith_ has joined #openstack-ansible | 12:11 | |
*** nicolasbock has joined #openstack-ansible | 12:11 | |
*** ansmith has quit IRC | 12:11 | |
openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server stable/train: Ansible 'search' is a test not a filter https://review.opendev.org/693177 | 12:15 |
*** mgariepy has joined #openstack-ansible | 12:17 | |
*** goldyfruit has joined #openstack-ansible | 12:18 | |
*** dave-mccowan has joined #openstack-ansible | 12:35 | |
*** nurdie has joined #openstack-ansible | 12:47 | |
openstackgerrit | Merged openstack/openstack-ansible-os_sahara master: Replace git.openstack.org with opendev.org https://review.opendev.org/694350 | 12:56 |
*** udesale has joined #openstack-ansible | 12:58 | |
*** ansmith_ has quit IRC | 12:58 | |
*** nurdie has quit IRC | 12:59 | |
*** nurdie has joined #openstack-ansible | 12:59 | |
*** nurdie has quit IRC | 13:03 | |
*** chandankumar is now known as raukadah | 13:05 | |
*** goldyfruit has quit IRC | 13:08 | |
openstackgerrit | Merged openstack/openstack-ansible-os_panko master: Replace git.openstack.org with opendev.org https://review.opendev.org/694347 | 13:09 |
*** hamzy has quit IRC | 13:19 | |
*** ansmith_ has joined #openstack-ansible | 13:44 | |
openstackgerrit | kourosh vivan proposed openstack/openstack-ansible-os_tempest master: Fix stackwiz venv pip install args https://review.opendev.org/694979 | 13:46 |
tacco | is this a know issue that cnocchi-config is missing on the second and third node after fresh deployment with OSA? | 13:54 |
tacco | i can fix this with gnocchi-upgrade but this is just a workaround for me | 13:54 |
*** luksky has quit IRC | 14:02 | |
*** nurdie has joined #openstack-ansible | 14:07 | |
noonedeadpunk | tacco: hm, personally I never heard about htat... | 14:10 |
*** DanyC has quit IRC | 14:10 | |
noonedeadpunk | tacco: btw, just fui, gnocchi project is unmaintained now. So consider start using it wisely - ceilometer also supports at least prometheus | 14:14 |
*** goldyfruit has joined #openstack-ansible | 14:19 | |
*** goldyfruit_ has joined #openstack-ansible | 14:28 | |
tacco | ok thanks for pointing this out. maybe we just throw gnocchi away. :) | 14:29 |
tacco | because we don't realy use it | 14:29 |
*** goldyfruit has quit IRC | 14:30 | |
openstackgerrit | kourosh vivan proposed openstack/openstack-ansible-os_tempest master: Fix stackwiz venv pip install args https://review.opendev.org/694979 | 14:35 |
*** macz has joined #openstack-ansible | 14:36 | |
admin0 | hi guys .. have you seen issues like this before: ? ERROR nova.compute.manager [instance: xxx] VirtualInterfaceCreateException: Virtual Interface creation failed | 14:38 |
admin0 | and i think rabbitmq is getting hammered by neutron-dhcp-agent requests | 14:38 |
*** errr has quit IRC | 14:40 | |
admin0 | mensis, i strugged with ELK and switched over to graylog .. i dont have good stats but the logging is solid | 14:41 |
admin0 | is there a config option to restrict the number of dhcp_agents per network .. for some networks, there are like 17 dhcp agents spawned | 14:46 |
cshen | admin0: dhcp_agents_per_network? | 14:47 |
admin0 | yep | 14:47 |
cshen | it's available in neutron.conf | 14:47 |
*** DanyC has joined #openstack-ansible | 14:48 | |
admin0 | is that equivalent to the number of network nodes ? | 14:49 |
admin0 | by default ? | 14:49 |
admin0 | its 17 in my case :D | 14:49 |
cshen | check https://docs.openstack.org/neutron/rocky/configuration/neutron.html | 14:49 |
cshen | it's 1 by default | 14:49 |
admin0 | 570 networks x 17 agents each = 9690 :D | 14:49 |
admin0 | its just 1 ? | 14:50 |
admin0 | oh .. i thought it was 2 for redundancy | 14:50 |
cshen | according to doc, yes, it's 1 | 14:50 |
mgariepy | one for neutron, not osa. | 14:50 |
admin0 | wow .. mine is : dhcp_agents_per_network = 17 | 14:51 |
admin0 | and i did not override it | 14:51 |
mgariepy | https://github.com/openstack/openstack-ansible-os_neutron/blob/master/templates/neutron.conf.j2#L64 | 14:52 |
cshen | how redundant your network is :-D | 14:52 |
mgariepy | admin0, are you using lxb? | 14:52 |
mgariepy | or ovs ? | 14:52 |
admin0 | ovs | 14:52 |
admin0 | max_l3_agents_per_router = 17 -- does that sound excessive also ? | 14:53 |
*** DanyC has quit IRC | 14:53 | |
admin0 | can you guys do a quick check and let me know what you have in those 2 settings | 14:54 |
admin0 | and when I reduce the size of those to 2, i don't think neutron will kill itself the excess 15 ones right ? that i have to do myself ? | 14:55 |
cshen | admin0: for our setup, max_l3_agents_per_router = 3 and dhcp_agents_per_network = 3 | 14:58 |
cshen | I think it's pretty common. | 14:58 |
cshen | I always kill excessive neutron processes with 'kill' command. | 14:59 |
cshen | if it spawns too many. | 14:59 |
admin0 | my 3 neutron_containers have the ips: 172.29.239.162 172.29.236.162 and 172.29.238.162 respectively ..is this a coincidence or are we making the ips similar deliberately ? | 15:01 |
cshen | are the ips from the same network? | 15:02 |
admin0 | from the same /22 | 15:02 |
cshen | check if you hard code the ips under /etc/openstack_deploy on deployer server. | 15:03 |
admin0 | for a fairly moderate setup ( 25 compute nodes and bit busy) .. out of the default, is there any recommend settings to override ? like timeouts , number of workers etc in neutron and nova ? | 15:03 |
cshen | for me, the ips of neutron containers are quite random. | 15:03 |
admin0 | since i have to run the playbook again to overrride those values, i figure if there is more, i can add it in one go | 15:04 |
cshen | I won't override the default values at the beginning if no good reason. | 15:04 |
admin0 | and is it recommend to increase/adjust vif_plugging_timeout and vif_plugging_is_fatal | 15:04 |
cshen | I never adjusted vif_plugging_timeout and vif_plugging_is_fatal | 15:05 |
cshen | don't over optimise | 15:06 |
cjloader | jrosser: ty for +2 +W on the nginx bug | 15:06 |
admin0 | i guess mine is due to this 17 stuff per network .. will adjust those and see how it goes | 15:06 |
cshen | admin0: sure. | 15:07 |
*** DanyC has joined #openstack-ansible | 15:20 | |
*** nurdie has quit IRC | 15:20 | |
*** DanyC has quit IRC | 15:24 | |
*** errr has joined #openstack-ansible | 15:28 | |
admin0 | in user_secrets, rabbitmq_monitoring_password .. is this used on the managemenet plugin ? if yes, what is the username ? | 15:28 |
admin0 | i was trying to search for the rabbit admin pass .. but i only see cookie token and monitoring_pass | 15:29 |
noonedeadpunk | admin0: by default user is monitoring to that password | 15:29 |
*** spatel has joined #openstack-ansible | 15:37 | |
*** ivve has quit IRC | 15:37 | |
*** DanyC has joined #openstack-ansible | 15:46 | |
*** cshen has quit IRC | 15:48 | |
*** sshnaidm|ruck has quit IRC | 15:49 | |
*** sshnaidm has joined #openstack-ansible | 15:50 | |
*** sshnaidm is now known as sshnaidm|ruck | 15:50 | |
*** pcaruana has quit IRC | 15:50 | |
*** pcaruana has joined #openstack-ansible | 15:51 | |
jrosser | noonedeadpunk: admin0 we were playing with that today actually | 15:57 |
jrosser | the UI is only moderatley useful unless you use rabbitmqctl and apply the "administrator" tag to the monitoring user | 15:57 |
jrosser | which is a bit surprising | 15:57 |
jrosser | otherwise it won't show youall the queues | 15:57 |
noonedeadpunk | yeah, with monitoring tag is show not everything and just for reading | 15:58 |
jrosser | the default is to only show the queues that belong to the user, and in our setup thats none | 15:58 |
noonedeadpunk | I guess it should be able to read overall stats? | 15:58 |
admin0 | i was able to reverse sort by queue and figure out that its the 3 neutron server containers where most of the messageed were queued .. when i check the neutron logs, its working as normal .. but the process is at 100% in the cpu | 15:58 |
admin0 | so either i need more neutron server containers .. or i need faster cpus | 15:59 |
noonedeadpunk | I think I've created admin with my own | 15:59 |
jrosser | noonedeadpunk: with the standard setup it was useless for looking at the overall rabbitmq status | 15:59 |
jrosser | because the monitoring user didnt have visibility of anything helpful, not even readonly | 15:59 |
noonedeadpunk | hm... that's strange.. I guess I'm using user just with monitoring tag for checking cluster status and number of messages depending on type | 16:00 |
*** udesale has quit IRC | 16:00 | |
noonedeadpunk | s/I am/I was/ | 16:00 |
noonedeadpunk | btw | 16:01 |
noonedeadpunk | #startmeeting openstack_ansible_meeting | 16:01 |
openstack | Meeting started Tue Nov 19 16:01:07 2019 UTC and is due to finish in 60 minutes. The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:01 |
*** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)" | 16:01 | |
openstack | The meeting name has been set to 'openstack_ansible_meeting' | 16:01 |
noonedeadpunk | #topic office hours | 16:01 |
*** openstack changes topic to "office hours (Meeting topic: openstack_ansible_meeting)" | 16:01 | |
noonedeadpunk | So, Queens has moved to extended maintenance status https://review.opendev.org/#/c/691318/ | 16:01 |
noonedeadpunk | I guess that evrardjp was going to discuss this here, but it's already merged, so... | 16:02 |
guilhermesp | o/ | 16:03 |
noonedeadpunk | Also I think we should wait for a while for the next rc until upgrade bugs will be figured out | 16:04 |
*** gyee has joined #openstack-ansible | 16:05 | |
noonedeadpunk | And we have kinda problem with upgrade jobs... So first of all they're pretty close to timouts. For telemetry they fails with timeout for centos. | 16:06 |
noonedeadpunk | Another thing is that we can't use depends-on for lower release upgrade jobs. And as it's not in the independent template - we can't set them as non-voting or modify/exclude per role. | 16:09 |
noonedeadpunk | So for horizon train they're going to fail, as stein don't allow doing metal horizon deployments | 16:09 |
cjloader | o/ | 16:10 |
cjloader | noonedeadpunk: how much longer do I have to complete inspector to get it in the next rc for train? | 16:11 |
jrosser | do we use bootstrap-ansible.sh to get both releases in place for upgrade jobs? | 16:12 |
jrosser | i'm not sure depends-on will work for either branch | 16:12 |
noonedeadpunk | yes, we do. Actually run-upgrade.sh is supposed to. But, we're checking out back to the head... | 16:16 |
noonedeadpunk | But yes, not sure either... | 16:16 |
noonedeadpunk | And it looks like a problem, especially when it's inlcuded to all roles at once. | 16:16 |
noonedeadpunk | On the other hand - they already helped us several times and prevented from breaking upgrade | 16:16 |
noonedeadpunk | So they are pretty useful. | 16:17 |
noonedeadpunk | cjloader: so we have to release no later than 15 of december | 16:17 |
cjloader | okay | 16:18 |
cjloader | i'll keep you guys informed | 16:18 |
jrosser | noonedeadpunk: also have you seen a bunch of broken things with changing tempest to run smoke test? | 16:20 |
noonedeadpunk | Yep, I did:( | 16:21 |
jrosser | it is good and bad | 16:22 |
jrosser | lots of broken <- bad | 16:22 |
jrosser | lots more test coverage <- good | 16:22 |
noonedeadpunk | tbh I never was good enough in fixing stuff to apply full tempest test... | 16:22 |
jrosser | but biggest problem seems to be the ceph jobs which are broken now on master | 16:22 |
noonedeadpunk | oh, I haven't realized that | 16:23 |
jrosser | like this https://review.opendev.org/#/c/694253/ | 16:25 |
jrosser | i *think* this is related to the tempest test being more thorough | 16:25 |
noonedeadpunk | according to https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_eac/694253/2/check/openstack-ansible-deploy-aio_ceph-ubuntu-bionic/eace31a/logs/openstack/aio1_utility_container-1101bcb3/utility/stestr_results.html it fails swift... | 16:27 |
noonedeadpunk | but the thing is that swift is generally fails https://review.opendev.org/#/c/694783/ | 16:28 |
noonedeadpunk | so not sure that problem is in ceph itself | 16:28 |
noonedeadpunk | the patch don't fix stuff for ubuntu distro now, but it shows that actually nothing pass tests | 16:30 |
jrosser | for swift it is this https://zuul.opendev.org/t/openstack/build/4a20e01c392e4e2d93f228de2ff9e30e/log/logs/openstack/aio1-utility/tempest_run.log.txt.gz#175 | 16:31 |
jrosser | i think horizon needs tempest telling to ignore the certificate check for public endpoint | 16:31 |
jrosser | and then congress is broken, looks like a bunch of missing config in the service | 16:32 |
noonedeadpunk | yep. And it looks like we don't deploy reseller user | 16:32 |
noonedeadpunk | this feels like tons of work to clean everythin out | 16:33 |
noonedeadpunk | but tbh I'm not sure we have an experts for each supported project | 16:34 |
jrosser | i think 4-6 roles are affected badly | 16:34 |
noonedeadpunk | I'd say swift is a critical one | 16:35 |
jrosser | imho improving test coverage is a good aim for this cycle, if we don't already have one | 16:35 |
jrosser | but right now when we try to release, not so good | 16:35 |
noonedeadpunk | ++ | 16:36 |
noonedeadpunk | ofc we can set some of stuff to non-voting untill release... But not sure it's the path to follow | 16:36 |
jrosser | or we can set this var back to how it was https://github.com/openstack/openstack-ansible-os_tempest/commit/6116c681a4119aed9b1fa7723de18ae0731ff500#diff-7eeda618087b49ae876084ab6c73fdbbL85-L99 | 16:37 |
jrosser | in the integrated repo | 16:37 |
jrosser | and leave the smoke test patch in os_tempest as an indicator of where we want to end up | 16:37 |
noonedeadpunk | that's nice idea | 16:37 |
noonedeadpunk | and rollback this right after release | 16:38 |
jrosser | yes, or make a pile of experimental jobs on the things we know break | 16:38 |
* noonedeadpunk always forget about experimental jobs | 16:39 | |
jrosser | perhaps too we should add more scenraios on the os_tempest repo, becasue thats really whats caught is out here | 16:40 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Roll back use of tempest smoke test for the integrated repo https://review.opendev.org/695033 | 16:48 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_designate master: Remove deprecated packages from centos installs https://review.opendev.org/694775 | 16:49 |
jrosser | lets see if that works ^ | 16:49 |
admin0 | anyone seen this on console and a jumbled display ? Unimplemented function 108(Inval All Palettes) [ further notices suppressed ] | 16:57 |
admin0 | Unimplemented function 102(Display Mark) [ further notices suppressed ] | 16:57 |
noonedeadpunk | #endmeeting | 17:00 |
*** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: http://bit.ly/2xA1eZC" | 17:00 | |
openstack | Meeting ended Tue Nov 19 17:00:20 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:00 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-11-19-16.01.html | 17:00 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-11-19-16.01.txt | 17:00 |
openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-11-19-16.01.log.html | 17:00 |
*** rpittau is now known as rpittau|afk | 17:06 | |
*** ivve has joined #openstack-ansible | 17:21 | |
openstackgerrit | Georgina Shippey proposed openstack/openstack-ansible-os_nova master: Disable nova-spicehtml5proxy service when installing novnc https://review.opendev.org/695045 | 17:26 |
openstackgerrit | Georgina Shippey proposed openstack/openstack-ansible-os_nova master: Disable spicehtml5proxy and serialproxy when installing novnc https://review.opendev.org/695045 | 18:22 |
openstackgerrit | Georgina Shippey proposed openstack/openstack-ansible-os_nova master: Disable other remote access methods when installing nova-spicehtml5proxy https://review.opendev.org/695059 | 18:27 |
openstackgerrit | Georgina Shippey proposed openstack/openstack-ansible-os_nova master: Disable spicehtml5proxy and serialproxy when installing novnc https://review.opendev.org/695045 | 18:28 |
*** kvivan_ has quit IRC | 18:28 | |
*** nicolasbock has quit IRC | 18:34 | |
*** nicolasbock has joined #openstack-ansible | 18:34 | |
*** DanyC has quit IRC | 18:41 | |
jrosser | noonedeadpunk: looks like https://review.opendev.org/#/c/694775/ is going to pass, the tempest whitelist rollback looks OK | 18:51 |
*** nicolasbock has quit IRC | 19:14 | |
*** nicolasbock has joined #openstack-ansible | 19:14 | |
admin0 | what could be a reason where half of the instances have proper console and half of them have garbage prompts | 19:17 |
mgariepy | per host? | 19:25 |
*** goldyfruit___ has joined #openstack-ansible | 19:55 | |
*** goldyfruit_ has quit IRC | 19:57 | |
*** tosky has quit IRC | 20:27 | |
*** openstackgerrit has quit IRC | 20:35 | |
admin0 | is there an average number of (ready) messages you see in rabbitmq queue (0 in unack) and beyond that needs some check ? | 20:43 |
*** mgariepy has quit IRC | 20:53 | |
*** openstackgerrit has joined #openstack-ansible | 20:54 | |
openstackgerrit | Lance Bragstad proposed openstack/openstack-ansible-os_keystone master: Remove references to writable LDAP from documentation https://review.opendev.org/695081 | 20:54 |
admin0 | checking if you guys know how to check the ready messages is and where its stuck | 20:57 |
*** goldyfruit_ has joined #openstack-ansible | 20:58 | |
*** goldyfruit___ has quit IRC | 21:00 | |
openstackgerrit | Bjoern Teipel proposed openstack/openstack-ansible master: Disable journald-remote playbook https://review.opendev.org/695083 | 21:07 |
openstackgerrit | Bjoern Teipel proposed openstack/openstack-ansible master: Disable journald-remote playbook https://review.opendev.org/695083 | 21:10 |
*** nicolasbock has quit IRC | 21:20 | |
*** mcarden has joined #openstack-ansible | 21:28 | |
*** nicolasbock has joined #openstack-ansible | 21:35 | |
*** spatel has quit IRC | 21:39 | |
*** ansmith_ has quit IRC | 21:42 | |
*** andrea15 has quit IRC | 21:46 | |
*** andrea15 has joined #openstack-ansible | 21:47 | |
*** andrea15 has quit IRC | 21:48 | |
*** andrea15 has joined #openstack-ansible | 21:48 | |
*** andrea15 has quit IRC | 21:49 | |
*** andrea15 has joined #openstack-ansible | 21:49 | |
*** andrea15 has quit IRC | 21:50 | |
*** andrea15 has joined #openstack-ansible | 21:51 | |
*** andrea15 has quit IRC | 21:52 | |
*** andrea15 has joined #openstack-ansible | 21:52 | |
jrosser | reviews needed... this unblocks master https://review.opendev.org/#/c/695033 | 21:56 |
*** DanyC has joined #openstack-ansible | 22:28 | |
*** pcaruana has quit IRC | 22:33 | |
*** macz has quit IRC | 22:35 | |
*** tosky has joined #openstack-ansible | 23:24 | |
*** tosky has quit IRC | 23:26 | |
*** ansmith_ has joined #openstack-ansible | 23:34 | |
*** ivve has quit IRC | 23:54 | |
*** goldyfruit_ has quit IRC | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!