| *** goldyfruit has joined #openstack-ansible | 00:07 | |
| *** weifan has quit IRC | 00:13 | |
| *** weifan has joined #openstack-ansible | 00:13 | |
| Nick_A | Anyone have an idea why ceph-ansible would fail to validate a template file? http://paste.openstack.org/show/eTvGTvXLjq8EMXS25TZH/ It removes the "bad" copy from /etc/tmpfiles.d so I can't compare them directly. Not finding where it gets that checksum to begin with. | 00:15 |
|---|---|---|
| *** weifan has quit IRC | 00:18 | |
| *** weifan has joined #openstack-ansible | 00:35 | |
| *** weifan has quit IRC | 00:37 | |
| *** TxGirlGeek has joined #openstack-ansible | 00:48 | |
| *** gyee has quit IRC | 01:14 | |
| *** spatel has joined #openstack-ansible | 01:27 | |
| *** logan- has quit IRC | 03:11 | |
| *** logan- has joined #openstack-ansible | 03:14 | |
| openstackgerrit | Xuan Yandong proposed openstack/openstack-ansible-ceph_client master: Cap sphinx for py2 to match global requirements https://review.opendev.org/670938 | 03:21 |
| openstackgerrit | Xuan Yandong proposed openstack/openstack-ansible-os_masakari master: Cap sphinx for py2 to match global requirements https://review.opendev.org/670939 | 03:28 |
| openstackgerrit | Xuan Yandong proposed openstack/openstack-ansible-os_congress master: Cap sphinx for py2 to match global requirements https://review.opendev.org/670940 | 03:31 |
| openstackgerrit | Xuan Yandong proposed openstack/openstack-ansible-os_manila master: Cap sphinx for py2 to match global requirements https://review.opendev.org/670941 | 03:36 |
| *** TxGirlGeek has quit IRC | 03:59 | |
| *** udesale has joined #openstack-ansible | 04:09 | |
| *** pcaruana has joined #openstack-ansible | 05:08 | |
| *** weifan has joined #openstack-ansible | 05:08 | |
| *** shyamb has joined #openstack-ansible | 05:13 | |
| *** cshen has joined #openstack-ansible | 05:19 | |
| *** weifan has quit IRC | 05:23 | |
| *** spatel has quit IRC | 05:28 | |
| *** shyamb has quit IRC | 05:28 | |
| *** udesale has quit IRC | 05:39 | |
| *** udesale has joined #openstack-ansible | 05:40 | |
| *** udesale has quit IRC | 05:42 | |
| *** shyamb has joined #openstack-ansible | 05:47 | |
| *** udesale has joined #openstack-ansible | 05:57 | |
| *** raukadah is now known as chandankumar | 06:03 | |
| openstackgerrit | Xuan Yandong proposed openstack/openstack-ansible-memcached_server master: Cap sphinx for py2 to match global requirements https://review.opendev.org/670956 | 06:24 |
| openstackgerrit | Xuan Yandong proposed openstack/openstack-ansible-nspawn_hosts master: Cap sphinx for py2 to match global requirements https://review.opendev.org/670957 | 06:27 |
| openstackgerrit | Xuan Yandong proposed openstack/openstack-ansible-apt_package_pinning master: Cap sphinx for py2 to match global requirements https://review.opendev.org/670958 | 06:33 |
| openstackgerrit | Xuan Yandong proposed openstack/openstack-ansible-os_placement master: Cap sphinx for py2 to match global requirements https://review.opendev.org/670960 | 06:41 |
| *** shyamb has quit IRC | 06:46 | |
| openstackgerrit | Xuan Yandong proposed openstack/openstack-ansible-os_panko master: Cap sphinx for py2 to match global requirements https://review.opendev.org/670961 | 06:50 |
| *** shyamb has joined #openstack-ansible | 06:51 | |
| *** rpittau|afk is now known as rpittau | 07:08 | |
| *** tosky has joined #openstack-ansible | 07:21 | |
| *** spatel has joined #openstack-ansible | 07:24 | |
| *** spatel has quit IRC | 07:29 | |
| *** udesale has quit IRC | 07:46 | |
| *** udesale has joined #openstack-ansible | 07:46 | |
| *** shyamb has quit IRC | 07:58 | |
| *** kopecmartin|off is now known as kopecmartin | 08:07 | |
| *** shyamb has joined #openstack-ansible | 09:00 | |
| *** shyamb has quit IRC | 09:53 | |
| *** shyamb has joined #openstack-ansible | 10:06 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_placement master: Use systemd-journald instead of log files https://review.opendev.org/670996 | 10:14 |
| *** tosky__ has joined #openstack-ansible | 10:17 | |
| *** tosky has quit IRC | 10:17 | |
| *** tosky__ is now known as tosky | 10:18 | |
| *** shyamb has quit IRC | 10:18 | |
| *** udesale has quit IRC | 10:29 | |
| *** electrofelix has joined #openstack-ansible | 10:45 | |
| *** shyamb has joined #openstack-ansible | 10:48 | |
| *** cshen has quit IRC | 11:06 | |
| *** kplant has joined #openstack-ansible | 11:10 | |
| *** cshen has joined #openstack-ansible | 11:22 | |
| *** luksky11 has joined #openstack-ansible | 11:26 | |
| *** cshen has quit IRC | 11:27 | |
| *** cshen has joined #openstack-ansible | 11:28 | |
| *** ansmith has quit IRC | 11:48 | |
| ioni | now that nova-lxd is discontinued, what is a good replacement for it? | 11:55 |
| ioni | i did plan to use nova-lxd as a replacement for openvz 6 | 11:56 |
| jrosser | ioni: it is sad about nova-lxd. i'm not sure there is anything else quite like that | 11:57 |
| *** shyamb has quit IRC | 11:59 | |
| *** shyamb has joined #openstack-ansible | 11:59 | |
| jamesdenton | was there a PR or note about that somewhere? | 12:04 |
| ioni | http://lists.openstack.org/pipermail/openstack-discuss/2019-July/007624.html | 12:07 |
| jamesdenton | thx ioni | 12:07 |
| ioni | jamesdenton, you're welcome | 12:07 |
| ioni | i'm still waiting to see what's going to happen with it | 12:08 |
| ioni | but for now, i'm not going to plan to swith to it | 12:08 |
| jamesdenton | good plan | 12:08 |
| *** jawad_axd has joined #openstack-ansible | 12:11 | |
| ioni | does anybody uses ipv4+ipv6 as endpoints for public interfaces? | 12:11 |
| ioni | i have set up for my fqdn ipv6 and now every time i restart haproxy, it binds randomly on ipv4 or ipv6 | 12:12 |
| ioni | but not on both | 12:12 |
| *** goldyfruit has quit IRC | 12:16 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_octavia master: Use systemd-journald instead of log files https://review.opendev.org/671019 | 12:20 |
| gokhani | hi team, ı am thinking of installing stein stable version. when will be ready stein stable version? I see that on github it is rc4. | 12:22 |
| mnaser | gokhani: https://review.opendev.org/#/c/666728/ whenever the release team pulls the trigger onb that | 12:25 |
| mnaser | noonedeadpunk: regarding the journald patches, i think that for some reason, when using uwsgi, it might not be passing the systemd socket correctly or something | 12:29 |
| mnaser | noonedeadpunk: when you look here, it doesn't seem like it's logging anything except uwsgi logs http://logs.openstack.org/96/670996/1/check/openstack-ansible-deploy-aio_metal-debian-stable/6854f16/logs/host/placement-api.service.journal-11-16-05.log.txt.gz | 12:30 |
| mnaser | wait no | 12:30 |
| mnaser | i lied | 12:30 |
| mnaser | there's a placement.requestlog and then the uwsgi one | 12:30 |
| noonedeadpunk | I also was concerned about uwsgi, but on some service it worked well... But it's still good that you've checked this out one more time:) | 12:33 |
| mnaser | noonedeadpunk: left a comment that i think applies to the other ones too | 12:33 |
| mnaser | i think it would be good to avoid having 2 log lines (and the openstack logs are more useful than the uwsgi ones imho) | 12:34 |
| noonedeadpunk | that's fair | 12:34 |
| mnaser | im gonna look at what the others look like so we can get teh pattern down | 12:34 |
| *** ansmith has joined #openstack-ansible | 12:36 | |
| mnaser | noonedeadpunk: looks like not all services print out access logs so i'm going to +2 the ones that seem ok (because they dont have an actual access log record) | 12:39 |
| mnaser | looks like oddly enough glance doesn't log requests..? | 12:39 |
| mnaser | http://logs.openstack.org/90/670890/3/check/openstack-ansible-deploy-aio_metal-debian-stable/29e324a/logs/host/glance-api.service.journal-21-04-17.log.txt.gz | 12:39 |
| noonedeadpunk | mnaser: I think about leaving https://opendev.org/openstack/openstack-ansible-os_octavia/src/branch/master/templates/octavia-uwsgi.ini.j2#L25 in place while setting disable-logging=True | 12:39 |
| noonedeadpunk | in case deployer would like to override disable-logging he won't face up with haproxy checks | 12:40 |
| mnaser | noonedeadpunk: i think that's a good idea | 12:40 |
| noonedeadpunk | I'm not 100% sure that we're using uwsgi for glance.... | 12:41 |
| mnaser | we are from what i see | 12:41 |
| noonedeadpunk | yep, you're right... | 12:42 |
| *** jawad_axd has quit IRC | 12:43 | |
| *** admin0 has joined #openstack-ansible | 12:43 | |
| noonedeadpunk | really strange since uwsgi is configured in pretty similar way... | 12:47 |
| ioni | do you guys talk about journalctl vs logging in /var/log/ for various services? | 12:48 |
| noonedeadpunk | yep | 12:48 |
| mnaser | ioni: yeah, we're trying to centralize it so everything goes into journald | 12:48 |
| mnaser | which makes debugging easier of a specific node and also makes log shipping easier because of the added metadata | 12:48 |
| ioni | i also noticed that some services are logged in files and other in journal | 12:48 |
| ioni | seems nice to have it in journald | 12:49 |
| noonedeadpunk | it's high time we changed this:) | 12:49 |
| mnaser | yeah it was stalling out for a while i think | 12:50 |
| noonedeadpunk | mnaser: anyway I'm going to add nolog for uwsgi despite glance doesn't contain it for some reason | 12:51 |
| mnaser | noonedeadpunk: i guess it was forgotten :P | 12:51 |
| *** udesale has joined #openstack-ansible | 12:52 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_octavia master: Use systemd-journald instead of log files https://review.opendev.org/671019 | 12:58 |
| mnaser | noonedeadpunk: i think eventually a good clean up would be to create a uwsgi role (like python_venv_build) | 13:00 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_nova master: Use systemd-journald instead of log files https://review.opendev.org/670882 | 13:00 |
| mnaser | so we can just always have a consistent way of deploying uwsgi in a venv + setting up configs | 13:00 |
| noonedeadpunk | yeah, was just thinking about it, since uwsgi is pretty common thing | 13:01 |
| mnaser | noonedeadpunk: also it will mean we dont have to install uwsgi in every single venv, we can have one single uwsgi venv and then reuse that for all services | 13:01 |
| mnaser | since uwsgi doesnt have to live in the virtualenv of the app it deploys | 13:01 |
| noonedeadpunk | nice idea | 13:01 |
| noonedeadpunk | I defenitely like it | 13:02 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_placement master: Use systemd-journald instead of log files https://review.opendev.org/670996 | 13:04 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_glance master: Use systemd-journald instead of log files https://review.opendev.org/670890 | 13:09 |
| jrosser | mnaser: is this good to go now? https://review.opendev.org/#/c/670672/ | 13:25 |
| *** goldyfruit has joined #openstack-ansible | 13:28 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ironic master: Use systemd-journald instead of log files https://review.opendev.org/671035 | 13:29 |
| *** shyamb has quit IRC | 13:29 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ironic master: Convert dynamic includes to static imports https://review.opendev.org/671037 | 13:34 |
| *** trident has quit IRC | 13:38 | |
| *** trident has joined #openstack-ansible | 13:39 | |
| *** TxGirlGeek has joined #openstack-ansible | 13:48 | |
| *** luksky11 has quit IRC | 13:51 | |
| mnaser | jrosser: yep! | 13:53 |
| mnaser | i think we can land that now | 13:53 |
| mnaser | and hopefully it won't do terrible things lol | 13:53 |
| * jrosser pulls rip cord and stands back | 13:53 | |
| guilhermesp | mornings! | 13:54 |
| mnaser | can someone look at https://review.opendev.org/#/c/670599/ ? | 13:57 |
| mnaser | to unblock the stack | 13:58 |
| * guilhermesp looking | 13:58 | |
| Nick_A | did you guys look more into that unknown unicast issue someone reported in stein yesterday? | 13:58 |
| jrosser | seeing a fair few jobs fail with this Client Error: Not Found for url: https://opendev.org/openstack/requirements/raw/f67ac75ebb1ac96e7f6a511d9c5e4c3de21c38d4/upper-constraints.txt | 14:02 |
| *** TxGirlGeek has quit IRC | 14:03 | |
| *** TxGirlGeek has joined #openstack-ansible | 14:03 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ironic master: Convert systemd services to common role(s) https://review.opendev.org/671046 | 14:06 |
| *** TxGirlGeek has quit IRC | 14:08 | |
| mnaser | jrosser: thats odd | 14:08 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ironic master: Convert systemd services to common role(s) https://review.opendev.org/671046 | 14:09 |
| mnaser | jrosser: bring that up to infra, the cluster of gitea is load balanced | 14:09 |
| mnaser | so its possible that one of them is not sync'd | 14:09 |
| mnaser | and is missing that commit | 14:09 |
| mnaser | the other thing is its not round robin so you cant try to replicate it | 14:09 |
| *** TxGirlGeek has joined #openstack-ansible | 14:10 | |
| grabes | Nick_A: A few looked at it, and jamesdenton said he saw the same thing happen. As of right now the bridge fdb isn’t getting populated with the correct MAC. | 14:10 |
| Nick_A | did you by chance compare to previous versions (rocky)? | 14:10 |
| *** TxGirlGeek has quit IRC | 14:10 | |
| *** TxGirlGe_ has joined #openstack-ansible | 14:11 | |
| grabes | Nick_A: Unfortunately this is a new install so I can’t compare anything. Only thing that I know at this point is the fdb table has only MACs starting with FE: and missing all the FA: entries. Therefore every VM will get all traffic incoming on that compute host if they are in the same network. | 14:12 |
| jonher | there's a bunch of reviews waiting for changing that URL to "https://releases.openstack.org/constraints/upper/master" even though the old url should still work. I have reviewed most of them: https://review.opendev.org/#/q/project:%22%255Eopenstack/(openstack-ansible%257Cansible-).*%22+status:open+NOT+project:%22%255Eopenstack/ansible-role-(k8s%257Ctripleo).*%22+opendev.org | 14:14 |
| *** TxGirlGe_ has quit IRC | 14:15 | |
| ioni | grabes, Nick_A is there a bug report for that? | 14:23 |
| *** cshen has quit IRC | 14:23 | |
| grabes | ioni, not that I am aware of. I was awaiting more info from jamesdenton. logan- has confirmed it on my side. Now its a matter of why. | 14:24 |
| ioni | ok | 14:29 |
| *** luksky11 has joined #openstack-ansible | 14:33 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ironic master: Convert dynamic includes to static imports https://review.opendev.org/671037 | 14:36 |
| openstackgerrit | Merged openstack/openstack-ansible-nspawn_container_create master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657240 | 14:41 |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: sync: add db_setup.yml https://review.opendev.org/670672 | 14:42 |
| openstackgerrit | Merged openstack/ansible-config_template master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657226 | 14:47 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_blazar master: Updated from OpenStack Ansible Tests https://review.opendev.org/671058 | 14:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_glance master: Updated from OpenStack Ansible Tests https://review.opendev.org/671059 | 14:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_horizon master: Updated from OpenStack Ansible Tests https://review.opendev.org/671060 | 14:51 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_magnum master: Updated from OpenStack Ansible Tests https://review.opendev.org/671061 | 14:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_manila master: Updated from OpenStack Ansible Tests https://review.opendev.org/671062 | 14:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_masakari master: Updated from OpenStack Ansible Tests https://review.opendev.org/671063 | 14:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_mistral master: Updated from OpenStack Ansible Tests https://review.opendev.org/671064 | 14:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_placement master: Updated from OpenStack Ansible Tests https://review.opendev.org/671065 | 14:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests https://review.opendev.org/671066 | 14:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests https://review.opendev.org/671067 | 14:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests https://review.opendev.org/671068 | 14:53 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests https://review.opendev.org/671069 | 14:53 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ironic master: Convert systemd services to common role(s) https://review.opendev.org/671046 | 15:14 |
| noonedeadpunk | mnaser seems like uwsgi is not sending it's access logs anymore http://logs.openstack.org/96/670996/2/check/openstack-ansible-deploy-aio_metal-debian-stable/7e32f5d/logs/host/placement-api.service.journal-14-10-11.log.txt.gz | 15:21 |
| *** cshen has joined #openstack-ansible | 15:26 | |
| *** chandankumar is now known as raukadah | 15:26 | |
| mnaser | noonedeadpunk: nice, that's what we wanted i guess | 15:31 |
| mnaser | it still seems to log the uwsgi logs which is perfect | 15:31 |
| mnaser | noonedeadpunk, jrosser, guilhermesp: those patches confirm that our work is done :) | 15:31 |
| mnaser | for the db_setup.yml stuff | 15:31 |
| * jrosser will fire in an update to db_setup.yml later | 15:33 | |
| *** gyee has joined #openstack-ansible | 15:39 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_manila master: Updated from OpenStack Ansible Tests https://review.opendev.org/671062 | 15:40 |
| noonedeadpunk | so time for service_setup.yml stuff? :P | 15:43 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server master: cleanup: refactor into galera_mariadb_service_name https://review.opendev.org/670599 | 15:43 |
| noonedeadpunk | That one has small changes to service_setup.yml https://review.opendev.org/#/c/670471/ So once it will be merged, I'll update already updated roles with fresh version of that file | 15:44 |
| noonedeadpunk | mnaser: btw, ironic still has logs http://logs.openstack.org/35/671035/1/check/openstack-ansible-deploy-aio_metal-ubuntu-bionic/dba40cc/logs/host/ironic/ but https://review.opendev.org/#/c/671046/ should resolve this at once | 15:48 |
| *** the_intern has joined #openstack-ansible | 15:51 | |
| *** luksky11 has quit IRC | 15:55 | |
| mnaser | #startmeeting openstack_ansible_meeting | 16:00 |
| openstack | Meeting started Tue Jul 16 16:00:56 2019 UTC and is due to finish in 60 minutes. The chair is mnaser. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| *** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)" | 16:00 | |
| openstack | The meeting name has been set to 'openstack_ansible_meeting' | 16:01 |
| mnaser | #topic rollcall | 16:01 |
| *** openstack changes topic to "rollcall (Meeting topic: openstack_ansible_meeting)" | 16:01 | |
| mnaser | o/ | 16:01 |
| noonedeadpunk | o/ | 16:01 |
| mnaser | looks like we're a bit less than the usual | 16:02 |
| jrosser | o/ | 16:02 |
| mnaser | i think generally things have been progressing nicely | 16:02 |
| mnaser | afaik releae was just about to merge? | 16:02 |
| mnaser | nvm | 16:02 |
| mnaser | it's out :D | 16:02 |
| mnaser | https://review.opendev.org/#/c/666728/ | 16:02 |
| mnaser | #topic open discussion | 16:02 |
| *** openstack changes topic to "open discussion (Meeting topic: openstack_ansible_meeting)" | 16:02 | |
| raukadah | \o/ | 16:03 |
| openstackgerrit | Merged openstack/openstack-ansible-os_ceilometer master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/670073 | 16:03 |
| mnaser | https://opendev.org/openstack/openstack-ansible/src/tag/19.0.0 | 16:03 |
| mnaser | it has been tagged indeed | 16:03 |
| guilhermesp | o/ | 16:04 |
| mnaser | so w00t | 16:04 |
| mnaser | tweet it out, tell your friends, etc, etc | 16:04 |
| jrosser | Do we need to do anything re. the reports of vms seeing all traffic? That sounds terribad. | 16:04 |
| mnaser | uh, i haven't seen anything about that | 16:04 |
| mnaser | context? | 16:04 |
| jrosser | ^^^up there in the history I think but both jamesdenton and Logan see fdb weirdness on stein | 16:05 |
| logan- | grabes noticed it on his environment and I have verified the behavior on there. we see bridge fdb entries on the hv nodes for the VM side of the tap interface, rather than the host's tap mac address | 16:05 |
| mnaser | ovs or lxb? | 16:05 |
| logan- | this is a stein env | 16:05 |
| logan- | lxb | 16:05 |
| mnaser | this does sound like a neutron bug though, or is it something we do? | 16:06 |
| mnaser | cause afaik we dont build the bridges | 16:06 |
| logan- | not something we do, I'm thinking neutron bug | 16:06 |
| mnaser | we let neutron do it | 16:06 |
| logan- | correct | 16:06 |
| logan- | i don't think it is osa config related | 16:06 |
| jrosser | I think I meant more about getting some neutron people to see what’s up, like we need to make a bug report I guess | 16:07 |
| logan- | but if someone has a stein lxb env id love some confirmation on what we're seeing in grabes env | 16:07 |
| mnaser | yeah we don't run lxb ever :X | 16:07 |
| jrosser | I have a stein lxb setup but will likely be tomorrow before I can poke at it | 16:08 |
| mnaser | ok sound sgood | 16:08 |
| logan- | jrosser: thanks! | 16:08 |
| mnaser | other stuff, noonedeadpunk has been working on patchsets to move all our logging to journald | 16:08 |
| mnaser | the topic is here https://review.opendev.org/#/q/topic:use_journalctl+(status:open+OR+status:merged) | 16:09 |
| logan- | neato | 16:09 |
| noonedeadpunk | And found neutron-ha-tool.py - does anyone use it for stein (or rocky at least)? | 16:09 |
| jrosser | That’s great, i was reading about all the journal extra fields | 16:09 |
| guilhermesp | nice | 16:09 |
| openstackgerrit | Merged openstack/openstack-ansible-nspawn_hosts master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657241 | 16:09 |
| mnaser | yeah, the neutron-ha-tool.py existance seemed like a rackspace-ism | 16:09 |
| guilhermesp | mnaser: this minimizes our disk space issues right? | 16:09 |
| openstackgerrit | Merged openstack/openstack-ansible-os_heat master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657253 | 16:10 |
| mnaser | guilhermesp: yeah, kinda, it means we can just ship systemd logs elsewhere and not have t oworry about services logging locally | 16:10 |
| * guilhermesp looking with passion to this topic | 16:10 | |
| noonedeadpunk | So I probably should raise this by an email before deprecation | 16:10 |
| *** jawad_axd has joined #openstack-ansible | 16:11 | |
| logan- | thanks for working on that noonedeadpunk | 16:11 |
| noonedeadpunk | since neutron has ha since pike I guess | 16:11 |
| logan- | i do think we'll need renos in these patches | 16:11 |
| jrosser | Sort of related I have the elk7 stuff almost done | 16:11 |
| noonedeadpunk | logan-: on all of them? | 16:11 |
| logan- | noonedeadpunk: idk. it'll cluster up our integrated build renos pretty bad if we do a reno per role. | 16:12 |
| noonedeadpunk | so can't we place reno just for openstack-ansible repo? And in case of removal some variables per repo? | 16:12 |
| logan- | yeah wfm | 16:12 |
| mnaser | ++ i like that idea | 16:12 |
| mnaser | (a single reno that is) | 16:12 |
| logan- | clutter not cluster* | 16:12 |
| mnaser | clustered integrated builds?! | 16:12 |
| mnaser | that sounds cool =P | 16:12 |
| mnaser | but yeah jrosser elk7 work might be good in combination | 16:13 |
| mnaser | ship systemd and call it a day | 16:13 |
| mnaser | great, so overall things are good in that side of things | 16:14 |
| logan- | yeah and having journalbeat upstreamed into elastic proper makes it easy to do id think | 16:14 |
| mnaser | i had an idea earlier i think i can work with noonedeadpunk to work on which is the uwsgi role | 16:14 |
| logan- | instead of having to install the 3rd party journalbeat | 16:14 |
| jrosser | Elk7 has some major changes so I want to get something minimal up so we can all have a hack | 16:14 |
| mnaser | (alongside the service_setup.yml task file similar to {mq,db}_setup.yml) | 16:14 |
| logan- | mnaser: cool makes sense.. so it'd be a common task file not a role? | 16:15 |
| *** jawad_axd has quit IRC | 16:15 | |
| mnaser | i think the idea is to make service_setup.yml (the keystone bits) a common task | 16:15 |
| mnaser | but uwsgi a common role (it seems too big to be a task, esp when it involves handlers to restart things, etc) | 16:15 |
| logan- | gotcha | 16:15 |
| mnaser | (btw, noonedeadpunk, i think adding a | 16:16 |
| mnaser | pushing up patch to drop neutron-ha-tool and a ML post saying "we will drop it speak up if you need it" is probably ok) | 16:16 |
| logan- | i wonder if we should move these common task sync files out of -tests into something else, maybe integrated repo, and move the post pipeline job there. it seems kind of weird that we sync a bunch of production task files from -tests | 16:16 |
| logan- | since they are not part of the testing framework at all | 16:17 |
| mnaser | yeah thats' something i thought about | 16:17 |
| jrosser | I was thinking the same | 16:17 |
| mnaser | slowly but surely openstack-ansible-tests should/will disappear | 16:17 |
| grabes | logan-: spatel is running stein on centos, and doesn’t have the fdb issues. | 16:17 |
| mnaser | i think spatel runs ovs tho | 16:17 |
| logan- | ^ i thought the same | 16:18 |
| logan- | if jrosser has time tomorrow it shouldnt take long to confirm the behavior on one of his hvs too. would be great to have some output from 2 different envs showing it when i write up the neutron bug | 16:19 |
| mnaser | but yeah overall i think we're doing okay in terms of 'production' deployments | 16:19 |
| grabes | I thought he was as well, but speaking with him yesterday he confirmed it was lxb | 16:19 |
| logan- | interesting ok | 16:19 |
| mnaser | i think we should probably schedule a hack/bugfix day like we did last time | 16:19 |
| noonedeadpunk | btw, I guess we have some work for upgrade script? | 16:19 |
| noonedeadpunk | which we've scheduled after release? | 16:20 |
| mnaser | i think before that we should try and get functional upgrade jobs | 16:20 |
| mnaser | if it takes 1hr to do a debian-based deploy, and our gate max is 3 hours, i think we should totally be ok in doing an upgrade check | 16:20 |
| guilhermesp | btw is there a script already for placemente for upgrade jobs? | 16:22 |
| logan- | no | 16:22 |
| logan- | not that im aware of | 16:22 |
| mnaser | i think the ansible bits are done | 16:22 |
| mnaser | but the upgrade scripts bit are not | 16:22 |
| guilhermesp | not sure if jesse started | 16:22 |
| openstackgerrit | Merged openstack/openstack-ansible-os_gnocchi master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657227 | 16:22 |
| noonedeadpunk | and we didn't backport placement to stein iirc | 16:22 |
| mnaser | https://review.opendev.org/#/c/664862/ | 16:22 |
| jrosser | and we need something for the galera wsrep method change too | 16:22 |
| mnaser | oh it wasn't complte but its a start | 16:23 |
| jrosser | thats been catching folks out and we've not really documented it | 16:23 |
| mnaser | i think all of these will get uncovered once we have a functional upgrade job | 16:23 |
| guilhermesp | yeah mnaser that was the patch | 16:23 |
| mnaser | btw | 16:23 |
| mnaser | the job already exists | 16:23 |
| mnaser | its just a matter of adding it to check & gate | 16:23 |
| mnaser | and then just doing the fixes to make it pass | 16:23 |
| grabes | one thing I do not have enabled is the l2population. However, I wasn’t sure that would do as intended on VLAN based networks | 16:23 |
| grabes | in neutron | 16:24 |
| logan- | yeah greenfield is done in master, but upgrade from S->T will require some db manage stuff in upgrade playbooks (i don't know what all needs to be done, is there a nova doc showing this?) and I don't think any of it is done yet | 16:24 |
| logan- | ah cool | 16:24 |
| * logan- hadn't seen that patch yet | 16:24 | |
| mnaser | it would be a good exercise to know if these issues have to do with using l2pop + dvr + lxb | 16:24 |
| grabes | Let me add it and restart a VM and see what happens | 16:25 |
| mnaser | i think guilhermesp actually got working upgrade jobs in our gate at some point | 16:25 |
| mnaser | but we just never merged it | 16:25 |
| jrosser | neutron related can we land this? https://review.opendev.org/#/c/668526/ | 16:25 |
| jrosser | it needs to be backported to S | 16:25 |
| logan- | yeah I suggested ml2 pop as a hacky workaround in grabes env, but honestly with neutron populating local node fdb macs incorrectly i don't know if it would even help to do ml2 pop. | 16:25 |
| *** hamzy has quit IRC | 16:25 | |
| logan- | grabes: we should be able to turn ml2 pop on in one hv and see what the fdb looks like | 16:25 |
| guilhermesp | the only thing I did in the upgrade jobs in the past was fixing tempest workspace | 16:25 |
| grabes | logan- doing that now, give me 5 | 16:26 |
| mnaser | yeah im sure it will uncover other weird things | 16:26 |
| jrosser | mnaser: i think we are very close on the bind-to-mgmt stuff too | 16:27 |
| jrosser | i need to update the db_setup task, then the bit things to land withh be rabbitmq and galera | 16:28 |
| logan- | jrosser: i have not had a chance to review those patches but one question as someone using the galera role outside of osa, does the role default behavior change? im guessing not, and the bind to management stuff is piped through from the osa integrated repo vars? | 16:29 |
| jrosser | logan-: yes the first thing to do has been going round adding defaults binding to 0.0.0.0 where they were missing, like this https://review.opendev.org/#/c/670403/ | 16:30 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible master: Add metal upgrade jobs https://review.opendev.org/671105 | 16:30 |
| logan- | gotcha | 16:30 |
| jrosser | then that can all get rewired onto the mgmt ip in the integrated repo group vars | 16:31 |
| mnaser | fyi there's a patch that will likely fail but it's a good start point if someone wants to do the ugprade work | 16:31 |
| logan- | thanks jrosser | 16:31 |
| grabes | logan-: looks the same, I didn’t see it add the fa mac | 16:31 |
| jrosser | logan-: heres whats done so far https://review.opendev.org/#/q/topic:bind-to-mgmt+(status:open+OR+status:merged) | 16:31 |
| *** ansmith has quit IRC | 16:32 | |
| *** ansmith has joined #openstack-ansible | 16:32 | |
| mnaser | can someone review any of the patches here if they're okay with the approach used https://review.opendev.org/#/q/topic:use_journalctl+(status:open+OR+status:merged) ? i don't want to start reviewing/merging those two as it'll be everyone from same org push and commit | 16:32 |
| mnaser | esp when its large cross-role stuff | 16:33 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_nova master: Use systemd-journald instead of log files https://review.opendev.org/670882 | 16:33 |
| openstackgerrit | Merged openstack/openstack-ansible-ceph_client master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657232 | 16:33 |
| logan- | jrosser: should we bind :: instead of 0.0.0.0? does it make a difference? | 16:35 |
| *** electrofelix has quit IRC | 16:35 | |
| mnaser | the :: vs 0.0.0.0 is a tricky one | 16:35 |
| mnaser | apparently certain distros treat :: as in listen to ipv6 only | 16:35 |
| mnaser | and some treat it as listen to ipv6 and ipv4 | 16:35 |
| jrosser | ^ reviews welcome :) | 16:35 |
| noonedeadpunk | Also I'd love to ask to review https://review.opendev.org/#/c/670471/ since there was a change in service_setup.yml which I'll probably need to implement for already merged roles | 16:35 |
| jrosser | i pretty much ignored ipv6 | 16:35 |
| jrosser | because i figured that in itself was a whole patch set for a ton of stuff that we'd do as a seperate piece of work | 16:36 |
| logan- | yeah | 16:36 |
| logan- | wfm | 16:36 |
| mnaser | noonedeadpunk: i like that, what was the change that was implemetned that was different from tehoo thers? | 16:37 |
| noonedeadpunk | default for validate_certs and condition which involves _service_in_ldap | 16:38 |
| mnaser | *the others*** | 16:38 |
| mnaser | aaah | 16:38 |
| mnaser | oh i think i see something | 16:38 |
| *** rpittau is now known as rpittau|afk | 16:38 | |
| mnaser | actually nvm | 16:38 |
| * jrosser heads out - catchup later | 16:38 | |
| mnaser | noonedeadpunk: i wonder if we also need to have multiple roles instead of one role | 16:39 |
| mnaser | i think heat is one of othose that needs multiple items | 16:39 |
| mnaser | later thanks for dropping by jrosser | 16:39 |
| noonedeadpunk | what do you mean under multiple roles? | 16:40 |
| *** TxGirlGeek has joined #openstack-ansible | 16:40 | |
| noonedeadpunk | ah, keystone user role? | 16:40 |
| mnaser | yeah | 16:40 |
| noonedeadpunk | you're right.... | 16:42 |
| noonedeadpunk | and several users as well... | 16:43 |
| noonedeadpunk | ok, there's smth to do then regarding this topic | 16:43 |
| mnaser | yeah so i think addressing that would be useful (which would need a "revision" of the api) | 16:44 |
| noonedeadpunk | so you mean to try to work out with single user? | 16:45 |
| mnaser | nono i mean like the service_setup.yml will have to revised so it says _service_users and _service_roles being a list | 16:45 |
| noonedeadpunk | ah, yep, sure | 16:46 |
| noonedeadpunk | that what I was going to do at the first place:) | 16:46 |
| mnaser | and then the existing role sthat merged will probably have to be revised so we dont break them when we make the change is openstack-ansible-tests | 16:46 |
| mnaser | perfect :D | 16:46 |
| openstackgerrit | Merged openstack/openstack-ansible-os_ironic master: Cap sphinx for py2 to match global requirements https://review.opendev.org/663582 | 16:49 |
| mnaser | i think that spretty much covers it all | 16:53 |
| mnaser | anything else? :) | 16:53 |
| *** hamzy has joined #openstack-ansible | 16:55 | |
| mnaser | i guess not :) | 16:56 |
| mnaser | #endmeeting | 16:56 |
| *** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: http://bit.ly/2xA1eZC" | 16:56 | |
| openstack | Meeting ended Tue Jul 16 16:56:16 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:56 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-07-16-16.00.html | 16:56 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-07-16-16.00.txt | 16:56 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-07-16-16.00.log.html | 16:56 |
| *** udesale has quit IRC | 17:09 | |
| *** kopecmartin is now known as kopecmartin|off | 17:11 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_heat master: Use systemd-journald instead of log files https://review.opendev.org/671112 | 17:12 |
| *** goldyfruit has quit IRC | 17:16 | |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657242 | 17:16 |
| *** TxGirlGeek has quit IRC | 17:17 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_magnum master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657258 | 17:17 |
| openstackgerrit | Merged openstack/openstack-ansible-rsyslog_server master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657238 | 17:20 |
| openstackgerrit | Merged openstack/openstack-ansible stable/queens: Bump SHAs for stable/queens https://review.opendev.org/670729 | 17:21 |
| openstackgerrit | Merged openstack/openstack-ansible-os_trove master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657267 | 17:21 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_aodh master: Convert dynamic includes to static imports https://review.opendev.org/671116 | 17:22 |
| *** chhagarw has joined #openstack-ansible | 17:24 | |
| openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657236 | 17:27 |
| openstackgerrit | Merged openstack/openstack-ansible-os_congress master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657248 | 17:31 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657234 | 17:32 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_barbican master: Convert dynamic includes to static imports https://review.opendev.org/671122 | 17:33 |
| *** weifan has joined #openstack-ansible | 17:34 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657247 | 17:34 |
| openstackgerrit | Merged openstack/openstack-ansible-os_rally master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/670054 | 17:34 |
| Nick_A | sorry if I missed it - did anyone open a bug with neutron for that unknown unicast issue? | 17:39 |
| Nick_A | saw "<jrosser> I think I meant more about getting some neutron people to see what’s up, like we need to make a bug report I guess" | 17:39 |
| openstackgerrit | Merged openstack/openstack-ansible-os_masakari master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657257 | 17:39 |
| *** luksky11 has joined #openstack-ansible | 17:42 | |
| *** the_intern has quit IRC | 17:42 | |
| *** cshen has quit IRC | 17:42 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_designate master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/657251 | 17:43 |
| openstackgerrit | Merged openstack/openstack-ansible-os_glance master: Updated from OpenStack Ansible Tests https://review.opendev.org/671059 | 17:44 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_gnocchi master: Use systemd-journald instead of log files https://review.opendev.org/671123 | 17:46 |
| noonedeadpunk | Nick_A: jrosser is going to test things tomorrow on his deployment so that we have enough details for filling a bug to neutron | 17:48 |
| logan- | Nick_A: you are welcome to file the bug. however, I am planning to write one up, but I'd like to get confirmation that we're seeing behavior on other stein+lxb envs first. do you have a stein+lxb env and time to help debug? :) | 17:52 |
| Nick_A | Not yet unfortunately - we're on rocky atm | 17:52 |
| *** TxGirlGeek has joined #openstack-ansible | 17:52 | |
| Nick_A | I want to be sure to follow the bug when reported | 17:53 |
| Nick_A | Rocky + lxb specifically | 17:53 |
| logan- | gotcha | 17:53 |
| openstackgerrit | Merged openstack/openstack-ansible-os_blazar master: Updated from OpenStack Ansible Tests https://review.opendev.org/671058 | 17:58 |
| openstackgerrit | Merged openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests https://review.opendev.org/671068 | 17:59 |
| *** electrofelix has joined #openstack-ansible | 18:00 | |
| *** spatel has joined #openstack-ansible | 18:00 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests https://review.opendev.org/671066 | 18:01 |
| *** tosky has quit IRC | 18:01 | |
| *** poopcat has joined #openstack-ansible | 18:01 | |
| *** electrofelix has quit IRC | 18:03 | |
| *** weifan has quit IRC | 18:04 | |
| *** weifan has joined #openstack-ansible | 18:04 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_placement master: Updated from OpenStack Ansible Tests https://review.opendev.org/671065 | 18:08 |
| *** weifan has quit IRC | 18:09 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests https://review.opendev.org/671067 | 18:09 |
| *** weifan has joined #openstack-ansible | 18:09 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Add placement client for neutron https://review.opendev.org/668526 | 18:12 |
| openstackgerrit | Merged openstack/openstack-ansible-os_magnum master: Updated from OpenStack Ansible Tests https://review.opendev.org/671061 | 18:13 |
| openstackgerrit | Merged openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests https://review.opendev.org/671069 | 18:14 |
| *** cshen has joined #openstack-ansible | 18:19 | |
| *** chhagarw has quit IRC | 18:20 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/670063 | 18:20 |
| *** goldyfruit has joined #openstack-ansible | 18:22 | |
| grabes | Nick_A: Just so you have the info, its me and jamesdenton who have this issue. Its not everyone on Stein/lxb beacuse spatel is working fine. He is Centos, and I am Ubuntu 18 | 18:24 |
| spatel | This is my fdb table from one of compute node, if anyone interested - http://paste.openstack.org/show/754411/ | 18:26 |
| logan- | very helpful spatel, thanks | 18:27 |
| grabes | Here is mine | 18:28 |
| grabes | http://paste.openstack.org/show/754448/ | 18:28 |
| *** cshen has quit IRC | 18:28 | |
| grabes | spatel: Are you running vlan, or vxlan? | 18:28 |
| spatel | grabes: no, i am running pure vlan provide | 18:29 |
| spatel | I kept vxlan interface and ip in place just incase i need to move from vlan provider to vxlan. | 18:30 |
| grabes | For the hell of it can you dump sysctl -a|grep arp I am interested to see if there are any differences | 18:30 |
| Nick_A | thanks grabes - we're also ubuntu 18 | 18:31 |
| spatel | grabes: here you go http://paste.openstack.org/show/754449/ | 18:32 |
| spatel | Nick_A: may be ubuntu 18 running on kernel 4.x has some loose bug for linuxbridge | 18:33 |
| grabes | spatel: Ok, looks the same. I was thinking maybe there was some sysctl not letting it learn the macs from the bridge. | 18:34 |
| spatel | grabes: but i believe bridge should learn macs using discovery method, that is core function of bridge nothing to do with neutron. | 18:35 |
| logan- | spatel: can you pastebin 'brctl showstp brqa34c47ab-0e' | 18:35 |
| logan- | yep it seems like learning is not functioning | 18:36 |
| spatel | logan-: http://paste.openstack.org/show/754450/ | 18:36 |
| logan- | thanks! | 18:36 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_aodh master: Convert dynamic includes to static imports https://review.opendev.org/671116 | 18:37 |
| grabes | I had to use a different brige, but the results should be the same http://paste.openstack.org/show/754451/ | 18:37 |
| spatel | reason neutron add macs permanently to reduce overall broadcast using l2pop, without that it should use brodcast function to learn macs itself. | 18:38 |
| *** weifan has quit IRC | 18:38 | |
| *** weifan has joined #openstack-ansible | 18:38 | |
| grabes | ageing time is 0 for me, and 300 for you | 18:39 |
| spatel | grabes: i assumed you have STP=no in interface. | 18:39 |
| *** cshen has joined #openstack-ansible | 18:39 | |
| grabes | spatel: correct | 18:40 |
| grabes | http://ask.xmodulo.com/disable-mac-learning-linux-bridge.html looks like its the ageing | 18:41 |
| spatel | if you have 0 age time then its not holding any macs in tables.. just keep flushing them | 18:41 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_barbican master: Convert dynamic includes to static imports https://review.opendev.org/671122 | 18:42 |
| spatel | In my case i have 300s which keep them in table for 5 minute before send other broadcast to learn. | 18:42 |
| grabes | Interesting, so this may be an Ubuntu issue, as I don’t have ageing defined anywhere in the interface config | 18:42 |
| spatel | try setting up age time and see | 18:42 |
| spatel | add bridge_ageing 300 in interface config file | 18:43 |
| *** weifan has quit IRC | 18:43 | |
| grabes | behold, I not have a fdb table with the right macs | 18:43 |
| *** cshen has quit IRC | 18:44 | |
| grabes | Thanks everyone for your help in finding the issue! | 18:47 |
| Nick_A | you added that setting to your interface config to fix it? | 18:47 |
| grabes | Nick_A: not yet, I have to double check how netplan wants it | 18:49 |
| spatel | i bet that is the issue, age time 0 means don't learn macs | 18:51 |
| grabes | spatel: 100% it, I manually set them to 300 and all is fine now. I am not sure at the moment if I can set a default ageing with Ubuntu and netplan, unless the bridge is defined. | 18:53 |
| spatel | what is netplan? | 18:54 |
| spatel | why don't you add that setting in your br-XXX interface file. | 18:54 |
| logan- | these are not system configured bridges | 18:54 |
| logan- | they are created by neutron | 18:54 |
| grabes | netplan is ubuntus new network config. I am trying to find out if I can set a global default. netplan appears to have you define it manually for each bridge | 18:56 |
| spatel | hmm, you are right.. | 18:56 |
| spatel | also worth open bug to neutron in worst case so they can cook then in. | 18:58 |
| *** weifan has joined #openstack-ansible | 19:05 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_masakari master: Updated from OpenStack Ansible Tests https://review.opendev.org/671063 | 19:06 |
| *** weifan has quit IRC | 19:10 | |
| logan- | spatel: if you run a 'brctl addbr testbr; brctl showstp testbr; brctl delbr testbr' i'm assuming you see ageing configured to 300 on the bridge right? | 19:16 |
| spatel | let me try | 19:16 |
| spatel | logan-: yes i am default seeing "ageing time 300.00" | 19:17 |
| logan- | thanks | 19:18 |
| spatel | what you guys seeing in Ubuntu 18? | 19:18 |
| logan- | same here on a bionic system | 19:18 |
| spatel | if ubuntu default setting 300 in that case may be neutron somewhere reseting it back to zero | 19:19 |
| grabes | I am seeing it at 300 by default as well, when creating a bridge manually. I am gonna create a new neutron net quick to see what it gets set to | 19:25 |
| grabes | ageing 0 | 19:29 |
| grabes | http://paste.openstack.org/show/754457/ | 19:32 |
| grabes | That will show the new network and bridge with ageing 0, and a manually created one with the proper default ageing | 19:33 |
| spatel | grabes: i would say open bug for neutron project, something hiding underneath | 19:37 |
| *** weifan has joined #openstack-ansible | 19:44 | |
| grabes | spatel: Gonna get a HV in debug mode, and log what its doing tonight | 19:44 |
| *** weifan has quit IRC | 19:49 | |
| *** kplant has quit IRC | 19:59 | |
| *** weifan has joined #openstack-ansible | 20:15 | |
| jrosser | looks like another db setup / db migrate race http://logs.openstack.org/22/671122/2/check/openstack-ansible-deploy-aio_metal-debian-stable/3b06a9d/job-output.txt.gz#_2019-07-16_19_15_23_617754 | 20:15 |
| jrosser | i guess we should really fix that everywhere | 20:16 |
| *** hamzy has quit IRC | 20:30 | |
| *** ansmith has quit IRC | 20:35 | |
| *** dasp has quit IRC | 20:45 | |
| *** dasp has joined #openstack-ansible | 20:47 | |
| *** pcaruana has quit IRC | 21:01 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_ironic master: Convert systemd services to common role(s) https://review.opendev.org/671046 | 21:09 |
| openstackgerrit | Merged openstack/openstack-ansible-os_glance master: Use systemd-journald instead of log files https://review.opendev.org/670890 | 21:10 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_neutron stable/stein: Add placement client for neutron https://review.opendev.org/671157 | 21:11 |
| *** ansmith has joined #openstack-ansible | 21:11 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_placement master: Use systemd-journald instead of log files https://review.opendev.org/670996 | 21:16 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_octavia master: Use systemd-journald instead of log files https://review.opendev.org/671019 | 21:19 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ironic master: Use systemd-journald instead of log files https://review.opendev.org/671035 | 21:21 |
| *** gokhani has quit IRC | 21:23 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_heat master: Use systemd-journald instead of log files https://review.opendev.org/671112 | 21:23 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_gnocchi master: Use systemd-journald instead of log files https://review.opendev.org/671123 | 21:26 |
| noonedeadpunk | mnaser: sorry, really forgotten at some point about removal of logs dir creation... | 21:27 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ironic master: Convert dynamic includes to static imports https://review.opendev.org/671037 | 21:30 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ironic master: Convert dynamic includes to static imports https://review.opendev.org/671037 | 21:31 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Use systemd-journald instead of log files https://review.opendev.org/670824 | 21:32 |
| mnaser | noonedeadpunk: all good, that's teh whole point of code review :D | 21:32 |
| *** luksky11 has quit IRC | 21:36 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Use systemd-journald instead of log files https://review.opendev.org/670882 | 21:46 |
| noonedeadpunk | strange thing about barbican db upgrade http://logs.openstack.org/22/671122/2/check/openstack-ansible-deploy-aio_distro_metal-centos-7/ad1d0d6/logs/ara-report/result/5e8cc5d0-cf72-4612-a712-a0bddfa30d2e/ | 21:49 |
| noonedeadpunk | I'm not sure if setting failed_when: false is a good idea for it... | 21:50 |
| *** spatel has quit IRC | 21:50 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_barbican master: Convert dynamic includes to static imports https://review.opendev.org/671122 | 21:54 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ironic master: Use systemd-journald instead of log files https://review.opendev.org/671035 | 21:58 |
| *** weifan has quit IRC | 22:17 | |
| *** weifan has joined #openstack-ansible | 22:17 | |
| *** weifan has quit IRC | 22:18 | |
| *** weifan has joined #openstack-ansible | 22:18 | |
| *** weifan has quit IRC | 22:19 | |
| *** weifan has joined #openstack-ansible | 22:19 | |
| *** weifan has quit IRC | 22:19 | |
| *** weifan has joined #openstack-ansible | 22:20 | |
| *** weifan has quit IRC | 22:20 | |
| *** weifan has joined #openstack-ansible | 22:20 | |
| *** weifan has quit IRC | 22:21 | |
| *** weifan has joined #openstack-ansible | 22:21 | |
| *** weifan has quit IRC | 22:22 | |
| *** weifan has joined #openstack-ansible | 22:22 | |
| *** weifan has quit IRC | 22:22 | |
| *** weifan has joined #openstack-ansible | 22:23 | |
| *** weifan has quit IRC | 22:23 | |
| *** weifan has joined #openstack-ansible | 22:23 | |
| *** weifan has quit IRC | 22:24 | |
| *** weifan has joined #openstack-ansible | 22:24 | |
| *** weifan has quit IRC | 22:25 | |
| *** weifan has joined #openstack-ansible | 23:02 | |
| *** weifan has quit IRC | 23:07 | |
| *** goldyfruit has quit IRC | 23:08 | |
| *** weifan has joined #openstack-ansible | 23:14 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server master: setup: don't try to login to create users and upgrade https://review.opendev.org/670601 | 23:21 |
| *** hamzy has joined #openstack-ansible | 23:27 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_aodh master: Convert dynamic includes to static imports https://review.opendev.org/671116 | 23:41 |
| *** goldyfruit has joined #openstack-ansible | 23:53 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!