opendevreview | Natz cheng proposed openstack/os-vif master: cleanup py27 support https://review.opendev.org/c/openstack/os-vif/+/896598 | 01:57 |
---|---|---|
*** ralonsoh_afk is now known as ralonsoh | 06:21 | |
opendevreview | Sahid Orentino Ferdjaoui proposed openstack/nova master: scheduler: AggregateMultitenancyIsolation to support unlimited tenant https://review.opendev.org/c/openstack/nova/+/896512 | 07:08 |
dvo-plv | Hello, All | 08:47 |
dvo-plv | Maybe you will have a chance to take a look on the reproposed spec file ? https://review.opendev.org/c/openstack/nova-specs/+/895924 | 08:48 |
dvo-plv | and check dependent patch for it https://review.opendev.org/c/openstack/nova/+/876075 | 08:48 |
opendevreview | Sahid Orentino Ferdjaoui proposed openstack/nova master: scheduler: AggregateMultitenancyIsolation to support unlimited tenant https://review.opendev.org/c/openstack/nova/+/896512 | 09:28 |
opendevreview | Amit Uniyal proposed openstack/nova master: Adds device tagging functional tests https://review.opendev.org/c/openstack/nova/+/895162 | 10:09 |
opendevreview | Amit Uniyal proposed openstack/nova master: Adds device tagging functional tests https://review.opendev.org/c/openstack/nova/+/895162 | 10:20 |
opendevreview | Amit Uniyal proposed openstack/nova master: Adds device tagging functional tests https://review.opendev.org/c/openstack/nova/+/895162 | 11:02 |
opendevreview | Amit Uniyal proposed openstack/nova master: Device tags: don't pass pf_interface=True to get_mac_by_pci_address https://review.opendev.org/c/openstack/nova/+/670593 | 11:02 |
opendevreview | Amit Uniyal proposed openstack/nova master: WIP: Device tagging: expose target PCI address, not source https://review.opendev.org/c/openstack/nova/+/672127 | 11:02 |
stephenfin | bauzas: Can you look at https://review.opendev.org/c/openstack/placement/+/886229 and https://review.opendev.org/c/openstack/placement/+/888281 when you get a chance? (SQLAlchemy 2.x stuff) | 12:32 |
bauzas | stephenfin: yeah I'll try | 12:32 |
opendevreview | Stephen Finucane proposed openstack/placement master: db: Workaround SQLAlchemy 2.x bug https://review.opendev.org/c/openstack/placement/+/888281 | 12:37 |
opendevreview | Stephen Finucane proposed openstack/placement master: Add job to test with SQLAlchemy master (2.x) https://review.opendev.org/c/openstack/placement/+/886229 | 12:37 |
opendevreview | Stephen Finucane proposed openstack/placement master: db: Wrap raw SQL query in sqlalchemy.text https://review.opendev.org/c/openstack/placement/+/896650 | 12:37 |
opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Fix the libvirt.images_type value in KVM docs https://review.opendev.org/c/openstack/nova/+/896651 | 12:58 |
bauzas | stephenfin: ack, thanks for the quick respins, will check | 13:00 |
sahid | o/ I have proposed a change for the filter AggregateMultiTenancyFilter, I have reused what we do in placement | 14:33 |
sahid | https://review.opendev.org/c/openstack/nova/+/896512 | 14:33 |
sahid | can you just tell whether that looks to be in the right direction for you guys? | 14:34 |
bauzas | I'll try | 14:35 |
sahid | thank you | 14:36 |
opendevreview | Sylvain Bauza proposed openstack/nova-specs master: explain why ironic-shards was reverted in the spec https://review.opendev.org/c/openstack/nova-specs/+/896679 | 14:53 |
opendevreview | Stephen Finucane proposed openstack/placement master: Add job to test with SQLAlchemy master (2.x) https://review.opendev.org/c/openstack/placement/+/886229 | 14:58 |
opendevreview | Dan Smith proposed openstack/nova-specs master: Add libvirt-dev-alias spec https://review.opendev.org/c/openstack/nova-specs/+/892806 | 14:59 |
opendevreview | Stephen Finucane proposed openstack/placement master: db: Wrap raw SQL query in sqlalchemy.text https://review.opendev.org/c/openstack/placement/+/896650 | 15:01 |
opendevreview | Stephen Finucane proposed openstack/placement master: Add job to test with SQLAlchemy master (2.x) https://review.opendev.org/c/openstack/placement/+/886229 | 15:01 |
*** blarnath is now known as d34dh0r53 | 15:06 | |
*** ralonsoh is now known as ralonsoh_ooo | 17:02 | |
*** ykarel is now known as ykarel|away | 17:16 | |
mnaser | https://bugs.launchpad.net/nova/+bug/2037585 -- does deleting neutron ports in a specific order sound like a reasonable fix here? | 18:51 |
mnaser | if so i can push that proposal | 18:51 |
greatgatsby | Hi. I was asking before about our compute aggregates become out of sync with the resource provider aggregates. We had it happen again last night, and I've found a PUT /resource_providers/<uuid>/aggregates in the logs at the time we detected them out of sync. What service or state might trigger this update on its own? I've been grepping through logs most of the day, but still haven't found what | 19:30 |
greatgatsby | triggers this to happen. | 19:30 |
greatgatsby | thanks *a lot* for any help | 19:31 |
JayF | greatgatsby: just curious, are the resources in question Ironic nodes? | 19:31 |
greatgatsby | thanks for the reply. No ironic, we pxe boot and use ansible for config | 19:33 |
JayF | ack; sorry I won't be much help then as that's my specialty; good luck! | 19:33 |
greatgatsby | thanks :-) | 19:34 |
dansmith | greatgatsby: nova-api will do that in response to creating or deleting aggregates on the nova side | 19:34 |
dansmith | nothing else should be doing that, AFAIK | 19:35 |
dansmith | can you trace the origin with a req-id or source ip? | 19:35 |
greatgatsby | source ip in one case came from the controller that lost the resource provider aggs. The nova aggs have never changed (or at least, we haven't changed them, and they stay consistent) | 19:36 |
greatgatsby | so, for example, compute 1 will still have the correct linux agg on the nova side, but it disappears on the resource provider side | 19:36 |
greatgatsby | this happened late last night | 19:37 |
greatgatsby | in one PUT message I see "nova-compute keystoneauth1/4.5.0 python-requests...." | 19:38 |
dansmith | "from the controller that lost the aggregates" doesn't mean anything to me | 19:41 |
dansmith | do you mean from a compute node? | 19:41 |
greatgatsby | oops, sorry, yes, the compute | 19:41 |
dansmith | there is some aggregate-manipulation that happens in the provider tree stuff now that I'm not familiar enough to speak about without some study | 19:42 |
dansmith | so must be something related to that I guess | 19:42 |
dansmith | best option would be to chat with gibi in his morning (central EU) | 19:42 |
dansmith | is the uuid in the PUT /resource_providers/uuid/aggregate the uuid of that same compute node? | 19:43 |
greatgatsby | yes, exactly | 19:43 |
greatgatsby | it's the only PUT to the resources providers and only to that specific node | 19:44 |
dansmith | I really didn't think that any of the computes would be adjusting their own aggregate membership, so that seems weird to me | 19:45 |
dansmith | is there something in the compute log that matches that timestamp? | 19:45 |
greatgatsby | there probably is, but I haven't found it. I've been grepping through logs all day. I just check the nova_api aggregates table in the database, the creation time is still months old, so they didn't get recreated. Updated is NULL though. | 19:47 |
*** JayF is now known as Guest1505 | 20:10 | |
*** JasonF is now known as jayf | 20:10 | |
*** jayf is now known as JayF | 20:11 | |
*** kopecmartin is now known as kopecmartin|off | 20:57 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!