Monday, 2024-02-12

qwebirc44496Hi00:42
noonedeadpunkmornings08:21
opendevreviewAndrew Bonney proposed openstack/openstack-ansible master: [doc] Remove guidance to drain RMQ which can result in failures  https://review.opendev.org/c/openstack/openstack-ansible/+/90876108:52
opendevreviewAndrew Bonney proposed openstack/openstack-ansible master: [doc] Update dist upgrade guide for 2023.1 / Ubuntu Jammy  https://review.opendev.org/c/openstack/openstack-ansible/+/90876208:52
jrossergood morning10:06
opendevreviewJonathan Rosser proposed openstack/openstack-ansible master: Always use physnet1 as external network name in AIO and examples  https://review.opendev.org/c/openstack/openstack-ansible/+/90876610:21
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Switch default external network name to 'physnet1'  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/90876810:40
noonedeadpunkjrosser: you've commited stash conflict ^10:48
jrosserargh10:49
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Switch default external network name to 'physnet1'  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/90876810:54
gokhanhi noonedeadpunk , I migrated one non primary infra node from focal to jammy. we really need this https://review.opendev.org/c/openstack/openstack-ansible/+/908762 otherwise nova compute service throws identity error. 11:25
gokhanmy non primary infra node also works as a compute node. 11:26
gokhanwithout yhis patch nova error is "nova.exception.InvalidConfiguration: No local node identity found, but this is not our first startup on this host. Refusing to start after potentially having lost that state!"11:29
opendevreviewMerged openstack/openstack-ansible stable/zed: Remove distro_ceph template from project defenition  https://review.opendev.org/c/openstack/openstack-ansible/+/90868211:34
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-ops master: Add playbook to run functional test of magnum capi driver  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/90636111:42
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-ops master: Add hook playbook install and test magnum capi driver  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/90636311:42
opendevreviewMerged openstack/openstack-ansible-os_keystone stable/2023.1: Re-distribute fernet keys when re-building the primary  https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/90770811:46
opendevreviewMerged openstack/openstack-ansible stable/2023.2: Remove distro_ceph template from project defenition  https://review.opendev.org/c/openstack/openstack-ansible/+/90828011:48
opendevreviewMerged openstack/openstack-ansible stable/2023.1: Remove distro_ceph template from project defenition  https://review.opendev.org/c/openstack/openstack-ansible/+/90868111:48
jrossernoonedeadpunk: any thoughts about this on a way to move common resources out of os_tempest? https://paste.opendev.org/show/bG8e86L4aU74LbGDdoLD/12:09
noonedeadpunkjrosser: um, can you provide vars for import_playbook?12:53
jrosserapparently, I need to test this though12:54
jrosserI was surprised at the example in the docs12:55
noonedeadpunkhuh12:59
noonedeadpunkIf it's possible - then it's fine I guess12:59
opendevreviewMerged openstack/openstack-ansible-os_nova master: Evaluate my_ip address once  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/90874813:09
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Switch default external network name to 'physnet1'  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/90876813:24
opendevreviewJonathan Rosser proposed openstack/openstack-ansible master: Allow virtualisation type to be defined in a test scenario  https://review.opendev.org/c/openstack/openstack-ansible/+/90732713:30
opendevreviewJonathan Rosser proposed openstack/openstack-ansible master: Remove unused variable  https://review.opendev.org/c/openstack/openstack-ansible/+/90877813:30
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova stable/2023.2: Evaluate my_ip address once  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/90869813:31
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova stable/2023.1: Evaluate my_ip address once  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/90869913:32
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-os_magnum master: Add job to test Vexxhost cluster API driver  https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/90519913:34
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova stable/2023.1: Evaluate my_ip address once  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/90869913:36
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova stable/2023.1: Evaluate my_ip address once  https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/90869913:37
opendevreviewAndrew Bonney proposed openstack/openstack-ansible-ceph_client master: Don't load systemd parent service for object cache  https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/90878213:54
opendevreviewMerged openstack/openstack-ansible master: Extra PIP_OPTS in bootstrap_ansible script must be space separated  https://review.opendev.org/c/openstack/openstack-ansible/+/90647213:57
opendevreviewMerged openstack/openstack-ansible master: Add SLURP upgrade jobs  https://review.opendev.org/c/openstack/openstack-ansible/+/90772913:57
opendevreviewMerged openstack/openstack-ansible master: [doc] Remove guidance to drain RMQ which can result in failures  https://review.opendev.org/c/openstack/openstack-ansible/+/90876113:57
opendevreviewMerged openstack/openstack-ansible master: [doc] Slighly simplify primary node redeployment  https://review.opendev.org/c/openstack/openstack-ansible/+/90675013:57
opendevreviewAndrew Bonney proposed openstack/openstack-ansible stable/2023.2: [doc] Remove guidance to drain RMQ which can result in failures  https://review.opendev.org/c/openstack/openstack-ansible/+/90870014:01
opendevreviewAndrew Bonney proposed openstack/openstack-ansible stable/2023.1: [doc] Remove guidance to drain RMQ which can result in failures  https://review.opendev.org/c/openstack/openstack-ansible/+/90880114:01
opendevreviewAndrew Bonney proposed openstack/openstack-ansible stable/zed: [doc] Remove guidance to drain RMQ which can result in failures  https://review.opendev.org/c/openstack/openstack-ansible/+/90880214:01
opendevreviewAndrew Bonney proposed openstack/openstack-ansible stable/yoga: [doc] Remove guidance to drain RMQ which can result in failures  https://review.opendev.org/c/openstack/openstack-ansible/+/90880314:02
noonedeadpunkany guess why in the world https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/868462 fails on keystone application_credentials tempest check?14:05
jrossernoonedeadpunk: does it make the same POST twice, first succeds then the next fails?14:46
jrosserhttps://paste.opendev.org/show/bnmOojg3q57M6A1O5fY2/14:47
jrosser19:35:23,403 looks pretty much the same as 19:35:23,88714:49
jrosserthose requests are logged in keystone here https://zuul.opendev.org/t/openstack/build/d4303cf786ba48a8aa6b760678941204/log/logs/host/keystone-wsgi-public.service.journal-19-39-27.log.txt#1951214:52
jrossersoooo many exceptions in the keystone log - is this normal?14:56
noonedeadpunkdunno. there're negative tests in tempest, so might be normal...15:07
opendevreviewJonathan Rosser proposed openstack/openstack-ansible master: Allow virtualisation type to be defined in a test scenario  https://review.opendev.org/c/openstack/openstack-ansible/+/90732715:07
noonedeadpunkbut kinda weird, that only octavia fails15:08
noonedeadpunkwhile integrated repo seems be passing...15:08
noonedeadpunkbut it looks like too much errors eventually....15:19
jrosserit does seem to be a very long sequence of exceptions15:19
jrosseri wonder if there is some database access error15:21
jrosserjust guesswork but this all comes from sqlalchemy not returning data, and afaik there has been a version bump of sqla recently?15:22
jrosser*not returnung a row15:22
noonedeadpunkyeah, it was... but I'd expect everything be failing then....15:23
noonedeadpunkso what's so specific about octavia....15:23
jrosserwell - is there parallelism in these tests?15:25
jrossersuch that the octaiva & keystone tempest tests somehow trample on each other15:25
opendevreviewMerged openstack/openstack-ansible master: [doc] Update dist upgrade guide for 2023.1 / Ubuntu Jammy  https://review.opendev.org/c/openstack/openstack-ansible/+/90876215:26
opendevreviewMerged openstack/openstack-ansible stable/2023.2: [doc] Remove guidance to drain RMQ which can result in failures  https://review.opendev.org/c/openstack/openstack-ansible/+/90870015:26
opendevreviewAndrew Bonney proposed openstack/openstack-ansible stable/2023.2: [doc] Update dist upgrade guide for 2023.1 / Ubuntu Jammy  https://review.opendev.org/c/openstack/openstack-ansible/+/90880415:28
opendevreviewAndrew Bonney proposed openstack/openstack-ansible stable/2023.1: [doc] Update dist upgrade guide for 2023.1 / Ubuntu Jammy  https://review.opendev.org/c/openstack/openstack-ansible/+/90880515:28
noonedeadpunkno, should not be. I believe we've disabled that globally...15:32
noonedeadpunkhttps://opendev.org/openstack/openstack-ansible/src/branch/master/tests/roles/bootstrap-host/templates/user_variables.aio.yml.j2#L30915:33
noonedeadpunkoh15:34
noonedeadpunkhuh15:34
noonedeadpunkhow we ended up having that inside octavia clause....15:36
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Remove tempest concurrency exception for Octavia AIO  https://review.opendev.org/c/openstack/openstack-ansible/+/90883115:39
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia master: Implement support for octavia-ovn-provider driver  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/86846215:39
jrosseroh huh15:47
jrossermaybe it's slow otherwise, but we run a really small set of tests there15:48
noonedeadpunkWell, it's there for 5y or so...16:11
noonedeadpunkAnd I don't see other differences otherwise.16:12
noonedeadpunkI can assume, that it simply can be reaching Apache connection limits16:12
noonedeadpunkfor instance16:12
jrosserapache log is here https://zuul.opendev.org/t/openstack/build/d4303cf786ba48a8aa6b760678941204/log/logs/host/apache2.service.journal-19-39-27.log.txt#236016:20
jrosserlooks like really it is coming from keystone16:21
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-plugins master: Do not log contents of installed keypairs by default  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/90883816:32
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-plugins master: Do not log contents of installed keypairs by default  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/90883816:40
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-ops master: Add collection to deploy magnum cluster-api with vexxhost driver  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/90145017:12
opendevreviewMerged openstack/openstack-ansible-rabbitmq_server master: Remove legacy upgrade task  https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/90775819:45
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-ops master: Cluster API Bootstrapping playbook  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/90217821:38
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-ops master: Add role to install and run sonobouy k8s validation tests  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/90605421:38
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-ops master: Add playbook to run functional test of magnum capi driver  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/90636121:38
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-ops master: Add hook playbook install and test magnum capi driver  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/90636321:38
opendevreviewMerged openstack/openstack-ansible-os_blazar master: Enabled memcached usage for token caching  https://review.opendev.org/c/openstack/openstack-ansible-os_blazar/+/90487823:18

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!