qwebirc44496 | Hi | 00:42 |
---|---|---|
noonedeadpunk | mornings | 08:21 |
opendevreview | Andrew Bonney proposed openstack/openstack-ansible master: [doc] Remove guidance to drain RMQ which can result in failures https://review.opendev.org/c/openstack/openstack-ansible/+/908761 | 08:52 |
opendevreview | Andrew Bonney proposed openstack/openstack-ansible master: [doc] Update dist upgrade guide for 2023.1 / Ubuntu Jammy https://review.opendev.org/c/openstack/openstack-ansible/+/908762 | 08:52 |
jrosser | good morning | 10:06 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Always use physnet1 as external network name in AIO and examples https://review.opendev.org/c/openstack/openstack-ansible/+/908766 | 10:21 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Switch default external network name to 'physnet1' https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/908768 | 10:40 |
noonedeadpunk | jrosser: you've commited stash conflict ^ | 10:48 |
jrosser | argh | 10:49 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Switch default external network name to 'physnet1' https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/908768 | 10:54 |
gokhan | hi noonedeadpunk , I migrated one non primary infra node from focal to jammy. we really need this https://review.opendev.org/c/openstack/openstack-ansible/+/908762 otherwise nova compute service throws identity error. | 11:25 |
gokhan | my non primary infra node also works as a compute node. | 11:26 |
gokhan | without yhis patch nova error is "nova.exception.InvalidConfiguration: No local node identity found, but this is not our first startup on this host. Refusing to start after potentially having lost that state!" | 11:29 |
opendevreview | Merged openstack/openstack-ansible stable/zed: Remove distro_ceph template from project defenition https://review.opendev.org/c/openstack/openstack-ansible/+/908682 | 11:34 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Add playbook to run functional test of magnum capi driver https://review.opendev.org/c/openstack/openstack-ansible-ops/+/906361 | 11:42 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Add hook playbook install and test magnum capi driver https://review.opendev.org/c/openstack/openstack-ansible-ops/+/906363 | 11:42 |
opendevreview | Merged openstack/openstack-ansible-os_keystone stable/2023.1: Re-distribute fernet keys when re-building the primary https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/907708 | 11:46 |
opendevreview | Merged openstack/openstack-ansible stable/2023.2: Remove distro_ceph template from project defenition https://review.opendev.org/c/openstack/openstack-ansible/+/908280 | 11:48 |
opendevreview | Merged openstack/openstack-ansible stable/2023.1: Remove distro_ceph template from project defenition https://review.opendev.org/c/openstack/openstack-ansible/+/908681 | 11:48 |
jrosser | noonedeadpunk: any thoughts about this on a way to move common resources out of os_tempest? https://paste.opendev.org/show/bG8e86L4aU74LbGDdoLD/ | 12:09 |
noonedeadpunk | jrosser: um, can you provide vars for import_playbook? | 12:53 |
jrosser | apparently, I need to test this though | 12:54 |
jrosser | I was surprised at the example in the docs | 12:55 |
noonedeadpunk | huh | 12:59 |
noonedeadpunk | If it's possible - then it's fine I guess | 12:59 |
opendevreview | Merged openstack/openstack-ansible-os_nova master: Evaluate my_ip address once https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/908748 | 13:09 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Switch default external network name to 'physnet1' https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/908768 | 13:24 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Allow virtualisation type to be defined in a test scenario https://review.opendev.org/c/openstack/openstack-ansible/+/907327 | 13:30 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Remove unused variable https://review.opendev.org/c/openstack/openstack-ansible/+/908778 | 13:30 |
opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova stable/2023.2: Evaluate my_ip address once https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/908698 | 13:31 |
opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova stable/2023.1: Evaluate my_ip address once https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/908699 | 13:32 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-os_magnum master: Add job to test Vexxhost cluster API driver https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/905199 | 13:34 |
opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova stable/2023.1: Evaluate my_ip address once https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/908699 | 13:36 |
opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova stable/2023.1: Evaluate my_ip address once https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/908699 | 13:37 |
opendevreview | Andrew Bonney proposed openstack/openstack-ansible-ceph_client master: Don't load systemd parent service for object cache https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/908782 | 13:54 |
opendevreview | Merged openstack/openstack-ansible master: Extra PIP_OPTS in bootstrap_ansible script must be space separated https://review.opendev.org/c/openstack/openstack-ansible/+/906472 | 13:57 |
opendevreview | Merged openstack/openstack-ansible master: Add SLURP upgrade jobs https://review.opendev.org/c/openstack/openstack-ansible/+/907729 | 13:57 |
opendevreview | Merged openstack/openstack-ansible master: [doc] Remove guidance to drain RMQ which can result in failures https://review.opendev.org/c/openstack/openstack-ansible/+/908761 | 13:57 |
opendevreview | Merged openstack/openstack-ansible master: [doc] Slighly simplify primary node redeployment https://review.opendev.org/c/openstack/openstack-ansible/+/906750 | 13:57 |
opendevreview | Andrew Bonney proposed openstack/openstack-ansible stable/2023.2: [doc] Remove guidance to drain RMQ which can result in failures https://review.opendev.org/c/openstack/openstack-ansible/+/908700 | 14:01 |
opendevreview | Andrew Bonney proposed openstack/openstack-ansible stable/2023.1: [doc] Remove guidance to drain RMQ which can result in failures https://review.opendev.org/c/openstack/openstack-ansible/+/908801 | 14:01 |
opendevreview | Andrew Bonney proposed openstack/openstack-ansible stable/zed: [doc] Remove guidance to drain RMQ which can result in failures https://review.opendev.org/c/openstack/openstack-ansible/+/908802 | 14:01 |
opendevreview | Andrew Bonney proposed openstack/openstack-ansible stable/yoga: [doc] Remove guidance to drain RMQ which can result in failures https://review.opendev.org/c/openstack/openstack-ansible/+/908803 | 14:02 |
noonedeadpunk | any guess why in the world https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/868462 fails on keystone application_credentials tempest check? | 14:05 |
jrosser | noonedeadpunk: does it make the same POST twice, first succeds then the next fails? | 14:46 |
jrosser | https://paste.opendev.org/show/bnmOojg3q57M6A1O5fY2/ | 14:47 |
jrosser | 19:35:23,403 looks pretty much the same as 19:35:23,887 | 14:49 |
jrosser | those requests are logged in keystone here https://zuul.opendev.org/t/openstack/build/d4303cf786ba48a8aa6b760678941204/log/logs/host/keystone-wsgi-public.service.journal-19-39-27.log.txt#19512 | 14:52 |
jrosser | soooo many exceptions in the keystone log - is this normal? | 14:56 |
noonedeadpunk | dunno. there're negative tests in tempest, so might be normal... | 15:07 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Allow virtualisation type to be defined in a test scenario https://review.opendev.org/c/openstack/openstack-ansible/+/907327 | 15:07 |
noonedeadpunk | but kinda weird, that only octavia fails | 15:08 |
noonedeadpunk | while integrated repo seems be passing... | 15:08 |
noonedeadpunk | but it looks like too much errors eventually.... | 15:19 |
jrosser | it does seem to be a very long sequence of exceptions | 15:19 |
jrosser | i wonder if there is some database access error | 15:21 |
jrosser | just guesswork but this all comes from sqlalchemy not returning data, and afaik there has been a version bump of sqla recently? | 15:22 |
jrosser | *not returnung a row | 15:22 |
noonedeadpunk | yeah, it was... but I'd expect everything be failing then.... | 15:23 |
noonedeadpunk | so what's so specific about octavia.... | 15:23 |
jrosser | well - is there parallelism in these tests? | 15:25 |
jrosser | such that the octaiva & keystone tempest tests somehow trample on each other | 15:25 |
opendevreview | Merged openstack/openstack-ansible master: [doc] Update dist upgrade guide for 2023.1 / Ubuntu Jammy https://review.opendev.org/c/openstack/openstack-ansible/+/908762 | 15:26 |
opendevreview | Merged openstack/openstack-ansible stable/2023.2: [doc] Remove guidance to drain RMQ which can result in failures https://review.opendev.org/c/openstack/openstack-ansible/+/908700 | 15:26 |
opendevreview | Andrew Bonney proposed openstack/openstack-ansible stable/2023.2: [doc] Update dist upgrade guide for 2023.1 / Ubuntu Jammy https://review.opendev.org/c/openstack/openstack-ansible/+/908804 | 15:28 |
opendevreview | Andrew Bonney proposed openstack/openstack-ansible stable/2023.1: [doc] Update dist upgrade guide for 2023.1 / Ubuntu Jammy https://review.opendev.org/c/openstack/openstack-ansible/+/908805 | 15:28 |
noonedeadpunk | no, should not be. I believe we've disabled that globally... | 15:32 |
noonedeadpunk | https://opendev.org/openstack/openstack-ansible/src/branch/master/tests/roles/bootstrap-host/templates/user_variables.aio.yml.j2#L309 | 15:33 |
noonedeadpunk | oh | 15:34 |
noonedeadpunk | huh | 15:34 |
noonedeadpunk | how we ended up having that inside octavia clause.... | 15:36 |
opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Remove tempest concurrency exception for Octavia AIO https://review.opendev.org/c/openstack/openstack-ansible/+/908831 | 15:39 |
opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia master: Implement support for octavia-ovn-provider driver https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/868462 | 15:39 |
jrosser | oh huh | 15:47 |
jrosser | maybe it's slow otherwise, but we run a really small set of tests there | 15:48 |
noonedeadpunk | Well, it's there for 5y or so... | 16:11 |
noonedeadpunk | And I don't see other differences otherwise. | 16:12 |
noonedeadpunk | I can assume, that it simply can be reaching Apache connection limits | 16:12 |
noonedeadpunk | for instance | 16:12 |
jrosser | apache log is here https://zuul.opendev.org/t/openstack/build/d4303cf786ba48a8aa6b760678941204/log/logs/host/apache2.service.journal-19-39-27.log.txt#2360 | 16:20 |
jrosser | looks like really it is coming from keystone | 16:21 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Do not log contents of installed keypairs by default https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/908838 | 16:32 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-plugins master: Do not log contents of installed keypairs by default https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/908838 | 16:40 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Add collection to deploy magnum cluster-api with vexxhost driver https://review.opendev.org/c/openstack/openstack-ansible-ops/+/901450 | 17:12 |
opendevreview | Merged openstack/openstack-ansible-rabbitmq_server master: Remove legacy upgrade task https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/907758 | 19:45 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Cluster API Bootstrapping playbook https://review.opendev.org/c/openstack/openstack-ansible-ops/+/902178 | 21:38 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Add role to install and run sonobouy k8s validation tests https://review.opendev.org/c/openstack/openstack-ansible-ops/+/906054 | 21:38 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Add playbook to run functional test of magnum capi driver https://review.opendev.org/c/openstack/openstack-ansible-ops/+/906361 | 21:38 |
opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Add hook playbook install and test magnum capi driver https://review.opendev.org/c/openstack/openstack-ansible-ops/+/906363 | 21:38 |
opendevreview | Merged openstack/openstack-ansible-os_blazar master: Enabled memcached usage for token caching https://review.opendev.org/c/openstack/openstack-ansible-os_blazar/+/904878 | 23:18 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!