| abdi | is anyone running into 404 resource not found errors for various tempest tests? I am using the master branch. For example, the following test: tempest.scenario.test_stamp_pattern.TestStampPattern.test_stamp_pattern invokes "POST http://15.113.218.73:9696/networking/v2.0/security-groups" to create a security group but fails with a 404 error: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be | 00:24 |
|---|---|---|
| abdi | found.", "detail": ""}} | 00:24 |
| abdi | I’ve root caused the issue above. You can ignore the question. Thanks. | 03:02 |
| gmann | k | 04:02 |
| *** pojadhav is now known as pojadhav|ruck | 04:36 | |
| *** tkajinam is now known as Guest299 | 04:46 | |
| *** soniya29 is now known as soniya29|lunch | 07:30 | |
| *** soniya29|lunch is now known as soniya29 | 08:14 | |
| opendevreview | Merged openstack/tempest master: Add release notes page for version 33.0.0 https://review.opendev.org/c/openstack/tempest/+/868543 | 09:24 |
| opendevreview | Merged openstack/tempest master: Remove references to 'all-plugin' tox environment https://review.opendev.org/c/openstack/tempest/+/860719 | 10:33 |
| opendevreview | Merged openstack/tempest master: zuul: Increase timeout for c9s-fips job https://review.opendev.org/c/openstack/tempest/+/866049 | 13:44 |
| *** soniya29 is now known as soniya29|out | 16:08 | |
| *** pojadhav|ruck is now known as pojadhav|out | 16:13 | |
| opendevreview | Ghanshyam Mann proposed openstack/tempest master: DNM: tetsing tox https://review.opendev.org/c/openstack/tempest/+/869404 | 20:34 |
| abdi | I am consistently seeing this AMQP server unreachable error right after a volume attachment request during the tempest test: cinder_tempest_plugin.scenario.test_volume_multiattach.VolumeMultiattachTests.test_multiattach_data_integrity. | 23:18 |
| abdi | Jan 05 02:22:43 devstack@n-api.service[2190307]: POST /compute/v2.1/servers/53da3852-4a03-42cb-937e-10929b6892d5/os-volume_attachments => generated 194 bytes in 391 msecs | 23:18 |
| abdi | Jan 05 02:40:36 devstack@n-api.service[2190308]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1849e160-fcc5-4c72-a8e0-664530f0e6c0] AMQP server on 15.113.218.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError. | 23:18 |
| abdi | The resulting failure is that the volume never attaches (transition from "Reserved" to "In Use" and goes back to "Available" status), which causes the test failure. I am investigating whether the oslo AMQP error is the culprit of or resulting from the volume attachment issue. The 18mins gap in the timestamp is leading me to believe the events are related. | 23:18 |
| abdi | I have combed nova, tempest, and cinder logs. I am looking for guidance as to what other logs could provide insights. Thanks ahead. | 23:18 |
| abdi | I should note that I am using the master devstack branch | 23:25 |
| clarkb | connection reset by peer implicates the other side of the connection (the amqp server) I would look at the logs for rabbit | 23:28 |
| abdi | Thank you clarkb. | 23:33 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!