| *** rlandy|ruck is now known as rlandy|out | 01:13 | |
| opendevreview | chandan kumar proposed openstack/tripleo-ci master: Added tripleo-ci-post ansible role https://review.opendev.org/c/openstack/tripleo-ci/+/832254 | 01:59 |
|---|---|---|
| opendevreview | chandan kumar proposed openstack/tripleo-ci master: Use required-projects-multinode-upstream as parent for multinode jobs https://review.opendev.org/c/openstack/tripleo-ci/+/831151 | 02:07 |
| opendevreview | Merged openstack/tripleo-heat-templates stable/victoria: Fix attr corresponding to ManilaCephFSNFSIdmapOverrides https://review.opendev.org/c/openstack/tripleo-heat-templates/+/831390 | 02:34 |
| *** frenzy_friday is now known as frenzyfriday|rover | 03:00 | |
| *** ysandeep|out is now known as ysandeep | 03:45 | |
| opendevreview | Brendan Shephard proposed openstack/python-tripleoclient master: Remove upgrade converge https://review.opendev.org/c/openstack/python-tripleoclient/+/817127 | 04:00 |
| opendevreview | chandan kumar proposed openstack/tripleo-ci master: Added tripleo-ci-post ansible role https://review.opendev.org/c/openstack/tripleo-ci/+/832254 | 04:07 |
| opendevreview | chandan kumar proposed openstack/tripleo-ci master: Use required-projects-multinode-upstream as parent for multinode jobs https://review.opendev.org/c/openstack/tripleo-ci/+/831151 | 04:07 |
| opendevreview | Brendan Shephard proposed openstack/python-tripleoclient master: Add verification for duplicate params https://review.opendev.org/c/openstack/python-tripleoclient/+/831477 | 04:21 |
| *** soniya29 is now known as soniya29|ruck | 05:21 | |
| opendevreview | Brendan Shephard proposed openstack/python-tripleoclient master: Add verification for duplicate params https://review.opendev.org/c/openstack/python-tripleoclient/+/831477 | 05:34 |
| opendevreview | Cedric Jeanneret proposed openstack/tripleo-ansible master: Disable GSSAPIAuthentication by default https://review.opendev.org/c/openstack/tripleo-ansible/+/832495 | 05:59 |
| Tengu | bshephar: -^^ | 05:59 |
| bshephar | ++ | 05:59 |
| Tengu | rlandy|out: heya! just got my master deploy running. UC works fine, but seeing the console of the controller-0, I'm pretty sure it will fail due to some UUID things preventing to boot on the actual system. | 06:30 |
| Tengu | guess that's the issue you mentioned. | 06:30 |
| Tengu | yeah. bingo. that dracut timeout, waiting on a disk UUID that doesn't exist. | 06:30 |
| Tengu | "yay". | 06:31 |
| opendevreview | Karthik S proposed openstack/os-net-config stable/wallaby: Revert "Updating sriov_config.service to run before driverctl.slice and network-pre" https://review.opendev.org/c/openstack/os-net-config/+/832316 | 06:35 |
| opendevreview | Francesco Pantano proposed openstack/python-tripleoclient master: Make --osd-spec and --crush-hierarchy not mutually exclusive https://review.opendev.org/c/openstack/python-tripleoclient/+/832339 | 07:03 |
| opendevreview | chandan kumar proposed openstack/tripleo-ci master: Use required-projects-multinode-upstream as parent for multinode jobs https://review.opendev.org/c/openstack/tripleo-ci/+/831151 | 07:08 |
| opendevreview | Francesco Pantano proposed openstack/tripleo-ansible master: Handle composed role name not strictly matching deployed server name https://review.opendev.org/c/openstack/tripleo-ansible/+/831523 | 07:09 |
| *** frenzy_friday is now known as frenzyfriday|rover | 07:44 | |
| opendevreview | Mikolaj Ciecierski proposed openstack/tripleo-upgrade stable/wallaby: Fix ping_results_*.log file name https://review.opendev.org/c/openstack/tripleo-upgrade/+/832501 | 08:28 |
| *** jpena|off is now known as jpena | 08:33 | |
| opendevreview | Mikolaj Ciecierski proposed openstack/tripleo-upgrade stable/ussuri: Fix ping_results_*.log file name https://review.opendev.org/c/openstack/tripleo-upgrade/+/832502 | 08:34 |
| opendevreview | Mikolaj Ciecierski proposed openstack/tripleo-upgrade stable/victoria: Fix ping_results_*.log file name https://review.opendev.org/c/openstack/tripleo-upgrade/+/832503 | 08:37 |
| opendevreview | Mikolaj Ciecierski proposed openstack/tripleo-upgrade stable/train: Fix ping_results_*.log file name https://review.opendev.org/c/openstack/tripleo-upgrade/+/832504 | 08:39 |
| opendevreview | chandan kumar proposed openstack/tripleo-ci master: Use tripleo-ci-build-containers-required-projects-upstream as parent https://review.opendev.org/c/openstack/tripleo-ci/+/831631 | 08:59 |
| opendevreview | chandan kumar proposed openstack/tripleo-ci master: Use tripleo-ci-build-images-required-projects-upstream as parent https://review.opendev.org/c/openstack/tripleo-ci/+/832184 | 09:06 |
| *** pmannidi is now known as pmannidi|AFK | 09:16 | |
| opendevreview | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Add extra debugging from the cache backend https://review.opendev.org/c/openstack/tripleo-heat-templates/+/832506 | 09:24 |
| opendevreview | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Add extra debugging from the cache backend https://review.opendev.org/c/openstack/tripleo-heat-templates/+/832506 | 09:25 |
| opendevreview | Marios Andreou proposed openstack/tripleo-ci master: Adds centos-9-scen000 minor update job to wallaby upgrade template https://review.opendev.org/c/openstack/tripleo-ci/+/831932 | 09:25 |
| Tengu | rlandy|out: uho. after check, it was using the overcloud-full image. re-kicking. | 09:36 |
| opendevreview | Francesco Pantano proposed openstack/python-tripleoclient stable/wallaby: Move get_ctlplane_attrs to utils https://review.opendev.org/c/openstack/python-tripleoclient/+/832507 | 09:44 |
| marios | spotz: o/ hey can you please have a look at that when you next have a chance https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/831198 - also please help me find another core to merge that? (can you please add someone else to the review if you agree) thank you! | 09:53 |
| opendevreview | Gregory Thiemonge proposed openstack/tripleo-ansible master: Prevent the abusive restart of the octavia services https://review.opendev.org/c/openstack/tripleo-ansible/+/832508 | 09:57 |
| opendevreview | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Drop services not used for undercloud role https://review.opendev.org/c/openstack/tripleo-heat-templates/+/827277 | 09:59 |
| *** frenzy_friday is now known as frenzyfriday|rover | 10:01 | |
| opendevreview | Bogdan Dobrelya proposed openstack/tripleo-heat-templates stable/train: [Train-only] Update cells db connection, if needed https://review.opendev.org/c/openstack/tripleo-heat-templates/+/830490 | 10:02 |
| opendevreview | Merged openstack/tripleo-heat-templates stable/victoria: Defining fs.aio-max-nr for hosts with libvirt service https://review.opendev.org/c/openstack/tripleo-heat-templates/+/829034 | 10:03 |
| opendevreview | Merged openstack/tripleo-heat-templates stable/ussuri: Defining fs.aio-max-nr for hosts with libvirt service https://review.opendev.org/c/openstack/tripleo-heat-templates/+/829035 | 10:03 |
| opendevreview | Merged openstack/tripleo-ci master: Add standard job definition for containers and Image base job https://review.opendev.org/c/openstack/tripleo-ci/+/832278 | 10:03 |
| opendevreview | Merged openstack/tripleo-common master: Export default location of password file https://review.opendev.org/c/openstack/tripleo-common/+/830994 | 10:03 |
| opendevreview | Merged openstack/python-tripleoclient master: Fix positional timeout arg https://review.opendev.org/c/openstack/python-tripleoclient/+/830819 | 10:03 |
| opendevreview | Merged openstack/tripleo-quickstart-extras master: Temporarily freeze openssl version https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/832309 | 10:03 |
| opendevreview | Merged openstack/tripleo-quickstart-extras master: Temporarily freeze openssl https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/832116 | 10:03 |
| opendevreview | Lukas Bezdicka proposed openstack/tripleo-upgrade stable/wallaby: Ensure migrate all the VMs before upgrade the compute https://review.opendev.org/c/openstack/tripleo-upgrade/+/832320 | 10:15 |
| opendevreview | Lukas Bezdicka proposed openstack/tripleo-upgrade stable/victoria: Ensure migrate all the VMs before upgrade the compute https://review.opendev.org/c/openstack/tripleo-upgrade/+/832321 | 10:15 |
| opendevreview | Lukas Bezdicka proposed openstack/tripleo-upgrade stable/ussuri: Ensure migrate all the VMs before upgrade the compute https://review.opendev.org/c/openstack/tripleo-upgrade/+/832322 | 10:16 |
| opendevreview | Lukas Bezdicka proposed openstack/tripleo-upgrade stable/train: Ensure migrate all the VMs before upgrade the compute https://review.opendev.org/c/openstack/tripleo-upgrade/+/831182 | 10:16 |
| Tengu | rlandy|out: ok - dropped in grub rescue. even better :). | 10:20 |
| *** frenzy_friday is now known as frenzyfriday|rover | 10:51 | |
| opendevreview | chandan kumar proposed openstack/tripleo-ci master: Add missing image build job post-run playbook part https://review.opendev.org/c/openstack/tripleo-ci/+/832516 | 11:04 |
| opendevreview | Tom Weininger proposed openstack/tripleo-heat-templates master: DNM Test new Octavia TLS parameters https://review.opendev.org/c/openstack/tripleo-heat-templates/+/832217 | 11:10 |
| *** rlandy|out is now known as rlandy|ruck | 11:15 | |
| *** dviroel|out is now known as dviroel | 11:22 | |
| opendevreview | Martin Schuppert proposed openstack/tripleo-heat-templates master: Fix network-environment.yaml ipv6 {{network.name}}Routes https://review.opendev.org/c/openstack/tripleo-heat-templates/+/832520 | 11:30 |
| *** pojadhav is now known as pojadhav|brb | 11:32 | |
| *** pojadhav|brb is now known as pojadhav | 11:41 | |
| opendevreview | Merged openstack/tripleo-validations stable/train: Change ansible_hostname to use ansible_facts https://review.opendev.org/c/openstack/tripleo-validations/+/823843 | 11:57 |
| opendevreview | Merged openstack/tripleo-validations stable/train: Make sure fact is available to find hostname https://review.opendev.org/c/openstack/tripleo-validations/+/823844 | 11:57 |
| opendevreview | amolkahat proposed openstack/tripleo-ci master: Add tripleo-ci-base-standalone-standard parent https://review.opendev.org/c/openstack/tripleo-ci/+/830987 | 11:58 |
| *** ykarel is now known as ykarel|mtg | 12:02 | |
| opendevreview | Cedric Jeanneret proposed openstack/tripleo-heat-templates master: Fix trailing slashes in bind-mounts and linting https://review.opendev.org/c/openstack/tripleo-heat-templates/+/831945 | 12:13 |
| Tengu | bogdando: -^^ just rebased your patch. good catch btw! | 12:14 |
| sakharkar_p | hjensas: I am trying to deploy 3 controllers 2 compute Wallaby Tripleo openstack overcloud. Ansible is failing on compute nodes as :- "FATAL | Check all networks Gateway availability | overcloud-novacompute-0 | error={"msg": "Invalid data passed to 'loop', it requires a list, got this instead: . Hint: If you passed a list/dict of just one element, try adding wantlist=True to your lookup invocation or use q/query instead of lookup."}" | 12:15 |
| opendevreview | amolkahat proposed openstack/tripleo-ci master: Add tripleo-ci-base-standalone-standard parent https://review.opendev.org/c/openstack/tripleo-ci/+/830987 | 12:15 |
| sakharkar_p | hjensas: Anything that I need to change or add? | 12:15 |
| bogdando | Tengu: thanks | 12:20 |
| opendevreview | James Slagle proposed openstack/python-tripleoclient master: Overcloud export with ephemeral Heat https://review.opendev.org/c/openstack/python-tripleoclient/+/801053 | 12:23 |
| sakharkar_p | ysandeep: ^ | 12:26 |
| opendevreview | Merged openstack/tripleo-heat-templates master: Disable GSSAPIAuthentication by default https://review.opendev.org/c/openstack/tripleo-heat-templates/+/831790 | 12:35 |
| hjensas | sakharkar_p: Can you check the ansible inventory? What is in variable - tripleo_nodes_validation_ping_test_gateway_ips ? | 12:49 |
| hjensas | sakharkar_p: the gateway_ips to ping is gathered here - https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/overcloud.j2.yaml#L1193-L1210 | 12:51 |
| opendevreview | Szymon Datko proposed openstack/python-tripleoclient master: Add missing hostname package to bindep https://review.opendev.org/c/openstack/python-tripleoclient/+/832628 | 12:54 |
| opendevreview | Michal Nasiadka proposed openstack/diskimage-builder master: containerfile: add support for Docker https://review.opendev.org/c/openstack/diskimage-builder/+/832630 | 13:05 |
| opendevreview | David Vallee Delisle proposed openstack/tripleo-validations master: Validating that RetryFilter is not in nova https://review.opendev.org/c/openstack/tripleo-validations/+/832633 | 13:12 |
| opendevreview | Tom Weininger proposed openstack/tripleo-heat-templates master: Add Octavia TLS parameters https://review.opendev.org/c/openstack/tripleo-heat-templates/+/832216 | 13:16 |
| opendevreview | Tom Weininger proposed openstack/tripleo-heat-templates master: DNM Test new Octavia TLS parameters https://review.opendev.org/c/openstack/tripleo-heat-templates/+/832217 | 13:16 |
| sakharkar_p | hjensas: Controller are passing but only computes are failing. Checking for the variable tripleo_nodes_validation_ping_test_gateway_ips | 13:18 |
| sakharkar_p | hjensas: searched for the variable got the results as :- https://paste.opendev.org/show/b6Jy5znES6mcxOiUFkGy/ | 13:20 |
| hjensas | sakharkar_p: try the same search for 'ping_test_gateway_ips' | 13:21 |
| sakharkar_p | hjensas: output for 'ping_test_gateway_ips' is as follows: https://paste.opendev.org/show/bCfVAjcD8KEtjkyaRUXj/ | 13:23 |
| Tengu | sakharkar_p: care to provide the actual value as found in /home/stack/tripleo-deploy/undercloud/undercloud-ansible-joim9nv7/global_vars.yaml ? | 13:23 |
| Tengu | oh, and.. /home/stack/config-download/overcloud/global_vars.yaml | 13:24 |
| Tengu | missed it | 13:24 |
| hjensas | sakharkar_p: /home/stack/overcloud-deploy/overcloud/config-download/overcloud/global_vars.yaml /home/stack/config-download/overcloud/global_vars.yaml | 13:24 |
| Tengu | :) | 13:24 |
| hjensas | the value for the var in those files. :) | 13:24 |
| Tengu | hjensas: iirc they should be the same actually | 13:24 |
| Tengu | (i.e. same files - symlink or something) | 13:24 |
| Tengu | rlandy|ruck: heya! do you want me to join the ci call in 5' ? | 13:25 |
| Tengu | since there's an issue with the overcloud-hardened-full on cs9 master apparently :/ | 13:25 |
| rlandy|ruck | Tengu: you are welcome to | 13:27 |
| Tengu | more calls \o/ | 13:27 |
| opendevreview | Francesco Pantano proposed openstack/python-tripleoclient stable/wallaby: Add missing get_hostame function needed by deployed Ceph https://review.opendev.org/c/openstack/python-tripleoclient/+/832636 | 13:29 |
| *** ykarel|mtg is now known as ykarel | 13:29 | |
| opendevreview | Fernando Díaz Bravo proposed openstack/python-tripleoclient master: bnr - Set properly the default inventory file https://review.opendev.org/c/openstack/python-tripleoclient/+/830321 | 13:34 |
| opendevreview | Michal Nasiadka proposed openstack/diskimage-builder master: containerfile: add support for Docker https://review.opendev.org/c/openstack/diskimage-builder/+/832630 | 13:48 |
| *** pojadhav is now known as pojadhav|afk | 14:05 | |
| tbarron | 7 | 14:16 |
| *** sshnaidm is now known as sshnaidm|afk | 14:25 | |
| opendevreview | Sofer Athlan-Guyot proposed openstack/tripleo-ansible stable/train: [dnm] Ensure english locale when running the command for ovs checks. https://review.opendev.org/c/openstack/tripleo-ansible/+/832305 | 14:31 |
| *** pojadhav|afk is now known as pojadhav | 14:32 | |
| *** dasm|off is now known as dasm | 14:35 | |
| cloudnull | mornings | 14:43 |
| rlandy|ruck | fmount[m]: hello ... can you look into https://bugs.launchpad.net/tripleo/+bug/1964133? | 14:47 |
| rlandy|ruck | falling over on wallaby c9 | 14:47 |
| opendevreview | Douglas Viroel proposed openstack/tripleo-quickstart master: DNM - Testing fips compatible packages https://review.opendev.org/c/openstack/tripleo-quickstart/+/828911 | 15:02 |
| *** sshnaidm|afk is now known as sshnaidm | 15:02 | |
| opendevreview | Daniel Bengtsson proposed openstack/python-tripleoclient stable/wallaby: Add --reproduce-command option into Undercloud commands. https://review.opendev.org/c/openstack/python-tripleoclient/+/832652 | 15:08 |
| opendevreview | Merged openstack/tripleo-heat-templates master: Octavia: Add missing region_name parameters https://review.opendev.org/c/openstack/tripleo-heat-templates/+/832222 | 15:11 |
| opendevreview | Chris Sibbitt proposed openstack/tripleo-ansible master: Fix collectd path replacement bug https://review.opendev.org/c/openstack/tripleo-ansible/+/831796 | 15:19 |
| opendevreview | Matthias Runge proposed openstack/tripleo-common master: Update prometheus and alertmanager containers https://review.opendev.org/c/openstack/tripleo-common/+/832657 | 15:25 |
| *** fpantano is now known as fmount | 15:26 | |
| fmount | rlandy|ruck: sure, looking into it | 15:26 |
| rlandy|ruck | thanks | 15:28 |
| opendevreview | Francesco Pantano proposed openstack/tripleo-ansible master: Use the same ContainerCephDaemonImage defined for deployed Ceph. https://review.opendev.org/c/openstack/tripleo-ansible/+/831829 | 15:53 |
| fmount | rlandy|ruck: fultonj see https://logserver.rdoproject.org/openstack-periodic-integration-stable1-cs9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-scenario001-standalone-wallaby/5504f1d/logs/undercloud/var/log/extra/podman/containers/ceph-4b5c8c0a-ff60-454b-a1b4-9747aa737d19-mon-standalone-localdomain/log/ceph/ceph-osd.0.log.txt.gz | 16:02 |
| fmount | related to the failure https://logserver.rdoproject.org/openstack-periodic-integration-stable1-cs9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-scenario001-standalone-wallaby/5504f1d/logs/undercloud/home/zuul/tripleo-deploy/standalone-ansible-ttaesph_/cephadm/cephadm_command.log.txt.gz | 16:02 |
| fmount | so basically cephadm failed to add osd-0 to the cluster | 16:03 |
| fmount | and the failure is expected | 16:03 |
| * rlandy|ruck reads back | 16:03 | |
| fmount | rlandy|ruck: did this job worked in the past? | 16:03 |
| * fmount worried :/ | 16:03 | |
| rlandy|ruck | periodic-tripleo-ci-centos-9-scenario001-standalone-wallaby - yes | 16:04 |
| * rlandy|ruck gets history | 16:04 | |
| fmount | rlandy|ruck: ack | 16:05 |
| fmount | because I see this: OSD::mkfs: ObjectStore::mkfs failed with error (5) Input/output error | 16:05 |
| fmount | which is the reason of the failure :/ | 16:06 |
| fmount | but | 16:06 |
| fmount | container images and cpehadm rpms are the same | 16:06 |
| rlandy|ruck | fmount: https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-scenario001-standalone-wallaby | 16:06 |
| fmount | we didnt' change them | 16:06 |
| rlandy|ruck | note cloud outage from 03/03 | 16:06 |
| rlandy|ruck | checking latest run | 16:07 |
| rlandy|ruck | https://logserver.rdoproject.org/openstack-periodic-integration-stable1-cs9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-scenario001-standalone-wallaby/5504f1d/ | 16:07 |
| fmount | ack | 16:07 |
| opendevreview | Sofer Athlan-Guyot proposed openstack/tripleo-upgrade stable/wallaby: Generate tripleo ansible inventory for Validation https://review.opendev.org/c/openstack/tripleo-upgrade/+/832663 | 16:07 |
| rlandy|ruck | https://logserver.rdoproject.org/openstack-periodic-integration-stable1-cs9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-scenario001-standalone-wallaby/5504f1d/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 16:07 |
| fmount | rlandy|ruck: last run is the one I linked | 16:07 |
| rlandy|ruck | yeah - so still there | 16:08 |
| opendevreview | Sofer Athlan-Guyot proposed openstack/tripleo-upgrade stable/victoria: Generate tripleo ansible inventory for Validation https://review.opendev.org/c/openstack/tripleo-upgrade/+/832664 | 16:09 |
| opendevreview | chandan kumar proposed openstack/tripleo-ci master: Added tripleo-ci-post ansible role https://review.opendev.org/c/openstack/tripleo-ci/+/832254 | 16:15 |
| opendevreview | chandan kumar proposed openstack/tripleo-ci master: Use required-projects-multinode-upstream as parent for multinode jobs https://review.opendev.org/c/openstack/tripleo-ci/+/831151 | 16:15 |
| opendevreview | Sofer Athlan-Guyot proposed openstack/tripleo-upgrade stable/ussuri: Generate tripleo ansible inventory for Validation https://review.opendev.org/c/openstack/tripleo-upgrade/+/832666 | 16:17 |
| opendevreview | Sofer Athlan-Guyot proposed openstack/tripleo-upgrade stable/ussuri: Generate tripleo ansible inventory for Validation https://review.opendev.org/c/openstack/tripleo-upgrade/+/832666 | 16:18 |
| opendevreview | Sofer Athlan-Guyot proposed openstack/tripleo-upgrade stable/train: Generate tripleo ansible inventory for Validation https://review.opendev.org/c/openstack/tripleo-upgrade/+/832667 | 16:18 |
| opendevreview | Tom Weininger proposed openstack/tripleo-heat-templates master: Add Octavia TLS parameters https://review.opendev.org/c/openstack/tripleo-heat-templates/+/832216 | 16:24 |
| opendevreview | Tom Weininger proposed openstack/tripleo-heat-templates master: DNM Test new Octavia TLS parameters https://review.opendev.org/c/openstack/tripleo-heat-templates/+/832217 | 16:24 |
| opendevreview | Harald Jensås proposed openstack/tripleo-heat-templates stable/ussuri: Fix "ManageNetworks" use-case https://review.opendev.org/c/openstack/tripleo-heat-templates/+/832669 | 16:35 |
| opendevreview | Cedric Jeanneret proposed openstack/tripleo-common stable/train: Ensure failures on the undercloud leads to a complete stop https://review.opendev.org/c/openstack/tripleo-common/+/830931 | 16:36 |
| opendevreview | Merged openstack/tripleo-heat-templates stable/victoria: Exclude /etc/openldap to avoid overriding ro file https://review.opendev.org/c/openstack/tripleo-heat-templates/+/830575 | 16:40 |
| opendevreview | Merged openstack/tripleo-validations stable/train: oslo_config_validator: Defaulting config_invalidations to empty list https://review.opendev.org/c/openstack/tripleo-validations/+/828751 | 16:40 |
| opendevreview | Merged openstack/tripleo-validations stable/train: Remove domain equivalence check https://review.opendev.org/c/openstack/tripleo-validations/+/823995 | 16:40 |
| opendevreview | Douglas Viroel proposed openstack/tripleo-quickstart-extras master: DNM - Debugging fs039 failures https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/832670 | 16:44 |
| opendevreview | Sofer Athlan-Guyot proposed openstack/tripleo-ansible master: Ensure english locale when running the command for ovs checks. https://review.opendev.org/c/openstack/tripleo-ansible/+/832671 | 16:44 |
| opendevreview | Bogdan Dobrelya proposed openstack/puppet-tripleo master: Differentiate hw_machine_type for FFU and non-FFU https://review.opendev.org/c/openstack/puppet-tripleo/+/832672 | 16:45 |
| opendevreview | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: (Re)pin nova-hw-machine-type-upgrade automagically https://review.opendev.org/c/openstack/tripleo-heat-templates/+/828894 | 16:53 |
| opendevreview | Merged openstack/tripleo-validations stable/train: Remove Docker references https://review.opendev.org/c/openstack/tripleo-validations/+/824035 | 16:53 |
| opendevreview | Merged openstack/tripleo-validations stable/train: Add undercloud-ipa-server-check task https://review.opendev.org/c/openstack/tripleo-validations/+/824046 | 16:53 |
| opendevreview | Merged openstack/tripleo-validations stable/train: Add validation for tripleo-ipa https://review.opendev.org/c/openstack/tripleo-validations/+/824216 | 16:53 |
| opendevreview | Merged openstack/tripleo-validations master: Redefining the irrelevant files list to ensure execution graph stability https://review.opendev.org/c/openstack/tripleo-validations/+/831940 | 16:54 |
| opendevreview | Merged openstack/validations-common stable/1.6: Update .gitreview for stable/1.6 https://review.opendev.org/c/openstack/validations-common/+/832271 | 16:54 |
| opendevreview | Merged openstack/tripleo-upgrade stable/wallaby: Fix ping_results_*.log file name https://review.opendev.org/c/openstack/tripleo-upgrade/+/832501 | 16:54 |
| *** dviroel is now known as dviroel|lunch | 16:57 | |
| *** frenzyfriday|rover is now known as frenzyfriday|pto | 17:00 | |
| *** jpena is now known as jpena|off | 17:32 | |
| *** odyssey4me is now known as Guest1620 | 17:47 | |
| *** odyssey4me_ is now known as odyssey4me | 17:47 | |
| opendevreview | Matthias Runge proposed openstack/tripleo-common master: Update prometheus and alertmanager containers https://review.opendev.org/c/openstack/tripleo-common/+/832657 | 17:52 |
| *** dviroel|lunch is now known as dviroel | 17:52 | |
| opendevreview | Matthias Runge proposed openstack/tripleo-common master: Update prometheus and alertmanager containers https://review.opendev.org/c/openstack/tripleo-common/+/832657 | 19:11 |
| opendevreview | James Slagle proposed openstack/python-tripleoclient master: Check undercloud disk space during overcloud deploy https://review.opendev.org/c/openstack/python-tripleoclient/+/831060 | 20:23 |
| opendevreview | James Slagle proposed openstack/python-tripleoclient master: Overcloud export with ephemeral Heat https://review.opendev.org/c/openstack/python-tripleoclient/+/801053 | 20:42 |
| opendevreview | Merged openstack/tripleo-upgrade stable/train: Ensure migrate all the VMs before upgrade the compute https://review.opendev.org/c/openstack/tripleo-upgrade/+/831182 | 20:47 |
| opendevreview | Douglas Viroel proposed openstack/tripleo-quickstart-extras master: Updates baremetal-full-freeipa playbook to reload NetworkManager https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/832670 | 20:51 |
| fultonj | rlandy|ruck: https://bugs.launchpad.net/tripleo/+bug/1964133/comments/1 | 21:03 |
| rlandy|ruck | fultonj: looking through all those failures | 21:04 |
| rlandy|ruck | I could not reproduce the standalone deploy failure | 21:04 |
| rlandy|ruck | but there are a ton of tempest failures | 21:04 |
| rlandy|ruck | that may all be related to each other | 21:04 |
| fultonj | tempest failures are a problem, but not at all related to 1964133 | 21:05 |
| fultonj | in 1964133 no OSDs came up so I'm trying to figure out why they didn't come up | 21:05 |
| rlandy|ruck | oh no, we have a different tempest bug | 21:05 |
| rlandy|ruck | the original failure was in deploy ... https://logserver.rdoproject.org/3d/3de35c67026f664c2dc7fca0bce8500664a5a0b0/openstack-periodic-integration-stable1-cs9/periodic-tripleo-ci-centos-9-scenario001-standalone-wallaby/94d57f3/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 21:06 |
| rlandy|ruck | that one has cleared I think | 21:06 |
| rlandy|ruck | so now we're digging through a bunch of tempest | 21:06 |
| fultonj | rlandy|ruck: that deploy log shows it failing on ceph deploy | 21:07 |
| rlandy|ruck | yeah - that was the first log | 21:08 |
| * rlandy|ruck gets latest run | 21:08 | |
| fultonj | same error as in https://bugs.launchpad.net/tripleo/+bug/1964133 | 21:08 |
| fultonj | FATAL | Wait for expected number of osds | 21:08 |
| fultonj | https://logserver.rdoproject.org/3d/3de35c67026f664c2dc7fca0bce8500664a5a0b0/openstack-periodic-integration-stable1-cs9/periodic-tripleo-ci-centos-9-scenario001-standalone-wallaby/94d57f3/logs/undercloud/home/zuul/tripleo-deploy/standalone-ansible-yj9fjd75/cephadm/cephadm_command.log.txt.gz | 21:08 |
| rlandy|ruck | https://logserver.rdoproject.org/54/36254/71/check/periodic-tripleo-ci-centos-9-scenario001-standalone-wallaby/323904a/logs/undercloud/var/log/tempest/stestr_results.html.gz | 21:08 |
| rlandy|ruck | latest run as I see it | 21:08 |
| fultonj | ok those are tempest failures on .test_snapshot_pattern.TestSnapshotPattern | 21:09 |
| rlandy|ruck | fultonj; ^^ looks like the same tempest errors we are seeing elsewhere | 21:09 |
| fultonj | ok | 21:10 |
| fultonj | 16:06 <rlandy|ruck> that one has cleared I think | 21:10 |
| fultonj | but when you said ^ | 21:10 |
| fultonj | do you mean there's no more OSD coming errors? | 21:10 |
| fultonj | if you got to that tempest error, then the OSDs came up | 21:10 |
| fultonj | do we have an LP bug for those tempest failures with test_snapshot_pattern? | 21:11 |
| fultonj | rlandy|ruck: ^ ? | 21:12 |
| *** odyssey4me is now known as Guest1634 | 21:15 | |
| fultonj | because if not i can open one | 21:15 |
| * fultonj thought thought the OSDs not coming up was the biggest problem https://bugs.launchpad.net/tripleo/+bug/1964133 | 21:15 | |
| rlandy|ruck | fultonj: it was when the bug was first logged | 21:16 |
| fultonj | ? | 21:16 |
| fultonj | rlandy|ruck: do you mean that bug/1964133 is for failures of periodic-tripleo-ci-centos-9-scenario001-standalone-wallaby and that originally it was OSDs failing to come up, but now it's about temptest failures instead? | 21:17 |
| rlandy|ruck | I'll comment more on that bug | 21:17 |
| rlandy|ruck | I think so | 21:17 |
| rlandy|ruck | confirming with the next run | 21:17 |
| rlandy|ruck | we've had some cloud instability | 21:17 |
| rlandy|ruck | I'll ping if it's still on ceph | 21:18 |
| fultonj | so we have a recent enough example of peroidic not failing on OSDs coming up. if it's temptest failing on cinder i can still help :) | 21:18 |
| rlandy|ruck | fultonj: ok - so that we may have ... | 21:21 |
| rlandy|ruck | basically we're tracking dozens of c9 tempest failures on https://bugs.launchpad.net/tripleo/+bug/1963907 | 21:28 |
| rlandy|ruck | not all are neutron only though | 21:29 |
| rlandy|ruck | we started there | 21:29 |
| rlandy|ruck | and then some in c8 | 21:30 |
| rlandy|ruck | https://bugs.launchpad.net/tripleo/+bug/1963907 | 21:30 |
| fultonj | ok! | 21:31 |
| fultonj | so asking for the bug with the tempest failures is like drinking the ocean | 21:31 |
| fultonj | but 1964133 might be for the storage tempest failures | 21:31 |
| rlandy|ruck | fultonj: exactly ... but I can confirm the deploy failure is no longer | 21:33 |
| rlandy|ruck | so we're down to a cazillion failing tempest tests | 21:34 |
| rlandy|ruck | and three actually promoting lines | 21:34 |
| rlandy|ruck | which is better than where we were yesterday | 21:34 |
| rlandy|ruck | so that's a start | 21:34 |
| fultonj | yeah, tha'ts good | 21:34 |
| fultonj | and... deploy failure is no longer is very good | 21:34 |
| opendevreview | John Fulton proposed openstack/tripleo-heat-templates master: Have Ceph log to a file for scenario 001/004 https://review.opendev.org/c/openstack/tripleo-heat-templates/+/832701 | 21:45 |
| opendevreview | John Fulton proposed openstack/tripleo-heat-templates stable/wallaby: Have Ceph log to a file for scenario 001/004 https://review.opendev.org/c/openstack/tripleo-heat-templates/+/832712 | 21:46 |
| rlandy|ruck | yep - we're narrowing it down to bunch of failures - that may be related to ssh keys | 22:02 |
| *** dviroel is now known as dviroel|afk | 22:03 | |
| fultonj | the two cinder temptest tests which failed both use SSH | 22:07 |
| opendevreview | Brendan Shephard proposed openstack/tripleo-heat-templates stable/wallaby: Disable GSSAPIAuthentication by default https://review.opendev.org/c/openstack/tripleo-heat-templates/+/832706 | 22:25 |
| *** pmannidi|AFK is now known as pmannidi|Away | 23:14 | |
| *** pmannidi|Away is now known as pmannidi|AFK | 23:15 | |
| opendevreview | Takashi Kajinami proposed openstack/tripleo-heat-templates master: Nova: Fix missing cache backend https://review.opendev.org/c/openstack/tripleo-heat-templates/+/832708 | 23:15 |
| *** pmannidi|AFK is now known as pmannidi | 23:15 | |
| *** pmannidi is now known as pmannidi|Away | 23:15 | |
| *** pmannidi|Away is now known as pmannidi | 23:15 | |
| opendevreview | Merged openstack/tripleo-validations stable/victoria: oslo_config_validator: Defaulting config_invalidations to empty list https://review.opendev.org/c/openstack/tripleo-validations/+/828669 | 23:30 |
| *** rlandy|ruck is now known as rlandy|out | 23:36 | |
| opendevreview | Takashi Kajinami proposed openstack/tripleo-heat-templates master: Use consistent indent in .sh files https://review.opendev.org/c/openstack/tripleo-heat-templates/+/831217 | 23:38 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!