| opendevreview | Takashi Kajinami proposed openstack/puppet-tripleo master: Include db classes explicitly https://review.opendev.org/c/openstack/puppet-tripleo/+/786644 | 01:13 |
|---|---|---|
| opendevreview | Ronelle Landy proposed openstack/openstack-tempest-skiplist master: Add -train and -ussuri branchful tests in scenario010 https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/802222 | 01:16 |
| *** pmannidi is now known as pmannidi|remote | 01:30 | |
| *** pmannidi|remote is now known as pmannidi | 01:54 | |
| *** pmannidi is now known as pmannidi|brb | 02:43 | |
| opendevreview | Merged openstack/python-tripleoclient master: Enabling pylint no-else-return https://review.opendev.org/c/openstack/python-tripleoclient/+/802032 | 04:10 |
| opendevreview | Merged openstack/tripleo-heat-templates master: Role parameter for tripleo_kernel_defer_reboot https://review.opendev.org/c/openstack/tripleo-heat-templates/+/801518 | 04:11 |
| *** pmannidi|brb is now known as pmannidi | 04:22 | |
| *** pojadhav- is now known as pojadhav | 05:29 | |
| opendevreview | Martin Schuppert proposed openstack/tripleo-heat-templates master: Enable archive task_log records while archiving the database https://review.opendev.org/c/openstack/tripleo-heat-templates/+/801939 | 05:38 |
| *** marios is now known as marios|ruck | 05:41 | |
| opendevreview | Merged openstack/tripleo-heat-templates master: Remove leftover of hieradata cleanup https://review.opendev.org/c/openstack/tripleo-heat-templates/+/800582 | 06:02 |
| opendevreview | Takashi Kajinami proposed openstack/tripleo-heat-templates stable/wallaby: Remove leftover of hieradata cleanup https://review.opendev.org/c/openstack/tripleo-heat-templates/+/802205 | 06:42 |
| *** amoralej|off is now known as amoralej | 06:45 | |
| opendevreview | Brendan Shephard proposed openstack/paunch stable/ussuri: Clean up containers with paunch defaults https://review.opendev.org/c/openstack/paunch/+/800411 | 06:51 |
| marios|ruck | pojadhav: https://review.opendev.org/c/openstack/tripleo-ci/+/797865/18#message-f54d225e492e242a96898893b2aaa6ed6eb874c3 | 07:11 |
| marios|ruck | pojadhav: careful about running that unnecessarily maybe you meant to run the 3rd party jobs instead (check-rdo) | 07:13 |
| pojadhav | marios|ruck, yeah for this RDO Third Party CI i posted recheck | 07:19 |
| pojadhav | is there a way to run only "RDO Third Party CI" again? | 07:19 |
| marios|ruck | pojadhav: yeah use check-rdo for that (see https://review.rdoproject.org/r/gitweb?p=config.git;a=blob;f=zuul.d/upstream.yaml#l572 ) | 07:21 |
| pojadhav | marios|ruck, ohhk thanks.. :) | 07:21 |
| marios|ruck | pojadhav: not only bad for resources but also you are taking a risk to merge your change :) like you had green ci report from zuul and you asked it to go again | 07:22 |
| marios|ruck | pojadhav: could fail for some new bug, or some transient issue and then you are delayed again | 07:22 |
| pojadhav | marios|ruck, yeah.. | 07:23 |
| marios|ruck | pojadhav: ack thanks for checking | 07:23 |
| pojadhav | marios|ruck, :-) | 07:23 |
| opendevreview | Grzegorz Grasza proposed openstack/tripleo-ci master: Enable memcached TLS testing in tripleo-standalone-multinode-ipa https://review.opendev.org/c/openstack/tripleo-ci/+/787331 | 07:41 |
| opendevreview | Grzegorz Grasza proposed openstack/tripleo-ci master: Test https://review.opendev.org/c/openstack/tripleo-ci/+/787955 | 07:41 |
| opendevreview | Grzegorz Grasza proposed openstack/tripleo-ci master: Enable Memcached TLS testing in tripleo-standalone-multinode-ipa https://review.opendev.org/c/openstack/tripleo-ci/+/787331 | 07:49 |
| opendevreview | Grzegorz Grasza proposed openstack/tripleo-ci master: Test https://review.opendev.org/c/openstack/tripleo-ci/+/787955 | 07:50 |
| *** rpittau|afk is now known as rpittau | 07:55 | |
| opendevreview | Juan Larriba proposed openstack/tripleo-ansible stable/wallaby: Remove the usage of ansible_date_time https://review.opendev.org/c/openstack/tripleo-ansible/+/801883 | 07:59 |
| opendevreview | Ananya proposed openstack/tripleo-ci-health-queries master: Updating the queries https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/802028 | 08:04 |
| opendevreview | Sorin Sbârnea proposed openstack/tripleo-repos master: Enable ansible-test sanity checks https://review.opendev.org/c/openstack/tripleo-repos/+/800462 | 08:40 |
| opendevreview | Ananya proposed openstack/tripleo-ci-health-queries master: Updating the queries https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/802028 | 08:47 |
| *** holser is now known as holser_ | 08:50 | |
| *** ykarel_ is now known as ykarel | 08:52 | |
| *** chem is now known as Guest2267 | 09:01 | |
| *** ykarel_ is now known as ykarel | 09:03 | |
| opendevreview | Sorin Sbârnea proposed openstack/tripleo-repos master: Enable ansible-test sanity checks https://review.opendev.org/c/openstack/tripleo-repos/+/800462 | 09:21 |
| opendevreview | Jiri Podivin proposed openstack/tripleo-validations stable/wallaby: Corrected the task 'Get file_descriptors total_limit' to get the 'fs.file-max' value. https://review.opendev.org/c/openstack/tripleo-validations/+/802247 | 09:42 |
| opendevreview | Jiri Podivin proposed openstack/tripleo-validations stable/victoria: Corrected the task 'Get file_descriptors total_limit' to get the 'fs.file-max' value. https://review.opendev.org/c/openstack/tripleo-validations/+/802248 | 09:45 |
| opendevreview | Jiri Podivin proposed openstack/tripleo-validations stable/ussuri: Corrected the task 'Get file_descriptors total_limit' to get the 'fs.file-max' value. https://review.opendev.org/c/openstack/tripleo-validations/+/802249 | 09:47 |
| opendevreview | Jiri Podivin proposed openstack/tripleo-validations stable/train: Corrected the task 'Get file_descriptors total_limit' to get the 'fs.file-max' value. https://review.opendev.org/c/openstack/tripleo-validations/+/802250 | 09:47 |
| opendevreview | Merged openstack/tripleo-ansible master: The variables in ansible should be used as {{ variable }}. https://review.opendev.org/c/openstack/tripleo-ansible/+/801735 | 09:55 |
| *** pmannidi is now known as pmannidi|AFK | 09:59 | |
| opendevreview | Merged openstack/puppet-tripleo master: nova_virtlogd_wrapper: Simplify string matching https://review.opendev.org/c/openstack/puppet-tripleo/+/801865 | 09:59 |
| opendevreview | chandan kumar proposed openstack/tripleo-quickstart master: Remove tripleo-operator-ansible from TQE requires https://review.opendev.org/c/openstack/tripleo-quickstart/+/790701 | 10:08 |
| opendevreview | Juan Badia Payno proposed openstack/tripleo-ansible master: WIP - Managed ceph when is installed with cephadm https://review.opendev.org/c/openstack/tripleo-ansible/+/795318 | 10:09 |
| opendevreview | chandan kumar proposed openstack/tripleo-quickstart-extras master: Move build-test-packages as a part of undercloud setup https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/790926 | 10:10 |
| opendevreview | chandan kumar proposed openstack/tripleo-operator-ansible master: [DNM] check rpm building for tripleo-operator https://review.opendev.org/c/openstack/tripleo-operator-ansible/+/791118 | 10:23 |
| opendevreview | chandan kumar proposed openstack/tripleo-heat-templates master: [DNM] tripleo-operator-ansible rpm testing https://review.opendev.org/c/openstack/tripleo-heat-templates/+/801296 | 10:38 |
| opendevreview | Martin Schuppert proposed openstack/tripleo-heat-templates master: Parameter to set api policy to limit live migration to role https://review.opendev.org/c/openstack/tripleo-heat-templates/+/802027 | 10:42 |
| opendevreview | amolkahat proposed openstack/tripleo-ci master: move scenario010 to branched jobs for voting https://review.opendev.org/c/openstack/tripleo-ci/+/800540 | 10:57 |
| *** jcapitao is now known as jcapitao_lunch | 11:00 | |
| opendevreview | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Do not fail if haproxy container UUID changes https://review.opendev.org/c/openstack/tripleo-heat-templates/+/798427 | 11:07 |
| opendevreview | Martin Magr proposed openstack/puppet-tripleo stable/train: Create SSL certificates from sslProfiles https://review.opendev.org/c/openstack/puppet-tripleo/+/798662 | 11:09 |
| shyam89 | Hi | 11:24 |
| shyam89 | ykarel: Tengu: Don't we have "/var/log/containers/stdouts" log dir for puppet on rhosp13? | 11:24 |
| shyam89 | I don't find it on my compute node | 11:24 |
| Tengu | shyam89: I think it was introduced in osp-15, with the move to podman. not 100% sure though. | 11:25 |
| shyam89 | Tengu: I see. So before that where were we storing the logs of puppet? | 11:25 |
| opendevreview | Juan Pablo Lopez proposed openstack/tripleo-ansible master: Add backup and restore mode for ReaR configuration https://review.opendev.org/c/openstack/tripleo-ansible/+/797035 | 11:27 |
| Tengu | don't know - I started working on OSP starting 15 ^^' | 11:27 |
| shyam89 | Tengu: Okay, that's fine. Thank you. | 11:28 |
| shyam89 | I think "/var/log/messages" was the only location for puppet logs | 11:28 |
| Tengu | shyam89: that's possible yeah. back then, I thought it would be nice keeping the logs in dedicated files. It was far easier with podman, and I didn't really want to backport to stein (osp-13) back then. | 11:30 |
| Tengu | (yeah - I was the one adding this new location for the logs ;)) | 11:31 |
| shyam89 | Tengu: Great! | 11:31 |
| shyam89 | I liked this feature. | 11:31 |
| shyam89 | Well organized and easy to access. | 11:32 |
| Tengu | you're not the only one ;). it helps a lot for CI as well. | 11:32 |
| shyam89 | :q | 11:32 |
| shyam89 | :) | 11:32 |
| opendevreview | Jiri Podivin proposed openstack/python-tripleoclient master: Overriding the log path argument for tripleoclient cli https://review.opendev.org/c/openstack/python-tripleoclient/+/794577 | 11:34 |
| opendevreview | Sorin Sbârnea proposed openstack/tripleo-repos master: Enable ansible-test sanity checks https://review.opendev.org/c/openstack/tripleo-repos/+/800462 | 11:47 |
| *** dviroel|out is now known as dviroel | 11:53 | |
| opendevreview | Ananya proposed openstack/tripleo-ci-health-queries master: Updating the queries https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/802028 | 12:05 |
| opendevreview | Jose Luis Franco proposed openstack/python-tripleoclient stable/train: Add --db-only option in undercloud_backup. https://review.opendev.org/c/openstack/python-tripleoclient/+/801297 | 12:20 |
| opendevreview | Jiri Podivin proposed openstack/tripleo-quickstart master: Suppressing ignore-errors rule in irrelevant cases https://review.opendev.org/c/openstack/tripleo-quickstart/+/802303 | 12:22 |
| opendevreview | Juan Pablo Lopez proposed openstack/tripleo-ansible master: Add backup and restore mode for ReaR configuration https://review.opendev.org/c/openstack/tripleo-ansible/+/797035 | 12:23 |
| *** jcapitao_lunch is now known as jcapitao | 12:33 | |
| opendevreview | Merged openstack/tripleo-ci-health-queries master: Updating the queries https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/802028 | 12:34 |
| opendevreview | Jiri Podivin proposed openstack/validations-libs master: DNM Triggering the 'tripleo-ci-centos-8-undercloud-containers' https://review.opendev.org/c/openstack/validations-libs/+/801049 | 12:47 |
| opendevreview | Marios Andreou proposed openstack/tripleo-ansible stable/train: Add support for v2 registries.conf https://review.opendev.org/c/openstack/tripleo-ansible/+/801615 | 12:52 |
| *** amoralej is now known as amoralej|lunch | 12:55 | |
| opendevreview | Jiri Podivin proposed openstack/validations-libs master: DNM https://review.opendev.org/c/openstack/validations-libs/+/802307 | 12:58 |
| opendevreview | Jiri Podivin proposed openstack/validations-libs master: DNM https://review.opendev.org/c/openstack/validations-libs/+/802309 | 13:11 |
| opendevreview | Jiri Podivin proposed openstack/validations-libs master: DNM https://review.opendev.org/c/openstack/validations-libs/+/802309 | 13:14 |
| opendevreview | Juan Pablo Lopez proposed openstack/tripleo-ansible master: Adding playbook to perform the restoration of a controller node using Ironic/PXE https://review.opendev.org/c/openstack/tripleo-ansible/+/799512 | 13:21 |
| opendevreview | Shnaidman Sagi (Sergey) proposed openstack/tripleo-heat-templates master: Remove all docker related tasks from upgrades https://review.opendev.org/c/openstack/tripleo-heat-templates/+/802310 | 13:44 |
| sshnaidm | mwhahaha, holser_ can you please take a look if I do it right? ^^ | 13:44 |
| opendevreview | Sorin Sbârnea proposed openstack/tripleo-repos master: WIP: Enable ansible-test sanity checks https://review.opendev.org/c/openstack/tripleo-repos/+/800462 | 13:46 |
| *** amoralej|lunch is now known as amoralej | 13:50 | |
| opendevreview | Shnaidman Sagi (Sergey) proposed openstack/tripleo-heat-templates stable/wallaby: Remove all docker related tasks from upgrades https://review.opendev.org/c/openstack/tripleo-heat-templates/+/802212 | 13:55 |
| opendevreview | Shnaidman Sagi (Sergey) proposed openstack/tripleo-quickstart-extras master: DNM try ansible 2.11 https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/797823 | 13:56 |
| holser_ | sshnaidm I am fine with https://review.opendev.org/c/openstack/tripleo-heat-templates/+/802310 | 14:01 |
| holser_ | as we don't have docker after upgrade | 14:01 |
| opendevreview | Takashi Kajinami proposed openstack/validations-libs master: Add missing font for PDF generation https://review.opendev.org/c/openstack/validations-libs/+/802311 | 14:08 |
| tkajinam | ^^^ jpodivin | 14:09 |
| jpodivin | tkajinam++ what confuses me is that we didn't need it before | 14:10 |
| tkajinam | I'm not sure what is the actual trigger but I recently hit the same issue in a different repo | 14:10 |
| tkajinam | and that change fixed the issue https://review.opendev.org/c/openstack/i18n/+/800322 | 14:10 |
| jpodivin | tkajinam: I mean, it seems like the environment we are running the jobs in changed. | 14:11 |
| tkajinam | maybe something with base job definition is changed | 14:13 |
| jpodivin | Probably, although I have no idea why would that manifest sever weeks apart. Oh well, it's better to be explicit than implicit anyway | 14:14 |
| opendevreview | Jiri Podivin proposed openstack/validations-libs master: DNM https://review.opendev.org/c/openstack/validations-libs/+/802307 | 14:16 |
| ykarel | jpodivin, tkajinam, recently sphinx was upgraded that might have triggered it | 14:18 |
| ykarel | https://review.opendev.org/c/openstack/requirements/+/802179/ | 14:18 |
| opendevreview | Shnaidman Sagi (Sergey) proposed openstack/tripleo-heat-templates stable/victoria: Remove all docker related tasks from upgrades https://review.opendev.org/c/openstack/tripleo-heat-templates/+/802214 | 14:19 |
| opendevreview | Shnaidman Sagi (Sergey) proposed openstack/tripleo-heat-templates stable/ussuri: Remove all docker related tasks from upgrades https://review.opendev.org/c/openstack/tripleo-heat-templates/+/802215 | 14:19 |
| tkajinam | ykarel, ah. that is likely to be the cause | 14:19 |
| jpodivin | ykarel: thanks, that does seem to be most likely cause. | 14:21 |
| tkajinam | we might need the same for the other repos | 14:21 |
| opendevreview | Juan Badia Payno proposed openstack/tripleo-ansible master: WIP - Managed ceph when is installed with cephadm https://review.opendev.org/c/openstack/tripleo-ansible/+/795318 | 14:21 |
| jpodivin | tkajinam: quite probably. I'll take a look at the other validation repos. | 14:22 |
| jpodivin | Can't hurt (famous last words) | 14:22 |
| opendevreview | Jiri Podivin proposed openstack/validations-common master: Add missing font for PDF generation openstack-tox-docs job started to fail with the following error: ! LaTeX Error: File `tgtermes.sty' not found. This patch adds the required font package to bindep doc profile. https://review.opendev.org/c/openstack/validations-common/+/802313 | 14:26 |
| opendevreview | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Revert "Use single task for image upload for all releases" https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/802216 | 14:29 |
| opendevreview | Jiri Podivin proposed openstack/validations-common master: Add missing font for PDF generation https://review.opendev.org/c/openstack/validations-common/+/802313 | 14:37 |
| opendevreview | Sorin Sbârnea proposed openstack/ansible-role-collect-logs master: Upgrade ansible-lint/molecule runs https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/792652 | 14:52 |
| *** ykarel is now known as ykarel|away | 14:56 | |
| opendevreview | Sorin Sbârnea proposed openstack/tripleo-repos master: WIP: Enable ansible-test sanity checks https://review.opendev.org/c/openstack/tripleo-repos/+/800462 | 14:57 |
| opendevreview | Juan Badia Payno proposed openstack/tripleo-quickstart-extras master: :Create overcloud_baremetal_deploy.yaml file properly https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/797452 | 15:05 |
| opendevreview | Simon Dodsley proposed openstack/tripleo-heat-templates master: Add Pure Storage FlashBlade Manila driver https://review.opendev.org/c/openstack/tripleo-heat-templates/+/792850 | 15:12 |
| opendevreview | Juan Larriba proposed openstack/tripleo-ansible stable/victoria: Use serial or parallel execution depending on the kind of backup https://review.opendev.org/c/openstack/tripleo-ansible/+/802217 | 15:18 |
| opendevreview | Juan Larriba proposed openstack/tripleo-ansible stable/ussuri: Use serial or parallel execution depending on the kind of backup https://review.opendev.org/c/openstack/tripleo-ansible/+/802338 | 15:18 |
| opendevreview | Juan Larriba proposed openstack/tripleo-ansible stable/train: Use serial or parallel execution depending on the kind of backup https://review.opendev.org/c/openstack/tripleo-ansible/+/802339 | 15:20 |
| opendevreview | Juan Larriba proposed openstack/tripleo-ansible stable/wallaby: Fix tripleo_backup_and_restore_rear_simulate boolean check https://review.opendev.org/c/openstack/tripleo-ansible/+/802340 | 15:31 |
| opendevreview | Juan Larriba proposed openstack/tripleo-ansible stable/victoria: Fix tripleo_backup_and_restore_rear_simulate boolean check https://review.opendev.org/c/openstack/tripleo-ansible/+/802341 | 15:32 |
| opendevreview | Juan Larriba proposed openstack/tripleo-ansible stable/ussuri: Fix tripleo_backup_and_restore_rear_simulate boolean check https://review.opendev.org/c/openstack/tripleo-ansible/+/802342 | 15:34 |
| opendevreview | Juan Larriba proposed openstack/tripleo-ansible stable/train: Fix tripleo_backup_and_restore_rear_simulate boolean check https://review.opendev.org/c/openstack/tripleo-ansible/+/802343 | 15:35 |
| opendevreview | Juan Larriba proposed openstack/tripleo-ansible stable/train: Fix tripleo_backup_and_restore_rear_simulate boolean check https://review.opendev.org/c/openstack/tripleo-ansible/+/802343 | 15:37 |
| opendevreview | Juan Larriba proposed openstack/tripleo-ansible stable/train: Fix tripleo_backup_and_restore_rear_simulate boolean check https://review.opendev.org/c/openstack/tripleo-ansible/+/802343 | 15:39 |
| opendevreview | Juan Larriba proposed openstack/tripleo-ansible stable/train: Use serial or parallel execution depending on the kind of backup https://review.opendev.org/c/openstack/tripleo-ansible/+/802339 | 15:48 |
| *** holser_ is now known as holser | 16:00 | |
| *** rlandy is now known as rlandy|ruck | 16:10 | |
| opendevreview | Brent Eagles proposed openstack/tripleo-heat-templates master: Set stop grace periods for designate services https://review.opendev.org/c/openstack/tripleo-heat-templates/+/801642 | 16:15 |
| opendevreview | Mikolaj Ciecierski proposed openstack/ansible-role-tripleo-modify-image master: Adds patch mechanism for testing changes from OpenDev https://review.opendev.org/c/openstack/ansible-role-tripleo-modify-image/+/802006 | 16:20 |
| *** amoralej is now known as amoralej|off | 16:34 | |
| *** rpittau is now known as rpittau|afk | 16:37 | |
| *** holser is now known as holser_ | 16:41 | |
| *** marios|ruck is now known as marios|out | 16:54 | |
| *** dviroel is now known as dviroel|afk | 16:56 | |
| opendevreview | Merged openstack/puppet-tripleo master: Remove support for Cavium LiquidIO https://review.opendev.org/c/openstack/puppet-tripleo/+/799791 | 16:58 |
| opendevreview | Merged openstack/openstack-tempest-skiplist master: Add -train and -ussuri branchful tests in scenario010 https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/802222 | 17:19 |
| opendevreview | Merged openstack/tripleo-common stable/victoria: Bump nautilus containers to v4.0.19 https://review.opendev.org/c/openstack/tripleo-common/+/801711 | 17:20 |
| opendevreview | Merged openstack/tripleo-quickstart master: Removing inventory file path from tox https://review.opendev.org/c/openstack/tripleo-quickstart/+/801999 | 17:20 |
| rlandy|ruck | ramishra: hi - still around? ping re: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/802216 due to ussuri failures | 17:31 |
| mwhahaha | rlandy|ruck: i don't think he's around, is there something i can help with? | 17:47 |
| rlandy|ruck | mwhahaha: hey ... per ramishra's suggestion, I added this change: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/801192/1/roles/overcloud-prep-images/tasks/overcloud-prep-images.yml | 17:48 |
| rlandy|ruck | now ussuri tests are passing on fs002 (where they were failing before) | 17:48 |
| rlandy|ruck | but fs001, fs035, fs020 and fs039 are failing | 17:48 |
| rlandy|ruck | what should the value of undercloud_enable_nova on ussuri? | 17:49 |
| mwhahaha | true | 17:49 |
| rlandy|ruck | the patch removed line 35 tripleo_overcloud_image_upload_local: "{{ undercloud_enable_nova|default(false) }}" | 17:49 |
| rlandy|ruck | and looking at fs002 difference, | 17:50 |
| rlandy|ruck | https://codesearch.opendev.org/?q=undercloud_enable_nova&i=nope&files=&excludeFiles=&repos= | 17:50 |
| rlandy|ruck | that value is set on the other ovb fs | 17:50 |
| rlandy|ruck | but not 002 | 17:50 |
| rlandy|ruck | which I suspect is the difference | 17:50 |
| mwhahaha | i wonder if it was used for testing the nova-less | 17:50 |
| rlandy|ruck | but I'm kind of guessing | 17:50 |
| mwhahaha | aren't we all :D | 17:51 |
| mwhahaha | can you link me to a fail? | 17:51 |
| rlandy|ruck | I hope not :) | 17:51 |
| rlandy|ruck | https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-ussuri/f03c46e/logs/undercloud/home/zuul/overcloud_image_upload.log.txt.gz | 17:51 |
| rlandy|ruck | the dates of the failure sync up with where we merged the change above though | 17:52 |
| mwhahaha | so yea that's the error when enable_nova is true | 17:52 |
| mwhahaha | because we no longer deploy glance | 17:52 |
| rlandy|ruck | we have two choices, | 17:52 |
| rlandy|ruck | go back to not using the operator for ussuri | 17:52 |
| rlandy|ruck | which seemed to be working | 17:52 |
| rlandy|ruck | or get the release and fs settings right | 17:53 |
| rlandy|ruck | wit line 35 train was failing | 17:53 |
| rlandy|ruck | with | 17:53 |
| mwhahaha | https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-ussuri/2e624ba/logs/undercloud/home/zuul/undercloud.conf.txt.gz | 17:54 |
| mwhahaha | so a previous version has enable_nova set to false | 17:54 |
| mwhahaha | so it seems that for ussuri, it's using the metalsmith stuff | 17:54 |
| mwhahaha | it's likely we don't have the automagic upload logic to handle that in tripleoclient | 17:54 |
| mwhahaha | yea so there's magical logic for --local | 17:55 |
| rlandy|ruck | could we fix this by just setting enable_nova correctly in fs files? | 17:55 |
| rlandy|ruck | undercloud_enable_nova that is | 17:56 |
| mwhahaha | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-prep-images/templates/overcloud-image-upload.sh.j2#L32-L34 | 17:56 |
| mwhahaha | that's needed for ussuri | 17:56 |
| mwhahaha | i'm not certain we support that in t-o-a | 17:56 |
| mwhahaha | yea we don't | 17:57 |
| rlandy|ruck | ok - so we need to put back the old script for ussuri | 17:57 |
| mwhahaha | so either tripleoclient needs to magic --local detection added for ussuri, or t-o-a needs to be extended to allow for --local, or we don't do this stuff | 17:57 |
| mwhahaha | yea | 17:57 |
| mwhahaha | there's a bug that needs to be fix in t-o-a to support --local | 17:57 |
| rlandy|ruck | k - going to put in a patch to put the old script back | 17:58 |
| rlandy|ruck | log a bug for t-o-a | 17:58 |
| rlandy|ruck | when said bug is fixed, we can remove the old script | 17:58 |
| rlandy|ruck | mwhahaha: ^^ ok? | 17:59 |
| mwhahaha | ya | 17:59 |
| rlandy|ruck | thanks | 17:59 |
| mwhahaha | i'm sure it's EmilienM's fault anyway | 17:59 |
| EmilienM | hi | 17:59 |
| mwhahaha | haven't blamed him for anything recently | 17:59 |
| mwhahaha | he probably wanted to actually test functionality in ci | 17:59 |
| mwhahaha | a novel concept | 17:59 |
| EmilienM | i don't remember anything | 18:01 |
| mwhahaha | yes, you are infact useless to us now | 18:01 |
| EmilienM | just now? | 18:02 |
| mwhahaha | trying to give you partial credit for past efforts | 18:02 |
| mwhahaha | perhaps it's a mistake | 18:02 |
| mwhahaha | rlandy|ruck: looks like tripleo_overcloud_image_upload_local already exists (just not documented) | 18:05 |
| mwhahaha | so you'd just need logic to enable that | 18:05 |
| rlandy|ruck | tripleo_overcloud_image_upload_local was the setting removed in the patch | 18:07 |
| mwhahaha | needs to be left in | 18:07 |
| * rlandy|ruck gets previous patch | 18:07 | |
| rlandy|ruck | we removed that for train | 18:08 |
| mwhahaha | needs to continue to live on | 18:08 |
| rlandy|ruck | https://github.com/openstack/tripleo-quickstart-extras/commit/c9676e9115f1aa097b528ca70119465991416767#diff-b960c920b677bcbde3d6d471b6bfd753d13030c3c309efb8b640063fb2cfd8a2 | 18:09 |
| rlandy|ruck | trouble started there | 18:09 |
| rlandy|ruck | the we took train out of the operation task: | 18:09 |
| rlandy|ruck | https://github.com/openstack/tripleo-quickstart-extras/commit/d91c7f6ee4ca09356de97da5024db4a9cdef3194#diff-b960c920b677bcbde3d6d471b6bfd753d13030c3c309efb8b640063fb2cfd8a2 | 18:09 |
| mwhahaha | yea so ussuri still needs teh _local var | 18:09 |
| rlandy|ruck | the we put train back with tripleo_overcloud_image_upload_loc removed | 18:09 |
| mwhahaha | because that's what gets used today | 18:10 |
| opendevreview | Alex Schultz proposed openstack/tripleo-operator-ansible master: Document local var https://review.opendev.org/c/openstack/tripleo-operator-ansible/+/802378 | 18:10 |
| rlandy|ruck | k - redoing change | 18:11 |
| mwhahaha | this error looks to be the same that dhill is reporting someone hitting | 18:11 |
| rlandy|ruck | ok - putting the setting back | 18:14 |
| rlandy|ruck | but will need to rework settings in train | 18:14 |
| mwhahaha | techincally metalsmith bits should work in train but it's likely this same problem | 18:15 |
| mwhahaha | where --local is needed | 18:15 |
| opendevreview | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add tripleo_overcloud_image_upload_local back https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/802382 | 18:15 |
| rlandy|ruck | https://github.com/openstack/tripleo-quickstart-extras/commit/d91c7f6ee4ca09356de97da5024db4a9cdef3194#diff-b960c920b677bcbde3d6d471b6bfd753d13030c3c309efb8b640063fb2cfd8a2 | 18:15 |
| rlandy|ruck | documents the original problem on train | 18:16 |
| mwhahaha | yea i looked at that bug and it doesn't seem to be related to this stuff | 18:16 |
| mwhahaha | samees like a race on something else | 18:16 |
| rlandy|ruck | https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/general_config/featureset001.yml#L211 needs to be changed | 18:16 |
| rlandy|ruck | to remove train | 18:16 |
| mwhahaha | no | 18:17 |
| mwhahaha | the default is enable nova in train | 18:17 |
| mwhahaha | we switched to metalsmith in ussuri i believe | 18:17 |
| mwhahaha | stevebaker might remember when that switch happened | 18:17 |
| rlandy|ruck | we had a test job in 16.2 | 18:17 |
| mwhahaha | 16.2 should still be enable nova | 18:17 |
| mwhahaha | the error from the lp isn't an upload image thing | 18:22 |
| mwhahaha | it's a cache thign within heat or something | 18:23 |
| mwhahaha | didn't we recently enable cache by default or something? i wonder if that's affecting this | 18:23 |
| rlandy|ruck | we were tracking https://trello.com/c/mSWG4ZeF/2027-cixlp1936287tripleociproa-property-error-resourcesnovacomputepropertiesimage-error-validating-value-overcloud-full-no-images-mat | 18:33 |
| rlandy|ruck | where no image uploaded for train | 18:33 |
| rlandy|ruck | when we had operator enabled there | 18:33 |
| rlandy|ruck | the same issue on ussuri fs002 | 18:34 |
| mwhahaha | that may not have been a not-uploaded problem | 18:34 |
| mwhahaha | dhill reported the image being there, but heat not seeing it | 18:34 |
| rlandy|ruck | ok - so that's a possibility | 18:34 |
| rlandy|ruck | retesting all OVB train and ussuri with https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/802382 | 18:35 |
| rlandy|ruck | will see what still fails and what passes | 18:35 |
| rlandy|ruck | however putting back the old upload script fixed the train issue | 18:35 |
| rlandy|ruck | testproject time | 18:35 |
| mwhahaha | yea seems weird because they do the same, but let me poke at the logs | 18:36 |
| mwhahaha | rlandy|ruck: https://logserver.rdoproject.org/openstack-periodic-integration-stable4/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-train/ab8385f/logs/undercloud/home/zuul/tripleo_overcloud_image_upload.sh.txt.gz | 18:41 |
| mwhahaha | it was because --local | 18:41 |
| mwhahaha | so the issue was that for train it was uploading --local instead of to glance | 18:41 |
| mwhahaha | https://logserver.rdoproject.org/openstack-periodic-integration-stable4/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-train/ab8385f/logs/undercloud/home/zuul/overcloud_image_upload.log.txt.gz | 18:43 |
| mwhahaha | shows --local instead of glance bits | 18:43 |
| rlandy|ruck | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-prep-images/templates/overcloud-image-upload.sh.j2#L32-L34 | 18:43 |
| rlandy|ruck | should not happen | 18:43 |
| mwhahaha | well it did in the original log | 18:44 |
| mwhahaha | so yea | 18:44 |
| mwhahaha | i pasted the issue from the original bug report | 18:44 |
| mwhahaha | we'll see what the ci reports this time | 18:45 |
| rlandy|ruck | https://review.rdoproject.org/r/c/testproject/+/24995 has the testproject with all OVB jobs train and ussuri | 18:46 |
| rlandy|ruck | with local back | 18:46 |
| mwhahaha | k | 18:46 |
| rlandy|ruck | letting that run - need to fix tripleo-ci-centos-7-content-provider in gate | 18:48 |
| opendevreview | Ronelle Landy proposed openstack/tripleo-ci master: Revert "Exclude buggy edk2-ovmf for t/u/v container-build" https://review.opendev.org/c/openstack/tripleo-ci/+/800646 | 19:00 |
| opendevreview | Brent Eagles proposed openstack/tripleo-heat-templates master: Add support for setting min TTL limit in designate https://review.opendev.org/c/openstack/tripleo-heat-templates/+/792478 | 19:04 |
| opendevreview | Brent Eagles proposed openstack/tripleo-heat-templates master: Add a role to run independent designate bind backends https://review.opendev.org/c/openstack/tripleo-heat-templates/+/801620 | 19:10 |
| opendevreview | Brent Eagles proposed openstack/tripleo-ansible master: Add DNS resolver forwarding support to Unbound https://review.opendev.org/c/openstack/tripleo-ansible/+/774173 | 19:17 |
| rlandy|ruck | mwhahaha: this may be a PTL question, but what's the requirement on c7 train support? | 19:24 |
| mwhahaha | since train is the only path to upgrade between the two. that's why we continue to test the minimum but it can't go away | 19:25 |
| mwhahaha | why? | 19:25 |
| mwhahaha | you looking at the ascii failure in quickstart installs? | 19:26 |
| rlandy|ruck | yep | 19:27 |
| rlandy|ruck | content provider gate failure | 19:27 |
| rlandy|ruck | https://bugs.launchpad.net/tripleo/+bug/1938079 | 19:27 |
| mwhahaha | i don't think it's gate only | 19:27 |
| mwhahaha | feels like maybe ansible version is bad? | 19:28 |
| *** holser_ is now known as holser | 19:28 | |
| rlandy|ruck | it's check as well | 19:28 |
| mwhahaha | so that's é | 19:28 |
| mwhahaha | was ansible-2.9.24 published recently? | 19:30 |
| mwhahaha | came out on the 19th | 19:31 |
| mwhahaha | weird | 19:31 |
| rlandy|ruck | checking | 19:31 |
| rlandy|ruck | only failing today | 19:31 |
| rlandy|ruck | on a couple mirrors | 19:31 |
| mwhahaha | yea it feels like the file is bad | 19:32 |
| mwhahaha | or something | 19:32 |
| mwhahaha | so there's a new pip version | 19:35 |
| mwhahaha | 21.2.1 | 19:35 |
| mwhahaha | vs 21.1.3 | 19:35 |
| mwhahaha | probably a pip bug | 19:35 |
| mwhahaha | https://aaca39517b0316f09d28-fe390436bababd65005a5c1c9412b532.ssl.cf2.rackcdn.com/798843/6/check/tripleo-ci-centos-7-content-provider/de85585/job-output.txt | 19:35 |
| mwhahaha | 2021-07-26 10:44:04.555991 | primary | Successfully installed pip-21.2.1 | 19:36 |
| mwhahaha | https://6503c13c96865987894e-e3a44ec24d6b3f64b86eca62b372ddf4.ssl.cf2.rackcdn.com/802142/1/gate/tripleo-ci-centos-7-content-provider/3e155f5/job-output.txt | 19:36 |
| mwhahaha | 2021-07-24 16:11:42.077583 | primary | Requirement already satisfied: pip in /home/zuul/workspace/.quickstart/lib/python3.6/site-packages (21.1.3) | 19:36 |
| mwhahaha | https://github.com/pypa/pip/issues/10214 | 19:37 |
| mwhahaha | https://github.com/pypa/pip/issues/10211 | 19:37 |
| mwhahaha | looks like the new version has all sorts of problems | 19:37 |
| rlandy|ruck | ah ok | 19:37 |
| rlandy|ruck | zbr: ^^ | 19:38 |
| rlandy|ruck | version lock?? | 19:38 |
| mwhahaha | maybe pin < 21.2 for c7 | 19:38 |
| mwhahaha | i know we have py3 but seems dangerous | 19:38 |
| rlandy|ruck | let's try | 19:38 |
| mwhahaha | https://github.com/pypa/pip/issues/10151 | 19:40 |
| mwhahaha | specifically has that error message | 19:40 |
| mwhahaha | when installing ansible | 19:40 |
| rlandy|ruck | thanks for the pointers | 19:40 |
| mwhahaha | https://github.com/pypa/pip/issues/10151#issuecomment-886157390 | 19:41 |
| opendevreview | Simon Dodsley proposed openstack/tripleo-heat-templates master: Add Pure Storage FlashBlade Manila driver https://review.opendev.org/c/openstack/tripleo-heat-templates/+/792850 | 20:00 |
| *** dviroel|afk is now known as dviroel | 20:04 | |
| opendevreview | Ronelle Landy proposed openstack/tripleo-quickstart master: DNM: Set pip install version for c7 https://review.opendev.org/c/openstack/tripleo-quickstart/+/802395 | 20:28 |
| opendevreview | Ronelle Landy proposed openstack/tripleo-quickstart master: DNM: Set pip install version for c7 https://review.opendev.org/c/openstack/tripleo-quickstart/+/802395 | 20:30 |
| opendevreview | Ronelle Landy proposed openstack/tripleo-quickstart master: DNM: Set pip install version for c7 https://review.opendev.org/c/openstack/tripleo-quickstart/+/802395 | 20:32 |
| opendevreview | Ronelle Landy proposed openstack/tripleo-quickstart master: DNM: Set pip install version for c7 https://review.opendev.org/c/openstack/tripleo-quickstart/+/802395 | 20:35 |
| opendevreview | Alex Schultz proposed openstack/tripleo-ansible master: Action module for bulk host prep https://review.opendev.org/c/openstack/tripleo-ansible/+/799712 | 20:35 |
| opendevreview | Alex Schultz proposed openstack/tripleo-heat-templates master: Create host_prep_data https://review.opendev.org/c/openstack/tripleo-heat-templates/+/799332 | 20:35 |
| opendevreview | Ronelle Landy proposed openstack/tripleo-quickstart master: DNM: Set pip install version for c7 https://review.opendev.org/c/openstack/tripleo-quickstart/+/802395 | 20:52 |
| opendevreview | Alex Schultz proposed openstack/python-tripleoclient master: Remove --standalone option https://review.opendev.org/c/openstack/python-tripleoclient/+/753447 | 21:02 |
| opendevreview | Merged openstack/tripleo-quickstart-extras master: Save tripleo-deploy reproducer script https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/801295 | 21:02 |
| opendevreview | Ronelle Landy proposed openstack/tripleo-quickstart master: DNM: Set pip install version for c7 https://review.opendev.org/c/openstack/tripleo-quickstart/+/802395 | 21:19 |
| opendevreview | Ronelle Landy proposed openstack/tripleo-ansible stable/train: DNM: Test https://review.opendev.org/c/openstack/tripleo-ansible/+/802401 | 21:24 |
| opendevreview | Merged openstack/tripleo-ci master: Future proof ansible test code https://review.opendev.org/c/openstack/tripleo-ci/+/802038 | 21:30 |
| opendevreview | Merged openstack/tripleo-validations master: EndpointNotFound is now handled gracefully https://review.opendev.org/c/openstack/tripleo-validations/+/786867 | 21:30 |
| rlandy|ruck | https://logserver.rdoproject.org/95/24995/71/check/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-train/a4ca15b/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 21:33 |
| rlandy|ruck | mwhahaha: ^^ with tripleo_overcloud_image_upload_local back | 21:34 |
| rlandy|ruck | and ussuri fs002 https://logserver.rdoproject.org/95/24995/71/check/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-ussuri/af81243/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 21:35 |
| mwhahaha | That's using the legacy script | 21:39 |
| mwhahaha | And it still failed | 21:39 |
| mwhahaha | Err we always write the legacy stuff | 21:40 |
| mwhahaha | https://logserver.rdoproject.org/95/24995/71/check/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-train/a4ca15b/logs/undercloud/home/zuul/tripleo_overcloud_image_upload.sh.txt.gz | 21:40 |
| mwhahaha | It still has --local | 21:40 |
| mwhahaha | Something tells me it there's a logic problem | 21:41 |
| mwhahaha | I wonder if you need |bool | 21:41 |
| mwhahaha | Oh the logic for local should be not undefcloud_enable_nova | 21:43 |
| mwhahaha | It's backwards | 21:43 |
| *** pmannidi is now known as pmannidi|AFK | 22:18 | |
| opendevreview | Brendan Shephard proposed openstack/paunch stable/ussuri: Clean up containers with paunch defaults https://review.opendev.org/c/openstack/paunch/+/800411 | 22:22 |
| opendevreview | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add tripleo_overcloud_image_upload_local back https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/802382 | 22:25 |
| *** ChanServ changes topic to "next irc meeting 06 August https://etherpad.opendev.org/p/tripleo-meeting-items " | 22:56 | |
| *** pmannidi|AFK is now known as pmannidi | 23:36 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!