opendevreview | Ian Wienand proposed openstack/diskimage-builder master: centos-minimal: boot test 9-stream https://review.opendev.org/c/openstack/diskimage-builder/+/814844 | 00:07 |
---|---|---|
*** pmannidi is now known as pmannidi|brb | 02:03 | |
*** pmannidi|brb is now known as pmannidi | 04:12 | |
*** amoralej|off is now known as amoralej | 06:06 | |
opendevreview | Jose Luis Franco proposed openstack/tripleo-ansible stable/wallaby: Add tripleo_dnf_stream Ansible module. https://review.opendev.org/c/openstack/tripleo-ansible/+/814948 | 06:07 |
opendevreview | Jiri Podivin proposed openstack/tripleo-quickstart-extras master: Override inventory var value if the job defines it's own https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/814801 | 06:11 |
opendevreview | Jose Luis Franco proposed openstack/tripleo-ansible stable/wallaby: Add tripleo_dnf_stream Ansible module. https://review.opendev.org/c/openstack/tripleo-ansible/+/814948 | 06:12 |
*** bcafarel_ is now known as bcafarel | 07:01 | |
opendevreview | Sandeep Yadav proposed openstack/tripleo-quickstart master: Use venv instead of virtualenv on EL9. https://review.opendev.org/c/openstack/tripleo-quickstart/+/813624 | 07:02 |
opendevreview | Ananya proposed openstack/tripleo-ci master: Update ci-health url if not present in CIX card desc https://review.opendev.org/c/openstack/tripleo-ci/+/813970 | 07:03 |
opendevreview | Jiri Podivin proposed openstack/tripleo-ci master: Add oc roles and composable roles to overrides https://review.opendev.org/c/openstack/tripleo-ci/+/815222 | 07:05 |
opendevreview | Sandeep Yadav proposed openstack/tripleo-quickstart master: Use venv instead of virtualenv on EL9. https://review.opendev.org/c/openstack/tripleo-quickstart/+/813624 | 07:05 |
opendevreview | Alfredo Moralejo proposed openstack/diskimage-builder master: Add support for CentOS Stream 9 in DIB https://review.opendev.org/c/openstack/diskimage-builder/+/811392 | 07:40 |
*** ykarel is now known as ykarel|lunch | 07:49 | |
opendevreview | Gael Chamoulaud proposed openstack/validations-libs master: [WIP] Add new CLI sub command to create community validations https://review.opendev.org/c/openstack/validations-libs/+/814829 | 08:02 |
opendevreview | Gael Chamoulaud proposed openstack/validations-libs master: [WIP] Add new CLI sub command to create community validations https://review.opendev.org/c/openstack/validations-libs/+/814829 | 08:04 |
opendevreview | Ananya proposed openstack/tripleo-ci master: Update ci-health url if not present in CIX card desc https://review.opendev.org/c/openstack/tripleo-ci/+/813970 | 08:39 |
*** ykarel|lunch is now known as ykarel | 09:35 | |
opendevreview | Shnaidman Sagi (Sergey) proposed openstack/tripleo-quickstart-extras master: Run TripleO jobs on Ansible 2.11 https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/797823 | 09:40 |
opendevreview | Merged openstack/tripleo-common stable/victoria: Add ipa client to tripleoclient container https://review.opendev.org/c/openstack/tripleo-common/+/814909 | 09:51 |
opendevreview | Merged openstack/puppet-pacemaker master: Make sure we wait for the cluster before setting resource_default_op https://review.opendev.org/c/openstack/puppet-pacemaker/+/815016 | 09:51 |
opendevreview | Sandeep Yadav proposed openstack/tripleo-quickstart master: Centos 9 periodic release file https://review.opendev.org/c/openstack/tripleo-quickstart/+/806910 | 10:02 |
opendevreview | Harald Jensås proposed openstack/tripleo-docs master: Partial revert "Document ``--skip-nodes-and-networks``" https://review.opendev.org/c/openstack/tripleo-docs/+/815274 | 10:24 |
opendevreview | Rajesh Tailor proposed openstack/tripleo-heat-templates stable/wallaby: Enable support for Libvirt modular daemons https://review.opendev.org/c/openstack/tripleo-heat-templates/+/814568 | 10:26 |
opendevreview | Harald Jensås proposed openstack/tripleo-docs master: Partial revert "Document ``--skip-nodes-and-networks``" https://review.opendev.org/c/openstack/tripleo-docs/+/815275 | 10:26 |
*** jcapitao is now known as jcapitao_lunch | 10:27 | |
opendevreview | Harald Jensås proposed openstack/tripleo-docs master: Partial revert "Document ``--skip-nodes-and-networks``" https://review.opendev.org/c/openstack/tripleo-docs/+/813141 | 10:27 |
*** rlandy is now known as rlandy|ruck | 10:32 | |
*** ysandeep is now known as ysandeep|afk | 10:48 | |
*** jbadiapa_ is now known as jbadiapa | 11:00 | |
*** dviroel|rover|afk is now known as dviroel|rover | 11:10 | |
opendevreview | chandan kumar proposed openstack/tripleo-ci master: [EL9] skip collectd container https://review.opendev.org/c/openstack/tripleo-ci/+/814428 | 11:39 |
opendevreview | Douglas Viroel proposed openstack/tripleo-quickstart-extras master: Revert "Add default forwarder to multinode-ipa - vexxhost" https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/815234 | 11:41 |
*** ysandeep|afk is now known as ysandeep | 11:50 | |
*** jcapitao_lunch is now known as jcapitao | 12:07 | |
*** amoralej is now known as amoralej|lunch | 12:12 | |
opendevreview | mbu proposed openstack/tripleo-quickstart-extras master: Add validation playbook in ovb.yml and make conditional import https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/815292 | 12:32 |
opendevreview | Radomir Dopieralski proposed openstack/puppet-tripleo stable/wallaby: Revert Horizon's Memecached config to use IP addresses https://review.opendev.org/c/openstack/puppet-tripleo/+/815242 | 12:42 |
*** amoralej|lunch is now known as amoralej | 12:54 | |
ykarel | marios, when you get chance please revisit https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/814699 | 12:54 |
ykarel | i replied to your questions there | 12:54 |
opendevreview | Sandeep Yadav proposed openstack/tripleo-quickstart master: Use venv instead of virtualenv on EL9. https://review.opendev.org/c/openstack/tripleo-quickstart/+/813624 | 12:57 |
*** jpena|off is now known as jpena | 13:00 | |
marios | ykarel: ack calls now but adding to list | 13:04 |
ykarel | ack Thanks marios | 13:05 |
*** artom_ is now known as artom | 13:06 | |
cloudnull | mornings | 13:10 |
slagle | good morning | 13:10 |
rlandy|ruck | cloudnull: hello | 13:16 |
cloudnull | rlandy|ruck 👋 | 13:16 |
rlandy|ruck | welcome back :) | 13:16 |
cloudnull | thanks! its good to be back | 13:16 |
cloudnull | how are things ? | 13:16 |
rlandy|ruck | you know - always fun | 13:18 |
cloudnull | so ... https://c.tenor.com/fKIG2kiLVPgAAAAC/this-is-fine-its-fine.gif | 13:24 |
*** ykarel is now known as ykarel|away | 13:25 | |
opendevreview | mbu proposed openstack/tripleo-quickstart-extras master: Add validation playbook in ovb.yml and make conditional import https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/815292 | 13:35 |
*** cloudnull2 is now known as cloudnull | 13:41 | |
opendevreview | Jiri Podivin proposed openstack/tripleo-ci master: Add OC roles and composable roles to overrides https://review.opendev.org/c/openstack/tripleo-ci/+/815222 | 14:09 |
opendevreview | Sandeep Yadav proposed openstack/tripleo-quickstart master: Centos 9 periodic release file https://review.opendev.org/c/openstack/tripleo-quickstart/+/806910 | 14:40 |
opendevreview | Sandeep Yadav proposed openstack/tripleo-quickstart master: Centos 9 periodic release file https://review.opendev.org/c/openstack/tripleo-quickstart/+/806910 | 14:47 |
sshnaidm | ade_lee, hi, do you know - what is the status of https://review.opendev.org/c/x/tripleo-ipa/+/771065 ? Do you plan to use modules from community or freeipa? | 14:51 |
sshnaidm | ade_lee, I'm asking because we should change everything to collections now and it's critical for tripleo-ipa to work with tripleo | 14:52 |
opendevreview | Sandeep Yadav proposed openstack/tripleo-quickstart master: Centos 9 periodic release file https://review.opendev.org/c/openstack/tripleo-quickstart/+/806910 | 14:53 |
ade_lee | sshnaidm, ack -- just got out of meeting - will take a look today | 15:01 |
*** amoralej is now known as amoralej|off | 15:09 | |
*** dviroel|rover is now known as dviroel|rover|lunch | 15:15 | |
rlandy|ruck | lbragstad: hey - we're going to merge the fs001 and fs020 rbac job definitions | 15:23 |
lbragstad | rlandy|ruck sweet - that sounds good | 15:23 |
rlandy|ruck | lbragstad: you can ping when you think we are ready to start adding the jobs to the integration line | 15:24 |
rlandy|ruck | to run regularly | 15:24 |
lbragstad | yeah - i need to follow up on all that stuff since i haven't looked at it in a week due to the PTG | 15:24 |
rlandy|ruck | lbragstad: no rush - just want to push forward our side | 15:25 |
*** ysandeep is now known as ysandeep|out | 15:32 | |
opendevreview | Alan Bishop proposed openstack/tripleo-heat-templates master: Clear up confusion on cinder's default volume type https://review.opendev.org/c/openstack/tripleo-heat-templates/+/815332 | 16:01 |
*** dviroel|rover|lunch is now known as dviroel|rover | 16:11 | |
opendevreview | Merged openstack/diskimage-builder master: Fix bootloader installation for gentoo https://review.opendev.org/c/openstack/diskimage-builder/+/814866 | 17:02 |
*** jpena is now known as jpena|off | 17:05 | |
opendevreview | Francesco Pantano proposed openstack/tripleo-heat-templates stable/train: [TRAIN-ONLY] Restart ceph-nfs after the Ceph Upgrade stage https://review.opendev.org/c/openstack/tripleo-heat-templates/+/812526 | 17:08 |
opendevreview | Merged openstack/tripleo-quickstart master: Enable use of yum-config module in wallaby https://review.opendev.org/c/openstack/tripleo-quickstart/+/812672 | 17:25 |
*** atarakt is now known as nhicher | 18:09 | |
opendevreview | Alex Schultz proposed openstack/python-tripleoclient master: Save needed stack outputs in working_dir https://review.opendev.org/c/openstack/python-tripleoclient/+/803609 | 18:13 |
opendevreview | Alex Schultz proposed openstack/python-tripleoclient master: Refactor --stack-only, --setup-only, --config-download-only https://review.opendev.org/c/openstack/python-tripleoclient/+/803610 | 18:13 |
opendevreview | Alex Schultz proposed openstack/python-tripleoclient master: Add additional saved stack outputs https://review.opendev.org/c/openstack/python-tripleoclient/+/813681 | 18:14 |
opendevreview | Merged openstack/tripleo-heat-templates stable/train: [FFWD][train-only] Ensure we get ovn_controller cert if needed https://review.opendev.org/c/openstack/tripleo-heat-templates/+/798843 | 18:15 |
opendevreview | Merged openstack/tripleo-heat-templates stable/wallaby: Do not set rabbitmq SSL CA certs when InternalTLSCAFile is '' https://review.opendev.org/c/openstack/tripleo-heat-templates/+/814824 | 18:16 |
opendevreview | Merged openstack/tripleo-heat-templates master: Fix TLS-e with custom network names https://review.opendev.org/c/openstack/tripleo-heat-templates/+/812286 | 18:16 |
opendevreview | Merged openstack/tripleo-ci master: Adds check/gate job definitions for centos9 build image https://review.opendev.org/c/openstack/tripleo-ci/+/813618 | 18:16 |
dviroel|rover | hi cloudnull o/ | 18:52 |
cloudnull | o/ | 18:52 |
dviroel|rover | cloudnull: pinging you about this revert https://review.opendev.org/c/openstack/tripleo-common/+/814653 | 18:53 |
dviroel|rover | cloudnull: we are trying to investigate this issue here https://bugs.launchpad.net/tripleo/+bug/1947403 | 18:54 |
dviroel|rover | cloudnull: this is happenning for a while now https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-train | 18:55 |
dviroel|rover | cloudnull: i started to testproject the revert here: https://review.rdoproject.org/r/c/testproject/+/35132/ (PS17) | 18:56 |
dviroel|rover | one of the conclusions is that after your fix, the instropect node task start to fails, and when it succeeds, take more than 1h to finish. Before that, was a task that was taking ~25min to complete | 18:57 |
opendevreview | Alex Schultz proposed openstack/tripleo-common master: [WIP] task-core file generation https://review.opendev.org/c/openstack/tripleo-common/+/798721 | 18:57 |
cloudnull | yeah that retry will make it take a lot longer to fail. | 18:58 |
cloudnull | but I dont think its the cause root cause of the introspection issue? | 18:59 |
dviroel|rover | cloudnull: sounds weird, but this jobs started to fail after the fix got merged | 19:00 |
dviroel|rover | cloudnull: but i don't know why | 19:00 |
cloudnull | i cant seem that as related, but I'm happy to +2 that revert | 19:01 |
opendevreview | Merged openstack/python-tripleoclient stable/wallaby: Fix overcloud admin authorize https://review.opendev.org/c/openstack/python-tripleoclient/+/815184 | 19:01 |
opendevreview | Merged openstack/tripleo-common stable/ussuri: Add ipa client to tripleoclient container https://review.opendev.org/c/openstack/tripleo-common/+/814910 | 19:01 |
mwhahaha | dviroel|rover: it's likely not related to that change but rather uncovers something else. | 19:02 |
dviroel|rover | mwhahaha: agree with you | 19:03 |
dviroel|rover | one of the first occurence was in the patch: https://review.opendev.org/c/openstack/tripleo-common/+/809148/2#message-0feb9c22078df028151f277b3ea01af8a607fca0 | 19:03 |
mwhahaha | historically ovb can be flakey with introspection due to a number of reasons | 19:03 |
mwhahaha | that patch will extend the possible time it may take to run because it will retry | 19:03 |
dviroel|rover | that is my thought too, looking at the fix | 19:04 |
mwhahaha | it was successful in ussuri https://review.opendev.org/c/openstack/tripleo-common/+/812960 | 19:04 |
cloudnull | ++ with a 10 second delay between attempts | 19:04 |
mwhahaha | so it seems to be specific to the train env | 19:05 |
dviroel|rover | yes, train only | 19:05 |
mwhahaha | are we using a different bmc image or pxe image between the two? | 19:05 |
dviroel|rover | i don't think so, but i can double check | 19:07 |
rlandy|ruck | should be the same bmc image | 19:09 |
rlandy|ruck | bmc was updated a little while ago - but it's the same image used on all releases | 19:09 |
mwhahaha | it's working? | 19:10 |
rlandy|ruck | we just updated the cert | 19:10 |
mwhahaha | https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001&branch=stable%2Ftrain | 19:10 |
rlandy|ruck | and reuploaded it | 19:10 |
mwhahaha | seems to be highlighting the flakeyness of introspection | 19:10 |
rlandy|ruck | on train - yep | 19:10 |
rlandy|ruck | lots of failures | 19:11 |
mwhahaha | the only thing that might have done is cause it to exceed timeouts, but the revert isn't the solution | 19:11 |
rlandy|ruck | we tried looking at reducing concurrency - didn't help | 19:12 |
mwhahaha | what i used to see was issues with the bmc reboots | 19:12 |
mwhahaha | but i don't know if that was resolved in newer ironic or what | 19:12 |
rlandy|ruck | https://trello.com/c/zil37fAT/2148-cixlp1947403tripleociproa-ovb-jobs-are-consistently-failing-on-tripleo-overcloud-node-introspect-introspection-timeout | 19:12 |
opendevreview | Merged openstack/tripleo-common stable/train: Add ipa client to tripleoclient container https://review.opendev.org/c/openstack/tripleo-common/+/814911 | 19:13 |
opendevreview | Merged openstack/tripleo-heat-templates stable/wallaby: Add InternalApiNetwork entry in ServiceNetMap https://review.opendev.org/c/openstack/tripleo-heat-templates/+/815198 | 19:13 |
opendevreview | Merged openstack/tripleo-heat-templates stable/wallaby: GaneshaNetwork - fallback -> external -> ctlplane https://review.opendev.org/c/openstack/tripleo-heat-templates/+/815199 | 19:13 |
rlandy|ruck | harold has some comments there | 19:13 |
mwhahaha | console logs are 0 which would make me think problems with the rebooting of nodes | 19:13 |
rlandy|ruck | Tengu reported some issues with provisioning nodes in his lab in train | 19:14 |
rlandy|ruck | provisioning is not our issue though | 19:14 |
opendevreview | Merged openstack/tripleo-quickstart-extras master: Disable DNSSEC validation on ipa-server install https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/815081 | 19:15 |
mwhahaha | i recall also having problems with the two commands so i used --provide --all-managable | 19:15 |
rlandy|ruck | https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-master | 19:15 |
mwhahaha | instead of the split commands | 19:15 |
rlandy|ruck | right - I remember that | 19:15 |
rlandy|ruck | somehow fs035 gets the worst of it | 19:16 |
rlandy|ruck | not sure if ipv6 even comes into the picture yet | 19:16 |
mwhahaha | all the branches use the same tenant right? | 19:16 |
rlandy|ruck | yes | 19:16 |
Tengu | rlandy|ruck: sorry, on master, for my issue | 19:24 |
rlandy|ruck | k - so unrelated then | 19:25 |
rlandy|ruck | master is doing ok for us | 19:25 |
Tengu | I will investigate this deeper over the week. guts say "race condition", especially since second attempt works | 19:27 |
Tengu | i will open an LP with details and logs | 19:28 |
mwhahaha | 2021-10-21 08:51:37.410 9 ERROR mistral.executors.default_executor mistral.exceptions.ActionException: BaremetalIntrospectionAction.wait_for_finish failed: Unable to establish connection to https://192.168.24.2:13050/v1/introspection/c6cbbc32-804a-4a69-a31f-e3d0c52f8ff2: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',)) | 19:31 |
mwhahaha | for the record, even on success that workflow fails | 19:31 |
mwhahaha | it just errors differently | 19:31 |
mwhahaha | rlandy|ruck, dviroel|rover: added comment 9 to the LP. looks like ironic is losing it's mind | 19:39 |
rlandy|ruck | thanks for the update | 19:41 |
dviroel|rover | mwhahaha: thanks for adding more info | 19:41 |
opendevreview | mbu proposed openstack/tripleo-quickstart-extras master: Add validation playbook in ovb.yml and make conditional import https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/815292 | 19:54 |
opendevreview | Merged openstack/puppet-tripleo stable/wallaby: Make sure resource_op_defaults are set before bundles https://review.opendev.org/c/openstack/puppet-tripleo/+/814940 | 19:58 |
opendevreview | Slawek Kaplonski proposed openstack/tripleo-heat-templates stable/victoria: Added support for Neutron loggings service plugin configuration https://review.opendev.org/c/openstack/tripleo-heat-templates/+/813582 | 20:10 |
opendevreview | Slawek Kaplonski proposed openstack/tripleo-heat-templates stable/ussuri: Added support for Neutron loggings service plugin configuration https://review.opendev.org/c/openstack/tripleo-heat-templates/+/813583 | 20:11 |
opendevreview | Slawek Kaplonski proposed openstack/tripleo-heat-templates stable/train: Added support for Neutron loggings service plugin configuration https://review.opendev.org/c/openstack/tripleo-heat-templates/+/813584 | 20:12 |
*** holser is now known as holser_ | 20:28 | |
*** holser_ is now known as holser | 20:29 | |
opendevreview | Ade Lee proposed openstack/tripleo-heat-templates master: Add environment file for FIPS deployments https://review.opendev.org/c/openstack/tripleo-heat-templates/+/815141 | 20:34 |
*** dviroel|rover is now known as dviroel|rover|out | 20:56 | |
opendevreview | Michele Baldessari proposed openstack/puppet-tripleo stable/victoria: Make sure resource_op_defaults are set before bundles https://review.opendev.org/c/openstack/puppet-tripleo/+/815361 | 21:17 |
opendevreview | Alex Schultz proposed openstack/tripleo-common master: Fix permissions for deployments https://review.opendev.org/c/openstack/tripleo-common/+/815384 | 21:27 |
opendevreview | Ian Wienand proposed openstack/diskimage-builder master: [wip] regenerate initramfs with FEDORA-2021-e4843341ca https://review.opendev.org/c/openstack/diskimage-builder/+/815385 | 21:38 |
opendevreview | Ade Lee proposed openstack/puppet-tripleo master: Add option to configure snmpd auth type https://review.opendev.org/c/openstack/puppet-tripleo/+/813087 | 21:53 |
opendevreview | Merged openstack/tripleo-heat-templates master: Adding NovaMkisofsCmd parameter to nova-compute https://review.opendev.org/c/openstack/tripleo-heat-templates/+/815029 | 22:03 |
opendevreview | Ade Lee proposed openstack/tripleo-heat-templates master: Add auth type for snmpd readonly user https://review.opendev.org/c/openstack/tripleo-heat-templates/+/813089 | 22:03 |
opendevreview | Ade Lee proposed openstack/tripleo-heat-templates master: Add environment file for FIPS deployments https://review.opendev.org/c/openstack/tripleo-heat-templates/+/815141 | 22:03 |
opendevreview | Ade Lee proposed openstack/tripleo-heat-templates master: Add environment file for FIPS deployments https://review.opendev.org/c/openstack/tripleo-heat-templates/+/815141 | 22:05 |
*** holser is now known as holser_ | 22:11 | |
opendevreview | Alex Schultz proposed openstack/tripleo-common master: [WIP] task-core file generation https://review.opendev.org/c/openstack/tripleo-common/+/798721 | 22:18 |
opendevreview | Ian Wienand proposed openstack/diskimage-builder master: [wip] regenerate initramfs with FEDORA-2021-e4843341ca https://review.opendev.org/c/openstack/diskimage-builder/+/815385 | 23:00 |
*** holser_ is now known as holser | 23:03 | |
opendevreview | David Vallee Delisle proposed openstack/os-net-config master: DNM vDPA support for CentOS9 https://review.opendev.org/c/openstack/os-net-config/+/815186 | 23:34 |
opendevreview | Merged openstack/tripleo-heat-templates stable/victoria: [victoria/ussuri/train] Tune minion defaults https://review.opendev.org/c/openstack/tripleo-heat-templates/+/814322 | 23:34 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!