| *** mcornea has joined #tripleo | 00:20 | |
| *** cdearborn has quit IRC | 00:28 | |
| *** derekh has quit IRC | 00:42 | |
| *** mcornea has quit IRC | 00:53 | |
| *** ysandeep|away is now known as ysandeep | 01:03 | |
| *** hkominos has quit IRC | 01:06 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Add centos aarch64 tests https://review.opendev.org/720339 | 01:18 |
|---|---|---|
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Make sure nova_api_ensure_cell0_database_url is deleted. https://review.opendev.org/720090 | 01:26 |
| openstackgerrit | Zhu Sheng Li proposed openstack/python-tripleoclient stable/stein: Fix overcloud node instrospect exception output https://review.opendev.org/720627 | 01:56 |
| *** Goneri has quit IRC | 01:59 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-ci master: ensure centos-7 train image builds are tested https://review.opendev.org/720538 | 02:00 |
| openstackgerrit | Takashi Kajinami proposed openstack/python-tripleoclient stable/stein: Fix overcloud node instrospect exception output https://review.opendev.org/720627 | 02:04 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-ci master: ensure centos-7 train image builds are tested https://review.opendev.org/720538 | 02:05 |
| *** apetrich has quit IRC | 02:08 | |
| *** jmasud has joined #tripleo | 02:15 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-ci master: Fix oooci-build-images role for CentOS-7 https://review.opendev.org/720575 | 02:15 |
| *** jmasud has quit IRC | 02:20 | |
| *** ysandeep is now known as ysandeep|afk | 02:21 | |
| openstackgerrit | Merged openstack/tripleo-ansible stable/train: tripleo_container_manage: print message if no container action https://review.opendev.org/720583 | 02:32 |
| *** jmasud has joined #tripleo | 02:36 | |
| *** ekultails has quit IRC | 02:48 | |
| *** jmasud has quit IRC | 02:50 | |
| *** jmasud has joined #tripleo | 03:00 | |
| *** rcernin has quit IRC | 03:10 | |
| *** psachin has joined #tripleo | 03:18 | |
| *** rcernin has joined #tripleo | 03:25 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Convert docker molecule usage to podman https://review.opendev.org/720609 | 03:26 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Convert docker molecule usage to podman https://review.opendev.org/720609 | 03:32 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Convert docker molecule usage to podman https://review.opendev.org/720609 | 03:39 |
| *** rh-jelabarre has quit IRC | 03:48 | |
| *** jmasud has quit IRC | 04:02 | |
| *** jmasud has joined #tripleo | 04:14 | |
| *** ramishra has joined #tripleo | 04:18 | |
| *** ysandeep|afk is now known as ysandeep | 04:22 | |
| openstackgerrit | Merged openstack/tripleo-common master: Use healthcheck_port for ironic_inspector_dnsmasq healthcheck https://review.opendev.org/720258 | 04:26 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Create octavia project/user based on given values https://review.opendev.org/709354 | 04:26 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add IronicDhcpv6StatefulAddressCount parameter https://review.opendev.org/720207 | 04:27 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Fix oooci-build-images role for CentOS-7 https://review.opendev.org/720575 | 04:34 |
| *** evrardjp has quit IRC | 04:37 | |
| *** evrardjp has joined #tripleo | 04:37 | |
| *** ysandeep is now known as ysandeep|reboot | 04:49 | |
| *** ykarel|away is now known as ykarel | 04:51 | |
| *** ysandeep|reboot is now known as ysandeep | 04:53 | |
| *** skramaja has joined #tripleo | 04:53 | |
| *** jmasud has quit IRC | 04:55 | |
| *** jmasud has joined #tripleo | 04:56 | |
| *** mnasiadka has quit IRC | 05:10 | |
| *** shadower has quit IRC | 05:10 | |
| *** jtomasek has quit IRC | 05:14 | |
| *** mnasiadka has joined #tripleo | 05:15 | |
| *** shadower has joined #tripleo | 05:15 | |
| *** jtomasek has joined #tripleo | 05:19 | |
| *** lmiccini has joined #tripleo | 05:21 | |
| *** ratailor has joined #tripleo | 05:24 | |
| *** akahat|ruck is now known as akahat|rover | 05:31 | |
| *** udesale has joined #tripleo | 05:35 | |
| *** ysandeep is now known as ysandeep|brb | 05:49 | |
| *** marios has joined #tripleo | 05:50 | |
| *** jmasud has quit IRC | 05:56 | |
| ykarel | EmilienM, Thanks | 06:06 |
| *** jmasud has joined #tripleo | 06:11 | |
| *** ysandeep|brb is now known as ysandeep | 06:12 | |
| *** jmasud has quit IRC | 06:13 | |
| *** bandini has joined #tripleo | 06:14 | |
| *** jmasud has joined #tripleo | 06:15 | |
| *** elGamal has quit IRC | 06:19 | |
| *** jfrancoa has joined #tripleo | 06:21 | |
| *** bogdando has joined #tripleo | 06:23 | |
| *** elGamal has joined #tripleo | 06:23 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates stable/train: Add IronicDhcpv6StatefulAddressCount parameter https://review.opendev.org/720651 | 06:23 |
| *** udesale has quit IRC | 06:26 | |
| *** udesale has joined #tripleo | 06:32 | |
| *** xek has joined #tripleo | 06:36 | |
| *** yolanda has quit IRC | 06:59 | |
| *** yolanda has joined #tripleo | 07:00 | |
| *** slaweq has joined #tripleo | 07:12 | |
| *** jcapitao has joined #tripleo | 07:16 | |
| *** jbadiapa has joined #tripleo | 07:19 | |
| *** rpittau|afk is now known as rpittau | 07:19 | |
| *** apetrich has joined #tripleo | 07:21 | |
| *** jpena|off is now known as jpena | 07:22 | |
| *** maciejjozefczyk has joined #tripleo | 07:24 | |
| *** akahat|rover is now known as akahat|rover|lun | 07:29 | |
| openstackgerrit | Merged openstack/tripleo-validations master: Switch install-docker with ensure-docker https://review.opendev.org/717829 | 07:29 |
| openstackgerrit | Merged openstack/tripleo-common stable/train: [stable-only] Pass timeout in mins to create_temp_url() https://review.opendev.org/719439 | 07:29 |
| *** akahat|rover|lun is now known as akahat|rover|brb | 07:29 | |
| *** tosky has joined #tripleo | 07:30 | |
| *** amoralej|off is now known as amoralej | 07:39 | |
| *** jpich has joined #tripleo | 07:39 | |
| *** cylopez has joined #tripleo | 07:47 | |
| *** akahat|rover|brb is now known as akahat|rover | 07:53 | |
| *** suuuper has joined #tripleo | 07:55 | |
| *** ccamacho has joined #tripleo | 07:56 | |
| *** threestrands has quit IRC | 07:56 | |
| *** ysandeep is now known as ysandeep|lunch | 07:57 | |
| *** cfontain_ has joined #tripleo | 08:00 | |
| *** derekh has joined #tripleo | 08:02 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo stable/train: Enable deployment with external loadbalancers https://review.opendev.org/720655 | 08:10 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo stable/train: Make the bundle user configurable via hiera https://review.opendev.org/720656 | 08:10 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo stable/train: Log stdout of HA containers https://review.opendev.org/720657 | 08:10 |
| *** dtantsur|afk is now known as dtantsur | 08:13 | |
| *** pkopec has joined #tripleo | 08:14 | |
| *** alexmcleod has joined #tripleo | 08:17 | |
| *** lbragstad_ has joined #tripleo | 08:17 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Fix oooci-build-images role for CentOS-7 https://review.opendev.org/720575 | 08:18 |
| *** lbragstad has quit IRC | 08:20 | |
| *** lucasagomes has joined #tripleo | 08:24 | |
| *** ysandeep|lunch is now known as ysandeep | 08:25 | |
| *** ykarel is now known as ykarel|lunch | 08:26 | |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade master: FFWD automation for HA and composable environments https://review.opendev.org/716976 | 08:27 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Fix oooci-build-images role for CentOS-7 https://review.opendev.org/720663 | 08:31 |
| *** jmasud has quit IRC | 08:33 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: WIP: Prevent regression of artcl as zuul role https://review.opendev.org/720168 | 08:35 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Fix oooci-build-images role for CentOS-7 https://review.opendev.org/720575 | 08:35 |
| *** maciejjozefczyk has quit IRC | 08:37 | |
| openstackgerrit | Pooja Jadhav proposed openstack/tripleo-quickstart-extras master: DNM: Testing ipa multinode https://review.opendev.org/706373 | 08:39 |
| *** maciejjozefczyk has joined #tripleo | 08:39 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-common master: Remove tripleo-buildimage-overcloud-hardened-full-centos-8 job https://review.opendev.org/720378 | 08:43 |
| *** derekh has quit IRC | 08:43 | |
| *** tkajinam has quit IRC | 08:51 | |
| *** waleedm has joined #tripleo | 08:52 | |
| *** cfontain_ has quit IRC | 08:53 | |
| *** derekh has joined #tripleo | 08:56 | |
| *** AJaeger has joined #tripleo | 09:09 | |
| AJaeger | HI, https://review.opendev.org/#/c/719597 fails since the RPM build uses "python3 setup.py build_sphinx" which is deprecated, where is that defined so that I can change it? | 09:09 |
| *** paramite has joined #tripleo | 09:11 | |
| openstackgerrit | Pooja Jadhav proposed openstack/tripleo-quickstart-extras master: DNM: Testing ipa multinode https://review.opendev.org/706373 | 09:17 |
| *** ysandeep is now known as ysandeep|afk | 09:21 | |
| *** paramite has quit IRC | 09:21 | |
| openstackgerrit | Francesco Pantano proposed openstack/tripleo-validations master: Introducing tripleo_delegate_to on ceph health validation https://review.opendev.org/718011 | 09:22 |
| *** yolanda has quit IRC | 09:23 | |
| openstackgerrit | Francesco Pantano proposed openstack/tripleo-validations master: Introducing tripleo_delegate_to on ceph health validation https://review.opendev.org/718011 | 09:24 |
| *** ykarel|lunch is now known as ykarel | 09:25 | |
| *** yolanda has joined #tripleo | 09:29 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: WIP: Prevent regression of artcl as zuul role https://review.opendev.org/720168 | 09:29 |
| Tengu | hmmm. interesting issue with the metalsmith overcloud provisionning: Unable to attach VIF f330a3cf-0344-4aaa-8d7a-8ecdd44175e5, not enough free physical ports. | 09:35 |
| Tengu | does it ring any bell to anyone? | 09:35 |
| ykarel | AJaeger, https://github.com/rdo-packages/tripleo-validations-distgit/blob/rpm-master/openstack-tripleo-validations.spec#L124 | 09:36 |
| *** jtomasek has quit IRC | 09:41 | |
| *** jtomasek has joined #tripleo | 09:41 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/diskimage-builder master: Remove Babel and any signs of translations https://review.opendev.org/720673 | 09:42 |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: WIP: Prevent regression of artcl as zuul role https://review.opendev.org/720168 | 09:48 |
| *** leanderthal has joined #tripleo | 09:58 | |
| *** waleedm has quit IRC | 10:00 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: Improve publish tasks https://review.opendev.org/720680 | 10:07 |
| *** numans has quit IRC | 10:08 | |
| *** skramaja_ has joined #tripleo | 10:08 | |
| *** numans has joined #tripleo | 10:10 | |
| *** skramaja has quit IRC | 10:10 | |
| *** yolanda has quit IRC | 10:10 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-ansible stable/train: [upgrade] Add inventory filters to map groups to roles https://review.opendev.org/720681 | 10:13 |
| odyssey4me | owalsh: your review of the backport would be appreciated - https://review.opendev.org/720681 :) | 10:13 |
| owalsh | odyssey4me: done | 10:15 |
| *** waleedm has joined #tripleo | 10:20 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Fix oooci-build-images role for CentOS-7 https://review.opendev.org/720575 | 10:22 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/python-tripleoclient stable/train: [DNM] c7 image build https://review.opendev.org/720585 | 10:22 |
| *** gfidente|afk is now known as gfidente | 10:22 | |
| AJaeger | ykarel: Thanks - changes for that are done via github? | 10:29 |
| ykarel | AJaeger, nope, rdo gerrit https://review.rdoproject.org/r/ | 10:30 |
| *** rpittau is now known as rpittau|bbl | 10:30 | |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: [Q->T] Alow supplying command options to leapp https://review.opendev.org/720685 | 10:31 |
| AJaeger | ykarel: argh - can you push a change for me, please? Just change "%{pyver_bin} setup.py build_sphinx -b html" to "sphinx-build -b html doc/source doc/build/html" to mirror what is done in tox.ini? | 10:31 |
| ykarel | AJaeger, sure will do, give me few minutes | 10:32 |
| AJaeger | ykarel: thanks a lot! Take your time - I'll need to do some cooking ;) | 10:32 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-upgrade master: FFWD automation for HA and composable environments https://review.opendev.org/716976 | 10:38 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-upgrade master: FFWD automation for HA and composable environments https://review.opendev.org/716976 | 10:40 |
| ykarel | AJaeger, proposed https://review.rdoproject.org/r/26606 | 10:41 |
| *** numans has quit IRC | 10:59 | |
| openstackgerrit | Takashi Kajinami proposed openstack/tripleo-heat-templates master: Set region_name for service authentication in ironic https://review.opendev.org/719393 | 10:59 |
| AJaeger | thanks, ykarel | 11:02 |
| *** jcapitao is now known as jcapitao_lunch | 11:05 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: WIP: Improve publish tasks https://review.opendev.org/720680 | 11:11 |
| ykarel | AJaeger, patch merged, u can try recheck now | 11:16 |
| *** bandini has quit IRC | 11:19 | |
| openstackgerrit | Bob Fournier proposed openstack/tripleo-common stable/train: Use healthcheck_port for ironic_inspector_dnsmasq healthcheck https://review.opendev.org/720688 | 11:24 |
| *** jpena is now known as jpena|lunch | 11:37 | |
| *** waleedm_ has joined #tripleo | 11:37 | |
| *** waleedm has quit IRC | 11:40 | |
| *** rfolco has joined #tripleo | 11:47 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Fix oooci-build-images role for CentOS-7 https://review.opendev.org/720575 | 11:47 |
| openstackgerrit | yatin proposed openstack/tripleo-ansible master: Create Symlink /usr/bin/ansible-playbook-3 when not exist https://review.opendev.org/720694 | 11:48 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Fix oooci-build-images role for CentOS-7 https://review.opendev.org/720575 | 11:48 |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: Allow artcl to be run by Zuul https://review.opendev.org/720168 | 11:51 |
| *** hjensas has quit IRC | 11:52 | |
| *** leanderthal has quit IRC | 11:52 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Fix oooci-build-images role for CentOS-7 https://review.opendev.org/720575 | 11:53 |
| *** leanderthal has joined #tripleo | 11:53 | |
| *** jcoufal has joined #tripleo | 11:54 | |
| *** rh-jelabarre has joined #tripleo | 11:54 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: ensure centos-7 train image builds are tested https://review.opendev.org/720538 | 11:55 |
| *** tkajinam has joined #tripleo | 11:56 | |
| *** jcoufal has quit IRC | 11:59 | |
| AJaeger | ykarel: great, thanks a lot! | 11:59 |
| *** udesale_ has joined #tripleo | 12:02 | |
| *** bandini has joined #tripleo | 12:02 | |
| openstackgerrit | Pooja Jadhav proposed openstack/tripleo-quickstart-extras master: DNM: Testing ipa multinode https://review.opendev.org/706373 | 12:03 |
| weshay|ruck | ykarel++ thanks for the revert | 12:03 |
| *** tkajinam has quit IRC | 12:04 | |
| *** waleedm__ has joined #tripleo | 12:05 | |
| *** udesale has quit IRC | 12:05 | |
| *** rlandy has joined #tripleo | 12:06 | |
| ykarel | weshay|ruck, also proposed follow up fix, i guess u checked that too | 12:07 |
| *** waleedm_ has quit IRC | 12:09 | |
| weshay|ruck | chandankumar, ping | 12:10 |
| chandankumar | weshay|ruck, pong | 12:10 |
| weshay|ruck | chandankumar, let's chat | 12:11 |
| chandankumar | weshay|ruck, yes | 12:11 |
| weshay|ruck | https://meet.google.com/mzh-mxgo-qem?authuser=1 | 12:11 |
| *** rcernin has quit IRC | 12:11 | |
| *** ekultails has joined #tripleo | 12:12 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Enable HA in minor updates job (scenario000) https://review.opendev.org/719664 | 12:18 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Enable HA in minor updates job (scenario000) https://review.opendev.org/719664 | 12:18 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Deprecate Keepalived service https://review.opendev.org/657067 | 12:18 |
| *** rpittau|bbl is now known as rpittau | 12:19 | |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient stable/train: Add missing download_ansible_playbooks function https://review.opendev.org/709066 | 12:20 |
| *** hjensas has joined #tripleo | 12:21 | |
| *** jcapitao_lunch is now known as jcapitao | 12:22 | |
| *** raildo has joined #tripleo | 12:23 | |
| *** psachin has quit IRC | 12:26 | |
| cloudnull | mornings | 12:28 |
| *** ykarel is now known as ykarel|afk | 12:35 | |
| *** ysandeep|afk is now known as ysandeep | 12:35 | |
| *** fultonj has quit IRC | 12:38 | |
| *** ykarel|afk is now known as ykarel | 12:39 | |
| ykarel | EmilienM, Could not find the requested service tripleo_keystone.service: host | 12:39 |
| ykarel | seen just now in a gate job in one of my patch, but doesn't seem related | 12:40 |
| ykarel | https://a159bad83b0083ae3f18-b71c90f67122d6f7b38b8442bc3a114a.ssl.cf1.rackcdn.com/713439/13/gate/tripleo-ci-centos-8-containers-undercloud-minion/b781b59/logs/undercloud/home/zuul/undercloud_install.log | 12:40 |
| EmilienM | mhhh | 12:40 |
| *** Goneri has joined #tripleo | 12:41 | |
| EmilienM | it sounds like a race condition at first look | 12:42 |
| EmilienM | where the service is starting before being enabled | 12:42 |
| EmilienM | let me dig a bit | 12:42 |
| ykarel | the job looks green, so likely a patch in gate have issue | 12:42 |
| ykarel | ack | 12:42 |
| *** jpena|lunch is now known as jpena | 12:44 | |
| EmilienM | ykarel: i'm not sure, the systemd daemon reload task was run just before; so the unit file should have been found when a bit later we enable and start the service | 12:48 |
| EmilienM | the best I could do is adding retries | 12:49 |
| EmilienM | I don't want to set daemon_reload: true for the systemd tasks beacuse it's expensive and useless, since we reloaded before already | 12:49 |
| *** fultonj has joined #tripleo | 12:51 | |
| *** pojadhav is now known as pojadhav|away | 12:57 | |
| ykarel | EmilienM, hmm strange tripleo_keystone.service file exist and as per logs daemon_reload also executed | 12:59 |
| EmilienM | ykarel: I'm still looking at it | 13:00 |
| EmilienM | ykarel: please file a bug in the meantime | 13:00 |
| ykarel | EmilienM, sure doing | 13:00 |
| EmilienM | ykarel: I'm looking at systemd logging: https://a159bad83b0083ae3f18-b71c90f67122d6f7b38b8442bc3a114a.ssl.cf1.rackcdn.com/713439/13/gate/tripleo-ci-centos-8-containers-undercloud-minion/b781b59/logs/undercloud/var/log/journal.txt | 13:01 |
| ykarel | ack | 13:03 |
| *** amoralej is now known as amoralej|lunch | 13:04 | |
| ykarel | EmilienM, filed https://bugs.launchpad.net/tripleo/+bug/1873453 and assigned to you | 13:07 |
| openstack | Launchpad bug 1873453 in tripleo "[master] Job in gate failed with Could not find the requested service tripleo_keystone.service: host" [Medium,Triaged] - Assigned to Emilien Macchi (emilienm) | 13:07 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage/systemd: add retries mechanism https://review.opendev.org/720707 | 13:08 |
| EmilienM | ykarel: ^ maybe it'll help. Hard to know | 13:08 |
| *** mcornea has joined #tripleo | 13:08 | |
| ykarel | EmilienM, hmm should help | 13:13 |
| ykarel | but really strange, as per logs, systemd[1]: Reloading. looks finished | 13:14 |
| ykarel | before that enable task | 13:14 |
| EmilienM | yeah | 13:14 |
| EmilienM | again i've seen these kind of things on slow systems with systemd | 13:14 |
| *** lbragstad_ is now known as lbragstad | 13:15 | |
| *** ratailor has quit IRC | 13:16 | |
| *** ratailor has joined #tripleo | 13:17 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add connection check before configuring tripleo-admin https://review.opendev.org/720459 | 13:18 |
| *** ratailor has quit IRC | 13:20 | |
| EmilienM | ykarel: do you have a logstash query to know how much we hit it in CI? | 13:22 |
| *** ratailor has joined #tripleo | 13:23 | |
| Tengu | fultonj: deploying an overcloud with 3ctl, 1compute and 3cephs right now against master, using the "operators" branch :). Seems to work well - just had to deactivate metalsmith provisionning. | 13:23 |
| Tengu | I think I'll need to read some more doc and see if I can get it working without any timeout or other related things. | 13:23 |
| ykarel | EmilienM, nope i didn't checked logstash, i think that was first one | 13:24 |
| Tengu | oohh. --concurrency CONCURRENCY | 13:24 |
| Tengu | THAT might be the trick ! 20 is a lot. | 13:24 |
| *** ratailor has quit IRC | 13:26 | |
| *** ratailor has joined #tripleo | 13:26 | |
| *** ykarel is now known as ykarel|afk | 13:31 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: manage systemd services per step vs start_order https://review.opendev.org/720614 | 13:32 |
| *** ratailor has quit IRC | 13:33 | |
| *** ratailor has joined #tripleo | 13:35 | |
| *** pojadhav|away is now known as pojadhav | 13:35 | |
| mwhahaha | weshay|ruck: https://review.opendev.org/#/c/720461/ | 13:37 |
| *** ratailor has quit IRC | 13:38 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-upgrade master: FFWD automation for HA and composable environments https://review.opendev.org/716976 | 13:39 |
| *** cdearborn has joined #tripleo | 13:39 | |
| mgoddard | Hi mwhahaha, is CI borked? | 13:43 |
| mwhahaha | probably | 13:44 |
| mwhahaha | i'll check your patch in a bit | 13:44 |
| mgoddard | thanks :) | 13:44 |
| mgoddard | would like to get the kolla patch merged ASAP | 13:44 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add connection check before configuring tripleo-admin https://review.opendev.org/720459 | 13:45 |
| *** d34dh0r53 has joined #tripleo | 13:46 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add connection check before configuring tripleo-admin https://review.opendev.org/720459 | 13:47 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Use a full string match for container images https://review.opendev.org/720236 | 13:49 |
| *** lbragstad_ has joined #tripleo | 13:51 | |
| *** amoralej|lunch is now known as amoralej | 13:51 | |
| *** lbragstad has quit IRC | 13:52 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Fix oooci-build-images role for CentOS-7 https://review.opendev.org/720575 | 13:52 |
| chandankumar | bandini, I have more detailed report from missing files on image https://logserver.rdoproject.org/61/26461/21/check/periodic-tripleo-ci-centos-8-overcloud-image-sanity-master/179b211/rpm_va.txt | 13:54 |
| ekultails | I need to get this merged in (--limit patch Depends-On this) but it keeps running into 2 unrelated Tempest failures. Anyway we can push this forward? https://review.opendev.org/#/c/719476/ | 13:59 |
| *** lbragstad_ has quit IRC | 14:00 | |
| *** lbragstad has joined #tripleo | 14:03 | |
| bandini | chandankumar: nice work! any idea yet as to who could be removing /var/lib{pcs,corosync,iscsi,etc} ? | 14:05 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: DNM - test ansible strategy optim on all scenarios https://review.opendev.org/711230 | 14:07 |
| *** cylopez has left #tripleo | 14:09 | |
| *** dtantsur is now known as dtantsur|brb | 14:09 | |
| chandankumar | bandini, no idea | 14:12 |
| bandini | ack | 14:13 |
| weshay|ruck | bandini, it comes and goes too | 14:13 |
| bandini | wow | 14:14 |
| weshay|ruck | there is a ghost in the system | 14:14 |
| *** TrevorV has joined #tripleo | 14:15 | |
| *** waleedm__ has quit IRC | 14:15 | |
| *** mpjetta has quit IRC | 14:29 | |
| *** ysandeep is now known as ysandeep|away | 14:31 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-ansible master: Add additional strategy optimization https://review.opendev.org/704443 | 14:37 |
| *** jfrancoa has quit IRC | 14:37 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-ansible master: Add additional strategy optimization https://review.opendev.org/704443 | 14:37 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: set empty default to systemd registers https://review.opendev.org/720729 | 14:38 |
| *** skramaja has joined #tripleo | 14:39 | |
| *** fultonj has quit IRC | 14:40 | |
| *** fultonj has joined #tripleo | 14:42 | |
| *** skramaja_ has quit IRC | 14:46 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: [install-deps] Use venv instead of virtualenv when possible https://review.opendev.org/707215 | 14:46 |
| openstackgerrit | Andreas Jaeger proposed openstack/os-net-config master: Cleanup py27 support https://review.opendev.org/720737 | 14:48 |
| *** fultonj has quit IRC | 14:55 | |
| *** fultonj has joined #tripleo | 14:56 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Fix oooci-build-images role for CentOS-7 https://review.opendev.org/720575 | 14:56 |
| *** fultonj has quit IRC | 14:57 | |
| *** fultonj has joined #tripleo | 14:57 | |
| *** fultonj has quit IRC | 14:57 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-ansible master: Add additional strategy optimization https://review.opendev.org/704443 | 14:58 |
| *** dtantsur|brb is now known as dtantsur | 15:03 | |
| *** skramaja has quit IRC | 15:05 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/diskimage-builder master: Remove Babel and any signs of translations https://review.opendev.org/720673 | 15:05 |
| *** ykarel|afk is now known as ykarel | 15:06 | |
| *** pkopec has quit IRC | 15:11 | |
| *** bandini has quit IRC | 15:17 | |
| *** fultonj has joined #tripleo | 15:17 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-docs master: Introduce Multibackend Storage Documenation https://review.opendev.org/713078 | 15:18 |
| openstackgerrit | Francesco Pantano proposed openstack/tripleo-validations master: Introducing tripleo_delegate_to on ceph health validation https://review.opendev.org/718011 | 15:20 |
| *** lmiccini has quit IRC | 15:25 | |
| ykarel | panda|ruck, akahat|rover is this issue: async task did not complete within the requested time - 5700s known in standalone deploys? | 15:27 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Fix oooci-build-images role for CentOS-7 https://review.opendev.org/720575 | 15:28 |
| ykarel | seeing multiple failures as per logstash http://logstash.openstack.org/#/dashboard/file/logstash.json?query=%5C%22Could%20not%20find%20the%20requested%20service%5C%22 | 15:28 |
| ykarel | me noticed it after seeing failure in gate | 15:29 |
| panda|ruck | ykarel: I see taht query empty even with a scope of 7 days. Do you have logs from a job ? | 15:30 |
| ykarel | mmm i see many failures | 15:31 |
| ykarel | sharing logs | 15:31 |
| ykarel | panda|ruck, noticed in gate failure of https://review.opendev.org/#/c/720453/ | 15:32 |
| ykarel | also see https://review.opendev.org/#/c/720453/ | 15:32 |
| EmilienM | ykarel: https://review.opendev.org/#/c/720694/ -1 | 15:33 |
| EmilienM | why having it in 2 places | 15:33 |
| EmilienM | this seems inefficient | 15:33 |
| ykarel | EmilienM, with sudo it searches in /usr/bin | 15:34 |
| ykarel | as search_path is not set always in /etc/sudoers | 15:34 |
| *** maciejjozefczyk has quit IRC | 15:34 | |
| ykarel | i am not aware why /usr/local/bin was set, | 15:35 |
| openstackgerrit | Merged openstack/tripleo-ansible master: podman_container: only add --rm if rm is True https://review.opendev.org/720582 | 15:35 |
| openstackgerrit | Merged openstack/tripleo-ansible stable/train: podman_container: only add --rm if rm is True https://review.opendev.org/720604 | 15:35 |
| ykarel | EmilienM, all this should be cleaned after all occurances of ansible-playbook-3 are removed | 15:35 |
| ykarel | i wanted to go safe by ensuring /usr/bin/ also exists | 15:35 |
| ykarel | mainly in Train which have both py2/py3 likely it will not be cleaned up | 15:36 |
| panda|ruck | ykarel: https://46ba4f32424b45a96f12-ceb114eb67fcf9b72ac420bfa1d8dc00.ssl.cf5.rackcdn.com/720453/1/gate/tripleo-ci-centos-8-scenario001-standalone/6291691/logs/undercloud/home/zuul/ansible.log at the botton. Is it related to the podman change you reverted ? | 15:37 |
| EmilienM | ykarel: in that case why not removing the file from local | 15:37 |
| EmilienM | and put it in /usr/bin only | 15:37 |
| EmilienM | I'm trying to avoid new tasks here | 15:37 |
| panda|ruck | ykarel: probably no, anyway, podman fails to create or run the containers | 15:37 |
| ykarel | EmilienM, it exists from long, so i didn't wanted to touch that | 15:38 |
| ykarel | considering all we go atleast from master | 15:38 |
| ykarel | panda|ruck, shouldn't be related | 15:39 |
| ykarel | btw which revert u talking about? | 15:39 |
| *** saneax has quit IRC | 15:39 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM: Adding role for IPA install and usage https://review.opendev.org/720757 | 15:46 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-ci master: DNM: Testing standalone IPA running on multinode https://review.opendev.org/706288 | 15:49 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: manage systemd services per step vs start_order https://review.opendev.org/720614 | 15:49 |
| AJaeger | ykarel: could you patch os-net-config the same way for sphinx-build, please? See https://review.opendev.org/720737 | 15:50 |
| *** dpawlik has quit IRC | 15:50 | |
| ykarel | AJaeger, ack sending | 15:54 |
| *** marios has quit IRC | 15:54 | |
| AJaeger | thanks! | 15:54 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: deploy-steps-tasks-step-1: update startup-configs with latest hashes https://review.opendev.org/720275 | 15:54 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: manage systemd services per step vs start_order https://review.opendev.org/720614 | 15:55 |
| *** pkopec has joined #tripleo | 15:55 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-ansible master: Add additional strategy optimization https://review.opendev.org/704443 | 15:56 |
| *** ykarel is now known as ykarel|away | 15:57 | |
| *** bogdando has quit IRC | 16:00 | |
| ykarel|away | AJaeger, https://review.rdoproject.org/r/#/c/26630/ | 16:01 |
| AJaeger | thanks, ykarel|away - have a great weekend! | 16:01 |
| ykarel|away | same 2 u | 16:01 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: manage systemd services per step vs start_order https://review.opendev.org/720614 | 16:01 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: remove systemd healthchecks https://review.opendev.org/720061 | 16:04 |
| *** lucasagomes has quit IRC | 16:05 | |
| *** hewbrocca is now known as hewbrocca_afk | 16:09 | |
| *** hewbrocca_afk is now known as hewbrocca | 16:09 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM: Adding role for IPA install and usage https://review.opendev.org/720757 | 16:11 |
| *** jpich has quit IRC | 16:13 | |
| *** jcapitao has quit IRC | 16:14 | |
| ykarel|away | EmilienM, i checked and those symlink were introduced with https://review.opendev.org/#/c/660212/ as a replacement of https://review.opendev.org/#/c/690733/5/deployed-server/deployed-server-bootstrap-centos.sh | 16:16 |
| ykarel|away | and symlink were created with https://review.opendev.org/#/c/632768/2 as reasoning for fedora | 16:16 |
| ykarel|away | i will update my patch | 16:16 |
| *** dtantsur is now known as dtantsur|afk | 16:16 | |
| *** rpittau is now known as rpittau|afk | 16:17 | |
| *** matbu has quit IRC | 16:20 | |
| *** gfidente is now known as gfidente|afk | 16:20 | |
| openstackgerrit | yatin proposed openstack/tripleo-ansible master: Create Symlink /usr/bin/ansible-playbook-3 when not exist https://review.opendev.org/720694 | 16:21 |
| ykarel|away | EmilienM, updated | 16:22 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-ci master: add ceph-ansible log path to collection https://review.opendev.org/720773 | 16:22 |
| *** udesale_ has quit IRC | 16:23 | |
| EmilienM | ykarel|away: thx, let's see how CI works. | 16:24 |
| ykarel|away | yes let' see | 16:24 |
| *** jmasud has joined #tripleo | 16:26 | |
| *** hamzy__ has joined #tripleo | 16:31 | |
| *** pkopec has quit IRC | 16:31 | |
| *** hamzy_ has quit IRC | 16:31 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: use releases rather than distro distro_version to determine dlrn path https://review.opendev.org/720776 | 16:33 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: use releases rather than distro distro_version to determine dlrn path https://review.opendev.org/720776 | 16:34 |
| openstackgerrit | Merged openstack/tripleo-ansible stable/train: Correctly set openstack_domains for ansible >= 2.9 https://review.opendev.org/720599 | 16:36 |
| *** evrardjp has quit IRC | 16:37 | |
| *** evrardjp has joined #tripleo | 16:37 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-ci master: Revert "Refactor image build for downstream and image-build role" https://review.opendev.org/720555 | 16:38 |
| *** gthiemon1e has joined #tripleo | 16:44 | |
| *** gfidente|afk has quit IRC | 16:46 | |
| *** gthiemonge has quit IRC | 16:47 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-ansible master: Add additional strategy optimization https://review.opendev.org/704443 | 16:48 |
| *** marbindrakon has quit IRC | 16:49 | |
| *** gthiemon1e is now known as gthiemonge | 16:49 | |
| openstackgerrit | Lance Bragstad proposed openstack/python-tripleoclient master: Add call to cleanup_ipa.yaml playbook when doing a stack delete https://review.opendev.org/713075 | 16:54 |
| *** jmasud has quit IRC | 16:55 | |
| *** jmasud has joined #tripleo | 16:56 | |
| mwhahaha | cloudnull, EmilienM: so I think the default ansible linear strategy is not what we want. I think free is closer to what we had with heat | 16:57 |
| *** bdodd has quit IRC | 16:58 | |
| * mwhahaha will test | 16:58 | |
| *** bdodd has joined #tripleo | 16:59 | |
| cloudnull | mwhahaha agreed. | 16:59 |
| mwhahaha | because with heat it was a client pull and they all did their stuff at the same time without blocking. It seems that linear doesn't provide that | 17:00 |
| cloudnull | I think we need to solve the "all errors are fatal" for the free strategy but I would agree | 17:00 |
| mwhahaha | I think that goes into the being able to have a failure percentage on our role concept | 17:00 |
| mwhahaha | but that's a linear or free problem | 17:01 |
| mwhahaha | or is there another failure gotcha with free? | 17:01 |
| cloudnull | I think we set all errors fatal on our playbooks, and last I looked that doesn't work with the free strategy | 17:02 |
| cloudnull | however, maybe we dont need that ? | 17:02 |
| mwhahaha | not sure, i shall test | 17:03 |
| Madkiss | So I got the alignment of nodes and servers and hostnames right, but now apparently the mapping from IPs to pools doesn't work. I am adding a new node to an existing cloud, and its Ips are in the environment, but it doesnt use then | 17:06 |
| mwhahaha | cloudnull: https://review.opendev.org/#/c/720236/ for kolla plz | 17:10 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM: Adding role for IPA install and usage https://review.opendev.org/720757 | 17:10 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Simplify ffwd2 CIP stein parameters. https://review.opendev.org/720783 | 17:11 |
| *** derekh has quit IRC | 17:12 | |
| cloudnull | mwhahaha done | 17:12 |
| mwhahaha | gracias | 17:12 |
| fultonj | cloudnull: have you seen this one? http://paste.openstack.org/show/792347 | 17:23 |
| fultonj | my tht and tripleo-ansible are using https://review.opendev.org/#/c/714217 and https://review.opendev.org/#/c/719466 | 17:23 |
| cloudnull | fultonj i have not seen that | 17:24 |
| fultonj | cloudnull: ok | 17:24 |
| cloudnull | fultonj I know that ramishra did a bunch of work on that playbook (the pw rotate capabilities), maybe something fell out of that ? | 17:29 |
| fultonj | if I comment that task out i get the exact same error from tripleo_image_params_prepare | 17:30 |
| * fultonj trying to see my plan get updated with hello world | 17:31 | |
| cloudnull | i dont think any of those patches touch the task "Generate passwords if does not exist and update plan" | 17:33 |
| fultonj | since the derive param needs to call tripleo_plan_parameters_update and that module is also broken for me i'll need to look into why | 17:34 |
| cloudnull | ++ | 17:34 |
| cloudnull | if you run with https://review.opendev.org/#/c/719466 the "hello world" bits are gone - https://review.opendev.org/#/c/719466/11/tripleo_ansible/playbooks/cli-derive-parameters.yaml changes that playbook to use the new role | 17:35 |
| cloudnull | maybe if you revert that playbook change you'll see the simple hello world update? | 17:35 |
| openstackgerrit | Daniel Bengtsson proposed openstack/tripleo-heat-templates master: Fix the unicode error with puppet. https://review.opendev.org/720787 | 17:37 |
| fultonj | thx, i'll keep digging | 17:39 |
| *** jpena is now known as jpena|off | 17:40 | |
| *** jmasud has quit IRC | 17:43 | |
| *** jmasud has joined #tripleo | 17:48 | |
| *** suuuper has quit IRC | 17:51 | |
| *** elGamal has quit IRC | 17:51 | |
| *** elGamal has joined #tripleo | 17:52 | |
| *** amoralej is now known as amoralej|off | 17:57 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: extract get_commands into playbooks https://review.opendev.org/720608 | 17:58 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: manage systemd services per step vs start_order https://review.opendev.org/720614 | 17:58 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: remove systemd healthchecks https://review.opendev.org/720061 | 17:58 |
| *** dciabrin has quit IRC | 18:00 | |
| *** jmasud has quit IRC | 18:05 | |
| *** rainleander has joined #tripleo | 18:17 | |
| *** leanderthal has quit IRC | 18:19 | |
| EmilienM | weshay|ruck: why do we have so many retries in gate? | 18:25 |
| * weshay|ruck looks | 18:25 | |
| weshay|ruck | EmilienM, so.. there was a patch earlier that reset the whole thing | 18:26 |
| EmilienM | ah ok | 18:27 |
| weshay|ruck | but does zuul capture that now? | 18:27 |
| weshay|ruck | or is retry still just when pre.yaml fails? | 18:27 |
| EmilienM | maybe? | 18:27 |
| EmilienM | i don't know it doesn't show logs | 18:27 |
| weshay|ruck | it's fairly new if it's capturing a reset | 18:27 |
| weshay|ruck | if it is a reset.. the issue is known | 18:27 |
| EmilienM | the dib stuff? | 18:27 |
| weshay|ruck | if it's not.. I'll watch the next batch start and look for errors in pre | 18:28 |
| weshay|ruck | EmilienM, ya.. chandan convinced me the overcloud image build was ok.. so I dropped a revert I had on his patch.. | 18:28 |
| weshay|ruck | which was dumb | 18:28 |
| weshay|ruck | that is what reset the gate | 18:28 |
| weshay|ruck | ooops? | 18:29 |
| weshay|ruck | if there is an issue w/ pre.yaml it's a bigger problem | 18:29 |
| EmilienM | weshay|ruck: do we continue to create logstash queries for encountered bugs? | 18:30 |
| EmilienM | i guess no | 18:30 |
| *** jmasud has joined #tripleo | 18:30 | |
| weshay|ruck | EmilienM, some times | 18:30 |
| weshay|ruck | when we're looking for patterns | 18:30 |
| weshay|ruck | they are impossible to get merged usually | 18:31 |
| EmilienM | for ex. i want to monitor https://bugs.launchpad.net/tripleo/+bug/1873453 | 18:31 |
| openstack | Launchpad bug 1873453 in tripleo "[master] Job in gate failed with Could not find the requested service tripleo_keystone.service: host" [Medium,In progress] - Assigned to Emilien Macchi (emilienm) | 18:31 |
| weshay|ruck | we need a core there | 18:31 |
| weshay|ruck | EmilienM, send me the pattern, I'll add a patch | 18:31 |
| EmilienM | i don't have one :/ | 18:32 |
| weshay|ruck | WELLL | 18:32 |
| *** homeski has joined #tripleo | 18:32 | |
| weshay|ruck | not sure if tempest core have rights to that logstash repo or not | 18:32 |
| weshay|ruck | they should | 18:32 |
| homeski | Hey team. If there is a better channel to ask in , let me know .. | 18:34 |
| homeski | We're running into an issue making stack updates due to our compute nodes having large number of interfaces 600+ in a DVR setup | 18:34 |
| homeski | https://opendev.org/openstack/tripleo-common/commit/32bc45c293c3ad9e24a803dfd82042efa81efdfe | 18:34 |
| homeski | That commit is directly related to the issue, and it's a correct fix... for that step , it moves us past | 18:35 |
| homeski | but we're also using external-ceph, and ceph-ansible also tries to gather_facts on compute hosts | 18:35 |
| EmilienM | homeski: what version? | 18:35 |
| homeski | which takes hours | 18:35 |
| homeski | and times out ... OSP13 | 18:35 |
| EmilienM | https://review.opendev.org/#/q/I0ff270dfabab2ef6926b8d2818ef5087eb03bed9 | 18:35 |
| EmilienM | mwhahaha backported to queens | 18:35 |
| EmilienM | so it'll get to a zstream at some point and you'll get the patch | 18:36 |
| mwhahaha | he's talking about the gather facts in ceph-ansible | 18:36 |
| EmilienM | oh | 18:36 |
| mwhahaha | we fixed that by adding cache | 18:36 |
| homeski | I made that code change to and it works, but now I'm bottlenecking at ceph-ansible running | 18:36 |
| mwhahaha | i believe it's also backported | 18:36 |
| EmilienM | fultonj: ^ can probably help | 18:36 |
| homeski | is there another patch for that, or can you just point me where to manually make a change to disable gathering facts in ceph ansible, if possible? | 18:37 |
| mwhahaha | though if you are using config download it might not work | 18:37 |
| mwhahaha | er not using | 18:37 |
| homeski | ceph-ansible starts: `2020-04-16 19:55:36,974 p=18822 u=mistral | TASK [gather and delegate facts] *********************************************** | 18:38 |
| homeski | ` | 18:38 |
| mwhahaha | configuring fact_caching{,_connection,timeout} in the ansible.cfg might help | 18:38 |
| homeski | gather facts finishes: `2020-04-16 21:44:54,212 p=18822 u=mistral | ok: [10.221.151.22 -> 10.221.151.10] => (item=10.221.151.10)` | 18:38 |
| fultonj | homeski: do you require ceph-ansible to run during this stack update? | 18:38 |
| mwhahaha | https://review.opendev.org/#/q/Ie7adf41cef0fafde646f840b2bf3e01ba42a17d5 | 18:38 |
| mwhahaha | was backported in oct | 18:38 |
| homeski | yes, I'm scaling a new node up. So I believe it needs to run to install ceph correctly on it? | 18:39 |
| fultonj | homeski: you could blacklist the nodes you're not updating | 18:40 |
| fultonj | https://access.redhat.com/solutions/4939291 | 18:40 |
| homeski | mwhahaha: set that on the undercloud? or where ansible seems to be running .. 10.221.151.22 | 18:40 |
| * mwhahaha shrugs | 18:40 | |
| fultonj | when ceph-ansible runs, it uses its own ansible.cfg | 18:40 |
| EmilienM | https://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/features/server_blacklist.html | 18:40 |
| fultonj | https://github.com/ceph/ceph-ansible/blob/master/ansible.cfg | 18:41 |
| mwhahaha | ceph-ansible's ancible.cfg would need it | 18:41 |
| fultonj | or versioned based on what you're using | 18:41 |
| fultonj | homeski: is this queens and luminous? | 18:41 |
| homeski | queens, on latest packages | 18:42 |
| homeski | thanks for the links..I think those could possibly help | 18:42 |
| homeski | and yes, luminous | 18:42 |
| fultonj | https://access.redhat.com/solutions/4939291 | 18:42 |
| *** alexmcleod has quit IRC | 18:43 | |
| homeski | ok, so possibly edit /usr/share/ceph-ansible/ansible.cfg | 18:43 |
| fultonj | homeski: maybe | 18:43 |
| fultonj | homeski you can no op the CephClient role to speed up stack updates for external ceph | 18:43 |
| openstackgerrit | Ade Lee proposed openstack/tripleo-heat-templates master: WIP - Add support for lunasa hsm in barbican https://review.opendev.org/720805 | 18:44 |
| homeski | once we solve this ceph-ansible bottleneck, any ideas if we'll hit somewhere else ansible runs and gathers facts? | 18:44 |
| fultonj | no need to have ceph-ansible update the ceph.conf and key for all compute nodes if you're doing a scale up of a few nodes | 18:44 |
| fultonj | similar concept for other compute nodes | 18:44 |
| fultonj | homeski: so i think a temporary blacklist will speed things up the most | 18:45 |
| fultonj | yeah, ceph-ansible could have fact tuning, but not running it on all the nodes is even faster | 18:45 |
| homeski | I'll give these suggestions a try. | 18:46 |
| homeski | I can reproduce this myself simply by running `ansible -m setup -a gather_subset=network` any ideas on what a real solution might look like with nodes with 100s of interfaces | 18:47 |
| fultonj | in train nd newer it's also possible use the Ansible --limit feature directly on the ceph-ansible run by passing something like openstack overcloud deploy ... -e ceph_ansible_limit=host1,host2 | 18:47 |
| homeski | we have 4 clusters with similar setup and interface counts | 18:47 |
| homeski | this is just one :) | 18:47 |
| homeski | at some point, I have to run real updates and upgrades on these clouds | 18:48 |
| *** AJaeger has left #tripleo | 18:49 | |
| *** dciabrin has joined #tripleo | 18:52 | |
| homeski | also, I've been going back and forth with support for a couple days, before I got desperate and came here.. | 18:52 |
| homeski | https://access.redhat.com/support/cases/#/case/02631469 | 18:52 |
| homeski | there's a lot of output there | 18:52 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: use releases rather than distro distro_version to determine dlrn path https://review.opendev.org/720776 | 18:56 |
| *** gthiemon1e has joined #tripleo | 19:12 | |
| *** gthiemonge has quit IRC | 19:12 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/train: Skip operating system upgrade tasks via OperatingSystemUpgrade param. https://review.opendev.org/713472 | 19:22 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM: Adding role for IPA install and usage https://review.opendev.org/720757 | 19:29 |
| *** raildo has quit IRC | 19:30 | |
| *** gthiemon1e has quit IRC | 19:41 | |
| *** gthiemonge has joined #tripleo | 19:42 | |
| *** raildo has joined #tripleo | 19:50 | |
| openstackgerrit | Merged openstack/tripleo-ansible master: Simplify tripleo_container_rm to not check binaries https://review.opendev.org/720606 | 19:52 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: use releases rather than distro distro_version to determine dlrn path https://review.opendev.org/720776 | 19:56 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: trim down ansible tasks https://review.opendev.org/720823 | 20:00 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/train: Simplify tripleo_container_rm to not check binaries https://review.opendev.org/720824 | 20:01 |
| *** jtomasek has quit IRC | 20:03 | |
| *** gthiemonge has quit IRC | 20:03 | |
| *** gthiemon1e has joined #tripleo | 20:03 | |
| *** TrevorV has quit IRC | 20:04 | |
| *** rainleander has quit IRC | 20:08 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Convert docker molecule usage to podman https://review.opendev.org/720609 | 20:11 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-ansible master: DNM - testing a strategy. https://review.opendev.org/720825 | 20:12 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: DNM - testing strategy https://review.opendev.org/720826 | 20:12 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Convert docker molecule usage to podman https://review.opendev.org/720609 | 20:15 |
| *** holser has quit IRC | 20:19 | |
| *** mcornea has quit IRC | 20:20 | |
| openstackgerrit | Merged openstack/tripleo-common master: Cleanup py27 support https://review.opendev.org/719531 | 20:22 |
| *** jmasud has quit IRC | 20:27 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Fix oooci-build-images role for CentOS-7 https://review.opendev.org/720575 | 20:30 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: ensure centos-7 train image builds are tested https://review.opendev.org/720538 | 20:30 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Rename ApacheMaxMaxClients property to ApacheMaxRequestWorkers https://review.opendev.org/718472 | 20:32 |
| *** mcornea has joined #tripleo | 20:34 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM: Adding role for IPA install and usage https://review.opendev.org/720757 | 20:38 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Fix oooci-build-images role for CentOS-7 https://review.opendev.org/720575 | 20:39 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: ensure centos-7 train image builds are tested https://review.opendev.org/720538 | 20:40 |
| *** mcornea has quit IRC | 20:59 | |
| *** rfolco has quit IRC | 21:11 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-docs master: Introduce Multibackend Storage Documenation https://review.opendev.org/713078 | 21:12 |
| *** jmasud has joined #tripleo | 21:15 | |
| *** ccamacho has quit IRC | 21:22 | |
| *** jmasud has quit IRC | 21:29 | |
| *** jmasud has joined #tripleo | 21:31 | |
| *** rh-jelabarre has quit IRC | 21:31 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Fix oooci-build-images role for CentOS-7 https://review.opendev.org/720575 | 21:35 |
| *** raildo has quit IRC | 21:35 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: ensure centos-7 train image builds are tested https://review.opendev.org/720538 | 21:35 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Fix oooci-build-images role for CentOS-7 https://review.opendev.org/720575 | 21:37 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: ensure centos-7 train image builds are tested https://review.opendev.org/720538 | 21:37 |
| openstackgerrit | Merged openstack/tripleo-operator-ansible master: Add ability to write scripts https://review.opendev.org/716093 | 21:42 |
| *** jmasud has quit IRC | 21:44 | |
| *** jbadiapa has quit IRC | 21:57 | |
| *** jmasud has joined #tripleo | 22:02 | |
| *** xek has quit IRC | 22:12 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM: Adding role for IPA install and usage https://review.opendev.org/720757 | 22:22 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Convert docker molecule usage to podman https://review.opendev.org/720609 | 22:28 |
| openstackgerrit | Luke Short proposed openstack/tripleo-common stable/train: WIP: [Train-Only] Do not log config-download deployment to stdout. https://review.opendev.org/720845 | 22:34 |
| openstackgerrit | Luke Short proposed openstack/tripleo-common stable/train: WIP: [Train-Only] Do not log config-download deployment to stdout. https://review.opendev.org/720845 | 22:35 |
| mwhahaha | anyone know why the host name is now "changed: [underclou]" in our ansible playbooks? | 22:59 |
| * mwhahaha sighs | 22:59 | |
| mwhahaha | i deal with it on monday i guess | 22:59 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM: Adding role for IPA install and usage https://review.opendev.org/720757 | 23:08 |
| *** rlandy has quit IRC | 23:13 | |
| *** marbindrakon has joined #tripleo | 23:15 | |
| *** chem has quit IRC | 23:18 | |
| *** chem has joined #tripleo | 23:20 | |
| *** tosky has quit IRC | 23:21 | |
| *** stevebaker has quit IRC | 23:21 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!