| *** prometheanfire has quit IRC | 00:20 | |
| *** prometheanfire has joined #openstack-infra | 00:23 | |
| *** ryohayakawa has joined #openstack-infra | 00:36 | |
| *** hongbin has quit IRC | 00:43 | |
| *** hongbin has joined #openstack-infra | 00:47 | |
| *** yamamoto has joined #openstack-infra | 00:57 | |
| *** sean-k-mooney1 has joined #openstack-infra | 00:59 | |
| *** ryo_hayakawa has joined #openstack-infra | 00:59 | |
| *** sean-k-mooney has quit IRC | 01:00 | |
| *** ryohayakawa has quit IRC | 01:01 | |
| *** Goneri has quit IRC | 01:02 | |
| *** armax has quit IRC | 01:07 | |
| *** yamamoto has quit IRC | 01:11 | |
| *** gyee has quit IRC | 01:15 | |
| *** ramishra has joined #openstack-infra | 01:33 | |
| *** yamamoto has joined #openstack-infra | 01:37 | |
| *** ricolin has joined #openstack-infra | 01:54 | |
| *** dychen has quit IRC | 02:06 | |
| *** tetsuro has joined #openstack-infra | 02:17 | |
| *** Lucas_Gray has quit IRC | 02:23 | |
| *** tetsuro has quit IRC | 02:25 | |
| *** tetsuro has joined #openstack-infra | 02:27 | |
| *** tetsuro has quit IRC | 02:37 | |
| *** rfolco has joined #openstack-infra | 02:55 | |
| *** tetsuro has joined #openstack-infra | 02:56 | |
| *** tetsuro has quit IRC | 02:59 | |
| *** mugsie has quit IRC | 02:59 | |
| *** rfolco has quit IRC | 02:59 | |
| *** rfolco has joined #openstack-infra | 03:00 | |
| *** mugsie has joined #openstack-infra | 03:02 | |
| *** rfolco has quit IRC | 03:05 | |
| *** armax has joined #openstack-infra | 03:08 | |
| *** psachin has joined #openstack-infra | 03:24 | |
| *** markvoelker has joined #openstack-infra | 03:28 | |
| *** Goneri has joined #openstack-infra | 03:28 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: multi-node-hosts-file: add ipv6 address if defined https://review.opendev.org/738952 | 03:47 |
|---|---|---|
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: multi-node-hosts-file: add ipv6 address if defined https://review.opendev.org/738952 | 03:52 |
| *** Goneri has quit IRC | 03:53 | |
| *** ddurst has joined #openstack-infra | 04:03 | |
| *** markvoelker has quit IRC | 04:05 | |
| *** hongbin has quit IRC | 04:09 | |
| AJaeger | config-core, a couple of reviews, please: https://review.opendev.org/738513 https://review.opendev.org/738378 https://review.opendev.org/737457 https://review.opendev.org/738842 https://review.opendev.org/738755 | 04:25 |
| *** evrardjp has quit IRC | 04:33 | |
| *** markvoelker has joined #openstack-infra | 04:33 | |
| *** evrardjp has joined #openstack-infra | 04:33 | |
| openstackgerrit | Merged openstack/project-config master: Use python3 for update_constraints https://review.opendev.org/738931 | 04:36 |
| *** ysandeep|away is now known as ysandeep | 04:37 | |
| *** markvoelker has quit IRC | 04:38 | |
| *** apetrich has quit IRC | 04:43 | |
| *** ykarel|away is now known as ykarel | 04:49 | |
| *** vishalmanchanda has joined #openstack-infra | 04:49 | |
| *** diablo_rojo has quit IRC | 04:50 | |
| *** udesale has joined #openstack-infra | 04:55 | |
| *** tetsuro has joined #openstack-infra | 04:59 | |
| *** tetsuro has quit IRC | 05:04 | |
| *** soniya29|rover is now known as soniya29|afk | 05:09 | |
| *** bhagyashris|afk is now known as bhagyashris | 05:11 | |
| *** priteau has joined #openstack-infra | 05:16 | |
| *** markvoelker has joined #openstack-infra | 05:26 | |
| *** lmiccini has joined #openstack-infra | 05:28 | |
| *** markvoelker has quit IRC | 05:30 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: multi-node-hosts-file: add ipv6 address if defined https://review.opendev.org/738952 | 05:43 |
| *** marios has joined #openstack-infra | 05:44 | |
| openstackgerrit | Merged openstack/project-config master: Add Vault app to StarlingX https://review.opendev.org/738513 | 05:52 |
| openstackgerrit | Merged openstack/project-config master: Create a new repository for Tobiko DevStack plugin https://review.opendev.org/738378 | 05:52 |
| openstackgerrit | Merged openstack/project-config master: Upadting horizon nodejs job name https://review.opendev.org/737457 | 05:53 |
| openstackgerrit | Merged openstack/project-config master: Create a new project for ansible-tripleo-ipa-server https://review.opendev.org/738842 | 05:53 |
| *** akahat is now known as akahat|pto | 05:58 | |
| *** xek has joined #openstack-infra | 06:00 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: emit-job-header: add inventory hostname https://review.opendev.org/738963 | 06:01 |
| *** sshnaidm|afk is now known as sshnaidm|ruck | 06:03 | |
| *** matt_kosut has joined #openstack-infra | 06:04 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: multi-node-hosts-file: add ipv6 address if defined https://review.opendev.org/738952 | 06:26 |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: multi-node-hosts-file: add ipv6 address if defined https://review.opendev.org/738952 | 06:37 |
| *** hashar has joined #openstack-infra | 06:39 | |
| *** eolivare has joined #openstack-infra | 06:45 | |
| *** nightmare_unreal has joined #openstack-infra | 06:50 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: multi-node-hosts-file: add ipv6 address if defined https://review.opendev.org/738952 | 06:54 |
| *** smarcet has joined #openstack-infra | 06:54 | |
| *** slaweq has joined #openstack-infra | 06:57 | |
| *** amoralej|off is now known as amoralej | 06:57 | |
| *** smarcet has quit IRC | 06:59 | |
| *** jcapitao has joined #openstack-infra | 07:13 | |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Update the common_translation_update role to use python3 https://review.opendev.org/738755 | 07:13 |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: multi-node-hosts-file: add ipv6 address if defined https://review.opendev.org/738952 | 07:16 |
| *** ralonsoh has joined #openstack-infra | 07:22 | |
| *** markvoelker has joined #openstack-infra | 07:27 | |
| *** bhagyashris is now known as bhagyashris|lunc | 07:28 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: multi-node-hosts-file: add ipv6 address if defined https://review.opendev.org/738952 | 07:29 |
| *** markvoelker has quit IRC | 07:31 | |
| *** ramishra has quit IRC | 07:36 | |
| *** Lucas_Gray has joined #openstack-infra | 07:40 | |
| *** rcernin has quit IRC | 07:45 | |
| *** soniya29|afk is now known as soniya29|rover | 07:46 | |
| *** tosky has joined #openstack-infra | 07:46 | |
| *** smarcet has joined #openstack-infra | 07:47 | |
| *** dtantsur|afk is now known as dtantsur | 07:47 | |
| *** Lucas_Gray has quit IRC | 07:50 | |
| *** smarcet has quit IRC | 07:52 | |
| *** jpena|off is now known as jpena | 07:56 | |
| *** ysandeep is now known as ysandeep|lunch | 08:02 | |
| openstackgerrit | Federico Ressi proposed openstack/project-config master: Fix x/devstack-plugin-tobiko name https://review.opendev.org/738979 | 08:03 |
| *** Lucas_Gray has joined #openstack-infra | 08:07 | |
| *** markvoelker has joined #openstack-infra | 08:08 | |
| *** markvoelker has quit IRC | 08:12 | |
| *** lbragstad_ has joined #openstack-infra | 08:17 | |
| *** ramishra has joined #openstack-infra | 08:19 | |
| *** lbragstad has quit IRC | 08:20 | |
| *** smarcet has joined #openstack-infra | 08:20 | |
| *** ociuhandu has quit IRC | 08:22 | |
| openstackgerrit | Stephen Finucane proposed openstack/pbr master: Add support for virtualenv 20.x https://review.opendev.org/719964 | 08:34 |
| *** xek has quit IRC | 08:43 | |
| *** apetrich has joined #openstack-infra | 08:43 | |
| *** xek has joined #openstack-infra | 08:43 | |
| *** gfidente has joined #openstack-infra | 08:44 | |
| *** apetrich has quit IRC | 08:46 | |
| *** apetrich has joined #openstack-infra | 08:46 | |
| *** xek has quit IRC | 08:48 | |
| *** xek has joined #openstack-infra | 08:48 | |
| *** derekh has joined #openstack-infra | 08:49 | |
| *** bhagyashris|lunc is now known as bhagyashris | 08:50 | |
| *** ociuhandu has joined #openstack-infra | 08:50 | |
| *** ysandeep|lunch is now known as ysandeep | 09:01 | |
| *** jaicaa has quit IRC | 09:05 | |
| *** jaicaa has joined #openstack-infra | 09:07 | |
| *** tkajinam has quit IRC | 09:09 | |
| *** hashar has quit IRC | 09:16 | |
| *** pcrews has quit IRC | 09:19 | |
| *** gfidente is now known as gfidente|ffu | 09:42 | |
| *** udesale_ has joined #openstack-infra | 09:48 | |
| *** owalsh_ is now known as owalsh | 09:50 | |
| *** udesale has quit IRC | 09:50 | |
| *** priteau has quit IRC | 09:58 | |
| *** markvoelker has joined #openstack-infra | 10:03 | |
| openstackgerrit | Elod Illes proposed openstack/devstack-gate master: DNM: remove g-api from subnode https://review.opendev.org/738780 | 10:05 |
| *** xek has quit IRC | 10:06 | |
| *** markvoelker has quit IRC | 10:08 | |
| openstackgerrit | Federico Ressi proposed openstack/project-config master: Fix x/devstack-plugin-tobiko name https://review.opendev.org/738979 | 10:19 |
| openstackgerrit | Federico Ressi proposed openstack/project-config master: Re-create x/devstack-plugin-tobiko project https://review.opendev.org/738979 | 10:22 |
| openstackgerrit | Federico Ressi proposed openstack/project-config master: Revert "Create a new repository for Tobiko DevStack plugin" https://review.opendev.org/739006 | 10:22 |
| openstackgerrit | Federico Ressi proposed openstack/project-config master: Revert "Create a new repository for Tobiko DevStack plugin" https://review.opendev.org/739006 | 10:22 |
| *** ricolin has quit IRC | 10:30 | |
| openstackgerrit | Aurelien Lourot proposed openstack/project-config master: Mirror arista and trilio charms to GitHub https://review.opendev.org/739009 | 10:30 |
| *** jcapitao is now known as jcapitao_lunch | 10:32 | |
| openstackgerrit | Stephen Finucane proposed openstack/pbr master: Add support for virtualenv 20.x https://review.opendev.org/719964 | 10:38 |
| *** ryo_hayakawa has quit IRC | 10:50 | |
| *** sean-k-mooney1 is now known as sean--k-mooney | 10:52 | |
| *** sean--k-mooney is now known as sean-k-mooney | 10:55 | |
| *** rajinir has quit IRC | 11:00 | |
| *** dklyle has quit IRC | 11:00 | |
| *** yamamoto has quit IRC | 11:02 | |
| *** yamamoto has joined #openstack-infra | 11:09 | |
| *** hashar has joined #openstack-infra | 11:34 | |
| *** jpena is now known as jpena|lunch | 11:43 | |
| *** rfolco has joined #openstack-infra | 11:48 | |
| *** osmanlicilegi has quit IRC | 11:50 | |
| *** ricolin has joined #openstack-infra | 11:53 | |
| *** markvoelker has joined #openstack-infra | 11:58 | |
| *** markvoelker has quit IRC | 12:00 | |
| *** amoralej is now known as amoralej|lunch | 12:00 | |
| *** yamamoto has quit IRC | 12:01 | |
| *** ysandeep is now known as ysandeep|afk | 12:01 | |
| *** jcapitao_lunch is now known as jcapitao | 12:04 | |
| *** rlandy has joined #openstack-infra | 12:07 | |
| *** osmanlicilegi has joined #openstack-infra | 12:07 | |
| *** rlandy is now known as rlandy|ruck | 12:10 | |
| *** yamamoto has joined #openstack-infra | 12:12 | |
| *** xek has joined #openstack-infra | 12:14 | |
| openstackgerrit | Merged openstack/project-config master: Mirror arista and trilio charms to GitHub https://review.opendev.org/739009 | 12:15 |
| *** ysandeep|afk is now known as ysandeep | 12:33 | |
| *** jpena|lunch is now known as jpena | 12:42 | |
| *** yamamoto has quit IRC | 12:42 | |
| *** Lucas_Gray has quit IRC | 12:57 | |
| *** Lucas_Gray has joined #openstack-infra | 13:07 | |
| *** zxiiro has joined #openstack-infra | 13:13 | |
| *** amoralej|lunch is now known as amoralej | 13:14 | |
| *** yamamoto has joined #openstack-infra | 13:19 | |
| *** yamamoto has quit IRC | 13:22 | |
| *** dave-mccowan has quit IRC | 13:40 | |
| *** yamamoto has joined #openstack-infra | 13:46 | |
| *** xek has quit IRC | 13:48 | |
| *** vishalmanchanda has quit IRC | 13:48 | |
| *** yamamoto has quit IRC | 13:53 | |
| *** psachin has quit IRC | 13:54 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Add a job for publishing a site to netlify https://review.opendev.org/739047 | 13:55 |
| *** Goneri has joined #openstack-infra | 14:01 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Add a job for publishing a site to netlify https://review.opendev.org/739047 | 14:07 |
| *** bhagyashris is now known as bhagyashris|afk | 14:15 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Add a job for publishing a site to netlify https://review.opendev.org/739047 | 14:16 |
| *** xek has joined #openstack-infra | 14:16 | |
| *** yamamoto has joined #openstack-infra | 14:36 | |
| *** yamamoto has quit IRC | 14:42 | |
| *** ysandeep is now known as ysandeep|away | 14:43 | |
| openstackgerrit | Alex Schultz proposed zuul/zuul-jobs master: Make persist-iptables more robust https://review.opendev.org/739061 | 14:45 |
| *** priteau has joined #openstack-infra | 14:51 | |
| *** ysandeep|away is now known as ysandeep | 14:53 | |
| *** sshnaidm|ruck is now known as sshnaidm|mtg | 14:57 | |
| *** rf0lc0 has joined #openstack-infra | 15:09 | |
| *** dpawlik2 has joined #openstack-infra | 15:12 | |
| *** sean-k-mooney1 has joined #openstack-infra | 15:12 | |
| *** yoctozepto2 has joined #openstack-infra | 15:13 | |
| *** JasonF has joined #openstack-infra | 15:13 | |
| *** vesper has joined #openstack-infra | 15:13 | |
| *** jaicaa_ has joined #openstack-infra | 15:13 | |
| *** rfolco has quit IRC | 15:14 | |
| *** vesper11 has quit IRC | 15:14 | |
| *** jaicaa has quit IRC | 15:14 | |
| *** redrobot has quit IRC | 15:14 | |
| *** Goneri has quit IRC | 15:14 | |
| *** irclogbot_2 has quit IRC | 15:14 | |
| *** mnasiadka has quit IRC | 15:14 | |
| *** howell_ has joined #openstack-infra | 15:14 | |
| *** Goneri has joined #openstack-infra | 15:14 | |
| *** mnasiadka_ has joined #openstack-infra | 15:14 | |
| *** dpawlik4 has quit IRC | 15:14 | |
| *** dosaboy has quit IRC | 15:14 | |
| *** sean-k-mooney has quit IRC | 15:14 | |
| *** JayF has quit IRC | 15:14 | |
| *** eolivare has quit IRC | 15:14 | |
| *** Wasaac has quit IRC | 15:14 | |
| *** howell has quit IRC | 15:14 | |
| *** howell_ is now known as howell | 15:14 | |
| *** JasonF is now known as JayF | 15:14 | |
| *** lifeless has quit IRC | 15:14 | |
| *** yoctozepto has quit IRC | 15:15 | |
| *** tonyb has quit IRC | 15:15 | |
| *** yoctozepto2 is now known as yoctozepto | 15:15 | |
| *** jamesdenton has quit IRC | 15:15 | |
| *** elod has quit IRC | 15:15 | |
| *** Wasaac has joined #openstack-infra | 15:15 | |
| *** elod has joined #openstack-infra | 15:16 | |
| *** tonyb has joined #openstack-infra | 15:16 | |
| *** jtomasek_ has quit IRC | 15:17 | |
| *** ykarel is now known as ykarel|away | 15:17 | |
| *** lmiccini has quit IRC | 15:18 | |
| *** irclogbot_3 has joined #openstack-infra | 15:18 | |
| *** jamesdenton has joined #openstack-infra | 15:18 | |
| *** dosaboy has joined #openstack-infra | 15:19 | |
| *** smarcet has quit IRC | 15:19 | |
| *** lifeless has joined #openstack-infra | 15:20 | |
| openstackgerrit | Federico Ressi proposed openstack/project-config master: Revert "Create a new repository for Tobiko DevStack plugin" https://review.opendev.org/739006 | 15:25 |
| openstackgerrit | Federico Ressi proposed openstack/project-config master: Re-create x/devstack-plugin-tobiko project https://review.opendev.org/738979 | 15:25 |
| openstackgerrit | Oleksandr Kozachenko proposed openstack/project-config master: Add node-labeler to the vexxhost tenant https://review.opendev.org/739071 | 15:26 |
| *** sean-k-mooney1 is now known as sean-k-mooney | 15:26 | |
| *** ysandeep is now known as ysandeep|away | 15:26 | |
| *** smarcet has joined #openstack-infra | 15:33 | |
| *** dklyle has joined #openstack-infra | 15:37 | |
| *** marios is now known as marios|out | 15:38 | |
| *** yamamoto has joined #openstack-infra | 15:40 | |
| openstackgerrit | Alex Schultz proposed zuul/zuul-jobs master: Make persist-iptables more robust https://review.opendev.org/739061 | 15:43 |
| *** xek has quit IRC | 15:45 | |
| *** marios|out has quit IRC | 15:47 | |
| *** gyee has joined #openstack-infra | 15:55 | |
| *** gyee has quit IRC | 15:56 | |
| *** hamalq has joined #openstack-infra | 15:57 | |
| *** hamalq_ has joined #openstack-infra | 15:58 | |
| *** dmellado has joined #openstack-infra | 16:00 | |
| *** hamalq has quit IRC | 16:02 | |
| openstackgerrit | Merged openstack/project-config master: Add node-labeler to the vexxhost tenant https://review.opendev.org/739071 | 16:03 |
| *** yamamoto has quit IRC | 16:04 | |
| *** gyee has joined #openstack-infra | 16:14 | |
| *** udesale_ has quit IRC | 16:19 | |
| *** dmellado has quit IRC | 16:20 | |
| *** factor has joined #openstack-infra | 16:21 | |
| *** icarusfactor has quit IRC | 16:21 | |
| *** lbragstad_ is now known as lbragstad | 16:22 | |
| *** dmellado has joined #openstack-infra | 16:22 | |
| *** amoralej is now known as amoralej|off | 16:27 | |
| *** factor has quit IRC | 16:28 | |
| *** dtantsur is now known as dtantsur|afk | 16:28 | |
| *** ociuhandu_ has joined #openstack-infra | 16:33 | |
| *** derekh has quit IRC | 16:34 | |
| *** yamamoto has joined #openstack-infra | 16:36 | |
| *** ociuhandu has quit IRC | 16:36 | |
| openstackgerrit | Luigi Toscano proposed zuul/zuul-jobs master: WIP fetch-coverage-output: direct link to coverage data https://review.opendev.org/739099 | 16:36 |
| *** ociuhandu_ has quit IRC | 16:38 | |
| *** Lucas_Gray has quit IRC | 16:40 | |
| *** smarcet has quit IRC | 16:44 | |
| *** yamamoto has quit IRC | 16:45 | |
| *** armax has quit IRC | 16:50 | |
| *** armax has joined #openstack-infra | 16:51 | |
| *** smarcet has joined #openstack-infra | 16:56 | |
| *** jcapitao has quit IRC | 17:05 | |
| *** smarcet has quit IRC | 17:08 | |
| *** nightmare_unreal has quit IRC | 17:09 | |
| *** ccamacho has quit IRC | 17:13 | |
| *** jpena is now known as jpena|off | 17:14 | |
| *** ricolin has quit IRC | 17:28 | |
| *** apetrich has quit IRC | 17:34 | |
| *** apetrich has joined #openstack-infra | 17:39 | |
| *** KeithMnemonic has joined #openstack-infra | 17:58 | |
| *** gfidente|ffu is now known as gfidente|afk | 18:29 | |
| *** ociuhandu has joined #openstack-infra | 18:34 | |
| *** haleyb has quit IRC | 18:36 | |
| *** ociuhandu has quit IRC | 18:39 | |
| *** rledisez has joined #openstack-infra | 18:42 | |
| yoctozepto | clarkb, fungi: I tried debugging that debian in CI: https://e270d0ff903275e3da5e-11d92d8452a346ca231ad13d26a55a7d.ssl.cf5.rackcdn.com/738877/6/check/kolla-ansible-debian-source/5c127ea/primary/logs/debug_time.txt | 18:47 |
| yoctozepto | it's interesting in the middle of the file, sorry for the lame output | 18:47 |
| yoctozepto | it seems it failed to synchronize the clock in 5 minutes | 18:48 |
| clarkb | ya quick ^F shows ntp is installed and the unit is/was running | 18:48 |
| yoctozepto | also, I confirmed we have chronyd in centos8 and timesyncd in both bionic and focal (but bionic gets ntp installed extra) | 18:48 |
| clarkb | I want to say ubuntu does a forced update on boot | 18:48 |
| clarkb | which ignores the slow sync over time | 18:49 |
| yoctozepto | well, ubuntu does timesyncd | 18:49 |
| yoctozepto | not ntp :-) | 18:49 |
| clarkb | yoctozepto: we run ntp everywhere but focal iirc | 18:49 |
| yoctozepto | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_779/738877/6/check/kolla-ansible-ubuntu-source/7798012/primary/logs/debug_time.txt | 18:49 |
| clarkb | we only do timesyncd on focal I think | 18:49 |
| yoctozepto | clarkb: nope, centos8 is chronyd | 18:49 |
| yoctozepto | and bionic is timesyncd | 18:49 |
| clarkb | yoctozepto: I mean for ubuntu | 18:49 |
| yoctozepto | me too :-) | 18:50 |
| clarkb | yoctozepto: see https://opendev.org/openstack/project-config/src/branch/master/nodepool/elements/infra-package-needs/pkg-map#L10-L13 | 18:50 |
| clarkb | maybe that means ntp and ntpdate don't actually get you ntp on bionic | 18:50 |
| *** haleyb has joined #openstack-infra | 18:51 | |
| yoctozepto | clarkb: yes, they are installed but timesyncd is being used | 18:51 |
| yoctozepto | for some reason debian acts differently | 18:52 |
| yoctozepto | and ntp disables timesyncd | 18:52 |
| fungi | are you sure both are installed on debian? | 18:54 |
| fungi | i thought they conflicted via breaks over a common virtual package | 18:54 |
| * fungi double-checks | 18:54 | |
| yoctozepto | fungi: yeah, timesyncd could get uninstalled | 18:54 |
| yoctozepto | let me see | 18:54 |
| clarkb | ntpd man page says it should run with iburst to quickly sync | 18:54 |
| yoctozepto | systemd-timesyncd.service loaded inactive dead Network Time Synchronization | 18:55 |
| clarkb | maybe that is something we can configure | 18:55 |
| yoctozepto | well, it seems available (loaded) | 18:55 |
| fungi | oh, well for starters, there is no systemd-timesyncd in debian buster, it was introduced later (and there's a copy in buster-backports) | 18:55 |
| yoctozepto | odd | 18:56 |
| yoctozepto | it seems available | 18:56 |
| fungi | on sid and bullseye systemd-timesyncd and ntpd packages both provide and conflict with the time-daemon virtual package, so they can't be coinstalled | 18:58 |
| fungi | but yeah, on one of my buster servers with no buster-backports in the sources list, it finds no systemd-timesyncd package | 18:59 |
| yoctozepto | maybe it's packaged in systemd itself | 18:59 |
| fungi | possible it was split into a separate package for bullseye, yes... checking | 19:00 |
| yoctozepto | anyhow, now trying a job that disables ntp and enables timesyncd to see what happens | 19:00 |
| fungi | ahh, yep, it's part of the systemd package on buster | 19:01 |
| fungi | and also includes /lib/systemd/system/systemd-timesyncd.service.d/disable-with-time-daemon.conf | 19:01 |
| fungi | which turns it off if ntpd is installed | 19:01 |
| fungi | so it looks like they probably split it into a separate package after buster to make that simpler to manage | 19:01 |
| yoctozepto | makes sense | 19:03 |
| fungi | which explains why it's not running on my buster servers | 19:04 |
| fungi | not that i would trust it anyway, i want the steadier time ntpd management provides | 19:05 |
| clarkb | yoctozepto: is the issue that you're observing clock skew or that you expect timesyncd? | 19:05 |
| fungi | but on test nodes yeah systemd-timesyncd should be fine | 19:05 |
| yoctozepto | clarkb: kolla-ansible wants to add prechecks for time synchronization, they would go via timedatectl to query the arbitraty ntp implementation about it and on debian this fails because seemingly ntp does not converge | 19:11 |
| yoctozepto | so ntp is fine if you want to enforce it | 19:12 |
| yoctozepto | as long as it does the job :D | 19:12 |
| clarkb | I wonder if that is a debian bug because I would really expect debians packaging to try and converge quickly the first time the service is started | 19:12 |
| clarkb | (it isn't started during image build time so first boot should be that occurence) | 19:13 |
| yoctozepto | yeah, I would expect this behaviour; not really a bug but a missed feature | 19:15 |
| fungi | in some ways debian still expects to be running on physical hardware with decently accurate hardware clock which can be updated on shutdown so that the system comes back up pretty close to in sync | 19:17 |
| fungi | ntpd is designed to slowly make very small skew corrections to slowly bring the system clock in sync with an accurate set of remote time sources | 19:18 |
| yoctozepto | well, it's true on vms as well as long as the host keeps the time in sync | 19:18 |
| fungi | if the time is waaay off it will struggle, or even give up. bsd ntp these days has a command line option telling it that it's okay to make a large jump correction when it first starts but then to do the normal slow and careful skew corrections | 19:19 |
| fungi | i think debian still expects something like ntpdate to do that though | 19:20 |
| fungi | ahh, nope, modern ntpd on debian has -G/--force-step-once | 19:20 |
| fungi | so like *bsd | 19:21 |
| yoctozepto | anyhow, the timedatectl is dumb | 19:21 |
| yoctozepto | https://3fd6cb5fa6438f16e00d-c77d7211b8c124ad183202888cc1ebe6.ssl.cf2.rackcdn.com/738877/8/check/kolla-ansible-debian-source/67be8ff/primary/logs/debug_time.txt | 19:21 |
| yoctozepto | timesyncd failed to start due to ntp being installed | 19:21 |
| yoctozepto | yet it now claims the clock is synchronized but the ntp service is not active | 19:21 |
| yoctozepto | oh well | 19:21 |
| fungi | or alternatively ntpd -g/--panicgate | 19:21 |
| fungi | which seems to be added by default | 19:22 |
| clarkb | fungi: ntpd has the iburst option | 19:23 |
| *** ralonsoh has quit IRC | 19:27 | |
| clarkb | fungi: I want to say the older ubuntus did ntpdate on boot then let ntpd manage it over time | 19:27 |
| clarkb | but I also recall from the before times that devstack jobs would run ntpdate in d-g? | 19:28 |
| clarkb | so maybe notand maybe we relied on the job to enforce that | 19:28 |
| clarkb | thinking out loud that may be something we add to our base job? | 19:28 |
| yoctozepto | so far only debian seems affected | 19:28 |
| clarkb | if not timesyncd then ntpdate | 19:28 |
| yoctozepto | did not check cento7 though | 19:28 |
| clarkb | and or just switch to timesyncd since everything is systemd now | 19:29 |
| fungi | xenial may have too old of a systemd, would need to check | 19:29 |
| yoctozepto | did not check xenial either but it's out of my interest | 19:29 |
| yoctozepto | both centos7 and 8 default to chrony in regular installs | 19:30 |
| yoctozepto | will check infra's centos7 | 19:30 |
| fungi | ahh, nope, xenial does have timesync units provided by the systemd package at least | 19:30 |
| fungi | so we could probably switch to it across the board | 19:30 |
| fungi | i expect opensuse, gentoo, et cetera have it | 19:30 |
| fungi | looks like it's in debian stretch as well | 19:31 |
| fungi | so while i wouldn't recommend it on our persistent servers, it's likely a good simplification for our test nodes | 19:31 |
| *** xek has joined #openstack-infra | 19:32 | |
| yoctozepto | yeah, and it's a default so our users would likely run it too | 19:34 |
| fungi | i guess most users aren't particularly concerned with time stability or subsecond precision | 19:38 |
| *** armax has quit IRC | 19:39 | |
| fungi | as long as the clock widget in the corner of their screen seems at least as accurate as their wristwatch | 19:39 |
| *** dave-mccowan has joined #openstack-infra | 19:42 | |
| yoctozepto | well, chronyd did not let me down for years now :-) | 19:48 |
| yoctozepto | not sure about timesyncd | 19:48 |
| yoctozepto | most environments generally tolerate second-level offsets | 19:48 |
| yoctozepto | bingo: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_bcc/738877/10/check/kolla-ansible-debian-source/bccf17b/primary/logs/debug_time.txt | 19:49 |
| yoctozepto | fungi, clarkb: ^ | 19:50 |
| yoctozepto | ^F "+ " to get the chain of commands | 19:50 |
| yoctozepto | that sleep 30 was an overkill but it generally shows timesyncd was able to do the job | 19:51 |
| *** hashar has quit IRC | 19:58 | |
| yoctozepto | it seems centos7 is even worse: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_0af/739138/1/check/kolla-ansible-centos-source/0af72f1/primary/logs/debug_time.txt | 20:04 |
| yoctozepto | it has neither chrony nor ntp nor timesyncd running | 20:05 |
| *** smarcet has joined #openstack-infra | 20:05 | |
| *** smarcet has quit IRC | 20:06 | |
| *** zxiiro has quit IRC | 20:07 | |
| *** smarcet has joined #openstack-infra | 20:08 | |
| *** dave-mccowan has quit IRC | 20:25 | |
| *** sshnaidm|mtg is now known as sshnaidm|afk | 20:27 | |
| *** ociuhandu has joined #openstack-infra | 20:35 | |
| sean-k-mooney | fungi: chrony is what we use for redhats openstack distibution | 20:38 |
| sean-k-mooney | fungi: if you need acurracy then you would use ptp | 20:38 |
| *** ociuhandu has quit IRC | 20:40 | |
| *** priteau has quit IRC | 20:44 | |
| *** ociuhandu has joined #openstack-infra | 20:45 | |
| *** ociuhandu has quit IRC | 20:49 | |
| *** priteau has joined #openstack-infra | 20:52 | |
| *** priteau has quit IRC | 20:52 | |
| *** Lucas_Gray has joined #openstack-infra | 20:57 | |
| *** xek has quit IRC | 21:00 | |
| openstackgerrit | Luigi Toscano proposed zuul/zuul-jobs master: fetch-coverage-output: direct link to coverage data https://review.opendev.org/739099 | 21:13 |
| *** ociuhandu has joined #openstack-infra | 21:14 | |
| *** ociuhandu has quit IRC | 21:20 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: multi-node-hosts-file: add ipv6 address if defined https://review.opendev.org/738952 | 21:25 |
| *** Tengu has quit IRC | 21:58 | |
| *** Tengu has joined #openstack-infra | 22:00 | |
| *** smarcet has quit IRC | 22:03 | |
| *** slaweq has quit IRC | 22:04 | |
| *** matt_kosut has quit IRC | 22:11 | |
| *** gyee has quit IRC | 22:21 | |
| *** Tengu has quit IRC | 22:25 | |
| *** Tengu has joined #openstack-infra | 22:27 | |
| *** armax has joined #openstack-infra | 22:42 | |
| *** rcernin has joined #openstack-infra | 22:42 | |
| *** tosky has quit IRC | 22:54 | |
| *** tkajinam has joined #openstack-infra | 22:55 | |
| *** rlandy|ruck has quit IRC | 22:57 | |
| *** markvoelker has joined #openstack-infra | 22:58 | |
| *** Wryhder has joined #openstack-infra | 23:02 | |
| *** markvoelker has quit IRC | 23:02 | |
| *** Lucas_Gray has quit IRC | 23:03 | |
| *** Wryhder is now known as Lucas_Gray | 23:03 | |
| *** Goneri has quit IRC | 23:08 | |
| *** armax has quit IRC | 23:25 | |
| *** Tengu has quit IRC | 23:26 | |
| *** Tengu has joined #openstack-infra | 23:28 | |
| *** hamalq_ has quit IRC | 23:52 | |
| *** ryohayakawa has joined #openstack-infra | 23:54 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!