Wednesday, 2021-07-28

opendevreviewMerged openstack/tripleo-upgrade stable/train: Stop the upgrade script if some of the commands fail.  https://review.opendev.org/c/openstack/tripleo-upgrade/+/80200200:37
opendevreviewSteve Baker proposed openstack/tripleo-quickstart-extras master: WIP Mount whole-disk lvm volumes in modify-image  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80192703:28
*** ykarel|away is now known as ykarel04:44
opendevreviewMerged openstack/openstack-tempest-skiplist master: Skip failing scenario004-standalone-cinder-train test  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/80255504:45
opendevreviewyatin proposed openstack/tripleo-quickstart master: [DNM] Test tripleo-ci release files in ci.centos gate job  https://review.opendev.org/c/openstack/tripleo-quickstart/+/80253304:55
*** marios is now known as marios|ruck05:49
opendevreviewMartin Schuppert proposed openstack/tripleo-heat-templates stable/wallaby: nova-compute: Adding failed_when to nova-compute stop task  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80246606:05
opendevreviewMartin Schuppert proposed openstack/tripleo-heat-templates stable/wallaby: Nova: Remove useless authtoken hieradata from computes  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80246706:08
opendevreviewJiri Podivin proposed openstack/tripleo-validations master: Ansible lint custom rule expansion  https://review.opendev.org/c/openstack/tripleo-validations/+/79863606:40
marios|ruckneeds reviews please https://review.opendev.org/c/openstack/tripleo-ansible/+/80161506:45
Tengulemme check06:46
Tengumarios|ruck: the depends-on is on a master patch, but iirc ooo-q is branchless?06:48
marios|ruckTengu: yes oooq is branchless, so we have conditionals in there that do stuff depending on which branch code is using it06:49
marios|ruckTengu: but what is the question06:49
Tengujust wanted to be sure there wasn't a false value for the depends-on06:49
Tengupatch is in gate :)06:49
marios|ruckTengu: no its fine, anyway merged now and also see commit message . The depends-on06:49
marios|ruckis unrelated but needed to pass centos7 jobs in ci.06:50
marios|ruckTengu: thanks for checking06:50
Tengunp06:52
*** rpittau|afk is now known as rpittau07:02
*** amoralej|off is now known as amoralej07:07
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/ussuri: DNM  https://review.opendev.org/c/openstack/tripleo-validations/+/80266207:25
ykarelbandini, hi07:29
ykarelbandini, can u check https://bugs.launchpad.net/tripleo/+bug/193703507:31
ykarelon what causing those timeouts07:32
ykarelin a patch it failed thrice in a row07:32
ykareli have a node held if u can check there07:32
opendevreviewMatthias Runge proposed openstack/tripleo-heat-templates master: Example configurable cap add  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80151107:36
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/train: DNM  https://review.opendev.org/c/openstack/tripleo-validations/+/80266607:40
marios|ruckykarel: please check https://bugs.launchpad.net/tripleo/+bug/1937035/comments/10 and file a new bug for the issue you are seeing please07:41
ykarelmarios|ruck, tempest is just fallback07:41
ykarelissue is in pcs timeouts07:41
ykarelso underlying issue is same, but ok to file seperate bug07:42
marios|ruckykarel: sure so lets track a new issue for it please so we can get a clean cix if needed 07:42
marios|ruckykarel: thanks07:42
opendevreviewJiri Podivin proposed openstack/validations-common master: callback adjustment for no hosts matched  https://review.opendev.org/c/openstack/validations-common/+/80016907:46
opendevreviewYariv proposed openstack/tripleo-upgrade master: [FFWD upgrade] Adding support of live/cold migration with external workload  https://review.opendev.org/c/openstack/tripleo-upgrade/+/80252407:51
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/ussuri: DNM  https://review.opendev.org/c/openstack/tripleo-validations/+/80266207:54
opendevreviewchandan kumar proposed openstack/tripleo-quickstart-extras master: Move build-test-packages as a part of undercloud setup  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/79092607:59
opendevreviewchandan kumar proposed openstack/tripleo-heat-templates master: [DNM] tripleo-operator-ansible rpm testing  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80129608:00
opendevreviewJiri Podivin proposed openstack/validations-common master: callback adjustment for no hosts matched  https://review.opendev.org/c/openstack/validations-common/+/80016908:33
*** ykarel is now known as ykarel|lunch08:34
*** zbr is now known as Guest254409:09
opendevreviewJiri Podivin proposed openstack/tripleo-validations master: Ansible lint custom rule expansion  https://review.opendev.org/c/openstack/tripleo-validations/+/79863609:22
opendevreviewShnaidman Sagi (Sergey) proposed openstack/tripleo-ansible master: DNM check ansible 2.11 with tripleo-ansible  https://review.opendev.org/c/openstack/tripleo-ansible/+/80267309:26
marios|ruckneed vote here please https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/801736 test at https://review.opendev.org/c/openstack/tripleo-heat-templates/+/802618 (scen4 tested)09:37
marios|ruckthank you sshnaidm|afk chandankumar 09:40
*** sshnaidm|afk is now known as sshnaidm09:45
*** pojadhav is now known as pojadhav|brb09:53
opendevreviewMarios Andreou proposed openstack/openstack-tempest-skiplist master: Revert "Skip tempest.scenario.test_object_storage_basic_ops.TestObjectStorageBasicOps"  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/80158409:53
opendevreviewMerged openstack/openstack-tempest-skiplist master: Revert "Skip manila_tempest_tests.tests.api.test_shares.SharesNFSTest test"  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/80173609:55
opendevreviewShnaidman Sagi (Sergey) proposed openstack/tripleo-ansible master: DNM check ansible 2.11 with tripleo-ansible  https://review.opendev.org/c/openstack/tripleo-ansible/+/80267310:04
*** ykarel|lunch is now known as ykarel10:17
opendevreviewJuan Badia Payno proposed openstack/tripleo-quickstart-extras master: WIP Create overcloud_baremetal_deploy.yaml file properly  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/79745210:20
opendevreviewMarios Andreou proposed openstack/openstack-tempest-skiplist master: Revert "Skip tempest.scenario.test_object_storage_basic_ops.TestObjectStorageBasicOps"  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/80158410:24
opendevreviewMarios Andreou proposed openstack/tripleo-heat-templates master: NO MERGE test scen4 tempest skip revert for related-bug  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80267910:24
opendevreviewJiri Podivin proposed openstack/validations-common master: Removing validations-libs from test-requirements  https://review.opendev.org/c/openstack/validations-common/+/80268010:26
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates stable/train: Do not fail if haproxy container UUID changes  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80246910:34
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates stable/wallaby: Do not fail if haproxy container UUID changes  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80247010:35
opendevreviewyatin proposed openstack/tripleo-quickstart master: Use dnf config-manager in CentOS8 releases  https://review.opendev.org/c/openstack/tripleo-quickstart/+/80268110:39
opendevreviewJiri Podivin proposed openstack/validations-libs master: Unit test refactor  https://review.opendev.org/c/openstack/validations-libs/+/80268210:39
*** jcapitao is now known as jcapitao_lunch10:42
opendevreviewMartin Schuppert proposed openstack/tripleo-heat-templates master: Parameter to set api policy to limit live migration to role  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80202710:54
*** pojadhav|brb is now known as pojadhav11:03
opendevreviewLukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: [FFWD][train-only] Ensure we get ovn_controller cert if needed  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/79884311:35
opendevreviewJuan Badia Payno proposed openstack/tripleo-ansible master: WIP ceph systemd call managed  https://review.opendev.org/c/openstack/tripleo-ansible/+/80268811:44
opendevreviewSorin Sbârnea proposed openstack/ansible-role-collect-logs master: Upgrade ansible-lint/molecule runs  https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/79265211:44
opendevreviewJiri Podivin proposed openstack/tripleo-validations master: Ansible lint custom rule expansion  https://review.opendev.org/c/openstack/tripleo-validations/+/79863611:47
*** rlandy is now known as rlandy|ruck11:52
*** jcapitao_lunch is now known as jcapitao12:19
opendevreviewJiri Podivin proposed openstack/validations-common master: DNM  https://review.opendev.org/c/openstack/validations-common/+/80269312:25
ykarelmarios|ruck, bandini reported https://bugs.launchpad.net/tripleo/+bug/193828312:29
ykareladded the cause for it12:30
ykarelamoralej, fyi ^12:31
*** pojadhav is now known as pojadhav|afk12:31
opendevreviewJiri Podivin proposed openstack/validations-common master: DNM  https://review.opendev.org/c/openstack/validations-common/+/80269412:32
amoralejykarel, so that timeout change is root cause for the issues with pacemaker we have been hitting lastly12:33
ykarelamoralej, yes 20s is much smaller to see such timeout12:33
ykarelin previous bug i see it failed even at 120s in wallaby, but that's rare, in master it's more frequent due to that low setting12:34
ykarelramishra, fyi ^ as caused with https://review.opendev.org/c/openstack/tripleo-heat-templates/+/79141612:37
* ykarel prepares fix12:38
marios|ruckykarel: thank you in call will check in bit12:41
marios|ruckykarel: promotion blocker? 12:42
ykarelmarios|ruck, yes12:42
ykarelpromotion jobs also impacted12:42
ykareladded logs12:43
marios|ruckykarel: ack i see one from the 26th at https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/3a8026d/logs/overcloud-controller-0/var/log/ the others are few days old12:43
ykarelyes happening randomly from few months12:43
opendevreviewyatin proposed openstack/tripleo-heat-templates master: Fix condition for pacemaker resource_op_defaults  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80269612:49
opendevreviewJiri Podivin proposed openstack/validations-common master: Reducing the sensitivity of the coverchange job  https://review.opendev.org/c/openstack/validations-common/+/80269312:53
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-validations master: Moving setting validation from nova_event_callback  https://review.opendev.org/c/openstack/tripleo-validations/+/79486612:57
*** artom_ is now known as artom12:58
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-validations master: Moving setting validation from nova_event_callback  https://review.opendev.org/c/openstack/tripleo-validations/+/79486613:04
opendevreviewJiri Podivin proposed openstack/validations-common master: DNM  https://review.opendev.org/c/openstack/validations-common/+/80269413:09
*** amoralej is now known as amoralej|lunch13:16
opendevreviewShnaidman Sagi (Sergey) proposed openstack/tripleo-ansible master: DNM check ansible 2.11 with tripleo-ansible  https://review.opendev.org/c/openstack/tripleo-ansible/+/80267313:25
opendevreviewJesse Pretorius proposed openstack/tripleo-heat-templates stable/train: Remove libvirt package from overcloud nodes  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80091213:25
opendevreviewJiri Podivin proposed openstack/validations-common master: DNM  https://review.opendev.org/c/openstack/validations-common/+/80269413:26
marios|ruckdvd: o/ hey waiting to hear back from infra but looks like your patch is stuck in the gate we may have to abandon and restore (hold for now please though)13:27
marios|ruckdvd: if there is a better way we'll take it otherwise we will do that in a few mins ^^^ https://zuul.openstack.org/status#800848 that patch 13:27
marios|ruckhttps://review.opendev.org/c/openstack/tripleo-heat-templates/+/800848/ 13:27
* dvd is looking13:28
rlandy|ruckall: ^^ note stuck gate - may require reset13:28
dvdmarios|ruck, I see some progress in the pytest jobs13:29
marios|ruck:( whole bunch of green runs below that will get thrown away if we abandon/restore 13:29
marios|ruckdvd: https://zuul.openstack.org/status#800848 13:29
dvdmarios|ruck, apparentlysomeone unstuck it?13:29
marios|ruckdvd: the tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates is queued 13:29
marios|ruckdvd: it is stuck 13:29
dvdoh wait13:29
dvdyou're right13:30
marios|ruckdvd: the rest of the jobs there are good13:30
marios|ruckdvd: but that one is just sitting there13:30
dvdack let me know if I need to abandon/restore13:30
marios|ruckdvd: ack don't do anythign please13:30
marios|ruckdvd: fungi: is checking for us now13:30
marios|ruckthank you fungi !13:30
fungiyeah, i should be able to let you know momentarily13:31
marios|ruckack anything is worth a try but if we really have to we'll just abandon thank you fungi take your time13:31
marios|ruckthanks rlandy|ruck++ completely missed that ;)13:33
*** amoralej|lunch is now known as amoralej13:38
opendevreviewJiri Podivin proposed openstack/validations-common master: DNM  https://review.opendev.org/c/openstack/validations-common/+/80269413:43
opendevreviewShnaidman Sagi (Sergey) proposed openstack/tripleo-ansible master: Convert all OS module imports to collections imports  https://review.opendev.org/c/openstack/tripleo-ansible/+/80271513:45
fungimarios|ruck: dvd: it's running now13:58
fungirlandy|ruck: ^13:58
dvdfungi, nice thanks13:58
rlandy|ruckfungi++13:58
dvdfungi++13:58
rlandy|ruckthank you!!13:58
rlandy|ruckreally didn't want to rerun the whole gate line13:58
fungino problem, sorry we still haven't found whatever causes nodepool launchers to sometimes squat node request locks indefinitely13:58
marios|ruckfungi: thank you!13:59
fungiany time13:59
marios|ruckfungi++ all the beers :)13:59
marios|ruckfungi: saving a bit of the planet in the process so many jobs would have had to rerun ;)14:00
marios|ruckneed another vote on this please https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/801584 (tested at https://review.opendev.org/c/openstack/tripleo-heat-templates/+/802679 scen4) cc Tengu around? :) 14:01
marios|ruckchandankumar: maybe ? ^ please thank you14:01
opendevreviewJiri Podivin proposed openstack/validations-libs master: Default value of the constructor parameter  https://review.opendev.org/c/openstack/validations-libs/+/79648214:02
marios|ruckthanks chandankumar 14:02
opendevreviewMatthias Runge proposed openstack/tripleo-heat-templates master: Example configurable cap add  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80151114:03
opendevreviewMerged openstack/openstack-tempest-skiplist master: Revert "Skip tempest.scenario.test_object_storage_basic_ops.TestObjectStorageBasicOps"  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/80158414:10
kashyapykarel: Hi, I was told you'll be able to put a machine on hold to debug these failures: https://review.rdoproject.org/r/c/testproject/+/3215714:24
ykarelkashyap, sure adding to autohold14:24
kashyapykarel: Thank you.  So this box a physical machine, or a VM?14:25
ykarelkashyap, vm14:26
ykarelkashyap, added https://softwarefactory-project.io/zuul/api/tenant/rdoproject.org/autohold, so if that job fails it will get held14:27
ykarelyour public key?14:27
kashyapykarel: Hmm; so a level-1 VM (which is running Compute node, and Nova instances are level-2 VMs as nested)14:27
kashyapykarel: Public key: https://paste.centos.org/view/6d1b3df014:28
kashyapykarel: This is also an AMD host, I'm hoping - otherwise it's not useful, afraid.14:29
ykarelkashyap, ssh zuul@zuul@38.102.83.15814:29
ykareli see svm in /proc/cpuinfo14:30
ykarelAMD EPYC 7402 24-Core Processor14:30
kashyapOkay; thanks.  I'll see if I can get anything useful out of it14:31
opendevreviewyatin proposed openstack/tripleo-heat-templates master: Fix condition for pacemaker resource_op_defaults  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80269614:31
kashyapykarel: I got permission denied when I try to SSH14:31
ykarelkashyap, added shared keys in authorized_keys14:34
ykarelcan u try again14:34
* kashyap tries14:34
kashyapykarel: Nope; still no luck14:35
kashyapykarel: That's the last 29 lines of SSH: https://paste.centos.org/view/62a6837a14:36
ykarelkashyap, sorry for typo earlier, try ssh zuul@38.102.83.15814:39
ykarelearlier user was specified twice14:39
kashyapAh, right; I thought it's part of the weird host name 14:40
kashyapykarel: Okay; I'm in14:41
*** ykarel is now known as ykarel|away14:45
opendevreviewRonelle Landy proposed openstack/openstack-tempest-skiplist master: Add back tripleo component tests in skip  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/80273314:52
rlandy|ruckmarios|ruck: ^^ pls vote14:52
rlandy|ruckshould sort out the issues in ci.centos on the next promotion14:52
opendevreviewJulia Kreger proposed openstack/tripleo-common master: Add dnsmasq to ironic-pxe container  https://review.opendev.org/c/openstack/tripleo-common/+/80273614:54
opendevreviewJiri Podivin proposed openstack/validations-libs master: Redundant conditional removal  https://review.opendev.org/c/openstack/validations-libs/+/80273714:55
marios|ruckrlandy|ruck: acv14:57
marios|ruckrlandy|ruck: ack :_14:57
rlandy|rucktestprojecting those tests14:58
opendevreviewchandan kumar proposed openstack/python-tripleoclient master: [DNM] tripleo-ansible-operator changes testing  https://review.opendev.org/c/openstack/python-tripleoclient/+/80273914:58
rlandy|rucklet's see if we can clear the tripleo component lines14:58
marios|ruckthank you rlandy|ruck 14:59
rlandy|ruck:)15:03
ykarel|awayjpodivin, i see u have couple of bugs filed for tempest failures, i commented on all of them as those looks duplicate of https://bugs.launchpad.net/tripleo/+bug/193828315:07
ykarel|awayplease check and if agree can close those as duplicate15:07
jpodivinykarel|away: I'll take a look tomorrow if that is fine with you. I'm about to leave :) 15:08
ykarel|awayjpodivin, sure nothing urgent, just cleanup15:08
kashyapykarel|away: Hi, it doesn't contain a TripleO deployment already15:09
opendevreviewMerged openstack/openstack-tempest-skiplist master: Add back tripleo component tests in skip  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/80273315:09
kashyapykarel|away: How do I get it there?  (Sorry for the questionw when you're about to head out)15:09
kashyaps/questionw/questions/15:09
ykarel|awaykashyap, deployment is in progress https://review.rdoproject.org/zuul/stream/3e70704ca5b94f078dd201929782e5a3?logfile=console.log15:09
kashyapykarel|away: Oh, I see15:10
kashyapykarel|away: How long will it take; and how long can I have the VM for debugging?15:10
ykarel|awaykashyap, can also check logs at tail -f standalone_deploy.log, once deployment finishes tempest will run15:11
kashyapykarel|away: I need to head out now; will check in a bit.  Thanks!15:12
ykarel|awaykashyap, will be there atleast till tomorrow same time, not sure for exact time15:12
kashyapOkay, noted15:12
opendevreviewAlex Schultz proposed openstack/tripleo-ansible master: Action module for bulk host prep  https://review.opendev.org/c/openstack/tripleo-ansible/+/79971215:12
opendevreviewJulia Kreger proposed openstack/tripleo-heat-templates master: Swap xinetd/tftp-server for dnsmasq to support ironic-pxe operations  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80274015:17
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-ansible master: Configure vhost-postcopy-support  https://review.opendev.org/c/openstack/tripleo-ansible/+/80274215:24
rlandy|ruckmwhahaha: back with image upload on OVB ... all releases are passing now except ussuri which is passing the '--local' option and failing: https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-ussuri/942ccd1/logs/undercloud/home/zuul/overcloud_image_upload.log.txt.gz15:28
mwhahahayea i saw that15:28
rlandy|ruckexpect for fs002 https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-ussuri/1fdac31/logs/undercloud/home/zuul/overcloud-image-upload.sh.txt.gz which doesn't pass --local and passes15:29
rlandy|ruckwhat is the correct setting for ussuri?15:29
mwhahahait doesn't appear so15:29
rlandy|ruckdo we need a setting change or is there a bug?15:29
mwhahahaso it looks like ussuri needs to not have --local even though nova is disabled15:29
rlandy|ruckok - if that is correct, I will fix the fs setting accordingly15:29
rlandy|ruckthanks15:29
rlandy|ruckmarios|ruck: ^^ putting in fix for ussuri OVB15:30
marios|ruckrlandy|ruck: thanks ping if need review15:31
*** chem is now known as Guest259815:36
rlandy|rucksshnaidm: is it possible to set a var for an operator from a featureset?15:45
rlandy|ruckhttps://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-prep-images/tasks/overcloud-prep-images.yml#L2415:45
rlandy|ruck^^ want to change that value just for ussuri15:45
rlandy|ruckie: keep undercloud_enable_nova asits value15:46
rlandy|ruckas its15:46
rlandy|ruckand change tripleo_overcloud_image_upload_local only15:46
opendevreviewMerged openstack/tripleo-heat-templates master: tripleo-podman: Enable podman.socket  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80084815:48
opendevreviewMerged openstack/puppet-tripleo stable/wallaby: Do not include client classes  https://review.opendev.org/c/openstack/puppet-tripleo/+/80018615:48
opendevreviewMerged openstack/tripleo-heat-templates master: Use yaml.safe_load to load YAML files  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80185015:48
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: Remove leftover of hieradata cleanup  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80220515:48
opendevreviewMerged openstack/tripleo-heat-templates master: Enable archive task_log records while archiving the database  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80193915:48
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: libvirt: fix formatting of the log_outputs parameter  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/79276415:48
opendevreviewMerged openstack/tripleo-heat-templates master: Nova: Remove unused password parameters  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/79501215:48
opendevreviewMerged openstack/tripleo-ansible stable/train: More descriptive task names  https://review.opendev.org/c/openstack/tripleo-ansible/+/80172915:48
opendevreviewMerged openstack/tripleo-ansible stable/train: Add support for v2 registries.conf  https://review.opendev.org/c/openstack/tripleo-ansible/+/80161515:48
opendevreviewMerged openstack/tripleo-ci master: Adds wallaby upgrades/updates jobs to periodic  https://review.opendev.org/c/openstack/tripleo-ci/+/79677115:48
opendevreviewMerged openstack/tripleo-heat-templates stable/ussuri: Remove all docker related tasks from upgrades  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80221515:48
opendevreviewMerged openstack/tripleo-heat-templates master: [c9] nova_libvirt with host's cgroupns  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80248915:48
sshnaidmrlandy|ruck, yep, I think it works15:49
rlandy|rucktripleo_overcloud_image_upload_local: "{% if release in ['ussuri'] %}false{% else %}{{ not undercloud_enable_nova|default(false) }}{% endif %}"15:49
rlandy|ruckotheriwise ^^15:49
sshnaidmjust {{ release in ['ussuri'] }}15:50
sshnaidmor {{ release not in ['ussuri'] }}15:50
marios|ruckrlandy|ruck: its already set from the featureset https://opendev.org/openstack/tripleo-quickstart/src/commit/c9bc2dd1df3ce7723f1907794beabada9dd04186/config/general_config/featureset039.yml#L1415:50
marios|ruckrlandy|ruck: can just set it there? ^ 15:50
marios|ruckrlandy|ruck: for the relevant featureset (also that should point to line 190 for undercloud_enable_nova https://opendev.org/openstack/tripleo-quickstart/src/commit/c9bc2dd1df3ce7723f1907794beabada9dd04186/config/general_config/featureset039.yml#L190 )15:51
marios|ruckrlandy|ruck: instead of adding convoluted special case into the operator args 15:51
rlandy|ruckI want to separate the condition and the undercloud_enable_nova setting15:51
marios|ruckrlandy|ruck: oh i thought you wanted to make undercloud_enable_nova false generally 15:52
marios|ruckrlandy|ruck: then do it directly in vars if you dont want it to depend on undercloud_enable_nova sorry 15:52
rlandy|ruckper comment above "so it looks like ussuri needs to not have --local even though nova is disabled"15:52
rlandy|ruckfor ussuri the case is diff15:52
sshnaidmrlandy|ruck, then your code above should work15:53
rlandy|rucktripleo_overcloud_image_upload_local: "{% if release in ['ussuri'] %}false{% else %}{{ not undercloud_enable_nova|default(false) }}{% endif %}15:53
rlandy|ruck^^ that one?15:53
marios|ruckyeah 15:53
rlandy|ruckk15:53
rlandy|rucklet's try it15:53
sshnaidmyep15:53
opendevreviewTakashi Kajinami proposed openstack/tripleo-ansible master: Allow customizing reload commands  https://review.opendev.org/c/openstack/tripleo-ansible/+/80121615:55
*** amoralej is now known as amoralej|off15:57
opendevreviewRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add ussuri case for --local in image upload  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80274715:57
opendevreviewJuan Badia Payno proposed openstack/tripleo-ansible master: WIP ceph systemd call managed  https://review.opendev.org/c/openstack/tripleo-ansible/+/80268816:04
opendevreviewSorin Sbârnea proposed openstack/tripleo-repos master: Address setuptools deprecation warnings  https://review.opendev.org/c/openstack/tripleo-repos/+/80275016:08
opendevreviewShnaidman Sagi (Sergey) proposed openstack/tripleo-ansible master: Convert all OS module imports to collections imports  https://review.opendev.org/c/openstack/tripleo-ansible/+/80271516:10
opendevreviewSorin Sbârnea proposed openstack/tripleo-repos master: setup.cfg: Use underscore instead of dash  https://review.opendev.org/c/openstack/tripleo-repos/+/80275016:12
opendevreviewJuan Badia Payno proposed openstack/tripleo-ansible master: WIP ceph systemd call managed  https://review.opendev.org/c/openstack/tripleo-ansible/+/80268816:16
opendevreviewSorin Sbârnea proposed openstack/tripleo-repos master: setup.cfg: Use underscore instead of dash  https://review.opendev.org/c/openstack/tripleo-repos/+/80275016:20
*** rpittau is now known as rpittau|afk16:21
opendevreviewSorin Sbârnea proposed openstack/tripleo-repos master: setup.cfg: Use underscore instead of dash  https://review.opendev.org/c/openstack/tripleo-repos/+/80275016:21
opendevreviewJuan Badia Payno proposed openstack/tripleo-ansible master: WIP ceph systemd call managed  https://review.opendev.org/c/openstack/tripleo-ansible/+/80268816:22
opendevreviewMarios Andreou proposed openstack/tripleo-specs master: Moving TripleO repos to independent release model  https://review.opendev.org/c/openstack/tripleo-specs/+/80151216:37
*** marios|ruck is now known as marios|out16:38
opendevreviewMerged openstack/tripleo-validations stable/train: Corrected the task 'Get file_descriptors total_limit' to get the 'fs.file-max' value.  https://review.opendev.org/c/openstack/tripleo-validations/+/80225016:42
*** pojadhav is now known as pojadhav|out16:57
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-heat-templates master: DNM Enabling vhost-postcopy-support when live_migration_permit_post_copy  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80276016:58
opendevreviewSorin Sbârnea proposed openstack/tripleo-repos master: Enable ansible-test sanity checks (nv)  https://review.opendev.org/c/openstack/tripleo-repos/+/80046217:09
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-heat-templates stable/train: [train-only] Don't auto-enable post-copy in DPDK deployment  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80276417:10
mwhahaharlandy|ruck: so i think our assumptions about ussuri are incorrect, something else is happening17:38
mwhahahahttps://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-ussuri/942ccd1/logs/undercloud/home/zuul/tripleo_overcloud_image_upload.sh.txt.gz 17:38
mwhahahahttps://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-ussuri/1fdac31/logs/undercloud/home/zuul/overcloud-image-upload.sh.txt.gz17:38
mwhahahathey are the same17:38
mwhahahai think something else is happening17:38
mwhahahahttps://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-ussuri/1fdac31/logs/undercloud/home/zuul/tripleo_overcloud_image_upload.sh.txt.gz17:40
mwhahahafs002 upload was fine17:41
opendevreviewMerged openstack/tripleo-ansible stable/victoria: Fix tripleo_backup_and_restore_rear_simulate boolean check  https://review.opendev.org/c/openstack/tripleo-ansible/+/80234117:42
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-heat-templates master: DNM Enabling vhost-postcopy-support when live_migration_permit_post_copy  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80276017:42
* rlandy|ruck looks17:43
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-heat-templates master: DNM Enabling vhost-postcopy-support when live_migration_permit_post_copy  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80276017:43
mwhahaharlandy|ruck: i don't know where those jobs came from so i went back to look at the ipa job test and it seemed that  they are different17:44
mwhahahahttps://logserver.rdoproject.org/95/24995/71/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-ussuri/41f09b3/logs/undercloud/home/zuul/overcloud-image-upload.sh.txt.gz17:44
mwhahahahttps://logserver.rdoproject.org/95/24995/71/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-ussuri/41f09b3/logs/undercloud/home/zuul/tripleo_overcloud_image_upload.sh.txt.gz17:44
mwhahahaenable_nova is false17:45
mwhahahado we not set the undercloud_enable_nova to false in ussuri configs?17:45
mwhahahahttps://logserver.rdoproject.org/95/24995/71/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-ussuri/41f09b3/logs/undercloud/home/zuul/undercloud.conf.txt.gz17:45
rlandy|ruckconfirming line failure failure first - then the test job ...17:46
rlandy|ruckhttps://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-ussuri/942ccd1/logs/undercloud/home/zuul/overcloud-image-upload.sh.txt.gz17:47
rlandy|ruck^^ what I see in  the last fs035 ussuri logs17:47
rlandy|ruckand in fs00217:47
mwhahaharight so comparing the two files in the same job, the t-o-a version doesn't have --local https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-ussuri/942ccd1/logs/undercloud/home/zuul/tripleo_overcloud_image_upload.sh.txt.gz17:47
mwhahahawhich is why it fails17:48
mwhahahabut that seems weird because it should have true if undercloud_enable_nova is set to false17:48
mwhahahahttps://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-ussuri/942ccd1/logs/undercloud/home/zuul/undercloud.conf.txt.gz17:48
mwhahahaenable_nova = false17:48
mwhahahaso it feels like that's coming from something else in ussuri17:48
rlandy|ruckfs002 does not have the local setting17:49
rlandy|ruckso the difference I was looking at is in the featureset17:49
mwhahaharight but in fs002, the two upload scripts are teh same17:50
rlandy|ruckhttps://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset035.yml#L19617:50
rlandy|ruckwhich has a undercloud_enable_nova: >- setting 17:50
rlandy|ruckbut fs002 does not17:50
mwhahaharight so fs002 is using nova (the default in U)17:51
mwhahahaand fs035 is using metalsmith17:51
rlandy|ruckcorrect17:51
rlandy|ruckso we're inconsistent17:51
mwhahahabut for some reason the logic you have in quickstart is not being picked up correctly17:51
rlandy|ruck(how unsual)17:51
mwhahahait's fine that they test different things17:51
mwhahahathe issue seems to be why does the logic fail for fs03517:51
mwhahahabut i looked at the failres from yesterday for https://review.rdoproject.org/r/c/testproject/+/2499517:52
mwhahahaand fs001 is also inconsistent in terms of the image upload bits17:52
rlandy|ruckhttps://review.rdoproject.org/zuul/stream/0acd6bc8e6554459a0719145c62dc9b1?logfile=console.log running in the testproject now reaches overcloud deploy17:53
* rlandy|ruck files bug so we can track this17:54
rlandy|ruckhttps://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/802747/1/roles/overcloud-prep-images/tasks/overcloud-prep-images.yml#24 is a bad hack17:54
mwhahahayea that's wrong17:55
mwhahahado we have the ansible vars dumpped somewhere in the log output?17:55
rlandy|ruckyeah17:55
mwhahahai'm looking at https://logserver.rdoproject.org/95/24995/71/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-ussuri/41f09b3/logs/17:56
mwhahaharole-vars.yaml is empty17:56
rlandy|ruckcheck var to see if have something there17:57
mwhahaha        undercloud_enable_nova: 'false'17:57
mwhahahait's a string17:57
mwhahahayou need to |bool|default17:57
mwhahahai think?17:57
rlandy|ruckhttps://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset002-ussuri/7c677c9/logs/undercloud/var/log/extra/dump_variables_vars.yaml.txt.gz17:58
rlandy|ruckgeneral vars if that helps17:58
mwhahahai think the issue is we need to |bool it17:58
rlandy|ruckcan try - funny it works on other releases17:58
rlandy|rucktrying new patch with |bool17:59
rlandy|ruckwill see if that addresses the problem17:59
rlandy|rucksec - just resetting 1718:01
mwhahahayea sure18:01
mwhahahai'm testing some stuff18:01
mwhahahaeh that should be fine18:01
mwhahahawtf18:01
opendevreviewMerged openstack/tripleo-ansible stable/ussuri: Fix tripleo_backup_and_restore_rear_simulate boolean check  https://review.opendev.org/c/openstack/tripleo-ansible/+/80234218:03
rlandy|ruckk - back18:04
rlandy|ruckso where are we are now?18:04
rlandy|ruck|bool not needed18:04
mwhahahayea shouldn't be needed18:04
mwhahahai wonder if it's a vars precidence thing18:08
mwhahahabecause undercloud_enable_nova is defined in extras-common/defaults.yml18:08
mwhahahaand set to true for ussuri18:08
mwhahahawhich would account for this18:08
* mwhahaha doesn't like that role18:09
rlandy|ruckhmmm ... defaults should have lower priority18:09
mwhahahashould (tm)18:09
opendevreviewAlex Schultz proposed openstack/tripleo-quickstart-extras master: DNM: debug undercloud_enable_nova  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80276718:11
rlandy|ruckthe setting takes  - just that  --local fails in ussuri18:11
mwhahahano it shouldn't18:11
mwhahahait should work18:11
mwhahahaper https://logserver.rdoproject.org/95/24995/71/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-ussuri/41f09b3/logs/undercloud/home/zuul/overcloud-image-upload.sh.txt.gz18:11
mwhahahait's what used to be there18:11
mwhahahait's failing because it's *not* passing --local but enable_nova is false18:11
rlandy|ruckalright ... let's rekick the test project with https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80276718:13
rlandy|ruckand see what value we are looking at18:14
mwhahahayea sec18:14
mwhahahahttps://review.rdoproject.org/r/c/testproject/+/3472518:14
rlandy|ruckok18:14
opendevreviewMerged openstack/tripleo-ansible stable/victoria: Use serial or parallel execution depending on the kind of backup  https://review.opendev.org/c/openstack/tripleo-ansible/+/80221718:30
opendevreviewMerged openstack/tripleo-ansible stable/ussuri: Use serial or parallel execution depending on the kind of backup  https://review.opendev.org/c/openstack/tripleo-ansible/+/80233818:31
opendevreviewBrent Eagles proposed openstack/tripleo-heat-templates master: Add a role to run independent designate bind backends  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80162018:42
mwhahaharlandy|ruck: ok so i confirmed that undercloud_enable_nova is false19:13
rlandy|ruckk - I abandoned the previous change19:15
* mwhahaha is thoroughly confused19:16
mwhahahait's the setting of tripleo_overcloud_image_upload_local19:17
mwhahahait's because it's a string19:18
mwhahahahttps://paste.opendev.org/show/807776/19:19
mwhahahaerrr https://paste.opendev.org/show/807777/19:19
mwhahahathe usage of > is dangerous19:20
mwhahahabecause it converts it to a string19:20
* mwhahaha patches19:21
opendevreviewAlex Schultz proposed openstack/tripleo-quickstart-extras master: Add bool to image upload vars  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80276719:24
mwhahaharlandy|ruck: -^19:24
opendevreviewAlex Schultz proposed openstack/tripleo-quickstart-extras master: Add bool to image upload vars  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80276719:25
rlandy|ruckk - thanks for digging through that19:25
mwhahahawho needs strong typing19:25
* mwhahaha flips tables19:25
mwhahahaTHANKS YAML19:25
rlandy|ruckwatching testproject19:33
rlandy|ruckthis is fun19:33
mwhahahalike watching paint dry19:33
rlandy|ruckthree zuuls, paint dry on multiple walls19:35
opendevreviewJuan Pablo Lopez proposed openstack/python-tripleoclient master: [WIP] Integrating restoration process to client  https://review.opendev.org/c/openstack/python-tripleoclient/+/80186120:21
opendevreviewJuan Pablo Lopez proposed openstack/tripleo-ansible master: Adding playbook to perform the restoration of a controller node using Ironic/PXE  https://review.opendev.org/c/openstack/tripleo-ansible/+/79951220:22
mwhahahaso looks like ussuri fs001 got past the image upload20:36
mwhahahaso promissing20:36
mwhahahatrain too20:36
mwhahahaso i think that fixes it20:36
rlandy|rucknice - looking good so far20:41
opendevreviewJuan Pablo Lopez proposed openstack/tripleo-ansible master: Add backup and restore mode for ReaR configuration  https://review.opendev.org/c/openstack/tripleo-ansible/+/79703520:46
opendevreviewSteve Baker proposed openstack/tripleo-ansible stable/wallaby: Copy generated /boot/grub2/grubenv to EFI dirs  https://review.opendev.org/c/openstack/tripleo-ansible/+/80280420:51
opendevreviewSteve Baker proposed openstack/tripleo-ansible stable/victoria: Copy generated /boot/grub2/grubenv to EFI dirs  https://review.opendev.org/c/openstack/tripleo-ansible/+/80280520:52
opendevreviewSteve Baker proposed openstack/tripleo-ansible stable/ussuri: Copy generated /boot/grub2/grubenv to EFI dirs  https://review.opendev.org/c/openstack/tripleo-ansible/+/80280620:53
opendevreviewSteve Baker proposed openstack/tripleo-ansible stable/train: Copy generated /boot/grub2/grubenv to EFI dirs  https://review.opendev.org/c/openstack/tripleo-ansible/+/80280820:55
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations master: Remove run-validations.sh script  https://review.opendev.org/c/openstack/tripleo-validations/+/78176120:59
opendevreviewSteve Baker proposed openstack/tripleo-quickstart-extras master: WIP Mount whole-disk lvm volumes in modify-image  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80192722:06
rlandy|ruckstevebaker: hi - how's it going with ^^?22:10
stevebakerrlandy|ruck: I've been trying to solve the mystery of why the lvm loopback devices don't get created when kpartx is called. Based on local centos8 testing I think it is because lvm2 isn't installed22:11
rlandy|ruckjust fyi ... https://images.rdoproject.org/centos8/master/rdo_trunk/current-tripleo/22:12
rlandy|ruckwe've promoted master building the new image22:13
rlandy|ruckso you can use current-tripleo (regular check) for your testing22:13
stevebakeryeah I noticed that :D which means this should start passing when the kpartx thing is solved https://review.opendev.org/c/openstack/tripleo-quickstart/+/80140922:13
rlandy|ruckok ...22:14
rlandy|ruckfeel free to leave me email if you want help from CI and we're off hours22:15
stevebakerrlandy|ruck: much appreciated, will do22:15
stevebakerrlandy|ruck: if installing lvm2 works we should probably get that into the image, I have no idea where that would happen. Some RDO nodepool build thing?22:16
rlandy|ruckyes if you need lvm2 on the undercloud22:17
rlandy|ruckRDO nodepool images are built by the rdo infra team 22:18
rlandy|ruckupstream images are much harder to change22:18
stevebakeroh if this is an undercloud then lvm2 could just be added to python-tripleoclient22:18
rlandy|rucksometimes it is :)22:20
rlandy|ruckOVB yes22:20
rlandy|ruckreal baremetal not22:20
stevebakerhmm22:20
rlandy|ruckcan we install it with undercloud_rpm_dependencies?22:23
rlandy|ruckper https://github.com/openstack/tripleo-quickstart/search?q=undercloud_rpm_dependencies22:23
rlandy|ruckwhere we install python-tripleoclient22:23
rlandy|ruckor adding it is fine22:23
rlandy|ruckbetter than relying on the node config22:23
stevebakerundercloud_rpm_dependencies might be best22:24
opendevreviewJulia Kreger proposed openstack/tripleo-heat-templates master: Swap xinetd/tftp-server for dnsmasq to support ironic-pxe operations  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80274022:25
stevebakeractually if its python-tripleoclient then end-users who customize images will have a easier time22:27
rlandy|ruckk - either way22:29
mwhahahafeels like it should be on tripleo-image-elements22:29
mwhahahacause i don't think it's specific to tripleoclient22:29
mwhahahaand we tried to make much of the DIB bits not a hard requirement22:29
mwhahahahttps://review.rdoproject.org/r/c/openstack/tripleoclient-distgit/+/3126122:30
mwhahahahttps://opendev.org/openstack/python-tripleoclient/src/branch/master/tripleoclient/v1/overcloud_image.py#L47-L5322:32
mwhahahaor there22:32
stevebakermwhahaha: on the other hand, downloading a overcloud-hardened-uefi-full.qcow2 and making a minor change is a different use-case than building a whole image22:34
mwhahahawhich we don't support?22:35
mwhahahado you mean via virt-customize?22:35
stevebakerlol good point22:35
mwhahahait should be build or virt-customize or bust22:35
mwhahahaanything beyond that means a bad time22:35
stevebakerthis particular case is running kpartx then mounting all the loopback devices https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/801927/6/roles/modify-image/tasks/manual.yml22:36
mwhahahapffft quickstart22:36
mwhahahaquickstart has always done questionable things to our images22:36
mwhahahathat stuff should likely be virt-customize instead of mounting and doing terrible things in the image22:37
stevebakertesting virt-customize with overcloud-hardened-uefi-full.qcow2 is on my list of things to do22:43
mwhahahathat's what we tell 3rd parties to do (not that they do, but it's what we document)22:44
stevebakermwhahaha: another wrinkle, infrared are aparently moving away from virt-customize to some different tool but I have again forgotton what its called. jparoly was looking at that22:53
mwhahahaPerhaps they should use what we document and not pick random tools22:54
mwhahahaThough to be honey we shouldn't be virt customizing anything22:55
mwhahahaStupid autocorrect, s/honey/honest22:55
mwhahahaProbably should evaluate why we're doing itin the first place22:56
stevebakeryep22:58
stevebakermwhahaha: the modify-image role used virt-customize until ~4 years ago, the commit message from sshnaidm suggests it was due to slowness https://opendev.org/openstack/tripleo-quickstart-extras/commit/c2dc459ac27fb9047adee7e8497fc33e288ab63223:06
*** pmannidi|AFK is now known as pmannidi23:08
opendevreviewMerged openstack/tripleo-heat-templates stable/train: Role parameter for tripleo_kernel_defer_reboot  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80189723:38
opendevreviewSteve Baker proposed openstack/tripleo-quickstart-extras master: WIP Mount whole-disk lvm volumes in modify-image  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80192723:40
opendevreviewMerged openstack/tripleo-ansible stable/train: Use serial or parallel execution depending on the kind of backup  https://review.opendev.org/c/openstack/tripleo-ansible/+/80233923:43

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!