Tuesday, 2021-10-05

opendevreviewMerged openstack/tripleo-quickstart-extras master: Revert "Don't run ephemeral heat for non enabled scenarios"  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81015700:05
opendevreviewMerged openstack/tripleo-common master: Allow for OCI manifests  https://review.opendev.org/c/openstack/tripleo-common/+/81031200:05
opendevreviewMerged openstack/puppet-tripleo master: Add ability to noop a service  https://review.opendev.org/c/openstack/puppet-tripleo/+/81233800:05
opendevreviewDouglas Viroel proposed openstack/tripleo-quickstart master: Replace generic repo setup with yum_config module  https://review.opendev.org/c/openstack/tripleo-quickstart/+/80840800:14
*** dviroel is now known as dviroel|out00:15
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-validations master: [oslo-config-validator] invalidating configs only when necessary  https://review.opendev.org/c/openstack/tripleo-validations/+/81049100:24
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-validations master: oslo-config-validator: invalidating configs only when necessary  https://review.opendev.org/c/openstack/tripleo-validations/+/81049100:25
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-validations master: oslo-config-validator: invalidating configs only when necessary  https://review.opendev.org/c/openstack/tripleo-validations/+/81049100:25
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo stable/wallaby: haproxy: Use healthcheck middleware to monitor service availability  https://review.opendev.org/c/openstack/puppet-tripleo/+/81017900:35
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo stable/wallaby: haproxy: Use healthcheck API for Ironic and Octavia  https://review.opendev.org/c/openstack/puppet-tripleo/+/81018000:35
opendevreviewSteve Baker proposed openstack/python-tripleoclient stable/wallaby: Add --boot-mode to import and configure  https://review.opendev.org/c/openstack/python-tripleoclient/+/81153900:35
opendevreviewSteve Baker proposed openstack/python-tripleoclient stable/wallaby: Always run growvols playbook after provision  https://review.opendev.org/c/openstack/python-tripleoclient/+/81227000:43
stevebaker rlandy|ruck|bbl: thanks, right now I need a simple way in quickstart of figuring out if the overcloud will deploy swift00:44
bshepharstevebaker: It defaults to false in Wallaby unless it's being specifically enabled by oooq somewhere. So if version is < wallaby, it's enabled00:53
stevebakerbshephar: this is on master, and it is needed for tempest tests on fs 001, 020, 035 https://review.rdoproject.org/r/c/testproject/+/3577700:54
bshepharchecking00:56
bshepharOhh overcloud deploying swift. Right. My bad, I misread your comment00:59
bshepharbshephar~~00:59
stevebakerI *think* overcloud swift will be deployed by default unless composable_scenario is set to a tht/ci/environments/scenario* file which switches it off01:03
bshepharYeah, overcloud swift should still be deployed by default I believe01:03
bshepharYeah, looks like it's still there by default. So I guess oooq disables it somewhere. hm01:04
stevebakerit looks like the only way to know if it is off is to test composable_scenario for scenario numbers known to switch it off01:05
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-validations master: oslo-config-validator: invalidating configs only when necessary  https://review.opendev.org/c/openstack/tripleo-validations/+/81049101:05
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-validations master: oslo-config-validator: invalidating configs only when necessary  https://review.opendev.org/c/openstack/tripleo-validations/+/81049101:05
stevebakerThis suggests we should just grow /srv to 50% of available disk always in quickstart, because knowning when to do it is impractical. 01:08
opendevreviewSteve Baker proposed openstack/tripleo-quickstart-extras master: Use tripleo-mount-image for modify-image  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80628401:32
opendevreviewSteve Baker proposed openstack/tripleo-quickstart-extras master: In modify-image don't convert qcow2<->raw  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80948701:32
opendevreviewSteve Baker proposed openstack/tripleo-quickstart-extras master: Support setting growvols_args in topology_map  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81241401:32
*** rlandy|ruck|bbl is now known as rlandy|ruck01:33
rlandy|ruckstevebaker: hi ... looks like you have the answer and patches in01:34
rlandy|rucksorry missed above01:34
stevebakerrlandy|ruck: hey, my plan is this change, and now I'm going to modify tripleo-quickstart/config/nodes/* to add custom growvols_args to some roles https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81241401:35
rlandy|ruckstevebaker: k - can add that to the testproject and rerun01:36
stevebakerrlandy|ruck: I'll also add a depends-on to https://review.opendev.org/c/openstack/tripleo-quickstart/+/80140901:37
rlandy|ruckok - then I'll rekick the testproject01:38
* rlandy|ruck out - will check tomorrow01:43
opendevreviewSteve Baker proposed openstack/tripleo-quickstart master: Switch to whole disk image on all master jobs  https://review.opendev.org/c/openstack/tripleo-quickstart/+/80140901:47
opendevreviewSteve Baker proposed openstack/tripleo-quickstart master: Set growvols_args for all Controller roles  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81241601:47
stevebakeralright, lets see how that goes01:49
opendevreviewTakashi Kajinami proposed openstack/tripleo-common master: Remove unused constants  https://review.opendev.org/c/openstack/tripleo-common/+/81241802:00
opendevreviewTakashi Kajinami proposed openstack/tripleo-common master: Remove unused constants  https://review.opendev.org/c/openstack/tripleo-common/+/81241802:07
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-validations master: oslo-config-validator: invalidating configs only when necessary  https://review.opendev.org/c/openstack/tripleo-validations/+/81049102:33
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-validations master: oslo-config-validator: Removing merged patches  https://review.opendev.org/c/openstack/tripleo-validations/+/81242202:39
opendevreviewRabi Mishra proposed openstack/tripleo-quickstart master: Provision networks before overcloud deploy  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81242303:15
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-validations master: oslo-config-validator: container plugin is replaced with collections  https://review.opendev.org/c/openstack/tripleo-validations/+/80419304:06
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-validations master: oslo-config-validator: container plugin is replaced with collections  https://review.opendev.org/c/openstack/tripleo-validations/+/80419304:11
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-common master: [c9] replacing genisoimage with xorriso  https://review.opendev.org/c/openstack/tripleo-common/+/80923304:19
opendevreviewTakashi Kajinami proposed openstack/tripleo-common master: Remove unused constants  https://review.opendev.org/c/openstack/tripleo-common/+/81241804:47
stevebakerlooking at this log output I can't tell which ansible task failed or why :/ https://review.rdoproject.org/zuul/build/a7f08ab05ed148c8b712580552e0f265/log/logs/undercloud/home/zuul/overcloud_node_provision.log.txt.gz05:01
opendevreviewMichele Baldessari proposed openstack/puppet-tripleo stable/wallaby: Add ability to noop a service  https://review.opendev.org/c/openstack/puppet-tripleo/+/81238905:01
stevebakerah, its more obvious in the raw output https://logserver.rdoproject.org/16/812416/1/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/a7f08ab/logs/undercloud/home/zuul/overcloud_node_provision.log.txt.gz05:02
bshepharstevebaker: I hate reading them there. I normally curl them and read it locally.05:04
bshepharAnd the \n's in the Ansible output make it difficult as well05:04
bshepharBetter when they're local so that I can hit them with some :%s/\\n/\r/g05:04
stevebakerwhat I really want is an ansible log formatter which never ever logs structured data as a single line json05:05
bshephartrue05:05
opendevreviewSteve Baker proposed openstack/tripleo-quickstart-extras master: Support setting growvols_args in topology_map  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81241405:10
opendevreviewSteve Baker proposed openstack/tripleo-quickstart-extras master: Use tripleo-mount-image for modify-image  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80628405:10
opendevreviewSteve Baker proposed openstack/tripleo-quickstart-extras master: In modify-image don't convert qcow2<->raw  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80948705:10
*** ykarel|away is now known as ykarel05:18
opendevreviewSteve Baker proposed openstack/tripleo-quickstart-extras master: Support setting growvols_args in topology_map  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81241405:18
opendevreviewSteve Baker proposed openstack/tripleo-quickstart-extras master: Use tripleo-mount-image for modify-image  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80628405:19
opendevreviewSteve Baker proposed openstack/tripleo-quickstart-extras master: In modify-image don't convert qcow2<->raw  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80948705:19
opendevreviewVijayalakshmi proposed openstack/os-net-config stable/victoria: Update sriov config service to handle nic partitioned PF  https://review.opendev.org/c/openstack/os-net-config/+/81235905:34
opendevreviewVijayalakshmi proposed openstack/os-net-config stable/victoria: Update sriov config service to handle nic partitioned PF  https://review.opendev.org/c/openstack/os-net-config/+/81235905:36
*** ysandeep|out is now known as ysandeep05:37
opendevreviewMerged openstack/openstack-tempest-skiplist master: Revert "Skip neutron_tempest_plugin.scenario.test_trunk.TrunkTest test"  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/81231605:51
opendevreviewCedric Jeanneret proposed openstack/puppet-tripleo stable/wallaby: Add a new bind-mount for vTPM logs  https://review.opendev.org/c/openstack/puppet-tripleo/+/81243006:06
opendevreviewSandeep Yadav proposed openstack/tripleo-heat-templates master: [WIP] Test custom network name  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81236906:36
opendevreviewSandeep Yadav proposed openstack/tripleo-quickstart master: [wip] New featureset for custom network  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81242806:54
opendevreviewJuan Larriba proposed openstack/tripleo-ansible stable/wallaby: Make Galera desync operation more resilient  https://review.opendev.org/c/openstack/tripleo-ansible/+/81232407:21
opendevreviewJuan Larriba proposed openstack/tripleo-ansible stable/victoria: Make Galera desync operation more resilient  https://review.opendev.org/c/openstack/tripleo-ansible/+/81232507:22
opendevreviewJuan Larriba proposed openstack/tripleo-ansible stable/ussuri: Make Galera desync operation more resilient  https://review.opendev.org/c/openstack/tripleo-ansible/+/81232607:23
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: Fix libvirt/qemu logs location  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81220807:25
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: Drop archive policy from enable-legacy-telemetry  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81219707:25
opendevreviewyatin proposed openstack/diskimage-builder master: Drop lower version requirement for networkx  https://review.opendev.org/c/openstack/diskimage-builder/+/81245307:26
ykarelbhagyashris|rover, let's see how ^ goes07:27
ykarelseems should work and would not need workarounds07:27
bhagyashris|roverykarel, ack07:27
*** amoralej|off is now known as amoralej07:27
*** jpena|off is now known as jpena07:33
opendevreviewMerged openstack/tripleo-ansible stable/train: Automate the /var/lib/ceph backup during recovery phase  https://review.opendev.org/c/openstack/tripleo-ansible/+/81220707:41
opendevreviewAnanya proposed openstack/tripleo-ci-health-queries master: Updating conflict dependencies  https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/81234107:57
*** ykarel is now known as ykarel|lunch08:18
opendevreviewMichele Baldessari proposed openstack/puppet-tripleo master: DNM/DNR WIP rabbitmq tls tests  https://review.opendev.org/c/openstack/puppet-tripleo/+/81240108:31
opendevreviewmbu proposed openstack/validations-libs master: Expose skip list mechanism via the CLI  https://review.opendev.org/c/openstack/validations-libs/+/80928908:38
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo master: haproxy: Add missing defualt_backend options  https://review.opendev.org/c/openstack/puppet-tripleo/+/81245708:55
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo master: DNM: Trigger the job with redis enabled  https://review.opendev.org/c/openstack/puppet-tripleo/+/81245808:55
tkajinambandini, dciabrin ^^^ fyi08:56
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo master: haproxy: Add missing defualt_backend option  https://review.opendev.org/c/openstack/puppet-tripleo/+/81245708:56
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo master: DNM: Trigger the job with redis enabled  https://review.opendev.org/c/openstack/puppet-tripleo/+/81245808:56
opendevreviewSandeep Yadav proposed openstack/tripleo-quickstart master: [wip] New featureset for custom network  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81242808:57
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo master: haproxy: Add missing default_backend option  https://review.opendev.org/c/openstack/puppet-tripleo/+/81245708:58
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo master: DNM: Trigger the job with redis enabled  https://review.opendev.org/c/openstack/puppet-tripleo/+/81245808:58
*** ysandeep is now known as ysandeep|lunch09:00
opendevreviewFrancesco Pantano proposed openstack/tripleo-heat-templates master: DNM - Test Pending Ceph Pacific daemons in CI  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/77891509:03
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Testing bug 1946045  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81246109:04
opendevreviewMatthias Runge proposed openstack/tripleo-heat-templates stable/victoria: Drop archive policy from enable-legacy-telemetry  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81243609:05
opendevreviewTakashi Kajinami proposed openstack/tripleo-ci master: puppet-tripleo: Trigger sc001/002 for changes related to Redis  https://review.opendev.org/c/openstack/tripleo-ci/+/81246209:07
opendevreviewTakashi Kajinami proposed openstack/tripleo-ci master: puppet-tripleo: Run sc001/002 for changes in redis manifests  https://review.opendev.org/c/openstack/tripleo-ci/+/81246209:09
Tenguhjensas: hello there! would you have some time this afternoon for some pairing about those custom network names? I'm close to a success, but there's apparently a "wrong" conversion happening at some point, preventing the actual success to happen.09:44
Tenguhjensas: http://anonypaste.com/6ff4d7  that's the new error - and, indeed, fqdn_storagecloud0 doesn't exist - it's actually fqdn_storage_cloud_0 (and same goes for the others). probably a diff due to the name_lower vs name.lower()09:46
Tengusince my network-data exposes a custom name, custom name_lower, custom subnet name, and has a custom role-data that's supposed to link things together... With some success, according to what I'm seeing in freeIPA and generated templates.09:47
Tenguysandeep|lunch: -^^  fyi09:47
*** ysandeep|lunch is now known as ysandeep09:48
Tenguhjensas: I keep my env as-is, so that everything is "as generated".09:48
ysandeepTengu: ack, thanks for keeping me in loop. 09:52
Tenguysandeep: updated https://bugs.launchpad.net/tripleo/+bug/1886915 as well09:54
Tenguwe're close, really.09:54
Tenguwell. I'm close. :)09:54
* ysandeep still at basic deploy, will move to ipa once basic deploy is success.09:55
Tenguysandeep: basic shouldn't hit many issues imho09:55
Tenguat least.... I didn't hit anything with what might be a wrong customization.09:56
Tengufood.09:56
* ysandeep agrees, following incremental approach to not miss any issues.09:58
hjensasTengu: I think I'm completely off with my patch. It fails the same way in CI I think - 'fqdn_internalapi' is undefined".10:15
opendevreviewVijayalakshmi proposed openstack/os-net-config stable/ussuri: sriov_config: light refactoring  https://review.opendev.org/c/openstack/os-net-config/+/81247410:22
opendevreviewVijayalakshmi proposed openstack/os-net-config stable/ussuri: Update sriov config service to handle nic partitioned PF  https://review.opendev.org/c/openstack/os-net-config/+/81247510:22
*** ykarel|lunch is now known as ykarel10:24
*** rlandy is now known as rlandy|ruck10:24
hjensasTengu: ... I will update the patch.10:25
opendevreviewMerged openstack/tripleo-common master: Remove tftp-server package from ironic-pxe container  https://review.opendev.org/c/openstack/tripleo-common/+/81198710:32
opendevreviewMerged openstack/tripleo-operator-ansible master: Drop minion job  https://review.opendev.org/c/openstack/tripleo-operator-ansible/+/81199310:32
rlandy|ruckramishra: hi ... just following up on the ci.centos error mentioned yesterday10:44
Tenguhjensas: if you want to jump on my env, let me know10:47
Tenguhjensas: we'd "just" need to re-provision the networks afaik10:47
opendevreviewMichele Baldessari proposed openstack/puppet-tripleo master: WIP Fix haproxy default_backend in redis and rabbitmq  https://review.opendev.org/c/openstack/puppet-tripleo/+/81247710:47
opendevreviewHarald Jensås proposed openstack/tripleo-heat-templates master: WIP - Use "network.name" in ApacheNetworks  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81228610:49
opendevreviewMerged openstack/tripleo-ci-health-queries master: Updating conflict dependencies  https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/81234110:49
hjensasTengu: can you try ^^ I'm happy to log in to your env and follow.10:50
Tenguhjensas: lemme check if I already deployed your ssh key (I think so)10:50
ysandeeprlandy|ruck: ramishra proposed a fix https://review.opendev.org/c/openstack/tripleo-quickstart/+/812423 , we passed the original error but hitting something new.. may be unrelated and a new issue.. I have posted details on patch.10:50
rlandy|ruckysandeep: thanks - created a LP bug - will reference it10:51
ysandeephjensas, Tengu the ci job failed: https://logserver.rdoproject.org/54/31954/11/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset064-master/02aef1a/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz , to me looks like failed because of missing custom role_data.yaml11:01
Tenguysandeep: more than probably yeah.11:01
Tenguysandeep: at least, custom topology is needed11:02
Tenguthat's what hjensas linked in one of his previous comments11:02
Tenguysandeep: https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/nodes/3ctlr_1comp.yml#L43-L5511:03
Tenguhjensas: heh, seems to work better now!11:03
ysandeepyes, topology feeds overcloud_baremetal_deploy.yaml, I already override that in featureset file after hjensas comment..  https://logserver.rdoproject.org/54/31954/11/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset064-master/02aef1a/logs/undercloud/home/zuul/overcloud_baremetal_deploy.yaml.txt.gz11:03
Tenguerf.... or not.11:04
Tenguaha! that's yet another step forward apparently.11:05
Tengumight be due to the half-failed deploy that happened before.11:06
Tengulemme clean things.11:07
Tenguah........ yeah. so. indeed. there's a regression: cleanup doesn't work anymore.11:07
*** jcapitao is now known as jcapitao_lunch11:14
Tenguhjensas: lemme trash the env and start on a new, cleaned thing....11:15
hjensasTengu: ok. Are you still using service_net_map_replace? Or are you setting ServiceNetMap?11:16
Tenguhjensas: I dropped that service_net_map_replace, it's creating issues with the freeIPA records: everything is missing11:16
*** rlandy|ruck is now known as rlandy|dr_appt11:16
Tenguhjensas: I've attached the generated network-data + role-data files to the LP11:16
Tenguit SHOULD be sufficient. though I'm more than probably missing a piece (that last bit preventing everything to work without error)11:17
Tenguhjensas: deploy restarted - it will take ~40 minutes to get things back to OC deploy.11:17
hjensasTengu: without service_net_map_replace, you need to map all services to your custom networks in ServiceNetMap, if not services will all be bound to 'ctlplane'11:18
Tenguhjensas: you should be able to connect back in about... 5 minutes?11:18
Tenguhjensas: isn't that mapping done in the role-data?11:18
Tenguhjensas: https://launchpadlibrarian.net/562084747/oc0-role-data.yaml11:18
Tenguor is there yet another thing to map?11:19
opendevreviewSandeep Yadav proposed openstack/tripleo-heat-templates master: [WIP] Test custom network name  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81236911:19
Tenguas said: using the service_net_map_replace prevents getting all the services created in freeipa. This was my first issue. Dropping it allows to get the services in, but it fails later (your patch allows to go forward)11:20
hjensasTengu: no, Service-to-Network is mapped in ServiceNetMap and VipSubnetMap heat params.11:20
hjensashttps://opendev.org/openstack/tripleo-heat-templates/src/branch/master/overcloud-resource-registry-puppet.j2.yaml#L369-L45611:20
Tenguhmmm.11:20
hjensasTengu: I think we need to fix that first issue as well. :-/11:20
Tenguok. so I'm missing yet another environment file.11:20
Tenguhjensas: want me to re-add the service_net_map_replace to my env?11:20
hjensasTengu: yes11:21
Tenguok11:21
Tengudone. it will be present once we hit the network provisionning and subsequent OC deploy.11:21
Tenguand we'll be able to confirm every single services are missing - we ONLY have the ctlplane ones.11:21
Tenguwhich is.... well. annoying :)11:21
Tenguhjensas: it's deploying freeIPA - it takes a moment.11:21
hjensasTengu: /me hopes it is already fixed.11:22
opendevreviewRabi Mishra proposed openstack/tripleo-quickstart master: Provision networks before overcloud deploy  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81242311:23
Tenguwell..... I already deployed today with your second patch iteration (the one adding .lower()) and it failed with missing services :)11:23
Tenguwe'll see.11:23
opendevreviewVijayalakshmi proposed openstack/os-net-config stable/train: Updating sriov_config.service to run before driverctl.slice and network-pre  https://review.opendev.org/c/openstack/os-net-config/+/81178011:24
Tenguyeah, freeipa service is being deployed. then UC will be configured.11:24
Tenguautomation at its finest, I can have a cup of tea :)11:24
*** jpena is now known as jpena|lunch11:24
hjensasramishra: Hey, there is a discussion in rhos-dev downstream, subject: "--skip-nodes-and-networks default". When you have time, take a look? I think you may want to share your opinion.11:25
hjensasTengu: I have an electrician here, he may need to pull the fuse where my router is connected ... If I dissaper you know why.11:29
ramishrahjensas: Hey! yeah seen that. I agree that we should make it optional (with --baremetal-deploy option) with overcloud deploy. Probably same for network provision...11:29
*** amoralej is now known as amoralej|lunch11:30
opendevreviewPranali Deore proposed openstack/tripleo-heat-templates master: Allow configuring secure RBAC in glance  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/78362311:32
Tenguhjensas: np - UC is starting to be configured, it's installing base packages, then it will build the patched tripleo-heat-template, install it, push configs, and deploy UC11:35
Tenguhjensas: at this point, you may already re-jump on it. but there's nothing to see yet11:35
opendevreviewMichele Baldessari proposed openstack/puppet-tripleo master: WIP Fix haproxy default_backend in a couple of services  https://review.opendev.org/c/openstack/puppet-tripleo/+/81247711:36
opendevreviewSandeep Yadav proposed openstack/tripleo-heat-templates master: [WIP] Test custom network name  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81236911:38
Tenguhjensas: tmux available on UC if you want. still nothing to show.11:39
opendevreviewTakashi Kajinami proposed openstack/tripleo-common master: Remove unused constants for TripleO UI  https://review.opendev.org/c/openstack/tripleo-common/+/81248611:42
opendevreviewyatin proposed openstack/tripleo-ci master: WIP/DNM - Add fips job  https://review.opendev.org/c/openstack/tripleo-ci/+/80821511:45
opendevreviewSandeep Yadav proposed openstack/tripleo-quickstart master: [wip] New featureset for custom network  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81242811:46
opendevreviewTakashi Kajinami proposed openstack/tripleo-common master: Remove unused constants for TripleO UI  https://review.opendev.org/c/openstack/tripleo-common/+/81248611:52
opendevreviewTakashi Kajinami proposed openstack/tripleo-common master: Remove unused DEPLOYMENT_STATUS_FILE  https://review.opendev.org/c/openstack/tripleo-common/+/81248811:52
opendevreviewTakashi Kajinami proposed openstack/tripleo-common master: Remove unused TRIPLEO_NETWORK_CONFIG_RESOURCE  https://review.opendev.org/c/openstack/tripleo-common/+/81248911:58
Tenguhjensas: files for OC are present, prefixed "oc0-*"12:01
Tenguhjensas: if you want to have a quick look.12:01
opendevreviewJuan Badia Payno proposed openstack/tripleo-ansible master: bnr Use replace instead of lineinfile  https://review.opendev.org/c/openstack/tripleo-ansible/+/81195312:01
opendevreviewTakashi Kajinami proposed openstack/tripleo-common master: Remove unused DEFAULT_DEPLOY_*_NAME  https://review.opendev.org/c/openstack/tripleo-common/+/81249012:02
opendevreviewTakashi Kajinami proposed openstack/tripleo-common master: Remove unused constants for Mistral workflows/actions  https://review.opendev.org/c/openstack/tripleo-common/+/81241812:05
*** dviroel|out is now known as dviroel12:07
Tenguhjensas: OC deploy started.12:12
*** jcapitao_lunch is now known as jcapitao12:16
opendevreviewmbu proposed openstack/python-tripleoclient stable/train: [Train-Only] Run Validations outside of mistral for the deployment  https://review.opendev.org/c/openstack/python-tripleoclient/+/80712512:19
*** jpena|lunch is now known as jpena12:22
Tenguhjensas: ok, so far, so good. the failures I've seen with the service_net_map_replace should come after the container image prepare.12:22
Tenguok. still failing.12:22
Tenguwait. what12:23
Tenguah. ok. now I have them.12:23
bhagyashris|roverTengu, Hi fyi, standalone jobs are blocking the gate due to this issue https://bugs.launchpad.net/tripleo/+bug/1946045/ we have fix ready : https://review.opendev.org/c/openstack/tripleo-heat-templates/+/812461 12:24
Tenguhjensas: so, your patch is, indeed, correcting the issue I had with the service_net_map_replace12:24
bhagyashris|roverTengu, after fixing the above one we have different issue which is hitting standalone sc001 and sc004 with this issue https://bugs.launchpad.net/tripleo/+bug/194609112:25
Tengubhagyashris|rover: sooo we're missing https://review.opendev.org/c/openstack/puppet-tripleo/+/812457  right? guess you want me to vote on it? Or should we wait for bandini to or his team?12:26
bhagyashris|roverwe can skip the recheck on those failures 12:26
Tengubhagyashris|rover: ah, ok. I'm not working on that at all, but good to know :)12:26
Tengubhagyashris|rover: my "thing" right now is tls-e with IPA and custom network names ^^'12:26
Tenguhjensas: would you have a moment for a quick call?12:27
Tenguunless you're about to lose power :)12:27
bhagyashris|roverTengu, yes you can vote on that,  and it would be great if you DF can help on https://bugs.launchpad.net/tripleo/+bug/1946091 12:27
bhagyashris|roverTengu, ok12:27
Tengubhagyashris|rover: that second issues sounds..... weird.12:28
bhagyashris|roverTengu, yeah...12:28
Tengubhagyashris|rover: I mean - I'm deploying master right now, and don't hit anything... but I guess I'm not using the same code version as that job, am I?12:28
bhagyashris|roverTengu, doing regression testing will update bug soon12:29
Tengubhagyashris|rover: ok! maybe cloudnull and/or mwhahaha can also have a quick look12:29
Tenguthey should show up shortly12:29
bhagyashris|roverTengu, ok thanks :)12:29
hjensasTengu: sure12:30
*** ysandeep is now known as ysandeep|afk12:34
bhagyashris|roverianw, hi kindly add in your review list https://review.opendev.org/c/openstack/diskimage-builder/+/812453 thanks :)12:35
opendevreviewMichele Baldessari proposed openstack/tripleo-common master: DNM/DNR WIP container image test  https://review.opendev.org/c/openstack/tripleo-common/+/81249812:44
sshnaidmbshephar, hey, please take a look: https://review.opendev.org/c/x/tripleo-ipa/+/812500 - if it's ok, I'll push it to your patchset12:53
opendevreviewFrancesco Pantano proposed openstack/tripleo-heat-templates master: DNM - Test Pending Ceph Pacific daemons in CI  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/77891512:55
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Wrap stopping podman -t with systemd timeouts  https://review.opendev.org/c/openstack/tripleo-ansible/+/80675312:58
opendevreviewMerged openstack/tripleo-ansible stable/train: Make Galera desync operation more resilient  https://review.opendev.org/c/openstack/tripleo-ansible/+/81232713:02
opendevreviewMerged openstack/python-tripleoclient master: Check for passwords at old path during tripleo deploy  https://review.opendev.org/c/openstack/python-tripleoclient/+/78963813:02
opendevreviewMerged openstack/os-net-config master: Drop six  https://review.opendev.org/c/openstack/os-net-config/+/81094113:02
opendevreviewMerged openstack/tripleo-ansible stable/wallaby: Automate the /var/lib/ceph backup during recovery phase  https://review.opendev.org/c/openstack/tripleo-ansible/+/81220413:02
*** amoralej|lunch is now known as amoralej13:03
*** blarnath is now known as d34dh0r5313:09
opendevreviewHarald Jensås proposed openstack/python-tripleoclient master: Deprecate and ignore --skip-nodes-and-networks  https://review.opendev.org/c/openstack/python-tripleoclient/+/81250113:09
opendevreviewJuan Badia Payno proposed openstack/tripleo-ansible master: bnr Use replace instead of lineinfile  https://review.opendev.org/c/openstack/tripleo-ansible/+/81195313:16
*** artom_ is now known as artom13:18
opendevreviewJuan Badia Payno proposed openstack/tripleo-ansible master: bnr Use replace instead of lineinfile  https://review.opendev.org/c/openstack/tripleo-ansible/+/81195313:24
cloudnullMornings. 13:24
opendevreviewJuan Badia Payno proposed openstack/tripleo-ansible master: bnr restore wirh Ironic  https://review.opendev.org/c/openstack/tripleo-ansible/+/81172613:26
*** ysandeep|afk is now known as ysandeep13:26
opendevreviewVijayalakshmi proposed openstack/os-net-config stable/ussuri: Update sriov config service to handle nic partitioned PF  https://review.opendev.org/c/openstack/os-net-config/+/81250213:30
*** dpawlik2 is now known as dpawlik13:31
*** rlandy|dr_appt is now known as rlandy|ruck13:32
opendevreviewVijayalakshmi proposed openstack/os-net-config stable/ussuri: Update sriov config service to handle nic partitioned PF  https://review.opendev.org/c/openstack/os-net-config/+/81250313:33
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-common master: image_uploader: Excluding schemaVersion 1 from copy_registry_to_registry  https://review.opendev.org/c/openstack/tripleo-common/+/81250413:38
opendevreviewAlex Schultz proposed openstack/tripleo-common master: Revert "Allow for OCI manifests"  https://review.opendev.org/c/openstack/tripleo-common/+/81244113:47
*** artom_ is now known as artom13:55
opendevreviewAlex Schultz proposed openstack/tripleo-ci master: Add scenario001/004 coverage to image uploader changes  https://review.opendev.org/c/openstack/tripleo-ci/+/81250613:55
mwhahahadvd, bogdando -^ adding test coverage for thatbug13:56
dvdgood idea13:59
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-heat-templates stable/wallaby: Allow configuring secure RBAC in nova  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81244214:01
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-heat-templates stable/wallaby: Allow configuring secure RBAC in placement  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81244314:01
bhagyashris|roverhttps://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/job/tripleo-quickstart-promote-wallaby-current-tripleo-delorean-minimal/14:02
*** ykarel is now known as ykarel|away14:03
rlandy|ruckTheJulia: hi can you review https://review.opendev.org/c/openstack/diskimage-builder/+/81245314:08
opendevreviewAlex Schultz proposed openstack/tripleo-common master: Revert "Revert "Allow for OCI manifests""  https://review.opendev.org/c/openstack/tripleo-common/+/81251114:23
mwhahahadvd -^ now with fixes14:23
dvdmwhahaha, I thought it was possible that oci would have no mediaType ?14:25
mwhahahait'll have a config mediatype14:25
mwhahahawhich is why we do both14:25
mwhahahait may not have a top level mediaType, but it must have a config mediaType14:25
dvdoh I see14:25
dvdnice!14:25
mwhahahawhere docker schemaVersion 2 has a top level mediaType14:26
mwhahahait's all terrible14:26
dvdlol14:26
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Wrap stopping podman -t with systemd timeouts  https://review.opendev.org/c/openstack/tripleo-ansible/+/80675314:31
opendevreviewCedric Jeanneret proposed openstack/tripleo-heat-templates master: WIP - Use "network.name" in ApacheNetworks  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81228614:33
opendevreviewSandeep Yadav proposed openstack/tripleo-quickstart master: [wip] New featureset for custom network  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81242814:36
Tenguysandeep: fyi, hjensas and I are getting closer to something that might work in the end. It's hitting bumps and failures, but.... I think we're on the right track. We should get something by the end of the week. Finger crossed!14:44
Tenguhjensas: re-deploying my env (sorry, I've kicked you out ^^') with the latest patch version of your WIP.14:45
ysandeepTengu, ack thanks! My deployment is failing with different reasons all config related so far.. 14:46
Tenguysandeep: sooo. with custom names and custom subnets comes custom CloudName{{CustomNetwork}}, among things. You also need to get that role-data right.14:47
Tenguysandeep: and you also need to get Harald's patch, though it's probably more TLS-related.14:48
ysandeepTengu: I have renamed networks under role-data.yaml https://review.opendev.org/c/openstack/tripleo-heat-templates/+/812369/6/ci/custom_ci_roles_data.yaml14:50
ysandeepTengu, hjensas I am wondering will I need to update these vars: https://logserver.rdoproject.org/54/31954/11/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset064-master/d1ed15d/logs/undercloud/home/zuul/cloud-names.yaml.txt.gz14:51
Tenguysandeep: lemme check, 1s14:51
Tenguysandeep: yeah, soo.... maybe a quick meeting?14:52
Tenguwould be easier/faster14:52
ysandeepsure14:52
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-validations master: Use collections in validations for Ansible 2.11  https://review.opendev.org/c/openstack/tripleo-validations/+/80676314:59
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-validations master: oslo-config-validator: container plugin is replaced with collections  https://review.opendev.org/c/openstack/tripleo-validations/+/80419314:59
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-validations master: oslo-config-validator: invalidating configs only when necessary  https://review.opendev.org/c/openstack/tripleo-validations/+/81049114:59
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-validations master: oslo-config-validator: Removing merged patches  https://review.opendev.org/c/openstack/tripleo-validations/+/81242215:00
Tenguhjensas: fyi, UC is getting ready (packages are being installed), and if you want to connect later tonight, well, feel free to jump in15:04
*** dtantsur_ is now known as dtantsur15:10
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-heat-templates stable/wallaby: Allow configuring secure RBAC in nova  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81244215:12
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-heat-templates stable/wallaby: Allow configuring secure RBAC in placement  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81244315:14
opendevreviewAlex Schultz proposed openstack/puppet-tripleo stable/wallaby: Remove mistral  https://review.opendev.org/c/openstack/puppet-tripleo/+/81119815:14
opendevreviewAlex Schultz proposed openstack/puppet-tripleo stable/wallaby: Remove zaqar  https://review.opendev.org/c/openstack/puppet-tripleo/+/81119915:14
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-heat-templates stable/wallaby: placement: Adding Debug parameter  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81244415:15
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-heat-templates stable/victoria: placement: Adding Debug parameter  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81244515:17
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-heat-templates stable/ussuri: placement: Adding Debug parameter  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81244615:17
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-heat-templates stable/train: placement: Adding Debug parameter  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81244715:17
opendevreviewRabi Mishra proposed openstack/tripleo-quickstart master: Provision networks before overcloud deploy  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81242315:20
Tenguhjensas: meh... getting tired - I just didn't built the package... shutting down, I'll get it back up tomorrow.15:54
opendevreviewAlex Schultz proposed openstack/python-tripleoclient master: [WIP] Import task core into tripleoclient  https://review.opendev.org/c/openstack/python-tripleoclient/+/79653316:04
opendevreviewAlex Schultz proposed openstack/python-tripleoclient master: [WIP] Import task core into tripleoclient  https://review.opendev.org/c/openstack/python-tripleoclient/+/79653316:04
opendevreviewFrancesco Pantano proposed openstack/tripleo-heat-templates stable/train: [TRAIN-ONLY] Restart ceph-nfs after the Ceph Upgrade stage  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81252616:14
opendevreviewFrancesco Pantano proposed openstack/tripleo-heat-templates stable/train: [TRAIN-ONLY] Restart ceph-nfs after the Ceph Upgrade stage  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81252616:16
*** amoralej is now known as amoralej|off16:20
*** ysandeep is now known as ysandeep|dinner16:30
*** jpena is now known as jpena|off16:32
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-common master: [c9] replacing genisoimage with xorriso  https://review.opendev.org/c/openstack/tripleo-common/+/80923316:34
opendevreviewAlex Schultz proposed openstack/python-tripleoclient master: [WIP] Import task core into tripleoclient  https://review.opendev.org/c/openstack/python-tripleoclient/+/79653316:40
opendevreviewAlex Schultz proposed openstack/python-tripleoclient master: [WIP] Import task core into tripleoclient  https://review.opendev.org/c/openstack/python-tripleoclient/+/79653316:49
opendevreviewMerged openstack/python-tripleoclient master: Remove --no-workflow option  https://review.opendev.org/c/openstack/python-tripleoclient/+/81118916:52
opendevreviewAlex Schultz proposed openstack/python-tripleoclient stable/wallaby: Check for passwords at old path during tripleo deploy  https://review.opendev.org/c/openstack/python-tripleoclient/+/81252917:02
opendevreviewAlex Schultz proposed openstack/python-tripleoclient stable/wallaby: Don't write <stack_name>-passwords.conf  https://review.opendev.org/c/openstack/python-tripleoclient/+/81253017:07
mwhahaha2021-10-05 15:49:58.695965 | primary | level=debug msg="error locating image \"quay.ceph.io/prometheus/node-exporter:v0.17.0\": error locating image with ID \"quay.ceph.io/prometheus/node-exporter:v0.17.0\": image not known"17:25
mwhahahais this known?17:25
mwhahahahttps://b76dad6435f958ae2b0d-8aa339b393181b8701951a5ddc4d5a6a.ssl.cf5.rackcdn.com/812511/1/check/tripleo-ci-centos-8-content-provider-wallaby/537291b/job-output.txt17:25
mwhahahaah quay.ceph.io timeout17:26
mwhahahaseems like the provider shold stop if those fail to fetch17:27
opendevreviewMerged openstack/tripleo-quickstart-extras master: Pass distro to tripleo_container_image_build role  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81107917:29
*** ysandeep|dinner is now known as ysandeep17:33
opendevreviewMerged openstack/tripleo-quickstart-extras master: Update conditional to add tcib_extra params  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81227817:34
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: Manila: Hide password strings  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81149317:34
opendevreviewDouglas Viroel proposed openstack/tripleo-quickstart master: Add 'generic' repos setup using yum_config module  https://review.opendev.org/c/openstack/tripleo-quickstart/+/80840817:41
opendevreviewAlex Schultz proposed openstack/python-tripleoclient master: [WIP] Import task core into tripleoclient  https://review.opendev.org/c/openstack/python-tripleoclient/+/79653318:14
opendevreviewAlex Schultz proposed openstack/tripleo-common master: [WIP] task-core file generation  https://review.opendev.org/c/openstack/tripleo-common/+/79872118:47
opendevreviewAlex Schultz proposed openstack/tripleo-heat-templates master: [WIP] task-core service example  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/79874718:47
opendevreviewAlex Schultz proposed openstack/python-tripleoclient master: [WIP] Import task core into tripleoclient  https://review.opendev.org/c/openstack/python-tripleoclient/+/79653318:53
rlandy|ruckmwhahaha: hi - do you think it's worth abandoning all the patching in the gate to get the fixes for the gate blockers through?19:06
rlandy|ruckthe scenarios test are going to fail on the patches above19:07
*** ysandeep is now known as ysandeep|out19:20
mwhahaharlandy|ruck: are there other fixes needed? i checked the gate an only abandoned one that actually triggered scenario001/319:25
stevebakermorning19:26
rlandy|ruckmwhahaha: there is a THT change failed in the gate right now19:42
rlandy|ruckbut it will finish shortly19:42
mwhahahaoh i must have missed that one, but everything already restarted behind it so leave it19:42
rlandy|ruckI'll go back and recheck the failed scenario 001, and 003 after the fixes merge19:42
rlandy|ruckstevebaker: hi - thanks for the fix for diskimage builder and train19:49
rlandy|ruckstevebaker: following up on https://review.rdoproject.org/r/c/testproject/+/3577719:49
rlandy|ruckwe got a pass on all test except fs00119:50
rlandy|rucksame errors19:50
lbragstadmwhahaha curious if you'd be able to give https://review.opendev.org/c/openstack/tripleo-heat-templates/+/781571 a look when you have some time19:57
opendevreviewMerged openstack/puppet-tripleo stable/wallaby: Add ability to noop a service  https://review.opendev.org/c/openstack/puppet-tripleo/+/81238920:06
opendevreviewAlex Schultz proposed openstack/python-tripleoclient master: [WIP] Import task core into tripleoclient  https://review.opendev.org/c/openstack/python-tripleoclient/+/79653320:20
opendevreviewJohn Fulton proposed openstack/tripleo-ansible master: Apply ceph_conf_overrides for non-deployed_ceph services  https://review.opendev.org/c/openstack/tripleo-ansible/+/81223020:22
opendevreviewJohn Fulton proposed openstack/tripleo-ansible master: Apply ceph_conf_overrides for non-deployed_ceph services  https://review.opendev.org/c/openstack/tripleo-ansible/+/81223020:23
opendevreviewAlex Schultz proposed openstack/python-tripleoclient master: [WIP] Import task core into tripleoclient  https://review.opendev.org/c/openstack/python-tripleoclient/+/79653320:24
stevebakerrlandy|ruck: but fs001 passed on this change, which should be testing the same thing https://review.opendev.org/c/openstack/tripleo-quickstart/+/80140920:28
* rlandy|ruck looks20:29
rlandy|ruckstevebaker: no quite - we run different tests on check and periodic https://opendev.org/openstack/openstack-tempest-skiplist/src/branch/master/roles/validate-tempest/vars/tempest_allow.yml20:31
* rlandy|ruck checks the fs035 tests that passed20:31
stevebakerah20:32
rlandy|ruckk - one last rerun on testproject  - let's see if we clear it20:34
rlandy|ruckif yes - I'll w+20:34
opendevreviewLance Bragstad proposed openstack/tripleo-heat-templates master: Implement project personas in custom placement policy file  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81043520:35
opendevreviewKevin Carter proposed openstack/tripleo-ansible master: add retry to rhos-bootstrap package install, network not ready  https://review.opendev.org/c/openstack/tripleo-ansible/+/78831820:42
*** dviroel is now known as dviroel|out20:55
stevebakerrlandy|ruck: can you see where I can view the failed tempest tests? At least there is no errors in the swift log which is a good sign https://review.rdoproject.org/zuul/build/460f073948e14a3090347c319d27ddf8/logs21:04
rlandy|ruckstevebaker: https://logserver.rdoproject.org/77/35777/3/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/460f073/logs/undercloud/var/log/tempest/stestr_results.html.gz21:05
rlandy|ruckif you click on the fail link, you will see the error21:05
stevebakerthanks21:05
rlandy|ruckhttps://logserver.rdoproject.org/77/35777/3/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/460f073/logs/ - see the README21:06
rlandy|ruckcontains all the useful links in the logs21:06
opendevreviewSteve Baker proposed openstack/python-tripleoclient stable/wallaby: Only use undercloud.conf ipxe_enabled for inspection  https://review.opendev.org/c/openstack/python-tripleoclient/+/81261521:23
opendevreviewDavid Vallee Delisle proposed openstack/tripleo-validations master: oslo-config-validator: Removing merged patches  https://review.opendev.org/c/openstack/tripleo-validations/+/81242222:52
*** rlandy is now known as rlandy|ruck23:30
rlandy|ruckstevebaker: looks like you are good to go now23:31
rlandy|ruckhttps://review.rdoproject.org/r/c/testproject/+/3577723:31
rlandy|ruck"success": true23:31
rlandy|ruckin fs00123:31
rlandy|ruck+2'ed both those patches23:33

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!