Monday, 2020-07-13

*** jmasud has quit IRC00:48
*** jmasud has joined #tripleo00:49
openstackgerritSteve Baker proposed openstack/tripleo-ansible master: Revert "Make the metalsmith module interactions more resilient"  https://review.opendev.org/74060001:22
openstackgerritSteve Baker proposed openstack/tripleo-ansible master: Capture metalsmith python logging  https://review.opendev.org/74060601:22
*** EmilienM|PTO is now known as EmilienM01:27
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: containers: add tcib_managed label to authorized images to be updated  https://review.opendev.org/74029801:30
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo_states: add missing space  https://review.opendev.org/74025301:30
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: container_systemd: improve logging  https://review.opendev.org/74025201:31
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: only run exec/create playbooks when needed  https://review.opendev.org/73986301:31
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: container_status: "exec" checks status  https://review.opendev.org/73983901:31
openstackgerritEmilien Macchi proposed openstack/tripleo-common stable/ussuri: tcib: move cradox to gnocchi-base & enable ci on scenario001  https://review.opendev.org/73953401:31
openstackgerritEmilien Macchi proposed openstack/tripleo-common stable/ussuri: Fix OVN Octavia provider driver package name  https://review.opendev.org/73974301:31
openstackgerritEmilien Macchi proposed openstack/tripleo-common stable/ussuri: Drop systemd support from nsswitch.conf  https://review.opendev.org/73974401:31
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ussuri: Collapse deploy steps  https://review.opendev.org/73949501:32
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ussuri: Collapse host prep tasks  https://review.opendev.org/73950201:32
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ussuri: Fix privilege escalation  https://review.opendev.org/73959101:32
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ussuri: Move sidecar kill scripts to host prep  https://review.opendev.org/73959501:32
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/train: Fix privilege escalation  https://review.opendev.org/73959201:32
openstackgerritEmilien Macchi proposed openstack/tripleo-common stable/train: Switch to tripleo_dense  https://review.opendev.org/73957801:32
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ussuri: Always clear cached facts first  https://review.opendev.org/73949301:33
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Generate container startup configs with a new module  https://review.opendev.org/73764401:33
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Switch deploy steps to tripleo_free  https://review.opendev.org/72473401:33
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Use tripleo linear when not using tripleo free  https://review.opendev.org/72476901:33
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Relax facts gathering plays on the overcloud  https://review.opendev.org/73464901:33
openstackgerritMerged openstack/diskimage-builder master: Switch from unittest2 compat methods to Python 3.x methods  https://review.opendev.org/73964502:21
*** fultonj has joined #tripleo02:49
*** psahoo has joined #tripleo02:55
*** pojadhav|pto is now known as pojadhav02:56
openstackgerritSteve Baker proposed openstack/tripleo-ansible master: Capture metalsmith python logging  https://review.opendev.org/74060602:57
*** weshay_ruck is now known as weshay_pto03:04
*** Tengu has quit IRC03:21
*** Tengu has joined #tripleo03:22
openstackgerritwu.chunyang proposed openstack/diskimage-builder master: remove py35 in "V" cycle  https://review.opendev.org/74060703:31
*** psachin has joined #tripleo03:36
*** ramishra has joined #tripleo03:44
openstackgerritMerged openstack/tripleo-ansible master: Update podman_container with better idempotency  https://review.opendev.org/74032503:48
openstackgerritMerged openstack/tripleo-heat-templates master: Fix bind mount volumes for novajoin containers  https://review.opendev.org/73903703:53
openstackgerritMerged openstack/python-tripleoclient master: Remove ffwd-upgrade commands from tripleoclient.  https://review.opendev.org/73903803:54
*** skramaja has joined #tripleo03:54
openstackgerritMerged openstack/tripleo-heat-templates master: Remove /run from some services  https://review.opendev.org/73995004:02
*** raukadah is now known as chandankumar04:20
*** Tengu has quit IRC04:21
*** Tengu has joined #tripleo04:22
*** evrardjp has quit IRC04:33
*** evrardjp has joined #tripleo04:33
*** psahoo has quit IRC04:35
*** soniya29 has joined #tripleo04:38
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Unmount NFS shares before launching LEAPP  https://review.opendev.org/73921904:39
*** psahoo has joined #tripleo04:40
*** Tengu has quit IRC04:41
*** bhagyashris|away is now known as bhagyashris04:41
*** Tengu has joined #tripleo04:42
*** ykarel has joined #tripleo04:43
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Don't set RABBITMQ_SERVER_ERL_ARGS  https://review.opendev.org/73975004:46
*** psachin has quit IRC04:58
*** abdysn has joined #tripleo05:02
*** Abdallahyas has joined #tripleo05:07
*** Abdallahyas has quit IRC05:09
*** psahoo has quit IRC05:10
*** Abdallahyas has joined #tripleo05:10
*** abdysn has quit IRC05:11
*** ykarel has quit IRC05:11
*** ykarel has joined #tripleo05:12
*** psahoo has joined #tripleo05:22
*** cloudnull has quit IRC05:23
*** lmiccini has joined #tripleo05:26
*** psahoo has quit IRC05:28
*** marios has joined #tripleo05:35
*** udesale has joined #tripleo05:38
*** psahoo has joined #tripleo05:44
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-ci master: Add support for authfile in buildcontainers role  https://review.opendev.org/73971005:44
*** cloudnull has joined #tripleo05:48
*** ysandeep|away is now known as ysandeep05:50
tkajinamis anybody aware that http://tripleo.org/ is down ?05:50
*** bandini has joined #tripleo05:50
*** ysandeep is now known as ysandeep|afk05:51
*** rcernin has quit IRC06:02
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: Add enable_centos_cr_repo var in release file  https://review.opendev.org/73701506:02
*** rcernin has joined #tripleo06:11
openstackgerritMerged openstack/tripleo-ansible master: tripleo_states: add missing space  https://review.opendev.org/74025306:14
*** ykarel has quit IRC06:15
*** Tengu has quit IRC06:21
*** Tengu has joined #tripleo06:23
openstackgerritCédric Jeanneret (Tengu) proposed openstack/tripleo-heat-templates master: Ensure name consistency for tmpfiles.d configurations  https://review.opendev.org/73695906:26
openstackgerritTakashi Kajinami proposed openstack/tripleo-heat-templates master: Remove duplicated hieradata  https://review.opendev.org/74061706:32
openstackgerritTakashi Kajinami proposed openstack/tripleo-heat-templates master: Use parameters in new neutron::server::notifications::nova class  https://review.opendev.org/74061806:32
openstackgerritTakashi Kajinami proposed openstack/puppet-tripleo master: Include neutron::server::notification::nova class  https://review.opendev.org/74061906:35
openstackgerritTakashi Kajinami proposed openstack/puppet-tripleo master: Include neutron::server::notification::nova class  https://review.opendev.org/74061906:36
*** tosky has joined #tripleo06:39
*** pcaruana has joined #tripleo06:49
*** psahoo has quit IRC06:49
*** ykarel has joined #tripleo06:50
*** bogdando has joined #tripleo06:52
*** maciejjozefczyk has joined #tripleo06:53
mariosgithub.com is down?06:54
Tenguapparently.06:55
Tenguyay.06:55
Tengusince06:55
Tengusince microsoft bought them, it's a failure a week06:55
openstackgerritRabi Mishra proposed openstack/tripleo-heat-templates master: Simplify host entries generation  https://review.opendev.org/73966106:55
ramishraUpdate07:00
ramishraWe have identified the source of elevated errors and are working on recovery.07:00
ramishraPosted 1 hour ago. Jul 13, 2020 - 05:53 UTC07:00
ramishrahttps://www.githubstatus.com/07:01
Tenguyup07:02
Tengujust saw it07:03
*** psahoo has joined #tripleo07:04
*** amoralej|off is now known as amoralej07:04
*** yolanda has joined #tripleo07:07
*** xek has joined #tripleo07:07
*** ccamacho has joined #tripleo07:13
*** pojadhav is now known as pojadhav|afk07:17
openstackgerritGrzegorz Grasza proposed openstack/tripleo-heat-templates stable/ussuri: Fix bind mount volumes for novajoin containers  https://review.opendev.org/74062307:19
openstackgerritGrzegorz Grasza proposed openstack/tripleo-heat-templates stable/train: Fix bind mount volumes for novajoin containers  https://review.opendev.org/74062407:19
*** abdysn has joined #tripleo07:34
*** Abdallahyas has quit IRC07:37
*** xek has quit IRC07:44
*** paramite has joined #tripleo07:44
*** suuuper has joined #tripleo07:51
*** ysandeep|afk is now known as ysandeep|rover07:53
*** lucasagomes has joined #tripleo07:56
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-ci master: Add support for authfile in buildcontainers role  https://review.opendev.org/73971008:03
*** pkopec has joined #tripleo08:03
*** rcernin has quit IRC08:06
openstackgerritJean Pierre Roquesalane proposed openstack/tripleo-specs master: VxFlexOS integration into Tripleo  https://review.opendev.org/72430108:14
*** ysandeep|rover is now known as ysandeep|lunch08:16
openstackgerritJean Pierre Roquesalane proposed openstack/tripleo-specs master: VxFlexOS integration into Tripleo  https://review.opendev.org/72430108:19
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Remove mock as test requirement  https://review.opendev.org/74063108:22
*** ramishra has quit IRC08:28
*** ramishra has joined #tripleo08:29
*** dtantsur|afk is now known as dtantsur08:34
*** jbadiapa has joined #tripleo08:40
*** abdysn has quit IRC08:55
*** abdysn has joined #tripleo08:55
*** ysandeep|lunch is now known as ysandeep|rover08:55
*** Abdallahyas has joined #tripleo08:57
*** pojadhav|afk is now known as pojadhav08:58
*** derekh has joined #tripleo09:00
*** abdysn has quit IRC09:00
*** sshnaidm|afk is now known as sshnaidm09:09
*** alexmcleod has joined #tripleo09:18
openstackgerritJean Pierre Roquesalane proposed openstack/tripleo-specs master: VxFlexOS integration into Tripleo  https://review.opendev.org/72430109:24
*** Abdallahyas has quit IRC09:25
*** abdysn has joined #tripleo09:26
*** aedc_ has joined #tripleo09:27
openstackgerritIury Gregory Melo Ferreira proposed openstack/diskimage-builder master: Update ipa jobs  https://review.opendev.org/74064209:27
openstackgerritMichele Baldessari proposed openstack/tripleo-ansible master: WIP Add tripleo_ha_wrapper role  https://review.opendev.org/72481709:28
openstackgerritMichele Baldessari proposed openstack/tripleo-quickstart-extras master: wip Pass proper VIPs on Standalone  https://review.opendev.org/72578209:28
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: redis bundle  https://review.opendev.org/70795409:29
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: mysql  https://review.opendev.org/70795509:29
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: cinder backup/volume  https://review.opendev.org/70795609:29
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: ovn dbs  https://review.opendev.org/70795709:29
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: rabbitmq  https://review.opendev.org/70795809:29
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: manila-share  https://review.opendev.org/70835709:29
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: haproxy bundle  https://review.opendev.org/70795309:29
openstackgerritJean Pierre Roquesalane proposed openstack/tripleo-specs master: VxFlexOS integration into Tripleo  https://review.opendev.org/72430109:34
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-upgrade stable/ussuri: Remove --update-plan-only from UPGRADE converge.  https://review.opendev.org/74064409:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-upgrade stable/train: Remove --update-plan-only from UPGRADE converge.  https://review.opendev.org/74064509:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/python-tripleoclient stable/ussuri: Remove ffwd-upgrade commands from tripleoclient.  https://review.opendev.org/74064609:37
*** shyamb has joined #tripleo09:46
shyambHi09:46
openstackgerritMerged openstack/tripleo-heat-templates stable/ussuri: Always clear cached facts first  https://review.opendev.org/73949309:47
openstackgerritMerged openstack/tripleo-validations master: Make Get OSD stat percentage compatible with both Luminous and Nautilus  https://review.opendev.org/73885509:47
openstackgerritJean Pierre Roquesalane proposed openstack/tripleo-specs master: VxFlexOS integration into Tripleo  https://review.opendev.org/72430109:51
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Replace validate-tempest with tempest-skiplist  https://review.opendev.org/72677309:52
*** shyamb has quit IRC09:53
*** rcernin has joined #tripleo09:54
*** ccamacho has quit IRC09:58
*** xek has joined #tripleo09:58
*** rcernin has quit IRC10:03
*** xek has quit IRC10:03
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Use command to set pythonintepreter  https://review.opendev.org/74044010:04
openstackgerritMerged openstack/tripleo-ansible master: container_systemd: improve logging  https://review.opendev.org/74025210:07
*** rcernin has joined #tripleo10:08
*** alexmcleod has quit IRC10:14
*** bogdando has quit IRC10:14
*** shyamb has joined #tripleo10:27
*** zbr has joined #tripleo10:34
*** rcernin has quit IRC10:40
*** waleedm has joined #tripleo10:49
openstackgerritArx Cruz proposed openstack/tripleo-quickstart master: DNM - Using os_tempest for queens and stein  https://review.opendev.org/74066210:50
*** waleedm_ has joined #tripleo10:50
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Deprecate validate-tempest skiplist  https://review.opendev.org/74066410:59
*** jpich has joined #tripleo11:01
*** alexmcleod has joined #tripleo11:03
odyssey4mehey folks, we could do with a DF +2+w for https://review.opendev.org/#/c/738606/ as soon as possible - it resolves an issue with executing parts of the upgrade process using tags11:08
*** shyamb has quit IRC11:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-upgrade stable/ussuri: Add --yes into update commands to autoconfirm.  https://review.opendev.org/74067211:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-upgrade stable/train: Add --yes into update commands to autoconfirm.  https://review.opendev.org/74067311:25
*** shyamb has joined #tripleo11:30
*** pojadhav is now known as pojadhav|afk11:31
*** bhagyashris is now known as bhagyashris|afk11:33
*** ccamacho has joined #tripleo11:34
*** tkajinam has quit IRC11:37
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Fix package manager used during undercloud packages update  https://review.opendev.org/74001911:39
*** psahoo has quit IRC11:43
openstackgerritSandeep Yadav proposed openstack/tripleo-heat-templates stable/train: Use distinct params for ca cert in nova-vnc-proxy and nova-libvirt  https://review.opendev.org/74067911:44
ysandeep|roverade_lee, could you please take a look at https://review.opendev.org/740679 when you have time11:45
ysandeep|roverpojadhav|afk, ^^ fyi..11:45
*** lmiccini has quit IRC11:47
*** jpich has quit IRC11:49
*** jpich has joined #tripleo11:50
openstackgerritMarios Andreou proposed openstack/tripleo-ci master: Add previous_release_mixed_upgrade_case ussuri to template  https://review.opendev.org/73993911:52
openstackgerritMarios Andreou proposed openstack/tripleo-ci master: Add centos8 standalone-upgrade master and stable/ussuri jobs  https://review.opendev.org/73884411:53
openstackgerritMarios Andreou proposed openstack/tripleo-ci master: Add centos8 container updates and upgrades jobs -ussuri train  https://review.opendev.org/73921711:53
openstackgerritMarios Andreou proposed openstack/tripleo-ci master: Add centos-8-containerized-undercloud-upgrades job ussuri/master  https://review.opendev.org/73921811:54
*** lmiccini has joined #tripleo11:54
*** raildo has joined #tripleo11:56
*** psahoo has joined #tripleo11:57
*** dpaterson has quit IRC11:58
*** dpaterson has joined #tripleo11:58
*** hberaud has quit IRC12:01
*** amoralej is now known as amoralej|lunch12:03
*** hberaud has joined #tripleo12:03
*** rfolco has joined #tripleo12:04
*** rlandy has joined #tripleo12:05
*** rlandy is now known as rlandy|ruck12:06
openstackgerritEmilien Macchi proposed openstack/tripleo-ci master: Revert "set minion job to nv for now"  https://review.opendev.org/74068212:07
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/ussuri: Update podman_container with better idempotency  https://review.opendev.org/74068312:07
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/train: Update podman_container with better idempotency  https://review.opendev.org/74068412:07
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Fix package manager used during undercloud packages update  https://review.opendev.org/74001912:08
*** udesale_ has joined #tripleo12:09
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Fix package manager used during undercloud packages update  https://review.opendev.org/74001912:10
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/ussuri: container_systemd: improve logging  https://review.opendev.org/74068512:11
*** rh-jelabarre has joined #tripleo12:12
*** udesale has quit IRC12:12
*** rh-jelabarre has quit IRC12:12
*** rh-jelabarre has joined #tripleo12:12
EmilienMmarios: hey, any idea why https://review.opendev.org/#/c/724734 wouldn't go to the gate?12:15
EmilienMwould it be the Depends-On? (PRs are merged on github)12:15
mariosEmilienM: i don't think so it shouldn't block ... perhaps try rebase and re-workflow. i don't see it at https://zuul.openstack.org/status12:18
mariosEmilienM: maybe zuul just missed the event ... or something ?12:19
EmilienMyeah, I'm not sure either12:19
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Switch deploy steps to tripleo_free  https://review.opendev.org/72473412:19
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Use tripleo linear when not using tripleo free  https://review.opendev.org/72476912:19
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Relax facts gathering plays on the overcloud  https://review.opendev.org/73464912:19
*** bogdando has joined #tripleo12:24
*** derekh has quit IRC12:26
*** osmanlicilegi has quit IRC12:33
*** bhagyashris|afk is now known as bhagyashris12:35
*** pojadhav|afk is now known as pojadhav12:35
*** xek has joined #tripleo12:38
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-upgrade stable/stein: [DNM] Test patch  https://review.opendev.org/74068712:39
*** shyamb has quit IRC12:40
openstackgerritJohn Fulton proposed openstack/tripleo-ansible stable/ussuri: Add default value in CinderRbdExtraPools task condition  https://review.opendev.org/74068812:40
*** osmanlicilegi has joined #tripleo12:42
*** xek has quit IRC12:44
cloudnullmornings12:50
lbragstad_Tengu strange - i've hit that issue a few times now12:51
*** lbragstad_ is now known as lbragstad12:51
lbragstadTengu i know when i built the overcloud images in the past, i was pasing in DIB_YUM_REPO_CONF12:51
lbragstadpassing*12:51
Tengulbragstad: well, I don't build the images. like, never.12:52
Tengulbragstad: and I did hit some issues, but it was due to a trailing repository file in the image that should have been dropped/not added.12:53
Tenguso I uncovered a bug, basically :).12:53
Tengulbragstad: that said - I was working with downstream mostly last week(s)12:53
lbragstadTengu theoretically - you run https://github.com/cjeanner/tripleo-lab/blob/master/roles/overcloud/tasks/manage-oc-images.yaml#L40-L59 every time you create a new environment, right?12:55
Tengulbragstad: IF https://github.com/cjeanner/tripleo-lab/blob/master/roles/overcloud/tasks/manage-oc-images.yaml#L3712:56
lbragstadbecause you pull the images, they're uncompressed (and changed), and the default value for overcloud_image_update is True12:56
Tengulbragstad: and I usually pass "false" there.12:56
lbragstadahh - https://github.com/cjeanner/tripleo-lab/blob/master/vars/main.yaml#L3212:56
rlandy|ruckEmilienM: hi - should there be repos installed on deployed overcloud nodes?12:56
Tengulbragstad: so my standard deploy usually involves "-e overcloud_image_update=false"12:57
lbragstadgotcha12:57
Tengurlandy|ruck: iirc nope12:57
Tenguthe overcloud image shouldn't need to install anything, in order to support a fully disconnected deploy... isn't it?12:58
EmilienMrlandy|ruck: if using deployed server, yes12:58
openstackgerritMerged openstack/tripleo-operator-ansible master: Stop to use the __future__ module.  https://review.opendev.org/73296812:58
rlandy|ruckTengu: EmilienM: we have a mixed situation in CI and I'm trying to figure out which one is correct12:58
rlandy|ruckwhen we download images, we inject repos12:59
rlandy|ruckwhen we build image we do not12:59
Tengupre-deployed need the repos, if using overcloud-full image it shouldn't12:59
Tenguat least that's what I have in mind :/12:59
rlandy|ruckTengu: I think that's right12:59
rlandy|ruckeven if we have a repo under teat - that is not in the downloaded image,13:00
rlandy|ruckthe containers are updated13:00
rlandy|ruckbefore deploy13:00
rlandy|ruckwhich should cover the change13:00
Tenguthe containers aren't part of the repositories anyway... ?13:00
rlandy|ruckthere are deps repos as well13:01
*** rlandy|ruck is now known as rlandy|ruck|mtg13:01
* rlandy|ruck|mtg picks this up later13:01
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: DNM: testing an octavia related openstacklib change  https://review.opendev.org/74010313:02
*** amoralej|lunch is now known as amoralej13:04
*** bogdando_ has joined #tripleo13:05
*** bogdando has quit IRC13:07
*** bogdando_ is now known as bogdando13:07
*** derekh has joined #tripleo13:09
*** mmethot has joined #tripleo13:10
*** ekultails has joined #tripleo13:10
*** Tengu has quit IRC13:13
*** Tengu has joined #tripleo13:15
*** ramishra has quit IRC13:22
*** soniya29 has quit IRC13:22
*** aedc_ has quit IRC13:26
*** Goneri has joined #tripleo13:26
*** ramishra has joined #tripleo13:26
*** udesale_ has quit IRC13:27
*** rlandy|ruck|mtg has quit IRC13:27
*** rfolco has quit IRC13:27
*** jbadiapa has quit IRC13:27
*** bdodd has quit IRC13:27
*** irclogbot_0 has quit IRC13:27
*** zbr|ruck has quit IRC13:27
*** TrevorV has joined #tripleo13:27
*** udesale_ has joined #tripleo13:28
*** rlandy|ruck|mtg has joined #tripleo13:28
*** rfolco has joined #tripleo13:28
*** jbadiapa has joined #tripleo13:28
*** bdodd has joined #tripleo13:28
*** irclogbot_0 has joined #tripleo13:28
*** zbr|ruck has joined #tripleo13:28
*** PhilSliderS has quit IRC13:31
*** PhilSliderS has joined #tripleo13:32
*** abdysn has quit IRC13:35
EmilienMsshnaidm: fyi idempotency seems ok for me now13:40
sshnaidmEmilienM, great13:40
*** d34dh0r53 has joined #tripleo13:45
*** soniya29 has joined #tripleo13:45
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: DNM - debug minion job  https://review.opendev.org/74069513:45
*** bhagyashris is now known as bhagyashris|afk13:56
*** artom has joined #tripleo13:56
*** xek has joined #tripleo13:57
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: container_startup_config: remove old startup config files  https://review.opendev.org/74069914:04
*** ykarel has quit IRC14:11
*** waleedm_ has quit IRC14:16
*** waleedm has quit IRC14:16
*** boazel has joined #tripleo14:17
*** amodi has quit IRC14:22
*** ykarel has joined #tripleo14:22
*** ysandeep|rover is now known as ysandeep|away14:32
*** beekneemech is now known as bnemec14:38
openstackgerritArx Cruz proposed openstack/tripleo-quickstart master: DNM - Using os_tempest for queens and stein  https://review.opendev.org/74066214:39
*** ykarel is now known as ykarel|away14:45
*** skramaja has quit IRC14:45
*** maciejjozefczyk has quit IRC14:47
*** Goneri has quit IRC14:50
*** lmiccini has quit IRC14:56
*** Goneri has joined #tripleo15:03
openstackgerritLance Bragstad proposed openstack/tripleo-operator-ansible master: trivial: fix spelling mistakes in image build README  https://review.opendev.org/74071015:04
*** udesale_ has quit IRC15:07
cloudnullEmilienM I've been looking into this execution issue with the minion jobs. Where is the calling function? -cc mwhahaha - If we're getting an error from the minion deploy execution what is executing that command? something in quickstart?15:08
cloudnullRE https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_a1e/740332/2/check/tripleo-ci-centos-8-containers-undercloud-minion/a1e30c5/logs/subnode-1/home/zuul/minion_install.log15:08
mwhahahacloudnull: we're chatting about this15:09
cloudnullwhere?15:10
EmilienMhttps://meet.google.com/qwb-ayru-uba15:10
ade_leemwhahaha, cloudnull , hjensas , https://review.opendev.org/#/c/740624/1  please15:12
*** soniya29 has quit IRC15:17
weshay_ptomwhahaha, EmilienM vex is down.. not much we can do w/ getting master promoted15:17
EmilienMdamn15:18
openstackgerritSergii Golovatiuk proposed openstack/python-tripleoclient master: Add "yes" prompt for update/upgrades commands  https://review.opendev.org/73032515:26
*** xek has quit IRC15:27
openstackgerritLuke Short proposed openstack/tripleo-heat-templates master: Expose the Apache WSGI timeout  https://review.opendev.org/73892515:27
*** rlandy|ruck|mtg is now known as rlandy|ruck15:31
openstackgerritAlex Schultz proposed openstack/tripleo-operator-ansible master: Revert "New parameters in order to set how we want to redirect logs"  https://review.opendev.org/74071515:34
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: log execs in /var/log/containers/stdouts  https://review.opendev.org/74072015:42
openstackgerritLuke Short proposed openstack/tripleo-heat-templates master: Expose the Apache WSGI timeout  https://review.opendev.org/73892515:46
*** d34dh0r53 has quit IRC15:47
*** dsneddon has joined #tripleo15:48
*** amodi has joined #tripleo15:50
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Generate container startup configs with a new module  https://review.opendev.org/73764415:53
*** marios is now known as marios|out15:54
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Switch minion to fetch from undercloud correctly  https://review.opendev.org/74072215:56
mwhahahacloudnull, EmilienM -^15:56
*** thrash|0ut is now known as thrash15:57
*** d34dh0r53 has joined #tripleo15:58
*** lucasagomes has quit IRC16:02
*** artom has quit IRC16:07
*** pkopec has quit IRC16:10
*** marios|out has quit IRC16:13
*** jpich has quit IRC16:13
*** artom has joined #tripleo16:18
*** bogdando has quit IRC16:20
*** suuuper has quit IRC16:20
*** amoralej is now known as amoralej|off16:22
openstackgerritMerged openstack/tripleo-ansible master: Revert "Make the metalsmith module interactions more resilient"  https://review.opendev.org/74060016:28
*** d34dh0r53 has quit IRC16:29
*** d34dh0r53 has joined #tripleo16:32
mwhahahacloudnull, EmilienM: so i think the minion failure is related to the missing updates16:33
mwhahahacloudnull: so my patch won't fix it16:33
mwhahahahttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_a1e/740332/2/check/tripleo-ci-centos-8-containers-undercloud-minion/a1e30c5/logs/undercloud/var/log/tripleo-container-image-prepare.log shows non-updated tags16:33
mwhahahastill uncertain how 192.168.24.1 ever worked, but who knows *magic*16:33
*** ykarel|away has quit IRC16:39
EmilienMmwhahaha: yeah and for the images to get updated, we need a promotion to have the kolla_version label in tcib images16:44
*** holser has quit IRC16:45
*** holser has joined #tripleo16:45
mnaserEmilienM, mwhahaha: does tripleo have any specific tuning for heat (engine or api) for its much larger heat stack usage?16:54
rlandy|ruckEmilienM: vexxhost is back -  the main(master) line has kicked - we will try promote this hash if tests pass16:54
mnaserseeing a bunch of this: Unexpected error occurred serving API: Timed out waiting for a reply to message ID a0b5bafc217a44f9a65adc983a1c5e4a: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID a0b5bafc217a44f9a65adc983a1c5e4a -- even on normal stack list api calls, while heat-engine is busy processing like 10 nested stacks16:55
*** ayoung has joined #tripleo16:55
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Set image_convert_memory_limit to 2048 in CI UC  https://review.opendev.org/73997016:57
mnaserrabbit is not struggling, and heat has it's own dedicated rabbit, and engine doesn't need much16:57
*** derekh has quit IRC17:00
cloudnullmnaser i don’t have answers for you, but I’m attempting to get them.17:02
apetrichmnaser, also looking into it.17:03
mnasercloudnull: thanks, i figured if anything, tripleo has the biggest sort of ... skillset at pushing heat to its boundaries17:03
*** maciejjozefczyk has joined #tripleo17:03
apetrichmnaser, do you know the current rpc_response_timeout that is set?17:07
mnaserapetrich: the default, aka 60s17:08
apetrichmnaser, this doc suggests 120s https://access.redhat.com/solutions/3766991 not exactly the same issue but it might help17:09
mnaserbut also, if i bump that, then i'd have to bump the load balancers timeout as i think we kill requests that don't respond within 60s17:09
apetrichtrue :(17:09
apetrichI'm still looking around17:09
mnasercause right now, in this test we're trying, we're creating 10x ovb stacks (which is apparently 5 vms, 6 networks), includes a bunch of nested stacks, all at once17:10
mnaseri suspect that's quite the hit on heat, esp with the ovb stack having a bunch of nested stacks too17:10
apetrichmnaser, this https://bugzilla.redhat.com/show_bug.cgi?id=1394920#c8  using memcache with heat17:11
openstackbugzilla.redhat.com bug 1394920 in openstack-heat "Timeout error when heat stack-update is used for big cluster" [Unspecified,Closed: errata] - Assigned to zbitter17:11
ekultailsmnaser: Increasing API timeouts is something I'm working on that may help out https://review.opendev.org/#/c/738925/17:11
ekultailsYeah, like apetrich mentioned too, memcache can be a huge help. It's enabled by default on both the Undercloud and Overcloud in master.17:12
mnaserapetrich: wow, yeah, that looks like memcache can be a big driver at helping things.  it doesn't look like the current config has it enabled17:12
mnaseri'm doing a run right now, when its done, i'll enable memcache and we can see impact17:13
*** ayoung has quit IRC17:14
apetrichmnaser, good luck! and if you could ping us back with the results :)17:15
*** dtantsur is now known as dtantsur|afk17:15
mnaserlooks like stacks haven't fired up yet, so restarting it now quickly17:16
*** ayoung has joined #tripleo17:17
openstackgerritMerged openstack/tripleo-ansible master: tripleo_container_manage: only run exec/create playbooks when needed  https://review.opendev.org/73986317:17
mnaserapetrich, ekultails: oh man, just looking at heat-engine logs, it's haulin' ass.17:19
mnaserthere must have been something inside ussuri that had an impact which caused this to be more of an issue17:19
apetrichdang17:19
mnaserwe should really emit a warning if memcache is not enabled17:19
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-common master: First pass at script cleanup  https://review.opendev.org/73566117:20
sshnaidmmnaser, do ovb stacks have nested stacks?17:21
mnasersshnaidm: i don't know the architecture but i _think_ they do, if not, they use resource_registry which i think indiretly end up as a nested stack17:22
mnaserfor exmaple, i'm seeing this: Stack CREATE COMPLETE (baremetal_28486_2_11469-baremetal_env-5nzprxc5arjp-openstack_baremetal_servers-cenlvfzeq7qf-2-gzrie4znpece): Stack CREATE completed successfully17:22
mnaserthat to me looks like a bunch of nested stacks17:22
mwhahahayes it's nested stacks17:28
mwhahahain ovb17:28
*** ayoung has quit IRC17:29
*** ayoung has joined #tripleo17:30
mnaserok, straight 18 minutes consistently for all 10 stacks with 2/3 engines running, going to restart with 3/3 engines and see how it goes17:31
cloudnullmwhahaha so, the root cause is the new container images, and we need an update to make everything go?17:44
*** ayoung has quit IRC18:03
mwhahahacloudnull: yea the containers need to be updated. tbh i think we should always create a specific tag even if we don't update the container18:03
cloudnull++18:04
mwhahahacloudnull: i'm also concerned that we don't allow for non-kolla(tcib) containers to be updated using teh same methods18:04
mwhahahait's really container agnostic18:04
mwhahahaso it shouldn't matter18:04
*** ayoung has joined #tripleo18:04
mwhahahathat means the ceph images can't be patches as is for hotfixes if we ever needed to deploy a fix18:04
cloudnullthe hotfix commands shouldn't limit to only tcib? it's just using the container modify role18:05
mwhahaharight but it sems that we are limiting it somehow18:06
mwhahahahence this failure18:06
cloudnullhum...18:06
cloudnullthere is the labels things that EmilienM put up a review for , maybe that's all we need?18:06
mwhahahawell that's the thing that should let the containers be updated but I'm wondering if we should skip that logic all together18:08
mwhahahaor flip it so it's supported but off by default18:10
mwhahahait's really to limit what we update in the upstream18:11
cloudnullthats a good idea. flip the logic.18:13
cloudnullthat might make some configs in prod have unexpected outcomes?18:14
*** psahoo has quit IRC18:18
*** toure has joined #tripleo18:18
mwhahahano idea18:22
mwhahahai wouldn't think so18:22
mwhahahabecause usually updates are targeted18:22
mwhahahabut it might if someone just updates w/o an include/exclude18:22
*** bandini has quit IRC18:38
mwhahaharlandy|ruck: dlrn build failure didn't fail the job19:21
mwhahahahttps://ea8788c57611fc6d8389-47e48377f1dffd3fe508c717ba170ff0.ssl.cf2.rackcdn.com/730325/10/check/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates/a78a122/logs/delorean_logs/component/tripleo/3a/12/3a12a9fab702d022e759ad492ea3c365bbb3a60a_dev/rpmbuild.log.txt.gz19:21
rlandy|rucklooking19:22
rlandy|ruckmwhahaha: tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates on 730325 failed - but you're saying it should have failed before undercloud install?19:26
mwhahahayes19:26
mwhahahathe tripleoclient wasn't actually tested because the job didn't build the pkg19:26
mwhahahait failed, so it should have failed during build-test-packages but didn't19:27
mwhahahaso it ran through the thing and then failed because the tripleoclient was wrong19:27
mwhahaha2020-07-09 22:49:36.775424 | primary | TASK [build-test-packages : Run DLRN] ******************************************19:27
mwhahaha2020-07-09 22:49:36.775522 | primary | Thursday 09 July 2020  22:49:36 +0000 (0:00:02.166)       0:07:47.365 *********19:27
mwhahaha2020-07-09 22:55:31.010771 | primary | changed: [undercloud]19:27
mwhahahait ran dlrn but didn't error when the pkg failed to build19:27
rlandy|ruckyea - it did run build-test-packages ...19:28
mwhahahabuild-test-packages should fail if any package failes to build19:28
rlandy|ruck2020-07-13 16:36:57 | 2020-07-13 16:36:57,331 INFO:dlrn:137 packages not built correctly for component tripleo: not updating the consistent symlink19:28
rlandy|ruckok - checking those conditions19:28
holserEmilienM ^^^19:28
mwhahahathat being said, holser the error was because it didn't have https://review.opendev.org/#/c/736816/ If you rebased it, it shouldn't fail on it again19:33
mwhahahaif it's still failing for teh same reason that seems weird19:33
* mwhahaha checks latest failure19:34
mwhahahaok it built on the latest run19:35
*** maciejjozefczyk has quit IRC19:35
EmilienMholser: yes?19:35
mwhahahahttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_4b5/730325/11/check/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates/4b55c9b/logs/undercloud/home/zuul/dlrn.log19:36
mwhahahasame error tho19:36
mwhahahaEmilienM: we has pkg building problems in ci19:36
* mwhahaha runs away19:36
EmilienMlooking19:37
mwhahahalatest failure was for requests.exceptions.HTTPError: 429 Client Error: Too Many Requests for url: http://mirror.dfw.rax.opendev.org:8082/v2/tripleomaster/centos-binary-cron/blobs/sha256:a5446237b91ad3921ed2aab4dab0c0dfe25a7a71b2d5766ca329f4726d0c2ced though19:38
EmilienMwe had that issue last week19:39
EmilienMand we talked about it here19:39
EmilienMhttps://my1.fr/files/emilien-right-now-2.gif19:39
EmilienMI remember rlandy|ruck reported it to infra19:40
EmilienMnot sure if we got help on this one19:40
rlandy|ruckmwhahaha: EmilienM: we thought that error was related to the fact that we were promoting multiple times a day19:40
rlandy|ruckand that the external mirror were not keeping up19:41
rlandy|ruckwe dropped the promoter frequency so that there would not be so many retries and we would not be rate limited19:41
rlandy|ruckit was better for a while19:41
rlandy|ruckright now, there are real container access problem19:41
mwhahahaprobably too many jobs :(19:41
rlandy|ruckas vexxhost went down and we didn't push all containers19:42
rlandy|ruckthere is a main line/maste job running now that should promote on the next run19:42
rlandy|ruckmwhahaha: filed https://bugs.launchpad.net/tripleo/+bug/1887427. I"m add a patch to check the status of dlrn.log after build https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/build-test-packages/tasks/main.yml#L27019:44
openstackLaunchpad bug 1887427 in tripleo "TripleO CI jobs do not fail on package build errors" [Critical,Triaged] - Assigned to Ronelle Landy (rlandy)19:44
mwhahahawhy does this feel similar to the undercloud minion being successful despite the command erroring19:45
rlandy|ruckin this case, we register the output but we don't check it19:46
mwhahahabut it should have been a rc=1? right?19:46
rlandy|ruckor check the log for "packages not built correctly"19:47
mwhahahabut i don't think it's accurate19:47
mwhahahabecause it says it didn't build 137 packages but it should have built 119:47
rlandy|ruckthere are multiple logs here ...19:49
mwhahahasure i'll let someone else figure it out :D19:50
rlandy|ruckbut the error failure is clearly stated in https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_4b5/730325/11/check/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates/4b55c9b/logs/undercloud/home/zuul/dlrn.log19:50
mwhahahabut that's my point about the error being wrong19:51
mwhahahait seems like dlrn is not properly doing component builds19:51
mwhahahait's only supposed to build python tripleoclient19:51
mwhahahanot 137 packages so that seems misleading19:51
mwhahahain 11 the job built correctly (or should have)19:51
mwhahahabut i didn't see a gate repo configured but maybe it's configured on the update (which it failed before install for other reasons)19:52
*** shadower has quit IRC19:52
mwhahahahttps://ea8788c57611fc6d8389-47e48377f1dffd3fe508c717ba170ff0.ssl.cf2.rackcdn.com/730325/10/check/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates/a78a122/logs/undercloud/home/zuul/install_built_repo.log19:53
openstackgerritMerged openstack/tripleo-heat-templates stable/ussuri: Task should fail on any failure  https://review.opendev.org/74011119:53
mwhahahaseems weird because it failed to build19:53
* mwhahaha shrugs19:53
mwhahahasomething weird here19:53
rlandy|ruckalso - that should have built in multiple jobs of that change19:54
rlandy|ruckhttps://5f1da7ac3ae03b20f89d-6333727e8e4cab8f6cba85bb2fbb6639.ssl.cf2.rackcdn.com/730325/11/check/tripleo-ci-centos-8-undercloud-containers/d2db986/logs/undercloud/etc/yum.repos.d/gating.repo19:54
rlandy|ruck^^ gating repo19:54
rlandy|ruck2020-07-13 16:08:02 | 2020-07-13 16:08:02,932 INFO:dlrn:137 packages not built correctly for component tripleo: not updating the consistent symlink19:55
rlandy|ruck^^ you're right19:55
rlandy|ruckthat's errors19:55
rlandy|ruckand never fails19:55
*** shadower has joined #tripleo19:55
rlandy|ruckprobably because that job doesn't tickle the change19:55
mwhahahanow for update jobs techincally the update should probably test the change on the update phase but something weird is going on19:56
rlandy|ruck2020-07-13 18:33:14 | 2020-07-13 18:33:14,563 INFO:dlrn:137 packages not built correctly for component tripleo: not updating the consistent symlink is everywhere19:57
rlandy|ruckrandom other job ...19:57
rlandy|ruckhttps://401a91287b54112958ae-96bca91b8ac8416a48bc1ab248a7deaf.ssl.cf2.rackcdn.com/738606/1/check/tripleo-ci-centos-8-undercloud-containers/fb6ab77/logs/undercloud/home/zuul/dlrn.log19:57
mwhahahayea i think that error is misleading19:58
mwhahahawhat's missing is if the pkg itself fails to build19:58
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Deprecate validate-tempest skiplist  https://review.opendev.org/74066420:04
rlandy|ruckthere a ton of errors in rpmbuild.log20:04
rlandy|ruckbeagles: hi - what's the status of https://review.opendev.org/#/c/739981/ and https://review.opendev.org/#/c/738488/?20:16
rlandy|ruckWe see the policy failures on scenario010 in the main line ... https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario010-standalone-master/4f059ba/logs/undercloud/var/log/tempest/stestr_results.html.gz20:16
rlandy|ruckhttps://bugs.launchpad.net/tripleo/+bug/1885602 says component pipeline only20:18
openstackLaunchpad bug 1885602 in tripleo "Octavia component: failing tempest, Details: {'faultcode': 'Client', 'faultstring': 'Policy does not allow this request to be performed.'," [Critical,Triaged] - Assigned to Brent Eagles (beagles)20:18
rlandy|ruckbut this hit the main line now20:18
*** maciejjozefczyk has joined #tripleo20:19
*** xek has joined #tripleo20:22
*** boazel_ has joined #tripleo20:30
rlandy|ruckmwhahaha: ^^ could you review https://review.opendev.org/#/c/738488/ and https://review.opendev.org/#/c/739981/ (scenario010 tempest failure)20:31
rlandy|ruckcard says "Upstream fix to unblock gates is waiting for reviews"20:32
*** boazel has quit IRC20:32
EmilienMrlandy|ruck: https://review.opendev.org/#/c/739981/ has a nit20:35
EmilienMwhich I just fixed20:36
*** maciejjozefczyk has quit IRC20:36
rlandy|ruckEmilienM: thanks20:37
openstackgerritDouglas Mendizábal proposed openstack/tripleo-heat-templates master: Add new Luna HSM parameters for Barbican  https://review.opendev.org/72562220:37
openstackgerritSteve Baker proposed openstack/tripleo-ansible master: Capture metalsmith python logging  https://review.opendev.org/74060620:38
openstackgerritDouglas Mendizábal proposed openstack/tripleo-heat-templates master: Add new Luna HSM parameters for Barbican  https://review.opendev.org/72562220:48
*** ccamacho has quit IRC20:52
*** raildo has quit IRC21:10
*** raildo has joined #tripleo21:11
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/ussuri: tripleo_container_manage: only run exec/create playbooks when needed  https://review.opendev.org/74081021:16
*** raildo has quit IRC21:17
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/train: tripleo_container_manage: only run exec/create playbooks when needed  https://review.opendev.org/74081121:17
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/ussuri: Add a new callback: tripleo_states  https://review.opendev.org/74081221:19
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/train: Add a new callback: tripleo_states  https://review.opendev.org/74081321:19
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/ussuri: tripleo_states: add missing space  https://review.opendev.org/74081421:19
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/train: tripleo_states: add missing space  https://review.opendev.org/74081721:20
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible stable/train: Introduce an Action Plugin to fetch container infos  https://review.opendev.org/74081821:24
*** TrevorV has quit IRC21:28
*** TrevorV has joined #tripleo21:31
*** TrevorV has quit IRC21:32
openstackgerritMerged openstack/tripleo-common stable/ussuri: (TCIB) Remove validation related things from mistral container  https://review.opendev.org/74025722:04
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Task should fail on any failure  https://review.opendev.org/74011222:04
openstackgerritMerged openstack/python-tripleoclient master: Rename UpgradeConvergeOvercloud into UpgradeConverge.  https://review.opendev.org/73671122:04
rlandy|ruckyay - merges22:24
*** rlandy|ruck is now known as rlandy|bbl22:34
*** tosky has quit IRC22:42
*** tkajinam has joined #tripleo22:54
*** ayoung has quit IRC23:06
*** ayoung has joined #tripleo23:08
*** rcernin has joined #tripleo23:08
*** boazel_ has quit IRC23:10
*** boazel has joined #tripleo23:14
*** hoonetorg has quit IRC23:24
*** holser has quit IRC23:33
*** holser has joined #tripleo23:33
*** holser has quit IRC23:34
*** elGamal has quit IRC23:34
*** elGamal has joined #tripleo23:34
*** holser has joined #tripleo23:34
*** holser has quit IRC23:36
*** holser has joined #tripleo23:38
*** hoonetorg has joined #tripleo23:38
*** xek has quit IRC23:40

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!