Wednesday, 2018-10-24

*** hamzy has joined #tripleo00:05
*** mjturek has quit IRC00:07
*** jbadiapa has quit IRC00:08
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791800:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819500:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]00:10
*** jbadiapa has joined #tripleo00:11
*** slaweq has joined #tripleo00:12
*** salmankhan has quit IRC00:12
larsksWhen configuring fencing, is the value of pcmk_host_list supposed to be a real hostname ("myhost-rack-2-datacenter-0") or something like "overcloud-controller-1"? I'm having a hard time finding the appropriate docs.  There are examples that show overcloud-controller-<n>, but pacemaker knows the hosts by their real name.00:20
*** trungnv has quit IRC00:25
*** trungnv has joined #tripleo00:25
*** sanjayu_ has quit IRC00:38
*** slaweq has quit IRC00:45
*** phuongnh has joined #tripleo01:01
*** medberry has quit IRC01:02
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791801:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819501:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819801:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)01:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]01:10
openstackLaunchpad bug 1798198 in tripleo "pip installs failing in rdo-cloud based jobs" [Critical,In progress]01:10
*** slaweq has joined #tripleo01:12
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Turn on quiet mode when logfile specified  https://review.openstack.org/61286501:17
*** mrsoul has joined #tripleo01:17
*** mschuppert has quit IRC01:21
trungnvHi everybody, Quite hard to setup undercloud with quickstart guide.01:22
trungnvI am running "./quickstart.sh --release queens   --no-clone --clean --tags untagged,provision,environment,undercloud-scripts -e supported_distro_check=false -e @overrides.yaml --teardown all 192.168.122.100"01:23
trungnvThen got Completed status. But I can not see undercloud in virsh list.01:24
trungnvPlease suggest me any solution for this issue. Thanks01:25
larskstrungnv: no solution for you, but you might want to ask on the tripleo-quickstart channel, #oooq.01:32
*** huynq has joined #tripleo01:32
trungnvlarsks, Thank you.01:33
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Fix epel repo rewrite, add to testing  https://review.openstack.org/61263601:43
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Turn on quiet mode when logfile specified  https://review.openstack.org/61286501:43
*** slaweq has quit IRC01:44
openstackgerritMerged openstack/tripleo-common stable/rocky: write_config: force utf8  https://review.openstack.org/61250901:45
*** itlinux has quit IRC01:46
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791802:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819502:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819802:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]02:10
openstackLaunchpad bug 1798198 in tripleo "pip installs failing in rdo-cloud based jobs" [Critical,In progress]02:10
*** slaweq has joined #tripleo02:11
tonybstevebaker: Are you around?02:22
tonybstevebaker: Oh nm I worked it out, I've caught by 179819502:25
*** slaweq has quit IRC02:44
*** jcoufal has quit IRC02:50
*** ade_lee has joined #tripleo02:52
openstackgerritTony Breeds proposed openstack/python-tripleoclient master: Add AdditionalArchitectures when configured  https://review.openstack.org/61287302:52
*** sambetts|afk has quit IRC02:56
*** psachin has joined #tripleo02:56
*** sambetts_ has joined #tripleo03:00
*** mmethot has quit IRC03:00
*** mmethot has joined #tripleo03:01
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791803:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819503:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819803:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]03:10
openstackLaunchpad bug 1798198 in tripleo "pip installs failing in rdo-cloud based jobs" [Critical,In progress]03:10
*** slaweq has joined #tripleo03:11
*** slaweq has quit IRC03:45
*** ramishra has joined #tripleo03:49
*** udesale has joined #tripleo03:50
*** udesale has quit IRC03:50
*** sanjayu_ has joined #tripleo03:50
*** udesale has joined #tripleo03:51
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791804:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819504:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819804:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]04:10
openstackLaunchpad bug 1798198 in tripleo "pip installs failing in rdo-cloud based jobs" [Critical,In progress]04:10
*** slaweq has joined #tripleo04:12
*** janki has joined #tripleo04:23
*** spsurya has joined #tripleo04:24
jankiHi. Can I have some reviews for https://review.openstack.org/#/c/612237/ (cherry-pick) and https://review.openstack.org/#/c/612663/04:24
jankimandre, jaosorior marios EmilienM ^04:25
*** tzumainn has quit IRC04:43
*** slaweq has quit IRC04:45
*** agopi has quit IRC04:45
*** ykarel has joined #tripleo04:46
*** agopi has joined #tripleo04:47
openstackgerritSteve Baker proposed openstack/tripleo-common master: Support v1 container image manifests  https://review.openstack.org/61288204:56
*** ratailor has joined #tripleo04:57
Tenguhello there :)05:02
*** chkumar|off is now known as chandankumar05:03
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Added support for installing tempest plugins from git  https://review.openstack.org/61237705:09
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791805:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819505:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819805:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)05:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]05:10
openstackLaunchpad bug 1798198 in tripleo "pip installs failing in rdo-cloud based jobs" [Critical,In progress]05:10
chandankumarjaosorior: Tengu quiquell|off \o/05:11
chandankumarjaosorior: Tengu we need https://review.openstack.org/#/c/612800/2 and then this https://review.openstack.org/#/c/605523/405:11
chandankumari mean +w05:11
*** slaweq has joined #tripleo05:11
Tengucan't +w :/05:11
Tengutoo young probably ;)05:11
chandankumarTengu: :-)05:11
Tengubut eventually it will come, I will get great powers and use them wisely ☺05:12
*** rlandy|bbl has quit IRC05:21
*** ramishra has quit IRC05:34
*** jfrancoa has joined #tripleo05:34
*** Petersingh has joined #tripleo05:37
*** ramishra has joined #tripleo05:39
*** slaweq has quit IRC05:44
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Add tripleo-heat-templates dir to Mistral volumes  https://review.openstack.org/61101105:45
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Use different base virtual_router_id on openshift  https://review.openstack.org/61224905:45
*** sshnaidm|pto is now known as sshnaidm|ruck05:45
*** waleedm has joined #tripleo05:50
*** ksambor has joined #tripleo05:52
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Fixed stackviz report for standalone  https://review.openstack.org/61261806:01
chandankumarsshnaidm|ruck: jaosorior https://review.openstack.org/#/c/612245/4 this one is also needed for puppet-swift standalone06:03
*** Petersingh has quit IRC06:05
*** Petersingh has joined #tripleo06:06
sshnaidm|ruckchandankumar, +206:07
chandankumarsshnaidm|ruck: thanks :-)06:07
Tenguerf... great. neutron_dhcp podman container doesn't seem to restart properly. yay.06:07
*** cylopez has joined #tripleo06:08
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791806:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819506:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819806:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)06:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]06:10
openstackLaunchpad bug 1798198 in tripleo "pip installs failing in rdo-cloud based jobs" [Critical,In progress]06:10
*** cylopez has left #tripleo06:10
*** slaweq has joined #tripleo06:11
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Add podman support to validate-tempest role  https://review.openstack.org/60535606:13
Tenguo____O06:13
Tengu"process_linux.go:399: container init caused \"rootfs_linux.go:58: mounting \\\"/run/netns\\\" to rootfs \\\"/var/lib/containers/storage/overlay/e47e9af7dce15c48556563fd65c4fdd3b76504c8babe887ebaa6875b75e3cabc/merged\\\" at \\\"/run/netns\\\" caused \\\"stat /run/netns: no such file or directory\\\"\""06:13
openstackgerritPranali Deore proposed openstack/tripleo-heat-templates master: Move metadata file creation for netapp to puppet-tripelo from THT  https://review.openstack.org/58813206:15
*** numans has joined #tripleo06:16
*** artom has quit IRC06:18
*** mschuppert has joined #tripleo06:18
chandankumarsshnaidm|ruck: these two needs +w https://review.openstack.org/612800 then this https://review.openstack.org/60552306:19
chandankumarfor standalone06:19
Tengufuu... /run/netns doesn't exist until we actually create a namespace.06:19
*** artom has joined #tripleo06:20
*** quiquell|off is now known as quiquell06:21
quiquellchandankumar, Tengu: o/06:22
chandankumar\o/\/|06:22
Tengu/o\06:22
Tenguyay... happy to see I have hit another issue with the way podman manages volumes -.-.06:28
quiquellTengu the hitman06:29
Tenguquiquell: ^^ at least I expend my knowledge on "some" topics. Now it's neutron06:30
chandankumaralias Tengu="hitman" :-)06:31
Tengucall me 4206:31
quiquellThe answer of everything06:31
Tenguamong other things :)06:32
*** mmagr has joined #tripleo06:32
chandankumarIs it Agent 47 na?06:32
Tenguin the game/movie, yeah. but 47 is just a prime number. nothing fancy06:33
Tengu42 is more... well, ya know. a whole thing )06:33
chandankumar:-)06:33
Tengu(so now, who's going to learn how paunch manages its containers in order to add some stuff in systemd? it's-a me, Tengu)06:34
*** aedc has quit IRC06:41
*** aedc has joined #tripleo06:41
*** aedc has quit IRC06:46
*** aedc has joined #tripleo06:47
*** ccamacho has joined #tripleo06:47
*** waleedm has quit IRC06:51
*** holser_ has joined #tripleo06:51
*** holser_ has quit IRC06:51
*** aedc has quit IRC06:52
*** holser_ has joined #tripleo06:52
*** yprokule has joined #tripleo07:00
Tengucan anyone point me the repository for the "paunch-services" package? Apparently it's not in the "paunch" repository, and I'm unable to find a "paunch-services" on the github mirror - maybe I'm missing something?07:01
*** rcernin has quit IRC07:03
jaosoriorpaunch-services?07:04
Tenguyeah07:04
jaosoriorTengu: well... it's not under openstack at all https://review.openstack.org/#/admin/projects/?filter=paunch07:05
Tenguit has a systemd unit file and some other things related, and I'm interested in it in order to inject a new unit.07:05
*** artom has quit IRC07:05
ykarelTengu, that's a subpackage07:05
Tenguand it comes from dlrn, that's for sure.07:05
*** pcaruana has joined #tripleo07:06
Tenguykarel: ok.. and where is it defined? )07:06
ykarelTengu, https://github.com/rdo-packages/paunch-distgit/blob/rpm-master/python-paunch.spec#L10207:06
Tengu:)07:06
Tenguoh.07:06
Tenguok. so I must push a change there. thank you ykarel07:06
Tenguykarel: in order to push changes for that, it's not on the gerrit.openstack.org right?07:07
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Skip hosts group in ceph-ansible inventory when all are blacklisted  https://review.openstack.org/61073607:07
*** artom has joined #tripleo07:07
ykarelTengu, https://review.rdoproject.org/r/#/dashboard/self07:08
Tenguah, great, thanks!07:08
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Skip hosts group in ceph-ansible inventory when all are blacklisted  https://review.openstack.org/61073607:08
jaosoriormschuppert: hey! how's it going? Do you need any help with the fixes to vendordata?07:09
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791807:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819507:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819807:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)07:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]07:10
openstackLaunchpad bug 1798198 in tripleo "pip installs failing in rdo-cloud based jobs" [Critical,In progress]07:10
mschuppertjaosorior: hi, morning. I run some furhter tests and submit the patches for review during the morning. will let you know when done.07:11
jaosoriormschuppert: sure, thanks. Let me know if you need any help07:12
*** threestrands has quit IRC07:13
*** ykarel is now known as ykarel|lunch07:20
*** waleedm has joined #tripleo07:21
*** agurenko has joined #tripleo07:21
*** amoralej|off is now known as amoralej07:25
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Python 3 compatibility: fix has_key  https://review.openstack.org/61037007:29
bandinisimple one ^07:29
*** hberaud has joined #tripleo07:43
*** hberaud has quit IRC07:43
*** hberaud has joined #tripleo07:44
*** jpena|off is now known as jpena07:48
*** shyamb has joined #tripleo07:50
shyambHi07:51
*** tosky has joined #tripleo07:52
openstackgerritNguyen Quang Huy proposed openstack/tripleo-quickstart master: Correct word in document  https://review.openstack.org/61293807:52
shyambWe are facing issue on overcloud deployment07:53
shyambcontrol node is not pingable07:53
shyambhttp://paste.openstack.org/show/732941/07:54
shyambcompute node is working fine07:54
shyambAny idea?07:54
shyambTengu: shardy:07:54
openstackgerritDaniel Alvarez proposed openstack/tripleo-quickstart master: DNM: Change featureset030 to work with ML2/OVS  https://review.openstack.org/61165307:56
*** shyamb has quit IRC07:58
*** shyamb has joined #tripleo07:59
openstackgerritUdi Kalifon proposed openstack/tempest-tripleo-ui master: Selenium infra  https://review.openstack.org/60542407:59
*** Petersingh is now known as Petersingh|lunch07:59
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO  https://review.openstack.org/60429308:00
*** jpich has joined #tripleo08:01
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Revert "Revert "Convert *tasks from bootstrap_nodeid to short_bootstrap_node_name""  https://review.openstack.org/61180008:01
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Skip hosts group in ceph-ansible inventory when all are blacklisted  https://review.openstack.org/61073608:04
jbadiapajrist, ping https://review.openstack.org/#/c/611371/08:09
openstackgerritDaniel Alvarez proposed openstack/tripleo-heat-templates master: Switch default neutron ML2 mechanism driver to OVN  https://review.openstack.org/59305608:09
*** shyamb has quit IRC08:09
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791808:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819508:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819808:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]08:10
openstackLaunchpad bug 1798198 in tripleo "pip installs failing in rdo-cloud based jobs" [Critical,In progress]08:10
openstackgerritDaniel Alvarez proposed openstack/tripleo-heat-templates master: Switch default neutron ML2 mechanism driver to OVN  https://review.openstack.org/59305608:12
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Function to apply workarounds  https://review.openstack.org/61260608:12
chemmarios: hi, I've got timeout on tripleo-ci-centos-7-scenario002-multinode-oooq-container in the gate during "Deploy the overcloud", I just recheck or is there something going on ?08:12
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Function to apply workarounds  https://review.openstack.org/61260608:13
*** ramishra has quit IRC08:16
*** ramishra has joined #tripleo08:17
*** bogdando has joined #tripleo08:18
*** akrivoka has joined #tripleo08:21
openstackgerritCarlos Goncalves proposed openstack/tripleo-heat-templates stable/queens: Remove NeutronServicePlugins from octavia environment files  https://review.openstack.org/60716908:22
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Fix variables for workaround variables.  https://review.openstack.org/61260708:23
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Allow specify Ceph upgrade workarounds.  https://review.openstack.org/61260808:23
*** gfidente has joined #tripleo08:23
*** ykarel|lunch is now known as ykarel08:28
*** akrivoka has quit IRC08:31
*** akrivoka has joined #tripleo08:32
*** derekh has joined #tripleo08:39
marioschem: o/ not sure man haven't been checking/looking there rfolco|rucker and sshnaidm|ruck are on it this sprint08:40
mariossshnaidm|ruck: anything known here? 11:12 < chem> marios: hi, I've got timeout on tripleo-ci-centos-7-scenario002-multinode-oooq-container in the gate during "Deploy the overcloud", I just  recheck or is there something going on ?08:40
chemmarios: ack, thanks08:41
chemsshnaidm|ruck: hi, so 001 timeout there https://review.openstack.org/#/c/612637/ (rocky)08:42
jistrmarios, panda, sshnaidm|ruck: can you please review here? currently CI works but "blank" dev deploys are broken. Looks like weshay's -1 there comes from misunderstanding, AFAICT. https://review.openstack.org/#/c/611601/08:42
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Log paunch configuration steps to a file  https://review.openstack.org/61294808:43
*** shyamb has joined #tripleo08:43
mariosjistr: ack noted for later08:43
jistrthanks08:43
chemsshnaidm|ruck: and 001 time out there https://review.openstack.org/#/c/612637/ (rocky as well)08:44
*** Petersingh|lunch is now known as Petersingh08:52
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Function to apply workarounds  https://review.openstack.org/61260608:57
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Fix variables for workaround variables.  https://review.openstack.org/61260708:57
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Allow specify Ceph upgrade workarounds.  https://review.openstack.org/61260808:57
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Use dnf and python3 on platforms where these are default  https://review.openstack.org/61267708:58
openstackgerritBogdan Dobrelya proposed openstack/paunch master: Fix labels to take multiple values  https://review.openstack.org/61129808:59
openstackgerritBogdan Dobrelya proposed openstack/paunch master: Add missing default-runtime support bits  https://review.openstack.org/60863208:59
openstackgerritBogdan Dobrelya proposed openstack/paunch master: Speed up getting the container name  https://review.openstack.org/61131208:59
openstackgerritBogdan Dobrelya proposed openstack/paunch master: Intoduce caching of podman ps calls in BaseRunner  https://review.openstack.org/61191108:59
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Fix EXTRA_VARS calculation for env_vars_to_source_file.  https://review.openstack.org/61295509:05
*** salmankhan has joined #tripleo09:06
*** sambetts_ is now known as sambetts|afk09:07
*** kopecmartin|off is now known as kopecmartin09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791809:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819509:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819809:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)09:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]09:10
openstackLaunchpad bug 1798198 in tripleo "pip installs failing in rdo-cloud based jobs" [Critical,In progress]09:10
openstackgerritCarlos Goncalves proposed openstack/ansible-role-tripleo-modify-image master: Use with_list for Ansible < 2.5 compatibility  https://review.openstack.org/61296009:21
openstackgerritMartin André proposed openstack/tripleo-common master: Add container images for openshift 3.11  https://review.openstack.org/61066309:22
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Update to OpenShift 3.11 release  https://review.openstack.org/61068209:27
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: DNM: Testing neutron/OVN rootwrap containers  https://review.openstack.org/60994709:28
*** dtantsur|afk is now known as dtantsur09:34
*** Petersingh is now known as Petersingh|mtg09:35
*** shyamb has quit IRC09:37
*** shyamb has joined #tripleo09:37
*** markmc has joined #tripleo09:38
openstackgerritMartin Schuppert proposed openstack/puppet-tripleo master: Add nova::vendordata to nova compute  https://review.openstack.org/61296509:41
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Fixed stackviz report for standalone  https://review.openstack.org/61261809:46
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Enable full tempest api and scenario tests for basic services  https://review.openstack.org/60604609:46
openstackgerritMartin Schuppert proposed openstack/tripleo-heat-templates master: Fix novajoin nova vendordata hieradata keys  https://review.openstack.org/61230709:52
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Log paunch configuration steps to a file  https://review.openstack.org/61294809:54
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: DNM: Testing neutron/OVN rootwrap containers  https://review.openstack.org/60994709:54
*** panda has quit IRC09:54
mschuppertjaosorior: https://review.openstack.org/612964 , https://review.openstack.org/612965 and https://review.openstack.org/61230709:54
*** panda has joined #tripleo09:55
jaosoriormschuppert: commented already :D09:55
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Make browbeat dependency optional  https://review.openstack.org/61297509:59
jaosoriormschuppert: thanks for the changes09:59
openstackgerritUdi Kalifon proposed openstack/tempest-tripleo-ui master: Selenium infra  https://review.openstack.org/60542410:02
jaosoriormschuppert: OK, lets wait for feedback from the puppet folks and see what they say10:03
mschuppertjaosorior: ack, I'll add some to review.10:05
*** iurygregory is now known as iury|lunch10:07
openstackgerritMartin Schuppert proposed openstack/tripleo-heat-templates master: Fix novajoin nova vendordata hieradata keys  https://review.openstack.org/61230710:09
*** huynq has quit IRC10:10
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791810:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819510:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819810:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]10:10
openstackLaunchpad bug 1798198 in tripleo "pip installs failing in rdo-cloud based jobs" [Critical,In progress]10:10
larsksHey folks. ovsdb on my compute nodes seems to have died or never got started in the first place...yet a stack update just completed successfully, despite errors from pupppet.  Does any of this sound familiar? This is a queens based deployment.10:10
*** shyamb has quit IRC10:14
*** shyam89 has joined #tripleo10:14
openstackgerritPablo Iranzo Gómez proposed openstack/tripleo-common master: Replace simple var usage  to  https://review.openstack.org/61297710:18
*** shyam89 has quit IRC10:18
openstackgerritPablo Iranzo Gómez proposed openstack/tripleo-common master: Replace simple $var usage to ${var}  https://review.openstack.org/61297710:19
openstackgerritCarlos Goncalves proposed openstack/tripleo-heat-templates stable/queens: Remove NeutronServicePlugins from octavia environment files  https://review.openstack.org/60716910:22
*** chem has quit IRC10:24
*** hberaud has quit IRC10:24
*** hberaud has joined #tripleo10:25
*** chem has joined #tripleo10:25
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Add the possibility to create more than one stack with reproducer.  https://review.openstack.org/61297910:26
*** quiquell has quit IRC10:29
*** quiquell has joined #tripleo10:30
sshnaidm|ruckjistr, fine with me, now even better to see in which release which feature was enabled :)10:30
*** phuongnh has quit IRC10:32
*** caboucha has joined #tripleo10:44
*** shyamb has joined #tripleo10:45
*** iury|lunch is now known as iurygregory10:45
jistrsshnaidm|ruck: thanks10:54
derekhI'm trying to use the reproducer-quickstart.sh script here http://logs.openstack.org/94/582294/14/check/tripleo-ci-centos-7-scenario012-multinode-oooq-container/fd7419b/logs/10:55
derekhbut hitting "2018-10-24 09:15:51 | Exception: <urlopen error [Errno 2] No such file or directory: '/home/zuul/tripleo-heat-installer-templates/environments/ssl/no-tls-endpoints-public-ip.yaml'>10:55
derekh"10:55
derekhathis didn't happen in the CI job I'm tryin to reproduce, any ideas ?10:55
sshnaidm|ruckderekh, hmm.. this file exists http://logs.openstack.org/94/582294/14/check/tripleo-ci-centos-7-scenario012-multinode-oooq-container/fd7419b/logs/undercloud/home/zuul/tripleo-heat-installer-templates/environments/ssl/10:58
sshnaidm|ruckderekh, do you have this directory on your node in reproducer?10:59
derekhsshnaidm|ruck: stand by, its running again (shouldn't take long)11:01
*** udesale has quit IRC11:01
jaosoriorsshnaidm|ruck: the zuul queue seems quite worrying. are we dealing with timeouts again?11:03
sshnaidm|ruckjaosorior, yes11:05
sshnaidm|ruckjaosorior, I see container prepare tasks take a long, but still checking..11:05
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791811:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819511:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)11:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]11:10
*** ratailor has quit IRC11:10
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Use Jinja2 macro to remove redundancy in workarounds.sh.j2.  https://review.openstack.org/61298711:14
*** dprince has joined #tripleo11:26
derekhsshnaidm|ruck: nope, don't have the file but I do have it in the parent directory, I guess I have a old version of t-h-t and a new version of tripleoclient https://review.openstack.org/#/c/607815/2/tripleoclient/v1/undercloud_config.py11:29
derekhsshnaidm|ruck: which suggest the reproducer script isn't reproducing11:30
*** shyamb has quit IRC11:30
jaosoriorderekh: that sounds about right. It's not grabbing the latest t-h-t then11:32
derekhjaosorior: yup11:33
sshnaidm|ruckderekh, what exactly does clone tht?11:33
derekhsshnaidm|ruck: not sure, I just run the reproducer script and expect it to work, will see if I can find out11:34
*** jpena is now known as jpena|lunch11:36
derekhjaosorior: sshnaidm|ruck: Oh a patch I'd depending on is in t-h-t, I guess I need to rebase it, so I wonder if the difference is that zuul rebases patches before running ci but the reproducer script doesn't11:37
sshnaidm|ruckderekh, maybe some problem with setting release/versions, didn't see it before, but I didn't reproduce this job also11:38
openstackgerritDerek Higgins proposed openstack/tripleo-heat-templates master: Add scenario 012 - overlcoud baremetal+ansible-ml2  https://review.openstack.org/57960311:38
jaosoriorderekh: that's a good theory. Let me know if rebasing it does the trick11:38
derekhjaosorior: will do11:38
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Fix pip installation  https://review.openstack.org/61264911:38
Tenguhey, anyone from Paunch can confirm this patch? https://review.rdoproject.org/r/#/c/17078/11:38
TenguThat would be really cool :).11:39
sshnaidm|ruckderekh, I put a patch recently that makes reproducer to rebase everything11:39
sshnaidm|ruckderekh, https://review.openstack.org/#/c/599460/11:40
jaosoriorTengu: so that always creates a placeholder namespace? wouldn't it make sense to clean it up too?11:40
Tengujaosorior: well, it's cleaned upon reboot anyway.11:40
jaosorioruhm...11:40
sshnaidm|ruckderekh, but may be some problems with dependencies.. not sure if it clone dependent changes correctly, need to check this firstly11:40
Tenguthe main goal is to get that bloody /var/netns directory with the right flags/rights11:41
Tengujaosorior: not sure if the directory is kept if no more netns exist though.11:41
jaosoriorTengu: just thinking that seeing a placeholder namespace might confuse folks looking at the environment.11:41
derekhsshnaidm|ruck: jaosorior ack, I'll let ye know of that ^^ rebase helps11:41
Tengujaosorior: lemme check what happens if I add an ExecStop=ip netns delete placeholder - the oneshot will call it anyway.11:42
Tenguerf... launched a "reboot" once more.... pff.11:44
Tenguanyway. apparently it's still working.11:44
sshnaidm|ruckderekh, thanks, if it doesn't - you can submit a LP and assign to me11:45
derekhsshnaidm|ruck: ack, thanks11:45
Tenguyeah, still working.11:46
jaosoriorcool cool11:46
Tengujaosorior: change updated :). (cc bogdando for your +1 on https://review.rdoproject.org/r/#/c/17078/ :) )11:47
*** ansmith has quit IRC11:48
Tenguso, that's already a good thing. This will ensure neutron container actually DO start upon reboot.11:48
Tengubut this doesn't correct the fact the network namespace is broken.11:49
Tengu(yeah, the one created by neutron)11:49
jaosoriorTengu: why not execute the delete on ExecStartPost ?11:49
Tengujaosorior: a oneshot does the ExecStop anyway11:49
jaosoriorah11:49
jaosoriorhadn't noticed it's a oneshot11:49
jaosoriorgot it11:49
jaosoriorthanks11:49
Tenguit runs the whole process PreStart, Start, and so on :)11:49
jaosoriorack11:50
jaosorior+1ed11:50
Tenguthanks!11:50
jaosoriornow we need someone will real powers :D11:50
Tenguykarel maybe? :)11:50
Tengunot sure who can do the needed nudge.11:50
jaosoriormaybe EmilienM and mwhahaha11:51
Tengujaosorior: EmilienM just pushed a +211:51
jaosorioryay11:51
jaosoriorthanks EmilienM11:51
jaosoriorEmilienM: let me know when you have time, I have some questions for you11:51
EmilienMnp :)11:51
*** raildo has joined #tripleo11:51
EmilienMjaosorior: ask them, I'll reply when I can :)11:51
ykarelTengu, ack11:51
*** shyamb has joined #tripleo11:52
Tenguykarel: :) thank you11:55
ykarelTengu, just to be safe good to add dependency on iproute package11:56
ykarelcommenting11:56
Tenguykarel: hm, should be installed anyway, I think podman/docker depend on it11:56
ykarelTengu, /me not sure11:57
*** rh-jelabarre has joined #tripleo11:57
Tenguwell, adding the dependency won't hurt anyway.11:57
ykarelexplicit should be good11:57
*** shyamb has quit IRC11:58
Tenguykarel: so I just have to add a "Requires: iproute" ?11:58
ykarelTengu, yes11:58
Tenguand this for the sub-package "paunch-services" in order to be clean.11:59
ykarelyeah11:59
*** trown|outtypewww is now known as trown11:59
Tenguykarel: updated :).12:00
Tenguthanks for your review12:00
ykarelTengu, +212:00
Tengucool :)12:01
openstackgerritCarol Bouchard proposed openstack/tripleo-heat-templates master: CiscoNexus: Update and Remove deprecated vars  https://review.openstack.org/60695812:04
openstackgerritChristophe Fontaine proposed openstack/tripleo-heat-templates stable/rocky: Fix NeutronSriovHostConfig path for ODL deployment with SRIOV  https://review.openstack.org/61299812:05
openstackgerritChristophe Fontaine proposed openstack/tripleo-heat-templates master: Per role Numa aware vswitch configuration  https://review.openstack.org/61271912:06
*** haleyb has quit IRC12:07
openstackgerritChristophe Fontaine proposed openstack/tripleo-heat-templates stable/rocky: Per role Numa aware vswitch configuration  https://review.openstack.org/61300012:08
*** amoralej is now known as amoralej|lunch12:08
*** haleyb has joined #tripleo12:08
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Add podman support to validate-tempest role  https://review.openstack.org/60535612:10
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791812:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819512:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]12:10
*** hjensas has quit IRC12:10
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Skip hosts group in ceph-ansible inventory when all are blacklisted  https://review.openstack.org/61073612:10
*** Petersingh|mtg is now known as Petersingh12:12
*** udesale has joined #tripleo12:17
*** quiquell is now known as quiquell|lunch12:19
*** udesale has quit IRC12:25
openstackgerritKamil Sambor proposed openstack/puppet-tripleo stable/pike: Restart ovs agent to restore rules  https://review.openstack.org/61093612:30
*** rlandy has joined #tripleo12:31
*** abishop has joined #tripleo12:31
*** rfolco|rucker is now known as rfolco|rover12:34
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Enable support for running refstack tests in TQE  https://review.openstack.org/57071912:35
*** jpena|lunch is now known as jpena12:37
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: Fix path for the SELinux service  https://review.openstack.org/61300312:39
*** jrist has quit IRC12:40
*** dmacpher__ has quit IRC12:48
*** dmacpher__ has joined #tripleo12:48
openstackgerritUdi Kalifon proposed openstack/tempest-tripleo-ui master: Selenium infra  https://review.openstack.org/60542412:48
ssbarneamwhahaha: f28 https://review.openstack.org/#/c/612677/ if you have time.12:48
openstackgerritFlorian Fuchs proposed openstack/tripleo-heat-templates master: Create default deployment plan  https://review.openstack.org/61130512:50
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Function to apply workarounds  https://review.openstack.org/61260612:55
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Fix variables for workaround variables.  https://review.openstack.org/61260712:55
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Allow specify Ceph upgrade workarounds.  https://review.openstack.org/61260812:55
jaosoriorwhat's up with the ansible-role-openstack-operations repo? anybody knows what that is?12:56
jaosoriorsame with ansible-role-redhat-subscription ?12:56
jaosoriornevermind ansible-role-redhat-subscription12:56
openstackgerritMehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates stable/rocky: ceilometer: --skip-metering-database is gone  https://review.openstack.org/61300912:56
jaosoriorbut the question still stands for ansible-role-openstack-operations12:56
*** morazi has joined #tripleo12:57
*** ansmith has joined #tripleo12:57
openstackgerritMehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates stable/queens: ceilometer: --skip-metering-database is gone  https://review.openstack.org/61301012:57
*** huynq has joined #tripleo12:57
*** mcornea has joined #tripleo12:58
*** bnemec has joined #tripleo13:04
*** dtantsur has quit IRC13:04
*** hberaud has quit IRC13:06
openstackgerritBogdan Dobrelya proposed openstack/puppet-tripleo master: Fix wrapper containers for podman w/o sockets  https://review.openstack.org/60609513:07
*** dtantsur has joined #tripleo13:09
*** lblanchard has joined #tripleo13:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791813:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819513:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)13:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]13:10
openstackgerritJose Luis Franco proposed openstack/tripleo-common stable/pike: [Pike Only] Remove comment related to namespace variable.  https://review.openstack.org/61301313:10
*** hberaud has joined #tripleo13:11
*** tzumainn has joined #tripleo13:12
*** beagles is now known as beagles_mtg13:12
*** Petersingh is now known as Petersingh|afk13:12
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: DNM: Testing neutron/OVN rootwrap containers  https://review.openstack.org/60994713:13
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Use Jinja2 macro to remove redundancy in workarounds.sh.j2.  https://review.openstack.org/61298713:17
*** Petersingh|afk has quit IRC13:18
*** tzumainn has quit IRC13:20
*** tzumainn has joined #tripleo13:21
*** udesale has joined #tripleo13:22
*** jcoufal has joined #tripleo13:23
chemdciabrin: hi, scenario002 failing with a "clustercheck >/dev/null returned 1 instead of one of [0]" on step2 of deployment (mysql_init_bundle ) does this ring a bell or am I the lucky one ?13:24
dciabrinchem yes it means galera did not start locally13:26
chemdciabrin: usual stuff and I just recheck or worth investigating ?13:26
dciabrinchem, i'm suprised it happens. what's the context?13:26
dciabrinchem let me look at the review logs first13:27
chemdciabrin: nothing particular here the mysql log http://logs.openstack.org/77/611677/4/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/c3d07bc/logs/undercloud/var/log/containers/mysql/mariadb.log.txt.gz13:27
*** amoralej|lunch is now known as amoralej13:28
chemdciabrin: (and the review for your convenience https://review.openstack.org/#/c/611677/, but it's really unrelated)13:28
dciabrinchem meh this is weird, the server has started really. it's still logging things every couple of seconds up to the end of the log file13:29
* dciabrin looks13:29
chemdciabrin: here's the error log http://logs.openstack.org/77/611677/4/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/c3d07bc/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-23_12_21_0613:29
*** agopi is now known as agopi|brb13:38
*** trown is now known as trown|brb13:38
derekhsshnaidm|ruck: jaosorior rebasing the patch in gerrit fixed my use of the reproducer script https://bugs.launchpad.net/tripleo/+bug/179970513:39
openstackLaunchpad bug 1799705 in tripleo "reproducer-quickstart.sh doesn't rebase depends-on patches" [Undecided,New] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)13:39
jaosoriorderekh: cool!13:40
*** agopi|brb has quit IRC13:43
*** vinaykns has joined #tripleo13:44
*** mjturek has joined #tripleo13:49
mwhahahasshnaidm|ruck, rfolco|rover, weshay: what's the deal with the upstream gate? timeouts?13:56
weshaymwhahaha, all timeouts afaict13:56
weshaylast 10 or so failures13:57
weshayhttp://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1&panelId=61&fullscreen13:57
weshayrfolco|rover, sshnaidm|ruck ^ any details on those?13:57
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Update to OpenShift 3.11 release  https://review.openstack.org/61068213:58
rfolco|roverwell, the last time I checked, containers were taking too long to start 15-17 min....13:59
*** trown|brb is now known as trown13:59
*** janki has quit IRC14:00
rfolco|rovermwhahaha, weshay I can take another look at the logs... I was hoping https://review.openstack.org/#/c/611911/ to help14:01
mwhahaharfolco|rover: we don't run podman in those jobs14:01
mwhahaha(yet)14:02
rfolco|roverok mixing problems here14:02
*** sanjayu_ has quit IRC14:02
rfolco|rovermwhahaha, checking logs then14:03
*** jrist has joined #tripleo14:05
*** udesale has quit IRC14:07
larsksHey folks. ovsdb on my compute nodes seems to have died or never got started in the first place...yet a stack update just completed successfully, despite errors from pupppet.  Does any of this sound familiar? This is a queens based deployment.14:07
*** percevalbot has quit IRC14:08
*** agopi|brb has joined #tripleo14:08
*** agopi|brb is now known as agopi14:08
*** jrist has quit IRC14:09
*** jrist has joined #tripleo14:09
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791814:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819514:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)14:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]14:10
dciabrinchem, seems to have impacted both galera and haproxy bundle resources for some reason :/14:13
chemdciabrin: what has impacted those two nice processes ?  You mean that error looks legit to you ?14:15
chemdciabrin: is that related to the review ?14:15
dciabrinchem, no i don't see why the review would impact it14:15
*** shyamb has joined #tripleo14:16
dciabrinchem i need to look at other logs and check whether those bundle resource exist, i can't explain why that would fail14:17
chemdciabrin: oki, so that could be real, do you need a lp ?14:18
dciabrinchem, if you can create it, that would be awesome14:19
dciabrinbandini, ^^14:19
openstackgerritHervé Beraud proposed openstack/tripleo-heat-templates master: Remove unnecessary logs due to misconfiguration from pacemake  https://review.openstack.org/61304314:22
*** waleedm has quit IRC14:22
chemdciabrin: oki, that will be my 3rd lp of the day.  At 4 I beat my personal record14:24
*** jrist has quit IRC14:24
dciabrinchem :_)14:24
dciabrinchem, oh ok, you looked at mariadb on the undercloud. it's not running on subnode2, apparently it's never started14:29
chemdciabrin: oh ...14:29
chemdciabrin: sorry14:30
ssbarneamwhahaha: f28 https://review.openstack.org/#/c/606944/ - safe to workflow, thanks!14:30
mwhahahassbarnea: k14:31
*** quiquell|lunch is now known as quiquell14:32
*** beagles_mtg is now known as beagles_food14:33
chemoh boy now the puppet-openstack-unit-4.8 puppet-openstack-unit-5.5 fails while they were passing some hours ago with the same code14:34
chemnext day, please.14:34
openstackgerritHervé Beraud proposed openstack/tripleo-heat-templates stable/queens: Remove unnecessary logs due to misconfiguration from pacemake  https://review.openstack.org/61305414:34
mwhahahachem: review?14:36
chemmwhahaha: https://review.openstack.org/#/c/611919/14:36
openstackgerritHervé Beraud proposed openstack/tripleo-heat-templates stable/rocky: Remove unnecessary logs due to misconfiguration from pacemake  https://review.openstack.org/61305514:37
chemmwhahaha: "cannot load such file -- augeas"14:37
chemmwhahaha: http://logs.openstack.org/19/611919/4/check/puppet-openstack-unit-4.8-centos-7/65bcdc0/job-output.txt.gz#_2018-10-24_11_06_06_11420014:37
*** jrist has joined #tripleo14:41
*** ykarel is now known as ykarel|away14:41
chemmwhahaha: something to add to the dependencies ?14:41
*** shyamb has quit IRC14:42
mwhahahachem: not sure will have to track it down14:42
chemmwhahaha: oki, creating a lp14:42
mwhahahachem: probably rspec-puppet-facts14:43
mwhahahachem: it was 1.9.0 is now 1.9.114:43
mwhahahachem: they just released 1.9.2 so i wonder if that fixes it14:43
mwhahahayea it does14:44
mwhahahachem: https://github.com/mcanevet/rspec-puppet-facts/commit/6b38b3c134212041720bf2bf4a3dac50259e360714:44
*** shyamb has joined #tripleo14:44
chemmwhahaha: nice14:44
mwhahahaso recheck :D14:45
chemmwhahaha: here we go, thanks for the help.  Do you have a pointer on how to get the diff of the installed packages so quickly ?14:49
mwhahahachem: it's in the logs14:50
mwhahahahttp://logs.openstack.org/19/611919/4/check/puppet-openstack-unit-4.8-centos-7/65bcdc0/job-output.txt.gz#_2018-10-24_11_02_05_00594114:50
mwhahahasince the traceback was in rspec-puppet-facts i just looked for the version there and then the last successful run for tehc hange14:51
chemmwhahaha: ack, make sense.  Thanks.14:53
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Fixed stackviz report for standalone  https://review.openstack.org/61261814:58
chemEmilienM: a quick review about undercloud upgrade that fails on the _member_ role, when you have a second https://review.openstack.org/#/c/611677/14:58
EmilienMchem: sure thing14:58
chemEmilienM: just the code, I'm looking at the current error, but it's about to merge and I know you've looked into it14:59
*** shyamb has quit IRC15:00
EmilienMchem: this looks excellent to me15:00
chemEmilienM: cool15:01
chandankumarEmilienM: https://review.openstack.org/#/c/611677 I have a doubt it will break tempest15:01
chandankumarthere we specifically use member role15:01
chandankumarEmilienM: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/validate-tempest/templates/configure-tempest.sh.j2#L15915:02
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Handle LP openvswitch meta-package on upgrade  https://review.openstack.org/60520015:03
*** beagles_food is now known as beagles15:03
EmilienMchem: ^ see chandankumar's comment15:04
Tengudtantsur: hey :). Is the "introspection" step avoidable when we import nodes in ironic? I.e. can we import them and "provide" them directly? the introspection is just horrible on my env, and I really, really don't want to lose about an hour with just that step (yeah, when I say "horrible", it's true)15:04
EmilienMchandankumar: _member_ is some legacy role only useful for horizon afik15:05
chandankumarEmilienM: what about keystone and other projects like swift15:05
chemchandankumar: well the _member_ role is present at deployment time15:05
chemchandankumar: so that would mean that all deployment would fail tempest15:06
chandankumarmost of the swift and keystone api tests depends on member role15:06
*** ykarel|away has quit IRC15:07
chandankumarnow we have standalone in picture running tempest tests against puppet projects15:07
chemchandankumar: this is the Member role which is used, not the _member_ one15:08
chemchandankumar: openstack role create --or-show Member from https://docs.openstack.org/tripleo-docs/latest/install/basic_deployment/tempest.html15:08
chandankumarchem: we specifically create that role for testing15:08
chandankumarlet's wait for the gates how it goes15:08
chemchandankumar: but in the review we're using the "_member_" role, not the "Member" one15:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791815:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819515:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]15:10
chemchandankumar: there is nothing in the gate that test that code path, it was found in redhat testing.15:10
chandankumarchem: ah, got it15:10
chemchandankumar: cool :)  but now I know why I kept seeing that member role next to the _member_ one :)15:11
chandankumarchem: since __member_ is going to stay there in our deployment , Can i use it for tempest also?15:12
chemchandankumar: if you don't don't destroy it, you can use it.  By default it's admin has this role.15:13
chandankumarsince customers most of the time does not follow docs that's why saying15:13
dtantsurTengu: it's optional, just make sure to provide the require stuff (mostly, MAC addresses) yourself15:13
chemchandankumar: and it's there only on the undercloud, not the overcloud15:14
chemchandankumar: hum... let's say that I'm sure it's on the undercloud, not sure about the overcloud15:15
Tengudtantsur: I can do that yeah, as I know them in advance (VM are provisionned with static MAC)15:15
Tengudtantsur: is there some doc for that?15:16
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates stable/queens: [Queens only] Use rhel-registration tool in Rhsm to update repos before upgrade  https://review.openstack.org/61187915:16
dtantsurTengu: check optional things in http://tripleo.org/install/environments/baremetal.html#instackenv-json15:16
Tengudtantsur: great, thanks!15:16
TenguI'll do that later - have a bug to squash first :).15:17
chandankumarchem: I will take a look on the overcloud15:17
*** agopi is now known as agopi|food15:22
bogdandofolks, how can I track down the issue "Exception: ERROR: Missing parameter type for parameter: PaunchLogFile" for https://review.openstack.org/#/c/612948/2 ?15:24
bogdandoso confusing...15:24
bogdandowhere did I miss that param?..15:24
bogdandoI followed the path as ConfigDebug works15:24
bogdandoapparently wasn't enough15:24
ksamborbogdando, you miss it here https://review.openstack.org/#/c/612948/2/common/deploy-steps.j2@6915:25
bogdandotype?15:25
ksamboryes15:25
bogdandowell crap... thanks!15:25
ksambornp15:25
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Use Jinja2 macro to remove redundancy in workarounds.sh.j2.  https://review.openstack.org/61298715:26
openstackgerritMarios Andreou proposed openstack/tripleo-quickstart-extras master: WIP: design for reproducer/zuulv3 alignment  https://review.openstack.org/61307715:26
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28  https://review.openstack.org/61046815:26
mariosrlandy: the simple illustration we spoke about ^^^15:26
mariosrlandy: https://review.openstack.org/61307715:26
rlandycool15:27
rlandywill review15:27
mariosrlandy: not necessary just fyi its the stuff we spoke about15:27
mariosrlandy: i'll use it for the call tomorrow15:27
*** ykarel|away has joined #tripleo15:28
*** ykarel|away is now known as ykarel15:28
mariosrlandy: (i mean sure review it but there isn't much to review ;) )15:28
openstackgerritMartin Schuppert proposed openstack/tripleo-heat-templates master: Fix novajoin nova vendordata hieradata keys  https://review.openstack.org/61230715:28
*** ksambor has quit IRC15:29
*** naturalblue has quit IRC15:30
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Log paunch configuration steps to a file  https://review.openstack.org/61294815:31
chemdciabrin: I'm gonna trigger a recheck on https://review.openstack.org/#/c/611677/ (the mysql not starting stuff)15:33
dciabrinchem ack15:33
*** mmagr has quit IRC15:33
dciabrinchem,  at this stage i can only say that pacemaker was not given a chance to start the galera server properly because some container monitoring timed out15:33
chemdciabrin: that may be super slow instance ?15:34
dciabrinchem i wonder if this could be related to some high load or something. will create the paunchpad with some explanation shortly15:34
dciabrinchem yeah i don't see any reason why this thing would misbehave all of a sudden15:34
*** agurenko has quit IRC15:34
*** agopi|food is now known as agopi15:42
*** Vorrtex has joined #tripleo15:42
*** huynq has quit IRC15:43
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates master: Sets ODL OVSDB inactivity probe timer  https://review.openstack.org/60943815:43
*** jfrancoa has quit IRC15:44
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Convert mac to hostname mapping to composable services  https://review.openstack.org/61308115:44
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Convert Cisco Nexus UCSM to composable service  https://review.openstack.org/61308215:44
slaglecaboucha: sambetts|afk : ^^15:46
slaglecaboucha: sambetts|afk : and https://review.openstack.org/#/c/612687/15:46
slaglecaboucha: sambetts|afk : i've tested them locally and they appear to do the right thing. although the produced data formats may be slightly different, not sure how it worked before. and i also wasn't sure what to set for NetworkNexusConfig15:48
slaglecaboucha: sambetts|afk : they illustrate how to do the same tasks as before entirely in ansible though so that it works with config-download15:49
*** pcaruana has quit IRC15:49
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: Use container_build_id for standalone containers  https://review.openstack.org/61308415:51
cabouchaslagle: hi15:51
cabouchaslagle:  I'll take a look15:51
cabouchaslagle:15:51
cabouchaslagle:  I was just going through extraconfig code and see where they hook up files.  I expect I'll have to change the hooks too.15:52
openstackgerrityolanda.robla proposed openstack/tripleo-common stable/rocky: Increase size for security hardened images  https://review.openstack.org/61308715:54
quiquellmwhahaha: This fix for the f28 makes any sense https://review.openstack.org/#/c/613084/  ?15:54
*** ccamacho has quit IRC15:54
slaglecaboucha: ok. just let me know, we can make further changes if needed.15:54
mwhahahaquiquell: if that's the correct tag sure, but you need to also fix L1015:55
openstackgerrityolanda.robla proposed openstack/tripleo-image-elements stable/rocky: Increase size for security hardened images  https://review.openstack.org/61308815:55
quiquellmwhahaha: ack15:55
cabouchaslagle: pinging my peers now.15:55
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: Use container_build_id for standalone containers  https://review.openstack.org/61308416:01
sambetts|afkslagle: thanks, looks great! Is this something that will be backport-able to rocky and queens?16:01
*** jcoufal_ has joined #tripleo16:02
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28  https://review.openstack.org/61046816:03
*** jcoufal has quit IRC16:03
slaglesambetts|afk: yes, we can backport. it's not strictly needed with queens, as config-download isn't the default in queens.16:05
slaglebut we can still backport it16:05
openstackgerritJuan Antonio Osorio Robles proposed openstack/python-tripleoclient master: Undercloud: Disable persisting VIPs in /etc/hosts  https://review.openstack.org/61309416:06
sambetts|afkslagle: I'm hitting the issue with OSP13 which is queens, so not sure if its being overridden to use config-download somewhere but its definatly trying to evaluate the steps even if it doesn't run them16:07
openstackgerritRaoul Scarazzini proposed openstack/tripleo-ha-utils master: Add heat results inside log files  https://review.openstack.org/61309516:07
*** ykarel is now known as ykarel|away16:07
cabouchaslagle:  I was interested in the mac2host changes but this is a separate issue.16:07
openstackgerritMerged openstack/tripleo-heat-templates master: Delete novajoin manual setup from freeipa setup script  https://review.openstack.org/61265816:08
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Rework neutron/own agent wrapper tools for podman  https://review.openstack.org/60697516:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791816:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819516:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)16:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]16:10
openstackgerritAthlan-Guyot sofer proposed openstack/instack-undercloud stable/queens: Update stackrc to v3 auth values when --use-heat is false.  https://review.openstack.org/61164716:10
slaglecaboucha: i'm not sure what template you mean by mac2host16:11
slaglethe UCSM teplate is the one that actually creates /root/mac2host16:12
cabouchaWe chatted about this yesterday. brb16:12
sambetts|afkthis one: https://review.openstack.org/#/c/613081/16:12
slaglelooks like i put the deprecation warning the 2nd patch16:13
cabouchaWas there a replacement written for extraconfig/all_nodes/mac_hostname.j2.yaml?16:13
sambetts|afkcaboucha: thats the link I just put16:13
sambetts|afkI went up recently16:13
sambetts|afks/I/it16:14
jaosoriormwhahaha: where is the standalone deployment getting its defaults from?16:14
*** ramishra has quit IRC16:14
mwhahahajaosorior: which defaults16:14
jaosoriorresource registry, enabled environments16:14
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Convert mac to hostname mapping to composable services  https://review.openstack.org/61308116:14
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Convert Cisco Nexus UCSM to composable service  https://review.openstack.org/61308216:14
slaglecaboucha: it's 2 patches ^16:15
jaosoriormwhahaha: are those set from python-tripleoclient?16:15
sambetts|afkslagle: I think it would be nice the ucsm/nexus template could use the output/facts from the generic mac to hostname service if possible, what do you think?16:15
cabouchaslagle, sambetts: sorry I missed the 2nd patch.16:15
slaglecaboucha: the one we talked about yesterday is the first one, however the 2nd one actually creates /root/mac2host16:15
cabouchaawesome!  TY so much16:15
dciabrinchem bandini https://bugs.launchpad.net/tripleo/+bug/1799744 FYI16:15
openstackLaunchpad bug 1799744 in tripleo "scenario003-multinode-oooq-container too slow to stop container, makes deployment fail " [Undecided,New]16:15
slaglesambetts|afk: yes, it'd be possible. all i did here was attempt to reproduce what was already there16:15
openstackgerritUdi Kalifon proposed openstack/tempest-tripleo-ui master: Selenium infra  https://review.openstack.org/60542416:16
*** psachin has quit IRC16:16
sambetts|afkslagle: yeah thats awesome :D16:16
cabouchaslagle:  I spent time today understanding how we pulled in our unique extraconfig files.16:16
cabouchaslagle:  I'm thinking there will be a unique way to pull in services since I don't expect our stuff will be a default service.16:17
slaglecaboucha: right, the service will have to be added to the list of services in your roles_data.yaml16:18
chemdciabrin: oh, outsanding analysis.  Should we increase that 20s timeout or just close that one as "get faster instance"16:18
dciabrinchem I'm concerned that we need more than 20s to stop a container tbh16:18
*** itlinux has joined #tripleo16:18
cabouchaslagle:  AH OK.  I do recall reading about that.  TY VM. I will chase that avenue down further.  I can't thank you enough for your help.16:18
mwhahahajaosorior: sec i'll explain in a min16:19
dciabrinchem (I'm also concerned we need to restart that container, but that's not link to that issue)16:19
dciabrinchem let's see if you recheck fixes that or if the machines are consistently overloaded?16:20
chemdciabrin: yeah, 20s it's only one billion of billion instruction by a modern cpu, that sound a bit short to stop docker :)16:21
dciabrinhaha16:22
chemdciabrin: I mean we buy SUV to go to the supermarket so, we definitively need to oversize everything a bit16:22
chemdciabrin: I need to end this day16:22
dciabrinchem is on fire :D16:23
chembye now16:23
mwhahahajaosorior: so the standalone environment files (the defaults) are managed via sample-env-generator16:24
mwhahahajaosorior: https://github.com/openstack/tripleo-heat-templates/blob/master/sample-env-generator/standalone.yaml16:24
*** chem is now known as chem_gone16:24
mwhahahajaosorior: which generates the two environments, https://github.com/openstack/tripleo-heat-templates/tree/master/environments/standalone16:24
mwhahahajaosorior: so if you need to add something throwit in the sample-env-generator config and then tox -e genconfig ; tox -e cleanup; git add *16:25
jaosoriorgot it16:25
jaosoriorthanks16:25
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: WIP - Switch standalone & undercloud to Podman by default  https://review.openstack.org/60845116:27
*** aedc has joined #tripleo16:27
*** phuongnh has joined #tripleo16:28
*** bogdando has quit IRC16:29
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Add rocky specific parameters to custom NICs.  https://review.openstack.org/60540716:30
*** hjensas has joined #tripleo16:31
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Skip hosts group in ceph-ansible inventory when all are blacklisted  https://review.openstack.org/61073616:32
*** phuongnh has quit IRC16:32
*** jpich has quit IRC16:38
*** mmagr has joined #tripleo16:38
*** ansmith has quit IRC16:39
*** yprokule has quit IRC16:40
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Standalone: Disable persisting VIPs on /etc/hosts for standalone  https://review.openstack.org/61310616:40
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Standalone: Disable persisting VIPs on /etc/hosts  https://review.openstack.org/61310616:41
chandankumarEmilienM: mwhahaha: please have a look at this https://tree.taiga.io/project/tripleo-ci-board/epic/256 when you get some time16:41
EmilienMchandankumar: ok16:41
openstackgerritCédric Jeanneret proposed openstack/puppet-tripleo master: Fix wrapper containers for podman w/o sockets  https://review.openstack.org/60609516:43
*** quiquell is now known as quiquell|off16:43
*** dtantsur is now known as dtantsur|afk16:46
*** trown is now known as trown|lunch16:46
*** pcaruana has joined #tripleo16:46
Tengudtantsur|afk: so I think I have a working baremetal.json file, at least I could mark my nodes as available - now it's time to ensure they are picked up as expected for an overcloud deploy :)16:46
*** panda is now known as panda|off16:59
rfolco|rovermwhahaha, weshay: I can't find a pattern or evidence for the gate timeouts. Besides the fact today's failures are from jobs that ran/started at the same time, no clear indication on what could be the root cause. undercloud installs taking ~1:40 and overcloud deploy taking 1:30. Different regions, different jobs types.17:00
openstackgerritBob Fournier proposed openstack/tripleo-heat-templates master: Add comments clarifying use of deprecated_params for roles and IPs  https://review.openstack.org/61310917:03
*** mmagr has quit IRC17:04
*** derekh has quit IRC17:07
weshayrfolco|rover, ya.. it's hard as hell w/o ara17:08
weshayrfolco|rover, thanks17:08
*** irclogbot_8 has joined #tripleo17:08
*** dprince has quit IRC17:08
*** salmankhan has quit IRC17:09
rfolco|roverweshay, I'll pick one and compare to a good run to see if I can spot anything... or come up with ideas on a trap to collect more data17:09
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791817:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819517:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]17:10
*** jpena is now known as jpena|off17:15
*** yolanda has quit IRC17:16
*** kopecmartin is now known as kopecmartin|off17:16
openstackgerritMichael Bayer proposed openstack/tripleo-heat-templates master: Implement Global Galera database  https://review.openstack.org/60973817:17
openstackgerritMichael Bayer proposed openstack/puppet-tripleo master: Implement Global Galera database  https://review.openstack.org/60973417:17
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: WIP: Add release file for fedora 28  https://review.openstack.org/61046817:19
openstackgerritCédric Jeanneret proposed openstack/puppet-tripleo master: Fix wrapper containers for podman w/o sockets  https://review.openstack.org/60609517:19
*** irclogbot_8 has quit IRC17:21
*** irclogbot_8 has joined #tripleo17:22
*** morazi has quit IRC17:26
*** dprince has joined #tripleo17:27
*** ansmith has joined #tripleo17:27
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: Set setype for log and persistant data directories  https://review.openstack.org/61180117:30
openstackgerritMichael Bayer proposed openstack/tripleo-heat-templates master: Implement Global Galera database  https://review.openstack.org/60973817:33
TenguEmilienM: ah, small note for tripleo-lab: it now avoids node introspection, meaning it will be faster to add overcloud nodes :). Like, really faster.17:38
*** holser_ has quit IRC17:38
Tengusee you guys!17:38
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Support podman when tagging container for Pacemaker  https://review.openstack.org/60418017:41
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Allow the environment to enable Podman on the overcloud  https://review.openstack.org/61252217:42
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Support podman when tagging container for Pacemaker  https://review.openstack.org/60418017:42
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Rework neutron/own agent wrapper tools for podman  https://review.openstack.org/60697517:43
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add capabilities for Neutron/OVN agents  https://review.openstack.org/60604517:43
EmilienMTengu: I rebased ^17:43
EmilienMTengu: so we can test easily THT within one single branch17:43
EmilienMTengu: good news for tripleo-lab, thx17:43
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: WIP / fs010: enable Podman on the overcloud  https://review.openstack.org/61252617:45
openstackgerritMichael Bayer proposed openstack/tripleo-heat-templates master: Implement Global Galera database  https://review.openstack.org/60973817:49
*** gfidente has quit IRC17:51
openstackgerritRaoul Scarazzini proposed openstack/tripleo-ha-utils master: Add heat results inside log files  https://review.openstack.org/61309517:52
openstackgerritMichael Bayer proposed openstack/tripleo-heat-templates master: Implement Global Galera database  https://review.openstack.org/60973817:58
openstackgerritRaoul Scarazzini proposed openstack/tripleo-ha-utils master: Add heat results inside log files  https://review.openstack.org/61309518:06
*** gfidente has joined #tripleo18:06
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791818:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819518:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]18:10
*** trown|lunch is now known as trown18:13
hjensasrfolco|rover: Regarding https://bugs.launchpad.net/tripleo/+bug/1797918 - Do we have any idea?18:15
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)18:15
rfolco|roverhjensas, I was hoping the infra ha router removal yesterday to solve this. Looks like jobs still failing, so I am looking what else could be done on ci side. Failures seem to be network intermittent... under investigation18:18
openstackgerritHarald Jensås proposed openstack/tripleo-quickstart-extras master: [WiP] - OVB - external network masquerading  https://review.openstack.org/60983018:19
*** holser_ has joined #tripleo18:25
hjensasrfolco|rover: ok, thanks.18:27
itlinuxhello guys, I am looking at this page https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/container_image_prepare.html#modifying-images-during-prepare but I do not not see tripleo in my deployment.18:32
*** ssbarnea|bkp2 has joined #tripleo18:39
*** dsneddon__ has joined #tripleo18:39
*** mmethot_ has joined #tripleo18:40
*** slaweq_ has joined #tripleo18:40
*** jistr_ has joined #tripleo18:42
*** fuzzball81 has joined #tripleo18:42
*** itlinux_ has joined #tripleo18:43
*** Vorrtex_ has joined #tripleo18:44
*** dprince_ has joined #tripleo18:44
*** Vorrtex_ has quit IRC18:44
*** dprince has quit IRC18:48
*** hjensas has quit IRC18:48
*** itlinux has quit IRC18:48
*** Vorrtex has quit IRC18:48
*** haleyb has quit IRC18:48
*** slaweq has quit IRC18:48
*** mmethot has quit IRC18:48
*** jbadiapa has quit IRC18:48
*** dsneddon has quit IRC18:48
*** dhill_ has quit IRC18:48
*** jidar has quit IRC18:48
*** ssbarnea has quit IRC18:48
*** zzzeek has quit IRC18:48
*** zul has quit IRC18:48
*** fultonj has quit IRC18:48
*** jjoyce has quit IRC18:48
*** rook has quit IRC18:48
*** slagle has quit IRC18:48
*** jistr has quit IRC18:48
*** mcarden has quit IRC18:48
*** spotz has quit IRC18:48
*** radez has quit IRC18:48
*** errr has quit IRC18:48
*** Hobbestigrou has quit IRC18:48
*** hjensas has joined #tripleo18:49
*** jbadiapa has joined #tripleo18:49
*** dhill_ has joined #tripleo18:50
*** jidar has joined #tripleo18:50
*** errr has joined #tripleo18:50
*** Hobbestigrou has joined #tripleo18:50
*** Vorrtex has joined #tripleo18:50
*** fultonj has joined #tripleo18:51
*** haleyb has joined #tripleo18:52
*** spotz has joined #tripleo18:52
*** rook has joined #tripleo18:54
*** rook has quit IRC18:54
*** rook has joined #tripleo18:54
*** rook is now known as Guest7909518:55
*** lblanchard has quit IRC18:55
itlinux_wow channel crazy today?18:55
*** amoralej is now known as amoralej|off18:57
weshaymwhahaha, jaosorior question.. we could consider promotiong w/o fs001/35 to refresh upstream jobs https://review.rdoproject.org/zuul/status19:00
mwhahahamight be beneficial19:00
weshayrfolco|rover, do we have anything tracking the truncating of the job-output.txt? https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/85a296d/19:01
weshaymwhahaha, k.. I'll wait for all the jobs to finish19:01
rfolco|roverweshay, no bug filed yet. Let me open a new bug for this.19:03
weshaythanks19:03
*** vinaykns has quit IRC19:04
rfolco|roverweshay, this is so weird https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/85a296d/job-output.txt.gz#_2018-10-24_16_52_33_05424219:04
*** roger2 has joined #tripleo19:04
weshayrfolco|rover, it's a network issue isn't it?19:05
*** morazi has joined #tripleo19:05
weshayrfolco|rover, I think the log is not copied correctly.. https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/85a296d/ara-report/result/5df01e4e-576f-4e87-8be8-5a129c0c93b0/19:05
*** openstackgerrit has quit IRC19:06
weshayrfolco|rover, actually that was a unable to get a heat stack19:06
weshay+(/home/zuul/src/git.openstack.org/openstack/tripleo-ci/toci_gate_test.sh:174): ./testenv-client -b 192.168.100.250:4730 -t 10800 --envsize 4 --ucinstance 4326cdfd-1331-4814-9af2-b650065e9690 --net-iso multi-nic -- ./toci_quickstart.sh19:06
weshayguess it can be anything19:06
rfolco|roverweshay, yeah, behavior is not consistent... but the strange thing is that the "network" becomes the bad guy only after teclient ??!19:06
rfolco|roverhttp://logs.rdoproject.org/91/564291/23/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/77d52c1/job-output.txt.gz19:06
weshaythey had this issue upstream one time, and fixed it19:06
weshayrfolco|rover, I think it's random19:07
weshaywhere it stops19:07
weshayheat stacks are f..19:07
weshayhttps://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/ad19158/job-output.txt.gz#_2018-10-24_16_43_18_66145119:07
weshayrdo-cloud is down again19:07
weshayrfolco|rover, check http://38.145.33.166/testenv-worker.log19:08
weshayrfolco|rover, also if you can fix the log rolling on that server19:08
weshaythat would be ++19:08
weshayrfolco|rover, https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/te-broker/tasks/main.yml#L11619:09
weshayrfolco|rover, let me know if you have any questions19:10
* weshay gets lunch19:10
*** weshay is now known as weshay_lunch19:10
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791819:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819519:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)19:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]19:10
*** gfidente has quit IRC19:11
*** akrivoka has quit IRC19:12
*** Guest79095 is now known as rook19:13
roger2I tried to deploy 1 controller and 1 compute and now I'm troubleshooting failures. Got any pointers for "Failure prepping block device"?19:16
roger2My env is: manual tripleo/queens/containerized/baremetal19:16
*** vinaykns has joined #tripleo19:23
*** ykarel|away has quit IRC19:23
*** irclogbot_8 has quit IRC19:25
*** irclogbot_8 has joined #tripleo19:25
*** irclogbot_8 has quit IRC19:26
*** bfournie has quit IRC19:26
*** irclogbot_8 has joined #tripleo19:27
*** irclogbot_8 has quit IRC19:31
*** vinaykns has quit IRC19:33
*** vinaykns has joined #tripleo19:36
*** hberaud has quit IRC19:36
*** slaweq_ is now known as slaweq19:40
*** lblanchard has joined #tripleo19:42
*** weshay_lunch is now known as weshay19:43
*** hberaud has joined #tripleo19:53
*** openstackgerrit has joined #tripleo19:53
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: undercloud_preflight: compare actual IPs without mask  https://review.openstack.org/61193719:53
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: undercloud_preflight: compare actual IPs without mask  https://review.openstack.org/61193719:53
openstackgerritVictor Pickard proposed openstack/tripleo-heat-templates stable/queens: Change log directory for OpenDaylight  https://review.openstack.org/61245919:54
*** apetrich has quit IRC20:00
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Remove defaults from masquerade-networks service env  https://review.openstack.org/60984520:07
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791820:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819520:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]20:10
mwhahaharfolco|rover, sshnaidm|ruck, weshay: just fyi but puppet 5.5.7 has trash puppet-openstack-unit-5.5-centos-7 for puppet-tripleo. I'm filing a bug and working on a fix20:12
sshnaidm|ruckmwhahaha, ack20:13
rfolco|rovermwhahaha, thx20:13
*** apetrich has joined #tripleo20:14
mwhahahahttps://bugs.launchpad.net/tripleo/+bug/179978620:16
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,Triaged] - Assigned to Alex Schultz (alex-schultz)20:16
*** Vorrtex has quit IRC20:17
weshaymwhahaha, thanks20:17
*** Vorrtex has joined #tripleo20:17
* mwhahaha flips tables20:18
*** Vorrtex has quit IRC20:18
*** dciabrin has quit IRC20:18
*** Vorrtex has joined #tripleo20:24
*** lblanchard has quit IRC20:30
openstackgerritHarald Jensås proposed openstack/tripleo-common master: Fix - config-download tarball upload OverflowError  https://review.openstack.org/61315520:33
*** ansmith has quit IRC20:34
*** Vorrtex has quit IRC20:46
*** pcaruana has quit IRC20:50
roger2I found this hint in /var/log/nova/nova-compute.log-20181024.gz: 2018-10-23 12:48:03.269 1528847 ERROR nova.compute.manager [req-...3e40 54a7...14d8 8788...7813 - default default] [instance: 19d5...686e] Failure prepping block device: InternalServerError: Unable to attach VIF 66cd...3c8a because Ironic can not update Neutron port 66cd...3c8a MAC address to match physical MAC address 00:30:48:c8:ff:0f (HTTP 500)20:51
fultonjroger2: https://bugzilla.redhat.com/show_bug.cgi?id=1560690#c2321:03
openstackbugzilla.redhat.com bug 1560690 in openstack-heat "Re-deployment of overcloud fails with: ResourceInError: resources.OpenShiftWorker: Went to status ERROR due to "Message: Build of instance c7c5191b-59ed-44a0-8b2a-0f68e48e9a52 aborted: Failure prepping block device., Code: 500"" [High,Closed: errata] - Assigned to jkreger21:03
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Add ctlplane interface routes  https://review.openstack.org/60494321:03
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - data + env (1/3)  https://review.openstack.org/58218021:03
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - network.j2 (2/3)  https://review.openstack.org/58218121:03
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Replace tripleo_common/utils/roles.py validate_role_yaml()  https://review.openstack.org/60847121:03
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - subnet fixed_ips (3/3)  https://review.openstack.org/58230121:03
roger2fultonj: thank you. looking.21:03
*** raildo has quit IRC21:03
*** jcoufal_ has quit IRC21:03
*** openstack has quit IRC21:03
*** openstack has joined #tripleo21:05
*** ChanServ sets mode: +o openstack21:05
openstackgerritMike Fedosin proposed openstack/tripleo-heat-templates master: WIP: Set container images for openshift 3.11  https://review.openstack.org/61316521:07
*** dprince_ has quit IRC21:09
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791821:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819521:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978621:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)21:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]21:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)21:10
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: Include local_ip & undercloud_admin_host in docker_insecure_registries  https://review.openstack.org/61316621:13
EmilienMstevebaker: ^21:14
stevebakerEmilienM: looks good21:16
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Fix pip installation  https://review.openstack.org/61264921:17
*** spsurya has quit IRC21:21
*** holser_ has quit IRC21:22
*** ansmith has joined #tripleo21:30
*** lblanchard has joined #tripleo21:33
*** itlinux_ has quit IRC21:33
*** holser_ has joined #tripleo21:39
*** tosky has quit IRC21:53
*** bnemec has quit IRC21:55
*** holser_ has quit IRC21:55
*** lblanchard has quit IRC21:59
*** lblanchard has joined #tripleo22:00
*** slaweq has quit IRC22:06
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791822:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819522:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978622:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]22:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)22:10
*** rh-jelabarre has quit IRC22:10
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates master: Skip hosts group in ceph-ansible inventory when all are blacklisted  https://review.openstack.org/61073622:13
*** sai_p_ has joined #tripleo22:17
*** lblanchard has quit IRC22:30
*** rlandy is now known as rlandy|bbl22:31
*** abishop has quit IRC22:33
*** mjturek has quit IRC22:41
*** lblanchard has joined #tripleo22:56
TenguEmilienM: ah cool :). will give it a try.23:04
*** rcernin has joined #tripleo23:05
*** itlinux has joined #tripleo23:05
*** sanjayu_ has joined #tripleo23:06
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Add OS::TripleO::Services::ContainerImagePrepare to ControllerOpenStack  https://review.openstack.org/61171023:07
TenguEmilienM: ah, you didn't rebase on my selinux work :'(.23:09
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179791823:10
openstackLaunchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179819523:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179978623:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged]23:10
openstackLaunchpad bug 1799786 in tripleo "puppet-openstack-unit-5.5-centos-7 broken due to updated puppet 5.5.7" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)23:10
*** openstackgerrit has quit IRC23:20
*** agopi has quit IRC23:32
*** ansmith has quit IRC23:38
*** openstackgerrit has joined #tripleo23:51
openstackgerritMerged openstack/tripleo-quickstart master: Create venv only when virtualenv is not there  https://review.openstack.org/60234723:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!