Wednesday, 2018-02-28

*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087400:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)00:10
*** lblanchard has joined #tripleo00:10
*** yamahata has joined #tripleo00:12
*** lblanchard has quit IRC00:14
*** yamahata has quit IRC00:17
*** yamahata has joined #tripleo00:30
*** dhill_ has quit IRC00:33
*** mcornea has quit IRC00:37
*** hamzy has quit IRC00:39
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Implement support for FFU undercloud upgrade workarounds  https://review.openstack.org/54842600:40
*** dxiri has quit IRC00:41
*** dxiri has joined #tripleo00:41
*** fragatina has quit IRC00:41
*** fragatina has joined #tripleo00:42
*** dxiri has quit IRC00:45
*** agopi|out has quit IRC00:47
*** agopi|out has joined #tripleo00:48
*** artom has quit IRC00:49
*** elgxl has quit IRC01:00
*** hamzy has joined #tripleo01:03
*** bfournie has joined #tripleo01:06
*** elgxl has joined #tripleo01:09
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087401:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)01:10
*** florianf has quit IRC01:16
*** jabadia has joined #tripleo01:27
*** wolverineav has quit IRC01:31
*** gvrangan has joined #tripleo01:32
*** wolverineav has joined #tripleo01:34
*** gvrangan has quit IRC01:35
*** elgxl has quit IRC01:43
*** ebarrera has quit IRC01:43
*** cshastri_ has joined #tripleo01:51
*** elgxl has joined #tripleo01:53
*** ihrachys_ has quit IRC01:57
*** jabadia has quit IRC02:02
*** pgadiya has joined #tripleo02:02
*** fragatina has quit IRC02:03
*** gvrangan has joined #tripleo02:03
*** fragatina has joined #tripleo02:03
*** fragatina has quit IRC02:04
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Implement support for FFU undercloud upgrade workarounds  https://review.openstack.org/54842602:05
*** itlinux has joined #tripleo02:07
*** gvrangan has quit IRC02:07
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Implement support for FFU undercloud upgrade workarounds  https://review.openstack.org/54842602:08
*** daidv has quit IRC02:09
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087402:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)02:10
*** gvrangan has joined #tripleo02:11
*** gvrangan has quit IRC02:13
*** gvrangan has joined #tripleo02:13
*** gvrangan has quit IRC02:18
*** elgxl has quit IRC02:27
*** elgxl has joined #tripleo02:32
*** wolverineav has quit IRC02:34
*** ykarel has joined #tripleo02:39
openstackgerritMerged openstack-infra/tripleo-ci master: Don't use HTTP proxy and mirror on rdo cloud  https://review.openstack.org/54818302:42
*** fragatina has joined #tripleo02:51
*** fragatina has quit IRC02:51
*** wolverineav has joined #tripleo02:54
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175087403:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)03:10
*** atoth has quit IRC03:11
*** wolverineav has quit IRC03:12
*** chlong has joined #tripleo03:13
*** psahoo has joined #tripleo03:31
*** moshele has joined #tripleo03:32
*** fragatina has joined #tripleo03:33
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Rework create reproducing script  https://review.openstack.org/54796003:34
*** anilvenkata has quit IRC03:36
*** ykarel has quit IRC03:37
*** moshele has quit IRC03:37
*** fragatina has quit IRC03:38
*** elgxl has quit IRC03:38
*** gvrangan has joined #tripleo03:40
openstackgerritMerged openstack/instack-undercloud master: Fix bootstrap NAT  https://review.openstack.org/54728103:40
openstackgerritMerged openstack/tripleo-upgrade master: Replace scenario file in oooq ffu upgrade.  https://review.openstack.org/54818503:40
*** elgxl has joined #tripleo03:42
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Add role_specific tag to missing role-specific parameters  https://review.openstack.org/54417003:48
*** sshnaidm|ptg has joined #tripleo03:49
*** gvrangan has quit IRC03:50
*** morazi has quit IRC03:54
*** brault has joined #tripleo03:54
*** gvrangan has joined #tripleo03:57
*** brault has quit IRC03:59
*** khyr0n has joined #tripleo04:00
*** shreshtha has joined #tripleo04:01
*** yamahata has quit IRC04:04
*** gvrangan has quit IRC04:04
*** gvrangan has joined #tripleo04:05
*** gvrangan has quit IRC04:08
*** tcw has quit IRC04:09
*** tcw has joined #tripleo04:11
*** wolverineav has joined #tripleo04:11
*** psachin` has joined #tripleo04:12
*** skramaja has joined #tripleo04:15
*** wolverineav has quit IRC04:16
*** udesale has joined #tripleo04:18
*** dmacpher_ has joined #tripleo04:25
*** dmacpher has quit IRC04:27
*** gvrangan has joined #tripleo04:30
*** ykarel has joined #tripleo04:33
*** gvrangan has quit IRC04:33
*** psachin` has quit IRC04:38
*** gvrangan has joined #tripleo04:41
*** elgxl has quit IRC04:46
*** gvrangan has quit IRC04:48
*** pdeore has joined #tripleo04:50
*** elgxl has joined #tripleo04:52
*** janki has joined #tripleo04:53
*** gvrangan has joined #tripleo04:53
ianwif there's anyone who understands the intersection of dib/tripleo/heat/os-refresh-config/rhel registration could comment on https://review.openstack.org/547255, that would be great.  it's adding a new env var for satellite registration, but i'm not sure if it should be ported into os-refresh-config04:53
*** masco has joined #tripleo04:56
*** elgxl has quit IRC04:57
*** anilvenkata has joined #tripleo04:59
*** mdnadeem has joined #tripleo05:02
*** ratailor has joined #tripleo05:04
*** psachin` has joined #tripleo05:10
*** gvrangan has quit IRC05:12
*** psachin` has quit IRC05:17
*** elgxl has joined #tripleo05:27
*** dpawar has joined #tripleo05:29
*** etingof has quit IRC05:35
*** moshele has joined #tripleo05:35
*** moshele has quit IRC05:39
*** gkadam has joined #tripleo05:39
*** fragatina has joined #tripleo05:40
*** fragatina has quit IRC05:40
*** fragatina has joined #tripleo05:41
*** psachin has joined #tripleo05:42
*** dxiri has joined #tripleo05:42
*** rlandy|bbl has quit IRC05:44
*** etingof has joined #tripleo05:47
*** dxiri has quit IRC05:53
*** myoung is now known as myoung|zzz05:56
*** elgxl has quit IRC05:57
*** wolverineav has joined #tripleo06:01
*** elgxl has joined #tripleo06:02
*** udesale_ has joined #tripleo06:03
*** ykarel_ has joined #tripleo06:04
*** udesale has quit IRC06:05
*** wolverineav has quit IRC06:06
*** udesale__ has joined #tripleo06:06
*** elgxl has quit IRC06:06
*** ykarel has quit IRC06:07
*** udesale_ has quit IRC06:09
*** fragatina has quit IRC06:16
*** fragatina has joined #tripleo06:17
*** jfrancoa has joined #tripleo06:19
*** jfrancoa has quit IRC06:19
*** jfrancoa has joined #tripleo06:20
*** dparkes has joined #tripleo06:21
*** dparkes has quit IRC06:26
*** chlong has quit IRC06:27
*** radeks has joined #tripleo06:30
*** moshele has joined #tripleo06:31
*** etingof has quit IRC06:36
*** aufi has joined #tripleo06:39
*** elgxl has joined #tripleo06:39
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/54845406:41
openstackgerritzhongshengping proposed openstack/puppet-pacemaker master: Follow the new PTI for document build  https://review.openstack.org/54846806:50
openstackgerritzhongshengping proposed openstack/puppet-tripleo master: Follow the new PTI for document build  https://review.openstack.org/54846906:50
*** etingof has joined #tripleo06:53
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart-extras master: Adding suffix into prep-containers log and script.  https://review.openstack.org/54847206:54
*** yprokule has joined #tripleo07:02
*** ykarel__ has joined #tripleo07:04
*** etingof has quit IRC07:06
*** ykarel_ has quit IRC07:06
*** ramishra has joined #tripleo07:18
*** ykarel__ is now known as ykarel07:20
*** etingof has joined #tripleo07:24
*** waleedm has joined #tripleo07:37
*** HoloIRCUser1 has quit IRC07:45
*** HoloIRCUser1 has joined #tripleo07:45
*** suuuper has joined #tripleo07:49
*** HoloIRCUser8 has joined #tripleo07:49
*** dbecker has joined #tripleo07:50
*** pcaruana has joined #tripleo07:51
*** HoloIRCUser1 has quit IRC07:52
*** brault has joined #tripleo07:55
*** waleedm has quit IRC07:56
*** nyechiel_ has quit IRC07:56
*** nyechiel has joined #tripleo07:56
*** rcernin has quit IRC07:57
*** brault has quit IRC07:59
*** HoloIRCUser8 has quit IRC08:01
*** gkadam_ has joined #tripleo08:02
*** ratailor_ has joined #tripleo08:02
*** pgadiya_ has joined #tripleo08:02
*** udesale_ has joined #tripleo08:02
*** mdnadeem_ has joined #tripleo08:02
*** pdeore_ has joined #tripleo08:02
*** ykarel_ has joined #tripleo08:02
*** psahoo_ has joined #tripleo08:02
*** chkumar246 has joined #tripleo08:02
*** HoloIRCUser1 has joined #tripleo08:02
*** cshastri has joined #tripleo08:03
*** pmannidi has quit IRC08:03
*** chandankumar has quit IRC08:05
*** cshastri_ has quit IRC08:05
*** gkadam has quit IRC08:05
*** ratailor has quit IRC08:05
*** pgadiya has quit IRC08:05
*** udesale__ has quit IRC08:05
*** pdeore has quit IRC08:05
*** psahoo has quit IRC08:05
*** mdnadeem has quit IRC08:05
*** lvdombrkr has joined #tripleo08:06
*** ykarel has quit IRC08:06
*** udesale__ has joined #tripleo08:07
*** pdeore__ has joined #tripleo08:07
*** ykarel__ has joined #tripleo08:07
*** ratailor__ has joined #tripleo08:08
*** gkadam__ has joined #tripleo08:08
*** udesale_ has quit IRC08:10
*** ykarel_ has quit IRC08:10
*** psahoo_ has quit IRC08:10
*** ebarrera has joined #tripleo08:10
*** ratailor_ has quit IRC08:10
*** cshastri has quit IRC08:10
*** mdnadeem_ has quit IRC08:10
*** pdeore_ has quit IRC08:10
*** chkumar246 has quit IRC08:10
*** pgadiya_ has quit IRC08:10
*** gkadam_ has quit IRC08:10
*** ykarel__ is now known as ykarel08:11
*** sshnaidm|ptg has quit IRC08:11
*** dparkes has joined #tripleo08:11
*** radeks has quit IRC08:11
*** ramishra has quit IRC08:12
*** dbecker has quit IRC08:12
*** ykarel is now known as ykarel|lunch08:14
*** bogdando has joined #tripleo08:16
*** ebarrera has quit IRC08:16
*** ebarrera has joined #tripleo08:17
*** HoloIRCUser8 has joined #tripleo08:18
*** HoloIRCUser1 has quit IRC08:21
*** psahoo_ has joined #tripleo08:23
*** pgadiya_ has joined #tripleo08:24
*** mdnadeem_ has joined #tripleo08:24
*** cshastri has joined #tripleo08:24
*** chkumar246 has joined #tripleo08:24
*** tesseract has joined #tripleo08:28
*** waleedm has joined #tripleo08:28
*** ykarel|lunch is now known as ykarel08:31
*** ccamacho has joined #tripleo08:35
*** oidgar has joined #tripleo08:37
EmilienMbogdando: hello08:37
*** ramishra has joined #tripleo08:39
*** egallen has joined #tripleo08:40
*** juriarte has joined #tripleo08:41
openstackgerritAnshul Jain proposed openstack/diskimage-builder master: Fix for passing user defined value for satellite cert for rhel-common.  https://review.openstack.org/54725508:43
EmilienMfor those who want to join remotely our PTG sessions:  https://bluejeans.com/27530305108:45
*** dparkes has quit IRC08:50
*** olivierbourdon38 has joined #tripleo08:56
*** jaosorior has joined #tripleo08:57
*** artom has joined #tripleo08:57
*** dciabrin has joined #tripleo08:58
*** d0ugal has joined #tripleo08:59
*** dprince has joined #tripleo09:00
bogdandoEmilienM: hi09:01
*** gfidente has joined #tripleo09:01
*** gfidente has quit IRC09:01
*** gfidente has joined #tripleo09:01
*** gfidente has quit IRC09:01
*** gfidente has joined #tripleo09:01
*** jtomasek has joined #tripleo09:02
*** thrash|g0ne is now known as thrash|ptg09:03
*** agurenko has joined #tripleo09:03
*** waleedm has quit IRC09:03
openstackgerritDougal Matthews proposed openstack/tripleo-common master: [Experimental] Use sub-workflows to reduce Zaqar post duplication  https://review.openstack.org/42506009:04
*** sshnaidm|ptg has joined #tripleo09:04
*** raildo has joined #tripleo09:05
*** jpich has joined #tripleo09:07
chkumar246d0ugal: Hello09:07
chkumar246d0ugal: you are in ptg?09:08
d0ugalchkumar246: Yes09:08
d0ugalchkumar246: In the Mistral room now, 66109:08
chkumar246d0ugal: I will check you in free time :-)09:08
d0ugalchkumar246: k09:08
*** chkumar246 is now known as chandankumar09:09
*** tosky has joined #tripleo09:09
rascafolks can someone link here the etherpad?09:12
jtomasekhttps://etherpad.openstack.org/p/tripleo-ptg-rocky-retro09:12
*** betherly has joined #tripleo09:13
*** yolanda has quit IRC09:13
rascathanks jtomasek09:14
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart master: [WIP] Update tripleo-inventory for extra nodes on OVB  https://review.openstack.org/54144609:14
*** waleedm has joined #tripleo09:15
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart master: [WIP] Update default supplemental ssh key  https://review.openstack.org/54173109:16
*** chem has quit IRC09:18
*** radeks has joined #tripleo09:19
*** suuuper has quit IRC09:20
*** athomas has joined #tripleo09:20
*** jpena|off is now known as jpena09:24
chandankumarweshay: I will be in openstack-qa room for qa retrospective, let me know when you need me for CI topics, I will come down.09:25
weshaychandankumar, k :)09:25
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras master: WIP: DNM: extra node for OVB stack role  https://review.openstack.org/54236809:26
*** zaneb has joined #tripleo09:29
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras master: Add ability  to deploy FreeIPA on OVB  https://review.openstack.org/53443509:31
*** cylopez has joined #tripleo09:32
*** cylopez has quit IRC09:32
*** ykarel_ has joined #tripleo09:33
*** pdeore_ has joined #tripleo09:33
*** pgadiya__ has joined #tripleo09:33
*** mdnadeem__ has joined #tripleo09:33
*** udesale_ has joined #tripleo09:33
*** cshastri_ has joined #tripleo09:33
*** dbecker has joined #tripleo09:33
*** bnemec has joined #tripleo09:33
*** chkumar246 has joined #tripleo09:34
*** ratailor_ has joined #tripleo09:34
*** psahoo__ has joined #tripleo09:34
*** gkadam_ has joined #tripleo09:34
*** chandankumar has quit IRC09:34
*** pgadiya_ has quit IRC09:34
*** mdnadeem_ has quit IRC09:34
*** ratailor__ has quit IRC09:34
*** ykarel has quit IRC09:35
*** ykarel__ has joined #tripleo09:35
*** ratailor__ has joined #tripleo09:36
*** pdeore__ has quit IRC09:36
*** psahoo_ has quit IRC09:36
*** gkadam__ has quit IRC09:36
*** udesale__ has quit IRC09:36
*** gkadam__ has joined #tripleo09:36
*** cshastri has quit IRC09:36
*** udesale has joined #tripleo09:37
*** gkadam__ is now known as gkadam09:37
*** pdeore has joined #tripleo09:37
*** pgadiya has joined #tripleo09:37
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: DNM: Test telemetry ci  https://review.openstack.org/54853109:38
*** psahoo__ has quit IRC09:38
*** udesale_ has quit IRC09:38
*** chkumar246 has quit IRC09:38
*** ykarel_ has quit IRC09:38
*** pgadiya__ has quit IRC09:38
*** gkadam_ has quit IRC09:39
*** cshastri_ has quit IRC09:39
*** ratailor_ has quit IRC09:39
*** mdnadeem__ has quit IRC09:39
*** pdeore_ has quit IRC09:39
*** jaganathan has quit IRC09:39
*** arxcruz|off is now known as arxcruz09:40
*** yolanda has joined #tripleo09:43
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: WIP: Migrate Ceph deployment to external_deploy_task  https://review.openstack.org/54696609:44
*** yamahata has joined #tripleo09:45
*** raildo has quit IRC09:48
*** psahoo__ has joined #tripleo09:50
*** florianf has joined #tripleo09:50
*** mdnadeem__ has joined #tripleo09:50
*** nyechiel has quit IRC09:51
*** chkumar246 has joined #tripleo09:51
*** cshastri_ has joined #tripleo09:52
*** nyechiel has joined #tripleo09:54
*** chkumar246 is now known as chandankumar09:54
*** raildo has joined #tripleo09:55
openstackgerritMerged openstack/tripleo-heat-templates master: Use ipaddress module  https://review.openstack.org/54809909:57
openstackgerritMerged openstack/tripleo-upgrade master: Ignore ffu patch errors  https://review.openstack.org/54665709:57
*** waleedm has quit IRC09:57
*** apetrich has joined #tripleo10:02
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: WIP: Migrate Ceph deployment to external_deploy_task  https://review.openstack.org/54696610:02
weshayEmilienM, https://etherpad.openstack.org/p/tripleo-ptg-ci10:03
weshaysshnaidm|ptg, panda|ptg https://etherpad.openstack.org/p/tripleo-ptg-ci10:04
*** mrch has joined #tripleo10:04
*** cshastri_ has quit IRC10:05
*** jaosorior has quit IRC10:06
*** jpich has quit IRC10:06
*** raildo has quit IRC10:09
EmilienMweshay: ack10:11
*** raildo has joined #tripleo10:13
*** jpich has joined #tripleo10:14
*** apevec has joined #tripleo10:14
*** mjturek has joined #tripleo10:15
*** gkadam_ has joined #tripleo10:15
*** jangutter has joined #tripleo10:15
apevecplease repaste link to ethpad10:15
*** jaosorior has joined #tripleo10:16
*** fragatina has quit IRC10:16
amoralejapevec, https://etherpad.openstack.org/p/tripleo-ptg-ci10:16
jpichthanks!10:16
*** fragatina has joined #tripleo10:16
*** gkadam has quit IRC10:18
*** salmankhan has joined #tripleo10:19
*** chem has joined #tripleo10:19
*** agurenko has quit IRC10:21
*** salmankhan has quit IRC10:23
*** salmankhan has joined #tripleo10:23
*** gabrioux has joined #tripleo10:24
*** agurenko has joined #tripleo10:24
*** colonwq has joined #tripleo10:25
openstackgerritGiulio Fidente proposed openstack/tripleo-quickstart master: WIP: config-download for scenario's 001 and 004  https://review.openstack.org/54830610:28
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: WIP: Migrate Ceph deployment to external_deploy_task  https://review.openstack.org/54696610:28
*** adarazs_afk is now known as adarazs10:29
*** ykarel__ is now known as ykarel10:29
openstackgerritMerged openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/54845410:31
*** zoli is now known as zoli|lunch10:32
*** zoli|lunch is now known as zoli10:33
*** jcoufal has joined #tripleo10:34
*** apevec has quit IRC10:36
*** apevec has joined #tripleo10:36
*** radeks has quit IRC10:37
*** radeks has joined #tripleo10:37
*** ykarel is now known as ykarel|afk10:39
*** mrch has quit IRC10:42
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Enable containers by default  https://review.openstack.org/54855410:44
*** udesale has quit IRC10:44
*** raildo has quit IRC10:44
*** salmankhan has quit IRC10:46
*** dparkes has joined #tripleo10:47
openstackgerritMerged openstack/tripleo-upgrade master: Fix typo (overcoud->overcloud)  https://review.openstack.org/54809410:47
*** apevec_ has joined #tripleo10:47
*** apevec_ has quit IRC10:47
*** apevec_ has joined #tripleo10:47
*** apevec has quit IRC10:47
*** athomas has quit IRC10:49
*** mrch has joined #tripleo10:52
*** dbecker has quit IRC10:53
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: DNM: testing p->m on experimental queue.  https://review.openstack.org/54576210:53
*** salmankhan has joined #tripleo10:53
*** number80 has joined #tripleo10:54
*** brault has joined #tripleo10:55
ccamachoEmilienM thanks10:58
*** brault has quit IRC10:59
*** suuuper has joined #tripleo11:00
*** etingof has quit IRC11:00
*** paramite has joined #tripleo11:01
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: WIP: remove deprecated file to support puppet-ceph  https://review.openstack.org/54856211:06
number80When we speak about architecture, we should also be specific about them11:08
number80for instance, ARM covers much more aarch64 :)11:08
number80*than11:08
*** etingof has joined #tripleo11:13
openstackgerritCarlos Camacho proposed openstack/tripleo-docs master: WIP: Add docs for Q upgrade workflow  https://review.openstack.org/53585911:15
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Revert part of the support to queens regarding to upgrade.  https://review.openstack.org/54681811:15
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: DNM: test P->M Upgrade in experimental.  https://review.openstack.org/54547711:15
*** mrch has quit IRC11:18
*** shreshtha has quit IRC11:19
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade master: WIP: New major upgrade workflow implementation.  https://review.openstack.org/54833611:19
*** waleedm has joined #tripleo11:20
*** jangutter has quit IRC11:21
*** dprince has quit IRC11:24
*** dprince has joined #tripleo11:25
*** bnemec has quit IRC11:28
*** jpich has quit IRC11:29
*** ykarel|afk is now known as ykarel11:32
*** salmankhan has quit IRC11:34
*** liverpooler has quit IRC11:38
*** bnemec has joined #tripleo11:40
openstackgerritMichele Baldessari proposed openstack/instack-undercloud master: mariadb online upgrade after yum update  https://review.openstack.org/54756011:41
*** adarazs is now known as adarazs_lunch11:41
*** apetrich has quit IRC11:41
*** HoloIRCUser1 has joined #tripleo11:42
*** HoloIRCUser8 has quit IRC11:42
openstackgerritMerged openstack/diskimage-builder master: Checking link status according to DIB_DHCP_TIMEOUT  https://review.openstack.org/52997611:42
*** HoloIRCUser1 has quit IRC11:42
openstackgerritMerged openstack/diskimage-builder master: update Gentoo Hardened profiles (now stable)  https://review.openstack.org/54670111:42
*** HoloIRCUser8 has joined #tripleo11:43
*** salmankhan has joined #tripleo11:45
bandinijaosorior: want to bring up the puppet eol thing you were talking about yesterday?11:47
jaosoriorbandini: well... we have 10 min, but I should bring it up at some point today11:47
*** agurenko has quit IRC11:47
*** d0ugal has quit IRC11:48
bandinijaosorior: yeah in the afternoon or tomorrow11:48
jaosorioror just watch it all burn11:48
bandiniand pour gasoline on top11:49
*** mjturek has quit IRC11:57
*** gabrioux has quit IRC11:57
*** jcoufal has quit IRC11:58
*** pgadiya has quit IRC11:58
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Fix update of pacemaker container images during major upgrade  https://review.openstack.org/54747611:58
beaglespuppet eol?11:59
*** gkadam has joined #tripleo11:59
* beagles waits for "news at 11" version11:59
*** oidgar has quit IRC12:00
*** radeks has quit IRC12:01
*** gkadam_ has quit IRC12:01
*** dprince has quit IRC12:01
*** yolanda has quit IRC12:02
*** jaosorior has quit IRC12:02
*** toure has quit IRC12:04
*** chem has quit IRC12:04
*** radeks has joined #tripleo12:06
*** dciabrin has quit IRC12:08
*** colonwq has quit IRC12:10
*** toure has joined #tripleo12:12
*** jtomasek has quit IRC12:14
*** sshnaidm|ptg has quit IRC12:16
*** gfidente has quit IRC12:18
*** bnemec has quit IRC12:18
*** yamahata has quit IRC12:18
*** brault has joined #tripleo12:20
*** oidgar has joined #tripleo12:25
*** oidgar has quit IRC12:26
*** ratailor__ has quit IRC12:27
*** Goneri has joined #tripleo12:29
*** waleedm has quit IRC12:32
*** ramishra has quit IRC12:32
*** zaneb has quit IRC12:33
*** jaosorior has joined #tripleo12:33
*** nyechiel has quit IRC12:36
openstackgerritAnshul Jain proposed openstack/diskimage-builder master: Fix for rhel7 iso image creation.  https://review.openstack.org/54858512:37
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Adds Overcloud Upgrade class and entry points for major upgrade  https://review.openstack.org/54536512:39
*** tosky has quit IRC12:43
*** udesale has joined #tripleo12:43
*** artom has quit IRC12:46
*** sshnaidm|ptg has joined #tripleo12:48
*** adarazs_lunch is now known as adarazs12:49
*** morazi has joined #tripleo12:50
*** dpawar has quit IRC12:50
*** apevec_ has quit IRC12:52
*** yolanda has joined #tripleo12:52
*** ipsecguy_ has joined #tripleo12:53
*** ipsecguy has quit IRC12:53
openstackgerritzhongshengping proposed openstack/puppet-pacemaker master: Follow the new PTI for document build  https://review.openstack.org/54846812:54
*** radeks has quit IRC12:54
*** colonwq has joined #tripleo12:56
Tengu|ptgEmilienM:  """if you look at the Puppet Enterprise support cycle and figure out which is the last one with Puppet 4 then you will know when 4 will be EOL.  If I read it right it looks to be around July 2018."""12:57
*** ipsecguy_ has quit IRC12:58
*** ipsecguy has joined #tripleo12:58
jaosorior:(12:58
mwhahahai tried to figure out when puppet 4 was eoling and i couldn't tell which PE mapped to puppet12:58
jaosorioris it time to panic yet?12:59
*** waleedm has joined #tripleo12:59
mwhahahaprobably13:00
*** gabrioux has joined #tripleo13:00
mwhahahathough we aren't really relying on fixes to puppet itself13:00
mwhahahaso it's less of a thing for us13:00
jaosoriorgonna panic anyway13:00
*** dparkes has quit IRC13:02
mwhahahahttps://media.giphy.com/media/NH3mWjNZ2FXtm/200.gif13:02
*** dprince has joined #tripleo13:03
*** vpickard_ is now known as vpickard13:03
*** mjturek has joined #tripleo13:04
Tengu|ptgmwhahaha: now you know :). It comes straight out of puppet user ML, from Pienar13:04
*** atoth has joined #tripleo13:05
*** athomas has joined #tripleo13:05
Tengu|ptgmwhahaha: fact is, migration from 4 to 5 is pretty trivial, you "just" need packages.13:05
*** agopi|out has quit IRC13:05
*** ledo_ has joined #tripleo13:06
*** trown|outtypewww is now known as trown13:06
*** waleedm has quit IRC13:08
*** jcoufal has joined #tripleo13:10
*** rbrady has joined #tripleo13:10
*** rbrady has quit IRC13:10
*** rbrady has joined #tripleo13:10
*** agurenko has joined #tripleo13:11
*** anilvenkata has quit IRC13:15
*** jcoufal has quit IRC13:15
*** pkovar has joined #tripleo13:16
*** d0ugal has joined #tripleo13:18
EmilienMmwhahaha: do we really care about puppet4 eol?13:22
*** dbecker has joined #tripleo13:22
mwhahahaEmilienM: ¯\_(ツ)_/¯13:22
*** radeks has joined #tripleo13:22
EmilienMyeah13:22
EmilienMlike puppet itself doesn't break us that often13:22
EmilienMand for the few features we're using from puppet13:22
EmilienMI would be more worried about our dependencies13:22
EmilienMif they make puppet5 only patches in our deps13:23
EmilienMthat ^ is the issue13:23
mwhahahait would probably be beneficial to get some version of puppet513:23
mwhahahabut not sure it's super pressing13:23
EmilienMfirst step would be to switch p-o-i to deploy puppet513:23
EmilienMand then poke number80 & team about packaging puppet513:23
EmilienMreminder for remotees, we have a bluejeans for PTG: https://bluejeans.com/27530305113:24
*** lblanchard has joined #tripleo13:25
*** dciabrin has joined #tripleo13:26
*** apetrich has joined #tripleo13:26
flaper87jistr: https://github.com/openshift/openshift-ansible/pull/732113:26
*** myoung|zzz is now known as myoung13:26
*** artom has joined #tripleo13:27
*** lblanchard has quit IRC13:28
*** myoung is now known as myoung|ruck13:28
*** pkovar has quit IRC13:28
*** jtomasek has joined #tripleo13:28
*** trown is now known as trown|rover13:29
*** psahoo__ has quit IRC13:30
*** gfidente has joined #tripleo13:30
*** gfidente has quit IRC13:30
*** gfidente has joined #tripleo13:30
*** gfidente has quit IRC13:30
*** gfidente has joined #tripleo13:30
*** yamahata has joined #tripleo13:31
*** lblanchard has joined #tripleo13:31
*** sshnaidm|ptg has quit IRC13:32
*** rlandy has joined #tripleo13:33
*** sshnaidm|ptg has joined #tripleo13:34
*** mcornea has joined #tripleo13:37
d0ugalchandankumar: are you free?13:37
d0ugalchandankumar: we are discussing mistral and tempest at the moment in 661 :)13:37
bogdandofolks, PTAL https://review.openstack.org/#/c/54692913:37
*** bnemec has joined #tripleo13:38
*** fultonj has joined #tripleo13:39
*** mdnadeem__ has quit IRC13:40
*** liverpooler has joined #tripleo13:40
jistrflaper87: looks good! i wondered if we want the `when` on the full block in systemd_units.yml instead of the individual tasks, but it may not matter13:40
*** kopecmartin has joined #tripleo13:40
number80EmilienM: puppet5 is on its way too13:40
* number80 is in the kolla room across the door13:41
jaosoriorbandini: ^^13:41
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Get tripleo-upgrade taken into account by zuul.  https://review.openstack.org/54859213:41
bandinijaosorior: noted, thanks!13:42
*** tosky has joined #tripleo13:43
*** gkadam has quit IRC13:45
flaper87jistr: tried to follow the way they did it for the _sdn flag13:45
*** zaneb has joined #tripleo13:45
jistrflaper87: ack that makes sense, i didn't notice that13:46
*** trown|rover is now known as trown|brb13:47
*** pkovar has joined #tripleo13:48
*** mjturek has quit IRC13:48
*** jfrancoa has quit IRC13:49
*** raildo has joined #tripleo13:51
chandankumard0ugal: sorry, stuck with tempest interop discussion13:52
*** jfrancoa has joined #tripleo13:52
*** ramishra has joined #tripleo13:54
*** pdeore has quit IRC13:54
beaglesEmilienM, thanks for reminding re blujeans13:55
*** chem has joined #tripleo13:56
*** apevec has joined #tripleo13:57
*** apevec has quit IRC13:57
*** apevec has joined #tripleo13:57
*** jpena is now known as jpena|off13:57
d0ugalchandankumar: np13:57
d0ugalchandankumar: I think we (the Mistral team) are a bit confused about tempest - maybe we can catch you later today/tomorrow.13:58
chandankumard0ugal: yup sure :-)13:58
*** ramishra has quit IRC13:59
*** skramaja has quit IRC13:59
*** jpena|off is now known as jpena14:00
*** dparkes has joined #tripleo14:01
*** trown|brb is now known as trown|rover14:01
EmilienMnumber80: ack. Please let me know where I can track the work. Do you have a trello card or something?14:02
EmilienMbeagles: sure, no problem14:02
d0ugalchandankumar: thanks - we are in 661 all the time :)14:02
EmilienMbeagles: let me know if any issue14:02
beaglesEmilienM, ack14:02
chandankumard0ugal: Once i get free from here, I will drop down there.14:02
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: DNM: testing p->m on experimental queue.  https://review.openstack.org/54576214:03
*** athomas has quit IRC14:04
d0ugalchandankumar: Great, thanks.14:04
number80EmilienM: I'll setup one in RDO trello (I'll add Alex and you in subscribe list)14:07
EmilienMnumber80: thank you14:07
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Prepare t-h-t for undercloud in a work dir  https://review.openstack.org/54287514:08
Tengu|ptgEmilienM, mwhahaha : for what I know, puppet5 doesn't really add new features, I think it's more a consolidation/cleaning of the puppet4 stuff.14:08
*** masco has quit IRC14:09
Tengu|ptgEmilienM, mwhahaha: meaning: I don't think you'll get weird issues due to """puppet5 module modifications""" - as there aren't really big stuff. There's one thing though, unrelated to puppet4 EOL: if you use the puppetlabs-stdlib, newer versions drops the "validate_*" thingy.14:09
Tengu|ptgand as this stdlib is used pretty widely in the other modules, you might be affected if a module pushes a new dependency on the verion of that lib.14:09
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Implement support for FFU undercloud upgrade workarounds  https://review.openstack.org/54842614:11
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Add support for using custom FFU repository scripts  https://review.openstack.org/54765514:11
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy OpenShift+CNS  https://review.openstack.org/54393314:12
*** ramishra has joined #tripleo14:15
*** moshele has quit IRC14:16
ccamachobeagles we can see the gerrit dashboard from your glasses reflex14:17
jtomasekhonza: Hi, this patch fixes the role parameters display when no count is set to the role https://review.openstack.org/#/c/547055/414:17
ccamachoxD14:17
beaglesccamacho, lol14:17
jtomasekhonza: which makes this series of patches work perfectly https://review.openstack.org/#/c/546586/14:18
ccamachoif you were buying stuff on Internet we will have also you credit card details :P14:18
beaglesccamacho, :) it's a good thing I was "behaving" all of this time then...14:18
ccamachoyeah14:19
ccamachobeagles++14:19
EmilienMccamacho: have you tried to backup an undercloud with your stuff, trash it and restore. How does everything works so far?14:19
honzajtomasek: /me looks14:19
*** dsariel has joined #tripleo14:20
honzanice14:20
jtomasekhonza: btw. there is a tripleo ptg bluejeans session if you want to join some of the ptg sessions https://bluejeans.com/27530305114:22
ccamachoEmilienM The undercloud backup works, I mean the database dump and the fs  backup is created correctly and stored in a Swift container, I tested the restore by stopping mysql in the UC upgrade...14:22
ccamachothen restore all and reinstall14:22
honzajtomasek: cool, thanks, i'll lurk14:22
*** jmelvin has joined #tripleo14:23
ccamachowe should work on TRoubleshooting14:23
ccamachoas people should know what to do with the backup14:23
ccamachoin the UC case is fair simple14:23
ccamachojust restore and retry14:23
*** jrist has joined #tripleo14:24
jristthanks honza14:24
*** bfournie has quit IRC14:24
EmilienMccamacho: what do you think of the idea of switching to containerized undercloud by using backup/restore method, instead of upgrade_tasks14:24
*** bfournie has joined #tripleo14:24
EmilienMmost of our operators don't care about the undercloud state14:24
Tengu|ptgbandini dciabrin so basically, haproxy 1.5.x just pushes "critical fixes" - so CVE (hence security) is more or less OK. duh. but features? nope, not at all, it's wayyyyy behind.14:24
EmilienMas long as it's in good shape when doing overcloud updates/upgrades14:24
honzajrist: jtomasek just shared this ptg bluejeans session https://bluejeans.com/27530305114:24
dciabrinTengu|ptg, :/14:25
EmilienMso we could backup the data/trash everything/deploy containerized undercloud/restore data14:25
jristI have another meeting in 514:25
EmilienMccamacho: wdyt? ^14:25
jristbut I'll lurk14:25
honzajrist: just fyi, nothing's happening at the moment :)14:25
Tengu|ptgdciabrin: so we can't really push the security aspect, until the 1.5 is EOL.14:25
Tengu|ptgno date so far for that event.14:25
*** ykarel is now known as ykarel|away14:26
Tengu|ptgdciabrin: 1.3 was EOL in 2016 -.-'14:26
*** aputtur_ has quit IRC14:26
jtomasekhonza, jrist: https://calendar.google.com/calendar/embed?src=tgpb5tv12mlu7kge5oqertje78%40group.calendar.google.com14:26
dciabrinTengu|ptg, don't we run 1.5?14:26
bandiniTengu|ptg: yeah what kind of features did you have in mind?14:26
Tengu|ptgdciabrin: yep, we do14:26
EmilienMptg session starting again14:27
Tengu|ptgbandini: mostly the easy reload without any downtime, better support for load/multiprocess14:27
EmilienMhttps://etherpad.openstack.org/p/tripleo-ptg-generic-provisioning14:27
*** mjturek has joined #tripleo14:27
Tengu|ptgbandini dciabrin we might have a quick chat with the next break :)14:27
ccamachohmmm EmilienM that might work, do we have docs for the containerized Undercloud¿?14:27
bandiniTengu|ptg: aye aye14:28
EmilienMccamacho: we do have. Happy to share it after ptg session14:28
dciabrinTengu|ptg, so: docker kill -s HUP $(docker ps -q --filter name=haproxy-bundle)14:28
ccamachoEmilienM thanks14:28
Tengu|ptgdciabrin: hmm thanks. have to add that capability to my little project :).14:28
dciabrinTengu|ptg, that will force haproxy to reload the config when restarting, without killing the haproxy container, this pacemaker shouldn't be impacted14:28
*** bfournie has quit IRC14:28
Tengu|ptgwe're close to get a let's encrypt certificate support for public accesses.14:28
Tengu|ptg(well, I AM close - I'll need to propose this project once it's stable enough :D)14:29
dciabrinTengu|ptg, oh sweet14:29
EmilienMccamacho: https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/undercloud.html14:29
Tengu|ptgdciabrin: https://github.com/cjeanneret/openstack-certodia/blob/master/src/certodia/lib/haproxy.py#L41  have to add that capability there.14:30
Tengu|ptgunfortunately, haproxy "stats" socket doesn't provide a way to reload haproxy :'(14:31
Tengu|ptgnot even in 1.914:31
*** agurenko is now known as agurenko|ptg14:31
*** leanderthal has joined #tripleo14:32
*** psachin has quit IRC14:33
*** ykarel|away has quit IRC14:34
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: Add alternative workflow to quickstart.sh  https://review.openstack.org/54800514:35
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras master: Move reproducer README file  https://review.openstack.org/54587514:36
jaosorior:(14:36
Tengu|ptgjaosorior: why are you sad? Because of haproxy? :)14:38
trozethi guys, when during a deployment a service container is brought up as unhealthy, is there no check in TripleO to fail the deployment?14:38
*** dhill_ has joined #tripleo14:39
*** apevec has quit IRC14:41
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Get tripleo-upgrade taken into account by zuul.  https://review.openstack.org/54859214:42
*** radeks has quit IRC14:46
jaosoriorTengu|ptg: yep14:46
*** kopecmartin has quit IRC14:46
*** raildo has quit IRC14:52
*** HoloIRCUser1 has joined #tripleo14:53
*** bnemec has quit IRC14:54
*** HoloIRCUser8 has quit IRC14:54
*** raildo has joined #tripleo14:55
*** dpawar has joined #tripleo14:55
*** dpawar has quit IRC14:56
*** ykarel|away has joined #tripleo14:56
*** raildo has quit IRC14:57
*** raildo has joined #tripleo14:57
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Rework create reproducing script  https://review.openstack.org/54796014:57
Tengu|ptgweshay: might be interesting for "ansible unit-testing" at some point: http://far-oeuf.com/ansible/unit-testing-roles-continuous-integration14:59
Tengu|ptgbut basically... requires a second run of ansible with a specific tag we can chose. Nice, but not what I'd call "unit tests" :'(.15:00
*** tosky has quit IRC15:03
*** bfournie has joined #tripleo15:06
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Implement support for FFU undercloud upgrade workarounds  https://review.openstack.org/54842615:08
*** HoloIRCUser1 has quit IRC15:08
*** chlong has joined #tripleo15:09
*** HoloIRCUser1 has joined #tripleo15:12
*** dpawar has joined #tripleo15:13
Tengu|ptgdciabrin: btw, we should as well talk a bit about haproxy stats and its exploitation I think :). Would be just good to get them and being able to push them to some metric system (fluentd, collectd, other). All is accessible with haproxy "stats" socket (the very same we can use to send orders to haproxy if level is set to admin)15:14
Tengu|ptgi.e. shared volume for that socket, and so on :).15:14
dciabrinTengu|ptg, oh yeah let's find a slot to discuss that with bandini15:14
*** shreshtha has joined #tripleo15:15
Tengu|ptgdciabrin bandini lemme know - I'm also here tomorrow - and I can stay a bit after the current talks today.15:15
*** bnemec has joined #tripleo15:15
bandiniwe can tag it during the next break?15:16
Tengu|ptggood for me.15:16
*** kopecmartin has joined #tripleo15:16
*** hasanq has joined #tripleo15:20
*** agurenko|ptg is now known as agurenko15:22
*** aputtur_ has joined #tripleo15:22
*** tosky has joined #tripleo15:22
*** hasanq has quit IRC15:22
mwhahahaweshay: http://cistatus.tripleo.org/ going to get fixed today?15:22
*** khyr0n has quit IRC15:23
*** gfidente has quit IRC15:24
*** agurenko is now known as agurenko|ptg15:24
*** nyechiel has joined #tripleo15:26
*** yolanda has quit IRC15:26
EmilienMnext session: TripleO as a generic baremetal provisioning tool - in 5 min15:28
EmilienMBJ is still https://bluejeans.com/27530305115:28
EmilienMI'll open mic when we start15:28
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Run logs collection after job finished in RDO CI  https://review.openstack.org/54594115:29
openstackgerritAlex Schultz proposed openstack/instack-undercloud stable/pike: Fix bootstrap NAT  https://review.openstack.org/54861615:30
weshaymwhahaha, it was down, not broken. It's running and gathering the data it needs atm15:31
mwhahahaweshay: it's still down?15:31
EmilienMstarting sessions on bj15:31
Tengu|ptgbandini dciabrin : small doubt: what's the "roadmap" for metrics in tripleo env? I think I saw fluentd was getting kicked out…?15:35
*** waleedm has joined #tripleo15:36
sshnaidm|ptgmwhahaha, IP address is changed, waiting for dprince to change dns record..15:36
sshnaidm|ptgmwhahaha, 38.145.34.1015:37
*** ledo_ has quit IRC15:37
bandiniTengu|ptg: not sure what the last state of things is. But we can find out15:40
Tengu|ptgbandini: would be nice. In a container env, one thing is really cool, called "prometheus".15:40
dprincesshnaidm|ptg: which IP address am I updating?15:40
Tengu|ptgbandini: it actually has exporters for haproxy stats and so on.15:41
sshnaidm|ptgdprince, sent you a mail15:41
*** dhill__ has joined #tripleo15:42
*** moshele has joined #tripleo15:42
*** dhill_ has quit IRC15:43
*** jpena is now known as jpena|off15:43
*** elgxl_ has joined #tripleo15:45
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Check that overcloud_nodes is defined before assigning hostnames  https://review.openstack.org/54715315:46
*** yolanda has joined #tripleo15:46
bandiniTengu|ptg: prometheus is being evaluated iirc15:46
mwhahahamyoung|ruck: do we have tripleoqueens containers posted? http://logs.openstack.org/13/548113/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/295f4be/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz#_2018-02-28_04_25_5915:46
Tengu|ptgbandini: \o/ good to hear!15:47
*** jpena|off is now known as jpena15:48
Tengu|ptgbandini: with its design it might be really nice to get a real hand on it. And if its "alert manager" is used as well, there's a really nice way to get dashboards/alerting if, for example, a compute is being overloaded, or a service is being dropping connections/other things15:48
* Tengu|ptg is currently picturing how nice it would show up on screens :]15:49
bandini:)15:49
*** elgxl_ has quit IRC15:49
*** elgxl has quit IRC15:50
myoung|ruckmwhahaha: AFAIK not yet, we have not had a queens promotion yet, and containers should be pushed by the promotion event.15:52
myoung|rucktrown: keep me honest here?  ^^15:52
myoung|rucktrown|rover: ^^%15:53
mwhahahamyoung|ruck: k zaqar folks are complaining because we're blocking their stable/queens patches15:53
mwhahahahttps://bugs.launchpad.net/bugs/175225215:53
openstackLaunchpad bug 1752252 in tripleo "failed-tripleo-ci-centos-7-scenario002-multinode-oooq-container" [Undecided,New]15:53
mwhahahaso hopefully that gets resolved today15:53
trown|rovermwhahaha: indeed we have not had queens promotion, we have run going now that is pinned to a hash that only failed one job last time on infra issues15:54
trown|rovermwhahaha: so if that job passes this round we will get promote15:54
*** jaosorior has quit IRC15:54
mwhahahak15:54
*** raildo has quit IRC15:54
EmilienMnext session: https://etherpad.openstack.org/p/tripleo-ptg-rocky-upgrades15:54
EmilienMsofer is about to kick it off shortly15:54
*** raildo has joined #tripleo15:54
*** dsariel has quit IRC15:56
*** lvdombrkr has quit IRC15:57
*** raildo has quit IRC15:57
*** raildo has joined #tripleo15:58
ccamachoEmilienM is it possible to stick the mic to chem?15:58
ccamachonot sure or put the laptop near15:58
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: ffu: Introduce Neutron fast-forward upgrade tasks  https://review.openstack.org/52154316:00
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: Add fast_forward_upgrade_tasks for ceilometer services  https://review.openstack.org/53372916:00
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: Adds fast_forward_upgrade_tasks for Heat services  https://review.openstack.org/53095616:00
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Introduce post FFU steps and use them for qeens switch  https://review.openstack.org/54778516:00
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Fix nova fast forward steps  https://review.openstack.org/54778616:00
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Add mongodb fast forward upgrade tasks  https://review.openstack.org/54778716:00
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Add memcached fast forward upgrade tasks  https://review.openstack.org/54778816:00
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Upgrades: fix pacemaker checks  https://review.openstack.org/54778916:00
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Change order of shutdown in README.rst  https://review.openstack.org/54863216:00
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Fix Cinder services action order  https://review.openstack.org/54863316:00
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Fix glance tasks  https://review.openstack.org/54863416:00
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Fix gnocchi FFU tasks  https://review.openstack.org/54863516:00
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Fix Keystone FFU tasks  https://review.openstack.org/54863616:00
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Fix swift FFU tasks  https://review.openstack.org/54863716:00
*** elgxl has joined #tripleo16:03
*** moshele has quit IRC16:04
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Fix nova fast forward steps  https://review.openstack.org/54778616:04
*** elgxl has quit IRC16:07
*** gfidente has joined #tripleo16:09
*** raildo has quit IRC16:10
*** pcaruana has quit IRC16:10
*** dsariel has joined #tripleo16:12
*** HoloIRCUser3 has joined #tripleo16:13
*** trown|rover is now known as trown|lunch16:15
*** HoloIRCUser3 has quit IRC16:15
*** dhill_ has joined #tripleo16:15
*** raildo has joined #tripleo16:15
*** chem` has joined #tripleo16:16
*** HoloIRCUser1 has quit IRC16:16
*** HoloIRCUser1 has joined #tripleo16:17
*** ykarel|away is now known as ykarel16:17
*** jaganathan has joined #tripleo16:17
*** lyarwood_ has joined #tripleo16:19
*** mcarden_ has joined #tripleo16:19
*** raildo has quit IRC16:20
openstackgerritDavid Peacock proposed openstack/tripleo-common master: [WIP - DO NOT MERGE] add option --gather-facts  https://review.openstack.org/54865116:22
*** afazekas_ has joined #tripleo16:23
*** thrash has joined #tripleo16:23
*** thrash has quit IRC16:23
*** thrash has joined #tripleo16:23
*** mburned` has joined #tripleo16:23
*** aputtur- has joined #tripleo16:23
*** eric-young has joined #tripleo16:23
*** dhill__ has quit IRC16:24
*** chem has quit IRC16:24
*** mburned has quit IRC16:24
*** aputtur has quit IRC16:24
*** PagliaccisCloud has quit IRC16:24
*** mcarden has quit IRC16:24
*** ericyoung has quit IRC16:24
*** afazekas has quit IRC16:24
*** fabbione has quit IRC16:24
*** thrash|ptg has quit IRC16:24
*** lyarwood has quit IRC16:24
*** OGtrilliams has joined #tripleo16:24
*** OGtrilliams is now known as PagliaccisCloud16:25
*** HoloIRCUser3 has joined #tripleo16:26
*** HoloIRCUser1 has quit IRC16:26
*** HoloIRCUser1 has joined #tripleo16:27
*** HoloIRCUser3 has quit IRC16:27
*** fabbione has joined #tripleo16:31
sshnaidm|ptgdprince, did you get my mail about dns name?16:31
*** udesale has quit IRC16:32
*** mjturek has quit IRC16:34
*** dpeacock has quit IRC16:37
*** leanderthal has quit IRC16:38
dprincesshnaidm|ptg: done16:38
sshnaidm|ptgdprince, thanks!16:38
rookfultonj: hey!16:39
fultonjhi rook16:39
*** radek has joined #tripleo16:40
rookfultonj so, deploying at scale w/ ceph has been problematic.16:40
rookfultonj honestly, i have been ignoring the memory utilization - as that is well known and documented.16:40
fultonjrook: yes, it is known and documented16:41
fultonji updated the doc comment section that we probably don't need another bug16:41
*** apetrich has quit IRC16:41
rookfultonj however, ignoring the memory junk, the deployment continues to fail :/16:41
rookfultonj I opened, https://bugzilla.redhat.com/show_bug.cgi?id=1549775 to track this new issue.16:42
*** waleedm has quit IRC16:43
fultonjhttps://github.com/openstack/tripleo-heat-templates/commit/7b762a6a0c6a2931d3a11eecaad246a16f66f4e016:43
*** dsariel has quit IRC16:43
fultonji see the bug was updated regarding ^16:44
*** florianf has quit IRC16:44
*** thrash is now known as thrash|g0ne16:44
fultonjrook: qe hits it16:44
*** florianf has joined #tripleo16:44
rookfultonj right i see gfidente mentioned to try this. I haven't tried it yet.16:45
*** waleedm has joined #tripleo16:45
rookI am trying w/ less nodes ATM.16:46
*** HoloIRCUser3 has joined #tripleo16:48
rookfultonj out in Ireland?16:48
fultonjyeah, (i seem to have caught a cold) going to fall asleepshortly16:49
rookfultonj ack -- i hear someone brought some snow with them :)16:49
rookfultonj: hope you get feeling better. I will let yall know the status of this scale testing.16:49
fultonjyeah, i think they're going to shut the city down in an hour or so16:49
*** waleedm has quit IRC16:49
fultonjrook: ok, thanks16:50
rookfultonj I wish there a way to speed up ceph-ansible... it has been a pain point.16:50
rookfultonj:16:50
rooklol16:50
rookon the shutting down the city16:50
rooknuts.16:50
fultonjthe issue is really to speed up ansible16:50
rookright16:50
fultonjin rocky the issue woud happen on another service fist16:50
fultonjwhoever needs ansible first16:50
fultonjundercloud sets up dns and ssh wrong16:50
*** HoloIRCUser1 has quit IRC16:51
rookugh16:51
*** d0ugal has quit IRC16:51
fultonjso just tell the undercloud's ssh to ignore dns16:51
rookfultonj alright man, ill stop bothering ya. Hope ya feel better asap16:51
fultonjpart of it is releated to a new docker16:51
fultonjrook: np16:51
mwhahahait's not the udnercloud to ignore dns16:51
*** dpeacock has joined #tripleo16:53
*** yamahata has quit IRC16:53
gfidenteyeah it's the overcloud which should16:54
gfidentesshd16:54
gfidenterook so indeed see how it goes with that commit16:54
*** gvrangan has joined #tripleo16:54
rookgfidente: will do.16:54
rookgfidente: thanks for the feedback...16:55
*** ccamacho is now known as ccamacho|PTO16:57
*** florianf has quit IRC16:57
*** agurenko|ptg has quit IRC16:57
*** dparkes has quit IRC16:57
trozetfultonj: hi16:59
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates stable/ocata: Tolerate network errors in pingtest retry logic  https://review.openstack.org/54866317:00
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates stable/newton: Tolerate network errors in pingtest retry logic  https://review.openstack.org/54866517:00
*** pkovar has quit IRC17:01
*** anilvenkata has joined #tripleo17:03
*** jaganathan has quit IRC17:03
*** yolanda has quit IRC17:04
*** dbecker has quit IRC17:04
*** salmankhan has quit IRC17:04
*** kopecmartin has quit IRC17:04
*** fragatina has quit IRC17:04
*** jtomasek has quit IRC17:05
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Add support for using custom FFU repository scripts  https://review.openstack.org/54765517:05
*** gabrioux has quit IRC17:05
*** olivierbourdon38 has quit IRC17:06
*** dprince has quit IRC17:06
*** salmankhan has joined #tripleo17:07
*** artom has quit IRC17:07
*** sshnaidm|ptg has quit IRC17:07
*** gabrioux has joined #tripleo17:08
*** gabrioux has quit IRC17:10
*** apevec has joined #tripleo17:11
trozetgfidente: ping?17:13
*** ebarrera_ has joined #tripleo17:13
gfidentetrozet we're here but moving in a bit17:14
trozetgfidente: seeing a failure in ceph-ansible, 2018-02-27 17:13:35.947838\", \"stderr\": \"stat: cannot stat \\'/var/run/ceph/ceph-mon.overcloud-controller-0.asok\\': No such file or directory\17:14
trozetgfidente: but i see stat /var/run/ceph/ceph-mon.overcloud-controller-0.opnfvlf.org.asok17:14
trozet  File: ‘/var/run/ceph/ceph-mon.overcloud-controller-0.opnfvlf.org.asok’17:14
trozetgfidente: i see you added an OR for fqdn: https://github.com/ceph/ceph-ansible/blob/bdcc52b96dc1f9c99ce490117170f644623d4846/roles/ceph-mon/tasks/docker/main.yml#L1017:15
gfidentetrozet yeah this is fixed in an updated version of ceph-ansible17:15
trozetgfidente: let me make sure i have the fix17:16
gfidentetrozet https://github.com/ceph/ceph-ansible/commit/bdcc52b96dc1f9c99ce490117170f644623d484617:17
gfidentetrozet I think it went into something like 3.0.2417:17
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: WIP: New major upgrade workflow implementation.  https://review.openstack.org/54833617:17
*** apevec has quit IRC17:17
trozetgfidente: yup i dont have the fix17:17
*** myoung|ruck is now known as myoung|ruck|food17:18
trozetgfidente: ceph-ansible-3.1.0beta2-1.el7.noarch17:18
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: WIP: New major upgrade workflow implementation.  https://review.openstack.org/54833617:18
trozetgfidente: looks like it is not updated here? http://mirror.centos.org/centos/7/storage/x86_64/ceph-luminous/ ?17:19
*** sshnaidm|ptg has joined #tripleo17:19
*** chem` has quit IRC17:20
trozettrown|lunch, weshay:^ looks like the versioning is off in the repo, 3.1.0 is older than 3.0.2417:20
gfidentetrozet possibly yes17:20
*** bnemec has quit IRC17:20
trozetgfidente:^^17:20
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: WIP: New major upgrade workflow implementation.  https://review.openstack.org/54833617:21
gfidentetrozet you should have it in http://cbs.centos.org/koji/buildinfo?buildID=2198917:21
gfidentetrozet needs promotion into -testing and -release17:21
mwhahahagithub.com down for anyone else or is it just mean17:22
*** fultonj has quit IRC17:22
trozetmwhahaha: its down17:22
mwhahahahmm17:23
openstackgerritDoug Hellmann proposed openstack/tripleo-ui master: update reno for queens  https://review.openstack.org/54867117:24
*** ebarrera_ has quit IRC17:25
*** dciabrin has quit IRC17:26
*** colonwq has quit IRC17:26
gfidentetty l!17:26
gfidentetrozet thanks for pinging, we're tagging the new builds for testing17:26
gfidenteyou can try the candidate builds meantime17:26
trozetgfidente: so does 3.0-24 built on 2/14 not contain the fix17:26
gfidente3.0.24 does yes17:27
gfidentebut for queens/luminous we target 3.1 branch17:27
*** yprokule has quit IRC17:27
trozetgfidente: ok i see17:27
*** jfrancoa has quit IRC17:27
trozetgfidente: i will just pull the candidate for now and try again17:27
gfidentetrozet ack, thanks!17:27
*** zoli is now known as zoli|gone17:27
trozetgfidente: thanks for your hlep17:27
trozethelp*17:27
*** zoli|gone is now known as zoli17:27
*** gfidente has quit IRC17:28
*** myoung|ruck|food is now known as myoung|ruck17:28
*** rbrady is now known as rbrady-afk17:30
*** chem` has joined #tripleo17:32
*** dpawar_ has joined #tripleo17:33
*** aufi has quit IRC17:33
*** bogdando has quit IRC17:34
*** tesseract has quit IRC17:34
*** dpawar has quit IRC17:35
*** trown|lunch is now known as trown|mtg17:36
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: update reno for queens  https://review.openstack.org/54867117:36
*** dpawar_ has quit IRC17:37
*** fragatina has joined #tripleo17:39
*** apevec has joined #tripleo17:41
*** apevec has quit IRC17:41
*** apevec has joined #tripleo17:41
*** dciabrin has joined #tripleo17:44
*** jtomasek has joined #tripleo17:45
*** tosky has quit IRC17:45
*** dansmith has quit IRC17:45
*** jtomasek has quit IRC17:46
*** jtomasek has joined #tripleo17:47
*** dansmith has joined #tripleo17:47
*** dansmith is now known as Guest8753317:47
*** wolverineav has joined #tripleo17:49
*** sshnaidm|ptg has quit IRC17:49
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: DNM: testing ffu.  https://review.openstack.org/54667017:50
*** ramishra has quit IRC17:51
*** elgxl has joined #tripleo17:52
*** zaneb has quit IRC17:53
*** apevec has quit IRC17:54
*** shreshtha has quit IRC17:54
*** ykarel is now known as ykarel|away17:56
*** jaganathan has joined #tripleo17:58
*** jpena is now known as jpena|off18:01
*** janki has quit IRC18:03
*** ykarel|away is now known as ykarel18:03
*** shreshtha has joined #tripleo18:07
*** suuuper has quit IRC18:10
*** ccamacho|PTO has quit IRC18:16
*** salmankhan has quit IRC18:20
*** elgxl has quit IRC18:22
*** HoloIRCUser3 has quit IRC18:22
*** HoloIRCUser3 has joined #tripleo18:23
*** fragatina has quit IRC18:23
*** fragatina has joined #tripleo18:24
*** HoloIRCUser6 has joined #tripleo18:25
*** elgxl has joined #tripleo18:26
*** elgxl has quit IRC18:27
*** HoloIRCUser3 has quit IRC18:27
*** dciabrin has quit IRC18:27
*** shreshtha has quit IRC18:36
openstackgerritMerged openstack/puppet-tripleo master: Add support for libvirt VNC TLS with option of a dedicated CA  https://review.openstack.org/53640418:39
*** rlandy is now known as rlandy|brb18:40
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Implement fetching of networks  https://review.openstack.org/54868518:51
*** trown|mtg is now known as trown18:54
*** _sshnaidm_ has joined #tripleo18:58
*** shreshtha has joined #tripleo18:59
openstackgerritSandhya Dasu proposed openstack/tripleo-heat-templates stable/ocata: Adding new config parameters for Cisco UCSM ML2 driver  https://review.openstack.org/54436818:59
*** wolverineav has quit IRC19:00
*** dparkes has joined #tripleo19:03
*** rlandy|brb is now known as rlandy19:04
*** wolverin_ has joined #tripleo19:04
*** trown is now known as trown|rover19:05
*** rbrady-afk is now known as rbrady19:08
*** wolverin_ has quit IRC19:09
mwhahahamyoung|ruck: do we have job status history of the ovb jobs in sova? i'm not seeing it on http://38.145.34.10/19:14
mwhahahamyoung|ruck: i'm trying to determine if fs022 is broken on pike or if it's something else19:15
openstackgerritSandhya Dasu proposed openstack/tripleo-heat-templates stable/newton: Adding new config parameters for Cisco UCSM ML2 driver  https://review.openstack.org/54868619:18
*** shreshtha has quit IRC19:18
myoung|ruckmwhahaha: not sure, looking now.19:18
myoung|ruckmwhahaha: in other news, the last job for queens promotion just deployed OC and transitioned into tempest.  https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens/31/console19:19
mwhahahahooray19:19
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add steps to allow downstream to use featuresets  https://review.openstack.org/53645219:19
openstackgerritSandhya Dasu proposed openstack/tripleo-heat-templates stable/newton: Adding new config parameters for Cisco UCSM ML2 driver  https://review.openstack.org/54868619:19
myoung|ruckmwhahaha: I'm looking here: http://38.145.35.214 at periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022-pike, which failure for pike are you looking at now?19:21
mwhahahamyoung|ruck: it was in check19:21
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Test feature sets with downstream  https://review.openstack.org/53645719:21
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Test feature sets with downstream  https://review.openstack.org/53645719:21
mwhahahamyoung|ruck: let me see the periodic failures19:21
myoung|ruckmwhahaha: the sova instances were just a few hours ago stood back up (thanks _sshnaidm_!)...looking for the pike check failure...19:23
mwhahahamyoung|ruck: yea its not the same19:23
mwhahahathat's something else19:23
mwhahahai was seeing a pingtest failure from nova19:23
*** dsariel has joined #tripleo19:23
mwhahahai rechecked to see if it's consistent19:23
mwhahahathe periodic failure seems to be an issue with br-ex19:23
mwhahahaError: Execution of '/usr/sbin/ip link set dev br-ex up' returned 1: Cannot find device "br-ex"[0m19:24
mwhahahahttps://logs.rdoproject.org/openstack-periodic-24hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-ocata/1bd3dfb/postci.txt.gz19:24
myoung|ruckhrm...are we missing logs in sova for check jobs?19:24
mwhahahai don't think so19:25
mwhahahawell i didn't see the check job in sova but maybe it's delayed19:25
mwhahahaanyway speaking of weird failures19:26
mwhahahamyoung|ruck: do you know if the install-built-repo task assumes something will always be updated? http://logs.openstack.org/30/548230/1/check/tripleo-ci-centos-7-containers-multinode/c0276ba/job-output.txt.gz#_2018-02-28_16_25_14_77578319:26
mwhahahahttp://logs.openstack.org/30/548230/1/check/tripleo-ci-centos-7-containers-multinode/c0276ba/logs/undercloud/home/zuul/install_built_repo.log.txt.gz19:27
mwhahahanot sure why that failed19:27
myoung|ruckhttp://logs.openstack.org/30/548230/1/check/tripleo-ci-centos-7-containers-multinode/c0276ba/logs/subnode-2/home/zuul/install_built_repo.log.txt.gz#_2018-02-28_16_25_1919:28
*** sai____ has joined #tripleo19:28
myoung|rucki think that fail was on subnode219:28
mwhahahaah ok19:29
myoung|ruck2018-02-28 16:25:19 | Error: Package: python-paunch-2.2.1-0.20180228162328.5c7a785.el7.centos.noarch (gating-repo)19:29
myoung|ruck2018-02-28 16:25:19 |            Requires: python2-cliff19:29
mwhahahabah19:29
myoung|rucknew dep?19:30
mwhahahano19:30
mwhahahashouldn't be19:30
myoung|rucksometimes these package names crack me up...there's so much I'm not familiar with19:30
*** wolverineav has joined #tripleo19:30
myoung|ruck"ahhh we couldn't install paunch because it requires cliff, but we're fine with tenacity"19:30
myoung|ruck{8p19:31
mwhahaha:D19:32
*** etingof has quit IRC19:33
weshaymyoung|ruck, mwhahaha, https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens/31/console19:35
mwhahahayay?19:36
weshayyes.. promtion will start in 4min19:36
weshayhttp://38.145.34.55/queens.log19:36
myoung|ruckweshay: dayumm.  I've been checking every 4-5 mins and you beat me to it.19:36
weshaypromotion19:36
mwhahaha\o/19:36
weshaymyoung|ruck, had it on my phone19:36
myoung|ruck{blink}19:36
myoung|ruckrss?19:37
*** wolverineav has quit IRC19:38
*** wolverineav has joined #tripleo19:38
*** _sshnaidm_2 has joined #tripleo19:38
*** _sshnaidm_ has quit IRC19:39
*** wolverineav has quit IRC19:39
*** wolverin_ has joined #tripleo19:39
weshay:(19:40
*** waleedm has joined #tripleo19:41
*** _sshnaidm_2 has quit IRC19:41
*** sshnaidm|ptg has joined #tripleo19:45
trozetmwhahaha: can you point me to anyone in #tripleo who is familiar with ceph/ceph-ansible.  I'm seeing more issues with luminous + queens19:46
mwhahahatrozet: fultonj gfidente19:46
trozetmwhahaha: anyone else, they aren't around right now19:47
mwhahahatrozet: nope19:47
*** itlinux has quit IRC19:47
mwhahahaweshay, myoung|ruck: did we get a master promotion too or just queens19:48
weshayjust queens, myoung|ruck will be reporting new master issues19:48
mwhahahabooo new master issues19:49
*** mwhahaha changes topic to "Queens RC1 deadline: March 1st - CI status: Master Promotion - RED, Queens Promotion - GREEN, check/gate - GREEN | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/"19:50
* myoung|ruck attempts to allocate more recv buffer space19:50
mwhahahamyoung|ruck: http://firehose.sandia.gov/images/firehose.jpg19:51
myoung|ruckmwhahaha: yes that.19:52
*** wolverin_ has quit IRC19:54
*** etingof has joined #tripleo19:56
mwhahahahmm looks like master fs001 failed for authentication failure again19:57
* mwhahaha digs19:57
weshaymyoung|ruck, I think mwhahaha needs a master promote as soon as possible19:58
mwhahahaqueens was more important but yea19:58
mwhahahawe need to get on this19:58
weshayyup19:58
mwhahahauh oh19:59
mwhahahadoesn't look like fs001 had my instack-undercloud fix19:59
mwhahahawhich is weird19:59
mwhahahacause it landed 2 days ago19:59
weshaymwhahaha, where do you see master failing on the firewall?19:59
*** ebarrera has quit IRC19:59
mwhahahahttps://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/2d8a03a/19:59
weshayhttps://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/67/19:59
mwhahahaFORWARD is DROP19:59
weshaymwhahaha, that just passed20:00
weshaymwhahaha, https://review.rdoproject.org/zuul/20:00
weshay17 and 19 failed20:00
mwhahahaweshay: so i guess this is my confusion on the status pages for these processes20:00
mwhahahaweshay: i'm probably looking at the wrong jobs20:01
weshayya.. status updates every 30 min20:01
weshayhttps://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/45442f0/tempest.html.gz20:02
weshaytelemetry20:02
mwhahahait would be realllllly nice to have a single view that wasn't just a smattering of links that required the viewer to know what is what20:02
weshayand20:02
weshayinfra https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/0ed31dc/console.txt.gz20:02
mwhahahaUnable to complete operation on subnet 87f0f9b4-edab-454d-a7d9-0144816b54b5: One or more ports have an IP allocation from this subnet.20:02
weshayinteresting20:03
weshaymyoung|ruck, you can bring up a recreate on ^20:03
*** juriarte has quit IRC20:03
mwhahahawas https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/0ed31dc/console.txt.gz just a failure calling dlrn?20:03
* mwhahaha doesn't know failed20:04
myoung|ruckweshay: sure.20:04
myoung|ruckmwhahaha: re: single view/pane, agreed.  I'm trying to keep up here20:04
weshaymyoung|ruck, you want to run https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/45442f0/reproducer-quickstart.sh20:04
myoung|ruckweshay: aye...doing that now on my personal tenangt20:05
myoung|rucktenant20:05
mwhahahaoh https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/0ed31dc/ara/ failed on ping check20:05
mwhahahaso infra20:05
mwhahahaso looks like 17 is the only code failure20:05
* mwhahaha goes looking20:05
mwhahahahttps://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/45442f0/subnode-2/var/log/containers/neutron/server.log.txt.gz#_2018-02-28_19_13_39_11620:07
mwhahahalooks like neutron isn't deleting things quick enough or something20:07
weshaymwhahaha, tempest couldn't delete the ip?20:08
* weshay checks the concurrency for tempest there20:08
weshay1720:08
mwhahahait's possible or it took to long20:08
weshaytempest_workers: 120:09
trozetweshay, mwhahaha: do you ever test ceph with queens in a noha deployment?  I only ahve one ceph monitor, and the status is stuck in probing.  I think it is not reaching quorum because there is only 1 mon20:09
weshaymwhahaha, so that just passed in queens..20:09
mwhahahatrozet: i've heard that there's an issue around something like that. we test non-ha in CI20:10
weshaycan't really help atm trozet20:10
mwhahahatrozet: i think you need to tune down some of the configs for that20:10
mwhahahatrozet: scenario001/003 are ceph based20:10
trozetmwhahaha: im thinking maybe im missing an env file or something..20:10
trozetmwhahaha: ok let me go check those configs20:10
mwhahahatrozet: https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/scenario001-multinode-containers.yaml#L116-L14220:11
mwhahahatrozet: you may need to turn CephPoolDefaultSize: 120:11
mwhahahatrozet: that had previously gotten us, that' should enable non-ha20:11
mwhahahatrozet: the default is 3 it hink20:11
trozetmwhahaha: right i had already set htat one20:11
mwhahahaweshay, myoung|ruck: so we probably just need to file a bug on the fs17 failure and get networking folks involved to figure out what happened20:12
myoung|ruckmwhahaha: I'm doing that now, and have a reproducer running presently20:12
myoung|ruckmwhahaha: on personal tenant20:13
mwhahahak20:13
weshaymyoung|ruck, ya.. but also write up a bug w/ the log that mwhahaha posted.. re: neutron not deleting the ip20:13
weshaymyoung|ruck, the escalation card should have asaf, myself and chandan or arx on it20:14
mwhahahaor it may not have been requested to be deleted but it seems to be a floating ip issue in the tempest test20:14
weshayas it's possible it's a tempest snafu too20:14
mwhahahayea20:14
*** eck` is now known as eck`gone20:15
*** atoth has quit IRC20:15
*** ledo_ has joined #tripleo20:19
*** waleedm has quit IRC20:19
trozetmwhahaha: can you tell me why this is set? https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/scenario001-multinode-containers.yaml#L11620:21
trozetmwhahaha: are the default insufficient?20:21
trozetdefaults*20:21
mwhahahatrozet: i have no idea20:21
trozetmwhahaha: ok i might try setting that then just to see what happens20:22
mwhahahatrozet: i assume there are no valid defaults for the disk config, but that's a question for the ceph folks20:23
trozetmwhahaha: well im guessing in line 118 specifying loop block device, I'm hoping OOO creates that20:24
*** ykarel_ has joined #tripleo20:29
weshaymyoung|ruck, + 16 https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/597b6db/console.txt.gz#_2018-02-28_20_09_14_79820:29
weshaywhoops20:30
weshayhttps://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/597b6db/console.txt.gz#_2018-02-28_20_05_46_02720:30
weshaymyoung|ruck, timeout pulling containers20:30
weshayfrom rdo-reg20:30
*** ykarel has quit IRC20:31
weshaymyoung|ruck, this also looks like infra https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/329/console20:33
*** aputtur_ has quit IRC20:34
*** radeks has joined #tripleo20:35
mwhahahaweshay: where's the container push for the promotion process (and is it still running for queens)20:35
*** fragatina has quit IRC20:35
*** fragatina has joined #tripleo20:36
*** fragatina has quit IRC20:36
weshaymwhahaha, yes.. the containers are pushing atm.. there was an issue w/ the list of containers because it was the first one on queens20:36
*** fragatina has joined #tripleo20:36
mwhahahak20:36
weshaymwhahaha, trown|rover can describe it better, but they are pushing now and he's fixing hte issue20:36
trown|rovermwhahaha: had a bug in container push script that caused list of containers to be empty, and we didnt fail on empty list20:38
mwhahahaoops :D20:38
trown|rovermwhahaha: currently just working on getting containers manually pushed asap, will push actual fix and fix for the issue of empty list being allowed later20:38
*** liverpooler has quit IRC20:39
ykarel_weshay, i think this is not timeout "in pulling containers" in fs16 but something else20:39
*** ykarel_ is now known as ykarel20:39
*** zaneb has joined #tripleo20:39
trown|rovermwhahaha: containers are all there on rdoproject, so just a matter of running manual tag and repush operation20:39
ykarelweshay, i think the issue is paste.openstack.org/show/682220/ i saw few days back, rlandy do you remember?20:41
ykareland you pinged slowest after that, i can't catch up after that20:42
weshayykarel, the issue wasn't w/ https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/container-push/container-push.yml#L37 ?20:44
myoung|ruckweshay, trown|rover: is there a way to kick the trello creation script faster or is it just a 4 hour timer?  https://bugs.launchpad.net/tripleo/+bug/1752420 logged for the fs17 issue above20:44
openstackLaunchpad bug 1752420 in tripleo "fs017: failure to delete IP causing tempest failures" [Critical,Triaged]20:44
weshaymyoung|ruck, 4hrs is fine.20:44
weshaymyoung|ruck, it gives us a chance of fixing the issue prior to the escalation20:44
*** yamahata has joined #tripleo20:45
ykarelweshay, i am talking about featureset 16 failure20:45
ykarel<weshay> myoung|ruck, + 16 https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/597b6db/console.txt.gz#_2018-02-28_20_09_14_79820:45
ykarel^^ one20:45
weshayoh k20:45
weshayykarel, it failed here https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/597b6db/console.txt.gz#_2018-02-28_20_05_46_02720:46
weshayhigher up20:46
* rlandy looks20:46
ykarelweshay, yes during running of overcloud-prep-containers.sh20:46
weshayykarel, and the undercloud did not get logged20:46
weshayykarel, right20:47
*** fragatina has quit IRC20:47
weshayok.. ok.. I'm in sync now ykarel20:47
weshayw/ ur coment20:47
weshaycomment20:47
weshayykarel, the featureset just passed on queens20:47
weshaythey use the same config20:47
* weshay checks the config20:47
rlandyykarel: yep - we looked at something similar last week20:47
ykarelweshay, yes it's not the config issue20:48
ykarelit happens sometime20:48
ykarelthe overcloud-prep-containers.sh stucks at container-check20:48
ykarelweshay, http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/overcloud-prep-containers/templates/overcloud-prep-containers.sh.j2#n10520:49
weshayman.. ya.. it could be container check20:50
weshaycontainer-check -c {{ working_dir }}/containers_update.yaml -u -p {{ container_process_count }}20:50
ykarelyes20:50
weshayykarel, that's why we only have it enabled in rdo-cloud20:50
weshay:)20:50
weshaystill is not 100% mature20:50
weshayrlandy, is familiar w/ that20:50
ykarelso if somehow if a container get into Dead state, container-check stucks20:50
weshayykarel, last time that happened did the undercloud log?20:51
weshaysl0w, ^20:51
weshayfyi20:51
ykarelsee paste.openstack.org/show/68222020:51
ykarelweshay, no undercloud logs were not there, this i found in my local reproducer20:51
weshayykarel, what do you see there?20:52
weshayah k20:52
weshayykarel, hrmm20:52
weshayI wonder if the undercloud went down20:52
weshayin both cases20:52
ykarelno it was up afair20:52
weshayykarel, although.... there's nothing special aobut 16 vs.. another scenario20:52
weshayre: container update20:52
weshayykarel, maybe a package update it blowing up networking?20:52
ykarelmay be20:53
ykarelam not sure20:53
ykareldon't know why container got into Dead state20:53
weshayykarel, myoung|ruck ok.. so that job should have a bug open on quickstart until we figure out something else20:53
*** vpickard is now known as vpickard_20:53
ykarel+120:54
mwhahahaoh that reminds me, have we enabled container updates in CI for changes?20:54
weshaymwhahaha, just in rdo-cloud20:54
weshayso 3rd party check and promotion20:55
weshayso we don't destroy upstream w/ $new process20:55
mwhahahathe problem is that we're running -containers jobs on other projects but they don't get the changes20:56
weshaymwhahaha, right20:56
weshaybut we need to be dam sure it's reliable20:56
weshaymwhahaha, or you make the call20:56
weshayand it can be enabled20:56
mwhahahawell is it a targeted update or is it all20:56
mwhahahaie a change with a neutron zuul change only gets neutron containers updated20:56
mwhahahaor a change updates all containers all the time20:56
weshayit's dlrn updates plus base centos w/ updates20:57
weshayso that if a dlrn package req's an additional centos rpm20:57
* weshay shows you20:57
mwhahahacan we away w/o doing the base centos update?20:57
weshaymwhahaha, https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-prep-containers/templates/overcloud-prep-containers.sh.j2#L9320:58
weshaymwhahaha, read the config there20:58
openstackgerritOpenStack Proposal Bot proposed openstack/python-tripleoclient stable/queens: Updated from global requirements  https://review.openstack.org/54870420:59
weshaymwhahaha, make sense?20:59
mwhahahayea i was just wondering if there's some more logic we can do to be even more targeted21:00
mwhahahanot sure if we should keep centos-base21:00
weshaywe have to21:00
weshaydelrean change requires a base rpm not on the system21:00
weshaythat's how it was originally21:00
weshayand we hit a bug21:01
weshayw/o centos updates .. base packages are not updated21:01
mwhahaha:/21:01
weshaydon't give me the side face21:01
mwhahaha:\21:01
mwhahaha:/21:01
mwhahaha:\21:01
mwhahaha:|21:01
mwhahahaoh yea did we package containers-check21:02
* mwhahaha likes to ask questions to which he knows the answer21:03
*** agopi has joined #tripleo21:05
*** apevec has joined #tripleo21:08
mwhahahaEmilienM: so given that we have a queens promotion, should we cut a release this week?21:08
weshayget it while it's hot21:10
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175242021:10
openstackLaunchpad bug 1752420 in tripleo "fs017: failure to delete IP causing tempest failures" [Critical,Triaged]21:10
*** ooolpbot has quit IRC21:10
*** trown|rover is now known as trown|rover|brb21:10
weshayI'll be back later21:11
*** artom has joined #tripleo21:13
*** dsariel has quit IRC21:16
*** agopi has quit IRC21:22
*** eck`gone is now known as eck`21:25
*** trown|rover|brb is now known as trown|rover21:26
*** ykarel is now known as ykarel|away21:28
*** jaganathan has quit IRC21:30
*** dsariel has joined #tripleo21:30
*** paramite has quit IRC21:40
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient stable/queens: Update .gitreview for stable/queens  https://review.openstack.org/53905721:45
*** fragatina has joined #tripleo21:47
*** wolverineav has joined #tripleo21:49
*** salmankhan has joined #tripleo21:51
*** fragatina has quit IRC21:52
*** fragatina has joined #tripleo21:53
EmilienMto repeat what I said to mwhahaha, +1 for a release when we have stable/queens jobs working21:54
EmilienMmwhahaha: not sure who to thank and congratulate but thanks everyone who were involved in making that promotion happening...21:55
mwhahahaindeed21:55
mwhahahaprops to the ci team for getting rdo cloud back up21:56
*** salmankhan has quit IRC21:56
*** wolverineav has quit IRC21:58
*** wolverineav has joined #tripleo21:59
mwhahahayea looks like fs022 is broken for pike22:01
* mwhahaha files bug22:01
trown|rover94311822:02
*** yolanda has joined #tripleo22:02
mwhahaha?22:03
trown|roveron the bus... yubikey fail22:04
mwhahaha:D22:04
*** bfournie has quit IRC22:05
trown|roverEmilienM: thank ykarel when he is not away, working in the middle of his night to help get promotion22:07
*** wolverineav has quit IRC22:08
mwhahahahttps://bugs.launchpad.net/tripleo/+bug/175244122:08
openstackLaunchpad bug 1752441 in tripleo "featureset022 on stable/pike fails on ping test" [Critical,Triaged]22:08
*** wolverineav has joined #tripleo22:08
*** ykarel|away has quit IRC22:09
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175242022:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175244122:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1752420 in tripleo "fs017: failure to delete IP causing tempest failures" [Critical,Triaged]22:10
openstackLaunchpad bug 1752441 in tripleo "featureset022 on stable/pike fails on ping test" [Critical,Triaged]22:10
*** trown|rover is now known as trown|outtypewww22:12
*** brault has quit IRC22:18
*** lyarwood_ is now known as lyarwood22:21
*** jtomasek has quit IRC22:22
EmilienMtrown|outtypewww: I will22:23
openstackgerritAde Lee proposed openstack/instack-undercloud master: Make sure novajoin endpoints are registered  https://review.openstack.org/54871722:24
*** anilvenkata has quit IRC22:24
*** brault has joined #tripleo22:24
*** yamahata has quit IRC22:24
*** rcernin has joined #tripleo22:25
*** dmacpher has joined #tripleo22:25
*** dmacpher_ has quit IRC22:27
*** brault has quit IRC22:28
*** jlabarre has quit IRC22:30
openstackgerritAde Lee proposed openstack/tripleo-common master: Add custom action to add dns entries via novajoin  https://review.openstack.org/54835522:31
*** dprince has joined #tripleo22:32
openstackgerritHarald JensÃ¥s proposed openstack/instack-undercloud master: Install and enable neutron baremetal mech plugin  https://review.openstack.org/53783022:35
hjensas\o/ promotion Green! Well done guys!22:35
hjensasand girls ... :)22:35
*** anilvenkata has joined #tripleo22:36
openstackgerritAde Lee proposed openstack/tripleo-heat-templates master: WIP: Add DNS data to IdM  https://review.openstack.org/54405222:36
*** chlong has quit IRC22:37
*** yamahata has joined #tripleo22:40
*** anilvenkata has quit IRC22:42
*** radeks has quit IRC22:43
*** wolverineav has quit IRC22:44
*** ebarrera_ has joined #tripleo22:49
*** Goneri has quit IRC22:49
*** fragatina has quit IRC22:52
*** fragatina has joined #tripleo22:52
*** wolverineav has joined #tripleo22:55
*** bfournie has joined #tripleo22:55
*** rlandy is now known as rlandy|bbl22:55
*** dciabrin has joined #tripleo22:57
*** yamahata has quit IRC22:59
*** jmelvin has quit IRC23:00
*** wolverineav has quit IRC23:04
*** yamahata has joined #tripleo23:04
*** wolverineav has joined #tripleo23:04
weshaymwhahaha, EmilienM I have fs017 on master recreated23:07
weshayDetails: {u'message': u'Unable to complete operation on subnet 20e994c5-b54a-4f31-8767-3f18bedbc6de: One or more ports have an IP allocation from this subnet.', u'type': u'SubnetInUse', u'detail': u''}23:07
mwhahahaweshay: yea sounds like we need to get the tempest/networking folks to look23:08
weshaymyoung|ruck, ^23:08
weshaymwhahaha, ok.. chandan has seen this23:09
weshayit's a tempest bug23:09
mwhahahaweshay: go catch some zzzzs23:09
*** wolverineav has quit IRC23:09
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175242023:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175244123:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1752420 in tripleo "fs017: failure to delete IP causing tempest failures" [Critical,Triaged]23:10
openstackLaunchpad bug 1752441 in tripleo "featureset022 on stable/pike fails on ping test" [Critical,Triaged]23:10
*** yamahata has quit IRC23:12
myoung|ruckweshay: , my recreater is still hanging on overcloud-prep-containers23:13
weshaymyoung|ruck, ok.. I have one working so you can nuke yours.. and save your tenant for another23:14
*** yamahata has joined #tripleo23:14
*** bugzy_ has joined #tripleo23:17
*** dciabrin has quit IRC23:18
*** Ng has quit IRC23:19
*** rajinir has quit IRC23:19
*** mnaser has quit IRC23:19
*** bugzy has quit IRC23:21
*** yamahata has quit IRC23:21
*** wolverineav has joined #tripleo23:21
*** rajinir has joined #tripleo23:21
*** wolverineav has quit IRC23:21
*** wolverineav has joined #tripleo23:21
*** mwhahaha has quit IRC23:21
*** yamahata has joined #tripleo23:22
*** gregwork has quit IRC23:22
myoung|ruckweshay: re-running mine, I need to be afk a bit for dinner.  Not sure why it was hanging, it pulled down containers and just sat.23:23
*** mnaser has joined #tripleo23:23
*** Ng has joined #tripleo23:23
*** ChanServ sets mode: +v Ng23:23
*** mnaser has quit IRC23:24
*** mcornea has quit IRC23:24
*** sdoran has quit IRC23:24
*** mgkwill has quit IRC23:25
myoung|ruckapevec, amoralej, weshay, trown|outtypewww: looks like RDO1 failed with half of the wierdo jobs timing out after 120, and the pacemaker job passing, but the OOOQ minimal job failling during OC deploy.  Not sure if it's root cause but errors rom zaqar about tripleo-ui-logging queue23:25
*** mnaser has joined #tripleo23:25
*** gregwork has joined #tripleo23:25
*** mwhahaha has joined #tripleo23:25
*** ChanServ sets mode: +v mwhahaha23:25
*** rajinir has quit IRC23:25
*** sdoran has joined #tripleo23:25
*** mnaser has quit IRC23:25
myoung|ruck^^ https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-queens-rdo_trunk-minimal-1/undercloud/var/log/zaqar/zaqar.log.gz, https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-queens-rdo_trunk-minimal-1/undercloud/home/stack/overcloud_deploy.log.gz23:25
*** patrickeast has quit IRC23:26
*** gregwork has quit IRC23:26
*** rajinir has joined #tripleo23:26
*** mnaser has joined #tripleo23:26
*** gregwork has joined #tripleo23:27
*** mgkwill has joined #tripleo23:27
*** kbyrne has quit IRC23:28
*** gregwork has quit IRC23:28
*** gregwork has joined #tripleo23:28
*** patrickeast has joined #tripleo23:28
*** ledo_ has quit IRC23:29
*** tcw has quit IRC23:31
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Tolerate network errors in pingtest retry logic  https://review.openstack.org/54866323:32
*** tcw has joined #tripleo23:33
*** kbyrne has joined #tripleo23:33
*** yamahata has quit IRC23:34
*** fragatina has quit IRC23:39
*** fragatina has joined #tripleo23:39
*** fragatina has quit IRC23:41
*** fragatina has joined #tripleo23:41
*** tcw has quit IRC23:47
*** tcw has joined #tripleo23:49
*** fragatina has quit IRC23:50
*** fragatina has joined #tripleo23:50
*** ledo_ has joined #tripleo23:50
*** yamahata has joined #tripleo23:53
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: Tolerate network errors in pingtest retry logic  https://review.openstack.org/54866523:53
*** fragatina has quit IRC23:55
*** fragatina has joined #tripleo23:56
*** bugzy has joined #tripleo23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!