Monday, 2017-05-29

*** gbarros_ has joined #tripleo00:01
*** gbarros has quit IRC00:02
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019500:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013200:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383000:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394500:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169415700:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]00:10
openstackLaunchpad bug 1693830 in tripleo "ovb-updates job fails with gnocchi upgrade command timeout" [Critical,Triaged]00:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged]00:10
openstackLaunchpad bug 1694157 in tripleo "all tripleo jobs are failing: python2-urllib3 fails to be deployed" [Critical,Triaged]00:10
*** gbarros_ has quit IRC00:16
*** mdnadeem has joined #tripleo00:23
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Drop support for Ubuntu precise  https://review.openstack.org/46818600:33
*** gbarros has joined #tripleo00:40
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019501:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013201:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383001:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394501:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169415701:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]01:10
openstackLaunchpad bug 1693830 in tripleo "ovb-updates job fails with gnocchi upgrade command timeout" [Critical,Triaged]01:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged]01:10
openstackLaunchpad bug 1694157 in tripleo "all tripleo jobs are failing: python2-urllib3 fails to be deployed" [Critical,Triaged]01:10
*** gbarros has quit IRC01:19
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019502:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013202:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383002:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394502:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169415702:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]02:10
openstackLaunchpad bug 1693830 in tripleo "ovb-updates job fails with gnocchi upgrade command timeout" [Critical,Triaged]02:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged]02:10
openstackLaunchpad bug 1694157 in tripleo "all tripleo jobs are failing: python2-urllib3 fails to be deployed" [Critical,Triaged]02:10
*** mdnadeem has quit IRC02:32
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: allow uninstalls to fail on gentoo  https://review.openstack.org/46875402:34
*** mdnadeem has joined #tripleo02:36
*** udesale has joined #tripleo02:43
*** udesale__ has joined #tripleo03:02
*** udesale has quit IRC03:04
*** udesale__ has quit IRC03:06
*** udesale__ has joined #tripleo03:07
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019503:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013203:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383003:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394503:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169415703:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]03:10
openstackLaunchpad bug 1693830 in tripleo "ovb-updates job fails with gnocchi upgrade command timeout" [Critical,Triaged]03:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged]03:10
openstackLaunchpad bug 1694157 in tripleo "all tripleo jobs are failing: python2-urllib3 fails to be deployed" [Critical,Triaged]03:10
*** itlinux has joined #tripleo03:14
*** ratailor has joined #tripleo03:29
*** mdnadeem has quit IRC03:30
*** links has joined #tripleo03:35
*** psahoo has joined #tripleo03:37
*** psahoo has quit IRC03:37
*** ratailor has quit IRC03:39
*** ratailor has joined #tripleo03:39
*** psahoo has joined #tripleo03:40
*** links has quit IRC03:43
*** janki has joined #tripleo03:44
*** links has joined #tripleo03:45
*** mdnadeem has joined #tripleo03:46
*** prateek has joined #tripleo03:48
*** ykarel has joined #tripleo03:48
*** itlinux has quit IRC03:57
*** itlinux has joined #tripleo04:02
*** masco has joined #tripleo04:03
*** itlinux has quit IRC04:04
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019504:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013204:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383004:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394504:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169415704:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]04:10
openstackLaunchpad bug 1693830 in tripleo "ovb-updates job fails with gnocchi upgrade command timeout" [Critical,Triaged]04:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged]04:10
openstackLaunchpad bug 1694157 in tripleo "all tripleo jobs are failing: python2-urllib3 fails to be deployed" [Critical,Triaged]04:10
*** itlinux has joined #tripleo04:13
*** sshnaidm|off is now known as sshnaidm|afk04:14
sshnaidm|afkcores, please review unblock our CI: https://review.openstack.org/#/c/46873204:15
sshnaidm|afkEmilienM, adarazs ^^04:15
*** itlinux has quit IRC04:17
bandinisshnaidm|afk: done04:21
*** yamahata has quit IRC04:21
*** itlinux has joined #tripleo04:23
*** itlinux has quit IRC04:28
*** jaosorior has joined #tripleo04:45
*** itlinux has joined #tripleo04:45
*** dparkes has quit IRC05:00
openstackgerritNuman Siddique proposed openstack/puppet-tripleo master: Pacemaker support for OVN DB servers  https://review.openstack.org/37227405:06
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019505:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013205:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383005:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394505:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169415705:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]05:10
openstackLaunchpad bug 1693830 in tripleo "ovb-updates job fails with gnocchi upgrade command timeout" [Critical,Triaged]05:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged]05:10
openstackLaunchpad bug 1694157 in tripleo "all tripleo jobs are failing: python2-urllib3 fails to be deployed" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)05:10
*** bkopilov has joined #tripleo05:10
*** lmiccini has joined #tripleo05:27
*** panda|travel is now known as panda|pnq05:29
*** itlinux has quit IRC05:33
openstackgerritAndreas Florath proposed openstack/diskimage-builder master: Refactor: Clean up state initialization  https://review.openstack.org/46876805:33
*** dmacpher has joined #tripleo05:37
*** florianf has joined #tripleo05:41
*** masco has quit IRC05:42
*** agurenko has joined #tripleo05:45
*** iranzo has joined #tripleo05:51
openstackgerritAndreas Florath proposed openstack/diskimage-builder master: Refactor: Remove globals from block device mkfs and mount  https://review.openstack.org/46872705:52
openstackgerritAndreas Florath proposed openstack/diskimage-builder master: Refactor: Generalize parameters passed to plugins  https://review.openstack.org/46870905:52
openstackgerritAndreas Florath proposed openstack/diskimage-builder master: Refactor: Pass 'state' to plugin constructor  https://review.openstack.org/46871605:52
*** dmacpher has quit IRC05:53
*** masco has joined #tripleo05:54
*** skramaja has joined #tripleo05:55
*** anshul has joined #tripleo05:56
*** dparkes has joined #tripleo06:02
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019506:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013206:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383006:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394506:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169415706:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169419106:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]06:10
openstackLaunchpad bug 1693830 in tripleo "ovb-updates job fails with gnocchi upgrade command timeout" [Critical,Triaged]06:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged]06:10
openstackLaunchpad bug 1694157 in tripleo "all tripleo jobs are failing: python2-urllib3 fails to be deployed" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)06:10
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged]06:10
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Add pylint with indent check  https://review.openstack.org/46877606:13
*** pgadiya has joined #tripleo06:16
*** pgadiya has quit IRC06:16
*** ebarrera has joined #tripleo06:22
*** ebarrera has quit IRC06:22
*** ebarrera has joined #tripleo06:23
*** jprovazn has joined #tripleo06:23
*** tvignaud_pto is now known as tvignaud06:24
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: allow uninstalls to fail on gentoo  https://review.openstack.org/46875406:28
bandinijaosorior: is https://bugs.launchpad.net/tripleo/+bug/1694191 something you can help with?06:29
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged]06:29
*** rcernin has joined #tripleo06:33
*** limao has joined #tripleo06:36
ebarreraping tripleo, I have been trying to use yaml templates to update arbitrary configuration files not handled by puppet. Is there a working example somewhere ?06:44
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: Drop support for Ubuntu precise  https://review.openstack.org/46818606:46
chandankumarsshnaidm|afk: hello06:46
*** limao_ has joined #tripleo06:50
*** limao has quit IRC06:53
*** yprokule has joined #tripleo06:58
*** jaganathan has joined #tripleo07:00
*** fzdarsky has joined #tripleo07:05
*** jlinkes has joined #tripleo07:05
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019507:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013207:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383007:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394507:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169415707:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169419107:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]07:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1693830 in tripleo "ovb-updates job fails with gnocchi upgrade command timeout" [Critical,Triaged]07:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged]07:10
openstackLaunchpad bug 1694157 in tripleo "all tripleo jobs are failing: python2-urllib3 fails to be deployed" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)07:10
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged]07:10
*** dtantsur|afk is now known as dtantsur07:11
*** bogdando has joined #tripleo07:11
*** anshul has quit IRC07:14
*** anshul has joined #tripleo07:14
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Modify PreNetworkConfig config inline with role-specific parameters  https://review.openstack.org/44705107:14
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Enable DPDK on boot using PreNetworkConfig  https://review.openstack.org/46749007:14
*** suuuper has joined #tripleo07:15
*** anshul has quit IRC07:23
*** anshul has joined #tripleo07:27
*** aufi has joined #tripleo07:28
EmilienMsshnaidm|afk: looking07:31
EmilienMapproved07:31
*** tesseract has joined #tripleo07:33
*** ccamacho has joined #tripleo07:34
openstackgerrityolanda.robla proposed openstack/tripleo-image-elements master: Add overcloud-secure element  https://review.openstack.org/44912207:35
*** limao_ has quit IRC07:37
*** jpena|off is now known as jpena07:38
jaosoriorbandini: well, the cert has the wrong name. As far as I remember, that's something that's generated by a quickstart task as well. Should be fixed there :/07:38
*** mcornea has joined #tripleo07:40
jaosoriorbandini: the other option is that the undercloud might not trust the certificate that the overcloud is exposing. So that might also give that verification failure.07:41
jaosoriorsshnaidm|afk: ^^07:41
*** amoralej|off is now known as amoralej07:43
*** egonzalez has joined #tripleo07:43
*** jpich has joined #tripleo07:45
*** milan has quit IRC07:47
*** dsariel has joined #tripleo07:48
*** karimb has joined #tripleo07:48
EmilienMjaosorior: I'm looking too now07:53
openstackgerritChristian Schwede proposed openstack/puppet-tripleo master: Fix Swift ring inconsistency in container deploymnents  https://review.openstack.org/46879007:57
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests  https://review.openstack.org/40373107:59
*** zzzeek has quit IRC08:00
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations  https://review.openstack.org/40357608:00
*** zzzeek has joined #tripleo08:00
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Fix ansible-lint.sh to check playbooks  https://review.openstack.org/44652508:01
*** tvignaud has quit IRC08:02
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019508:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013208:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383008:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394508:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169415708:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169419108:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]08:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1693830 in tripleo "ovb-updates job fails with gnocchi upgrade command timeout" [Critical,Triaged]08:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged]08:10
openstackLaunchpad bug 1694157 in tripleo "all tripleo jobs are failing: python2-urllib3 fails to be deployed" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)08:10
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged]08:10
*** dparkes has quit IRC08:11
*** sid1 has joined #tripleo08:11
*** tvignaud has joined #tripleo08:15
*** gbarros has joined #tripleo08:17
*** lmiccini has quit IRC08:18
*** karimb has quit IRC08:18
*** lucas-afk is now known as lucasagomes08:19
*** masco has quit IRC08:26
*** paramite has joined #tripleo08:26
ebarreraping tripleo, I have been trying to use yaml templates to update arbitrary configuration files not handled by puppet. Is there a working example somewhere ?08:27
*** karthiks has joined #tripleo08:29
EmilienMbandini, jaosorior: the SSL error is weird - because the previous and following requests work fine08:30
EmilienMI wonder if this error is consistent08:30
EmilienMor if we are just unlucky08:30
*** masco has joined #tripleo08:30
EmilienM/Stage[main]/Keystone::Roles::Admin/Keystone_tenant[service]/ensure: created08:30
bandinioh wow08:30
EmilienMlike 1 second before08:30
*** lmiccini has joined #tripleo08:30
EmilienMsee http://logs.openstack.org/32/468732/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/ea6bb99/logs/undercloud/home/jenkins/undercloud_install.log.txt.gz#_2017-05-29_01_17_0908:30
EmilienMI'm pretty sure it's random08:31
EmilienMbut I'll triple check08:31
jaosoriorEmilienM: any idea what endpoint was used?08:31
EmilienMjaosorior: same08:31
EmilienMI think08:31
EmilienMthough it's always for /Stage[main]/Keystone::Roles::Admin/Keystone_user[admin]08:33
EmilienMin both ha & container jobs08:33
EmilienMit can also be a race08:35
jaosoriorso, it tried to use https://192.168.24.2:13000/v3/auth/tokens   and certmonger generated a cert for 192.168.24.2 as well :/08:35
EmilienMyeah i don't think it's in certmonger08:35
jaosoriordoes journalctl report any haproxy issue?08:36
EmilienMthe error doesn't look like in keystone at least: http://logs.openstack.org/32/468732/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/ea6bb99/logs/undercloud/var/log/keystone/keystone.log.txt.gz08:36
EmilienMno error, afict08:36
EmilienMMay 29 01:25:52 undercloud haproxy[15998]: Connect from 192.168.24.3:33512 to 192.168.24.3:35357 (keystone_admin/HTTP)08:37
EmilienMMay 29 01:25:52 undercloud haproxy[15998]: 192.168.24.2:55806 [29/May/2017:01:25:52.836] ironic/1: SSL handshake failure08:37
EmilienMI think it's an orchestration race08:37
EmilienMwhere cert could have been managed after starting HAproxy or something08:37
*** brault has joined #tripleo08:37
EmilienMlooking at tripleo::certmonger::haproxy now08:38
yolandahi, good morning. I have a customer that is experiencing problems when redeploying the overcloud, hits an error with heat metadata urls that don't exist, and he has to manually fix them using https://access.redhat.com/solutions/292418108:38
yolandawhat can be causing that, if he deletes the stack properly those urls shouldn't be regenerated properly?08:38
jaosoriorthere seem to be other errors there May 29 01:26:34 tripleo-centos-7-tripleo-test-cloud-rh1-9028206 haproxy[15998]: 192.168.24.2:56984 [29/May/2017:01:26:34.318] ironic/1: SSL handshake failure08:38
jaosoriorEmilienM: oh, lol, you were way ahead of me08:39
EmilienMyeah I think i found it08:39
*** gbarros has quit IRC08:40
EmilienMmhh no08:40
*** suuuper has quit IRC08:41
EmilienMjaosorior: I'm trying something anyway08:41
*** suuuper has joined #tripleo08:41
*** dparkes has joined #tripleo08:42
*** karimb has joined #tripleo08:42
*** derekh has joined #tripleo08:45
*** milan has joined #tripleo08:46
*** chem has joined #tripleo08:46
*** dparkes has quit IRC08:47
jpichWhere could I find more information about what the different puppet steps do? E.g. I regularly see comments like "this is done in step 3 but should happen in step 2" but I'm not sure which is which08:48
*** prateek_ has joined #tripleo08:49
EmilienMjpich: in puppet-tripleo08:50
EmilienMgimme a sec08:50
EmilienMfor ex: https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/nova.pp#L13608:51
*** prateek has quit IRC08:53
jpichEmilienM: Thanks! I was hoping for somewhat higher level documentation, like "configuration should happen in step x, service restarts usually happen in step y" and whatever else might be going on. Or is it different for each service?08:56
hjensasebarrera: I think you either use the puppet module::config classes available in most openstack puppet modules. Or you need to create a heat software config resource that run a script.08:58
*** karimb has quit IRC08:58
hjensasebarrera: there is also a deploy artifact that you could use to drop the content of a tarball onto / of overcloud nodes.08:59
EmilienMjaosorior: I found a second weird thing with the HAproxy binding08:59
EmilienMjpich: it's different for each service08:59
EmilienMjpich: it's documented I think, gimme a sec09:00
EmilienMjpich: https://github.com/openstack/tripleo-heat-templates/blob/e8dc8c6faeabfbe0fc82dd554c9f184e6a087ae4/puppet/services/README.rst#deployment-steps09:01
ebarrerahjensas, http://pastebin.test.redhat.com/488617 I tried this, using nova_config, but it didnt work09:01
jpichEmilienM: Perfect, thank you!09:01
EmilienMprobably not perfect, if you see something that miss let me know09:02
EmilienMthanks for feedback!09:02
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: certmonger/haproxy: generate certs before running HAproxy  https://review.openstack.org/46881009:03
hjensasebarrera: That should'nt be in ControllerExtraConfigPost. Hang on, finding doc link.09:03
jaosoriorEmilienM: that makes sense. Lets hope that does the trick09:04
EmilienMjaosorior: why don't we have httpchk GET /v3 for keystone public endpoint?09:04
EmilienMwe have it for keystone admin endpoint09:04
EmilienM(which isn't SSL afik)09:04
jaosoriorI'm sure it's not keystone. We could see in the journalctl logs that haproxy was failing at the ssl handshake09:05
hjensasebarrera: https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/10/html-single/advanced_overcloud_customization/#sect-Customizing_Puppet_Configuration_Data09:05
EmilienMjaosorior: it's weird because I haven't found any anomaly in puppet catalog09:05
jaosorioruhm, good question, I'm honestly not sure why it isn't there.09:05
ebarrerahjensas, I saw it, but the think is that the parameters I want to configure are not in hiera data09:05
hjensasebarrera: what you put in """ parameter_defaults:\n  NovaComputeExtraConfig: \n """ will be in hieradata.09:06
EmilienMjaosorior: I need your power09:07
EmilienMjaosorior: https://review.openstack.org/#/c/468628/09:07
openstackgerritBogdan Dobrelya proposed openstack/tripleo-specs master: Best practices for logging of containerized services  https://review.openstack.org/46290009:07
ebarrerahjensas, It wasn't :(09:07
ebarrerahjensas, at least with what i tried09:08
ebarrerahjensas, so I know that the puppet class nova_config is to customize arbitrary paramenters on config file, but I didn't success on using it09:10
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019509:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013209:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383009:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394509:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169415709:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169419109:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]09:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1693830 in tripleo "ovb-updates job fails with gnocchi upgrade command timeout" [Critical,Triaged]09:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged]09:10
openstackLaunchpad bug 1694157 in tripleo "all tripleo jobs are failing: python2-urllib3 fails to be deployed" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)09:10
hjensasebarrera: It should work. Verify that you don't set the same parameter in two environment files, or somehow overwrite it?09:10
openstackgerritMerged openstack-infra/tripleo-ci master: Fix CI python-urllib3 install failure  https://review.openstack.org/46873209:10
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)09:10
ebarrerahjensas, does it logs good to you what I sent ?09:11
openstackgerritJulie Pichon proposed openstack/tripleo-common master: Parse roles from roles_data.yaml directly  https://review.openstack.org/46767809:12
hjensasebarrera: tje pastebin? That is _wrong_. It is using ControllerExtraConfigPost, not ControllerExtraConfig. Also there are indentation errors, L23 and L25 is on the same indentation. So your ControllerExtraConfigPost section is ignored.09:13
ebarrerahjensas, ack I will try again with try again :)09:13
*** sshnaidm|afk is now known as sshnaidm09:14
EmilienMsshnaidm: thx for https://bugs.launchpad.net/tripleo/+bug/1694157 - now merged09:15
openstackLaunchpad bug 1694157 in tripleo "all tripleo jobs are failing: python2-urllib3 fails to be deployed" [Critical,Fix released] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)09:15
ebarrerahjensas, I used post cause in the hook section there is only pre or post and then NodeExtraConfing but not specific for controller/copmute ... let my try09:15
EmilienMsshnaidm: I think I have a fix for https://bugs.launchpad.net/tripleo/+bug/169419109:15
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)09:15
sshnaidmEmilienM, great09:15
EmilienMnow I'm working on disabling telemetry from OVB jobs. OK?09:15
sshnaidmEmilienM, reading back..09:15
sshnaidmEmilienM, hmm.. didn't we disable it? I think trown worked on it09:16
hjensasebarrera: what version is this?09:16
EmilienMsshnaidm: he did https://review.openstack.org/#/c/468031/09:16
ebarrerahjensas, osp1009:16
sshnaidmEmilienM, oh, but it didn't include ovb-updates, right?09:16
hjensasebarrera: the you have [ROLE]ExtraConfig, so you should be able to do this for controllers only.09:16
sshnaidmbecause it's not oooq09:16
EmilienMsshnaidm: and https://review.openstack.org/#/c/46803909:16
EmilienMsshnaidm: featureset001 is ovb-ha?09:17
ebarrerahjensas, thanks :)09:17
sshnaidmEmilienM, yep09:17
EmilienMkk09:17
EmilienMyeah let me disable it from ovb-udates09:17
EmilienMwe loose ipv6 coverage for telemetry09:17
EmilienMbut really we'll survive for now I think09:17
ebarrerahjensas++09:17
sshnaidmEmilienM, yeah, need to add it for ovb-updates args in tripleo-ci.09:17
EmilienMI'm on it Sir09:17
sshnaidmEmilienM, we didn't really test telemetry never.. just deployed it. I'm in doubt it worked at all09:18
EmilienMit did09:18
sshnaidmok.. because each time I looked it was full of tracebacks and errors09:18
EmilienMredis :P09:19
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Custom containerized undercloud deployments  https://review.openstack.org/45079209:19
EmilienMsshnaidm: I keep the coverage for newton though (since we didn't have scenario001 in place)09:20
EmilienMsshnaidm: and I think newton ovb-updates is fine09:20
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Add heat environment for disabling all telemetry services  https://review.openstack.org/46881809:22
sshnaidmEmilienM, sure09:22
*** karimb has joined #tripleo09:22
*** dparkes has joined #tripleo09:25
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Disable Telemetry on ovb-updates jobs  https://review.openstack.org/46882009:25
EmilienMsshnaidm: ^09:26
*** zoli is now known as zoli|lunch09:26
*** masco has quit IRC09:27
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: Add openstack undercloud backup  https://review.openstack.org/46621309:42
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: Add openstack undercloud backup  https://review.openstack.org/46621309:45
*** cylopez has joined #tripleo09:58
*** masco has joined #tripleo10:00
openstackgerritMerged openstack/tripleo-validations master: Add per host groups to dynamic inventory  https://review.openstack.org/46555810:08
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019510:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013210:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383010:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394510:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169419110:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]10:10
openstackLaunchpad bug 1693830 in tripleo "ovb-updates job fails with gnocchi upgrade command timeout" [Critical,Triaged]10:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged]10:10
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)10:10
*** vpickard has quit IRC10:20
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Generate subunit result for pingtest  https://review.openstack.org/46884710:25
bogdandofolks, don't we miss pulling a new version of a service container on configuring it with t-h-t?10:26
sshnaidmadarazs, arxcruz ^^10:26
bogdandodo you think this is a bug? looks like we need something like k8s does with its https://kubernetes.io/docs/concepts/containers/images/10:26
*** cylopez has quit IRC10:26
bogdandothis also looks related https://github.com/moby/moby/issues/13331. the missing --pull flag could be work arounded by heat docker agent perhaps10:28
bogdandoat least for a service config stage, would be nice to have this. Unless it comes with docker for restarts as well10:29
bogdandothoughts?10:29
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: Add openstack undercloud backup  https://review.openstack.org/46621310:31
openstackgerritMerged openstack-infra/tripleo-ci master: [newton-to-ocata] Force EnablePackageInstall to true on multinode jobs  https://review.openstack.org/46862810:38
bogdandojistr: https://bugs.launchpad.net/tripleo/+bug/1694241 PTAL :)10:38
openstackLaunchpad bug 1694241 in tripleo "Services need an imagePull policy for a t-h-t configuration stage and runtime" [High,Triaged]10:38
*** anshul has quit IRC10:39
*** zoli|lunch is now known as zoli10:41
arxcruzsshnaidm: awesome, I was wondering if we could generate a 'fake subunit' when tempest not run, so we can keep the periodic job sending results to o-health daily :)10:42
arxcruzsshnaidm: o-healty only catch the testrepository.subunit file btw10:43
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: Adjust package installation for openSUSE  https://review.openstack.org/46873410:43
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: Drop support for Ubuntu precise  https://review.openstack.org/46818610:44
*** anshul has joined #tripleo10:45
*** hewbrocca_afk is now known as hewbrocca10:45
EmilienMbandini: what is the patch again for https://bugs.launchpad.net/tripleo/+bug/1690132 ?10:46
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged]10:46
EmilienMah https://review.openstack.org/#/c/46398510:47
bandinisec10:47
bandiniEmilienM: yep that one10:48
EmilienMkk10:48
EmilienMbandini: it should merge now, I'll watch it today10:48
bandiniEmilienM: awesome, thanks!10:49
EmilienMcool10:49
EmilienMtrying to get rid of all alerts10:49
bandininice! I hope to be a bit more useful starting next week, once back10:49
*** circ-user-TeTGj has joined #tripleo10:54
*** masco has quit IRC10:56
*** lifeless has quit IRC10:58
jistrbogdando: good catch. I wonder how would we go about solving that best. Maybe deleting/untagging the images locally on overcloud nodes? That should force an image pull i'd think.11:01
jistrbogdando: or explicitly calling a pull. I'm actually not sure how we do it in the agent nowadays.11:02
* jistr looks11:02
*** masco has joined #tripleo11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019511:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013211:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383011:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394511:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169419111:10
*** ooolpbot has quit IRC11:10
*** adarazs is now known as adarazs_afk11:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged] - Assigned to Michele Baldessari (michele)11:10
openstackLaunchpad bug 1693830 in tripleo "ovb-updates job fails with gnocchi upgrade command timeout" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)11:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)11:10
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)11:10
jistrbogdando: added a comment at https://bugs.launchpad.net/tripleo/+bug/1694241 -- docker-puppet.py might be in the clear (assuming we want the latest images always), but paunch might not be. /cc stevebaker11:11
openstackLaunchpad bug 1694241 in tripleo "Services need an imagePull policy for a t-h-t configuration stage and runtime" [High,Triaged]11:11
*** lucasagomes is now known as lucas-hungry11:12
jistrbogdando: we'll also need something to remove old images so that we don't fill up the disks. (But not remove them immediately so that we can do a revert if needed...)11:12
openstackgerritMerged openstack/tripleo-quickstart-extras master: Add stack deploy status output for failed deploy debugging  https://review.openstack.org/46842911:13
*** oidgar has joined #tripleo11:16
oidgarHi guys, suddenly I have a problem with deploying overcloud. I have 2 OVB nodes registered to the undercloud in available state and maintenance false. when I'm trying to deploy overcloud I get the following message:11:17
oidgar"Only 0 nodes are exposed to Nova of 2 requests. Check that enough nodes are in "available" state with maintenance mode off."11:18
oidgarany ideas how to investigate it?11:18
*** karimb has quit IRC11:21
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Add stack health check validation  https://review.openstack.org/46760711:24
openstackgerritNuman Siddique proposed openstack/tripleo-heat-templates master: WIP: Support deploying OVN as container services  https://review.openstack.org/46886011:28
*** lifeless has joined #tripleo11:31
*** anshul has quit IRC11:39
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Remove Mitaka release reference from validate-tempest  https://review.openstack.org/46886211:40
openstackgerritMerged openstack/tripleo-quickstart-extras master: Exclude puppet-watcher from building role  https://review.openstack.org/46804111:43
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Containerized nova-compute working with Deployed Server  https://review.openstack.org/46839111:44
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart master: Featureset010 for multinode containers  https://review.openstack.org/46709411:47
*** anshul has joined #tripleo11:51
*** adarazs_afk is now known as adarazs11:51
*** chandankumar is now known as chkumar|hackersp11:52
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart master: Featureset010 for multinode containers  https://review.openstack.org/46709411:54
EmilienMbandini, jaosorior: just an FYI, we hit the SSL issue on updates job also: http://logs.openstack.org/20/468820/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-updates/2c57632/console.html#_2017-05-29_11_42_34_24836911:56
EmilienMwhich makes sense11:56
*** udesale__ has quit IRC11:57
*** links has quit IRC11:57
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: [NO MERGE] test multinode containers  https://review.openstack.org/46710011:58
*** prateek_ has quit IRC11:58
*** ratailor has quit IRC11:58
EmilienMbandini, jaosorior: and https://review.openstack.org/#/c/468810/ didn't help yet, still the same error. I'm digging11:58
*** psahoo has quit IRC11:58
*** mdnadeem has quit IRC11:58
*** dsariel has quit IRC11:59
EmilienMI think it's the urllib thing12:01
*** ccamacho is now known as ccamacho|lunch12:02
sshnaidmarxcruz,  you can generate subunit manually in the same way as in patch. I think we will copy tempest subunit over pingtest..12:02
*** ykarel has quit IRC12:03
EmilienMamoralej: the urllib thing broke also tripleo ci, stable jobs too12:04
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart master: Container featuresets for scenarios 001-004  https://review.openstack.org/46669612:04
*** janki has quit IRC12:05
amoralejEmilienM, is not fixed in https://review.openstack.org/#/c/468732/?12:05
EmilienMamoralej: seems like not for ovb jobs12:06
EmilienMsshnaidm: ^ fyi12:06
sshnaidmEmilienM, ovb jobs fail with ssl problem12:06
EmilienMsshnaidm: I think it's urllib312:07
sshnaidmEmilienM, hmm.. you know, I had ssl error once, when I used urllib3 with python older than 2.7.912:07
sshnaidmEmilienM, may be related?12:08
EmilienMmaybe12:08
EmilienMit's a lot of coincidence :12:08
sshnaidmhttp://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings12:08
*** prateek_ has joined #tripleo12:09
EmilienMthough I compared the version of urllib that worked before and it's the same12:10
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart master: Container upgrade featuresets for scenarios 001-004  https://review.openstack.org/46594712:10
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019512:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013212:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383012:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394512:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169419112:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged] - Assigned to Michele Baldessari (michele)12:10
openstackLaunchpad bug 1693830 in tripleo "ovb-updates job fails with gnocchi upgrade command timeout" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)12:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)12:10
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)12:10
sshnaidmEmilienM, but something changed in this, because job couldn't update it. Maybe it's nodepool that installed some special version12:11
amoralejsshnaidm, EmilienM, apparently requests and urllib3 is ok in that job12:11
EmilienMand same thing in puppet CI we have the issue12:11
EmilienMthat's why I think it's urllib related12:11
amoralejit's removing it12:11
amoralejmmm12:12
amoralejmaybe, not, give me a while12:12
EmilienMsee http://logs.openstack.org/55/459955/3/check/gate-puppet-openstack-integration-4-scenario002-tempest-centos-7/40cf9dd/logs/puppet.txt.gz#_2017-05-29_07_35_3112:12
EmilienMin Puppet OpenStack CI12:12
EmilienM2017-05-29 07:35:31 +0000 Puppet (err): Execution of '/bin/yum -d 0 -e 0 -y install python-keystoneclient' returned 1: Error unpacking rpm package python2-urllib3-1.16-1.el7.noarch12:12
EmilienMerror: unpacking of archive failed on file /usr/lib/python2.7/site-packages/urllib3/packages/ssl_match_hostname: cpio: rename failed - Is a directory12:12
EmilienMerror: python2-urllib3-1.16-1.el7.noarch: install failed12:12
EmilienMthat's the urllib that amoralej is fixing12:12
EmilienMmaybe it's 2 different issues12:13
sshnaidmEmilienM, it's the same issue I fixed in patch12:14
*** psahoo has joined #tripleo12:14
*** lucas-hungry is now known as lucasagomes12:14
EmilienMamoralej is right, versions of urllib and requests are good in ssl failing jobs12:15
EmilienMit's maybe something else... /me keeps digging12:16
amoralejthe only issue is that in tripleo-ci fix we are using rm instead of pip uninstall and we are leaving the eggs-info around12:16
amoralejbut i tested it and that shouldn't be causing problems12:17
*** karimb has joined #tripleo12:18
*** gbarros has joined #tripleo12:18
*** pcaruana has joined #tripleo12:20
lyarwoodHas anyone seen this quickstart.sh error on freshly installed centos-7.3 hosts? "Aborting, target uses selinux but python bindings (libselinux-python) aren't installed!" http://paste.openstack.org/show/610860/12:20
lyarwoodIt's installed, SELinux is enforcing etc, seems that ansible isn't installing it in a venv it's creating but I have no idea where that is or how to force the installation of libselinux-python12:21
adarazslyarwood: did you do ./quickstart.sh --install-deps?12:22
EmilienMamoralej: one thing is sure, ocata is also affected12:22
lyarwoodadarazs: yeah but that's a localhost thing right? not $VIRTHOST12:22
adarazslyarwood: the selinux python package needs to be installed on the system, not in the venv.12:22
lyarwoodadarazs: kk, well it's installed on the system12:23
adarazslyarwood: yeah, you need to do this on the host running quickstart, not the virthost.12:23
lyarwoodadarazs: both the client and the $VIRTHOSTT12:23
lyarwoodhmm12:23
EmilienMamoralej: http://logs.openstack.org/18/468818/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/b5b8d17/logs/undercloud/home/jenkins/undercloud_install.log.txt.gz#_2017-05-29_10_11_4312:23
EmilienMsame thing as master12:23
lyarwoodadarazs: okay just checked, it's on both12:23
amoralejsounds bad12:23
amoralejone thing i could do is pin requests in dib element12:24
amoralejthat would fix all in once12:24
lyarwood# rpm -q libselinux-python12:24
lyarwoodlibselinux-python-2.5-13.fc25.x86_6412:24
lyarwoodadarazs: ^ on the client12:24
amoralejbut we'd need new images to be rebuilt12:24
adarazslyarwood: hm, that's weird. there were some changes around how we handle the selinux problem. is your ~/.quickstart/ directory fresh? meaning, did you delete it recently?12:24
adarazsand your quickstart repo fresh :)12:25
lyarwoodadarazs: ah that might it, let me rm -rf and try again12:25
lyarwoodadarazs: I assumed it cleaned that up with each run, my bad.12:25
adarazslyarwood: you can run quickstart.sh with --clean12:25
jaosorioramoralej, sshnaidm: are we sure it's not an issue with requests/urllib? upstream, requests uses another CA bundle. and IIRC downstream (or the rpm at least) requests used openssl instead (which is why CI worked)12:26
lyarwoodadarazs: ack thanks12:26
adarazslyarwood: yeah, there's a change that might address this problem. it's a bit tricky to start rm -rf/ing stuff in the user's home.12:26
adarazsI mean by default12:26
adarazsso --clean is not default12:26
amoralejjaosorior, mmmm let me check12:26
lyarwoodadarazs: ack cool12:27
jaosorioramoralej: if it's back to using the upstream requests CA bundle, that would expain the SSL verify errors.12:27
amoraleji need to leave for a while, i'll be back12:27
*** amoralej is now known as amoralej|lunch12:28
EmilienMjaosorior: is the version the same?12:28
EmilienMhow can we check if we have the one from upstream?12:28
EmilienMjaosorior: http://logs.openstack.org/10/468810/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/13e81dc/console.html#_2017-05-29_10_02_54_88657312:29
EmilienMboth are deployed from centos-openstack-ocata so we should be good no?12:30
jaosoriorEmilienM: $ python -c 'import requests; print(requests.certs.where())'             │····························································································12:30
jaosorior/etc/pki/tls/certs/ca-bundle.crt12:30
EmilienMjaosorior: amoralej was also wondering if we need to purge eggs-info for both packages12:31
jaosoriorI'm honestly not sure about that :/12:31
jaosoriorEmilienM, amoralej|lunch: Anyway, but the one I posted above should be the CA bundle that requests should be using. If it points somewhere else then that's the issue.12:31
EmilienMok12:32
lyarwoodadarazs: that worked, thanks again!12:32
adarazslyarwood: yay :)12:32
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart master: Transpose the featureset documentation table  https://review.openstack.org/46887012:34
*** prateek_ has quit IRC12:35
jistrpanda|pnq, arxcruz: doc table format change ^^12:35
jistr(i hope i don't don't have to redo that due to potential conflicts :D )12:35
jistrit was transposed by org-mode but i still have to get it into org mode table format and out of it semi-manually, so the transposition doesn't come entirely free...12:37
adarazsjistr: I wonder if we shouldn't just restart with a new table for every 9 or 10 featureset, this is going to grow out of control even with this transposed way :/12:37
jistradarazs: yea that could be a way too... though having a single table is nice for comparing quickly (if you have a large enough screen :D )12:37
adarazsjistr: well yeah, exactly. :)12:38
adarazsI guess I won't be the first to complain with a 4k screen :P12:38
jistradarazs: we could also shrink the table vertically by not using horizontal lines. Still pretty followable (that's how org mode does tables) and you can fit many FSs (50?) vertically on a screen no problem.12:39
arxcruzI liked12:39
arxcruzI was worried also with the increasing in featuresets12:39
arxcruzand I don't have a 4k display, but it's big enough :D12:39
*** psahoo has quit IRC12:44
*** michapma has joined #tripleo12:45
*** jpena is now known as jpena|lunch12:46
EmilienMsshnaidm, amoralej|lunch : I compared packages, I don't see anything https://www.diffchecker.com/6fQ0gEAC12:47
EmilienMexcept maybe the source of requests/urllib packages12:48
sshnaidmEmilienM, I compared pep2-freeze lists there, and changes are in requests and urllib312:48
EmilienMsshnaidm: where? in ci?12:49
EmilienMlocally you mean ok12:49
sshnaidmEmilienM, http://logs.openstack.org/03/468703/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/61c50de/logs/pip2-freeze.txt.gz12:50
sshnaidmEmilienM, and the older: http://logs.openstack.org/77/430277/112/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/70b75a2/logs/pip2-freeze.txt.gz12:51
EmilienMah12:52
honzajtomasek: florianf: Let's get these merged.  We also need longer than we think for packaging... https://review.openstack.org/#/q/project:openstack/tripleo-ui+mit+status:open12:52
*** janki has joined #tripleo12:52
honzajtomasek: florianf: both have been approved by RDO12:53
EmilienMsshnaidm: https://www.diffchecker.com/UFBTqSN512:53
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: testing generating subunit  https://review.openstack.org/46887412:53
jtomasekhonza: yep, both need +2 from florianf12:53
honzajtomasek: and +1 from you on one12:53
honzajtomasek: workflow12:54
*** janki has quit IRC12:54
florianfhonza, jtomasek: Let me just do a quick test run...12:54
EmilienMsshnaidm: I guess something is missing in https://review.openstack.org/#/c/468732/12:54
jtomasekhonza: ack12:54
honzajtomasek: florianf: doesn't have to be done this second, just please make it a priority12:54
sshnaidmEmilienM, will try pip uninstall now12:54
florianfhonza: ack12:54
EmilienMsshnaidm: i'm afraid we can't use yum without python-requests12:55
*** pblaho has joined #tripleo12:55
EmilienMsshnaidm: we're going to to shoot in our feet12:55
sshnaidmEmilienM, I wonder why do we delete requests at all? https://github.com/openstack-infra/tripleo-ci/blob/7548af6a7c94892c165a6ffde4976e1fa05861cb/toci_gate_test-orig.sh#L29-L2912:56
EmilienMsshnaidm: see https://review.openstack.org/#/c/468823/12:57
*** skramaja has quit IRC12:57
EmilienMsshnaidm: because we don't want python packages deployed by pip12:57
*** dsariel has joined #tripleo12:59
sshnaidmEmilienM, maybe to do the same in tripleo-ci jobs, not only puppet?12:59
EmilienMsshnaidm: yes, I can give a try13:00
*** oidgar has quit IRC13:01
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Uninstall requests/urllib3 pip installation  https://review.openstack.org/46887713:03
EmilienMsshnaidm: can you please review? ^13:03
sshnaidmlet's see if it helps13:05
honzajtomasek: What do you think about i18n in log messages?  Should we force it to English?13:06
honzajtomasek: Do you think that logging the redux state is important (in the file log)?  I'd say so but the state is rather large and makes things noisy13:07
honzajtomasek: e.g. each redux action generates two such messages13:08
honzajtomasek: and each message contains all files in a plan13:08
jtomasekhonza: good question, If the translation can be done explicitly during loging, it would be probably better to have it in english13:08
jtomasekhonza: yeah, I consider react logger a development tool, we could disable it for production13:09
jtomasekhonza: or we can modify it to include state only in case when an error is logged13:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019513:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013213:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169383013:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394513:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169419113:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged] - Assigned to Michele Baldessari (michele)13:10
openstackLaunchpad bug 1693830 in tripleo "ovb-updates job fails with gnocchi upgrade command timeout" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)13:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)13:10
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)13:10
honzajtomasek: I think the error-gets-a-state-logged idea!13:10
*** oidgar has joined #tripleo13:12
*** Guest79619 is now known as mgagne13:14
*** mgagne has quit IRC13:14
*** mgagne has joined #tripleo13:14
EmilienMsshnaidm: see the same thing in puppet job http://logs.openstack.org/64/468864/2/check/gate-puppet-openstack-integration-4-scenario001-tempest-centos-7/ce661ca/console.html#_2017-05-29_12_57_33_69936613:16
*** Goneri has joined #tripleo13:16
*** sid2 has joined #tripleo13:17
*** sid1 has quit IRC13:18
*** kodokuu has joined #tripleo13:18
EmilienMmcornea, marios: https://bugs.launchpad.net/tripleo/+bug/1693824 and https://bugs.launchpad.net/tripleo/+bug/1693790 looks similar, are they the same bug?13:19
openstackLaunchpad bug 1693824 in tripleo "Ocata -> Pike undercloud upgrade: nova instances turn to ERROR state after undercloud upgrade" [Critical,Triaged]13:19
openstackLaunchpad bug 1693790 in tripleo "Ocata -> Pike undercloud upgrade fails: Reason: object.__new__(thread.lock) is not safe, use thread.lock.__new__()" [Critical,Triaged]13:19
mcorneaEmilienM: hi! I think they're different - 1693824 is about nova instances going to error state, 1693790 about the thread lock error13:21
EmilienMok good13:21
*** amoralej|lunch is now known as amoralej13:21
jpichhonza: Not sure about the full context behind your "i18n & logs" comment, however fwiw the community pulled away from translating logs recently so it doesn't need to be supported (see http://lists.openstack.org/pipermail/openstack-operators/2017-March/012953.html - only user-facing messages should be translatable)13:23
*** psahoo has joined #tripleo13:25
*** adarazs is now known as adarazs_afk13:27
amoralejEmilienM, I'm trying to reproduce the SSL issue with p-o-i using your patch13:31
*** dsariel has quit IRC13:33
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Add stack health check validation  https://review.openstack.org/46760713:34
*** dtantsur is now known as dtantsur|brb13:34
EmilienMamoralej: same13:35
EmilienMamoralej: how do you run tests with a nodepool image? they aren't public13:37
amoraleji've reproduced what nodepool does in my node before running p-o-i13:37
amoraleji mean pip installing git-review13:38
amoralejto see if it's related13:38
EmilienMah ok13:38
*** kodokuu has quit IRC13:38
amoralejahhhh, i know what it is13:39
amoraleji guess it's certifi packages?13:39
EmilienMamoralej: can you ellaborate?13:40
amoralejcertifi is being istalled as dependency of git-review also13:40
amoralejand it's related to certificates13:40
honzajpich: ah, nice!13:43
EmilienMamoralej: oops13:44
amoralejEmilienM, if certifi is installed python-requests use certificates provided by it instead of /etc/pki/tls/certs/ca-bundle.crt13:44
EmilienMyeah it all makes sense13:44
amoralejyes13:44
EmilienMjaosorior: ^ fyi13:44
amoralejcould you add certifi to the list or pip uninstall ?13:44
EmilienMyes13:44
amoraleji remember python-certifi is requirement for some package in rdo13:45
amoralejbut i think we patch the rpm package to use system-wise ones13:45
amoraleji'll check it13:45
jaosorioramoralej, EmilienM: that makes sense.13:46
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Uninstall certifi/requests/urllib3 pip installation  https://review.openstack.org/46887713:48
EmilienMamoralej: and tripleo ^ please review (I didn't install certifi on purpuse, because it's managed by yum if needed)13:48
*** salmankhan has joined #tripleo13:52
*** jpena|lunch is now known as jpena13:53
amoralejEmilienM, i'm sending the patch to project-config also13:55
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Add heat environment for disabling all telemetry services  https://review.openstack.org/46881813:59
openstackgerritMerged openstack-infra/tripleo-ci master: Disable Telemetry on ovb-updates jobs  https://review.openstack.org/46882014:00
openstackgerritMerged openstack/puppet-tripleo stable/newton: Add retries to the ::pacemaker::stonith property  https://review.openstack.org/46398514:00
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: [Newton only] - Manually touch ssl.conf before installing mod_ssl  https://review.openstack.org/46352914:00
openstackgerritMerged openstack/tripleo-quickstart-extras master: Generate subunit result for pingtest  https://review.openstack.org/46884714:02
*** zoli is now known as zoli|afk14:05
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019514:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013214:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394514:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169419114:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged] - Assigned to Michele Baldessari (michele)14:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)14:10
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)14:10
*** adarazs_afk is now known as adarazs14:15
*** agurenko has quit IRC14:17
*** flepied has quit IRC14:18
*** percevalbot has quit IRC14:18
*** artom has quit IRC14:23
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Uninstall certifi/requests/urllib3 pip installation  https://review.openstack.org/46887714:24
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Uninstall certifi/requests/urllib3 pip installation  https://review.openstack.org/46887714:24
*** aufi has quit IRC14:24
EmilienMsshnaidm: ^ if you can review the last version it should be good now. Puppet CI works with that14:25
*** percevalbot has joined #tripleo14:25
sshnaidmEmilienM, great14:25
EmilienMyes14:25
sshnaidmEmilienM, certifi is installed as deps?14:26
EmilienMsshnaidm: yes14:26
openstackgerritMerged openstack/instack-undercloud master: Log exception tracebacks  https://review.openstack.org/46842614:28
*** artom has joined #tripleo14:32
jaosoriortoday's a holiday in the states, right?14:32
openstackgerritMerged openstack/tripleo-ui master: Add react-router-dom dependency  https://review.openstack.org/46674514:32
openstackgerritMerged openstack/tripleo-ui master: Remove a duplicate license header  https://review.openstack.org/46630314:33
openstackgerritMerged openstack/tripleo-ui master: Use GetFlattenedParametersAction  https://review.openstack.org/46370414:33
EmilienMjaosorior: yes14:35
EmilienMjaosorior: Memorial Day14:35
jaosoriorwhat about Canada?14:36
EmilienMjaosorior: they work14:38
EmilienMlook I'm here :D14:38
*** dsariel has joined #tripleo14:40
jaosoriorlol14:41
*** noslzzp has joined #tripleo14:49
openstackgerritJaganathan Palanisamy proposed openstack/python-tripleoclient master: Optional override of the plan environment file  https://review.openstack.org/46839014:52
*** zoli|afk is now known as zoli14:53
jistrEmilienM: introducing the container multinode job into project-config here, please let me know your feedback when you have bandwidth to look https://review.openstack.org/#/c/46889714:53
sshnaidmEmilienM, fyi https://bugs.launchpad.net/tripleo/+bug/169428014:54
openstackLaunchpad bug 1694280 in tripleo "Repositories setup inside the image in TripleO CI by quickstart may take 50 min" [Critical,Triaged]14:54
EmilienMjistr: ok I'll look shortly14:54
jistrthanks!14:54
sshnaidmEmilienM, seems like it's main problem for timeouts in jobs as I can see14:54
EmilienMsshnaidm: 50m is excellent14:54
EmilienM:)14:54
EmilienMno really, wtf?14:54
sshnaidmEmilienM, instead of 5, yes :(14:54
sshnaidmthis mysterious libguestfs14:54
EmilienMjistr: lgtm, +114:56
EmilienMsshnaidm: yeah. Even 5 min is too long14:56
jistrEmilienM: thanks14:56
yolandahi, can i get reviews on https://review.openstack.org/449122 ? i amended to increase the sizing a bit, and include a README14:56
EmilienMamoralej: https://review.openstack.org/#/c/468864/ fails now, when I dropped the "rpm"14:57
EmilienMamoralej: "rm"14:57
*** dtantsur|brb is now known as dtantsur14:57
sshnaidmEmilienM, I'll try to add image update based not on libguestfs, but repeating the old tripleo-ci way: https://github.com/openstack-infra/tripleo-ci/blob/87722b14c7f000e0f35337bf8a82bb347806b45f/scripts/common_functions.sh#L84-L8814:57
amoralejyeah, i was checking14:57
amoralejgive me a while before re-adding it, please14:57
EmilienMsshnaidm: ok14:57
bogdandofolks, did we switch to paunch already? jistr^^ ?14:57
EmilienMamoralej: ok np14:57
bogdandoMy deploy fails with14:58
bogdando2017-05-29 14:57:09 |   File "/usr/libexec/os-refresh-config/configure.d/50-heat-config-docker-cmd", line 20, in <module>14:58
bogdando2017-05-29 14:57:09 |     import paunch14:58
bogdando2017-05-29 14:57:09 | ImportError: No module named paunch14:58
EmilienMyes: https://review.openstack.org/#/c/455845/14:58
EmilienMbogdando: ^14:58
jistrbogdando: i think so14:58
jistrbogdando: you'll need newer overcloud-full.qcow2 i guess14:58
sshnaidmEmilienM, not sure it's best solution, when I'm off till end of week maybe other oooq folks will finish it or find more proper solution14:58
sshnaidmadarazs, trown|outtypewww take a look please in your time: https://bugs.launchpad.net/tripleo/+bug/169428014:59
openstackLaunchpad bug 1694280 in tripleo "Repositories setup inside the image in TripleO CI by quickstart may take 50 min" [Critical,Triaged]14:59
bogdandojistr: sigh. I do install on vanilla centos714:59
bogdandoall I put ther is that 'undercloud deploy' requires15:00
amoralejEmilienM, when you have several packages in a single pip uninstall command, if first one is not installed the others are not uninstalled15:00
*** jaganathan has quit IRC15:00
bogdandodo we have a package for paunch at DLRN?15:01
EmilienMamoralej: lol, very smart15:01
EmilienMamoralej: so we need multiple lines?15:02
amoralejyes15:02
EmilienMamoralej: do you want me to push15:02
EmilienM?15:02
amoraleji can do it if you want15:02
*** noslzzp has quit IRC15:03
EmilienMamoralej: ok, thanks15:04
*** ykarel has joined #tripleo15:04
*** anshul has quit IRC15:05
*** bkopilov has quit IRC15:06
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019515:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013215:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394515:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169419115:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged] - Assigned to Michele Baldessari (michele)15:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)15:10
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)15:10
*** psahoo has quit IRC15:14
*** salmankhan has quit IRC15:15
jistrbogdando: so i went tracing deps and submitted https://review.rdoproject.org/r/#/c/6861 but indeed we don't have the paunch package in trunk yet15:17
bogdandojistr: thanks!15:17
*** salmankhan has joined #tripleo15:17
jistrbogdando: the switch to paunch might have merged a bit too early then15:18
*** dparkes has quit IRC15:18
bogdandowell pip install works for me, but yeah, we need a packge15:18
openstackgerritDmitry Tantsur proposed openstack/tripleo-quickstart master: Switch to "ipmi" hardware type by default for >= Pike  https://review.openstack.org/46890715:18
EmilienMamoralej: should I update my tripleo-ci patch?15:19
amoralejEmilienM, i'm preparing it, we have similar issue with rpm -ev also15:19
amoralejlet me test it15:19
EmilienMok15:19
*** jroll has joined #tripleo15:20
*** ykarel_ has joined #tripleo15:21
amoralejEmilienM, rpm was failing also, logs.openstack.org/77/468877/4/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/80be7b5/console.html15:22
*** bogdando has quit IRC15:23
*** yprokule has quit IRC15:23
EmilienMamoralej: ouch15:23
*** ykarel has quit IRC15:24
openstackgerritAlfredo Moralejo proposed openstack-infra/tripleo-ci master: Uninstall certifi/requests/urllib3 pip installation  https://review.openstack.org/46887715:28
*** ykarel_ has quit IRC15:30
*** chkumar|hackersp is now known as chandankumar15:36
*** artom has quit IRC15:37
chandankumarsshnaidm: hello15:38
sshnaidmchandankumar, hi15:38
chandankumarsshnaidm: please have a look on this review https://review.openstack.org/#/c/468862/15:38
openstackgerritDmitry Tantsur proposed openstack/tripleo-docs master: Document hardware types for the undercloud and virtualbmc  https://review.openstack.org/46891015:38
chandankumarsshnaidm: i got to meet bandini and Gabriele in pune :-)15:39
sshnaidmchandankumar, cool :)15:39
chandankumarsshnaidm: i am adding a test ci job to test the changes15:39
sshnaidmchandankumar, I think we need to sync with trown|outtypewww about removing mitaka, it's better to do it for all roles at once. If we decide to do it..15:40
chandankumartrown|outtypewww: ^^15:40
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: Add openstack undercloud backup  https://review.openstack.org/46621315:42
chandankumarsshnaidm: sure :-)15:42
*** mcornea has quit IRC15:46
chandankumarsshnaidm: for adding a test job for tempest toci-quickstart/config/testenv/ovb.yml run_tempest is removed, where should i change the config?15:47
*** pkovar has joined #tripleo15:47
*** hewbrocca is now known as hewbrocca_afk15:49
*** aufi has joined #tripleo15:49
sshnaidmchandankumar, in featureset https://github.com/openstack/tripleo-quickstart/blob/c8268da9b869a2374fb3b02a2b54a60b563eed65/config/general_config/featureset001.yml#L45-L4515:50
*** iranzo has quit IRC15:50
sshnaidmchandankumar, just make patch for tripleo-quickstart repo, not for tripleo-ci15:50
chandankumarah got that15:50
*** fragatina has joined #tripleo15:53
*** tesseract has quit IRC15:53
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: DONOT Review: Testing tempest patch  https://review.openstack.org/46891615:53
chandankumarsshnaidm: ^^15:54
*** jlinkes has quit IRC15:56
*** tbonds has quit IRC15:58
*** tbonds has joined #tripleo15:58
*** fragatina has quit IRC15:59
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK  https://review.openstack.org/43027716:00
*** rcernin has quit IRC16:01
*** zoli is now known as zoli|gone16:02
*** mcornea has joined #tripleo16:08
*** karimb has quit IRC16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019516:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013216:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394516:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169419116:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged] - Assigned to Michele Baldessari (michele)16:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)16:10
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)16:10
*** salmankhan has quit IRC16:14
*** jpich has quit IRC16:15
*** lucasagomes is now known as lucas-afk16:16
*** mcornea has quit IRC16:17
*** pcaruana has quit IRC16:17
*** lmiccini has quit IRC16:18
*** egonzalez has quit IRC16:21
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: Add openstack undercloud backup  https://review.openstack.org/46621316:28
*** chem has quit IRC16:29
*** chem has joined #tripleo16:29
*** derekh has quit IRC16:41
*** sid2 has quit IRC16:42
ansiwenCI (igate-tripleo-ci-centos-7-scenario002-multinode-upgrades) is still failing here (stable/ocata), because of some zaqar failure, but I have no idea what that is. I need assistance to solve that. https://review.openstack.org/#/c/462542/16:45
*** pcaruana has joined #tripleo16:45
*** artom has joined #tripleo16:47
*** aufi has quit IRC16:47
*** oidgar has quit IRC16:48
*** masco has quit IRC16:54
*** fragatina has joined #tripleo16:55
*** fragatina has quit IRC16:59
*** florianf has quit IRC17:04
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019517:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013217:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394517:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169419117:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged] - Assigned to Michele Baldessari (michele)17:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)17:10
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)17:10
*** florianf has joined #tripleo17:15
*** fragatina has joined #tripleo17:16
*** fragatina has quit IRC17:21
*** sri_ has joined #tripleo17:21
*** jpena is now known as jpena|off17:23
sri_I am having issue with placement api in Ocata , If have to controllers I need to run placement api in two nodes , If i did that When i created a 5 vms or more vms only couple of vms are creating ..!17:24
*** jaganathan has joined #tripleo17:26
sri_Sorry I was supose to ask this question in HA17:26
*** milan has quit IRC17:36
*** artom has quit IRC17:38
*** sri_ has quit IRC17:43
*** oidgar has joined #tripleo17:43
*** social has quit IRC17:44
*** social has joined #tripleo17:44
openstackgerritBrent Eagles proposed openstack/tripleo-docs master: Post deployment installation instructions for Octavia  https://review.openstack.org/44749617:47
*** suuuper has quit IRC17:50
openstackgerritHarald Jensås proposed openstack/instack-undercloud master: Tripleo routed networks ironic inspector, and Undercloud  https://review.openstack.org/43754417:51
*** oidgar has quit IRC17:52
*** artom has joined #tripleo17:55
*** dtantsur is now known as dtantsur|afk17:55
openstackgerritMark Goddard proposed openstack/diskimage-builder master: Remove dracut-network element  https://review.openstack.org/46893018:00
*** social has quit IRC18:06
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019518:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013218:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394518:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169419118:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged] - Assigned to Michele Baldessari (michele)18:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)18:10
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)18:10
*** artom has quit IRC18:15
*** fragatina has joined #tripleo18:16
*** fragatina has quit IRC18:21
openstackgerritDavid Moreau Simard proposed openstack/tripleo-common master: Test container images from trunk.registry.rdoproject.org  https://review.openstack.org/46765118:24
openstackgerritMerged openstack-infra/tripleo-ci master: Uninstall certifi/requests/urllib3 pip installation  https://review.openstack.org/46887718:32
*** dparkes has joined #tripleo18:34
*** ccamacho|lunch has quit IRC18:38
*** amoralej is now known as amoralej|off18:42
*** jaganathan has quit IRC18:59
*** bogdando has joined #tripleo19:00
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: testing generating subunit  https://review.openstack.org/46887419:02
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019519:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013219:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394519:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169419119:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged] - Assigned to Michele Baldessari (michele)19:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)19:10
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)19:10
*** jprovazn has quit IRC19:17
*** fragatina has joined #tripleo19:17
*** flepied has joined #tripleo19:18
*** fragatina has quit IRC19:22
*** dsariel has quit IRC19:24
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: ceilometer-expirer: remove the crontab during upgrade  https://review.openstack.org/46609619:28
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Ocata upgrades testing - DNM  https://review.openstack.org/46305019:28
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Ocata upgrades testing - DNM  https://review.openstack.org/46305019:29
*** jaosorior is now known as jaosorior_away19:29
*** social has joined #tripleo19:34
*** fragatina has joined #tripleo19:38
*** fragatina has quit IRC19:43
*** fragatina has joined #tripleo19:51
*** brault has quit IRC19:54
*** fragatina has quit IRC19:55
*** fragatina has joined #tripleo19:56
*** fragatina has quit IRC20:04
*** dsariel has joined #tripleo20:04
*** paramite has quit IRC20:06
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019520:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013220:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394520:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169419120:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged] - Assigned to Michele Baldessari (michele)20:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)20:10
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)20:10
*** gbarros has quit IRC20:12
*** dsariel has quit IRC20:14
*** ebarrera has quit IRC20:15
*** ebarrera has joined #tripleo20:15
*** florianf has quit IRC20:21
*** karimb has joined #tripleo20:22
*** karimb has quit IRC20:22
*** Goneri has quit IRC20:23
*** pcaruana has quit IRC20:24
*** bogdando has quit IRC20:41
*** fragatina has joined #tripleo21:00
*** artom has joined #tripleo21:03
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019521:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013221:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394521:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169419121:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)21:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged] - Assigned to Michele Baldessari (michele)21:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)21:10
openstackLaunchpad bug 1694191 in tripleo "CI: ovb ha oooq job fails to install undercloud with SSL: CERTIFICATE_VERIFY_FAILED" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)21:10
*** ebarrera has quit IRC21:11
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs  https://review.openstack.org/35921521:15
*** sid1 has joined #tripleo21:17
*** fragatina has quit IRC21:20
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: [DO NOT MERGE] Add binding:host_id to neutron ports.  https://review.openstack.org/46872521:20
*** fragatina has joined #tripleo21:22
openstackgerritLukas Bezdicka proposed openstack/tripleo-common master: Ensure Swift Rings backup container and URLs  https://review.openstack.org/46896021:30
*** flepied has quit IRC21:30
*** sshnaidm is now known as sshnaidm|off21:30
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: [DO NOT MERGE] Add binding:host_id to neutron ports.  https://review.openstack.org/46872521:32
*** fragatina has quit IRC21:32
*** circ-user-TeTGj has quit IRC21:33
*** flepied has joined #tripleo21:42
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: testing generating subunit  https://review.openstack.org/46887421:44
*** social has quit IRC21:51
*** flepied has quit IRC21:52
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019522:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013222:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394522:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged] - Assigned to Michele Baldessari (michele)22:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)22:10
*** sid1 has quit IRC22:13
*** vpickard has joined #tripleo22:35
*** pkovar has quit IRC22:38
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Containerize Sahara  https://review.openstack.org/46268122:41
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: WIP: Test containerized Sahara  https://review.openstack.org/46268222:41
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168019523:10
openstackLaunchpad bug 1680195 in tripleo "Random ovb-ha ping test failures" [Critical,In progress] - Assigned to John Trowbridge (trown)23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169013223:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/169394523:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1690132 in tripleo "Newton HA failure: unable to push cib, cib_apply_diff failed" [Critical,Triaged] - Assigned to Michele Baldessari (michele)23:10
openstackLaunchpad bug 1693945 in tripleo "ovb-ha-oooq job execution is timing out regularly" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm)23:10
*** jkilpatr has joined #tripleo23:17
*** egafford has joined #tripleo23:24
*** jkilpatr has quit IRC23:25
*** jkilpatr has joined #tripleo23:48
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: [DO NOT MERGE] Add binding:host_id to neutron ports.  https://review.openstack.org/46872523:48
*** jkilpatr has quit IRC23:55
*** chatter29 has joined #tripleo23:58
chatter29hey guys23:58
*** axisys has joined #tripleo23:58
chatter29allah is doing23:58
chatter29sun is not doing allah is doing23:58
chatter29to accept Islam say that i bear witness that there is no deity worthy of worship except Allah and Muhammad peace be upon him is his slave and messenger23:58
*** chatter29 has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!