Friday, 2018-03-09

openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Modify OVB stack and resource identifiers to match te-broker  https://review.openstack.org/55103000:02
*** slaweq__ has joined #tripleo00:04
*** alee_ has joined #tripleo00:07
*** slaweq__ has quit IRC00:09
*** wolverineav has joined #tripleo00:09
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403600:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]00:10
*** wolverineav has quit IRC00:14
*** slaweq__ has joined #tripleo00:15
*** beagles|biab is now known as beagles00:18
*** slaweq__ has quit IRC00:19
*** wolverineav has joined #tripleo00:22
*** alee_ has quit IRC00:23
*** alee_ has joined #tripleo00:23
*** slaweq__ has joined #tripleo00:25
*** wolverineav has quit IRC00:27
*** slaweq__ has quit IRC00:29
*** tosky has quit IRC00:30
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Modify OVB stack and resource identifiers to match te-broker  https://review.openstack.org/55103000:32
*** slaweq__ has joined #tripleo00:35
*** moshele has joined #tripleo00:39
*** itlinux has joined #tripleo00:39
*** slaweq__ has quit IRC00:39
*** wolverineav has joined #tripleo00:40
*** slaweq__ has joined #tripleo00:45
*** wolverineav has quit IRC00:48
*** slaweq__ has quit IRC00:50
*** ykarel has joined #tripleo00:52
*** slaweq__ has joined #tripleo00:55
*** slaweq__ has quit IRC01:00
*** chem has quit IRC01:01
*** hamzy has joined #tripleo01:06
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403601:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]01:10
*** wolverineav has joined #tripleo01:19
*** wolverineav has quit IRC01:23
*** lifeless has quit IRC01:27
*** wolverineav has joined #tripleo01:29
*** rlandy has quit IRC01:33
*** wolverineav has quit IRC01:33
*** ykarel has quit IRC01:34
*** slaweq__ has joined #tripleo01:36
*** slaweq__ has quit IRC01:41
*** gregwork has quit IRC01:42
*** gregwork has joined #tripleo01:43
*** myoung has joined #tripleo01:47
*** myoung has quit IRC01:52
*** khyr0n has quit IRC02:02
*** pchavva has joined #tripleo02:04
*** moshele has quit IRC02:04
*** jrist has joined #tripleo02:05
*** jrist has joined #tripleo02:05
*** fragatina has quit IRC02:06
*** slaweq__ has joined #tripleo02:07
*** wolverineav has joined #tripleo02:07
*** fragatina has joined #tripleo02:09
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403602:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]02:10
*** slaweq__ has quit IRC02:11
*** wolverineav has quit IRC02:11
*** fragatina has quit IRC02:13
*** slaweq__ has joined #tripleo02:17
*** slaweq__ has quit IRC02:21
*** alee_ has quit IRC02:25
*** alee_ has joined #tripleo02:28
*** wolverineav has joined #tripleo02:32
*** khyr0n has joined #tripleo02:36
*** khyr0n has quit IRC02:36
*** wolverineav has quit IRC02:37
*** wolverineav has joined #tripleo02:42
*** agopi has joined #tripleo02:44
*** wolverineav has quit IRC02:46
*** fzdarsky_ has joined #tripleo02:47
*** slaweq__ has joined #tripleo02:47
*** fzdarsky has quit IRC02:51
*** slaweq__ has quit IRC02:52
*** wolverineav has joined #tripleo02:59
*** skramaja has joined #tripleo03:01
*** tzumainn has quit IRC03:01
*** wolverineav has quit IRC03:03
*** lifeless has joined #tripleo03:06
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403603:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]03:10
*** ooolpbot has quit IRC03:10
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: DPDK deployment fails when there is no deprecated parameters  https://review.openstack.org/55111003:10
*** wolverineav has joined #tripleo03:11
*** hamzy has quit IRC03:14
*** wolverineav has quit IRC03:15
*** jaganathan has quit IRC03:16
*** wolverineav has joined #tripleo03:33
*** stendulker has joined #tripleo03:33
*** stendulker has quit IRC03:34
*** stendulker has joined #tripleo03:34
*** ramishra has joined #tripleo03:36
*** psachin has joined #tripleo03:39
*** cdearborn has quit IRC03:48
*** slaweq__ has joined #tripleo03:48
*** slaweq__ has quit IRC03:53
*** gkadam has joined #tripleo03:55
*** fragatina has joined #tripleo04:02
*** fragatina has quit IRC04:07
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403604:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]04:10
*** ooolpbot has quit IRC04:10
*** wolverineav has quit IRC04:12
*** wolverineav has joined #tripleo04:13
*** wolverineav has quit IRC04:17
*** StevenK has quit IRC04:21
*** masco has quit IRC04:23
*** hamzy has joined #tripleo04:23
*** StevenK has joined #tripleo04:23
openstackgerritMerged openstack/tripleo-upgrade master: Remove any extra newlines from upgrade script  https://review.openstack.org/54959204:25
*** slaweq has joined #tripleo04:29
openstackgerritAnshul Jain proposed openstack/diskimage-builder master: proliant-tools: add net-tools package for redhat image creation.  https://review.openstack.org/54815404:31
*** fragatina has joined #tripleo04:32
*** slaweq has quit IRC04:34
*** wolverineav has joined #tripleo04:35
*** fragatina has quit IRC04:35
*** fragatina has joined #tripleo04:36
*** slaweq has joined #tripleo04:39
*** slaweq has quit IRC04:44
*** slaweq has joined #tripleo04:50
*** slaweq has quit IRC04:54
*** pchavva has quit IRC04:58
*** slaweq has joined #tripleo05:00
*** slaweq has quit IRC05:04
*** agopi has quit IRC05:06
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403605:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]05:10
*** ooolpbot has quit IRC05:10
*** slaweq has joined #tripleo05:10
*** slaweq has quit IRC05:15
*** fragatina has quit IRC05:16
*** fragatina has joined #tripleo05:16
*** ratailor has joined #tripleo05:21
*** pdeore has joined #tripleo05:23
*** udesale has joined #tripleo05:27
*** dpawar has joined #tripleo05:28
*** mdnadeem has joined #tripleo05:31
*** dpawar_ has joined #tripleo05:33
*** dpawar_ has quit IRC05:33
*** dpawar_ has joined #tripleo05:33
*** dpawar has quit IRC05:34
*** jaosorior has joined #tripleo05:37
*** dpawar_ has quit IRC05:38
*** slaweq has joined #tripleo05:40
Tenguhello there05:45
*** slaweq has quit IRC05:45
jaosoriorTengu: sup dude05:47
*** itlinux has quit IRC05:48
Tengujaosorior: back to office, almost healthy :)05:48
Tenguwhat about you?05:48
jaosoriorTengu: sleepyyyy need coffee05:49
Tenguneed some tea. and, well, medics -.-'05:49
*** slaweq has joined #tripleo05:51
*** tripleo-user has joined #tripleo05:53
*** pgadiya has joined #tripleo05:54
*** slaweq has quit IRC05:55
*** bfournie has joined #tripleo05:56
*** dpawar has joined #tripleo05:57
*** bfournie1 has quit IRC05:57
*** radeks__ has joined #tripleo06:04
chandankumarjaosorior: Good morning06:06
*** itlinux has joined #tripleo06:06
*** radeks_ has joined #tripleo06:06
jaosoriorchandankumar: hey man, how's it going?06:07
chandankumarjaosorior: please have a look on pep8 failure http://logs.openstack.org/25/548325/15/check/openstack-tox-pep8/600a934/job-output.txt.gz#_2018-03-08_17_49_56_45168706:07
jaosoriordid you figure out the issue yesterday?06:07
chandankumarjaosorior: other job passed06:07
jaosoriorchandankumar: ah yeah, I looked at it yesterday and didn't figure it out06:07
jaosoriorbut then again... I was also trying to do 3 things at the same time :D so that doesn't help06:07
jaosoriorI'll check it out again06:07
*** yurii has joined #tripleo06:07
*** yurii is now known as yprokule06:07
chandankumarjaosorior: sure thanks :-)06:07
*** radeks__ has quit IRC06:09
*** itlinux has quit IRC06:09
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403606:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]06:10
*** ooolpbot has quit IRC06:10
*** abhishekk has joined #tripleo06:11
*** slaweq has joined #tripleo06:11
*** slaweq has quit IRC06:16
*** wolverineav has quit IRC06:18
*** itlinux has joined #tripleo06:20
*** gkadam has quit IRC06:28
*** bfournie1 has joined #tripleo06:29
*** bfournie has quit IRC06:30
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/55117606:34
*** dpawar has quit IRC06:34
jaosoriorchandankumar: found the issue06:40
jaosoriortrozet: your patch worked.06:40
jaosoriormoguimar: let me know when you're around06:41
*** slaweq has joined #tripleo06:41
*** jfrancoa has joined #tripleo06:42
*** jfrancoa has quit IRC06:42
*** jfrancoa has joined #tripleo06:43
*** jrist has quit IRC06:43
*** sai_p has quit IRC06:43
chandankumarjaosorior: thanks, it worked06:44
openstackgerritChandan Kumar proposed openstack/tripleo-heat-templates master: Added t-h-t for tempest container  https://review.openstack.org/54832506:45
*** slaweq has quit IRC06:46
openstackgerritChandan Kumar proposed openstack/tripleo-heat-templates master: Added t-h-t for tempest container  https://review.openstack.org/54832506:46
*** sshnaidm|afk has quit IRC06:47
openstackgerritChandan Kumar proposed openstack/tripleo-heat-templates master: Added t-h-t for tempest container  https://review.openstack.org/54832506:47
*** slaweq has joined #tripleo06:52
*** marios has joined #tripleo06:56
*** slaweq has quit IRC06:57
*** jrist has joined #tripleo07:01
*** lvdombrkr has joined #tripleo07:04
*** jschlueter has joined #tripleo07:07
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403607:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]07:10
*** lvdombrkr89 has joined #tripleo07:12
*** lvdombrkr has quit IRC07:14
*** suuuper has joined #tripleo07:16
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates master: WIP Upgrade data on disk on mariadb major upgrade  https://review.openstack.org/54666607:18
*** pcaruana has joined #tripleo07:27
*** dparkes has joined #tripleo07:32
openstackgerritlidong proposed openstack/tripleo-quickstart master: Update the outdated links  https://review.openstack.org/55119407:36
*** d0ugal_ has quit IRC07:37
*** stendulker has quit IRC07:38
*** stendulker has joined #tripleo07:39
*** wojdec has joined #tripleo07:42
*** dpawar has joined #tripleo07:44
*** wojdec1 has joined #tripleo07:44
*** wojdec has quit IRC07:47
*** bogdando has joined #tripleo07:50
*** wolverineav has joined #tripleo07:52
*** slaweq has joined #tripleo07:53
*** d0ugal_ has joined #tripleo07:55
*** wolverineav has quit IRC07:58
*** slaweq has quit IRC07:58
*** rcernin has quit IRC08:00
*** lvdombrkr89 has quit IRC08:00
*** lvdombrkr89 has joined #tripleo08:01
*** slaweq__ has joined #tripleo08:04
*** aufi has joined #tripleo08:05
openstackgerritAnshul Jain proposed openstack/diskimage-builder master: proliant-tools: add net-tools package to support hpsum utility  https://review.openstack.org/54815408:07
*** slaweq__ has quit IRC08:08
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403608:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]08:10
*** lvdombrkr has joined #tripleo08:10
*** lvdombrkr89 has quit IRC08:10
*** florianf has joined #tripleo08:12
*** slaweq__ has joined #tripleo08:14
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: WIP: New major upgrade workflow implementation.  https://review.openstack.org/54833608:16
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/54922008:16
*** ebarrera has joined #tripleo08:18
*** slaweq__ has quit IRC08:18
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart-extras master: Enable undercloud upgrade using tripleo-upgrade role.  https://review.openstack.org/54917908:18
*** ramishra has quit IRC08:19
*** ramishra has joined #tripleo08:21
*** slaweq__ has joined #tripleo08:24
*** ccamacho has joined #tripleo08:24
*** gkadam has joined #tripleo08:25
openstackgerritHarald JensÃ¥s proposed openstack/tripleo-docs master: Documentation - TripleO routed-spine-and-leaf  https://review.openstack.org/53993908:26
openstackgerritAnshul Jain proposed openstack/diskimage-builder master: proliant-tools: add net-tools package to support hpsum utility  https://review.openstack.org/54815408:28
*** slaweq__ has quit IRC08:28
openstackgerritAnshul Jain proposed openstack/diskimage-builder master: proliant-tools: add net-tools package to support hpsum utility  https://review.openstack.org/54815408:29
*** wolverineav has joined #tripleo08:30
*** ykarel has joined #tripleo08:33
*** slaweq__ has joined #tripleo08:34
*** wolverineav has quit IRC08:35
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates stable/queens: FFU: Fix nova fast forward steps  https://review.openstack.org/55120508:37
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates stable/queens: FFU: Add memcached fast forward upgrade tasks  https://review.openstack.org/55120708:37
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates stable/queens: Add fast_forward_upgrade_tasks for ceilometer services  https://review.openstack.org/55120808:38
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates stable/queens: ffu: Introduce Neutron fast-forward upgrade tasks  https://review.openstack.org/55121008:38
*** tesseract has joined #tripleo08:38
*** dpawar has quit IRC08:38
*** slaweq__ has quit IRC08:39
*** lvdombrkr89 has joined #tripleo08:41
*** lvdombrkr has quit IRC08:44
*** slaweq__ has joined #tripleo08:44
*** dpawar has joined #tripleo08:47
*** lvdombrkr has joined #tripleo08:48
*** threestrands_ has quit IRC08:48
*** slaweq__ has quit IRC08:49
*** lvdombrkr89 has quit IRC08:49
*** egallen has joined #tripleo08:52
*** gfidente has joined #tripleo08:56
*** gfidente has quit IRC08:56
*** gfidente has joined #tripleo08:56
*** radeks__ has joined #tripleo08:58
*** amoralej|off is now known as amoralej09:00
*** radeks_ has quit IRC09:01
*** jpich has joined #tripleo09:03
*** slaweq__ has joined #tripleo09:04
*** guits_ has joined #tripleo09:06
*** lyarwood is now known as lyaaaaaaaaaaarwo09:09
*** slaweq__ has quit IRC09:09
*** lyaaaaaaaaaaarwo is now known as lyaaaaaaaarwood09:09
*** radeks__ has quit IRC09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403609:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]09:10
*** athomas has joined #tripleo09:11
*** slaweq__ has joined #tripleo09:15
*** d0ugal_ has quit IRC09:16
*** d0ugal has joined #tripleo09:17
*** d0ugal has quit IRC09:17
*** d0ugal has joined #tripleo09:17
*** lucas-afk is now known as lucasagomes09:18
*** slaweq__ has quit IRC09:20
*** ykarel has quit IRC09:21
*** slaweq__ has joined #tripleo09:25
*** matbu is now known as matbu|pto09:25
*** wojdec1 has left #tripleo09:27
*** dougbtv_ has joined #tripleo09:29
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Convert ServiceNetMap evals to hiera interpolation  https://review.openstack.org/52669209:29
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: zuul: do not run containerized undercloud  https://review.openstack.org/55102209:29
*** slaweq__ has quit IRC09:30
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: undercloud: set cleaning and provisioning networks to 'ctlplane'  https://review.openstack.org/55010009:30
*** dougbtv has quit IRC09:30
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: undercloud_post: override stackrc  https://review.openstack.org/55098909:31
*** d0ugal has quit IRC09:32
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: ironic/undercloud: align configuration with instack-undercloud  https://review.openstack.org/55063809:32
*** holser__ has joined #tripleo09:32
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: neutron: rename db when upgrading a containerized undercloud  https://review.openstack.org/54960909:33
*** dougbtv__ has joined #tripleo09:33
*** d0ugal has joined #tripleo09:34
*** wolverineav has joined #tripleo09:35
*** slaweq__ has joined #tripleo09:35
*** dougbtv_ has quit IRC09:35
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Prepare t-h-t for undercloud in a work dir  https://review.openstack.org/54287509:36
*** dpawar has quit IRC09:40
*** wolverineav has quit IRC09:40
*** slaweq__ has quit IRC09:40
*** guits_ has quit IRC09:41
*** d0ugal has quit IRC09:42
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Prepare t-h-t for undercloud in a work dir  https://review.openstack.org/54287509:43
*** holser__ has quit IRC09:45
*** slaweq__ has joined #tripleo09:45
*** holser__ has joined #tripleo09:47
*** dtantsur|afk is now known as dtantsur09:47
bogdandodtantsur: hi! Any help with this please https://trello.com/c/xkyfUGST/34-identify-all-blockers-for-ovb-fs001#comment-5aa2580d85dea3066c62a672 ?09:48
*** dbecker has joined #tripleo09:48
bogdandothe introspection fix worked though, that's good news, dtantsur09:48
*** lvdombrkr has quit IRC09:48
dtantsurbogdando: morning, will take a look09:49
bogdandothanks!09:49
bogdandodtantsur: I have a live env as well09:49
*** derekh has joined #tripleo09:49
dtantsurbogdando: it's an issue in our workflows, that does not usually manifest itself because we have cleaning disabled by default.09:50
*** slaweq__ has quit IRC09:50
dtantsurbogdando: when https://review.openstack.org/546663 merges it will be hidden from you too09:50
dtantsurhowever, mind filing an LP for it? against tripleo-common09:50
bogdandoand keep failing? ))09:51
bogdandoin a hidden state I mean :)09:51
dtantsurbogdando: well, cleaning will be disabled, so you'll skip this 'clean wait' state09:51
dtantsurit should be an easy fix though, lemme think about it09:52
bogdandodtantsur: thanks!09:52
bogdandoI'll file a bug then09:52
*** chem has joined #tripleo09:52
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Undercloud: wire in 'clean_nodes'  https://review.openstack.org/54666309:53
*** guits_ has joined #tripleo09:55
*** slaweq__ has joined #tripleo09:56
*** pblaho has joined #tripleo09:56
*** d0ugal has joined #tripleo09:57
*** wolverineav has joined #tripleo09:57
*** Uday_ has joined #tripleo09:59
Uday_Hi09:59
bogdandodtantsur: https://bugs.launchpad.net/tripleo/+bug/175460910:00
openstackLaunchpad bug 1754609 in tripleo "Openstack node provide fails for containerized undercloud" [Undecided,New]10:00
*** numans has quit IRC10:00
*** slaweq__ has quit IRC10:00
*** radeks has joined #tripleo10:00
*** wolverineav has quit IRC10:01
*** numans has joined #tripleo10:02
*** gfidente has quit IRC10:03
*** dougbtv_ has joined #tripleo10:03
*** slaweq__ has joined #tripleo10:06
openstackgerritMerged openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/55117610:06
*** dougbtv__ has quit IRC10:06
dtantsurbogdando: thanks.. something weird is going in with workflows, still looking into it10:07
*** gfidente has joined #tripleo10:07
*** gfidente has quit IRC10:07
*** gfidente has joined #tripleo10:07
*** salmankhan has joined #tripleo10:09
dtantsurbogdando: in a containerized undercloud where do I find /etc/ironic/ironic.conf?10:09
dtantsurI think we're hitting a combination of two problems, but I need to double-check10:09
bogdandodtantsur: /var/lib/config-data/puppet-generated/ironic*10:10
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403610:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]10:10
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates stable/queens: Fix default nic config file names  https://review.openstack.org/55123710:10
*** slaweq__ has quit IRC10:10
bandinijistr: ^ I backported your patch to queens, without it ComputeInstanceHA is broken. hope that's okay :)10:11
dtantsurbogdando: oh, I see :)10:11
jistrbandini: it's more than ok! thanks :)10:11
bogdandolet me guess... is it tht/puppet fails behind of instack undercloud? :D10:11
dtantsurbogdando: much simpler: https://bugs.launchpad.net/tripleo/+bug/1754609/comments/110:12
openstackLaunchpad bug 1754609 in tripleo "Openstack node provide fails for containerized undercloud" [High,Triaged]10:12
dtantsurd0ugal: hey, do you have any idea on #2 in https://bugs.launchpad.net/tripleo/+bug/1754609/comments/1 ?10:12
d0ugalstendulker: looking.10:12
*** salmankhan has quit IRC10:12
d0ugalwoah, sorry stendulker. Not sure how I done that.10:12
d0ugaldtantsur: looking :)10:12
*** salmankhan has joined #tripleo10:13
dtantsurbogdando: while d0ugal is looking into timeout problem, I think I know an easy fix for the first problem, gimme a minute10:13
bogdandodtantsur: thank you, that was fast and well done RCA :)10:13
openstackgerritDmitry Tantsur proposed openstack/tripleo-heat-templates master: undercloud: enable only metadata cleaning  https://review.openstack.org/55124010:16
dtantsurbogdando: ^^^ should fix this10:16
*** slaweq__ has joined #tripleo10:16
dtantsurmmm, forgot closes-bug10:16
EmilienMd0ugal: no urgency but just FYI https://trello.com/c/ffGstScp/48-migrate-mistral-workflow-management-from-instack-undercloud when you have time. Thanks a lot!10:16
openstackgerritDmitry Tantsur proposed openstack/tripleo-heat-templates master: undercloud: enable only metadata cleaning  https://review.openstack.org/55124010:16
dtantsurokay, now ^^^10:17
openstackgerritDmitry Tantsur proposed openstack/tripleo-heat-templates stable/queens: Configure deploy logs for Ironic  https://review.openstack.org/55124110:18
d0ugalEmilienM: neat, I'll try and review today.10:18
bogdandodtantsur: thanks! that fix is only partial?10:19
*** moguimar1 has joined #tripleo10:19
dtantsurbogdando: it fixes your problem. it does not fix non-working timeouts though10:19
bogdandobut fully work arounds, right?10:19
bogdandoack10:19
*** salmankhan has quit IRC10:19
*** moguimar1 is now known as moisa10:20
*** slaweq__ has quit IRC10:20
*** moguimar is now known as Guest2560710:21
*** moisa is now known as moguimar10:21
*** Guest25607 has joined #tripleo10:21
openstackgerritzenghui.shi proposed openstack/puppet-tripleo master: Add interface mapping support for sriov configuration  https://review.openstack.org/49944810:22
bogdandod0ugal, dtantsur: can I kill the debug env?10:22
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Remove registry special casing which no longer has any effect  https://review.openstack.org/55124310:22
d0ugalbogdando: I don't think I need it.10:22
d0ugaldtantsur: is this something new? i.e. has something changed?10:23
dtantsurbogdando: go ahead10:23
dtantsurd0ugal: I don't think so. I just think nobody actually ever hit these timeouts...10:23
d0ugaldtantsur: k, thanks10:23
bogdandordo cloud cares of your corner cases!10:24
d0ugal:)10:24
*** wolverineav has joined #tripleo10:25
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart master: Run ovb-ha (fs001) with a containerized undercloud  https://review.openstack.org/54255610:26
*** slaweq__ has joined #tripleo10:26
shardyjtomasek: Hi, I wanted to talk again about the poll-for-status requirement when you have a moment10:27
*** moguimar has quit IRC10:27
shardyI was thinking, what if we abstracted the zaqar.queue_post calls in the workbooks, so each time a message is written to a queue, we also write the message to the plan?10:27
shardyso you could read e.g plan-status.yaml and get the last message pushed to zaqar?10:28
shardythat would keep the data out of the plan-environment, and enable polling for the latest status, e.g tripleo.deployment.deploy is FAILED, or tripleo.ansible-playbook is FAILED etc10:29
*** udesale_ has joined #tripleo10:29
jtomasekshardy: that sounds good10:29
shardyjtomasek: Ok, I'll grab a coffee then try to get it working :)10:30
*** wolverineav has quit IRC10:30
*** tosky has joined #tripleo10:30
*** slaweq__ has quit IRC10:31
jtomasekshardy: what code sends the zaqar messages, is it ansible or mistral? (/me things ansible)10:32
*** udesale has quit IRC10:32
jtomasekin case of config-download progress of course10:32
*** udesale has joined #tripleo10:33
*** udesale_ has quit IRC10:33
openstackgerritzenghui.shi proposed openstack/tripleo-heat-templates master: Add interface mapping support for sriov configuration  https://review.openstack.org/49944710:35
*** moguimar has joined #tripleo10:36
*** dpawar has joined #tripleo10:36
*** slaweq__ has joined #tripleo10:36
*** udesale has quit IRC10:40
*** slaweq__ has quit IRC10:41
*** moguimar has quit IRC10:43
shardyjtomasek: all the zaqar messages are sent via the mistral workbooks10:44
*** yprokule has quit IRC10:44
shardyso I think we can create a new workbook which wraps the zaqar.queue_post action, and have it post the action and write to the plan10:44
*** moguimar has joined #tripleo10:44
jtomasekshardy: I thought that was an exception in case of config-download10:45
* jtomasek checks workbook10:45
*** yprokule has joined #tripleo10:46
shardyhttps://github.com/openstack/tripleo-common/blob/master/workbooks/deployment.yaml#L34610:46
shardyjtomasek: AFAICS it's the same10:46
d0ugalif you are talking about the ansible output, the ansible action sends it to the queue passed in here: https://github.com/openstack/tripleo-common/blob/master/workbooks/deployment.yaml#L37410:48
shardyd0ugal: what's the easiest way to wrap that action, e.g zaqar.queue_post, can I have the workbook run another wrapper workbook, or is it best to subclass the action in tripleo-common?10:48
jtomasekshardy: https://review.openstack.org/#/c/425060/10:48
*** abhishekk has quit IRC10:48
d0ugalshardy: that depends how you want to wrap it :)10:48
d0ugalshardy: but yeah, that patch is the best way I have found so far10:49
*** wolverineav has joined #tripleo10:49
shardyd0ugal: ah nice, so yeah we could use that and just push the message to swift as well as zaqar10:49
jtomasekshardy: thanks, I have misunderstood to which actions you wanted to update the state, It totally makes sense to write the status only in cases when mistral workflow sends the messages... cool10:49
shardyexcept if actions are pushing stuff directly so we'll have to make sure nothing does that10:50
shardysounds like the ansible action does, e.g it's different to every other action?10:50
d0ugalshardy: the ansible action is a special case, so it can stream the output to zaqar10:51
d0ugalotherwise you'd potentially wait a long time for any results10:51
d0ugals/results/output/10:51
*** pblaho has quit IRC10:51
shardyd0ugal: ah, but we still send a message after the action completes to say success/failure I think?10:51
shardyor if not then we can10:51
jtomasekshardy: yes10:51
jtomasekthat was my confusion10:51
d0ugalshardy: yes, I think we do10:51
shardyOk then the streaming stuff just doesn't end up in swift, which is probably OK10:52
d0ugalthe special case with the ansible action is that it sends messages directly and then the workflow can also send messages10:52
shardywe just want the result of the most recently run workflow, e.g the last status message10:52
d0ugalno other action sends messages directly (well, other than zaqar actions :))10:52
jtomasekthere are start/success/failed messages sent from the mistral workflow and in addition ansible itself sends granular updates to different zaqar queue afaiu10:52
shardyd0ugal: Ok thanks for clarifying10:52
d0ugalhttps://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/ansible.py#L470-L47910:52
*** psachin has quit IRC10:52
d0ugaljtomasek: I thought it was a different queue, but it seems to be the same: https://github.com/openstack/tripleo-common/blob/master/workbooks/deployment.yaml#L37410:53
jtomasekd0ugal: even better!10:53
jtomasekthats great actually, yay:)10:53
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Add output dir and cleanup vars for UC use_heat  https://review.openstack.org/54694810:54
d0ugalhaha, great10:54
shardyd0ugal: are you working on follow-up patches to convert all-the-things to your wrapper, e.g more than just baremetal?10:54
shardywe'll need the plan management and deploy ones for the UI use-case I think10:54
*** wolverineav has quit IRC10:54
shardy(and eventually everything I guess)10:54
d0ugalshardy: yes, eventually - I am not sure it totally works yet tbh10:54
jtomasek+110:54
d0ugalshardy: but I can prioritise it if needed10:54
d0ugalI was mostly doing it as a cleanup/refactor - i.e. low priority10:55
shardyd0ugal: if you have some time to move it forward that would be great, we're trying to get OpenShift deployments working via tripleo-ui, which won't work without this way to poll the plan deploy status10:55
jtomasekshardy: only thing I wonder about now is what is the contents of the data provided when config-download deployment fails. it would be nice to include error output from ansible but I assume that is included. (Validations do the same thing)10:55
d0ugalRight10:55
shardywe could probably hack in some temporary way to do it, but moving this forward and then adding the persisting of most recent message seems cleaner10:56
d0ugalshardy: I'll see what I can do - it could be that we get the deploy workflows working first (I chose baremetal as I think it has the most edge cases to handle)10:56
openstackgerritMichele Baldessari proposed openstack/tripleo-docs master: Add Instance HA docs  https://review.openstack.org/54423210:56
shardyjtomasek: yes, I'm assuming we can get some useful output from the ansible action, regardless of the streaming thing10:56
jtomasekshardy: nice10:56
shardyand persist that like any other status message10:56
d0ugalshardy: do we have something describing the need re:swift storage?10:57
d0ugaldo we want to store every message or only the ansible output?10:57
jtomasekshardy: are you going to create a separate workflow similar to dougal's patch and use that, or you intend to create another workflow wrapper for dougal's workflow?10:57
openstackgerritMarios Andreou proposed openstack/python-tripleoclient stable/queens: Add --roles and --nodes params to overcloud upgrade run cli  https://review.openstack.org/55125410:57
shardyd0ugal: it's what we discussed yesterday - the UI needs some way to poll (at any time) the deployment status of the plan, so persisting the last sent message is one way to achieve that10:57
d0ugaloh, only the last message.10:58
shardye.g even when the queue is empty, we still need to have access to the last sent message10:58
shardyd0ugal: yeah, I'm assuming just the last one as I think writing a list into swift will be too slow10:58
d0ugalokay, that should be easy enough.10:58
*** psachin has joined #tripleo10:58
shardybut just overwriting an object with a single message payload should be OK I think10:59
jtomasekshardy, d0ugal: actually for general solution we need more than last message - for validation results - each validation is triggered using the same workflow10:59
jtomasekto get results for them we need to find last message per execution rather than workflow10:59
shardyjtomasek: Ok maybe we can write a file per exectution into swift?11:00
jtomasekso we would need to store executionId: <lastMessage which contains the execution id> in swift11:00
jtomasekexactly11:00
d0ugalRight, so the object id matching the execution id?11:00
shardyjtomasek: Ok so we could have a directory, and write a file per execution, but we'd need some way to tell what is the latest11:01
jtomasekhm, that reintroduces the problem of executions not persisted...11:01
d0ugaljtomasek: but after the execution is purged from mistral, how do you know the ID? :)11:01
shardywell the execution could be deleted, but we'd still have the status in swift?11:01
d0ugalshardy: can we just get the latest by creation/updated time?11:01
shardyd0ugal: yeah maybe, I wasn't sure on the resolution of that11:01
jtomasekthe record in swift would also need to include workflow id11:01
*** guits_ has quit IRC11:02
*** wolverineav has joined #tripleo11:02
shardyyes the messages all have the workflow name and an execution ID11:02
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Include new CLI changes for overcloud update.  https://review.openstack.org/55051711:02
shardyso we'd write that to swift11:02
d0ugaljtomasek: tripleo.deployment.v1.deploy_plan-EXECUTION_UUID11:02
jtomasekcool11:02
d0ugalSomething like that?11:02
shardyyeah we could combine the workflow name and execution ID, but the workflow is already persisted via "type" I think?11:03
shardyeither would be fine I guess11:03
jtomasekd0ugal: executionId: { message { type: workflow name, payload: payload}11:03
jtomasekd0ugal: so I think we're good since the message type matches the workflow name11:03
d0ugaljtomasek: I was thinking of the object name in swift? How do you find it?11:04
shardyjtomasek: I was thinking we could base the changes on top of the patch from d0ugal, particularly if he's happy to add the deployment & plan management workflows to the patch or post a follow-up11:04
shardyThen https://review.openstack.org/#/c/425060/7/workbooks/zaqar.yaml looks like a good place to add writing to the plan container11:04
shardyalthough we'd need to pass the plan name in there11:04
d0ugalshardy: happy for it to be based on my patch (I'll probably rename it from tripleo.zaqar.v1 tho if we are going to add swift. tripleo.messaging.v1?)11:05
jtomasekshardy: right I did not realize you aim for general solution11:05
shardyd0ugal: ack that sounds good11:05
*** dpawar has quit IRC11:06
jtomasekwhat if we store the information in one object per plan?11:06
shardyjtomasek: yup it seems nice if we can go for a general solution here vs some special-casing in the deploy/plan workflows11:06
*** salmankhan has joined #tripleo11:06
jtomasekfetching a set of objects from swift is not very performant iirc11:06
*** wolverineav has quit IRC11:06
jtomasekand there would be a lot of them in case of tracking executions11:07
shardyjtomasek: that's what I expected until you said you need to store multiple executions11:07
shardyto store one object, we'd need to read an object, merge/append the message, then write it11:07
shardyI was thinking we'd just write an object for each message11:07
shardywhich would probably be faster11:07
shardybut yeah there could be a cost reading, I wonder if you can head the container then work out the latest from that?11:08
shardyof if we used an incrementing index or something when writing the file (e.g a timestamp)11:08
shardyso the plan object list can be sorted without reading anything11:08
*** skramaja has quit IRC11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403611:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]11:10
*** flepied has joined #tripleo11:12
d0ugalshardy: do we have introspection coverage in CI? I'm wondering how many of my baremetal.yaml changes are tested?11:13
chandankumarjaosorior: Now new failures on the patch https://review.openstack.org/#/c/548325/ failing to install undercloud11:13
chandankumarhttp://logs.openstack.org/25/548325/18/check/tripleo-ci-centos-7-undercloud-oooq/7d48ede/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-03-09_08_42_5211:13
jaosoriorchandankumar: it was a package issue http://logs.openstack.org/25/548325/18/check/tripleo-ci-centos-7-undercloud-oooq/7d48ede/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-03-09_08_35_4211:15
chandankumarjaosorior: you mean os-refresh-config package issue?11:16
*** jaosorior has quit IRC11:16
d0ugalshardy: I am guessing not very much is covered, I just noticed a typo - it should have been totally broken :/11:16
openstackgerritDougal Matthews proposed openstack/tripleo-common master: [Experimental] Use sub-workflows to reduce Zaqar post duplication  https://review.openstack.org/42506011:16
jtomasekshardy: I am concerned whether introducing this is not worse than configuring mistral to persist all executions (which is what we're reimplementing basically)11:16
shardyd0ugal: Hmm, it should be tested by one of the ovb jobs I think, let me check11:16
*** jaosorior has joined #tripleo11:16
d0ugalshardy: they both failed, so that might explain it :)11:17
*** slaweq__ has joined #tripleo11:17
d0ugaljtomasek: I think we would start to see performance issues in Mistral if we do that - but we could look into it.11:17
*** stendulker has quit IRC11:17
shardyjtomasek: well we could obviously configure mistral to never expire executions, but then the DB will just grow over time so we'd need some way to clean up11:17
jtomasekd0ugal: but I very much expect the same in case of swift - even worse11:18
d0ugaljtomasek: mistral stores far far more than just the last message (every execution, task execution, action execution etc.)11:18
shardylike map executions to a plan, or delete the old executions each deploy/update?11:18
shardythat seems more complex than persisting the message payload to me11:18
*** liverpooler has quit IRC11:18
shardyjtomasek: why would performance be a problem, we'll write a few objects of a few kb11:19
shardyvs a DB growing to gigabytes over time11:19
shardyand those objects will get deleted with the plan11:19
d0ugalwe could add object expiry to swift - over a very long time if we want it to clear out eventually11:20
shardyI'm open to other suggestions though, ultimately I just want the UI to work with config download ASAP :)11:20
jtomasekshardy: if that is one message per workflow, then it should be fine as the number of objects would be equal to number of different workflows we have, ok lets do it this way.11:21
shardyd0ugal: yeah or we could e.g clear plan/deploy-messages/* at the start of each update or something11:21
*** jaosorior has quit IRC11:21
jtomasekthis solution will not cover validation results11:21
shardythe CLI clears the entire plan anyway, right?11:21
d0ugalshardy: yeah, I think so11:21
*** jaosorior_ has joined #tripleo11:21
shardyjtomasek: how do you get the validation results today?11:22
*** slaweq__ has quit IRC11:22
d0ugalI gotta go and take care of a chore, bbiab11:22
jtomasekshardy: we fetch all executions, find the executions of 'run_validation' workflows, filter by validation names, find the latest11:23
*** jaosorior_ has quit IRC11:23
shardyjtomasek: Ok, so we could do the same for deploy, but we know execution expiry will be a problem, like in the case of validations11:23
jtomasekbecause all validations are triggered using same workflow, but differentiate by input11:23
*** jaosorior__ has joined #tripleo11:23
*** paramite has joined #tripleo11:24
jtomasekyes, right11:24
shardyjtomasek: I guess that's the same as deploy, same workflow but different plan11:24
*** jaosorior__ has quit IRC11:24
jtomasekoh, right, but since we're storing in plan, that would get covered11:24
*** jaosorior has joined #tripleo11:25
*** jaosorior has quit IRC11:25
shardyyeah it would be a way to store execution data for each plan11:25
*** jaosorior has joined #tripleo11:25
openstackgerritMarios Andreou proposed openstack/tripleo-docs master: Adds FFU developer docs base - workflow and tripleo-heat-templates  https://review.openstack.org/52665611:27
*** slaweq__ has joined #tripleo11:27
*** adarazs is now known as adarazs_afk11:29
*** psachin has quit IRC11:29
*** slaweq__ has quit IRC11:32
*** pblaho has joined #tripleo11:32
dtantsurugh, the mirrors break undercloud installation11:34
*** psachin has joined #tripleo11:34
dtantsurbogdando: FYI /var/lib/config-data is not collected in the CI runs11:35
*** moshele has joined #tripleo11:35
jaosoriordtantsur: it is; it just isn't in /var/lib/config-data for some reason11:36
dtantsurjaosorior: can we put some hints somewhere on where to find all this stuff? :)11:36
jaosoriordtantsur: I don't know where to put such hints. I just know cause I needed to look for it not too long ago (trying to find em again now to point you to them)11:37
*** slaweq__ has joined #tripleo11:37
dtantsurjaosorior: there's a README page on each CI run with a few links11:37
jaosoriordtantsur: right, but I don't know how to change that README11:38
dtantsurI see11:38
jaosorioruhm... and I don't find any controller logs from any recent OVB patch11:39
jaosoriorstrange11:39
jaosoriordtantsur: anyway, in multinode jobs you should be able to find them in the subnode-2 directory in /var/log/config-data11:40
jaosoriordtantsur: like this http://logs.openstack.org/82/550882/1/check/tripleo-ci-centos-7-scenario007-multinode-oooq-container/2c03a74/logs/subnode-2/var/log/config-data/11:40
dtantsurjaosorior: I'm more interested in the containerized undercloud now11:41
*** moshele has quit IRC11:42
*** slaweq__ has quit IRC11:42
*** pkovar has joined #tripleo11:42
jaosoriorok11:42
*** derekh has quit IRC11:45
*** moshele has joined #tripleo11:46
*** slaweq__ has joined #tripleo11:48
*** derekh has joined #tripleo11:48
shardyjtomasek: re validations, how does that work when you switch from the "nodes" to the "plans" view?11:49
shardye.g are the validations actually scoped to a plan?11:49
shardyit's not that clear from the UI because they are visible at the top of the page in both cases11:50
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: A keystone only controller deployment  https://review.openstack.org/54010711:50
shardythis is one reason why we might want to move the (sometimes service and/or openstack specific) validations to be in some roles shared by t-h-t, e.g so we can select appropriate validations based on the enabled roles for each plan?11:51
*** slaweq__ has quit IRC11:52
shardyjtomasek: also I noticed a problem wrt introspection - if you have nodes that are availble, but not introspected, it's not possible to click "introspect" and introspect them11:53
jtomasekshardy: validations are scoped to plan but some of them don't use that information11:54
*** panda|off is now known as panda11:54
*** ccamacho has quit IRC11:55
jtomasekyou need to move the available nodes to manageable starte by selecting them and running "manage11:55
jtomasek" action11:55
jtomasekshardy: ^11:55
*** ccamacho has joined #tripleo11:55
jtomasekshardy: if you trigger introspection on 'available' nodes, ironic will complain about it11:56
shardyjtomasek: Ok, we should tell the user that vs exploding error dialogs from mistral :)11:56
shardyalso when you do that, the nodes are unselected, so you have to check the boxes again11:56
jtomasekshardy: well, that is a problem of mistral workflow error handling. there should be clear error message (not cluttered by mistral stuff)11:57
shardyjtomasek: yeah sure, I'm just noting it as a problem that needs fixing11:57
shardyI'll raise a bug11:57
jtomasekshardy: thanks11:58
*** slaweq__ has joined #tripleo11:58
*** ratailor has quit IRC11:59
shardyhttps://bugs.launchpad.net/tripleo/+bug/175464012:01
openstackLaunchpad bug 1754640 in tripleo "Trying to introspect available nodes give unclear error output" [Medium,Triaged]12:01
*** pdeore has quit IRC12:01
*** slaweq__ has quit IRC12:02
*** jlabarre has quit IRC12:05
*** slaweq__ has joined #tripleo12:08
openstackgerritRussell Tweed proposed openstack/tripleo-heat-templates master: Fix invalid role template generated for ComputeOvsDpdk  https://review.openstack.org/55126712:10
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403612:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]12:10
*** slaweq__ has quit IRC12:13
*** adarazs_afk is now known as adarazs12:13
*** raildo has joined #tripleo12:17
*** slaweq__ has joined #tripleo12:18
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Refactor some common code between overcloud_upgrade and update  https://review.openstack.org/55079912:19
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Fix gnocchi FFU tasks  https://review.openstack.org/54863512:22
*** bfournie1 has quit IRC12:22
*** bfournie has joined #tripleo12:23
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Fix glance tasks  https://review.openstack.org/54863412:23
openstackgerritRicardo Noriega proposed openstack/tripleo-heat-templates master: Changing to L2GW Opendaylight v2 driver  https://review.openstack.org/55127012:23
*** slaweq__ has quit IRC12:23
*** moguimar has quit IRC12:24
openstackgerritChandan Kumar proposed openstack/python-tripleoclient master: Added fake tempest docker service to undercloud config  https://review.openstack.org/55127112:25
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Refactor some common code between overcloud_upgrade and update  https://review.openstack.org/55079912:25
*** moguimar has joined #tripleo12:26
*** bfournie has quit IRC12:27
bogdandofolks, my ovb fs001 fails very similar to The testing is blocked by something very similar to https://bugzilla.redhat.com/show_bug.cgi?id=148633412:27
openstackbugzilla.redhat.com bug 1486334 in instack-undercloud "OSP undercloud installation failed due to iptables conflict" [Unspecified,Closed: notabug] - Assigned to jslagle12:27
bogdandoundercloud install fails with12:27
bogdandoProtected multilib versions: iptables-1.4.21-18.2.el7_4.i686 != iptables-1.4.21-18.3.el7_4.x86_6412:27
bogdandois it a known CI issue?12:27
*** moshele has quit IRC12:28
*** slaweq__ has joined #tripleo12:28
bogdandohttps://review.openstack.org/#/c/542556/ , there is no logs for undercloud install cuz of https://bugs.launchpad.net/tripleo/+bug/1754280 , but my local env shows that issue. So that might be the case for RDO CI results as well...12:29
openstackLaunchpad bug 1754280 in tripleo "OVB job fs001 does not produce undercloud install logs and reproduce script" [High,Triaged] - Assigned to John Trowbridge (trown)12:29
*** slaweq__ has quit IRC12:33
*** udesale has joined #tripleo12:36
*** slaweq__ has joined #tripleo12:38
*** wolverineav has joined #tripleo12:39
*** thrash|ptg is now known as thrash12:42
openstackgerritHarald JensÃ¥s proposed openstack/tripleo-docs master: Documentation - TripleO routed-spine-and-leaf  https://review.openstack.org/53993912:42
*** wolverineav has quit IRC12:43
*** gkadam_ has joined #tripleo12:43
*** slaweq__ has quit IRC12:43
*** gkadam has quit IRC12:46
*** slaweq__ has joined #tripleo12:49
*** lucasagomes is now known as lucas-hungry12:49
*** slaweq__ has quit IRC12:54
*** liverpooler has joined #tripleo12:57
*** slaweq__ has joined #tripleo12:59
*** bfournie has joined #tripleo13:00
Uday_Any way to tweak controller's OS limits [nofile,nproc] using triple o resources while deploying overcloud?13:02
*** slaweq__ has quit IRC13:04
*** wolverineav has joined #tripleo13:07
openstackgerritHarald JensÃ¥s proposed openstack/tripleo-docs master: Documentation - TripleO routed-spine-and-leaf  https://review.openstack.org/53993913:07
*** slaweq__ has joined #tripleo13:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403613:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]13:10
*** pchavva has joined #tripleo13:10
*** wolverineav has quit IRC13:12
*** aufi has quit IRC13:13
*** slaweq__ has quit IRC13:14
*** fragatina has quit IRC13:16
*** fragatina has joined #tripleo13:16
*** liverpooler has quit IRC13:17
*** liverpooler has joined #tripleo13:17
*** suuuper has quit IRC13:18
*** ebarrera has quit IRC13:23
*** ebarrera has joined #tripleo13:24
*** lucas-hungry is now known as lucasagomes13:30
*** rlandy has joined #tripleo13:31
*** Goneri has joined #tripleo13:32
*** leanderthal has joined #tripleo13:32
*** pblaho has quit IRC13:34
*** pgadiya has quit IRC13:35
*** amoralej is now known as amoralej|lunch13:37
*** salmankhan has quit IRC13:37
*** aufi has joined #tripleo13:38
*** aufi_ has joined #tripleo13:38
*** moguimar has quit IRC13:40
*** Noam_ has joined #tripleo13:41
Noam_hi guys, i have issue with deploy tripleo with ovs-dpdk branch is stable queens13:42
*** aufi has quit IRC13:42
Noam_i get this error13:43
Noam_Error: Evaluation Error: Error while evaluating a Resource Statement, Duplicate declaration: Keepalived::Instance[55] is already declared in file /etc/puppet/modules/tripleo/manifests/keepalived.pp:186; cannot redeclare at /etc/puppet/modules/tripleo/manifests/keepalived.pp:186 at /etc/puppet/modules/tripleo/manifests/keepalived.pp:186:7 on node overcloud-controller-0.localdomain"13:43
*** radeks_ has joined #tripleo13:44
*** Uday_ has quit IRC13:44
shardyNoam_: which branch are you deploying?  There is no TripleO ovs-dpdk branch AFAIK13:45
*** trown|outtypewww is now known as trown|rover13:45
shardyNoam_: that error means you have whatever is declared at /etc/puppet/modules/tripleo/manifests/keepalived.pp:186 also configured somewhere else13:45
shardye.g /etc/puppet/modules/tripleo/manifests/keepalived.pp:186:713:45
shardyNoam_: I'd check those lines and see what the declaration refers to13:46
shardymaybe it's a corner case related to your configuration?13:46
Noam_this what appear in line 18613:46
Noam_keepalived::instance { "${vrouter_id}":13:46
*** chem is now known as chem|mtg13:49
openstackgerritMerged openstack/tripleo-ui master: update reno for queens  https://review.openstack.org/54867113:49
openstackgerritBob Fournier proposed openstack/tripleo-heat-templates master: Add check for old-style nic config files  https://review.openstack.org/55020113:49
Noam_any idea what to check this file does not give any clues13:50
*** cdearborn has joined #tripleo13:50
*** holser__ has quit IRC13:51
*** dprince has joined #tripleo13:51
*** holser___ has joined #tripleo13:51
shardyNoam_: I'd check the network configuration e.g ensure you've not got any conflicting settings between networks and/or add some debug to the module and figure out why it's failing validation based on the inputs13:51
shardyhttps://hardysteven.blogspot.co.uk/2018/02/debugging-tripleo-revisited-heat.html has some info on that13:52
d0ugalhonza: What happens if the queue doesn't exist?13:52
shardysee the "Debugging via Puppet directly" section13:52
shardyNoam_: ^^13:52
d0ugalhonza: Oh, I see, 50313:52
honzad0ugal: https://bugs.launchpad.net/tripleo/+bug/175406113:52
openstackLaunchpad bug 1754061 in tripleo "zaqar returns 503 causing overcloud deployment failure" [High,Triaged] - Assigned to Honza Pokorny (hpokorny)13:52
honzayes13:52
d0ugalhonza: I'm not sure I like the idea of claim_messages having a side effect of creating a queue...13:53
d0ugalhonza: this basically changes the behaviour IMO13:53
honzad0ugal: it makes the claim messages call safe13:54
Noam_thanks13:54
*** eck` is now known as eck`gone13:54
*** jmelvin has joined #tripleo13:54
openstackgerritRadoslaw Smigielski proposed openstack/instack-undercloud master: remove ownership change of ironic-dbsync.log  https://review.openstack.org/55128313:54
honzad0ugal: should we move this logic to the workflow then?13:55
d0ugalhonza: I think that makes more sense but I'm still processing it13:55
*** jrist has quit IRC13:55
honzad0ugal: k13:55
*** toure is now known as toure|biab13:57
*** pblaho has joined #tripleo13:57
openstackgerritRadoslaw Smigielski proposed openstack/instack-undercloud master: remove ownership change of ironic-dbsync.log  https://review.openstack.org/55128313:58
bandiniso we seem to be failing in CI with some gcc installation errors (http://logs.openstack.org/41/550741/1/check/puppet-openstack-unit-4.8-centos-7/49ef448/job-output.txt.gz#_2018-03-09_10_46_45_365500) anyone seen that already?13:59
apetrichhonza, I'd rather have that in the workflow too. the claim messages creating queues seems odd14:00
honzaapetrich: +114:00
honzaapetrich: this seemed liked the easiest solution14:01
*** gkadam__ has joined #tripleo14:01
*** mcornea has joined #tripleo14:02
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Enable usage of memcached for keystone  https://review.openstack.org/55128614:03
*** gkadam_ has quit IRC14:03
d0ugalhonza: posted a review14:03
honzad0ugal: thanks!14:04
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Enable usage of memcached for keystone  https://review.openstack.org/55128614:04
d0ugalhonza: I think it will be fairly easy to move forward - let me know if I can help further with it.14:05
d0ugalhonza: oh, does this need to be backported?14:05
honzad0ugal: sounds easy; yes, i believe so14:05
d0ugalhonza: that is more than a pain, since backporting a new action violates the stable policy :)14:06
* d0ugal ponders some more14:06
honzad0ugal: there is also no way for the workflow to test if a queue exists14:06
EmilienMsounds like all gate is red14:06
bandiniEmilienM: yeah I just filed https://bugs.launchpad.net/tripleo/+bug/175466914:06
openstackLaunchpad bug 1754669 in tripleo "different rpm packages install are failing" [Critical,Triaged]14:06
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Configure keystone's memcached options via hieradata  https://review.openstack.org/55128714:06
d0ugalhonza: yeah, it is strange that we don't have an action for that. I guess it just hasn't been needed before.14:07
*** jrist has joined #tripleo14:07
d0ugalhonza: we can probably justify it as a bug in Mistral with some clever wording14:07
EmilienMhttp://logs.openstack.org/35/548635/2/check/tripleo-ci-centos-7-containers-multinode/efe6fe3/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-03-09_13_01_3814:07
honzad0ugal: haha14:07
EmilienMamoralej|lunch: have you seen that? ^14:07
EmilienM2018-03-09 13:01:38 | 2018-03-09 13:01:38,587 INFO: [1;31mError: /Stage[main]/Ironic::Drivers::Ansible/Package[systemd-python]/ensure: change from purged to present failed: Execution of '/bin/yum -d 0 -e 0 -y install systemd-python' returned 1: Error: Package: systemd-python-219-42.el7_4.7.x86_64 (quickstart-centos-updates)14:07
*** tzumainn has joined #tripleo14:07
EmilienMtrown|rover: ^ fyi14:08
* EmilienM files a bug14:08
bogdandoand OVB on RDO cloud , by repro script fails similarly14:08
bogdandohttps://trello.com/c/xkyfUGST/34-identify-all-blockers-for-ovb-fs001#comment-5aa27d67ace128c5ce1a6ae314:09
bandiniEmilienM: https://bugs.launchpad.net/tripleo/+bug/175466914:09
openstackLaunchpad bug 1754669 in tripleo "different rpm packages install are failing" [Critical,Triaged]14:09
bandiniI just filed it 5mins ago14:09
jaosoriorI'm off14:09
jaosoriorhave a good weekend everyone!14:09
bandinibye jaosorior, enjoy the w-e14:09
*** jaosorior has quit IRC14:09
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403614:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175466914:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]14:10
openstackLaunchpad bug 1754669 in tripleo "different rpm packages install are failing" [Critical,Triaged]14:10
EmilienMhttps://bugs.launchpad.net/tripleo/+bug/175467014:10
openstackLaunchpad bug 1754670 in tripleo " Error when installing package: systemd-python-219-42.el7_4.7.x86_64" [Critical,Triaged]14:10
trown|roverhappy friday \o/14:10
*** slaweq__ has joined #tripleo14:10
EmilienMah bandini created one14:10
d0ugalhonza: very worst case, we need to add a simple zaqar action to tripleo-common and backport it. Then delete it in master14:11
bandiniEmilienM: Yeah I have also seen gcc installation failures (besides systemd ones)14:11
EmilienMi'll abandon mine14:11
d0ugalhonza: but lets try and backport first14:11
EmilienMok14:11
EmilienMamoralej|lunch: when you're back, I think we need help on this one14:12
*** amoralej|lunch is now known as amoralej14:12
EmilienMhttps://bugs.launchpad.net/tripleo/+bug/175466914:12
amoralejlet me check14:12
openstackLaunchpad bug 1754669 in tripleo "different rpm packages install are failing" [Critical,Triaged]14:12
EmilienMthx14:12
honzad0ugal: please elaborate14:12
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Refactor some common code between overcloud_upgrade and update  https://review.openstack.org/55079914:13
*** slaweq__ has quit IRC14:15
*** pradk has joined #tripleo14:15
*** salmankhan has joined #tripleo14:15
mcorneaEmilienM: o/ thanks for creating the queens branch for tripleo-upgrade14:16
amoralejEmilienM, that's out of sync mirror14:16
EmilienMmcornea: it'll be 2 beers.14:16
amoralejmissing packages on http://mirror.dfw.rax.openstack.org/centos/7/updates/x86_64/Packages14:16
mcorneaEmilienM: only 2? I think it deserves more :)14:16
EmilienMlol14:16
EmilienMamoralej: mirror issue?14:16
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: [CVE-2018-1000115] memcached: restrict to TCP & internal_api network  https://review.openstack.org/55129214:17
amoralejyes14:17
amoralejthat's what it looks like14:17
*** lblanchard has joined #tripleo14:17
EmilienMwe need paul14:19
*** slaweq__ has joined #tripleo14:20
*** toure|biab is now known as toure14:21
*** paramite has quit IRC14:21
*** Noam_ has quit IRC14:24
*** slaweq__ has quit IRC14:25
*** dansmith is now known as superdan14:26
*** salmankhan has quit IRC14:27
holser___EmilienM - quick question... Should be 1754607 bug assigned to Security Squad?14:29
EmilienMI'm not sure we assign bugs to squads14:29
EmilienMor do we?14:29
EmilienMCVE is public, code is sent now14:29
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Assignning a value to NeutronServiceName propertiy in neutron-ovs-dpdk-agent.yaml  https://review.openstack.org/55082414:30
*** pblaho has quit IRC14:30
*** slaweq__ has joined #tripleo14:31
*** salmankhan has joined #tripleo14:32
*** pblaho has joined #tripleo14:32
jristflorianf: can you +2 this https://review.openstack.org/#/c/550536/ and +1 workflow14:32
holser___EmilienM - thanks. Though I think it's open question as, sometimes, bug should be fixed very fast, or faster than goes to public14:32
*** chem|mtg is now known as chem14:34
EmilienMholser___: security bugs are handled by https://launchpad.net/~tripleo-coresec14:34
*** wolverineav has joined #tripleo14:34
EmilienMholser___: Juan is part of it14:34
holser___Ahh - nice14:34
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing.  https://review.openstack.org/52568614:34
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: DNM: testing ffu.  https://review.openstack.org/54667014:34
holser___I didn't know that14:34
EmilienMholser___: and was aware about this bug and reviewed the code before I sent it public14:35
*** slaweq__ has quit IRC14:36
*** aufi_ has quit IRC14:37
*** pblaho has quit IRC14:37
*** pblaho has joined #tripleo14:37
florianfjrist: yep, let me have a quick look14:38
jristflorianf: thank you kind sir14:38
*** wolverineav has quit IRC14:39
*** moguimar has joined #tripleo14:40
*** slaweq__ has joined #tripleo14:41
*** myoung has joined #tripleo14:41
*** dtantsur is now known as dtantsur|brb14:42
*** jlabarre has joined #tripleo14:43
*** chlong has joined #tripleo14:45
openstackgerritMerged openstack/tripleo-ui master: Fix ModalPanel in Firefox  https://review.openstack.org/55053614:45
*** slaweq__ has quit IRC14:45
*** myoung has quit IRC14:48
*** mdnadeem has quit IRC14:50
chandankumarEmilienM: please have a look on these review https://review.openstack.org/548325 and https://review.openstack.org/55127114:50
*** slaweq__ has joined #tripleo14:51
*** eck`gone is now known as eck`14:51
*** myoung has joined #tripleo14:53
*** myoung is now known as myoung|ruck14:54
*** slaweq__ has quit IRC14:55
*** moguimar has quit IRC14:57
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart master: Add P->Q & Q->M release files.  https://review.openstack.org/55130614:57
*** moguimar has joined #tripleo14:58
*** slaweq__ has joined #tripleo15:01
*** wolverineav has joined #tripleo15:02
*** tosky has quit IRC15:03
*** mwhahaha changes topic to "Welcome to Rocky. CI status: Promotions - GREENish check/gate - RED (infra mirror problems) | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/"15:05
*** slaweq__ has quit IRC15:06
*** ykarel has joined #tripleo15:06
*** tosky has joined #tripleo15:07
*** wolverineav has quit IRC15:07
openstackgerritDerek Higgins proposed openstack/instack-undercloud master: Remove duplicate entry for neutron::service_plugins  https://review.openstack.org/55131115:09
openstackgerritDerek Higgins proposed openstack/instack-undercloud master: Don't include host_routes when creating a IPv6 subnet  https://review.openstack.org/55131215:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403615:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175466915:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]15:10
openstackLaunchpad bug 1754669 in tripleo "different rpm packages install are failing" [Critical,Triaged]15:10
*** slaweq__ has joined #tripleo15:11
*** ratailor has joined #tripleo15:12
*** agopi has joined #tripleo15:15
*** slaweq__ has quit IRC15:16
*** ihrachys has joined #tripleo15:16
*** slaweq__ has joined #tripleo15:21
*** bfournie1 has joined #tripleo15:22
*** rickflare2 has quit IRC15:22
*** bfournie has quit IRC15:24
*** slaweq__ has quit IRC15:26
*** slaweq__ has joined #tripleo15:32
*** dparkes has quit IRC15:33
*** wolverineav has joined #tripleo15:35
*** moguimar has quit IRC15:36
*** slaweq__ has quit IRC15:36
*** wolverineav has quit IRC15:40
*** udesale has quit IRC15:41
*** slaweq__ has joined #tripleo15:42
EmilienMFYI gate is red, please do not recheck15:44
EmilienMinfra is on it: https://review.openstack.org/#/c/551318/15:44
EmilienMchandankumar: I will, probably next week at this stage of the weke15:45
EmilienMweek*15:45
*** ratailor has quit IRC15:46
*** slaweq__ has quit IRC15:47
*** slaweq has joined #tripleo15:52
*** jlabarre has quit IRC15:54
*** slaweq has quit IRC15:56
*** dtantsur|brb is now known as dtantsur15:57
EmilienMcentos mirror caches should be up to date as of a few minutes ago16:00
EmilienMlet's recheck on one patch and see if it helps16:00
EmilienMplease do not recheck now, I'll give an update here16:00
*** slaweq has joined #tripleo16:02
*** pcaruana has quit IRC16:02
EmilienMd0ugal: hey, your first comment on https://review.openstack.org/#/c/551009/1/extraconfig/post_deploy/undercloud_post.sh is for workflows, but have you seen L169?16:03
EmilienMd0ugal: your comment is at the line of workbooks16:04
EmilienMjust making sure I also need to change the grep for workbooks16:04
d0ugalEmilienM: oh, dammit16:04
EmilienMno problem, just making sure you don't want to filter workbooks, and just workflows.16:04
d0ugalEmilienM: Yeah, you should be good.16:05
d0ugalSorry about that16:05
EmilienMok good16:05
EmilienMno worries! thanks for the review16:05
EmilienMholser___: hey, looking your comment on https://review.openstack.org/#/c/551009/1/extraconfig/post_deploy/undercloud_post.sh - what other triggers did you mean?16:06
d0ugalAttempting to change my vote, but gerrit is crawling16:06
EmilienMholser___: I probably missed them but in my local deployment that's the only I saw16:06
EmilienMholser___: maybe the keystone fernet token rotation thing?16:07
*** slaweq has quit IRC16:07
*** haleyb_ is now known as haleyb16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403616:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175466916:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]16:10
openstackLaunchpad bug 1754669 in tripleo "different rpm packages install are failing" [Critical,Triaged]16:10
*** slaweq__ has joined #tripleo16:12
*** slaweq__ has quit IRC16:17
holser___EmilienM - look at line 16716:18
EmilienMholser___: https://git.openstack.org/cgit/openstack/instack-undercloud/tree/instack_undercloud/undercloud.py#n190216:18
EmilienMthis is the only trigger that we created in tripleo16:19
EmilienMbut I probably missed something16:19
*** shardy has quit IRC16:19
EmilienMholser___: are you aware of another trigger?16:20
*** radeks_ has quit IRC16:20
openstackgerritMerged openstack/tripleo-validations stable/pike: Unit testing for ini  https://review.openstack.org/52702016:21
dtantsurd0ugal: hey, any opinion on https://bugzilla.redhat.com/show_bug.cgi?id=1551790 ?16:22
openstackbugzilla.redhat.com bug 1551790 in python-tripleoclient "Successful introspection notes are confusing and need to be enhanced." [Unspecified,New] - Assigned to rhos-maint16:22
*** slaweq has joined #tripleo16:23
holser___EmilienM - I don't know but the operator may create16:23
*** jpich has quit IRC16:23
holser___if we delete all we should create all, if we delete one we should create one16:23
EmilienMholser___: I'm fine with it.16:24
holser___EmilienM - let's replace 166-168  with  openstack cron trigger delete publish-ui-logs-hourly16:24
holser___and I'll be fine16:24
holser___That's only one concern I have16:24
holser___Otherwise we may delete something operator created16:25
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: undercloud_post: manage post mistral config  https://review.openstack.org/55100916:26
EmilienMholser___: done ^16:26
holser___thanks16:26
EmilienMholser___: please double check I did well16:26
* holser___ checking16:26
*** holser___ is now known as holser__16:27
*** slaweq has quit IRC16:27
*** leanderthal has quit IRC16:29
holser__EmilienM - you may also use awk ---> openstack cron trigger list | awk '/tripleo/ { print $2 }'16:29
holser__but I am fine with what we have now16:29
holser__+116:29
d0ugaldtantsur: that is the same as the lp bug you sent earlier?16:29
d0ugaldtantsur: looks like it. I couldn't figure it out16:29
d0ugalI'll need to try and take a longer look next week.16:29
dtantsurd0ugal: nope, just something weird about the way we report no-op inspection16:30
dtantsurlow priority, ignore it for now16:30
*** jpich has joined #tripleo16:32
d0ugaldtantsur: oh, I see. yeah, that is weird. I guess one message comes from the workflow and one from tripleoclient.16:32
*** slaweq has joined #tripleo16:33
*** myoung|ruck is now known as myoung|ruck|brb16:33
*** wolverineav has joined #tripleo16:34
*** bogdando has quit IRC16:34
*** pradk has quit IRC16:35
*** slaweq has quit IRC16:37
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Assignning a value to NeutronServiceName propertiy in neutron-ovs-dpdk-agent.yaml  https://review.openstack.org/55082416:38
*** wolverineav has quit IRC16:39
openstackgerritMerged openstack/tripleo-docs master: Adds FFU developer docs base - workflow and tripleo-heat-templates  https://review.openstack.org/52665616:39
openstackgerritBen Nemec proposed openstack/tripleo-repos master: Fix broken link in readme  https://review.openstack.org/55132516:40
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: FFU: Add support for panko service upgrade  https://review.openstack.org/53376416:40
*** gkadam__ has quit IRC16:42
*** slaweq has joined #tripleo16:43
*** pblaho has quit IRC16:43
*** neo_ has joined #tripleo16:44
neo_Hi16:44
neo_ways to tweak controller's OS limits [nofile,nproc] using triple o resources while deploying overcloud?16:45
mwhahahaneo_: i don't think we expose it in a general way. There are some things that are doing that so I know we have the code but we don't expose it to THT16:46
*** flepied has quit IRC16:47
*** slaweq has quit IRC16:47
*** ykarel has quit IRC16:49
EmilienMwe might need to create a blueprint for the mox removal goal16:51
*** psachin has quit IRC16:53
*** slaweq has joined #tripleo16:53
bnemecI would be shocked if there's much mox use in tripleo.16:55
EmilienMbnemec: os-net-config16:55
EmilienMhttps://review.openstack.org/#/c/550988/16:55
bnemecYeah, that's one. :-)16:56
bnemecMost of our Python code was written after the switch to mock though.16:56
bnemecI suppose it's possible the other os-*-config projects have it too.16:57
*** ebarrera has quit IRC16:57
*** slaweq has quit IRC16:58
*** Hedged-Handful has quit IRC17:00
*** lyaaaaaaaarwood is now known as lyarwood17:00
*** fzdarsky_ is now known as fzdarsky17:01
*** slaweq has joined #tripleo17:03
*** myoung|ruck|brb is now known as myoung|ruck17:06
*** marios has quit IRC17:08
*** slaweq has quit IRC17:09
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403617:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175466917:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]17:10
openstackLaunchpad bug 1754669 in tripleo "different rpm packages install are failing" [Critical,Triaged]17:10
neo_thanks +mwhahaha17:10
*** egallen has quit IRC17:10
*** gvrangan_ has joined #tripleo17:10
*** jfrancoa has quit IRC17:13
*** slaweq has joined #tripleo17:14
neo_Is it possible to change MariaDb configuration on controllers using triple O resources? eg:innodb_buffer_pool_size=2048M,innodb_additional_mem_pool_size=400M,innodb_log_file_size=25M,innodb_log_buffer_size=80M17:16
*** gvrangan_ has quit IRC17:17
neo_I am trying same things with haproxy,rabbitmq and Openstack services (nova.conf,neutron.conf and keystone.conf)17:18
*** slaweq has quit IRC17:19
openstackgerritAlex Schultz proposed openstack/instack-undercloud stable/ocata: Fix bootstrap NAT  https://review.openstack.org/55133517:21
neo_Any inputs from triple O contributors will be useful17:23
*** slaweq has joined #tripleo17:24
*** jpich has quit IRC17:24
*** jtomasek has quit IRC17:24
*** slagle has quit IRC17:26
*** slagle has joined #tripleo17:27
*** jlabarre has joined #tripleo17:27
*** holser__ has quit IRC17:28
mwhahahaneo_: so it depends, you'd have to look into the puppet-tripleo and tripleo-heat-templates to see if we expose anything you want to configure17:28
mwhahahaneo_: for openstack services if it's not exposed, you can override stuff with hieradata as needed17:28
*** slaweq has quit IRC17:28
*** radeks_ has joined #tripleo17:28
neo_Thanks @mwhahaha will look into puppet-tripleO17:30
*** dtantsur is now known as dtantsur|afk17:30
*** radeks has quit IRC17:32
*** yprokule has quit IRC17:33
*** slaweq has joined #tripleo17:34
openstackgerritAlex Schultz proposed openstack/instack-undercloud stable/newton: Fix bootstrap NAT  https://review.openstack.org/55134017:35
openstackgerritAlex Schultz proposed openstack/instack-undercloud stable/newton: Fix bootstrap NAT  https://review.openstack.org/55134017:35
*** slaweq has quit IRC17:39
*** trown|rover is now known as trown|lunch17:41
*** slaweq has joined #tripleo17:44
*** florianf has quit IRC17:45
EmilienMgate is back17:46
EmilienMpeople can do recheck17:46
*** stevebaker has quit IRC17:46
*** EmilienM changes topic to "Welcome to Rocky. CI status: Promotions - GREENish check/gate - GREEN | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/"17:46
*** slaweq has quit IRC17:49
*** derekh has quit IRC17:50
*** stevebaker has joined #tripleo17:50
*** slaweq has joined #tripleo17:54
*** slaweq has quit IRC17:59
*** gfidente has quit IRC18:00
*** stevebaker has quit IRC18:00
*** lucasagomes is now known as lucas-afk18:01
*** egallen has joined #tripleo18:04
*** jmelvin has quit IRC18:04
*** slaweq has joined #tripleo18:05
*** stevebaker has joined #tripleo18:05
*** pkovar has quit IRC18:06
*** slagle has quit IRC18:06
*** agopi has quit IRC18:07
*** slaweq has quit IRC18:10
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403618:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175466918:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]18:10
openstackLaunchpad bug 1754669 in tripleo "different rpm packages install are failing" [Critical,Triaged]18:10
*** myoung|ruck is now known as myoung|afk18:10
openstackgerritOpenStack Release Bot proposed openstack/tripleo-upgrade stable/queens: Update .gitreview for stable/queens  https://review.openstack.org/55134618:10
openstackgerritOpenStack Release Bot proposed openstack/tripleo-upgrade stable/queens: Update UPPER_CONSTRAINTS_FILE for stable/queens  https://review.openstack.org/55134718:10
openstackgerritOpenStack Release Bot proposed openstack/tripleo-upgrade master: Update reno for stable/queens  https://review.openstack.org/55134818:10
*** myoung|alt has joined #tripleo18:12
EmilienMchem: tripleo-upgrade is branched!18:12
*** matyoung has joined #tripleo18:14
*** matyoung is now known as myoung|ruck|afk18:14
*** slaweq has joined #tripleo18:15
*** jmelvin has joined #tripleo18:15
*** myoung|alt has quit IRC18:15
*** myoung|afk has quit IRC18:15
*** fragatina has quit IRC18:16
*** dmellado has quit IRC18:16
*** stevebaker has quit IRC18:17
*** slaweq has quit IRC18:19
*** wolverineav has joined #tripleo18:21
*** stevebaker has joined #tripleo18:21
*** dmsimard is now known as dmsimard|afk18:25
*** slaweq has joined #tripleo18:25
openstackgerritMerged openstack/instack-undercloud master: Only delete and re-create managed Mistral workflows  https://review.openstack.org/54747418:26
*** jbadiapa has quit IRC18:27
*** slaweq has quit IRC18:30
*** wolverineav has quit IRC18:30
*** wolverineav has joined #tripleo18:31
*** wolverineav has quit IRC18:34
*** wolverineav has joined #tripleo18:34
*** slaweq has joined #tripleo18:35
*** trown|lunch is now known as trown|rover18:39
*** slaweq has quit IRC18:40
*** dmellado has joined #tripleo18:42
*** slagle has joined #tripleo18:42
*** slaweq has joined #tripleo18:45
*** dmacpher__ has joined #tripleo18:46
openstackgerritMerged openstack/puppet-tripleo stable/pike: Fix stack update with rabbitmq containers  https://review.openstack.org/55074318:47
openstackgerritMerged openstack/tripleo-upgrade master: Fix non working repo upgrade command for ffu.  https://review.openstack.org/55047818:47
openstackgerritMerged openstack/tripleo-upgrade stable/queens: Update .gitreview for stable/queens  https://review.openstack.org/55134618:47
openstackgerritMerged openstack/tripleo-upgrade stable/queens: Update UPPER_CONSTRAINTS_FILE for stable/queens  https://review.openstack.org/55134718:47
openstackgerritMerged openstack/tripleo-upgrade master: Update reno for stable/queens  https://review.openstack.org/55134818:47
*** dmacpher_ has quit IRC18:49
*** ykarel has joined #tripleo18:49
*** athomas has quit IRC18:49
*** slaweq has quit IRC18:50
*** itlinux has quit IRC18:50
*** dprince has quit IRC18:54
*** slaweq has joined #tripleo18:55
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: [CVE-2018-1000115] memcached: restrict to TCP & localhost  https://review.openstack.org/55135318:56
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: [CVE-2018-1000115] memcached: restrict to TCP & localhost  https://review.openstack.org/55135319:00
*** slaweq has quit IRC19:00
EmilienMamoralej: ovb jobs fail19:01
EmilienMI wonder if it's the same mirror issue19:01
*** psachin has joined #tripleo19:01
amoralejlogs?19:01
EmilienMtrown|rover: ^19:01
EmilienMlet me look19:01
amoralejyou mean periodic?19:01
amoralejor gate jobs?19:01
EmilienMno logs19:02
EmilienMgate19:02
EmilienMhttps://logs.rdoproject.org/92/551292/1/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z3479eb7ed40b49da8c744116d1ed9a42/19:02
EmilienMhttps://logs.rdoproject.org/92/551292/1/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z3479eb7ed40b49da8c744116d1ed9a42/console.txt.gz#_2018-03-09_16_26_17_50219:02
EmilienMsounds like it failed to get env19:02
* EmilienM bbl dinner19:03
*** tesseract has quit IRC19:05
*** slaweq has joined #tripleo19:06
trown|roverEmilienM: ya I think something is going on with rdocloud atm19:06
*** salmankhan has quit IRC19:06
trown|roveror at least was a couple hours ago... seems like it might be ok right this second19:07
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: zuul: do not run containerized undercloud  https://review.openstack.org/55102219:09
mwhahahalooks like there was some network event ~2 hours ago or so19:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403619:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175466919:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]19:10
openstackLaunchpad bug 1754669 in tripleo "different rpm packages install are failing" [Critical,Triaged]19:10
*** radeks_ has quit IRC19:10
*** slaweq has quit IRC19:10
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: undercloud: enable only metadata cleaning  https://review.openstack.org/55124019:11
mwhahahaactually everything is queued in rdocloud19:11
mwhahahatrown|rover, myoung|ruck|afk: https://review.rdoproject.org/zuul/ things are just stuck in queued19:11
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Run ovb-ha (fs001) with a containerized undercloud  https://review.openstack.org/54255619:11
*** radeks has joined #tripleo19:12
trown|roverhmm... i have no idea how to fix that19:12
* mwhahaha plays the dmsimard|afk summon card19:12
trown|rovernot enough mana, need to wait a few turns19:12
mwhahahapretty much19:13
*** wolverineav has quit IRC19:14
*** wolverineav has joined #tripleo19:14
EmilienMI have mana19:15
*** slaweq has joined #tripleo19:16
EmilienMnobody else but dmsimard|afk has access to that?19:18
EmilienMamoralej: ^19:18
mwhahahano idea who has access to the zuul stuff19:18
mwhahahaor the knowledge19:18
* mwhahaha just knows he doesn't19:18
amoralejwhat's the problem19:18
amoralejlet me check19:18
*** wolverineav has quit IRC19:18
mwhahahaamoralej: things are just stuck in queued19:19
EmilienMamoralej: jobs look stuck in queue19:19
*** slaweq has quit IRC19:21
amoralejproblems creating instances in rdo-cloud19:21
amoralejBuild of instance b3489c5c-f27a-4365-8c24-65555a55cebe aborted: Failed to allocate the network(s), not rescheduling.19:23
amoralejEmilienM, mwhahaha ^19:23
amoraleji don't have access to the tenant19:23
mwhahahatrown|rover: do you?19:23
trown|rovermwhahaha: I think so, but I dont know what to do with it19:25
mwhahahai wonder if we have a bunch of stuff stuck in deleting19:26
mwhahahaor something19:26
*** slaweq has joined #tripleo19:26
*** wolverineav has joined #tripleo19:28
trown|rovermwhahaha: amoralej is asking ops folks about it19:30
*** slaweq has quit IRC19:31
trown|roverlooking on the tenant it is just a bunch of instances stuck in spawning19:31
*** wolverineav has quit IRC19:34
*** fragatina has joined #tripleo19:36
*** slaweq has joined #tripleo19:36
*** ykarel has quit IRC19:38
*** slaweq has quit IRC19:41
chemEmilienM: that will be the good new  of the day.  Thanks.19:51
*** chem is now known as chem|eow19:51
*** sshnaidm|afk has joined #tripleo19:51
*** sshnaidm|afk has quit IRC19:52
amoralejEmilienM, mwhahaha dmanchad is checking19:53
amoraleji need to leave now19:53
mwhahahak19:53
*** sshnaidm|afk has joined #tripleo19:53
*** amoralej is now known as amoralej|off19:54
*** slaweq has joined #tripleo19:57
*** wolverineav has joined #tripleo19:58
*** slaweq has quit IRC20:01
*** tzumainn has quit IRC20:01
*** wolverineav has quit IRC20:03
*** slaweq__ has joined #tripleo20:07
*** tosky has quit IRC20:07
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403620:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175466920:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]20:10
openstackLaunchpad bug 1754669 in tripleo "different rpm packages install are failing" [Critical,Triaged]20:10
*** tosky has joined #tripleo20:10
*** jtomasek has joined #tripleo20:12
*** slaweq__ has quit IRC20:12
openstackgerritGonéri Le Bouder proposed openstack/tripleo-quickstart-extras master: pass the fine input to subunit2junitxml  https://review.openstack.org/55136420:13
*** itlinux_ has joined #tripleo20:14
*** jtomasek has quit IRC20:15
*** slaweq__ has joined #tripleo20:17
*** jtomasek has joined #tripleo20:19
*** jtomasek has quit IRC20:20
*** threestrands has joined #tripleo20:22
*** threestrands has quit IRC20:22
*** threestrands has joined #tripleo20:22
*** slaweq__ has quit IRC20:22
openstackgerritRajini Karthik proposed openstack/tripleo-heat-templates master: Add support for Dell EMC XtremIO Cinder ISCSI Backend  https://review.openstack.org/54408720:27
*** slaweq has joined #tripleo20:27
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: neutron: Call destroy-patch-ports before starting ovs-agent  https://review.openstack.org/51935420:28
*** ihrachys has quit IRC20:29
*** ihrachys_ has joined #tripleo20:29
*** slaweq has quit IRC20:32
*** wolverineav has joined #tripleo20:33
*** sl0w has quit IRC20:33
*** pchavva has quit IRC20:34
mwhahahareported bug on the rdo ci issues, https://bugs.launchpad.net/tripleo/+bug/175475520:35
openstackLaunchpad bug 1754755 in tripleo "RDO CI jobs queued because instances are not spawning in RDO Cloud" [Critical,Triaged]20:35
*** Sl0w has joined #tripleo20:35
trown|roverthanks mwhahaha20:35
*** itlinux_ has quit IRC20:35
*** slaweq has joined #tripleo20:36
*** psachin has quit IRC20:38
*** itlinux has joined #tripleo20:38
*** jabadia has joined #tripleo20:42
*** raildo has quit IRC20:42
*** itlinux has quit IRC20:43
*** jtomasek has joined #tripleo20:44
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade stable/queens: Fix non working repo upgrade command for ffu.  https://review.openstack.org/55136820:49
*** bfournie1 has quit IRC21:00
*** bfournie has joined #tripleo21:00
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Fix overcloud_nodes check failing branch FF  https://review.openstack.org/55136921:01
*** moshele has joined #tripleo21:02
*** abishop_ has quit IRC21:03
openstackgerritBrent Eagles proposed openstack/puppet-tripleo master: Adding wrapper scripts for neutron agent subprocesses  https://review.openstack.org/55022421:04
*** thrash is now known as thrash|g0ne21:04
*** abishop has joined #tripleo21:05
*** bfournie has quit IRC21:05
*** abishop has quit IRC21:08
*** abishop has joined #tripleo21:09
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403621:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]21:10
*** radeks has quit IRC21:10
*** moshele has quit IRC21:11
EmilienMtrown|rover, mwhahaha: I added 'alert' tag to https://bugs.launchpad.net/tripleo/+bug/175475521:11
openstackLaunchpad bug 1754755 in tripleo "RDO CI jobs queued because instances are not spawning in RDO Cloud" [Critical,Triaged]21:11
ihrachys_EmilienM, I think I know the answer but still checking - does tripleo have any tests for scenarios like service state changes (start / stop / restart)?21:11
EmilienMdmanchad: you around?21:12
mwhahahaoh i knew i was forgetting a tag21:12
mwhahahaEmilienM: he said kforde was going to keep poking at it21:12
mwhahahathink he's off21:12
EmilienMihrachys_: I'm glad you think I know the answer because I knew you would think that I knew the answer21:12
EmilienMihrachys_: and I'm sad to tell you the answer21:12
ihrachys_haha :)21:12
EmilienMbut no, we don't have these kind of tests21:12
EmilienMBUT I think this would be really good to have.21:13
ihrachys_yeah. it's not like we cover our side in neutron either (we have tests for ovs agent restarts only)21:13
ihrachys_but nothing for dhcp agent or l3 agent21:14
ihrachys_so we are going to look into that. of course tripleo would need its own tests because of containers etc.21:14
EmilienMthe question is21:14
EmilienMwhat do you want to test exactly21:14
EmilienMI can produce a restart now if you like21:14
EmilienMbut during the restart, we need to test things, no?21:14
EmilienMlike traffic, etc21:14
ihrachys_yes. that's what we do in neutron tests for ovs agent, we run ping in background. we would need to do the same for other agents, and in tripleo context.21:15
ihrachys_well, for dhcp agent it would be not ping but dhclient21:15
ihrachys_ok thanks for the answers. it's our QE asking if it's covered anywhere, I will update them about the sad state.21:15
EmilienMthe problem, imho, is the scale of our testing infra21:16
EmilienMeven if we spawn a VM, run a ping21:16
ihrachys_I would be happy to tell you we are going to look into it but I doubt it.21:16
EmilienMthe agent restart will be fast because it's a small infra, small db, etc21:16
EmilienMthe test would be nice if the db was realistic, with a lot of ports, routers, etc21:16
mwhahahawe might have reboot tests somewhere21:16
mwhahahabut not likely in CI today21:16
EmilienMto me, we should have a periodic job, running in a 20 nodes deployments for ex21:17
EmilienMand run something like Rally21:17
EmilienM+ some restart/reboot tests21:17
ihrachys_yeah, resync may take a while. but first step is just checking that agents down don't disrupt existing wiring21:17
EmilienMindeed21:17
EmilienMis there an existing tool in openstack that does it?21:18
ihrachys_which I think they don't in neutron context, but with containers debacle it got in focus again21:18
EmilienMbecause it's "easily" (tm) scriptable otherwise21:18
ihrachys_no tool that I know of, but in neutron we have fullstack testing framework that allows us to manipulate agents21:18
EmilienMok21:18
EmilienMin our case, a "docker restart neutron_api" (on the right host) would restart neutron-server21:19
ihrachys_it looks like https://github.com/openstack/neutron/blob/master/neutron/tests/fullstack/test_connectivity.py#L24621:19
ihrachys_EmilienM, right, there is no way out of implementing the tests on tripleo side (too)21:19
EmilienMcool21:19
EmilienMso in the case of a single node deployment, like we have in gate now, we could easily run this script if it supported docker21:19
EmilienMimho we could even run your test21:19
EmilienMwe just need to add docker support21:20
EmilienMbecause our overcloud is a single node, so no need to take care of "where neutron is running", we can predict that21:20
ihrachys_not sure it's easily reusable, it's tailored for neutron; it's not a tempest or smth.21:21
mcorneaEmilienM: ihrachys_ I think we have sometehing like that available in tripleo-upgrade where we test the floating ip reachability during upgrade when we bring down the agents21:21
EmilienMwoot21:22
EmilienMsee we have everything, just ask :D21:22
*** threestrands has quit IRC21:22
ihrachys_heh. mcornea reference to github or smth?21:23
mcorneahttps://github.com/openstack/tripleo-upgrade/blob/master/templates/l3_agent_start_ping.sh.j221:23
mcorneahttps://github.com/openstack/tripleo-upgrade/blob/master/templates/l3_agent_stop_ping.sh.j221:23
mcorneaand we run these scripts before/after upgrade steps21:23
ihrachys_mcornea, that's nice.21:24
ihrachys_"Ping loss higher than 1% detected"21:25
ihrachys_how long does the check run?21:25
*** chem|eow has quit IRC21:25
mcorneaas long as the upgrade step take, for our usual testing topologies usually around 1h21:26
bnemecHeh, m|eow21:26
ihrachys_mcornea, so this allows for e.g. 36 seconds window of broken connectivity. correct?21:26
EmilienMI'm surprised we didn't use YAQL21:27
* EmilienM friday troll21:27
mcorneaihrachys_: yes21:27
mcorneaihrachys_: our tests showed sporadic such loss so we added this accepted error rate to avoid jobs failure21:29
ihrachys_mcornea, thanks for the reference. very helpful.21:29
*** abishop_ has joined #tripleo21:30
ihrachys_mcornea, another thing worth checking would be reboot a pre-created instance and checking we can get into it via ssh21:30
ihrachys_over and over21:30
*** jabadia has quit IRC21:31
*** abishop has quit IRC21:32
mcorneaihrachys_: so during upgrade do nova reboot, wait for it to come back online and check ssh to the instance works?21:32
mcorneaihrachys_: or reboot via ssh from inside instance? because during upgrade we bring down the api21:33
ihrachys_mcornea, just killing instance would work, by any means21:37
ihrachys_if api is not there, then reboot from inside the instance would be ok21:38
mcorneaihrachys_: cool, I'll add this to my to do list21:38
ihrachys_we could also use virsh to kill it but it would probably be harder to pull21:38
openstackgerritMerged openstack/tripleo-image-elements master: Add another path for service files  https://review.openstack.org/53961921:40
*** jtomasek has quit IRC21:42
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/queens: [CVE-2018-1000115] memcached: restrict to TCP & internal_api network  https://review.openstack.org/55138021:43
*** paramite has joined #tripleo21:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: [CVE-2018-1000115] memcached: restrict to TCP & internal_api network  https://review.openstack.org/55138221:46
*** slaweq has quit IRC21:49
*** slaweq has joined #tripleo21:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: [CVE-2018-1000115] memcached: restrict to TCP & internal_api network  https://review.openstack.org/55138521:51
*** trown|rover is now known as trown|outtypewww21:52
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/newton: [CVE-2018-1000115] memcached: restrict to TCP & internal_api network  https://review.openstack.org/55138721:53
openstackgerritEmilien Macchi proposed openstack/instack-undercloud stable/queens: [CVE-2018-1000115] memcached: restrict to TCP & localhost  https://review.openstack.org/55138821:53
openstackgerritEmilien Macchi proposed openstack/instack-undercloud stable/pike: [CVE-2018-1000115] memcached: restrict to TCP & localhost  https://review.openstack.org/55138921:54
openstackgerritEmilien Macchi proposed openstack/instack-undercloud stable/ocata: [CVE-2018-1000115] memcached: restrict to TCP & localhost  https://review.openstack.org/55139021:54
openstackgerritEmilien Macchi proposed openstack/instack-undercloud stable/newton: [CVE-2018-1000115] memcached: restrict to TCP & localhost  https://review.openstack.org/55139321:55
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403622:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175475522:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1754755 in tripleo "RDO CI jobs queued because instances are not spawning in RDO Cloud" [Critical,Triaged]22:10
*** rfolco has quit IRC22:13
*** mcornea has quit IRC22:15
bnemecError: Evaluation Error: Error while evaluating a Resource Statement, Duplicate declaration: Keepalived::Instance[55] is already declared in file /etc/puppet/modules/tripleo/manifests/keepalived.pp:190; cannot redeclare at /etc/puppet/modules/tripleo/manifests/keepalived.pp:190 at /etc/puppet/modules/tripleo/manifests/keepalived.pp:190:7 on node overcloud-controller-0.localdomain22:24
bnemecThat is incredibly unhelpful.22:24
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: ironic-conductor: mount /var/lib/config-data/ironic_conductor/  https://review.openstack.org/55139822:24
EmilienMmwhahaha: I'm not sure but that might be that ^22:24
*** jmelvin has quit IRC22:24
EmilienMbnemec: which patch?22:24
bnemecEmilienM: I'm seeing that just trying to run a basic deployment locally.22:25
EmilienMmhh22:25
*** rbowen has quit IRC22:25
mwhahahabnemec: did you add another vip?22:25
*** rbowen has joined #tripleo22:26
mwhahahai think the numbering scheme is hard coded22:26
EmilienMit is22:26
EmilienMbnemec: your error is helpful in fact22:26
bnemecNot to me. :-P22:26
EmilienMit means a resource in puppet-tripleo overlaps with the same resource in puppet-keepalived22:26
EmilienMerr no22:27
*** sanjayu has quit IRC22:27
EmilienMit means puppet-tripleo tries to create 2 times the same resource22:27
mwhahahayea that code is scarey22:27
EmilienMso yeah, probably some hiera thing22:27
bnemecOh, duplicate indexes: http://paste.openstack.org/show/697081/22:27
mwhahahahttps://github.com/openstack/puppet-tripleo/blob/master/manifests/keepalived.pp#L17922:27
EmilienMdon't git blame plz22:27
*** Goneri has quit IRC22:27
bnemeclol22:27
EmilienMI was young22:27
EmilienMand innocent22:27
mwhahahasomeone else did this puppet4 specific stuff22:28
bnemecI bet this is because I use custom network config.22:28
*** Goneri has joined #tripleo22:28
* bnemec does not look forward to digging into networking again22:29
EmilienMbnemec: wait for ansible22:29
bnemecEmilienM: Because I'll run into different bugs then? ;-)22:30
mwhahahabnemec: your indexes need to be unique22:30
mwhahahabnemec: you have them set to 122:30
mwhahahahttp://paste.openstack.org/show/697081/22:30
bnemecI didn't set them at all.  I have no idea where that's coming from.22:30
mwhahaha*magic*22:30
*** panda is now known as panda|off22:31
EmilienMhttp://my1.fr/files/emilien-right-now.jpg22:31
mwhahahaso that's the brokenness22:31
mwhahahacause they need to be 1,2,322:31
bnemecYeah22:31
bnemecI feel like this is a bug though.  This exact configuration worked a few weeks ago.22:31
mwhahahaprobably related to the network refactoring22:32
EmilienMwell it works in tripleo-ci (tm)22:32
mwhahahai think someone already reported this bug (or what it you)22:32
bnemecAh, no it wasn't me.22:32
bnemecYup: https://bugs.launchpad.net/tripleo/+bug/175467922:32
openstackLaunchpad bug 1754679 in tripleo "Duplicate declaration: Keepalived::Instance[55]" [Undecided,New]22:32
EmilienMUntriagged????22:33
bnemecEmilienM: *shifty eyes* I don't know what you mean...22:33
mwhahahahttp://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/puppet/all-nodes-config.j2.yaml#n18222:34
mwhahahait's in all-nodes-config.j2.yaml22:34
mwhahahadat jinja222:34
bnemecWCPGW?22:34
EmilienMwe need YAQL22:34
EmilienMYAQL + jinja to generate hieradata run by ansible22:34
bnemecWell, that answers my question. :-P22:34
EmilienMprocessed by heat-engine22:35
EmilienMin a container22:35
bnemecLive webcam of EmilienM: https://goo.gl/images/nMjVsM22:36
bnemec:-D22:36
*** jmelvin has joined #tripleo22:36
EmilienMlol22:36
EmilienMwell I might be a troll22:37
EmilienMbut i'm here to fix things sometimes :P22:37
bnemecI'm here to report broken things sometimes, so that works out.22:37
bnemecI'm idly curious how this isn't breaking ci.22:38
EmilienM:P22:38
bnemecI think it uses the same network templates I do.22:38
bnemecUnless the ovb jobs have just been so broken that nobody noticed this particular breakage.22:38
* bnemec is not sure since they don't seem to be tracked anywhere AFAHCT22:39
mwhahahathis was committed back in january22:40
mwhahahaso22:40
mwhahahasomething else broke it22:40
mwhahahahttps://github.com/openstack/tripleo-heat-templates/commit/749a99a5cd53d4c5308e38f97f6d2d1439a262ad22:40
bnemecOh good, so it could be anything that merged in the last three weeks. :-)22:40
mwhahahawait i always forget the date goes by the commit date not merge22:41
* mwhahaha pulls up the change22:41
mwhahahahttps://review.openstack.org/#/c/531036/22:41
mwhahahano it was merged 8 weeks ago22:41
mwhahahanow i had a change to tripleo::keepalive22:42
mwhahahahttps://github.com/openstack/puppet-tripleo/commit/e083f248a920ba067424f7fa1353e61ff234d6bd22:42
mwhahahabut that didn't change the indexing part22:42
* EmilienM wishes everyone a good weekend and disappears magically22:42
mwhahahaQUITER22:42
bnemecNo, it's the hieradata that's broken.  Looks like the keepalived module is doing the right thing.22:43
mwhahahak22:43
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: Fix typo in network templates  https://review.openstack.org/55140222:43
* bnemec clicks22:43
bnemecSounds promising :-)22:43
bnemecNope :-(22:44
mwhahahabet it some dependency change22:45
mwhahahalike jinja is no longer allowing for the varilable updates22:46
mwhahahaor something stupid like that22:46
bnemec\o/ functional programming!22:46
mwhahahabecause templates are awesome22:46
* mwhahaha also gives up for the week22:47
bnemecMaybe it will magically fix itself over the weekend.22:50
* bnemec heads off to play in the snow and drink Irish whiskey22:52
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: FFU upgrade issue with the release loop var.  https://review.openstack.org/54903522:53
* bnemec notes that that's pretty much what he did last weekend too22:55
*** cdearborn_ has joined #tripleo22:58
*** sanjayu has joined #tripleo22:59
*** cdearborn has quit IRC23:02
*** cdearborn_ has quit IRC23:02
*** paramite has quit IRC23:08
*** rlandy has quit IRC23:10
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403623:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175475523:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]23:10
openstackLaunchpad bug 1754755 in tripleo "RDO CI jobs queued because instances are not spawning in RDO Cloud" [Critical,Triaged]23:10
*** slaweq has quit IRC23:33
*** slaweq has joined #tripleo23:34
*** slaweq has quit IRC23:39
*** liverpooler has quit IRC23:49

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!